mirar.pipelines.sedmv2 package

Module containing all relevant scripts for reducing photometric data from the Spectral Energy Distribution Machine v2 (SEDMv2)

Subpackages

Submodules

mirar.pipelines.sedmv2.blocks module

Script containing the various BaseProcessor lists which are used to build configurations for the SEDMv2Pipeline.

mirar.pipelines.sedmv2.generator module

Module containing functions to generate astrometric/photometric calibration catalogs for SEDMv2

mirar.pipelines.sedmv2.generator.sedmv2_astrometric_catalog_generator(image: Image) → Gaia2Mass[source]

Returns an astrometric catalog for sedmv2, either Gaia or 2MASS

Parameters:

image – image to generate a catalog for

Returns:

Gaia/2MASS catalog around image

mirar.pipelines.sedmv2.generator.sedmv2_color_function_ps1(image: Image) → tuple[tuple[str, str], tuple[str, str], tuple[float, float]][source]
Args:

image: Image object undergoing photometric calibrations

Returns:

color_filts: the two PS1 columns that define color term color_errs: the two PS1 columns with associated errors firstguess_color_zp: first guess at color and zeropoint (constant for sedmv2)

mirar.pipelines.sedmv2.generator.sedmv2_photcal_catalog_purifier(sci_catalog: Table, ref_catalog: Table, image: Image, stargal_threshold: float = 0.5) → tuple[Table, Table][source]
To hand to PhotCalibrator catalogs_purifier;
purifies science catalog by removing:

sources with nonzero Sextractor FLAGS sources with PSF mag = -99 sources near edge of image

purifies reference catalog by removing:

sources with 0 reported error sources that are likely galaxies according to PS1StarGal ‘psScore’

Parameters:

  • sci_catalog – SEDMv2 Sextractor catalog

  • ref_catalog – reference catalog

  • image – SEDMv2 Image object

Returns:

purified sci_ and ref_ catalogs

mirar.pipelines.sedmv2.generator.sedmv2_photometric_catalog_generator(image: Image) → BaseCatalog[source]

Generate a photometric calibration catalog for sedmv2 images

For u band: SDSS if possible, otherwise Skymapper (otherwise fail) For g/r/i/z: use PS1StarGal

Parameters:

image – Image

Returns:

catalog at image position

mirar.pipelines.sedmv2.generator.sedmv2_reference_image_generator(image: Image) → BaseReferenceGenerator[source]

Get a reference image generator for an sedmv2 image

For u band: SDSS if possible, otherwise fail For g/r/i/z: use PS1

Parameters:

image – image

Returns:

Reference image generator

mirar.pipelines.sedmv2.generator.sedmv2_reference_image_resampler(**kwargs) → Swarp[source]

Generates a resampler for reference images

Parameters:

kwargs – kwargs

Returns:

Swarp processor

mirar.pipelines.sedmv2.generator.sedmv2_reference_psfex(output_sub_dir: str, norm_fits: bool) → PSFex[source]

Generates a PSFex processor for reference images

Parameters:

  • output_sub_dir – output sui directory

  • norm_fits – boolean

Returns:

Sextractor processor

mirar.pipelines.sedmv2.generator.sedmv2_reference_sextractor(output_sub_dir: str) → Sextractor[source]

Generates a sextractor processor for reference images

Parameters:

  • output_sub_dir – output sub directory

  • gain – gain of image

Returns:

Sextractor processor

mirar.pipelines.sedmv2.generator.sedmv2_zogy_catalogs_purifier(sci_catalog: Table, ref_catalog: Table) → tuple[ndarray, ndarray][source]

To hand to ZOGY catalogs_purifier

Parameters:

  • sci_catalog – SEDMv2 Sextractor catalog

  • ref_catalog – reference catalog

Returns:

good source indices for sci_ and ref_ catalogs

mirar.pipelines.sedmv2.load_sedmv2_image module

Module for loading raw SEDMv2 images and ensuring they have the correct format

mirar.pipelines.sedmv2.load_sedmv2_image.clean_cal_header(hdr0: Header, split_headers: list[Header], filepath, is_mode0: bool) → tuple[Header, list[Header]][source]

function to modify the primary header of an SEDMv2 calibration file (flat or bias or dark) :param hdr0: original primary header of calibration file :param hdr1: original secondary header of calibration file :return: modified headers

mirar.pipelines.sedmv2.load_sedmv2_image.clean_science_header(header: Header, split_headers: list[Header], is_mode0: bool) → tuple[Header, list[Header]][source]

function to modify the primary header of an SEDMv2 science file :param header: original primary header of science file :param split_headers: the remaining headers, one for each extension of MEF :param is_mode0: True if observed in SEDMv2 observation mode 0 :return: modified primary header

mirar.pipelines.sedmv2.load_sedmv2_image.date_obs_to_mjd(t_raw: str) → str[source]

function to convert DATE-OBS from raw SEDMv2 headers into MJD :param t_raw: date from SEDMv2 header :return: time in MJD example: 20230609_102119.377549 -> 60104.43147427719

mirar.pipelines.sedmv2.load_sedmv2_image.load_raw_sedmv2_mef(path: str | Path) → tuple[Header, list[array], list[Header]][source]

Load mef image

mirar.pipelines.sedmv2.load_sedmv2_image.load_sedmv2_mef_image(path: str | Path) → list[Image][source]

Function to load sedmv2 mef images :param path: Path to image :return: list of images

mirar.pipelines.sedmv2.sedmv2_pipeline module

Module to run the SEDMv2 data reduction pipeline

class mirar.pipelines.sedmv2.sedmv2_pipeline.SEDMv2Pipeline(selected_configurations: str | list[str] = 'default', night: int | str = '')[source]

Bases: Pipeline

Class to run SEDMv2 data reduction pipeline

all_pipeline_configurations = {'default': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.header_annotate.HeaderEditor object>], 'default_stellar': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.header_annotate.HeaderEditor object>, <mirar.processors.sources.forced_photometry.ForcedPhotometryDetector object>, <mirar.processors.photometry.aperture_photometry.AperturePhotometry object>, <mirar.processors.sources.source_exporter.SourceWriter object>], 'default_transient': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.header_annotate.HeaderEditor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.sources.forced_photometry.ForcedPhotometryDetector object>, <mirar.processors.photometry.psf_photometry.PSFPhotometry object>, <mirar.processors.sources.source_exporter.SourceWriter object>], 'psf_all_then_calibrate': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>], 'realtime': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>], 'transient_PSF': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.reference.ProcessReference object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.zogy.zogy.ZOGYPrepare object>, <mirar.processors.zogy.zogy.ZOGY object>, <mirar.processors.sources.forced_photometry.ForcedPhotometryDetector object>, <mirar.processors.photometry.psf_photometry.PSFPhotometry object>, <mirar.processors.sources.source_exporter.SourceWriter object>], 'transient_PSF_nocolor': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.reference.ProcessReference object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.zogy.zogy.ZOGYPrepare object>, <mirar.processors.zogy.zogy.ZOGY object>, <mirar.processors.sources.forced_photometry.ForcedPhotometryDetector object>, <mirar.processors.photometry.psf_photometry.PSFPhotometry object>, <mirar.processors.sources.source_exporter.SourceWriter object>], 'transient_upload': [<mirar.processors.utils.image_loader.MEFLoader object>, <mirar.processors.mask.MaskPixelsFromPath object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.bias.BiasCalibrator object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.dark.DarkCalibrator object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.flat.FlatCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.utils.image_selector.ImageSelector object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.astromatic.sextractor.background_subtractor.SextractorBkgSubtractor object>, <mirar.processors.astrometry.anet.anet_processor.AstrometryNet object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.utils.image_selector.ImageDebatcher object>, <mirar.processors.utils.image_selector.ImageBatcher object>, <mirar.processors.astromatic.swarp.swarp.Swarp object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.astromatic.sextractor.sextractor.Sextractor object>, <mirar.processors.photcal.photcalibrator.PhotCalibrator object>, <mirar.processors.utils.image_saver.ImageSaver object>, <mirar.processors.utils.header_annotate.HeaderEditor object>, <mirar.processors.astromatic.psfex.psfex.PSFex object>, <mirar.processors.sources.forced_photometry.ForcedPhotometryDetector object>, <mirar.processors.photometry.psf_photometry.PSFPhotometry object>, <mirar.processors.sources.source_exporter.SourceWriter object>, <mirar.processors.skyportal.skyportal_source.SkyportalSourceUploader object>]}
default_cal_requirements = [<mirar.processors.utils.cal_hunter.CalRequirement object>]
static download_raw_images_for_night(night: str | int)[source]

Function to download images from a remote server

Parameters:

night – Night of data to download

Returns:

None

name = 'sedmv2'
non_linear_level = 30000