astro.recipes.mods package

Submodules

astro.recipes.mods.OptionsParser module

Simple options parser, meant to parse arguments to tasks

astro.recipes.mods.Pipeline module

Definition of pipelines, used to send jobs to the Distributed Processing Unit.

A job for the DPU is a dictionary:

job = {} job[‘DPU_MODE’] = one of “IND”, “SEQ”, “SYN” job[‘DPU_JOBS’] = [list of Task instances] job[‘DPU_NAME’] = dpu.hpc.rug.astro-wise.org job[‘DPU_TIME’] = <expected processsing time>

In this code a list of these dictionaries is sent in one command to the DPU. Depending on the mode specified in the dictionary different things happen:

Is this (below) how it works?

IND: Job does not wait for anything, is not waited on SEQ: Job waits for the immediate previous job to finish SYN: Job waits for all previous SEQ jobs to finish

[{IND}, {IND}, {IND}, {SEQ}] = everything runs immediately? [{SEQ}, {SEQ}, {SEQ}, {SEQ}] = one job at a time, from left to right [{SEQ}, {SEQ}, {SYN}, {SEQ}] = also goes one job at a time left to right

Note that whithin each dictionary, the DPU_JOBS list is assumed to be “IND”.

There are several levels of parallelization:

  • Options are duplicated
    (depending on their value and the Pipeline they are meant for)
  • Tasks are organized to run IND, SEQ or SYN
    (depends on sequence, length=1 may run IND, even if normally they are SEQ)
  • Tasks are grouped to be sent in groups of size “processes_per_node”
  • Composite tasks may be used to optimize data flow
  • Composite task only comes into play when task_sequences have length>1 * In this case the CompositeTask class may be used * … and sometimes it is not

— Missing is a balancing routine (present in old version) e.g. it is better to split 4 jobs as 2,2 than as 3,1.

class astro.recipes.mods.Pipeline.BDSMPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'f-BDSM': (<class 'astro.recipes.BDSM.BDSMTask'>, 'SEQ'), 'py-BDSM': (<class 'astro.recipes.pyBDSM.pyBDSMTask'>, 'SEQ')}
single_node_tasks = []
task_sequences = {'BDSM': ['f-BDSM'], 'f-BDSM': ['f-BDSM'], 'py-BDSM': ['py-BDSM']}
class astro.recipes.mods.Pipeline.BiasPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'Bias': (<class 'astro.recipes.Bias.BiasTask'>, 'IND'), 'DarkCurrent': (<class 'astro.recipes.DarkCurrent.DarkCurrentTask'>, 'IND'), 'HotPixels': (<class 'astro.recipes.HotPixels.HotPixelsTask'>, 'IND'), 'ReadNoise': (<class 'astro.recipes.ReadNoise.ReadNoiseTask'>, 'IND')}
single_node_tasks = []
task_sequences = {'Bias': ['Bias'], 'DarkCurrent': ['DarkCurrent'], 'HotPixels': ['HotPixels'], 'ReadNoise': ['ReadNoise']}
class astro.recipes.mods.Pipeline.CompositeTask

Bases: common.util.Pipeline.CompositeTask, astro.recipes.mods.Task.TaskMixin

class astro.recipes.mods.Pipeline.EuclidLISPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'EuclidExport': (<class 'astro.recipes.EuclidExport.EuclidExportTask'>, 'SEQ'), 'EuclidImport': (<class 'astro.recipes.EuclidImport.EuclidImportTask'>, 'SEQ'), 'EuclidLISTest': (<class 'astro.recipes.EuclidLISTest.EuclidLISTestTask'>, 'SEQ'), 'Target': (<class 'astro.recipes.TargetProcessor.TargetProcessorTask'>, 'SEQ')}
single_node_tasks = []
task_sequences = {'EuclidExport': ['EuclidExport'], 'EuclidImport': ['EuclidImport'], 'EuclidLIS': ['EuclidImport', 'Target', 'EuclidExport'], 'EuclidLISTest': ['EuclidLISTest']}
class astro.recipes.mods.Pipeline.FlatfieldPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'Background': (<class 'astro.recipes.BackgroundFrameTask.BackgroundFrameTask'>, 'SEQ'), 'ColdPixels': (<class 'astro.recipes.ColdPixels.ColdPixelsTask'>, 'SEQ'), 'DomeFlat': (<class 'astro.recipes.DomeFlat.DomeFlatTask'>, 'SEQ'), 'FringeFlat': (<class 'astro.recipes.FringeFlat.FringeFlatTask'>, 'SEQ'), 'Gain': (<class 'astro.recipes.Gain.GainTask'>, 'SEQ'), 'MasterFlat': (<class 'astro.recipes.MasterFlat.MasterFlatTask'>, 'SEQ'), 'NightSkyFlat': (<class 'astro.recipes.NightSkyFlat.NightSkyFlatTask'>, 'SEQ'), 'QuickCheck': (<class 'astro.recipes.QuickCheck.QuickCheckTask'>, 'SEQ'), 'Shutter': (<class 'astro.recipes.ShutterCheck.ShutterCheckTask'>, 'SEQ'), 'TwilightFlat': (<class 'astro.recipes.TwilightFlat.TwilightFlatTask'>, 'SEQ')}
single_node_tasks = []
task_sequences = {'Background': ['Background'], 'ColdPixels': ['ColdPixels'], 'DomeFlat': ['DomeFlat'], 'FringeFlat': ['FringeFlat'], 'Gain': ['Gain'], 'MasterFlat': ['MasterFlat'], 'NightSkyFlat': ['NightSkyFlat'], 'QuickCheck': ['QuickCheck'], 'Shutter': ['Shutter'], 'TwilightFlat': ['TwilightFlat']}
class astro.recipes.mods.Pipeline.ImagePipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'AssociateList': (<class 'astro.recipes.AssociateList.AssociateListTask'>, 'SYN'), 'Astrometry': (<class 'astro.recipes.Astrometry.AstrometricParametersTask'>, 'SEQ'), 'Coadd': (<class 'astro.recipes.Coadd.CoaddTask'>, 'SYN'), 'GAstrom': (<class 'astro.recipes.GAstrom.GAstromTask'>, 'SYN'), 'GAstromSL': (<class 'astro.recipes.GAstromSourceList.GAstromSourceListTask'>, 'SEQ'), 'GPhotom': (<class 'astro.recipes.GPhotom.GPhotomTask'>, 'SYN'), 'Reduce': (<class 'astro.recipes.Reduce.ReduceTask'>, 'SEQ'), 'Reference': (<class 'astro.recipes.Reference.ReferenceTask'>, 'SEQ'), 'Regrid': (<class 'astro.recipes.Regrid.RegridTask'>, 'SYN'), 'SourceList': (<class 'astro.recipes.SourceList.SourceListTask'>, 'SYN')}
single_node_tasks = ['GAstrom', 'GPhotom', 'Coadd', 'Reference']
task_sequences = {'AssociateList': ['AssociateList'], 'Astrometry': ['Astrometry'], 'Coadd': ['Coadd'], 'GAstrom': ['GAstrom'], 'GAstromSL': ['GAstromSL'], 'GAstrometry': ['Astrometry', 'GAstromSL', 'GAstrom'], 'GPhotom': ['GPhotom'], 'GPhotometry': ['Astrometry', 'GAstromSL', 'GPhotom'], 'Reduce': ['Reduce'], 'Reduce>Astrometry': ['Reduce', 'Astrometry'], 'Reduce>Coadd': ['Reduce', 'Astrometry', 'Regrid', 'Coadd'], 'Reduce>GAstrometry>Coadd': ['Reduce', 'Astrometry', 'GAstromSL', 'GAstrom', 'Regrid', 'Coadd'], 'Reduce>GAstrometry>Regrid': ['Reduce', 'Astrometry', 'GAstromSL', 'GAstrom', 'Regrid'], 'Reduce>GPhotometry>Coadd': ['Reduce', 'Astrometry', 'GAstromSL', 'GPhotom', 'Regrid', 'Coadd'], 'Reduce>GPhotometry>Regrid': ['Reduce', 'Astrometry', 'GAstromSL', 'GPhotom', 'Regrid'], 'Reduce>Regrid': ['Reduce', 'Astrometry', 'Regrid'], 'Reference': ['Reference'], 'Regrid': ['Regrid'], 'Regrid>Coadd': ['Regrid', 'Coadd'], 'SourceList': ['SourceList']}
class astro.recipes.mods.Pipeline.MiscPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'ApertureCorrection': (<class 'astro.recipes.ApertureCorrectionTask.ApertureCorrectionTask'>, 'IND'), 'BPZ': (<class 'astro.recipes.BPZSourceCollectionTask.BPZSourceCollectionTask'>, 'IND'), 'Convolve': (<class 'astro.recipes.Convolve.ConvolveTask'>, 'SEQ'), 'CrossTalk': (<class 'astro.recipes.CrossTalkTask.CrossTalkTask'>, 'IND'), 'CrossTalkCorrectedFrame': (<class 'astro.recipes.CrossTalkCorrectedFrameTask.CrossTalkCorrectedFrameTask'>, 'IND'), 'ESOID': (<class 'astro.recipes.ESOIDTask.ESOIDTask'>, 'IND'), 'ExportForESO': (<class 'astro.recipes.ExportCoaddForESOTask.ExportCoaddForESOTask'>, 'IND'), 'Extinction': (<class 'astro.recipes.ExtinctionSourceCollectionTask.ExtinctionSourceCollectionTask'>, 'IND'), 'GaAP': (<class 'astro.recipes.GaAPSourceCollectionTask.GaAPSourceCollectionTask'>, 'IND'), 'GalFit': (<class 'astro.recipes.GalFit.GalFitTask'>, 'IND'), 'GalPhot': (<class 'astro.recipes.GalPhot.GalPhotTask'>, 'IND'), 'Gaussianize': (<class 'astro.recipes.GaussianizedFrameTask.GaussianizedFrameTask'>, 'IND'), 'KidsCat': (<class 'astro.recipes.KidsCatTask.KidsCatTask'>, 'IND'), 'KidsCatMatched': (<class 'astro.recipes.KidsCatMatchedTask.KidsCatMatchedTask'>, 'IND'), 'Manmask': (<class 'astro.recipes.ManMask.ManMaskTask'>, 'IND'), 'Null': (<class 'astro.recipes.Null.NullTask'>, 'IND'), 'PSF': (<class 'astro.recipes.PSFModelTask.PSFModelTask'>, 'IND'), 'RawFitsInspect': (<class 'astro.recipes.RawFitsDataInspectTask.RawFitsDataInspectTask'>, 'IND'), 'RawFrame': (<class 'astro.recipes.RawFrameTask.RawFrameTask'>, 'IND'), 'Satmask': (<class 'astro.recipes.SatMask.SatMaskTask'>, 'IND'), 'Scamp': (<class 'astro.recipes.Scamp.ScampTask'>, 'IND')}
single_node_tasks = ['Gaussianize', 'GaAP', 'BPZ', 'PSF', 'Extinction', 'ExportForESO', 'KidsCat', 'KidsCatMatched', 'ApertureCorrection', 'ESOID', 'Scamp', 'Satmask', 'Manmask']
task_sequences = {'ApertureCorrection': ['ApertureCorrection'], 'BPZ': ['BPZ'], 'Convolve': ['Convolve'], 'CrossTalk': ['CrossTalk'], 'CrossTalkCorrectedFrame': ['CrossTalkCorrectedFrame'], 'ESOID': ['ESOID'], 'ExportForESO': ['ExportForESO'], 'Extinction': ['Extinction'], 'GaAP': ['GaAP'], 'GalFit': ['GalFit'], 'GalPhot': ['GalPhot'], 'Gaussianize': ['Gaussianize'], 'Gaussianize>GaAP': ['Gaussianize', 'GaAP'], 'KidsCat': ['KidsCat'], 'KidsCatMatched': ['KidsCatMatched'], 'Manmask': ['Manmask'], 'Null': ['Null'], 'Null>Null': ['Null', 'Null'], 'Null>Null>Null': ['Null', 'Null', 'Null'], 'PSF': ['PSF'], 'RawFitsInspect': ['RawFitsInspect'], 'RawFrame': ['RawFrame'], 'Satmask': ['Satmask'], 'Scamp': ['Scamp']}
class astro.recipes.mods.Pipeline.ParallelOptions(options)

Bases: object

A dictionary of options is duplicated in various ways (group filenames to be sent to different nodes, add a chip clause etc.). This is handled by this set of classes.

get_parallel_options()
class astro.recipes.mods.Pipeline.ParallelOptionsByChip(options)

Bases: astro.recipes.mods.Pipeline.ParallelOptions

Duplicate options by duplicating the options for each chip of the instrument

get_parallel_options()
class astro.recipes.mods.Pipeline.ParallelOptionsByFilename(options, option_name, group_size=3)

Bases: astro.recipes.mods.Pipeline.ParallelOptions

Duplicate options by splitting a list of filenames in the options

get_parallel_options()
class astro.recipes.mods.Pipeline.ParallelOptionsByFilenameCal(options, option_name)

Bases: astro.recipes.mods.Pipeline.ParallelOptions

In the case of calibration files the set of input filenames belongs together, so we must not create a task for each filename.

get_parallel_options()
group_filenames_by_ccd(filenames)
class astro.recipes.mods.Pipeline.ParallelOptionsBySID(options)

Bases: astro.recipes.mods.Pipeline.ParallelOptions

get_parallel_options()
class astro.recipes.mods.Pipeline.PhotometricPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'Astrometry': (<class 'astro.recipes.Astrometry.AstrometricParametersTask'>, 'SEQ'), 'Monitoring': (<class 'astro.recipes.PhotCalMonitoring.MonitoringTask'>, 'IND'), 'Photcat': (<class 'astro.recipes.PhotCalExtractResulttable.PhotcatTask'>, 'SEQ'), 'Photom': (<class 'astro.recipes.PhotCalExtractZeropoint.PhotomTask'>, 'SEQ'), 'Reduce': (<class 'astro.recipes.Reduce.ReduceTask'>, 'SEQ'), 'Variability': (<class 'astro.recipes.Variability.VariabilityTask'>, 'IND')}
single_node_tasks = ['MDia', 'Variability', 'Monitoring']
task_sequences = {'MDia': ['MDia'], 'Monitoring': ['Monitoring'], 'Photcat': ['Photcat'], 'Photcat>Photom': ['Photcat', 'Photom'], 'Photom': ['Photom'], 'Reduce>Photcat': ['Reduce', 'Astrometry', 'Photcat'], 'Reduce>Photom': ['Reduce', 'Astrometry', 'Photcat', 'Photom'], 'Variability': ['Variability']}
class astro.recipes.mods.Pipeline.Pipeline

Bases: common.util.Pipeline.Pipeline

CPJ_DICT = {'coadddpu.astro.target.astro-wise.org': (1, {}), 'dpu-test.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.grid.target.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 16, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 16, 'Gaussianize': 4, 'EuclidImport': 16}), 'dpu.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.science.ru.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 12, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 12, 'Gaussianize': 4, 'EuclidImport': 12})}
awetarget = 'astro'
classmethod create_paralleloptions(pipeline, options)

Factory function for ParallelOptions classes

classmethod create_pipeline(sequence_identifier)

Factory function for Pipelines; returns an instance of the Pipeline which contains the specified sequence identifier

classmethod get_atomic_tasks()
classmethod get_available_sequence_identifiers()
classmethod sequence_identifier_exists(sequence_identifier)
class astro.recipes.mods.Pipeline.TargetProcessorPipeline

Bases: astro.recipes.mods.Pipeline.Pipeline

atomic_task_map = {'Target': (<class 'astro.recipes.TargetProcessor.TargetProcessorTask'>, 'SEQ')}
single_node_tasks = []
task_sequences = {'Target': ['Target']}
astro.recipes.mods.Pipeline.diff(dict1, dict2)

Return keys in dict1 that are not present in dict2

astro.recipes.mods.Task module

The astro Task, this is derived from the common Task.

With TaskMixin some methods are mixed in the astro Task.

class astro.recipes.mods.Task.ImagePipelineMixin

Bases: object

This mixin class contains functionality that is only used by the image pipeline.

class astro.recipes.mods.Task.Task(*args, **kwargs)

Bases: common.util.Pipeline.Task, astro.recipes.mods.Task.TaskMixin

class astro.recipes.mods.Task.TaskMixin

Bases: object

Mixin class for Task classes

check_frame_geometries(frames, ref_naxis1=None, ref_naxis2=None)

Check to see if the trimmed size of RawFrames and the NAXIS1 and NAXIS2 attributes of all other frames are the same for all input frames. Due to multiple configurations of some instruments (e.g., SUP), some data may cross configuration boundaries. This method compares the values of the NAXIS1 and NAXIS2 attributes of the first frame in the list to that of the remaining frames.

NOTE: There is no check for this in the entire system except

through this method. Make sure all possibilities are covered and error messages are clear.

frames: list of frames derived from BaseFrame

ref_naxis1: manually specify the NAXIS1 value to compare ref_naxis2: manually specify the NAXIS2 value to compare

NOTE: If not all of naxis1, naxis2, are specified, unpredictable
results may occur. In other words, specify all of them or none of them.
astro.recipes.mods.Task.get_most_recent(objs)

Get most recent versions of ReducedScienceFrames or RegriddedFrames based on instrument, chip, filter, and DATE_OBS. It is necessary to use these instead of the RawScienceFrame because a RawScienceFrame is not guaranteed to exist (reduced frame ingestion).

objs: a list or Select object of ReducedScienceFrames or
RegriddedFrames

Returns a list of ReducedScienceFrames or RegriddedFrames.

astro.recipes.mods.dpu module

The astro Processor

This is derived from the common Processor, the Pipeline is defined.

class astro.recipes.mods.dpu.LocalProcessor

Bases: common.util.Processor.LocalProcessor

class Pipeline

Bases: common.util.Pipeline.Pipeline

CPJ_DICT = {'coadddpu.astro.target.astro-wise.org': (1, {}), 'dpu-test.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.grid.target.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 16, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 16, 'Gaussianize': 4, 'EuclidImport': 16}), 'dpu.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.science.ru.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 12, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 12, 'Gaussianize': 4, 'EuclidImport': 12})}
awetarget = 'astro'
classmethod create_paralleloptions(pipeline, options)

Factory function for ParallelOptions classes

classmethod create_pipeline(sequence_identifier)

Factory function for Pipelines; returns an instance of the Pipeline which contains the specified sequence identifier

classmethod get_atomic_tasks()
classmethod get_available_sequence_identifiers()
classmethod sequence_identifier_exists(sequence_identifier)
class astro.recipes.mods.dpu.Processor(dpu_name, request_logs=False)

Bases: common.util.Processor.Processor

class Pipeline

Bases: common.util.Pipeline.Pipeline

CPJ_DICT = {'coadddpu.astro.target.astro-wise.org': (1, {}), 'dpu-test.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.grid.target.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 16, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 16, 'Gaussianize': 4, 'EuclidImport': 16}), 'dpu.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.science.ru.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 12, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 12, 'Gaussianize': 4, 'EuclidImport': 12})}
awetarget = 'astro'
classmethod create_paralleloptions(pipeline, options)

Factory function for ParallelOptions classes

classmethod create_pipeline(sequence_identifier)

Factory function for Pipelines; returns an instance of the Pipeline which contains the specified sequence identifier

classmethod get_atomic_tasks()
classmethod get_available_sequence_identifiers()
classmethod sequence_identifier_exists(sequence_identifier)

astro.recipes.mods.lpu module

Local Processing Unit.

This is simply a way to provide a similar interface to that provided by the dpu module when users run taks locally. From the astro-wise prompt tasks may be run on the local machine with commands such as:

lpu.run(‘ReadNoise’, i=’OMEGACAM’, d=‘2016-01-01’, C=0)

class astro.recipes.mods.lpu.LocalProcessor

Bases: common.util.Processor.LocalProcessor

class Pipeline

Bases: common.util.Pipeline.Pipeline

CPJ_DICT = {'coadddpu.astro.target.astro-wise.org': (1, {}), 'dpu-test.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.grid.target.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 16, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 16, 'Gaussianize': 4, 'EuclidImport': 16}), 'dpu.hpc.rug.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 24, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'BPZ': 6, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 24, 'Gaussianize': 4, 'EuclidImport': 24}), 'dpu.science.ru.astro-wise.org': (1, {'ApertureCorrection': 6, 'EuclidExport': 12, 'KidsCat': 10, 'ExportForESO': 10, 'GaAP': 6, 'KidsCatMatched': 10, 'SourceList': 10, 'Extinction': 6, 'ESOID': 6, 'Coadd': 12, 'Gaussianize': 4, 'EuclidImport': 12})}
awetarget = 'astro'
classmethod create_paralleloptions(pipeline, options)

Factory function for ParallelOptions classes

classmethod create_pipeline(sequence_identifier)

Factory function for Pipelines; returns an instance of the Pipeline which contains the specified sequence identifier

classmethod get_atomic_tasks()
classmethod get_available_sequence_identifiers()
classmethod sequence_identifier_exists(sequence_identifier)

Module contents

This directory contains the implementation classes used by the recipes defined in the parent directory.