DDF MosaicKing

DDF.md

Mosaicking for the MeerKAT GPLS using Direction Dependent Faceting

Mosaicking 3 single scan pointings of 3 minutes each.

DDFacet command: DDF.py --Data-MS T16R02C02-corr-scan3-chan512-t16-XXYY.ms,T16R02C04-corr-scan4-chan512-t16-XXYY.ms,T16R02C06-corr-scan5-chan512-t16-XXYY.ms --Data-ColName DATA --Data-ChunkHours 3.0 --Data-Sort 1 --Predict-ColName POINTING_MODEL --Output-Mode Clean --Output-Name mgpls_im_01/T16R02-avg-mosaic-di1/im-di1 --Output-Cubes all --Output-Images all --Image-NPix 18000 --Image-Cell 1.0 --Facets-NFacets 9 --Weight-Robust -1.0 --Weight-SigmoidTaperInnerRolloffStrength 0 --Weight-SigmoidTaperOuterRolloffStrength 0 --RIME-DecorrMode FT --Parallel-NCPU 60 --Cache-Reset 1 --Beam-Model FITS --Beam-NBand 3 --Beam-CenterNorm 1 --Beam-Smooth 1 --Beam-FITSFile mktat_beams/new_mkt_pb_avg_$(xy)_$(reim).fits --Beam-FITSFeed xy --Beam-DtBeamMin 4.0 --Beam-FITSParAngleIncDeg 0.5 --Freq-NBand 3 --Freq-NDegridBand 12 --Deconv-Mode SSD2 --Deconv-MaxMajorIter 4 --Deconv-RMSFactor 3.0 --Deconv-PeakFactor 0.01 --Mask-Auto 1 --SSD2-PolyFreqOrder 3 --Log-Memory 1 --Log-Boring 0

Image Header

Name= im-dil.app.restored.fits
HDU = 0
Shape = [18225, 18225, 1, 1]
Number of channels = 1
Number of stokes = 1
Coordinate type = Right Ascension, Declination
Projection = SIN
Image reference pixels = [9113, 9113]
Image reference coords [14:17:01.3800, -061.10.37.9000]
Image ref coords (deg) = [214.256 deg, -61.1772 deg]
Pixel increment = -1′′, 1′′
Celestial frame = ICRS
Spectral frame = TOPO
Velocity definition = RADIO
Pixel unit = Jy/beam
Restoring beam = 21.8848′′ X 10.2914", 50.8834 deg

# 
# Traceback (most recent call last):
#   File "/home/aramaila/.virtualenvs/DDF/bin/DDF.py", line 457, in <module>
#     main(OP, messages)
#   File "/home/aramaila/.virtualenvs/DDF/bin/DDF.py", line 283, in main
#     Imager.Init()
#   File "/home/aramaila/.virtualenvs/DDF/lib/python3.6/site-packages/DDFacet/Imager/ClassDeconvMachine.py", line 313, in Init
#     self.CreateFacetMachines()
#   File "/home/aramaila/.virtualenvs/DDF/lib/python3.6/site-packages/DDFacet/Imager/ClassDeconvMachine.py", line 353, in CreateFacetMachines
#     self.FacetMachine.Init()
#   File "/home/aramaila/.virtualenvs/DDF/lib/python3.6/site-packages/DDFacet/Imager/ClassFacetMachine.py", line 813, in Init
#     self.setWisdom()
#   File "/home/aramaila/.virtualenvs/DDF/lib/python3.6/site-packages/DDFacet/Imager/ClassFacetMachine.py", line 874, in setWisdom
#     ModFFTW.learnFFTWWisdom(*TypeKey)
#   File "/home/aramaila/.virtualenvs/DDF/lib/python3.6/site-packages/DDFacet/ToolsDir/ModFFTW.py", line 792, in learnFFTWWisdom
#     print("  Computing fftw wisdom FFTs for shape [%i x %i] and dtype %s" % (npix_x,npix_y,dtype.__name__), file=log)
# TypeError: must be real number, not getset_descriptor
2024-02-01 10:59:01 STIMELA.mosaic.mosaic-di1 ERROR: step 'mosaic.mosaic-di1' has failed, aborting the recipe
──────────────────────────────────────────────────────────────────────────────────────── detailed error report follows ────────────────────────────────────────────────────────────────────────────────────────
        ⚠ step 'mosaic.mosaic-di1' has failed, aborting the recipe
        └── error running cab '/home/aramaila/.virtualenvs/DDF/bin/DDF.py'
            └── /home/aramaila/.virtualenvs/DDF/bin/DDF.py returns error code 1 after 0:00:14
────────────────────────────────────────────────────────────────────────────────────────────── profiling results ──────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                                                                                                          
                                                       averages & total I/O                                                                       peaks                                   
                     ┏━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━┳━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━┳━━━━━━┓ ┏━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━┳━━━━━━┳━━━━━━━━┳━━━━━━━━┓
                     ┃                   ┃  time hms ┃ CPU % ┃ Mem GB ┃ Load ┃ R GB/s ┃ W GB/s ┃ R GB ┃ W GB ┃ ┃                   ┃  time hms ┃ CPU % ┃ Mem GB ┃ Load ┃ R GB/s ┃ W GB/s ┃
                     ┡━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━╇━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━╇━━━━━━┩ ┡━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━╇━━━━━━╇━━━━━━━━╇━━━━━━━━┩
                     │ mosaic            │ 0:00:15.2 │  1.92 │  33.00 │ 1.07 │   0.00 │   0.00 │ 0.03 │ 0.01 │ │ mosaic            │ 0:00:15.2 │  9.90 │  33.00 │ 1.15 │   0.01 │   0.01 │
                     │ mosaic.mosaic-di1 │ 0:00:14.9 │  1.86 │  33.00 │ 1.07 │   0.00 │   0.00 │ 0.03 │ 0.01 │ │ mosaic.mosaic-di1 │ 0:00:14.9 │  9.90 │  33.00 │ 1.15 │   0.01 │   0.01 │
                     └───────────────────┴───────────┴───────┴────────┴──────┴────────┴────────┴──────┴──────┘ └───────────────────┴───────────┴───────┴────────┴──────┴────────┴────────┘

2024-02-01 10:59:01 STIMELA.mosaic INFO: saved full profiling stats to mgpls_im_06/logs/log-20240201-105832/stimela.stats.full
2024-02-01 10:59:01 STIMELA.mosaic INFO: saved summary to mgpls_im_06/logs/log-20240201-105832/stimela.stats.summary.txt
2024-02-01 10:59:01 STIMELA ERROR: run failed, exiting with error code 1
2024-02-01 10:59:01 STIMELA.mosaic INFO: last log directory was mgpls_im_06/logs/log-20240201-105832