Skip to content

Instantly share code, notes, and snippets.

@Athanaseus

Athanaseus/slum_1.log

Created January 31, 2024 09:04
Show Gist options
  • Save Athanaseus/fde104a0f8230ea75097f9c2c3e8e119 to your computer and use it in GitHub Desktop.
Save Athanaseus/fde104a0f8230ea75097f9c2c3e8e119 to your computer and use it in GitHub Desktop.
Download ZIP
NODE=1
Raw
slum_1.log
2024-01-31 10:59:31 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: ### validated inputs
2024-01-31 10:59:31 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: cab flagdata:
2024-01-31 10:59:31 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: spw =
2024-01-31 10:59:31 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: mode = summary
2024-01-31 10:59:31 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: ms = /scratch3/users/athanaseus/msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms
2024-01-31 10:59:31 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: singularity image /scratch3/users/athanaseus/images/quay.io-stimela2-casa:cc0.0.2.simg exists
### running /opt/slurm/bin/srun -J loop-pointings.mgpls-reductions.flagsummary-stats-0 /software/common/singularity/3.11.3/bin/singularity exec --containall --pwd /scratch3/users/athanaseus/runner --bind /scratch3/users/athanaseus/runner:/scratch3/user2024-01-31 10:59:39 STIMELA.loop-pointings.mgpls-reductions INFO: recipe 'MGPLS-HII-bubbles' executed successfully
sers/athanaseus/msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms:ro /scratch3/users/athanaseus/images/quay.io-stimela2-casa:cc0.0.2.simg casa --log2term --nologger --nologfile -c
import sys, json
kw = json.loads(sys.argv[-1])
try:
utype = unicode
except NameError:
utype = bytes
def stringify(x):
if isinstance(x, (utype, str)):
return str(x)
elif isinstance(x, list):
return [stringify(y) for y in x]
else:
return x
kw = {key: stringify(value) for key, value in kw.items()}
flagdata(**kw)
{"vis": "/scratch3/users/athanaseus/msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms", "spw": "", "mode": "summary"}
#
# =========================================
# The start-up time of CASA may vary
# depending on whether the shared libraries
# are cached or not.
# =========================================
#
# Python: athanaseus/runner IPython 5.1.0 -- An enhanced Interactive Python.
#
# CASA 5.8.0-109 -- Common Astronomy Software Applications
#
# Creating a new telemetry file
# Telemetry initialized. Telemetry will send anonymized usage statistics to NRAO.
# You can disable telemetry by adding the following line to your ~/.casarc file:
# EnableTelemetry: False
# 2024-01-31 08:59:35 INFO ::casa CASA Version 5.8.0-109
# --> CrashReporter initialized.
# 2024-01-31 08:59:37 INFO flagdata::::
# 2024-01-31 08:59:37 INFO flagdata::::+ ##########################################
# 2024-01-31 08:59:37 INFO flagdata::::+ ##### Begin Task: flagdata #####
# 2024-01-31 08:59:37 INFO flagdata:::: flagdata(vis="/scratch3/users/athanaseus/msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms",mode="summary",autocorr=False,inpfile="",reason="any",
# 2024-01-31 08:59:37 INFO flagdata::::+ tbuff=0.0,spw="",field="",antenna="",uvrange="",
# 2024-01-31 08:59:37 INFO flagdata::::+ timerange="",correlation="",scan="",intent="",array="",
# 2024-01-31 08:59:37 INFO flagdata::::+ observation="",feed="",clipminmax=[],datacolumn="DATA",clipoutside=True,
# 2024-01-31 08:59:37 INFO flagdata::::+ channelavg=False,chanbin=1,timeavg=False,timebin="0s",clipzeros=False,
# 2024-01-31 08:59:37 INFO flagdata::::+ quackinterval=1.0,quackmode="beg",quackincrement=False,tolerance=0.0,addantenna="",
# 2024-01-31 08:59:37 INFO flagdata::::+ lowerlimit=0.0,upperlimit=90.0,ntime="scan",combinescans=False,timecutoff=4.0,
# 2024-01-31 08:59:37 INFO flagdata::::+ freqcutoff=3.0,timefit="line",freqfit="poly",maxnpieces=7,flagdimension="freqtime",
# 2024-01-31 08:59:37 INFO flagdata::::+ usewindowstats="none",halfwin=1,extendflags=True,winsize=3,timedev="",
# 2024-01-31 08:59:37 INFO flagdata::::+ freqdev="",timedevscale=5.0,freqdevscale=5.0,spectralmax=1000000.0,spectralmin=0.0,
# 2024-01-31 08:59:37 INFO flagdata::::+ antint_ref_antenna="",minchanfrac=0.6,verbose=False,extendpols=True,growtime=50.0,
# 2024-01-31 08:59:37 INFO flagdata::::+ growfreq=50.0,growaround=False,flagneartime=False,flagnearfreq=False,minrel=0.0,
# 2024-01-31 08:59:37 INFO flagdata::::+ maxrel=1.0,minabs=0,maxabs=-1,spwchan=False,spwcorr=False,
# 2024-01-31 08:59:37 INFO flagdata::::+ basecnt=False,fieldcnt=False,name="Summary",action="apply",display="",
# 2024-01-31 08:59:37 INFO flagdata::::+ flagbackup=True,savepars=False,cmdreason="",outfile="",overwrite=True,
# 2024-01-31 08:59:37 INFO flagdata::::+ writeflags=True)
# 2024-01-31 08:59:37 INFO AgentFlagger::open Table type is Measurement Set
# 2024-01-31 08:59:37 INFO flagdata:::: Summary mode is active
# 2024-01-31 08:59:37 INFO flagdata:::: Initializing the agents
# 2024-01-31 08:59:37 INFO Summary::setAgentParameters display is:
# 2024-01-31 08:59:37 INFO AgentFlagger::initAgents There are 1 valid agents in list
# 2024-01-31 08:59:37 INFO flagdata:::: Running the agentflagger tool
# 2024-01-31 08:59:37 INFO FlagMSHandler:: Chunk = 1 \\\[progress: 100%], Observation = 0, Array = 0, Scan = 3, Field = 0 (T16R02C02), Spw = 0, Channels = 4096, Corrs = [ XX YY ], Total Rows = 20801
# 2024-01-31 08:59:38 INFO FlagMSHandler::nextChunk ====================================================================================
# 2024-01-31 08:59:38 INFO Summary::getResult observation 0 flagged: 7.09307e+07 total: 1.70402e+08 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult spw 0 flagged: 7.09307e+07 total: 1.70402e+08 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult field T16R02C02 flagged: 7.09307e+07 total: 1.70402e+08 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult array 0 flagged: 7.09307e+07 total: 1.70402e+08 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult scan 3 flagged: 7.09307e+07 total: 1.70402e+08 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m062 flagged: 5.49683e+06 total: 5.49683e+06 (100%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m028 flagged: 2.02895e+06 total: 5.49683e+06 (36.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m027 flagged: 2.03766e+06 total: 5.49683e+06 (37.1%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m013 flagged: 2.02322e+06 total: 5.49683e+06 (36.8%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m003 flagged: 2.06053e+06 total: 5.49683e+06 (37.5%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m022 flagged: 1.97408e+06 total: 5.49683e+06 (35.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m020 flagged: 2.06473e+06 total: 5.49683e+06 (37.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m006 flagged: 2.03612e+06 total: 5.49683e+06 (37%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m029 flagged: 2.02948e+06 total: 5.49683e+06 (36.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m019 flagged: 2.03405e+06 total: 5.49683e+06 (37%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m023 flagged: 5.49683e+06 total: 5.49683e+06 (100%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m030 flagged: 1.99973e+06 total: 5.49683e+06 (36.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m060 flagged: 5.49683e+06 total: 5.49683e+06 (100%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m017 flagged: 2.00072e+06 total: 5.49683e+06 (36.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m014 flagged: 2.0153e+06 total: 5.49683e+06 (36.7%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m057 flagged: 1.43238e+06 total: 5.49683e+06 (26.1%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m000 flagged: 2.04289e+06 total: 5.49683e+06 (37.2%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m058 flagged: 1.28899e+06 total: 5.49683e+06 (23.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m051 flagged: 1.77985e+06 total: 5.49683e+06 (32.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m009 flagged: 2.02554e+06 total: 5.49683e+06 (36.8%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m061 flagged: 5.49683e+06 total: 5.49683e+06 (100%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m034 flagged: 1.97751e+06 total: 5.49683e+06 (36%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m024 flagged: 1.95626e+06 total: 5.49683e+06 (35.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m032 flagged: 1.93002e+06 total: 5.49683e+06 (35.1%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m053 flagged: 1.78317e+06 total: 5.49683e+06 (32.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m007 flagged: 2.02919e+06 total: 5.49683e+06 (36.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m002 flagged: 2.05097e+06 total: 5.49683e+06 (37.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m054 flagged: 1.89199e+06 total: 5.49683e+06 (34.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m015 flagged: 2.03946e+06 total: 5.49683e+06 (37.1%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m001 flagged: 2.0627e+06 total: 5.49683e+06 (37.5%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m004 flagged: 2.03935e+06 total: 5.49683e+06 (37.1%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m010 flagged: 2.00107e+06 total: 5.49683e+06 (36.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m050 flagged: 1.55166e+06 total: 5.49683e+06 (28.2%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m005 flagged: 2.05007e+06 total: 5.49683e+06 (37.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m021 flagged: 1.99753e+06 total: 5.49683e+06 (36.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m026 flagged: 2.01232e+06 total: 5.49683e+06 (36.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m044 flagged: 1.85132e+06 total: 5.49683e+06 (33.7%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m056 flagged: 1.64268e+06 total: 5.49683e+06 (29.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m016 flagged: 2.00278e+06 total: 5.49683e+06 (36.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m012 flagged: 2.05037e+06 total: 5.49683e+06 (37.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m011 flagged: 2.04308e+06 total: 5.49683e+06 (37.2%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m031 flagged: 1.96529e+06 total: 5.49683e+06 (35.8%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m033 flagged: 1.71971e+06 total: 5.49683e+06 (31.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m035 flagged: 1.99093e+06 total: 5.49683e+06 (36.2%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m049 flagged: 1.56007e+06 total: 5.49683e+06 (28.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m047 flagged: 1.89476e+06 total: 5.49683e+06 (34.5%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m048 flagged: 1.67185e+06 total: 5.49683e+06 (30.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m036 flagged: 1.9746e+06 total: 5.49683e+06 (35.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m037 flagged: 1.97142e+06 total: 5.49683e+06 (35.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m038 flagged: 1.979e+06 total: 5.49683e+06 (36%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m025 flagged: 1.9602e+06 total: 5.49683e+06 (35.7%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m059 flagged: 5.49683e+06 total: 5.49683e+06 (100%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m039 flagged: 1.96111e+06 total: 5.49683e+06 (35.7%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m040 flagged: 1.94697e+06 total: 5.49683e+06 (35.4%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m041 flagged: 5.49683e+06 total: 5.49683e+06 (100%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m052 flagged: 1.7593e+06 total: 5.49683e+06 (32%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m042 flagged: 1.96437e+06 total: 5.49683e+06 (35.7%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m043 flagged: 1.92056e+06 total: 5.49683e+06 (34.9%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m045 flagged: 1.74067e+06 total: 5.49683e+06 (31.7%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m018 flagged: 2.05058e+06 total: 5.49683e+06 (37.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult antenna m055 flagged: 1.71929e+06 total: 5.49683e+06 (31.3%)
# 2024-01-31 08:59:38 INFO Summary::getResult correlation YY flagged: 3.54653e+07 total: 8.52009e+07 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult correlation XX flagged: 3.54653e+07 total: 8.52009e+07 (41.6%)
# 2024-01-31 08:59:38 INFO Summary::getResult [bold green]Total Flagged: 7.09307e+07 Total Counts: 1.70402e+08 (41.6%)[/bold green]
# 2024-01-31 08:59:38 INFO flagdata:::: Flags are not written to the MS. (action='calculate')
# 2024-01-31 08:59:39 INFO flagdata:::: ##### End Task: flagdata #####
# 2024-01-31 08:59:39 INFO flagdata::::+ ##########################################
2024-01-31 10:59:38 STIMELA.loop-pointings.mgpls-reductions.flagsummary-stats-0 INFO: flagdata returns exit code 0 after 0:00:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment