Measurements take place within the meas_base framework.
meas_base distinguishes between a measurement “algorithm” (e.g. a bit of code
John Swinbank jdswinbank
jdswinbank
/ gist:1516422d4c2465a8290f3b98a8ef2fda
Created
August 7, 2020 16:49
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (lsst-scipipe-1a1d771) bash-4.2$ ./bin/run_demo.sh | |
| + '[' '!' -f DATA_REPO/butler.yaml ']' | |
| + butler create DATA_REPO | |
| Downloading https://hpiers.obspm.fr/iers/bul/bulc/Leap_Second.dat | |
| |=========================================================================================================================================================================================================| 1.3k/1.3k (100.00%) 0s | |
| + butler register-instrument DATA_REPO lsst.obs.subaru.HyperSuprimeCam | |
| + '[' '!' -d DATA_REPO/HSC/calib ']' | |
| + butler import DATA_REPO /mnt/lsst/src/lsst/pipelines_check/export_dir --export-file /mnt/lsst/src/lsst/pipelines_check/export_dir/export.yaml --output-run shared/ci_hsc --skip-dimensions instrument,physical_filter,detector | |
| ++ find -L DATA_REPO/HSC/raw -type f |
jdswinbank
/ test_spanSets
Created
July 19, 2019 22:01
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ ./tests/test_spanSets | |
| ================================================================= | |
| ==57077==ERROR: AddressSanitizer: container-overflow on address 0x6110000057c0 at pc 0x00010473e01e bp 0x7ffeeb555f50 sp 0x7ffeeb555f48 | |
| WRITE of size 4 at 0x6110000057c0 thread T0 | |
| #0 0x10473e01d in SpanSet_testFunctor::test_method() AssignmentFunctors.h:24 | |
| #1 0x10473345a in SpanSet_testFunctor_invoker() test_spanSets.cc:664 | |
| #2 0x10808f8ee in boost::detail::function::function_obj_invoker0<boost::detail::forward, int>::invoke(boost::detail::function::function_buffer&) (libboost_unit_test_framework.dylib:x86_64+0xb8ee) | |
| #3 0x10808c309 in boost::execution_monitor::catch_signals(boost::function<int ()> const&) (libboost_unit_test_framework.dylib:x86_64+0x8309) | |
| #4 0x10808c47b in boost::execution_monitor::execute(boost::function<int ()> const&) (libboost_unit_test_framework.dylib:x86_64+0x847b) | |
| #5 0x10808d07d in boost::execution_monitor::vexecute(boost::function<void ()> const&) (libboost_unit_test_framew |
jdswinbank
/ sconsUtils-AddressSanitizer
Created
July 19, 2019 20:06
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/python/lsst/sconsUtils/builders.py b/python/lsst/sconsUtils/builders.py | |
| index a14e150..02ad96c 100644 | |
| --- a/python/lsst/sconsUtils/builders.py | |
| +++ b/python/lsst/sconsUtils/builders.py | |
| @@ -22,7 +22,7 @@ def SharedLibraryIncomplete(self, target, source, **keywords): | |
| """ | |
| myenv = self.Clone() | |
| if myenv['PLATFORM'] == 'darwin': | |
| - myenv['SHLINKFLAGS'] += ["-undefined", "suppress", "-flat_namespace", "-headerpad_max_install_names"] | |
| + myenv['SHLINKFLAGS'] += ["-undefined", "suppress", "-flat_namespace", "-headerpad_max_install_names", "-fsanitize=address", "-shared-libasan"] |
jdswinbank
/ gist:2dcc1431a585b2a0c490212766fd3108
Created
February 13, 2019 22:28
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [swinbank@lsst-dev01 astrometry_net_data (master)]$ uname -a | |
| Linux lsst-dev01.ncsa.illinois.edu 3.10.0-862.14.4.el7.x86_64 #1 SMP Wed Sep 26 15:12:11 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | |
| [swinbank@lsst-dev01 astrometry_net_data (master)]$ sort --version | |
| sort (GNU coreutils) 8.22 | |
| Copyright (C) 2013 Free Software Foundation, Inc. | |
| License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>. | |
| This is free software: you are free to change and redistribute it. | |
| There is NO WARRANTY, to the extent permitted by law. | |
| Written by Mike Haertel and Paul Eggert. |
jdswinbank
/ gist:e4ff4e472e4fec3f52f582ea1fe4e7e6
Created
February 5, 2019 00:59
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [swinbank@lsst-dev01 pipelines_lsst_io (master)]$ pip install -r requirements.txt | |
| Collecting documenteer[pipelines]==0.4.2 (from -r requirements.txt (line 1)) | |
| Downloading https://files.pythonhosted.org/packages/e7/14/fbafa9d199dca07690521d6bd549851c30752320ecb9307aaf6d0cefaca9/documenteer-0.4.2-py3-none-any.whl (57kB) | |
| 100% |████████████████████████████████| 61kB 4.9MB/s | |
| Collecting sphinx-prompt (from documenteer[pipelines]==0.4.2->-r requirements.txt (line 1)) | |
| Requirement already satisfied: requests in /software/lsstsw/stack_20181012/stack/miniconda3-4.5.4-fcd27eb/Linux64/requests/2.9.1.lsst1+4/lib/python/requests-2.9.1-py3.6.egg (from documenteer[pipelines]==0.4.2->-r requirements.txt (line 1)) (2.9.1) | |
| Collecting Sphinx<1.8.0,>=1.7.0 (from documenteer[pipelines]==0.4.2->-r requirements.txt (line 1)) | |
| Using cached https://files.pythonhosted.org/packages/90/f9/a0babe32c78480994e4f1b93315558f5ed756104054a7029c672a8d77b72/Sphinx-1.7.9-py2.py3-none-any.whl | |
| Requirement already satisfied: PyYAML in /softwar |
jdswinbank
/ meas_base.rst
Last active
October 1, 2018 22:28
jdswinbank
/ gist:805f9c392a6ba8290e962f8501d52aac
Created
August 30, 2018 16:25
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ valgrind tests/Persistence_3 | |
| ==235923== Memcheck, a memory error detector | |
| ==235923== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al. | |
| ==235923== Using Valgrind-3.13.0 and LibVEX; rerun with -h for copyright info | |
| ==235923== Command: tests/Persistence_3 | |
| ==235923== | |
| Running 1 test case... | |
| *** No errors detected | |
| ==235923== Invalid read of size 8 |
jdswinbank
/ gist:2db30e49b703b8e7781c9ba14d713692
Created
July 24, 2018 01:05
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Setting up the basic environment: | |
| [jds@magpie 087 (master)]$ ssh -Y swinbank@lsst-dev01.ncsa.illinois.edu | |
| Last login: Mon Jul 23 19:58:05 2018 from 205.175.118.96 | |
| lsst-dev01.ncsa.illinois.edu (141.142.237.49) | |
| OS: CentOS 7.5.1804 HW: Dell Inc. CPU: 48x 2.60GHz RAM: 252 GB | |
| Site: ncsa DC: ncsa3003 Cluster: developer Role: dev_login | |
| Puppet environment: production | |
| Next scheduled maintenance: 2018-09-20 08:00-12:00 CT http://ls.st/0l6 | |
| GPFS fileset usage for user swinbank: |
jdswinbank
/ gist:97990db37ba607cf124c0a884cb72822
Created
July 6, 2018 19:59
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| afw 16.0-9-gdf7162dbc w_2018_26 current setup | |
| apr 1.5.2 sims w_2017_42 w_2017_40 w_2017_41 v12_0 w_2017_43 v12_1 w_2017_44 v12_1_1 w_2017_45 v12_1_2 w_2017_46 v13_0 w_2017_47 v14_0 w_2017_48 v15_0 b2931 b3023 bo_xin_170713 bo_xin_170913 d_2017_08_09 d_2017_08_10 d_2017_08_11 d_2017_08_13 d_2017_08_14 d_2017_08_15 d_2017_08_16 d_2017_08_17 d_2017_08_18 d_2017_08_20 d_2017_08_21 d_2017_08_22 d_2017_08_23 d_2017_08_24 d_2017_09_01 d_2017_09_03 d_2017_09_04 d_2017_09_05 d_2017_09_06 d_2017_09_07 d_2017_09_08 d_2017_09_10 d_2017_09_11 d_2017_09_12 d_2017_09_13 d_2017_09_14 d_2017_09_15 d_2017_09_17 d_2017_09_18 d_2017_09_19 d_2017_09_21 d_2017_09_22 d_2017_09_24 d_2017_09_25 d_2017_09_26 d_2017_09_27 d_2017_09_28 d_2017_09_29 d_2017_10_01 d_2017_10_02 d_2017_10_03 d_2017_10_04 d_2017_10_05 d_2017_10_06 d_2017_10_08 d_2017_10_09 d_2017_10_10 d_2017_10_11 d_2017_10_12 d_2017_10_13 d_2017_10_15 d_2017_10_16 d_2017_10_17 d_2017_10_18 d_2017_10_19 d_2017_10_20 d_2017_10_22 d_2 |
jdswinbank
/ gist:857ea2a086a46d91ee361cf65ad6c6c0
Last active
July 6, 2018 19:40
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ setup --nolocks -n -v -v -v -v -v -v -v -r ./astrometry_net_data astrometry_net_data | |
| sourcing /ssd/lsstsw/stack/eups/2.1.4/site/startup.py | |
| sourcing /ssd/lsstsw/stack3_20171021/stack/miniconda3-4.3.21-10a4fa6/site/startup.py | |
| sourcing /home/swinbank/.eups/startup.py | |
| Locking is disabled | |
| Reading tags from /ssd/lsstsw/stack3_20171021/stack/miniconda3-4.3.21-10a4fa6/ups_db/global.tags | |
| Regenerating missing or out-of-date cache for Linux64 in /home/swinbank/.eups/ups_db | |
| Using VRO for "default": ['type:exact', 'commandLine', 'version', 'versionExpr', 'current'] | |
| VRO used commandLine Setting up: astrometry_net_data Flavor: Linux64 Version: LOCAL:/ssd/swinbank/lsst_dm_stack_demo/astrometry_net_data | |
| Issuing commands: |
NewerOlder