Skip to content

Instantly share code, notes, and snippets.

@rhiannonlynne

rhiannonlynne/Creating a lsst_sims release.md

Last active June 15, 2016 19:49
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save rhiannonlynne/adbacd3bcb1cb5846c71 to your computer and use it in GitHub Desktop.
Save rhiannonlynne/adbacd3bcb1cb5846c71 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Creating a lsst_sims release.md

First: git tag the package for release. (please also fill out the git "Release" page, making it an official release and giving you a spot to write notes. Writing release notes as we go makes understanding changes much easier down the road!)

Next, for eups:

  • log into lsst-dev as lsstsw : (without taking along your own ssh github keys!)
  • ssh -a lsstsw@lsst-dev.ncsa.illinois.edu
  • source bin/setup.sh
  • rebuild -r sims_tag -r dm_tag lsst_sims lsst_apps (or appropriate DM git tag (12.0.rc1, etc.) and sims git tag (sims_2.2.5, etc): note that these resolve left to right, and any matching tag that is found will be used. Use the git format, not the eups format.). -- note the BUILD ID that comes from the rebuild process.
  • publish -b BUILDID -t sims lsst_sims
  • publish -b BUILDID -t sims lsst_apps
  • EUPSPKG_SOURCE=git publish -b BUILDID -t sims sims_maps
  • EUPSPKG_SOURCE=git publish -b BUILDID -t sims sims_skybrightness_data

OR : just use run-rebuild on jenkins: https://ci.lsst.codes/job/run-rebuild/ and the related run-publish.

Next, for Conda binaries: You must build the conda binaries on both a linux and a mac machine (and at the moment, yosemite must be used on the mac side, until oorb builds with conda are fixed for SIP problems).
More info on conda release building is at https://github.com/mjuric/conda-lsst -- Note that conda versions < 4.1 needs a fix from conda/conda#2343 in order to work (as of conda 4.1 this is in conda itself).

-- To set up to build conda binaries on lsst-dev

  • ssh [username]@lsst-dev.ncsa.illinois.edu
  • git clone git@github.com:mjuric/conda-lsst.git
  • cd conda-lsst
  • ./bin/bootstrap.sh
  • export PATH="$PWD/bin/:$PWD/miniconda/bin:$PATH"
  • conda config --add channels http://eupsforge.net/conda/dev

-- To build the binaries (at any time later)

  • ssh [username]@lsst-dev.ncsa.illinois.edu
  • cd conda-lsst
  • export PATH="$PWD/bin:$PWD/miniconda/bin:$PATH"
  • conda lsst make-recipes build:BUILDID lsst_apps lsst_sims --build
  • conda lsst upload
  • (note that if your username on lsst-dev is different than your user name on your machine, you should include your username/servername or put it in the .condalsstrc - see the conda-lsst README).
  • (BUILDID = b1852, etc.)

Repeat the above on a mac to build the OSX binaries. Note that you must use BASH to run the bootstrap script. Note that you must remove anaconda or other conda installations from your path before running any of the above commands.

To remove outdated versions of packages from the conda channel:

  • cat recipes/rebuild.sh | grep ^rebuild | awk '{ print $2"-"$3".tar.bz2" } > packages.txt
  • mv $(cat packages.txt) ../tmp; rm ; mv ../tmp/ .; conda index .

(but apparently this is not so much of a problem now and could possibly be ignored).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment