Dan Blanchard dan-blanchard

## create_single_machine_sge.md

      
              6 files
            
          
              4 forks
            
          
              1 comment
            
          
              8 stars
            
          
                dan-blanchard
                / create_single_machine_sge.md
            
            
              Last active
              March 20, 2022 10:40
            
              
                How to setup a single-machine (Sun) Grid Engine installation for unit tests on Travis-CI
              
          
    I recently needed a way to run unit tests on Travis for a project that uses Sun Grid Engine, Grid Map.  Unfortunately, it seemed like no one had figured out how to set that up on Travis before (or simply create a single-machine installation without any user interaction). After hours of trial-and-error, I now know the secrets to making a single-machine installation of SGE that runs on Travis, and I'm sharing my script to prevent other people from going through the same frustrating experience.
To use the install_sge.sh script below, you just need to copy all of the files in this gist to a travis sub-directory directly under the root of your GitHub project, and add the following lines to your .travis.yml
before_install:
  - travis/install_sge.sh
  - export SGE_ROOT=/var/lib/gridengine
  - export SGE_CELL=default
  - export DRMAA_LIBRARY_PATH=/usr/lib/libdrmaa.so.1.0

  
## .1.miniconda.md

      
              3 files
            
          
              4 forks
            
          
              19 comments
            
          
              65 stars
            
          
                dan-blanchard
                / .1.miniconda.md
            
            
              Last active
              December 11, 2019 22:38
            
              
                Quicker Travis builds that rely on numpy and scipy using Miniconda
              
          
    For ETS's SKLL project, we found out the hard way that Travis-CI's support for numpy and scipy is pretty abysmal. There are pre-installed versions of numpy for some versions of Python, but those are seriously out of date, and scipy is not there are at all. The two most popular approaches for working around this are to (1) build everything from scratch, or (2) use apt-get to install more recent (but still out of date) versions of numpy and scipy. Both of these approaches lead to longer build times, and with the second approach, you still don't have the most recent versions of anything. To circumvent these issues, we've switched to using Miniconda (Anaconda's lightweight cousin) to install everything.
A template for installing a simple Python package that relies on numpy and scipy using Miniconda is provided below. Since it's a common s

  
## keybase.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                dan-blanchard
                / keybase.md
            
            
              Created
              January 31, 2017 16:17
            
              
                keybase.md
              
          
    Keybase proof

I hereby claim:

I am dan-blanchard on github.
I am danblanchard (https://keybase.io/danblanchard) on keybase.
I have a public key ASBzkQX9EzbCix_coIlz0AeZQGKe7UNiGbSBXW6sMI37Ago

To claim this, I am signing this object:

  
## fix_timestamps.py
#!/usr/bin/env python
'''
Little script to set timestamps based on filenames for files uploaded to
Dropbox by CameraSync.

:author: Dan Blanchard
:date: September, 2013
'''

from __future__ import print_function, unicode_literals

## check_gridsearch.py
#!/usr/bin/env python
'''
Simple test script to see if we get ValueErrors with joblib and the current
version of Python
'''
import logging
import sys
from multiprocessing import cpu_count

import sklearn.datasets
	#!/usr/bin/env python
	'''
	Little script to set timestamps based on filenames for files uploaded to
	Dropbox by CameraSync.

	:author: Dan Blanchard
	:date: September, 2013
	'''

	from __future__ import print_function, unicode_literals
	#!/usr/bin/env python
	'''
	Simple test script to see if we get ValueErrors with joblib and the current
	version of Python
	'''
	import logging
	import sys
	from multiprocessing import cpu_count

	import sklearn.datasets