Skip to content

Instantly share code, notes, and snippets.

@sinemetu1
Created June 26, 2018 20:34
Show Gist options
  • Save sinemetu1/25ddfae30fe077a359f52b918360907d to your computer and use it in GitHub Desktop.
Save sinemetu1/25ddfae30fe077a359f52b918360907d to your computer and use it in GitHub Desktop.
Example pyspark .travis.yml
sudo: false
env:
global:
- BOTO_CONFIG=/dev/null
- SPARK_VERSION=2.0.2
matrix:
- TOX_ENV=py27
- TOX_ENV=py3
- TOX_ENV=pep8
language: python
python: 2.7
install:
- curl -Ol "http://d3kbcqa49mib13.cloudfront.net/spark-$SPARK_VERSION-bin-hadoop2.7.tgz"
- tar xvf "spark-$SPARK_VERSION-bin-hadoop2.7.tgz"
- "export SPARK_HOME=`pwd`/spark-$SPARK_VERSION-bin-hadoop2.7"
- pip install tox
- git clone git@github.com:iheartradio/ihrpi.git && cd ihrpi/ && python setup.py install && cd ..
script:
- ihrpi-tox-run
before_deploy:
- ihrpi-build
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment