Skip to content

Instantly share code, notes, and snippets.

@dannguyen
Last active July 9, 2022 03:40
Show Gist options
  • Save dannguyen/9e5082ac6a80590bfe1541952fcf5212 to your computer and use it in GitHub Desktop.
Save dannguyen/9e5082ac6a80590bfe1541952fcf5212 to your computer and use it in GitHub Desktop.
Batch installation script for installing fun Python libraries for compciv2017 class (on top of Anaconda/Python 3.5+)
###############################################################################
# Batch script for setting up fun Python libraries for Computational Methods in the Civic Sphere 2017
#
# Should be run after installing Anaconda 4.2+/Python 3.5+ via https://www.continuum.io/downloads
#
# Doesn't include libraries that are installed as dependencies (e.g. numpy via pandas)
##############################################################################
##############################################################################
###### Yes
### awscli: The power of AWS from command-line
# https://aws.amazon.com/cli/
pip install awscli
### boto3: The power of AWS in Python scripting
# https://boto3.readthedocs.io/en/latest/
conda install -y boto3=1.4.1
### csvkit: command-line tools for converting to and working with CSV
# http://csvkit.readthedocs.io/en/latest/
conda install -y csvkit=0.9.1
### cssselect: provides CSS selector queries for lxml
# https://pythonhosted.org/cssselect/
conda install -y cssselect
### Flask: Micro web framework
# http://flask.pocoo.org/
conda install -y flask=0.11.1
### iPython: productive interactive computing
# https://ipython.readthedocs.io/en/stable/
conda install -y ipython=5.1.0
### lxml: best XML/HTML parsing
# http://lxml.de/
conda install -y lxml=3.7.0 --channel conda-forge
### moviepy: programmatic video editing
# http://zulko.github.io/moviepy/
pip install moviepy
### pillow: python imaging library
# https://python-pillow.org/
conda install -y pillow=3.4.2
### pydub: Manipulate audio with a simple and easy high level interface
# http://pydub.com/
pip install pydub
### pyproj: Python interface for PROJ4, i.e. coordinate projection
# https://jswhit.github.io/pyproj/
# https://github.com/dannguyen/python-notebooks-data-wrangling/blob/master/scripts/wrangling-nypd-frisks.py
conda install -y pyproj
### requests: HTTP for Humans
# http://docs.python-requests.org/en/master/
conda install -y requests=2.12.4
### spaCy: Industrial-strength natural language processing
# https://spacy.io/
conda install -y spacy=0.101.0
### xmltodict: easy XML parsing
# https://xmldataset.readthedocs.io/en/latest/
conda install -y xmltodict --channel conda-forge
### youtube-dl: command-line video-archiving
# https://rg3.github.io/youtube-dl/
pip install youtube-dl
##############################################################################
###### Cool stuff
### Geocoder: wrapper around geocoding APIs
# http://geocoder.readthedocs.io/
pip install geocoder
### opencv3
# http://docs.opencv.org/3.0-beta/doc/py_tutorials/py_setup/py_intro/py_intro.html
conda install -y opencv3=3.1.0 --channel menpo
### pdfplumber: Plumb a PDF and easily extract text and tables.
# https://github.com/jsvine/pdfplumber
# https://github.com/dannguyen/pdftotablestable
pip install pdfplumber
### selenium: web browser automation
# http://selenium-python.readthedocs.io/
conda install -y selenium --channel conda-forge
### tweepy: wrapper around Twitter API
# http://docs.tweepy.org/en/v3.5.0/
pip install tweepy
##############################################################################
###### Data stuff
# (hopefully don't need to do data analysis/viz shit for this course, but just in case)
### pandas: R for Python
# http://pandas.pydata.org/
conda install -y pandas=0.19.1
### matplotlib: Python plotting
# http://matplotlib.org/
# http://www.labri.fr/perso/nrougier/teaching/matplotlib/matplotlib.html
conda install -y matplotlib=1.5.3
### basemap: Matplotlib plugin for plotting data on map projections
# https://github.com/matplotlib/basemap
# https://gist.github.com/dannguyen/eb1c4e70565d8cb82d63
conda install -y basemap=1.0.7
### Seaborn: statistical data visualization (pretty matplotlib)
# http://seaborn.pydata.org/
conda install -y seaborn
##############################################################################
###### Experimental
### altair: Declarative statistical visualization library
# https://altair-viz.github.io/
# https://dansaber.wordpress.com/2016/10/02/a-dramatic-tour-through-pythons-data-visualization-landscape-including-ggplot-and-altair/
conda install -y altair --channel conda-forge
### cartopy: A library providing cartographic tools for python.
# http://scitools.org.uk/cartopy/index.html
conda install -y cartopy --channel IOOS
### librosa: Python library for audio and music analysis
# http://librosa.github.io/librosa/index.html
conda install -y librosa --channel conda-forge
# schedule: Python job scheduling for humans
# https://github.com/dbader/schedule
pip install schedule
@adnan-abdullah1
Copy link

Why do we need some packages from Conda and some from pip

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment