This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "aliases":{}, | |
| "warmers":{}, | |
| "mappings": { | |
| "world": { | |
| "properties": { | |
| "capital": { | |
| "properties": { | |
| "district": { | |
| "type": "string" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ###### development tools | |
| sudo apt-get install build-essential python-dev git nodejs-legacy npm gnome-tweak-tool openjdk-8-jdk | |
| ### Python packages | |
| sudo apt-get install python-pip python-virtualenv python-numpy python-matplotlib | |
| ### pip packages | |
| pip install django flask django-widget-tweaks django-ckeditor beautifulsoup4 requests classifier SymPy ipython |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| tiny script to convert a pandas data frame into a JSON object | |
| """ | |
| import ujson as json | |
| import pandas | |
| import numpy as np | |
| df = pandas.DataFrame({ | |
| "time" : [1,2,3,4,5], |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## invoking pyspark as follows: ## | |
| # /path/to/spark-1.2.0-bin-hadoop2.4/bin/pyspark --jars /path/to/spark-1.2.0-bin-hadoop2.4/jars/spark-cassandra-connector-assembly-1.2.0-SNAPSHOT.jar | |
| # first, stop the spark context launched by pyspark to avoid the conflict | |
| sc.stop() | |
| from py4j.java_gateway import java_import | |
| from pyspark import SparkConf | |
| conf = (SparkConf() | |
| .setMaster("local") |
NewerOlder