This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import json | |
import urllib.parse | |
import boto3 | |
s3 = boto3.client('s3') | |
dynamodb_client = boto3.resource('dynamodb') | |
table_name = # your dynamodb table name | |
table = dynamodb_client.Table(table_name) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
easy_install pip | |
sudo pip install --upgrade setuptools | |
sudo pip install --upgrade distribute | |
sudo pip install virtualenv virtualenvwrapper | |
echo -e "\nsource /usr/local/bin/virtualenvwrapper.sh" >> .bash_profile | |
mkvirtualenv <your-virtual-env-name> | |
workon <your-virtual-env-name> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
""" | |
Goal is to be able to transform a text file into machine readable form | |
""" | |
import pandas as pd | |
import numpy as np | |
from sklearn import preprocessing | |
#open the file | |
df = pd.read_csv('<your file name>') | |
#select categoricals |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
java -cp .:commons-io-1.2.jar:commons-cli-1.jar:rabbitmq-client.jar:postgresql-9.2-1002.jdbc3.jar Receive |