This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
{ | |
"AWSTemplateFormatVersion" : "2012-10-17", | |
"Description" : "Launch EC2 Instance as a bastion host for Qubole. http://docs.qubole.com/en/latest/user-guide/clusters/clusters-in-vpcs.html.", | |
"Parameters" : { | |
"AccountName" : { | |
"Description" : "For tagging purposes - example : BI Sales Department", | |
"Type" : "String" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
import boto3 | |
import argparse | |
# Available args: | |
# Environment | |
# --env dev, stage or prod | |
# | |
# run the script from a command line like so: | |
# python boto-s3-things.py --env=stage |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
{ | |
"AWSTemplateFormatVersion": "2010-09-09", | |
"Description": "The AWS CloudFormation template for Kinesis Stream", | |
"Parameters": { | |
"Environment": { | |
"Description": "dev, stage, or prod - this is for bucket tags", | |
"Type": "String", | |
"MinLength": "3", | |
"MaxLength": "5" | |
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# finish dis later | |
sudo pip install kaggle-cli | |
kg download -u 'myUsername' -p 'myPassword' -d DigitRecognizer -f test.csv | |
# https://www.kaggle.com/seanlahman/the-history-of-baseball/downloads/the-history-of-baseball.zip | |
# https://www.kaggle.com/seanlahman/the-history-of-baseball |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/Rscript | |
library("RSiteCatalyst") | |
project_name <- "testing-omniture" | |
rsid <- "REPORT-SUITE-ID" | |
rsid_friendly <- "FRIENDLY-NAME" | |
today_dt <- Sys.Date() | |
date.1.start <- Sys.Date()-3 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/Rscript | |
library(aws.s3) | |
library(stringi) | |
source("./credentials/aws.txt") | |
#bucketlist() | |
s3conn <- rawConnection(raw(0), "r+") | |
#this is not writing anything out.... | |
tempfile <- paste0("hello this is a test.") | |
put_object(tempfile, | |
object = ("liz-example/redshift/tempfile"), |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
usage() { | |
echo " | |
Usage: | |
-e Environment (dev, stage, prod) | |
" | |
} | |
while getopts "e:" flag |