Skip to content

Instantly share code, notes, and snippets.

@psykidellic

psykidellic/gist:6167276

Created August 6, 2013 18:36
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save psykidellic/6167276 to your computer and use it in GitHub Desktop.
Save psykidellic/6167276 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
-- Run script that dumps DB data into csv over S3
-- Run EMR script to while will process the data - maybe executed as cron from our ec2?
-- Saves processed data in CSV over s3
-- Scripts runs and puts the data from CSV into PGSQL DB.
-- Remove old CSV, new CSV and close the EMR instance.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment