Skip to content

Instantly share code, notes, and snippets.

@potetm
Last active August 29, 2015 14:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save potetm/3debf03dbeb4b93f4767 to your computer and use it in GitHub Desktop.
Save potetm/3debf03dbeb4b93f4767 to your computer and use it in GitHub Desktop.
Post batch datomic sqs deploy
  1. Fix the imports that were in flight when we deployed:
  • Get the job ids from the jobs table for incomplete jobs (these are the import ids that were in flight)
  • On a separate router, stop the router process, and start a repl with JVM_OPTS="-Xmx=25g -Xms=25g lein repl :headless :host 0.0.0.0 :port 1987
  • Make sure analytics-engine.maintenance.imports/get-incomplete-docs-for-import returns empty for each import id
    • If not:
    • Send the doc ids to analytics-engine.maintenance.import/requeue-documents-for-upload
    • Make sure analytics-engine.maintenance.imports/get-incomplete-docs-for-import returns empty
  • Since the import is fully uploaded, it is safe to: (analytics-engine.pipeline/handle-job-complete! {:job-id import-id, :job-type :document-uploader})
  1. Fix the 4 failed batches from the document updater:
  • Get the list of id, status maps from the emails.
  • Send the list through analytics-engine.repository.document/batch-update-document-statuses
@bostonou
Copy link

This is done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment