- Fix the imports that were in flight when we deployed:
- Get the job ids from the jobs table for incomplete jobs (these are the import ids that were in flight)
- On a separate router, stop the router process, and start a repl with
JVM_OPTS="-Xmx=25g -Xms=25g lein repl :headless :host 0.0.0.0 :port 1987
- Make sure
analytics-engine.maintenance.imports/get-incomplete-docs-for-import
returns empty for each import id- If not:
- Send the doc ids to
analytics-engine.maintenance.import/requeue-documents-for-upload
- Make sure
analytics-engine.maintenance.imports/get-incomplete-docs-for-import
returns empty
- Since the import is fully uploaded, it is safe to:
(analytics-engine.pipeline/handle-job-complete! {:job-id import-id, :job-type :document-uploader})
- Fix the 4 failed batches from the document updater:
- Get the list of id, status maps from the emails.
- Send the list through
analytics-engine.repository.document/batch-update-document-statuses
This is done.