Skip to content

Instantly share code, notes, and snippets.

View mark-dce's full-sized avatar

Mark Bussey mark-dce

13 followers · 1 following
  • Data Curation Experts
  • Minneapolis, MN
View GitHub Profile
@mark-dce
mark-dce / gist:9a6ee536bb6461ccc3f5
Created September 29, 2015 20:14
Resque error on short video upload
Worker
ip-10-157-104-54.ec2.internal:26580 on CHARACTERIZE at just now Retry or Remove
Class
ActiveJob::QueueAdapters::ResqueAdapter::JobWrapper
Arguments
---
job_class: CharacterizeJob
job_id: debc6273-1a46-4088-a78b-f82bd9b769a4
queue_name: characterize
arguments:
@mark-dce
mark-dce / gist:8a98f5613316378e2c2c
Created October 2, 2015 17:00
UCSB CSV Collection Import Error
[ucsb@adrlstage pamss045-Couper]$ date; RAILS_ENV=production /opt/alex2/current/script/import_csv /opt/ingest/metadata/adrl-dm/ingest-ready/pamss045-Couper/marks-pamss045\(Couper\)-collection.csv /opt/ingest/data/ingest/couper-scans
Fri Oct 2 16:58:18 UTC 2015
Loading environment...
Starting image import...
Note property: note_value => From the Mildred Couper papers, PA Mss 45.
Note property: note_type => original
@mark-dce
mark-dce / helm.log
Created October 15, 2015 19:33
Text Importer log for http://wustl.curationexperts.com/concern/texts/jh343s41z
[deploy@ip-10-157-104-54 current]$ RAILS_ENV=production bundle exec script/import -t text -p /opt/sample-data/DCE_WU_content_model/ -v open -a lew
Loading environment
Import Text records using metadata files in: /opt/sample-data/DCE_WU_content_model/
Starting import
19:18:11 Parsing lew1880.0001.007.xml
19:18:12 attaching file: helm_01_0001_bln.tif
19:18:15 attaching file: helm_01_0002_ttl.tif
19:18:19 attaching file: helm_01_0003_unm.tif
19:18:25 attaching file: helm_01_0004_unm.tif
@mark-dce
mark-dce / gist:bdfbffaa8996d233f363
Created October 15, 2015 22:32
Importer seems to slow proportionately to number of object in repo
[deploy@ip-10-157-104-54 current]$ RAILS_ENV=production bundle exec script/import -t text -p /data/helmar/ -v open -a lew
Loading environment
Import Text records using metadata files in: /data/helmar/
Starting import
21:40:00 Parsing lew1880.0001.007.xml
21:40:01 attaching file: lew1880.0001.007.xml
21:40:04 attaching file: helm_01_0001_bln.tif
21:40:07 attaching file: helm_01_0002_ttl.tif
21:40:15 attaching file: helm_01_0003_unm.tif
@mark-dce
mark-dce / gist:00e71cdfa44797008df5
Created October 16, 2015 14:35
helmar importer finish
23:08:44 attaching file: helm_01_0250_243.tif
23:09:25 attaching file: helm_01_0251_244.tif
23:10:07 attaching file: helm_01_0252_245.tif
23:10:50 attaching file: helm_01_0253_246.tif
23:11:31 attaching file: helm_01_0254_247.tif
23:12:12 attaching file: helm_01_0255_248.tif
23:12:55 attaching file: helm_01_0256_249.tif
23:13:36 attaching file: helm_01_0257_250.tif
23:14:18 attaching file: helm_01_0258_251.tif
23:15:00 attaching file: helm_01_0259_252.tif
@mark-dce
mark-dce / gist:6ba250882fd6cdc8d5c6
Created October 22, 2015 14:57
Start of import after Trey's updates - 2015-10-22
14:49:11 Parsing lew1864.0001.001.xml
14:49:12 attaching file: lew1864.0001.001.xml
14:49:13 attaching file: letz_01_0001_unm.tif
14:49:15 attaching file: letz_01_0002_ttl.tif
14:49:18 attaching file: letz_01_0003_bln.tif
14:49:24 attaching file: letz_01_0004_003.tif
14:49:30 attaching file: letz_01_0005_004.tif
14:49:35 attaching file: letz_01_0006_005.tif
14:49:41 attaching file: letz_01_0007_006.tif
14:49:47 attaching file: letz_01_0008_007.tif
@mark-dce
mark-dce / CONTRIBUTING.md
Created June 6, 2013 20:09
Project Hydra Contribution Guidelines v6.0

How to Contribute

We want your help to make Project Hydra great. There are a few guidelines that we need contributors to follow so that we can have a chance of keeping on top of things.

Hydra Project Intellectual Property Licensing and Ownership

All code contributors must have an Individual Contributor License Agreement (iCLA) on file with the Hydra Project Steering Group. If the contributor works for an institution, the institution must have a Corporate Contributor License Agreement (cCLA) on file.

@mark-dce
mark-dce / LICENSE.txt
Created June 12, 2013 06:36
Boilerplate license file for project hydra use.
##########################################################################
# Copyright [yyyy] [originating institution(s)]
# Additional copyright may be held by others, as reflected in the commit log
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
@mark-dce
mark-dce / readme_footer.md
Created June 12, 2013 06:38
Markdown for Hydra info to be placed in footers of main readme in project hydra repos.
@mark-dce
mark-dce / production.log
Created December 21, 2015 16:50
WUSTL Server Production Log excerpt - DELETE "/concern/texts/5m60qs44g"
I, [2015-12-21T16:41:24.194790 #24437] INFO -- : Started DELETE "/concern/texts/5m60qs44g" for 67.220.20.131 at 2015-12-21 16:41:24 +0000
I, [2015-12-21T16:41:24.196092 #24437] INFO -- : Processing by CurationConcerns::TextsController#destroy as HTML
I, [2015-12-21T16:41:24.196144 #24437] INFO -- : Parameters: {"authenticity_token"=>"LjapcqwDLaq6m9NZ8z9UReFlxlr7cmge2nj3ZNLmbws8NOWOKxQZ15G4AmzC3zXWol+nnLPhNGJitVYWUXClqA==", "id"=>"5m60qs44g"}
D, [2015-12-21T16:41:24.492438 #24437] DEBUG -- : Load LDP (287.1ms) http://127.0.0.1:8080/fedora/rest/prod/5m/60/qs/44/5m60qs44g Service: 17794540
D, [2015-12-21T16:41:24.694338 #24437] DEBUG -- : User Load (0.4ms) SELECT "users".* FROM "users" WHERE "users"."id" = $1 ORDER BY "users"."id" ASC LIMIT 1 [["id", 2]]
D, [2015-12-21T16:41:24.695180 #24437] DEBUG -- : Usergroups are ["public", "admin", "registered"]
D, [2015-12-21T16:41:24.734192 #24437] DEBUG -- : Load LDP (24.4ms) http://127.0.0.1:8080/fedora/rest/prod/7h/14/9q/43/7h149q43m Service: 17794540
D