View asset-manager-nginx.log
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "Host: asset-manager.dev.gov.uk"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "X-Real-IP: 127.0.0.1"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "X-Forwarded-Server: static.dev.gov.uk"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "X-Forwarded-For: 127.0.0.1"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "X-Forwarded-Host: static.dev.gov.uk"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "Connection: close"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari
/537.36"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "Upgrade-Insecure-Requests: 1"
2018/01/23 16:11:22 [debug] 17761#0: *5 http header: "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8"
View 2018-01-23-gds-updates.md

Achievements

  • Migrated more non-attachment assets from Whitehall to Asset Manager
  • Started serving the migrated Whitehall non-attachment assets from Asset Manager

Ongoing and next

  • Continuing to migrate remaining non-attachment assets from Whitehall to Asset Manager and removing them from NFS
  • Continuing to switch these Whitehall assets over to be served from Asset Manager
  • Spiking on supporting attachment assets from Whitehall in Asset Manager (authorisation for drafts)
View whitehall-attachment-problem.md

Backend/Admin

jamesmead@ec2-integration-blue-whitehall_backend-ip-10-1-6-139:~$ curl -s -v "https://whitehall-admin.integration.govuk-internal.digital/government_data/file/672533/netLec7.pdf" >/dev/null
* Hostname was NOT found in DNS cache
*   Trying 10.1.6.248...
* Connected to whitehall-admin.integration.govuk-internal.digital (10.1.6.248) port 443 (#0)
* successfully set certificate verify locations:
*   CAfile: none
  CApath: /etc/ssl/certs
View 2018-01-16-gds-updates.md

Achievements

  • Deleted all Asset Manager assets from NFS - they are now stored on S3
  • Started serving more of the migrated Whitehall assets from Asset Manager
  • Fixed problem with migrating assets with non-ascii characters in filenames
  • Improved performance of Whitehall-related actions in Asset Manager
  • Helped diagnose problems with assets relating to the move of the integration environment to AWS

Ongoing and next

View GDS_SSO_STRATEGY.log
vagrant@development:/var/apps/whitehall$ sudo sh -c "echo 'real' > /etc/govuk/whitehall/env.d/GDS_SSO_STRATEGY"
vagrant@development:/var/apps/whitehall$ sudo cat /etc/govuk/whitehall/env.d/GDS_SSO_STRATEGY
real
View explain-with-index.rb
{"queryPlanner"=>
{"plannerVersion"=>1,
"namespace"=>"govuk_assets_development.assets",
"indexFilterSet"=>false,
"parsedQuery"=>
{"$and"=>
[{"_type"=>{"$eq"=>"WhitehallAsset"}},
{"deleted_at"=>{"$eq"=>nil}},
{"legacy_url_path"=>{"$eq"=>"foo"}}]},
"winningPlan"=>
View publishing-api-development.log
Started PUT "/v2/content/665bdfa0-a8a9-4588-9030-f2fb338f9878" for 127.0.0.1 at 2018-01-11 12:21:30 +0000
Processing by V2::ContentItemsController#put_content as JSON
Parameters: {"title"=>"Testing attachment access", "locale"=>"en", "publishing_app"=>"whitehall", "redirects"=>[], "update_type"=>"major", "description"=>"Testing attachment access - Summary", "details"=>{"body"=>"<div class=\"govspeak\"><p>Testing attachment access - Body</p>\n</div>", "change_history"=>[], "documents"=>[], "emphasised_organisations"=>["300ee6db-9ed5-4d74-8f06-889663fd4a3d"], "political"=>false, "government"=>nil, "tags"=>{"browse_pages"=>[], "policies"=>[], "topics"=>[]}, "first_public_at"=>"2018-01-11T12:21:29.000+00:00"}, "document_type"=>"policy_paper", "public_updated_at"=>"2018-01-11T12:21:29.000+00:00", "rendering_app"=>"government-frontend", "schema_name"=>"publication", "links"=>{"topics"=>[], "parent"=>[], "organisations"=>["300ee6db-9ed5-4d74-8f06-889663fd4a3d"], "world_locations"=>[], "policy_areas"=>["3f2c03fa-00
View govuk-development-vm.md

Data replication

The idea here is to load the routes for the router and draft-router. Life's too short to work out how to create the routes manually!

  • cd /var/govuk/govuk-puppet/development-vm/replication
  • Apply replicate-data-local.diff patch to skip all dbs on mongo-1.backend & api-mongo-1.api
  • Run the following command to import data for router & draft-router: ./replicate-data-local.sh -s -d backups/YYYY-MM-DD -p -q -e -t -i 'collections_publisher contacts release search_admin tariff_admin tariff_temporal'

Authenticating proxy

View TODO.md
  • Rebuild dev VM
  • Import routes
  • Create minimal other data, e.g. Whitehall user
  • Run all the relevant apps with bowl, including draft-government-frontend