Skip to content

Instantly share code, notes, and snippets.

@mattlqx
Last active December 4, 2015 18:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mattlqx/6293024a4989dcd9c322 to your computer and use it in GitHub Desktop.
Save mattlqx/6293024a4989dcd9c322 to your computer and use it in GitHub Desktop.
Opsworks agent update 3430 on 14.04
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Updating the instance agent to version 3430-20151125145248
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Starting: Downloading new agent version 3430-20151125145248
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: [ Fri, 04 Dec 2015 18:45:01 +0000 ] downloader: Successfully created temporary download directory. (/tmp/opsworks-downloader.PhXKCRxL)
[ Fri, 04 Dec 2015 18:45:01 +0000 ] downloader: File size test passed.
[ Fri, 04 Dec 2015 18:45:01 +0000 ] downloader: Checksum proof passed.
[ Fri, 04 Dec 2015 18:45:01 +0000 ] downloader: Successfully downloaded https://opsworks-instance-agent-us-east-1.s3.amazonaws.com/3430-20151125145248/opsworks-agent-installer.tgz
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Finished: Downloading new agent version 3430-20151125145248 (0 sec)
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Starting: Updating the agent
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Extracting new agent
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: About to execute `"tar xzpof /tmp/opsworks-agent-installer.tgz"` from /tmp/d20151204-5645-1o2zznr with 0 retries
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Deleting downloaded files
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: About to execute `"rm -vf /tmp/opsworks-agent-installer.tgz*"` from /tmp with 0 retries
[2015-12-04 18:45:01] DEBUG [agent-updater (5645)]: removed ‘/tmp/opsworks-agent-installer.tgz’
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Installing the new downloaded agent
[2015-12-04 18:45:01] INFO [agent-updater (5645)]: Starting: Running update-installer
[2015-12-04 18:45:01] INFO [update-installer (5645)]: Starting: Installing ruby
[2015-12-04 18:45:01] INFO [update-installer (5645)]: About to execute `"/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/../../bin/installer_wrapper.sh -r -R 'opsworks-instance-assets-us-east-1.s3.amazonaws.com'"` from /tmp with 0 retries
[2015-12-04 18:45:20] DEBUG [update-installer (5645)]: Using opsworks-instance-assets-us-east-1.s3.amazonaws.com for assets.
Downloading agent ruby package
[ Fri, 04 Dec 2015 18:45:01 +0000 ] downloader: Successfully created temporary download directory. (/tmp/opsworks-downloader.lGv9J9Dw)
[ Fri, 04 Dec 2015 18:45:02 +0000 ] downloader: File size test passed.
[ Fri, 04 Dec 2015 18:45:02 +0000 ] downloader: Checksum proof skipped.
[ Fri, 04 Dec 2015 18:45:02 +0000 ] downloader: Successfully downloaded https://opsworks-instance-assets-us-east-1.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
Installing agent ruby
(Reading database ... 102416 files and directories currently installed.)
Preparing to unpack .../opsworks-agent-ruby_2.0.0-p645-1_amd64.deb ...
Unpacking opsworks-agent-ruby (2.0.0-p645-1) over (2.0.0-p645-1) ...
Setting up opsworks-agent-ruby (2.0.0-p645-1) ...
Cleanning up
[2015-12-04 18:45:20] INFO [update-installer (5645)]: Finished: Installing ruby (19 sec)
[2015-12-04 18:45:20] INFO [update-installer (5645)]: Starting: Installing new instance agent
[2015-12-04 18:45:20] INFO [update-installer (5645)]: Creating basic directory structure
[2015-12-04 18:45:20] INFO [update-installer (5645)]: Populating agent home directory with current release
[2015-12-04 18:45:20] INFO [update-installer (5645)]: Finished: Installing new instance agent (0 sec)
[2015-12-04 18:45:20] INFO [update-installer (5645)]: Starting: Installing new bundled gems
[2015-12-04 18:45:20] INFO [update-installer (5645)]: About to execute `"/opt/aws/opsworks/local/bin/bundle install --local --shebang '/opt/aws/opsworks/local/bin/ruby' --binstubs --deployment"` from /opt/aws/opsworks/releases/20151125145248_3430-20151125145248 with 0 retries
[2015-12-04 18:45:38] DEBUG [update-installer (5645)]: Installing rake (10.0.3)
Installing i18n (0.6.9)
Installing multi_json (1.7.4)
Installing activesupport (3.2.16)
Installing json (1.7.7)
Installing nokogiri (1.5.9)
Installing aws-sdk-v1 (1.65.0)
Installing aws-sdk (1.65.0)
Installing metaclass (0.0.2)
Installing mocha (0.13.3)
Installing bourne (1.5.0)
Installing builder (3.2.2)
Installing hashie (2.0.5)
Installing mixlib-log (1.6.0)
Installing moneta (0.6.0)
Installing rack (1.5.2)
Installing chef-zero (1.7.3)
Installing diff-lcs (1.2.5)
Installing erubis (2.7.0)
Installing highline (1.6.19)
Installing mime-types (1.23)
Installing mixlib-authentication (1.3.0)
Installing mixlib-cli (1.4.0)
Installing mixlib-config (2.1.0)
Installing mixlib-shellout (1.4.0)
Installing net-ssh (2.8.0)
Installing net-ssh-gateway (1.2.0)
Installing net-ssh-multi (1.1)
Using ohai (6.20.0) from source at vendor/gems/ohai-6.20.0
Installing coderay (1.1.0)
Installing method_source (0.8.2)
Installing slop (3.4.7)
Installing pry (0.9.12.6)
Installing puma (1.6.3)
Installing rest-client (1.6.7)
Installing yajl-ruby (1.2.0)
Installing chef (11.10.4)
Installing ci_reporter (1.9.1)
Installing daemons (1.1.9)
Installing fakefs (0.5.1)
Installing gli (2.5.6)
Installing ipaddress (0.8.0)
Installing minitest (4.7.5)
Installing minitest-chef-handler (1.0.1)
Installing simple_pid (0.2.1)
Installing process_manager (0.0.18)
Installing ruby-hmac (0.4.0)
Installing shoulda-context (1.1.2)
Installing shoulda-matchers (1.5.6)
Installing shoulda (3.5.0)
Installing systemu (2.5.2)
Installing test-unit (2.5.5)
Installing thor (0.18.1)
Installing timecop (0.6.1)
Installing uuidtools (2.1.4)
Using bundler (1.5.3)
Updating files in vendor/cache
Your bundle is complete!
Gems in the group " were not installed.
It was installed into ./vendor/bundle
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Finished: Installing new bundled gems (18 sec)
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Starting: Installing new lockrun
[2015-12-04 18:45:38] INFO [update-installer (5645)]: About to execute `"gcc /opt/aws/opsworks/releases/20151125145248_3430-20151125145248/vendor/lockrun/lockrun.c -o /opt/aws/opsworks/releases/20151125145248_3430-20151125145248/bin/lockrun"` from /tmp with 0 retries
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Finished: Installing new lockrun (0 sec)
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Starting: Symlinking new instance agent
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Linking new release
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Unlinking last release
[2015-12-04 18:45:38] ERROR [update-installer (5645)]: Update unsuccessful, trying to rollback: No such file or directory - /etc/systemd/system/opsworks-agent.service - /opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:1439:in `unlink'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:1439:in `block in remove_file'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:1444:in `platform_support'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:1438:in `remove_file'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:785:in `remove_file'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:563:in `block in rm'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:562:in `each'
/opt/aws/opsworks/local/lib/ruby/2.0.0/fileutils.rb:562:in `rm'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/installer.rb:108:in `unlink_init_system'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/installer.rb:93:in `unlink_last_release'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/installer.rb:100:in `symlink_current_release'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/update_installer.rb:34:in `block in run'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/log.rb:96:in `measure'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/update_installer.rb:34:in `run'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/update_installer.rb:16:in `run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:71:in `block (2 levels) in update_or_rollback'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/log.rb:96:in `measure'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:71:in `block in update_or_rollback'
/opt/aws/opsworks/local/lib/ruby/2.0.0/tmpdir.rb:88:in `mktmpdir'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:61:in `update_or_rollback'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/instance_agent_updater.rb:35:in `block in run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/log.rb:96:in `measure'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/instance_agent_updater.rb:35:in `run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/instance_agent_updater.rb:11:in `run'
/opt/aws/opsworks/current/bin/opsworks-agent-updater:11:in `<main>'
[2015-12-04 18:45:38] INFO [update-installer (5645)]: Starting: Running rollback procedure
[2015-12-04 18:45:38] INFO [rollback (5645)]: Starting: Symlinking the last agent to be current again
[2015-12-04 18:45:38] INFO [rollback (5645)]: Linking new release
[2015-12-04 18:45:38] INFO [rollback (5645)]: Finished: Symlinking the last agent to be current again (0 sec)
[2015-12-04 18:45:38] INFO [rollback (5645)]: Starting: Stoping monit
[2015-12-04 18:45:38] INFO [rollback (5645)]: About to execute `"service monit stop"` from /tmp with 0 retries
[2015-12-04 18:45:39] DEBUG [rollback (5645)]: * Stopping daemon monitor monit
...done.
[2015-12-04 18:45:39] INFO [rollback (5645)]: Finished: Stoping monit (1 sec)
[2015-12-04 18:45:39] INFO [rollback (5645)]: Starting: Bootstrapping monit
[2015-12-04 18:45:39] INFO [rollback (5645)]: Reboot not required - will restart monit now.
[2015-12-04 18:45:39] INFO [rollback (5645)]: About to execute `"service monit restart"` from /tmp with 0 retries
[2015-12-04 18:45:39] DEBUG [rollback (5645)]: * Restarting daemon monitor monit
...done.
[2015-12-04 18:45:39] INFO [rollback (5645)]: Finished: Bootstrapping monit (0 sec)
[2015-12-04 18:45:39] INFO [rollback (5645)]: Starting: Make sure any instance agent processes are stopped
[2015-12-04 18:45:39] ERROR [rollback (5645)]: Failed to rollback - agent installation may be broken: Failed to stop agent - /opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/system.rb:190:in `block (3 levels) in <module:System>'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/system.rb:189:in `chdir'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/system.rb:189:in `block (2 levels) in <module:System>'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/rollback.rb:32:in `block in run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/log.rb:96:in `measure'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/rollback.rb:32:in `run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/rollback.rb:15:in `run'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/updater.rb:90:in `block in rollback'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/log.rb:96:in `measure'
/tmp/d20151204-5645-1o2zznr/opsworks-agent-installer/opsworks-agent/lib/bootstrap/updater.rb:90:in `rollback'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:78:in `rescue in block in update_or_rollback'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:70:in `block in update_or_rollback'
/opt/aws/opsworks/local/lib/ruby/2.0.0/tmpdir.rb:88:in `mktmpdir'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:61:in `update_or_rollback'
/opt/aws/opsworks/local/lib/ruby/2.0.0/tmpdir.rb:88:in `mktmpdir'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/updater.rb:61:in `update_or_rollback'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/instance_agent_updater.rb:35:in `block in run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/log.rb:96:in `measure'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/instance_agent_updater.rb:35:in `run'
/opt/aws/opsworks/releases/20151028121402_3428-20151028121402/lib/bootstrap/instance_agent_updater.rb:11:in `run'
/opt/aws/opsworks/current/bin/opsworks-agent-updater:11:in `<main>'
[2015-12-04 18:45:39] INFO [rollback (5645)]: Deleting failed update: /opt/aws/opsworks/releases/20151125145248_3430-20151125145248
[2015-12-04 18:45:39] INFO [rollback (5645)]: Finished: Updating the agent (38 sec)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment