Skip to content

Instantly share code, notes, and snippets.

View josephglanville's full-sized avatar

Joseph Glanville josephglanville

56 followers · 23 following
View GitHub Profile
@josephglanville
josephglanville / master_status
Created July 29, 2016 05:50
MariaDB semi-sync hang
+--------------------+----------+--------------+------------------+
| File | Position | Binlog_Do_DB | Binlog_Ignore_DB |
+--------------------+----------+--------------+------------------+
| mariadb-bin.000005 | 329 | | |
+--------------------+----------+--------------+------------------+
@josephglanville
josephglanville / hang.log
Created July 28, 2016 12:57
MariaDB hang
2016-07-28T12:49:59.135827Z app[mariadb.host2-34df8696-457d-47a8-9014-f67ce6ebbd9b]: 2016-07-28 12:49:59 139690207103744 [Note] ReplSemiSyncMaster::updateSyncHeader: server(1684293900), (mariadb-bin.000005, 105654222) sync(1), repl(1)
2016-07-28T12:49:59.135934Z app[mariadb.host2-34df8696-457d-47a8-9014-f67ce6ebbd9b]: 2016-07-28 12:49:59 139690207103744 [Note] ReplSemiSyncMaster::readSlaveReply: Wait for replica's reply
2016-07-28T12:49:59.135897Z app[mariadb.host0-42aa03f8-a07d-497d-9534-074b8af0bf46]: 2016-07-28 12:49:59 140201364466432 [Note] ReplSemiSyncSlave::slaveReadSyncHeader: reply - 0
2016-07-28T12:49:59.401808Z app[mariadb.host2-34df8696-457d-47a8-9014-f67ce6ebbd9b]: 2016-07-28 12:49:59 139690207103744 [Note] ReplSemiSyncMaster::readSlaveReply: Got reply (mariadb-bin.000005, 105654222)
2016-07-28T12:49:59.401857Z app[mariadb.host2-34df8696-457d-47a8-9014-f67ce6ebbd9b]: 2016-07-28 12:49:59 139690207103744 [Note] ActiveTranx::::clear_active_tranx_nodes: cleared all nodes
2016-07-28T12:49:59.401667Z a
@josephglanville
josephglanville / new_system_app.md
Created March 16, 2016 10:25
Add new system app to Flynn

Adding a new system app

For all system apps

  • Add to bootstrap manifest template in bootstrap/manifest_template.json use deploy-app action unless app is pre-controller.
  • Add to image to release manifest in util/release/version_template.json
  • Add to updater SystemApps in updater/types/types.go
@josephglanville
josephglanville / get_cedar_packages.rb
Created February 28, 2016 04:16
Gets list of currently included packages in the Cedar-14 stack
require 'mechanize'
mechanize = Mechanize.new
page = mechanize.get('https://devcenter.heroku.com/articles/cedar-ubuntu-packages')
rows = page.xpath('/html/body/div/div/div/article/table/tr')
pkgs = rows.map {|r| r.xpath('td').map {|e| e.text.strip}}
pkgs.each do |pkg|
if pkg[2] != "absent"
@josephglanville
josephglanville / flynn-host.log
Created February 6, 2016 01:10
ec2 stop+start then reboot
INFO[02-06|00:59:20] starting daemon app=host pid=2240 fn=runDaemon host.id=ip100773
INFO[02-06|00:59:20] validating host ID app=host pid=2240 fn=runDaemon host.id=ip100773
INFO[02-06|00:59:20] detecting external IP app=host pid=2240 fn=runDaemon host.id=ip100773
INFO[02-06|00:59:20] using external IP 10.0.7.73 app=host pid=2240 fn=runDaemon host.id=ip100773
INFO[02-06|00:59:20] registering with cluster discovery service app=host pid=2240 fn=runDaemon host.id=ip100773 token=https://discovery.flynn.io/clusters/8c5e917a-6407-426b-9470-ec192467e1be addr=10.0.7.73:1113 name=ip100773
INFO[02-06|00:59:22] registered with cluster discovery service app=host pid=2240 fn=runDaemon host.id=ip100773 id=221ec50d-9a1a-48d1-b573-cc61128bc6ba
INFO[02-06|00:59:22] initializing volume manager app=host pid=2240 fn=runDaemon host.id=ip100773 provider=zfs
INFO[02-06|00:59:22] initializing job backend app=host pid=2240 fn=ru
@josephglanville
josephglanville / pgxlog.go
Created February 1, 2016 00:58
//
// This Source Code Form is subject to the terms of the Mozilla Public
// License, v. 2.0. If a copy of the MPL was not distributed with this
// file, You can obtain one at http://mozilla.org/MPL/2.0/.
//
// This file is derived from:
// https://github.com/joyent/manatee-state-machine/blob/d441fe941faddb51d6e6237d792dd4d7fae64cc6/lib/xlog.js
//
// Copyright (c) 2014, Joyent, Inc.
// Copyright (c) 2015, Prime Directive, Inc.
@josephglanville
josephglanville / xlog.go
Created February 1, 2016 00:58
package xlog
type Position string
type XLog interface {
// Returns the zero position for this xlog
Zero() Position
// Increment increments an xlog position by the given number.
// Returns the new position of the xlog.
Increment(Position, int) (Position, error)
@josephglanville
josephglanville / scheduler.log
Created January 27, 2016 19:19
t=2016-01-27T18:42:53+0000 lvl=info msg="creating cluster and controller clients" component=scheduler fn=main
t=2016-01-27T18:42:53+0000 lvl=info msg="started scheduler" component=scheduler fn=main backoffPeriod=10m0s
t=2016-01-27T18:42:53+0000 lvl=info msg="starting scheduler loop" component=scheduler fn=Run
t=2016-01-27T18:42:53+0000 lvl=info msg="connecting host event stream" component=scheduler fn=streamHostEvents
t=2016-01-27T18:42:53+0000 lvl=info msg="serving HTTP requests" component=scheduler fn=startHTTPServer addr=:5000
t=2016-01-27T18:42:53+0000 lvl=info msg="handling host event" component=scheduler fn=HandleHostEvent event.type=up
t=2016-01-27T18:42:53+0000 lvl=info msg="host is up, starting job event stream" component=scheduler fn=handleNewHost host.id=host0
t=2016-01-27T18:42:53+0000 lvl=info msg="connecting job event stream" component=scheduler fn=StreamEventsTo host.id=host0
t=2016-01-27T18:42:53+0000 lvl=info msg="getting active jobs" component=scheduler fn=StreamEventsTo host.id=host0
t=2016
@josephglanville
josephglanville / scheduler.log
Created January 24, 2016 20:00
253 <0>1 2016-01-24T19:17:09.469188Z host0 bfdcde4b-ac74-4fc8-8352-24d516514e15 scheduler.host0-633892dd-bbb4-4b9f-98ae-fd2a617d8566 ID3 [flynn seq="308"] t=2016-01-24T19:17:09+0000 lvl=info msg="registering RPC server" app=containerinit fn=containerInitApp
252 <0>1 2016-01-24T19:17:09.4692998Z host0 bfdcde4b-ac74-4fc8-8352-24d516514e15 scheduler.host0-633892dd-bbb4-4b9f-98ae-fd2a617d8566 ID3 [flynn seq="309"] t=2016-01-24T19:17:09+0000 lvl=info msg="creating stdout pipe" app=containerinit fn=containerInitApp
252 <0>1 2016-01-24T19:17:09.4693121Z host0 bfdcde4b-ac74-4fc8-8352-24d516514e15 scheduler.host0-633892dd-bbb4-4b9f-98ae-fd2a617d8566 ID3 [flynn seq="310"] t=2016-01-24T19:17:09+0000 lvl=info msg="creating stderr pipe" app=containerinit fn=containerInitApp
253 <0>1 2016-01-24T19:17:09.4693196Z host0 bfdcde4b-ac74-4fc8-8352-24d516514e15 scheduler.host0-633892dd-bbb4-4b9f-98ae-fd2a617d8566 ID3 [flynn seq="311"] t=2016-01-24T19:17:09+0000 lvl=info msg="waiting to be resumed" app=containerinit fn=containerIn
@josephglanville
josephglanville / .flynnrc
Created December 10, 2015 10:08
default = "default"
[[cluster]]
Name = "default"
Key = "e58aee407ce6ffb8992703a95a7b824b"
TLSPin = "EnQtOwTJL4spiC/5qywh94CkNJIa9KFclVGTwiL5VJI="
ControllerURL = "https://controller.3.localflynn.com"
GitURL = "https://git.3.localflynn.com"