Skip to content

Instantly share code, notes, and snippets.

View rberger's full-sized avatar

Robert J. Berger rberger

67 followers · 133 following
View GitHub Profile
@rberger
rberger / AllowChangePassword.json
Created August 3, 2015 05:09
Additional iam policies to allow power users to update their console password and 2FA
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowUsersAllActionsForCredentials",
"Effect": "Allow",
"Action": [
"iam:*LoginProfile",
"iam:*AccessKey*",
"iam:*SigningCertificate*"
@rberger
rberger / invalid-user.log
Created July 24, 2015 22:49
Sample of stuff filling up files like /var/log/mesos/mesos-master.ip-10-0-7-66.us-west-2.compute.internal.invalid-user.log.INFO.*
I0724 06:02:37.594578 1886 master.cpp:3763] Sending 1 offers to framework 20150709-213701-1107755018-5050-1878-0001 (cassandra.dcos) at scheduler-ab5b99ab-9c57-49ff-a354-b73d38776eea@10.0.3.154:39431
I0724 06:02:37.594882 1886 master.cpp:3763] Sending 1 offers to framework 20150709-213701-1107755018-5050-1878-0005 (hdfs) at scheduler-42e50ad0-c157-41ff-bf4f-f113320f4173@10.0.3.154:45553
I0724 06:02:37.595080 1886 master.cpp:3763] Sending 1 offers to framework 20150709-213701-1107755018-5050-1878-0002 (kafka) at scheduler-dc1ad9aa-dd65-4340-8b20-1bc3716d329c@10.0.3.157:41974
I0724 06:02:37.597298 1890 master.cpp:2276] Processing ACCEPT call for offers: [ 20150709-213701-1107755018-5050-1878-O4453513 ] on slave 20150709-213701-1107755018-5050-1878-S2 at slave(1)@10.0.3.154:5051 (ip-10-0-3-154.us-west-2.compute.internal) for framework 20150709-213701-1107755018-5050-1878-0001 (cassandra.dcos) at scheduler-ab5b99ab-9c57-49ff-a354-b73d38776eea@10.0.3.154:39431
I0724 06:02:37.597643 1890 hierarchical.hpp:632]
@rberger
rberger / chef_ntp_debug_output
Created May 16, 2015 20:06
Snippet of initial Chef client run that fails on ntp::apparmor restart
[2015-05-16T19:56:01+00:00] INFO: service[ntp] restarted
- restart service service[ntp]
[2015-05-16T19:56:01+00:00] INFO: cookbook_file[/etc/apparmor.d/usr.sbin.ntpd] sending restart action to service[apparmor] (delayed)
Recipe: ntp::apparmor
* service[apparmor] action restart[2015-05-16T19:56:01+00:00] INFO: Processing service[apparmor] action restart (ntp::apparmor line 20)
[2015-05-16T19:56:01+00:00] DEBUG: providers for generic service resource enabled on node include: [Chef::Provider::Service::Debian, Chef::Provider::Service::Init, Chef::Provider::Service::Invokercd, Chef::Provider::Service::Upstart]
[2015-05-16T19:56:01+00:00] DEBUG: providers that refused resource service[apparmor] were: [Chef::Provider::Service::Upstart]
[2015-05-16T19:56:01+00:00] DEBUG: providers that support resource service[apparmor] include: [Chef::Provider::Service::Debian, Chef::Provider::Service::Init, Chef::Provider::Service::Invokercd]
[2015-05-16T19:56:01+00:00] DEBUG: providers that survived replacement include: [Ch
@rberger
rberger / ProducerPerformance.txt
Created January 9, 2015 22:46
Kafka Performance test yammer metrics CsvReport always fails to create csv file
bin/kafka-run-class.sh kafka.tools.ProducerPerformance --topics ${topic_base_name}-part-1-rep-3 --messages 5000 --message-size 100 --request-num-acks -1 --broker-list ${kafka0}:${kafka_port},${kafka1}:${kafka_port},${kafka2}:${kafka_port} --batch-size 8196 --csv-reporter-enabled
start.time, end.time, compression, message.size, batch.size, total.data.sent.in.MB, MB.sec, total.data.sent.in.nMsg, nMsg.sec
java.io.IOException: Unable to create kafka_metrics/ProducerRequestSize.csv
at com.yammer.metrics.reporting.CsvReporter.createStreamForMetric(CsvReporter.java:141)
at com.yammer.metrics.reporting.CsvReporter.getPrintStream(CsvReporter.java:257)
at com.yammer.metrics.reporting.CsvReporter.access$000(CsvReporter.java:22)
at com.yammer.metrics.reporting.CsvReporter$1.getStream(CsvReporter.java:156)
at com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:194)
at com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:22)
@rberger
rberger / An item in Kibana
Created December 16, 2014 03:54
Data in Elasticsearch but not in Kibana 4
{
"_index": "ep-client-stats-staging-v2",
"_type": "stats",
"_id": "41bcc398-2298-4925-b0d4-6df13749a54f",
"_score": 7.4639173,
"_source": {
"WhenAddedToEsBulkProcessor": "2014-12-16T01:19:51.448Z",
"WhenPublishedToKafka": "2014-12-16T01:09:21.042196751Z",
"When": "2014-12-16T01:09:21.168220861Z",
"WhenConsumedFromKafka": "2014-12-16T01:09:21.146Z",
@rberger
rberger / Example Chefspec file
Created October 16, 2014 05:04
How to have an external cookbook's LWRP matcher used in nested describes in Chefspec
require 'chefspec'
require 'chefspec/berkshelf'
describe 'base::default' do
let(:chef_run) { ChefSpec::SoloRunner.converge(described_recipe) }
it { expect(chef_run).to include_recipe('base::_setup') }
it { expect(chef_run).to include_recipe('base::_route53') }
describe 'base::_setup' do
@rberger
rberger / Gemfile.lock
Created May 28, 2014 21:19
Gemfile.lock for chef-metal run of 'bar'
GIT
remote: git://github.com/berkshelf/vagrant-berkshelf.git
revision: b72aaf75c46b1ce99c8353e3a475e58795ecc4b7
specs:
vagrant-berkshelf (2.0.1)
berkshelf (~> 3.1)
celluloid (~> 0.16.0.pre)
celluloid-io (~> 0.16.0.pre)
GIT
@rberger
rberger / stacktrace.txt
Created May 28, 2014 21:17
stacktrace of "bar" run
Generated at 2014-05-28 14:13:35 -0700
Net::HTTPServerException: machine_batch[default] (dev02::web_server line 20) had an error: Net::HTTPServerException: chef_client[bar] (basic_chef_client::block line 133) had an error: Net::HTTPServerException: 403 "Forbidden"
/Users/rberger/.rvm/rubies/ruby-1.9.3-p547/lib/ruby/1.9.1/net/http.rb:2633:in `error!'
/Users/rberger/.rvm/gems/ruby-1.9.3-p547@rfspot-metal/gems/chef-11.12.4/lib/chef/http.rb:143:in `request'
/Users/rberger/.rvm/gems/ruby-1.9.3-p547@rfspot-metal/gems/chef-11.12.4/lib/chef/http.rb:124:in `post'
/Users/rberger/.rvm/gems/ruby-1.9.3-p547@rfspot-metal/gems/cheffish-0.5.beta.3/lib/cheffish/actor_provider_base.rb:30:in `block in create_actor'
/Users/rberger/.rvm/gems/ruby-1.9.3-p547@rfspot-metal/gems/chef-11.12.4/lib/chef/mixin/why_run.rb:52:in `call'
/Users/rberger/.rvm/gems/ruby-1.9.3-p547@rfspot-metal/gems/chef-11.12.4/lib/chef/mixin/why_run.rb:52:in `add_action'
/Users/rberger/.rvm/gems/ruby-1.9.3-p547@rfspot-metal/gems/chef-11.12.4/lib/chef/provider.
@rberger
rberger / chef-client run
Last active August 29, 2015 14:01
Failure with second "bar" instance
> chef-client -c .chef/client.rb -o dev02::web_server -l info
[2014-05-28T14:12:25-07:00] INFO: Forking chef instance to converge...
Starting Chef Client, version 11.12.4
[2014-05-28T14:12:25-07:00] INFO: *** Chef 11.12.4 ***
[2014-05-28T14:12:25-07:00] INFO: Chef-client pid: 5297
[2014-05-28T14:12:30-07:00] WARN: Run List override has been provided.
[2014-05-28T14:12:30-07:00] WARN: Original Run List: []
[2014-05-28T14:12:30-07:00] WARN: Overridden Run List: [recipe[dev02::web_server]]
[2014-05-28T14:12:30-07:00] INFO: Run List is [recipe[dev02::web_server]]
[2014-05-28T14:12:30-07:00] INFO: Run List expands to [dev02::web_server]
@rberger
rberger / stacktrace
Created May 27, 2014 06:04
Stacktrace of chef-client run on workstation for chef-metal creating the new machine client
Generated at 2014-05-26 22:58:31 -0700
Net::HTTPServerException: machine_batch[default] (dev02::web_server line 20) had an error: Net::HTTPServerException: chef_client[web] (basic_chef_client::block line 133) had an error: Net::HTTPServerException: 403 "Forbidden"
/Users/rberger/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/net/http/response.rb:119:in `error!'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/chef-11.12.4/lib/chef/http.rb:143:in `request'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/chef-11.12.4/lib/chef/http.rb:124:in `post'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/cheffish-0.5.beta/lib/cheffish/actor_provider_base.rb:30:in `block in create_actor'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/chef-11.12.4/lib/chef/mixin/why_run.rb:52:in `call'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/chef-11.12.4/lib/chef/mixin/why_run.rb:52:in `add_action'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/chef-11.12.4/lib/chef/provider.rb:155:in `converge_by'
/Users/rberger/.rvm/gems/ruby-2.1.2/gems/cheffish-0.5.beta/lib/cheffish/actor_provi