Skip to content

Instantly share code, notes, and snippets.

View Aslan's full-sized avatar

Aslan

5 followers · 23 following
View GitHub Profile
@Aslan
Aslan / gist:875ef9ed0c0cca24dda7
Created October 26, 2015 19:22
15/10/26 19:19:38 INFO client.RMProxy: Connecting to ResourceManager at ip-10-65-200-150.ec2.internal/10.65.200.150:8032
Container: container_1444274555723_0062_02_000003 on ip-10-169-170-124.ec2.internal_8041
==========================================================================================
LogType:stderr
Log Upload Time:26-Oct-2015 19:18:20
LogLength:9332
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
@Aslan
Aslan / gist:ebb24e747f630dc898a1
Created October 24, 2015 01:03
15/10/24 01:00:34 INFO client.RMProxy: Connecting to ResourceManager at ip-10-65-200-150.ec2.internal/10.65.200.150:8032
Container: container_1444274555723_0060_01_000003 on ip-10-169-170-124.ec2.internal_8041
==========================================================================================
LogType:stderr
Log Upload Time:24-Oct-2015 01:00:10
LogLength:4299
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
@Aslan
Aslan / gist:dcb2fd1933c857519d86
Created October 23, 2015 23:15
executing pwd:
/home/hadoop
executing /usr/bin/spark-submit --class com.truex.prometheus.CLIJob Prometheus-assembly-0.0.1.jar -e 'select x.id, x.title, x.description, x.mediaavailableDate as available_date, x.mediaexpirationDate as expiration_date, mediacategories.medianame as media_name, x.mediakeywords as keywords, mediaratings.scheme as rating_scheme, mediaratings.rating, cast(mediaratings.subRatings as String) as sub_ratings, content.plfileduration as duration, x.plmediaprovider as provider, x.ngccontentAdType as ad_type, x.ngcepisodeNumber as episode, ngcnetwork as network, x.ngcseasonNumber as season_number, x.ngcuID as ngc_uid, x.ngcvideoType as video_type from etl lateral view explode(entries) entries as x lateral view explode(x.mediacategories) cat as mediacategories lateral view explode(x.mediaratings) r as mediaratings lateral view explode(x.mediacontent) mediacontent as content lateral view outer explode(x.ngcnetwork) net as ngcnetworkr' -j http://feed.theplatform.com/f/ngc/ngcngw-analytics /tmp/t
@Aslan
Aslan / gist:2884426
Created June 6, 2012 20:12
first file had this at line
4 node[:rails_env] = 'qa'
5 node[:app_name] = 'rtb_bidder'
6 rtb_data_bag = data_bag_item('rtb', 'app')
96 include_recipe "rtb::common_tail"
in rtb_common.rb:
@Aslan
Aslan / gist:2586581
Created May 3, 2012 15:37
service "apache2" do
name "apache2"
supports :restart => true, :reload => true
action :enable
end
@Aslan
Aslan / gist:2503427
Created April 26, 2012 21:43
[
"archive_master_production",
"archive_slave_production"
]
@Aslan
Aslan / gist:2418296
Created April 19, 2012 03:45
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: *****************************************
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: Can not find config file: /etc/chef/solr.rb, using defaults.
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: No such file or directory - /etc/chef/solr.rb
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: *****************************************
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: This operation is destructive!
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: I'm going to count to 10, and then delete your Solr index and rebuild it.
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: CTRL-C will, of course, stop this disaster.
[Wed, 18 Apr 2012 19:59:30 -0700] WARN: ... 0
[Wed, 18 Apr 2012 19:59:31 -0700] WARN: ... 1
[Wed, 18 Apr 2012 19:59:32 -0700] WARN: ... 2
@Aslan
Aslan / solr-chef-indexer.log
Created April 19, 2012 01:47
2012-04-19_01:45:49.37100 [Wed, 18 Apr 2012 18:43:11 -0700] INFO: Indexing node 391fc140-fb02-4936-a2df-b833d2d378c8 from chef status ok}
2012-04-19_01:45:49.37101 [Wed, 18 Apr 2012 18:43:12 -0700] INFO: Indexing node 01d1a6a8-7855-4e11-b70c-744e24f2c5e2 from chef status ok}
2012-04-19_01:45:49.37102 [Wed, 18 Apr 2012 18:43:14 -0700] INFO: Indexing node 0e7312ef-9f8c-4e33-96e2-11fd806f2d97 from chef status ok}
2012-04-19_01:45:49.37102 [Wed, 18 Apr 2012 18:43:16 -0700] INFO: Indexing node 391fc140-fb02-4936-a2df-b833d2d378c8 from chef status ok}
2012-04-19_01:45:49.37103 [Wed, 18 Apr 2012 18:43:17 -0700] INFO: Indexing node 01d1a6a8-7855-4e11-b70c-744e24f2c5e2 from chef status ok}
2012-04-19_01:45:49.37104 [Wed, 18 Apr 2012 18:43:19 -0700] INFO: Indexing node e9913986-2614-49aa-9300-611bfd9e19f9 from chef status ok}
2012-04-19_01:45:49.37105 [Wed, 18 Apr 2012 18:44:20 -0700] FATAL: POST to Solr 'http://localhost:8983' failed. Chef::Exceptions::SolrConnectionError exception: Timeout::Error: execution expired
@Aslan
Aslan / gist:2231317
Created March 28, 2012 22:55
root:/etc/sv/chef-client/log/main# chef-client -l debug
[Tue, 06 Mar 2012 17:07:14 -0800] DEBUG: Loading plugin os
[Tue, 06 Mar 2012 17:07:14 -0800] DEBUG: Loading plugin kernel
[Tue, 06 Mar 2012 17:07:14 -0800] DEBUG: Loading plugin ruby
[Tue, 06 Mar 2012 17:07:14 -0800] DEBUG: Loading plugin languages
[Tue, 06 Mar 2012 17:07:14 -0800] DEBUG: ---- Begin ruby -e "require 'rbconfig'; puts %Q(host_cpu=#{::Config::CONFIG['host_cpu']},host_vendor=#{::Config::CONFIG['host_vendor']},release_date=#{RUBY_RELEASE_DATE},ruby_bin=#{::File.join(::Config::CONFIG['bindir'], ::Config::CONFIG['ruby_install_name'])},platform=#{RUBY_PLATFORM},target_cpu=#{::Config::CONFIG['target_cpu']},host_os=#{::Config::CONFIG['host_os']},version=#{RUBY_VERSION},host=#{::Config::CONFIG['host']},target_vendor=#{::Config::CONFIG['target_vendor']},target_os=#{::Config::CONFIG['target_os']},target=#{::Config::CONFIG['target']},bin_dir=#{::Config::CONFIG['bindir']},)" STDOUT ----
[Tue, 06 Mar 2012 17:07:14 -0800] DEBUG: host_cpu=x86_64,host_vend
@Aslan
Aslan / gist:1346539
Created November 7, 2011 23:28
require 'ohai'
require 'json'
o = Ohai::System.new
o.all_plugins
chef_config = JSON.parse(o[:ec2][:userdata])
if chef_config.kind_of?(Array)
chef_config = chef_config[o[:ec2][:ami_launch_index]]
end
Chef::Log.info(chef_config["app_role"])
if chef_config["app_role"] == "primary"