Skip to content

Instantly share code, notes, and snippets.

View pboling's full-sized avatar
🏓
Ping me if you need me!

Peter Boling pboling

🏓
Ping me if you need me!
219 followers · 367 following
View GitHub Profile
@pboling
pboling / color_logger.rb
Last active December 28, 2015 03:59
Log Formatter
# Patterned after this LogFormatter:
# https://github.com/QutBioacousticsResearchGroup/bioacoustic-workbench/blob/master/config/initializers/log_formatting.rb
# And some of this:
# http://95.154.230.254/ip-1/encoded/Oi8vcGFzdGViaW4uY29tL1hxRU1keGRT
# Makes as much as possible constant values to not bog down GC and make it whip fast
class ColorLogger
SEVERITY_TO_TAG_MAP = {'DEBUG' => 'meh', 'INFO' => 'fyi', 'WARN' => 'hmm', 'ERROR' => 'wtf', 'FATAL' => 'omg', 'UNKNOWN' => '???'}
SEVERITY_TO_COLOR_MAP = {'DEBUG' => '0;37', 'INFO' => '32', 'WARN' => '33', 'ERROR' => '31', 'FATAL' => '31', 'UNKNOWN' => '37'}
USE_HUMOROUS_SEVERITIES = begin
@pboling
pboling / nested_lib_loader.rb
Last active December 21, 2015 06:38
# DESCRIPTION:
# For auto lazy loading of namespaced objects nested in sub-directories
# This is a custom library loader - Written by Peter Boling
# INSTALLATION:
# 1. Add 'gist-dep' to your Gemfile
# 2. bundle install
# 3. gist-dep add --path lib/handy_gists/nested_lib_loader.rb 6265104/nested_lib_loader.rb
# 4. add the following lines (uncommented) to your config/application.rb inside the `class Application < Rails::Application`
# require "#{config.root}/lib/handy_gists/nested_lib_loader"
# include HandyGists::NestedLibLoader
@pboling
pboling / facebook_throttle.rb
Last active July 10, 2018 14:47
Facebook API Rate Limit Throttler using Sidekiq, does not execute the job inside the lock, to maintain some semblance of performance, just marks it in a counter, which other jobs from the same queue and using the same token will also update, and which will be throttled. Jobs from other queues will not be able to bust the lock until the timer run…
# Mixin to (i.e. include in) any worker class that does FB API calls and should be throttled.
module FacebookThrottle
def perform_throttled(*args, &block)
options = args.extract_options!
user = User.find_by_fb_uid(options[:fb_uid])
if user
if !user.valid_facebook_token? # A bitwise flag managed by flag_shih_tzu gem
puts "Skipping #{self.class} #{user.fb_uid}: Invalid Oauth Token for #{user}"
return false
@pboling
pboling / messages.log
Created March 15, 2013 05:35
Latest messages/log output after delete/restart
2013-03-15 05:30:16,530 INFO [neo4j.txmanager]: TM new log: tm_tx_log.1
2013-03-15 05:30:16,556 INFO [neo4j.xafactory]: Opened logical log [/var/lib/neo4j/data/graph.db/index/lucene.log.1] version=0, lastTxId=1 (clean)
2013-03-15 05:30:16,560 DEBUG [neo4j.diagnostics]: --- STARTUP diagnostics START ---
2013-03-15 05:30:16,561 DEBUG [neo4j.diagnostics]: Neo4j Kernel properties:
2013-03-15 05:30:16,563 DEBUG [neo4j.diagnostics]: forced_kernel_id=
2013-03-15 05:30:16,563 DEBUG [neo4j.diagnostics]: read_only=false
2013-03-15 05:30:16,563 DEBUG [neo4j.diagnostics]: neo4j.ext.udc.host=udc.neo4j.org
2013-03-15 05:30:16,564 DEBUG [neo4j.diagnostics]: logical_log=nioneo_logical.log
2013-03-15 05:30:16,564 DEBUG [neo4j.diagnostics]: node_auto_indexing=false
2013-03-15 05:30:16,564 DEBUG [neo4j.diagnostics]: intercept_committing_transactions=false
@pboling
pboling / gist:5167673
Created March 15, 2013 05:27
Failed to recover with SEVERE error
$ sudo /var/lib/neo4j/bin/neo4j console
Starting Neo4j Server console-mode...
05:23:30,210 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
05:23:30,211 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
05:23:30,211 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml]
05:23:30,232 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@52c05d3b - URL [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml] is not of type file
05:23:30,351 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
05:23:30,357 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
05:23:30,362 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
0
@pboling
pboling / messages.log
Created March 15, 2013 05:01
cat /var/lib/neo4j/data/graph.db/messages.log
2013-03-13 21:55:13,456 DEBUG [neo4j.diagnostics]: nioneo_logical.log.v5: 2013-03-13T21:54:23+0000 - 22.61 MB
2013-03-13 21:55:13,456 DEBUG [neo4j.diagnostics]: nioneo_logical.log.v2: 2013-03-13T20:26:56+0000 - 25.00 MB
2013-03-13 21:55:13,456 DEBUG [neo4j.diagnostics]: neostore.relationshipstore.db: 2013-03-13T21:54:35+0000 - 2.11 MB
2013-03-13 21:55:13,456 DEBUG [neo4j.diagnostics]: neostore.propertystore.db.strings.id: 2013-03-13T21:54:35+0000 - 9.00 B
2013-03-13 21:55:13,457 DEBUG [neo4j.diagnostics]: nioneo_logical.log.v6: 2013-03-13T21:55:12+0000 - 16.00 B
2013-03-13 21:55:13,457 DEBUG [neo4j.diagnostics]: neostore.relationshipstore.db.id: 2013-03-13T21:54:35+0000 - 9.00 B
2013-03-13 21:55:13,457 DEBUG [neo4j.diagnostics]: neostore.nodestore.db: 2013-03-13T21:54:35+0000 - 569.00 kB
2013-03-13 21:55:13,457 DEBUG [neo4j.diagnostics]: neostore: 2013-03-13T21:55:12+0000 - 54.00 B
2013-03-13 21:55:13,458 DEBUG [neo4j.diagnostics]: nioneo_logical.log.v1: 2013-03-13T20:13:29+0000 - 25.00 MB
2
@pboling
pboling / Neo4j Error
Created March 13, 2013 23:05
Neo4j error as seen from Neography attempt to execute script within a Sidekiq worker
2013-03-13T22:55:32+00:00 app[low.1]: 2013-03-13T22:55:32Z 2 TID-wdnkc WARN: 757: unexpected token at '<html>
2013-03-13T22:55:32+00:00 app[low.1]: <head>
2013-03-13T22:55:32+00:00 app[low.1]: <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
2013-03-13T22:55:32+00:00 app[low.1]: <title>Error 500 Failed to get current transaction.</title>
2013-03-13T22:55:32+00:00 app[low.1]: </head>
2013-03-13T22:55:32+00:00 app[low.1]: <body><h2>HTTP ERROR 500</h2>
2013-03-13T22:55:32+00:00 app[low.1]: <p>Problem accessing /db/data/ext/GremlinPlugin/graphdb/execute_script. Reason:
2013-03-13T22:55:32+00:00 app[low.1]: <pre> Failed to get current transaction.</pre></p><h3>Caused by:</h3><pre>org.neo4j.graphdb.TransactionFailureException: Failed to get current transaction.
2013-03-13T22:55:32+00:00 app[low.1]: at org.neo4j.kernel.impl.core.LockReleaser.getTransaction(LockReleaser.java:341)
2013-03-13T22:55:32+00:00 app[low.1]: at org.neo4j.kernel.impl.core.LockReleaser.getCowPropertyRemoveMap(Loc
@pboling
pboling / Neo4j daemon
Created March 13, 2013 23:02
Starting Neo4j as daemon
$ sudo /var/lib/neo4j/bin/neo4j start
Starting Neo4j Server...21:58:39,775 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
21:58:39,775 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
21:58:39,775 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml]
21:58:39,803 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@2dec8909 - URL [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml] is not of type file
21:58:39,922 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
21:58:39,929 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
21:58:39,933 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
21:58:39,950 |-IN
@pboling
pboling / console output
Last active December 14, 2015 22:18
Starting Neo4j in console mode
$ sudo /var/lib/neo4j/bin/neo4j console
Starting Neo4j Server console-mode...
21:54:34,229 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
21:54:34,229 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
21:54:34,229 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml]
21:54:34,252 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@52c05d3b - URL [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml] is not of type file
21:54:34,445 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
21:54:34,470 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
21:54:34,474 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
2
@pboling
pboling / console output
Created March 13, 2013 18:24
Neo4j console SEVERE problems
ubuntu@ip-d-d-d-d:~$ sudo /var/lib/neo4j/bin/neo4j console
Starting Neo4j Server console-mode...
17:54:30,962 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
17:54:30,962 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
17:54:30,962 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml]
17:54:30,984 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@5328f6ee - URL [jar:file:/usr/share/neo4j/system/lib/neo4j-server-1.8.1.jar!/logback.xml] is not of type file
17:54:31,044 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
17:54:31,051 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
17:54:31,055 |-INFO in ch.qos.logback.core.jora