Skip to content

Instantly share code, notes, and snippets.

View rmoff's full-sized avatar

Robin Moffatt rmoff

480 followers · 0 following
View GitHub Profile
@rmoff
rmoff / gist:79274b9b26b2e1e3306c
Created April 7, 2015 15:37
320101 Attempt to target more than one WLDFSystemResource to server
Error: 320101]Attempt to target more than one WLDFSystemResource to server
Cause: BI/BI Apps come with a pre-defined Diagnostic Module (Module-FMWDFW), which means that you cannot create a new one targeting the same servers. If you want to add your own stuff you need to either add it to this module or disable it first and then create your own.
@rmoff
rmoff / gist:62c5ac4056c0c97f31e7
Created April 15, 2015 10:54
OBIEE system presentation variables
(Paste this into a Static Text view in OBIEE to see the current values)
[u][b]Predefined Presentation Variables
[/b][/u][br/]
<p align="left">
[b]dashboard.currentPage:[/b] @{dashboard.currentPage}[br/]
[b]dashboard.author:[/b] @{dashboard.author}[br/]
[b]dashboard.caption:[/b] @{dashboard.caption}[br/]
[b]dashboard.description:[/b] @{dashboard.description}[br/]
[b]dashboard.location:[/b] @{dashboard.location}[br/]
@rmoff
rmoff / ELK-articles.txt
Created May 11, 2015 13:43
Blog posts about ELK (Elasticsearch, Logstash, and Kibana)
[http://ritt.md/go-elk-1](http://ritt.md/go-elk-1)
http://ritt.md/go-elk-2
http://ritt.md/go-elk-3
@rmoff
rmoff / gist:cd158282f620a4fa4d4b
Created June 16, 2015 12:51
Kibana won't show geoip field in dropdown - solution

For Kibana to create a Tile map it needs geo-encoded data, which logstash does easily with the geoid plugin, BUT the field mapping in Elasticsearch must be geopoint. Logstash does this dynamically so long as the index being written to matches the elasticsearch-template.json template, which is any prefixed with logstash. Otherwise, you need to update the index field mapping yourself for this to work.

@rmoff
rmoff / roracle.clob.md
Created July 21, 2015 16:17
Error in .valueClassTest(ans, "data.frame", "fetch") : invalid value from generic function 'fetch', class "try-error", expected "data.frame"

Error from ROracle when running fetch(query):

Error in .valueClassTest(ans, "data.frame", "fetch") : 
  invalid value from generic function 'fetch', class "try-error", expected "data.frame"

Cause: a CLOB in the data being returned (SELECT * - lazy!). Fix: Didn't need the CLOB anyway so dropped it from the query.

@rmoff
rmoff / monitor_nqs_temp.sh
Last active September 21, 2015 12:04
Track BI Server (nqsserver) temp usage over time
!#/usr/bin/bash
export FMW_HOME=/u01/BI_FMW/
export OUTBASE=/tmp/nqstmp_usage
while [ 1 -eq 1 ]; do echo -n $(date) >> $OUTBASE.du;echo -n ',' >> $OUTBASE.du;du $FMW_HOME/instances/instance1/tmp/OracleBIServerComponent/coreapplication_obis1/obis_temp >> $OUTBASE.du;sleep 5; done
@rmoff
rmoff / kafka.md
Created October 6, 2015 07:40
Kafka quick start - WARN Failed to send producer request with correlation id to broker

Courtesy of here, if you're using a producer on a node remote to the kafka server, you need to make sure you've set advertised.host.name in config/server.properties, otherwise the client may not pick up the correct remote host to connect to.

@rmoff
rmoff / Conference Abstract Writing Tips.md
Last active October 13, 2015 16:26
Conference Abstract Writing Tips
@rmoff
rmoff / result.txt
Last active October 22, 2015 06:34
Logstash using json codec when the input isn't json
plaintext message here {:exception=>#<NoMethodError: undefined method `[]' for 68.68:Float>, :backtrace=>["/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.4-java/lib/logstash/event.rb:73:in `initialize'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-codec-json-1.0.1/lib/logstash/codecs/json.rb:46:in `decode'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-input-kafka-1.0.0/lib/logstash/inputs/kafka.rb:169:in `queue_event'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-input-kafka-1.0.0/lib/logstash/inputs/kafka.rb:139:in `run'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.4-java/lib/logstash/pipeline.rb:177:in `inputworker'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.4-java/lib/logstash/pipeline.rb:171:in `start_input'"], :level=>:error}
@rmoff
rmoff / notes.md
Last active October 22, 2015 21:23
Kafka / Logtash / Flume notes

Flume puts just raw text on Kafka, whereas Logstash by default puts encoded message.

68.68.99.199 - - [06/Apr/2014:03:35:25 +0000] "GET /2013/04/smartview-as-the-replacement-for-bi-office-with-obiee-11-1-1-7/ HTTP/1.1" 200 12391 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"

vs

{"message":"68.68.99.199 - - [06/Apr/2014:03:35:25 +0000] \"GET /2013/04/smartview-as-the-replacement-for-bi-office-with-obiee-11-1-1-7/ HTTP/1.1\" 200 12391 \"-\" \"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)\"","@version":"1","@timestamp":"2015-10-21T21:38:10.165Z","host":"bigdatalite.localdomain","path":"/home/oracle/website_logs/access_log.small"}

This means that Flume -> Kafka -> Logstash with default configs fails at the Logstash stage: