Skip to content

Instantly share code, notes, and snippets.

Avatar

Robin Moffatt rmoff

View GitHub Profile
@rmoff
rmoff / gist:79274b9b26b2e1e3306c
Created Apr 7, 2015
320101 Attempt to target more than one WLDFSystemResource to server
View gist:79274b9b26b2e1e3306c
Error: 320101]Attempt to target more than one WLDFSystemResource to server
Cause: BI/BI Apps come with a pre-defined Diagnostic Module (Module-FMWDFW), which means that you cannot create a new one targeting the same servers. If you want to add your own stuff you need to either add it to this module or disable it first and then create your own.
@rmoff
rmoff / gist:62c5ac4056c0c97f31e7
Created Apr 15, 2015
OBIEE system presentation variables
View gist:62c5ac4056c0c97f31e7
(Paste this into a Static Text view in OBIEE to see the current values)
[u][b]Predefined Presentation Variables
[/b][/u][br/]
<p align="left">
[b]dashboard.currentPage:[/b] @{dashboard.currentPage}[br/]
[b]dashboard.author:[/b] @{dashboard.author}[br/]
[b]dashboard.caption:[/b] @{dashboard.caption}[br/]
[b]dashboard.description:[/b] @{dashboard.description}[br/]
[b]dashboard.location:[/b] @{dashboard.location}[br/]
@rmoff
rmoff / ELK-articles.txt
Created May 11, 2015
Blog posts about ELK (Elasticsearch, Logstash, and Kibana)
View ELK-articles.txt
[http://ritt.md/go-elk-1](http://ritt.md/go-elk-1)
http://ritt.md/go-elk-2
http://ritt.md/go-elk-3
@rmoff
rmoff / gist:cd158282f620a4fa4d4b
Created Jun 16, 2015
Kibana won't show geoip field in dropdown - solution
View gist:cd158282f620a4fa4d4b

For Kibana to create a Tile map it needs geo-encoded data, which logstash does easily with the geoid plugin, BUT the field mapping in Elasticsearch must be geopoint. Logstash does this dynamically so long as the index being written to matches the elasticsearch-template.json template, which is any prefixed with logstash. Otherwise, you need to update the index field mapping yourself for this to work.

@rmoff
rmoff / roracle.clob.md
Created Jul 21, 2015
Error in .valueClassTest(ans, "data.frame", "fetch") : invalid value from generic function 'fetch', class "try-error", expected "data.frame"
View roracle.clob.md

Error from ROracle when running fetch(query):

Error in .valueClassTest(ans, "data.frame", "fetch") : 
  invalid value from generic function 'fetch', class "try-error", expected "data.frame"

Cause: a CLOB in the data being returned (SELECT * - lazy!). Fix: Didn't need the CLOB anyway so dropped it from the query.

@rmoff
rmoff / monitor_nqs_temp.sh
Last active Sep 21, 2015
Track BI Server (nqsserver) temp usage over time
View monitor_nqs_temp.sh
!#/usr/bin/bash
export FMW_HOME=/u01/BI_FMW/
export OUTBASE=/tmp/nqstmp_usage
while [ 1 -eq 1 ]; do echo -n $(date) >> $OUTBASE.du;echo -n ',' >> $OUTBASE.du;du $FMW_HOME/instances/instance1/tmp/OracleBIServerComponent/coreapplication_obis1/obis_temp >> $OUTBASE.du;sleep 5; done
@rmoff
rmoff / kafka.md
Created Oct 6, 2015
Kafka quick start - WARN Failed to send producer request with correlation id to broker
View kafka.md

Courtesy of here, if you're using a producer on a node remote to the kafka server, you need to make sure you've set advertised.host.name in config/server.properties, otherwise the client may not pick up the correct remote host to connect to.

@rmoff
rmoff / result.txt
Last active Oct 22, 2015
Logstash using json codec when the input isn't json
View result.txt
plaintext message here {:exception=>#<NoMethodError: undefined method `[]' for 68.68:Float>, :backtrace=>["/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.4-java/lib/logstash/event.rb:73:in `initialize'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-codec-json-1.0.1/lib/logstash/codecs/json.rb:46:in `decode'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-input-kafka-1.0.0/lib/logstash/inputs/kafka.rb:169:in `queue_event'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-input-kafka-1.0.0/lib/logstash/inputs/kafka.rb:139:in `run'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.4-java/lib/logstash/pipeline.rb:177:in `inputworker'", "/opt/logstash-1.5.4/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.4-java/lib/logstash/pipeline.rb:171:in `start_input'"], :level=>:error}
@rmoff
rmoff / notes.md
Last active Oct 22, 2015
Kafka / Logtash / Flume notes
View notes.md

Flume puts just raw text on Kafka, whereas Logstash by default puts encoded message.

68.68.99.199 - - [06/Apr/2014:03:35:25 +0000] "GET /2013/04/smartview-as-the-replacement-for-bi-office-with-obiee-11-1-1-7/ HTTP/1.1" 200 12391 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"

vs

{"message":"68.68.99.199 - - [06/Apr/2014:03:35:25 +0000] \"GET /2013/04/smartview-as-the-replacement-for-bi-office-with-obiee-11-1-1-7/ HTTP/1.1\" 200 12391 \"-\" \"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)\"","@version":"1","@timestamp":"2015-10-21T21:38:10.165Z","host":"bigdatalite.localdomain","path":"/home/oracle/website_logs/access_log.small"}

This means that Flume -> Kafka -> Logstash with default configs fails at the Logstash stage:

You can’t perform that action at this time.