Skip to content

Instantly share code, notes, and snippets.

View tjake's full-sized avatar

Jake Luciani tjake

  • DataStax
  • Stamford CT
  • X @tjake
View GitHub Profile
Add the following line to your /etc/apt/sources.list
deb http://debian.qa.datastax.com/ brisk main
then do
wget -O - http://debian.qa.datastax.com/debian/apt_key | sudo apt-key add -
sudo apt-get update
Single node, keep in mind writes are buffered in Solr, not durable.
=================================================================
SOLR WRITES: (Buffered)
clients:4, loops:2500, type:write, rate(ops/sec):2132.0
clients:4, loops:2500, type:write, rate(ops/sec):4208.0
clients:4, loops:2500, type:write, rate(ops/sec):4484.0
clients:4, loops:2500, type:write, rate(ops/sec):4291.0
* Add handler for *:* unique term all docs contain.
* Add custom search component
* Create robust thrift client wrapper w/ circuit breaker
* Custom query filter
* How should I handle huge doc lists?
{ "BlogSite" : //Keyspace
{ "User1" : //Key
{ "Posts" : //ColumnFamily
{ "20100426-Lucandra-Talk" : //Column Name
"I'm talking about lucandra today!", //Column Value
"20100427-Lucandra-Talk-Rocked!" : "They liked it!" },
},
{ "Comments" : //SuperColumnFamily
{ "20100426-Lucandra-Talk-1": //SuperColumn
ERROR [pool-1-thread-2] 2010-02-01 22:02:26,918 Cassandra.java (line 1000) Internal error processing get_key_range
java.lang.OutOfMemoryError: Java heap space
at java.util.HashMap.<init>(HashMap.java:203)
at java.util.HashMap.<init>(HashMap.java:217)
at java.util.HashSet.<init>(HashSet.java:125)
at org.apache.cassandra.service.StorageProxy.getKeyRange(StorageProxy.java:601)
at org.apache.cassandra.service.CassandraServer.get_key_range(CassandraServer.java:524)
at org.apache.cassandra.service.Cassandra$Processor$get_key_range.process(Cassandra.java:992)
at org.apache.cassandra.service.Cassandra$Processor.process(Cassandra.java:817)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:253)
#!/usr/bin/perl
use strict;
use warnings;
print "hi";
Results:
real op rate : 43973
adjusted op rate stderr : 0
key rate : 43973
latency mean : 20.5
latency median : 17.4
latency 95th percentile : 47.2
latency 99th percentile : 63.0
latency 99.9th percentile : 95.2
latency max : 365.5