Skip to content

Instantly share code, notes, and snippets.

@gdusbabek

gdusbabek/blueflood_ideas.md

Last active December 21, 2015 09:08
Show Gist options
  • Save gdusbabek/6282671 to your computer and use it in GitHub Desktop.
Save gdusbabek/6282671 to your computer and use it in GitHub Desktop.
Download ZIP
Blueflood Improvement Ideas
Raw
blueflood_ideas.md

Blueflood Improvment Ideas

These are in no particular order. I add them as I think of them.

  1. Local ingestion durability.
  2. Use the Cassandra Fat Client for ingestion, rollup and/or query
  3. l2met integration (http://r.32k.io/l2met-introduction)
  4. Fluentd integration (http://fluentd.org)
  5. A distributed test suite
  6. Internode coordination (obviate manual shard assignment)
  7. Alternate backends (Redis, Riak, etc.)
  8. Custom TTLs - this needs to be just dead easy
  9. Native bitmap and/or bit-slice indexes.
  10. Whirr for cluster spin up/down (http://whirr.apache.org)
  11. statsd/graphite integration (NOTE: in progress)
  12. Faux AstyanaxReaer and AstyanaxWriter implementations that just read/write to memory. This would enable a whole other class of tests.
  13. Look at Spark and Mesos to see if there is any benefit for use or integration.

Previously on the list, but completed

  1. Newer cassandra support in test (via maven profiles)
  2. UDP Ingestion
  3. Pluggable ingestion transformation pipelines (mostly done, see AsyncChain and friends)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment