Skip to content

Instantly share code, notes, and snippets.

@neofob
Last active April 19, 2017 13:47
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save neofob/c2dd39d8a9aaae51ad772ce3daf3c633 to your computer and use it in GitHub Desktop.
Save neofob/c2dd39d8a9aaae51ad772ce3daf3c633 to your computer and use it in GitHub Desktop.
FOSDEM 2017 note

FOSDEM 2017

Free and Open Source Software Developers' European Meeting

tuan t. pham

#Saturday, Febuary 4

##Software Heritage Speaker: Stefano Zacchiroli, Roberto Di Cosmo

Software must written for people to read, and only incidentally for machine to execute.

Think of it as Project Gutenberg of Human Written Software meets WaybackMachine/Archive. Source for the Win!

Source code provides a view into the mind of the designer, Len Shustek.

##Sysdig Analysing log data

/dev/null is available everywhere. Let's write to it. Clever Hack!

Tools: sysdig, csysdig

Source: https://github.com/draios/sysdig

##Backup and disaster Recovery Bareos, ReaR, Relax and Recovery...etc. Using scripts to take snapshot of the system and recover when disaster strike.

#Sunday, Febuary 5

##Scaling Graphite At Booking.com, there are a lot of metrics to collect. In order to scope with the large amount of data, the traditional Graphite software stack is redesigned in order to scale. Vladimir Smirnov gives a brief talk on how they did it.

###Initial Thought

Legacy Graphite Component New component
carbon-relay.py carbon-c-relay

carbon-c-relay: written in C, routes 1M data points per second using only 2 cores.

The key with scaling is that carbon-[c]-relay is Single Point Of Failure. It's hard to scale when there are requirements of Fault-tolerance and High Availability. So the team at Booking redesign the Graphite Stack using carbonzipper, carbonserver, and go-carbon.

###Redesign the Graphite software stack

Legacy Graphite Component New component
carbon-cache.py carbonzipper + carbonserver + go-carbon

The beautiful new software stack looks like this: ZipperStack

###SourceCode on github.com

Component URL
carbonzipper https://github.com/dgryski/carbonzipper
carbonserver https://github.com/grobian/carbonserver
carbonsearch https://github.com/kanatohodets/carbonsearch
go-carbon https://github.com/lomik/go-carbon
carbon-api https://github.com/dgryski/carbonapi
carbon-c-relay https://github.com/grobian/carbon-c-relay

Another thought: IPv6 on Android just works with Android 6.x version.

#Links

Title URL
FOSDEM 2017 https://fosdem.org/2017
Software Heritage API https://archive.softwareheritage.org/api
Software Heritage https://fosdem.org/2017/schedule/event/software_heritage/
Graphite at Scale https://fosdem.org/2017/schedule/event/graphite_at_scale/
Backup & Recovery https://fosdem.org/2017/schedule/track/backup_and_disaster_recovery/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment