My company is looking for a senior Ansible Developer. You will work with me on our Big Data cluster on AWS.
- Strong hands-on experience with Python, Ansible and AWS.
- Cassandra
- Chronos
- Cloudera
- Consul
- Docker
- ElasticSearch
- Flume
- Kafka
- Kibana
- Impala
- Marathon
- Mesos
- MongoDB
- Nodejs
- PrestoDB
- Redis
- Samza
- Scala
- Spark
- Ubuntu
- Zookeeper
Our Big Data cluster is fully automated with Ansible, Docker and Microservices. We use ephemeral storage and a mix of on-demand and spot instances. We scale up and down the cluster based of traffic.
Our OSX machines are fully automated with Ansible too.
We have only cattles and no pets.
We do programming anarchy and we have antifragile architecture.
We have implemented Netflix stack with Docker containers instead of AMIs. http://techblog.netflix.com/2011/08/building-with-legos.html
Our monitoring infrastructure works like Yammer's one : https://eng.yammer.com/application-monitoring-infrastructure-at-yammer/
Some containers are provisioned with Ansible, others with our Microservices written in Nodejs.
Our Continuous Deployment requires 12 seconds to deploy.
We use schema registry like Linkedin: https://engineering.linkedin.com/kafka/kafka-linkedin-current-and-future
Our Microservices library (written by us) uses Protocol Buffer and pattern matching and it works also in the browser.
2015 will be the year of Big Data in the Cloud and Docker. We have already achieved both goals.