AWS hack tasks

gistfile1.txt

* A Logstash client -> Kinesis -> Logstash indexer (scale out?) -> CloudSearch
                                                                -> Redshift
pipeline.

* A CloudFormation template to spin up an HA NFS server setup, with drdb replication configured, volumes provisioned, and heartbeat configured and running for failover

* Define a new ECU measure that actually makes sense. An automation approach to spinning up all instance types, and run SPECint and SPECfp and generate a relative score of CPU capacity across EC2 instances.

* An app to determine how much to run in x region – enumerate all services in account via Billing API, then 1:1 match that with another region pricing to see what it would cost to run in the other region

* An app which can introspect an existing AWS environment (how do you define this?), take a target region as a parameter and work out dependencies and consistently clone an env in a target environment including migrating AMIs, security groups, network ACLs, etc (Karl Durrance has offered to do this one). Should probably leverage CloudFormation. Call it CloudMigration?

* Framework which optimises upload and download of content into S3 via multi-part API, Range GETs etc

* Framework which optimises very large volume (sends per sec/min) of emails via SES

* Build a set of diagnostics scripts which can be used by a customer on prem to help debug issues like CF not being accessible etc

* A 3d printer controlled by the SWF service ;) http://aws.amazon.com/swf/

* Build a single pane of glass web app/android/iPhone/iPad/lesser tablet/etc CloudWatch style thingy.

* Investigate http://www.iis.net/download/WebFarmFramework on AWS - what is complementary etc?

* Build a basic app which hooks into billing API and draws billing info per region and transfer costs etc on a map of the world

* Build a simple Google Android and iOS push notification service integrated with SNS - a solution could be written to use Apple Push Notification Service (APNS) http://blog.serverdensity.com/2009/07/10/how-to-build-an-apple-push-notification-provider-server-tutorial/ and Android Cloud to Device Messaging (C2DM) http://blog.serverdensity.com/2010/10/07/android-push-notifications-tutorial/, but in the case of Android at least this isn't necessarily going to cover all Android devices out there on the market (I.e. C2DM support requires Android 2.2 or later).

* Setup a 'poor mans' HA software load balancer using ENIs and optionally programmatically controlled routing rules in the VPC

* Build a simple SQS replicator - using 0mq on a small EC2 instance to replicate SQS queues across regions.

* Build a distributed load testing environment with CloudFormation and JMeter (or similar)

* Build an ANT for provisioning AWS infrastructure - like a suped up CloudFormation, but using boto, written in Python, and using an ANTish pattern to allow "AWS build tasks" to be defined and reused. This would provide ultimate flexibility, and go some way toward ease of use for semi-knowledgeable developers.