Skip to content

Instantly share code, notes, and snippets.

@phrawzty
Last active August 29, 2015 14:15
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save phrawzty/3d2f5008247a288453a5 to your computer and use it in GitHub Desktop.
Save phrawzty/3d2f5008247a288453a5 to your computer and use it in GitHub Desktop.
Socorro roles and AWS instance types

Roles and Types

There are a number of "roles" in the Socorro infra. The resource profiles for these roles are not identical, ergo there will be different AWS instance types for different roles.

The roles are:

  • Admin
  • Collectors
  • Crash-Analysis
  • Elasticsearch
  • Middleware
  • Postgres
  • Processors
  • RabbitMQ
  • SymbolAPI
  • Webheads

Admin

Admin nodes are responsible for orchestrating deployments and running Crontabber. For historical reasons beyond the scope of this document, there are three admin nodes in PHX1; however, only two (one each for Stage and Prod) will be required in AWS.

Resource profile

The orchestration of deployments is relatively lightweight, requiring only enough resources to pull some repositories, unpack some tarballs, that sort of thing. The various Crontabber jobs are also fairly lightweight (from the perspective of the Admin node, at least), since they're mostly just triggering actions on other nodes (largely DB-related).

Note that current admin node sp-admin01 (a Xeon server with two processors and 8 GB of RAM) is pinned constantly. This is only because we're running a bunch of migration-related tasks on it that won't be a factor once we're in AWS for realsies.

Instance recommendation

Collectors

Resource profile

Instance recommendation

Crash-Analysis

Resource profile

Instance recommendation

Elasticsearch

Resource profile

Instance recommendation

Middleware

Resource profile

Instance recommendation

Postgres

Resource profile

Instance recommendation

Processors

Resource profile

Instance recommendation

RabbitMQ

Resource profile

Instance recommendation

SymbolAPI

Resource profile

Instance recommendation

Webheads

Resource profile

Instance recommendation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment