- Boot servers (always includes security groups)
- Boot servers with base image
- Boot servers with image snapshot
- Boot servers with additional volumes
- Boot servers with isolated networks
- Boot server from volume
- Unprepared volume
- Prepared volume
- Build, List, Delete servers at scale (more than 100 server instances)
- Cluster builds and deletes
- Live migration
- Single
- Cluster
- OS
- Image size
- Volume size
- Flavor type
- Number of servers
- Build times (in seconds)
- Max concurrent builds with acceptable performance and low failure rate
- Volume preparation time (in seconds)
- Migration time (in seconds)
- Max number of concurrent migrations
- Max number of ACTIVE servers in the cloud while sustaining acceptable performance and low failure rate.
- Response times of list/delete servers at scale (more than 100 server instances) (in milliseconds)
- Cloud Controller, Message Queue, DBs servers utilization metrics (CPU, Memory, Net, Storage IO, Storage Capacity)
- Uploading Images
- Deleting Images
- List images as number of images grow
- Image Snapshots
- Different image sizes
- Concurrent image snapshots
- Image size (Uncompressed and compressed)
- Image format (QCOW2, RAW, etc)
- Number of images
- Backend (Swift)
- Upload time in seconds
- Delete time in seconds
- Response times of list/delete images at scale (more than 100 images including snapshots) in milliseconds
- Glance server node and DB node server utilization metrics
- Max number of images in the Glance servers while sustaining acceptable response time
- Authentication
- Token validation at scale (more than 50 tenants, each w/ 2 users)
- Create and delete tenants
- List tenants as number of tenants grow
- Create and delete users
- List users as number of users grow
- Backend choice (LDAP, PAM, RDBMS, etc)
- Number of users per tenants
- Number of tenants
- Response times of list/create tenant/users at scale (more than 50 tenants with 2 users each)
- Throughput of Identity service while keeping acceptable performance
- Create and delete Networks, Subnets, Ports, Routers
- Large number of tenant networks and ports
- List Networks, Subnets, Ports, Routers
- Concurrent create volumes
- Concurrent delete volumes
- List volumes at scale more than 100 volumes