public-cloud-services.md

GCP

service	oss
Cloud Dataflow	Apache Beam
Cloud Dataproc	Apache Hadoop, Apache Spark, Apache Pig, Apache Hive
Cloud Datalab	Jupyter
Cloud Dataprep	?
Data Studio	?
BigQuery	-

BigQuery

• prefer denormalized and pre-joined tables.

AWS

AWS CloudWatch

• https://aws.amazon.com/jp/cloudwatch/
• a cloud monitoring tool.

AWS CloudFront

• a CDN service.

Amazon Route 53

• a DNS service.

ELB - Elastic Load Balancing

• a load balancer for EC2 instances.
• it has "Connection Draining" function that enables to remove the EC2 instance gracefully.
• its console is not isolated, in EC2 console.
• First create one or more "target group", after that create a load balancer.

AWS CodeStar

• https://aws.amazon.com/jp/codestar/
• a tool, and also a development environment and a deploy service that is constructed with some AWS services.

AWS CloudFormation

• https://aws.amazon.com/jp/cloudformation/
• a provisioning tool, like Ansible?

AWS CloudDeploy

• https://aws.amazon.com/jp/codedeploy/
• an appliction deploy tool.

AWS CodeCommit

• a git repository service like GitHub.

AWS CodeBuild

• a build interface?
  • like Jenkins?

AWS CodePipeline

• https://aws.amazon.com/jp/codepipeline/
• a software lifecycle pipeline builder.

AWS OpsWorks

• https://aws.amazon.com/jp/opsworks/
• Chef on AWS

Amazon Kinesis Streams

• https://aws.amazon.com/jp/kinesis/streams/
• a tool for stream processing.
• one of the use cases is log collection.
  • store into S3.

AWS Data Pipeline

• https://aws.amazon.com/jp/datapipeline/
• this tool transfers data from anything to AWS tools like S3, RDS and so on.
• so it is impossible to use this to transfer data to Google BigQuery.
  • if you want to do that, use Google Stackdriver Logging https://cloud.google.com/logging/ instead.
  • "Stackdriver Logging は Google がカスタマイズしてパッケージ化した Fluentd エージェントを使っています。"

AWS CLI

• https://aws.amazon.com/jp/cli/
• This is what we call CLI.
• Commands like aws rds describe-db-instances
• Needs IAM account and its API key and secret.

AWS Service Catalog

• http://dev.classmethod.jp/cloud/aws-service-catalog/

AWS Elastic Beanstalk

• EC2 + middlewares + deploy tools
• EC2 instance that is used by Elastic Beanstalk is automatically created by the wizard.
  • t1.micro instance is choosed.