Skip to content

Instantly share code, notes, and snippets.

@donwany
Created April 1, 2018 14:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save donwany/942d6520e0b46cbce1f9d2c3a93befbb to your computer and use it in GitHub Desktop.
Save donwany/942d6520e0b46cbce1f9d2c3a93befbb to your computer and use it in GitHub Desktop.
Introduction to amazon sagemaker 101
Display the source blob
Display the rendered blob
Raw
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Author: Theophilus Siameh\n",
" Email : theodondre@gmail.com\n"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Introduction"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Amazon SageMaker is a <b>fully-managed platform</b> that enables <b>developers</b> and <b>data scientists</b> to quickly and easily build, train, and deploy machine learning models at any scale. \n",
"Amazon SageMaker removes all the barriers that typically \n",
"slow down developers who want to use machine learning."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Machine learning often feels a lot harder than it should be to most developers because the process to build and train models, and then deploy them into production is too complicated and too slow."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"First, you need to collect and prepare your training data to discover which elements of your data set are important. Then, you need to select which algorithm and framework you’ll use. After deciding on your approach, you need to teach the model how to make predictions by training, which requires a lot of compute. Then, you need to tune the model so it delivers the best possible predictions, which is often a tedious and manual effort. After you’ve developed a fully trained model, you need to integrate the model with your application and deploy this application on infrastructure that will scale. All of this takes a lot of specialized expertise, access to large amounts of compute and storage, and a lot of time to experiment and optimize every part of the process. In the end, it's not a surprise that the whole thing feels out of reach for most developers.\n",
"\n",
"Amazon SageMaker removes the complexity that holds back developer success with each of these steps. Amazon SageMaker includes modules that can be used together or independently to build, train, and deploy your machine learning models."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Source: https://aws.amazon.com/sagemaker/"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## How it works !"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"<b>Build</b>\n",
"\n",
"Amazon SageMaker makes it easy to build ML models and get them ready for training by providing everything you need to quickly connect to your training data, and to select and optimize the best algorithm and framework for your application. Amazon SageMaker includes hosted Jupyter notebooks that make it easy to explore and visualize your training data stored in Amazon S3. You can connect directly to data in S3, or use AWS Glue to move data from Amazon RDS, Amazon DynamoDB, and Amazon Redshift into S3 for analysis in your notebook.\n",
"\n",
"To help you select your algorithm, Amazon SageMaker includes the <b>12</b> most common machine learning algorithms which have been pre-installed and optimized to deliver up to <b>10 times</b> the performance you’ll find running these algorithms anywhere else. Amazon SageMaker also comes pre-configured to run TensorFlow and Apache MXNet, two of the most popular open source frameworks. You also have the option of using your own framework.\n",
"\n",
"<b>Train</b>\n",
"\n",
"You can begin training your model with a single click in the Amazon SageMaker console. Amazon SageMaker manages all of the underlying infrastructure for you and can easily scale to train models at petabyte scale. To make the training process even faster and easier, Amazon SageMaker can automatically tune your model to achieve the highest possible accuracy.\n",
"\n",
"<b>Deploy</b>\n",
"\n",
"Once your model is trained and tuned, Amazon SageMaker makes it easy to deploy in production so you can start generating predictions on new data (a process called inference). Amazon SageMaker deploys your model on auto-scaling clusters of Amazon SageMaker ML instances that are spread across multiple availability zones to deliver both high performance and high availability. Amazon SageMaker also includes built-in A/B testing capabilities to help you test your model and experiment with different versions to achieve the best results.\n",
"\n",
"Amazon SageMaker takes away the heavy lifting of machine learning, so you can build, train, and deploy machine learning models quickly and easily."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Benefits"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"<b>Get to Production with Machine Learning Quickly</b>\n",
"\n",
"Amazon SageMaker significantly reduces the amount of time needed to train, tune, and deploy machine learning models. Amazon SageMaker manages and automates all the sophisticated training and tuning techniques so you can get models into production quickly.\n",
"\n",
"<b>Choose Any Framework or Algorithm</b>\n",
"\n",
"Amazon SageMaker supports all machine algorithms and frameworks so you can use the technology you are already familiar with. Apache MXNet and TensorFlow are pre-installed, and Amazon SageMaker offers a range of built-in, high performance machine learning algorithms. If you want to train with an alternative framework or algorithm, you can bring your own in a Docker container.\n",
"\n",
"<b>One-Click Training and Deployment</b>\n",
"\n",
"Amazon SageMaker lets you begin training your model with a single click in the console or with a simple API call. When the training is complete, and you’re ready to deploy your model, you can launch it with a single click in the Amazon SageMaker console.\n",
"\n",
"<b>Easily Integrate With Your Existing Workflow</b>\n",
"\n",
"Amazon SageMaker is designed in three modules that can be used together or independently as part of any existing ML workflow you might already have in place.\n",
"\n",
"<b>Easy Access to Trained Models</b>\n",
"\n",
"Amazon SageMaker makes it easy to integrate machine learning models into your applications by providing an HTTPS endpoint that can be called from any application.\n",
"\n",
"<b>Optimized for Speed</b>\n",
"\n",
"Amazon SageMaker is pre-configured with the latest versions of TensorFlow and Apache MXNet, with CUDA9 library support for maximum performance with NVIDIA GPUs. With Amazon SageMaker P3 instances running NVIDIA Volta V100 GPUs, Amazon SageMaker lets you train deep learning models with unparalleled speed."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## FAQ and Pricing\n",
"\n",
"https://aws.amazon.com/sagemaker/faqs/\n",
"\n",
"https://aws.amazon.com/sagemaker/pricing/"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Documentation\n",
"\n",
"https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-dg.pdf"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "conda_python3",
"language": "python",
"name": "conda_python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.2"
}
},
"nbformat": 4,
"nbformat_minor": 2
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment