Skip to content

Instantly share code, notes, and snippets.

@devinschumacher
Last active April 23, 2024 14:42
Show Gist options
  • Star 8 You must be signed in to star a gist
  • Fork 3 You must be signed in to fork a gist
  • Save devinschumacher/87dd5b87234f2d0e5dba56503bfba533 to your computer and use it in GitHub Desktop.
Save devinschumacher/87dd5b87234f2d0e5dba56503bfba533 to your computer and use it in GitHub Desktop.
Cloud GPUs // The Best Servers, Services & Providers [RANKED!]

Cloud GPUs: Servers, Providers & Everything You Would Ever Need

Your company's GPU computing strategy is essential whether you engage in 3D visualization, machine learning, AI, or any other form of intensive computing.

There was a time when businesses had to wait for long periods of time while deep learning models were being trained and processed. Because it was time-consuming, costly, and created space and organization problems, it reduced their output.

This problem has been resolved in the most recent GPU designs. Because of their high parallel processing efficiency, they are well-suited for handling large calculations and speeding up the training of your AI models.

When it comes to deep learning, GPUs can speed up the training of neural networks by a factor of 250 compared to CPUs, and the latest generation of cloud GPUs is reshaping data science and other emerging technologies by delivering even greater performance at a lower cost and with the added benefits of easy scalability and rapid deployment.

This article will provide an overview of cloud GPUs, their applications in artificial intelligence, machine learning, and deep learning, and the top cloud GPU deployment platforms available today.

The Top Cloud GPU Rental Provider: Latitude

latitude cloud gpu



Cloud GPU Providers - RANKED!

  1. Latitude.sh
  2. OVH Cloud
  3. Paperspace
  4. Vultr
  5. Vast AI
  6. Gcore
  7. Lambda Labs
  8. Genesis Cloud
  9. Tensor Dock
  10. Microsoft Azure
  11. IBM Cloud
  12. FluidStack
  13. Leader GPU
  14. DataCrunch
  15. RunPod
  16. Google Cloud GPU
  17. Amazon AWS
  18. Jarvis Labs

RunPod

Cloud GPU Provider Website Pricing Free Trial / Free Credits
Google Colaboratory ❤️ https://colab.research.google.com FREE FREE FOREVER*
Kaggle Kernels https://www.kaggle.com FREE FREE FOREVER*
Activeloop https://www.activeloop.ai - -
Alibaba cloud https://alibabacloud.com Pay as you go $300 credits
AWS Sagemaker https://aws.amazon.com/sagemaker/ pricing 🏷️ Free plans
Azure https://azure.microsoft.com/en-in/services/machine-learning-studio/ pricing 🏷️ $200 credits
Cirrascale http://www.cirrascale.com pricing 🏷️ -
Cloudalize https://www.cloudalize.com pricing 🏷️ -
Crestle https://crestle.ai pricing 🏷️ -
DataCrunch https://datacrunch.io V100 at $0.69/h Fast.ai Special Discount
Dataiku https://www.dataiku.com - Free Plans
Deep Cognition https://deepcognition.ai pricing 🏷️ Desktop version free to use
Deepnote https://www.deepnote.com/ Currently in Beta -
Examesh.de https://examesh.de/en/ - 15min of NVIDIA Tesla V100 32 GB
Exoscale https://www.exoscale.com/gpu/ pricing 🏷️ -
Genesis Cloud https://www.genesiscloud.com/ 1080Ti at $0.30/hour 166 free GPU hours
Golem https://golem.network - -
Google Cloud Platform https://cloud.google.com/gpu/ pricing 🏷️ $300 credits
GPUeater https://gpueater.com pricing 🏷️ -
GPULab https://gpulab.io pricing 🏷️ -
Hostkey https://hostkey.com/dedicated-servers/gpu/ GPU from 90 euros/month Free trials available
IBM Cloud https://www.ibm.com/cloud/gpu Pay as you go $200 credits
Jarvis Labs https://jarvislabs.ai/ RTX 5000 at $0.49/hr Fast.ai Special Discount
Lambda Labs https://lambdalabs.com/service/gpu-cloud 4x Pascals start at $1.50/hr Reserved Instance Discounts
Leadergpu https://www.leadergpu.com pricing 🏷️ -
Nimblebox https://nimblebox.ai pricing 🏷️ Free $10 worth of cloud credits
Nvidia cloud Nvidia Cloud GPU - -
One Stop System https://www.onestopsystems.com - -
Paperspace https://www.paperspace.com pricing 🏷️ Referal Program Available
puzl.ee https://puzl.ee/gpu-cloud Rent a fraction of A100 for 0.40EUR/h Free cloud Kubernetes API, up to 10 GPUs per pod
Q Blocks https://qblocks.cloud/ $20 package ~ 100 GPU hours Free 20 Compute Hours for Early access
Rapid Switch https://www.rapidswitch.com pricing 🏷️ -
Spell https://spell.run/developers pricing 🏷️ $10 GPU credit on signup
TensorDock https://tensordock.com pricing 🏷️ pricing 🏷️ Discounts to FOOS, students and researchers
Vast.ai https://vast.ai pricing 🏷️ -
vscaler https://www.vscaler.com On Request -

So, What are Cloud GPUs?

Let's start with GPUs to get a better grasp on cloud GPUs.

Graphics processing units (GPUs) are specialized electronic circuitry that can rapidly alter and manipulate memory to expedite the generation of images and graphics.

Modern graphics processing units are more effective at image and computer graphics manipulation than conventional central processing units (CPUs) due to their parallel structure (CPUs). The central processing unit (CPU) die, the PC's video card, or the motherboard could all house a GPU.

Massive artificial intelligence (AI) and deep learning tasks can be executed in the cloud using cloud graphics processing units (GPUs). In order to use this function, a GPU is not required.

Popular GPU manufacturers include AMD, NVIDIA, Radeon, and GeForce.


Deploy your model as a Web app

Have an idea and want to serve to world 🌎 , create a Webapp and deploy it as a flask , Django etc

Vendor Website Pricing Free Trial / Free Credits
Deta https://www.deta.sh/ pricing 🏷️ Free plan available
Digital Ocean https://www.digitalocean.com Pay as you go Free $100 credits with github student pack
Glitch https://glitch.com - -
Heroku https://www.heroku.com pricing 🏷️ Free plan (model<500MB)
PythonAnywhere https://www.pythonanywhere.com/ pricing 🏷️ Free Beginner Account Available
Render https://render.com pricing 🏷️ -
Streamlit For Teams https://www.streamlit.io/ pricing 🏷️ Currently in Beta ( Streamlit Cloud Tool )
Zeit https://zeit.co pricing 🏷️ Free plan available

MLOps Platforms

A Beautiful marriage 💍 between Machine Learning and DevOps ( A Match Made in Heaven )

Working on Serious Enterprise Level projects that has potential to serve millions of people and make 💰 , leave it to the power ⚡ of DevOps to manage your Machine Learning LifeCycle

Project / Platform Website Pricing Free Trial / Free Credits
Akira.ai https://www.akira.ai/mlops-platform/ pricing 🏷️ -
Algo https://www.algomox.com/aiops - Free Edition Available
Algorithmia https://algorithmia.com/ pricing 🏷️ -
Allegro https://www.allegro.ai/ pricing 🏷️ - for enterprise Open Source & Enterprise Version
Amazon Sagemaker https://aws.amazon.com/sagemaker/ pricing 🏷️ Available for free as part of AWS Free Tier
Arrikto https://arrikto.com/ - -
ClearML https://clear.ml pricing 🏷️ Free plan available
Cnvrg https://cnvrg.io/platform/mlops/ pricing 🏷️ -
DataRobot https://www.datarobot.com/platform/mlops/ - $500 of free usage credits across products
Flyte https://flyte.org/ - Open Source :octocat: Link
Google Cloud AI Platform https://cloud.google.com/ai-platform/ pricing 🏷️ -
Gradient from Paperspace https://gradient.paperspace.com/ pricing 🏷️ Free GPUs by Gradient
Grid.ai https://grid.ai/ pricing 🏷️ $25 free credits + special promo for researchers!
HPE - Ezmeral Solution from HP -
HPE - GreenLake Solution from HP -
Iguazio https://iguazio.com/mlops/ - 14 Day Free Trial
KubeFlow ( for k8s ) https://www.kubeflow.org/ - Open Source :octocat: Link
MLFlow https://mlflow.org/ - Open Source :octocat:
Neptune.ai https://neptune.ai/ pricing 🏷️ Freemium
Neu.ro https://neu.ro/ - -
Seldon Core https://seldon.io/tech/products/core/ - -
Valohai https://valohai.com pricing 🏷️ -

Perks and offers

If you are a student or researcher you can get extra credts , contact the provider

  • Examesh supports Public Research for free and gives special discount to long-term bookings.

  • Paperspace provides $10 of free Gradient° credit fast.ai link

  • Do you have a GPU lying around rent your machine to Earn money using Vast.ai*

  • Test Drive Nvidia GPU link

  • AWS Cloud Credits for Research -link

  • Nvidia GPU Grant Program- link

  • If you are a Startup then google has you covered wth Startup Program giving you credits from $1000 to $100000 - link

  • Google giving cluster of 1000 TPUs to researcher In total, this cluster delivers a total of more than 180 petaflops of raw compute power! techcrunch link - application link

  • Google cloud Education Grant - link

  • Github Education pack - along with many offers has upto $110 credits for AWS - link

  • Watch out on fast.ai Forums to get coupon code for free credits

  • Want to use a Super Computer but don't have one, go for Golem - Golem is a decentralized marketplace for computing power. It enables CPUs and GPUs to connect in a peer-to-peer network, enabling both application owners and individual users to rent resources from other users machines, so turbo charge your next model training.

  • Hostkey provides grants for research, startups and competition winners link

* Notes

  • Google colab and Kaggle kernels have limited session time
  • Most of the gpu providers run on top of AWS , GCP etc so may have more or less same pricing as the latter
  • Information given above is best to my searching ability , you may recheck with the provider for pricing and other info
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment