The landscape of Serverless GPU providers in 2023

All startups providing serverless GPUs

Photo by Nana Dua on Unsplash

The serverless GPU space is heating up with image and text generation startups blowing up!

Since my last writeup, a few companies have shut down (inferrd)and a few have been renamed (slai.io to beam.cloud). So writing a V2 version for 2023!

Here is the landscape of serverless GPU startups in 2023:

1. Modal

> Containerization built from the ground up in-house so super fast bootup (cold start minimized)

> Serverless GPU with job parallelization! A perfect combo for video/audio processing at scale in mins.

modal

2. Banana

Good online presence, tutorials to deploy popular models, and well-known in the dev community!

Banana

3. Replicate.com

Strong mentions on social media, how-to guides to deploy popular models like Whisper, Stable…