Zongheng Yang Profile picture
Nov 16, 2022 β€’ 7 tweets β€’ 5 min read β€’ Read on X
Introducing SkyPilot:

Run ML and Data Science jobs on any cloud, with massive cost savings.

πŸš€ Run jobs on any cloud
⏰ Get GPU/TPU/CPU in 1 click
πŸ’΅ Reduce > 3x cost

skypilot.co
Read blog: medium.com/@zongheng_yang…

🧡1/
2/ Clouds are expensive πŸ’΅. SkyPilot reduces cloud bills by 3-6x.

Here's SkyPilot training BERT on WikiText-103 from @huggingface on spot instances *across* AWS & GCP. (Video attached above)

SkyPilot offers auto-recovery from preemptions, saving 3x cost for this job. Image
3/ Save more πŸ’΅πŸ’΅πŸ’΅ by (1) auto stopping idle clusters (2) auto picking cheapest region/cloud.

Here's an example of SkyPilot shopping for the cheapest region/cloud for allocating 8x A100 GPUs.

Single-cloud users also save on intra-cloud price differences (see blog for details). Image
4/ Clouds are also getting hard to use 🧐. With SkyPilot, you can run ML/Data Science jobs on any cloud, with no code change πŸš€.

SkyPilot simplifies the cloud infra heavy-lifting that ML/DS users don't want to deal with.

Running an existing project is simple: Image
5/ Reliably spin up GPU/TPU/CPU

Clouds often run out of capacity and getting VMs fails.

SkyPilot solves this by:
🌐 checking all regions and clouds
πŸ”€ auto-failover across them

⏰ Reliably spin up a VM with 1 command:
$ sky gpunode
$ sky tpunode
$ sky cpunode
SkyPilot is in active use by dozens of ML/data science users in 10+ orgs.

β€’ Groups at @berkeley_ai @stanfordnlp use SkyPilot for training on GPUs and TPUs
β€’ @salkinstitute uses SkyPilot to cut 80% cost for bio batch jobs on CPU instances
β€’ Active collab w/ several companies
πŸš€πŸš€ Start using the cloud easily and cost effectively today πŸš€πŸš€

$ pip install skypilot

Star our GitHub: skypilot.co
Read blog: medium.com/@zongheng_yang…

Follow @skypilot_org for new updates we'll be sharing in the coming months!

#Cloud #MultiCloud #ML #DataScience

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with Zongheng Yang

Zongheng Yang Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(