Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Lightning AI ⚡️ Profile picture
Lightning AI ⚡️
@LightningAI
From idea to AI, Lightning fast ⚡️. Creators of AI Studio, PyTorch Lightning, TorchMetrics, Fabric, Lit-GPT, Lit-LLaMA 🚀
Jerome Ku Profile picture 1 subscribed
Jan 19, 2023 • 4 tweets • 1 min read
Train a 20-billion parameter GPT model for text prediction on 3 GPU nodes with Lightning. 🤯

The entire training process is contained in a simple script that you can scan, read, and understand in just a few seconds.✅

🧵(1/4) Image You can customize any part of this process: the dataset, model, hyperparameters, and training strategy.

Also, you can easily swap out which 🛠️hardware you’re using. With a single flag, you can choose to run on 3 nodes (as in this example), or higher to fit your model.

🧵(2/4)