๐Ÿฆ‰DVC Profile picture
Jan 16 โ€ข 7 tweets โ€ข 4 min read
๐Ÿ‘จ๐Ÿปโ€๐Ÿ’ป Setup CI/CD in your machine learning projects using these simple yet powerful โ€œโ™พ๏ธ CML commandsโ€:

๐Ÿ”„ ci
๐Ÿƒโ€โ™‚๏ธ runner
โคด๏ธ pr
๐Ÿ’ฌ comment
๐Ÿง‘๐Ÿผโ€๐Ÿซ tensorboard

@Iterativeai @DVCorg
#cml #tensorboard #opensource

๐Ÿงต[1/7]
๐Ÿ”„ ci

The โ€œcml ciโ€ command prepares the whole repository for CML operations after creating the cml.yaml file

๐Ÿงต[2/7]
๐Ÿƒโ€โ™‚๏ธ runner

When a workflow requires computational resources, CML can automatically allocate cloud instances using โ€œcml runnerโ€. You can spin up instances on AWS, Azure, GCP, Kubernetes or any other provider. We can start a runner using โ€œcml runner launchโ€ command.

๐Ÿงต[3/7]
โคด๏ธ pr

We can also commit specified files to a new branch and create a pull request using โ€œcml pr createโ€ command.

๐Ÿงต[4/7]
๐Ÿ’ฌ comment

We can effortlessly post a Markdown report as a comment on a commit or pull/merge request with โ€œcml comment createโ€ command.

๐Ÿงต[5/7]
๐Ÿง‘๐Ÿผโ€๐Ÿซ tensorboard

The โ€œcml tensorboard connectโ€ returns a link to a tensorboard.dev page.

๐Ÿงต[6/7]
๐Ÿ‘จ๐Ÿปโ€๐Ÿ’ป Thanks for reading till here!

You can head straight to the docs to start integrating all these features in your projects ๐Ÿ‘‡
cml.dev/doc/ref

๐Ÿงต[7/7]

โ€ข โ€ข โ€ข

Missing some Tweet in this thread? You can try to force a refresh
ใ€€

Keep Current with ๐Ÿฆ‰DVC

๐Ÿฆ‰DVC Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @DVCorg

Jan 12
๐ŸŽ Ding Dong! Hereโ€™s a flash from Iterative Community this month๐Ÿ‘‡

๐Ÿฆฎ MLOps Guide
๐Ÿงช DVC Extension
๐ŸŒŒ A Fable about MLOps
๐Ÿ“ Cheatsheet for DVC
๐Ÿง‘โ€๐Ÿ’ป Data Query Language

@Iterativeai @DVCorg
#mlOps #data #community

๐Ÿงต[1/7]
๐Ÿฆฎ MLOps Guide

For their engineering final project at @Insper, Arthur Olga, Gabriel Monteiro, Guilherme Leite, and Vinicius Lima created the MLOps Guide, which provides a Complete MLOps development cycle using DVC, CML, and IBM Watson.

mlops-guide.github.io

๐Ÿงต[2/7]
๐Ÿงช DVC Extension

@erykml1 wrote a fabulous, in-depth tutorial on experiment tracking using our new DVC Extension for VS Code ๐Ÿ‘‡

towardsdatascience.com/turn-vs-code-iโ€ฆ

๐Ÿงต[3/7]
Read 7 tweets
Dec 20, 2022
๐Ÿ‘จ๐Ÿปโ€๐Ÿ’ป Ever tried deploying a model? and ended up entangled in scripts?

Hereโ€™s how MLEM lets us do โ€œsingle command deploymentsโ€ โšก๏ธ:

- Deployment Options
- Setting up the Environment
- Run the command
- Getting Predictions

@Iterativeai @DVCorg
#mlem #aws #deployment

๐Ÿงต[1/6]
๐Ÿš€ MLEM gives us a simple and powerful API to deploy to platforms such as:

โœ… @awscloud Sagemaker
โœ… Docker Container
โœ… Heroku
โœ… Kubernetes

๐Ÿงต[2/6]
๐ŸŒฑ Setting up the Environment

Setting up the environment varies for each case, but here let's take the example of Heroku.

We can either set โ€œHEROKU_API_KEYโ€ environment variable or use Heroku CLI to run โ€œheroku loginโ€.

๐Ÿงต[3/6]
Read 6 tweets
Dec 15, 2022
๐——๐—ฉ๐—–๐—Ÿ๐—ถ๐˜ƒ๐—ฒ + ๐˜†๐—ผ๐˜‚๐—ฟ ๐—ฐ๐—ผ๐—ฑ๐—ฒ = ๐—˜๐˜…๐—ฝ๐—ฒ๐—ฟ๐—ถ๐—บ๐—ฒ๐—ป๐˜ ๐˜๐—ฟ๐—ฎ๐—ฐ๐—ธ๐—ถ๐—ป๐—ด!

Produce an experiment tracker in CLI or @Code with DVCLive and a few lines added to your code or notebook

Version your ML experiments fast with no database or SaaS needed colab.research.google.com/drive/1VKEBdSgโ€ฆ
1/4
๐—›๐—ผ๐˜„ ๐—ฑ๐—ผ๐—ฒ๐˜€ ๐—ถ๐˜ ๐˜„๐—ผ๐—ฟ๐—ธ?

1 . Install DVC and DVCLive ๐š™๐š’๐š™ ๐š’๐š—๐šœ๐š๐šŠ๐š•๐š• --๐šž๐š™๐š๐š›๐šŠ๐š๐šŽ ๐š๐šŸ๐šŒ

2. Initialize your repo with ๐—š๐—ถ๐˜ and ๐——๐—ฉ๐—–

2/4
3 . In your code or notebook, enable DVC experiment tracking using DVCLive with ๐šœ๐šŠ๐šŸ๐šŽ_๐š๐šŸ๐šŒ_๐šŽ๐šก๐š™=๐šƒ๐š›๐šž๐šŽ

3/4
Read 4 tweets
Dec 14, 2022
โœจ Visualize your pipelines as beautiful graphs of connected stages using โ€œdvc dagโ€ command.

Here's different types of graphs you can explore ๐Ÿ—บ๏ธ

โœ… Full DAG
โžก๏ธ DAG of outputs
๐Ÿงœโ€โ™€๏ธ Mermaid flowchart
โšช๏ธ DOT format
๐Ÿ“ฃ Verbose

@Iterativeai @DVCorg
#data #pipeline #dag

๐Ÿงต[1/7]
โœ… Full DAG

โ€œdvc dag --fullโ€ shows the full DAG that the target stage belongs to, instead of showing only its ancestors.

๐Ÿงต[2/7]
โžก๏ธ DAG of outputs

โ€œdvc dag --outsโ€ shows a DAG of chained dependencies and outputs instead of the stages themselves.

๐Ÿงต[3/7]
Read 7 tweets
Dec 12, 2022
๐Ÿฆ‰ DVC is designed to improve upon past solutions to make the life of ML teams easier. Hereโ€™s how it differentiates from other related technologies:

๐Ÿฑ Git
๐Ÿ“ฆ Git-LFS (Large File Storage)
๐Ÿ—„ Git-annex

@Iterativeai @DVCorg
#mlOps #data #git #lfs

๐Ÿงต[1/5]
๐Ÿฑ Git vs DVC

DVC builds upon Git by the concept of data files โ€“ large files that should not be stored in a Git repository, but need to be tracked and versioned.

It leverages Git's features to enable managing different versions of data, data pipelines, and experiments.

๐Ÿงต[2/5]
๐Ÿ“ฆ Git-LFS vs DVC

DVC does not require special servers like Git-LFS demands. Any cloud storage like S3, Google Cloud Storage, or even an SSH server can be used as a remote storage.

No additional databases, servers, or infrastructure are required.

๐Ÿงต[3/5]
Read 5 tweets
Dec 3, 2022
๐Ÿฆ‰ Hereโ€™s a quick brief from Iterative Community๐Ÿ‘‡

๐Ÿช GitHub Universe
๐Ÿค Hacktoberfest Contributions
๐Ÿ“น Closure Session 2 event
โ™พ๏ธ CML at NeurIPS
๐Ÿ‡ฌ๐Ÿ‡ง MLOps Summit London
๐Ÿ‡บ๐Ÿ‡ธ ODSC West

@Iterativeai @DVCorg
#mlOps #data #pipeline #dag

๐Ÿงต[1/8]
๐Ÿช Dmitry at GitHub Universe

Dmitry Petrov (@FullStackML) spoke at #GitHubUniverse on โ€œML with Git: experiment tracking in Codespacesโ€ on 8th November.

He presented how to use the DVC extension for VS Code and Codespaces to streamline ML experimentation process.

๐Ÿงต[2/8]
๐Ÿค Hacktoberfest Contributions

Huge thanks to @francesco086, vvssttkk, and @DeepyamanDatta for their contributions!

We are sending personalized shirts to them.

Special thanks to @mertbozkirr for leading the Hacktoberfest charge!

๐Ÿงต[3/8]
Read 8 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(