🦉DVC Profile picture
Dec 14, 2022 7 tweets 4 min read Read on X
✨ Visualize your pipelines as beautiful graphs of connected stages using “dvc dag” command.

Here's different types of graphs you can explore 🗺️

✅ Full DAG
➡️ DAG of outputs
🧜‍♀️ Mermaid flowchart
⚪️ DOT format
📣 Verbose

@Iterativeai @DVCorg
#data #pipeline #dag

🧵[1/7]
✅ Full DAG

“dvc dag --full” shows the full DAG that the target stage belongs to, instead of showing only its ancestors.

🧵[2/7]
➡️ DAG of outputs

“dvc dag --outs” shows a DAG of chained dependencies and outputs instead of the stages themselves.

🧵[3/7]
🧜‍♀️ Mermaid flowchart

“dvc dag --mermaid” displays DAG in mermaid format. It can be passed to third-party visualization utilities.

🧵[4/7]
⚪️ DOT format

“dvc dag --dot” shows DAG in DOT format. It can also be passed to third-party visualization utilities.

🧵[5/7]
📣 Verbose format

“dvc dag --verbose” displays detailed tracing information along with a graph.

🧵[6/7]
❤️ Thanks for Reading!

Visit our command-reference to know more about all the awesome features in DVC 👇
dvc.org/doc/command-re…

🧵[7/7]

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with 🦉DVC

🦉DVC Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @DVCorg

May 18, 2023
𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗦𝗽𝗼𝘁𝗹𝗶𝗴𝗵𝘁!!

We were privileged to have Matt Squire from @FuzzyLabsAI, a renowned expert in the MLOps space, as our guest.

During the session, Matt shared his insights on the benefits of open-source MLOps tools and how they can help businesses.

🧵🧵 Image
In his 𝗣𝗿𝗲𝘀𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻, Matt provided a comprehensive breakdown of the MLOps tool space, categorizing it into SaaS platforms, fully open source, and partly open source tools.
He went on to describe the defining traits of open source and why he believes it to be the best choice for MLOps, including its flexibility, cost-effectiveness, and agility.

Matt's views on open-source MLOps tools generated a lot of engagement from our community members.
Read 4 tweets
May 17, 2023
Several data practitioners have asked for a tutorial video from us on DVC, and we are glad to make this available.

In this video, you'll discover how to use the DVCLive and @huggingface datasets to create a Tweet Sentiment Analyzer.

🧵🧵🧵 Image
Do you want to learn more about using real-time metrics in machine learning experiments? Look nowhere else!

In this 𝘁𝘂𝘁𝗼𝗿𝗶𝗮𝗹, we'll show you how to use DVCLive and the Hugging Face Dataset to build a potent Twitter sentiment analyzer.
𝐃𝐕𝐂𝐋𝐢𝐯𝐞, a library from 𝐃𝐕𝐂, gives you the ability to easily monitor your ML experiments. You will be able to easily grasp the performance of your model at every stage thanks to its real-time metrics.
Read 9 tweets
Apr 25, 2023
We are happy to announce something exciting to the ML/AI Community🚨

DVC has just released its new integration with Optuna, enabling you to streamline and optimize your hyperparameter search process while keeping track of every step with version control.
Our users have been requesting this integration for a while, and we're thrilled to deliver!

With the DVC's extension for VS Code, you can easily monitor and analyze your results, saving you time and effort in your machine learning workflow.
Try out our new integration today and see the benefits for yourself! 🚀

This is the link to the video -

In the video, we explain how to use Optuna with Keras and view each iteration as an experiment in DVC's experiment table and plots. 🔍📈
Read 4 tweets
Apr 20, 2023
Here's a comprehensive thread on how to build a seamless batch-scoring experience.

You will learn how to:

🤖 Design ML pipelines with @DVCorg

🐈 Training with @gitlab and CML

🧪 ML experiments with @Iterativeai Studio

🚢 Deployments with @ApacheAirflow

🧵 [1/6]
🤖 Design #ML pipelines using #DVC! Streamline your process with the following steps:

1️⃣ Data prep

2️⃣ Feature engineering

3️⃣ Model training

4️⃣ Model evaluation

DVC optimizes run time & tracks changes for a more efficient workflow!

Get started with 'dvc exp run' 🚀

🧵 [2/6]
Read 14 tweets
Feb 28, 2023
What is your favourite IDE/Code Editor for Machine Learning?

1. Jupyter Lab/Notebook
2. R Studio
3. Pycharm
4. VS Code
5. Spyder
6. Others(name it)
Follow @DVCorg

A lot of people keep mentioning @code

Check out this @code Extension for Machine learning experiment management -

marketplace.visualstudio.com/items?itemName…
These are the Top @code extensions for Machine learning in 2023.

1. GitHub Copilot
2. DVC
3. GitLens
4. Jupyter
5. Jupyter Notebook Renderers
6. Python
7. Pylance
8. Python Indent
9. Indent-rainbow
10. Todo MD

You can also share other ones to educate others.
Read 5 tweets
Feb 13, 2023
Woah! Been here? Is deep learning model training going horribly wrong? 🙋🏽‍♂️

Iterative Studio makes this easy to see so you don't waste time and resources!

🧵 1/7
With Iterative Studio and DVCLive, you can monitor the progress of your long-running experiments against others that you or your team have performed. All are easily accessed at work, at home, or by the rest of your team on the project.

🧵2/7
You provide a couple environment variables for your model training job:

You can enter your STUDIO_TOKEN and dvc exp run if running locally

🧵3/7
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(