neptune.ai Profile picture
Dec 6 6 tweets 4 min read
#MLOps standard industry best practices” don’t apply to most #ML teams’ reality.

Why?

Those who write and share best practices are doing ML at a hyper scale.

Those who read and re-share them are doing ML at a reasonable scale.
Companies like Google, Netflix, Uber, and Airbnb are doing an awesome job for the community by sharing their blogs, white papers, and open-sourcing their tools.

But whatever they do, it is shaped (and biased) by THEIR MLOps problems.

Most companies don’t have their problems.
They would love to have their problems, but they don’t.

They operate on a smaller scale & have different (& other) challenges.

And they are the biggest part of the ML industry.

They want to know what’s the best way to do MLOps at their scale, with their resources & limitations
And since there is not much out there specifically for RS companies, they read (& share) whatever is out there.

And the vicious cycle continues.

The moral of the story is this.

Think about
-your problem
-your use case
-your limitations
-your needs

Solve YOUR MLOps problems
Don’t do something just because it is a “standard industry practice”.

Btw, here are some places where you can find good stuff about reasonable scale MLOps:
- @jacopotagliabue, @xLaszlo, @aesroka, @ElectricWeegie on linkedin
mlops.community
- Mlops discord buff.ly/3VE08Gg
- MLOps reddit buff.ly/3WLkTk7
- MLOps blog (and our guide to Reasonable scale MLOps) buff.ly/2Z5bA2J
- MLOps live buff.ly/3TmuKtC

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with neptune.ai

neptune.ai Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @neptune_ai

Dec 7
Great @pytorchlightnin + Hydra (clean and scalable) template to kickstart any deep learning project by @ukashxukash (and some other contributors).

Main ideas behind it:
-Predefined structure: clean & scalable so that work can easily be extended
-Rapid Experimentation: thanks to hydra command line superpowrs
-Little Boilerplate: thanks to automating pipelines with config instantiation
-Main Configs: specify default training configuration
-Experiment Configs: override chosen hyperparameters
-Workflow: comes down to 4 simple steps
-Experiment Tracking: @TensorBoard, @weights_biases, neptune.ai, @Cometml, @MLflow, @CSVLogger
-Logs: all logs are stored in a dynamically generated folder structure
-& more
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(