rohan_daxini Profile picture
Feb 8 10 tweets 4 min read
@sidekiq can easily process, not just millions, but billions of background jobs, without any sweat.

- Company processing (few of many)
- Insights on how to scale
- Few handy Gem/Tools (eg. for concurrency and threshold throttling)

A thread 🧵👇

#Ruby #Rails #rubyonrails
"2.8 billion Sidekiq jobs were processed over the past month" @ConvertKit
"...we have implemented many changes that allow us to process billions of jobs that interact with our databases hosting more than 60 TB of data in more than 90 billion documents" sensortower.com
"Overall, we have processed over 25 Billion background jobs using Sidekiq" ~AirPR onclusive.com
"How We Scaled to Thousands of Sidekiq Workers"

A good read from SensorTower sensortower.com/blog/how-we-sc…
Scaling Sidekiq in production
- Rajagopal Sathyamurthi

medium.com/@rajagopals/sc…
💎 sidekiq-throttled 💎
Concurrency and threshold throttling for Sidekiq

github.com/sensortower/si…

by @SensorTower
💎 job-iteration💎
Makes your background jobs interruptible and resumable by design.

by @ShopifyEng

github.com/shopify/job-it…
What I’ve learned after 3 billion jobs in Sidekiq ~Anderson Dias

en.eventials.com/locaweb/what-i…

(PS: This video is not in English)
This thread is incomplete without gratitude to Sidekiq creator @getajobmike 🙇‍♂️
and
celebration for its 10th birthday recently 🎉

mikeperham.com/2022/01/17/hap…

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with rohan_daxini

rohan_daxini Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @rohan_daxini

Feb 2
Ruby gems worth checking and considering

A thread 🧵👇

#Ruby #Rails #rubyonrails
💎 scientist 💎
A Ruby library for carefully refactoring critical paths

github.com/github/scienti…
💎 strong_migrations 💎
Catch unsafe migrations in development

github.com/ankane/strong_…

by @andrewkane
Read 12 tweets
Jan 22
Concepts and topics every Ruby on Rails developer should know

A thread 🧵👇
💎 1/ Rails initialization process

Article: guides.rubyonrails.org/initialization…

Video1:

Video2:
💎 2/ What is Rack and how does it work?

Article1: guides.rubyonrails.org/rails_on_rack.…

Article2: thoughtbot.com/upcase/videos/…

Video1:

Video2:
Read 17 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

:(