Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Shopify Engineering Profile picture
@ShopifyEng
Nov 30, 2022 • 12 tweets • 2 min read • Read on X
Another Black Friday Cyber Monday (BFCM) weekend done and dusted!

We achieved 99.999+% uptime while averaging 3 Terabytes per minute of egress traffic across our infrastructure.

That’s 4.3 Petabytes per day! 🤯

Check out the thread for more awesome performance stats 🧵👇
🚢 Helping us stay on top of the traffic over BFCM, our MySQL fleet performed over 14 Million queries per second (QPS) at peak, averaging over 8.5 Million QPS throughout BFCM.
📇At peak BFCM, we indexed 16 Gigabytes per second of data of logs.
🔍To monitor the availability and scalability of our merchants and stay ahead of any potential issues, we collected up to 20 Billion operational metrics per minute and generated 27 Gigabits per second in metrics volume. 😲
📈We served 75.98 Million requests per minute to our commerce platform at peak. That’s 1.27 Million requests per second!
🎚️To keep our system responsive under heavy load this weekend we processed over 32 Billion asynchronous tasks using Resque.
💫Over the weekend we delivered over 24 Billion webhooks to support the +8,000 apps in the @ShopifyDevs ecosystem.
🚀Our data platform saw an average throughput increase of 35 percent over 2021.

Our batch data ingestion service ingested 1.1 Trillion (yes, with a T) total messages during BFCM.
📈Our #ApacheKafka streaming infrastructure served 20 Million messages per second at peak, that’s a 52% growth from 2021!
✉️ Shopify sent 437 Million emails on behalf of merchants, at a peak of 619K emails per minute; an increase of 58% and 44% from last year, respectively.
🌐BFCM has really become a global phenomenon! We served 7.29 Petabytes of traffic to shoppers outside of North America!
Our platform availability, scalability, and resiliency during BFCM meant our merchants could focus on doing what they do best:
💰 $7.5 Billion in global sales from Shopify merchants.
🕒 $3.5 Million per minute at peak on Friday.

What an amazing few days for Shopify merchants! 🎉

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Shopify Engineering

Shopify Engineering Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @ShopifyEng

Shopify Engineering Profile picture
Dec 3
Powering global-scale commerce demands observability systems that can handle immense scale. During the BFCM peak, we processed an astounding 7TB of logs per second 🚀📊
Check out more BFCM highlights 🧵👇
We averaged 170 million requests per minute at Shopify’s edge over BFCM, with bursts over 280 million requests per minute 🚀
We processed and served over 57PB of data from our infrastructure over BFCM 🙌
Read 11 tweets
Shopify Engineering Profile picture
Nov 28, 2023
That's a wrap on another incredible BFCM! You got a nerdy preview from @tobi, and we're back with the final stats. Let’s go!🧵👇

We achieved 99.999+% uptime, handling 29.7 PB of data served from across our infrastructure over the entire event! That’s over 5 TB/min.
Taking a step back — preparing for an event of this magnitude doesn't happen spontaneously. We initiated load testing in April and refined both our forecast and capacity model for our merchants. A special thanks to our friends @GoogleCloud for their support this holiday season🙌
During the BFCM rush, our MySQL fleet (a powerful combo of MySQL 5.7 and MySQL 8) demonstrated top notch performance, handling over 19 million queries per second (QPS) at peak.
Read 8 tweets
Shopify Engineering Profile picture
Nov 30, 2021
2021 was our biggest Black Friday Cyber Monday ever! Together with our friends at @GoogleCloud we achieved near-perfect uptime while averaging ~30TB/min of egress traffic across our infrastructure. That’s a massive ~43PB/day!

Here are some of the most interesting stats 🧵👇
⏪ Rewinding for a moment — preparing for an event of this scale doesn't happen overnight. In anticipation of BFCM 2021 we began load testing back in July! To better simulate real global traffic we spread out our load generation across @GoogleCloud's global network. A chart showing load testing and peak CPU usage across Shopi
To keep up with the traffic over BFCM our Core MySQL fleet performed over 11 Million QPS and delivered 11 TERABYTES per second read I/O.
Read 9 tweets
Shopify Engineering Profile picture
Oct 28, 2021
Ready for #RubyConf2021? We'll be there with a full lineup speakers from Shopify and opportunities to get connected both on the ground and virtually! Tickets are still available here: rubyconf.org

Want to know what we have coming up? Follow along on this thread 👇 Shopify at RubyConf Denver 2021, November 8-10. 15 speakers,
Take it easy on the first day of the conference because we'll pick things up on day two with talks from @tenderlove, @paracycle, @flavorjones, and @kddnewton! Plus later in the day we'll have an informal session at our booth that you won't want to miss... RubyConf 2021 Denver speaker promotional graphic featuring aRubyConf 2021 Denver speaker promotional graphic featuring aRubyConf 2021 Denver speaker promotional graphic featuring aRubyConf 2021 Denver speaker promotional graphic featuring a
☕ Better get your coffee early on day three because we'll have a jam packed morning with sessions from @bruckmayer, @thecodepixi, @jemmaissroff, and @love2code. RubyConf 2021 Denver speaker promotional graphic featuring aRubyConf 2021 Denver speaker promotional graphic featuring aRubyConf 2021 Denver speaker promotional graphic featuring aRubyConf 2021 Denver speaker promotional graphic featuring a
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(