Another Black Friday Cyber Monday (BFCM) weekend done and dusted!
We achieved 99.999+% uptime while averaging 3 Terabytes per minute of egress traffic across our infrastructure.
That’s 4.3 Petabytes per day! 🤯
Check out the thread for more awesome performance stats 🧵👇
🚢 Helping us stay on top of the traffic over BFCM, our MySQL fleet performed over 14 Million queries per second (QPS) at peak, averaging over 8.5 Million QPS throughout BFCM.
📇At peak BFCM, we indexed 16 Gigabytes per second of data of logs.
🔍To monitor the availability and scalability of our merchants and stay ahead of any potential issues, we collected up to 20 Billion operational metrics per minute and generated 27 Gigabits per second in metrics volume. 😲
📈We served 75.98 Million requests per minute to our commerce platform at peak. That’s 1.27 Million requests per second!
🎚️To keep our system responsive under heavy load this weekend we processed over 32 Billion asynchronous tasks using Resque.
💫Over the weekend we delivered over 24 Billion webhooks to support the +8,000 apps in the @ShopifyDevs ecosystem.
🚀Our data platform saw an average throughput increase of 35 percent over 2021.
Our batch data ingestion service ingested 1.1 Trillion (yes, with a T) total messages during BFCM.
📈Our #ApacheKafka streaming infrastructure served 20 Million messages per second at peak, that’s a 52% growth from 2021!
✉️ Shopify sent 437 Million emails on behalf of merchants, at a peak of 619K emails per minute; an increase of 58% and 44% from last year, respectively.
🌐BFCM has really become a global phenomenon! We served 7.29 Petabytes of traffic to shoppers outside of North America!
Our platform availability, scalability, and resiliency during BFCM meant our merchants could focus on doing what they do best:
💰 $7.5 Billion in global sales from Shopify merchants.
🕒 $3.5 Million per minute at peak on Friday.
What an amazing few days for Shopify merchants! 🎉
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Taking a step back — preparing for an event of this magnitude doesn't happen spontaneously. We initiated load testing in April and refined both our forecast and capacity model for our merchants. A special thanks to our friends @GoogleCloud for their support this holiday season🙌
During the BFCM rush, our MySQL fleet (a powerful combo of MySQL 5.7 and MySQL 8) demonstrated top notch performance, handling over 19 million queries per second (QPS) at peak.
2021 was our biggest Black Friday Cyber Monday ever! Together with our friends at @GoogleCloud we achieved near-perfect uptime while averaging ~30TB/min of egress traffic across our infrastructure. That’s a massive ~43PB/day!
Here are some of the most interesting stats 🧵👇
⏪ Rewinding for a moment — preparing for an event of this scale doesn't happen overnight. In anticipation of BFCM 2021 we began load testing back in July! To better simulate real global traffic we spread out our load generation across @GoogleCloud's global network.
To keep up with the traffic over BFCM our Core MySQL fleet performed over 11 Million QPS and delivered 11 TERABYTES per second read I/O.
Ready for #RubyConf2021? We'll be there with a full lineup speakers from Shopify and opportunities to get connected both on the ground and virtually! Tickets are still available here: rubyconf.org
Want to know what we have coming up? Follow along on this thread 👇
Take it easy on the first day of the conference because we'll pick things up on day two with talks from @tenderlove, @paracycle, @flavorjones, and @kddnewton! Plus later in the day we'll have an informal session at our booth that you won't want to miss...