Shopify Engineering Profile picture
Making commerce better for everyone. Follow us for technical discussions and updates on how engineers build @Shopify. Explore open roles: https://t.co/NFSvvCJBXt

Nov 30, 2022, 12 tweets

Another Black Friday Cyber Monday (BFCM) weekend done and dusted!

We achieved 99.999+% uptime while averaging 3 Terabytes per minute of egress traffic across our infrastructure.

That’s 4.3 Petabytes per day! 🤯

Check out the thread for more awesome performance stats 🧵👇

🚢 Helping us stay on top of the traffic over BFCM, our MySQL fleet performed over 14 Million queries per second (QPS) at peak, averaging over 8.5 Million QPS throughout BFCM.

📇At peak BFCM, we indexed 16 Gigabytes per second of data of logs.

🔍To monitor the availability and scalability of our merchants and stay ahead of any potential issues, we collected up to 20 Billion operational metrics per minute and generated 27 Gigabits per second in metrics volume. 😲

📈We served 75.98 Million requests per minute to our commerce platform at peak. That’s 1.27 Million requests per second!

🎚️To keep our system responsive under heavy load this weekend we processed over 32 Billion asynchronous tasks using Resque.

💫Over the weekend we delivered over 24 Billion webhooks to support the +8,000 apps in the @ShopifyDevs ecosystem.

🚀Our data platform saw an average throughput increase of 35 percent over 2021.

Our batch data ingestion service ingested 1.1 Trillion (yes, with a T) total messages during BFCM.

📈Our #ApacheKafka streaming infrastructure served 20 Million messages per second at peak, that’s a 52% growth from 2021!

✉️ Shopify sent 437 Million emails on behalf of merchants, at a peak of 619K emails per minute; an increase of 58% and 44% from last year, respectively.

🌐BFCM has really become a global phenomenon! We served 7.29 Petabytes of traffic to shoppers outside of North America!

Our platform availability, scalability, and resiliency during BFCM meant our merchants could focus on doing what they do best:
💰 $7.5 Billion in global sales from Shopify merchants.
🕒 $3.5 Million per minute at peak on Friday.

What an amazing few days for Shopify merchants! 🎉

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling