Read on Twitter
/1 Why did Amazon Prime Video monitoring move ππ«π¨π¦ π¬ππ«π―ππ«π₯ππ¬π¬ ππ¨ π¦π¨π§π¨π₯π’ππ‘π’π? How can it save 90% cost?
The diagram below shows the architecture comparison before and after the migration.
The diagram below shows the architecture comparison before and after the migration.
/2 What is Amazon Prime Video Monitoring Service?
Prime Video service needs to monitor the quality of thousands of live streams. The monitoring tool automatically analyzes the streams in real-time and identifies quality issues like block corruption, video freeze, etc.
Prime Video service needs to monitor the quality of thousands of live streams. The monitoring tool automatically analyzes the streams in real-time and identifies quality issues like block corruption, video freeze, etc.
/3 here are 3 steps: media converter, defect detector, and real-time notification.
/4
πΉ What is the problem with the old architecture?
The old architecture was based on Amazon Lambda, which was good for building services quickly. However, it was not cost-effective when running the architecture at a high scale. The two most expensive operations are:
πΉ What is the problem with the old architecture?
The old architecture was based on Amazon Lambda, which was good for building services quickly. However, it was not cost-effective when running the architecture at a high scale. The two most expensive operations are:
/5
1. The orchestration workflow - AWS step functions charge users by state transitions and the orchestration performs multiple state transitions every second.
1. The orchestration workflow - AWS step functions charge users by state transitions and the orchestration performs multiple state transitions every second.
/6
2. Data passing between distributed components - the intermediate data is stored in Amazon S3 so that the next stage can download. The download can be costly when the volume is high.
2. Data passing between distributed components - the intermediate data is stored in Amazon S3 so that the next stage can download. The download can be costly when the volume is high.
/7
πΉ Monolithic architecture saves 90% cost
A monolithic architecture is designed to address thecost issues. There are still 3 components, but the media converter and defect detector are deployed in the same process, saving the cost of passing data over the network.
πΉ Monolithic architecture saves 90% cost
A monolithic architecture is designed to address thecost issues. There are still 3 components, but the media converter and defect detector are deployed in the same process, saving the cost of passing data over the network.
/8 Surprisingly, this approach to deployment architecture change led to 90% cost savings!
This is an interesting and unique case study because microservices have become a go-to and fashionable choice in the tech industry.
This is an interesting and unique case study because microservices have become a go-to and fashionable choice in the tech industry.
/9 It's good to see that we are having more discussions about evolving the architecture and having more honest discussions about its pros and cons. Decomposing components into distributed microservices comes with a cost.
/10 πΉ What did Amazon leaders say about this?
Amazon CTO Werner Vogels: βBuilding ππ―π¨π₯π―πππ₯π π¬π¨πππ°ππ«π π¬π²π¬πππ¦π¬ is a strategy, not a religion. And revisiting your architectures with an open mind is a must.β
Amazon CTO Werner Vogels: βBuilding ππ―π¨π₯π―πππ₯π π¬π¨πππ°ππ«π π¬π²π¬πππ¦π¬ is a strategy, not a religion. And revisiting your architectures with an open mind is a must.β
/11 Ex Amazon VP Sustainability Adrian Cockcroft: βThe Prime Video team had followed a path I call πππ«π―ππ«π₯ππ¬π¬ π
π’π«π¬πβ¦I donβt advocate πππ«π―ππ«π₯ππ¬π¬ ππ§π₯π²β.
/12
Get a Free System Design PDF (158 pages) by subscribing to our weekly newsletter today: blog.bytebytego.com
Get a Free System Design PDF (158 pages) by subscribing to our weekly newsletter today: blog.bytebytego.com
/13 I hope you've found this thread helpful.
Follow me @alexxubyte for more.
Like/Retweet the first tweet below if you can:
Follow me @alexxubyte for more.
Like/Retweet the first tweet below if you can:
https://twitter.com/alexxubyte/status/1655601921322012673
β’ β’ β’
Missing some Tweet in this thread? You can try to
force a refresh
γ
