Ankur Kumar πŸ’« Profile picture
A Techie, Blogger & Mentor | Shares Cloud Native, Microservices & Leadership Learnings | Loved Husband, Proud Dad | Founder of Vedcraft for Software Architects

Nov 28, 2022, 33 tweets

AWS re:Invent is happening this week and sharing my observations/notes in this thread 🧡
#awsreinvent #awsreinvent2022

Key sessions related to Microservices in reinvent (you can also watch online later)πŸ‘‡

Shared as part of Application Integration Patterns for #Microservices - using Message Exchange pattern for communication πŸ‘‡

Liked the applicability of composite pattern (topic/queue chaining)

Publicis sapient

#awsreinvent2022 #microservices

As part of the Resiliency Hub workshop, a relatively new service by AWS:
- Great recommendation based on AWS well-architected framework
- Assess RTO & RPO of your app based on the resilience policy
- Also provides recommendations to make it compliant

AWS Resilience workshop (you can refer):
catalog.workshops.aws/event/dashboar…

Liked the interface to assess the resiliency of an application in AWS:

S3 Batch Operations (for large jobs) for higher restore throughput to significantly reduce restore completion time πŸ‘‡
(e.g. restore 10M+ objects such as sensor data in a few hours for ML analysis)

Concept of a virtual cluster within an EKS cluster is an interesting deployment perspective πŸ‘‡

Watching Peter's session virtually - Performance is the new mantra as a differentiator:
1. Nitro (4 generations now) - that's why the focus on building its own chip with lower latency, higher throughput
2. Also supports sustainability benefits

New announcements by Peter during AWS reInvent:
1. New Nitro V5 released
2. EC2 C7 gn instance powered by Nitro
3. HPC7G instance for EC2 powered by Graviton 3E processor

Key points from Peter's session:
1. Focus on EFA for HPC, SRD (Scalable Reliable Datagram) built by AWS to overcome single path network limitation of TCP to multipath using SRD
2. All new EBS io2 volumes next year will use SRD) for high performance with lower tail latency

Key points from Peter's session:
3. ENA Express launched using SRD for low latency
4. ElasticCache with ENA Express reduces latency with higher throughput (taking advantage of multi-path networking

Key annoucements from Adam's session:
πŸ”˜ OpenSearch Analytics Service
πŸ”˜ Amazon Redshift integration for Apache Spark
πŸ”˜ Amazon Aurora zero-ETL integration with Amazon Redshift - launched for near real-time analytics and ML on transactional data

Key annoucements from Adam's session:
πŸ”˜Amazon DataZone for Data Governance
πŸ”˜ Operational paginated report in Amazon QuickSight
πŸ”˜ ML-powered forecasting with Q

Key announcements from Adam's session:
πŸ”˜ Amazon GuardDuty for EKS protection (launched earlier)
πŸ”˜ Container Runtime Threat Detection launched

Amazon co-founded Opensource Cybersecurity framework and launched Security Lake supporting OCF today πŸ‘

That's a key differentiator from other cloud providers - 600+ instance types for compute in AWS πŸ‘
#awsreinvent2022

New instance launch using Graviton πŸ‘‡

For HPC workload, new launches πŸ‘‡

Expo is always inspirational πŸ‘

Netflix Chaos Engineering πŸ‘‡
β–ͺ️ FIT (failure injection technology) - next evolution of chaos engineering
β–ͺ️ Services get resilience tested using the emulation applying scenarios, scor and treatment - triggers fallback and then measure the impact

Netflix Chaos Engineering πŸ‘‡
β–ͺ️CRR - By adding headers to the request determine injection points
β–ͺ️Provides ability to trigger failure for certain devices or a specific request
β–ͺ️FIT UI to plan/execute chaos test cases via the interface

Netflix Chaos Engineering πŸ‘‡
β–ͺ️Apply Canary strategy to Chaos Engineering
β–ͺ️Canary + FIT to limit the experiment
β–ͺ️ Monitoring analysis using the event stream infra in real-time (e.g. comparing Canary and baseline monitoring to find trends)

End-to-end Chaos Engineering (evolution from Chaos Monkey to the new approach using FIT) πŸ‘‡

Build your own Chaos Engineering discipline using πŸ‘‡

Amazon recently launched Amazon CloudWatch Internet Monitor providing insights, monitoring, suggestions based on user profile, geographic granularity, health notification using event bridge, etc.

End-to-end data products are an important aspect of building the scalable data strategy πŸ‘‡

Amazon is leveraging Opensource solution like Apache Spark to extend their capabilities πŸ‘‡

A new capability for document database - fully managed dbms is prime offering and value-add by AWS πŸ‘‡

Sagemaker extending its capabilities with support for Geospatial MLπŸ‘‡

Great to attend the workshop on using AWS HPC Compute with AWS ParallelCluster (uses opensource technologies such as Slurm, Spack, Modules)

#awsreinvent2022

AWS Nitro Enclaves (AWS Proprietary for Confidential Computing) - launched in 2020, going to get more traction using trusted compute environments in the future, particularly for financial services.
Great to do a workshop for blockchain processing using AWS Nitro Enclaves:

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling