Ankur Kumar πŸ’« Profile picture
Nov 28, 2022 β€’ 33 tweets β€’ 11 min read β€’ Read on X
AWS re:Invent is happening this week and sharing my observations/notes in this thread 🧡
#awsreinvent #awsreinvent2022
Key sessions related to Microservices in reinvent (you can also watch online later)πŸ‘‡ Image
Shared as part of Application Integration Patterns for #Microservices - using Message Exchange pattern for communication πŸ‘‡ Image
Liked the applicability of composite pattern (topic/queue chaining)

Publicis sapient

#awsreinvent2022 #microservices Image
As part of the Resiliency Hub workshop, a relatively new service by AWS:
- Great recommendation based on AWS well-architected framework
- Assess RTO & RPO of your app based on the resilience policy
- Also provides recommendations to make it compliant ImageImage
AWS Resilience workshop (you can refer):
catalog.workshops.aws/event/dashboar…
Liked the interface to assess the resiliency of an application in AWS: Image
S3 Batch Operations (for large jobs) for higher restore throughput to significantly reduce restore completion time πŸ‘‡
(e.g. restore 10M+ objects such as sensor data in a few hours for ML analysis) Image
Concept of a virtual cluster within an EKS cluster is an interesting deployment perspective πŸ‘‡ Image
Watching Peter's session virtually - Performance is the new mantra as a differentiator:
1. Nitro (4 generations now) - that's why the focus on building its own chip with lower latency, higher throughput
2. Also supports sustainability benefits
New announcements by Peter during AWS reInvent:
1. New Nitro V5 released
2. EC2 C7 gn instance powered by Nitro
3. HPC7G instance for EC2 powered by Graviton 3E processor
Key points from Peter's session:
1. Focus on EFA for HPC, SRD (Scalable Reliable Datagram) built by AWS to overcome single path network limitation of TCP to multipath using SRD
2. All new EBS io2 volumes next year will use SRD) for high performance with lower tail latency Image
Key points from Peter's session:
3. ENA Express launched using SRD for low latency
4. ElasticCache with ENA Express reduces latency with higher throughput (taking advantage of multi-path networking Image
Key annoucements from Adam's session:
πŸ”˜ OpenSearch Analytics Service
πŸ”˜ Amazon Redshift integration for Apache Spark
πŸ”˜ Amazon Aurora zero-ETL integration with Amazon Redshift - launched for near real-time analytics and ML on transactional data
Key annoucements from Adam's session:
πŸ”˜Amazon DataZone for Data Governance
πŸ”˜ Operational paginated report in Amazon QuickSight
πŸ”˜ ML-powered forecasting with Q
Key announcements from Adam's session:
πŸ”˜ Amazon GuardDuty for EKS protection (launched earlier)
πŸ”˜ Container Runtime Threat Detection launched Image
Amazon co-founded Opensource Cybersecurity framework and launched Security Lake supporting OCF today πŸ‘ Image
That's a key differentiator from other cloud providers - 600+ instance types for compute in AWS πŸ‘
#awsreinvent2022 Image
New instance launch using Graviton πŸ‘‡ Image
For HPC workload, new launches πŸ‘‡ Image
Expo is always inspirational πŸ‘
Netflix Chaos Engineering πŸ‘‡
β–ͺ️ FIT (failure injection technology) - next evolution of chaos engineering
β–ͺ️ Services get resilience tested using the emulation applying scenarios, scor and treatment - triggers fallback and then measure the impact Image
Netflix Chaos Engineering πŸ‘‡
β–ͺ️CRR - By adding headers to the request determine injection points
β–ͺ️Provides ability to trigger failure for certain devices or a specific request
β–ͺ️FIT UI to plan/execute chaos test cases via the interface Image
Netflix Chaos Engineering πŸ‘‡
β–ͺ️Apply Canary strategy to Chaos Engineering
β–ͺ️Canary + FIT to limit the experiment
β–ͺ️ Monitoring analysis using the event stream infra in real-time (e.g. comparing Canary and baseline monitoring to find trends) ImageImage
End-to-end Chaos Engineering (evolution from Chaos Monkey to the new approach using FIT) πŸ‘‡ Image
Build your own Chaos Engineering discipline using πŸ‘‡ Image
Amazon recently launched Amazon CloudWatch Internet Monitor providing insights, monitoring, suggestions based on user profile, geographic granularity, health notification using event bridge, etc. Image
End-to-end data products are an important aspect of building the scalable data strategy πŸ‘‡ Image
Amazon is leveraging Opensource solution like Apache Spark to extend their capabilities πŸ‘‡ Image
A new capability for document database - fully managed dbms is prime offering and value-add by AWS πŸ‘‡ Image
Sagemaker extending its capabilities with support for Geospatial MLπŸ‘‡ Image
Great to attend the workshop on using AWS HPC Compute with AWS ParallelCluster (uses opensource technologies such as Slurm, Spack, Modules)

#awsreinvent2022 Image
AWS Nitro Enclaves (AWS Proprietary for Confidential Computing) - launched in 2020, going to get more traction using trusted compute environments in the future, particularly for financial services.
Great to do a workshop for blockchain processing using AWS Nitro Enclaves: Image

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with Ankur Kumar πŸ’«

Ankur Kumar πŸ’« Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @ankurkumarz

Sep 8
Read this thread to know about Lakehouse architecture pioneered by Databricks (keeping it an active thread to keep all the key architecture knowledge as simple read) 🧡
(image source: Databricks)

#Databricks #Lakehouse #DeltaLake Image
Databricks along with UC Berkley & Stanford published this whitepaper in 2021 to revolutionize the DWH with Lakehouse architecture -> "Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics"
people.eecs.berkeley.edu/~matei/papers/…
Image
Databricks as a pioneer for unifying the warehouse and data lake as a Lakehouse platform, eliminating the complexity with foundation as delta lake.

Image: Databricks Image
Read 22 tweets
Jun 27, 2023
Attending Snowflake Summit 2023 Keynote Session virtually - will be sharing notes as part of this thread as we progress 🧡
Feel free to share your learnings as a reply - will be glad to see snapshots from the people, who can attend in-person.

#snowflake #SnowflakeSummit2023
Frank Slootman (CEO) started with AI and Financial Services - with mention to DTCC, Fiserv, and Fidelity clearly indicating to bring more Financial Services clients addressing their Security, Governance, and other challenges - like the analogy with Data UniverseπŸ‘
Native Applications Framework - one of the key announcements by Frank - to build apps similar to Mobile Appstore

#SnowflakeSummit
Read 30 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(