Editing my conversation with @lajacobsson for @RealWorldSls and there's a nugget of insight that I wanted to share with you about implicit coupling that we often overlook when using SNS with SQS.
The topic is usually owned by the publisher and deployed in the publisher's stack, and the subscriber would reference its ARN via a CloudFormation stack output or something, creating an implicit coupling there.
2/
You need message attributes to do filtering, but the publisher has no idea what the subscriber cares about (nor should it, loose coupling and all). So teams that own the subscriber have to ask the publisher's team to add the message attributes they need.
3/
This creates inter-team dependency and coupling. The subscribers no longer have the autonomy to do their thing, project momentum is lost as teams have to rely on other teams to review, merge and deploy their changes.
I've seen too many projects die due to this type of dep.
4/
AND, you're limited to 10 attributes per message, so for populate messages (like "order_created" in an e-commence app), it's also possible to actually run out of space!
5/
It's something that I hadn't thought about, even though I've had plenty of other reasons to prefer EventBridge over SNS these days: lumigo.io/blog/5-reasons…
6/
There's so much other good stuff in this conversation, can't wait to share with you all in a few weeks. Until then, check out the other conversations we have published already🤘
One of the most misunderstood aspects of Lambda is how throttling applies to async invocations.
Or rather, how it doesn't!
🧵
With Lambda's Invoke API, you can choose invocationType as "RequestResponse" (ie, sync) or "Event" (i.e. async).
With sync invocations, throttling limits are checked to make sure you stay within:
* regional concurrency limit
* the function's reserved concurrencydocs.aws.amazon.com/lambda/latest/…
However, this is not true for async invocations.
The Event Invoke Frontend service accepts the request and passes it onto an internal queue.
Concurrency limits are not checked at this point and are instead applied later when the internal poller attempts to invoke the function synchronously.
If you want to learn more about how Lambda works under the hood, make sure you watch @julian_wood's fantastic session from re:Invent 2022.
I have written over 800 technical articles in the last 14 years and they have been read millions of times.
I see a lot of folks making the same mistakes I did early on in my journey.
So here are some principles to help you get better at writing.
🧵
1. 𝗦𝗲𝗹𝗹 𝘁𝗵𝗲 𝗽𝗿𝗼𝗯𝗹𝗲𝗺, 𝗻𝗼𝘁 𝘁𝗵𝗲 𝘀𝗼𝗹𝘂𝘁𝗶𝗼𝗻
Like that scene in The Wolf of Wall Street where Di Caprio asked Jon Bernthal to sell him a pen.
First, create the demand, then supply the solution.
Sell the problem to the reader. Help them understand why it’s a problem worth solving.
If the readers are not interested in the problem you're solving, they won't care about whatever solution you propose, no matter how good the solution is.
Payload-based filtering was one of the key reasons to choose EventBridge over SNS. This makes SNS a much more viable option in Event-Driven Architecture.
This is a very interesting thread and the surrounding discussions. I've had similar discussions in the past, but I don't want to make too many assumptions here because I wasn't part of the conversation with the client.
First of all, serverless has been successfully adopted at a much bigger scale in other companies. LEGO for example have 26 squads working mostly with serverless, and PostNL has been all in on serverless since 2018.
So technology is probably not the problem.
From the clues I'm able to pick up, the team has given it a go but they faced tooling gaps when you have both serverful (RDS) and serverless components, and maybe needed help to navigate those hard edges and adapt their practices to work better with serverless
The "serviceful" mindset means you'll need to learn and use many services in your architecture. Having the right tool to help you along can make a world of difference. And here are 7 of my favourites.
Serverless IDE is a VSCode extension that will save you countless hours when you work with CloudFormation, AWS SAM or the Serverless Framework.
Auto-completion, schema validation, CF docs on hover, and many more.