Robin Moffatt 🍻🏃🥓 Profile picture
Oct 5, 2022 17 tweets 8 min read Read on X
“A lot of the time you don’t need real time” *gasp* #current22
“A lot of the Modern Data Stack is marketing bullshit” #current22

OMG I love this talk Image
ELT vs ETL
#current22 Image
dbt sits on top of your data platform of choice Image
dbt workflow #Current22 Image
The view of batch vs streaming from @notamyfromdbt #current22
Strong resonance with @esammer’s talk yesterday Image
the convergence of batch and streaming worlds #current22 Image
Being able to write the same SQL without needing to code for time windows etc is more accessible and makes it feel much more like a regular database #current22 Image
working with streaming data in dbt and snowflake. Streaming and batch nodes in the same lineage chart #current22 Image
Who owns all of this? The analytics engineer. Image
🎯 Shouldn’t be talking about batch vs streaming, but what your company needs #Current22
Where could it go wrong? #current22

(Love that @notamyfromdbt looks forward on this and not just a best case scenario) Image
🔥 #current22 Image
Spicy take, but important one. *why* does it need to be real-time? What are they doing with that data? What is the business impact if we *don’t* have real-time #Current22
Sometimes though you *do* need real-time. @notamyfromdbt’s example was an airline that had a screen showing when to close the gate for a flight. A five minute SLA was ok and only what was possible with the tooling at the time - but real-time *would* have been better #Current22
Sometimes it’s not either/or - it’s both #Current22 Image
The world is shifting. It should be about the use cases, not batch vs streaming. Analytics engineer is well placed to own this intersection. #current22

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Robin Moffatt 🍻🏃🥓

Robin Moffatt 🍻🏃🥓 Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @rmoff

Mar 29, 2023
Gosh, I'd forgotten the pleasures and pains of abstract review for a conference. Pet peeves this morning:

☠️ Vendors submitting piss-poor product pitch abstracts. It doesn't take a genius to see through your abstract and look you up on LinkedIn to put 2 and 2 together. (1/n)
If you're a vendor, be open about your talk and its content. Pitching per se is not evil, but trying to hide it is. If you have useful things to say then perhaps your talk will be useful for the confernce. But be up front and honest about it. (2/n)
☠️ DAs with piss-poor abstracts. This is *literally your job*. Either bring it, or GTFO.
There are so many resources out there to help with writing abstracts (and hey, DM me and *I'll* help too, srsly), but you cannot just phone it in. It looks bad on you, and your company (3/n)
Read 4 tweets
Oct 19, 2022
Big strategic decisions that a data team helps a company make #coalesceConf a couple of men sitting at ...graphical user interface, a...
Although… you can give all the data you want and sometimes it'll still get ignored graphical user interface, t...
"Shout out Indiana Jones…Fuck the Nazis" #coalesceConf Image
Read 16 tweets
Oct 19, 2022
.@bennstancil's talk at @coalesceConf is starting!
@bennstancil @coalesceconf It's hard to measure the success of a data team #coalesceConf
that can be fine when the economy is fine, but as things get tough you end up with tough questions #coalesceConf
Read 4 tweets
Oct 19, 2022
So does @MySQL Heatwave "Lakehouse" actually act as a lakehouse as defined elsewhere and write *back* to object storage through a table format? Or it's just MySQL that can also query data that's on object storage? The latter is cool of course, but the naming is puzzling me.
The press release is unclear, other than in the fact that OMG OUR BENCHMARK SHOWED WE ARE FASTER, WHO'DA THUNK IT?!! oracle.com/news/announcem…
The technical brief (oracle.com/a/ocom/docs/my…) makes note of "the HeatWave internal format" for working with external data. There's lots of mention of CSV and Parquet and magic fairies^H^H^H^H^H^H^Hmachine learning to guess at schemas.
Read 5 tweets
Oct 19, 2022
Audience feedback at conference talks is *really* useful for speakers and organisers. It lets speakers understand what they're doing well (and perhaps what they're not). It helps organisers gauge the direction of content (more of this, less of that).
Reading these this morning makes me very proud of all the speakers at #Current22 😁
There's also some fair criticism in there that's great feedback to work with speakers and the program committee on
Read 4 tweets
Oct 11, 2022
Looks like a fascinating set of talks at @coalesceconf #dbtcoalesce next week. I'll be firing up my 56k modem and dialling in for several of them including:
Keynote: The End of the Road for The Modern Data Stack You Know, from @jthandy and @margaretfrancis

coalesce.getdbt.com/agenda/keynote…
Intentional learning: How and why you should learn Data Jawn, from @notamyfromdbt

I loved chatting to Amy at #Current22 and I also need to find out what a Jawn is :D

coalesce.getdbt.com/agenda/intenti…
Read 9 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(