Gunnar Morling 🌍 Profile picture
Technologist @Confluentinc · Ex-lead of Debezium · Spec lead of Bean Validation 2.0 · Creator of JfrUnit, kcctl and MapStruct · Java Champion · 🚴

Sep 1, 2022, 9 tweets

Data tweeps: I'm trying to get an overview about players in the space of incrementally updated materialized database views. That field is absolutely exploding right now, and it's really hard to keep track. Here are the ones I'm aware of 👇:

1⃣ @MaterializeInc (materialize.com): Definitely the most prominent one, Postgres-compatible, based on the Timely/Differential Dataflow algorithms. Business Source License.

2⃣ #PranaDB (github.com/cashapp/pranadb); created by @CashApp, "designed from the outset to be horizontally scalable", Apache v2 License.

3⃣ @risingwave (risingwave.dev); also Postgres-compatible. Apache v2 License.

4⃣ @readysetio (readyset.io); specifically targeting caching use cases, but it's also incremental view materialization (based on Noria). Business Source License.

5⃣ @leap_db (leapdb.com). MySQL-compatible. Not quite clear on the license, seems to be SaaS exclusively?

6⃣ pgsql-ivm (github.com/sraoss/pgsql-i…); an extension for incremental view maintenance within Postgres itself. May become part of PG proper some day. Not clear on the license, I suppose PostgreSQL License?

7⃣ Besides all these above which are positioned as databases, there's multiple streaming SQL solutions, but I think it's a separate solution space, e.g. with @ApacheFlink SQL (e.g. via @Decodableco), @ksqlDB, and @DeltaStreamInc.

Those are the ones I'm aware of right now; would love to learn about other view mat you may know. Would be cool (but tons of work) to have a blog post with a thorough comparison, e.g. exploring the specific query capabilities and consistency guarantees. One day, perhaps :)

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling