Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Robert Nishihara Profile picture
Robert Nishihara
@robertnishihara
Co-founder and CEO @anyscalecompute. Co-creator of @raydistributed. Previously PhD ML at Berkeley.
Jan 25, 2023 • 10 tweets • 5 min read
I remember in 2016 when @ApacheSpark set the record for sorting 100TB in the most cost-efficient way ($144 in 2016, $115 in today's prices).

Today, @raydistributed broke the $1 / TB barrier and set the world record at $97! 🔥📈🥳🎂🎗️🥂

anyscale.com/blog/ray-break… I was at Berkeley at the time: @ucbrise and @berkeley_ai.

Though Spark had been used by many companies in production for ages, for many people, this marked Spark's transition from being a research project to a production-grade system.

And the rest is history. 😏
Dec 31, 2022 • 9 tweets • 4 min read
Exciting to see Quokka at the top of Hacker News (written by Ziheng Wang).

In ~1000 lines of Python, Quokka is a high performance fault-tolerant query engine built on

1⃣ Ray (@raydistributed) - distributed execution
2⃣ Polars - fast dataframes
3⃣ Arrow (@ApacheArrow) - fast I/O Image We tried to design #Ray to be as flexible as possible, and this makes it possible to build not only scalable applications with Ray, but also to build entire scalable systems and products on top.