Read on Twitter
ππ₯ very exciting breakthrough π₯π
if you are doing rpc data extraction in python, cryo will make your code faster
it can do 10,000+ requests per second in rust and return results as a python dataframe. up to 16x faster than a highly-optimized native python client
details π
if you are doing rpc data extraction in python, cryo will make your code faster
it can do 10,000+ requests per second in rust and return results as a python dataframe. up to 16x faster than a highly-optimized native python client
details π
what is cryo? itβs a rust tool for bulk data extraction from EVM nodes
it can be used to build pipelines that are fast + robust + embracing open data standards
it can be used to build pipelines that are fast + robust + embracing open data standards
https://twitter.com/notnotstorm/status/1677020205502074880
cryo can extract lots of ethereum datatypes (logs, traces, state diffs, etc)
it also has many options for 1) filtering the data, 2) formatting the output, and 3) controlling the concurrency+ratelimit of data acquisition
it also has many options for 1) filtering the data, 2) formatting the output, and 3) controlling the concurrency+ratelimit of data acquisition
how do you use cryo from python?
pip install cryo_python
import cryo
df = cryo.collect(βtxsβ, β¦)
...itβs that simple
pip install cryo_python
import cryo
df = cryo.collect(βtxsβ, β¦)
...itβs that simple
the cryo python adapter has full feature parity with the rust lib
ππ€π¦
you can return the results as:
- a polars dataframe
- a pandas dataframe
- a dict of lists
- a list of dicts
- parquet / csv / json / avro files
see this notebook for examples datasets.paradigm.xyz/notebooks/cryoβ¦
ππ€π¦
you can return the results as:
- a polars dataframe
- a pandas dataframe
- a dict of lists
- a list of dicts
- parquet / csv / json / avro files
see this notebook for examples datasets.paradigm.xyz/notebooks/cryoβ¦
that notebook contains an example benchmark comparing cryo to a highly-optimized βnativeβ python client
the native client uses msgspec (h/t @bantg ) for C++ serde under the hood
even so, cryo is anywhere between 4x faster to 16x faster than the native python client
the native client uses msgspec (h/t @bantg ) for C++ serde under the hood
even so, cryo is anywhere between 4x faster to 16x faster than the native python client
if you do bulk data extraction in python, give cryo a try
leaning on cryo instead of native python will make your code faster and simpler
this is **alpha-level** software, please report any bugs to the issue tracker
leaning on cryo instead of native python will make your code faster and simpler
this is **alpha-level** software, please report any bugs to the issue tracker
exciting roadmap ahead so stay tuned. better performance + more features otw
github:
telegram: https://t.co/FbEKaNRMDqgithub.com/paradigmxyz/crβ¦
t.me/paradigm_flood
github:
telegram: https://t.co/FbEKaNRMDqgithub.com/paradigmxyz/crβ¦
t.me/paradigm_flood
β’ β’ β’
Missing some Tweet in this thread? You can try to
force a refresh
γ
