Mackenzie Mathis, PhD Profile picture
May 3, 2023 β€’ 7 tweets β€’ 5 min read β€’ Read on X
πŸ¦“ Self-supervised multimodal ML is promising the next AI breakthrough - in our new work published in @Nature, we debut @cebraAI: for self-supervised hypothesis- and discovery-driven science.

πŸ“ doi.org/10.1038/s41586…
πŸ’»github.com/AdaptiveMotorC…
πŸ¦“ cebra.ai
πŸ§΅β¬‡οΈ
First, this is a story about people πŸ₯³ @stes_io & @jinnnnnleeΒ  are co-first authors and it was absolute pleasure to work with them & see the πŸ¦“ CEBRA magic come to life. A few happy/fun bits in the @Nature research briefing!

πŸ”—nature.com/articles/d4158…
The work: we focused in on 4 open-access datasets: synthetic, hippocampus, sensorimotor, and vision across species & recording methods to show the general performance and many features of #CEBRA

cc @AllenInstitute @sejdevries @PresNCM & more (πŸ™) Image
The strength of CEBRA is the flexibility & performance: no generative model = no restrictions on data, & it can be used unsupervised (Time) or w/labels (Behavior).

Here, we demo on hippocampus with CEBRA-Time and then do hypo. testing for a quantitative readout of model fit!
One big #CEBRA moment for us was seeing the impressive video decoding results:

🐭🧠+πŸŽ₯->πŸ¦“=

- high perf. >95% accuracy at frame prediction πŸ”₯
- highly similar latents across Neuropixels & 2-photon data βœ…
- differences in performance across the visual system of 🐭
To be continued...
we won't tweet all the science today,
so stay tuned for more highlights later πŸ–€πŸ¦“πŸΎ
βœ¨πŸ¦“πŸ–€ Our Research Briefing can now be found at rdcu.be/dbhwe

- the problem, our solution, and future directions … 🚨including how CEBRA is not limited to neural dataπŸš¨β€” if you use t-SNE or UMAP, consider using CEBRA for more consistent and higher accuracy results Image

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with Mackenzie Mathis, PhD

Mackenzie Mathis, PhD Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(