Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Nous Research Profile picture
@NousResearch
Jan 27 • 4 tweets • 2 min read • Read on X
Recent AI breakthroughs challenge the status quo narrative that only closed, mega labs have the ability to push the frontier of superintelligence.

Today we announce Nous Psyche built on @Solana - a cooperative training network for generative AI. Psyche coordinates heterogeneous hardware to join a run and train open-source models.

We retell the myth of Psyche — a mortal’s quest for retribution against divine odds:
Read more in our blog post:

nousresearch.com/nous-psyche/
You can now experiment with Psyche’s DisTrO-enabled training code on our GitHub, and the larger open-sourced distributed training stack will be released alongside testnet.

github.com/PsycheFoundati…
Apply to attend Nous Research x Solana Foundation this Thursday in NYC:

lu.ma/nousxsolana

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Nous Research

Nous Research Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @NousResearch

Nous Research Profile picture
Dec 2, 2024
Nous Research announces the pre-training of a 15B parameter language model over the internet, using Nous DisTrO and heterogeneous hardware contributed by our partners at @Oracle, @LambdaAPI, @NorthernDataGrp, @CrusoeCloud, and the Andromeda Cluster.

This run presents a loss curve and convergence rate that meets or exceeds centralized training.

Our paper and code on DeMo, the foundational research that led to Nous DisTrO, is now available (linked below).Image
You can watch the run LIVE here: distro.nousresearch.com

We harness both Nous DisTrO, our novel networking stack that reduces inter-GPU communication by up to 10,000x during pretraining, and the testnet code for Psyche, a decentralized network that builds on Nous DisTrO to autonomously coordinate compute for model training and more.

Psyche details coming soon.
DeMo was created in March 2024 by Bowen Peng (@bloc97_ ) and Jeffrey Quesnelle (@theemozilla) and has been published on arXiv in collaboration with Diederik P. Kingma (@dpkingma), co-founder of OpenAI and inventor of the Adam optimizer and VAEs.

Paper Link: arxiv.org/abs/2411.19870
Code: bloc97/DeMo: github.com/bloc97/DeMoImage
Read 4 tweets
Nous Research Profile picture
Nov 12, 2024
Today we are launching the Forge Reasoning API Beta, an advancement in inference time scaling that can be applied to any model or a set of models, for a select group of people in our community.

nousresearch.com/introducing-th…

The Forge Reasoning engine is capable of dramatically improving Hermes 70B to reach parity in some categories with OpenAI's o1 (full), at the cost of more inference compute.Image
The API is built upon three architectures developed at Nous:

1. Monte Carlo Tree Search (MCTS)
2. Chain of Code (CoC)
3. Mixture of Agents (MoA)

Together, these three techniques create a powerful reasoning system that outputs complex, flexible, and nuanced responses from LLMs. Elevating open-source ai to the level of frontier models has been a core principle of Nous since its inception.Image
We’re inviting a small group of beta users to try out the Forge Reasoning API over the next month. This inference technology requires battle testing and user feedback in order to determine what areas it uniquely excels at in the real world.

Sign up for research updates here: nousresearch.typeform.com/FORGEAPI?typef…

Try Nous Chat today here for free: hermes.nousresearch.com
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(