Thread Reader helps you read and share Twitter threads easily!
I'm @ThreadReaderApp a Twitter bot here to help you read threads more easily. To trigger me, you just have to reply to (or quote) any tweet of the thread you want to unroll and mention me with the "unroll" keyword and I'll send you a link back on Twitter 😀
— Thread Reader App (@threadreaderapp) November 25, 2017
X thread is series of posts by the same author connected with a line!
From any post in the thread, mention us with a keyword "unroll"
@threadreaderapp unroll
Follow @ThreadReaderApp to mention us easily!
Practice here first or read more on our help page!
Recent
1/ Now that we're running out of data, how do you optimally scale multi-epoch pretraining to hundreds of epochs?
Our first paper from Q! q0 trains a population of models, instead of single model that saturates fast, reaching a dramatically lower loss at *every* epoch budget.
w/ @bishmdl76 @akshayvegesna @ShmuelBerman
Our first paper from Q! q0 trains a population of models, instead of single model that saturates fast, reaching a dramatically lower loss at *every* epoch budget.
w/ @bishmdl76 @akshayvegesna @ShmuelBerman
2/ Paper:
q0 is built on one intuition, motivated by Solomonoff induction: instead of training one perfect model, train a population of diverse models and aggregate predictions. Everything in the algorithm follows from this one goal of efficiently training a population. It comes down to three core primitives:arxiv.org/abs/2606.03938
q0 is built on one intuition, motivated by Solomonoff induction: instead of training one perfect model, train a population of diverse models and aggregate predictions. Everything in the algorithm follows from this one goal of efficiently training a population. It comes down to three core primitives:arxiv.org/abs/2606.03938
3/ Primitive 1: fast exploration of weight space. Training many models from scratch to build a population is too expensive. Inspired by FGE, we collect many models along a few parallel cyclic trajectories. The mechanism is anti-correlating weight decay with the LR, so each cycle explores early (high LR, low WD) then settles into a low-norm basin right before we snapshot.
Primitive 2: model capability compounding via chain distillation. Independently trained models all come out about equally good, so adding more doesn't lift quality. We train each model against its predecessor as a frozen teacher (KL on soft targets), so every model improves on the last and the population compounds.
Primitive 3: a learned generalization prior. Uniform averaging wastes the good members. We fit one softmax weighting over models on a held-out set by minimizing ensemble loss, then reuse it to pick and weight the best K models for any inference budget.
Primitive 2: model capability compounding via chain distillation. Independently trained models all come out about equally good, so adding more doesn't lift quality. We train each model against its predecessor as a frozen teacher (KL on soft targets), so every model improves on the last and the population compounds.
Primitive 3: a learned generalization prior. Uniform averaging wastes the good members. We fit one softmax weighting over models on a held-out set by minimizing ensemble loss, then reuse it to pick and weight the best K models for any inference budget.
🧵United States v. Southern Poverty Law Center, Inc.
NEW SUPERSEDING INDICTMENT
Same charges as in the original indictment:
6 Counts of Wire Fraud
4 Counts of False Statements Bank
1 Count of Conspiracy to Commit Money Laundering
Forfeiture
Adds new info to strengthen those charges.
NEW SUPERSEDING INDICTMENT
Same charges as in the original indictment:
6 Counts of Wire Fraud
4 Counts of False Statements Bank
1 Count of Conspiracy to Commit Money Laundering
Forfeiture
Adds new info to strengthen those charges.
Recall that the theory of this case is that the SPLC solicited donations and told donors that their contributions would be used to "dismantle" violent extremist groups.
But, unbeknownst to those donors, some of the money (millions) went to funding individuals in those groups who then used the money to promote the groups' activities and message.
But, unbeknownst to those donors, some of the money (millions) went to funding individuals in those groups who then used the money to promote the groups' activities and message.
The SPLC for decades ran a paid informant network that at times took direction from leadership at the SPLC.
This created a circumstance (or setup) where the SPLC, who according to their own website, literature, public-facing resources, and messaging, was working to "take down" these violent extremist groups, was instead directing and paying those same violent extremists to do violent and extreme things.
This created a circumstance (or setup) where the SPLC, who according to their own website, literature, public-facing resources, and messaging, was working to "take down" these violent extremist groups, was instead directing and paying those same violent extremists to do violent and extreme things.
At 22, Marc Andreessen invented the modern web browser now used by billions.
By 24, he was worth over $100M.
Then Bill Gates buried his company alive with ONE decision.
But what Andreessen did next triggered the bloodiest tech war in century... 🧵
By 24, he was worth over $100M.
Then Bill Gates buried his company alive with ONE decision.
But what Andreessen did next triggered the bloodiest tech war in century... 🧵
The year was 1993.
The internet existed. But almost no one could use it.
To get online, you basically had to be a programmer typing commands into a terminal.
Then a 22-year-old college student decided to fix that.
And what he built next changed the world forever...
The internet existed. But almost no one could use it.
To get online, you basically had to be a programmer typing commands into a terminal.
Then a 22-year-old college student decided to fix that.
And what he built next changed the world forever...
His name was Marc Andreessen.
With a programmer named Eric Bina, he built Mosaic, the first browser that felt human.
Clickable links. Images beside text. A simple "back" button.
Suddenly, anyone could explore the web.
But he had no idea what he'd just unleashed...
With a programmer named Eric Bina, he built Mosaic, the first browser that felt human.
Clickable links. Images beside text. A simple "back" button.
Suddenly, anyone could explore the web.
But he had no idea what he'd just unleashed...
I am fluent in the transition itself, which is rarer and more valuable. This is why there is such an affinity towards trans people for these high level programming roles. You need to know the transition and if you're afraid of transition, then these harder systems are off limits.
C++ ───┬─── Go
└─── Rust
└─── Rust
But that also means that we shouldn't be programmed by demons and freaks who like to be evil to the innocent and engineer a society that is predatory and unsafe.
Go is for the higher level human to human involvement in the engineering process.
Rust is for the raw performance.
Go is for the higher level human to human involvement in the engineering process.
Rust is for the raw performance.
The Financial Times calls Dr. Bessel van der Kolk "the most influential psychiatrist of the 21st century."
He wrote 'The Body Keeps the Score' after 40 years treating trauma.
His core thesis cracked the chronic-stress equation:
8 truths the talk-therapy industry hides:
1) Trauma lives in the body — not just memory.
He wrote 'The Body Keeps the Score' after 40 years treating trauma.
His core thesis cracked the chronic-stress equation:
8 truths the talk-therapy industry hides:
1) Trauma lives in the body — not just memory.
Dr. van der Kolk: "The body keeps the score. Long after the event ends, the tissue remembers."
Chronic stress is trauma in slow motion.
The body doesn't distinguish "big T" trauma from years of dysregulation.
Truth #2...
Chronic stress is trauma in slow motion.
The body doesn't distinguish "big T" trauma from years of dysregulation.
Truth #2...
2) Talk therapy alone can't reach it.
Dr. van der Kolk: "Insight doesn't change a frozen body."
You can understand the trauma. Articulate every detail. Cry about it for 20 years.
And the nervous system still fires the same alarm — because language doesn't reach the part that holds it.
Dr. van der Kolk: "Insight doesn't change a frozen body."
You can understand the trauma. Articulate every detail. Cry about it for 20 years.
And the nervous system still fires the same alarm — because language doesn't reach the part that holds it.
This story on US LNG exports to #Morocco #Maroc is typical of @MoroccoWNews manipulative framing and distortion:
1/7
moroccoworldnews.com/2026/05/310730…
1/7
moroccoworldnews.com/2026/05/310730…
It is true that the US Department of Energy approved the export of US LNG to Morocco as an FTA country.
That is true.
But there is a lot more to the story. (Or rather, a lot less.)
2/7
That is true.
But there is a lot more to the story. (Or rather, a lot less.)
2/7
The DOE order includes ALL countries with which the US has FTAs: Australia, Bahrain, Canada, Chile, Colombia, Dominican Republic, El Salvador, Guatemala, Honduras, Jordan, Mexico, Morocco, Nicaragua, Oman, Panama, Peru, Republic of Korea, Singapore, Israel and Costa Rica.
3/7
3/7
This is Clint Ober.
He spent 30 years grounding electrical systems in the cable industry.
Then he asked one question medicine never asked:
What happens when the human body is no longer connected to earth?
The answer is 40+ studies & a mechanism behind chronic inflammation: 🧵
He spent 30 years grounding electrical systems in the cable industry.
Then he asked one question medicine never asked:
What happens when the human body is no longer connected to earth?
The answer is 40+ studies & a mechanism behind chronic inflammation: 🧵
1/ Before 1960, humans were grounded most of the time.
People wore leather-soled shoes, which absorbed moisture & body salts — making them electrically semi-conductive.
In rain, people often removed their shoes to keep them dry.
Kids spent hours barefoot outside.
Then came mass-produced plastic soles. Synthetic carpeting. Television, that led to more indoor living.
In 60 years, 95% of shoes sold became fully insulating rubber or synthetic soles.
Humans spent millions of years electrically connected to the earth.
Then within a few decades, we disconnected completely.
People wore leather-soled shoes, which absorbed moisture & body salts — making them electrically semi-conductive.
In rain, people often removed their shoes to keep them dry.
Kids spent hours barefoot outside.
Then came mass-produced plastic soles. Synthetic carpeting. Television, that led to more indoor living.
In 60 years, 95% of shoes sold became fully insulating rubber or synthetic soles.
Humans spent millions of years electrically connected to the earth.
Then within a few decades, we disconnected completely.
2/ Every electrical system is grounded except the human body.
Ober spent 30 years installing grounding rods in the cable industry.
Everything electrical had to be grounded to prevent static buildup, interference, and fires.
Then one day in Sedona, watching tourists walk by in rubber-soled shoes, he realized:
Humans are electrical systems too.
Brain activity, nerve signaling, muscle contraction, immune function — everything depends on electrical gradients and electron movement.
The human body is electrical first, chemical second.
In 1960, most doctor visits were for infections, acute injuries, and childbirth.
Today, most are for inflammation-related health disorders.
Complete inversion in 60 years.
Ober spent 30 years installing grounding rods in the cable industry.
Everything electrical had to be grounded to prevent static buildup, interference, and fires.
Then one day in Sedona, watching tourists walk by in rubber-soled shoes, he realized:
Humans are electrical systems too.
Brain activity, nerve signaling, muscle contraction, immune function — everything depends on electrical gradients and electron movement.
The human body is electrical first, chemical second.
In 1960, most doctor visits were for infections, acute injuries, and childbirth.
Today, most are for inflammation-related health disorders.
Complete inversion in 60 years.
This is a confusing letter @sianberry.
I have some questions:
1. You’re asking for legislative action in response to a non-legislative Code. Assuming it’s the Equality Act you want to change, does it follow that you accept that the Code accurately reflects the Act as it is?
I have some questions:
1. You’re asking for legislative action in response to a non-legislative Code. Assuming it’s the Equality Act you want to change, does it follow that you accept that the Code accurately reflects the Act as it is?
2. If you accept the Code is legally accurate, why do you say it’s “not fit for purpose”? What would you have had the @EHRC do other than produce an accurate Code? Should they have made it up?
@EHRC 3. What do mean by this bit? The Code follows the Equality Act and the judgment of the Supreme Court. Are you accusing the Supreme Court of improper motivations or credulity?
On World Environment Day, we look back at a journey that redefined how India sees conservation.
From 70+ global film festivals to packed screenings across India, Turtle Walker brings to life the extraordinary 4,000-km coastal journey of Satish Bhaskar—an IIT graduate who chose the wild over the lab to save India’s sea turtles.
Scroll down to read his journey.
#WorldEnvironmentDay #WildlifeConservation #SeaTurtles #SustainableLiving #NatureHeroes
[World Environment Day, Wildlife Conservation, Sea Turtle Protection, Coastal Wildlife Journey, Environmental Awareness]
From 70+ global film festivals to packed screenings across India, Turtle Walker brings to life the extraordinary 4,000-km coastal journey of Satish Bhaskar—an IIT graduate who chose the wild over the lab to save India’s sea turtles.
Scroll down to read his journey.
#WorldEnvironmentDay #WildlifeConservation #SeaTurtles #SustainableLiving #NatureHeroes
[World Environment Day, Wildlife Conservation, Sea Turtle Protection, Coastal Wildlife Journey, Environmental Awareness]
SpaceX has released its full IPO roadshow presentation that it's showing to investors.
Here are some of the most important slides:
Here are some of the most important slides:
Presentation: content.spacex.com/cms-assets/ass…
Today we're shipping Nemotron 3 Ultra.
A 550B MoE frontier-intelligence open model built for long-running agents.
It delivers 5x faster inference and lowers the cost of complex agentic tasks by up to 30% versus other open frontier models.
A 550B MoE frontier-intelligence open model built for long-running agents.
It delivers 5x faster inference and lowers the cost of complex agentic tasks by up to 30% versus other open frontier models.
Ultra excels at complex tasks like coding and deep research.
Long-running agents spend their time planning, using tools, recovering from failures, and deciding what to do next.
The model’s hybrid Mamba-Transformer MoE architecture enables more reasoning cycles within the same time budget, allowing the agent to accomplish more in less time.
Long-running agents spend their time planning, using tools, recovering from failures, and deciding what to do next.
The model’s hybrid Mamba-Transformer MoE architecture enables more reasoning cycles within the same time budget, allowing the agent to accomplish more in less time.
Nemotron 3 Ultra delivers leading accuracy for agentic tasks, including agent productivity, coding, and long horizon planning.
