SemiAnalysis Profile picture
Jul 3 5 tweets 3 min read Read on X
Everyone's always talking about agentic coding harnesses: Claude Code, Codex, OpenCode, Pi... the list goes on. But what's the difference between all of them? What even Is a harness anyway?

In this thread, we'll take a look under the hood. (1/5)🧵 Image
It is first helpful to understand how the underlying models work. Opus, GPT 5.5, etc (the models) are all stateless -- they remember nothing between requests. That is, each time you press "enter" at the prompt factory, the harness rebuilds the entire conversation and ships it (this is why prompt caching is so important!). There is no memory sitting on the server. Whatever the model "knows" about your session exists only because the harness packed it into that one request. (2/5)Image
So a "harness" is really a context orchestration tool. Every request body it builds typically has the same three parts:

🟠 System Prompt: the "you are Claude Code" setup, plus injected stuff like your file tree or recent commits
🟠 Tool Definitions: a list of JSON schemas describing available tools the model has to "act", I.e., Bash, FileRead, etc.
🟠 Messages: the chronological list of user/assistant messages, as well as thinking blocks.

Since the model is stateless, the harness reassembles and resends all of these parts every turn. What differs between Claude Code, Codex, and OpenCode is not only the TUI/UX features, but how this context is managed. For instance, people like Pi because you have more control over how the harness is managed and therefore how the context is. (3/5)
When you send a message, the harness will route your request to the appropriate LLM server, then apply some chat templates to convert the HTTP request to something the model can better understand. The harness will also add more advanced parameters to control cache, max output tokens, and other things depending on the type of request.

Given the context described above, the model will decide what tools, if any, to use. If the model chooses a tool, it will literally generate the appropriate tool use JSON and return it in the response body! This tool use is then parsed in the harness on the host machine and executed, and its output is automatically sent back to the LLM for processing. (4/5)Image
So while all harnesses make slightly different decisions while performing this "plan, act, verify" pattern, this loop is the common skeleton driving all agentic tasks. So let's stop talking about harnesses like they're magic! While good harness engineering helps, the real power is still in the models themselves. Everything else is just REST all the way down. (5/5)Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with SemiAnalysis

SemiAnalysis Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @SemiAnalysis_

Jul 18
Similar to DeepSeek in January 2025, Panicans may think that the AI networking switch TAM will massively shrink because Kimi K3 uses KDA Attention, which reduces KV-transfer networking bandwidth by up to 10x. But the opposite is true, as we explain below. 👇️ 1/8🧵 Image
While it is true that Kimi K3 uses Kimi Delta Linear Attention (KDA) in 3 out of every 4 layers and that KDA reduces KV-cache transfer bandwidth by up to 10x compared with comparable full global-attention models, the important missing piece is that Kimi K3 requires WideEP to serve. 2/8🧵Image
Because Kimi K3 has 2.8 trillion parameters, even at MXFP4, each forward pass will require 1.5 TB of HBM bandwidth. This means that, even with spec decode, serving it profitably at a reasonable level of interactivity requires aggregating many chips together over a high-bandwidth network, such as the GB300 NVL72. 3/8🧵
Read 8 tweets
Jul 18
MASSIVE DELAY ALERT TO ORACLE’S STARGATE SITE AND BLOOM ENERGY🚨🚨

Oracle’s Project Jupiter behind-the-meter datacenter project in New Mexico that plans to use Bloom Energy is at risk of a 1-2 year delay due to permitting and pipeline building blockers. (1/8)🧵 Image
As we continue to monitor the status of datacenter delays, whether they are real, whether they are fake... some are out and out delayed because of -> building gas pipelines and receiving permits for power generation equipment. (2/8)
Oracle's proposed 2.45 GW Project Jupiter site in New Mexico can't run at any meaningful capacity until a 17 mile pipeline (the Green Chile Pipeline) connecting the El Paso Natural Gas (EPNG) system to a delivery meter station is constructed. Oracle switched from turbines to Bloom Energy fuel cells earlier this year — but fuel cells run on pipeline gas too. All details below👇️ (3/8)Image
Read 8 tweets
Jul 17
Similar to the panic over DeepSeek R1, some uneducated people think Kimi K3’s use of linear attention (KDA) is bad for NVIDIA, HBM, DRAM, and networking because it has relatively lower KV-cache requirements. The opposite is true, and we explain why below. 👇️ 1/8🧵 Image
Kimi K3 is actually quite positive for NVIDIA, as large-model inference is where the NVL72 shines. Because K3 has more than 2.8 trillion parameters, it requires a large scale-up domain to store its weights. 2/8🧵 Image
Secondly, although Kimi Delta Attention has up to 10× lower networking requirements for KV-cache transfers, its large weights require even more network bandwidth to implement an optimization called WideEP, which spreads the weights across different GPUs. 3/8🧵 Image
Read 8 tweets
Jul 13
On Feb 28th 2026, the United States launched Operation “Epic Fury” against Iran.

Markets and media were caught off guard, but careful and diligent observers were hardly surprised.

The signals sat in plain sight for weeks, you just had to know where to look. A thread on OSINT — and why we run some of our research the same way. (1/10)🧵Image
Before the first strike ever came down on Tehran, OSINT accounts right here on this platform were tracking the military buildup in the Middle East in near real time.

Here for example one could see how leading up to the 28th, 333 (at a minimum) C-5 and C-17 transport aircraft flights were recorded leaving US bases towards the Middle East theater. (2/10)

x.com/ArmchairAdml/s…
Additionally, here one could see how U.S. F-22 Raptor stealth fighters were amassing at the Israeli Uvda Air Base, with Patriot missile components being set up on site, and new tarmacs being constructed. (3/10)

Read 10 tweets
Jul 7
TSMC’s moat is bigger than PPA, EUV, or yield. It is the EDA/IP ecosystem wrapped around the fab. (1/8)🧵 Image
TSMC’s Open Innovation Platform has turned Synopsys, Cadence, Arm, Rambus, Alphawave, and dozens of IP vendors into a pre-validated tape-out network. And that moat is measurable. (2/8)
TSMC’s certified Silicon IP library grew from 3K items in 2010 to 93K in 2025. 31x growth. (3/8)
Read 8 tweets
Jul 6
With the recent surge in AI mega clusters, reaching hundreds of thousands to millions of AI accelerators, cloud providers encountered a new set of challenges that forced them to run chip interconnect at a new scale: interconnecting multiple datacenters together. This is called scale-across. (1/7)🧵Image
Scale-across has been widely popularized by Nvidia last year, but is now often used imprecisely as a generic term to talk almost about any Datacenter interconnect network. To make it short, scale-across refers to backend datacenter interconnect networks that are used to connect multiple datacenters all together to form a single, coherent cluster. (2/7)Image
The main confusion comes from the fact that scale across can use the same network equipment as for traditional datacenter interconnect. Indeed, as interconnections often reach a few kilometers minimum, operators can use ZR/ZR+ coherent pluggables and Optical Line Systems, which can use amplifiers and passive (AWG) or active (WSS) multiplexers. (3/7)Image
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(