Dean W. Ball Profile picture
Jul 17 1 tweets 3 min read Read on X
Some observations on Kimi:

1. It's a very good model! I don't think its performance can be explained away by distillation or anything like that. In agentic coding sessions, it seems pretty much on par with the best public models of Q1 2026. In my fairly limited use, it also seemed very token hungry. It's not obvious to me that this model is actually that cheap to run.

2. I am personally surprised the Chinese state continues to allow the open sourcing of models this good, given potential risks. To be clear, I *myself* might be fine with models presenting this level of marginal risk being open weight, but I am surprised that China is fine with it. I suspect the reason they are is 75% explained by strategic blindness/lack of AGI-pilledness (the CCP is very Yann Lecun-y in its views of AI). The other 25% or so is their lack of compute for customer inference (making China's open-weight strategy an unintended byproduct of US export controls) and the normal Chinese strategy of aggressive exports. For the companies, as opposed to the government, the decision to open source is partially ideological and partially because they are behind, and they know that very few people would pay for sub-frontier models from China.

3. Open-weight models are inherently decelerationist, and I'm continually surprised to see the so-called "accelerationists" so excited about open-weight models. I suspect the reason they are is that they know open-weight models are effectively ungovernable, and they simply like the overall cloak of ungovernability open-weight models create over the whole of AI. It's not a bad strategy; it reminds me of James Scott's recounting of the hill people in "the art of not being governed." Still, in the end, open-weight models deter further AI capex.

4. One probable outcome of an open-weight-model-dominant world is full AI communism, which is precisely what China proposes: rather than a market product, AI is a "public good" which will ultimately be provided by the state as a kind of "digital public infrastructure." This future strikes me as a dystopian hellscape, but I've never met an open-weight models advocate who doesn't ultimately concede this is where things end. You'd be surprised how many 'accelerationists' lobbied me, while I was in government, to support an eleven or twelve-figure federally funded data center so that startups could train models at a subsidy and then give them away for free. There was no other way for AI to progress, they said. Perhaps this is the logical end state of things. Nonetheless, I find myself surprised to see supposed accelerationists excited about such an outcome. I think many of them just don't know what they're doing. Many accelerationists do not view the creation and serving of frontier models as a legitimate business.

5. I would guess that the Trump Administration will at some point realize that their best strategy here would be to create large amounts of regulatory risk around the use of open-weight Chinese models. You don't need to "ban open source" (one of the dumber motifs of AI policy discussion). You just need to direct every agency to issue soft law that creates FUD. "A Federal Reserve Advisory Bulletin found that there may be backdoors in Chinese AI models." It needn't be that well justified. You just create enough regulatory risk that every regulated enterprise backs off. You probably don't want to create so much regulatory risk that you scare off the hyperscalers from serving Chinese models; this will just drive startups to sketchier providers. There's a happy middle ground here. I'd assume they will do some version of this.

6. It's probably true that open-weight models of this capability make the world a bit more dangerous, but not so much more that you'll really notice. At some point the models will be capable enough that you will notice. "A nonliving, invisible, dangerous, and infinitely self-replicating agent escaped from a Chinese lab," you say? Color me shocked.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Dean W. Ball

Dean W. Ball Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @deanwball

Jul 2
There are two broad ways this can work:

1. You divide this 5% over all US households, handing each a direct stake.
2. You give the stake directly to the government.

(1) is fine. (2) is probably ruinous, akin to inviting rats to live and reproduce in the walls of your house.
It will never stop at 5%. It will go on and on and on. The governance will become a nightmare. Political capture will be real. And it will generate precisely no goodwill with the public. None, if they themselves see no direct financial benefit.
“What has the AI industry even done for America.”

“Well, it handed a collective $200b of itself to Donald Trump.”

Half the country instantly hates you, and even a decent chunk of Republicans will assume this is corrupt by default.
Read 5 tweets
Jun 7
I think part of it, at least vis a vis US/China competition, is that US and western chattering classes find it hard to believe that the market-driven outcome of frontier AI could possibly be right. They basically believe, in their hearts, that the Chinese system, with its “industrial strategy,” has eclipsed capitalism. So they harbor the same inferiority complex toward the Chinese system that many Americans once harbored toward the EU’s system. Their heuristic is that the industrial strategists of China have grasped the whole picture of the technological competition in a way that US industrialists, with their “profit maximizing incentives,” could not possibly have matched. And so any outcome in the economy that is not the result of “strategy” is therefore prima facie worse than what the “strategists” have concocted. They also believe the Chinese strategists possess awesome powers of foresight and the ability to evade all tendencies of financial and economic gravity, due of course to “strategy,” really it’s almost a kind of orientalism.

Meanwhile the U.S. industrialists are making new advances in math and science, and the fastest-growing businesses in history, by spending hundreds of billions of dollars on high-margin chips whose legacy is in rendering video games, cramming them underneath tents if need be, and investing generational capital into new energy generation technologies as they do it, and perhaps even colonizing space as an instrumentally convergent result. But none of that is “strategy,” you see.
The salient thing is that nobody, absolutely nobody, in the Washington DC strategic class describes “capitalism” as existing in competition with the Chinese system. It is always “democracy.” They think capitalism already lost and that we have to become like China, with state-led public/private enterprise (“strategy”). So the word we use to describe, waves hands, “our way of life vis a vis their way of life” is “democracy.” Their defense is of a political order. On average they seem to feel no particular attachment to the economic order. This is bipartisan and is why the feeling of many in DC was “of course the government can tell anthropic to do whatever they want!” Civil-military fusion, the death of the private and its assumption into politics, they ultimately cheer these things on. They love them. They only decry them when social media is framed as the driving agent behind these trends (eg “polarization” discourse). Then it is bad, but that’s just because that framing makes them feel not in charge.
The irony is that I suppose I am a part of the U.S. strategic class and the above analysis is in fact Confucian af
Read 4 tweets
Jul 29, 2024
The AI community is laser-focused on SB 1047, but there's another AI bill in California that is equally, if not more, aggressive than 1047: AB 3211.

Like 1047, AB 3211 has passed one chamber of the legislature and is authored by a powerful legislator.

Let's take a look. 🧵 Image
AB 3211 is a deepfake bill, officially titled the Provenance, Authenticity, and Watermarking Standards Act.

It mandates the use of watermarking for all generative AI systems, and requires all large websites and apps to display provenance information for digital content.
The bill requires that *all* generative AI systems, regardless of content or size, include watermarks. As written, it applies to everything from a nucleic acid sequence predictor made by a grad student all the way up to multi-billion dollar foundation models.
Read 10 tweets
Jun 17, 2024
The latest amendments to SB 1047, introduced today, unfortunately seem to be a step in the wrong direction.

Let me explain.
The Frontier Model Division now has a new power: the ability to raise or lower the threshold for a covered model at will. This gives the agency regulatory powers that it could deploy in unpredictable ways.
This power includes the ability to unilaterally change the threshold for fine-tunes that are under its jurisdiction.
Read 9 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(