Kelsey Piper Profile picture
Jan 24, 2019 7 tweets 2 min read Read on X
I actually watched the whole #AlphaStar demo this morning with my girlfriend, who unlike me actually plays StarCraft. Read the article (vox.com/future-perfect…), but thoughts:
The systems we watched were trained for seven and fourteen days real-time, which is 200-400 years of gameplay time accumulated. In a way, "number of days" is misleading as a stat, it's pretty much just a function of how much compute you bought.
Nonetheless I think it merits a mention, because ....DeepMind decided in November or December to focus here. They then got top-pro level play in the space of about a month real time. Yes, this is because they can do a lot in parallel. But... they can do a lot in parallel.
From an AI capabilities perspective it's the amount of compute that's actually interesting. But from the perspective of thinking about how the deployment of these systems is going to happen, the fact so little real-world time is required is pretty critical actually.
Girlfriend and I disagree on whether this level of play given this much training time is impressive. I think it is. If you can get up to superhuman levels with two hundred years of training data there's a lot you can get up to superhuman levels at.
Girlfriend mostly contests that AlphaStar is all that superhuman. It wins by leaning in to its advantages as a computer -- micro, precision, multitasking. It's technically at par with humans in reaction time and actions per minute, but we both think a bigger handicap appropriate.
I think I have a model where.... human-level decisionmaking in most arenas plus the ability to really lean into the advantages of being a computer might be all you need.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Kelsey Piper

Kelsey Piper Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @KelseyTuoc

Apr 25
There are lots of flash-in-the-pan controversies in the news these days and by the time enough details have come out to clarify the situation most people have moved on. It's worthwhile to revisit some cases where the waters were at first muddy and see what was really going on.🧵
Jose Hermosillo is a US citizen who was detained for more than a week by ICE. The government has insisted that he confessed to illegal entry and that's why they held him for a week. He says that he told them all along he was a US citizen and was pressured to sign a document he couldn't read.

I think the facts point overwhelmingly towards a single, obvious conclusion and anyone looking into it in good faith for fifteen minutes will reach the same conclusion. Here are the established facts: Hermosillo is a 19yo from Albuquerque. He was visiting family in Tuscon when, his family says, he had a medical emergency and visited the ER: when they discharged him he tried to walk to the place where he was staying, got lost and encountered Border Patrol. Hermosillo's account is that he told them he was from New Mexico and they accused him of being from Mexico, demanded his ID he didn't have on him, and arrested him.

Everyone agrees that two days later he told a judge he was a US citizen, but was still kept incarcerated for 8 more days until his family tracked down where he was being held and brought proof of his citizenship.

The government's sworn account in the criminal complaint against him is that agents found him "at or near Nogales, Arizona", 70 miles away from Tuscon, which they later admitted was false. After his story was widely shared, the government asserted that he walked up to Border Patrol and confessed to being an illegal immigrant from Mexico. They released a document signed by him, purporting to be a confession he gave during an interview, in which he claimed to have entered illegally through the desert on April 8 and been picked up by Border Patrol later on April 8.

Hermosillo's family says he is intellectually disabled and cannot read. The signature on his confession is clearly that of someone who struggles to write his name. Hermosillo says he was told to sign documents he could not read, but that he never told ICE he was from Mexico, because he isn't. He says he told them he was from New Mexico.

So the government account is that an intellectually disabled man wandered up to Border Patrol in Tuscon and falsely claimed to be an illegal immigrant from Mexico. At that time they filed paperwork claiming under oath to have arrested him in or near Nogales, 70 miles south, but they assure us, they otherwise accurately filled out the paperwork in which Hermosillo claimed that his parents were Mexican citizens and that he had snuck across the border through the desert alone the same day he was arrested in Tuscon. (his confession does not explain how he got from Nogales to Tuscon if he entered by walking through the desert alone, probably because when the confession was extracted ICE was claiming he'd been arrested in Nogales.) The government says that after telling this lie at great length on April 9th, swearing to its truth, he then on April 10th at his first court hearing told a judge that he was actually a US citizen and had not entered illegally.

And the competing account is that he told them he was from New Mexico all along, they had him sign something he didn't read confessing to illegal entry, and on April 10th he repeated the same story to a judge that he'd said on April 8th and April 9th, which was that he was a US citizen from New Mexico.

Now, Border Patrol is well established to files affidavits saying that a person confessed to illegal entry when we know this is untrue. Here, for example, is a case where they claimed a baby was going to Kansas to seek employment:Image
Given all of this, I think there's an obvious leading guess for what happened. He said he was from New Mexico. They decided he was from Mexico. They arrested him and made him sign a confession, but it came out later he'd been telling the truth.
Read 5 tweets
Apr 17
o4-mini-high is the first AI to pass my personal secret benchmark for hallucinations and complex reasoning, so I guess now I can tell you all what that benchmark is. It's simple: I post a complex midgame chessboard and 'mate in one'. The chessboard does not have a mate in one.
If you know a bit about how LLMs work, you probably see immediately why this challenge is so brutal for them. They're trained on tons of chess puzzles. Every single one of those chess puzzles, if labelled "mate in one", has a mate in one.
As a result, even AIs that generally solve chess puzzles very capably fall apart on this question. What they'll do is check over, and over, and over for the checkmate that they've unquestionably accepted is there. Eventually after 1000s of tests they hallucinate a solution. Image
Read 11 tweets
Apr 16
The Miami Herald published a great article about one man who applied for refugee status, received it, and was seized at the airport and sent to CECOT for no reason: I posted it and everyone went "yeah that seems bad". Garcia, though, we can argue over.miamiherald.com/news/local/imm…
This is the toxoplasma of rage phenomenon, where the most controversial case gets debated far more than the clearcut ones where everyone just goes "yeah okay, that's fucked up" slatestarcodex.com/2014/12/17/the…
there are probably some other reasons that Abrego Garcia is being debated more - the court order to bring him back arrived the fastest because there had been a standing order not to send him in the first place.
Read 7 tweets
Apr 16
The 20million number is an article of faith on the right, but it's completely made up. I've been trying for a long time to track down how they came up with it. Even if you assume that literally every border encounter was an illegal alien allowed in, you get half that number.
This is important because they'll explain why they have to throw innocent asylum seekers in El Salvadoran prisons with 'well we have to get 20million of them out' and they don't, because half of them are imaginary people who only exist in their head.
There's very little more dangerous than trying to solve a problem the extent of which you're also lying about, because the lie will distort every part of your logic about what you need to actually do.
Read 4 tweets
Apr 10
We just finished dividing 5yo's room into two to make space for the (planned, not yet in progress) new baby. He's been enthusiastic about the whole process, and I promised him that while the room would be smaller we would make it his absolutely perfect awesome room.
Two walls are painted orange and two blue, his choice of colors. Today we put up dinosaur wallpaper and I got a bunch of glow in the dark stars for his ceiling. To be specific, I got 530 of them. I put up a rocket, the Moon, three saturns, an astronaut, some beautiful stars.
I ask him if it's good. He says that once all 530 of the stars cover every single part of the ceiling, it will be absolutely perfect, the best room ever. Now, 200 of these are some nice high quality stars and the other 330 are tiny tiny dots. Also he has a 12ft ceiling.
Read 13 tweets
Mar 27
8 year old just asked at the dinner table "what is a liberal" and now three adults are vehemently speaking over each other. "people on the left in the United States tend to favor more government intervention in markets-" "that's NOT liberal don't you tell her that's liberal"
"kiddo, are you aware that in the past women didn't have as many rights as men? at the time, the people who wanted to change that were liberals" "that does NOT mean -" "today, BOTH liberals and conservatives are in favor of women getting the vote -"
she is gamely asking clarifying questions about the entire intellectual history of the west. the baby meanwhile noticed we were distracted and stole 28 fruit bars
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(