1) It took quite a few iterations to get this far. I saved the chat history, and I prompted it 77 times (some were repeats and mistakes). The chat is here: github.com/dfeldman/opera…
If you think the answer on the left indicates that GPT-3.5 does not have a world-model....
Then you have to agree that the answer on the right indicates GPT-4 does.
I completely made up this question btw, so I don't think it's in any training data.
It's pretty evident to me that we're no longer in "stochastic parrot" territory. GPT-4 is capable of genuinely reasoning about the world. It's pretty dumb sometimes, and makes odd mistakes. But it does seem to have some emergent simple world-model.
People like to say GPT-4 isn’t intelligent because it doesn’t have a “world model.” What is a question I can ask it to prove it doesn’t have a world model?
Like I tried stuff like “I’m in New York, I fly a Cessna for three hours west, jump out with a parachute, and catch a freight train south, where am I ” and it follows along and has reasonable guesses
This is a specific question Gary Marcus cited as indicating there is no “world model.” BUT GPT-4 gets it right!!!
Republicans: but some families are wealthy and can afford to pay!
Democrats: oh you’re right, let’s tax the wealthy families!
Republicans: oh bother
Seriously, Minnesota is one of the wealthiest states, without having any oil/gas or much tech or finance. Housing is relatively cheap and basic government services are overall pretty good. We can afford to do much more
we’ve pretty consistently had state budget surpluses, it is now over $9 billion per year
Only one person ever has tasted plutonium. It got on his face during an experiment gone wrong at Los Alamos, he had his stomach pumped and his breath tested as slightly radioactive for the rest of his life. He also was forbidden from working in a lab again. But he died at 87.
He eventually did a physics PhD, had a family and started an interior landscape company that was extremely successful, and died of natural causes. All while having a few micrograms of plutonium in his body.