Even if it's passed the USMLE, #ChatGPT is not an MD.

LLMs aren't constrained to truth, and ChatGPT's biggest hurdle for #healthcare applications is "AI hallucination" (that is, confidently making stuff up.)

New @statnews:

statnews.com/2023/01/26/cha…
Last week Meta's chief #AI scientist called #ChatGPT "nothing revolutionary, although that's the way it's perceived in the public."

Brief explainer of how ChatGPT works in my piece above, with better ones from @OpenAI's site.

The TL;DR is that human feedback is the "special sauce" that puts ChatGPT apart from its predecessors, but it

1) introduces a lot of places for humans to bias the algorithms

2) can depend on absolutely terrible human labor conditions
time.com/6247678/openai…
The biggest fear is that ChatGPT is right enough of the time to give the "impression of greatness," per CEO Sam Altman.

But its agnosticism to truth, propensity to make up references, and not-up-to-date knowledge could make it a big problem in medicine.
statnews.com/2023/01/26/cha…
I didn't cover this in my story, but @NewsGuardRating has an excellent piece on how ChatGPT could become (or maybe already is) a low-barrier source of #misinformation.

newsguardtech.com/misinformation…
And the controversy over listing ChatGPT as an author? The authors consulted it like "a colleague"; it revised sections of the paper.

"We'll leave it to the associate editors handling our manuscripts how they wish to proceed with that," said Tseng.
Read about this and more, including ethical guardrails for AI, in my piece for @statnews: statnews.com/2023/01/26/cha…
If you don't have access, you're in luck: STAT+ is running a special through tomorrow; use STAT25 at checkout for 25% off an annual membership.

(You can also try STAT+ free for 30 days, or get a bigger discount if you're a student/academic!)

Deets: statnews.com/stat-plus/

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Brittany Trang

Brittany Trang Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @brittanytrang

Oct 3, 2022
As I'm fresh from academia, I had a lot of questions when I saw the OSTP's public access mandate.

What is actually going to happen to research publishing? (...ie, will the industry collapse?)

Of course, it's not that simple. My @statnews story: (1/7) statnews.com/2022/10/03/whi…
Right now, federally funded research from large US agencies has to be publicly available 12 months after it's published.

This policy, which went into effect in 2016, has let millions of taxpayers read the work they're funding. (2/7)
However, I had no idea that some of my own papers are freely available online because when I try to access them on the journal site, I still get hit with a paywall. (3/7)
Read 7 tweets
Aug 18, 2022
Today our paper about #PFAS destruction (at much milder conditions than previously thought possible) is out in @ScienceMagazine.

We also present a detailed, evidence-based degradation mechanism.

This paper is my entire PhD and I'm very proud of it. A 🧵:
science.org/doi/10.1126/sc…
PFAS are environmental pollutants linked to negative health effects at exposure levels so low that the US EPA recently set a drinking water health advisory limit that is lower than we can measure

(a nice way of saying there's no safe level)

In the last few years, the field has gotten pretty good at removing PFAS from water.

Our group in particular has made several regenerable PFAS adsorbents. But every time we present this research, someone asks 🙋‍♂️ "What do you do with the PFAS after you've desorbed it?"
Read 20 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(