E.W. Niedermeyer Profile picture
Sep 15, 2020 8 tweets 3 min read Read on X
Wow, this is huge: the safety driver who was behind the wheel the night Elaine Herzberg was hit and killed by an Uber self-driving test vehicle is being charged with negligent homicide. Whichever way this case goes, it's going to set an important precedent.
What makes this case so tough: on the one hand, this safety driver was hired to monitor a development vehicle during testing and ensure its safety... but on the other hand we know that this is an almost impossible task to sustain, and distraction was inevitable.
To flesh out the second half of that: Uber had this safety driver working 10 hours per shift, at night, all alone, with no driver monitoring. There's a good deal of scientific research that suggests this set her up to inevitably fail. More on that here👇
In fact, a lot of the context around this tragic crash suggests that Uber ATG's AV development program was headed toward this kind of disaster. When I wrote about the 10 lessons I took from this incident, I tended to blame Uber more than the driver thedrive.com/tech/27023/10-…
Some best practices for on-road AV testing have emerged since this tragedy: extensive training, camera-based driver monitoring, always test in teams of two, regularly alternate partners, regularly alternate roles. Thus far, these rules have prevented any further fatalities.
This case is especially relevant as Tesla comes closer to releasing "beta" versions of "feature complete Full Self-Driving" that the company says will require driver oversight at first. This puts totally untrained consumers in the role of a safety driver for an in-development AV.
The NTSB investigation really captures the conflict here. It calls the operator's distraction and failure to monitor the "probably cause" but says Uber's lack of risk assessment, driver oversight and "mechanisms for addressing complaceny" contributed [PDF] dms.ntsb.gov/public/62500-6…
One other angle that's worth mentioning in this thread: Herzberg's family has filed a $10m civil suit against the state of AZ and governor Doug Ducey, alleging that their policy of attracting AV testing by reducing regulations contributed to her death. phoenixnewtimes.com/news/claim-duc…

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with E.W. Niedermeyer

E.W. Niedermeyer Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @Tweetermeyer

Mar 24, 2023
There's a fascinating thread here, where Elon seems to go nuts for anything Google is doing, and funds "competition" for their work based on the assumption that they are much farther along than they are.
semafor.com/article/03/24/…
This is literally how Tesla ended up going into driving automation tech! Most people still don't know that Google developed a system called "AutoPilot"but didn't bring it to market based on the exact safety concerns plaguing Tesla's version
thedrive.com/tech/29877/dr-…
The driving automation play and the AI play are different in some respects, but in both cases Musk was trying to "frontrun" competition with what he (mistakenly) thought were imminent Google monopolies. He's kind of an emerging tech squatter?
Read 8 tweets
Mar 23, 2023
This is a really good way to prove that you're not just a jerk, but someone who doesn't engage with technology in a thoughtful way as well.
Here's the thing about automation: "understanding the technology" is barely half the battle. If you don't understand the work you're trying to automate, you'll never succeed. The people who proclaim rampant job loss from automation grok the tech, but are clueless about the jobs.
Driving automation technology is rampant with this flavor of cluelessness. People see a video and say "oh look, it's driving" without having the first clue about what driving in an economically valuable way entails (long-tail reliability, insurance, customer service, etc)
Read 6 tweets
Mar 22, 2023
Now that the "self-driving car" bubble has burst, why not spend the technology dividend on solving this actual, real-world problem?
Right now the auto industry is planning to spend the technology dividend on Level 2 systems, which provide an enticing simulacrum of self-driving without delivering any actual proven safety benefits. That's where the money is, so never mind about safety I guess!
It doesn't have to be that way. Instead we could apply the performance improvements and cost reductions in driving automation tech to the systems we know deliver improved safety outcomes... which just happen to be the systems that don't pretend to be "self-driving."
Read 5 tweets
Mar 21, 2023
I asked Midjourney to show me a Persian miniature of a robotaxi and it gave the thing a lidar dome that looks like a mosque 🥹 Image
I've been having fun trying to understand how Midjourney imagines the term "robotaxi" in different contexts, so I'll continue to post the results in this thread.

Here we have one of my favorite examples of an ancient Egyptian robotaxi, complete with a massive infotainment system Image
The Oregon Trail sure ain't what it used to be, now that we got them self-driving Conestoga wagons, I'll tell you what. Image
Read 15 tweets
Mar 15, 2023
It says a lot about the Tesla fandom that the response to revelations about Tesla's malfeasance is always "oh well every other automaker does this, you just never hear about it, and though I don't actually cite any sources just trust that I have looked into this."
Tesla has tried to do this itself, for example in its only public statement on my reporting about its record of environmental violations at Fremont.

I dug into their claims, and the comparison Tesla drew actually shows how much worse their record is
thedrive.com/tech/28432/tes…
Fremont has some 47 Clean Air Act violations since it last settled some 30 violations with @AirDistrict in mid-2021. I challenge Tesla's defenders to name a single auto final assembly factory with a record that comes close to that. Just one! echo.epa.gov/detailed-facil…
Read 5 tweets
Mar 13, 2023
The whole "this wasn't VCs, this was just SVB" narrative elides a major point of this whole episode: insularity concentrates risk in lots of ways. You think it was a coincidence that a bank so embedded in this specific ecosystem failed to hedge for higher interest rates?
Like, I guess it's probably a good thing that Silicon Valley didn't do all of it's Finding Out all at once (as much as some players might deserve it)... but let's not pretend we can or should prevent that Finding Out from happening in a more orderly fashion.
I have friends and acquaintances in Silicon Valley who are amazing people doing amazing work, and I wish them nothing but good things. But there were plenty of good people in Detroit, and that culture still had to undergo a major reckoning. And guess what? That pain was worth it.
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(