Adversarial attacks are not likely to be common, but the vulnerability shows how how important it is to have diverse and redundant sensor modalities in autonomous vehicles. If you can create a safety risk by fooling one camera, you were in trouble long before the attack.
https://twitter.com/WIRED/status/1316000512135880704
Tesla's approach to full autonomy is seen as plausible by people who know a little bit about machine learning and absolutely nothing about safety critical systems architecture and functional safety... which is a lot of people these days!
Try doing some basic functional safety thinking yourself: imagine a totally driverless Tesla driving down the road, when something goes wrong. For example, a camera goes out due to humidity or mud. What might happen? Play it out.
https://twitter.com/Tweetermeyer/status/1315052366345854976
The lack of redundancy on the sensor side creates single points of failure if one of those sensors goes out, just like the lack of diversity means there's a single point of failure if a camera can be fooled. Heck, Teslas hit trucks because both camera and radar fail to see them!
• • •
Missing some Tweet in this thread? You can try to
force a refresh
