#FSDBeta Community Tracker: Thank you
This has come a long way in a year thanks to the community participation & feedback. We have collected nearly 70k miles to track & measure progress. I was initially collecting data on my own in Oct 2021 & others wanted to join me. 1/4
🙏@energyvest@PaperBagInvest & @freshjiva for pushing me to expand the data collection to the community 🙏@xskidave for all the feedback & support since the beginning! 🙏@EVGuyCanada for building a great app to track data while we drive & for supporting the data integration.
2/4
🙏@CYBRLFT for all the feedback to improve the details collected including critical disengagements. There are honestly too many people to thank, but here are some mentions…sorry if I missed anyone as I don’t know all off the top of my head @GreyTesla@SantoroSystems
3/4
🧵Measuring #FSDBeta progress as a community after 1 year:
Many people like to use the metric “miles to disengagement” to measure or compare progress for autonomous vehicles. While this is a possible metric, is it the right one and the only one? I don’t think so…
1/11
Waymo doesn’t think miles to disengagement provides relevant insights into capabilities or comparison of performance to others:
Their thread goes on to state that the data may fluctuate depending on geography and other factors.
2/11
Cruise provided 4 different reasons for disengagements: medium.com/cruise/the-dis…
1 reason under ‘True AV limitations or errors’ stated about disengagements “are sometimes reportable to the DMV”. This raises a big question: Are companies only reporting SOME disengagements?
3/11