How to become a self-driving car engineer? 💻🧠🚗

Well, there is no easy answer - building a self-driving car requires expertise from many different fields.

The good new is that there are many paths that will lead you to a job in this industry!

Read more details below 👇
There are many different engineering roles in a self-driving car project:

💻 Software Development
🧠 Machine Learning
👀 Computer Vision
🏎️ Vehicle Control
⚙️ Hardware
💽 Big Data
🕹️ Simulation
📍 Mapping
🚧 Safety
🔒 Security
📝 Test and Validation
🔨 Tooling

and more... 👇
Over the next days I'll share some of my experience working in the industry and describe in more details the different roles and what skills are required to enter the field.

I will link all threads below so stay tuned 👇

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Vladimir Haltakov

Vladimir Haltakov Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @haltakov

28 Oct
Self-driving car engineer roles - Computer Vision Engineer 👀

The camera is one of the most important sensors! It is not always the most accurate one, but it can provide much more data than a lidar or radar. Extracting this data is the job of the CV engineer.

Thread 👇
Problems to work on 🤔

Here some typical object classes that need to be detected and classified.

🛑 Traffic signs
🚦 Traffic lights
🚘 Vehicles
🚶 Pedestrians
🦌 Animals
🛣️ Lane markings
🏔️ Landmarks
🚧 Construction zones
🧱 Obstacles
🚔 Police cars
Distance estimation 📏

Detecting an object is not enough, though. You also want to know how far the object is from the car. While the detection part is dominated by deep learning, the traditional CV methods (e.g. Kalman Filter) are still very useful for distance estimation.
Read 10 tweets
27 Oct
Self-driving car engineer roles - Software Engineer 💻

There are many specialized roles in a self-driving car project, like ML or CV engineers. However, every projects needs lots of good software devs - you can enter the industry even without specific knowledge!

Thread 👇
Problems to work on 🤔

Some problems that software developers work on to build a self-driving car (the list is not exhaustive):
- HMI
- Operating system
- Logging and tracing
- Communication between ECUs
- Internal frameworks and libraries
- Implementing diagnostic interfaces
Software engineers also work closely with many of the more specialized roles.

For example with Machine Learning engineers to implement models on the ECU or with Vehicle Control engineers to get their algos working efficiently.

And tooling and testing are huge separate topic!
Read 8 tweets
27 Oct
Self-driving car approaches 🧠🚗

Some interesting self-driving news lately:
- Waymo launching test fleet without safety driver
- Tesla launching a beta of their Full Self-Driving
- Mercedes announcing a level 3 traffic jam pilot for 2021

There are 3 very different approaches 👇
1️⃣ "Everything that fits" approach.

This is Waymo's approach, but other companies like Cruise, Argo, Aurora, Uber, Zoox have a similar strategy.

Fit as much sensors as possible on the car, build high-definition maps of the environment and throw in lots of compute power.
Check out some images of these cars - they all have multiple lidars, cameras and radars all around the car. Waymo now has 29 cameras! 😲

They are not really integrated in a consumer oriented way, but it should be fine for a robotaxi. ImageImageImageImage
Read 12 tweets
26 Oct
Tesla released a beta version of their Full Self Driving (FSD) software to selected people couple of days ago 🧠🚗.

The first impressions are quite interesting! Here some comments from my side.

Thread 👇

Technology 🤖

A lot of the technology behind the FSD software was presented at a conference in February. Check out this video, it is really interesting!



Main point is Tesla is using a "Bird's eye view" neural network to predict the layout of the road.
You can see this in action in the car - you see all lines defining the lanes and the road boundaries in the display. They seem to be coming from the vision system and not from a map, because they are very unstable and often not very accurate. ImageImage
Read 13 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!