Tesla Real World Automated Vehicle Behavior Observation
Whenever I can, I engage the AutoPilot feature on my Tesla Model 3 so I can enjoy what it can and can't do so I can make as many observations as possible. In this particular case, I was in "Navigate by AutoPilot" on my way to the shop the other day and I experienced something new. So as soon as this event happened I hit the "archive" button so I could review the video feeds later.
What I observed was the following, a plastic bag floated up in front of the car at windshield height. I didn't see much harm as I was tracking it and then I discovered that the onboard cameras were as well. Just before the bag flew past the vehicle, the left turn signal began flashing and the vehicle maneuvered to the left just after the bag floated past the windshield in an attempt to avoid the bag.
Today I had a little time to pull the thumb drive from the vehicle and sliced out the event and created a short video:
Very nice. How quick to disengage auto pilot?
Concerned that the maneuver was kind of "after the fact" and in a real dangerous reality, would it have happened soon enough. However, I am very naive about autonomous driving at this point. Thanks for the post.
The term “assist” applies as long as the controls are in place. The driver is ultimately responsible for the safe operation of the vehicle at all times. What I observed isn’t something I’ve seen documented. This is today and the newer vehicles have a drive computer that has the computing power that is 21x greater than mine.
As soon as you turn the wheel it will disengage lane centering. If you touch the brake, it all turns off. It happens very quickly.
Nice capture Scott. Interesting for sure. There is definitely a clear delay in reaction time. Maybe the system can detect the nature of objects that the camera is capturing and whether they will result in a soft or hard contact, resulting varying levels of avoidance! If there is no object intelligence and that had been a piece of 2 x 4 or a rock, you could have been "wearing" it on autopilot…
Thanks Martin. Today as you know these are assistance systems and the driver is ultimately responsible for the safe operation of the vehicle. I would love to be able to see the data log covering this to see what was detected and classified. As noted above in my response to Dick, the new drive computer is 21x more powerful and would have likely processed things a little quicker. The human mind is…
Interesting. Reminds me of a picture I saw taken at the first DARPA Grand Challenge challenge in 2004. An Oshkosh 10 ton 6 x 6 was stopped dead by a 5 foot sagebrush. The sensors could not determine what it was. Think that was in Popular Science magazine. None of the vehicles in that first challenge finished the course. By 2007 the course had moved from the desert to a simulated urban…
Thanks for the links Rex, we’ve come a long way in a short period of time!
Heck, my Mother had quicker reaction time than that. Anytime she observed something as a potential danger while in the car, her right arm was across my chest as a child restraint measure in less than a second and her foot that was already resting on the brake pedal ( A just-in-case parental protection mode feature, standard equipment ) initiated the vehicle deceleration system hard enough to…
Yeah but although the steering maneuver happened after the bag passed, the turn signal came on about 1 second before. As far as I know this is an undocumented feature and something that will likely get better over time. And yes, as explained during the 3+ hour Tesla Autonomy Day presentations, Tesla will upload data for analysis which may result in hand-annotation and add to their image…
Your aged neural network is called Wisdom :O)
And, I was negligent in not extending you some kudos for the nice capture and posting. I tried to find some faults with your video based on my previous and extensive "Scott Brown" training, but was unable to do same. So, nice job!!
The Nascar boys could have benefited from that feature in Fontana this past Sunday debris was flying everywhere. lol
Hi Scott, it would be interesting to know if your Tesla canceled swerving to avoid the object because of the center divider to your left or did it recognize that the object was a harmless plastic bag floating toward you. Another question is why didn't it signal to the right? I'd assume a car was in the other lane blocking it from switching lanes. Pretty cool stuff.
Hi Nick, I don’t know exactly what drove those decisions so this is all speculation at this point. On that freeway there is room for another lane so I don’t think the center divider was an issue. I will review the other camera angles and let you know whether there was a vehicle in the zone or not.