Tesla Real World Automated Vehicle Behavior Observation

Scott Manager Claremont, California Posted   Latest  
Demonstration
Autonomous Vehicles
2018 Tesla 3 Long Range 1-spd
Auto Pilot

Whenever I can, I engage the AutoPilot feature on my Tesla Model 3 so I can enjoy what it can and can't do so I can make as many observations as possible. In this particular case, I was in "Navigate by AutoPilot" on my way to the shop the other day and I experienced something new. So as soon as this event happened I hit the "archive" button so I could review the video feeds later. 

What I observed was the following, a plastic bag floated up in front of the car at windshield height. I didn't see much harm as I was tracking it and then I discovered that the onboard cameras were as well. Just before the bag flew past the vehicle, the left turn signal began flashing and the vehicle maneuvered to the left just after the bag floated past the windshield in an attempt to avoid the bag. 

Today I had a little time to pull the thumb drive from the vehicle and sliced out the event and created a short video

+7
Interesting
Ronald Mechanic
Birmingham, Alabama
Ronald Default
 

Very nice. How quick to disengage auto pilot?

0 Default Ð Bounty Awarded
Dick Technical Support Specialist
Québec, Quebec
Dick Default
 

Concerned that the maneuver was kind of "after the fact" and in a real dangerous reality, would it have happened soon enough. However, I am very naive about autonomous driving at this point. Thanks for the post.

+1 Default Ð Bounty Awarded
Scott Manager
Claremont, California
Scott Default
 

The term “assist” applies as long as the controls are in place. The driver is ultimately responsible for the safe operation of the vehicle at all times. What I observed isn’t something I’ve seen documented. This is today and the newer vehicles have a drive computer that has the computing power that is 21x greater than mine.

+1 Default Ð Bounty Awarded
Scott Manager
Claremont, California
Scott Default
 

As soon as you turn the wheel it will disengage lane centering. If you touch the brake, it all turns off. It happens very quickly.

0 Default Ð Bounty Awarded
Martin Instructor
Burnaby, British Columbia
Martin Default
 

Nice capture Scott. Interesting for sure. There is definitely a clear delay in reaction time. Maybe the system can detect the nature of objects that the camera is capturing and whether they will result in a soft or hard contact, resulting varying levels of avoidance! If there is no object intelligence and that had been a piece of 2 x 4 or a rock, you could have been "wearing" it on autopilot…

0 Default Ð Bounty Awarded
Scott Manager
Claremont, California
Scott Default
 

Thanks Martin. Today as you know these are assistance systems and the driver is ultimately responsible for the safe operation of the vehicle. I would love to be able to see the data log covering this to see what was detected and classified. As noted above in my response to Dick, the new drive computer is 21x more powerful and would have likely processed things a little quicker. The human mind is…

+1 Default Ð Bounty Awarded
Rex Technical Support Specialist
Alliance, Ohio
Rex Default
 

Interesting. Reminds me of a picture I saw taken at the first DARPA Grand Challenge challenge in 2004. An Oshkosh 10 ton 6 x 6 was stopped dead by a 5 foot sagebrush. The sensors could not determine what it was. Think that was in Popular Science magazine. None of the vehicles in that first challenge finished the course. By 2007 the course had moved from the desert to a simulated urban…

0 Default Ð Bounty Awarded
Scott Manager
Claremont, California
Scott Default
 

Thanks for the links Rex, we’ve come a long way in a short period of time!

0 Default Ð Bounty Awarded
Hollis Technician
Boulder, Colorado
Hollis Default
 

Heck, my Mother had quicker reaction time than that. Anytime she observed something as a potential danger while in the car, her right arm was across my chest as a child restraint measure in less than a second and her foot that was already resting on the brake pedal ( A just-in-case parental protection mode feature, standard equipment ) initiated the vehicle deceleration system hard enough to…

+1 Default Ð Bounty Awarded
Scott Manager
Claremont, California
Scott Default
 

Yeah but although the steering maneuver happened after the bag passed, the turn signal came on about 1 second before. As far as I know this is an undocumented feature and something that will likely get better over time. And yes, as explained during the 3+ hour Tesla Autonomy Day presentations, Tesla will upload data for analysis which may result in hand-annotation and add to their image…

+2 Default Ð Bounty Awarded
Hollis Technician
Boulder, Colorado
Hollis Default
 

Your aged neural network is called Wisdom :O)

0 Default Ð Bounty Awarded
Antonio Owner/Technician
Nutley, New Jersey
Antonio Default
 

Wowww, wowww, wowww

0 Default Ð Bounty Awarded
Dick Technical Support Specialist
Québec, Quebec
Dick Default
 

And, I was negligent in not extending you some kudos for the nice capture and posting. I tried to find some faults with your video based on my previous and extensive "Scott Brown" training, but was unable to do same. So, nice job!!

0 Default Ð Bounty Awarded
Robert Diagnostician
Oldsmar, Florida
Robert Default
 

The Nascar boys could have benefited from that feature in Fontana this past Sunday debris was flying everywhere. lol

0 Default Ð Bounty Awarded
Nick Manager
Culver City, California
Nick Default
 

Hi Scott, it would be interesting to know if your Tesla canceled swerving to avoid the object because of the center divider to your left or did it recognize that the object was a harmless plastic bag floating toward you. Another question is why didn't it signal to the right? I'd assume a car was in the other lane blocking it from switching lanes. Pretty cool stuff.

0 Default Ð Bounty Awarded
Scott Manager
Claremont, California
Scott Default
 

Hi Nick, I don’t know exactly what drove those decisions so this is all speculation at this point. On that freeway there is room for another lane so I don’t think the center divider was an issue. I will review the other camera angles and let you know whether there was a vehicle in the zone or not.

0 Default Ð Bounty Awarded