In response to drivers not paying attention while using Tesla's Autopilot system, the company has implemented several methods to keep the driver's eyes on the road and hands on the steering wheel.
These alertness checks come in the form of chimes and steering wheel 'nags' to ensure the driver has their hands on the wheel and is ready to take over. However, after a long list of Autopilot-related incidents, the NHTSA has concluded that this is insufficient.
Specifically, the federal regulator said in a recent report that "Tesla's weak driver engagement system was not appropriate for Autopilot's permissive operating capabilities," leading to "foreseeable misuse and avoidable crashes."
Tesla's latest FSD software update enhances driver monitoring with Vision-Based Attention Monitoring to ensure safety, addressing concerns over Autopilot-related incidents and improving the strikeout system.Spencer Platt/Getty Images
Tesla Is Replacing Steering Wheel Nags with New Vision-Based Attention Monitoring
Tesla is addressing these concerns with a software update currently available to employees, which will be released to the public later. The new update, Full Self-Driving (FSD) software v12.4, includes several features, but what stands out is Vision-Based Attention Monitoring.
The release notes (via NotaTeslaApp) state that "the driver monitoring system now primarily relies on the cabin camera to determine driver attentiveness." But how can it ensure the driver is alert while on the road?
This new driver monitoring system ensures the driver is paying attention by issuing strikes every time the driver's hands are not on the steering wheel or when it detects that they are not looking at their surroundings, the road, and other motorists.
The good news is that this strike system has been updated to be more lenient. Previously, the system would disable FSD for a driver for one week after five strikes. These strikes would only reset after that week or when Tesla cleared everyone's strikes once a year.
The new strikeout system is more forgiving, gradually removing strikes over time. The release notes indicate that one strike will be removed for every seven days the driver goes without receiving a new one.
Tesla has also ensured that previous jailbreaks will no longer work with this new update. The new Vision-Based Attention Monitoring feature will not be activated when the camera is covered, there is insufficient lighting, the driver is not looking forward, or the driver is wearing sunglasses or a hat that covers their eyes.
If the system detects any of these conditions, it will revert to the old steering wheel nag, which requires the driver to continuously apply pressure to the steering wheel while using Autopilot.
Regarding data privacy, Tesla says footage from the cabin camera will be processed within the vehicle and transmitted only to the company's database if the driver agrees to data sharing.
