May 19, 2024
By Karan Singh
Previously, the Tesla X account shared a video where FSD V12 appeared to consider a pedestrian’s hand gestures when navigating. Elon Musk also confirmed on X that hand gesture recognition would be improved in V12.4, and even better by V12.5.
Tesla has had plans for gesture recognition for many years, with Musk mentioning hand gesture recognition in 2021. FSD is supposed to be able to adapt to new and unique circumstances in a safe manner, whether following instructions from a police officer, or understanding the hand signals from a cyclist.
Boris Johnson and FSD
Boris Johnson, the ex-Prime Minister of the UK, recently got to experience FSD V12 in the crowded streets of LA, with his wife and child in the backseat. Tesla provided a vehicle and assistant for his self-driven experience through 5-road intersections, heavy traffic, and pedestrians.
At the end of about 45 minutes I feel like a driving test examiner – except that I want to tell the car that it has passed, with flying colours. -Boris Johnson
Gestures coming soon
Johnson had a single experience with hand gestures in his drive – being waved at a hotel. While the car didn’t recognize the gesture – even on FSD V12.3.6 – the Tesla official in the vehicle confirmed that “‘It doesn’t yet recognise that gesture, but we are fixing it for the next iteration. It should be done next month.”.
It’s not immediately clear whether the Tesla employee is referring to FSD v12.4, which is expected to start rolling out to the public later this week, or Tesla’s next major FSD release, V12.5. According to Musk, V12.5 is expected to handle much more complicated situations and even start vehicle-to-fleet communication.
Yeah, I wouldn’t count on this in 12.3.x, but 12.4 is a big improvement and 12.5 might nail it
— Elon Musk (@elonmusk) May 10, 2024
Solving FSD
When you’re tackling a problem like FSD, which has never been solved before, you sometimes have to pivot and realize there’s a better approach. That’s what Tesla has done with FSD and AI. Just a few years ago where people thought cars would need to be able to read signs to achieve autonomy, but with the latest approach, there’s no need to. As long as the vehicle has seen a specific sign before and has enough examples, it’s already trained on what humans do when such a sign is found. The same will be true for hand gestures, the vehicle won’t need to know what each hand gesture means, it’ll just recognize that when a current gesture is made, this is how the vehicle should react.
Tesla does this by feeding it millions of examples of very specific situations and AI recognizes patterns. This is an example where Tesla leverages fleet data. They can easily capture millions of examples of hand gestures and how humans reacted, and feed that to their AI training model.
As Tesla processes more video, FSD will continue to improve. Tesla is expected to spend $10 billion on AI this year alone, most of it going toward improving FSD.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Rivian to Add Google Cast and Native YouTube App, Will Tesla Respond?
May 17, 2024
By Not a Tesla App Staff
Coming to Rivian vehicles over a software update is Google Cast and YouTube support, which will allow for seamless, high-quality content streaming to Rivian vehicles.
This is a big step forward for Rivian’s software integration, especially compared to Tesla, which has yet to integrate native apps or release the long-rumored Tesla native app store.
Google Cast
Google Cast is Google’s version of Apple AirPlay which is supported in a variety of audio and video streaming apps such as Netflix, Disney+, YouTube, and more. By using a supported app, a user will be able to cast content directly to Rivian’s main 15.6” center screen.
Like Casting to a TV or Smart Device at home, this will allow you to play, pause, or skip back and forth using the vehicle’s touchscreen. Google Casting automatically pauses when the vehicle shifts into Drive.
Native YouTube App
Alongside Google Cast, Rivian is also bringing a native YouTube app to vehicles, enabling users to access YouTube’s video and music library from anywhere with a data connection. These features will be integrated right into Rivian’s vehicle operating system, which means they will receive regular software updates, and not be reliant on browser-based capabilities.
Similar to casting content, YouTube content will also automatically pause when the vehicle is shifted into Drive.
Tesla Equivalents
For the time being, there is no way to AirPlay or Cast video from a phone or tablet to Tesla’s front or rear screens. However, for some apps such as YouTube, you can send the video URL to the vehicle and have it open the YouTube app to that video.
To do this, open the YouTube app and find a video. Once you’d like to share it with the vehicle you can tap on share. You’ll then need to share it with the Tesla app which will then send it to your vehicle. On iPhones this requires you to scroll to the right and tap on More, which brings up the native sharing screen and has the Tesla app.
However, this is far more limited than including AirPlay or Google Cast support which will work for practically and video, even personal videos in your photo library.
Elon Musk mentioned back in 2016 that Tesla would add mirroring of phone apps to the center screen, but that has yet to materialize. More recently Musk mentioned a native X App coming to Tesla vehicles.
Tesla Theater
Tesla Theater allows users to stream videos from various platforms, including YouTube, but these are web-based applications, with no native applications available. This leaves some marked limitations on usability.
Tesla most recently announced in their 2024.14 update that the browser will be able to be expanded to full-screen mode when parked, enabling more access to streaming services on the web. Meanwhile, Google Cast and Apple Airplay continue to remain highly requested features.
Tesla FSD V12.4 – Features and Release Date
May 16, 2024
By Not a Tesla App Staff
The greatly anticipated FSD v12.4 is around the corner, with Elon Musk mentioning that it will be going to employees this weekend, with limited external testers next week.
Several significant improvements are coming with V12.4, which is being compared to the leap in performance that was previously seen between V12 and V11.
Improved Comfort and Reduced Interventions
There are quite a few improvements expected with V12.4, which Musk has said will be focused on user comfort by reducing hard accelerations and sudden braking. According to Musk, FSD v12.4 is also expected to have a 5-10x improvement in time between user interventions, which means that Tesla is rapidly approaching its goal for the Robotaxi announcement on August 8, 2024.
Steering Wheel Nag Removal
FSD V12.4 is expected to eliminate the steering wheel nag, as Musk confirmed its removal last week. The camera-based driver monitoring system will be taking over, providing a hands-free experience. These improvements will most likely benefit owners who have cabin cameras with infrared lights the most, while Tesla may continue to use steering wheel nag as a fallback mechanism.
Driverless Autopark
The second key feature that may be included in v12.4 will be Banish Autopark, previously known as Reverse Summon, allowing you to choose a parking spot, exit the vehicle and have the car park itself. Whether this feature makes it in v12.4 is yet to be seen, but Musk has mentioned that parking without a driver is coming soon.
Automatically Seek Parking Spot at Destination
Finally, your Tesla will now traverse a parking lot and automatically enter Autopark mode when arriving at a destination, according to a post from Musk.
Eligibility and Branch
Tesla recently added FSD v12.3.6 to the 2024.14 branch with updates 2024.14.5 and 2024.14.6. This makes it very likely that Tesla’s next FSD version will also be based on 2024.14, meaning that it will be available to any vehicle on 2024.14.x.
For users on update 2024.3.25, this means that they’ll receive all of the features included in updates 2024.8 and 2024.14, which should make it a massive update.
Release Date
Musk has mentioned that FSD V12.4 is going out to employee vehicles for internal testing this weekend, with external testing starting next week. The rollouts typically go slower than predicted but looks like we may see this begin shipping to customers by the end of the month.