Tesla FSD and Autopilot: General AI Now Enabled With Youtube Videos

Monday - July 17 2023, 23:22 UTC - 1 year ago

Tesla FSD and Autopilot are now enabled with general AI that can use videos from Youtube. This is allowing for different cars with different cameras and camera positions to be used which will increase the rate of AI improvement with Teslabot training. Tesla is aiming to mass produce Teslabots soon with the first use cases being security guard bots, warehouse bots for moving boxes and parts, factory bots, delivery bots, and a voice controlled bot as a walking super-iPhone.

Tesla FSD and Autopilot used to require complete retraining when the cameras were moved on Tesla vehicles. Tesla AI lead, Ashok Elluswamy, has now said that Tesla can now even use video of driving from Youtube. This means the cameras can be moved and Tesla can still use the driving video for its General AI. This means that different cars with different cameras and different camera positions were used.

The new general driving video capability means that if Tesla succeeds with FSD then they will be able resell the software to other car makers with different car models and different camera positions.

It also means that Teslabot training can proceed quickly, as the bot has different cameras and camera positions. Tesla will be doubling its driving AI supercomputer processing power once every three months. This and foundation of full neural network processing of video should increase the rate of improvement for all of Tesla AI. Tesla now has over 250 million miles of FSD driving data. Tesla can use all 10 billion miles per year of driving data from all of its cars for training and 2 billion miles per year of dedicated FSD driving data.

There are reports from Connecting the Dots that Tesla now has about 100 Teslabots working in their research labs and perhaps a few dozen in their factories. Connecting the Dots revealed this information in an interview he had with Tesla Herbert and Scott Walker.

Tesla can do a lot of Teslabot training via reinforcement learning and simulation. There are reports that Teslabots can handle wiring. This would be hugely useful for wiring Tesla cars in the factory. Scott Walker repeated his point that real world data with real world Teslabots will be needed to complete the training of Teslabots. If the cost for Tesla is $10,000 per Teslabot with mass produced Teslabots, then $1 billion of hardware research budget would enable the creation of 100,000 Teslabots and this would use the battery supply of 5000 Model Y cars.

Tesla will want to create profitable use cases and business models for in-training Teslabots. This would follow Tesla making and selling autopilot for driver assist and a beta version of FSD. The first Teslabot use cases will be: .

Observer or security guard bots. Using the mobile camera capability.

Warehouse bots for moving boxes and parts. There are reports of useful factory operations involving moving and placing parts precisly already.

Basic factory bots for moving parts.

Combined with robotaxi and robotrucks there will be delivery bots. This would replace UberEats at scale.

Tesla could create a voice controlled bot to act as a walking super-iPhone, TV or camera. It would have 100-200 times the battery capacity and 200 times the compute of your iPhone, It could charge your other portable devices.

Tesla now has over a hundred Teslabots in development. It would make sense for Tesla to scale to a few thousand bots for training to work out basic capabilities, safety and a base of rapid AI training. Once the foundation of capability is a bit more advanced, the speed of development would be maximized with mass production of hundreds of thousands of Teslabots next year and the use of Teslabots to complete various tasks for Tesla and Tesla related businesses.