Tesla's Artificial Intelligence Division has developed a powerful supercomputer named Dojo. This system has been online and operational for several months, and it's expected to become one of the top five most powerful computers globally by February 2024, with a projected compute power of 100 exaflops. This is equivalent to 300,000 Nvidia A100 GPUs, which are typically used to create advanced software and large AI models.
The Dojo system is designed to train Tesla's full self-driving neural network, processing vast amounts of visual data captured by the vehicle's cameras. This involves labeling, which is assigning a designation to a cluster of pixels so the AI can understand what it's looking at. This process is crucial for recognizing patterns and making associations, which are essential for autonomous driving.
Dojo is a significant departure from traditional AI training clusters, which are typically made up of large cabinets packed with GPUs. Instead, Dojo is a bespoke hardware platform designed from the ground up by Tesla's AI division exclusively for training their latest computer vision video-based full self-driving networks. This system is more efficiently powered by Tesla's own Dojo chips, which are assembled on one single piece of silicon, a concept similar to Apple's M1 chip.
The Dojo system is not just a single unit but becomes functional at the tile level, where multiple chips are fused together to function as one system. This architecture allows for a high level of efficiency with minimal need for power or cooling. Tesla has fused 25 Dojo chips to create one unified computer system, which contains all the necessary hardware for power, cooling, and data transfer.
This new system means that Tesla will be able to quickly add a large amount of computing power to their AI training program at a relatively low cost. It also means that Tesla will not have to compete in the marketplace to buy the same Nvidia chips as everyone else in their industry. Instead, they can leverage the inflated value placed on AI training power to create a whole new business model with their existing AI division.
Elon Musk has stated that future versions of Dojo will be more tailored to general-purpose AI training, making it adaptable for various applications beyond Tesla's current needs. Once Tesla's Dojo system is up to a level where it is delivering all of the compute power they need, every additional Dojo system that they build becomes an asset that can be monetized. This could work similarly to Amazon Web Services or Microsoft Azure, where companies rent out their spare server capacity. This business model is seen as extremely lucrative, and it's expected to significantly impact Tesla's future.
The value of an exaflop, the unit used to measure the amount of work a computer can handle in one second, is unfathomably large. One exaflop represents one quintillion computer operations per second. This is equivalent to 300,000 Nvidia A100 GPUs, which are used to create the most advanced software on Earth, such as large AI models. The value of Tesla's creation with Dojo is estimated to be around three billion dollars.
1. Tesla's Artificial Intelligence Division has created a new type of supercomputer called Dojo.
2. Dojo has been online for a few months and is expected to reach the top 5 most powerful computers in the world by early next year.
3. The Dojo project is a significant deal that is about to change everything for Tesla.
4. In June 2023, Elon Musk announced that Dojo has been online and running useful tasks at Tesla data centers.
5. Dojo's Hardware is production-ready since July 2023.
6. Tesla AI is forecasting that Dojo will become one of the top five most powerful supercomputers in the world by February 2024.
7. Tesla is creating a three billion dollar supercomputer with Dojo.
8. Dojo is designed to function as a training ground for Tesla's full self-driving neural network.
9. Dojo is a bespoke hardware platform designed exclusively by Tesla's AI division for training their latest computer vision video-based full self-driving networks.
10. Dojo is processing vast amounts of visual data captured by the vehicle's cameras.
11. Dojo is more correctly described as an artificial intelligence training cluster.
12. Dojo is a system on a chip, an entire computer assembled on one single piece of silicon.
13. Dojo becomes functional on the tile level, where multiple chips are fused together to function as one system.
14. Tesla has fused 25 Dojo chips to create one unified computer system.
15. Tesla is not going to the same Marketplace and competing to buy the same Nvidia chips as everyone else in their industry.
16. Elon Musk has said that future versions of the Dojo system will be more tailored to general-purpose AI training.
17. Once Tesla gets their own Dojo system up to a level where it is delivering all of the compu power that they need then every additional Dojo system that they build becomes an asset that can be monetized.
18. Elon sees this working exactly the same as something like Amazon web service or Microsoft Azure, Tesla will simply rent out their excess computing power for anyone who needs it.