Indeed, Musk suggested that synthetic data — data generated by AI models themselves — is the path forward. “The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data],” he said. “With synthetic data … [AI] will sort of grade itself and go through this process of self-learning.”

Artificial Intelligence experts, including Elon Musk, have claimed that the available real-world data for training AI models has largely been exhausted.

The cumulative sum of human knowledge has been exhausted in AI training,” Musk said. “That happened basically last year.”