Dai Qionghai, Academician of the Chinese Academy of Engineering: the cost of algorithmic models is getting higher and higher. The total investment of GPT series research is more than 3 billion US dollars.

[Dai Qionghai, academician of the Chinese Academy of Engineering: the cost of algorithmic large models is becoming increasingly high.] Science and Technology Innovation Board Daily reported on the 28th that Dai Qionghai, academician of the Chinese Academy of Engineering and president of the Chinese Society of artificial Intelligence, said at the Zhongguancun Forum that the cost of algorithmic large models is becoming higher and higher. The cost of GPT-3 training is about 5 million US dollars, and the cumulative investment of GPT series research is more than 3 billion US dollars. And the model is getting bigger and bigger, increasing by 20,000 times in five years. Tasks are becoming more and more diverse, and one model is open source to handle multiple tasks. The GPT-3 training data is about People's Daily's 450000 years of writing. (reporter Li Mingming)