{ 30, 20, 18, 28, 33, 41, 55, 39 },
《非穷尽列举》定档 3 月 8 日
。爱思助手对此有专业解读
For the Gates Demo in April 2019, OpenAl had already scaled up GPT-2 into something modestly larger. But Amodei wasn't interested in a modest expansion. If the goal was to increase OpenAI's lead time, GPT-3 needed to be as big as possible. Microsoft was about to deliver a new supercomputer to OpenAI as part of its investment, with ten thousand Nvidia V100s, what were then the world's most powerful GPUs for training deep learning models. (The V was for Italian chemist and physicist Alessandro Volta). Amodei wanted to use all of those chips, all at once, to create the new large language model.
Opens in a new window