Those who have been working with LLMs now know that attention is not all you need. As the parameter and token size increase, the need for fine-tuning and the reliance on GPUs also increases. And to do all of these at scale, you would need lots and lots of money – approximately $100 billion.
Sam Altman previously suggested that OpenAI may try to raise as much as $100 billion in the coming years to achieve its aim of developing AGI, alongside improving its model capabilities. But, as of now, there hasn’t been any update, and the total funding stands at $11.3 billion.
Keep reading with a 7-day free trial
Subscribe to
The Belamy | Weekly dose of best Tech stories
to keep reading this post and get 7 days of free access to the full post archives.