Oil Money is All You Need

Those who have been working with LLMs now know that attention is not all you need. As the parameter and token size increase, the need for fine-tuning and the reliance on GPUs also increases. And to do all of these at scale, you would need lots and lots of money – approximately $100 billion.

Sam Altman previously suggested that OpenAI may try to raise as much as $100 billion in the coming years to achieve its aim of developing AGI, alongside improving its model capabilities. But, as of now, there hasn’t been any update, and the total funding stands at $11.3 billion.