Data is Dead 💀

Also in today's edition: TCS Witnesses Slump, Vicuna vs Alpaca & India Builds Suite of GPTs

The data defence is broken. Data accumulation was once considered a moat for companies that slowed down the competitors from catching up. The development of LLMs has diminished the value of data hoarding. For instance, OpenAI, which took years to build ChatGPT, witnessed a competitor in the form of Google’s Bard, which was trained on the conversational data of ChatGPT, as reported by the media. Bizarrely odd, right?

Similarly, Alpaca was built by fine-tuning Meta’s LLaMA using OpenAI’s text-davinci-003 data. Another LLaMA-model Vicuna, a 13-billion parameter model, was trained on fine-tuned data from a LLaMA base model using conversations gathered from ShareGPT as well.