While Elon Musk has kept his promise of open sourcing Grok, the developer community is reacting with mixed feelings. There are questions on his motives behind releasing it and concerns regarding the nature of this open-source initiative, as it lacks the training dataset and detailed methodologies.
In a recent blog, xAI announced the launch of the base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. “This means that the model is not fine-tuned for any specific application, such as dialogue,” read the post.
“We should just call it open-weight models at this point,” said a user named Swalsh on HackerNews. While the models’ weights (the parameters developed during the training process) are made available, there is a lack of transparency regarding the training data.
