LLM hallucinations have forever been a thorn in the side of researchers and developers, remaining an unsolved problem. However, there’s hope now with a lot of new techniques emerging in the space, claiming to address this challenge to an extent. OpenAI function calling, Microsoft Guidance, and GrantSlatton’s patch for llama.cpp, alongside SudoLang, prlang and Jargon are some of the methods that enforce a context-free grammar or a JSON schema.
Out of all these techniques, LMQL by SRI Lab seems to be gaining the spotlight.Â
Keep reading with a 7-day free trial
Subscribe to Sector 6 | The Newsletter of AIM to keep reading this post and get 7 days of free access to the full post archives.