LLM Hallucinations 🤦

LLM hallucinations have forever been a thorn in the side of researchers and developers, remaining an unsolved problem. However, there’s hope now with a lot of new techniques emerging in the space, claiming to address this challenge to an extent. OpenAI function calling, Microsoft Guidance, and GrantSlatton’s patch for llama.cpp, alongside SudoLang, prlang and Jargon are some of the methods that enforce a context-free grammar or a JSON schema.

Out of all these techniques, LMQL by SRI Lab seems to be gaining the spotlight.