Post
2777
Do chatbots lie about Céline Dion? We now have answers, not speculation.
Ai2 just released OLMoTrace and it's a game-changer for transparency. You can literally see where an AI's responses come from in its training data - in real time.
The demo shows results about Céline. So I tried it out myself! Watch what happens in the video.
For journalists, researchers studying hallucinations and anyone who needs to trust their AI, this is like getting X-ray vision into AI systems. When the model made claims, I could instantly verify them against original sources. When it hallucinated, I could see why.
You can finally 1) understand how LLMs actually work and 2) verify if what they're saying is true. No more blind trust.
This pushes the open data movement to the next level.
👉 Blog post: https://allenai.org/blog/olmotrace
👉 Paper: https://www.datocms-assets.com/64837/1743890415-olmotrace.pdf
P.S.: A word of caution: never use a chatbot as a knowledge base. It's not Google. Better use it with a connection to the internet.
Ai2 just released OLMoTrace and it's a game-changer for transparency. You can literally see where an AI's responses come from in its training data - in real time.
The demo shows results about Céline. So I tried it out myself! Watch what happens in the video.
For journalists, researchers studying hallucinations and anyone who needs to trust their AI, this is like getting X-ray vision into AI systems. When the model made claims, I could instantly verify them against original sources. When it hallucinated, I could see why.
You can finally 1) understand how LLMs actually work and 2) verify if what they're saying is true. No more blind trust.
This pushes the open data movement to the next level.
👉 Blog post: https://allenai.org/blog/olmotrace
👉 Paper: https://www.datocms-assets.com/64837/1743890415-olmotrace.pdf
P.S.: A word of caution: never use a chatbot as a knowledge base. It's not Google. Better use it with a connection to the internet.
