Calibration Game

Get better at identifying hallucination in LLMs.


The Calibration Game is a tool designed for research and educational purposes to help individuals improve their ability to identify hallucinations in language models (LLMs). The game involves assessing your confidence in the accuracy of LLM responses to various questions or prompts. A rating of 0 indicates certainty that the response will be incorrect, while a rating of 1 indicates certainty in an accurate response. At the end of the game, players receive a calibration score based on how accurately their confidence ratings aligned with LLM performance across all prompts. A perfect score means that predictions were precisely aligned with actual accuracy, and a score of 0 is considered best possible.

Share on FacebookShare on TwitterShare on LinkedIn
Calibration Game
and other useful AI tools on Daily Zaps
Daily Zaps A.I. Hub

Explore Similar AI Tools

Copyright 2023. All Rights Reserved