Klarity: Open-source tool for analyzing uncertainty in LLM output

Klarity is an open-source tool designed to analyze uncertainty and decision-making in Large Language Model (LLM) token generation. It provides real-time analysis, combining log probabilities and semantic understanding, and outputs structured JSON with insights. It supports Hugging Face transformers and is tested with Qwen2.5 models. The tool aims to help users understand and debug LLM behavior by providing insights into uncertainty and risk areas during text generation.