FiddleCube: Generate Q&A to test your LLM

FiddleCube offers a tool to automatically generate question-answer datasets for testing and evaluating LLMs. It addresses the challenge of creating and maintaining such datasets, especially with frequent updates to prompts and RAG contexts. The tool generates diverse question types and filters for quality. The provided code snippet and API key link facilitate easy use.

• •Automates Q&A dataset generation for LLM testing.
• •Addresses the need for dataset updates with prompt/RAG changes.
• •Generates diverse question types.
• •Includes filtering for quality.