# llm-evaluation

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

promptfooは、AIアプリ（ChatGPTのようなAIを使ったサービス）の品質チェックとセキュリティ検査を自動化するツールです。「この質問をしたらAIが正しく答えるか？」「悪意ある入力で情報が漏れないか？」といったテストを、設定ファイ

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.