Clear ×

Llm eval

5 repositories found

Arize-ai

Arize-ai

phoenix
Python AI analysis

Phoenix is an AI observability and evaluation platform built for monitoring, evaluating, and debugging LLM applications and AI agents. It serves data...

Production ready Niche use case
agents ai-monitoring ai-observability
10.5k
974
661
105/wk
active
8/10 AI & ML
promptfoo

promptfoo

promptfoo
TypeScript AI analysis

Promptfoo is a CLI and library for evaluating, testing, and red-teaming LLM applications, enabling users to compare model performance across multiple...

Production ready Beginner friendly
ci ci-cd cicd
23.1k
2.1k
417
205/wk +52 yesterday
active
8/10 AI & ML
Giskard-AI

Giskard-AI

giskard-oss
Python AI analysis

Giskard is an open-source Python library for testing, evaluating, and red-teaming agentic AI systems. It specializes in dynamic multi-turn agent...

Production ready Niche use case
agent-evaluation ai-red-team ai-security
5.5k
484
71
19/wk
active
8/10 AI & ML
truera

truera

trulens
Python AI analysis

TruLens is a specialized evaluation and tracking platform for LLM applications and AI agents, designed to systematically assess performance through...

Production ready Niche use case
agent-evaluation agentops ai-agents
3.4k
309
103
recent
8/10 AI & ML
AI-QL

AI-QL

tuui
TypeScript AI analysis

TUUI is a desktop application providing a local Model Context Protocol (MCP) client for orchestrating multiple LLM APIs (Claude, OpenAI, DeepSeek,...

Production ready Single maintainer Niche use case
agent agentic-ai ai
1.2k
105
2
slow
7/10 AI & ML