Agenta
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM obser
Rating
Votes
0
score
Downloads
0
total
Price
Free
No login needed
Works With
About
The Open-source LLMOps Platform Build reliable LLM applications faster with integrated prompt management, evaluation, and observability.
Documentation • Website • Agenta Cloud
What is Agenta?
Agenta is a platform for building production-grade LLM applications. It helps engineering and product teams create reliable LLM apps faster through integrated prompt management, evaluation, and observability.
Core Features
🧪 Prompt Management & Prompt Engineering
Collaborate with Subject Matter Experts (SMEs) on prompt engineering and make sure nothing breaks in production.
- Interactive LLM Playground: Compare prompts side by side against your test cases
- Multi-Model Support: Experiment with 50+ LLM models or bring-your-own models
- Version Control: Version prompts and configurations with branching and environments
- Complex Configurations: Enable SMEs to collaborate on complex configuration schemas beyond simple prompts
📊 LLM Evaluation
Evaluate your LLM applications systematically with both human and automated feedback.
- Flexible Testsets: Create testcases from production data, playground experiments, or upload CSVs
- Pre-built and Custom Evaluators: Use LLM-as-judge, one of our 20+ pre-built evaluators, or your custom evaluators
- UI and API Access: Run evaluations via UI (for SMEs) or programmatically (for engineers)
- Human Feedback Integration: Collect and incorporate expert annotations
Explore evaluation frameworks →
📡 LLM Observability
Get visibility into your LLM applications in production.
- Cost & Performance Tracking: Monitor spending, latency, and usage patterns
- LLM Tracing: Debug complex workflows with detailed traces
- Open Standards: OpenTelemetry native tracing compatible with OpenLLMetry, and OpenInference
- Integrations: Comes with pre-built integrations for most models and frameworks
📸 Screenshots
🚀 Getting Started
Agenta Cloud (Recommended):
The easiest way to get started is through Agenta Cloud. Free tier available with no credit card required.
Don't lose this
Three weeks from now, you'll want Agenta again. Will you remember where to find it?
Save it to your library and the next time you need Agenta, it’s one tap away — from any AI app you use. Group it into a bench with the rest of the team for that kind of task and you can pull the whole stack at once.
⚡ Pro tip for geeks: add a-gnt 🤵🏻♂️ as a custom connector in Claude or a custom GPT in ChatGPT — one click and your library is right there in the chat. Or, if you’re in an editor, install the a-gnt MCP server and say “use my [bench name]” in Claude Code, Cursor, VS Code, or Windsurf.
a-gnt's Take
Our honest review
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM obser. Best for anyone looking to make their AI assistant more capable in devops & monitoring. It's completely free and works across most major AI apps. This one just landed in the catalog — worth trying while it's fresh.
Tips for getting started
Tap "Get" above, pick your AI app, and follow the steps. Most installs take under 30 seconds.
What's New
Imported from GitHub
Ratings & Reviews
0.0
out of 5
0 ratings
No reviews yet. Be the first to share your experience.