Opik is an open-source platform that helps you understand what your LLM application is doing, measure how well it’s working, and systematically make it better. Whether you’re building a chatbot, a RAG pipeline, or a multi-step agent, Opik gives you the tools to go from “it works on my laptop” to “it works reliably in production.”
Using Claude Code, Cursor, or VS Code Copilot? Install the Opik MCP server and drive your entire workspace from chat — read traces, score outputs, save prompts, and run experiments without opening the UI.
Opik records every LLM call, tool invocation, and agent step so you can inspect the full chain of events that led to any output. Add a few lines of code and you’ll have a complete log of every request and response.
When you spot a trace that looks wrong, turn it into a test case. Use Ollie to do this automatically (just describe what went wrong), or add test cases through the UI or SDK. Then run your test suite with Ollie or from the SDK to verify your fixes.
Over time, your test suite grows from real production failures, not hypothetical examples.
Set up online evaluation rules that automatically score incoming traces, and monitor feedback scores, latency, cost, and error rates from the project dashboard.
Get Opik running with your existing AI stack in minutes. Works with OpenAI, Anthropic, LangChain, and 50+ other providers and frameworks.
Connect Claude Code, Cursor, or VS Code Copilot directly to your Opik workspace. Read traces, score outputs, and run experiments from chat — no UI required.
Record every LLM call, tool invocation, and agent step. Debug failures, track token costs, and understand what your application is doing.
Score your application on hallucination, context recall, relevance, and more using automated LLM-as-a-judge and heuristic metrics.
Automatically generate and test better prompts for every step in your agent using six optimization algorithms.
Store and version your prompts, compare results in the Prompt Playground, and experiment with different models.
Deploy on your own infrastructure with Docker locally or Kubernetes at scale. Full control over your data.
All Opik versions (cloud, open source, and enterprise) include the full AI engineering feature set and run on the Comet platform, with proven performance at scale supporting many of the world’s largest organizations.