# Opik Documentation

## Docs

- [Home](https://www.comet.com/docs/opik.mdx): Build, test, and optimize GenAI apps from prototype to production. Comprehensive tracing, evaluation, and prompt optimization for RAG, agents, and more.
- [Quickstart](https://www.comet.com/docs/opik/quickstart.mdx): Integrate Opik with your LLM application to log calls and chains efficiently. Get started with our step-by-step guide.
- [Quickstart notebook](https://www.comet.com/docs/opik/quickstart_notebook.mdx): Learn to automate LLM workflow evaluation and track calls with Opik using Chain of Density Summarization for Arxiv papers.
- [Roadmap](https://www.comet.com/docs/opik/roadmap.mdx): Explore Opik's evolving roadmap and contribute ideas to enhance our open-source project as we develop new features and improve functionality.
- [FAQ](https://www.comet.com/docs/opik/faq.mdx): Explore common questions about Opik, learn how to get started, and find assistance to enhance your experience with our powerful tool.
- [Tracing Core Concepts](https://www.comet.com/docs/opik/tracing/concepts.mdx): Learn about the core concepts of Opik's tracing system, including traces, spans, threads, and how they work together to provide comprehensive observability for your LLM applications.
- [Log traces](https://www.comet.com/docs/opik/tracing/log_traces.mdx): Monitor the flow of your LLM applications with tracing to identify issues and optimize performance using Opik's powerful tools.
- [Log conversations](https://www.comet.com/docs/opik/tracing/log_chat_conversations.mdx): Capture and analyze chat conversations on Opik, enabling better tracking of user interactions and improving chatbot performance.
- [Log user feedback](https://www.comet.com/docs/opik/tracing/annotate_traces.mdx): Capture user feedback and track performance metrics to enhance your agent's effectiveness with Opik's logging capabilities.
- [Log media & attachments](https://www.comet.com/docs/opik/tracing/log_multimodal_traces.mdx): Capture multimodal traces in Opik by logging images, videos, and audio files using the Python SDK's Attachment type.
- [Cost tracking](https://www.comet.com/docs/opik/tracing/cost_tracking.mdx): Monitor and analyze cost patterns in your LLM apps using Opik's dashboard to identify anomalies and optimize spending.
- [Export by SDK, REST, and UI](https://www.comet.com/docs/opik/tracing/export_data.mdx): Learn to export traces and spans using Opik SDK, REST, and UI for enhanced model tuning and deeper analysis.
- [Import/Export by command line](https://www.comet.com/docs/opik/tracing/import_export_commands.mdx): Learn to export, import, migrate, and backup project data using Opik's command line tools efficiently.
- [✨ Opik Assist (Beta)](https://www.comet.com/docs/opik/tracing/opik_assist.mdx): AI-powered trace analysis and debugging assistant for your LLM applications
- [SDK configuration](https://www.comet.com/docs/opik/tracing/sdk_configuration.mdx): Configure Python and TypeScript SDKs effectively. Set up your API key and instance URL for seamless routing and authentication.
- [Log Agent Graphs](https://www.comet.com/docs/opik/tracing/log_agent_graphs.mdx): Learn to log agent execution graphs in Opik for enhanced debugging and flow visualization across frameworks like LangGraph and Google ADK.
- [Log distributed traces](https://www.comet.com/docs/opik/tracing/log_distributed_traces.mdx): Learn to track distributed traces in complex LLM applications using Opik's built-in support for multi-service tracing.
- [Offline fallback and message replay](https://www.comet.com/docs/opik/tracing/offline_fallback.mdx): Keep your tracing data intact during network outages with Opik's offline fallback. Learn how failed messages are automatically stored and replayed when connectivity is restored.
- [Overview](https://www.comet.com/docs/opik/evaluation/overview.mdx): Evaluate the quality of LLM outputs using Opik's framework to systematically test prompts and models against datasets with pre-built metrics.
- [Concepts](https://www.comet.com/docs/opik/evaluation/concepts.mdx): Learn to streamline evaluation of LLM applications with Opik for faster iterations and enhanced output review.
- [Manage datasets](https://www.comet.com/docs/opik/evaluation/manage_datasets.mdx): Evaluate your LLM using datasets. Learn to create and manage them via Python SDK, TypeScript SDK, or the Traces table.
- [Evaluate single prompts](https://www.comet.com/docs/opik/evaluation/evaluate_prompt.mdx): Evaluate and compare prompt performance in Opik using the playground or Python SDK to enhance your prompt engineering process.
- [Evaluate your agent](https://www.comet.com/docs/opik/evaluation/evaluate_your_llm.mdx): Evaluate your LLM applications confidently. Learn the five steps to assess complex LLM chains or agents effectively.
- [Evaluate agent trajectories](https://www.comet.com/docs/opik/evaluation/evaluate_agent_trajectory.mdx): Evaluate agent trajectories to optimize tool selection and reasoning paths, ensuring efficient agent behavior before production with Opik.
- [Evaluate multimodal traces](https://www.comet.com/docs/opik/evaluation/evaluate_multimodal.mdx): Evaluate multimodal prompts with Opik. Learn to run experiments in the UI or SDK, customize models, and understand image input support.
- [Evaluate multi-turn agents](https://www.comet.com/docs/opik/evaluation/evaluate_multi_turn_agents.mdx): Learn to evaluate multi-turn agents using simulation techniques to enhance chatbot performance and improve user interactions.
- [Manually logging experiments](https://www.comet.com/docs/opik/evaluation/log_experiments_with_rest_api.mdx): Evaluate your LLM application by logging pre-computed experiments and boosting confidence in performance with this detailed guide.
- [Re-running an existing experiment](https://www.comet.com/docs/opik/evaluation/update_existing_experiment.mdx): Learn how to update existing experiments in Opik by changing names, configurations, and scores effectively.
- [Annotation Queues](https://www.comet.com/docs/opik/evaluation/annotation_queues.mdx): Optimize your AI projects by enabling SMEs to efficiently review and annotate outputs using Opik's intuitive Annotation Queues feature.
- [Overview](https://www.comet.com/docs/opik/evaluation/metrics/overview.mdx): Describes all the built-in evaluation metrics provided by Opik
- [Heuristic metrics](https://www.comet.com/docs/opik/evaluation/metrics/heuristic_metrics.mdx): Describes all the built-in heuristic metrics provided by Opik
- [Hallucination](https://www.comet.com/docs/opik/evaluation/metrics/hallucination.mdx): Describes the Hallucination metric
- [LLM Juries](https://www.comet.com/docs/opik/evaluation/metrics/llm_juries.mdx): Combine multiple judges into an ensemble with LLMJuriesJudge
- [G-Eval](https://www.comet.com/docs/opik/evaluation/metrics/g_eval.mdx): Describes Opik's built-in G-Eval metric which is a task agnostic LLM as a Judge metric
- [Compliance risk](https://www.comet.com/docs/opik/evaluation/metrics/compliance_risk.mdx): Flag non-compliant or high-risk assistant replies with ComplianceRiskJudge
- [Prompt uncertainty](https://www.comet.com/docs/opik/evaluation/metrics/prompt_diagnostics.mdx): Estimate prompt ambiguity with PromptUncertaintyJudge
- [Moderation](https://www.comet.com/docs/opik/evaluation/metrics/moderation.mdx): Describes the Moderation metric
- [Meaning Match](https://www.comet.com/docs/opik/evaluation/metrics/meaning_match.mdx): Describes the Meaning Match metric
- [Usefulness](https://www.comet.com/docs/opik/evaluation/metrics/usefulness.mdx): Describes the Usefulness metric
- [Summarization consistency](https://www.comet.com/docs/opik/evaluation/metrics/summarization_consistency.mdx): Ensure autogenerated summaries stay faithful to the source content
- [Summarization coherence](https://www.comet.com/docs/opik/evaluation/metrics/summarization_coherence.mdx): Rate how readable and well-structured a summary is with SummarizationCoherenceJudge
- [Dialogue helpfulness](https://www.comet.com/docs/opik/evaluation/metrics/dialogue_helpfulness.mdx): Measure how helpful an assistant reply is within a dialogue
- [Answer relevance](https://www.comet.com/docs/opik/evaluation/metrics/answer_relevance.mdx): Describes the Answer Relevance metric
- [Context precision](https://www.comet.com/docs/opik/evaluation/metrics/context_precision.mdx): Describes the Context Precision metric
- [Context recall](https://www.comet.com/docs/opik/evaluation/metrics/context_recall.mdx): Describes the Context Recall metric
- [Trajectory accuracy](https://www.comet.com/docs/opik/evaluation/metrics/trajectory_accuracy.mdx): Score whether an agent followed the expected action path
- [Agent task completion](https://www.comet.com/docs/opik/evaluation/metrics/agent_task_completion.mdx): Verify whether an agent fulfilled its assigned objective
- [Agent tool correctness](https://www.comet.com/docs/opik/evaluation/metrics/agent_tool_correctness.mdx): Evaluate whether an agent invoked and interpreted tools correctly
- [Conversational metrics](https://www.comet.com/docs/opik/evaluation/metrics/conversation_threads_metrics.mdx): Describes metrics related to scoring the conversational threads
- [Custom model](https://www.comet.com/docs/opik/evaluation/metrics/custom_model.mdx): Describes how to use a custom model for Opik's built-in LLM as a Judge metrics
- [Advanced configuration](https://www.comet.com/docs/opik/evaluation/metrics/advanced_configuration.mdx): Fine-tune Opik metrics with async scoring, evaluator temperatures, and logprob handling
- [Custom metric](https://www.comet.com/docs/opik/evaluation/metrics/custom_metric.mdx): Describes how to create your own metric to use with Opik's evaluation platform
- [Custom conversation metric](https://www.comet.com/docs/opik/evaluation/metrics/custom_conversation_metric.mdx): Learn how to create custom metrics for evaluating multi-turn conversations
- [Task span metrics](https://www.comet.com/docs/opik/evaluation/metrics/task_span_metrics.mdx): Learn how to create task span metrics for evaluating the detailed execution information of your LLM tasks
- [Best practices for evaluating agents](https://www.comet.com/docs/opik/evaluation/evaluate_agents.mdx): Learn best practices for evaluating AI agents, ensuring reliability and scalability throughout their lifecycle with Opik's guidance.
- [Evaluate threads](https://www.comet.com/docs/opik/evaluation/evaluate_threads.mdx): Evaluate and optimize conversation threads in Opik using the evaluate_threads function in the Python SDK for enhanced multi-turn conversations.
- [Cookbook - Evaluate hallucination metric](https://www.comet.com/docs/opik/evaluation/evaluate_hallucination_metric.mdx): Learn to evaluate the Hallucination metric using the LLM Evaluation SDK and improve your model's performance with Opik.
- [Cookbook - Evaluate moderation metric](https://www.comet.com/docs/opik/evaluation/evaluate_moderation_metric.mdx): Evaluate the Moderation metric in the LLM Evaluation SDK to enhance your moderation capabilities using Opik's platform.
- [Prompt management](https://www.comet.com/docs/opik/prompt_engineering/prompt_management.mdx): Learn to utilize Opik's prompt library for versioning, reusing, and managing your prompts centrally across projects.
- [Prompt Playground](https://www.comet.com/docs/opik/prompt_engineering/playground.mdx): Experiment with LLM prompts in Opik's playground to evaluate performance and enhance your prompt engineering skills.
- [Prompt Generator and Improver](https://www.comet.com/docs/opik/prompt_engineering/improve.mdx): Enhance your prompt quality using Opik's AI tools for efficient prompt generation and refinement based on expert engineering strategies.
- [Opik's MCP server](https://www.comet.com/docs/opik/prompt_engineering/mcp_server.mdx): Configure Opik's MCP server with Cursor IDE to manage prompts and analyze traces efficiently.
- [Pytest integration](https://www.comet.com/docs/opik/testing/pytest_integration.mdx): Monitor your LLM applications' performance by using Opik's Pytest integration to track test results and ensure reliability before deployment.
- [Production monitoring](https://www.comet.com/docs/opik/production/production_monitoring.mdx): Monitor your production LLM applications with Opik. Evaluate feedback scores, trace counts, and token usage daily and hourly for optimal insights.
- [Online Evaluation rules](https://www.comet.com/docs/opik/production/rules.mdx): Evaluate production LLM performance with Opik's automated metrics to efficiently score traces and identify issues.
- [Gateway](https://www.comet.com/docs/opik/production/gateway.mdx): Build a centralized LLM gateway with Opik to streamline access to multiple LLM providers using a consistent API format.
- [Guardrails](https://www.comet.com/docs/opik/production/guardrails.mdx): Monitor your LLM calls with guardrails in Opik to prevent risks and ensure safe application outputs.
- [Anonymizers](https://www.comet.com/docs/opik/production/anonymizers.mdx): Protect sensitive information in your LLM applications with Opik's Anonymizers, ensuring compliance and preventing accidental data exposure.
- [Alerts](https://www.comet.com/docs/opik/production/alerts.mdx): Configure automated webhook notifications to stay informed about events in your Opik workspace, from trace errors to feedback scores and prompt changes.
- [Dashboards](https://www.comet.com/docs/opik/production/dashboards.mdx): Create customizable dashboards to monitor quality, cost, and performance of your LLM projects and visualize experiment results.
- [Overview](https://www.comet.com/docs/opik/administration/overview.mdx): Learn how to manage users, workspaces, roles, and authentication settings in Opik for your organization.
- [Roles and Permissions](https://www.comet.com/docs/opik/administration/roles_and_permissions.mdx): Learn how to configure workspace roles and permissions in Opik for fine-grained access control.
- [Overview](https://www.comet.com/docs/opik/administration/workspace-settings/overview.mdx): Configure workspace-level settings including feedback definitions, AI providers, preferences, and member management in Opik.
- [Feedback Definitions](https://www.comet.com/docs/opik/administration/workspace-settings/feedback_definitions.mdx): Configure custom feedback types for evaluating LLM outputs
- [AI Providers](https://www.comet.com/docs/opik/administration/workspace-settings/ai_providers.mdx): Configure connections to Large Language Model providers
- [Workspace Preferences](https://www.comet.com/docs/opik/administration/workspace-settings/workspace_preferences.mdx): Configure workspace-wide preferences including thread timeout and data truncation settings in Opik.
- [Workspace Members](https://www.comet.com/docs/opik/administration/workspace-settings/workspace_members.mdx): Manage workspace members, invite users, and control workspace access in Opik.
- [Admin Dashboard](https://www.comet.com/docs/opik/administration/admin-dashboard/overview.mdx): Learn how to access and navigate the Opik admin dashboard to manage your organization settings.
- [Workspaces](https://www.comet.com/docs/opik/administration/admin-dashboard/workspaces.mdx): Learn how to create, manage, and configure workspaces within your Opik organization.
- [Users](https://www.comet.com/docs/opik/administration/admin-dashboard/users.mdx): Learn how to manage users and organization roles in your Opik organization.
- [Organization Settings](https://www.comet.com/docs/opik/administration/admin-dashboard/organization_settings.mdx): Configure organization-wide settings in Opik.
- [Service Accounts](https://www.comet.com/docs/opik/administration/admin-dashboard/service_accounts.mdx): Learn how to create and manage service accounts for programmatic API access to your Opik organization.
- [Authentication Overview](https://www.comet.com/docs/opik/administration/authentication/overview.mdx): Learn about the authentication options available in Opik, including SAML, OIDC, and JWT, and choose the right one for your organization.
- [SAML SSO](https://www.comet.com/docs/opik/administration/authentication/saml.mdx): Learn how to configure SAML-based single sign-on for your Opik organization with enterprise identity providers.
- [OIDC SSO](https://www.comet.com/docs/opik/administration/authentication/oidc.mdx): Learn how to configure OpenID Connect (OIDC) single sign-on for your Opik organization.
- [JWT Authentication](https://www.comet.com/docs/opik/administration/authentication/jwt.mdx): Learn how to configure JWT-based authentication for programmatic access to your Opik organization.
- [Contribution Overview](https://www.comet.com/docs/opik/contributing/overview.mdx): Contribute to Opik by submitting bug reports, suggesting features, or improving documentation to enhance the project for everyone.
- [Documentation](https://www.comet.com/docs/opik/contributing/guides/documentation.mdx): Learn how to contribute effectively to Opik's documentation, including guidelines and structure for seamless collaboration.
- [Local Development Setup](https://www.comet.com/docs/opik/contributing/guides/local-development.mdx): Comprehensive guide for setting up and running Opik locally for development
- [Python SDK](https://www.comet.com/docs/opik/contributing/guides/python-sdk.mdx): Learn how to contribute to the Opik Python SDK, enabling seamless integration for developers in their Python applications.
- [TypeScript SDK](https://www.comet.com/docs/opik/contributing/guides/typescript-sdk.mdx): Learn how to contribute effectively to the Opik TypeScript SDK by reviewing guidelines and project structure.
- [Opik Optimizer](https://www.comet.com/docs/opik/contributing/guides/agent-optimizer-sdk.mdx): Contribute effectively to the Agent Optimizer SDK and enhance model performance. Start optimizing prompts with our detailed guide.
- [Frontend](https://www.comet.com/docs/opik/contributing/guides/frontend.mdx): Learn how to contribute to the Opik frontend project by reviewing guidelines and project structure for effective collaboration.
- [Backend](https://www.comet.com/docs/opik/contributing/guides/backend.mdx): Learn how to contribute to the Opik backend, enhancing data handling and API functionality in this Java application.
- [Bounty Program](https://www.comet.com/docs/opik/contributing/developer-programs/bounties.mdx): Participate in the Opik Bounty Program to enhance the platform, showcase your skills, and earn rewards for your contributions.
- [Overview](https://www.comet.com/docs/opik/integrations/overview.mdx): Explore how to log, visualize, and evaluate LLM calls and RAG pipelines using Opik's robust integrations with popular frameworks.
- [Observability for BeeAI (TypeScript) with Opik](https://www.comet.com/docs/opik/integrations/beeai-typescript.mdx): Start here to integrate Opik into your BeeAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LangChain (JavaScript) with Opik](https://www.comet.com/docs/opik/integrations/langchainjs.mdx): Start here to integrate Opik into your LangChain-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Mastra with Opik](https://www.comet.com/docs/opik/integrations/mastra.mdx): Start here to integrate Opik into your Mastra-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Vercel AI SDK with Opik](https://www.comet.com/docs/opik/integrations/vercel-ai-sdk.mdx): Start here to integrate Opik into your Vercel AI SDK-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Cloudflare Workers AI with Opik](https://www.comet.com/docs/opik/integrations/cloudflare-workers-ai.mdx): Start here to integrate Opik into your Cloudflare Workers AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Google Gemini (TypeScript) with Opik](https://www.comet.com/docs/opik/integrations/gemini-typescript.mdx): Start here to integrate Opik into your Google Gemini-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenAI (TypeScript) with Opik](https://www.comet.com/docs/opik/integrations/openai-typescript.mdx): Start here to integrate Opik into your OpenAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Opik TypeScript SDK](https://www.comet.com/docs/opik/integrations/typescript-sdk.mdx): Monitor and debug your JavaScript/TypeScript apps with Opik's SDK, enabling seamless integration for LLM applications and AI workflows.
- [Observability for AG2 with Opik](https://www.comet.com/docs/opik/integrations/ag2.mdx): Start here to integrate Opik into your AG2-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Agent Spec with Opik](https://www.comet.com/docs/opik/integrations/agentspec.mdx): Start here to integrate Opik into your Agent Spec-based application for end-to-end observability, unit testing, and optimization.
- [Observability for Agno with Opik](https://www.comet.com/docs/opik/integrations/agno.mdx): Start here to integrate Opik into your Agno-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for BeeAI (Python) with Opik](https://www.comet.com/docs/opik/integrations/beeai.mdx): Start here to integrate Opik into your BeeAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Claude Agent SDK with Opik](https://www.comet.com/docs/opik/integrations/claude-agent-sdk.mdx): Configure Claude Code telemetry and OTLP export settings with clear signal and compatibility expectations for Opik.
- [Observability for AutoGen with Opik](https://www.comet.com/docs/opik/integrations/autogen.mdx): Start here to integrate Opik into your AutoGen-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for CrewAI with Opik](https://www.comet.com/docs/opik/integrations/crewai.mdx): Start here to integrate Opik into your CrewAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for DSPy with Opik](https://www.comet.com/docs/opik/integrations/dspy.mdx): Start here to integrate Opik into your DSPy-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Google Agent Development Kit (Python) with Opik](https://www.comet.com/docs/opik/integrations/adk.mdx): Start here to integrate Opik into your Google Agent Development Kit-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Haystack with Opik](https://www.comet.com/docs/opik/integrations/haystack.mdx): Start here to integrate Opik into your Haystack-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Harbor with Opik](https://www.comet.com/docs/opik/integrations/harbor.mdx): Start here to integrate Opik into your Harbor benchmark evaluation runs for end-to-end agent observability and analysis.
- [Structured Output Tracking for Instructor with Opik](https://www.comet.com/docs/opik/integrations/instructor.mdx): Start here to integrate Opik into your Instructor-based genai application for structured output tracking, schema validation monitoring, and LLM call observability.
- [Observability for LangChain (Python) with Opik](https://www.comet.com/docs/opik/integrations/langchain.mdx): Start here to integrate Opik into your LangChain-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LangGraph with Opik](https://www.comet.com/docs/opik/integrations/langgraph.mdx): Start here to integrate Opik into your LangGraph-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LangServe with Opik](https://www.comet.com/docs/opik/integrations/langserve.mdx): Configure LangServe host-level OpenTelemetry export for Opik with clear applicability and minimal setup guidance.
- [Observability for LiveKit with Opik](https://www.comet.com/docs/opik/integrations/livekit.mdx): Start here to integrate Opik into your LiveKit-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for LlamaIndex with Opik](https://www.comet.com/docs/opik/integrations/llama_index.mdx): Start here to integrate Opik into your LlamaIndex-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Microsoft Agent Framework (Python) with Opik](https://www.comet.com/docs/opik/integrations/microsoft-agent-framework.mdx): Start here to integrate Opik into your Microsoft Agent Framework-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenAI Agents with Opik](https://www.comet.com/docs/opik/integrations/openai_agents.mdx): Start here to integrate Opik into your OpenAI Agents-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Pipecat with Opik](https://www.comet.com/docs/opik/integrations/pipecat.mdx): Start here to integrate Opik into your Pipecat-based real-time voice agent application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Pydantic AI with Opik](https://www.comet.com/docs/opik/integrations/pydantic-ai.mdx): Start here to integrate Opik into your Pydantic AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Semantic Kernel (Python) with Opik](https://www.comet.com/docs/opik/integrations/semantic-kernel.mdx): Start here to integrate Opik into your Semantic Kernel-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Smolagents with Opik](https://www.comet.com/docs/opik/integrations/smolagents.mdx): Start here to integrate Opik into your Smolagents-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Strands Agents with Opik](https://www.comet.com/docs/opik/integrations/strands-agents.mdx): Start here to integrate Opik into your Strands Agents-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Temporal with Opik](https://www.comet.com/docs/opik/integrations/temporal.mdx): Configure Temporal Python OpenTelemetry tracing and export to Opik.
- [Observability for VoltAgent with Opik](https://www.comet.com/docs/opik/integrations/voltagent.mdx): Start here to integrate Opik into your VoltAgent-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Anthropic with Opik](https://www.comet.com/docs/opik/integrations/anthropic.mdx): Start here to integrate Opik into your Anthropic-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for AWS Bedrock with Opik](https://www.comet.com/docs/opik/integrations/bedrock.mdx): Start here to integrate Opik into your AWS Bedrock-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for BytePlus with Opik](https://www.comet.com/docs/opik/integrations/byteplus.mdx): Start here to integrate Opik into your BytePlus-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Cohere with Opik](https://www.comet.com/docs/opik/integrations/cohere.mdx): Start here to integrate Opik into your Cohere-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for DeepSeek with Opik](https://www.comet.com/docs/opik/integrations/deepseek.mdx): Start here to integrate Opik into your DeepSeek-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Fireworks AI with Opik](https://www.comet.com/docs/opik/integrations/fireworks-ai.mdx): Start here to integrate Opik into your Fireworks AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Google Gemini (Python) with Opik](https://www.comet.com/docs/opik/integrations/gemini.mdx): Start here to integrate Opik into your Google Gemini-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Groq with Opik](https://www.comet.com/docs/opik/integrations/groq.mdx): Start here to integrate Opik into your Groq-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Mistral AI with Opik](https://www.comet.com/docs/opik/integrations/mistral.mdx): Start here to integrate Opik into your Mistral AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Novita AI with Opik](https://www.comet.com/docs/opik/integrations/novita-ai.mdx): Start here to integrate Opik into your Novita AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Ollama with Opik](https://www.comet.com/docs/opik/integrations/ollama.mdx): Start here to integrate Opik into your Ollama-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenAI (Python) with Opik](https://www.comet.com/docs/opik/integrations/openai.mdx): Start here to integrate Opik into your OpenAI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Predibase with Opik](https://www.comet.com/docs/opik/integrations/predibase.mdx): Start here to integrate Opik into your Predibase-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Together AI with Opik](https://www.comet.com/docs/opik/integrations/together-ai.mdx): Start here to integrate Opik into your Together AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for IBM watsonx with Opik](https://www.comet.com/docs/opik/integrations/watsonx.mdx): Start here to integrate Opik into your IBM watsonx-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for xAI Grok with Opik](https://www.comet.com/docs/opik/integrations/xai-grok.mdx): Start here to integrate Opik into your xAI Grok-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Gretel with Opik](https://www.comet.com/docs/opik/integrations/gretel.mdx): Start here to integrate Opik into your Gretel-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Hugging Face Datasets with Opik](https://www.comet.com/docs/opik/integrations/huggingface-datasets.mdx): Start here to integrate Opik with Hugging Face Datasets for end-to-end LLM observability, unit testing, and optimization.
- [Evaluate LLM Applications with Ragas Metrics in Opik](https://www.comet.com/docs/opik/integrations/ragas.mdx): Use Ragas evaluation metrics to assess your LLM application quality and automatically track results in Opik for comprehensive performance monitoring.
- [Observability for Opik LLM Gateway with Opik](https://www.comet.com/docs/opik/integrations/opik-llm-gateway.mdx): Start here to integrate Opik LLM Gateway into your genai application for centralized LLM provider access using a consistent API format.
- [Observability for Kong AI Gateway with Opik](https://www.comet.com/docs/opik/integrations/kong-ai-gateway.mdx): Start here to integrate Kong AI Gateway with Opik for production-ready LLM gateway capabilities with enterprise features.
- [Observability for AISuite with Opik](https://www.comet.com/docs/opik/integrations/aisuite.mdx): Start here to integrate Opik into your AISuite-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Anannas AI with Opik](https://www.comet.com/docs/opik/integrations/anannas.mdx): Start here to integrate Opik into your Anannas AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Helicone with Opik](https://www.comet.com/docs/opik/integrations/helicone.mdx): Learn how to integrate Helicone with Opik to log and monitor your LLM traffic using the standard Helicone integration setup.
- [Observability for LiteLLM with Opik](https://www.comet.com/docs/opik/integrations/litellm.mdx): Start here to integrate Opik into your LiteLLM-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for OpenRouter with Opik](https://www.comet.com/docs/opik/integrations/openrouter.mdx): Start here to integrate Opik into your OpenRouter-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Portkey with Opik](https://www.comet.com/docs/opik/integrations/portkey.mdx): Start here to integrate Portkey with Opik for enterprise-grade LLM gateway capabilities with advanced routing and fallback features.
- [Observability for TrueFoundry with Opik](https://www.comet.com/docs/opik/integrations/truefoundry.mdx): Start here to integrate TrueFoundry with Opik for enterprise MLOps platform capabilities with LLM gateway features.
- [Observability for Vercel AI Gateway with Opik](https://www.comet.com/docs/opik/integrations/vercel-ai-gateway.mdx): Start here to integrate Vercel AI Gateway with Opik for unified access to multiple AI providers with edge-optimized performance.
- [Validation Tracking for Guardrails AI with Opik](https://www.comet.com/docs/opik/integrations/guardrails-ai.mdx): Start here to integrate Opik into your Guardrails AI-based genai application for validation tracking, compliance monitoring, and guard evaluation.
- [Overview](https://www.comet.com/docs/opik/integrations/python-sdk.mdx): Build powerful applications with Opik's Python SDK, enabling seamless integration and functionality for your projects.
- [OpenTelemetry Python SDK](https://www.comet.com/docs/opik/integrations/opentelemetry-python-sdk.mdx): Learn to instrument your Python applications with OpenTelemetry SDK to effectively send trace data to Opik for better observability.
- [Observability for Spring AI (Java) with Opik](https://www.comet.com/docs/opik/integrations/spring-ai.mdx): Start here to integrate Opik into your Spring AI-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Quarkus LangChain4j with Opik](https://www.comet.com/docs/opik/integrations/quarkus-langchain4j.mdx): Configure Quarkus LangChain4j OpenTelemetry export to send traces to Opik.
- [Observability for Microsoft Agent Framework (.NET) with Opik](https://www.comet.com/docs/opik/integrations/microsoft-agent-framework-dotnet.mdx): Start here to integrate Opik into your Microsoft Agent Framework-based .NET application for end-to-end LLM observability, unit testing, and optimization.
- [OpenTelemetry Ruby SDK](https://www.comet.com/docs/opik/integrations/opentelemetry-ruby-sdk.mdx): Configure OpenTelemetry SDK in your Ruby app to send telemetry data to Opik efficiently and enhance your observability.
- [Observability for Cursor with Opik](https://www.comet.com/docs/opik/integrations/cursor.mdx): Start here to integrate Opik into your Cursor-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Dify with Opik](https://www.comet.com/docs/opik/integrations/dify.mdx): Start here to integrate Opik into your Dify-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Flowise with Opik](https://www.comet.com/docs/opik/integrations/flowise.mdx): Start here to integrate Opik into your Flowise-based genai application for end-to-end LLM observability, unit testing, and optimization.
- [Observability for Langflow with Opik](https://www.comet.com/docs/opik/integrations/langflow.mdx): Start here to integrate Opik into your Langflow applications for end-to-end LLM observability.
- [Observability for n8n with Opik](https://www.comet.com/docs/opik/integrations/n8n.mdx): Start here to integrate Opik into your n8n-based workflow automation for end-to-end LLM observability.
- [Observability for OpenClaw with Opik](https://www.comet.com/docs/opik/integrations/openclaw.mdx): Install and configure the OpenClaw community plugin to export LLM, tool, and agent traces to Opik.
- [Observability for OpenAI Codex with Opik](https://www.comet.com/docs/opik/integrations/openai-codex.mdx): Configure OpenAI Codex OpenTelemetry export to send trace telemetry to Opik.
- [Observability for OpenWebUI with Opik](https://www.comet.com/docs/opik/integrations/openwebui.mdx): Start here to integrate Opik into your OpenWebUI-based AI application for end-to-end LLM observability and monitoring.
- [Observability for Prompt Flow with Opik](https://www.comet.com/docs/opik/integrations/prompt-flow.mdx): Configure Prompt Flow tracing with OpenTelemetry endpoint settings compatible with Opik deployment modes.
- [OpenTelemetry](https://www.comet.com/docs/opik/integrations/opentelemetry.mdx): Integrate OpenTelemetry SDKs with Opik to enhance your ML/AI apps with distributed tracing and streamline monitoring.
- [Agent Optimization](https://www.comet.com/docs/opik/agent_optimization/overview.mdx): Learn about Opik's automated LLM prompt and agent optimization SDK. Discover MetaPrompt, Few-shot Bayesian, and Evolutionary optimization algorithms for enhanced performance.
- [Optimization Studio](https://www.comet.com/docs/opik/agent_optimization/optimization_studio.mdx): Run prompt optimizations from the Opik UI with datasets, metrics, and visual progress tracking.
- [Quickstart](https://www.comet.com/docs/opik/agent_optimization/quickstart.mdx): Install the Agent Optimizer SDK, run your first optimization, and inspect the results in under 10 minutes.
- [Optimizer Introduction Cookbook](https://www.comet.com/docs/opik/agent_optimization/quickstart_notebook.mdx): Learn how to use Opik Agent Optimizer with the HotPotQA dataset through an interactive notebook, covering setup, configuration, and optimization techniques.
- [Optimizer Frequently Asked Questions](https://www.comet.com/docs/opik/agent_optimization/faq.mdx): Find answers to common questions about Opik Agent Optimizer, including optimizer selection, configuration, usage, and best practices.
- [Changelog](https://www.comet.com/docs/opik/agent_optimization/changelog.mdx): Release notes focused on Agent Optimizer features.
- [Known Issues](https://www.comet.com/docs/opik/agent_optimization/known_issues.mdx): Known runtime issues when running Opik Optimizer with current dependencies.
- [Opik Agent Optimizer Core Concepts](https://www.comet.com/docs/opik/agent_optimization/optimization/concepts.mdx): Learn about the core concepts of Opik Agent Optimizer, including key terms, evaluation processes, optimization workflows, and best practices for effective LLM optimization.
- [Configuring LLM Providers](https://www.comet.com/docs/opik/agent_optimization/optimization/configure_models.mdx): Learn how to configure different LLM providers like OpenAI, Anthropic, Gemini, Azure, and Ollama for use with the Opik Agent Optimizer.
- [Define datasets](https://www.comet.com/docs/opik/agent_optimization/optimization/define_datasets.mdx): Design, version, and validate datasets used for optimization runs.
- [Define metrics](https://www.comet.com/docs/opik/agent_optimization/optimization/define_metrics.mdx): Create reliable metrics and composite objectives for Agent Optimizer runs.
- [Optimize prompts](https://www.comet.com/docs/opik/agent_optimization/optimization/optimize_prompts.mdx): Pick the right optimizer, run experiments, and ship better prompts.
- [Optimize tools (MCP)](https://www.comet.com/docs/opik/agent_optimization/optimization/optimize_tools.mdx): Improve MCP tool and parameter descriptions without changing prompt text.
- [Optimize agents](https://www.comet.com/docs/opik/agent_optimization/optimization/optimize_agents.mdx): Connect the Agent Optimizer to Agent Frameworks.
- [Optimize multimodal prompts](https://www.comet.com/docs/opik/agent_optimization/optimization/optimize_multimodal.mdx): Run optimizations for prompts that combine text, images, and other modalities.
- [Dashboard results](https://www.comet.com/docs/opik/agent_optimization/optimization/dashboard_results.mdx): Analyze optimization trials, failure modes, and improvements inside Opik.
- [Optimization algorithms overview](https://www.comet.com/docs/opik/agent_optimization/algorithms/overview.mdx): Compare Agent Optimizer algorithms and pick the right one for your workload.
- [Optimizer benchmarks](https://www.comet.com/docs/opik/agent_optimization/algorithms/benchmarks.mdx): Compare algorithm performance across common datasets and learn how to run the benchmark suite locally.
- [MetaPrompt Optimizer](https://www.comet.com/docs/opik/agent_optimization/algorithms/metaprompt_optimizer.mdx): Learn how to use the MetaPrompt Optimizer to refine and improve your LLM prompts through systematic analysis and iterative refinement.
- [HRPO (Hierarchical Reflective Prompt Optimizer)](https://www.comet.com/docs/opik/agent_optimization/algorithms/hierarchical_adaptive_optimizer.mdx): Learn how to use HRPO (Hierarchical Reflective Prompt Optimizer) to improve prompts through systematic root cause analysis of failure modes and targeted refinement.
- [Few-Shot Bayesian Optimizer](https://www.comet.com/docs/opik/agent_optimization/algorithms/fewshot_bayesian_optimizer.mdx): Learn how to use the Few-Shot Bayesian Optimizer to find optimal few-shot examples for your chat-based prompts using Bayesian optimization techniques.
- [Evolutionary Optimizer: Genetic Algorithms](https://www.comet.com/docs/opik/agent_optimization/algorithms/evolutionary_optimizer.mdx): Learn how to use the Evolutionary Optimizer to discover optimal prompts through genetic algorithms, with support for multi-objective optimization and LLM-driven genetic operations.
- [GEPA Optimizer](https://www.comet.com/docs/opik/agent_optimization/algorithms/gepa_optimizer.mdx): Use the external GEPA package through Opik's `GepaOptimizer` to optimize a single system prompt for single-turn tasks with a reflection model.
- [Parameter Optimizer: Bayesian Parameter Tuning](https://www.comet.com/docs/opik/agent_optimization/algorithms/parameter_optimizer.mdx): Learn how to use the Parameter Optimizer to find optimal LLM call parameters (temperature, top_p, etc.) using Bayesian optimization without changing your prompt.
- [Tool Optimization (MCP & Function Calling)](https://www.comet.com/docs/opik/agent_optimization/algorithms/tool_optimization.mdx): Learn how to optimize prompts that leverage MCP (Model Context Protocol) tools and function calling capabilities across supported optimizers.
- [Optimizer Introduction Cookbook](https://www.comet.com/docs/opik/agent_optimization/quickstart_notebook.mdx): Learn how to use Opik Agent Optimizer with the HotPotQA dataset through an interactive notebook, covering setup, configuration, and optimization techniques.
- [Synthetic Data Optimizer Cookbook](https://www.comet.com/docs/opik/agent_optimization/cookbooks/synthetic_data_optimizer_cookbook.mdx): Learn how to generate synthetic Q&A data from Opik traces and optimize prompts using the MetaPromptOptimizer through an interactive notebook.
- [ARC-AGI Optimization Tutorial](https://www.comet.com/docs/opik/agent_optimization/cookbooks/arc_agi_optimizer_cookbook.mdx): End-to-end ARC-AGI optimization walkthrough with Opik Agent Optimizer.
- [Multimodal Agent Optimization Tutorial](https://www.comet.com/docs/opik/agent_optimization/cookbooks/multimodal_agent_optimizer_cookbook.mdx): Multimodal agent optimization tutorial inspired by a self-driving car example.
- [Extending Optimizers](https://www.comet.com/docs/opik/agent_optimization/advanced/extending_optimizers.mdx): Learn how to extend Opik's optimization framework with custom algorithms and contribute to the project's development.
- [Custom metrics](https://www.comet.com/docs/opik/agent_optimization/advanced/custom_metrics.mdx): Build specialized metrics, integrate external models, and reuse them across optimizations.
- [Custom Optimizer Prompts](https://www.comet.com/docs/opik/agent_optimization/advanced/prompt_customization.mdx): Learn how to override and customize the internal prompt templates used by Opik optimizers to add domain constraints, safety requirements, or custom formatting.
- [Sampling controls](https://www.comet.com/docs/opik/agent_optimization/advanced/n_samples.mdx): Use n_samples, n_samples_minibatch, and the n parameter to trade cost for stability and exploration.
- [Multiple Completions (n parameter)](https://www.comet.com/docs/opik/agent_optimization/advanced/multiple_completions.mdx): Learn how to use the n parameter to generate multiple candidate outputs per evaluation, reducing variance and improving optimization results through best-of-k selection.
- [Chaining optimizers](https://www.comet.com/docs/opik/agent_optimization/advanced/chaining_optimizers.mdx): Run multiple optimizers in sequence to balance exploration and fine-tuning.
- [Opik Agent Optimizer API Reference](https://www.comet.com/docs/opik/agent_optimization/advanced/api_reference.mdx): Technical SDK reference guide
- [Overview](https://www.comet.com/docs/opik/self-host/overview.mdx): Explore how to self-host Opik on your infrastructure with full feature access, including tracing and evaluation, without user management.
- [Local deployment](https://www.comet.com/docs/opik/self-host/local_deployment.mdx): Configure your local Opik deployment using Docker Compose for quick setup. Ideal for testing but not for production environments.
- [Kubernetes deployment](https://www.comet.com/docs/opik/self-host/kubernetes.mdx): Learn to configure and deploy Opik on Kubernetes using our Helm chart for robust, production-ready environments.
- [Migrating from Bitnami Charts and Images](https://www.comet.com/docs/opik/self-host/helm.mdx): Learn how to migrate from Bitnami charts and images to Opik's official Helm chart
- [Platform Architecture](https://www.comet.com/docs/opik/self-host/architecture.mdx): Learn how Opik's architecture utilizes multiple services for backend, frontend, and data management, optimizing performance and scalability.
- [Scaling Opik](https://www.comet.com/docs/opik/self-host/scaling.mdx): Learn best practices and configurations for running Opik in production, ensuring resilience and scalability for mission-critical workloads.
- [Advanced clickhouse backup](https://www.comet.com/docs/opik/self-host/backup.mdx): Learn to implement SQL-based and dedicated backup tools for ClickHouse in Opik's Kubernetes setup to ensure data protection and recovery.
- [Troubleshooting](https://www.comet.com/docs/opik/self-host/troubleshooting.mdx): Troubleshooting guide for common issues when running self-hosted Opik deployments.
- [Anonymous usage statistics](https://www.comet.com/docs/opik/self-host/configure/anonymous_usage_statistics.mdx): Learn how to enable or disable anonymous usage statistics reporting in Opik to improve platform performance and user experience.
- [Large CSV uploads](https://www.comet.com/docs/opik/self-host/configure/large_csv_uploads.mdx): Configure Opik to accept CSV uploads up to 2GB, enabling efficient dataset creation and asynchronous processing.
- [Dataset versioning migration](https://www.comet.com/docs/opik/self-host/configure/dataset_versioning_migration.mdx): Learn about the automated dataset versioning migration process when upgrading to Opik 1.9.92 or higher, including configuration, monitoring, and recovery steps.
- [Overview](https://www.comet.com/docs/opik/reference/overview.mdx): Explore comprehensive SDK reference documentation with Opik to effectively implement and utilize all available methods.
- [REST API Client](https://www.comet.com/docs/opik/reference/python-sdk/rest-api.mdx): Access all Opik platform functionality with the Python SDK's REST API client for advanced operations and custom integrations.
- [Batching and update operations](https://www.comet.com/docs/opik/reference/python-sdk/troubleshooting/batching-and-updates.mdx): Understand how batching affects update operations and how to avoid data loss when using the Opik Python SDK.
- [Opik TypeScript SDK](https://www.comet.com/docs/opik/integrations/typescript-sdk.mdx): Monitor and debug your JavaScript/TypeScript apps with Opik's SDK, enabling seamless integration for LLM applications and AI workflows.
- [Opik TS - Interactive Setup Tool](https://www.comet.com/docs/opik/reference/typescript-sdk/opik-ts.mdx): A guided CLI tool for quickly integrating Opik SDK into your Node.js/TypeScript projects with automatic configuration and setup.
- [Prompts](https://www.comet.com/docs/opik/reference/typescript-sdk/prompts.mdx): Learn to version, store, and format LLM prompt templates using the Opik TypeScript SDK for seamless integration with your codebase.
- [Opik Query Language (OQL)](https://www.comet.com/docs/opik/reference/typescript-sdk/opik-query-language.mdx): Learn to use OQL for powerful data filtering in Opik with SQL-like syntax and expressive conditions for precise data retrieval.
- [Evaluation](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/overview.mdx): Evaluate your LLM applications effectively using Opik's TypeScript SDK and the powerful evaluate function for diverse evaluation scenarios.
- [Quick Start](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/quick-start.mdx): Evaluate your AI models effectively. Learn to create datasets and analyze results with Opik's TypeScript SDK in just 15 minutes.
- [Datasets](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/datasets.mdx): Learn to create and manage datasets in Opik for effective evaluation, leveraging TypeScript's type safety and deduplication features.
- [Evaluate Function](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/evaluate_function.mdx): Evaluate LLM tasks against datasets using customizable metrics with the evaluate function in Opik for precise assessments.
- [evaluatePrompt Function](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/evaluate_prompt_function.mdx): Evaluate prompt templates against datasets effortlessly with Opik. Streamline formatting, generate responses, and assess results using key metrics.
- [Models](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/models.mdx): Configure models for evaluation using the TypeScript SDK with Opik, enabling seamless integration with various providers and custom settings.
- [Evaluation Metrics](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/metrics.mdx): Evaluate AI model performance with Opik metrics to ensure accurate assessments and informed decisions.
- [Experiments](https://www.comet.com/docs/opik/reference/typescript-sdk/evaluation/experiments.mdx): Evaluate and compare LLM applications with Opik by linking execution data to datasets for structured analysis and performance tracking.
- [Overview](https://www.comet.com/docs/opik/reference/rest-api/overview.mdx): Explore the Opik REST API to integrate seamlessly with Open-Source and Opik Cloud platforms. Engage with our community for support.
- [Overview](https://www.comet.com/docs/opik/opik-university/overview.mdx): Master Opik's features through structured video tutorials, enhancing your observability and monitoring capabilities for better production outcomes.
- [Opik Overview](https://www.comet.com/docs/opik/opik-university/intro/opik-overview.mdx): Explore Opik's capabilities to enhance your workflow and maximize productivity with practical insights and an engaging video tutorial.
- [Next steps / Set expectations](https://www.comet.com/docs/opik/opik-university/intro/next-steps.mdx): Learn to set clear expectations for your project with Opik, ensuring alignment and understanding among all stakeholders.
- [Log Traces](https://www.comet.com/docs/opik/opik-university/observability/log-traces.mdx): Monitor and analyze log traces effectively with Opik to improve system observability and troubleshoot issues efficiently.
- [Annotate Traces](https://www.comet.com/docs/opik/opik-university/observability/annotate-traces.mdx): Learn to effectively annotate traces in Opik to improve observability and gain deeper insights into your applications.
- [Evaluation Concepts and Overview](https://www.comet.com/docs/opik/opik-university/evaluation/concepts-overview.mdx): Explore evaluation concepts in Opik to enhance your understanding and implementation strategies for effective assessments.
- [Create Evaluation Datasets](https://www.comet.com/docs/opik/opik-university/evaluation/create-datasets.mdx): Build and manage evaluation datasets effectively using Opik's tools to enhance your analysis and decision-making processes.
- [Define Evaluation Metrics](https://www.comet.com/docs/opik/opik-university/evaluation/define-metrics.mdx): Learn to define and implement effective evaluation metrics in Opik for better performance analysis and decision-making.
- [Evaluate your LLM Application](https://www.comet.com/docs/opik/opik-university/evaluation/evaluate-llm-app.mdx): Evaluate your LLM application effectively with Opik's comprehensive evaluation tools and insights for optimized performance.
- [No-code LLM Evaluation Workflow](https://www.comet.com/docs/opik/opik-university/evaluation/evaluation-ui-workflow.mdx): Evaluate LLM performance effortlessly with Opik's no-code workflow, streamlining your machine learning evaluation process.
- [Prompt Management](https://www.comet.com/docs/opik/opik-university/prompt-engineering/prompt-management.mdx): Learn to effectively manage and optimize prompts in Opik to enhance your AI-driven projects and streamline workflows.
- [Prompt Playground](https://www.comet.com/docs/opik/opik-university/prompt-engineering/prompt-playground.mdx): Learn to craft effective prompts for AI interactions in Opik's Prompt Playground. Enhance your prompt engineering skills today.
- [PyTest Integration](https://www.comet.com/docs/opik/opik-university/testing/pytest-integration.mdx): Learn to seamlessly integrate PyTest in Opik to enhance your testing workflows and ensure reliable software performance.
- [Online Evaluation Rules](https://www.comet.com/docs/opik/opik-university/production-monitoring/online-evaluation-rules.mdx): Monitor and evaluate production processes effectively with Opik's comprehensive online evaluation rules.

## API Docs

- API Reference > System Usage [Get datasets information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-dataset-bi-info.mdx)
- API Reference > System Usage [Get experiments information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-experiment-bi-info.mdx)
- API Reference > System Usage [Get spans information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-spans-bi-info.mdx)
- API Reference > System Usage [Get spans count on previous day for all available workspaces](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-spans-count-for-workspaces.mdx)
- API Reference > System Usage [Get traces information for BI events](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-traces-bi-info.mdx)
- API Reference > System Usage [Get traces count on previous day for all available workspaces](https://www.comet.com/docs/opik/reference/rest-api/system-usage/get-traces-count-for-workspaces.mdx)
- API Reference > Agent Configs [Create optimizer config with initial blueprint](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/create-agent-config.mdx)
- API Reference > Agent Configs [Add blueprint to existing config](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/update-agent-config.mdx)
- API Reference > Agent Configs [Create blueprint from mask](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/create-blueprint-from-mask.mdx)
- API Reference > Agent Configs [Create or update environments](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/create-or-update-envs.mdx)
- API Reference > Agent Configs [Retrieve blueprint by environment](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-by-env.mdx)
- API Reference > Agent Configs [Set environment by blueprint name](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/set-env-by-blueprint-name.mdx)
- API Reference > Agent Configs [Delete environment](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/delete-env.mdx)
- API Reference > Agent Configs [Retrieve blueprint by ID](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-by-id.mdx)
- API Reference > Agent Configs [Retrieve blueprint by name](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-by-name.mdx)
- API Reference > Agent Configs [Get blueprint history](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-blueprint-history.mdx)
- API Reference > Agent Configs [Retrieve delta by blueprint ID](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-delta-by-id.mdx)
- API Reference > Agent Configs [Retrieve latest blueprint](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/get-latest-blueprint.mdx)
- API Reference > Agent Configs [Remove configuration parameters](https://www.comet.com/docs/opik/reference/rest-api/agent-configs/remove-config-keys.mdx)
- API Reference > Alerts [Find alerts](https://www.comet.com/docs/opik/reference/rest-api/alerts/find-alerts.mdx)
- API Reference > Alerts [Create alert](https://www.comet.com/docs/opik/reference/rest-api/alerts/create-alert.mdx)
- API Reference > Alerts [Delete alert batch](https://www.comet.com/docs/opik/reference/rest-api/alerts/delete-alert-batch.mdx)
- API Reference > Alerts [Get Alert by id](https://www.comet.com/docs/opik/reference/rest-api/alerts/get-alert-by-id.mdx)
- API Reference > Alerts [Update alert](https://www.comet.com/docs/opik/reference/rest-api/alerts/update-alert.mdx)
- API Reference > Alerts [Get webhook payload examples](https://www.comet.com/docs/opik/reference/rest-api/alerts/get-webhook-examples.mdx)
- API Reference > Alerts [Test alert webhook](https://www.comet.com/docs/opik/reference/rest-api/alerts/test-webhook.mdx)
- API Reference > Annotation Queues [Add items to annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/add-items-to-annotation-queue.mdx)
- API Reference > Annotation Queues [Find annotation queues](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/find-annotation-queues.mdx)
- API Reference > Annotation Queues [Create annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/create-annotation-queue.mdx)
- API Reference > Annotation Queues [Create annotation queue batch](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/create-annotation-queue-batch.mdx)
- API Reference > Annotation Queues [Delete annotation queue batch](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/delete-annotation-queue-batch.mdx)
- API Reference > Annotation Queues [Get annotation queue by id](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/get-annotation-queue-by-id.mdx)
- API Reference > Annotation Queues [Update annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/update-annotation-queue.mdx)
- API Reference > Annotation Queues [Remove items from annotation queue](https://www.comet.com/docs/opik/reference/rest-api/annotation-queues/remove-items-from-annotation-queue.mdx)
- API Reference > Attachments [Attachments list for entity](https://www.comet.com/docs/opik/reference/rest-api/attachments/attachment-list.mdx)
- API Reference > Attachments [Complete multipart attachment upload](https://www.comet.com/docs/opik/reference/rest-api/attachments/complete-multi-part-upload.mdx)
- API Reference > Attachments [Delete attachments](https://www.comet.com/docs/opik/reference/rest-api/attachments/delete-attachments.mdx)
- API Reference > Attachments [Download attachment from MinIO](https://www.comet.com/docs/opik/reference/rest-api/attachments/download-attachment.mdx)
- API Reference > Attachments [Start multipart attachment upload](https://www.comet.com/docs/opik/reference/rest-api/attachments/start-multi-part-upload.mdx)
- API Reference > Attachments [Upload attachment to MinIO](https://www.comet.com/docs/opik/reference/rest-api/attachments/upload-attachment.mdx)
- API Reference > Check [Check user access to workspace](https://www.comet.com/docs/opik/reference/rest-api/check/access.mdx)
- API Reference > Check [User's default workspace name](https://www.comet.com/docs/opik/reference/rest-api/check/get-workspace-name.mdx)
- API Reference > Automation Rule Evaluators [Find project Evaluators](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/find-evaluators.mdx)
- API Reference > Automation Rule Evaluators [Create automation rule evaluator](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/create-automation-rule-evaluator.mdx)
- API Reference > Automation Rule Evaluators [Delete automation rule evaluators](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/delete-automation-rule-evaluator-batch.mdx)
- API Reference > Automation Rule Evaluators [Get automation rule evaluator by id](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/get-evaluator-by-id.mdx)
- API Reference > Automation Rule Evaluators [Update Automation Rule Evaluator by id](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/update-automation-rule-evaluator.mdx)
- API Reference > Automation Rule Evaluators [Get automation rule evaluator logs by id](https://www.comet.com/docs/opik/reference/rest-api/automation-rule-evaluators/get-evaluator-logs-by-id.mdx)
- API Reference > Chat Completions [Create chat completions](https://www.comet.com/docs/opik/reference/rest-api/chat-completions/create-chat-completions.mdx)
- API Reference > Dashboards [Find dashboards](https://www.comet.com/docs/opik/reference/rest-api/dashboards/find-dashboards.mdx)
- API Reference > Dashboards [Create dashboard](https://www.comet.com/docs/opik/reference/rest-api/dashboards/create-dashboard.mdx)
- API Reference > Dashboards [Get dashboard by id](https://www.comet.com/docs/opik/reference/rest-api/dashboards/get-dashboard-by-id.mdx)
- API Reference > Dashboards [Delete dashboard](https://www.comet.com/docs/opik/reference/rest-api/dashboards/delete-dashboard.mdx)
- API Reference > Dashboards [Update dashboard](https://www.comet.com/docs/opik/reference/rest-api/dashboards/update-dashboard.mdx)
- API Reference > Dashboards [Delete dashboards](https://www.comet.com/docs/opik/reference/rest-api/dashboards/delete-dashboards-batch.mdx)
- API Reference > Datasets [Apply changes to dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/apply-dataset-item-changes.mdx)
- API Reference > Datasets [Batch update dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/batch-update-dataset-items.mdx)
- API Reference > Datasets [Find datasets](https://www.comet.com/docs/opik/reference/rest-api/datasets/find-datasets.mdx)
- API Reference > Datasets [Create dataset](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset.mdx)
- API Reference > Datasets [Create/update dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-or-update-dataset-items.mdx)
- API Reference > Datasets [Create dataset items from CSV file](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-csv.mdx)
- API Reference > Datasets [Create dataset items from spans](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-spans.mdx)
- API Reference > Datasets [Create dataset items from traces](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-dataset-items-from-traces.mdx)
- API Reference > Datasets [Get dataset by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-by-id.mdx)
- API Reference > Datasets [Update dataset by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/update-dataset.mdx)
- API Reference > Datasets [Delete dataset by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-dataset.mdx)
- API Reference > Datasets [Delete dataset by name](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-dataset-by-name.mdx)
- API Reference > Datasets [Delete dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-dataset-items.mdx)
- API Reference > Datasets [Delete datasets](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-datasets-batch.mdx)
- API Reference > Datasets [Download dataset export file](https://www.comet.com/docs/opik/reference/rest-api/datasets/download-dataset-export.mdx)
- API Reference > Datasets [Expand dataset with synthetic samples](https://www.comet.com/docs/opik/reference/rest-api/datasets/expand-dataset.mdx)
- API Reference > Datasets [Find dataset items with experiment items](https://www.comet.com/docs/opik/reference/rest-api/datasets/find-dataset-items-with-experiment-items.mdx)
- API Reference > Datasets [Get dataset by name](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-by-identifier.mdx)
- API Reference > Datasets [Get experiment items stats for dataset](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-experiment-items-stats.mdx)
- API Reference > Datasets [Get dataset export job status](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-export-job.mdx)
- API Reference > Datasets [Get all dataset export jobs](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-export-jobs.mdx)
- API Reference > Datasets [Get dataset item by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-item-by-id.mdx)
- API Reference > Datasets [Partially update dataset item by id](https://www.comet.com/docs/opik/reference/rest-api/datasets/patch-dataset-item.mdx)
- API Reference > Datasets [Get dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-items.mdx)
- API Reference > Datasets [Get dataset items output columns](https://www.comet.com/docs/opik/reference/rest-api/datasets/get-dataset-items-output-columns.mdx)
- API Reference > Datasets [Mark dataset export job as viewed](https://www.comet.com/docs/opik/reference/rest-api/datasets/mark-dataset-export-job-viewed.mdx)
- API Reference > Datasets [Start dataset CSV export](https://www.comet.com/docs/opik/reference/rest-api/datasets/start-dataset-export.mdx)
- API Reference > Datasets [Stream dataset items](https://www.comet.com/docs/opik/reference/rest-api/datasets/stream-dataset-items.mdx)
- API Reference > Datasets [Compare latest version with draft](https://www.comet.com/docs/opik/reference/rest-api/datasets/compare-dataset-versions.mdx)
- API Reference > Datasets [Create version tag](https://www.comet.com/docs/opik/reference/rest-api/datasets/create-version-tag.mdx)
- API Reference > Datasets [Delete version tag](https://www.comet.com/docs/opik/reference/rest-api/datasets/delete-version-tag.mdx)
- API Reference > Datasets [List dataset versions](https://www.comet.com/docs/opik/reference/rest-api/datasets/list-dataset-versions.mdx)
- API Reference > Datasets [Restore dataset to a previous version](https://www.comet.com/docs/opik/reference/rest-api/datasets/restore-dataset-version.mdx)
- API Reference > Datasets [Retrieve dataset version by name](https://www.comet.com/docs/opik/reference/rest-api/datasets/retrieve-dataset-version.mdx)
- API Reference > Datasets [Update dataset version](https://www.comet.com/docs/opik/reference/rest-api/datasets/update-dataset-version.mdx)
- API Reference > Experiments [Batch update experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/batch-update-experiments.mdx)
- API Reference > Experiments [Find experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-experiments.mdx)
- API Reference > Experiments [Create experiment](https://www.comet.com/docs/opik/reference/rest-api/experiments/create-experiment.mdx)
- API Reference > Experiments [Create experiment items](https://www.comet.com/docs/opik/reference/rest-api/experiments/create-experiment-items.mdx)
- API Reference > Experiments [Delete experiment items](https://www.comet.com/docs/opik/reference/rest-api/experiments/delete-experiment-items.mdx)
- API Reference > Experiments [Delete experiments by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/delete-experiments-by-id.mdx)
- API Reference > Experiments [Create and execute experiment](https://www.comet.com/docs/opik/reference/rest-api/experiments/execute-experiment.mdx)
- API Reference > Experiments [Record experiment items in bulk](https://www.comet.com/docs/opik/reference/rest-api/experiments/experiment-items-bulk.mdx)
- API Reference > Experiments [Find Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-feedback-score-names.mdx)
- API Reference > Experiments [Find experiment groups](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-experiment-groups.mdx)
- API Reference > Experiments [Find experiment groups with aggregations](https://www.comet.com/docs/opik/reference/rest-api/experiments/find-experiment-groups-aggregations.mdx)
- API Reference > Experiments [Finish experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/finish-experiments.mdx)
- API Reference > Experiments [Get experiment by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/get-experiment-by-id.mdx)
- API Reference > Experiments [Update experiment by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/update-experiment.mdx)
- API Reference > Experiments [Get experiment item by id](https://www.comet.com/docs/opik/reference/rest-api/experiments/get-experiment-item-by-id.mdx)
- API Reference > Experiments [Stream experiment items](https://www.comet.com/docs/opik/reference/rest-api/experiments/stream-experiment-items.mdx)
- API Reference > Experiments [Stream experiments](https://www.comet.com/docs/opik/reference/rest-api/experiments/stream-experiments.mdx)
- API Reference > Feedback Definitions [Find Feedback definitions](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/find-feedback-definitions.mdx)
- API Reference > Feedback Definitions [Create feedback definition](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/create-feedback-definition.mdx)
- API Reference > Feedback Definitions [Get feedback definition by id](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/get-feedback-definition-by-id.mdx)
- API Reference > Feedback Definitions [Update feedback definition by id](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/update-feedback-definition.mdx)
- API Reference > Feedback Definitions [Delete feedback definition by id](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/delete-feedback-definition-by-id.mdx)
- API Reference > Feedback Definitions [Delete feedback definitions](https://www.comet.com/docs/opik/reference/rest-api/feedback-definitions/delete-feedback-definitions-batch.mdx)
- API Reference > Guardrails [Create guardrails for traces in a batch](https://www.comet.com/docs/opik/reference/rest-api/guardrails/create-guardrails.mdx)
- API Reference > Insights Views [Find insights views](https://www.comet.com/docs/opik/reference/rest-api/insights-views/find-insights-views.mdx)
- API Reference > Insights Views [Create insights view](https://www.comet.com/docs/opik/reference/rest-api/insights-views/create-insights-view.mdx)
- API Reference > Insights Views [Get insights view by id](https://www.comet.com/docs/opik/reference/rest-api/insights-views/get-insights-view-by-id.mdx)
- API Reference > Insights Views [Delete insights view](https://www.comet.com/docs/opik/reference/rest-api/insights-views/delete-insights-view.mdx)
- API Reference > Insights Views [Update insights view](https://www.comet.com/docs/opik/reference/rest-api/insights-views/update-insights-view.mdx)
- API Reference > Insights Views [Delete insights views](https://www.comet.com/docs/opik/reference/rest-api/insights-views/delete-insights-views-batch.mdx)
- API Reference > Llm Models [Get LLM models](https://www.comet.com/docs/opik/reference/rest-api/llm-models/get-llm-models.mdx)
- API Reference > Llm Provider Key [Delete LLM Provider's ApiKeys](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/delete-llm-provider-api-keys-batch.mdx)
- API Reference > Llm Provider Key [Find LLM Provider's ApiKeys](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/find-llm-provider-keys.mdx)
- API Reference > Llm Provider Key [Store LLM Provider's ApiKey](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/store-llm-provider-api-key.mdx)
- API Reference > Llm Provider Key [Get LLM Provider's ApiKey by id](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/get-llm-provider-api-key-by-id.mdx)
- API Reference > Llm Provider Key [Update LLM Provider's ApiKey](https://www.comet.com/docs/opik/reference/rest-api/llm-provider-key/update-llm-provider-api-key.mdx)
- API Reference > Runners [Get local runner job logs](https://www.comet.com/docs/opik/reference/rest-api/runners/get-job-logs.mdx)
- API Reference > Runners [Append local runner job logs](https://www.comet.com/docs/opik/reference/rest-api/runners/append-job-logs.mdx)
- API Reference > Runners [Cancel local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/cancel-job.mdx)
- API Reference > Runners [Submit bridge command](https://www.comet.com/docs/opik/reference/rest-api/runners/create-bridge-command.mdx)
- API Reference > Runners [Create local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/create-job.mdx)
- API Reference > Runners [Get local runner](https://www.comet.com/docs/opik/reference/rest-api/runners/get-runner.mdx)
- API Reference > Runners [Disconnect local runner](https://www.comet.com/docs/opik/reference/rest-api/runners/disconnect-runner.mdx)
- API Reference > Runners [Get bridge command](https://www.comet.com/docs/opik/reference/rest-api/runners/get-bridge-command.mdx)
- API Reference > Runners [Get local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/get-job.mdx)
- API Reference > Runners [Local runner heartbeat](https://www.comet.com/docs/opik/reference/rest-api/runners/heartbeat.mdx)
- API Reference > Runners [List local runner jobs](https://www.comet.com/docs/opik/reference/rest-api/runners/list-jobs.mdx)
- API Reference > Runners [List local runners](https://www.comet.com/docs/opik/reference/rest-api/runners/list-runners.mdx)
- API Reference > Runners [Poll next bridge commands](https://www.comet.com/docs/opik/reference/rest-api/runners/next-bridge-commands.mdx)
- API Reference > Runners [Next local runner job](https://www.comet.com/docs/opik/reference/rest-api/runners/next-job.mdx)
- API Reference > Runners [Patch runner checklist](https://www.comet.com/docs/opik/reference/rest-api/runners/patch-checklist.mdx)
- API Reference > Runners [Register local runner agents](https://www.comet.com/docs/opik/reference/rest-api/runners/register-agents.mdx)
- API Reference > Runners [Report bridge command result](https://www.comet.com/docs/opik/reference/rest-api/runners/report-bridge-result.mdx)
- API Reference > Runners [Report local runner job result](https://www.comet.com/docs/opik/reference/rest-api/runners/report-job-result.mdx)
- API Reference > Manual Evaluation [Manually evaluate spans](https://www.comet.com/docs/opik/reference/rest-api/manual-evaluation/evaluate-spans.mdx)
- API Reference > Manual Evaluation [Manually evaluate threads](https://www.comet.com/docs/opik/reference/rest-api/manual-evaluation/evaluate-threads.mdx)
- API Reference > Manual Evaluation [Manually evaluate traces](https://www.comet.com/docs/opik/reference/rest-api/manual-evaluation/evaluate-traces.mdx)
- API Reference > Ollama [List available Ollama models](https://www.comet.com/docs/opik/reference/rest-api/ollama/list-models.mdx)
- API Reference > Ollama [Test connection to Ollama instance](https://www.comet.com/docs/opik/reference/rest-api/ollama/test-connection.mdx)
- API Reference > Ollie State [Download ollie state](https://www.comet.com/docs/opik/reference/rest-api/ollie-state/download-ollie-state.mdx)
- API Reference > Ollie State [Replace ollie state](https://www.comet.com/docs/opik/reference/rest-api/ollie-state/replace-ollie-state.mdx)
- API Reference > Ollie State [Delete ollie state](https://www.comet.com/docs/opik/reference/rest-api/ollie-state/delete-ollie-state.mdx)
- API Reference > Open Telemetry Ingestion [Receive Protobuf Traces](https://www.comet.com/docs/opik/reference/rest-api/open-telemetry-ingestion/receive-protobuf-traces.mdx)
- API Reference > Optimizations [Cancel Studio optimizations](https://www.comet.com/docs/opik/reference/rest-api/optimizations/cancel-studio-optimizations.mdx)
- API Reference > Optimizations [Find optimizations](https://www.comet.com/docs/opik/reference/rest-api/optimizations/find-optimizations.mdx)
- API Reference > Optimizations [Create optimization](https://www.comet.com/docs/opik/reference/rest-api/optimizations/create-optimization.mdx)
- API Reference > Optimizations [Upsert optimization](https://www.comet.com/docs/opik/reference/rest-api/optimizations/upsert-optimization.mdx)
- API Reference > Optimizations [Delete optimizations by id](https://www.comet.com/docs/opik/reference/rest-api/optimizations/delete-optimizations-by-id.mdx)
- API Reference > Optimizations [Get optimization by id](https://www.comet.com/docs/opik/reference/rest-api/optimizations/get-optimization-by-id.mdx)
- API Reference > Optimizations [Update optimization by id](https://www.comet.com/docs/opik/reference/rest-api/optimizations/update-optimizations-by-id.mdx)
- API Reference > Optimizations [Get Studio optimization logs](https://www.comet.com/docs/opik/reference/rest-api/optimizations/get-studio-optimization-logs.mdx)
- API Reference > Pairing [Activate a pairing session](https://www.comet.com/docs/opik/reference/rest-api/pairing/activate-pairing-session.mdx)
- API Reference > Pairing [Create a pairing session](https://www.comet.com/docs/opik/reference/rest-api/pairing/create-pairing-session.mdx)
- API Reference > Projects [Find alerts by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-alerts-by-project.mdx)
- API Reference > Projects [Find dashboards by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-dashboards-by-project.mdx)
- API Reference > Projects [Find datasets by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-datasets-by-project.mdx)
- API Reference > Projects [Find experiments by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-experiments-by-project.mdx)
- API Reference > Projects [Find optimizations by project](https://www.comet.com/docs/opik/reference/rest-api/projects/find-optimizations-by-project.mdx)
- API Reference > Projects [Get prompts by project](https://www.comet.com/docs/opik/reference/rest-api/projects/get-prompts-by-project.mdx)
- API Reference > Projects [Find projects](https://www.comet.com/docs/opik/reference/rest-api/projects/find-projects.mdx)
- API Reference > Projects [Create project](https://www.comet.com/docs/opik/reference/rest-api/projects/create-project.mdx)
- API Reference > Projects [Get project by id](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-by-id.mdx)
- API Reference > Projects [Delete project by id](https://www.comet.com/docs/opik/reference/rest-api/projects/delete-project-by-id.mdx)
- API Reference > Projects [Update project by id](https://www.comet.com/docs/opik/reference/rest-api/projects/update-project.mdx)
- API Reference > Projects [Delete projects](https://www.comet.com/docs/opik/reference/rest-api/projects/delete-projects-batch.mdx)
- API Reference > Projects [Find Feedback Score names By Project Ids](https://www.comet.com/docs/opik/reference/rest-api/projects/find-feedback-score-names-by-project-ids.mdx)
- API Reference > Projects [Find Token Usage names](https://www.comet.com/docs/opik/reference/rest-api/projects/find-token-usage-names.mdx)
- API Reference > Projects [Get Project KPI Cards](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-kpi-cards.mdx)
- API Reference > Projects [Get Project Metrics](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-metrics.mdx)
- API Reference > Projects [Get Project Stats](https://www.comet.com/docs/opik/reference/rest-api/projects/get-project-stats.mdx)
- API Reference > Projects [Retrieve project](https://www.comet.com/docs/opik/reference/rest-api/projects/retrieve-project.mdx)
- API Reference > Prompts [Get prompts](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompts.mdx)
- API Reference > Prompts [Create prompt](https://www.comet.com/docs/opik/reference/rest-api/prompts/create-prompt.mdx)
- API Reference > Prompts [Create prompt version](https://www.comet.com/docs/opik/reference/rest-api/prompts/create-prompt-version.mdx)
- API Reference > Prompts [Update prompt versions](https://www.comet.com/docs/opik/reference/rest-api/prompts/update-prompt-versions.mdx)
- API Reference > Prompts [Get prompt by id](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-by-id.mdx)
- API Reference > Prompts [Update prompt](https://www.comet.com/docs/opik/reference/rest-api/prompts/update-prompt.mdx)
- API Reference > Prompts [Delete prompt](https://www.comet.com/docs/opik/reference/rest-api/prompts/delete-prompt.mdx)
- API Reference > Prompts [Delete prompts](https://www.comet.com/docs/opik/reference/rest-api/prompts/delete-prompts-batch.mdx)
- API Reference > Prompts [Get prompt by commit](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-by-commit.mdx)
- API Reference > Prompts [Get prompt version by id](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-version-by-id.mdx)
- API Reference > Prompts [Get prompt versions](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompt-versions.mdx)
- API Reference > Prompts [Get prompts by commits](https://www.comet.com/docs/opik/reference/rest-api/prompts/get-prompts-by-commits.mdx)
- API Reference > Prompts [Restore prompt version](https://www.comet.com/docs/opik/reference/rest-api/prompts/restore-prompt-version.mdx)
- API Reference > Prompts [Retrieve prompt version](https://www.comet.com/docs/opik/reference/rest-api/prompts/retrieve-prompt-version.mdx)
- API Reference > Retention Rules [Find retention rules](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/find-retention-rules.mdx)
- API Reference > Retention Rules [Create retention rule](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/create-retention-rule.mdx)
- API Reference > Retention Rules [Get retention rule by id](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/get-retention-rule-by-id.mdx)
- API Reference > Retention Rules [Deactivate retention rule](https://www.comet.com/docs/opik/reference/rest-api/retention-rules/deactivate-retention-rule.mdx)
- API Reference > Service Toggles [Get Service Toggles](https://www.comet.com/docs/opik/reference/rest-api/service-toggles/get-service-toggles.mdx)
- API Reference > Spans [Add span comment](https://www.comet.com/docs/opik/reference/rest-api/spans/add-span-comment.mdx)
- API Reference > Spans [Add span feedback score](https://www.comet.com/docs/opik/reference/rest-api/spans/add-span-feedback-score.mdx)
- API Reference > Spans [Create spans](https://www.comet.com/docs/opik/reference/rest-api/spans/create-spans.mdx)
- API Reference > Spans [Batch update spans](https://www.comet.com/docs/opik/reference/rest-api/spans/batch-update-spans.mdx)
- API Reference > Spans [Get spans by project_name or project_id and optionally by trace_id and/or type](https://www.comet.com/docs/opik/reference/rest-api/spans/get-spans-by-project.mdx)
- API Reference > Spans [Create span](https://www.comet.com/docs/opik/reference/rest-api/spans/create-span.mdx)
- API Reference > Spans [Get span by id](https://www.comet.com/docs/opik/reference/rest-api/spans/get-span-by-id.mdx)
- API Reference > Spans [Delete span by id](https://www.comet.com/docs/opik/reference/rest-api/spans/delete-span-by-id.mdx)
- API Reference > Spans [Update span by id](https://www.comet.com/docs/opik/reference/rest-api/spans/update-span.mdx)
- API Reference > Spans [Delete span comments](https://www.comet.com/docs/opik/reference/rest-api/spans/delete-span-comments.mdx)
- API Reference > Spans [Delete span feedback score](https://www.comet.com/docs/opik/reference/rest-api/spans/delete-span-feedback-score.mdx)
- API Reference > Spans [Find Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/spans/find-feedback-score-names-1.mdx)
- API Reference > Spans [Get span comment](https://www.comet.com/docs/opik/reference/rest-api/spans/get-span-comment.mdx)
- API Reference > Spans [Get span stats](https://www.comet.com/docs/opik/reference/rest-api/spans/get-span-stats.mdx)
- API Reference > Spans [Batch feedback scoring for spans](https://www.comet.com/docs/opik/reference/rest-api/spans/score-batch-of-spans.mdx)
- API Reference > Spans [Search spans](https://www.comet.com/docs/opik/reference/rest-api/spans/search-spans.mdx)
- API Reference > Spans [Update span comment by id](https://www.comet.com/docs/opik/reference/rest-api/spans/update-span-comment.mdx)
- API Reference > Traces [Add thread comment](https://www.comet.com/docs/opik/reference/rest-api/traces/add-thread-comment.mdx)
- API Reference > Traces [Add trace comment](https://www.comet.com/docs/opik/reference/rest-api/traces/add-trace-comment.mdx)
- API Reference > Traces [Add trace feedback score](https://www.comet.com/docs/opik/reference/rest-api/traces/add-trace-feedback-score.mdx)
- API Reference > Traces [Create traces](https://www.comet.com/docs/opik/reference/rest-api/traces/create-traces.mdx)
- API Reference > Traces [Batch update traces](https://www.comet.com/docs/opik/reference/rest-api/traces/batch-update-traces.mdx)
- API Reference > Traces [Batch update threads](https://www.comet.com/docs/opik/reference/rest-api/traces/batch-update-threads.mdx)
- API Reference > Traces [Close trace thread(s)](https://www.comet.com/docs/opik/reference/rest-api/traces/close-trace-thread.mdx)
- API Reference > Traces [Get traces by project_name or project_id](https://www.comet.com/docs/opik/reference/rest-api/traces/get-traces-by-project.mdx)
- API Reference > Traces [Create trace](https://www.comet.com/docs/opik/reference/rest-api/traces/create-trace.mdx)
- API Reference > Traces [Get trace by id](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-by-id.mdx)
- API Reference > Traces [Delete trace by id](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-by-id.mdx)
- API Reference > Traces [Update trace by id](https://www.comet.com/docs/opik/reference/rest-api/traces/update-trace.mdx)
- API Reference > Traces [Delete thread comments](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-thread-comments.mdx)
- API Reference > Traces [Delete thread feedback scores](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-thread-feedback-scores.mdx)
- API Reference > Traces [Delete trace comments](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-comments.mdx)
- API Reference > Traces [Delete trace feedback score](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-feedback-score.mdx)
- API Reference > Traces [Delete trace threads](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-trace-threads.mdx)
- API Reference > Traces [Delete traces](https://www.comet.com/docs/opik/reference/rest-api/traces/delete-traces.mdx)
- API Reference > Traces [Find Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/traces/find-feedback-score-names-2.mdx)
- API Reference > Traces [Find Trace Threads Feedback Score names](https://www.comet.com/docs/opik/reference/rest-api/traces/find-trace-threads-feedback-score-names.mdx)
- API Reference > Traces [Get trace stats](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-stats.mdx)
- API Reference > Traces [Get thread comment](https://www.comet.com/docs/opik/reference/rest-api/traces/get-thread-comment.mdx)
- API Reference > Traces [Get trace thread stats](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-thread-stats.mdx)
- API Reference > Traces [Get trace comment](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-comment.mdx)
- API Reference > Traces [Get trace thread](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-thread.mdx)
- API Reference > Traces [Get trace threads](https://www.comet.com/docs/opik/reference/rest-api/traces/get-trace-threads.mdx)
- API Reference > Traces [Open trace thread](https://www.comet.com/docs/opik/reference/rest-api/traces/open-trace-thread.mdx)
- API Reference > Traces [Batch feedback scoring for threads](https://www.comet.com/docs/opik/reference/rest-api/traces/score-batch-of-threads.mdx)
- API Reference > Traces [Batch feedback scoring for traces](https://www.comet.com/docs/opik/reference/rest-api/traces/score-batch-of-traces.mdx)
- API Reference > Traces [Search trace threads](https://www.comet.com/docs/opik/reference/rest-api/traces/search-trace-threads.mdx)
- API Reference > Traces [Search traces](https://www.comet.com/docs/opik/reference/rest-api/traces/search-traces.mdx)
- API Reference > Traces [Update thread](https://www.comet.com/docs/opik/reference/rest-api/traces/update-thread.mdx)
- API Reference > Traces [Update thread comment by id](https://www.comet.com/docs/opik/reference/rest-api/traces/update-thread-comment.mdx)
- API Reference > Traces [Update trace comment by id](https://www.comet.com/docs/opik/reference/rest-api/traces/update-trace-comment.mdx)
- API Reference > Welcome Wizard [Get welcome wizard tracking status](https://www.comet.com/docs/opik/reference/rest-api/welcome-wizard/get-welcome-wizard-status.mdx)
- API Reference > Welcome Wizard [Submit welcome wizard](https://www.comet.com/docs/opik/reference/rest-api/welcome-wizard/submit-welcome-wizard.mdx)
- API Reference > Workspace Permissions [Get workspace permissions for the authenticated user](https://www.comet.com/docs/opik/reference/rest-api/workspace-permissions/get-workspace-user-permissions.mdx)
- API Reference > Workspaces [Get costs summary](https://www.comet.com/docs/opik/reference/rest-api/workspaces/costs-summary.mdx)
- API Reference > Workspaces [Get workspace configuration](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-workspace-configuration.mdx)
- API Reference > Workspaces [Upsert workspace configuration](https://www.comet.com/docs/opik/reference/rest-api/workspaces/upsert-workspace-configuration.mdx)
- API Reference > Workspaces [Delete workspace configuration](https://www.comet.com/docs/opik/reference/rest-api/workspaces/delete-workspace-configuration.mdx)
- API Reference > Workspaces [Get cost daily data](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-cost.mdx)
- API Reference > Workspaces [Get metric daily data](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-metric.mdx)
- API Reference > Workspaces [Get workspace version](https://www.comet.com/docs/opik/reference/rest-api/workspaces/get-workspace-version.mdx)
- API Reference > Workspaces [Get metrics summary](https://www.comet.com/docs/opik/reference/rest-api/workspaces/metrics-summary.mdx)
- API Reference > Redirect [Create dataset redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/datasets-redirect.mdx)
- API Reference > Redirect [Create experiment redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/experiments-redirect.mdx)
- API Reference > Redirect [Create optimization redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/optimizations-redirect.mdx)
- API Reference > Redirect [Create project redirect url](https://www.comet.com/docs/opik/reference/rest-api/redirect/projects-redirect.mdx)

## OpenAPI Specification

The raw OpenAPI 3.1 specification for this API is available at:
- [OpenAPI JSON](https://www.comet.com/openapi.json)
- [OpenAPI YAML](https://www.comet.com/openapi.yaml)