Using Opik with DSPy

DSPy is the framework for programming—rather than prompting—language models.

In this guide, we will showcase how to integrate Opik with DSPy so that all the DSPy calls are logged as traces in Opik.

Creating an account on Comet.com

Comet provides a hosted version of the Opik platform, simply create an account and grab you API Key.

You can also run the Opik platform locally, see the installation guide for more information.

1 %pip install --upgrade opik dspy

1 import opik
2 
3 opik.configure(use_local=False)

1 import os
2 import getpass
3 
4 if "OPENAI_API_KEY" not in os.environ:
5     os.environ["OPENAI_API_KEY"] = getpass.getpass("Enter your OpenAI API key: ")

Logging traces

In order to log traces to Opik, you will need to set the opik callback:

1 import dspy
2 from opik.integrations.dspy.callback import OpikCallback
3 
4 lm = dspy.LM("openai/gpt-4o-mini")
5 
6 project_name = "DSPY"
7 opik_callback = OpikCallback(project_name=project_name)
8 
9 dspy.configure(lm=lm, callbacks=[opik_callback])

1 cot = dspy.ChainOfThought("question -> answer")
2 cot(question="What is the meaning of life?")

The trace is now logged to the Opik platform:

DSPy trace

1	import os
2	import getpass
3
4	if "OPENAI_API_KEY" not in os.environ:
5	os.environ["OPENAI_API_KEY"] = getpass.getpass("Enter your OpenAI API key: ")

1	import dspy
2	from opik.integrations.dspy.callback import OpikCallback
3
4	lm = dspy.LM("openai/gpt-4o-mini")
5
6	project_name = "DSPY"
7	opik_callback = OpikCallback(project_name=project_name)
8
9	dspy.configure(lm=lm, callbacks=[opik_callback])

1	cot = dspy.ChainOfThought("question -> answer")
2	cot(question="What is the meaning of life?")