Today, we’re thrilled to introduce Opik – an open-source, end-to-end LLM development platform that provides the observability tools you need…
Introduction BERTScore represents a pivotal shift in LLM evaluation, moving beyond traditional heuristic-based metrics like BLEU and ROUGE to a…
While LLM usage is soaring, productionizing an LLM-powered application or software product presents new and different challenges compared to traditional…
Each layer of visibility into your training and debugging workflows builds confidence that your models will work reliably in production.…
Follow the evolution of my personal AI project and discover how to integrate image analysis, LLM models, and LLM-as-a-judge evaluation…
For the past few months, I’ve been working on LLM-based evaluations (”LLM-as-a-Judge” metrics) for language models. The results have so…
Perplexity is, historically speaking, one of the "standard" evaluation metrics for language models. And while recent years have seen a…
OpenAI’s Python API is quickly becoming one of the most-downloaded Python packages. With an easy-to-use SDK and access…
