BERTScore For LLM Evaluation
Introduction BERTScore represents a pivotal shift in LLM evaluation, moving beyond traditional heuristic-based metrics like BLEU and ROUGE to a…
Intro to LLM Observability: What to Monitor & How to Get Started
While LLM usage is soaring, productionizing an LLM-powered application or software product presents new and different challenges compared to traditional…
Building ClaireBot, an AI Personal Stylist Chatbot
Follow the evolution of my personal AI project and discover how to integrate image analysis, LLM models, and LLM-as-a-judge evaluation…
Structured Generation for LLM-as-a-Judge Evaluations
For the past few months, I’ve been working on LLM-based evaluations (”LLM-as-a-Judge” metrics) for language models. The results have so…
Perplexity for LLM Evaluation
Perplexity is, historically speaking, one of the "standard" evaluation metrics for language models. And while recent years have seen a…
OpenAI Evals: Log Datasets & Evaluate LLM Performance with Opik
OpenAI’s Python API is quickly becoming one of the most-downloaded Python packages. With an easy-to-use SDK and access…
Meet Opik: Your New Tool to Evaluate, Test, and Monitor LLM Applications
Today, we’re thrilled to introduce Opik – an open-source, end-to-end LLM development platform that provides the observability tools you need…
