BERTScore For LLM Evaluation
Introduction BERTScore represents a pivotal shift in LLM evaluation, moving beyond traditional heuristic-based metrics like BLEU and ROUGE to a…
Building ClaireBot, an AI Personal Stylist Chatbot
Follow the evolution of my personal AI project and discover how to integrate image analysis, LLM models, and LLM-as-a-judge evaluation…
Perplexity for LLM Evaluation
Perplexity is, historically speaking, one of the "standard" evaluation metrics for language models. And while recent years have seen a…
OpenAI Evals: Log Datasets & Evaluate LLM Performance with Opik
OpenAI’s Python API is quickly becoming one of the most-downloaded Python packages. With an easy-to-use SDK and access…
Building a Low-Cost Local LLM Server to Run 70 Billion Parameter Models
A guest post from Fabrício Ceolin, DevOps Engineer at Comet. Inspired by the growing demand for large-scale language models, Fabrício…
How to Evaluate Your RAG Using the RAGAs Framework
Welcome to Lesson 10 of 11 in our free course series, LLM Twin: Building Your Production-Ready AI Replica. You’ll learn…
How to Use Comet’s New Integration with Union & Flyte
In the machine learning (ML) and artificial intelligence (AI) domain, managing, tracking, and visualizing model training processes, especially at scale,…
