Run open source LLM evaluations with Opik!

Star
Comet logo
  • Opik LLM Evals
  • Products
    • Opik – LLM Evaluation
    • ML Experiment Management
    • ML Artifacts
    • ML Model Registry
    • ML Model Production Monitoring
  • Docs
    • Opik – LLM Evaluation
    • ML Experiment Management
  • Pricing
  • Customers
  • Learn
    • Blog
    • Deep Learning Weekly
    • LLM Course
  • Company
    • About Us
    • News and Events
      • Events
      • Press Releases
    • Careers
    • Contact Us
    • Leadership
  • Login
Get Demo
Try Comet Free
  1. Home
  2. Sagemaker & Comet

Track & Evaluate:
Comet x SageMaker

Match the power of SageMaker with the precision of Comet’s end-to-end model evaluation platform. Comet now comes fully integrated and ready to use in any SageMaker project. 

Amazon Sagemaker and Comet partnership

Trusted by the most innovative ML teams

AssemblyAI logo
Natwest logo
Uber Logo
Netflix Logo
Etsy logo
Mobileye logo
AssemblyAI logo
Natwest logo
Uber Logo
Netflix Logo
Etsy logo
Mobileye logo

Run Comet Inside SageMaker Studio, Notebooks, and Pipelines

SageMaker’s integrated development environment includes everything you need to build, train, and deploy machine learning models at scale — with Comet’s suite of world class tracking, observability, and optimization tools available every step of the way. 

  • Fully managed machine learning services, tools, and workflows
  • High-performance, low-cost ML infrastructure for any use case
  • One integrated dev environment to build, train, & deploy ML models at scale
  • Centralized access to notebooks, debuggers, profilers, pipelines, MLOps, and more
  • Seamless ML and GenAI model evaluation across dev and production lifecycles
  • Experiment tracking, debugging, dataset versioning, and visualization for SageMaker training runs
  • Model production monitoring to stay ahead of data drift, accuracy issues, and error metrics
  • LLM evaluation for GenAI applications, with tracing, annotation, pre-configured LLM-as-a-judge metrics, and more

Free Access to Opik for GenAI Application Development

SageMaker customers who purchase Comet’s integration receive full access to Opik, Comet’s leading end-to-end LLM evaluation platform.

Opik automates LLM tracing, eval metrics, unit testing, production dataset creation, and more, to support continuous optimization of your app’s interactions with LLMs.

Try Opik Free

Fully Managed & Secure

Each Comet deployment through Amazon SageMaker Partner AI Apps is securely isolated and provisioned automatically, ensuring data privacy.

Existing SageMaker workflows, identities, and session management extend to Comet for a truly seamless integration.

Getting Started with Comet

The full Comet environment – including Opik – appears directly inside the SageMaker console and is deployed, managed and supported by AWS.

Add just a couple lines of code to your existing workflow to start logging, analyzing, and comparing your ML model training runs and LLM inputs and outputs, with results displaying in your Comet workspace within SageMaker.

An AI Platform Built for Enterprise, Driven by Community

Natwest logo

“The announcement of Comet being available as a SageMaker partner app will simplify our technology estate and developer workflow, allowing our data scientists and ML engineers a better experience for experiment tracking, cataloging and registering models, and monitoring those models in production.”

Greig Cowan headshot

Greig Cowan

Head of AI and Data Science Innovation, Natwest

Get started today for free.

No credit card required, try Comet with no risk and no commitment.

Book a Demo
Contact Sales
Comet logo
  • LinkedIn
  • X
  • YouTube
  • Facebook

Subscribe to Comet

Thank you for subscribing to Comet’s newsletter!

Products

  • Opik
  • Experiment Management
  • Artifacts
  • Model Registry
  • Model Production Monitoring

Learn

  • Documentation
  • Resources
  • Comet Blog
  • Deep Learning Weekly
  • Heartbeat
  • LLM Course

Company

  • About Us
  • News and Events
  • Careers
  • Contact Us

Pricing

  • Pricing
  • Create a Free Account
  • Contact Sales
Capterra badge
AICPA badge

©2025 Comet ML, Inc. – All Rights Reserved

Terms of Service

Privacy Policy

CCPA Privacy Notice

Cookie Settings

We use cookies to collect statistical usage information about our website and its visitors and ensure we give you the best experience on our website. Please refer to our Privacy Policy to learn more.OkPrivacy policy