Comet MLOPs Platform on GCP
Overview¶
The Comet MLOps Platform on GCP Marketplace provides a quick and easy deployment for self-managed infrastructure and is free for a single user. If you haven't already, get your free license token here.
The image on GCP Marketplace includes the following configuration:
- Comet already running - no installation required
- Ubuntu 24.04 LTS base image
- 1TB storage disk, with enough space for a kubernetes all-in-one deployment
1. GCP Setup ¶
Get Started¶
At the top of the Marketplace Product details page, select the existing project where you wish to deploy Comet or start a new project. Once the project has been selected click on the "Get Started" button and then agree to the terms and agreements. In the modal click on "Deploy".
Enable required APIs¶
In order to deploy a VM product from Marketplace, the following APIs are required: - Compute Engine API - Infrastructure Manager API
Click on "Enable" and wait for it to finish.
Deploy¶
Fill out the Terraform deployment configuration to deploy Comet. Then click "Deploy".
- Enter a name for your Comet deployment
- Select an existing service account (or create a new one)
- Choose a zone
Machine type¶
We recommend an n1-standard-16 machine. - 16 vCPU, 8 core - 60 GB Memory
Boot Disk¶
- Standard persistent disk
- 1000 GB
Networking¶
Adjust these values to your desired specifications.
Wait for the Solution deployment to finish¶
The Details tab will list the Basic information and Outputs related to your deployment.
Basic information¶
- Deployment name
- Location
- Deployment date
- Deployed from
- Labels
Outputs¶
- Instance Machine Type
- Instance Nat Ip
- Instance Network
- Instance Self Link
- Instance Zone
2. Connect to the Virtual Machine¶
(Easy) SSH to the Virtual Machine¶
On the Resources tabs click on the Compute Engine Resource Name. The next page should open to the "Details" panel of your machine. Click on "SSH" to open an in browser terminal and authorize the connection when prompted. You should find yourself at the command line of your virtual machine where Comet is installed.
cometctl
¶
Use Comet's command line utility cometctl
to manage the installation. GCP Marketplace Solution deployments of Comet come with this tool installed and ready to use.
3. Initialize Commet¶
Comet comes pre-installed on this image but not pre-licensed.
sudo cometctl init --license-token <license-token>
Update the Comet configuration¶
At the very least you'll want to set the base domain.
sudo cometctl kaio update-config
Deployment status¶
If for any reason you need to verify that Comet components are running you can check the deployment status.
sudo cometctl kaio status
4. Access the deployment UI¶
To access the Comet UI, either navigate to your configured Comet base domain or modify your /etc/hosts
to include this line:
<VM_PUBLIC_IP> comet.local
5. Smoke test¶
If you'd like you can smoke test the deployment using a tool called cometx
. Smoke Testing
Note: You will need to pip install a few packages. Instructions are at the above link.
Additional options¶
sudo cometctl kaio -h
Re-install Comet¶
Use this command if Comet needs to be reinstalled. It's rare you would need to run this command for GCP Marketplace installs.
sudo cometctl kaio install
Updating Comet¶
You can update Comet components using cometctl
.
sudo cometctl kaio upgrade
Running kubectl
¶
This image runs minikube under the hood. For debugging purposes if you're familiar with kubernetes you can run kubectl
directly by switching to the comet-ml
user.
su comet-ml