Skip to main content

Prerequisites

Step 1: Find Models with Attestation Support

First, list available models and filter for those supporting attestation:

curl

Python

Note the model_id (UUID) for a model you want to use.

Step 2: Get Attestation Report

Before running inference, request an attestation report to verify the GPU machine. Generate a unique nonce (random string) for freshness verification.

curl

Python

Example Response

Save the signing_address - you’ll use it to verify response signatures. Verify the image_digest - compare with the expected digest published in the latest official release to confirm the running container hasn’t been tampered with.

Step 3: Run Confidential Inference

Now run inference using the confidential completions endpoint. The request format is OpenAI-compatible.

curl

Python

Response Headers

The response includes signature headers for verification:

Step 4: Verify the Response Signature

Verify that the response came from the attested machine by checking the signature.

Python (with eth_account)

Complete Example

Here’s a complete Python script that performs verified confidential inference:

What’s Next