Vision

SCX.ai vision models support multimodal inputs, allowing users to process both text and images. These models analyze images and generate context-aware text responses. Learn how to query SCX.ai vision models using either the OpenAI Python client.

Make a query with an image

On SCX.ai, the vision model request follows OpenAI’s multimodal input format which accepts both text and image inputs in a structured payload. While the call is similar to Text Generation, it differs by including an encoded image file, referenced via the image_path variable. A helper function is used to convert this image into a base64 string, allowing it to be passed alongside the text in the request.

Step 1

Make a new Python file and copy the code below.;

from openai import OpenAI
import base64

client = OpenAI(
    base_url="https://api.scx.ai/v1",
    api_key="your-scx-api-key",
)

# Helper function to encode the image
def encode_image(image_path):
  with open(image_path, "rb") as image_file:
    return base64.b64encode(image_file.read()).decode('utf-8')

# The path to your image
image_path = "sample.JPEG"

# The base64 string of the image
image_base64 = encode_image(image_path)

print(image_base64)

response = client.chat.completions.create(
    model="Llama-4-Maverick-17B-128E-Instruct",
    messages=[
        {
            "role": "user",
            "content": [
                {"type": "text", "text": "What is happening in this image?"},
                {"type": "image_url", "image_url": {"url": f"data:image/jpeg;base64,{image_base64}"}}
            ]
        }
    ]
)

print(response.choices[0].message.content)

Step 2

Use your SCX.ai API key and base URL from the API keys and URLs page to replace the string fields "your-scx-api-key" and "https://api.scx.ai/v1"in the construction of the client.

Step 3

Select an image and move it to a suitable path that you can specify in the lines.

python
# The path to your image
image_path = "sample.JPEG"

Step 4

Verify the prompt to pair with the image in the content portion of the user prompt.

Step 5

Run the Python file to receive the text output.