Agent Hub Overview

The Agent Hub is where you can connect various kinds of models and configure them to work with your project annotations. You can set up a model’s credentials based on the provider, and use those credentials to connect it to your team.

Models connected this way can be used in Multimodal forms either while annotating or through Explore.

Connect a model

To connect a model:

1. From the left panel, go to the Agent Hub.
2. In the Models tab, click + Connect.
3. Type the name of your model connection.
4. Type the description of your model connection (optional).
5. Select a provider: OpenAI, Anthropic, or Gemini.
6. Select the Model from the list available by the provider.
7. Select the model’s Credentials.
8. Under Instructions, type the system prompt that the model should operate on to define its behavior, personality, tone, and approach to tasks.
9. Define the following information based on what is applicable to your selected model:
   • Select the model’s Reasoning effort: Minimal, Low, Medium, or High. Reducing reasoning effort can result in faster responses and fewer tokens used on reasoning in a response. Increasing reasoning effort can result in slower, but higher quality responses, using more tokens.
   • Select the model’s Verbosity: Low, Medium, or High. Lower levels yield shorter answers.
   • Select the model’s Temperature to control its randomness. Lowering the temperature results in less random completions. As the temperature approaches zero, the model will become deterministic and repetitive.
   • Enter the Max tokens to define the total number of words and punctuation used.
   • Enter the Timeout in seconds to define how long the request is pending before it gets canceled. This ensures that it doesn’t wait for the model’s response indefinitely.
   • Enter the Max retries to define how many times the system will retry a request if it fails due to timeouts, rate limits, connection limits, or other temporary issues.
10. Choose the model’s response format:
    • Text: The response will be delivered in a text format. (Default)
    • Structured Output: The response will be delivered based on a JSON schema. You can provide the schema to define the structure of the model’s response format yourself. The schema must always include the mandatory keys: name, description, type (which must always be “object”), and properties. When you’ve made your changes, you can apply them by clicking Save.
11. Add a function under Tools which the model can make use of based on the input received from the user. You may have up to 20 functions in each connection at a time.
12. When you’re done, click Connect.

Validate connection

To validate your model connection:

1. In the Agent Hub, find your connection.
2. Click the three dots ⋮.
3. Select Check connection.

🚧

Validating your connections

If there are any issues with the connection’s credentials (i.e. your tokens were exhausted), validation will fail.

Response Format

When you call your AI model from a Pipeline (coming soon) via SuperAnnotate, we forward your request to the configured AI model, then return the response in a consistent JSON format so it’s easy to handle in your applications.

Each response contains the following fields:

Text

Example of a response where response format is text.

{
    "content": "SuperAnnotate is consistently ranked the #1 Data Labeling platform on G2, driven by passionate customers and concrete results.",
    "response_type": "text",
    "timestamp": "2025-08-26T06:15:53.372046Z",
    "model_used": "gpt-5",
    "agent_used": "Chatgpt",
    "tool_calls": [],
    "tokens_used": 99
}

JSON schema

Use this checklist to make sure your JSON passes standard validation rules:

1. Required fields present: name, description, type, and properties are all required.
2. Strings: Both name and description must be strings (e.g., "project_name").
3. Type key: Type value must be "object" at the root level.
4. Properties: Must be an object containing at least one field.
5. Each field in properties must be:
   • Either an object with type defined, OR
   • A Boolean (true/false).
6. Unique keys: No duplicate property names allowed.

{
  "name": "Book Metadata",
  "description": "Provide the book's title to receive its metadata",
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "authors": {
      "type": "array",
      "items": {
        "type": "string"
      }
    },
    "abstract": {
      "type": "string"
    },
    "keywords": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "title",
    "authors",
    "abstract",
    "keywords"
  ]
}

Example response of a structured output:

{
    "content": {
        "title": "The Lean Startup",
        "authors": [
            "Eric Ries"
        ],
        "abstract": "The Lean Startup is a methodology for developing businesses and products with maximum capital efficiency and validated learning. It advocates iterating rapidly through Build-Measure-Learn cycles, focusing on minimum viable products (MVPs), actionable metrics, and continuous deployment to reduce waste and increase the odds of product-market fit.",
        "keywords": [
            "Lean Startup",
            "MVP",
            "Build-Measure-Learn",
            "validated learning",
            "pivot",
            "innovation accounting",
            "continuous deployment",
            "startup methodology"
        ]
    },
    "response_type": "json_schema",
    "timestamp": "2025-08-26T06:11:16.084436Z",
    "model_used": "gpt-5",
    "agent_used": "My_Chatgpt_Agent",
    "tool_calls": [],
    "tokens_used": 331
}

Tools

This JSON object corresponds to the tools argument in the OpenAI API. Currently, functions are the only supported tool type.

The tool choice is always set on “auto”, which lets the model choose when to call the function.

Each tool definition must include the following mandatory keys:

• name – A unique name for the tool.
• description – A short explanation of the tool's purpose.

We recommend also including the parameters key to define the input schema. Providing this key ensures the function can return a non-empty object when called.

An example of a function:

{
  "name": "get_weather",
  "description": "Determine weather in my location",
  "strict": true,
  "parameters": {
    "type": "object",
    "properties": {
      "location": {
        "type": "string",
        "description": "The city and state e.g. San Francisco, CA"
      },
      "unit": {
        "type": "string",
        "enum": [
          "c",
          "f"
        ]
      }
    },
    "additionalProperties": false,
    "required": [
      "location",
      "unit"
    ]
  }
}

Example response when a tool call is made:

{
    "content": null,
    "response_type": "json_schema",
    "timestamp": "2025-08-26T05:47:51.965671Z",
    "model_used": "gpt-5",
    "agent_used": "My_Chatgpt_Agent",
    "tool_calls": [
        {
            "name": "get_weather",
            "content": {
                "unit": "f",
                "location": "San Francisco, CA"
            }
        }
    ],
    "tokens_used": 239
}

Edit connection

To edit your model connection:

1. In the Agent Hub, find your connection.
2. Click the three dots ⋮.
3. Select Edit.
4. Make your changes accordingly. You can edit everything except for the Provider.
5. Click Save.

🚧

Editing your connections

If there are any issues with the connection’s credentials (i.e. your tokens were exhausted), editing will not take effect.

Duplicate connection

To duplicate your model connection:

1. In the Agent Hub, find your connection.
2. Click the three dots ⋮.
3. Select Duplicate.
4. Type the name of the connection duplicate.
5. Click Duplicate.

🚧

Duplicating your connections

You cannot duplicate a connection if you’ve already reached the maximum of 200 per team. If there are any issues with the connection’s credentials (i.e. your tokens were exhausted), duplication will not take effect.

Delete connection

To delete your model connection:

1. In the Agent Hub, find your connection.
2. Click the three dots ⋮.
3. Select Delete.
4. In the pop-up, click Delete.

🚧

Keep in mind

Any projects using this connection will be affected and may become invalid.