26.2 26.1
26.2 26.1

Providers

An LLM provider connects the account of a company that supplies large language models (LLMs), for example OpenAI, to the Agent Gateway of one platform. The LLM provider holds the provider API Key: the API Key of that account. The Agent Gateway uses the provider API Key for each call to the LLM provider.

Agents never get the provider API Key. They call the LLM provider with a virtual API Key, which belongs to one LLM provider. Refer to Virtual Keys for details on virtual API Keys, and to Agent Gateway for an overview of the Agent Gateway.

Overview on the Providers View

To open the list of LLM providers, click Providers in the Governance group of the sidebar. The Providers view shows the LLM providers of all platforms on which you have access to the Agent Gateway. Each row of the table is one LLM provider of one platform.

The view consists of the following parts:

1 one circle orange The Search Bar

2 two circle orange The Filters

3 three circle orange The Providers Table

4 four circle orange The Pagination Controls

Click New Provider to create a new provider. Refer to Creating a Provider for details.

image-20261104-143514.png

The Search above the table narrows the list to the items that match your search term. Refer to Working With the Control Hub for details on searching, filtering, and sorting.

The Filters

Various filters are available next to the search bar. Refer to Working With the Control Hub for details on filtering, searching, and sorting.

The Providers Table

The table lists one row per provider. It shows the following columns:

Column

Description

Name

The name of the LLM provider, and its provider type below it. Click the name to open the Provider Details page. Refer to Managing a Provider for details.

Provider API Key

The last four characters of the provider API Key, for example …4f2a. The Control Hub never shows more of the provider API Key.

Default Model

The model that a call without a model goes to. The column shows none if the LLM provider has no default model.

Platform

The platform of the LLM provider.

Virtual API Keys

The number of virtual API Keys of the LLM provider. Click a number greater than 0 to open the Virtual Keys view, filtered to this LLM provider. A dash (–) shows that the number is not known: you do not have permission to read the virtual API Keys of the platform, or they could not be read.

The Pagination Controls

The pagination controls below the table split the list into pages. They appear when at least one entry in the content table exists. Refer to Working With the Control Hub for details.

Required Permissions

Each action needs a permission (scope) on the platform of the LLM provider. The connection test is an exception: it needs its scope on at least one platform. An action that is unavailable because you do not have its permission shows You do not have the necessary permissions for this action. when you point at it.

Action

Scope

Without the Scope

See the LLM providers

agent-model-providers-read

The LLM providers of the platform are not shown.

Add an LLM provider

agent-model-providers-create

The platform is not offered.

Test the connection

agent-model-providers-create on any platform

The test shows The connection could not be tested.

Change an LLM provider

agent-model-providers-update

The fields are locked. Test Connection, Discard Changes, and Save Changes are unavailable.

Remove an LLM provider

agent-model-providers-delete

Remove Provider is unavailable.

See the number of virtual API Keys

agent-model-virtual-keys-read

The table and Virtual Keys show a dash (–). The dialog Remove Provider lists no virtual API Keys.

Refer to Agent Gateway for the permission that opens the Agent Gateway pages.

📗