Skip to main content
A Provider is an LLM endpoint the engine talks to. One provider can expose many Models. Providers are managed in Command Center → Settings → Providers, scoped to your tenant.
Viewing the catalog is open to any tenant user; only tenant-level users can add, edit, or delete providers. See Users & Organizations.
Providers catalog

​
Fields

FieldRequiredDescription
KeyYesShort identifier, unique within your tenant. Example: openai, cloudtemple
Provider typeYesIntegration used to reach the provider — see Provider types
Base URLCompatible & Azure typesEndpoint root. Required for compatible/Azure types; leave empty for native types
API Key Var NameWhen auth is requiredName 2501 resolves to find the secret — see API key resolution
Requires auth—On by default. Turn off for endpoints with no key (e.g. self-hosted on a private network)
Enabled—Disabling makes all of its models unavailable without deleting anything

​
Provider types

FamilyTypesNotes
Nativeopenai, anthropic, mistral, deepseek, cohere, openrouter, togetheraiBuilt-in integrations. No endpoint URL needed.
Compatibleopenai-compatible, anthropic-compatible, azurePoint at any API-compatible endpoint via a Base URL
Use a compatible type to register a self-hosted model server (vLLM, Ollama, LM Studio) or any vendor exposing an OpenAI- or Anthropic-style API.
Adding a new endpoint of an existing type is pure configuration. Adding a brand-new type (a vendor with its own API shape) requires a 2501 release — contact your Account Executive.

​
API key resolution

The API key is resolved at runtime in two steps:
  1. 2501 looks for a tenant-scoped Credential matching the API Key Var Name.
  2. If none exists, it falls back to an environment variable of the same name on the engine.
This lets you rotate keys in the UI without touching the engine environment. When you save the provider, the dialog checks that the key resolves and warns if it cannot be found.
The matching Credential must be tenant-scoped for the engine to resolve it. A credential restricted to a specific organization will not be found. Leave the Organization field unset so the credential is created as Tenant, not Org.
Providers that do not need a key (e.g. a self-hosted model on a private network) can turn off Requires auth.

​
Azure settings

For the azure type, two extra fields appear:
FieldDefaultDescription
API Version2025-04-01-previewThe Azure OpenAI API version to target
API ModechatWhich API surface to call: chat, responses, or completion
Azure API Management (APIM) gateways are supported as the endpoint: set the Base URL to your APIM gateway URL to route model traffic through it for centralized policy, rate limiting, and logging.

​
Deletion rule

A provider that still has models cannot be deleted. Remove or reassign its models first, or simply disable the provider instead.

​
Deploy-time seeding

On deploy, the installer seeds providers from API keys detected in the engine environment. After that, management moves to Command Center — no engine restart needed for additions or edits.