Skip to main content
4 min read

Organization LLM Providers

LLM Providers

Manage the LLM providers and models available to agents across your organization.

Open Settings → Organization Settings → LLM Providers.

Available for roles: Admin

Scope: Organization

What this controls

Organization LLM providers are shared at the tenant level. Agents in every workspace can use providers you configure here, unless a workspace is set up to use its own providers.

Catalog

  1. Search providers and filter by type (All types, or a specific type such as OpenAI).
  2. When no providers exist, the empty state reads No LLM providers connected.
  3. Table columns: Provider, Type, Models, and Created.

Add a provider

  1. Click New provider and choose a type: Amazon Bedrock, Anthropic, Gemini, or OpenAI.
  2. The wizard title is Add OpenAI (or the type you picked). Steps: Credentials, then Models.
  3. Credentials subtitle: Connect this provider with an API key from Vault.

Step 1. Credentials

FieldRequiredExample
Provider nameYesdocs-capture-openai (placeholder example: openai-prod)
Vault credentialYes (when using vault)Select an existing Vault secret for that provider type
API keyYes (when adding new credentials)Placeholder key for docs capture only; do not use a real production key in examples
Base URLNohttps://api.openai.com/v1 (prefilled for OpenAI)
API versionNoLeave empty for standard OpenAI; required for Azure OpenAI (for example 2024-02-01)
  1. Enter a unique Provider name.
  2. Choose Select from vault to pick an existing credential, or Add new credentials to store a new API key in Vault.
  3. Complete any provider-specific fields shown for that type (for example Bedrock auth method).
  4. Click Continue to create the provider and move to models, or Cancel to discard.

Step 2. Models

Choose which models to register for this provider.

  1. Select one or more models to register (at least one).
  2. Click Add provider to finish, Back to return to credentials, or Cancel to close.

Manage an existing provider

From the row actions menu:

ActionWhat it does
Edit providerUpdate provider settings
Delete providerOpens Delete provider? Confirm to permanently remove the provider and its credentials. Agents and workflows that use it lose access. This cannot be undone.

Click a provider row to open details, including registered models.

For workspace-scoped LLM configuration, see LLM Providers under Workspace Settings.