LLM Providers

Overview

Atolio makes it easy to securely configure and manage access to commercial LLMs of your choice. Atolio supports multiple LLM models across different providers, allowing you to select the best model for your organization’s needs.

High-level Configuration Workflow

To configure an LLM provider, navigate to the administration panel at your Atolio deployment URL (e.g., https://search.example.com/admin) and select LLM Provider from the menu.

Atolio uses different models for different kinds of work, and supports a range of providers. Models are updated as improved ones become available. Per provider, the following is currently made available within Atolio. Select Configure for your provider’s setup steps:

Provider	Supported Models	Configuration
Anthropic	Sonnet 5.5 Haiku 4.5	Configure
AWS Bedrock	GPT-5.6 Sol GPT-5.6 Luna Sonnet 5.5 Haiku 4.5	Configure
Azure Foundry	GPT-5.6 Sol GPT-5.6 Luna	Configure
Google Gemini	Gemini Flash 3.6	Configure
OpenAI	GPT-5.6 Sol GPT-5.6 Luna	Configure

Configuring a Provider

Most providers require an API key. AWS Bedrock is the exception: it uses the IAM role of your AWS deployment instead. To enable a provider:

1. Open Atolio and head to the Admin panel
2. Select LLM Provider from the left-pane menu
3. Select the LLM Provider and follow the steps on its page, linked in the table above.

Multiple LLM Models

You can easily configure and manage multiple LLM providers within a single Atolio instance. While only one provider is active at a time, this flexibility enables you to test new providers, compare their performance, and maintain fallback options in case of credential expiration or service issues.

Key capabilities:

• Multiple Provider Support: Add as many LLM provider configurations as you need. Anthropic and AWS Bedrock share the same namespace, as do Azure and Azure OpenAI.
• Default Management: Easily switch between providers by setting any as the default with a single click. For existing systems, the first configured provider becomes the implicit default. When additional providers are added, the previous default is preserved.
• Protected Defaults: The currently active default provider cannot be removed to ensure continuity of service.

Changing Providers

As described in the Multiple LLM Models section, you can freely switch between configured LLM providers by setting a different provider as the default. This allows you to test new providers or change providers without requiring system reconfiguration.