AWS Bedrock

Atolio can use models hosted on Amazon Bedrock. Bedrock does not use an API key: Atolio must be deployed on AWS, and it calls Bedrock as the Marvin service role marvin_svc_act. The Atolio Terraform deployment already grants this role permission to invoke Bedrock models.

Steps

1. Enable the model in Bedrock.
2. For AWS Marketplace models only, grant Marketplace permissions.
3. Enable AWS Bedrock in Atolio.

Enable the Model

In the AWS console, open the Amazon Bedrock playground and invoke the selected model once. This enables the model for your account and accepts its terms of use.

Grant Marketplace Permissions

Skip this step unless the selected model is an AWS Marketplace model, for example a third-party model with Marketplace billing.

Append the following statement to the existing marvin_svc_act role:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "aws-marketplace:ViewSubscriptions",
                "aws-marketplace:Subscribe"
            ],
            "Resource": "*"
        }
    ]
}

Configure Atolio

1. In Atolio, open the Admin panel and select LLM Provider.
2. Choose AWS Bedrock, select the model family (Anthropic or OpenAI), and enable it. The region is selected automatically from the region Atolio is deployed in.

For more details, see the Amazon Bedrock User Guide.

Note: Anthropic and AWS Bedrock share the same namespace. See Multiple LLM Models.