AWS Bedrock Integration
Connect AWS Bedrock to LLM Gateway for access to foundation models
AWS Bedrock is Amazon's fully managed service that provides access to foundation models from leading AI companies. This guide shows how to create AWS Bedrock Long-Term API Keys and integrate them with LLM Gateway.
Prerequisites
- An AWS account with Bedrock access enabled
- LLM Gateway account (Pro plan required for provider keys) or self-hosted instance (free)
Overview
AWS Bedrock supports Long-Term API Keys for simplified authentication. These keys provide direct API access without requiring IAM credentials or complex authentication flows.
Create AWS Bedrock Long-Term API Key
Enable Model Access in Bedrock
- Log into the AWS Console
- Navigate to AWS Bedrock service
- Go to Model access in the left sidebar
- Click Manage model access
- Enable the models you want to use (e.g., Claude 3.5, Llama 3)
- Wait for access to be granted (usually instant for most models)
Create Long-Term API Key
- In AWS Bedrock console, navigate to API Keys in the left sidebar
- Click Create Long-Term API Key
- Set expiry date ("Never expires" is recommended)
- Click Generate
- Important: Copy the API key immediately - it's only shown once!
Add to LLM Gateway
Navigate to Provider Keys
- Log into LLM Gateway Dashboard
- Select your organization and project
- Go to Provider Keys in the sidebar
Add AWS Bedrock Provider Key
- Click Add for AWS Bedrock
- Paste your Long-Term API Key
- Select Region Prefix based on where you want to use your models:
- us. - For US regions (
us-east-1
,us-west-2
) - eu. - For European regions (
eu-central-1
,eu-west-1
) - global. - For global/cross-region endpoints
- us. - For US regions (
- Click Add Key
The system will validate your key and confirm the connection.
Test the Integration
Test your integration with a simple API call:
curl -X POST https://api.llmgateway.io/v1/chat/completions \
-H "Authorization: Bearer YOUR_LLMGATEWAY_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "aws-bedrock/claude-3-5-sonnet",
"messages": [
{
"role": "user",
"content": "Hello from AWS Bedrock!"
}
]
}'
Replace YOUR_LLMGATEWAY_API_KEY
with your LLM Gateway API key.
Available Models
Once configured, you can access all AWS Bedrock models through LLM Gateway:
- Anthropic Claude:
aws-bedrock/claude-3-5-sonnet
,aws-bedrock/claude-3-5-haiku
- Meta Llama:
aws-bedrock/llama-3-2-90b
,aws-bedrock/llama-3-2-11b
- Amazon Titan:
aws-bedrock/amazon.titan-text-express-v1
- And more...
Browse all available models at llmgateway.io/models
Troubleshooting
"Model not available" error
- Verify you've enabled model access in AWS Bedrock console
- Check that the region where you created your key has access to the model
- Some models are only available in specific regions
Rate limiting
- AWS Bedrock has request quotas per model and region
- Monitor usage in AWS Bedrock console
- Consider requesting quota increases for high-volume workloads
How is this guide?
Last updated on