Azure Integration

Create an Azure OpenAI Resource

1. Log into the Azure Portal (https://portal.azure.com)
2. Click Create a resource
3. Search for Azure OpenAI and select it
4. Click Create
5. Configure the resource:
   • Subscription: Select your Azure subscription
   • Resource group: Create new or select existing
   • Region: Choose a region (e.g., East US, West Europe)
   • Name: Enter a unique resource name (this will be your <resource-name>)
   • Pricing tier: Select Standard S0
6. Click Review + create, then Create
7. Wait for deployment to complete

Important: Note your resource name - it will be used in the base URL: https://<resource-name>.openai.azure.com

Deploy Models

1. Navigate to your Azure resource in the Azure Portal
2. Click Go to Azure OpenAI Studio or visit https://oai.azure.com
3. In Azure Studio, select Deployments from the left sidebar
4. Click Create new deployment
5. Configure your deployment:
   • Model: Select a model (e.g., gpt-4o, gpt-4o-mini, gpt-4-turbo)
   • Deployment name: Enter a name (this must match the model identifier you'll use – use the pre-filled name)
   • Model version: Select the latest version
   • Deployment type: Global Standard
6. Click Create
7. Repeat for additional models you want to use

Note: The deployment name must match the expected model name:

• For gpt-4o-mini → deployment name should be gpt-4o-mini
• For gpt-35-turbo → deployment name should be gpt-35-turbo etc.

Get API Key

1. In the Azure Portal, go to your Azure resource
2. Click Keys and Endpoint in the left sidebar
3. Copy Key 1 or Key 2
4. Note your Endpoint URL (should be https://<resource-name>.openai.azure.com)

Important: Keep your API key secure - it provides access to your Azure deployments.

Navigate to Provider Keys

1. Log into LLM Gateway Dashboard
2. Select your organization and project
3. Go to Provider Keys in the sidebar

Add Azure Provider Key

1. Click Add for Azure
2. Enter your API Key from Azure Portal
3. Enter your Resource Name (the name from your Azure endpoint URL)
   • Example: If your endpoint is https://my-openai-resource.openai.azure.com, enter my-openai-resource
4. Select your preferred type (Azure OpenAI or AI Foundry)
5. Adapt the Validation Model to a model that you already deployed and is available This is a one time check to ensure the API key is valid and the model can be accessed.
6. Click Add Key

The system will validate your key and confirm the connection.

Test the Integration

Test your integration with a simple API call:

curl -X POST https://api.llmgateway.io/v1/chat/completions \
  -H "Authorization: Bearer YOUR_LLMGATEWAY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "azure/gpt-4o-mini",
    "messages": [
      {
        "role": "user",
        "content": "Hello from Azure!"
      }
    ]
  }'

Replace YOUR_LLMGATEWAY_API_KEY with your LLM Gateway API key.