Skip to content

deploy_customization.md

Latest commit

 

History

History
74 lines (47 loc) · 2.92 KB

deploy_customization.md

File metadata and controls

74 lines (47 loc) · 2.92 KB

Getting Started with Agents Using Azure AI Foundry: Deployment customization

This document describes how to customize the deployment of the Agents Chat with Azure AI Foundry. Once you follow the steps here, you can run azd up as described in the Deploying steps.

Disabling resources

Disabling a resource will stop that resource from being created and deployed to your Azure Project.

  • To disable AI Search, run azd env set USE_SEARCH_SERVICE false
  • To disable Application Insights, run azd env set USE_APPLICATION_INSIGHTS false
  • To disable Container Registry, run azd env set USE_CONTAINER_REGISTRY false

Once you disable these resources, they will not be deployed when you run azd up.

Customizing resource names

By default, this template will use a naming convention with unique strings to prevent naming collisions within Azure. To override default naming conventions, the following keys can be set:

  • AZURE_EXISTING_AIPROJECT_RESOURCE_ID - An existing AI Project Resource ID be used. If specified, resources for AI Foundry Project and Azure AI service will not be created.
  • AZURE_AIPROJECT_NAME - The name of the AI Foundry Project
  • AZURE_AISERVICES_NAME - The name of the Azure AI service
  • AZURE_STORAGE_ACCOUNT_NAME - The name of the Storage Account
  • AZURE_APPLICATION_INSIGHTS_NAME - The name of the Application Insights instance
  • AZURE_LOG_ANALYTICS_WORKSPACE_NAME - The name of the Log Analytics workspace used by Application Insights

To override any of those resource names, run azd env set <key> <value> before running azd up.

Customizing model deployments

For more information on the Azure OpenAI models and non-Microsoft models that can be used in your deployment, view the list of models supported by Azure AI Agent Service.

To customize the model deployments, you can set the following environment variables:

Using a different chat model

Change the agent model format (either OpenAI or Microsoft):

azd env set AZURE_AI_AGENT_MODEL_FORMAT Microsoft

Change the agent model name:

azd env set AZURE_AI_AGENT_MODEL_NAME gpt-4o-mini

Set the version of the agent model:

azd env set AZURE_AI_AGENT_MODEL_VERSION 2024-07-18

Setting capacity and deployment SKU

For quota regions, you may find yourself needing to modify the default capacity and deployment SKU. The default tokens per minute deployed in this template is 50,000.

Change the capacity (in thousands of tokens per minute) of the agent deployment:

azd env set AZURE_AI_AGENT_DEPLOYMENT_CAPACITY 50

Change the SKU of the agent deployment:

azd env set AZURE_AI_AGENT_DEPLOYMENT_SKU Standard
⚡