Foundry Tools
Foundry Tools is Microsoft's family of prebuilt AI APIs for speech, translation, language, document and content understanding, vision, search and content safety. Developers call them through REST APIs and SDKs without training a model. It was formerly called Azure AI Services and, before that, Cognitive Services.1
Also known as Azure AI Services, Azure AI services, Azure Cognitive Services, Cognitive Services
- Intended for
- Application developers, Data scientists and data engineers, Solution architects
- Runs on
- Azure public cloud regions (per tool), On-premises Docker containers for selected tools
At a glance
- What is it?
- Foundry Tools, formerly Azure AI Services and before that Cognitive Services, is a set of pretrained AI services that developers call through REST APIs and client SDKs. Learn lists Speech, Translator, Language, Content Understanding, Document Intelligence, Vision, Azure AI Search, Content Safety, Custom Vision and Immersive Reader. Microsoft's architecture guide describes each tool as targeting one capability, so an application can add a feature such as OCR or transcription without building a model, and notes that many tools share the same Azure resource type as Microsoft Foundry while remaining distinct products. Several older services are retired or scheduled for retirement and are not for new applications.123
- What does it do?
- The tools convert speech to text and text to speech, translate text across more than 100 languages and dialects, recognize entities and detect personal data in text, extract text, key-value pairs and tables from documents, turn documents, images and video into structured data, analyze images (including OCR and face detection), search company content and flag harmful content. Some tools train custom models on your own labeled data, many run in containers on premises, and many offer a free F0 tier for trials.13
- Who needs it?
- Application developers who need a specific, well-defined AI capability inside an app or workflow and do not need to choose models, orchestrate agents or train from scratch. Microsoft's architecture guide recommends considering Foundry Tools before building a custom model, and also names them as common building blocks for retrieval and agent solutions built in Microsoft Foundry.2
- What does it need?1
- An Azure subscription and a Foundry Tools or Foundry resource
- Microsoft Entra credentials or a resource key
- A region where the specific API is offered
- Labeled training data if you plan to build a custom model
- What it is not
- Foundry Tools is not the place for generative AI orchestration or agents; Microsoft's architecture guide says to work in Microsoft Foundry for models, agents and orchestration. It is not a training platform beyond each tool's customization options; for custom architectures Microsoft points to Azure Machine Learning. The rename changed the brand, not the services. Retired tools such as Language Understanding (LUIS), QnA Maker, Personalizer, Anomaly Detector, Metrics Advisor and Content Moderator are not options for new work.12
Availability and licensing. Generally available service family (Learn, checked 26 Oct 2026). Anomaly Detector, Content Moderator, Language Understanding (LUIS), Metrics Advisor, Personalizer and QnA Maker are marked retired and remain only for existing applications. Pricing is per transaction by tier, with a free F0 tier on many tools; new Azure accounts can try Azure free for up to 30 days. No prices are quoted here.3
The problem it solves
Many business applications need one narrow AI capability: read an invoice, transcribe a call, translate a message, describe an image or check text for harmful content. Training and hosting a model for each of these takes time and data science skills that most application teams do not have.
Foundry Tools offers these capabilities as managed APIs with tiered, per-transaction pricing, so a team can call them like any other web service and add customization only where a tool supports it.1
How it works
You create a resource in an Azure subscription and call the tool through its REST API or SDK with Microsoft Entra credentials or a resource key. The pricing tier sets the maximum transactions per second, the features enabled and the cost for a set number of transactions, with extra charges beyond that.
- Out of the box: send an image, audio file or document and receive results with no customization.
- Customization: some tools train custom models on your labeled data, and Custom Speech has CI/CD support through Azure DevOps and GitHub Actions.
- Containers: many tools run as Docker containers on premises to keep processing close to the data.
Security layers include Entra authentication, resource keys and Azure Virtual Networks. Learn lists Cloud Security Alliance STAR, FedRAMP Moderate and HIPAA BAA among the certifications.1
Diagram as a list
Copilot & business apps
- Application, workflow or agentSends data and receives AI results
AI models & platform
- Azure Speech and TranslatorAudio and language conversion
- Document Intelligence and Content UnderstandingStructured data from documents and media
- Azure Vision and Custom VisionImage and video analysis
- Azure LanguageEntities, personal data and classification
Developer tools
- Foundry Tools resource and REST or SDK endpointAuthenticated entry point with a pricing tier
Security, identity & governance
- Content SafetyHarmful content detection
Cloud & hybrid infrastructure
- On-premises containersSelected tools running near the data
Capabilities
Speech14
Speech to text, text to speech, speech translation and speaker recognition; Microsoft also delivers its MAI-Voice and MAI-Transcribe models through Azure Speech.
Why it matters: Adds transcription, captions and voice output to apps and voice agents.
Limits: Model and voice availability varies by region; custom voice training and hosting are billed separately.
Translator1
Machine translation covering more than 100 languages and dialects, including at-risk and endangered ones.
Why it matters: Supports multilingual apps and content without building translation models.
Limits: Quality varies by language pair; review output for regulated content.
Document Intelligence and Content Understanding35
Extract text, key-value pairs and tables from documents, and convert unstructured documents, images and video into structured data.
Why it matters: Automates data entry from forms, invoices and other files.
Limits: Content Understanding is not available in the new Foundry portal at GA and runs from the classic portal.
Language2
Named entity recognition, personal data detection and language detection, with custom text classification options.
Why it matters: Structures text for search, routing and compliance checks.
Limits: Generative tasks such as open-ended summarization fit Foundry Models better.
Vision and Custom Vision13
Image and video analysis, OCR and face detection, plus custom image recognition trained on your images.
Why it matters: Adds visual inspection and image understanding to apps.
Limits: Custom Vision models need labeled images for training.
Content Safety12
Detects unwanted or harmful content in user and AI generated text and images.
Why it matters: A safety layer for apps and agents that handle user content.
Limits: Microsoft's architecture guide now lists it as Content Safety in Foundry Control Plane, so documentation may use either name.
On-premises containers1
Many tools can run in Docker containers outside Azure datacenters.
Why it matters: Keeps processing close to data for compliance, security or operational reasons.
Limits: Not every tool is offered as a container; check the container support list.
Practical use cases
Staff retype data from invoices and forms into business systems.
- Approach
- Use Document Intelligence to extract fields and tables, then pass the results to a workflow.
- Role of Foundry Tools
- Foundry Tools performs the extraction.
- Data, infrastructure and skills
- Azure subscription, sample documents and a workflow or app to receive results.
- Type of benefit
- Less manual data entry
- Caveats
- Accuracy depends on document quality and layout; test with your own samples.
- First step
- Run a sample invoice through the Document Intelligence quickstart.
A support channel must serve customers in many languages, by text and voice.
- Approach
- Combine Translator with Azure Speech, or use Speech inside a Foundry voice agent.
- Role of Foundry Tools
- Foundry Tools provides translation, transcription and speech output.
- Data, infrastructure and skills
- Azure subscription and the languages and regions you need.
- Type of benefit
- Wider language coverage
- Caveats
- Language and voice coverage varies; review sensitive translations.
- First step
- Translate a set of real support messages and review the output.
Sources 6
A community platform needs to screen user posts for harmful content.
- Approach
- Send posts through Content Safety before publishing.
- Role of Foundry Tools
- Foundry Tools classifies harmful content.
- Data, infrastructure and skills
- Azure subscription and a moderation policy.
- Type of benefit
- Lower moderation risk
- Caveats
- Automated screening needs human review for edge cases.
- First step
- Test Content Safety on a sample of past posts.
Who uses it
Direct pojišťovna (part of the Direct group)
In productionDirect pojišťovna: AI agents for windshield claims
15 minutes to about 2 minutes (87% less) (measured)
Financial services, Czechia
Air India
In productionAir India: AI.g customer service agent on Azure OpenAI
about 40,000 (2026), up from an average of 30,000 (2024) (measured)
Travel and hospitality, India
EY
ScalingEY: Dynamics 365 Sales with agents, and Copilot across the firm
85,000 in 18 months; goal 100,000 (measured)
Professional services, Global
Works with
Optional integration
- Microsoft Foundry Agent ServiceVoice-based agents use Azure Speech in Foundry Tools when the architecture needs transcription or synthesis.
- Microsoft Power PlatformLearn names Power Automate and Logic Apps among the automation tools used with Foundry Tools.
Complementary tools
- Azure Machine LearningMicrosoft suggests Foundry Tools for preprocessing and retrieval and Azure Machine Learning to train and govern the custom model.
- Microsoft Foundry ModelsFor generative tasks Microsoft points to Foundry; MAI speech models are delivered through Azure Speech.
Same family
- Azure AI SearchLearn lists Azure AI Search among the Foundry Tools.
- Microsoft FoundryAzure AI Services were renamed Foundry Tools and are listed as part of Foundry.
Optional integration for
- Azure Database for PostgreSQLThe azure_ai extension calls Azure Language in Foundry Tools.
- Microsoft Foundry ModelsMAI-Voice and MAI-Transcribe models are delivered through Azure Speech in Foundry Tools.
Relationship labels follow Microsoft's documentation. "Alternative approaches" does not mean one is better: each profile says when it fits.
Getting started
Pick the right tool
Use Microsoft's architecture guide to match the task to a tool and confirm no custom model is needed.
Check: One tool covers the task without custom training.
Create a resource on the free tier
Create a Foundry Tools resource and choose the F0 SKU where the tool offers it.
Check: You have an endpoint and credentials for the resource.
Run a quickstart
Call the tool with the quickstart in your language using a sample file.
Check: The API returns the expected JSON result.
Harden for production
Switch to Microsoft Entra authentication and virtual network rules, and pick a paid tier that fits your transaction volume.
Check: Requests succeed with Entra credentials from your production network.
Avoid retired services
Check that the design does not use Anomaly Detector, Content Moderator, LUIS, Metrics Advisor, Personalizer or QnA Maker.
Check: The architecture uses only tools listed as available.
Official resources
Deciding whether you need it?
Three free tools apply Microsoft's own published guidance to your situation, and say when Foundry Tools or any new technology is not needed.
Sources
Each statement above links to the source it comes from. Labels say who reported it.
- What are Foundry Tools? (opens in a new tab)
- AI and machine learning products (Azure Architecture Center) (opens in a new tab)
- Foundry Tools product page (opens in a new tab)
- Foundry Models sold by Azure - Microsoft Foundry (opens in a new tab)
- Microsoft Foundry portal general availability overview (opens in a new tab)
- What is Microsoft Foundry Agent Service? (opens in a new tab)
Thank you. Your correction was sent.
The editors check it against the sources. If you left an email address, they may reply about it.