Setting Up AI Solutions in Foundry
Unlock the complete study guide + 1,040 practice questions across 16 full exams.
Bundled into the existing AI-103 premium course — no separate purchase.
14-day money-back guarantee — no questions asked.
Included in this chapter:
- Provisioning order and the capability host
- Standard agent setup and your own state stores
- Choosing a model deployment type
- Version upgrade policy and model retirement
- Choosing the agent runtime: prompt or hosted
- Agent versions and structured inputs
- Role assignments the setup depends on
- Network isolation for agent traffic
- Infrastructure as code and the release pipeline
- Holding the footprint in its desired state
- Designing agents to survive a dependency outage
The main Foundry deployment options, by decision axis
| Decision axis | Standard (pay-per-token) | Provisioned (PTU) | Batch | Managed compute | Instant access (preview) |
|---|---|---|---|---|---|
| Billing basis | Input and output tokens consumed | Reserved provisioned throughput units | Tokens at 50 percent less than Global Standard | Hourly per accelerator SKU | Tokens against a global quota pool |
| Capacity you must hold | Token quota only, no compute quota | PTUs, sized per model and version pair | A separate enqueued-token quota | Accelerator quota per SKU and region, separate from VM quota | Whatever global quota Global Standard deployments leave |
| Latency behaviour | Best effort; more variable at high sustained volume | Lower and more consistent | 24-hour target turnaround, no real-time SLA | Fixed by the accelerators you reserved | Best effort |
| Inference processing location | Global, data zone, or the deployment region | Global, data zone, or the deployment region | Global or data zone | Global only | Any Azure region |
| Documented fit | Variable, bursty online traffic | Consistent high volume needing predictable throughput | Large asynchronous jobs that are not time sensitive | Open-source and custom-weight models | Getting started, prototyping, trying a new model |
Decision tree
Cheat sheet
Unlock with Premium — includes all practice exams and the complete study guide.
References
- Set up standard agent resources for Foundry Agent Service
- Role-based access control for Microsoft Foundry
- Capability hosts for Foundry Agent Service
- Set up private networking for Foundry Agent Service
- Use your own resources in the Foundry Agent Service
- Deployment overview for Microsoft Foundry Models
- Understanding deployment types in Microsoft Foundry Models
- Foundry Models from partners and community
- Model versioning in Microsoft Foundry Models
- Hosted agents in Foundry Agent Service
- Customize agent behavior at runtime with structured inputs
- Explore Azure Developer CLI support for CI/CD pipelines
- How to run an evaluation in GitHub Action
- Observability in generative AI
- Implement CI/CD pipelines for multi-agent systems with GitHub Actions
- Understand scope in Azure Policy
- Details of the policy exemption structure
- Azure Policy definitions effect basics
- Remediate non-compliant resources with Azure Policy
- Retry pattern Well-Architected
- Cache-Aside pattern Well-Architected
- Circuit Breaker pattern Well-Architected