Local when it matters. Cloud when it counts. | THRSP1065

Ajay Mungara presents Intel and Microsoft’s approach to combining local AI execution with Azure, using local models for speed, privacy, and efficiency while drawing on cloud capabilities for more sophisticated reasoning and enterprise scale.

Choosing where agent workloads run

The session focuses on routing agentic AI workloads rather than treating local and cloud execution as an either-or decision. Routing choices account for three factors:

Mungara discusses complexity, semantic, elastic, and escalation routing. Escalation routing starts with smaller models and moves to more capable models when needed, helping reduce token costs.

Agent workflows and cost optimization

An AI-generated presentation example uses 59 agents and includes cost tracking. The session also examines why total token spending can rise even as token prices fall, making workload optimization important.

Other topics include:

Enterprise deployment considerations

The closing segment addresses enterprise policies, security, confidential computing, and practical deployment guidance. These considerations sit alongside privacy, cost, and model capability when deciding how to combine local execution with Azure services.

Chapters

Session details and resources

Explore Windows next steps and resources.