Day in the life of AI Engineer: With a Demo
Anthony Sofio walks through what AI engineering looks like in practice, using a real end-to-end demo of a production-style generative AI app built with Microsoft Agent Framework and Azure AI Foundry, including multi-agent orchestration, RAG, evaluation, and safety/observability patterns.
Overview
This episode of Sip N’ Sync with Azure features Priyanka Vergadia interviewing Anthony Sofio about a practical, end-to-end AI engineering project built on Microsoft’s AI stack.
What the session covers
Day-to-day AI engineering (vs traditional software engineering)
- How AI engineering work differs from “standard” app development when outputs are non-deterministic.
- The shift toward multi-agent and multimodal systems for production-ready AI apps.
End-to-end demo: a generative AI children’s story app
Anthony demonstrates a personal project built for his kids: a generative AI app that uses multiple agents to:
- Create story outlines
- Generate illustrations
- Review content
- Add interactive activity pages
The app combines multiple modalities, including text, images, and text-to-speech.
Multi-agent orchestration with Microsoft Agent Framework
- Designing and orchestrating multi-agent workflows using Microsoft Agent Framework.
- Using conditional and parallel execution to control complex workflows.
Retrieval-Augmented Generation (RAG)
- How RAG can bring external knowledge into AI applications.
Observability, tracing, and debugging
- Tracing, monitoring, and debugging AI applications with OpenTelemetry.
- Using AI Toolkit for VS Code as part of the workflow.
Evaluation techniques
- Evaluating prompts and agents using LLM-as-a-judge techniques.
Safety and guardrails
- Applying content safety and guardrails for enterprise scenarios and child-friendly use cases.
Resources
- AI Engineer Persona Samples (GitHub): https://github.com/Azure-Samples/AIEngineerPersona
- Microsoft Agent Framework docs: https://learn.microsoft.com/agent-framework/
- Microsoft Agent Framework (GitHub): https://github.com/microsoft/agent-framework
- AI Toolkit for VS Code: https://aka.ms/aitoolkit
- Sip N’ Sync with Azure playlist: https://aka.ms/SipAndSyncPlaylist