April from Microsoft Developer demonstrates how to use the Browser Automation Tool in Azure AI Foundry, showing step-by-step browser task automation with AI and Playwright Workspaces.

Browser Automation Tool (Preview) in Azure AI Foundry

In this video, April from Microsoft Developer demonstrates the Browser Automation Tool (Preview) integrated into Azure AI Foundry. The tool enables users to automate complex browser tasks by simply providing natural language instructions to an agent powered by Azure's AI capabilities.

Key Highlights

• Natural Language Task Automation: Submit requests in plain English and an agent interprets and executes browser tasks accordingly.
• Playwright Workspaces Integration: Sessions are powered by Playwright Workspaces, running directly within your Azure subscription for enhanced security and isolation.
• Automated Page Interaction: The AI model analyzes web page structures, decides actions, and executes them step-by-step, dynamically adapting if the page changes during the process.
• Practical Walkthrough:
  1. Create Playwright Workspace Resource: Learn how to set up the foundational environment for browser automation.
  2. Connect Playwright Workspace in Foundry: Integrate your resource with Azure AI Foundry to start developing automation flows.
  3. Run Sample Code in VS Code: See an example in Visual Studio Code demonstrating how automation is triggered and monitored across your session.
• Security and Isolation: Each browser automation session runs in its own isolated workspace to protect data and ensure secure operations.

Get Started

• Try the Browser Automation Tool (Preview) at ai.azure.com
• Learn more: Browser Automation Tool Documentation

Community Links

• Join discussions on Discord
• Visit the community Forum

Chapters

• 0:00 - 1:30 Intro
• 1:31 - 4:09 Create the Playwright Workspace resource
• 4:10 - 5:24 Connect the Playwright Workspace resource in Foundry
• 5:25 - 11:07 Run the sample code in VS Code
• 11:08 - 11:36 Outro

This episode shows the accessibility and flexibility of Azure AI's latest automation features, providing developers a quick way to build and test browser workflows using powerful Microsoft AI services.