#

Microsoft AI Builder

Senior Designer | Paris, FR

AI Builder is a simple, point-and-click tool within the Microsoft Power Platform that helps non-technical users bring machine learning into their business and use AI to automate processes and predict outcomes.


Challenges
  • The Power Platform needed a simple way to augment their tools with AI
  • Non-technical users needed to confidently create and use AI models
Actions
  • Simplified the model creation process with a step-by-step wizard and contextual guidance
  • Created the UX for prebuilt and custom AI models
  • Used research and a data-driven approach for feature release planning
Results
  • Launched AI builder at Power Platform summit
  • Engagement growth increased month over month
  • Empowered non-technical users to leverage AI without needing coding skills
AI Builder build page

The challenge

Since most AI Builder users lack a data science background, the UX needed to be intuitive and approachable to build user trust in the technology. Regular user studies and customer interviews were essential for keeping our designs aligned with these goals.

AI Builder chart

User flows & wireframes

Designing new AI Builder features required extensive exploration before finalizing designs. I often led brainstorm sessions with our broader team to generate innovative ideas. From these sessions I developed user flows and wireframes that guided the team toward the most effective design directions.

AI Builder brainstorm Conducting a brainstorm session for a new AI template. AI Builder user flow
AI Builder wireframe
AI Builder wireframe
AI Builder wireframe Early wireframe explorations for discovering and creating an AI model.

Research

AI Builder benefits from a dedicated UX research team, which conducts user studies, creates benchmark reports, and collects customer feedback. Product research always shapes and informs the direction of my design work.

AI Builder persona map AI Builder persona tools Persona maps paint a clear picture of the journey our users go through.
AI Builder research insight
AI Builder research insight
Research insights from Prediction model user studies.

The launch

AI Builder launched in June 2019 to an enthusiastic crowd of Power Platform users. The excitement and positive feedback motivated us to continue refining and expanding its capabilities. AI Builder has since delivered measurable value to the Power Platform business, extending the potential of Power Apps and Power Automate.

AI Builder launch
AI Builder announced at the Microsoft Business Applications Summit - June 2019
AI Builder Build page
AI Builder home page with all AI templates and prebuilt models to explore
AI Builder Get Started AI template modal window with instructions for creating and using the model
AI Builder Get Started
AI Builder Wizard
The AI Builder Prediction model multi-step 'wizard' to help users create predictions based on historical data
AI Builder Wizard AI Builder model details page
After a model is trained, the details page allows the user to review results and then use it in an app or a flow
AI Builder Studio
Trained and published models are available to add to apps created in the Power Apps studio
AI Builder Business Card App
AI Builder Business Card App
AI Builder Business Card App
Business Card Reader app example with built in AI Builder model extracting contact information from a business card photo

CASE STUDY

Form Processing AI template

The Form Processing AI template is a custom model that speeds up data entry by extracting and organizing data from documents such as invoices and tax forms.

Challenges
  • Data showed a 42% drop off on step 2
  • Auto detected fields would frequently make mistakes and capture text incorrectly
  • Users wanted more control in the UX
Actions
  • Dedicated a week-long design sprint to understand and fix the problem
  • I led brainstorming sessions to generate ideas
  • Used wireframes, prototypes, and user research to lead a successful solution
Results
  • Improvements to the UX saw an immediate 30% increase in the model completion rate
  • Solved user problems quickly and effeciently
AI Builder user study

1.Understanding the problem

To successfully create a working Form Processing model, users needed to complete four basic steps. However, telemetry data showed a 42% user drop off at step two.

Problem: Auto detected fields doesn't always capture the correct text
Challenge: Design a new UX that lets users select and edit both auto-detected and manually chosen fields

AI Builder step1

1. Import multiple document samples for the model to use

AI Builder step1

2. Select which auto detected text fields the model should extract

❗️ 42% user drop off

AI Builder step1

3. Train your model using the selected text fields

AI Builder step1

4. Publish your model and use it in apps and flows

2.Brainstorming

I led a brainstorming session to generate a wide range of ideas. After voting, we selected two promising directions to test with users. Although design is rarely a linear process, these steps illustrate how I approach creating a design solution that solves real customer problems.

AI Builder sketch

3.Sketching & Whiteboarding

My initial sketches focused on educating users about the new feature and guiding them through the required selection steps. A whiteboarding session helped refine the chosen direction and fill gaps in the user flow.

AI Builder sketch AI Builder whiteboard

4.Prototyping

After finalizing the flow, our team built the concept in Figma, collaborating to create all required screens for a complete design. We developed a working Figma prototype to test the experience with customers.

AI Builder user flow

5.User interviews

Within a day, the prototype was ready for testing and our research team presented to users to gather feedback. The reception was very positive and with minor adjustments, we released our update.

AI Builder user study

6.Updated release

The improved version of Form Processing launched in spring 2020. Customers welcomed the update, and the success rate for completing form processing models increased by ↑ 30%.

AI Builder Forms wizard
AI Builder Forms wizard
AI Builder Forms wizard
AI Builder Forms wizard
AI Builder wizard AI Builder model details page