Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Power Automate Support Engineer / Consultant to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary:

Contributors will evaluate and improve AI-generated support responses for Microsoft Copilot agents in Power Automate scenarios. Work includes analyzing flow issues, scoring AI outputs using structured rubrics, identifying root causes, and producing corrected responses to generate high-quality training data.

Consultant Engagement Terms (fixed):

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities:

Contributors will:

• Evaluate AI-generated support responses using defined rubrics
• Analyze Power Automate scenarios including flows, triggers, and run history
• Identify root causes of failures or incorrect behavior
• Rewrite or produce improved, user-ready support responses
• Provide structured justifications and annotations
• Label failure modes and gaps in AI reasoning
• Follow detailed project and quality guidelines

Expected Outcomes:

• Completed evaluations with rubric scores and justifications
• Root cause analyses for each scenario
• High-quality rewritten or ideal support responses
• Structured annotations suitable for AI training

Qualifications:

• 3–7+ years of hands-on experience with Power Automate
• Strong troubleshooting and debugging skills in production or support contexts
• Experience with support engineering, incident resolution, or similar workflows
• Familiarity with structured evaluation, QA, or rubric-based assessment
• Ability to communicate technical solutions clearly and concisely