Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Copilot Studio Specialist / Conversational AI Designer to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary:

Contributors will evaluate and improve AI-generated conversational flows and responses within Copilot Studio, focusing on dialogue quality, logic, and task completion.

Consultant Engagement Terms (fixed):

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities:

Contributors will:

• Evaluate conversational AI outputs and flow logic
• Identify breakdowns in reasoning, intent handling, or task flow
• Improve responses for clarity, accuracy, and usability
• Label failure modes in AI interactions
• Provide structured evaluations and annotations
• Follow defined rubric frameworks

Expected Outcomes:

• Evaluated and improved conversational outputs
• Structured feedback on dialogue quality
• Annotated training data for AI improvement

Qualifications:

• Experience with Copilot Studio
• Strong understanding of dialogue design and user interaction flows
• Background in chatbot design, automation, or AI systems
• Ability to apply structured evaluation frameworks