Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Buyer & Purchasing expert to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary:

Consultants will create and evaluate realistic procurement and sourcing scenarios to test and improve advanced AI reasoning. Work involves authoring real-world prompts, defining evaluation criteria, assessing AI responses, and producing expert-quality reference answers.

Consultant Engagement Terms:

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities:

Contributors will:

• Create realistic, complex procurement and sourcing prompts based on professional experience
• Define clear, objective rubrics to evaluate response quality
• Evaluate AI-generated reasoning against established criteria
• Produce gold-standard responses reflecting senior-level procurement judgment
• Follow project guidelines and quality standards consistently

Expected Outcomes:

• High-quality prompt packs with clear constraints and evaluation criteria
• Accurate, defensible expert evaluations of AI reasoning
• Gold responses suitable for model training and benchmarking

Qualifications:

• 10+ years of experience in procurement, sourcing, or supply chain roles
• Background in retail, manufacturing, or complex supply environments
• Strong written communication and analytical skills
• Ability to translate real-world work into structured, evaluable tasks
• Prior data annotation or AI evaluation experience is a strong plus