Project Overview:
Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.
We are seeking a skilled senior enterprise IT leader
to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.
Location:
U.S.-based experts only
Engagement:
Part-time, project-based expert evaluation work
Work Type:
Remote
Project Summary:
Consultants will create realistic, domain-specific enterprise IT prompts, define evaluation rubrics, assess advanced LLM responses, and author high-quality reference answers grounded in real-world infrastructure and operations experience.
Consultant Engagement Terms:
This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).
Responsibilities:
Contributors will:
• Author complex, realistic enterprise IT prompts based on lived professional experience
• Design structured, criteria-based rubrics to evaluate AI responses
• Evaluate LLM outputs against expert-defined standards
• Identify reasoning gaps, risks, and missing considerations in model responses
• Produce “golden” responses reflecting best-in-class professional judgment
Expected Outcomes:
• High-fidelity enterprise IT prompts
• Clear, multi-criteria evaluation rubrics
• Documented expert evaluation of model responses
• Authoritative reference answers suitable for model training and benchmarking
Qualifications:
• 10+ years of experience in enterprise IT, engineering, or systems leadership
• Background in complex IT environments (cloud, infrastructure, operations, security)
• Experience as CIO, CTO, IT Director, Head of IT, Engineering Manager, or Solutions Architect
• Strong analytical writing and structured reasoning skills
LinkedIn Global Data Privacy Notice for Job Candidates: https://legal.linkedin.com/content/dam/legal/Global-Data-Privacy-Notice_LI_TalentCommunity.pdf