Or read your CV against this role — about fifteen seconds, no account.
AI/ML
AI Trainer & Evaluator
Why we like this role
A practical AI role for someone who can turn model behavior into precise feedback. The best fit is a person who enjoys careful evaluation work as much as building the system itself. The posted range is $20-40/hour.
About this opportunity
Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.
Key Responsibilities:
- Evaluate and score AI-generated responses using well-defined rubrics and metrics across diverse subject areas.
- Annotate and categorize data sets to improve AI model accuracy and reliability.
- Apply keen attention to detail in reviewing content for relevance, coherence, and factual accuracy.
- Provide clear, actionable feedback on AI performance to inform ongoing model improvements.
- Collaborate with the customer's team to interpret guidelines and contribute to rubric refinement.
- Document findings and maintain meticulous records of annotations and evaluations.
- Engage in critical reading and analysis of complex subject matter ranging from business and finance to marketing, healthcare, and legal domains.
Required Skills and Qualifications:
- Exceptional attention to detail and accuracy in data annotation and content evaluation.
- Strong critical reading and analytical skills with the ability to interpret and apply rubrics.
- Proficiency in written and verbal communication; ability to articulate nuanced feedback clearly.
- Bachelor’s degree required.
- Experience in evaluating or scoring large volumes of content against detailed criteria.
- Experience with AI training, machine learning data annotation, or related tasks is highly valued.
- Ability to work independently and collaboratively in a fully remote environment.
Preferred Qualifications:
- Background in business, finance, legal, marketing, healthcare, or research fields.
- Prior experience in AI training, human-in-the-loop systems, or quality assurance of AI-generated content.
- Familiarity with industry-standard annotation tools or AI evaluation platforms.
Required skills
- Attention to Detail
- Rubrics
- Critical Reading
- AI Training
- Content Evaluation
You might also like
DevOps Engineer
A full-time, US-remote DevOps role with a genuinely strong package — $160–220k base, equity, and up to full health-premium reimbursement. Five years of Azure-centred DevOps expected; Kubernetes and Docker are daily tools.
- $160,000–$220,000 / year
- Remote — US only
- Full-time
- 1 opening
View roleData Partnerships Lead
Build the data-partnerships function from the ground up: strategy, team, and the playbooks that scale it. A full-time leadership role at $130–180k base with equity, for an operator who has built partnership programs before.
- $130,000–$180,000 / year
- Remote — Worldwide
- Full-time
- 1 opening
View role
If this role suits you.
Apply now