AI Content Reviewer – Remote

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. The role is fully remote, allowing you to work with a global team while ensuring content meets accuracy, clarity, brand, and safety standards.

Key responsibilities

• Review AI‑generated text, image captions, and code for relevance, toxicity, bias, and factual integrity.
• Create high‑quality training datasets by labeling data according to strict guidelines.
• Audit junior reviewers or automated systems to maintain consistency with project rubrics.
• Collaborate with operations to refine style guides and annotation instructions.
• Identify model error patterns and provide detailed feedback to data scientists and engineers.
• Monitor metrics such as Inter‑Agreement Rate and F1 score to gauge review impact on model performance.

Required profile

• Minimum 2 years of experience in content review, moderation, fact‑checking, or quality assurance within tech or digital media.
• Ability to analyze complex information quickly and justify decisions under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience testing or providing feedback on generative AI models (e.g., ChatGPT, Bard, Midjourney).
• Background in linguistics, data annotation, or computational linguistics is a plus.

Required skills

• Familiarity with generative AI models (ChatGPT, Bard, Midjourney).
• Proficiency with data annotation tools and spreadsheet software.
• Understanding of evaluation metrics such as Inter‑Agreement Rate and F1 score.