Search Quality Evaluator (AI Training)

About the role

Aligner is looking for Search Quality Evaluators to assess search engine results, AI-generated answers and content recommendations, helping ensure that AI systems are accurate, relevant and useful. This is a fully remote, flexible hourly contract of 10 to 40 hours per week, open to anyone with a reliable internet connection, good judgment and a commitment to thorough work; no technical or AI background is required.

Key responsibilities

• Evaluate search engine results for relevance, accuracy and usefulness to the searcher's intent
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple results and rank them by quality and helpfulness
• Provide clear, concise written explanations to support your ratings
• Work through batches of tasks independently at your own pace and on your own schedule
• Cover a wide range of topics, from everyday queries to news, science and culture

Required profile

• Comfortable using search engines and navigating the web
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented, with a systematic, methodical approach
• Strong written communication skills in English
• Self-motivated and reliable when working independently
• No technical, AI or professional research background required

Nice to have

• Background in research, journalism, editing or information science
• Experience in quality assurance, content moderation or critical analysis
• Familiarity with AI tools, search platforms or content evaluation workflows
• Broad general knowledge across many subject areas

What we offer

• Work on AI projects alongside leading research labs
• Fully remote and flexible work
• Freelance autonomy with meaningful, task-based work
• Potential for ongoing work and contract extension as new projects launch