Arabic Data Annotator – Remote, $11/hr

About the role

We are seeking an Arabic‑speaking Data Annotator to support the quality evaluation of large language model (LLM) outputs. This short‑term, remote position focuses on personalisation prompts and ensures AI responses are relevant, accurate, and respectful of user data.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI responses for relevance, grounding, helpfulness, and correct use of personal data.
• Conduct side‑by‑side (SxS) comparisons and rank AI outputs.
• Identify grounding errors, poor inferences, and forced personalisation.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in Arabic (reading and writing).
• Experience in data annotation, AI quality evaluation, content moderation, or a related analytical role.
• Strong analytical thinking, attention to detail, and ability to assess nuanced AI responses.
• BS/BA degree or equivalent experience in an analytical field.
• Excellent written communication and structured feedback skills.
• Self‑motivated, able to work independently with full‑time availability and a required overlap with PST hours.

Required skills

What we offer

• Competitive hourly rate of $11.
• Remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge AI personalisation research.