LLM AI Quality Analyst (Arabic) – Remote

About the role

We are looking for a detail‑oriented Arabic speaker to join our AI team as a Quality Analyst. In this short‑term, remote position you will design conversational prompts, evaluate personalized AI responses, and ensure data privacy compliance.

Key responsibilities

• Design multi‑turn conversational prompts based on personal context.
• Evaluate AI responses for relevance, grounding, and helpfulness.
• Assess correct and incorrect use of personal data in model outputs.
• Perform side‑by‑side (SxS) ranking of AI responses.
• Identify grounding errors, poor inferences, and forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations.

Required profile

• Fluent in Arabic (reading and writing).
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and ability to evaluate nuanced AI outputs.
• BS/BA degree or equivalent analytical experience.
• Self‑motivated, able to work independently with full‑time availability and a 4‑hour PST overlap.
• Reliable desktop/laptop with stable internet connection.

Required skills

What we offer

• Competitive hourly rate of $11/hr.
• Remote work with flexible schedule.
• Short‑term contract (2 months) providing immediate start.