AI Technical Lead

About the role

AllysAI is seeking a hands‑on AI Technical Lead to own the design, implementation, and operation of enterprise LLM systems. You will work closely with client technical teams, guide engineering delivery, and ensure robust, secure AI solutions for regulated industries.

Key responsibilities

• Design architecture decisions, choosing deterministic workflows, RAG, single or multiple agents, and justify model, framework, and infrastructure trade‑offs.
• Build Python services, APIs, retrieval pipelines, tool integrations, and agent workflows, including document AI pipelines for OCR, extraction, and classification.
• Create test datasets, evaluate retrieval and output quality, conduct error analysis, and define regression tests and release criteria.
• Deploy to client‑controlled cloud or on‑prem environments, managing monitoring, latency, cost, reliability, and recovery.
• Implement security controls, access boundaries, and data protection throughout the system.
• Lead engineering delivery, divide work, review code, set standards, and coordinate integration and production handover with clients.

Required profile

• 5+ years of professional software engineering experience, with at least 2 years building production LLM or generative AI systems used by real users.
• Strong Python and backend engineering skills, including APIs, databases, integrations, and automated testing.
• Hands‑on experience with RAG, vector search, re‑ranking, structured outputs, and agent/tool orchestration.
• Proven ability to take AI systems into production using Docker, CI/CD, monitoring, and secure deployment practices.
• Clear communication in English to discuss architecture, risks, and trade‑offs with clients.

Required skills

• Python
• APIs, databases, integrations, automated testing
• RAG, vector search, re‑ranking, structured output handling
• Agent and tool orchestration
• Docker, CI/CD pipelines
• Monitoring and secure deployment
• Azure OpenAI, Azure AI Search, Azure Document Intelligence, API Management
• AWS or GCP experience

What we offer

• Competitive compensation based on experience and role scope.
• Flexible time off.
• Hands‑on technical ownership and direct exposure to enterprise clients.
• Opportunity to build reusable capabilities across multiple production deployments.