Lead AI Data Engineer

Key Skills:

Roles & Responsibilities

• Design, develop, and deploy advanced AI solutions with a strong focus on Generative AI and Agentic AI use cases.
• Build and manage end-to-end AI workflows using AWS services such as Amazon Bedrock, SageMaker, Lambda, DynamoDB, and Azure services including Azure OpenAI and Azure ML.
• Architect and implement scalable RAG pipelines, including prompt engineering, embedding strategies, and vector database design.
• Develop and orchestrate AI agents using frameworks such as LangChain and AWS Agent Framework.
• Ensure cloud security, governance, and compliance, with a focus on identity management and risk mitigation for GenAI models.
• Collaborate with product managers, data scientists, and engineering teams to translate business requirements into scalable AI solutions.
• Lead model evaluation, monitoring, fine-tuning, and performance optimization to ensure high-quality outcomes.
• Drive best practices for AI development, deployment, and MLOps in cloud environments.
• Mentor junior engineers and provide technical leadership across AI and data engineering initiatives.
• Stay current with emerging AI/ML trends, tools, and cloud-native technologies to continuously enhance AI capabilities.

Experience Required

• 7 - 9 years of experience in data engineering, AI/ML, or related roles, preferably in product-based organizations.
• Strong hands-on experience in building and deploying Generative AI solutions in production environments.
• Proven expertise with AWS and Azure AI ecosystems, including Bedrock, SageMaker, Azure OpenAI, and Azure ML.
• Solid experience in designing and implementing RAG-based architectures and AI agent frameworks.
• Experience working with vector databases, embeddings, and large language models (LLMs).
• Strong understanding of cloud security, IAM, compliance, and risk management for AI workloads.
• Experience collaborating with cross-functional teams to deliver measurable business impact through AI solutions.
• Prior experience leading technical teams or mentoring engineers is highly desirable.

Education: