Senior GenAI Engineer

Grid Dynamics is seeking an AI Expert (Senior Engineer) to spearhead the development of local Large Language Models (LLMs) for Personally Identifiable Information (PII) detection across our vast data ecosystem. This role involves building and fine-tuning custom LLMs that can identify PII in documents, databases, knowledge graphs, source code, and other knowledge-sharing platforms. The models must effectively handle data at scale (50+ PB of data) and remain up-to-date with continuous retraining on a quarterly or monthly basis.

As the AI Senior Engineer, you will design and implement these AI solutions using technologies like Ray, llama.cpp, ollama, vLLM, and PyTorch, deploying them on Azure cloud and on-premises infrastructure for efficient, large-scale operation. You will also develop generative AI agents that leverage data schemas and metadata to improve PII detection accuracy. Collaboration is key: you will work closely with data engineering, security, and compliance teams to ensure the AI models meet business requirements and align with industry regulations (GDPR, CCPA, PCI DSS, etc.).

Essential functions

• Design, train, fine-tune, and optimize local LLMs or other NLP models for PII detection across diverse data types (documents, databases, knowledge graphs, code, and other knowledge-sharing formats).
• Develop generative AI agents (on Autogen/Langgraph) for schema- and metadata-based PII detection to enhance identification of sensitive data.
• Work with cutting-edge AI frameworks (Ray, llama.cpp, ollama, vLLM, PyTorch) to deploy and scale models efficiently in a distributed environment.
• Implement and optimize AI/ML solutions on Azure cloud and on-premise infrastructure, ensuring high performance and reliability.
• Collaborate with data engineering, security, and compliance teams to align AI solutions with business needs and regulatory requirements.
• Lead a small team of AI engineers, providing mentorship, code reviews, and technical guidance to drive project success.
• Maintain and monitor model performance, retraining models on a quarterly or monthly basis to handle 50+ PB of evolving data and to improve accuracy over time.
• Ensure AI models follow best practices and compliance standards, adhering to security requirements and regulations (GDPR, CCPA, PCI DSS, etc.).

Qualifications

• Strong experience with AI frameworks such as Ray, llama.cpp, ollama, vLLM, and PyTorch for building and scaling LLM solutions.
• Expertise in LLM fine-tuning and prompt engineering, including techniques like Reinforcement Learning from Human Feedback (RLHF) to refine model outputs.
• Hands-on experience with AI model deployment in Azure cloud environments as well as on-premises servers.
• Familiarity with large-scale data (50+ PB) and distributed computing paradigms (e.g., using clusters or Ray) to handle massive datasets.
• Familiarity with MCP (Model Context Protocol) Servers and securing them.
• Strong programming skills in Python, with experience in machine learning frameworks and libraries.
• Ability to work cross-functionally with stakeholders in security, compliance, and data engineering to incorporate their requirements into AI solutions.
• Strong awareness if not implementation experience with Differential Privacy/Federated Learning.
• Excellent communication skills, with the ability to explain complex AI concepts and results to non-technical teams and leadership clearly.