Assistant Vice President– Generative AI – Systems Architect

Ready to shape the future of work

At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges.

If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment.

Genpact (NYSE: G) is anadvanced technology services and solutions company that deliverslastingvalue for leading enterprisesglobally.Through ourdeep business knowledge, operational excellence, and cutting-edge solutions - we help companies across industries get ahead and stay ahead.Powered by curiosity, courage, and innovation,our teamsimplementdata, technology, and AItocreate tomorrow, today.Get to know us atand on,,, and.

Inviting applications for the role ofAssistant Vice President- Generative AI - Systems Architect

Role Overview: We are looking for an experienced Systems Architect with extensive experience in designing and scaling Generative AI systems to production. This role requires an individual with deep expertise in system architecture, software engineering, data platforms, and AI infrastructure, who can bridge the gap between data science, engineering and business.

You will be responsible for end-to-end architecture of Gen.AI systems including model lifecycle management, inference, orchestration, pipelines

Key Responsibilities:

• 
  

  Architect and design end-to-end systems for production-grade Generative AI applications (e.g., LLM-based chatbots, copilots, content generation tools).

• 
  

  Define and oversee system architecture covering data ingestion, model training/fine-tuning, inferencing, and deployment pipelines.

• 
  

  Establish architectural tenets like modularity, scalability, reliability, observability, and maintainability.

• 
  

  Collaborate with data scientists, ML engineers, platform engineers, and product managers to align architecture with business and AI goals.

• 
  

  Choose and integrate foundation models (open source or proprietary) using APIs, model hubs, or fine-tuned versions.

• 
  

  Evaluate and design solutions based on architecture patterns such as Retrieval-Augmented Generation (RAG), Agentic AI, Multi-modal AI, and Federated Learning.

• 
  

  Design secure and compliant architecture for enterprise settings, including data governance, auditability, and access control.

• 
  

  Lead system design reviews and define non-functional requirements (NFRs), including latency, availability, throughput, and cost.

• 
  

  Work closely with MLOps teams to define the CI/CD processes for model and system updates.

• 
  

  Contribute to the creation of reference architectures, design templates, and reusable components.

• 
  

  Stay abreast of the latest advancements in GenAI, system design patterns, and AI platform tooling.

Qualifications we seek in you!

Minimum Qualifications

• 
  

  Proven experience designing and implementing distributed systems, cloud-native architectures, and microservices.

• 
  

  Deep understanding of Generative AI architectures, including LLMs, diffusion models, prompt engineering, and model fine-tuning.

• 
  

  Strong experience with at least one cloud platform (AWS, GCP, or Azure) and services like SageMaker, Vertex AI, or Azure ML.

• 
  

  Experience with Agentic AI systems or orchestrating multiple LLM agents.

• 
  

  Experience with multimodal systems (e.g., combining image, text, video, and speech models).

• 
  

  Knowledge of semantic search, vector databases, and retrieval techniques in RAG.

• 
  

  Familiarity with Zero Trust architecture and advanced enterprise security practices.

• 
  

  Experience in building developer platforms/toolkits for AI consumption.

• 
  

  Contributions to open-source AI system frameworks or thought leadership in GenAI architecture.

• 
  

  Hands-on experience with tools and frameworks like LangChain, Hugging Face, Ray, Kubeflow, MLflow, or Weaviate/FAISS.

• 
  

  Knowledge of data pipelines, ETL/ELT, and data lakes/warehouses (e.g., Snowflake, BigQuery, Delta Lake).

• 
  

  Solid grasp of DevOps and MLOps principles, including containerization (Docker), orchestration (Kubernetes), CI/CD pipelines, and model monitoring.

• 
  

  Familiarity with system design tradeoffs in latency vs cost vs scale for GenAI workloads.

Preferred Qualifications:

• 
  

  Bachelor&rsquos or Master&rsquos degree in computer science, Engineering, or related field.

• 
  

  Experience in software/system architecture, with experience in GenAI/AI/ML.

• 
  

  Proven experience designing and implementing distributed systems, cloud-native architectures, and microservices.

• 
  

  Strong interpersonal and communication skills ability to collaborate and present to technical and executive stakeholders.

• 
  

  Certifications in cloud platforms (e.g., AWS Certified Solutions Architect, Microsoft Certified: Azure Solutions Architect Expert, Google Cloud Professional Data Engineer).

• 
  

  Familiarity with data governance and security best practices.

Why join Genpact

• 
  

  Be a transformation leader - Work at the cutting edge of AI, automation, and digital innovation

• 
  

  Make an impact - Drive change for global enterprises and solve business challenges that matter

• 
  

  Accelerate your career - Get hands-on experience, mentorship, and continuous learning opportunities

• 
  

  Work with the best - Join 140,000+ bold thinkers and problem-solvers who push boundaries every day

• 
  

  Thrive in a values-driven culture - Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.

Let&rsquos build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.