Product Architect - AI/ML

Product Architect - AI/ML

Location: India/Offshore

Experience: 12-15 years (Minimum 6-7 years in AI/ML Product Architecture)

Location: -Pune preferred / Hyderabad (4 Days WFO)

Role Overview

Define and drive the technical product vision for enterprise AI/ML platforms in healthcare,

translating business requirements into scalable architectures while ensuring delivery

excellence and long-term product sustainability. This role requires hands-on leadership,

flexible collaboration across time zones, and the ability to mentor engineering teams.

Product & Technical Strategy

• Architect end-to-end product solutions for processing clinical records, claims, and

healthcare documentation

• Design hybrid Azure/on-premises architectures supporting multi-tenant SaaS and

enterprise deployment models

• Establish product architecture principles, design patterns, and technology stack

decisions

• Evaluate build-vs-buy decisions for AI capabilities, Drive technical feasibility

assessments and rapid prototyping for new product features

• Own non-functional requirements: performance, security, compliance (HIPAA),

scalability, reliability

• Present architectural proposals and technical roadmaps to leadership through clear

presentations and documentation AI/ML Product Engineering

• Design and implement fine-tuning pipelines for domain-specific LLMs (e.g. Llama,

Mistral, Phi-3) on medical datasets

• Architect MLOps frameworks enabling continuous model improvement: training,

evaluation, deployment, monitoring

• Build “built-in-intelligence-products” using advanced AI models.

• Implement distributed training infrastructure on Azure ML with GPU optimization

(RTX5090/4090/A100/H100 clusters)

• Create model evaluation frameworks with domain-specific metrics and quality

benchmarks

• Develop synthetic data generation capabilities for model training and testing

• Establish model versioning, A/B testing, and rollback strategies for production

deployments Platform & Infrastructure

• Design microservices architectures with Azure Kubernetes Service, Service Bus, Event

Hubs for event-driven workflows

• Build scalable data pipelines using Azure Data Factory, Synapse Analytics, Databricks for

high-volume processing

• Implement CI/CD automation through Azure DevOps with comprehensive testing and

deployment gates

• Architect observability solutions: monitoring, logging, alerting, performance analytics

• Design hybrid cloud integration patterns connecting Azure services with on-premises

systems

• Manage data architecture: Azure SQL, Cosmos DB, blob storage, data lakes with lifecycle

policies Delivery Excellence & Hands-On Leadership

• Lead proof-of-concept execution from inception to production-ready solutions within

defined timelines

• Conduct rigorous code reviews ensuring adherence to standards, performance

optimization, and maintainability

• Roll up sleeves for critical implementation work: debugging production issues, optimizing

model performance, refactoring complex modules

• Deliver technical demos to internal stakeholders and customers showcasing product

capabilities

• Establish engineering excellence standards: code quality, testing frameworks, peer

reviews, documentation

• Create comprehensive technical documentation: architecture decision records, API

contracts, deployment guides

• Identify and systematically address technical debt across AI models, infrastructure, and

codebase Team Development & Collaboration

• Mentor and develop junior engineers and fresh graduates through pair programming, and

technical guidance

• Review and provide constructive feedback on designs, code, and technical approaches

from team members

• Foster engineering culture emphasizing quality, innovation, and continuous learning

• Collaborate with US-based teams requiring flexibility for meetings during early morning or

late evening IST hours

• Bridge communication between offshore development teams and US-based

product/business stakeholders • Translate business requirements from US teams into

actionable technical tasks for India-based engineers

• Participate in cross-timezone planning, sprint reviews, and architecture discussions

Required Qualifications • [Non Negotiable] Expert Python development with PyTorch,

Transformers, production ML frameworks • [Non Negotiable] Comfortable handling

NVIDIA/CUDA variants and their inner workings.

• [Non Negotiable] Proven experience fine-tuning LLMs and deploying custom models in

regulated environments • [Non Negotiable] Track record of shipping production AI products

with measurable business impact

• [Non Negotiable] Core Software Engineering skills. AI/ ML expertise, DevOps.

• [Non Negotiable] Flexibility to work with US hours overlap Key Competencie

• Hands-on technical leadership and a user-centric approach to technical architecture

• Ownership mindset with accountability for outcomes and the ability to balance

innovation with pragmatic engineering

• Effective communicator capable of engaging both technical and non-technical audiences

• Comfortable operating at multiple levels: strategy, architecture, and implementation