Product Architect – AI/ML
Experience:
Minimum:
Location:
- Pune (WFO – 4 Days)
- Hyderabad (Only Immediate Joiner)
Role Overview
Define and drive the technical product vision for enterprise AI/ML platforms in healthcare, translating business requirements into scalable architectures while ensuring delivery excellence and long-term product sustainability. This role requires hands-on leadership, flexible collaboration across time zones, and the ability to mentor engineering teams.
Product & Technical Strategy
- Architect end-to-end product solutions for processing clinical records, claims, and healthcare documentation
- Design hybrid Azure/on-premises architectures supporting multi-tenant SaaS and enterprise deployment models
- Establish product architecture principles, design patterns, and technology stack decisions
- Evaluate build-vs-buy decisions for AI capabilities
- Drive technical feasibility assessments and rapid prototyping for new product features
- Own non-functional requirements: performance, security, compliance (HIPAA), scalability, reliability
- Present architectural proposals and technical roadmaps to leadership through clear presentations and documentation
AI/ML Product Engineering
- Design and implement fine-tuning pipelines for domain-specific LLMs (LLaMA, Mistral, Phi-3) on medical datasets
- Architect MLOps frameworks enabling continuous model improvement: training, evaluation, deployment, monitoring
- Build built-in-intelligence products using advanced AI models
- Implement distributed training infrastructure on Azure ML with GPU optimization (RTX 5090/4090, A100, H100 clusters)
- Create model evaluation frameworks with domain-specific metrics and quality benchmarks
- Develop synthetic data generation capabilities for model training and testing
- Establish model versioning, A/B testing, and rollback strategies for production deployments
Platform & Infrastructure
- Design microservices architectures using Azure Kubernetes Service (AKS), Service Bus, Event Hubs for event-driven workflows
- Build scalable data pipelines using Azure Data Factory, Synapse Analytics, Databricks
- Implement CI/CD automation through Azure DevOps with comprehensive testing and deployment gates
- Architect observability solutions: monitoring, logging, alerting, performance analytics
- Design hybrid cloud integration patterns connecting Azure services with on-premises systems
- Manage data architecture: Azure SQL, Cosmos DB, Blob Storage, Data Lakes with lifecycle policies
Delivery Excellence & Hands-On Leadership
- Lead proof-of-concept execution from inception to production-ready solutions within defined timelines
- Conduct rigorous code reviews ensuring adherence to standards, performance optimization, and maintainability
- Hands-on involvement in critical implementation work: debugging production issues, optimizing model performance, refactoring complex modules
- Deliver technical demos to internal stakeholders and customers showcasing product capabilities
- Establish engineering excellence standards: code quality, testing frameworks, peer reviews, documentation
- Create technical documentation: architecture decision records, API contracts, deployment guides
- Identify and address technical debt across AI models, infrastructure, and codebase
Team Development & Collaboration
- Mentor junior engineers and fresh graduates through pair programming and technical guidance
- Review and provide feedback on designs, code, and technical approaches
- Foster an engineering culture focused on quality, innovation, and continuous learning
- Collaborate with US-based teams with flexibility for early morning or late evening IST meetings
- Bridge communication between offshore development teams and US-based stakeholders
- Translate business requirements into actionable technical tasks for India-based teams
- Participate in cross-time-zone planning, sprint reviews, and architecture discussions
Required Qualifications (Non-Negotiable)
- Expert Python development with PyTorch, Transformers, and production ML frameworks
- Comfortable handling NVIDIA/CUDA variants and their inner workings
- Proven experience fine-tuning LLMs and deploying custom models in regulated environments
- Track record of shipping production AI products with measurable business impact
- Strong core software engineering skills with AI/ML and DevOps expertise
- Flexibility to work with US hours overlap
Working hours:
11:00 AM – 8:00 PM IST
Key Competencies
- Hands-on technical leadership and user-centric approach to architecture
- Ownership mindset with accountability for outcomes
- Ability to balance innovation with pragmatic engineering
- Strong communication skills across technical and non-technical audiences
- Comfort operating at strategy, architecture, and implementation levels
