Lead Engineer (AI/ML - Training & Experimentation)

Prodapt Solutions

5 - 10 years

10 - 15 Lacs

chennai

Posted:-1 days ago| Platform:

Apply

Skills Required

python data engineering model development debugging ml continuous integration natural language processing metadata management jupyter notebook aiml machine learning artificial intelligence sql deep learning spark gcp troubleshooting

Work Mode

Work from Office

Job Type

Full Time

Job Description

Overview

Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at scale.

Responsibilities

Develop, maintain, and enhance interactive Jupyter-based notebook environments for model development, experimentation, and training.
Build and optimize Pipelines (file-based and git-based) for orchestrating training and experiment jobs, ensuring seamless transition from research to production.Integrate and manage Project Namespace storage for organizing research data and experiment artifacts.Enable flexible compute resource allocation (CPU/GPU) for diverse ML workloads, including deep learning, NLP, and recommendation systems.Implement and support experiment tracking tools for managing model versions, metadata, and reproducibility.Develop and optimize data loading and processing workflows using technologies such as Spark, cuDF, RAPIDS, and NVTabular. Leverage Google Cloud Platform (GCP) for scalable compute, storage, and orchestration of training jobs. Ensure robust model governance, including lineage tracking, metadata management, and compliance. Collaborate with data scientists, ML engineers, and platform teams to deliver reliable, production-grade solutions. Participate in code reviews, architecture discussions, and continuous improvement of the platform.Requirements

Required Technical Skills

Proficiency in Python, especially for ML model development and data engineering.
Experience with Jupyter Notebooks and interactive development environments.
Familiarity with distributed data processing frameworks (Spark, cuDF, RAPIDS, NVTabular).
Experience with cloud platforms (GCP preferred) and scalable compute resource management (CPU/GPU).
Strong understanding of experiment tracking, model versioning, and metadata management.
Experience with CI/CD tools and automation for ML workflows.
Knowledge of model governance, reproducibility, and compliance best practices.
Excellent troubleshooting, debugging, and communication skills.

Preferred Qualifications

Experience with Pipeline orchestration (file-based and git-based).
Familiarity with ecosystem or large-scale financial/ML platforms.
Exposure to research and production environment isolation for ML workflows.
Experience with dashboarding and monitoring tools for training jobs and experiment outcomes.
Knowledge of data privacy, security, and compliance in ML environments.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Prodapt Solutions

Software Development

Chennai Tamilnadu

Login to

Please Verify Your Phone or Email

Confirm Action

Lead Engineer (AI/ML - Training & Experimentation)