Data Engineer AI/ML - Immediate Joiner

Job Title: Data Engineer AI/ML

Location: Pune / Bangalore, India

Experience: 410 years

Employment Type: Full-time

About the Role:

We are looking for an experienced Data Engineer with a strong background in AI/ML data processing to design and optimize scalable data pipelines. The ideal candidate will have hands-on expertise in NumPy, Lambda functions, and Apache Spark, and will play a key role in enabling machine learning workflows and advanced analytics by ensuring clean, well-structured, and high-quality data availability.

Key Responsibilities:

• Design, develop, and maintain data pipelines that support AI/ML model training and inference workflows.
• Use Python (NumPy, Pandas, Lambda functions) to perform data preprocessing, transformation, and feature engineering.
• Build and optimize large-scale distributed data processing systems using Apache Spark (PySpark).
• Collaborate with data scientists and ML engineers to prepare, clean, and validate datasets for model development.
• Implement ETL/ELT pipelines for structured and unstructured data using cloud and on-premises solutions.
• Optimize data workflows for performance, scalability, and automation in AI/ML pipelines.
• Work with cloud platforms (AWS, Azure, or GCP) to manage and deploy data pipelines for machine learning environments.
• Maintain and monitor data quality, lineage, and governance to ensure reliable model outcomes.
• Contribute to the development of feature stores and reusable data assets for ML models.

Required Skills & Qualifications:

• Bachelors or Masters degree in Computer Science, Data Engineering, Artificial Intelligence, or a related field.
• 410 years of experience in data engineering, ML data pipelines, or big data frameworks.
• Strong programming skills in Python, with deep knowledge of NumPy, Pandas, and Lambda functions for efficient numerical and functional programming.
• Hands-on experience in Apache Spark (PySpark, Spark SQL) for distributed data processing and transformation.
• Solid understanding of AI/ML data workflows, including data ingestion, preprocessing, feature extraction, and model deployment.
• Experience with cloud-based data services such as AWS (Lambda, Glue, EMR, S3, Redshift), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).
• Strong SQL skills and experience working with relational and NoSQL databases.
• Familiarity with containerization (Docker, Kubernetes) and version control (Git).

Good to Have:

• Experience building ML data pipelines integrated with frameworks like TensorFlow, PyTorch, or Scikit-learn.
• Knowledge of real-time or streaming data processing (Kafka, Flink).
• Understanding of feature store concepts and MLOps pipelines.
• Exposure to data lakehouse architectures (e.g., Databricks, Delta Lake).

Soft Skills:

• Strong analytical and problem-solving abilities.
• Effective communication and collaboration with cross-functional AI/ML and data science teams.
• Self-motivated with a passion for automation, innovation, and scalable data solutions.

Why Join Us:

• Work on cutting-edge AI and ML data platforms that power intelligent business decisions.
• Collaborate with a multidisciplinary team of data scientists, ML engineers, and product developers.
• Opportunity to build scalable, cloud-native data systems leveraging Python, Spark, and modern AI technologies.
• Competitive compensation, flexible work culture, and continuous learning opportunities.