Assistant Manager - Data Engineering

0 - 8 years

0 Lacs

Posted:2 days ago| Platform: Indeed logo

Apply

Work Mode

On-site

Job Description

Designation: Assistant Manager – Data Engineering
Level: L3
Experience: 5 to 8 years
Location: Bengaluru

Job Description:

We are seeking a highly skilled and motivated AI Engineering Expert with deep expertise in Databricks to designing, building, and deploying scalable and robust AI solutions.

The ideal candidate will have deep expertise in the Databricks Lakehouse platform to design, build, and deploy scalable AI solutions. This is a hands-on role for a professional who is passionate about productionizing machine learning and generative AI applications, ensuring robust and enterprise-grade AI engineering practices in a cloud environment (AWS, Azure, or GCP).

Responsibilities:

  • Build and Deploy AI/ML Pipelines: Design and deploy end-to-end AI/ML pipelines at scale on Databricks using PySpark and MLflow.
  • Develop MLOps Workflows: Create and implement comprehensive MLOps workflows, including CI/CD, model monitoring, drift detection, and automated retraining strategies.
  • Implement Inference Solutions: Build both real-time and batch inference solutions, exposing models via APIs or integrated workflows.
  • Generative AI Expertise: Candidate needs to hands-on with cutting-edge Generative AI frameworks such as LLMs, RAG, and fine-tuning, leveraging Databricks and its integrations (e.g., LangChain).
  • Data Governance: Ensure compliance with data governance, lineage, and access control protocols using Unity Catalog and other cloud-native tools.
  • Cost Optimization: Strategically optimize compute and storage costs while maintaining high performance for all AI workloads.

Skills:

  • Experience: 5-8 years in AI Engineering, ML Engineering, or a related role.
  • Platform Expertise: Strong expertise in Databricks, PySpark, Delta Lake, Unity Catalog, and MLflow.
  • MLOps: Hands-on experience with MLOps frameworks (MLflow, Kubeflow, Airflow, or similar).
  • Generative AI: Proven background in deploying and scaling LLMs or advanced AI models in enterprise environments.
  • Software Engineering: Strong software engineering skills in Python, including experience with APIs and containerization using Docker/Kubernetes.
  • Cloud Platforms: Experience with cloud platforms (Azure, AWS, GCP) for AI workloads.

Job Snapshot
Updated Date
07-11-2025
Job ID
J_4148
Location
Bengaluru, Karnataka, India
Experience
5 - 8 Years
Employee Type
Permanent

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You