Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in karnataka
>
Infogain
>
Senior Data Engineer

Senior Data Engineer

Infogain

5 - 9 years

0 Lacs

karnataka

Posted:19 hours ago| Platform: Shine logo

Apply

Skills Required

sql azure databricks azure data factory pyspark

Work Mode

On-site

Job Type

Full Time

Job Description

You should have 6 to 9 years of experience in Data Engineering with a focus on Azure Databricks, Azure Data Factory, Pyspark, and SQL. The work location for this role can be Bengaluru, Pune, Mumbai, Noida, or Gurugram with a notice period of 0 to 15 days. This job is in a Hybrid mode. As a Data Engineer in this role, your key responsibilities will include developing scalable data pipelines using Azure Data Factory (ADF), Databricks, PySpark, and Delta Lake to support ML and AI workloads. You will be optimizing and transforming large datasets for feature engineering, model training, and real-time AI inference. Building and maintaining lakehouse architecture using Azure Data Lake Storage (ADLS) & Delta Lake will also be a part of your responsibilities. Collaborating closely with ML engineers & Data Scientists, you will deliver high-quality, structured data for training Generative AI models. Implementing MLOps best practices for continuous data processing, versioning, and model retraining workflows will be essential. Monitoring & enhancing data quality using Azure Data Quality Services is also a key responsibility. Ensuring cost-efficient data processing in Databricks by utilizing Photon, Delta Caching, and Auto-Scaling Clusters is another important aspect of this role. Securing data pipelines by implementing RBAC, encryption, and governance will also be a part of your duties. The required skills & experience for this position include having 5+ years of experience in Data Engineering with Azure & Databricks. Proficiency in PySpark, SQL, and Delta Lake for large-scale data transformations is crucial. Strong experience with Azure Data Factory (ADF), Azure Synapse, and Event Hubs is necessary. Hands-on experience in building feature stores for ML models will be beneficial. Experience with ML model deployment and MLOps pipelines (MLflow, Kubernetes, or Azure ML) is considered a plus. A good understanding of Generative AI concepts and handling unstructured data is desirable. Strong problem-solving, debugging, and performance optimization skills are also required for this role.,

More Jobs at Infogain

Aws Data Engineer

Pune, Delhi NCR, Bengaluru

4 - 6 yrs

INR 13 - 23 Lacs

SAP Developer (Senior)

Bengaluru

5 - 8 yrs

INR 6 - 11 Lacs

Dot NET Fullstack (React) Developer (Senior)

Bengaluru

6 - 8 yrs

INR 13 - 15 Lacs

Application Support Engineer (Senior)

Bengaluru

6 - 8 yrs

INR 8 - 10 Lacs

Dot NET Core Developer (Senior)

Bengaluru

6 - 8 yrs

INR 13 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Infogain

IT Services and IT Consulting

Los Gatos CA

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Senior Data Engineer