Azure Data Engineer (Python | PySpark | Gen AI)

Altimetrik

10 - 16 years

1 - 4 Lacs

chennai bengaluru

Posted:5 days ago| Platform:

Apply

Skills Required

pyspark generative ai azure databricks machine learning python azure data factory

Work Mode

Work from Office

Job Type

Full Time

Job Description

Experience:

Role Overview:

Azure Data Engineer

Key Responsibilities:

Design, develop, and optimize
data pipelines
using
Azure Data Factory, Databricks, Python, and PySpark
.
Build and maintain
ETL/ELT workflows
for large-scale data processing.
Work with Azure components such as
ADLS, Azure SQL, Azure Synapse, Azure Functions, Key Vault
, etc.
Implement and automate
CI/CD pipelines
for data workflows.
Collaborate with data scientists and AI teams to integrate
Gen AI models
with data pipelines.
Optimize data pipelines for performance, scalability, and cost efficiency.
Ensure data quality, governance, and security across all environments.
Troubleshoot and resolve production issues, ensuring high data availability.
Document technical designs, architecture, and data workflows.

Required Skills:

Strong hands-on experience in
Python
and
PySpark
.
Solid expertise in
Azure Data Stack
(ADF, Databricks, ADLS, Synapse).
Experience with
big data processing
and distributed computing.
Good understanding of
Gen AI concepts
, embeddings, vector stores, LLMs, prompt workflows (basic knowledge acceptable).
Strong experience in
SQL
and performance tuning.
Experience in
CI/CD
, Git, and DevOps pipelines.
Good problem-solving, communication, and stakeholder management skills.

Good to Have:

Experience with
MLflow
, model deployment, or AI workflow automation.
Knowledge of Snowflake or other cloud data warehouses.
Exposure to
Databricks Unity Catalog
, Delta Lake, or Lakehouse architectures.
Experience working in Agile environment.

More Jobs at Altimetrik

.net/ dotnet developer- 6+yrs- pune/chennai- Client- Citi Bank

Pune, Chennai

5 - 10 yrs

INR 20 - 35 Lacs

SDET- 5+yrs- Chennai/Pune- Client- Citi Bank

Pune, Chennai

5 - 10 yrs

INR 12 - 22 Lacs

Java Full Stack Developer

Pune, Chennai

6 - 10 yrs

INR 18 - 32 Lacs

Software Engineering Manager

Bengaluru

13 - 15 yrs

INR 37 - 45 Lacs

GEN AI Engineer

Pune, Gurugram, Bengaluru

3 - 8 yrs

INR 12 - 22 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.