Data Engineer

Aziro

5 - 9 years

16 - 30 Lacs

bengaluru

Posted:3 weeks ago| Platform:

Apply

Skills Required

pyspark pandas numpy python data warehousing etl sql

Work Mode

Hybrid

Job Type

Full Time

Job Description

Data Engineer

Key Responsibilities

Data Pipeline & Big Data Engineering

Design, develop, and optimize robust
Extract, Transform, Load (ETL)/Extract, Load, Transform (ELT)
data pipelines using
Apache Spark
(preferably
PySpark
) to process massive, diverse datasets (batch and streaming).
Utilize
Pandas
for localized, highly efficient data manipulation, cleaning, and preparation, often for data prototyping or for data that fits within memory limits.
Leverage
NumPy
for complex numerical computations, vectorization, and efficient array operations within data preparation tasks.
Implement data quality checks, monitoring, and alerting for all production data pipelines, ensuring data integrity and reliability.
Optimize Spark jobs and data processing workflows for performance, cost-efficiency, and scalability.

More Jobs at Aziro

Pre - Sales Technical Project Manager - Aziro (Formerly MSys)

Pune, Chennai, Bengaluru

12.0 - 22.0 yrs

INR 25 - 35 Lacs

Site Reliability Engineer - Data Center storage | Aziro

Pune, Chennai, Bengaluru

5.0 - 9.0 yrs

INR 10 - 20 Lacs

Solution Architect

Pune, Chennai, Bengaluru

10.0 - 19.0 yrs

INR 20 - 30 Lacs

Senior AIML Engineers (6+ Years)

Noida, Chennai, Bengaluru

6.0 - 11.0 yrs

INR 12 - 22 Lacs

AIML Architect

Noida, Pune, Chennai

12.0 - 22.0 yrs

INR 27 - 37 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.