Big Data Engineer

Aqilea

9 - 11 years

9 - 13 Lacs

bengaluru

Posted:14 hours ago| Platform:

Apply

Skills Required

performance tuning data modeling analytical consulting workflow data quality distribution system sql python data extraction

Work Mode

Work from Office

Job Type

Full Time

Job Description

Work Location: Chennai / Bangalore / Pune / MumbaiWorking Mode: Work From Office

Design, develop, and maintain scalable
Big Data pipelines
and data processing frameworks.
Build and optimize distributed data processing solutions using
Apache Spark
.
Write clean, efficient, and high-performance code using
Scala and Python
.
Work with large datasets and write advanced
SQL
queries for data extraction, transformation, and analysis.
Implement data ingestion workflows from multiple structured and unstructured data sources.
Ensure high data quality, reliability, performance, and security across the data lifecycle.
Collaborate with cross-functional teams including data architects, data scientists, and platform engineers.
Troubleshoot production issues and optimize system performance in large-scale environments.

Required Skills:

Strong experience in
Big Data technologies
(Hadoop ecosystem, HDFS, Hive, etc.)
Expert-level proficiency in
Apache Spark
(DataFrame, RDD, Spark SQL).
Hands-on development experience in
Scala
and
Python
.
Strong
SQL
skills for handling complex queries and large datasets.
Experience with performance tuning of Spark jobs and distributed systems.
Knowledge of data modeling, ETL concepts, and workflow orchestration tools is a plus.

Notice Period:

Immediate to 15 Days Only

Work Location

: Bangalore(Hybrid)

More Jobs at Aqilea

Financial Systems Senior Analyst

Hyderabad

7 - 12 yrs

INR 8 - 12 Lacs

Senior iOS Engineer

Bengaluru

8 - 13 yrs

INR 9 - 13 Lacs

Front End Web Developer

Bengaluru

3 - 8 yrs

INR 3 - 6 Lacs

Java Backend Developer

Bengaluru

5 - 10 yrs

INR 4 - 7 Lacs

Java Tech Lead

Bengaluru

8 - 13 yrs

INR 9 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.