Data Engineer

Policybazaar

3 - 5 years

13 - 20 Lacs

gurugram

Posted:5 hours ago| Platform:

Apply

Skills Required

hive hadoop spark

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Title :

Location:

Experience:

Role Overview

Key Responsibilities:

Design, develop, and maintain scalable big data pipelines and architectures to support business and analytical needs
Build and optimize data processing systems using technologies such as Hadoop, Hive, Spark, and Python/Java
Implement data governance principles, ensuring data quality, integrity, and security across all data layers.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Integrate and manage data from diverse sources including SQL, NoSQL databases, APIs, and streaming data.
Design and maintain real-time data streaming and message queuing systems (e.g., Kafka, Spark Streaming, Storm).
Conduct data profiling, cleansing, and validation to ensure accuracy and reliability.
Continuously improve system performance, scalability, and efficiency through automation and optimization.

Qualification:

Bachelors or Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field.
4+ years
of hands-on experience as a Data Engineer or in a related data engineering
role.
Proven expertise with big data technologies such as
Hadoop, Hive, Spark, and Kafka.
Strong programming skills in Python, Java, or Scala
Proficiency with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, Cassandra).
Working knowledge of stream-processing frameworks such as Spark Streaming or Storm.
Strong analytical and problem-solving skills with the ability to design solutions for complex business use cases.
Excellent project management and organizational skills with experience working in dynamic, cross-functional environments.

More Jobs at Policybazaar

Urgently Hiring For Relationship Manager - Field Sales

Pune, Nagpur, Mumbai (All Areas)

1 - 6 yrs

INR 3 - 4 Lacs

Urgently Hiring For Relationship Manager - Field Sales

Lucknow, Kanpur, Patna

1 - 6 yrs

INR 3 - 4 Lacs

Assistant Manager - Sales - Gurgaon

Gurugram

7 - 12 yrs

INR 6 - 9 Lacs

Manager/Senior Manager - Training(Gurgaon) For DFOS Channel

Gurugram

10 - 18 yrs

INR 17 - 27 Lacs

Team Leader- Direct Sales || Ludhiana

Ludhiana

6 - 11 yrs

INR 4 - 7 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.