S

Senior Data Engineer Specialist (Hadoop, NiFi & Airflow)

Sunware Technologies Private Limited

8 years

10 - 25 Lacs

Pune

Posted:5 days ago

Job Description

Job role: Data Engineering Specialist (Hadoop, NiFi & Airflow)
Experience: 8+ Years
Location: Pune

Role Summary

We are looking for an experienced Data Engineering Specialist to design, develop, and optimize scalable data ingestion and ETL pipelines across the Hadoop ecosystem. The ideal candidate should have strong hands-on experience with Apache NiFi, Spark/PySpark, Hadoop/HDFS, Apache Airflow, Cloudera Data Engineering (CDE), Hive, SQL, and Python.

Mandatory Skills

  • Apache NiFi
  • Spark / PySpark
  • Hadoop / HDFS
  • Apache Airflow
  • Cloudera Data Engineering (CDE)
  • Hive & SQL
  • Python

Key Responsibilities

  • Design, develop, and maintain scalable ETL and data ingestion pipelines.
  • Build and optimize data processing solutions using Spark, PySpark, and NiFi.
  • Develop and manage Airflow workflows for scheduling and orchestration.
  • Work with Hadoop, HDFS, Hive, and CDE for enterprise data processing.
  • Write efficient Hive SQL and Python code for data transformation and automation.
  • Monitor, troubleshoot, and optimize production data pipelines.
  • Collaborate with cross-functional teams to deliver reliable data solutions.

Required Qualifications

  • 8+ years of experience in Data Engineering and Big Data technologies.
  • Strong expertise in NiFi, Spark/PySpark, Hive SQL, Python, and Airflow.
  • Good understanding of Hadoop, HDFS, distributed data processing, and ETL best practices.
  • Hands-on experience with Cloudera Data Engineering (CDE) or similar enterprise data platforms.
  • Experience supporting and optimizing production data pipelines.
  • Strong analytical, problem-solving, and communication skills.

Interested Candidates can send their resume to mithradevi.gunakumar@sunware.in

Job Types: Full-time, Permanent

Pay: ₹1,000,000.00 - ₹2,500,000.00 per year

Benefits:

  • Health insurance
  • Provident Fund

Application Question(s):

  • How many years of experience do you have in Apache NiFi?
  • How many years of experience do you have in Airflow?
  • How many years of experience do you have in Hadoop/HDFS?
  • How many years of experience do you have in Pyspark/Spark?
  • How many years of experience do you have in Python?
  • How many years of experience do you have in SQL?
  • What is your Notice Period? If serving, then mention the last working date

Work Location: In person

Skills Required

Hadoop Data Engineering Data Ingestion ETL Pipelines Apache Spark Pyspark SQL Python ETL Data Processing Data Transformation

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
S
Sunware Technologies Private Limited

RecommendedJobs for You

S

Pune

S

Pune