Posted:19 hours ago
**Job Title:** Data Engineering Hadoop Developer (3-8 Years Experience)
Core Python, Pyspark, SQL. Mandatory background/Hands on exp on Apache Iceberg
**Job Summary**
Seeking a Hadoop Developer with 3-8 years of experience in big data engineering to design, build, and optimize scalable data pipelines on Hadoop ecosystem technologies. The role involves batch/stream processing, data integration, performance tuning, and close collaboration with business teams.
**Key Responsibilities**
1. Design and develop robust ETL/data pipelines using Hadoop ecosystem tools.
2. Build and optimize large-scale data processing jobs using Spark and/or Hive.
3. Develop workflows using Airflow.
4. Write complex SQL/HiveQL for data transformation and reporting needs.
5. Ingest structured and unstructured data from multiple sources (Kafka, Sqoop, APIs, files).
6. Ensure data quality, lineage, and governance standards are followed.
7. Monitor, troubleshoot, and tune jobs for performance and scalability.
8. Create technical documentation and follow coding best practices.
**Required Skills**
1. 3-8 years of hands-on experience in Hadoop/big data development.
2. Strong knowledge of HDFS, Hive, Spark,
3. String knowledge in Python/Scala
4. Strong SQL and data modelling fundamentals.
5. Experience with workflow orchestration tools (Airflow).
6. Good understanding of Linux, shell scripting, and distributed systems.
8. Familiarity with version control (Git) and Agile delivery practices.
Free courses, interview questions and practice for each skill.
Hybrid
Full Time
Tech Mahindra
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
Bengaluru
Salary: Not disclosed
Chennai, Bengaluru
16.0 - 31.0 Lacs P.A.
Kochi, Bengaluru
Salary: Not disclosed
Bengaluru
Salary: Not disclosed
Pune
18.0 - 22.5 Lacs P.A.
Chennai, Bengaluru
14.0 - 24.0 Lacs P.A.
Chennai
Salary: Not disclosed
Hyderabad
Salary: Not disclosed
Chennai, Bengaluru
Salary: Not disclosed
Gurugram
Salary: Not disclosed
AI Job Matching Summary