Teamware Solutions logo

Big Data Engineer (Hadoop)

5 - 8 years

4 - 7 Lacs

chennai tamil nadu india

Posted:1 week ago| Platform: Foundit logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities:

  • Design, develop, and optimize large-scale data processing workflows using Hadoop components such as

    HDFS, MapReduce, Hive, Pig, and HBase

    .
  • Build and maintain ETL pipelines to ingest and transform data from various sources into Hadoop clusters.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions.
  • Ensure data quality, integrity, and security within big data environments.
  • Monitor and troubleshoot Hadoop cluster performance and resolve issues proactively.
  • Implement best practices for data storage, processing, and retrieval in Hadoop ecosystems.
  • Develop automation scripts for data pipeline orchestration and workflow management (using tools like Apache Oozie or Airflow).
  • Participate in capacity planning, cluster management, and Hadoop upgrades.
  • Document data architecture, workflows, and operational procedures.

Qualifications and Requirements:

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
  • 3+ years of experience as a Big Data Engineer or Hadoop Developer.
  • Hands-on experience with core Hadoop ecosystem components:

    HDFS, MapReduce, Hive, Pig, HBase, Sqoop, Flume

    .
  • Strong proficiency in

    Java, Scala, or Python

    for big data processing.
  • Experience with data modeling and query optimization in Hive or HBase.
  • Familiarity with data ingestion techniques and tools (Sqoop, Flume, Kafka).
  • Understanding of cluster management and resource schedulers like YARN.
  • Knowledge of Linux/Unix environments and shell scripting.
  • Experience with version control (Git) and CI/CD pipelines.
  • Strong analytical and problem-solving skills.

More Jobs at Teamware Solutions

Fraud Investigation Analyst

Bengaluru, Hyderabad

1 - 3 yrs
|

INR 3 - 6 Lacs

AML/KYC Analyst

Bengaluru

1 - 3 yrs
|

INR 3 - 5 Lacs

AML/KYC/CDD/EDD/Client Onboarding/ Global KYC

Bengaluru

1 - 4 yrs
|

INR 3 - 5 Lacs

Sanction screening Bangalore

Bengaluru

3 - 5 yrs
|

INR 5 - 9 Lacs

Sanction Screening

Bengaluru

3 - 6 yrs
|

INR 3 - 7 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Teamware Solutions logo
Teamware Solutions

IT Services and IT Consulting

Chennai Tamilnadu

RecommendedJobs for You

Teamware Solutions logo

Big Data Engineer (Hadoop)

Teamware Solutions

chennai, tamil nadu, india

Teamware Solutions ( A division of Quantum Leap Co nsulting Private LTD). logo

Big Data Engineer (Hadoop)

Teamware Solutions ( A division of Quantum Leap Co nsulting Private LTD).

Chennai

Senior Technical Consultant - C#/.Net

4s Advisory

delhi ncr, india

Senior Technical Consultant - C#/.Net

4s Advisory

chennai, tamil nadu, india

Capgemini Technology Services India Limited logo

SRE

Capgemini Technology Services India Limited

bengaluru, karnataka, india

Software Engineer (Full Stack)

Airpay Services

panchkula, haryana, india

Aptean logo

Engineer, Development

Aptean

bengaluru, karnataka, india

Aptean logo

Lead Engineer, Automation

Aptean

bengaluru, karnataka, india

DealerSocket logo

Lead Software Engineer

DealerSocket

hyderabad, telangana, india

DealerSocket logo

Lead Software Engineer

DealerSocket

hyderabad, telangana, india