Hadoop Developer

Wellborn Technologies

6 years

0 Lacs

Noida Uttar Pradesh India

Posted:3 months ago| Platform:

Apply

Skills Required

hadoop developer data migration oracle database mysql aws azure sql script python linux connect hive pyspark etl pipeline design orchestration monitoring management configuration storage programming scripting optimization spark tuning query governance integration logging security

Work Mode

On-site

Job Type

Full Time

Job Description

Senior Hadoop Administrator / Big Data Engineer

Relevant: 6 years to 8 years

Location: Noida

Work mode: Monday to Friday (5 days Work from Office)

Budget: 22lpa to 26lpa

Migration project Oracle Cloud to Database MySQL (on-premises), No AWS or Azure is required

SQL script and Python migration

On-premises (OS: Linux) solutions - Standalone data base, connect with multiple data source

Core Competencies

Big Data Technologies: Hadoop (HDFS, YARN), Hive, PySpark
Data Ingestion & ETL: End-to-end pipeline design, orchestration, and monitoring
Cluster Management: Primary/Secondary cluster configuration, load balancing, HA setup
Platforms: On-premises infrastructure
Databases: MySQL
Storage & Management: HDFS, Hive Metastore
Programming & Scripting:
Python, PySpark, SQL
Performance Optimization: Spark tuning, Hive query optimization, YARN/EMR resource management, partitioning/bucketing
CI/CD for Data Pipelines: Building and deploying automated data pipelines in on premises environment
Monitoring & Governance: Integration with logging, monitoring tools; experience with security frameworks preferred

More Jobs at Wellborn Technologies

Frappe ERPNext Consultant (Functional + Developer)

Dehradun, Uttarakhand, India

6.0 - 6.0 yrs

Salary: Not disclosed

Android Developer

Dehradun, Uttarakhand, India

3.0 - 3.0 yrs

Salary: Not disclosed

Mobile Application Developer

Chennai, Tamil Nadu, India

8.0 - 8.0 yrs

Salary: Not disclosed

Hadoop Developer

Noida, Uttar Pradesh, India

6.0 - 6.0 yrs

Salary: Not disclosed

ETL Developer

Noida, Uttar Pradesh, India

5.0 - 6.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.