Senior Data Engineer

Dautom

0 years

0 Lacs

India

Posted:2 weeks ago| Platform:

Apply

Skills Required

data java mapreduce hive spark hadoop sqoop sql analyze integrity audit programming python scripting linux ruby nosql azure learning

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities:

Lead and manage a
backend/distributed systems team
and third-party resources
Build and optimize
Java, MapReduce, Hive, and Spark jobs
Work with a wide range of
Hadoop tools
: HDFS, Pig, Hive, HBase, Sqoop, Flume
Implement and manage
real-time stream processing
using Spark Streaming, Storm
Develop
dimensional data models
and perform
advanced SQL tuning
Analyze source data integrity and ensure accurate data ingestion
Build dashboards and BI solutions using best practices
Collaborate with internal teams and vendors to prioritize and deliver data initiatives
Deploy, monitor, and audit big data models and workflows

Technical Skills:

Strong hands-on with
Hadoop (Cloudera), Hive, Pig, Impala, Spark
Programming in
Java, Python, Scala
, and scripting (Linux, Ruby, PHP)
Experience with
NoSQL and SQL databases
: Cassandra, Postgres
Familiarity with
cloud services (Azure preferred)
Exposure to
machine learning/data science
tools is a plus

More Jobs at Dautom

Delivery Coordinator

India

Experience: Not specified

Salary: Not disclosed

Oracle HCM Consultant

India

5.0 - 5.0 yrs

Salary: Not disclosed

SENIOR JAVA DEVELOPER

India

Experience: Not specified

Salary: Not disclosed

Data Governance Consultant

India

5.0 - 5.0 yrs

Salary: Not disclosed

Project Manager Data Protection

India

15.0 - 15.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.