Data Engineer

Careernet

3 - 8 years

37 - 65 Lacs

bengaluru

Posted:1 hour ago| Platform:

Apply

Skills Required

java hadoop cassandra big data aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Skills:

Roles and Responsibilities:

Design, implement, and support large-scale data processing systems using Hadoop (MapReduce, Hive, HDFS)
Build and optimize data lakes on AWS to store and process massive data sets
Work with Cassandra to manage distributed, high-volume, and low-latency data workloads
Collaborate with data scientists, analysts, and product teams to understand data needs and deliver reliable solutions
Ensure data quality, governance, and consistency across systems and environments
Monitor and troubleshoot data pipelines, ensuring reliability and scalability
Utilize strong proficiency in Java with a solid understanding of data structures and multithreading
Apply hands-on experience with Big Data technologies such as Hadoop, Hive, HDFS, and Spark
Maintain a solid understanding of ETL processes and data architecture principles
Work in agile environments with CI/CD practices and ensure familiarity with data security, compliance, and privacy best practices
Exposure to DevOps tools (Docker, Kubernetes, Terraform) is a plus

Skills Required:

Strong hands-on experience with Hadoop (MapReduce, Hive, HDFS)
Proficiency in Java with a good understanding of data structures and multithreading
Experience with Big Data tools and frameworks like Hive, Spark
Working knowledge of Cassandra for distributed database management
Exposure to AWS services and data lake architectures
Familiarity with ETL processes and data architecture principles
Knowledge of CI/CD, agile practices, and DevOps tools (e.g., Docker, Kubernetes, Terraform)
Awareness of data governance, security, and compliance standards

Education:

More Jobs at Careernet

Devops Engineer

Pune

6 - 11 yrs

INR 10 - 20 Lacs

Servicenow Developer

Chennai, Bengaluru, Hyderabad

4 - 6 yrs

INR 10 - 18 Lacs

RDS Engineer

Bengaluru

6 - 9 yrs

INR 8 - 18 Lacs

Senior ML Software Engineer

Bengaluru

7 - 11 yrs

INR 30 - 40 Lacs

ICC System Architect

Bengaluru

12 - 17 yrs

INR 22 - 37 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.