Big Data Engineer

RiskInsight Consulting Pvt Ltd.

4 years

0 Lacs

Hyderabad Telangana India

Posted:1 day ago| Platform:

Apply

Skills Required

data design hadoop spark nosql integrity monitoring troubleshooting processing governance security support engineering hive programming python scala sql querying communication collaboration cutting collaborative training development

Work Mode

On-site

Job Type

Full Time

Job Description

Responsibilities

Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases
Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis
Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions
Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques
Optimize data processing workflows for maximum performance and efficiency
Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems
Implement best practices for data governance, security, and compliance
Document technical designs, processes, and procedures to support knowledge sharing across teams

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or a related field
4+ years of experience as a Big Data Engineer or in a similar role
Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks
Extensive experience with programming languages such as Python, Scala, or Java
Knowledge of data modeling and data warehousing concepts
Familiarity with NoSQL databases like Cassandra or MongoDB
Proficient in SQL for data querying and analysis
Strong analytical and problem-solving skills
Excellent communication and collaboration abilities
Ability to work independently and effectively in a fast-paced environment

Benefits

Competitive salary and benefits package.Opportunity to work on cutting-edge technologies and solve complex challenges.Dynamic and collaborative work environment with opportunities for growth and career advancement.Regular training and professional development opportunities.

More Jobs at RiskInsight Consulting Pvt Ltd.

Test Automation Engineer

Hyderabad, Telangana, India

8 - 8 yrs

Salary: Not disclosed

Test Automation Engineer

India

10.0 - 10.0 yrs

Salary: Not disclosed

Senior Test Automation Engineer

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

SAP Hana Consultant

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Big Data Engineer

Pune, Maharashtra, India

4.0 - 4.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.