Big Data Engineer

IDESLABS PRIVATE LIMITED

6 - 11 years

7 - 11 Lacs

hyderabad

Posted:3 hours ago| Platform:

Apply

Skills Required

pyspark azure data factory big data azure databricks data engineering hive data validation scala sql automation tools java spark hadoop etl hbase python data processing nosql data bricks data quality mapreduce kafka system performance sqoop aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.

Roles and Responsibility

Design and develop scalable big data systems using Pyspark and Azure Data Bricks.
Implement and manage workflows for efficient data processing.
Collaborate with cross-functional teams to integrate data from various sources.
Develop and maintain large-scale data pipelines and architectures.
Optimize system performance and troubleshoot issues.
Ensure data quality and integrity through data validation and testing procedures.

Job Requirements

Strong experience in big data engineering with Pyspark and Azure Data Bricks.
Proficiency in managing and working with large datasets.
Experience with workflows and automation tools.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
Ability to work in a fast-paced environment and meet deadlines.

More Jobs at IDESLABS PRIVATE LIMITED

Bank Fast Platform Engineer

Bengaluru

3.0 - 7.0 yrs

INR 5 - 9 Lacs

Risk Business Analyst

Bengaluru

5.0 - 10.0 yrs

INR 8 - 13 Lacs

Salesforce Commerce Cloud Professional

Hyderabad

3.0 - 5.0 yrs

INR 4 - 6 Lacs

Python Scripting with Terraform Professional

Hyderabad

3.0 - 5.0 yrs

INR 4 - 6 Lacs

Nodejs / AWS Developer

Hyderabad

3.0 - 5.0 yrs

INR 4 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.