Valuelabs logo

Pyspark Developer

6 - 10 years

20 - 35 Lacs

hyderabad

Posted:1 day ago| Platform: Naukri logo

Apply

Skills Required

pyspark hadoop big data cloudera scala azure databricks spark oozie spark streaming data bricks

Work Mode

Work from Office

Job Type

Full Time

Job Description

ValueLabs is Hiring: Data Engineer | Cloudera Data Platform (CDP)

Location:

About ValueLabs

Hyderabad

Role Overview

Data Engineer

Key Responsibilities

  • Build and optimize ETL pipelines using PySpark on CDP
  • Ingest data from RDBMS, APIs, and file systems into data lakes/warehouses
  • Cleanse and transform large datasets to support analytics
  • Tune PySpark code and Cloudera components for performance
  • Implement data quality checks and validation routines
  • Automate workflows using Apache Oozie, Airflow, or similar tools
  • Monitor pipeline health and troubleshoot issues
  • Collaborate with cross-functional teams to meet data requirements
  • Document processes, code, and configurations

Required Qualifications

  • Bachelors/Masters in Computer Science, Data Engineering, or related field
  • Minimum 5 years of experience in Data Engineering roles

Technical Skills

  • PySpark (RDDs, DataFrames, optimization)
  • Cloudera Data Platform (Cloudera Manager, Hive, Impala, HDFS, HBase)
  • Data Warehousing & SQL (Hive, Impala)
  • Big Data Tools (Hadoop, Kafka)
  • Workflow Orchestration (Oozie, Airflow)
  • Linux scripting and automation

Soft Skills

  • Strong analytical and problem-solving abilities
  • Excellent communication skills
  • Team player with the ability to work independently
  • Detail-oriented with a focus on data accuracy

More Jobs at Valuelabs

React JS Developer

Bengaluru

8 - 12 yrs
|

INR 25 - 35 Lacs

Business Analyst

Hyderabad

4 - 9 yrs
|

INR 0 - 3 Lacs

Fullstack Developer

Bengaluru

5 - 10 yrs
|

INR 15 - 30 Lacs

Api Automation Tester

Hyderabad

2 - 7 yrs
|

INR 5 - 12 Lacs

Senior Software Engineer-Node.js+React.js

Chennai

6 - 11 yrs
|

INR 22 - 32 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Valuelabs logo
Valuelabs

IT Services and IT Consulting

Hyderabad Telangana

RecommendedJobs for You

Tata Consultancy Services logo

Pyspark Developer

Tata Consultancy Services

hyderabad, chennai, bengaluru

Valuelabs logo

Pyspark Developer

Valuelabs

hyderabad

Tata Consultancy Services logo

Pyspark Developer

Tata Consultancy Services

pune, gurugram, bengaluru

Viraaj HR Solutions Private Limited logo

Pyspark Developer

Viraaj HR Solutions Private Limited

chennai, tamil nadu, india

Viraaj HR Solutions Private Limited logo

Pyspark Developer

Viraaj HR Solutions Private Limited

greater kolkata area

Viraaj HR Solutions Private Limited logo

Pyspark Developer

Viraaj HR Solutions Private Limited

bengaluru, karnataka, india

Viraaj HR Solutions Private Limited logo

Pyspark Developer

Viraaj HR Solutions Private Limited

hyderabad, telangana, india

Viraaj HR Solutions Private Limited logo

Pyspark Developer

Viraaj HR Solutions Private Limited

pune, maharashtra, india

Tata Consultancy Services logo

Pyspark Developer

Tata Consultancy Services

hyderabad, chennai, bengaluru

W Beyond logo

Pyspark Developer

W Beyond

visakhapatnam