Databricks + Pyspark

Cognizant

4 years

0 Lacs

hyderābād

Posted:1 week ago| Platform: GlassDoor logo

Apply

Skills Required

databricks pyspark data design processing etl architecture engineering spark optimization storage collaboration devops monitoring automation logging pipeline

Work Mode

On-site

Job Type

Part Time

Job Description

Skills- Databricks+ Pyspark

Experience: 4 to 13 years

Location: AIA-Pune

We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.

Key Responsibilities:

Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.
Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models.
Performance & Cost Optimization: Fine-tune Spark configurations, optimize Databricks clusters, and reduce compute/storage costs.
Collaboration: Work closely with Data Scientists, Analysts, and DevOps teams to ensure data reliability.
ETL & Data Warehousing: Implement scalable ETL processes for structured & unstructured data.
Monitoring & Automation: Implement logging, monitoring, and alerting mechanisms for data pipeline health and fault tolerance.

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.