Databricks + Pyspark

Cognizant

8 - 13 years

27 - 42 Lacs

hyderabad

Posted:1 hour ago| Platform:

Apply

Skills Required

hive amazon redshift pyspark data warehousing data architecture data pipeline sql plsql automation data modeling optimization spark devops hadoop etl big data python workflow machine learning data engineering sql server data bricks hdfs sqoop aws ssis informatica etl process

Work Mode

Work from Office

Job Type

Full Time

Job Description

Skills- Databricks+ Pyspark

Experience: 4 to 13 years

Location: AIA-Pune

We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.

Key Responsibilities:

Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.
Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models.
Performance & Cost Optimization: Fine-tune Spark configurations, optimize Databricks clusters, and reduce compute/storage costs.
Collaboration: Work closely with Data Scientists, Analysts, and DevOps teams to ensure data reliability.
ETL & Data Warehousing: Implement scalable ETL processes for structured & unstructured data.
Monitoring & Automation: Implement logging, monitoring, and alerting mechanisms for data pipeline health and fault tolerance.

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.