Data Engineer (Pyspark + DataBricks) Contract Hiring

Golden Opportunities

6 - 10 years

18 Lacs

hyderabad chennai bengaluru

Posted:6 hours ago| Platform:

Apply

Skills Required

databricks delta lake architecture data engineering pyspark data engineer etl

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Summary:

We are looking for a skilled Data Engineer with strong experience in PySpark and Azure Databricks to design, build, and optimize scalable data pipelines and analytics solutions.

The ideal candidate will have hands-on expertise in big data processing, Azure data services, and automation for data-driven decision-making.

Key Responsibilities:

Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory and Databricks. Build and optimize PySpark scripts and Databricks notebooks for large-scale data processing. Perform data ingestion, transformation, and aggregation from multiple sources (SQL, APIs, ADLS, Blob, SFTP, etc.).
Implement Delta Lake architecture for data versioning, ACID transactions, and optimized queries.
Work with Azure Data Lake Storage (Gen2) for managing and structuring raw, processed, and curated data layers. Develop and manage CI/CD pipelines for Databricks using Azure DevOps or GitHub Actions.
Implement data validation, quality checks, and monitoring mechanisms across data pipelines. Collaborate with business and analytics teams to deliver clean, structured data for reporting and machine learning.
Optimize PySpark jobs using techniques like broadcast joins, Z-Ordering, partitioning, and caching.
Ensure compliance with data governance, security, and regulatory requirements. Troubleshoot performance bottlenecks and improve resource utilization on Databricks clusters.

Contact Person - Christopher

Email id - christopher@gojobs.biz

More Jobs at Golden Opportunities

Application Support Engineer-L1 (Should have worked on ITIL)-

Pune, Coimbatore

1 - 2 yrs

INR 2 - 3 Lacs

Provider Contact Center Executive (International voice process)

Bengaluru

Experience: Not specified

INR 2 - 3 Lacs

Dotnet + Angular developer - SA/M - GO/JC/21515/2025

Mumbai Metropolitan Region

Experience: Not specified

Salary: Not disclosed

Sailpoint Developer - GO/JC/21506/2025

Mumbai Metropolitan Region

Experience: Not specified

Salary: Not disclosed

Zonal Manager - Sales - GO/JC/014/2025

Navi Mumbai, Maharashtra, India

5 - 8 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.