Home
Jobs

Posted:20 hours ago| Platform: Linkedin logo

Apply

Skills Required

data databricks unity pyspark sql governance strategies design etl controls auditing spark compliance security testing audits writing architecture azure aws airflow git processing devops engineering

Work Mode

On-site

Job Type

Full Time

Job Description

Bangalore & Gurugram YOE - 7+ years We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data quality and compliance across all stages of the data lifecycle. Implement best practices for data security and lineage within the Databricks ecosystem. Participate in CI/CD, version control, and testing practices for data pipelines Required Skills: Proven experience with Databricks and Unity Catalog (data permissions, lineage, audits). Strong hands-on skills with PySpark and Spark SQL. Solid experience writing and optimizing complex SQL queries. Familiarity with Delta Lake, data lakehouse architecture, and data partitioning. Experience with cloud platforms like Azure or AWS. Understanding of data governance, RBAC, and data security standards. Preferred Qualifications: Databricks Certified Data Engineer Associate or Professional. Experience with tools like Airflow, Git, Azure Data Factory, or dbt. Exposure to streaming data and real-time processing. Knowledge of DevOps practices for data engineering. Interested candidate can submit details at https://forms.office.com/r/g2h52X7Bt9 Show more Show less

More Jobs at PwC India

Senior Consultant - AI

Delhi, Bengaluru

5 - 10 yrs
|

INR 11 - 21 Lacs

Chatbot Developer_serving notice period_max 60dys

Bengaluru

4 - 8 yrs
|

INR 7 - 17 Lacs

Senior Automation Tester_only BLR_serving notice period/60day np Max

Bengaluru

4 - 8 yrs
|

INR 7 - 17 Lacs

Associate - Business Analyst

Bengaluru, Gurgaon, Mumbai (All Areas)

3 - 5 yrs
|

INR 6 - 8 Lacs

Senior Manager - Account Management

Bengaluru, Gurgaon, Mumbai (All Areas)

10 - 15 yrs
|

INR 20 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now

My Connections PwC India

Download Chrome Extension (See your connection in the PwC India )

chrome image
Download Now
PwC India
PwC India
www.pwc.in

Business Consulting and Services

Kolkata West Bengal

10001 Employees

1625 Jobs

    Key People

  • Santhosh Rao

    Partner

  • Ruchi Bhattacharya

    Partner, Head of Consulting

RecommendedJobs for You

Vestas logo

Data Engineer

Vestas

Chennai

Mount Talent Consulting logo

Data Engineer

Mount Talent Consulting

Hyderabad, Pune, Bengaluru

Revature logo

Data Engineer

Revature

Chennai

HCLTech logo

Data Engineer

HCLTech

Hyderabad, Chennai, Bengaluru

SP Software logo

Data Engineer

SP Software

Bengaluru

Centific logo

Data Engineer

Centific

Hyderabad

Avigna.AI logo

Data Engineer

Avigna.AI

Pune

Mindsprint logo

Data Engineer

Mindsprint

Chennai, Bengaluru

Zentek Infosoft logo

Data Engineer

Zentek Infosoft

Hyderabad, Chennai, Bengaluru

Ideagen logo

Data Engineer

Ideagen

Hyderābād