Data Engineer

Paypay India

5 - 9 years

18 - 33 Lacs

gurugram

Posted:-1 days ago| Platform:

Apply

Skills Required

data bricks airflow data engineering glue scala data lake spark aws python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform.
Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines.
Develop data processing workflows using Databricks, Delta Lake, and Spark technologies.
Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery.
Construct automation, frameworks, and enhanced tools to streamline data engineering workflows.
Collaborate across teams to facilitate smooth data flow and integration.
Enforce best practices in observability, data governance, security, and regulatory compliance

Preferred candidate profile

Minimum 5 years as a Data Engineer or similar role.
Hands-on experience with Databricks, Delta Lake, Spark, and Scala.
Proven ability to design, build, and operate Data Lakes or Data Warehouses.
Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect).
Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell).
Strong command of at least one primary language (Scala, Python, etc.) and SQL.
Experience with data catalog and metadata management (Unity Catalog, Lakeformation).
Experience in Infrastructure as Code (IaC) using Terraform.
Excellent problem-solving and debugging abilities for complex data challenges.
Strong communication and collaboration skills.
Capability to make informed decisions, learn quickly, and consider complex technical contexts.

More Jobs at Paypay India

Site Reliability Engineer

Gurugram

5.0 - 10.0 yrs

INR 25 - 40 Lacs

Site Reliability Engineer (SRE)

New Delhi, Gurugram, Delhi / NCR

5.0 - 10.0 yrs

INR 35 - 75 Lacs

Data Engineer

gurugram

5.0 - 9.0 yrs

INR 18 - 33 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.