Senior Data Engineer

EXL

6 years

0 Lacs

pune maharashtra india

Posted:1 day ago| Platform:

Apply

Skills Required

data power processing pipeline orchestration management cataloging design coding support marketing hadoop spark hive airflow databricks git jira jenkins agile test development aws automation governance integration engineering software combination sql python

Work Mode

On-site

Job Type

Full Time

Job Description

Summary:

Technical Proficiency:

6+ years of experience and a bachelor’s degree in computer science or a related field, or equivalent work experience
In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster
At least 4 years of solid production quality coding experience in data pipeline implementation in Python
Experience working with public cloud platforms, preferably AWS
Experience working with Databricks and/or Snowflake
Experience in Git, JIRA, Jenkins, shell scripting
Familiarity with Agile methodology, test-driven development, source control management and test automation

Role and Responsibilities:

You will build services that will integrate directly with products and with external vendors.
You will work with modern data technologies such as Hadoop, Spark, DBT, Dagster/Airflow, Atlan, Trino, etc., modern data platforms such as Databricks and Snowflake and cloud technologies across AWS stack
Identify, design, and implement automation of manual processes, optimizing data delivery, reducing Cloud cost, etc.
Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage.
Support operations to manage the production environment and help in resolving production issues with RCA
Write unit/integration tests, adopt Test-driven development, contribute to engineering wiki, and document design/implementation etc.

Education:

Key Skills:

More Jobs at EXL

Senior Manager

Gurgaon

7 - 10 yrs

INR 20 - 30 Lacs

GL - Senior Executive

Bengaluru

3 - 6 yrs

INR 3 - 8 Lacs

Executive (Accounts Payable )

Pune

1 - 3 yrs

INR 2 - 3 Lacs

OTC Cash Application - Senior Executive

Bengaluru

1 - 3 yrs

INR 1 - 5 Lacs

OTC Billing - Senior Executive

Bengaluru

1 - 3 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.