Senior Data Engineer

Experian

6 - 9 years

13 - 17 Lacs

hyderabad

Posted:1 week ago| Platform:

Apply

Skills Required

continuous integration python cd tools sql ci / cd tools amazon redshift airflow data warehousing ci/cd pyspark emr data engineering financial services agile development methodology apache jenkins gitlab agile aws etl etl process

Work Mode

Work from Office

Job Type

Full Time

Job Description

Senior Data Engineer is responsible for design, develop and support ETL data pipelines solutions primary in AWS environment
Design, develop, and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets.
Work as part of a team to build out and support data warehouse, implement solutions using PySpark to process structured and unstructured data.
Play key role in building out a semantic layer through development of ETLs and virtualized views.
Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment
Support existing ETL processes written in SQL, or leveraging third party APIs with Python, troubleshoot and resolve production issues.
Strong SQL and data to understand and troubleshoot existing complex SQL.
Hands-on experience with Apache Airflow or equivalent tools (AWS MWAA) for orchestration of data pipelines
Create and maintain report specifications and process documentations as part of the required data deliverables.
Serve as liaison with business and technical teams to achieve project objectives, delivering cross functional reporting solutions.
Troubleshoot and resolve data, system, and performance issues
Communicating with business partners, other technical teams and management to collect requirements, articulate data deliverables, and provide technical designs.

Experience and Skills

you have completed graduation from BE/Btech
6 to 9 years of experience in Data Engineering development
5 years of experience in Python scripting
You should have 8 years experience in SQL, 5+years in Datawarehouse, 5yrs in Agile and 3yrs with Cloud
3 years of experience with AWS ecosystem (Redshift, EMR, S3, MWAA)
5 years of experience in Agile development methodology
You will work with the team to create solutions
Proficiency in CI/CD tools (Jenkins, GitLab, etc.)

More Jobs at Experian

Product Owner

Hyderabad, Telangana

Experience: Not specified

Salary: Not disclosed

Lead - Test Engineering

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Associate- Demand & Software License Management

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Credit Controller

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Client Delivery Analyst

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.