Luxoft logo

ETL Developer with AWS EMR

5 - 9 years

0 Lacs

chennai tamil nadu

Posted:4 days ago| Platform: Shine logo

Apply

Skills Required

python sql sas di snowflake tableau etl development aws emr pyspark aws s3

Work Mode

On-site

Job Type

Full Time

Job Description

As a Python Developer, you will be joining a team working with a renowned financial institution to deliver business value through your expertise. Your role will involve analyzing existing SAS DI pipelines and SQL-based transformations, translating and optimizing SAS SQL logic into Python code using frameworks like Pyspark, developing scalable ETL pipelines on AWS EMR, implementing data transformation and aggregation logic, designing modular code for distributed data processing tasks, integrating EMR jobs with various systems, and developing Tableau reports for business reporting. Key Responsibilities: - Analyze existing SAS DI pipelines and SQL-based transformations. - Translate and optimize SAS SQL logic into Python code using frameworks such as Pyspark. - Develop and maintain scalable ETL pipelines using Python on AWS EMR. - Implement data transformation, cleansing, and aggregation logic to meet business requirements. - Design modular and reusable code for distributed data processing tasks on EMR clusters. - Integrate EMR jobs with upstream and downstream systems like AWS S3, Snowflake, and Tableau. - Develop Tableau reports for business reporting. Qualifications Required: - 6+ years of experience in ETL development, with a minimum of 5 years working with AWS EMR. - Bachelor's degree in Computer Science, Data Science, Statistics, or a related field. - Proficiency in Python for data processing and scripting. - Proficient in SQL and experience with ETL tools such as SAS DI or Informatica. - Hands-on experience with AWS services including EMR, S3, IAM, VPC, and Glue. - Familiarity with data storage systems like Snowflake or RDS. - Excellent communication skills and ability to collaborate in a team environment. - Strong problem-solving skills and capability to work independently. Join us in this exciting opportunity to contribute to the success of our projects and collaborate with a team of skilled professionals in a challenging environment.,

More Jobs at Luxoft

Murex XVA Functional BA

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Fullstack Developer (React, JavaScript, TypeScript)

Pune, Maharashtra, India

3 - 3 yrs
|

Salary: Not disclosed

Data Engineer

Pune, Maharashtra, India

5 - 8 yrs
|

Salary: Not disclosed

Power Bi Developer

Gurugram

7 - 10 yrs
|

INR 15 - 20 Lacs

Credit Risk Consultant

Gurugram

4 - 8 yrs
|

INR 7 - 11 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Luxoft logo
Luxoft

IT Services and IT Consulting

Zug New York

RecommendedJobs for You

Luxoft logo

ETL Developer with AWS EMR

Luxoft

chennai, tamil nadu

Luxoft logo

ETL Developer with AWS EMR

Luxoft

chennai, tamil nadu

Luxoft logo

ETL Developer with AWS EMR

Luxoft

chennai, tamil nadu

Luxoft logo

ETL Developer with AWS EMR

Luxoft

chennai, tamil nadu