Senior Data Engineer - Python & Spark & SQL

Mastercard

4 - 8 years

10 - 15 Lacs

pune

Posted:2 weeks ago| Platform:

Apply

Skills Required

python machine learning sql deep learning unix internals deep learning frameworks hive algorithms rdbms scala information security data engineering artificial intelligence java apache nifi spark hadoop api sqoop big data aws unix hbase ml

Work Mode

Work from Office

Job Type

Full Time

Job Description

Title and Summary

Senior Data Engineer - Python
Spark & SQLOverview-Mastercard is a global technology company behind the worlds fastest payments processing network
We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless
We ensure every employee has the opportunity to be a part of something bigger and to change lives
We believe as our company grows, so should you
We believe in connecting everyone to endless, priceless possibilities
Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data
You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems

Role

Modernize existing systems as needed, while also maintaining and supporting the current legacy applications
Follow MasterCard Quality Assurance and Quality Control processes
Leverage new technologies and approaches to foster innovation when handling increasingly large data sets
Work together with the project team to meet scheduled deadlines and identify any new issues, offering solutions to resolve problems as they arise
Provide recommendations to uphold essential standards and processes, while
proactively identifying opportunities to enhance standards and streamline workflows for greater efficiency

All About You

Skilled in Data Engineering and experienced in delivering several end-to-end data warehouse projects within Big Data environments
Experience in developing data pipelines using Spark with Python or Java on Hadoop or object storage
Extensive experience working with Python programmingPrior experience of working in a Unix environment is required
Experienced in working with RDBMS databases and possess strong SQL skillsHaving experience with AI/ML and deep learning algorithms would be considered a valuable asset
Experience of working on Nifi will be an added advantageExperience of working with APIs will be an added advantageExperience with machine learning and deep learning algorithms will be an added advantage
Experience of working in Agile team
Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
Strong communication skills - both verbal and written and strong relationship, collaboration

kills and organizational skills

Capable of managing several projects simultaneously, collaborating with both internal and external teams, and offering technical guidance to junior colleagues
Demonstrates high energy, attention to detail, and a proactive approach, with the ability to work independently under pressure
Shows strong initiative and self-motivation to achieve resultsProficient in rapidly adopting new technologies and executing PoCs to identify optimal solutions
Adaptable team player with experience collaborating across diverse, matrix-structured, and globally distributed project teams

More Jobs at Mastercard

Senior Analyst - Project Management

Pune

5 - 9 yrs

INR 13 - 18 Lacs

Sr. Principal Software Engineer

Pune

9 - 13 yrs

INR 20 - 25 Lacs

Lead Software Engineer-R-245726

Vadodara, Gujarat, India

2 - 4 yrs

Salary: Not disclosed

Consultant-2

Gurugram, Haryana

Experience: Not specified

Salary: Not disclosed

Consultant-2

Gurugram, Haryana

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.