Director, Data Engineering & Architecture - Core Services

Mastercard

12 - 16 years

35 - 40 Lacs

pune

Posted:-1 days ago| Platform:

Apply

Skills Required

python big data technologies cloud platforms apache aws hive scala microsoft azure data architecture data engineering ansible sql nosql software development life cycle java spark gcp jenkins j2ee terraform hadoop big data etl agile methodology

Work Mode

Work from Office

Job Type

Full Time

Job Description

Overview

We are seeking a visionary and hands-on Director of Data Engineering & Architecture to lead the design and delivery of scalable data solutions within Mastercards Core Services
This role combines deep technical expertise in big data technologies with strategic leadership and people management
You will architect systems that power Mastercards core transaction platforms and services, while mentoring a high-performing engineering team
Role Responsibilities Architect and deliver end-to-end data platforms using technologies such as Hadoop, Spark, Scala, and Python
Lead and mentor a team of data engineers and architects, fostering a culture of innovation, accountability, and continuous improvement
Lead the adoption of object store architectures like Ozone to overcome HDFS limitations in scalability and small file handling
Define and evolve Mastercards reference architecture for big data processing, ensuring alignment with enterprise engineering principles
Collaborate cross-functionally with product, infrastructure, and business teams to translate requirements into scalable technical solutions
Ensure engineering excellence through code reviews, architectural guidance, and adherence to best practices in software development and data governance
Drive performance and reliability improvements across data pipelines and platforms, proactively identifying and resolving bottlenecks
Champion modern engineering practices including CI/CD, DevOps, and cloud-native development

All About You

Technical Qualifications

Proven experience designing and delivering large-scale distributed data architectures in production environments
Deep expertise in Apache Ozone, including its metadata layer, replication protocols (RAFT), and S3-compatible object APIs4
Strong understanding of big data technologies (Hadoop, Spark, Scala, Python) and cloud platforms (AWS, Azure, GCP)
Experience with advanced design patterns (e.g, service-to-worker, API gateway, dependency injection) to implement efficient, scalable code
Skilled in infrastructure-as-code and orchestration tools (Terraform, Ansible, Jenkins)
Ability to simplify complex systems and reduce operational overhead through automation and standardization

Professional Skills

Strong leadership skills with experience managing and developing engineering teams
Ability to communicate complex technical concepts to non-technical stakeholders
Experience with agile methodologies and modern software development lifecycle practices
Passion for mentoring, coaching, and building inclusive teams
Education Bachelors or Masters degree in Computer Science, Engineering, or related field.

More Jobs at Mastercard

Senior Analyst - Project Management

Pune

5 - 9 yrs

INR 13 - 18 Lacs

Sr. Principal Software Engineer

Pune

9 - 13 yrs

INR 20 - 25 Lacs

Lead Software Engineer-R-245726

Vadodara, Gujarat, India

2 - 4 yrs

Salary: Not disclosed

Consultant-2

Gurugram, Haryana

Experience: Not specified

Salary: Not disclosed

Consultant-2

Gurugram, Haryana

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.