Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in pune
>
Mastercard
>
Senior Software Engineer (Data Platform | Bigdata, NiFi, Spark

Senior Software Engineer (Data Platform | Bigdata, NiFi, Spark

Mastercard

7 - 12 years

19 - 22 Lacs

pune

Posted:3 days ago| Platform:

Apply

Skills Required

software engineer s3 kubernetes data pipelines data engineer airflow workflow orchestration ai data engineering alerting java apache nifi spark gcp devops apache spark linux onboarding splunk big data aws apache airflow azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

Senior Software Engineer (Data Platform | Bigdata, NiFi, Spark, Airflow, Kubernetes, MinIO,CEPH)

Overview

The Enterprise Data Solutions team is looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space
The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain

About the Role

As a Senior Software Engineer on the enterprise-wide Data Platform team, you will play a critical role in building, enhancing, and scaling distributed data systems
Youll collaborate with engineering leads and cross-functional teams to deliver robust solutions using technologies such as NiFi, Spark, MinIO, Kubernetes, and Airflow

Key Responsibilities

Design and develop scalable data pipelines and services using NiFi, Spark, and other distributed frameworks
Install and debug the services like NiFi, Spark, Airflow, Kubernetes, MinIO/CEPH etc
Contribute to the integration and deployment of containerized workloads using Kubernetes and Airflow
Collaborate with product managers, architects, and engineers to translate business requirements into technical solutions
Ensure high availability, fault tolerance, and performance of platform components
Participate in code reviews, testing, and documentation to uphold engineering excellence
Monitor and troubleshoot production systems, proactively identifying and resolving issues
Support onboarding and enablement of application teams using the data platform

Technical Skills

Experience with distributed systems and data processing frameworks (eg, Apache NiFi, Apache Spark)
Familiarity with object storage systems like MinIO or S3
Hands-on experience with Kubernetes and workflow orchestration tools like Apache Airflow
Background in Java for data processing and automation is desired
Understanding of CI/CD pipelines and DevOps practices
Expertise in Linux/Unix administration, scripting, and automation
Experience with Dynatrace/Splunk for monitoring, alerting, and incident management in production environments
Exposure to cloud platforms (AWS, GCP, or Azure) is a plus
Exposure to AI solutions for automating data platform tasks is preferred

Soft Skills

Strong problem-solving and analytical skills
Effective communication and collaboration across teams
Ability to work independently and take ownership of deliverables
Willingness to mentor junior engineers and contribute to team growth

Qualifications

Bachelors degree in Computer Science, Engineering, or a related field
7+ years of experience in software engineering, preferably in data platform or infrastructure teams
Prior experience in enterprise environments or large-scale systems is preferred

More Jobs at Mastercard

Senior Analyst - Project Management

Pune

5 - 9 yrs

INR 13 - 18 Lacs

Sr. Principal Software Engineer

Pune

9 - 13 yrs

INR 20 - 25 Lacs

Lead Software Engineer-R-245726

Vadodara, Gujarat, India

2 - 4 yrs

Salary: Not disclosed

Consultant-2

Gurugram, Haryana

Experience: Not specified

Salary: Not disclosed

Consultant-2

Gurugram, Haryana

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Software Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.