P

MDM Developer / Senior Software Engineer

Predfut Technology

10 - 20 Lacs

Chennai

Posted:1 week ago

Job Description

Job Summary

We are looking for an experienced MDM Developer with strong expertise in PySpark and Java to design, develop, and maintain scalable data processing pipelines and master data management solutions. The candidate will be responsible for data integration, transformation, cleansing, deduplication, and synchronization across enterprise systems.

Key Responsibilities

  • Design and develop scalable data processing pipelines using Apache Spark and PySpark.
  • Develop backend applications and REST APIs using Java and Spring Boot.
  • Build ETL/ELT pipelines for processing large volumes of structured and semi-structured data.
  • Implement MDM processes, including data matching, merging, deduplication, and survivorship rules.
  • Integrate master data from ERP, CRM, databases, APIs, and external systems.
  • Develop data validation, standardization, and quality-checking frameworks.
  • Optimize PySpark jobs for performance, memory utilization, and distributed processing.
  • Design and maintain batch and near-real-time data synchronization workflows.
  • Troubleshoot production issues and ensure data consistency across applications.
  • Collaborate with data engineering, architecture, and business teams.

Required Technical Skills

Technology

Expected Expertise

PySpark

Strong hands-on experience with Spark DataFrames, transformations, joins, aggregations, and performance optimization

Java

Core Java, Java 8+, Spring Boot, REST APIs

SQL

Complex queries, joins, stored procedures, query optimization

Apache Spark

Distributed processing, partitioning, caching, Spark SQL

MDM

Data matching, deduplication, survivorship, golden records

ETL/ELT

Data extraction, transformation, loading, and orchestration

Databases

PostgreSQL, MySQL, Oracle, or SQL Server

Data Formats

JSON, CSV, Parquet, XML

Version Control

Git, CI/CD pipelines

Good to Have

  • Experience with AWS Glue, EMR, S3, or Azure Databricks.
  • Knowledge of Apache Kafka for event-driven data integration.
  • Experience with Delta Lake or data lakehouse architectures.
  • Exposure to Informatica MDM, Reltio, or similar MDM platforms.
  • Experience with Docker, Kubernetes, and cloud deployments.
  • Knowledge of data governance, metadata management, and data lineage.

Pay: ₹1,075,000.00 - ₹2,010,000.00 per year

Benefits:

  • Paid time off
  • Provident Fund

Work Location: Hybrid remote in Chennai, Tamil Nadu

Skills Required

Pyspark Java Data Processing Master Data Management Data Integration Apache Spark Backend Rest Apis Spring Boot ETL Master Data ERP

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now
P
Predfut Technology

RecommendedJobs for You

P
P