Data Engineer

National Payment Corporation of India (NPCI) is hiring!

The opportunity

We are seeking a Data Engineer to join NPCIs Data Solutioning and Architecture team. In this role, you will design, develop, and implement scalable data solutions that align with organizational goals. You will leverage your expertise in data architecture, modeling, migration, and validation, while managing a team of senior data engineers and collaborating with stakeholders across departments to deliver high-quality, data-driven solutions.

Job details

• Job Title:

  Data Engineer

• Division:

  NPCI Market Innovation

• Years of Experience:

  3+ to 13 years

• Education:

  Bachelors/Masters in Computer Science, Electronics/Electrical Engineering, Data Science, or related technical field

• Employment Type:

  Full-time

• Location:

  Mumbai, Hyderabad & Chennai

• Role Type:

  Permanent

Key responsibilities

• Lead the design and maintenance of data lakes and scalable data tables ensuring data privacy and security.
• Represent the core NPCI Data Engineering team to devise optimal data engineering solutions.
• Evaluate POCs and recommend emerging data technologies/tools to drive innovation.
• Suggest architectural models, review, and approve technical documentation.
• Collaborate with cross-functional teams to ensure robust data pipelines for data-driven solutions.
• Perform hands-on coding and design to implement optimal data pipelines.
• Manage and mentor a team of senior/lead data engineers, set career development goals, and track progress.
• Influence cross-functional teams with data-driven insights to improve product features and performance.

Key skills and experience required

• Strong expertise in data architecture, modeling, migration, and validation.
• Hands-on experience in ETL/ELT processes and building scalable data pipelines.
• Excellent problem-solving, interpersonal, and communication skills.
• Ability to manage teams and collaborate with stakeholders across departments.
• Knowledge of banking and financial services is an added advantage.

Required Technical Skills

• Data Pipeline Tools:

  Apache Hadoop, Apache Hive, Apache Spark, DBT, DAGSTER, Trino, Airflow.

• Real-Time Processing:

  Kafka, Spark Streaming, Flink, Druid.

• Programming:

  Python, PySpark, Scala.

• SQL:

  Advanced proficiency and query optimization.

• Data Visualization:

  Tableau, Power BI, Apache Superset.
• Big Data Solutions & Data Governance principles.

• Containerization & Deployment:

  Kubernetes, Docker, CI/CD.
• Monitoring tools and performance tuning.

Good to have skills and experience required

• Bachelors or Masters degree in Computer Science, Electronics/Electrical Engineering, Data Science, or related technical field.
• 4+ years of experience in data engineering, data warehousing, and ETL technologies.
• Practical knowledge of Big Data solutions and governance principles.