Big Data Engineer

Job Title:

Experience:

Employment Type:

About the Role

Experience Requirements

• 5+ years

   of professional experience in

  Data Engineering

  ,

  Data Pipeline Development

  , or

  Big Data Platform Development

• Proven experience in

  data architecture

  ,

  data modeling

  , and

  ETL design

Technical Skills & ExpertiseBig Data & Distributed Systems

• Hands-on experience with

  Hadoop

  ,

  Spark

  ,

  MapReduce

  ,

  Hive

  ,

  HBase

  , and other distributed computing frameworks
• Proficiency in

  PySpark

   for scalable data transformations and analytics

Programming & Software Engineering

• Strong development skills in

  Python

   (best practices: linting, unit testing, integration testing, code review, Git flow)
• Knowledge of

  algorithms

  ,

  data structures

  , and

  data validation techniques

• Experience with

  bash scripting

   and

  Linux OS configuration

Data Architecture & Databases

• Expertise in

  data warehousing

  ,

  data modeling

   (Relational, ETL, OLTP)
• Strong SQL skills (SQL, PL/SQL, T-SQL); exposure to

  NoSQL databases

   is a plus
• Experience with

  data quality assessment

  , including profiling, anomaly detection, and schema documentation

DevOps & Agile Practices

• Familiarity with

  CI/CD pipelines

   and tools like

  GitHub

  ,

  Jenkins

  , and

  Docker

• Understanding of

  Agile methodology

  ,

  DevOps principles

  , and modern software delivery practices
• Troubleshooting distributed systems and production issues in a collaborative environment

Functional Skills

• Proven experience working in

  Agile teams

• Ability to ensure

  technical quality

  ,

  scalable design

  , and

  maintainability

   of data systems
• Strong analytical and problem-solving skills; capable of benchmarking and evaluating emerging technologies
• Prior experience in

  Banking

  ,

  Financial Services

  , or

  FinTech

   domains is highly preferred
• Capable of influencing cross-functional teams and improving technical productivity through mentorship and collaboration

If you have the skills and are ready to make an impact, we'd love to hear from you! Apply today or share this post with someone who might be interested.

shalini.v@saranshinc.com