Data Engineer

Job Title: Data Engineer

Location: Chennai (WFO-5 days a week)

Job Overview:

Data Engineer

Key Responsibilities:

• Lead and mentor a team of 5 or more data engineers, ensuring high-quality deliverables and adherence to project timelines.
• Design, implement, and optimize large-scale data warehousing and data lake solutions, preferably on big data platforms.
• Manage and monitor production data pipelines, ensuring minimal downtime and timely resolution of failures.
• Ensure compliance with SOX, PCI, and PII requirements across data systems and processes.
• Work collaboratively in an Agile environment using tools like JIRA and Confluence for documentation, sprint planning, and tracking.
• Collaborate with cross-functional teams including data scientists, analysts, DevOps, and product managers.
• Drive best practices in code quality, testing, deployment, and documentation.

Required Skills & Qualifications:

• Minimum of 4 years of total experience in data engineering or a related field.
• Minimum 1 years of experience in a technical leadership or team lead role.
• Strong experience with 

  data warehouse

   and 

  data lake

   architectures.
• Proficiency in 

  Snowflake

  , 

  Apache Spark

  , 

  Python scripting

  , 

  Bash scripting

  , and 

  Linux

  .
• Expertise in 

  FiServ or TSYS

   platform.
• Experience managing and troubleshooting 

  production jobs

  , pipelines, and job orchestration tools.
• Experience in 

  Snowpark Python and Snowpark Containers Service

• Experience with 

  Serverless technologies and AWS services

• Experience with File transfer tools like 

  SFTP and FTP and FTPS

• Scripting experience with 

  AWS

  client tool with S3 files

• Excellent understanding of data governance and compliance standards including 

  SOX

  , 

  PCI

  , and 

  PII

  .
• Exceptional written and verbal communication skills, with proven experience documenting technical processes and designs.
• Prior experience working in 

  banking

  , 

  financial services

  , or 

  credit card

   domains.
• Familiarity with CI/CD practices and modern data toolchains.
• Experience working in a cloud environment (AWS, GCP, or Azure).