Data Engineer

Looking for a specialized Data engineer who focuses on building and maintaining data pipelines to collect, process, and analyze large volumes of transaction data specifically for the purpose of detecting and preventing fraudulent activity within a company's payment systems.

As a Senior Data Engineer

• Oversee the integration and management of data from various sources and storage systems, establishing processes and pipelines to produce cohesive datasets for analysis and modeling.
• Design and develop data pipelines to automate repetitive tasks within data science and data engineering.
• Demonstrated experience leading cross-functional teams or working across different teams to solve complex problems.
• Partner with software engineering teams to deploy and validate production artifacts.
• Identify patterns and innovative solutions in existing spaces, consistently seeking opportunities to simplify, automate tasks, and build reusable components for multiple use cases and teams.
• Create data products that are well-modeled, thoroughly documented, and easy to understand and maintain.
• Comfortable leading projects in environments with undefined or loose requirements.

Qualifications

• Bachelor’s degree in computer science, Information Systems, or another related field.
• 7 to 9 years of experience in Data Engineering and implementing multiple end-to-end DW projects in a Big Data environment.

• ​

  Experience in building data pipelines through Spark with Java/Scala on Hadoop or Object storage.
• ​Experience working with Databases like Oracle, and Netezza and have strong SQL knowledge.
• ​Experience working on Nifi will be an added advantage.
• ​Experience working with APIs will be an added advantage.
• Experience and working in a Unix environment is an added advantage.
• ​Strong analytical skills are required for debugging production issues, providing root causes, and implementing the mitigation plan.
• ​Ability to multi-task across multiple projects, interface with external/internal resources, and provide technical leadership to junior team members.
• ​Flexibility to work as a member of matrix-based diverse and geographically distributed project teams.
• ​Experience of working in Agile teams.