Lead Data Engineer

PYSPARK, Python, SQL , AWS, Data bricks.

Job Title: Senior Software Engineer

Duties

Evaluate and implement solutions to improve cost, quality, and performance of data products

Work alongside other team members promoting a DevSecOps culture

Participate in data delivery and modernization initiatives for the product

Required

Design and implement data pipelines, ETL processes, and data storage solutions that support data-intensive applications

Develop, test, and maintain architectures such as databases and large-scale data processing systems using tools such as Spark, Databricks and AWS

Solid in Java/Python, Data structure and Algorithms

Proven experience in development, testing (TDD) and integration of high complex software solutions leveraging change management

Experience in full-stack development and designing loosely coupled API based systems

Experience delivering Transactional, Warehouse, Analytical and Reporting Data Platforms leveraging modern cloud data technologies

Proven experience in an Agile/Scrum team environment

Proven experience leveraging DevSecOps and lean development principles such as Continuous Integration and Continuous Delivery

Experience in cloud development with the AWS platform

Desired

Capable of collaborating with multiple business stakeholders to provide information technology solutions

Skilled in interpersonal communications, negotiation, and conflict resolution

Proven experience working in a team environment, influence effectively, ability to resolve impediments in a timely manner

Learning Agility / Innovative desire and openness for continuous technical learning and identifying areas for application

Growth mindest willingness to deal and thrive in uncertainty

AWS Cloud Practitioner certification