Senior Data Engineer

Lead Data Engineer

WHAT YOU’LL DO:

• Lead the design and implementation of scalable, efficient, and robust data architectures to meet business needs and analytical requirements

• Collaborate with stakeholders to understand data requirements, build subject matter expertise, and define optimal data models and structures.

• Design and develop data pipelines, ETL processes, and data integration solutions for ingesting, processing, and transforming large volumes of structured and unstructured data.

• Optimize data pipelines for performance, reliability, and scalability.

• Oversee the management and maintenance of databases, data warehouses, and data lakes to ensure high performance, data integrity, and security.

• Establish and enforce data quality standards, validation rules, and data governance practices to ensure data accuracy, consistency, and compliance with regulations.

• Drive initiatives to improve data quality and documentation of data assets.

• Provide technical leadership and mentorship to junior team members, assisting in their skill development and growth.

• Lead and participate in code reviews, ensuring best practices and high-quality code.

• Implement monitoring systems and practices to track data pipeline performance, identify bottlenecks, and optimize for improved efficiency and scalability.

• Collaborate with stakeholders to understand reporting requirements and provide support in developing interactive dashboards using Power BI for data visualization.

• Communicate effectively with non-technical stakeholders to translate technical concepts into actionable insights and business value.

• Maintain comprehensive documentation of data pipelines, workflows, workflows, and data models. Adhere to best practices in data engineering and ensure compliance with organizational standards.

WHAT YOU’LL NEED:

• 7+ years of experience in a data engineering role

• Bachelor's degree in computer science, Information Technology, or a related field

• Experience in data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching

• Proficient in SQL and Python, with the ability to translate complexity into efficient code

• Experience working on different type of databases and data warehouse technologies

• Experience with Azure Data Factory and/or Apache Airflow

• Effective communication skills (verbal and written) in English

• Genuine passion about technology and solving data problems

• Structured thinking with the ability to break down ambiguous problems and propose impactful data modeling designs

• Strong leadership, problem-solving, and decision-making skills

• Ability to use data to inform decision making and drive outcomes

• Ability to understand, document and convert business requirements into data models

• Ability to work effectively with a remote team across multiple time zones, and in an Agile environment

• Ability to mentor junior team members

• Driven and self-motivated with excellent organizational skills

• Comfortable learning innovative technologies and systems