Lead Data Engineer

About the Role We’re looking for a Lead Data Engineer to join our growing Data & Analytics team. You’ll play a critical role in designing, building, and optimizing the infrastructure that powers our data products and insights. This is a hands-on leadership role where you’ll drive technical direction, mentor team members, and ensure the reliability and scalability of our data systems. What you will do Lead the design and development of robust, scalable, and secure data pipelines and workflows. Own and evolve our data architecture, ensuring it supports current and future business needs. Collaborate cross-functionally with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Manage and enhance data ingestion and transformation processes using tools like Fivetran, Airflow, and Python. Oversee data warehouse design and optimization using Snowflake and AWS services. Promote best practices in data modeling, ETL/ELT design, and data governance. Enable efficient and consistent reporting by ensuring well-structured datasets for Tableau and other BI tools. Mentor junior engineers and foster a culture of technical excellence and continuous learning. Tech Stack You’ll Work With Languages & Tools: Python, SQL Data Orchestration: Apache Airflow Data Integration: Fivetran Data Warehousing: Snowflake BI & Visualization: Tableau Cloud Platform: AWS (e.g., S3, Lambda, EC2, etc.) Version Control & CI/CD: Git, GitHub Actions What We’re Looking For 7+ years of experience in data engineering, with at least 1–2 years in a technical leadership role. Strong knowledge of modern data architectures, including ELT pipelines, data lakes, and warehousing. Proficiency in Python and SQL; experience building data pipelines and automations. Deep experience with Snowflake or similar cloud-based data warehouses. Experience with cloud platforms like AWS, Google Cloud, or Azure and best practices. Proven experience with Airflow or similar orchestration tools. Understanding of data modeling techniques and performance optimization strategies. Strong communication and collaboration skills, with the ability to explain complex data topics to non-technical stakeholders. Preferred Qualifications Exposure to Kafka or other streaming data platforms. Familiarity with data privacy, compliance, and governance frameworks. Experience collaborating with data science teams and understanding machine learning workflows. Experience with data visualization tools (e.g., Tableau, Power BI) to communicate insights effectively. Why Join Us As a Lead Data Engineer with us, you'll engage in solving some of the most compelling and complex problems in the data engineering landscape, including: Handling Unstructured Data: Develop scalable solutions to process and analyze unstructured data from various sources, enabling meaningful insights from complex datasets. Optimizing Real-Time Data Processing: Design and implement low-latency data pipelines using tools like Apache Kafka and Apache Flink to support real-time applications in domains such as autonomous vehicles and smart grids. Ensuring Data Integrity and Lineage: Establish comprehensive data lineage systems to track data origins, transformations, and movements, facilitating error detection and compliance auditing. Scalability and Performance Optimization: Address challenges related to processing large datasets, optimizing query performance, and ensuring efficient data storage and retrieval in cloud environments. Show more Show less