Lead Data Engineer

8+years of experience in data engineering, with a minimum of 2+ years in a leadership or lead capacity.
Proven experience building and operating large-scale data platforms in a production environment.Track record of successfully delivering complex data projects from ideation to deployment.

Educational Background: Bachelor's or Masters degree in Computer Science, Engineering, or a related technical field.

Communications

Excellent analytical, problem-solving, and critical thinking skills with meticulous attention to detail.
Strong communication (written and verbal) and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.Ability to work independently and manage multiple priorities in a fast-paced environment.Experience with Agile/Scrum development methodologies is a plus.

Job Responsibilities

Key Responsibilities

Technical Leadership & Architecture:
Lead the design and implementation of robust, scalable, and efficient data architectures (data warehouses, data lakes, streaming platforms) that align with organizational strategy and future growth.Define and enforce data engineering best practices, coding standards, and design principles.Evaluate and recommend new technologies, tools, and platforms to enhance data capabilities.Oversee the end-to-end data development lifecycle, from data ingestion, cleansing, transformation, and curation to data presentation.

Data Pipeline Development & Optimization:Architect, build, and maintain complex ETL/ELT pipelines for batch and real-time data processing using various tools and programming languages.Optimize existing data pipelines for performance, cost-effectiveness, and reliability.Implement data quality checks, monitoring, and alerting mechanisms to ensure data integrity.Ensure data security, privacy, and compliance with relevant regulations (e.g., GDPR, local data laws).

Team Leadership & Mentorship:Lead, mentor, and technically guide a team of data engineers, fostering their growth and skill development.Conduct code reviews, provide constructive feedback, and promote a culture of engineering excellence.Assist in talent acquisition, including interviewing and onboarding new team members.Allocate tasks, manage workloads, and ensure timely delivery of data engineering projects.

Collaboration & Stakeholder Management:Collaborate closely with data scientists, data analysts, software engineers, product managers, and business stakeholders to understand data requirements and translate them into technical solutions.Communicate complex technical concepts and data strategies effectively to both technical and non-technical audiences.Act as a subject matter expert and technical point of contact for data-related initiatives.

Operational Excellence:
Oversee the operational health, monitoring, and troubleshooting of data infrastructure and pipelines.Drive automation initiatives for data processes and infrastructure.