Lead Data Engineer

Job Description

Job Summary: We are looking for an experienced Lead Data Engineer to drive data engineering initiatives, architect scalable data solutions, and lead a team of engineers. The ideal candidate will have 10+ years of experience , specializing in Snowflake, Matillion, and Cloud platforms (Azure/AWS) and expertise in BI tools like Power BI, Tableau . This role requires strong SQL skills, analytical capabilities, excellent communication, and leadership abilities . The candidate should be able to scope projects, interact with clients, and deliver efficient data solutions . Key Responsibilities: Data Architecture Engineering: Design and develop scalable, high-performance data solutions using Snowflake, Matillion, and cloud environments (Azure/AWS) . ETL/ELT Development: Build and optimize ETL/ELT pipelines leveraging Matillion, Snowflake native capabilities, dbt, and other data integration tools. BI Data Visualization: Use Power BI, Tableau, and DOMO to develop insightful reports and dashboards, ensuring seamless data flow from the backend to visualization layers. SQL Development Optimization: Write and optimize complex SQL queries for performance tuning, data transformation, and analytics. Cloud Data Management: Implement data lakes, data warehouses, and data marts on Azure/AWS , ensuring security, scalability, and cost efficiency. Data Modeling Data Warehousing: Design and implement dimensional models, star/snowflake schemas, and data warehouse best practices . Project Scoping Client Engagement: Collaborate with stakeholders to understand business requirements , define project scope, and deliver tailored data solutions. Team Leadership: Lead a team of data engineers , conduct code reviews, mentor junior engineers, and establish best practices. Automation Performance Optimization: Automate workflows, monitor system performance, and optimize data processes for efficiency. Data Governance Security: Ensure compliance with industry best practices, data privacy laws, and security protocols. Workflow Orchestration: Implement and manage orchestration tools like Apache Airflow, Prefect, or Dagster for automated data workflows. Required Skills Qualifications: 10+ years of experience in data engineering and cloud-based data solutions . Expertise in Snowflake , including performance tuning, data sharing, and security management . Strong experience with Matillion for ETL/ELT development. Proficiency in Azure or AWS Cloud Services (e.g., AWS Redshift, S3, Glue, Azure Synapse, Data Factory). Hands-on experience with BI tools such as Power BI, Tableau . Exceptional SQL skills for query optimization and data modeling . Strong analytical and problem-solving skills to translate business needs into technical solutions. Proven ability to lead teams , mentor engineers, and manage projects effectively. Excellent communication skills to collaborate with clients, stakeholders, and cross-functional teams. Experience with Python or other scripting languages for data processing is a plus. Experience with dbt for data transformation and modeling . Knowledge of workflow orchestration tools like Apache Airflow, Prefect, or Dagster .