Job
Description
As an experienced Lead Data Engineer, your role will involve driving data engineering initiatives, architecting scalable data solutions, and leading a team of engineers. You specialize in Snowflake, Matillion, and Cloud platforms (Azure/AWS) and have expertise in BI tools like Power BI, Tableau. You are required to have strong SQL skills, analytical capabilities, excellent communication, and leadership abilities. Your responsibilities will include: - Designing and developing scalable, high-performance data solutions using Snowflake, Matillion, and cloud environments (Azure/AWS). - Building and optimizing ETL/ELT pipelines leveraging Matillion, Snowflake native capabilities, dbt, and other data integration tools. - Using Power BI, Tableau, and DOMO to develop insightful reports and dashboards, ensuring seamless data flow from the backend to visualization layers. - Writing and optimizing complex SQL queries for performance tuning, data transformation, and analytics. - Implementing data lakes, data warehouses, and data marts on Azure/AWS, ensuring security, scalability, and cost efficiency. - Designing and implementing dimensional models, star/snowflake schemas, and data warehouse best practices. - Collaborating with stakeholders to understand business requirements, define project scope, and deliver tailored data solutions. - Leading a team of data engineers, conducting code reviews, mentoring junior engineers, and establishing best practices. - Automating workflows, monitoring system performance, and optimizing data processes for efficiency. - Ensuring compliance with industry best practices, data privacy laws, and security protocols. - Implementing and managing orchestration tools like Apache Airflow, Prefect, or Dagster for automated data workflows. Required Skills & Qualifications: - 10+ years of experience in data engineering and cloud-based data solutions. - Expertise in Snowflake, including performance tuning, data sharing, and security management. - Strong experience with Matillion for ETL/ELT development. - Proficiency in Azure or AWS Cloud Services (e.g., AWS Redshift, S3, Glue, Azure Synapse, Data Factory). - Hands-on experience with BI tools such as Power BI, Tableau. - Exceptional SQL skills for query optimization and data modeling. - Strong analytical and problem-solving skills to translate business needs into technical solutions. - Proven ability to lead teams, mentor engineers, and manage projects effectively. - Excellent communication skills to collaborate with clients, stakeholders, and cross-functional teams. - Experience with Python or other scripting languages for data processing is a plus. - Experience with dbt for data transformation and modeling. - Knowledge of workflow orchestration tools like Apache Airflow, Prefect, or Dagster.,
