Lead Data Engineer

Key Responsibilities:

• Designing, constructing, installing, testing, and maintaining highly scalable data management systems
• Familiarity with the Agile development methodology and to be part of Agile scrum team and partner with various stake holders.
• Responsible for conceptualizing and designing detailed solutions.
• Works with product team to prioritize features for ongoing sprints and managing a list of data requirements based on industry trends, new technologies and project requirements.
• Communicating project progress to stakeholders and capable of handling risks and issues affecting the project.

Key Responsibilities:

• Design, develop, and optimize data models, schemas, and ETL processes within the Snowflake platform.

• Write complex SQL queries for data extraction, transformation, and analysis.

• Collaborate with data architects and data scientists to gather requirements and implement data solutions that meet business needs.

• Implement and maintain data governance processes, ensuring data quality, security, and compliance.

• Monitor and troubleshoot data pipelines and ETL processes to ensure smooth operation and timely data availability.

• Develop and maintain documentation for data models, ETL processes, and data governance policies.

• Utilize Python for data manipulation, automation of data processes, and integration with other tools and systems.

• Work with PostgreSQL databases to support data storage and retrieval as needed.

• Stay updated with industry best practices and emerging technologies related to cloud data warehousing and data governance.

Qualifications:

• A minimum of 8 years of working experience with Data and a minimum of 4 years of

  Snowflake Experience.

• Strong expertise in

  Snowflake, including data modeling, performance tuning, and best practices.

• Proficient in

  SQL with the ability to write complex queries for data analysis and reporting.

• Experience in ETL processes and tools, with a strong understanding of data integration methodologies.
• Familiarity with

  Data Governance processes and policies, ensuring data quality and compliance.

• Proficient in

  Python for data processing and automation.

• Experience with

  PostgreSQL, including database design and query optimization.

• Strong analytical and problem-solving skills, with attention to detail.
• Excellent communication and collaboration skills, able to work effectively in a team-oriented environment.
• Experience with

  cloud platforms (e.g., AWS, Azure, GCP) is a plus.

• Bachelors degree in computer science, Data Science, Information Technology, or a related field.