Senior Data Engineer (Snowflake)

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
• Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
• Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
• Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
• Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
• Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
• Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
• Contribute to the development and enhancement of our data warehouse architecture
  

Requirements

Mandatory:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
• At least 3+ years of exp in Snowflake data warehousing technologies.
• At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
• Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
• Working experience with Elastic Search and its application in data pipelines.
• Proficiency in SQL and experience with data modelling techniques.
• Strong understanding of cloud-based data storage solutions such as AWS S3.
• Experience working with NFS and other file storage systems.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.