Data Engineer

Responsibilities:

• Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
• Develop and implement data quality checks and monitoring processes to ensure data integrity.
• Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
• Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
• Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
• Version control code using Git and collaborate with the team through code reviews.
• Document data pipelines and processes for future reference and knowledge sharing.

Qualifications:

• 5+ years of experience in data engineering or a related field.
• Proven experience in designing, developing, and deploying data pipelines.
• Hands on experience with Snowflake, Python and SQL
• Experience with data warehousing and data modeling concepts.
• Analyse data & develop reports using Looker, Domo tools.
• Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
• Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
• Experience with Git for version control.
• Excellent communication and collaboration skills.
• Ability to work independently and as part of a team.
• Strong problem-solving and analytical skills.

Bonus Points:

• Experience with data orchestration tools (Airflow, Luigi, etc.).
• Experience with data visualization tools (Tableau, Power BI, etc.).