Data Engineer (Snowflake)

Job Description

Netstratum is looking for a Data Engineer - Snowflake, who will be responsible for creating and managing automated data pipelines and data stores in Snowflake. You will design, implement, test, debug, and deploy highly configurable and metadata-driven solutions. Your expertise will drive seamless integration with AWS environments, partnering with business analysts to translate requirements into effective solutions, and collaborating within an agile team to adapt to evolving needs.

Responsibilities

• Create and manage automated data pipelines and data stores in Snowflake, ensuring efficient design, implementation, testing, debugging, and deployment.
• Develop highly configurable, metadata-driven solutions that can be reused across various projects.
• Implement automated testing and deployment processes for Snowflake solutions, ensuring smooth integration with AWS environments.
• Partner with business analysts to understand requirements, groom user stories, and implement solutions effectively.
• Work within an agile team to rapidly iterate and release solutions, adapting to changing requirements and feedback.
• Provide technical advice and assist end-users in troubleshooting and resolving issues related to Snowflake and associated technologies.
• Proficiency with DBT (Data Build Tool) for data modeling and transformation, and Apache Airflow for workflow orchestration and scheduling.
• Expertise in Snowflake utilities including SnowSQL, Snowpipe, and Snowlight for handling streaming data.
• In-depth knowledge of Snowflake advanced features such as resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero Copy Clone, and Time Travel.
• Experience with re-clustering Snowflake data and understanding of micro-partitions.
• Proficiency in deploying Snowflake features like data sharing, events, and lake-house patterns.
• Experience in handling semi-structured data (JSON, XML) in Snowflake.
• Expertise in Snowflake, SQL, JavaScript, and Data Vault 2.0 or Dimensional Data Model.

Skills Required

• Bachelor’s Degree in Computer Science, MIS, or a related field.
• 3+ years in professional database and data warehouse development.
• 3+ years of experience with Snowflake, including Snowpipes, Snowshare, Tasks, Streams, UDFs, and Procedures.
• 3+ years of experience with Python, FastAPI
• Experience in microservices architecture and understanding of cloud computing.
• Familiarity with Azure ADO
• Experience with Power BI or Tableau.
• Understanding of Agile methodologies, Scrum, or Kanban.
• Knowledge of CI/CD pipelines and AWS cloud services.