Snowflake Developer

1. Databricks to Snowflake Migration:

• Understand existing pipelines and frameworks built in Databricks (PySpark/Spark).
• Help re-architect data pipelines and workflows for execution in Snowflake, using efficient SQL-based processing.
• Ensure a smooth transition by maintaining data consistency, performance, and scalability in the new environment.

1. Snowflake

   :

• Strong experience with storage integrations, staging (internal/external), Snowpipe, tables/views, COPY INTO, CREATE OR ALTER, and file formats.
• Knowledge of Snowflakes role-based access control (RBAC) and performance tuning best practices.
• DBT (with Snowflake) - Implement and manage models, macros, materializations, and Snowflake SQL execution within DBT.
• Use DBT for modular development, version control, and environment-based deployments.
• Airflow (orchestration) - Design and manage DAGs to automate workflows.
• Handle task dependencies, error recovery, monitoring, and integration with tools like Cosmos, Astronomer, or Docker.

1. Databricks:

• Ability to analyse and interpret existing Databricks notebooks/jobs and translate them into Snowflake/DBT equivalents.
• Understand Spark transformations and dependencies to guide migration strategy.

1. DevOps & CI/CD:

• CI/CD Pipeline Development - Build automated pipelines for Snowflake and DBT deployments using tools like GitHub Actions, Azure DevOps.
• Manage version-controlled environments and ensure smooth promotion of changes across dev, test, and prod.

1. Monitoring:

• Implement robust monitoring, alerting, and logging for data pipelines.
• Build self-healing or alert-driven mechanisms for critical or severe issue detection.

Please fill out the form below to apply.

https://forms.gle/v5YLJekk1fHJhqB29