Associate Data Architect I- Azure/Snowflake & AWS Migration

3 - 9 years

0 Lacs

Posted:1 week ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Overview: As a Tech Lead specializing in Azure/Snowflake & AWS Migration, you will be responsible for designing and developing scalable data pipelines using Snowflake as the primary data platform. Your role will involve integrating with tools like Azure Data Factory, Synapse Analytics, and AWS services. The main focus will be on building robust and efficient SQL and Python-based data transformations for cleansing, enrichment, and integration of large-scale datasets. Additionally, you will lead migration initiatives from AWS-based data platforms to a Snowflake-centered architecture. Key Responsibilities: - Design and develop scalable data pipelines using Snowflake as the primary data platform - Integrate with tools like Azure Data Factory, Synapse Analytics, and AWS services - Build robust, efficient SQL and Python-based data transformations - Lead migration initiatives from AWS-based data platforms to Snowflake-centered architecture - Rebuild AWS Glue pipelines in Azure Data Factory or using Snowflake-native ELT approaches - Migrate EMR Spark jobs to Snowflake SQL or Python-based pipelines - Migrate Redshift workloads to Snowflake with schema conversion and performance optimization - Transition S3-based data lakes (Hudi, Hive) to Snowflake external tables via ADLS Gen2 or Azure Blob Storage - Redirect Kinesis/MSK streaming data to Azure Event Hubs, followed by ingestion into Snowflake - Support database migrations from AWS RDS to Snowflake - Design modern Snowflake lakehouse-style architectures - Integrate Azure Functions or Logic Apps with Snowflake for orchestration Qualification Required: - 9+ years of data engineering experience, with 3+ years on Microsoft Azure stack and hands-on Snowflake expertise - Proficiency in Python, SQL, Azure Data Factory, and Synapse Analytics - Experience in migrating workloads from AWS to Azure/Snowflake - Strong understanding of cloud architecture and hybrid data environments - Hands-on experience with database migration, schema conversion, and tuning - Familiarity with Azure Event Hubs, Logic Apps, and Key Vault - Working knowledge of CI/CD, version control (Git), and DevOps principles Please note that the Company Skills mentioned are Azure, AWS Redshift, Athena, Azure Data Lake. Role Overview: As a Tech Lead specializing in Azure/Snowflake & AWS Migration, you will be responsible for designing and developing scalable data pipelines using Snowflake as the primary data platform. Your role will involve integrating with tools like Azure Data Factory, Synapse Analytics, and AWS services. The main focus will be on building robust and efficient SQL and Python-based data transformations for cleansing, enrichment, and integration of large-scale datasets. Additionally, you will lead migration initiatives from AWS-based data platforms to a Snowflake-centered architecture. Key Responsibilities: - Design and develop scalable data pipelines using Snowflake as the primary data platform - Integrate with tools like Azure Data Factory, Synapse Analytics, and AWS services - Build robust, efficient SQL and Python-based data transformations - Lead migration initiatives from AWS-based data platforms to Snowflake-centered architecture - Rebuild AWS Glue pipelines in Azure Data Factory or using Snowflake-native ELT approaches - Migrate EMR Spark jobs to Snowflake SQL or Python-based pipelines - Migrate Redshift workloads to Snowflake with schema conversion and performance optimization - Transition S3-based data lakes (Hudi, Hive) to Snowflake external tables via ADLS Gen2 or Azure Blob Storage - Redirect Kinesis/MSK streaming data to Azure Event Hubs, followed by ingestion into Snowflake - Support database migrations from AWS RDS to Snowflake - Design modern Snowflake lakehouse-style architectures - Integrate Azure Functions or Logic Apps with Snowflake for orchestration Qualification Required: - 9+ years of data engineering experience, with 3+ years on Microsoft Azure stack and hands-on Snowflake expertise - Proficiency in Python, SQL, Azure Data Factory, and Synapse Analytics - Experience in migrating workloads from AWS to Azure/Snowflake - Strong understanding of cloud architecture and hybrid data environments - Hands-on experience with database migration, schema conversion, and tuning - Familiarity with Azure Event Hubs, Logic Apps, and Key Vault - Working knowledge of CI/CD, version control (Git), and DevOps principles Please note that the Company Skills mentioned are Azure, AWS Redshift, Athena, Azure Data Lake.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You