Lead Data Engineer-snowflake

• Job Summary
  

Data Engineer

Snowflake or similar cloud data warehouse platforms

data integration technologies

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines for structured and semi-structured data.
• Implement and manage Snowflake-based data warehouse solutions or similar platforms.
• Develop data ingestion using Snowpipe, Streams, and Tasks.
• Build and manage integrations using SnapLogic or similar iPaaS tools.
• Perform data modeling, schema design, and metadata management.
• Write and optimize SQL and Snowflake SQL queries for performance and scalability.
• Handle JSON/XML processing and integrate data from REST APIs.
• Implement source-to-target mappings (STTM) and data transformation logic.
• Ensure data quality, data validation, governance, and security standards.
• Monitor and tune pipeline performance; implement robust error handling and recovery.
• Develop Python scripts for automation, transformation, and orchestration.
• Support pipeline orchestration and workflow automation.
• Collaborate with cross-functional teams to understand data requirements and integration patterns.
  

Required Skills

Data Platforms & Warehousing

• Snowflake or similar cloud data warehouse platforms
• Cloud Data Warehousing concepts
• Snowpipe, Streams & Tasks
  

Data Engineering & Integration

• ETL / ELT pipelines
• Data Integration and Pipeline Orchestration
• SnapLogic or similar iPaaS tools
• API Integrations (REST APIs)
  

Data Management

• Data Modeling and Schema Design
• Source-to-Target Mapping (STTM)
• Data Quality, Validation, Governance, and Security
• Metadata Management
  

Programming & Querying

• Strong SQL and Snowflake SQL
• Python for data processing and automation
• JSON / XML processing
  

DevOps & Monitoring

• DevOps for Data Engineering
• CI/CD pipelines for data workflows
• Logging, monitoring, and alerting
• Workflow automation and integration patterns
  

Performance & Reliability

• Performance tuning and optimization
• Error handling and fault-tolerant design
  

Nice to Have

• Experience with multi-cloud environments (AWS/Azure/GCP)
• Exposure to data cataloging and lineage tools
• Experience in enterprise-scale data platforms