Data Engineer - Snowflake DB

As a Snowflake Data Engineer with 3-5 years of experience, you will be responsible for designing, developing, and optimizing cloud-based data warehousing solutions. This is an exciting opportunity to work on a flagship data initiative for a premier Big 4 consulting client, offering ample scope for technical innovation, learning, and career growth. Your key responsibilities will include: - Designing and developing high-performance data pipelines in Snowflake for data ingestion, transformation, and storage. You will focus on external tables, semi-structured data handling, and transformation logic. - Optimizing Snowflake workloads to ensure optimal query execution and cost-effective utilization of compute and storage resources. You will tune performance across large-scale datasets and implement workload management strategies. - Developing robust ETL processes using SQL, Python, and orchestration tools like DBT, Apache Airflow, Matillion, or Talend. Automation, data transformation, and pipeline reliability will be your focus. - Integrating with AWS Glue by utilizing capabilities such as crawlers, jobs, and external tables for seamless integration with Snowflake. You will ensure consistent and automated data ingestion and cataloging. - Enforcing data governance, role-based access control, and compliance protocols within Snowflake to ensure secure handling of sensitive data and privacy adherence. - Handling diverse data formats including structured and semi-structured formats like JSON, Parquet, Avro, XML, etc., to enable flexibility in data consumption across reporting and analytics. - Designing dimensional models optimized for Snowflake architecture, including fact and dimension tables, to enable efficient querying and integration with BI tools. - Collaborating with business stakeholders, data analysts, and BI developers to translate business requirements into scalable data solutions. - Monitoring end-to-end data workflows, ensuring system reliability, and proactively troubleshooting failures and performance bottlenecks. Key Skills & Qualifications: - Hands-on experience with Snowflake development and architecture. - Proficiency in SQL, Python, and cloud-native ETL/ELT tools. - Experience with AWS Glue, S3, and Snowflake integration. - Strong knowledge of data modeling, performance tuning, and cost optimization. - Familiarity with handling semi-structured data. - Good understanding of data governance, access control, and security best practices. - Excellent problem-solving and communication skills. Nice To Have: - Experience working with Big 4 consulting clients or large enterprise environments. - Exposure to DevOps practices, CI/CD pipelines, and data quality framework. If you are looking to leverage your expertise in Snowflake and cloud-based data warehousing to drive technical innovation and deliver scalable solutions, this role offers an exciting opportunity to grow your career and make a significant impact.,