Data Engineering Lead

You are a highly skilled Data Engineering Lead with expertise in AWS and Snowflake. Your role involves designing and delivering scalable data engineering solutions, particularly within the telecommunications industry. Your deep knowledge of end-to-end data architectures, layered data processing frameworks, and optimized data pipelines will be crucial in this position. Your responsibilities include designing, developing, and maintaining scalable data architectures and pipelines for large-scale data platforms. You will be tasked with building and optimizing Data Lakes to consolidate structured and unstructured data sources. Implementing real-time and batch data processing using Snowflake features like Streams, Tasks, and Snowpipe is also part of your role. You will leverage AWS services such as EC2, Glue, Lambda, S3, Athena, and MWAA for data integration, processing, and analytics. Developing and managing PySpark/Python-based workflows for scalable transformations and automation will be essential. Additionally, you will perform data modeling, performance tuning, and optimization in Snowflake and collaborate with cross-functional teams to deliver end-to-end data engineering solutions aligned with business goals. Your primary skills must include strong expertise in AWS and Snowflake, proficiency in AWS Glue, and hands-on experience with PySpark. Additional skills such as strong programming skills in Python, experience with distributed data processing pipelines, knowledge of Airflow/MWAA for orchestration, and exposure to advanced analytics and secure data sharing will be advantageous for this role.,