ETL Lead

• Develop AWS data pipelines in AWS cloud environment
• Strong knowledge in writing, understanding and debugging complex SQL and PG/ PLSQL scripts
• Use transformation logics in AWS Glue/Pyspark with dataframes handling structured data/semi structured data
• Good working knowledge in Snowflake data warehouse
• Lead the design and implementation of data transformation workflows using DBT
• Experienced in debugging, diagnosing and troubleshooting Medium/complex production code
• Develop various AWS services such as Glue, RDS, Redshift, Lambda etc , services
• Strong hands-on experience in native AWS Glue ETL engineering, S3, Redshift Database, integration with other native AWS services and CICD using Python, pyspark and AWS APIs
• Hands-on experience in any User defined functions in Lambda, EC2 Instances type & Details, Secret Manager Ids, Roles and policies (Inline policies), Lifecycle Policies at bucket level and S3 Glacier details Code commit repositories, SNS system etc
• Good to have knowledge in developing and maintaining data pipelines using AWS Cloud formation
• Guide Team to ensure success in building and migrating applications, software and services following the principles of the AWS Well-Architected Framework
• Experience building and optimizing AWS data pipelines, architectures and data sets
• Experience in automation and provisioning services on AWS
• Capture and share best-practice knowledge among the AWS solutions architecture community AWS solutions architect and/or AWS developer certification is preferred
• Strong communication skills Should have worked on at least 3-4 End-to-End Implementations/ Projects
• Maintain comprehensive documentation for Snowflake and DBT configurations, processes, and changes

Location - Hyderabad, Bangalore, Chennai, Pune, Mumbai, Kolkata