AWS Data Engineer

You will be responsible for enhancements, new development, defect resolution, and production support of ETL development using AWS native services. Your role will involve the integration of data sets using AWS services such as Glue and Lambda functions. Additionally, you will utilize AWS SNS to send emails and alerts. Authoring ETL processes using Python and PySpark will be a key part of your responsibilities, along with ETL process monitoring using CloudWatch events. You will also be connecting with different data sources like S3 and validating data using Athena. Experience in CI/CD using GitHub Actions and proficiency in Agile methodology are essential for this role. Key Responsibilities: - Enhancements, new development, defect resolution, and production support of ETL development using AWS native services - Integration of data sets using AWS services such as Glue and Lambda functions - Utilization of AWS SNS to send emails and alerts - Authoring ETL processes using Python and PySpark - ETL process monitoring using CloudWatch events - Connecting with different data sources like S3 and validating data using Athena - Experience in CI/CD using GitHub Actions - Proficiency in Agile methodology Qualifications Required: - Deep technical skills in AWS Glue (Crawler, Data Catalog): 5 years - Hands-on experience with Python and PySpark: 3 years - PL/SQL experience: 3 years - CloudFormation and Terraform: 2 years - CI/CD GitHub actions: 1 year - Experience with BI systems (PowerBI, Tableau): 1 year - Good understanding of AWS services like S3, SNS, Secret Manager, Athena, and Lambda: 2 years,