AWS Data Engineer - Manager

Role Overview: You will be responsible for building enterprise-level data engineering solutions on AWS to support large-scale data initiatives. Your role will involve using Python and data orchestration tools such as Apache Airflow, AWS Step Functions, or equivalent. Additionally, you will work with distributed data frameworks like Apache Spark, Kafka, and Hive, as well as various AWS services like S3, Lambda, Kinesis, Redshift, EMR, Glue, and SQS. Your expertise in data modeling and designing ETL/ELT pipelines for batch and real-time ingestion will be crucial in this role. You will also need to be familiar with CI/CD pipelines, version control, and infrastructure-as-code tools like CloudFormation and Terraform. Your analytical skills, problem-solving approach, and customer orientation will contribute to the success of the projects. Effective communication and collaboration with clients and internal teams are essential aspects of this role. Key Responsibilities: - Build enterprise-level data engineering solutions on AWS for large-scale data initiatives - Utilize Python and data orchestration tools like Apache Airflow, AWS Step Functions, or equivalent - Work with distributed data frameworks such as Apache Spark, Kafka, and Hive - Utilize AWS services including S3, Lambda, Kinesis, Redshift, EMR, Glue, and SQS - Design ETL/ELT pipelines for batch and real-time ingestion - Implement CI/CD pipelines, version control, and infrastructure-as-code tools like CloudFormation and Terraform - Apply strong analytical skills, proactive problem-solving approach, and customer orientation - Collaborate effectively with clients and internal teams in a consulting environment Qualifications Required: - Proven experience in building enterprise-level data engineering solutions on AWS - Proficiency in Python and hands-on experience with data orchestration tools - Solid hands-on experience with distributed data frameworks and streaming technologies - Hands-on expertise with AWS ecosystem services - Strong data modeling skills and experience in designing ETL/ELT pipelines - Familiarity with CI/CD pipelines, version control, and infrastructure-as-code tools - Exceptional analytical skills with a proactive, problem-solving approach - Excellent communication and collaboration skills - Bachelors or higher degree in Computer Science, Information Systems, Engineering, or related fields - AWS certification(s) highly desirable.,