Job
Description
As an AWS Data Engineer, your role will involve working with various AWS Data Services like Glue, Lambda, EventBridge, Kinesis, S3/EMR, Redshift, RDS, Step Functions, Airflow & Pyspark. Your responsibilities will include designing data components, optimizing clusters, and implementing automated testing and deployment processes. Additionally, you will be required to have expertise in IAM, CloudTrail, and Python & SQL. Key Responsibilities: - Utilize AWS Glue to create and manage crawlers and jobs for automating data cataloging and ingestion processes from structured and unstructured data sources. - Build ETL pipelines and manage crawlers using AWS Glue, while also working with the Glue data catalog. - Design and manage Redshift clusters, write complex SQL queries, and optimize query performance for AWS Redshift. - Enable data consumption from reporting and analytics applications by leveraging AWS services such as QuickSight, Sagemaker, and JDBC/ODBC connectivity. Qualifications Required: - Strong experience (8 to 12 years) in AWS Data Services and a deep understanding of data design and models. - Proficiency in version control systems like SVN and Git. - Familiarity with Cluster optimization, Automated testing, Code Coverage, and UAT support. Note: Additional details about the company were not provided in the job description. As an AWS Data Engineer, your role will involve working with various AWS Data Services like Glue, Lambda, EventBridge, Kinesis, S3/EMR, Redshift, RDS, Step Functions, Airflow & Pyspark. Your responsibilities will include designing data components, optimizing clusters, and implementing automated testing and deployment processes. Additionally, you will be required to have expertise in IAM, CloudTrail, and Python & SQL. Key Responsibilities: - Utilize AWS Glue to create and manage crawlers and jobs for automating data cataloging and ingestion processes from structured and unstructured data sources. - Build ETL pipelines and manage crawlers using AWS Glue, while also working with the Glue data catalog. - Design and manage Redshift clusters, write complex SQL queries, and optimize query performance for AWS Redshift. - Enable data consumption from reporting and analytics applications by leveraging AWS services such as QuickSight, Sagemaker, and JDBC/ODBC connectivity. Qualifications Required: - Strong experience (8 to 12 years) in AWS Data Services and a deep understanding of data design and models. - Proficiency in version control systems like SVN and Git. - Familiarity with Cluster optimization, Automated testing, Code Coverage, and UAT support. Note: Additional details about the company were not provided in the job description.
