Posted:4 weeks ago|
Platform:
On-site
Full Time
Role Description Job Description: 7+ Yrs experienced AWS Data Engineer to design, implement, and optimize data workflows on AWS. Candidate should have expertise in AWS Data Platform, Data Ingestion (AWS DMS), AWS Airflow, and Redshift. Key Responsibilities Design & Develop Data Pipelines β Build scalable and efficient data pipelines for batch and real-time data processing using AWS services. Data Ingestion & Migration β Utilize AWS DMS (Database Migration Service) to migrate and sync data across different sources. Workflow Orchestration β Implement and manage workflows using AWS Managed Workflows for Apache Airflow (MWAA). Data Warehousing β Design and optimize Amazon Redshift for high-performance data analytics and reporting. ETL Processing β Implement ETL/ELT processes to extract, transform, and load data into Redshift and other AWS storage solutions. Performance Tuning β Optimize queries, indexing, and data partitioning strategies for efficient data processing. Integration with AWS Services β Work with AWS Glue, S3, Kinesis, Lambda, Athena, Step Functions, and other AWS data services. Monitor & Troubleshoot β Ensure reliability, scalability, and security of data pipelines, resolving issues proactively. Required Skills & Experience Mandatory skills: β AWS Data Platform β Hands-on experience in building data solutions on AWS. β Data Ingestion & Migration (AWS DMS) β Expertise in AWS Database Migration Service (DMS) for data replication and migration. β Amazon Redshift β Experience in designing and optimizing Redshift data warehouses. Good To Have β AWS Airflow (MWAA) β Strong knowledge of Apache Airflow for workflow automation and orchestration. β ETL/ELT Development β Experience with SQL, Python, Spark, or Glue for data transformation. β Performance Optimization β Tuning queries, managing data partitions, and improving data processing speeds. β AWS Cloud Infrastructure β Familiarity with AWS IAM, networking, security best practices, and cost optimization. Preferred Qualifications AWS Certified Data Analytics β Specialty or AWS Certified Solutions Architect is a plus. Experience with real-time data streaming (Kinesis, Kafka, or similar technologies). Exposure to Machine Learning Pipelines on AWS is a plus. Skills DMS,Airflow,Redshirt Show more Show less
UST
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections UST
Hyderabad, Telangana, India
Experience: Not specified
Salary: Not disclosed
Hyderabad, Telangana, India
Experience: Not specified
Salary: Not disclosed