Job
Description
Job Description AWS Data Engineer Key words - Sas, Sas bi, Sas di. Sas MA Experience - 5 to 8 years Location - Hyderabad and Chennai Responsibilities: Participate in efforts to design, build, and develop rapid solutions and services Implement ETL/ELT Processes: Develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, Open Source and AWS tools. Build applications using Python, SQL and AWS Be a key team member in design and development of the Data pipeline. Apply knowledge of basic principles, methods and practices to simple and moderately complex assignments Proactively identify and implement opportunities to automate tasks and develop reusable frameworks Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms Review functional and technical designs to identify areas of risk and/or missing requirements Provide technical write-ups and drawings to promote the proposed solutions. Requirements: 6-7 years experience with automation of DevOps build Experience working directly with technical and business teams Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon Athena, Amazon Redshift, Amazon Cloud watch, Amazon SNS and AWS Step Functions. Strong experience with modern programming languages such as Python, Spark, and Scala. Create Email alerts to send any notification mail. Create new?airflow DAG's and workflows for each source systems. Define Trigger events either time or file based on the requirements Familiar with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway; Familiar with software DevOps CI/CD tools, such Git, Jenkins, Linux, and Shell Script Ability to learn quickly, be organized and detail oriented Build of DAG's and Airflow Experience in Software Engineering and Development Understanding of database schema design
