AWS Data Engineer

Role AWS Data Engineer

Required Technical Skill Set AWS Redshift, Glue, PySpark

Desired Experience Range 4-10 Years

Location of Requirement Chennai/Pune

Desired Competencies (Technical/Behavioral Competency)

Must-Have • Strong hands-on experience in Python programming and PySpark

• Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)

• Experience working with Apache Spark and Hadoop ecosystem.

• Experience in writing and optimizing SQL for data manipulations

• Good Exposure to scheduling tools. Airflow is preferable.

• Must Have Data Warehouse Experience with AWS Redshift or Hive

• Experience in implementing security measures for data protection.

• Expertise to build/test complex data pipelines for ETL processes (batch and near real time) • Readable documentation of all the components being developed.

• Knowledge of Database technologies for OLTP and OLAP workloads

Good-to-Have • Good understanding of Data warehouse and Data Lakes • Familiarize ETL tools like Netezza or Informatica. • Experience working with NoSQL databases like DynamoDB or MongoDB. • Good to have exposure to AWS services (Step Functions, Athena) • Data Modelling exposure • Familiarity with Investment Banking domain