AWS Engineer

Responsibilities Include

• Hands-on experience with Hadoop, Spark with Python on AWS.
• Provide technical support for data engineering systems, addressing user queries, and resolving issues related to data pipelines, AWS services, Snowflake, Hadoop, and Spark.
• Investigate and troubleshoot issues in data pipelines, identifying root causes and implementing solutions to prevent recurrence.
• Experience with a range of big data architectures like Hadoop,Spark,Kafka,Hive or other big data technologies.
• Effectively manage and resolve incidents related to data processing, ensuring minimal downtime and optimal system performance.
• Collaborate with cross-functional teams to prioritize and address critical issues promptly.
• Experience in Tuning and Optimizing Spark jobs
• Knowledge on Terraform templates for Infrastructure provisioning on AWS (or cloud formation templates)
• Possess minimum 3+ years of in BI/DW development experience with Data Model Architecture/Design.
• Should have a good understanding of functional programming concepts.
• Good knowledge of Python with experience of production grade Python projects.
• Continuous Integration, branching and merging, pair programming, code reviews, unit testing, agile methodologies (Scrum), Design Patterns.
• Knowledge on CI/CD implementation like AWS Code Commit, Code Deploy for CI/CD pipelines (Git knowledge preferable)
• Knowledge on Scheduling Tools and techniques on Hadoop/EMR.
• Excellent written and verbal communication skills.
• Strong analytical and project management skills.

Technical Essentials

• Proven experience in providing technical support for data engineering systems.
• Strong understanding of AWS services, including S3, Glue, Redshift, EMR, Lambda, Athena, and Step Functions.
• Hands-on experience supporting Snowflake, Hadoop, Spark, and Python in a production environment.
• Familiarity with data modeling, optimization, and performance tuning.
• Excellent problem-solving skills and the ability to analyze and diagnose complex technical issues.
• Experience with incident management, including prioritization and resolution procedures.
• Strong communication and collaboration skills for working with cross-functional teams.
• Knowledge of best practices in cloud-based data engineering and support.
• Preferred:
• AWS Certified Solutions Architect - Associate