Tech Lead - AWS Data Engineer

• Understanding the current business functionalities of the ETL processes and identifying areas for improvement.
• Designing and building AWS Glue workflows to replace existing ETL processes.
• Standardizing code across all workflows to maintain consistency and scalability.
• Conducting unit tests on all converted jobs to ensure accuracy and reliability.
• Loading initial data into the required workflows and validating data integrity.
• Implementing a layered architecture in AWS and Snowflake for efficient data consumption.
• Creating comprehensive mapping documents for all existing processes and assets.
• Developing additional views and logic to supplement reporting requirements.
• Deploying solutions to QA/UAT environments and providing support for Production migration.
• Documenting procedures to enable end-user execution and ongoing support.
• Knowledge of CICD pipelines and Jenkins.
• Domain related finance, manufacturing, Sales would be preferable

Required Skills and Qualifications:

• Bachelors degree in Computer Science, Engineering, or a related field (or equivalent experience).
• Proven experience as a Technical Architect or similar role, with a track record of designing and implementing complex technical solutions.
• Strong expertise in architecture principles, design patterns, and best practices.
• Hands-on experience with cloud platforms (e.g., AWS) and related services(AWS Glue, AWS Athena, AWS Lambda, AWS Devops, AWS CloudWatch, AWS S3).
• Proficiency in PySpark & Snowflake.
• Excellent analytical and problem-solving skills with a strong attention to detail.
• Outstanding communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders.
• Experience in Agile methodologies and DevOps practices.
• Relevant certifications (e.g., AWS Certified Associate Architect).
• Experience in leading digital transformation initiatives, migration projects, and Data Modeling.
• Knowledge of containerization and orchestration tools.