AWS Glue Python Developer

As an AWS Glue Python Developer with 4 to 5+ years of relevant experience, your role will involve the following key responsibilities: - Data Modelling: Design and implement efficient data models to ensure data accuracy and optimal performance. - ETL Development: Develop, maintain, and optimize ETL processes for extracting, transforming, and loading data from various sources into the data warehouse. - SQL Expertise: Write complex SQL queries for data extraction, manipulation, and analysis. - Python Development: Develop and maintain Python scripts and applications to support data processing and automation. - AWS Expertise: Utilize your deep knowledge of AWS services such as S3, Redshift, Glue, EMR, and Athena to build and maintain data pipelines and infrastructure. - Infrastructure as Code (IaC): Experience with tools like Terraform or CloudFormation for automating the provisioning and management of AWS resources is a plus. - Big Data Processing: Knowledge of PySpark for big data processing and analysis is desirable. - Source Code Management: Utilize Git and GitHub for version control and collaboration on data engineering projects. - Performance Optimization: Identify and implement optimizations for data processing pipelines to enhance efficiency and reduce costs. - Data Quality: Implement data quality checks and validation procedures to maintain data integrity. - Collaboration: Work closely with data scientists, analysts, and other teams to understand data requirements and deliver high-quality data solutions. - Documentation: Maintain comprehensive documentation for all data engineering processes and projects. Qualifications required for this role include: - 4-5 years of experience in data engineering roles with a strong emphasis on AWS technologies. - Proficiency in data modelling, SQL, and Python. - Demonstrated expertise in AWS services, especially for data processing, extract transform and load. - Familiarity with Infrastructure as Code (IaC) tools. - Experience with PySpark and big data processing is a plus. - Strong version control skills using Git and GitHub. - Excellent problem-solving and communication skills. - Ability to work independently and in a team, taking ownership of projects and delivering on time. In addition to the above responsibilities and qualifications, the company follows a hiring process that includes Screening (HR Round), Technical Round 1, Technical Round 2, and Final HR Round.,