Senior Data Engineer

ole Overview

AWS Data Engineer

Core Requirements

Must Have:

1. Python OOP and Development Experience (7+ years)

   – Strong hands-on experience with object-oriented programming, reusable code design, and Python-based data workflows.

2. AWS Data Migration and API Developer Ecosystem (4+ years)

   – Proven experience in cloud data migration, developing APIs, and working with AWS Big Data services (e.g., Glue, EMR, Athena, Redshift) and serverless offerings (e.g., Lambda, Step Functions).

3. SQL Programming (3+ years)

   – Strong SQL skills for data querying, optimization, and transformation.

4. Snowflake (2+ years)

   – Hands-on experience in Snowflake data warehousing, schema design, and performance tuning.

5. DBT (1+ years)

   – Experience in data transformation and modeling using dbt.

Nice to Have:

CI/CD Pipelines

BI Tooling and Data Analytics

Infrastructure as Code (IaC)

Linux and Networking Essentials

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines on AWS.
• Lead end-to-end data migration projects ensuring data integrity, security, and performance.
• Develop and maintain APIs for seamless data access and integration across systems.
• Collaborate with data analysts, BI teams, and stakeholders to deliver optimized data models and analytics solutions.
• Implement dbt models to support data transformation and standardization.
• Ensure code quality, version control, and deployment practices using CI/CD pipelines.
• Contribute to infrastructure automation and monitoring for data platforms.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• Strong problem-solving skills with attention to detail.
• Excellent communication and collaboration skills to work across technical and business teams.