Data Engineer

Job Title:

About the Role:

Data Engineer

Key Responsibilities:

• Design, develop, and maintain robust

  ETL/ELT pipelines

  using

  Python

  and

  SQL

  .
• Build and manage

  data infrastructure

  on

  AWS

  and

  Azure

  cloud platforms.
• Optimize

  data storage and retrieval

  using cloud-native tools and services.
• Collaborate with cross-functional teams to understand

  data requirements

  and deliver efficient solutions.
• Ensure

  data quality, integrity, and security

  across all systems.
• Monitor and troubleshoot

  data workflows

  and resolve performance issues.
• Implement

  best practices

  for

  data governance

  and

  compliance

  .

Required Skills & Qualifications:

• Proven experience as a

  Data Engineer

  or similar role.
• Strong proficiency in

  Python

  for data processing and automation.
• Advanced knowledge of

  SQL

  for querying and managing relational databases.
• Hands-on experience with

  AWS services

  such as

  S3, Redshift, Glue, Lambda

  .
• Familiarity with

  Azure services

  like

  Data Factory, Synapse, Blob Storage

  .
• Experience in

  data modeling

  ,

  data warehousing

  , and

  big data technologies

  .
• Understanding of

  CI/CD pipelines

  and version control (e.g.,

  Git

  ).
• Excellent

  problem-solving

  and

  communication

  skills.

Preferred Qualifications:

• Bachelors or Masters degree in

  Computer Science

  ,

  Engineering

  , or a related field.
• Experience with

  orchestration tools

  like

  Apache Airflow

  or

  Azure Data Factory

  .
• Knowledge of

  containerization (Docker)

  and

  infrastructure-as-code tools

  (

  Terraform

  ,

  CloudFormation

  ).
• Familiarity with

  data lake architectures

  and

  real-time data streaming

  using

  Kafka

  or

  Kinesis

  .

Tech Stack:

Programming: