data engineer

Job Overview:

Senior Data Engineer

Key Responsibilities:

• Design, develop, and maintain

  batch and real-time data pipelines

  ensuring scalability, performance, and reliability.
• Architect and implement

  Data Lakes

  ,

  Data Warehouses

  , and

  Lakehouse solutions

  using modern architectural patterns.
• Ensure

  data quality, governance

  , and

  integrity

  across the data lifecycle.
• Continuously monitor, troubleshoot, and

  optimize pipeline performance

  .
• Contribute to and maintain

  best practices, coding standards

  , and technical documentation.
• Work closely with business and engineering teams to translate complex requirements into effective

  technical solutions

  .
• Mentor and support other engineers, fostering a

  culture of continuous learning

  , collaboration, and knowledge sharing.

Required Skills & Experience:

• Bachelor s degree

  in Computer Science, Information Systems, or a related field (Master s degree is a plus).

• 4 - 8 years of experience

  in data engineering, with a proven track record of building and scaling data infrastructure.
• Strong hands-on experience with

  AWS data services

  :

• S3, Glue, Athena, EMR, Kinesis

  , etc.
• Proficiency in

  SQL

  and working with various

  file formats

  :

• Parquet, Delta Lake, Apache Iceberg, Hudi

  .
• Expertise in

  Change Data Capture (CDC) patterns

  .
• Hands-on experience with stream processing tools such as:

• Apache Flink, Kafka Streams

  , or

  distributed processing frameworks

  like

  PySpark

  .
• Experience in

  workflow orchestration tools

  like

  Apache Airflow

  .
• Strong understanding of

  relational and NoSQL databases

  ,

  data warehousing concepts

  , and

  cloud-based data architecture

  .
• Familiarity with

  data integration tools

  and modern

  data management platforms

  .
• Excellent

  analytical, problem-solving

  , and

  communication skills

  , with the ability to work across functional teams.

emerging data technologies