Senior Data Engineer

Job Title:

Location:

About the Role:

Senior Data Engineer

Key Responsibilities:

• Design and develop robust data pipelines using

  Databricks (Spark, Delta Lake)

  and

  AWS services

  (e.g., S3, Glue, EMR, Lambda).
• Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver clean, well-structured data.
  
• Optimize ETL processes for performance, scalability, and reliability.
  
• Implement data quality checks, monitoring, and alerting.
  
• Manage and orchestrate workflows using tools like

  Airflow

  or

  Databricks Workflows

  .
• Ensure data security and compliance according to industry best practices.
  

Required Skills:

• 5+ years of experience as a Data Engineer or in a similar role.
  
• Hands-on experience with

  Databricks (including notebooks, jobs, and Delta Lake)

  .
• Strong knowledge of

  AWS services

  , especially

  S3, Glue, Lambda, Redshift

  , and

  IAM

  .
• Proficient in

  Python

  and

  SQL

  .
• Experience with distributed systems and big data processing (e.g.,

  Apache Spark

  ).
• Familiarity with CI/CD and infrastructure-as-code tools like

  Terraform

  or

  CloudFormation

  .

Preferred Qualifications:

• Experience with

  streaming data

  (Kafka, Kinesis).
• Knowledge of

  data governance

  and

  data cataloging

  .
• Databricks and/or AWS certifications.