Senior Data Engineer

Job Title: Senior Data Engineer

About the Role

Senior Data Engineer

Key Responsibilities

• Design, develop, and maintain

  scalable ETL/ELT pipelines

  using Python.
• Lead and perform

  data mapping activities

  , translating business requirements into detailed source-to-target mappings.
• Build and optimize

  data warehouse

  and

  data lake

  solutions on cloud platforms (AWS/Azure/GCP).
• Collaborate with business, analysts, and data science teams to understand data requirements and map datasets across systems.
  
• Implement

  data quality rules

  , validation checks, and monitoring frameworks.
• Develop automation and CI/CD workflows for data engineering environments.
  
• Work with distributed data processing frameworks (Spark/Databricks/Hadoop).
  
• Ensure data compliance, metadata management, and governance standards.
  

Required Skills & Qualifications

• 7+ years

  of data engineering experience.
• Strong proficiency in

  Python

  (Pandas, PySpark, Airflow, etc.).
• Hands-on experience with

  data mapping

  , including S2T (source-to-target) documentation and transformation logic creation.
• Strong SQL skills with experience in complex joins, window functions, and performance tuning.
  
• Expertise in cloud data platforms (

  AWS

  , Azure, or GCP).
• Experience with

  big data tools

  such as Spark, Hadoop, Kafka.
• Strong understanding of ETL/ELT concepts and best practices.
  
• Experience with Git, CI/CD pipelines, and workflow orchestration.
  
• Good communication skills and ability to collaborate with business and technical teams.
  

Preferred Qualifications

• Experience with

  Databricks

  ,

  Snowflake

  ,

  Redshift

  , or

  BigQuery

  .
• Knowledge of data modeling and metadata management.
  
• Familiarity with data governance and data catalog tools.
  

Education

• Bachelors or Master’s degree in Computer Science, Engineering, or related field.