Data Engineer

Job Title: Data Engineer

Experience:

Job Overview

Data Engineer

Key Responsibilities

• Design, develop, and maintain

  ETL/ELT pipelines

  for large-scale data processing.
• Work with

  Python, Spark, and SQL

  to transform and integrate data from various sources.
• Implement data solutions on

  Microsoft Fabric, Databricks, or Snowflake

  .
• Ensure

  data quality, integrity, and performance optimization

  across workflows.
• Collaborate with data analysts, data scientists, and business teams to define data requirements.
• Monitor, troubleshoot, and optimize data pipelines for

  scalability and efficiency

  .
• Implement best practices for

  data security, governance, and compliance

  .

Required Skills & Qualifications

• 24 years

  of experience as a Data Engineer or in a similar role.
• Strong programming skills in

  Python

  and experience with

  Apache Spark

  .
• Proficiency in

  SQL

  for data manipulation, optimization, and performance tuning.
• Hands-on experience with

  one or more

  of the following platforms:

• Microsoft Fabric

• Databricks

• Snowflake

• Familiarity with

  cloud platforms

  (Azure, AWS, or GCP) and

  data lake/data warehouse architectures

  .
• Knowledge of

  CI/CD pipelines

  and

  version control (Git)

  is a plus.

Preferred Skills

• Experience with

  Delta Lake, Parquet, or similar formats

  .
• Exposure to

  data modeling

  and

  data governance frameworks

  .
• Understanding of

  big data ecosystems

  and

  real-time data streaming

  .

Education

• Bachelor’s or Master’s degree in

  Computer Science, Information Technology, Data Engineering

  , or a related field.