Data Engineer

Data Engineer

Job Title:

Company:

Experience:

Educational qualification:

Location

Notice Period:

Responsibilities:

• Design, develop, and maintain robust

  ETL/ELT data pipelines

  using tools such as

  Airflow

  or

  dbt

  .
• Optimize

  PostgreSQL

  performance through

  query tuning, partitioning, indexing, JSONB handling

  , and

  PL/pgSQL scripting

  .
• Develop efficient

  SQL

  and

  Python

  scripts for data transformation, automation, and workflow orchestration.
• Work with

  Big Data technologies

  such as

  Apache Spark

  and

  Hadoop

  for large-scale data processing.
• Implement and manage

  real-time data streaming

  using

  Kafka

  or

  Amazon Kinesis

  .
• Ensure

  data reliability and versioning

  using

  Delta Lake

  ,

  Apache Hudi

  , or

  Apache Iceberg

  frameworks.
• Implement and maintain

  version control (Git)

  and integrate

  CI/CD workflows

  for data pipelines.
• Ensure

  data accuracy, integrity, and security

  , while documenting data flows, architecture, and processes.

Skills Required:

• Minimum

  5+ years of experience

  as a Data Engineer or in a similar role.
• Strong hands-on expertise in

  PostgreSQL

  (query optimisation, partitioning, indexing, JSONB, PL/pgSQL scripting).
• Proficiency in

  SQL

  and

  Python

  for data manipulation, automation, and orchestration.
• Hands-on experience with

  ETL/ELT frameworks

  such as

  Airflow

  ,

  dbt

  , or equivalent tools.
• Exposure to

  Big Data tools

  Apache Spark

  ,

  Hadoop

  , and

  streaming systems

  like

  Kafka

  or

  Kinesis

  .
• Familiarity with

  data versioning frameworks

  such as

  Delta Lake

  ,

  Hudi

  , or

  Iceberg

  .
• Experience with

  Git

  and

  CI/CD pipelines

  for data engineering workflows.
• Excellent

  communication, analytical, and problem-solving

  skills.
• Good to have experience with

  Snowflake

  .