Data Engineer

We are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions.

• Design, develop, and maintain robust ETL/ELT data pipelines using tools such as Airflow or dbt.
• Optimize PostgreSQL performance through query tuning, partitioning, indexing, JSONB handling, and PL/pgSQL scripting.
• Develop efficient SQL and Python scripts for data transformation, automation, and workflow orchestration.
• Work with Big Data technologies such as Apache Spark and Hadoop for large-scale data processing.
• Implement and manage real-time data streaming using Kafka or Amazon Kinesis.
• Ensure data reliability and versioning using Delta Lake, Apache Hudi, or Apache Iceberg frameworks.
• Implement and maintain version control (Git) and integrate CI/CD workflows for data pipelines.
• Ensure data accuracy, integrity, and security, while documenting data flows, architecture, and processes.

• Minimum 5+ years of experience as a Data Engineer or in a similar role.
• Strong hands-on expertise in PostgreSQL (query optimisation, partitioning, indexing, JSONB, PL/pgSQL scripting).
• Proficiency in SQL and Python for data manipulation, automation, and orchestration.
• Hands-on experience with ETL/ELT frameworks such as Airflow, dbt, or equivalent tools.
• Exposure to Big Data tools – Apache Spark, Hadoop, and streaming systems like Kafka or Kinesis.
• Familiarity with data versioning frameworks such as Delta Lake, Hudi, or Iceberg.
• Experience with Git and CI/CD pipelines for data engineering workflows.
• Excellent communication, analytical, and problem-solving skills.
• Good to have experience with Snowflake.

B Tech/ M Tech/ BCA/MCA (Computer Science) or related field.