Software Engineer

Responsibilities

• Design, develop, and maintain ETL pipelines for efficient data extraction, transformation, and loading.
• Work with Big Data technologies (Hadoop, Spark, Hive, etc. ) to process and analyse large datasets.
• Develop and maintain data warehouse models and ensure data integrity and consistency.
• Optimise and tune ETL workflows for better performance and scalability.
• Collaborate with data analysts, data scientists, and other engineering teams to deliver high-quality data solutions.
• Monitor, debug, and troubleshoot data flow issues in production systems.
• Write clean, maintainable, and well-documented code following best practices.
  

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 0-4 years of experience in Data Engineering / ETL / Big Data development.
• Familiarity with Python, Java, or Scala for data processing.
• Understanding of cloud data platforms (AWS Redshift, Google BigQuery, Azure Synapse, Snowflake) is a plus.
• Strong analytical, problem-solving, and debugging skills.
• Hands-on experience with SQL and database concepts (RDBMS like MySQL, PostgreSQL, or Oracle).
• Strong knowledge of ETL tools (Informatica, Talend, SSIS, Apache NiFi, or custom ETL pipelines).
• Strong knowledge of Big Data technologies (Hadoop, Spark, Hive, HDFS).
• Hands-on experience with Data modelling and data warehousing concepts (Star/Snowflake schema).
  

Preferred Skills (Good To Have)

• Experience with Airflow, Kafka, or AWS Glue.
• Knowledge of Linux / Unix systems.
• Familiarity with version control tools (Git, Bitbucket).
• Understanding of CI/CD pipelines and data governance practices.