Data Engineer - Corporate Functions

Data Engineer

Roles & Responsibilities

• Data Pipeline Development:

  Design, develop, and maintain data solutions for data generation, collection, and processing. You will create data pipelines, implement

  ETL

  processes to migrate and deploy data, and take ownership of projects from inception to deployment.

• Collaboration & Communication:

  Collaborate with cross-functional teams, including Data Architects, Business SMEs, and Data Scientists, to understand data requirements and design solutions that meet business needs. You will participate in sprint planning meetings and provide estimations on technical implementation.

• Data Quality & Governance:

  Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency. You will also implement data security and privacy measures to protect sensitive data and adhere to standard methodologies for coding, testing, and designing reusable code.

• Technology & Innovation:

  Leverage cloud platforms (

  AWS

  preferred) to build scalable and efficient data solutions. You will explore new tools and technologies to improve

  ETL

  platform performance.

Qualifications

• A Master's degree with 1-3 years of experience, a Bachelor's degree with 3-5 years of experience, or a Diploma with 7-9 years of experience in Computer Science, IT, or a related field.
• Proficiency in

  Python, PySpark

  , and

  Scala

  for data processing and

  ETL

  workflows.
• Hands-on experience with

  Databricks

  for building

  ETL

  pipelines and handling

  big data

  processing.
• Experience with data warehousing platforms such as

  Amazon Redshift

  or

  Snowflake

  .
• Strong knowledge of

  SQL

  and experience with relational databases (

  PostgreSQL, MySQL

  ).
• Familiarity with

  big data

  frameworks like

  Apache Hadoop, Spark

  , and

  Kafka

  .
• Certifications such as

  AWS Certified Data Engineer

  or

  Databricks Certified

  are preferred.

Soft Skills

• Problem-Solving:

  Excellent critical-thinking and problem-solving skills.

• Collaboration:

  Strong communication and collaboration skills, with a demonstrated awareness of how to function in a team setting.

• Presentation:

  Demonstrated presentation skills for communicating insights and solutions effectively.

• Initiative:

  The ability to explore new tools and technologies to improve platform performance.