Data Engineer

Job Title: Data Engineer

Job Type:

About the Role:

Data Engineer

This role requires a strong background in data engineering, database technologies, and cloud platforms, along with the ability to work in an Agile environment to drive data initiatives forward.

Responsibilities:

• Design, build, and maintain scalable and efficient data pipelines that move, transform, and store large datasets.
  
• Develop and optimize ETL processes using tools such as

  Apache Spark

  ,

  Apache Kafka

  , or

  AWS Glue

  .
• Work with

  SQL

  and

  NoSQL

  databases to ensure the availability, consistency, and reliability of data.
• Collaborate with data scientists and analysts to ensure data requirements and quality standards are met.
  
• Design and implement data models, schemas, and architectures for data lakes and data warehouses.
  
• Automate manual data processes to improve efficiency and data processing speed.
  
• Ensure data security, privacy, and compliance with industry standards and regulations.
  
• Continuously evaluate and integrate new tools and technologies to enhance data engineering processes.
  
• Troubleshoot and resolve data quality and performance issues.
  
• Participate in code reviews and contribute to a culture of best practices in data engineering.
  

Requirements:

• 3-10 years of experience as a

  Data Engineer

  or in a similar role.
• Strong proficiency in

  SQL

  and experience with

  NoSQL

  databases (e.g., MongoDB, Cassandra).
• Experience with

  big data

  technologies such as

  Apache Hadoop

  ,

  Spark

  ,

  Hive

  , and

  Kafka

  .
• Hands-on experience with cloud platforms like

  AWS

  ,

  Azure

  , or

  Google Cloud

  .
• Proficiency in

  Python

  ,

  Java

  , or

  Scala

  for data processing and scripting.
• Familiarity with data warehousing concepts, tools, and technologies (e.g.,

  Snowflake

  ,

  Redshift

  ,

  BigQuery

  ).
• Experience working with data modeling, data lakes, and data pipelines.
  
• Solid understanding of data governance, data privacy, and security best practices.
  
• Strong problem-solving and debugging skills.
  
• Ability to work in an

  Agile

  development environment.
• Excellent communication skills and the ability to work cross-functionally.