Data engineer

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, building, and optimizing data pipelines and architectures to support our growing data-driven initiatives. Knowledge of machine learning techniques and frameworks is a significant advantage and will allow you to collaborate closely with our data science team.  

Key Responsibilities:

- Design, implement, and maintain scalable data pipelines for collecting, processing, and analyzing large datasets.  

- Build and optimize data architectures to support business intelligence, analytics, and machine learning models.  

- Collaborate with data scientists, analysts, and software engineers to ensure seamless data integration and accessibility.  

- Develop and maintain ETL (Extract, Transform, Load) workflows and tools.  

- Monitor and troubleshoot data systems to ensure high availability and performance.  

- Implement and enforce best practices for data security, governance, and quality.  

- Evaluate and integrate new technologies to enhance data engineering capabilities.  

Qualifications:

- Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.  

- Proven experience as a Data Engineer or in a similar role.  

- Proficiency in programming languages such as Python, Java, or Scala.  

- Hands-on experience with data pipeline tools (e.g., Apache Airflow, AWS Glue).  

- Strong knowledge of SQL and database systems (e.g., PostgreSQL, MySQL, MongoDB).  

- Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark).  

- Familiarity with data modeling, schema design, and data warehousing concepts.  

- Understanding of CI/CD pipelines and version control systems like Git.  

Preferred Skills:

- Familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch, scikit-learn).  

- Experience deploying machine learning models and working with MLOps tools.  

- Knowledge of distributed systems and real-time data processing (e.g., Kafka, Flink).