Senior Data Engineers

Senior Data Engineers in the Shipping & Energy Industry

Clarksons Research, the market leading provider of data and intelligence across shipping and trade, is seeking hard-working and enthusiastic individuals to join our expert team to support the expansion and development of our business. Clarksons Research is part of the Clarksons group, the world’s leading integrated shipping services provider and a FTSE 250 company headquartered in London.

Clarksons Research is looking for experienced data analysts that are keen to take responsibility for delivering insights to clients based on wide ranging, interesting data sets using the latest data science and analytical techniques, and building data pipelines to facilitate analysis.

The Role

-         Lead in proposing plans and implementing systems for processing and analysing big data sets.

-         Develop and use algorithmic and machine learning techniques to extract, transform, derive, aggregate and validate data.

-         Work in a fast-paced, motivated and agile team.

-         Work alongside data analysts and developers to deliver big data processing solutions and analytics.

Requirements:

·        5+ years with Big Data tools: Databricks, Apache Spark, Kafka, Data Lakes

·        Experience designing and scaling Big Data systems including partitioning strategies

·        Strong SQL, Spark SQL, and Spark Streaming abilities

·        Expert in Spark optimization, Delta, and Databricks Lakehouse

·        Azure knowledge, including streaming data from Event Hubs or Kafka

·        Proficient in Python, PySpark, Scala

·        Spatial data experience using H3 indexes

·        Comfortable with Git in Azure DevOps and Infrastructure as Code (IaC) provisioning

Salary

Location

Number of vacancies

Start date

Vacancy type

Further details

https://www.linkedin.com/company/clarksons-research/

How to apply

Closing date