Senior Data Engineer

Are you interested in being involved in the biggest, data driven transformation of transport solutions in history? We are in the middle of our digitalization journey, and you are welcome to join and help us drive analytics and artificial intelligence initiatives which enable new business models.

We are looking for Data Engineers 8+ years of relevant experience with possible DevOps skills to develop and optimize data pipelines and work together with Data Scientists and other experts who focus on generating business value out of data. You will work with the latest technology, in agile product teams which discover data to create innovative services.

These are challenges waiting for you:

You will be joining the UST DDE Data analysis and automation team where you will enable the ordering of new data and ingestion for Root cause analysis, Total Vehicle Health backlog as well as our internal data engineering authoring and support roadmap

Diagnostic data engineering is an essential part of creating the data ingestion pipeline from UDP. Without this, no service.

You ingest and process data coming from our business application, factory equipment (Industrial Internet of Things), products (Vehicle Logged Data), as well as external sources. You will organize both structured and unstructured data to enable development of new services, such as preventive maintenance of vehicle, fuel consumption and battery lifetime optimization and many more innovative services which are changing our business models.

Your typical day at work will be filled with the following activities:

• Build complex data pipelines in Microsoft Azure
• Optimize existing data pipelines
• Support in building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources to Azure
• Work closely with data analysts and data scientists to provide required data structures and enable new insights
• Able to provision resources on Azure
• Keep the data secure across the end-to-end solutions
• Evaluate and improve existing data analytics solutions
• Develop your competences, learn new tools and ways of working

• We are looking for experienced data engineer with 8+ years of experience and relevant education background
• You have good hands-on skills on Azure Data Analytics, Spark, Databricks (Cost Optimization Techniques, Cluster Optimization, Performance Tuning)
• You have strong hands-on ETL skills and experience in building data pipelines using Databricks (with good knowledge of spark) and orchestrating Data workloads on Azure Data Factory
• You have experience working with AI Assistant tools (like Github Copilot) and have achieved results implementing them in your project. You have a passion for AI and would like to mentor other members of the team on how to effectively use AI for productivity improvements
• Experience in handling real-time streaming/transactional data preferably Spark-Streaming, Kafka/EventHubs/EventGrid/Stream Analytics/Service Bus etc
• You have significant experience in processing data in scripting languages (Python, Pyspark, Scala)
• Working with Git and following Git workflow (Branching, Managing conflicts, etc.)
• Databases (like SQL server or Netezza) don’t have any secret for you
• You are comfortable with DevOps (or DevSecOps) and are able to provision resources in Azure
• You are comfortable working in a diverse, complex, and fast-changing landscape of data sources
• You communicate fluently in English. You are proactive problem solver with innovative thinking and a strong team player

Extras – good to have:

• Good understanding of Volvo Data Marketplace
• Experience in AGILE project methodology and practice with ARM Templates/Bicep on the DevOps front
• Understanding the DevOps Architecture (Agent Pools, Accounts, Var Groups, Templating, etc.)
• Azure Networking model (public and private connectivity, VNET injection, etc.)
• Familiarity with Microsoft Power BI or other data visualization tools such as Qlik, SAP Business Objects
• Knowledge of other services and tools used to ETL workflows like Informatica IICS
• Familiarity with database management systems, online analytical processing (OLAP)

• Being a part of a product team focusing both on maintenance and innovations
• A steep learning curve with a state of the art and individualized training program
• Collaborative environment
• Work-life balance: we make sure you enjoy quality time away from work
• Clear career path & extensive development opportunities such as mentoring or coaching programs
• Participation in international projects and different pieces of training
• Unlimited access to learning including Microsoft ESI training programs and certifications, Pluralsight, Udemy and many more