Senior Data Engineer

Role Description

Role Description:

As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing andoptimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will workclosely with data analysts and data scientists to develop data pipelines and run data science experiments. Youwill be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousingtechnologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that the Azure environment is secure and complies with relevant regulations.

Roles & Responsibilities:

• Designing, developing and deploying cloud-based data platforms using Microsoft Azure

• Integrating and processing large amounts of structured and unstructured data from various sources

• Implementing and optimizing ETL processes and data pipelines

• Developing and maintaining security and access controls

• Collaborating with other teams to ensure the consistency and integrity of data

• Troubleshooting and resolving data platform issues

Technical Skills

Skills Requirements:

Expertise in Azure services and tools such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics

Experience in building scalable and reliable data pipelines using Azure services, Apache Spark, and related big data technologies

Familiarity with cloud-based infrastructure and deployment, specifically on Azure

Strong knowledge of programming languages such as Python, C#, and SQL

Must have excellent communication skills and be able to communicate complex technical information to non-technical stakeholders in a clear and concise manner.

Must understand the company's long-term vision and align with it.

Provide leadership, guidance, and support to team members, ensuring the successful completion of tasks, and promoting a positive work environment that fosters collaboration and productivity, taking responsibility of the whole team.