Data Engineer - Python AWS

As Data Engineer you will have following key accountabilities:

• Develop, test and deploy big data applications.
• Ensure that all development work in data pipelines follows best practices for ensuring
• validity, efficiency and maintainability.
• Collaborate in a distributed, cross-functional agile team to reached shared goals.
• Take ownership of technical implementations and architecture together with your team
• and in alignment with communities of practices.
• Communicate with data producers to align on data exchange formats and interfaces.
• Communicate with data consumers and other stakeholders in order to help
• them fulfill their needs to drive the business.
• Provide suggestions to business in the Media Measurement context on how existing and
• new data sources can be utilized to enhance our existing product portfolio.
• Recommend different ways to constantly improve data reliability and quality.

Qualifications

Main technologies you will be using with us:

• Python
• AWS
• Spark (Java, Scala, PySpark)
• Airflow
• GitLab
• Atlassian suite

Now that we've introduced you to the position as Data Engineer, what skills, qualifications and experience should you have?

• You have a bachelor's degree in computer science, software/computer engineering, or
• applied mathematics.
• You have at least 3+ years of working experience as a Data Engineer.
• You are curious about finding new and unusual ways of how to solve data management
• issues.
• You already have experience with at least one cloud provider (GC, AWS, Azure).
• You have solid hands-on experience with Python.
• You have experience with Java or Scala.
• You know how to develop data-intensive applications using Spark.
• You are comfortable writing SQL queries to wrangle data from relational databases.
• You know how to orchestrate data pipelines with Airflow or any other similar data scheduling and orchestration tool.
• You have experience with CI/CD and ideally also with IaC using Terraform.
• You are following best practices in software engineering, like pair programming, testing, clean code and agile software development frameworks.
• You are able to give and take open, constructive feedback.