Data Engineer

Role Overview: You will be responsible for integrating data from various siloed systems into CDF using ETL tools such as Azure Data Factory or Informatica PowerCenter. Additionally, you will transform and contextualize data within CDF using programming languages like Python and tools like Apache Spark and Databricks for data analysis and visualization. Your understanding of industrial data and processes will be crucial for successful data integration. Key Responsibilities: - Utilize ETL tools like Azure Data Factory or Informatica PowerCenter to integrate data from different systems into CDF - Write scripts in Python, especially for using the Cognite Python SDK, to transform and contextualize data within CDF - Work with REST APIs for data extraction and integration - Manage databases like PostgreSQL and use database gateways for data management - Utilize cloud storage solutions for extracting data - Use tools like Apache Spark and Databricks for data analysis and visualization - Apply industrial data knowledge to contextualize data within CDF - Manage projects and coordinate with different teams for successful data integration - Communicate effectively with cross-functional teams and stakeholders Qualifications Required: - Experience with ETL tools like Azure Data Factory or Informatica PowerCenter - Proficiency in programming languages like Python - Familiarity with REST APIs - Knowledge of databases such as PostgreSQL - Understanding of cloud storage solutions - Skills in data transformation and contextualization - Familiarity with tools like Apache Spark and Databricks for data analysis and visualization - Understanding of industrial data and processes - Project management skills - Strong communication skills for collaboration with cross-functional teams and stakeholders,