Data Engineer - Celonis - OCPM

Role & responsibilities

Job Responsibilities:

• Design, develop, and maintain robust and scalable data pipelines to support various data processing and analytics needs.
• Work with large datasets, both structured and unstructured, to derive meaningful insights. Writing optimized SQL queries for integration with other applications.
• Implement ETL processes to extract, transform, and load data from diverse sources into data warehouses or data lakes.
• Solid understanding of data modelling concepts and database design principles.
• Develop and maintain data models to ensure data integrity, consistency, and accessibility.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize data processing workflows for performance, scalability, and reliability.
• Ensure data quality and implement data validation and cleansing processes.
• Integrate data from multiple sources, including APIs, databases, and third-party systems.
• Monitor and troubleshoot data pipelines to ensure smooth operation and timely data delivery.
• Stay up to date with the latest trends and technologies in data engineering and recommend improvements to existing processes.

Experience Expected:

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with database management systems.
• Hands-on experience with ETL tools and processes.
• Knowledge of various data sources (including ERP, CRM, and SAP) is beneficial
• Excellent problem-solving skills and attention to detail.
• Analytical abilities, Strong Technical Skills, Good communication skills
• Good understanding of the technology and domain.

Preferred to have Advanced expertise in ANY one or Combination of the following software/tools:

• Big data tools: Hadoop, Spark, Kafka, etc
• Relational SQL and NoSQL databases.
• Data pipeline / ETL tools like Informatica, DataStage, SSIS
• Cloud tools: Azure Data Factory (ADF) / AWS Glue / GCP
• Design, develop, and maintain scalable and efficient data pipelines using Python with the libraries Pandas/NumPy/Bonobo/Matplotlib.

  ofile