Data Engineer

Title

Key Responsibilities

• Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository.
• Build and Maintain Data Infrastructure: Design, implement, and manage data warehouses, data lakes, and other data storage solutions.
• Ensure Data Quality and Integrity: Develop data validation, cleansing, and normalization processes to ensure data accuracy and consistency.
• Collaborate with Data Analysts and Business Process Owners: Work with data analysts and business process owners to understand their data requirements and provide data support for their projects.
• Optimize Data Systems for Performance: Continuously monitor and optimize data systems for performance, scalability, and reliability.
• Develop and Maintain Data Governance Policies: Create and enforce data governance policies to ensure data security, compliance, and regulatory requirements.
  

Experience & Skills

• Hands-on experience in implementing, supporting, and administering modern cloud-based data solutions (Google BigQuery, AWS Redshift, Azure Synapse, Snowflake, etc.).
• Strong programming skills in SQL, Java, and Python.
• Experience in configuring and managing data pipelines using Apache Airflow, Informatica, Talend, SAP BODS or API-based extraction.
• Expertise in real-time data processing frameworks.
• Strong understanding of Git and CI/CD for automated deployment and version control.
• Experience with Infrastructure-as-Code tools like Terraform for cloud resource management.
• Good stakeholder management skills to collaborate effectively across teams.
• Solid understanding of SAP ERP data and processes to integrate enterprise data sources.
• Exposure to data visualization and front-end tools (Tableau, Looker, etc.).
• Strong command of English with excellent communication skills.