Manager - Data Engineer (Work from office)

We are seeking a highly skilled and experienced Data Engineering professional for our data engineering team. The ideal candidate will have extensive hands-on experience with the Microsoft Azure technology stack, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and other related services. This role requires a strong focus on data management, data engineering, and governance, ensuring the delivery of high-quality data solutions to support business objectives.

Key Responsibilities:

• Technical Oversight & Delivery :

• Provide technical guidance and support to team members, promoting best practices and innovative solutions
• Oversee the planning, execution, and delivery of data engineering projects, ensuring alignment with business goals and timelines.

• Data Engineering:

• Design, develop, and maintain scalable and robust data pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
• Implement ETL/ELT processes to ingest, transform, and load data from various sources into data lakes and data warehouses (specifically sources includes Excel, SAP HANA, APIs and SQL server).
• Optimize data workflows for performance, scalability, and reliability.

• Data Management:

• Ensure data quality, integrity, and consistency across all data platforms.
• Manage data storage, retrieval, and archiving solutions, leveraging Azure Blob Storage, Azure Data Lake, and Azure SQL Database.
• Develop and enforce data management policies and procedures.

• Data Governance:

• Establish and maintain data governance frameworks, including data cataloging, lineage, and metadata management.
• Implement data security and privacy measures, ensuring compliance with relevant regulations and industry standards.
• Monitor and audit data usage, access controls, and data protection practices.

• Collaboration & Communication:

• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions.
• Communicate complex technical concepts to non-technical stakeholders, ensuring transparency and alignment.
• Provide regular updates and reports on data engineering activities, progress, and challenges.

Qualifications:

• Bachelors or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Strong hands-on experience with the Microsoft Azure technology stack, including but not limited to:
• Azure Data Factory
• Azure Databricks
• Azure SQL Database
• Azure Synapse Analytics
• Azure Data Lake Storage
• Proficiency in programming languages such as SQL, Python, and Scala.
• Experience with data modeling, ETL/ELT processes, Medallion Architecture, and data warehousing solutions.
• Solid understanding of data governance principles, data quality management, and data security best practices.
• Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
• Strong communication, leadership, and project management skills.

Preferred Qualifications:

• Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Azure Solutions Architect Expert.
• Experience with other data platforms and tools such as Power BI, Azure Machine Learning, and Azure DevOps.
• Familiarity with big data technologies and frameworks like Hadoop and Spark.