The Manager - Data Engineering is responsible for steering and building the NextGen Business Intelligence & Data Strategy, Data Virtualization, and Data Lakes Warehousing, through researching and experimenting with emerging data technologies and industry trends with a view to bringing business value through early adoption. The role holder is also responsible for developing and defining key business questions, support analysis, improvement and creation of key metrics and dashboards for the learning organization to provide effective solutions to be shared with internal customers at all levels of the organization, supporting in drafting strategic documents for the senior stakeholders.He/she will be responsible for the technical implementation of high-quality, enterprise-grade solutions and be in one of the largest and most complex data warehouse environments, which requires deep expertise in the design, creation, management, and business use of large datasets, as well as designing, implementing, and operating stable, scalable, low-cost solutions to flow data from production systems into the data warehouse and into end-user facing applications (Power BI). The Data Engineer’s technical skills and creativity will prove instrumental in creating custom data pipeline solutions, where existing tools prove insufficient.
Role Details – Key Responsibilities And Accountabilities
Data Engineering for Business Intelligence & Data Analysis & Reporting
- Transform and improve performance of existing reporting & analytics use cases with more efficient and state of the art data engineering solutions
- Contribute to business analysis of the OLTP and OLAP data and in decision support with extensive database programming
- Understand business requirements in BI context and design data models to transform raw data into meaningful insights
Data Warehouse Architecture & Tools
- Build and maintain a scalable data lineage system to improve data infrastructure reliability and efficiency
- Build the infrastructure required for optimal ETL of data from a wide variety of data sources using SQL and ‘big data’ technologies
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
- Identify opportunities for data acquisition and build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
- Ensure the architecture will support all the business needs to drive actionable insights
Data Pipeline ETLs & Monitoring
- Own end-to-end ETL process to build data pipelines, from planning to collection to analysis, including writing custom queries, data cleaning and manipulation, and the ability to work with large datasets
- Acquire data from primary or secondary data sources and maintain databases / data systems and in charge of ensuring consistent data quality on a continuous basis
- Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements
- Design, develop, test, and deploy scalable Power BI dashboards and develop real-time database solutions and pipeline to Power BI Dashboard
- Design ETL using SSIS Packages to reprocess any date data at any time using Reprocess Logic
Automation of Financial & Operations Reporting
- Write T-SQL Stored procedures for performing automation tasks, Performed and fine-tuned Stored Procedures and SQL Queries and User Defined Functions, and for Triggers, Constraints, and Indexes using various DDL and DML commands
- Maintain the Log and Audit information in SQL tables, experienced in providing Logging, Error Handling by using Event Handler for SSIS Packages
- Develop SQL queries /scripts to validate the data such as checking duplicates, null values, truncated values and ensuring correct data aggregations
- Perform data quality analysis using advanced SQL skills as well as Count Validation, Dimensional Analysis, Statistical Analysis and Data Quality Validation in Data Migration. Extensive SQL querying on Staging, Data warehouse and Data Mart
- Develop C# scripts in SSIS and automating tasks using C#
Coordination and Communication
- Ensure regular information exchange with all relevant stakeholders and update them on the acquired knowledge from the business intelligence analysis
- Build relationships and maintain strong partnerships with key personnel to help achieve organisational goals
Audit and Reporting
- Perform ad-hoc BI analysis reports, proposing and presenting recommendations to senior management on strategic decisions, and planned future initiatives
- Support on the preparation of business presentations and reports related to financial and operational performance for various stakeholders, on periodic and ad hoc basis as and when required
- Support on performing regular audit of various processes and databases for the FP&A function in order to identify gaps and risks, and propose corrective actions
Policies and Procedures
- Support on developing and reviewing the FP&A policies and procedures and ensure it is implemented and reported on as a part of the policies and procedures for the FP&A function
- Support on the development and implementation of relevant policies and procedures
Human Capital Responsibilities
- Assist with the implementation of the performance management process by setting objectives, monitoring performance, and provide constructive feedback and provide inputs to senior management
- Provide mentorship for the purpose of developing a continuous talent pipeline for key roles
- Provide inputs on training needs and coordinate with the HC department to ensure facilitation of training requirements
- Develop and implement on the job-training for the team
- Provide inputs for the development of annual manpower plan
- Ensure the implementation of MAF Retail’s corporate policies and relevant procedures
Disclaimer: This role description reflects the general details considered necessary to describe the principal responsibilities of the role identified and shall not be construed as an exhaustive description of all the work requirements inherent to success in the role.
