Job
Description
Role Description SUMMARY: This position is responsible for design, development and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role is a blend of technical leadership, team leadership, and hands-on development. Responsibilities/Tasks Responsible for collecting, moving, storing, and preparing data for analytics enablement. Participates in project planning sessions, working closely with business analysts and team members to analyse requirements and provides design recommendations for complex systems. Designs and develops new data pipelines for ingesting high-volume data sets. Develops pipelines using disciplined processes, adhering to industry standards and best practices, including complete ease with agile development methods throughout the SDLC. Demonstrates processes to all stakeholders. Shares knowledge and provide technical guidance to other team members within area of expertise. Takes part in reviews of work, e.g. design and code reviews. Works with team members to analyse and understand problems with complex systems and resolve them. Resolves customer complaints and respond with suggestions for improvements and enhancements. This position description identifies the responsibilities and tasks typically associated with the performance of the position. Other relevant essential functions may be required. EMPLOYMENT QUALIFICATIONS: EDUCATION: Bachelor’s degree in a related field. Relevant combination of education and experience may be considered in lieu of degree. Continuous learning, as defined by the Company’s learning philosophy, is required. Certification or progress toward certification is highly preferred and encouraged. Experience 8 years’ experience in application development. At least five years of experience in Azure big data services/technologies (Databricks, Azure, Python, unit testing, SQL and Azure Data Lake). SKILLS/KNOWLEDGE/ABILITIES (SKA) REQUIRED: Deep knowledge of SQL/TSQL Strong understanding of Azure Big Data Services such as Azure Data Lake Storage, Azure Data Factory, Logic Apps, Azure Functions Agile software process Working experiences of test-driven development framework. Excellent inter-personal and communication skills. Ability to multi-task in a fast-paced environment. Flexibility to adapt to changing business needs. Team player who is delivery-oriented and takes responsibility for the team’s success. Enthusiastic, can-do attitude with the drive to continually learn and improve. Highly self-motivated, creative, and able to dive deep in problem solving. Skills Databricks,Python,Azure,Unit Testing Show more Show less
