Job
Description
In this role you will be joining the Enterprise Data Solutions team, within the Digital & Information Technology organization. Driven by a passion for operational excellence and innovation, we partner with all functional groups to provide the expertise and technologies which will enable the company to digitalize, simplify, and scale for the future. We are seeking an experienced Sr. Data Engineer to join our Enterprise Data Solutions team. The ideal candidate will have a strong background in data engineering, data analysis, business intelligence, and data management. This role will be responsible for the ingestion, processing, and storage of data in our Azure Databricks Data Lake and SQL Server data warehouses. OVERVIEW: The Enterprise Data Solutions team provides Skillsoft with the data backbone needed to seamlessly connect systems and enable data-driven business insights through democratized and analytics-ready data sets. Our mission is to: Deliver analytics-ready data sets that enhance business insights, drive decision making, and foster a culture of data-driven innovation. Set a gold standard for process, collaboration, and communication. OPPORTUNITY HIGHLIGHTS: Lead the identification of business data requirements, create data models and design processes that align to the business logic and regularly communicate with business stakeholders to ensure delivery meets business needs. Design ETL processes, develop source-to-target mappings/integration workflows and manage load processes to support regular and ad hoc activities considering the needs of down-stream systems, functions and visualizations. Work with the latest open-source tools, libraries, platforms and languages to build data products enabling other analysts to explore and interact with large and complex data sets Build robust systems and reusable code modules to solve problems across the team and organization with an eye on the long-term maintenance and support of the application Perform routine testing of own and others’ work to guarantee accurate, complete processes that support business needs. Awareness and compliance with all organizational development standards, industry best practices and business, security, privacy, and retention requirements. Routinely monitor performance, diagnose and implement tuning/optimization strategies to guarantee a highly efficient data structure. Collaborate with other engineers through active participation in code reviews and challenge the team to deliver with precision, consistency and speed. Document data flows and technical designs to ensure compliance with organization, business and security best practices. Regularly monitor timelines and workload. Ensure delivery promises are met or exceeded. Ability and willingness to support the BI mission through learning new technologies and supporting other projects as needed. Provides code reviews and technical guidance to the team. Collaborate closely with the SA and TPO and get the requirements and develop the enterprise solutions SKILLS & QUALIFICATIONS: Bachelor’s degree in quantitative field – engineering, finance, data science, statistics, economics, or other quantitative. 5+ years of experience in Data Engineering/Data Management space and working with enterprise level production data warehouses. 5+ years of experience in working with Azure Databricks 5+ years experience in SQL and PySpark Ability to work in an Agile methodology environment. Experience and interest in cloud migration/journey to the cloud for data platforms and landscape Strong business acumen, analytical skills, and technical abilities Practical problem-solving skills and ability to move complex projects forward.
