Senior Data Engineer - Enterprise Data Solutions

In this role at Skillsoft, you will be a part of the Enterprise Data Solutions team, focused on digitalizing, simplifying, and scaling for the future. As a Sr. Data Engineer, you will be responsible for the ingestion, processing, and storage of data in the Azure Databricks Data Lake and SQL Server data warehouses. **Role Overview:** The Enterprise Data Solutions team at Skillsoft delivers analytics-ready data sets to enhance business insights and foster a culture of data-driven innovation. Your mission will involve setting a gold standard for process, collaboration, and communication. **Key Responsibilities:** - Lead the identification of business data requirements, create data models, and design processes aligning with business logic while ensuring delivery meets business needs. - Design ETL processes, develop source-to-target mappings, and manage load processes to support regular and ad hoc activities, considering downstream systems, functions, and visualizations. - Utilize the latest open-source tools and platforms to build data products for exploring and interacting with large data sets. - Build robust systems and reusable code modules, focusing on long-term maintenance and support. - Perform routine testing to guarantee accurate processes, ensuring compliance with organizational standards and industry best practices. - Monitor performance, diagnose issues, and implement optimization strategies for an efficient data structure. - Collaborate with other engineers, participate in code reviews, and document data flows and technical designs. - Monitor timelines and workload to ensure delivery promises are met or exceeded. - Support BI initiatives by learning new technologies and providing technical guidance to the team. **Qualifications Required:** - Bachelor's degree in a quantitative field such as engineering, finance, data science, statistics, or economics. - 5+ years of experience in Data Engineering/Data Management and working with enterprise-level data warehouses. - 5+ years of experience with Azure Databricks, SQL, and PySpark. - Ability to work in an Agile methodology environment. - Experience and interest in cloud migration for data platforms. - Strong business acumen, analytical skills, and technical abilities. If you are intrigued by this opportunity at Skillsoft, we encourage you to apply and be a part of transforming learning through innovative solutions.,