Senior Data Engineer - Capabilities & Insights

As a Senior Data Engineer at QuantumBlack, you will play a critical role in maintaining and improving data pipelines within the company. Your primary responsibilities will include supporting DE pipelines, managing work to ensure stability and availability of models, and providing rapid responses to incidents and user queries. Additionally, you will proactively monitor existing data pipelines, collect feedback from end-users, and collaborate with the scrum master to develop intervention plans. Key Responsibilities: - Support DE pipelines and ensure stability, continuity, and availability of models - Monitor data pipelines for efficiency and proactively identify areas requiring maintenance - Collect user feedback and collaborate with the team to develop intervention plans - Assetize data pipelines to maximize reusability in other data initiatives - Identify innovative data ingestion and preparation techniques to optimize run-time and robustness - Enforce Data Governance rules and proactively identify risks hindering compliant data use - Prioritize and deliver solutions in line with SLAs and OLAs, providing regular updates to stakeholders - Provide regional cover and support, offering expertise to resolve key incidents during business hours - Identify proactive strategies to prevent future data problems and improve solution quality - Own and contribute to Service Improvement items, including incident reduction and automation - Perform proactive and reactive monitoring and alerting Qualifications Required: - Graduate or postgraduate degree in computer science, engineering, applied mathematics, quantitative social sciences, or related field - 2-5 years of relevant industry analytics experience - Knowledge of ITIL processes - Hands-on experience with Python and Spark - Proficiency in SQL/MSSQL Database - Familiarity with monitoring tools like Grafana and Splunk - Working knowledge of Kedro is advantageous - Understanding of JIRA and Service Now tools - Experience with cloud providers such as AWS/Azure/GCP is a plus - Ability to work effectively with individuals at all levels within an organization - Familiarity with scheduling tools like Airflow and Argo At QuantumBlack, you will have the opportunity to work in a global community with colleagues from over 65 countries and diverse backgrounds. The company values continuous learning, encourages diverse perspectives, and offers world-class benefits to ensure holistic well-being for you and your family. Joining QuantumBlack means being part of a high-performance culture where your ideas and contributions truly matter, and where mentorship and growth opportunities are provided to help you become a stronger leader faster than you ever thought possible.,