Group Director Engineering, Data Platforms

LSEG (London Stock Exchange Group) is a prominent provider of financial markets infrastructure worldwide, offering financial data, analytics, news, and index products to a vast customer base spanning over 170 countries. Committed to excellence, we collaborate with our customers throughout the trade lifecycle to assist them in making informed decisions, executing trades, raising capital, and optimizing their operations. With a rich history of over three centuries, cutting-edge technologies, and a global team of 25,000 professionals across 60 countries, we are dedicated to promoting financial stability, driving economic empowerment, and fostering sustainable growth. In the role of Group Director of Software Engineering, you will be responsible for designing and implementing functionalities with a focus on Data Engineering tasks. Your primary tasks will involve working with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, thereby modernizing data products and distribution channels. You will play a pivotal role in driving the software development lifecycle for continuous data delivery and spearheading the evaluation and adoption of emerging technologies. Key Responsibilities: - Collaborate closely with Subject Matter Experts (SMEs) and Tech Leads to ensure delivery on commitments - Develop and maintain secure and compliant production data processing pipelines on Microsoft Fabric and Azure for data ingestion, transformation, and product delivery - Ensure high-performing, efficient, organized, and reliable data pipelines and data stores based on business requirements and constraints - Design, implement, monitor, and optimize data platforms to meet the needs of data pipelines from both functional and non-functional perspectives - Undertake data-related implementation tasks encompassing provisioning data storage services, ingesting streaming and batch data, implementing security requirements, defining data retention policies, identifying performance bottlenecks, establishing monitoring and telemetry, and accessing external data sources - Design and operationalize large-scale enterprise data solutions and applications utilizing Azure data and analytics services such as Delta.io, Lakehouse, Fabric, Azure Cosmos DB, Azure Data Factory, Spark, and Azure Blob storage, among others Skills and Experience: - Relevant experience in Data Platforms within the Financial Services industry and familiarity with Azure's PaaS/SaaS offerings - Proven expertise as a data engineer with a focus on cloud distributed data processing platforms like Spark and modern open table concepts such as delta/iceberg - Strong proficiency in Azure services including Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, and others - Proficiency in Spark, SQL, and Python/Scala/Java - Experience in building Lakehouse architecture using open-source table formats like delta and parquet, along with tools like Jupyter Notebook - Strong understanding of security processes utilizing Azure Key Vault, IAM, RBAC, Monitor, etc. - Proficient in integrating, transforming, and consolidating data from diverse structured and unstructured data systems to build analytics solutions - Ability to think strategically while effectively managing day-to-day delivery requirements - Strong communication, presentation, documentation, and interpersonal skills - Capable of working independently in a fast-paced environment with changing requirements and priorities Join us at LSEG, a leading global financial markets infrastructure and data provider, where our core values of Integrity, Partnership, Excellence, and Change guide us in driving financial stability, empowering economies, and fostering sustainable growth.,