Big Data Lead

Role Overview: You will be joining Investor Services Technology as an Applications Development Technology Senior Data Lead Analyst. In this senior-level position, you will be responsible for establishing and implementing canonical data architecture, driving data governance, leading data analysis and programming activities for applications across Investor Services, and modernizing the data strategy and architecture. Key Responsibilities: - Design and implement Spark, Hive, Scala pipelines using Medallion model - Architect data integration across custody platforms - Embed automation in metadata, data dictionary, data catalogues, and quality checks - Ensure reliability, cost optimization, and data governance - Mentor engineers and participate in architecture reviews - Ensure application design adheres to architecture blueprint and enforce coding standards - Collaborate with cross-functional teams for integrated solutions - Provide guidance and coaching to mid-level developers and analysts - Assess risks in business decisions and drive compliance with regulations - Implement DevOps practices and promote continuous integration, delivery, and automated testing - Utilize Openshift for container orchestration and manage source code using GitHub Qualifications Required: - Big Data Engineering skills including Hive, Spark, Scala, Delta Lake, and performance tuning - Data Architecture knowledge in Medallion, Data Mesh, and multi-zone Data Lake - Experience with GenAI for Data, including metadata, test data, code gen, and lineage - Cloud & DevOps expertise in AWS/Azure, GitHub Actions, and Airflow - Familiarity with Data Governance practices such as schema evolution, contracts, and observability - Bachelors or Masters in CS, Data Engineering, or related field - Minimum 12 years in data engineering, with at least 5 years in financial services (Custody preferred),