AVP - Bigdata Engineer

The Applications Development Sr Programmer Analyst is responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your role will involve leading applications systems analysis and programming activities. You will partner with multiple management teams to ensure appropriate integration of functions to meet goals, identify necessary system enhancements for deploying new products and process improvements, and resolve high-impact problems/projects through in-depth evaluation of complex business processes and system processes. Your expertise in applications programming will be crucial in ensuring that application design aligns with the overall architecture blueprint. As a key member of the team, you will be instrumental in developing and maintaining systems that power near real-time/Batch, information retrieval (IR), and grounding (RAG) services. Your responsibilities will include designing and building highly scalable web crawling and data extraction systems, optimizing data extraction architecture for peak performance, and developing robust systems to process vast volumes and extract meaningful insights through advanced data processing techniques. Additionally, you will design and implement high-throughput data pipelines and infrastructure to handle petabyte-scale datasets seamlessly. You must have expertise in Hadoop, Spark, Oracle, CICD, Light speed, OpenShift, Java, and Microservices. The qualifications for this role include 8+ years of relevant experience in Apps Development or systems analysis, 5+ years of programming with at least one software programming language experience, and 5+ years of leading design or architecture experience. Subject Matter Expertise in at least one area of Applications Development is required, along with clear and concise written and verbal communication skills. Experience with Python, analytic methods, frameworks, real-time streaming, and stream processing frameworks is a plus. Prior experience in the financial industry is a must. In this role, you will play a key part in driving the adoption of capabilities across regions by collaborating with regional business and technology teams, integrating data into the DataHub (EAP), and prototyping methods to develop insights with business analytics and digital product teams. Your proven ability to attract, develop, engage, and sustain engineering/technical talent will be essential in fostering a culture of innovation and excellence. A Bachelor's degree/University degree or equivalent experience is required, with a Master's degree preferred. Full-time employment is offered in the Technology job family group, specifically in Applications Development.,