Lead, Quality Engineering (AI/ML)

The Team: This team is recognized for its expertise, innovation, and passion. Together, you'll focus on agile product development with cutting-edge technology, offering insights into global capital markets and the financial services industry. Your role will involve close collaboration, initiative, and achieving ambitious goals alongside your talented colleagues and stakeholders. This is a unique opportunity to be a pivotal part of our fast-growing global organization during this exciting phase in our company's evolution.

The Impact: This role is essential for the Market Intelligence Group of S&P as it ensures the development of new software solutions and continuous improvement and stability of our existing applications. Role will enable our clients with a seamless user experience and access to up-to-date data, ultimately bolstering their confidence in our services and reinforcing our competitive position in the market.

Whats in it for you:

• Drive quality practices and processes.
• Exposure to cutting-edge technology and tools in the financial domain.
• Opportunity to work within an multi cloud environment (AWS), promoting skill development and innovation.
• Collaboration with global teams, offering diverse perspectives and enhancing your professional growth potential.
• Access to a dynamic and forward-thinking work environment, where you can contribute to the development of innovative solutions and stay at the forefront of industry trends.
• Working Realtime in actual CI/CD environment
• Work with multiple MI product and learn Public Market domain.

Responsibilities:

• Leads and designs test automation architecture to work across all product technologies covering areas such as (but not limited to) build verification, functional verification, stability, and data integrity.
• Build test frameworks/architectures specifically for applications predicated on Large Language Models (LLMs) and agentic workflows.
• Design, develop & maintain framework, scripts and execute automation scripts.
• Expertise in Automation Testing for WebdriverIO (Typescript), and Cypress (JavaScript)
• Spearheads the enhancement of software development processes across all teams in accordance with Total Quality Assurance best practices (including, but not limited to, project management, development, business operations, reporting, and quality management).
• Oversee and participate in the development and review of test strategies and test plans to ensure appropriate test coverage of all features.
• Oversee and participate in the performance of tests across various applications.
• Offers support and mentorship to other engineers on the automation team. Provides technical guidance to software testers to facilitate their adaptation to automation tools.
• Become a subject matter expert in the domain and applications built and supported by our program.
• Review requirements, user stories, specifications, and technical design documents and create detailed, comprehensive and well-structured test plans and test cases using available test methods.
• Estimate, prioritize, plan and coordinate testing activities in Agile environment.
• Solid understanding of database concepts, methodologies, and best practices
• Proficiency in SQL and database querying
• Liaise with internal teams (e.g. developers and product managers) to identify system requirements, and evaluate system interfaces, operational requirements, andperformance requirements of overall system.

What Were Looking For:

• Bachelors or masters degree in Computer Science, Engineering, or a related field.
• A minimum of 10 years of experience as a Quality Engineer, with leadership exposure.
• Exhibits experience in testing agentic workflows and possesses the capability to construct AI agents.
• Demonstrates a thorough understanding of Machine Learning concepts and possesses the ability to efficiently analyze extensive datasets.
• Strong skills in Python, JavaScript or TypeScript.
• Experience with API and mobile testing.
• Expertise in GitHub pipelines for continuous delivery.
• Excellent communication and facilitation skills.
• Ability to translate software requirements/stories into accurate and complete test scenarios, including identifying detailed test data needs.
• Proficiency in SQL and database querying, with a solid understanding of database concepts, methodologies, and best practices.
• Experience managing teams and mentoring team members across multiple projects and products.
• Ownership of delivery, with the ability to identify potential risks and mitigate them to achieve desired goals.
• Excellent written and spoken English skills.
• Experience working in a distributed environment with colleagues across different geographies.

Must Haves:

• Possesses experience in building test frameworks/architectures specifically for applications predicated on Large Language Models (LLMs) and agentic workflows.
• Demonstrates a thorough understanding of Machine Learning concepts and possesses the ability to efficiently analyze extensive datasets.
• Experience in Python programing language.

Additional Skills (Preferred):

• Good understanding of performance testing and metrics.
• Experience with AWS/Azure
• Understanding of UX principles
• C# language skill.