Software Development Engineer in Test - AI/LLM QA Engineer

Company Description

At Infinite Possibilities, we’re reimagining how Private Equity and consulting teams work—by building intelligent AI-native workflows and agentic platforms tailored to the real-world needs of high-performance teams. Our mission is to accelerate value creation through cutting-edge AI, system design, and product craftsmanship. We're a fast-growing startup building at the intersection of LLMs, infrastructure, and human-AI collaboration.

Role Description

SDET

Key Roles & Responsibilities

• Design, develop, and maintain automated test frameworks for AI-based applications.
• Perform

  LLM QA

  testing, including prompt-response validation, accuracy scoring, and regression testing.
• Collaborate with developers, AI engineers, and product teams to identify quality gaps and resolve defects.
• Conduct functional, integration, performance, and regression testing.
• Develop and execute test plans, test cases, and scripts for both manual and automated testing.
• Monitor and track defects, ensuring timely closure and retesting.
• Ensure test automation integrates seamlessly with CI/CD pipelines.
• Provide quality metrics, reports, and insights to stakeholders.

Must-Have Skills & Qualifications

• 3–4 years of hands-on experience in QA/SDET roles.
• Strong experience in LLM QA (validating AI model outputs, accuracy checks, and prompt testing).
• Proficiency in test automation frameworks
• Strong Python skills for writing test scripts and automation.
• Experience with REST API testing tools (Postman, REST Assured).
• Familiarity with CI/CD tools (Jenkins, GitHub Actions, GitLab CI, etc.).
• Knowledge of software testing methodologies (unit, integration, functional, performance).
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.

Perks & Benefits

• Industry-leading pay with performance-based rewards.
• Work on cutting-edge AI applications with global impact and real-world use cases.
• Join a remote-first, fast-paced team with direct influence on product and architecture decisions.

Think you’re a fit? Apply now and let’s build something extraordinary together.