Senior Test Automation Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role : Senior Test Automation Engineer
Experience Level : 3 to 6 Years
Work Location : Bengaluru/Mumbai/Trivandrum
Work From Office : Hybrid

Role & Responsibilities:

• Design and implement UI automation frameworks for React-based healthcare applications.

• Automate testing of digital avatar interactions and real-time visualizations

• Test ADA-compliant features and responsive design across devices

• Automate WebRTC audio/video streams and real-time communication testing

• Test software to ensure responsiveness and efficiency

• Test real-time database operations (Firestore, Cloud SQL)

• Validate session metadata, audit logs, and complex healthcare data structures

• Ensure HIPAA compliance, data encryption, and PII protection

• Perform SQL-based testing for healthcare data integration

• Execute complex healthcare workflow testing across multiple use cases

• Test multi-turn conversational flows and emergency scenario handling

• Validate edge cases, stress testing, and session recovery mechanisms

• Create comprehensive test scenarios for healthcare compliance

• Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion

• Build and maintain automated testing frameworks for agent workflows using Python

• Test for hallucinations, prompt injection, bias, PII leakage, and response safety

• Test end-to-end integration between UI, microservices, and AI agents

• Self-starter proactive and extremely detail oriented

• Validate GCP infrastructure, CI/CD pipelines, and deployment automation

• Implement Automated CI/CD processes using Jenkins tools

• Perform security testing and telephony platform integrations

• Test observability systems and cloud-based microservice environments

• Work with observability tools (e.g., LangSmith, Trulens, logging pipelines) to analyze agent execution

• Design test strategy and estimates for automation

• Technology focused, agnostic to tools, adaptable to change in technology

• Suggest quality fixes and improvements

• Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic

• Contribute to the development of agent test harnesses and benchmarking pipelines

• Validate message integrity and orchestration between avatar UI, voice services, context managers, and LLM endpoints using REST/gRPC/WebSocket automation

• Implement contract and schema validation for API integrations

• Test event-driven architectures using Kafka/MQTT and ensure reliable message delivery

• Ensure continuous integration and safe model rollout through MLOps-aware CI/CD testing

• Implement model version checks and regression suite hooks in deployment pipelines

• Work with Docker, Helm, and GitHub Actions for containerized deployments

Required Skills:

Core Testing & Automation:

• 3+ years QA automation experience with Selenium WebDriver expertise

• Java/Python programming for automation frameworks

• API Testing proficiency (RestAssured, Postman, REST/GraphQL APIs)

• Event-driven automation (REST/gRPC/WebSocket, Kafka/MQTT testing)

• Contract & schema validation expertise

• Async workflow simulation and event bus testing (Kafka, NATS)

• API contract testing tools (Karate, Swagger mocks, pact testing)

Frontend & UI Testing:

• Strong JavaScript frameworks knowledge (React, Angular, Vue.js)

• Multimodal UI automation (Playwright/Cypress for avatar rendering, gestures, text sync)

• Visual regression testing tools (Applitools, Percy)

• WebDriver with video validation capabilities

• Speech & Audio testing (ASR/TTS accuracy, latency profiling, ffmpeg pipelines)

• Visual & Motion regression testing (OpenCV-based comparison, frame analysis)

• Accessibility testing tools (Axe-core, Lighthouse, screen reader validation)

• End-to-end conversation flow simulation with mock APIs

Cloud & Platform:

• GCP/AWS cloud platform experience and microservices testing

• Docker, Kubernetes containerization and orchestration

• Infrastructure testing and deployment validation

• Performance testing tools (JMeter, LoadRunner, k6, Locust, Gatling)

• CI/CD pipeline testing (Jenkins, GitHub Actions, Helm)

• MLOps-aware testing (model version checks, regression suite hooks)

• Observability & monitoring tools (OpenTelemetry, Grafana, ELK, Prometheus)

• Chaos testing and fault injection (Gremlin, synthetic fault testing)

• Database & caching validation (SQL/NoSQL automation, Redis, schema drift monitoring)

AI & Healthcare Specific:

• AI/ML testing and conversational AI validation

• Healthcare compliance knowledge (HIPAA, FHIR standards)

• Security testing for regulated environments

• Voice AI and speech recognition testing

• LLM endpoint testing and validation

• Avatar UI and multimodal interaction testing

• Context manager and conversation flow testing

Security & Compliance:

• Enterprise security standards (HIPAA, SOC2, GDPR) automation

• Security testing tools (OWASP ZAP, Burp Suite)

• JWT validation and authentication testing

• Policy-as-code implementation (OPA)

• Secret scanning and vulnerability assessment

• Error handling and circuit breaker validation

Good to have:

• Evaluate agent output using rubric-based, LLM-based, and scenario-based techniques

• LLM-specific testing including prompt testing

• Multi-turn conversation testing

• Shadow testing and anomaly monitoring experience

• Distributed load testing with Grafana integration

• Microservice contract chaining expertise

• Image diffing and automated snapshot testing

• Noise robustness testing for voice interaction