Get alerts for new jobs matching your selected skills, preferred locations, and experience range. Manage Job Alerts
5.0 - 10.0 years
15 - 25 Lacs
Hyderabad
Work from Office
We are seeking a highly skilled Quality Engineer Data to ensure the reliability, accuracy, and performance of data pipelines and AI/ML models within our SmartFM platform . This role is critical to delivering trusted data and actionable insights that drive smart building optimization and operational efficiency. Key Responsibilities: Design and implement robust QA strategies for data pipelines , ML models , and agentic workflows . Test and validate data ingestion and streaming systems (e.g., StreamSets , Kafka ) for accuracy, completeness, and resilience. Ensure data integrity and schema validation within MongoDB and other data stores. Collaborate with Data Engineers to proactively identify and resolve data quality issues. Partner with Data Scientists to validate ML/DL/LLM model performance, fairness, and robustness. Automate testing processes using frameworks such as Pytest , Great Expectations , and Deepchecks . Monitor production pipelines for anomalies, data drift , and model degradation . Participate in code reviews , QA audits, and maintain comprehensive documentation of test plans and results. Continuously evaluate and improve QA processes based on industry best practices and emerging trends. Required Technical Skills: 510 years of QA experience with a focus on data validation and ML model testing . Strong command of SQL for complex data queries and integrity checks. Practical experience with StreamSets , Kafka , and MongoDB . Proficient in Python scripting for automation and testing. Familiarity with ML testing metrics , model validation techniques, and bias detection . Exposure to cloud platforms such as Azure , AWS , or GCP . Working knowledge of QA tools like Pytest , Great Expectations , and Deepchecks . Understanding of Node.js and React-based applications is an added advantage. Additional Qualifications: Excellent communication , documentation , and cross-functional collaboration skills. Strong analytical mindset and high attention to detail. Ability to work with cross-disciplinary teams including Engineering, Data Science, and Product. Passion for continuous learning and adoption of new QA tools and methodologies. Domain knowledge in facility management , IoT , or building automation systems is a strong plus.
Posted 1 week ago
4 - 9 years
7 - 17 Lacs
Mumbai
Work from Office
About the Role We're seeking a skilled Python QA Analyst to join our team focused on AI and agentic systems. In this role, you'll ensure the quality and reliability of our AI products while occasionally supporting agentic development during periods of lower QA workload. Key Responsibilities Design, implement and maintain comprehensive test suites for AI and agentic systems Create automated testing frameworks using Python to validate AI model outputs and behaviors Develop test cases that cover edge scenarios and potential failure modes in AI systems Perform thorough regression testing on new releases and feature updates Validate that AI systems meet functional requirements and performance benchmarks Document bugs with clear reproduction steps and expected behaviors Collaborate with AI engineers to understand model architectures and potential weak points Support the development team in troubleshooting and resolving identified issues Assist with agentic development projects during periods of lower QA workload Requirements Experience in software QA, with a focus on Python Strong Python programming skills and experience with testing frameworks (pytest, unittest) Understanding of AI concepts, machine learning workflows, and LLM evaluation techniques Experience testing complex systems with multiple integrations Familiarity with CI/CD pipelines and test automation Knowledge of version control systems (Git) Experience with bug tracking and project management tools Nice to Have Experience with AI-specific testing methodologies and evaluation metrics Understanding of LLM evaluation techniques (including hallucination detection, bias testing) Background in agentic system development or testing Experience with containerization (Docker) and orchestration tools Knowledge of API testing (Postman, requests) Familiarity with prompt engineering and prompt testing methodologies What You'll Do Develop comprehensive test plans for new AI features and systems Build and maintain automated test suites that validate model outputs against expected benchmarks Create specialized tests for agentic behaviors and decision-making processes Collaborate with cross-functional teams to define quality standards and acceptance criteria Participate in code reviews from a quality assurance perspective Contribute to agentic development projects when QA workload allows Help establish testing best practices for AI and agentic systems This position offers the opportunity to work at the cutting edge of AI quality assurance while developing skills in agentic system development. Join us in building reliable, high-quality AI products that our customers can trust.
Posted 2 months ago
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Accenture
39581 Jobs | Dublin
Wipro
19070 Jobs | Bengaluru
Accenture in India
14409 Jobs | Dublin 2
EY
14248 Jobs | London
Uplers
10536 Jobs | Ahmedabad
Amazon
10262 Jobs | Seattle,WA
IBM
9120 Jobs | Armonk
Oracle
8925 Jobs | Redwood City
Capgemini
7500 Jobs | Paris,France
Virtusa
7132 Jobs | Southborough