Job
Description
As a Software Engineer or SDET at Mindtickle, you will have the exciting opportunity to design, build, and maintain scalable automation frameworks to ensure consistent product quality. You will be responsible for developing comprehensive automated test suites, improving CI/CD pipelines, and building scalable testing systems for reliable and repeatable releases. Your role will involve working on test automation frameworks to qualify AI-driven features, testing LLM-powered features, and maintaining evaluation frameworks to measure quality and accuracy. Key Responsibilities: - Design, build, and maintain scalable automation frameworks for project qualification pre- and post-release - Develop comprehensive automated test suites and improve CI/CD pipelines - Build scalable testing systems, generate test data, and ensure ongoing quality through automated regression and synthetic monitoring - Work on test automation frameworks to qualify AI-driven features and LLM-powered features - Develop and maintain evaluation frameworks to measure quality, accuracy, relevance, bias, and hallucination rates - Conduct robustness, safety, and adversarial testing for AI systems - Improve quality engineering aspects and Developer Experience (DevEx) - Collaborate closely with developers and product managers to ensure exceptional reliability and performance Qualifications Required: - 2+ years of experience as a Software Engineer or SDET - Proficiency in Go, Java, or Python - Hands-on experience with LLM APIs and pipelines - Experience integrating automation into CI/CD pipelines - Strong skills in API testing, version control, and containerization - Familiarity with cloud platforms - Clear communication and collaboration skills - Experience in prompt engineering, embeddings, RAG, and LLM evaluation metrics preferred Preferred Qualifications: - Bachelor's degree in Computer Science, Engineering, or related field - Familiarity with LLMs and GenAI concepts - Experience with LLM testing tools - Experience in evaluating AI systems for bias, fairness, and AI safety principles - Strong analytical mindset and structured problem-solving approach Please note that the company details were not explicitly mentioned in the job description. As a Software Engineer or SDET at Mindtickle, you will have the exciting opportunity to design, build, and maintain scalable automation frameworks to ensure consistent product quality. You will be responsible for developing comprehensive automated test suites, improving CI/CD pipelines, and building scalable testing systems for reliable and repeatable releases. Your role will involve working on test automation frameworks to qualify AI-driven features, testing LLM-powered features, and maintaining evaluation frameworks to measure quality and accuracy. Key Responsibilities: - Design, build, and maintain scalable automation frameworks for project qualification pre- and post-release - Develop comprehensive automated test suites and improve CI/CD pipelines - Build scalable testing systems, generate test data, and ensure ongoing quality through automated regression and synthetic monitoring - Work on test automation frameworks to qualify AI-driven features and LLM-powered features - Develop and maintain evaluation frameworks to measure quality, accuracy, relevance, bias, and hallucination rates - Conduct robustness, safety, and adversarial testing for AI systems - Improve quality engineering aspects and Developer Experience (DevEx) - Collaborate closely with developers and product managers to ensure exceptional reliability and performance Qualifications Required: - 2+ years of experience as a Software Engineer or SDET - Proficiency in Go, Java, or Python - Hands-on experience with LLM APIs and pipelines - Experience integrating automation into CI/CD pipelines - Strong skills in API testing, version control, and containerization - Familiarity with cloud platforms - Clear communication and collaboration skills - Experience in prompt engineering, embeddings, RAG, and LLM evaluation metrics preferred Preferred Qualifications: - Bachelor's degree in Computer Science, Engineering, or related field - Familiarity with LLMs and GenAI concepts - Experience with LLM testing tools - Experience in evaluating AI systems for bias, fairness, and AI safety principles - Strong analytical mindset and structured problem-solving approach Please note that the company details were not explicitly mentioned in the job description.
