General Summary: As a Staff Engineer for ML Test and Automation Staff Engineer, highly skilled and knowledgeable in Testing ML/DL models to benchmark Qualcomm AI Accelerator. Being upto to date on the State of Art market trends and proactively working for understanding the customer needs to identify the right sets of tools/metrics to achieve the best quality and customer experience. Basic Qualifications: Masters or Bachelors degree in Computer science , Machine learning/AI or related field experience 11 + years relevant work experience Strong knowledge in ML/DL/LLMs in Test Strong in Python programming and good problem solving skills Preferred Qualifications: Excellent programming skills in one or more programming languages (Python, Bash) Ability to define and recommend System test methodologies , metrics to benchmark Qualcomm AI Accelerator Hands-on experience in benchmarking and optimizing Deep Learning Models on AI Accelerators/GPUs Good work experience with AI frameworks models performance, quantization, and accuracy metrics Hands-on experience in API testing & developing automation scripts for Embedded/IOT Platforms Responsibilities: Performance and Accuracy benchmarking of Deep Learning models (LLM,OD, CV, NLP, Transformers etc.) Understanding how all elements of the ML software ecosystem work together and developing QA approaches/frameworks that fit the overall strategy. Providing System test recommendations for AI Inference Accelerator Cards Responsible for development of validation strategies and creation of appropriate ML test harnesses for AI Inference Accelerator Cards Experience in bringing up embedded platforms for customers and internal engg releases. Strong debugging and analysis skills, for root causing complex issues Providing test infrastructure to enable engineering teams to test and deliver functional/performance metrics for language models. Ensure ML features are planned, validated, and automated as per release and customer requirements. Strong hands-on automation skills to enable onboarding of automated features into the test framework. Minimum Qualifications: Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Test Engineering or related work experience. OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Test Engineering or related work experience. OR PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Test Engineering or related work experience. 2+ year of work experience with Software Test or System Test, developing and automating test plans, and/or tools (e.g., Source Code Control Systems, Continuous Integration Tools, and Bug Tracking Tools).
