Cloud Machine Learning LLM Serving Staff engineer

As a Cloud Machine Learning LLM Serving Staff Engineer at Qualcomm India Private Limited, you will be part of the Cloud Computing team developing hardware and software for Machine Learning solutions across various markets. You will be involved in analyzing software requirements, designing software solutions for Qualcomm's SOCs, identifying system level issues, and leading high performing teams towards system design and deliverables. Key Responsibilities: - Analyze software requirements, consult with architecture and HW engineers, and implement software solutions for Qualcomm's SOCs. - Identify system level issues, interface with software development, integration, and test teams. - Lead high performing teams in Machine Learning software engineering. - Utilize mathematical modeling and state-of-the-art algorithms in the ML/AI space. - Optimize Deep Learning models on Qualcomm AI 100 and build framework extensions for Qualcomm AI 100. - Collaborate with internal teams to optimize training and inference for deep learning. - Develop software tools and ecosystem around AI SW Stack. - Work on building abstraction layers for inference accelerator. - Optimize workloads for scale-up and scale-out systems. - Apply software engineering best practices. Desirable Skills and Aptitudes: - Deep Learning experience in LLMs, Natural Language Processing, Vision, Audio, Recommendation systems. - Knowledge of Pytorch, TensorFlow software stacks. - Proficiency in C/C++/Python programming and software design. - Ability to work independently and lead your own development effort. - Strong developer with a research mindset and problem-solving skills. - Knowledge of tiling and scheduling a Machine learning operator. - Experience in using C++ 14, profiling software, and optimization techniques. - Hands-on experience with CUDA, CUDNN is a plus. Qualifications: - Bachelor's / Masters/ PHD degree in Engineering, Machine learning/AI, Information Systems, Computer Science, or related field. - 8+ years of Software Engineering or related work experience. - Experience with Programming languages such as C++, Python. Minimum Qualifications: - Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering experience. OR - Master's degree and 3+ years of Software Engineering experience. OR - PhD and 2+ years of Software Engineering experience. - 2+ years of experience with Programming languages such as C, C++, Java, Python. Qualcomm is an equal opportunity employer and is committed to providing accessible processes for individuals with disabilities. For more information about this role, please contact Qualcomm Careers.,