Associate III - Semiconductor S/W Product Development

As an LLM Engineer focusing on On-Prem Deployment & Domain Tuning with a semiconductor background at UST, your role involves the following key responsibilities: - Hands-on deployment of open-source LLMs like LLaMA, Mistral, SemiKong using tools such as Ollama, vLLM, or containerized stacks on GPU-based on-prem infrastructure. - Strong expertise in building Retrieval-Augmented Generation (RAG) pipelines using vector databases (e.g., FAISS, Qdrant, Weaviate) integrated with tools like LangChain or LlamaIndex. - Proficiency in model fine-tuning methods such as LoRA/QLoRA, HuggingFace Transformers, PEFT, and DeepSpeed for instruction tuning or full fine-tuning. - Experience in collecting, curating, cleaning, and annotating domain-specific datasets for supervised fine-tuning, including document chunking, prompt engineering, and data formatting. - Ability to benchmark multiple LLMs like SemiKong, Falcon, MPT, and evaluate their performance on tasks such as Q&A, summarization, and domain comprehension. - Working familiarity with semiconductor industry terminology, documents, and workflows is highly desirable. - Solid understanding of CUDA, PyTorch, model parallelism, and performance optimization on multi-GPU environments. Proficiency in Python, Git, and containerization (Docker). Desired Skills: - Experience with Kubernetes or MLOps is a bonus. Qualifications: - BTech in Computer Science. - 3 to 6 years of experience in ML/NLP/LLM engineering, with at least 1 to 2 years of hands-on experience with LLMs in deployment, tuning, and RAG implementation. - Experience in building custom LLM/SLM solutions using open-source models, especially in resource-constrained or secure/on-prem environments. Additionally, UST values humility, humanity, and integrity, aiming to listen, learn, be empathetic, help selflessly, and better the lives of those less fortunate. As UST may periodically redefine roles and responsibilities based on organizational requirements or performance, compliance with company policies and procedures is essential to support and promote UST's core values of innovation, diversity, and inclusion.,