FlyByHire.ai

Job Title: LLM Engineer Job Type: Full-time Location: Remote Job Summary: We are seeking an experienced LLM Engineer to join our team. The successful candidate will have a strong background in developing and fine-tuning large language models (LLMs) using PyTorch. The ideal candidate will be well-versed in various fine-tuning methods, including LoRa, QLora, and PEFT, and have experience with optimization libraries like Unsloth. Key Responsibilities: * Design, develop, and deploy large language models (LLMs) using PyTorch * Fine-tune LLMs using various methods like LoRa, QLora, PEFT, and Quantization * Optimize LLM performance using libraries like Unsloth and vLLM * Collaborate with cross-functional teams to integrate LLMs into products and services Requirements: * Education: Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field * Core Skills: + 3+ years of experience in developing and fine-tuning LLMs using PyTorch + Strong understanding of deep learning concepts and architectures + Experience with fine-tuning methods like LoRa, QLora, PEFT, and Quantization + Familiarity with optimization libraries like Unsloth and vLLM * Extra Related Skills: + Experience with open-source deep learning libraries + Knowledge of model quantization and deployment strategies + Familiarity with containerization using Docker Nice to Have: * Experience with other deep learning frameworks * Knowledge of transfer learning and domain adaptation techniques * Familiarity with model interpretability and explainability techniques