LLM Engineer

Job Title:

Job Type:

Location:

Job Summary:

We are seeking an experienced LLM Engineer to join our team. The successful candidate will have a strong background in developing and fine-tuning large language models (LLMs) using PyTorch. The ideal candidate will be well-versed in various fine-tuning methods, including LoRa, QLora, and PEFT, and have experience with optimization libraries like Unsloth.

Key Responsibilities:

* Design, develop, and deploy large language models (LLMs) using PyTorch

* Fine-tune LLMs using various methods like LoRa, QLora, PEFT, and Quantization

* Optimize LLM performance using libraries like Unsloth and vLLM

* Collaborate with cross-functional teams to integrate LLMs into products and services

Requirements:

Education:

Core Skills:

+ 3+ years of experience in developing and fine-tuning LLMs using PyTorch

+ Strong understanding of deep learning concepts and architectures

+ Experience with fine-tuning methods like LoRa, QLora, PEFT, and Quantization

+ Familiarity with optimization libraries like Unsloth and vLLM

Extra Related Skills:

+ Experience with open-source deep learning libraries

+ Knowledge of model quantization and deployment strategies

+ Familiarity with containerization using Docker

Nice to Have:

* Experience with other deep learning frameworks

* Knowledge of transfer learning and domain adaptation techniques

* Familiarity with model interpretability and explainability techniques