Senior AI/ML Engineer

The Senior AI/ML Engineer will lead the development, fine-tuning, and optimization of advanced multimodal AI systems involving OCR and Vision-Language Models. The role requires strong hands-on technical expertise and the ability to build production-ready, scalable AI pipelines.

Core Responsibilities:

• Fine-tune and adapt multimodal LLMs (e.g., Qwen-VL, LLaVA, Mistral-based VLMs) for domain-specific document understanding.
• Design prompt templates, instruction sets, and output structures to improve JSON-formatted extraction quality.
• Perform full-scale fine-tuning, incremental learning, and cross-dataset training to ensure robust model generalization.
• Create evaluation metrics, validation datasets, and accuracy benchmarking reports.
• Optimize inference efficiency using

  quantization, LoRA, QLoRA, PEFT adapters

  , and frameworks like

  Ray Serve, vLLM, Unsloth

  .
• Integrate AI models into production systems in collaboration with backend engineers.
• Build monitoring utilities for inference latency, token usage, model confidence scores, and pipeline performance.
  

Required Skill Set

Technical Skills (Mandatory):

• Strong Python programming expertise.
• Experience with

  PyTorch

  and

  Hugging Face Transformers

  .
• Hands-on experience with OCR tools:

  PaddleOCR, Tesseract, EasyOCR

  .
• Experience fine-tuning or serving

  LLMs / VLMs

  such as Qwen, LLaVA, Mistral, Vicuna, etc.
• Knowledge of

  LoRA, QLoRA, PEFT

  for efficient model training.
• Expertise in JSON schema generation, prompt engineering & structured data extraction.
• Experience with

  vLLM, Unsloth, Ray Serve

  for high-throughput inference.
• Strong understanding of

  tokenization, attention mechanisms, quantization (4-bit/8-bit)

  .
• Experience deploying models using

  Docker, CUDA, NVIDIA GPU environments

  .

Nice to Have:

• Experience with LLM-specific model serving and optimization.
• Exposure to

  CI/CD

  pipelines, Cloud environments (Azure / AWS / GCP).
• Familiarity with

  PDF parsing

  libraries (Camelot, PyMuPDF, PDFPlumber).
• Previous experience in

  Document AI

  , automated invoice extraction, OCR+LLM pipelines.

Desired Candidate Profile

• 6+ years of experience as an AI/ML Engineer or Deep Learning Specialist.
• Ability to work independently and deliver production-quality ML pipelines.
• Strong problem-solving, debugging, and research-oriented mindset.
• Capability to work in fast-paced, distributed/remote environments with tight timelines.

Notice: One month.

Candidates from Kolkata are preferred.