AI Engineer / Sr. AI Engineer

Key Responsibilities:

• Fine-tune and adapt

  multimodal LLMs

  (Qwen-VL, LLaVA, etc.) for document-understanding tasks.
• Design

  prompt templates

  and instruction sets to improve structured JSON output accuracy.
• Perform full and incremental fine-tuning across multiple datasets for better generalization.
• Develop validation datasets and

  evaluation metrics

  to measure model accuracy and robustness.
• Optimize inference using

  quantization, LoRA adapters, vLLM, Unsloth, and Ray Serve

  .
• Collaborate with backend engineers to integrate VLMs into

  production pipelines

  .
• Build monitoring tools to log

  model confidence scores, token usage, latency, and performance drift

  .
• Work on continuous improvements to enhance model throughput and reduce inference costs.
  

Required Skills & Experience

• Strong Python expertise with hands-on experience in

  PyTorch

  and

  Hugging Face Transformers

  .
• Practical experience with OCR tools such as

  PaddleOCR, Tesseract, EasyOCR

  .
• Hands-on experience fine-tuning or deploying

  LLMs / VLMs

  (Qwen, LLaVA, Mistral, Vicuna, etc.).
• Solid understanding of

  LoRA / QLoRA / PEFT

  for efficient model training.
• Experience with JSON schema generation,

  prompt engineering

  , and structured data extraction.
• Familiarity with

  Unsloth, Ray Serve, vLLM

  for high-performance inference serving.
• Knowledge of

  Docker, CUDA, and GPU-based deployment

  .
• Strong grasp of tokenization, attention mechanisms, and

  4-bit / 8-bit quantization

  .

Nice to Have

• Experience with

  LLM model serving frameworks

  and production deployments.
• Exposure to

  CI/CD pipelines

  and cloud platforms (Azure, AWS, GCP).
• Familiarity with

  PDF parsing tools

  (Camelot, PyMuPDF, pdfplumber).
• Background in

  AI-based document intelligence

  , invoice extraction, or OCR automation systems.

What We Offer

• Opportunity to work on cutting-edge

  Vision-Language AI

  systems.
• Hands-on involvement in

  production-grade OCR + LLM

  workflows.
• Competitive compensation with a flexible and remote-friendly work culture.
• Collaborative environment focused on innovation in

  enterprise document automation

  .

Notice: One month.

Candidates from Kolkata are preferred.