LLM Engineer

0 - 3 years

3 - 6 Lacs

Posted:13 hours ago| Platform: Foundit logo

Apply

Skills Required

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities:

  • Design and implement LLM-based features across Qure's products, including clinician-facing assistants and automated diagnostic flows.
  • Build internal tools, APIs, and developer-facing utilities to enable scalable LLM integrations.
  • Collaborate with prompt engineers to design modular, composable workflows (e.g., RAG, chaining, structured prompting).
  • Evaluate model performance and behavior across tasks using human feedback and automated metrics.
  • Optimize latency, cost, and reliability of LLM systems using caching, batching, and fallback strategies.
  • Deploy and monitor LLM services in production, integrating observability and usage analytics.
  • Build systems for prompt versioning, LLM configurations, and multi-model experimentation.
  • Lead cross-functional initiatives and drive end-to-end project execution across engineering, product, and clinical teams.
  • Contribute to internal LLM guidelines, safety practices, and developer enablement.
  • Foster a culture of collaboration, ownership, and technical excellence in building impactful LLM-driven solutions.

Required Skills & Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Solid understanding of LLM architectures, inference workflows, context management, and prompt patterns.
  • Strong programming skills in Python; familiarity with frameworks like LangChain, Haystack, or Pydantic AI.
  • Experience integrating OpenAI, Anthropic, or open-source models into production systems.
  • Familiarity with emerging LLM protocols (e.g., MCP) and frameworks enabling agentic behaviors (autonomous agents, task decomposition, memory systems).
  • Proven ability to work across infrastructure, product, and research teams.
  • Comfort with cloud platforms (AWS/GCP), containerized deployments (Docker/K8s), and observability tools.
  • Strong understanding of LLM guardrails to ensure responsible, safe, and reliable production usage.
  • Strong problem-solving, communication, and cross-functional collaboration skills.

Preferred Skills:

  • Experience in the healthcare industry, with understanding of compliance and security requirements.
  • Experience building user-facing tools or assistants powered by LLMs.
  • Strong sense of ownership and ability to balance experimentation with production readiness.
  • Familiarity with agile methodologies and project management practices.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

bengaluru, karnataka, india

visakhapatnam, hyderabad

noida, uttar pradesh, india

noida, uttar pradesh, india