Jobs
Interviews
Infosys logo

AI / LLM Engineer

10 years

Pune

Posted:5 hours ago

Apply

Job Description

Job Description:
  • As an AI LLM Engineer you will build the AI enabled capabilities that support summaries narratives explanations recommendations retrieval evaluation and governed human review experiences across an enterprise platform
  • You will work closely with architects product teams data engineers backend engineers security QA and domain specialists to convert AI patterns into production ready software components

Key Responsibilities:
  • Design and implement LLM powered workflows for summarization narrative generation classification extraction contextual reasoning explanation and reviewer assist use cases
  • Build retrieval augmented generation pipelines including document ingestion chunking embedding generation metadata tagging vector indexing retrieval tuning and grounded response generation
  • Develop reusable prompt templates prompt versions context builders response schemas evaluation routines and AI orchestration services
  • Integrate with enterprise AI services such as Azure OpenAI Azure AI Foundry OpenAI APIs Google Gemini Anthropic Hugging Face or equivalent approved platforms
  • Implement AI run logging prompt model metadata capture evidence citations output traceability reviewer feedback capture and human in the loop controls
  • Build AI evaluation routines for answer quality retrieval quality hallucination checks regression testing consistency and groundedness
  • Collaborate with backend and DevOps teams to containerize AI services deploy them securely monitor usage track costs and troubleshoot production issues
  • Support responsible AI practices such as prompt injection checks data leakage prevention policy based guardrails and AI output validation

Technical Requirements:
  • Minimum 10 years of experience in software engineering AI ML engineering applied ML data science engineering or related roles
  • Strong hands on Python programming experience and practical exposure to LLM based application development
  • Experience with RAG vector databases embeddings prompt engineering evaluation frameworks and AI service integration
  • Experience with frameworks such as LangChain LangGraph LlamaIndex Semantic Kernel AutoGen CrewAI or equivalent tools
  • Working knowledge of REST APIs microservices SQL structured data concepts Git workflows testing and software engineering practices
  • Understanding of document extraction semantic search NLP retrieval quality hallucination risk prompt safety and AI evaluation methods
  • Ability to build production oriented AI components rather than isolated proof of concept demos

Additional Responsibilities:
  • Experience with Azure OpenAI Azure AI Foundry Azure AI Search Azure Document Intelligence Google AI Studio Gemini AWS Bedrock or Vertex AI
  • Exposure to RAG evaluation tools such as RAGAS DeepEval Promptfoo LangSmith or equivalent frameworks
  • Experience with AI governance prompt model registry AI audit logs explainability groundedness checks and human review workflows

Preferred Skills: Technology->AI-Agentic AI->Agent Engineering,Technology->AI-AI Engineering->AI/ML Solution Architecture and Design->traditional ai ml,Technology->AI-Data science->AI-Data science,Technology->AI-Machine Learning->ML Platform,Technology->AI-Machine Learning->Responsible AI

Skills Required

Backend USE Cases Azure Regression Testing Devops Software Engineering Ai/ml Data Science Python Application Development Rest Apis Microservices

Learn the skills this job asks for

See your skill gap for Machine Learning Engineer →

Free courses, interview questions and practice for each skill.

More Jobs at Infosys

Qlik Sense Developer

Hyderabad

Experience: Not specified

|

Salary: Not disclosed

Site Reliability Engineer

Hyderabad

Experience: Not specified

|

Salary: Not disclosed

SRE - Agentic FDE & Automation

Hyderabad

Experience: Not specified

|

Salary: Not disclosed

Spark Developer

Bengaluru

Experience: Not specified

|

Salary: Not disclosed

Spark Developer

Bengaluru

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You

Infosys logo

AI / LLM Engineer

Infosys

Pune

Infosys logo

AI / LLM Engineer

Infosys

Pune