LLMOps Engineer

Xoriant

8 - 12 years

35 - 40 Lacs

Pune Bengaluru Mumbai (All Areas)

Posted:4 hours ago| Platform:

Apply

Skills Required

LLM ops Langfuse AWS

Work Mode

Hybrid

Job Type

Full Time

Job Description

Required Qualifications

8+ years of experience in DevOps, SRE, or similar roles, with at least 1 year specifically working with LLMs or AI systems in production
Strong hands-on experience with AWS cloud services, particularly Bedrock, Lambda, SQS, API Gateway, OpenSearch, and CloudWatch
Experience with infrastructure-as-code using Terraform, CloudFormation, or similar tools
Proficiency in Python and experience building automation tooling and pipelines
Familiarity with LangOps platforms such as Langfuse for LLM observability and evaluation
Experience with CI/CD pipelines
Knowledge of logging, monitoring, and alerting systems
Understanding of security best practices for AI systems, including prompt injection mitigation techniques
Excellent troubleshooting and problem-solving skills
Strong communication skills and ability to work effectively with cross-functional teams
Must be legally entitled to work in the country where the role is located

Preferred Qualifications

Experience with prompt engineering and testing tools like Promptfoo
Familiarity with vector databases and retrieval-augmented generation (RAG) systems
Knowledge of serverless architectures and event-driven systems
Experience with AWS Guardrails for LLM security
Background in data engineering or machine learning operations
Understanding of financial systems and data security requirements in the finance industry
Familiarity with implementing technical solutions to meet compliance requirements outlined in SOC2, ISAE 3402, and ISO 27001

More Jobs at Xoriant

Python Software Developer - Linux

Bengaluru

5 - 10 yrs

INR 9 - 19 Lacs

Tech Lead/Architect With Maplelabs ( A Xoriant Company)

Bengaluru

10 - 20 yrs

INR 15 - 22 Lacs

Xoriant Hiring Big data hiring

Pune

5 - 9 yrs

INR 20 - 27 Lacs

Xoriant Hiring AppOps Engineer

Pune

5 - 7 yrs

INR 20 - 27 Lacs

Software Engineer in Test(SDET)

Pune, Maharashtra, India

5 - 8 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.