4 Llm Infrastructure Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

10.0 - 12.0 years

0 Lacs

bengaluru, karnataka, india

On-site

We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. What You'll Do Lead and inspire a high-performing engineering team delivering backend systems, APIs, databases, and LLM infrastructure. Define and communicate the technical vision, ensuring alignment w...

Posted 3 days ago

AI Match Score
Apply

6.0 - 10.0 years

35 - 65 Lacs

bengaluru

Hybrid

Key Responsibilities 1. LLM Infrastructure, Deployment & Runtime Design, deploy, and operate open-source LLMs (e.g., Llama, DeepSeek, Mistral, etc.) on cloud (AWS/Azure/GCP/Oracle) and on-prem infrastructure. Build and maintain high-performance inference microservices and APIs for LLM workloads (REST/gRPC, gateway, auth, RBAC, rate limiting). Implement efficient runtime optimizations : quantization, tensor parallelism, batching, caching, and appropriate serving frameworks (e.g., vLLM, TGI, TensorRT-LLM, Ray Serve, etc.). Ensure secure network, storage, and data paths , aligned with enterprise requirements (VPCs, private links, firewalls, secrets management). 2. SRE, Reliability & Operations ...

Posted 1 month ago

AI Match Score
Apply

4.0 - 6.0 years

0 Lacs

Bengaluru, Karnataka, India

Remote

Get To Know Us First! Who We Are At interface.ai, were redefining the future of banking with AI. Our cutting-edge Generative AI-powered platform serves over 100 banks and credit unions, delivering hyper-personalized customer interactions across voice, chat, and employee-assisting solutions. Our mission : To make banking effortless, intelligent, and profitableenhancing user experience while boosting revenue and efficiency for financial institutions. Were not just another AI company. Our proprietary AI, built 100% in-house, is designed for zero-shot learning, achieving 90%+ accuracy on Day 1. With a world-class team from Microsoft, ISB, and IIMs, and a 1,800% growth rate in the last year, were...

Posted 4 months ago

AI Match Score
Apply

3.0 - 7.0 years

0 Lacs

chennai, tamil nadu

On-site

As a Transformation Engineering professional at Talworx, you will be expected to meet the following requirements: A Bachelor's degree in Computer Science, Information Systems, or a related field is preferred. You should have at least 5 years of experience in application development, deployment, and support. Your expertise should encompass a wide range of technologies including Java, JEE, JSP, Spring, Spring Boot (Microservices), Spring JPA, REST, JSON, Junit, React, Python, Javascript, HTML, and XML. Additionally, you should have a minimum of 3 years of experience in a Platform/Application Engineering role supporting on-premises and Cloud-based deployments, with a preference for Azure. While...

Posted 4 months ago

AI Match Score
Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies