1 Inference Routing Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

Constient Global Solutions logo
LLM Systems Engineer Constient Global Solutions

5.0 - 9.0 years

0 Lacs

chennai, all india

On-site

As an engineer in this role, you will be responsible for building and optimizing high-throughput, low-latency LLM inference infrastructure using open-source models such as Qwen, LLaMA, and Mixtral on multi-GPU systems like A100/H100. Your ownership will include performance tuning, model hosting, routing logic, speculative decoding, and cost-efficiency tooling. Key Responsibilities: - Deep experience with vLLM, tensor/pipe parallelism, and KV cache management - Strong grasp of CUDA-level inference bottlenecks, FlashAttention2, and quantization - Familiarity with FP8, INT4, and speculative decoding (e.g., TwinPilots, PowerInfer) - Proven ability to scale LLMs across multi-GPU nodes using TP, D...

Posted 3 days ago

AI Match Score
Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store

Featured Companies

View All Companies