Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in bengaluru
>
Glance
>
SDE III - GPU Engineer

SDE III - GPU Engineer

Name: Jobpe
Address: T-Hub, Plot No 1/C, Sy No 83/1, Raidurgam panmaktha, Knowledge City Rd, Hyderabad, Telangana, 500081, IN
Telephone: +91-83339-09630
Price range: Free

Glance

4 - 9 years

37 - 45 Lacs

bengaluru

Posted:4 weeks ago| Platform:

Apply

Skills Required

telecom accessories c++ manager technology e-commerce scheduling performance analysis research open source python

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a

Senior Software Engineer (SDE III)

who will build, profile, and optimize GPU workloads powering next-generation generative AI experiences from

Stable Diffusion

image generation to transformer-based multimodal models. you'll work closely with research and infrastructure teams to make model inference faster, more cost-efficient, and production-ready.

This role is ideal for engineers passionate about

pushing GPUs to their limits

, writing high-performance kernels, and turning cutting-edge research into scalable systems.

Key Responsibilities

Develop, optimize, and maintain
GPU kernels
(CUDA, Triton, ROCm) for diffusion, attention, and convolution operators.
Profile end-to-end inference pipelines (data movement, kernel scheduling, memory transfers) to identify and resolve bottlenecks.
Apply techniques like
operator fusion, tiling, caching, and mixed-precision compute
to maximize GPU throughput.
Collaborate with researchers to productionize experimental layers or model architectures.
Build
benchmarking tools
and micro-tests for latency, memory, and throughput regressions.
Integrate kernel improvements into serving stacks, ensuring
reliability and repeatable performance
.
Work with platform teams to tune runtime configurations and job scheduling for GPU utilization.

Required Qualifications

4+ years of experience in systems or ML engineering, with 2+ years working on
GPU or accelerator optimization
.
Strong hands-on skills with
CUDA programming
, memory hierarchies, warps, threads, and shared memory.
Familiarity with profiling tools (Nsight, nvprof, CUPTI) and performance analysis.
Working knowledge of PyTorch, JAX, or TensorFlow internals.
Proficiency in
C++
and
Python
.
Experience with
mixed precision
, FP16/BF16, or quantization.
Deep curiosity about system bottlenecks and numerical correctness.

Preferred Qualifications

Experience building fused operators or integrating custom kernels with PyTorch extensions.
Understanding of NCCL / distributed inference frameworks.
Contributions to open-source GPU or compiler projects (Triton, TVM, XLA, TensorRT).
Familiarity with multi-GPU / multi-node training and inference setups.

More Jobs at Glance

Lead - Executive Assistant

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru

10.0 - 15.0 yrs

INR 35 - 40 Lacs

Senior Associate - Executive Assistant

Bengaluru

10.0 - 15.0 yrs

INR 35 - 40 Lacs

Senior Manager - Programmatic Monetization

Bengaluru

6.0 - 10.0 yrs

INR 8 - 12 Lacs

Staff Engineer - Machine Learning

Bengaluru

10.0 - 15.0 yrs

INR 12 - 17 Lacs

Machine Learning Engineer III -Recommendations

Bengaluru

5.0 - 10.0 yrs

INR 40 - 45 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Glance

Technology, Mobile Advertising

N/A

Before You Leave... Find Your Perfect Job!

Login to

Please Verify Your Phone or Email

Confirm Action

Contact Us

SDE III - GPU Engineer

Experience & Salary

Skills Required

Work Mode

Job Type

Job Description

Senior Software Engineer (SDE III)

Stable Diffusion

pushing GPUs to their limits

Key Responsibilities

GPU kernels

operator fusion, tiling, caching, and mixed-precision compute

benchmarking tools

reliability and repeatable performance

Required Qualifications

GPU or accelerator optimization

CUDA programming

C++

Python

mixed precision

Preferred Qualifications

More Jobs at Glance