HPC Software Optimization Engineer - C++

THE ROLE:

As a Senior Software Developer, you will develop both GPU kernel-level optimization and distributed software efforts for large-scale AI workloads. This is a technical leadership role with direct influence over critical software components in AMD s AI stack. You ll architect and implement optimized compute kernels, guide software teams through the full product lifecycle, and work closely with internal and external partners to deploy scalable, high-performance solutions.

THE PERSON:

We re looking for a highly skilled, deep systems thinker who thrives in complex problem domains involving parallel computing, GPU architecture, and AI model execution. You are confident leading software architecture decisions and know how to translate business goals into robust, optimized software solutions. You re just as comfortable writing performance-critical code as you are guiding agile development teams across product lifecycles. Ideal candidates have a strong balance of low-level programming, distributed systems knowledge, and leadership experience paired with a passion for AI performance at scale.

KEY RESPONSIBILITIES:

• GPU Kernel Optimization

  :

  Develop and optimize GPU kernels to accelerate inference and training of large machine learning models while ensuring numerical accuracy and runtime efficiency.
• Multi-GPU and Multi-Node Scaling:Architect and implement strategies for distributed training/inference across multi-GPU/multi-node environments using model/data parallelism techniques.
• Performance Profiling:Identify bottlenecks and performance limitations using profiling tools; propose and implement optimizations to improve hardware utilization.
• Parallel Computing

  :

  Design and implement multi-threaded and synchronized compute techniques for scalable execution on modern GPU architectures.
• Benchmarking & Testing:Build robust benchmarking and validation infrastructure to assess performance, reliability, and scalability of deployed software.
• Documentation & Best Practices:Produce technical documentation and share architectural patterns, code optimization tips, and reusable components.

PREFERRED EXPERIENCE:

Software Team Leadership

• Collaboration with customers and business units to define deliverables and roadmaps.
• Interfacing with executive leadership on program progress and strategic planning.
• Experience in production-level software deployment (e.g., upstreaming to open source, commercial rollouts).

Software Architecture

• Deep experience with GPU kernel optimization in

  C++12/17/20

  .
• Working knowledge of frameworks such as

  PyTorch, vLLM, Cutlass, Kokkos

  .
• Practical expertise in CPU/GPU architecture and system-level performance tuning.
• Proficiency in

  Python

  scripting and infrastructure automation.
• Application of software design patterns and industry-standard engineering practices.

GPU & Low-Level Optimization

• Hands-on experience with

  CUDA

  and low-level GPU programming.
• Kernel optimization in

  assembly

  and tight loops for latency-sensitive code.
• Proficiency with performance profiling tools (Nsight, VTune, Perf, etc.).
• Experience with distributed computing strategies in AI environments (multi-GPU, NCCL, MPI).
• Strong debugging, problem-solving, and performance tuning skills in complex systems.

ACADEMIC CREDENTIALS:

• Bachelor s or Master s degree

  in Computer Engineering, Electrical Engineering, Computer Science, or a related technical field.
• Advanced degrees or published work in HPC, GPU computing, or AI systems is a plus.