refresh

Trending Companies

Trending

Jobs

JobsAMD

AI Training Optimization Engineer

AMD

AI Training Optimization Engineer

AMD

Beijing

·

On-site

·

Full-time

·

1mo ago

Benefits & Perks

Learning and development stipend

Flexible PTO policy

Parental leave program

Wellness benefits

Required Skills

TensorFlow

SQL

Python

WHAT YOU DO AT AMD CHANGES EVERYTHING:

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.THE ROLE: As part of AMD’s Training Optimization Team, you will help customers train AI models seamlessly and efficiently on AMD GPUs. You will identify and fill gaps in AMD’s training ecosystem, optimize critical kernels, and leverage frontier techniques to push the limits of training performance on large-scale systems.

You will also contribute to the development of kernel agents—tools that accelerate kernel iteration and ultimately assist humans in achieving extreme GPU performance.

THE PERSON: You are a strong GPU performance engineer with a solid understanding ofalgorithms, model architectures, and kernel implementations. You can move fluidly from mathematical concepts to low-level optimization, and you excel in diagnosing real training bottlenecks. You are comfortable working directly with customers and collaborating across internal teams.

**KEY RESPONSIBILITIES:**1.Support Customers: Ensure smooth training on AMD GPUs by identifying bottlenecks and delivering kernel-level performance improvements.
2. Optimize Hot Operators: Design and optimize kernels using HIP, CUDA, and Triton across real training workloads.
3. Advance Kernel Agents: Improve agent-based tooling to speed up kernel development and help achieve peak performance.
4. Strengthen AMD’s Training Ecosystem: Fill functional gaps, improve framework integration, and enhance ROCm-based training performance.
5. Explore Frontier Kernel Techniques: Prototype next-generation kernels (e.g., sparse attention, linear attention ops).
6. Collaborate Across Teams: Work with GPU library teams, runtime/communication teams, and open-source maintainers to drive upstream improvements.
7. Optimize Distributed Training: Improve performance across multi-GPU and multi-node clusters through better comm/compute overlap and parallelism strategies.

**PREFERRED EXPERIENCE:**1. Hands-on experience withHIP, CUDA, Triton, and GPU performance tuning.
2. Strong understanding of Transformer models, attention mechanisms, and training algorithms.
3. Experience profiling and optimizing kernels with low-level tools.
4. Familiarity with Py Torch internals, Megatron-LM, Deep Speed, or other large-training frameworks.
5. Experience debugging or optimizing distributed training (DP/TP/PP/ZeRO).
6. Experience building or optimizing kernel agents, runtime schedulers, or performance-automation tools.
7. Contributions to kernel libraries (CUTLASS, CK), Triton, or ML compiler ecosystems.

ACADEMIC CREDENTIALS:

  • Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

Benefits offered are described:  AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.  AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Total Views

0

Apply Clicks

0

Mock Applicants

0

Scraps

0

About AMD

AMD

AMD

Public

A semiconductor company that designs and develops graphics units, processors, and media solutions

10,001+

Employees

Santa Clara

Headquarters

Reviews

3.5

25 reviews

Work Life Balance

3.2

Compensation

4.1

Culture

3.6

Career

3.4

Management

3.1

65%

Recommend to a Friend

Pros

Good compensation and benefits

Positive work environment

Great management and coworkers

Cons

Poor work life balance

Micromanagement and excessive tracking

Too much pressure and workload

Salary Ranges

6 data points

L2

L3

L4

L5

L6

M3

M4

M5

M6

L2 · Data Scientist L2

0 reports

$104,000

total / year

Base

$41,600

Stock

$52,000

Bonus

$10,400

$72,800

$135,200

Interview Experience

5 interviews

Difficulty

3.6

/ 5

Duration

14-28 weeks

Offer Rate

60%

Experience

Positive 20%

Neutral 20%

Negative 60%

Interview Process

1

Application Review

2

Recruiter Screen

3

Technical Phone Screen

4

Technical Interview

5

Hiring Manager Interview

6

Offer

Common Questions

Coding/Algorithm

Technical Knowledge

Behavioral/STAR

Past Experience

System Design