Back

ROCm AI System Software Architect

JOB_DESCRIPTION.SHARE.HTML
CAROUSEL_PARAGRAPH

• JOB_DESCRIPTION.SHARE.HTML
• MARKHAM, Canada
• Engineering
• 77876
• CAD $183,600.00/Yr.
• CAD $275,400.00/Yr.

mail_outline
Get future jobs matching this search
Loginor Register

Job Description

WHAT YOU DO AT AMD CHANGES EVERYTHING:

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

THE PERSON

You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C/C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers.

THE ROLE:

We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging/profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions.

KEY RESPONSIBILITIES:

• Develop and deliver advanced AI software solutions for AMD customers and users.
• Enable and optimize the AI software stack for frameworks like Py Torch, vLLM, and GGML/llama.cpp, as well as emerging open-source AI software.
• Implement state-of-the-art AI models and enhance their performance.
• Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement.
• Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows

PREFERRED EXPERIENCE:

• Expertise in system software design and optimization, with experience on cross-platform development and programming languages C/C++ and Python.
• Proven problem-solving skills and effective communication abilities.
• Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators.
• Compiler and low-level GPU programming is a plus.
• Solid understanding of AI/ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations.
• Open-source software development experience is a plus.

ACADEMIC CREDENTIALS

• Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.
Apply JOB_DESCRIPTION.SHARE.HTML
CAROUSEL_PARAGRAPH
JOB_DESCRIPTION.SHARE.HTML