NVIDIA is developing processor and system architectures that accelerate machine learning, automotive and high performance computing applications. We are seeking a strong candidate to do performance analysis and kernels development for NVIDIA's new architectures. Your work will play a critical role in shaping the future of deep learning hardware and software, ensuring optimal performance for next-generation AI applications.  This position offers the opportunity to make a meaningful impact in a fast-moving, technology focused company.

What you'll be doing:

• Design, develop, and optimize major layers in LLM (e.g attention, GEMM, inter-GPU communication) for NVIDIA's new architectures.

• Implement and fine-tune kernels to achieve optimal performance on NVIDIA GPUs.

• Conduct in-depth performance analysis of GPU kernels, including Attention and other critical operations.

• Identify bottlenecks, optimize resource utilization, and improve throughput, and power efficiency

• Create and maintain workloads and micro-benchmark suites to evaluate kernel performance across various hardware and software configurations.

• Generate performance projections, comparisons, and detailed analysis reports for internal and external stakeholders.

• Collaborate with architecture, software, and product teams to guide the development of next-generation deep learning hardware and software.

What we need to see:

• Pursuing BS, MS or PhD in relevant discipline (CS, EE, CE).

• Strong software skills with C/C++, Python, MPI, OpenMP etc.

• Solid computer science (CS) SW & HW arch background.

• Experience of DL workload and operator performance will be a plus.

• Familiarity with GPU computing and parallel programming models will be a plus.

• Excellent oral and written communication skills.

• Good organizational, time management and task prioritization skills.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning