
Pioneering accelerated computing and AI
Senior Software AI Engineer, LLM Solutions
Our System Design Automation team is looking for an AI Engineer with solid software skills to join our engineering group.The team develops and sustains a range of tools and capabilities for NVIDIA's current and next-generation hardware platforms — including LLM-powered automation and intelligent debugging solutions, alongside traditional software engineering tools.Our work accelerates issue resolution, improves product reliability, and powers the world's most advanced GPU and data center technologies.NVIDIA's Hardware Networking division is a global leader in end-to-end accelerated computing and connectivity for high-performance data centers — spanning GPUs, networking platforms, and AI software across cloud, HPC, autonomous vehicles, and media & entertainment.
What You'll Be Doing:
-
Develop and support software tools across the engineering stack — from data processing and backend services to user-facing interfaces
-
Build and maintain data pipelines and ETL flows for logs, telemetry, and hardware test data supporting AI/ML workflows
-
Prepare, clean, and structure large, complex datasets (structured & unstructured) for LLM training and fine-tuning
-
Develop and deploy LLM-based applications for root cause analysis and hardware debugging
-
Design and implement agentic workflows — multi-step, tool-using AI agents capable of autonomous reasoning and action
-
Experiment with prompt engineering, RAG, and vector search to integrate domain knowledge into models
-
Collaborate with hardware, reliability, and AI platform teams to embed intelligent tools into NVIDIA's engineering ecosystem
What We Need to See:
-
B.Sc. or M.Sc. in Computer Science, Electrical/Computer Engineering, Data Science, or equivalent practical experience
-
5+ years of experience in software engineering with AI/ML or a related field
-
Strong Python skills (pandas, Num Py, Py Torch or Tensor Flow)
-
Solid understanding of deep learning fundamentals and strong interest in LLMs/NLP
-
Hands-on experience with Linux, Git, and container tools (e.g., Docker)
-
Strong analytical and problem-solving skills
-
Eagerness to learn complex hardware/software systems
Ways to Stand Out from the crowd
-
Experience with full-stack or frontend web development, particularly building internal tools or dashboards using React
-
Hands-on experience designing and implementing agentic workflows (e.g., Lang Chain, Lang Graph, Auto Gen, or similar frameworks)
-
Experience with LLM fine-tuning, prompt engineering, or RAG pipelines
-
Familiarity with hardware debugging, observability/logging systems, or chip/system reliability analysis
-
Experience with vector databases (FAISS, Pinecone, Milvus) or MLOps tools (MLflow, Kubeflow)
NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most talented and forward-thinking individuals in the world working for us. If you’re creative, data-driven, and eager to build LLM-powered tools that transform hardware engineering, we want to hear from you!NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.
Total Views
0
Total Apply Clicks
0
Total Mock Apply
0
Total Bookmarks
0
Similar jobs

Senior Applied Scientist, Annapurna ML
Amazon · Seattle, WA, USA

Senior Machine Learning Engineer, Specialist
Vanguard · 3 Locations

Staff Software Engineer, AI/ML Recommendations, Rankings, Predictions, YouTube

Senior Staff Machine Learning Engineer
GEICO · Palo Alto; Seattle

Senior Applied AI Engineer
StackBlitz · Remote
About NVIDIA

NVIDIA
PublicA computing platform company operating at the intersection of graphics, HPC, and AI.
10,001+
Employees
Santa Clara
Headquarters
$4.57T
Valuation
Reviews
10 reviews
4.4
10 reviews
Work-life balance
2.8
Compensation
4.5
Culture
4.2
Career
4.3
Management
3.8
78%
Recommend to a friend
Pros
Cutting-edge technology and innovation
Excellent compensation and benefits
Great team culture and collaboration
Cons
High pressure and expectations
Poor work-life balance and long hours
Fast-paced environment leading to burnout
Salary Ranges
79 data points
L3
L4
L5
L3 · Data Scientist IC2
0 reports
$177,542
total per year
Base
-
Stock
-
Bonus
-
$150,910
$204,174
Interview experience
5 interviews
Difficulty
3.0
/ 5
Interview process
1
Application Review
2
Recruiter Screen
3
Technical Phone Screen
4
Onsite/Virtual Interviews
5
Team Matching
6
Offer
Common questions
Coding/Algorithm
System Design
Behavioral/STAR
Technical Knowledge
Past Experience
Latest updates
Negotiating NVIDIA's Offer
Base, stock, and sign-on negotiable. Recruiters invested in closing candidates. CEO reviews all 42K employee salaries monthly. Stock growth has made many employees millionaires.
reddit/blind
·
NVIDIA Company Reviews
WLB rated 3.9/5 (lowest category). 64% satisfied with WLB but 53% feel burnt out. Compensation rated 4.4-4.5/5. Experience highly team-dependent.
reddit/blind
·
NVIDIA Interview Discussions
Technical bar is high with 4-6 rounds. Process takes 4-8 weeks. Expect C++ questions, LeetCode medium, and system design. Difficulty rated 3.16/5.
reddit/blind
·
NVIDIA Culture Discussions
Team-dependent experience; sink-or-swim culture that rewards high performers but can be overwhelming. No politics, flat structure, but demanding workload with some teams requiring evening/weekend work.
reddit/blind
·