refresh

Trending companies

Trending companies

NVIDIA
NVIDIA

Pioneering accelerated computing and AI

Senior Software AI Engineer, LLM Solutions

RoleMachine Learning
LevelSenior
LocationIsrael, Yokneam
WorkOn-site
TypeFull-time
Posted1 week ago
Apply now

Our System Design Automation team is looking for an AI Engineer with solid software skills to join our engineering group.The team develops and sustains a range of tools and capabilities for NVIDIA's current and next-generation hardware platforms — including LLM-powered automation and intelligent debugging solutions, alongside traditional software engineering tools.Our work accelerates issue resolution, improves product reliability, and powers the world's most advanced GPU and data center technologies.NVIDIA's Hardware Networking division is a global leader in end-to-end accelerated computing and connectivity for high-performance data centers — spanning GPUs, networking platforms, and AI software across cloud, HPC, autonomous vehicles, and media & entertainment.

What You'll Be Doing:

  • Develop and support software tools across the engineering stack — from data processing and backend services to user-facing interfaces

  • Build and maintain data pipelines and ETL flows for logs, telemetry, and hardware test data supporting AI/ML workflows

  • Prepare, clean, and structure large, complex datasets (structured & unstructured) for LLM training and fine-tuning

  • Develop and deploy LLM-based applications for root cause analysis and hardware debugging

  • Design and implement agentic workflows — multi-step, tool-using AI agents capable of autonomous reasoning and action

  • Experiment with prompt engineering, RAG, and vector search to integrate domain knowledge into models

  • Collaborate with hardware, reliability, and AI platform teams to embed intelligent tools into NVIDIA's engineering ecosystem

What We Need to See:

  • B.Sc. or M.Sc. in Computer Science, Electrical/Computer Engineering, Data Science, or equivalent practical experience

  • 5+ years of experience in software engineering with AI/ML or a related field

  • Strong Python skills (pandas, Num Py, Py Torch or Tensor Flow)

  • Solid understanding of deep learning fundamentals and strong interest in LLMs/NLP

  • Hands-on experience with Linux, Git, and container tools (e.g., Docker)

  • Strong analytical and problem-solving skills

  • Eagerness to learn complex hardware/software systems

Ways to Stand Out from the crowd

  • Experience with full-stack or frontend web development, particularly building internal tools or dashboards using React

  • Hands-on experience designing and implementing agentic workflows (e.g., Lang Chain, Lang Graph, Auto Gen, or similar frameworks)

  • Experience with LLM fine-tuning, prompt engineering, or RAG pipelines

  • Familiarity with hardware debugging, observability/logging systems, or chip/system reliability analysis

  • Experience with vector databases (FAISS, Pinecone, Milvus) or MLOps tools (MLflow, Kubeflow)

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most talented and forward-thinking individuals in the world working for us. If you’re creative, data-driven, and eager to build LLM-powered tools that transform hardware engineering, we want to hear from you!NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Total Views

0

Total Apply Clicks

0

Total Mock Apply

0

Total Bookmarks

0

About NVIDIA

NVIDIA

NVIDIA

Public

A computing platform company operating at the intersection of graphics, HPC, and AI.

10,001+

Employees

Santa Clara

Headquarters

$4.57T

Valuation

Reviews

10 reviews

4.4

10 reviews

Work-life balance

2.8

Compensation

4.5

Culture

4.2

Career

4.3

Management

3.8

78%

Recommend to a friend

Pros

Cutting-edge technology and innovation

Excellent compensation and benefits

Great team culture and collaboration

Cons

High pressure and expectations

Poor work-life balance and long hours

Fast-paced environment leading to burnout

Salary Ranges

79 data points

L3

L4

L5

L3 · Data Scientist IC2

0 reports

$177,542

total per year

Base

-

Stock

-

Bonus

-

$150,910

$204,174

Interview experience

5 interviews

Difficulty

3.0

/ 5

Interview process

1

Application Review

2

Recruiter Screen

3

Technical Phone Screen

4

Onsite/Virtual Interviews

5

Team Matching

6

Offer

Common questions

Coding/Algorithm

System Design

Behavioral/STAR

Technical Knowledge

Past Experience