Jobs
Required skills
Python
Java
PyTorch
TensorFlow
Scala
We're looking for a Senior AI/MLOps Engineer to join a group that specializes in Security and Networking, and specifically ML, AI and agent development. As a Senior AI/MLOps Engineer, you’ll build and maintain the infrastructure, tools and processes necessary to support the AI lifecycle in a production environment. You will collaborate closely with data scientists, software engineers, security architects and DevOps teams to ensure smooth deployment, modeling and optimization of AI models. This role involves creative problem solving alongside engineering teams, and is pivotal for the continued success of AI networking security.
What you’ll be doing:
-
Developing, improving and optimizing scalable infrastructure for handling and deploying security and networking AI models and agents in production, ensuring high availability, scalability, reproducibility, and performance.
-
Optimizing AI models and agents for performance, scalability, and resource utilization, considering factors such as latency, efficiency, and cost.
-
Monitoring and deploying agentic systems, LLMs, and ML models in production.
-
Designing and implementing frameworks/pipelines for AI training, inference, and experimentation.
-
Collaborating closely with data scientists, security architects and software engineers to operationalize and deploy AI models and agents, including packaging and integration with existing systems. Participate in developing and reviewing code, design documents, use case reviews, and test plan reviews.
-
Collaborating with DevOps teams to integrate pipelines and workflows into the CI/CD process, ensuring flawless deployments and rollbacks.
-
Building and maintaining monitoring and alerting systems to proactively identify and resolve issues relating to quality, performance and infrastructure.
-
Implementing access controls, authentication mechanisms, and encryption standards for AI models and data.
-
Documenting guidelines, and standard operating procedures for MLOps/AI processes and sharing knowledge with the wider team.
-
Develop proof-of-concepts for new features.
What we need to see:
-
BSc/MSc in CS/CE or related field (or equivalent experience)
-
Strong background in AI with experience deploying and monitoring AI/ML models, LLMs and agents to production systems at scale, including distributed and multi-node environments - at least 5 years of experience.
-
Proficiency in programming languages such as Python, Java, or Scala, along with experience in using ML/AI frameworks and libraries (e.g. Tensor Flow, Py Torch).
-
Proficiency in microservices architecture, container orchestration, cloud platforms, and scalable infrastructure for training and inference workloads
-
Knowledge of inference optimization techniques.
-
Understanding of build infrastructure and CI/CD tools and practices (e.g. GitLab, GitHub Actions, Jenkins)
-
You are detail-oriented and care deeply about robust, well tested, high-performance code in production environments.
-
You are proactive, take full ownership of your deliverables, have a can-do approach, and excellent communication and collaboration skills, able to work effectively in multifunctional teams.
Ways to stand out from the crowd:
-
Knowledge of network protocols and Linux internals
-
Security and networking background, with knowledge of security protocols, network architectures, firewalls, intrusion detection systems, and other relevant security and networking concepts
-
Experience deploying and optimizing generative models and agents
-
Knowledge of network security principles and practices
NVIDIA has some of the most forward-thinking and hardworking people on the planet working for us and, due to unprecedented growth, our special engineering teams are growing fast. If you're a creative and autonomous engineer with a genuine passion for technology, we want to hear from you.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Total Views
0
Apply Clicks
0
Weekly mock applicants
0
Bookmarks
0
Similar jobs

Senior Principal MLOps Engineer, AI Inference
Red Hat · 2 Locations

Principal Product Manager - Fraud, Risk & ML Platform
SoFi · WA - Seattle; CA - San Francisco

Staff Software Engineer, ML Infra & Distributed Systems
Tubi (Fox) · San Francisco, CA; Los Angeles, CA; New York, NY (Hybrid); USA - Remote

Principal Engineer, Data & ML Infrastructure
Motional · Boston, Massachusetts, United States; Pittsburgh, Pennsylvania, United States; Remote U.S.

Sr. ML Ops Engineer, tvScientific
Pinterest · San Francisco, CA, US; Remote, US
About NVIDIA

NVIDIA
PublicA computing platform company operating at the intersection of graphics, HPC, and AI.
10,001+
Employees
Santa Clara
Headquarters
$4.57T
Valuation
Reviews
4.4
10 reviews
Work-life balance
2.8
Compensation
4.5
Culture
4.2
Career
4.3
Management
3.8
78%
Recommend to a friend
Pros
Cutting-edge technology and innovation
Excellent compensation and benefits
Great team culture and collaboration
Cons
High pressure and expectations
Poor work-life balance and long hours
Fast-paced environment leading to burnout
Salary Ranges
79 data points
Junior/L3
Mid/L4
Senior/L5
Junior/L3 · Analyst
7 reports
$170,275
total per year
Base
$130,981
Stock
-
Bonus
-
$155,480
$234,166
Interview experience
5 interviews
Difficulty
3.0
/ 5
Interview process
1
Application Review
2
Recruiter Screen
3
Technical Phone Screen
4
Onsite/Virtual Interviews
5
Team Matching
6
Offer
Common questions
Coding/Algorithm
System Design
Behavioral/STAR
Technical Knowledge
Past Experience
News & Buzz
Negotiating NVIDIA's Offer
Base, stock, and sign-on negotiable. Recruiters invested in closing candidates. CEO reviews all 42K employee salaries monthly. Stock growth has made many employees millionaires.
News
·
NaNw ago
NVIDIA Company Reviews
WLB rated 3.9/5 (lowest category). 64% satisfied with WLB but 53% feel burnt out. Compensation rated 4.4-4.5/5. Experience highly team-dependent.
News
·
NaNw ago
NVIDIA Interview Discussions
Technical bar is high with 4-6 rounds. Process takes 4-8 weeks. Expect C++ questions, LeetCode medium, and system design. Difficulty rated 3.16/5.
News
·
NaNw ago
NVIDIA Culture Discussions
Team-dependent experience; sink-or-swim culture that rewards high performers but can be overwhelming. No politics, flat structure, but demanding workload with some teams requiring evening/weekend work.
News
·
NaNw ago