Jobs

Software Engineer, Simulator Evaluation
Mountain View, California, United States; San Francisco, California, United States
·
On-site
·
Full-time
·
1mo ago
Compensation
$170,000 - $216,000
Benefits and perks
•Equity
•401(k)
Required skills
Python
C++
SQL
Pandas
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
Waymo’s simulator is one of the most complex virtual environments ever built. It blends deterministic logic, physical dynamics, and state-of-the-art Generative AI to create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you mathematically prove that a virtual world is "real"?
We are looking for a Software Engineer to build the metrics and pipelines that grade this hybrid environment. You will work at the intersection of systems engineering and AI, writing the code that processes petabytes of simulation logs to answer a simple but vital question: "Did the simulator do the right thing?"
In this role, you will report to Senior Staff Software Engineering Manager and serve as a core contributor to the simulator evaluation stack.
You will:
-
Implement Evaluation Metrics and mine Datasets: You will translate mathematical concepts and product requirements into robust, efficient code (C++/Python). You will implement metrics that measure everything from agent rule compliance (e.g., "Did it stop at the red light?") to the statistical quality of AI-generated traffic. You will use a variety of methods to mine from Waymo's enormous corpse of driving logs to select the most relevant examples to evaluate the simulator on.
-
Build Scalable Pipelines: You will own key components of our data processing infrastructure. You will write and maintain the pipelines that ingest simulation logs, compute metrics at scale, and surface results to the broader engineering team.
-
Analyze & Debug: You will act as the first line of defense for simulation quality. You will dig into metric results to distinguish between genuine regressions (e.g., a code bug causing cars to stall) and evaluation noise.
-
Collaborate & Iterate: You will work closely with Tech Leads to refine our evaluation capabilities, quickly prototyping new ideas and hardening them for production use.
You have:
-
Engineering Craftsmanship:
-
2+ years of industry experience in software development.
-
Solid proficiency in Python or C++, with experience writing clean, testable, and maintainable production code.
-
Experience with version control, code review, and debugging complex systems.
-
Data Fluency:
-
You are comfortable working with data. You know how to query a dataset (SQL/Pandas), visualize a result, and sanity-check your own metrics.
-
You have a curiosity for "why" the numbers look the way they do.
-
Adaptability:
-
You are excited to work in a hybrid environment where you might evaluate a physics engine one day and a generative model the next.
We prefer:
-
Experience with data processing frameworks (e.g., Map Reduce, Flume, Spark), data analysis libraries (Pandas, Num Py), or machine learning.
-
Background in Autonomous driving, Robotics, Simulation, or Ad Tech.
-
Familiarity with basic statistics or machine learning concepts.
-
Experience validating software performance or quality (e.g., building test infrastructure).
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range**$170,000—$216,000 USD**
Total Views
0
Apply Clicks
0
Weekly mock applicants
0
Bookmarks
0
Similar jobs

Software Engineer, Mapping
Aurora · Mountain View, California

Software Engineer, Behavior Planning
Aurora · Mountain View, California

Software Engineer, Core Infrastructure
Moveworks · Mountain View, CA

Software Engineer, Routing
Nuro · Mountain View, California (HQ)

ML / AI Software Engineer - C++ Metrics Frameworks
General Motors · 4 Locations
About Waymo

Waymo
Series CWaymo LLC is an American autonomous driving technology company headquartered in Mountain View, California. It is a subsidiary of Alphabet Inc., Google's parent company.
1,001-5,000
Employees
Mountain View
Headquarters
$200B
Valuation
Reviews
4.2
10 reviews
Work-life balance
2.8
Compensation
4.1
Culture
4.3
Career
3.5
Management
3.8
78%
Recommend to a friend
Pros
Supportive and collaborative team environment
Innovative and cutting-edge technology projects
Competitive salary and excellent benefits
Cons
Fast-paced environment can be stressful
Work-life balance challenges
High pressure and overwhelming workload
Salary Ranges
310 data points
Mid/L4
Mid/L4 · Data Scientist
38 reports
$280,748
total per year
Base
$183,551
Stock
$74,549
Bonus
$22,649
$187,768
$434,285
Interview experience
5 interviews
Difficulty
3.6
/ 5
Duration
14-28 weeks
Offer rate
60%
Experience
Positive 40%
Neutral 60%
Negative 0%
Interview process
1
Application Review
2
Recruiter Screen
3
Technical Phone Screen
4
Coding Round
5
Onsite/Virtual Interviews
6
Final Round
Common questions
Coding/Algorithm
Machine Learning
System Design
Behavioral/STAR
Technical Knowledge
News & Buzz
S.F. is obsessed with Waymo while human drivers are killing people - San Francisco Chronicle
San Francisco Chronicle
News
·
3d ago
Waymo Means Way Mo’ Cars, According To Uber Docs - Streetsblog New York City
Streetsblog New York City
News
·
4d ago
Flexdrive by Lyft begins construction on major Waymo hub in Nashville - WKRN News 2
WKRN News 2
News
·
4d ago
Waymo launches driverless ride service in Orlando - WESH
WESH
News
·
5d ago