
Organizing the world's information and making it universally accessible.
Staff Software Engineer, AI/ML Performance
-
Identify and maintain ML training and serving benchmarks.
-
Achieve state-of-the-art performance for customer launches, and in case of 3P/OSS models, for competitive benchmark submissions (ML Commons, InferenceX, etc.).
-
Use the benchmarks to identify performance opportunities and directly drive both near-term SOTA (e.g. custom kernels) and out-of-the-box performance (e.g. compiler/runtime optimizations, agentic tooling, auto-sharding) in collaboration with partner teams.
-
Participate in algorithmic innovation, exploiting new TPU hardware features and model-preserving optimizations (e.g. speculative decoding, sparsity, quantization, LoRA, etc.).
-
Participate in co-designing models that are TPU-friendly to showcase model quality at performance of OSS models typically designed on GPUs.
-
Bachelor's degree or equivalent practical experience.
-
8 years of experience programming in C++ or Python.
-
5 years of experience testing, and launching software products.
-
5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
-
3 years of experience with software design and architecture.
Total Views
0
Total Apply Clicks
0
Total Mock Apply
0
Total Bookmarks
0
Similar jobs

Sr. System Development Engineer, Cloud AI/ML/storage server teams
Amazon · Cupertino, CA, USA

Senior Full-Stack Engineer II - AI/ML
DigitalOcean · San Francisco

Principal Machine Learning Engineer (Recommendation)
Binance · Asia

Senior ML Software Engineer - Integration & Quality
Cerebras · Sunnyvale CA or Toronto Canada

Principal AI Deployment Architect
Celonis · Madrid, Spain
About Google

Google specializes in internet-related services and products, including search, advertising, and software.
10,001+
Employees
Mountain View
Headquarters
$1,700B
Valuation
Reviews
10 reviews
4.5
10 reviews
Work-life balance
3.2
Compensation
4.3
Culture
4.1
Career
4.2
Management
3.8
82%
Recommend to a friend
Pros
Great benefits and perks
Innovative and interesting work
Career development and learning opportunities
Cons
High pressure and expectations
Long hours and heavy workload
Fast-paced and overwhelming environment
Salary Ranges
57,503 data points
Junior/L3
L6
L7
L8
Mid/L4
Principal/L7
Senior/L5
Staff/L6
Director
L3
L4
L5
Junior/L3 · Data Scientist L3
0 reports
$176,704
total per year
Base
-
Stock
-
Bonus
-
$150,298
$203,110
Interview experience
9 interviews
Difficulty
3.4
/ 5
Duration
14-28 weeks
Offer rate
44%
Experience
Positive 0%
Neutral 56%
Negative 44%
Interview process
1
Application Review
2
Online Assessment/Technical Screen
3
Phone Screen
4
Onsite/Virtual Interviews
5
Team Matching
6
Offer
Common questions
Coding/Algorithm
System Design
Behavioral/STAR
Technical Knowledge
Product Sense
Latest updates
Our eighth generation TPUs: two chips for the agentic era - blog.google
blog.google
News
·
1w ago
Google Maps on Android Auto now shows bigger labels on streets along your route [Gallery] - 9to5Google
9to5Google
News
·
1w ago
Google to invest up to $40 billion in AI rival Anthropic - Reuters
Reuters
News
·
1w ago
Google to invest up to $40B in Anthropic in cash and compute - TechCrunch
TechCrunch
News
·
1w ago