refresh

Trending companies

Trending companies

Jobs

JobsGoogle

Principal Engineer, GKE Platform for AI Inference Workloads

Google

Principal Engineer, GKE Platform for AI Inference Workloads

Google

·

On-site

·

Full-time

·

1w ago

  • Lead the architectural direction for llm-d, ensuring a highly optimized, scalable foundation for distributed LLM and Reinforcement Learning (RL) serving across the GKE fleet.

  • Define GKE's evolution to support massive-scale inference and RL, solving novel orchestration problems in dynamic resource allocation, multi-host TPU/GPU scheduling, and high-throughput networking.

  • Partner with strategic AI model builders, Deep Mind, and Vertex AI to co-develop an AI-first roadmap, leveraging Google's custom silicon to optimize throughput and compute density.

  • Lead the broader Kubernetes ecosystem and Open Source Software (OSS) community, driving key upstream initiatives to establish industry standards for AI, RL, and accelerator orchestration.

  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.

  • 15 years of experience in software engineering, or 15 years of experience with an advanced degree.

  • Experience building distributed systems and driving technical strategy for platform-level infrastructure.

  • Experience with Kubernetes, container runtimes, and AI/ML infrastructure (e.g., inference serving, LLM, hardware accelerators).

Total Views

0

Apply Clicks

0

Weekly mock applicants

0

Bookmarks

0

About Google

Google

Google

Public

Google specializes in internet-related services and products, including search, advertising, and software.

10,001+

Employees

Mountain View

Headquarters

$1,700B

Valuation

Reviews

3.7

25 reviews

Work-life balance

3.8

Compensation

4.2

Culture

3.4

Career

3.9

Management

2.8

68%

Recommend to a friend

Pros

Excellent compensation and benefits

Smart and talented colleagues

Great perks and work flexibility

Cons

Management and leadership issues

Bureaucracy and slow processes

Constantly changing priorities and reorganizations

Salary Ranges

57,502 data points

Junior/L3

L3

L4

L5

L6

L7

L8

Mid/L4

Principal/L7

Senior/L5

Staff/L6

Director

Junior/L3 · Data Scientist L3

0 reports

$176,704

total per year

Base

-

Stock

-

Bonus

-

$150,298

$203,110

Interview experience

9 interviews

Difficulty

3.4

/ 5

Duration

14-28 weeks

Offer rate

44%

Experience

Positive 0%

Neutral 56%

Negative 44%

Interview process

1

Application Review

2

Online Assessment/Technical Screen

3

Phone Screen

4

Onsite/Virtual Interviews

5

Team Matching

6

Offer

Common questions

Coding/Algorithm

System Design

Behavioral/STAR

Technical Knowledge

Product Sense