Current on academic literature on LLM models' capabilities, and research on autorating (through LLMs, and otherwise), user simulation, and evaluation.

Understand the current system, and the needs for rating and agentic tasks in the Google context.

Build and deliver functioning systems to Google products, with the goal to improve the next generation of products, for the user, while keeping in mind Google's serving constraints and systems.

Bachelor’s degree or equivalent practical experience.

5 years of experience with software development in C++ or Python.

Experience developing, deploying, managing, and maintaining Machine Learning (ML) infrastructure.

Experience in Applied Machine Learning or Machine Learning infrastructure.