Building datasets, metrics, and autoraters.

Analyzing and debugging existing behavior.

Problem-solving to improve the accuracy, tone, and style of responses.

Implementing new features, such as visual aids in the response.

Prompt engineering, and collaborating with the core model team to improve the underlying model, personalization, first- and third-party data ingestion into AI Mode and running A/B experiments.

Bachelor’s degree or equivalent practical experience.

5 years of experience with software development in one or more programming languages.

3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.

3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).

3 years of experience in statistical modeling, data mining, and data analysis.

1 year of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).