About the job

Trust and Safety (T&S) enables Google to deliver helpful, trusted experiences by ensuring our products, platforms, and services are responsibly built and safe for users. Responsibility and safety are critical for product and business success and drive decisions and requirements across the product life-cycle, from design and development to ongoing product operations. T&S Safe Search team focuses on detecting and measuring sensitive and harmful content in Search results and Search features. We collaborate closely with Safe Search engineers on building algorithmic protections against such content to enable safe user experiences in Search. We focus on scalable solutions for collecting, annotating, and analyzing data to achieve results.

As a Senior Engineering Analyst in the T&S Safe Search Intelligence team, you will work to discover, measure, and mitigate user trust risks in Search through automated and scalable solutions. This would include working on Search results and various Search features with a focus on harmful content (e.g., CSAM, NCII, VE). You will build relationships with Search engineers, Product Managers (PMs), and User Experience (UX) specialists in order to improve Search protections. You will also work on analyzing existing product protections, evaluating content, and helping to improve policy definitions.

Our aim is to resolve problems at scale by working with engineers on automated product protections. This role will be exposed to graphic, controversial, or upsetting content.

Responsibilities

• Develop domain knowledge in Search infrastructure, ranking signals, and products.

• Develop prompt-based AI Raters that can evaluate content safety in Google products.

• Investigate and analyze patterns of badness and abuse on Google Search, utilizing data-driven insights to develop countermeasures and enhance platform security.

• Analyze large datasets to identify trends, patterns, and anomalies that may indicate abuse or quality issues within Google Search.

• Collaborate effectively with cross-functional teams, including Engineering, Product, Policy, and Legal, to develop and implement solutions that enhance search quality and user trust.

Minimum qualifications

• Bachelor's degree or equivalent practical experience.

• 5 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.

• 5 years of experience managing projects and defining project scope, goals, and deliverables.

Preferred qualifications

• Experience using Python for data manipulation and analysis.

• Experience with prompt engineering and applying Large Language Models (LLMs) to data labeling.

• Experience in product analysis and identifying user harm risks.

• Ability to design sampling approaches and use statistical analysis to make product recommendations.

• Excellent problem-solving and critical thinking skills, with attention to detail in an ever-changing environment.