The AI, Search & Knowledge Platforms team builds amazing products and services for Apple's customers while serving as a foundational partner to teams across Apple. The team delivers world-class AI, search, and knowledge systems powering Siri, Apple Intelligence, Safari, and i Message, and operates the foundational platforms and infrastructure that keep these intelligent experiences running at hyperscale.
As part of this group, you will be doing large scale machine learning and deep learning research and development to improve Open Domain Question Answering (using both structured knowledge graph data and unstructured web data) and Summarization as well as developing fundamental building blocks needed for Artificial Intelligence. This involves developing sophisticated machine learning and large language models (LLMs) to understand user queries, retrieve and rank relevant documents across multiple sources and synthesize information across documents to provide user with a direct answer that best satisfies their intent and information seeking needs. Additionally, you will research and develop the state-of-the-art LLMs for summarizing personal data such as emails, messages, and notifications.

You will also work with researchers and data scientists to develop, fine-tune, and evaluate domain specific Large Language Models for various tasks and applications in Apple's AI powered products and conduct applied research to transfer the cutting edge research in generative AI to production ready technologies.

Description:

In this role, you will work on LLM based question answering and Apple Intelligence features to provide concise, accurate, and grounded information to users to help them complete their tasks quickly on Apple devices.

Your core responsibilities will include:

• Designing and developing advanced Reinforcement Learning technologies in the post-training of generative model, and delivering the end-user experience.

• Driving cross-functional technical initiatives, collaborating with research, engineering and production teams to translate theoretical advances into deployable systems.

• Developing novel and cutting-edge RL algorithms and improving existing ones.

• Staying up to date with the latest RL research and integrate best practices into the team's workflow.

• Working on the end-to-end ML lifecycle: algorithm design and implementation, data collection, model training, evaluation, and deployment.

Preferred Qualifications:

Deep expertise in reinforcement learning-based post-training on LLM models, reward modeling, RLHF, RLAIF, Chain-of-thought, and agentic AI R&D.

Deep understanding of cutting edge RL algorithms and large language model.

Deep understanding in LLM pre-training, post-training.

Strong product intuition and ownership

Excellent communication skills

Minimum Qualifications:

3+ years of ML experiences in search, natural language processing/understanding. Conversational AI.

Proven experience for LLM post training, including but not limited to SFT, RLHF, RLAIF, Reward Modeling, Chain-of-thought, agentic LLM.

Hands-on experience building RL pipelines and training agents in simulation or real-world environments.

Growth mindset and ability to learn new technologies

MS or Ph.D. in Computer Science, Machine Learning with a specialty in reinforcement learning, or a related field

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .

Pay & Benefits:

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $171,600 and $302,200, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.