Research Scientist, Multi-Modal Understanding & Synthesis

Meta is seeking a Research Scientist to drive foundational research in multi-modal understanding, synthesis, and world models. In this role, you will advance the state of the art in building AI systems that perceive, reason across, and generate content spanning vision, language, audio, and other modalities. You will develop world models that learn rich internal representations of human behavior, enabling prediction, planning, and simulation. Collaborating with world-class researchers and engineers, you will define research directions, publish influential work, and translate breakthroughs into technologies that power Meta's next-generation AI products.
Research Scientist, Multi-Modal Understanding & Synthesis Responsibilities
Lead original research in multi-modal learning, developing architectures and algorithms that unify understanding and generation across vision, language, audio, and other modalities
Design and build world models that learn predictive representations of human behavior, supporting capabilities such as simulation, planning, and reasoning
Drive end-to-end research projects from problem formulation and dataset curation through model development, evaluation, and integration into real-time prototypes
Develop novel approaches for multi-modal synthesis, enabling coherent generation of images, video, text, and audio from unified representations
Establish rigorous evaluation frameworks, benchmarks, and metrics to measure progress in multi-modal reasoning and world modeling
Mentor other engineers and researchers on the team, providing technical guidance on multi-modal architectures, generative models, and research best practices
Publish research findings at top-tier peer-reviewed venues such as NeurIPS, ICLR, and CVPR to advance the broader scientific community

Minimum Qualifications:

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
PhD in Machine Learning, Computer Vision, Natural Language Processing, or a closely related field
6+ years of experience conducting AI research in multi-modal learning, generative models, or world models, including experience leading major research initiatives from conception through publication or production deployment
Experience implementing and evaluating multi-modal systems using deep learning frameworks such as Py Torch or Tensor Flow, with proficiency in Python
Experience publishing original research in peer-reviewed machine learning or AI venues
Experience driving cross-functional technical decisions and communicating research findings and trade-offs to both research and engineering audiences through written documents and presentations
Experience with techniques spanning multiple modalities such as vision-language models, multi-modal transformers, or cross-modal representation learning

Preferred Qualifications:

Experience developing large-scale multi-modal foundation models or vision-language models
Experience with world models, predictive learning, or model-based reinforcement learning for planning and reasoning
First-author publications at top-tier venues such as NeurIPS, ICLR, or CVPR demonstrating contributions to multi-modal learning, generative models, or world models

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and Whats App further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
For those who live in or expect to work from California if hired for this position, please click here for additional information.
United States of America: $184,000/year to $257,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity:

Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.
Apply for this job
Take the first step toward a rewarding career at Meta.
Recruiters can view your conversations with AI. Using AI is optional and does not impact the outcome of your application process.Learn more about AI usage and settings.
Sign up
to ask follow-up questions