
Research Scientist, HCI-Multimodality - Interaction Perception, PICO
About the role
About the Team:
The team at PICO is dedicated to leverage technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion, we continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.
We focus on computer vision + NLP + LLM for next-generation VR intelligent interaction.
Responsibilities:
- Develop computer vision-driven VR interaction algorithms centered on intelligent input method systems.
- Build LLM & NLP algorithms for prediction, error correction and completion.
- Research lightweight LLM/NLP and vision-language multimodal fusion for VR.
- Deliver technical innovations, patents and research translation.
- Provide technical leadership for the algorithm team.
Requirements:
Minimum Qualifications:
-
Master’s/PhD in CS, AI or related field.
-
5+ years NLP/LLM R&D experience, 2+ years leading core algorithms.
-
Expertise in Transformers, LLMs and sequence modeling.
-
Proficiency in Py Torch/Tensor Flow.
-
Basic computer vision or multimodal background.
-
Preferred Qualifications
-
Experience in intelligent input methods, especially Chinese input methods.
-
LLM fine-tuning and optimization for interactive systems.
-
Vision-language multimodal fusion for VR.
-
Lightweight model deployment on VR/edge devices.
-
VR interaction and scenario understanding.
Required skills
Machine learning
Model evaluation
Data workflows
About ByteDance
San Jose
Headquarters