
Research Scientist, HCI-Multimodality- Interaction Perception, Pico
About the role
About the Team:
The team at PICO is dedicated to leverage technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion, we continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.
We focus on computer vision + NLP + LLM for next-generation VR intelligent interaction.
Responsibilities:
- Develop computer vision-driven VR interaction algorithms centered on intelligent input method systems.
- Build LLM & NLP algorithms for prediction, error correction and completion.
- Research lightweight LLM/NLP and vision-language multimodal fusion for VR.
- Deliver technical innovations, patents and research translation.
- Provide technical leadership for the algorithm team.
Requirements:
Minimum Qualifications:
-
Master’s/PhD in CS, AI or related field.
-
5+ years NLP/LLM R&D experience, 2+ years leading core algorithms.
-
Expertise in Transformers, LLMs and sequence modeling.
-
Proficiency in Py Torch/Tensor Flow.
-
Basic computer vision or multimodal background.
-
Preferred Qualifications
-
Experience in intelligent input methods, especially Chinese input methods.
-
LLM fine-tuning and optimization for interactive systems.
-
Vision-language multimodal fusion for VR.
-
Lightweight model deployment on VR/edge devices.
-
VR interaction and scenario understanding.
Required skills
Machine learning
Model evaluation
Data workflows

Can my resume get me an interview?
Get your resume score and fixes with refresh.cv.
About ByteDance
San Jose
Headquarters