ByteDance
ByteDance

Research Scientist, HCI-Multimodality - Interaction Perception, PICO

RoleMachine Learning
LevelMid Level
LocationSan Jose, Canada, United States
WorkOn-site
TypeRegular
PostedToday
Apply now

About the role

About the Team:

The team at PICO is dedicated to leverage technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion, we continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.

We focus on computer vision + NLP + LLM for next-generation VR intelligent interaction.

Responsibilities:

  • Develop computer vision-driven VR interaction algorithms centered on intelligent input method systems.
  • Build LLM & NLP algorithms for prediction, error correction and completion.
  • Research lightweight LLM/NLP and vision-language multimodal fusion for VR.
  • Deliver technical innovations, patents and research translation.
  • Provide technical leadership for the algorithm team.

Requirements:

Minimum Qualifications:

  • Master’s/PhD in CS, AI or related field.

  • 5+ years NLP/LLM R&D experience, 2+ years leading core algorithms.

  • Expertise in Transformers, LLMs and sequence modeling.

  • Proficiency in Py Torch/Tensor Flow.

  • Basic computer vision or multimodal background.

  • Preferred Qualifications

  • Experience in intelligent input methods, especially Chinese input methods.

  • LLM fine-tuning and optimization for interactive systems.

  • Vision-language multimodal fusion for VR.

  • Lightweight model deployment on VR/edge devices.

  • VR interaction and scenario understanding.

Required skills

Machine learning

Model evaluation

Data workflows

About ByteDance

San Jose

Headquarters