LLM/MLLM Algorithm Engineer - Global E-Commerce

About the Team:

The team focuses on the development of large models in NLP, CV, and multimodal domains. The team aims to establish state-of-the-art (SOTA) models while delving deeply into these areas to optimize algorithms for e-commerce data, thereby enhancing business outcomes. By refining algorithms and collaborating with business operations, the team strives to govern the quality and ecosystem of Byte Dance's e-commerce products comprehensively. This includes addressing issues such as risks, violations, and low-quality content, while also fostering the e-commerce ecosystem. The ultimate goal is to maximize platform governance efficiency and effectiveness.

• Job Responsibilities
• Large language Model Algorithm Development: Build domain-specific large language models (LLM/MLLM) for e-commerce, integrating domain knowledge to rapidly apply models to business scenarios.
• E-commerce Governance Optimization: Understand e-commerce governance scenarios deeply to improve merchant/product/video/live-stream/IPR governance through algorithm optimization. Develop state-of-the-art intelligent review systems capable of “knowing why to reject” decisions.
• Model Enhancement: Handle tasks like data construction, foundational model enhancement, instruction fine-tuning, chain-of-thought (CoT) , and parameter-efficient fine-tuning (PEFT) to achieve optimal model performance in the e-commerce domain.
• Problem Solving for Governance Applications: Address challenges such as long text/sequence modeling, few-shot learning, content moderation, violation detection, and policy recommendation using large models and multimodal approaches.
• Model Development and Optimization: Research and optimize e-commerce-specific NLP and multimodal large models to improve multilingual, multi-task, and multi-modal algorithm performance across various e-commerce scenarios.

Requirements:

• Minimum Qualifications
• Strong Technical Background: Solid foundation in machine learning and familiarity with cutting-edge AI technologies. Preference for candidates with high-quality academic publications or competition experience.
• Big Data Proficiency: Familiarity with big data frameworks and applications like Map Reduce/Spark is preferred.
• Model Training Expertise: Experience with training and deploying Tensor Flow/Py Torch models.
• Model Compression and Inference Optimization: Understanding of research and techniques for model compression and inference acceleration, including quantization, pruning, distillation, and TensorRT optimization.

Preferred Qualifications:

Expertise in One of the Following Areas:

• Computer Vision (CV) & Multimodal:
  In-depth knowledge in fields such as image search, classification, segmentation, detection, OCR, graph neural networks, multimodal learning, unsupervised/self-supervised learning, etc.
  Experience in CV/multimodal large model projects is preferred, especially for e-commerce scenarios like video/product multimodal modeling.
  Strong practical abilities, with achievements in competitions such as Kaggle, COCO, Image Net, Activity Net, ICPC, etc.
• Publications in top-tier conferences (e.g., CVPR, ICCV, ECCV) are a plus.
• Natural Language Processing (NLP):
  Expertise in areas such as pretraining, NLU, multilingual and cross-lingual learning, NLG, transfer learning, and semi-supervised learning.
  Experience in LLM-related projects and applying them to unify e-commerce NLP tasks is a plus.
  Strong practical abilities, with achievements in competitions like Kaggle, GLUE, Super GLUE, CLUE, etc.
• Publications in top-tier conferences (e.g., ACL, EMNLP) are a plus.
• Knowledge of training acceleration methods such as mixed precision training and distributed training is a plus.