# 概述

### 游戏场景下的用户智能服务挑战

大数据时代，利用人工智能等前沿技术进行改造升级已成为各行各业的必然趋势。其中，利用以个人为中心的用户数据建立千人千面的智能服务系统，已广泛应用于多个领域，成为学术界与工业界长久以来的研究热点与研究重点。而其中游戏产业为用户智能服务研究提供了良好的数据基础和丰富的研究问题，同时也带来了独特的挑战。

首先，游戏中的用户数据具有类型丰富、日志齐全、场景多样等特点，**如何从多源异构的游戏数据中构建高效的用户动态表征**是用户智能服务研究的数据基础和关键难点。例如，用户个人信息能够总体描述用户基本特征，用户行为日志能够精细刻画用户动作历史，用户关系图谱能够多角度呈现用户与其他对象之间的交互联系，用户多模态数据如图片、轨迹、键鼠、聊天、语音等能够反映用户实时动态

其次，游戏受众各不相同，玩家群体呈现泛化特征，而玩家个体存在个性偏好，**如何结合用户表征，理解用户潜在特性和行为因果模式，提出具有可解释性的用户建模算法**是用户智能服务研究的核心问题和模型基础。一方面，玩家按照玩法偏好可以划分为不同群体，如“风景党”、“任务狂”、“对战流”等，玩家基于社交关系或者游戏设计会加入临时团体如队伍或者固定团体如帮会，队伍或者帮会会呈现出整体趋同的特点；另一方面，每一名玩家性格、偏好迥然不同，平均每天都会有上万条游戏行为事件，在游戏世界中留下独一无二的活动轨迹。。

最后也是最重要的一点，游戏世界自由度不断提升，玩法元素层出不穷，衍生出极其丰富的应用场景，**如何基于用户动态表征和用户建模算法，结合特定业务领域知识，转化出可行的用户服务应用**成为用户智能服务研究的重要目标和落地难点。从玩家角度，道具/礼包推荐、侠侣/师徒推荐、装备/时装推荐等个性化策略帮助个体玩家快速成长和更好地享受游戏快乐；从运营角度，对战匹配、外挂检测、活动模拟等整体配置促进游戏整体公平性、可玩性和可持续性；从程序角度，资源预加载、延迟预测、卡顿检测等客户端或服务端优化协助开发人员更好维护玩家游戏体验。

### 网易伏羲用户画像组开放课题

网易游戏伏羲实验室用户画像组(以下简称为Fuxi-UP，<https://fuxi.163.com/tech.html#yhhx>)依托游戏平台海量数据，形成了游戏场景下的标准化大数据集，以“背景-定义-挑战-评估-数据”的形式提炼出一系列的开放研究课题，致力于面向海内外青年学者搭建游戏用户研究产学研合作平台。Fuxi-UP已建立起以“用户表征-用户建模-服务应用”为核心的研究体系（如图1所示），与多款在营游戏合作，为千万级玩家提供贴心服务，同时与浙江大学、清华大学、中国科学技术大学、天津大学、中科院计算所等国内知名高校和潘纲、崔鹏、陈刚、刘淇、况琨、赵洪科、赵莎、陈龙彪、毕经平、姚迪、赵翔宇等优秀学者合作，在KDD、WWW、ICDE、AAAI、MM、ICDM、CIKM、IEEE TC、IEEE TKDE、ACM TKDD、ACM TOIS、IEEE TG等人工智能领域顶级会议和期刊上发表多篇学术论文，并在国际游戏领域顶级学术会议IEEE CoG 2020荣获最佳论文奖。

![图1：面向游戏玩家的用户画像服务研究框架](https://noterminus.gitee.io/image_bed/images/research_framework_2022.png)

针对用户表征，Fuxi-UP应用人工智能技术帮助搭建游戏用户标签体系，学习用户动态行为行为嵌入和用户动态网络嵌入，捕获游戏玩家自身和玩家之间的深层次动态关联；针对方法建模，Fuxi-UP结合人工智能技术，对关系网络中的用户行为事件建模，通过模型可解释、因果分析、联邦学习、自动机器学习、在线学习等先进技术方法，有效捕获用户行为背后的隐藏规律和隐含状态；同时在领域知识加持下，Fuxi-UP运用人工智能技术能加速反外挂、用户流失/付费预测、玩家胜率预测、项目价值预估/预测等任务，同时针对用户个人提供定制化的推荐、匹配等服务，高效孵化出优质智能服务应用。

当前已成型的开放研究课题包括：（不断更新中）

* [游戏玩家进入的下一个游戏场景预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/map_prediction)
* [MMORPG游戏服务器的合并模拟预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/game_server_merge_simulation)
* [基于游戏虚拟社交空间的玩家时空序列预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/online_time_prediction)
* [基于多源数据融合的游戏玩家状态预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/multi_view_prediction)
* [MMORPG中的虚拟游戏道具价格预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/game_item_price_prediction)
* [结合因果推断的时序预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/causal_inference_for_sequential_prediction)
* [游戏玩家流失预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/churn_prediction)
* [游戏玩家流失原因分析](https://fuxi-up-research.gitbook.io/open-project/research_topics/churn_causal_analysis)
* [基于玩家角色轨迹的游戏外挂检测](https://fuxi-up-research.gitbook.io/open-project/research_topics/trace_based_bot_dectection)
* [基于玩家社交图谱的游戏外挂检测](https://fuxi-up-research.gitbook.io/open-project/research_topics/social_graph_based_bot_detection)
* [基于玩家行为序列的游戏外挂检测](https://fuxi-up-research.gitbook.io/open-project/research_topics/behavior_sequences_based_bot_detection)
* [基于游戏客户端截图的FPS透视挂检测](https://fuxi-up-research.gitbook.io/open-project/research_topics/image_based_fps_perspective_plugin_detection)
* [在线游戏中的半监督异常交易群体检测](https://fuxi-up-research.gitbook.io/open-project/research_topics/semi_supervised_trade_subgraph_detection)
* [在线游戏中的交易网络子图匹配](https://fuxi-up-research.gitbook.io/open-project/research_topics/trade_subgraph_matching)
* [可解释的外挂检测](https://fuxi-up-research.gitbook.io/open-project/research_topics/explainable_cheating_detection)
* [个性化礼包生成与个性化礼包推荐](https://fuxi-up-research.gitbook.io/open-project/research_topics/personalized_bundle_recommendation)
* [基于玩家实时交互的游戏道具推荐](https://fuxi-up-research.gitbook.io/open-project/research_topics/rl_based_recommendation)
* [游戏玩家时装商品搭配推荐](https://fuxi-up-research.gitbook.io/open-project/research_topics/gnn_based_fashion_recommendation)
* [基于游戏社交关系的玩家-帮会关系预测](https://fuxi-up-research.gitbook.io/open-project/research_topics/personalized_guild_recommendation)
* [MMORPG帮会健康度演变预测](https://github.com/Construction/fuxi-up-open-research/blob/master/research_topics/guild_healthy_analysis.md)
* [基于游戏战场中行为序列的玩家竞技风格挖掘](https://fuxi-up-research.gitbook.io/open-project/research_topics/behavior_categorization_in_competition)
* [基于游戏战场中行为序列的动作价值评估](https://fuxi-up-research.gitbook.io/open-project/research_topics/player_action_evaluation)
* [面向全局优化的游戏玩家组队匹配](https://fuxi-up-research.gitbook.io/open-project/research_topics/global_matchmaking)
* [游戏场景下的稳定学习框架](https://fuxi-up-research.gitbook.io/open-project/research_topics/stable_learning_framework)
* [数据众包质量控制方法研究](https://fuxi-up-research.gitbook.io/open-project/research_topics/crowdsourcing_quality_control)

当前已成型的开放工程课题包括：（不断更新中）

* [模型可解释性应用Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/application_of_xai)
* [用户行为序列可视化系统Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/behavior_sequences_visualization)
* [因果分析仿真环境Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/causal_analysis_simulation_environment)
* [基于区块链技术的数据加密和流转框架Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/data_encryption_and_circulation_based_on_blockchain_technology)
* [游戏联邦学习框架Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/game_federated_learning_framework_demo)
* [画像标签体系可视化Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/portrait_label_system_visualization)
* [回报分解仿真环境Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/return_breakdown_simulation_environment)
* [用户关系图谱可视化系统Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/user_relationship_graph_visualization_system)
* [游戏AutoML框架Demo制作](https://fuxi-up-research.gitbook.io/open-project/engineering_topics/game_automl_framework)

同时为帮助领域外学者快速了解游戏场景和开展研究，整理相关游戏背景知识和游戏数据说明如下：

* [游戏背景知识](https://fuxi-up-research.gitbook.io/open-project/background_knowledge/game_basics)
* [游戏数据集描述](https://fuxi-up-research.gitbook.io/open-project/public_data/data_desc)

### 论文流程

Fuxi-UP组论文兴趣既包括针对通用AI问题的研究性论文，也包括结合业务落地的工业性论文，具体的论文流程请参考[用户画像组论文流程](https://github.com/Construction/fuxi-up-open-research/blob/master/research_pipeline.md)。

### 高校合作

Fuxi-UP组期待与高校学术力量进行深入合作，合作形式包括且不限于**学术顾问**、**横向合作**、**论文合作**以及**联合申办学术活动**等。

具体合作申请事宜请参考[高校合作申请流程](https://fuxi-up-research.gitbook.io/open-project/cooperation_rules/cooperation_rules)。

如有疑问，欢迎邮件联系咨询：

* Email: <hztaojianrong@corp.netease.com>, <wurunze1@corp.netease.com>

### 数据竞赛

Fuxi-UP组为学术界提供来自工业界的实际问题及数据，举办了相关的数据竞赛， 欢迎来自学界和业界的同仁积极参与：

* [IEEE BigData Cup 2021： Reinforcement Learning based Recommender System Challenge](https://fuxi-up-research.gitbook.io/fuxi-up-challenges/challenge/bigdatacup2021-rl4rs-challenge) , 相关开源数据集RL4RS地址:<https://github.com/fuxiAIlab/RL4RS>

### 已发表论文

#### 会议论文

* Minghao Zhao, Le Wu, Yile Liang, Lei Chen, Jian Zhang, Qilin Deng, Kai Wang, Xudong Shen, Tangjie Lyu and Runze Wu, *Investigating Accuracy-Novelty Performance for Graph-based Collaborative Filtering*, **SIGIR'2022** (accepted)
* Xianyang Qi, Jiashu Pu, Shiwei Zhao, Jianrong Tao and Runze Wu, *A GNN-Enhanced Game Bot Detection Model for MMORPGs*, **PAKDD'2022** (accepted)
* Wenbin Li, Xiaokai Chu, Yueyang Su, Di Yao, Shiwei Zhao, Runze Wu, Shize Zhang, Jianrong Tao, Hao Deng and Jingping Bi, *FingFormer: Contrastive Graph-based Finger Operation Tranformer for Unsupervised Mobile Game Bot Detection*, **WWW'2022** (accepted)
* Jiashu Pu, Jianshi Lin, Xiaoxi Mao, Xudong Shen, Jianrong Tao, Yue Shang and Runze Wu, *Unsupervised representation learning of player behavioral data with Confidence Guided Masking*, **WWW'2022** (accepted)
* Chuang Zhao, Hongke Zhao, Yong Ge, Runze Wu and Xudong Shen, *Winning Tracker: A New Model for Real-time Winning Prediction in MOBA Games*, **WWW'2022** (accepted)
* Jian Zhang, Minghao Zhao, Runze Wu and Qi Xuan, *Center-Oriented Attentive Temporal Pooling for Link Prediction on Dynamic Networks*, **AAAI'2022 Workshop** (accepted)
* Lei Zhang, Xiang Wang, Chuang Zhao, Hongke Zhao, Rui Li and Runze Wu, *Co-Promotion Predictions of Financing Market and Sales Market: A Cooperative-Competitive Attention Approach*, **AAAI'2022** (accepted)
* Chuang Zhao, Hongke Zhao, Runze Wu, Qiling Deng, Yu Ding, Jianrong Tao and Changjie Fan, *Multi-dimensional Prediction of Guild Health in Online Games: A Stability-AwareMulti-task Learning Approach*, **AAAI'2022** (accepted)
* Sha Zhao, Junwei Fang, Shiwei Zhao, Runze Wu, Jianrong Tao, Shijian Li and Gang Pan, *T-Detector: A Trajectory based Pre-trained Model for Game Bot Detection in MMORPGs*, **ICDE'2022** (accepted)
* Manhu Qu, Jie Huang, Hao Deng, Runze Wu, Xudong Shen, Jianrong Tao and Tangjie Lyu, *EasySM: A data-driven intelligent decision support system for server merge*, **AAAI'2022 Demo** (accepted)
* Jie Huang, Qi Liu, Fei Wang, Zhenya Huang, Songtao Fang, Runze Wu, Enhong Chen, Yu Su and Shijin Wang, *Group-Level Cognitive Diagnosis: A Multi-Task Learning Perspective*, **ICDM'2021** (accepted)
* Qiling Deng, Kai Wang, Minghao Zhao, Runze Wu, Yu Ding, Zhene Zou, Yue Shang, Jianrong Tao and Changjie Fan, *Build Your Own Bundle - A Neural Combinatorial Optimization Method*, **ACMMM'2021** (accepted)
* Qiling Deng & Hao Li, Kai Wang, Zhipeng Hu, Runze Wu, Linxia Gong, Jianrong Tao, Changjie Fan and Peng Cui, *"Globally Optimized Matchmaking in Online Games"*, **KDD' 2021** (accepted)
* Yin Gu, Qi Liu, Kai Zhang, Zhenya Huang, Runze Wu, Jianrong Tao, *"NeuralAC: Learning Cooperation and Competition Effects for Match Outcome Prediction"*, **AAAI' 2021** [PDF](https://noterminus.gitee.io/image_bed/docs/Yin-Gu-AAAI21.pdf)
* Kai Wang, Zhene Zou, Qilin Deng, Jianrong Tao, Runze Wu, Changjie Fan, Liang Chen, Peng Cui, *"Reinforcement Learning with a Disentangled Universal Value Function for Item Recommendation"*, **AAAI' 2021** [PDF](https://ojs.aaai.org/index.php/AAAI/article/view/16569)
* Jianrong Tao, Yu Xiong, Shiwei Zhao, Yuhong Xu, Jianshi Lin, Runze Wu, Changjie Fan, *"XAI-Driven Explainable Multi-view Game Cheating Detection"*, **CoG' 2020** (***Best Paper***) [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238611.pdf)
* Shiwei Zhao, Runze Wu, Jianrong Tao, Manhu Qu, Hao Li, Changjie Fan, *"Multi-source Data Multi-task Learning for Profiling Players in Online Games"*, **CoG' 2020** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238598.pdf)
* Linxia Gong, Xiaochuan Feng, Dezhi Ye, Hao Li, Runze Wu, Jianrong Tao, Changjie Fan, Peng Cui, *"OptMatch: Optimized Matchmaking via Modeling the High-Order Interactions on the Arena"*, **KDD' 2020** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238605.pdf)
* Qilin Deng, Kai Wang, Minghao Zhao, Zhene Zou, Runze Wu, Jianrong Tao, Changjie Fan, Liang Chen, *"Personalized Bundle Recommendation in Online Games"*, **CIKM' 2020** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238585.pdf)
* Runze Wu, Hao Deng, Jianrong Tao, Changjie Fan, Qi Liu, Liang Chen, *"Deep Behavior Tracing with Multi-level Temporality Preserved Embedding"*, **CIKM' 2020** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238606.pdf)
* Kai Wang, Hao Li, Linxia Gong, Jianrong Tao, Runze Wu, Changjie Fan, Liang Chen, Peng Cui, *"Match Tracing: A Unified Framework for Real-time Win Prediction and Quantifiable Performance Evaluation"*, **CIKM' 2020** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238612.pdf)
* Angyu Zheng, Liang Chen, Fenfang Xie, Jianrong Tao, Changjie Fan, Zibin Zheng, *"Keep You from Leaving: Churn Prediction in Online Games"*, **DASFAA' 2020** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238582.pdf)
* Jianrong Tao, Linxia Gong, Changjie Fan, Longbiao Chen, Dezhi Ye, Sha Zhao, *"GMTL: A GART Based Multi-task Learning Model forMulti-Social-Temporal Prediction in Online Games"*, **CIKM' 2019** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238581.pdf)
* Jianrong Tao, Jianshi Lin, Shize Zhang, Sha Zhao, Runze Wu, Changjie Fan, Peng Cui, *"MVAN: Multi-view Attention Networks for Real Money Trading Detection in Online Games"*, **KDD' 2019** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20190624/201906242016223847.pdf)
* Jianrong Tao, Jiarong Xu, Linxia Gong, Yifu Li, Changjie Fan, Zhou Zhao，*“NGUARD: A Game Bot Detection Framework for NetEase MMORPGs”*， **KDD' 2018** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20180524/15271225706990.pdf)

#### 期刊论文

* Shiwei Zhao and Runze Wu, Jianrong Tao, Manhu Qu, Minghao Zhao and Changjie Fan, *perCLTV: A General System for Personalized Customer Lifetime Value Prediction in Online Games*, **ACM TOIS** (accepted)
* Xiang Wen & Shiwei Zhao, Haobo Wang, Runze Wu, Manhu Qu, Tianlei Hu, Gang Chen, Jianrong Tao and Changjie Fan, *Multi-Source Multi-Label Learning for User Profiling in Online Games*, **IEEE TMM** (accepted)
* Anpeng Wu, Junkun Yuan, Kun Kuang, Bo Li, Runze Wu, Qiang Zhu, Yueting Zhuang and Fei Wu, *Learning Decomposed Representations for Treatment Effect Estimation*, **IEEE TKDE** (accepted)
* Chongrong Fang, Haoyu Liu, Mao Miao, Jie Ye, Lei Wang, Wansheng Zhang, Daxiang Kang, Biao Lyu, Shunmin Zhu, Peng Cheng and Jiming Chen, *Towards Automatic Root Cause Diagnosis of Persistent Packet Loss in Cloud Overlay Network*, **IEEE/ACM TON** (accepted)
* Ge Fan, Biao Geng, Jianrong Tao, Kai Wang and Changjie Fan, *PPPNE: Personalized Proximity Preserved Network Embedding*, **NEUROCOMPUTING** (accepted)
* Qiling Deng, Minghao Zhao, Kai Wang, Runze Wu, Xudong Shen, Jianrong Tao and Changjie Fan, *"Find Your Organization in MMORPGs"*, **IEEE Trans. on Games** (accepted)
* Kun Kuang, Hengtao Zhang, Runze Wu, Fei Wu, Yueting Zhang and Aijun Zhang, *"Balance-Subsampled Stable Prediction across Unknown Test Data"*, **ACM TKDD** (accepted)
* Minghao Zhao, Qilin Deng, Kai Wang, Runze Wu, Jianrong Tao, Changjie Fan, Liang Chen and Peng Cui, *"Bilateral Filtering Graph Convolutional Network for Social Recommendation in Power-Law Networks"*, **ACM TOIS** (accepted)
* Jiarong Xu and Yifan Luo, Jianrong Tao and Changjie Fan, Zhou Zhao and Jiangang Lu, *"NGUARD+: An Attention-based Game Bot Detection Framework via Player Behavior Sequences"*, **ACM TKDD** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238596.pdf)
* Kun Kuang, Peng Cui, Hao Zou, Bo Li, Jianrong Tao, Fei Wu, Shiqiang Yang, *"Data-Driven Variable Decomposition for Treatment Effect Estimation"*, **IEEE TKDE** [PDF](https://nos.netease.com/mg-file/mg/neteasegamecampus/art_works/20200812/202008122020238608.pdf)