付心仪博士负责或参与多项国家级或企业联合研究课题：

• 面向基层养老服务体系的老年人心理异常快速识别与联动响应机制研究（清华大学自主科研项目，主持)

• 基于大模型的低隐私主动识人智能感知关键技术研究（企事业单位委托项目，主持）

• 京港澳高校交流项目“跨学科交叉前沿探索合作交流项目”（北京市教育委员会项目，主持）

• 基于融合感知的老年长期行为-心理监测与异常预警研究（北京市自然科学基金青年项目，主持）

• 智能家居交互体验顶层设计（企事业单位委托项目，主持）

• 声学及无线电频率无线传感技术效能实地评估项目（企事业单位委托项目，主持）

• 基于虚拟现实的文化遗产数字化科普展示播研究（教育部人文社科青年项目，主持）

• 新型人工智能背景下的创新与社会发展新模式研究（北京市科学技术协会智库项目，主持）

• 5G+AR、VR技术的科幻产业高质量发展路径研究（北京市发展和改革委员会项目，主持)

• 面向未来个性化人居的智慧空间建构及设计研究（丰田联合研究基金，主持）

• 人居场景下的多模态情感计算理论与方法研究（清华大学自主科研计划，主持）

• 控制板的触控功能算法软件系统开发（企事业单位委托项目，CO-PI）

• 面向元宇宙的多源沉浸感知与多模态实时生成理论与方法研究（国家自然科学基金专项项目，骨干）

• 面向智能家居的多模态自然人机交互理论与方法研究（国家自然科学基金面上项目，骨干）

• 丝路文物数字化快捷采集方法及面向极端复杂环境的装备研发（国家重点研发计划，骨干）

• 雕塑、壁画类文化遗产的虚拟复原 (国家重点基础研究发展计划-973计划，骨干)

• 基于知识学习的文物色彩复原数字化理论与方法研究 (国家自然科学基金面上项目，骨干)

• 基于图像的数字化动漫造型理论与方法研究 (国家自然科学基金面上项目，骨干)

• VR内容的生成与设计（国家重点研发计划，参与）

发表论文：

[1]. He Zhang and Xinyi Fu*. 2025. Zero-shot Emotion Annotation in Facial Images Using Large Multimodal Models: Benchmarking and Prospects for Multi-Class, Multi-Frame Approaches. In Proceedings of the 3rd International Workshop on Multimodal and Responsible Affective Computing (MRAC ’25), October 27–31, 2025, Dublin, Ireland. ACM, New York, NY, USA, 10 pages. https://doi.org/10.1145/3746270.3760233

[2]. Xinyi Fu#, Meng Li#, Xiaomeng Li, Wen Chen, Lening Yu, Zixin Chen, Shuting Wen, Yilin Li, Jiachen Du, Yun Wang*, Yingqing Xu*, and Yunbing Chen*. 2025. Emerging Computing Technology for Digital Culture Heritage Preservation and Inheritance: A Literature Review. IEEE Transactions on Computational Social Systems (2025), 1–38. DOI:https://doi.org/10.1109/TCSS.2025.3589324

[3]. Yang Jiao*, Ruoting Sun, Rong Luo, Xiwen Yao, Xinran She, Kotaro Hara, Yuewen Zhang, and Xinyi Fu. 2025. Tactile Data Comics: Combining Step-by-step Presentation of Tactile Graphics with Verbal Narration for the Blind and Visually Impaired. In Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '25). Association for Computing Machinery, New York, NY, USA, Article 29, 1–14. https://doi.org/10.1145/3663547.3746338

[4]. He Zhang, Xinyang Li, Xingyu Zhou and Xinyi Fu*. VR Calm+: Furry Stress Ball as a Haptic Modality for Relaxation in Virtual Reality. In 2025 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, Daejeon, Korea, Republic of, 632–633. DOI: 10.1109/ISMAR-Adjunct68609.2025.00128.

[5]. Jiachen Du, Xinkai Zou, Liwen He, Shuzi Yin, Bingjie Gao, Wenjing Deng, Xinyi Fu, and Haipeng Mi*. 2026. Emotional Support Originating from Dialogue: Empowering Older Adults' Self-Tracking of Sleep-Related Daytime Factors. In Companion of the 2025 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp Companion '25). Association for Computing Machinery, New York, NY, USA, 70–74. https://doi.org/10.1145/3714394.3754418

[6]. Jiachen Du, Bingjie Gao, Shuzi Yin, Xinkai Zou, Wenjing Deng, and Xinyi Fu*. 2026. TaskWise: Enhancing Cognitive Performance in Task Management through Interactive Detail Enrichment. In Companion of the 2025 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp Companion '25). Association for Computing Machinery, New York, NY, USA, 271–275. https://doi.org/10.1145/3714394.3754433

[7]. Jiachen Du, Hanyu Huang, Xinkai Zou, Shuzi Yin, Bingjie Gao, and Xinyi Fu*. 2025. The Social Dynamics of Voice Cloning: Trust, Privacy, and Ethical Tensions When Sharing Your AI Voice Replica. In Companion Publication of the 2025 Conference on Computer-Supported Cooperative Work and Social Computing (CSCW Companion '25). Association for Computing Machinery, New York, NY, USA, 307–311. https://doi.org/10.1145/3715070.3749244

[8]. 何爽,徐迎庆,付心仪*.智能厨房交互设计研究综述[J].建筑技艺(中英文),2025,31(02):25-33.DOI:10.19953/j.at.2025.02.006.

[9]. Cheng Xue, Minghui Liu, Yuxiang Zhai, Jiachen Du, Xinyi Fu*. (2025). Physiological and Behavioral Analysis Based Multimodal Evaluation of Older Adults’ Experience with Kitchen Appliances. In: Gao, Q., Zhou, J. (eds) Human Aspects of IT for the Aged Population. HCII 2025. Lecture Notes in Computer Science, vol 15810. Springer, Cham. https://doi.org/10.1007/978-3-031-92710-2_11

[10]. He Zhang, Xinyi Fu*, and John Millar Carroll. "Augmenting Image Annotation: A Human–LMM Collaborative Framework for Efficient Object Selection and Label Generation." ICLR 2025 Workshop on Bidirectional Human-AI Alignment.

[11]. Jiachen Du, Tongtong Jin, Ruowen Niu, Yuxiang Zhai, and Xinyi Fu*. 2025. Enhancing Older Adults' Lives with Conversational Agents: A Systematic Review of Contexts, Capabilities, and User-Centered Design Strategies. In Proceedings of the Twelfth International Symposium of Chinese CHI (CHCHI '24). Association for Computing Machinery, New York, NY, USA, 258–268. https://doi.org/10.1145/3758871.3758891

[12]. Xiao Xue, Shuang He, Keqi Chen, Ruoxin Qiao, Weitai Xu, Enyang Wang, Yaxuan Zhao, and Xinyi Fu*. 2025. When My Car Whispers Secrets to My Home: Envisioning the Opportunities and Challenges of Human-Vehicle-Home Integrated Ecosystems through Probes. In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '25). Association for Computing Machinery, New York, NY, USA, Article 598, 1–12. https://doi.org/10.1145/3706599.3720252

[12].Shuang He, Da Gao, Xingyu Zhou, Haoyu Dai, Shengyi Wang, Yingqing Xu, and Xinyi Fu*. 2025. BakeEase: Redefining Baking Experiences with AI-Powered Multimodal Systems. In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '25). Association for Computing Machinery, New York, NY, USA, Article 90, 1–8. https://doi.org/10.1145/3706599.3720180

[13]. Cheng Xue, Zonglin Zuo, Xinran Jiang, and Xinyi Fu*. 2024. DogChat: A Pet-centered Smart Collar Prototype based on Large Language Models and Wechat. In Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '24). Association for Computing Machinery, New York, NY, USA, 162–166. https://doi.org/10.1145/3675094.3677606

[14]. He Zhang, Xinyang Li, Xinyi Fu*, Christine Qiu, Jiyuan Zhang, and John M. Carroll. 2024. Understanding Fear Responses and Coping Mechanisms in VR Horror Gaming: Insights From Semistructured Interviews. IEEE Transactions on Games 16, 4 (2024), 868–881. DOI:https://doi.org/10.1109/TG.2024.3403768

[15]. 徐迎庆,周沁怡,邓婕,张煜, 付心仪*. 人工智能在设计产业中的应用及发展 [J]. 包装工程, 2024, 45 (08): 1-10. DOI:10.19554/j.cnki.1001-3563.2024.08.001.

[16]. Xiao Xue, Xinyang Li, Boyang Jia, Jiachen Du, and Xinyi Fu*. 2024. Who Should Hold Control? Rethinking Empowerment in Home Automation among Cohabitants through the Lens of Co-Design. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 854, 1–19. https://doi.org/10.1145/3613904.3642866

[17]. Mengyu Chen, Shuang He, and Xinyi Fu*. 2024. A Case Study Exploring the Applicability of Heuristic Evaluation in Smart Home Systems. In Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA '24). Association for Computing Machinery, New York, NY, USA, Article 498, 1–7. https://doi.org/10.1145/3613905.3637131

[18]. He Zhang, Xinyang Li, Yuanxi Sun, Xinyi Fu*, Christine Qiu, and John M. Carroll. 2024. VRMN-bD: A Multi-modal Natural Behavior Dataset of Immersive Human Fear Responses in VR Stand-up Interactive Games. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 320–330. DOI:https://doi.org/10.1109/VR58804.2024.00054

[19]. Zhuying Li, Xipei Ren, Chengyu Liu, Ding Ding, and Xinyi Fu. 2024. Editorial: Body-centric computing for health and wellbeing. Frontiers in Computer Science Volume 6-2024, (2024). DOI:https://doi.org/10.3389/fcomp.2024.1393102

[20]. Cheng Xue, Yingting Gao, Ananda Robin, Jiachen Du, Qianyao Xu, and Xinyi Fu*. 2024. Meta-Home: Smart Home Digital Twin Design from the Perspective of Smart metaverse. In Proceedings of the Eleventh International Symposium of Chinese CHI (CHCHI '23). Association for Computing Machinery, New York, NY, USA, 309–320. https://doi.org/10.1145/3629606.3629635

[21]. He Zhang, Xinyang Li, Christine Qiu, and Xinyi Fu*. 2024. Decoding Fear: Exploring User Experiences in Virtual Reality Horror Games. In Proceedings of the Eleventh International Symposium of Chinese CHI (CHCHI '23). Association for Computing Machinery, New York, NY, USA, 411–419. https://doi.org/10.1145/3629606.3629646

[22]. He Zhang, Robin Ananda, Xinyi Fu*, Zhe Sun, Xiaoyu Wang, Keqi Chen, and John Carroll. 2024. Multi-channel Sensor Network Construction, Data Fusion and Challenges for Smart Home. In Proceedings of the Eleventh International Symposium of Chinese CHI (CHCHI '23). Association for Computing Machinery, New York, NY, USA, 344–351. https://doi.org/10.1145/3629606.3629638

[23]. Jiachen Du, Boyang Jia, and Xinyi Fu*. 2024. Space Brain: An AI Autonomous Spatial Decision System. In Artificial Intelligence, Springer Nature Singapore, Singapore, 61–67.

[24]. Tongxin Sun, Tongtong Jin, Yuru Huang, Meng Li, Yun Wang, Zhe Jia & Xinyi Fu*. (2023). Restoring Dunhuang Murals: Crafting Cultural Heritage Preservation Knowledge into Immersive Virtual Reality Experience Design. International Journal of Human–Computer Interaction, 40(8), 2019–2040. https://doi.org/10.1080/10447318.2023.2232976

[25]. 付心仪, 张鹤, 薛程, 孙童心. 面向未来的智能家居前沿进展[J]. 科技导报, 2023, 41(8): 36-52; doi: 10.3981/j.issn.1000-7857.2023.08.004 （FU Xinyi, ZHANG He, XUE Cheng, SUN Tongxin. A review of the frontier research on future smart home. Science & Technology Review, 2023, 41(8): 36-52.）

[26]. 肖虹,唐健凯,丘雨涵,付心仪*.隐私友好的步态数据采集与情绪识别方法[J].计算机辅助设计与图形学学报,2023,35(02):203-212. （Xiao Hong, Tang Jiankai, Qiu Christine, Fu Xinyi*. A Method of Privacy-Friendly Gait Date Acquisition and Emotion Recognition[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(2): 203-212. DOI: 10.3724/SP.J.1089.2023.20042）

[27]. 徐迎庆, 王韫, 付心仪, 等. 学科交叉与设计创新研究进展[J]. 科技导报, 2023, 41(8): 17-25; doi: 10.3981/j.issn.1000-7857.2023.08.002 （XU Yingqing,WANG Yun,FU Xinyi, et al. A review of the interdisciplinary research and design innovation[J]. Science & Technology Review, 2023, 41(8): 17-25.）

[28]. Zhe Sun, Robin Ananda, and Xinyi Fu*. 2024. EmoSparkle: Tangible Prototype to Convey Visual Expressions for Visually Impaired Individuals in Real-time Conversations. In Proceedings of the Tenth International Symposium of Chinese CHI (Chinese CHI '22). Association for Computing Machinery, New York, NY, USA, 38–49. https://doi.org/10.1145/3565698.3565768

[29]. Keqi Chen, Xinyi Fu*, and Chris Speed. 2024. User-friendly interactive affective system to leverage aggressive driving behavior. In Proceedings of the Tenth International Symposium of Chinese CHI (Chinese CHI '22). Association for Computing Machinery, New York, NY, USA, 50–61. https://doi.org/10.1145/3565698.3565769

[30]. Jie Liu, Dan Luo, Xinyi Fu, Qi Lu, and Karen Yixin Kang. 2022. Design Strategy of Multimodal Perception System for Smart Environment. In Internet of Things for Smart Environments. Springer, 93–115. https://doi.org/10.1007/978-3-031-09729-4_6

[31]. 付心仪,张鹤,薛程,李欣洋,孙喆,徐迎庆*.智能家居综合实验平台设计研究与应用实践[J].包装工程,2022,43(16):50-58+108.DOI:10.19554/j.cnki.1001-3563.2022.16.005. （Xinyi Fu, He Zhang, Cheng Xue, Xinyang Li, Yingqing Xu. Design Research and Application Practice of Integrated Experimental Platform for Smart Home. Packaging Engineering, 2022,43(16):50-58, 108.）

[32]. Xinyi Fu, Cheng Xue, Qiuyi Yin, Yu Jiang, Ye Li, Yichen Cai and Weilin Sun. Gesture based fear recognition using non-performance dataset from VR horror games [C]//2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 2021: 1-8

[33]. Xinyi Wang, Cheng Xue, Tongxin Sun, Jingyi Liu, and Xinyi Fu*. 2021. Mobile Screen-based User Interface Design Guideline for Panoramic VR in Shopping Scene. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (MobileHCI '21). Association for Computing Machinery, New York, NY, USA, Article 34, 1–14. DOI:https://doi.org/10.1145/3447526.3472055

[34]. 付心仪,李岩,孙志军,杜鹃,王凤平,徐迎庆*.敦煌莫高窟烟熏壁画的数字化色彩复原研究[J].敦煌研究,2021(01):137-147.（FU Xinyi，LI Yan, SUN Zhijun, DU Juan, WANG Fengping, XU Yingqing. Digital Color Restoration of Soot Covered Murals in the Mogao Grottoes at Dunhuang [J]. Dunhuang Research, 2021(01):137-147.）

[35]. 付心仪,蔡天阳,薛程,张宇翔,徐迎庆*.基于BGRU-FUS-NN神经网络的姿态情感计算方法研究[J].计算机辅助设计与图形学学报,2020,32(07):1070-1079. （Fu, X., Cai, T., Xue, C., Zhang, Y., & Xu, Y. (2020). Research on body-gesture affective computing method based on BGRU-FUS-NN neural network. Journal of Computer-Aided Design and Computer Graphics, 32(7), 1070-1079.）

[36]. 付心仪,薛程,李希,张玥泽,蔡天阳.基于姿态的情感计算综述[J].计算机辅助设计与图形学学报,2020,32(07):1052-1061. （Xinyi F, Cheng X, Xi L, et al. A Review of Body Gesture Based Affective Computing[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(7): 1052-1061.）

[37]. 郝强,付心仪*,徐迎庆.信息时代背景下的新兴大众化设计[J].装饰,2020(03):38-42. (Qiang Hao, Xinyi Fu, Yingqing Xu. Emerging Popular Design in Information Age [J]. ZHUANGSHI, 2020(03):38-42.) (CSSCI)

[38]. Xinyi Fu, Yaxin Zhu, Zhijing Xiao, Yingqing Xu, and Xiaojuan Ma*. RestoreVR: Generating Embodied Knowledge and Situated Experience of Dunhuang Mural Conservation via Interactive Virtual Reality [C]. //In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 2020:1–13.

[39]. Zanzhen Huang, Yaxin Zhu, Xiaofei Mao, Tianxin Su, Xinyi Fu and Guangzheng Fei*. coisTable: An Individual-and-Spatial-Aware Tabletop System for Co-located Collaboration [C]. //the 6th International Conference on Dependable Systems and Their Applications (DSA), Harbin, China, 2020:91-99.

[40]. 付心仪,麻晓娟*,孙志军.破损壁画的数字化复原研究——以敦煌壁画为例[J].装饰,2019(01):21-27.(Xinyi Fu, Xiaojuan Ma*, Zhijun Sun. Digital Restoration of Damaged Murals: Based on Dunhuang Murals [J]. ZHUANGSHI, 2019(01):21-27.)

[41]. 付心仪,刘世霞,徐迎庆*. 信息可视化的发展与思考[J]. 装饰, 2017(04):16-19. (Xinyi Fu, Shixia Liu, Yingqing Xu*. The Development and Reflection of Information Visualization [J]. ZHUANGSHI, 2017(04):16-19.)

[42]. Xinyi Fu, Yi Han, Zhijun Sun, Xiaojuan Ma and Yingqing Xu*. Line-drawing Enhanced Interactive Mural Restoration for Dunhuang Mogao Grottoes [C]. //ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2017(IV-2/W2):99-106.

[43]. Yan Li, Fengping Wang, Xinyi Fu, Zhijun Sun and Yingqing Xu*. Analysis of the pigments for smoked mural by confocal micro-Raman spectroscopy[J]. Journal of Raman Spectroscopy. 2017(48):1479–1486. (SCI Q1 IF=2.7)

授权专利：

  [1] 付心仪,李欣洋,王韫,薛程。（外观）智能家居椅：中国，专利号：ZL 202330124880.3，申请日：2023-03-16；授权日：2023年9月26日

  [2] 焦阳，付心仪，薛程。虚拟现实摄像设备的控制方法及装置：中国，专利号：ZL 202211735771.6，申请日：2022-12-30；授权日：2025年10月28日

  [4] 刘洁,薛程,付心仪。（外观）用于情绪感知的椅子：中国，专利号：ZL202230557005.X，申请日：2022-08-24；授权日：2022-12-27

  [5] 刘洁,薛程,JEUNG JIHONG,何沐菲,付心仪。一种情绪感知方法、系统及存储介质：中国，专利号：ZL 202211020906.0，申请日：2022-08-24；授权日；2024-11-5

  [6] 付心仪，徐迎庆，张鹤，薛程，何爽，孙喆，高莹婷。智能家居综合实验系统及数据处理方法：中国，专利号：ZL202210863171.1，申请日：2022年7月20日；授权日：2024年8月26日

  [7] 徐迎庆，孙喆，付心仪。图像处理系统、方法、设备、可读存储介质及程序产品：中国，专利号：ZL202110762134.7，申请日：2021-04-13；授权日：2024-09-20

  [8] 付心仪，朱雅鑫，徐迎庆。基于姿态的情感识别方法及装置：中国，专利号：ZL202010183739.6, 申请日：2020-03-16；授权日：2023-05-23 

  [9] 付心仪，韩奕，魏文，徐迎庆。破损壁画修复方法及系统：中国，专利号：ZL201710199268.6，申请日：2017-03-29，授权日：2020-10-30 

  [10] 王功明，徐迎庆，付心仪，魏文，严娴，张映雪。基于NPsim矩阵的近邻颜色搜索方法及装置：中国，专利号：ZL201510108710.0， 申请日：2015-03-12，授权日：2018-04-10

  [11] 王功明，徐迎庆，冼枫，付心仪，魏文，严娴。烟熏壁画动态形成过程的模拟方法：中国，专利号：ZL201510063876.5，申请日：2015-02-06，授权日：2017-07-07

  [12] 王功明，徐迎庆，魏文，付心仪。烟熏效果真实感模拟方法：中国， 专利号：ZL201410331612.9，申请日：2014-07-11，授权日：2017-02-15