神级合作！脑机接口+游戏=？

近期，上海交大瑞金医院和

出品爆款游戏《原神》的米哈游公司

签署战略合作协议

双方以中国脑计划的实施为契机

积极助推建设瑞金医院脑病中心

该中心旨在以神经调控与脑机接口

临床应用为突破口

共研脑机接口技术

助力医学服务与研究的数字化、

移动化、远程化和智能化

电院吕宝粮教授担任中心实验室主任

此次合作，双方将结合各自在医学临床研究和信息技术领域的优势，合作共建“瑞金医院脑病中心米哈游联合实验室”。

电院吕宝粮表示，该团队目前正在使用多模态脑机接口技术采集抑郁症患者的脑电、眼动等多模态数据，探索抑郁症的客观评估方法，这是目前阶段的主要研究任务。“未来，米哈游将为该系统设计游戏，我们可以采集患者在玩游戏过程中的脑电和眼动等多模态数据，以评估游戏过程中抑郁症患者的注意力、睡眠质量和情绪状态，同时为未来的交互游戏设计提供生理数据和认知科学的技术支撑。”

研究人员帮助受试者戴上头盔，以追踪他的脑电波

实验室有一台装有跟踪眼睛运动和脑电波的设备的多模态脑机接口系统。当用户戴上头盔观看视频并回答互动问题时，他的脑电波和眼动会被记录下来。吕宝粮说：“我们发现健康人与抑郁症患者在这些指标上存在一些差异，我们希望能找出一些明确的规则或标准来帮助医生做出判断。”

“目前，抑郁症的诊断主要取决于患者的描述和医生基于量表的主观判断。”吕宝粮表示，“我们的研究有望为该过程增加更多客观指标，并有助于更好地评估抑郁症，这是我们研究的一个主要目标。”

从长远来看，实验室则希望开发出用于治疗该疾病的产品。吕宝粮说：“例如，我们可以开发一种游戏来调整患者的情绪。或者我们也可以创建一个机器人帮助病人在家中记录生活，监测病人的病情和治疗效果。同时，该机器人还可以根据病人的病情与病人进行互动。”

此外，这种产品可以帮助采集患者的多模态生理数据，以支撑难治性抑郁症患者脑深部电刺激疗法—该疗法使用脑深部电刺激技术增强或降低情感神经回路的活动。

上海交通大学教授，新实验室主任吕宝粮（左）展示了该系统如何跟踪眼球运动

瑞金医院功能神经外科的医生张陈诚表示，这项研究对于将抑郁症作为一种数字疗法是重要的，这是处于医学前沿的以证据为基础的治疗干预措施，这些干预措施由高质量的软件程序驱动，旨在预防、管理或治疗医学疾病。

“常规检查如血液检查无法诊断抑郁症。” 张陈诚说，“我们必须根据患者的行为做出判断。一些数字方法可以帮助我们收集信息并分析患者的行为，然后制定出包括传统疗法和新技术在内的个性化疗法。此外，治疗抑郁症需要很长时间，我们需要这样的方法来帮助我们监控患者的病情并采取预防措施，例如家用护理机器人。”

吕宝粮表示，当脑机接口技术成熟时，它将可以用于治疗其他精神疾病。

联合实验室目前已围绕“难治性抑郁症脑机接口神经调控治疗临床研究”项目开展联合攻关，未来将依照产学研医相结合模式，形成基础-临床-产业三大环节全链条脑科学研究体系，建设基于虚拟现实技术的数字疗法，以高参与度且便捷的方式管理治疗措施，可实现不受制于患者日程安排并在他们熟悉的私密环境中提供干预，减少由传统药物提供过程中所带来的困扰，形成云慢病闭环管理体系，实现慢病从预防-诊疗-康复-随访的全程防控体系的建设。

相关英文报道

Shanghai Jiao Tong University’s Ruijin Hospital and gaming company MiHoYo have signed an agreement for a laboratory to explore brain-computer interface technology and its use in clinical medicine.

The two parties will work together in technology development and talent cultivation to make the lab influential in education, research, application and industry in terms of brain-computer interface technology.

The hospital launched a brain-computer interface center last year to research using the new technology in diagnosing and treating depression. MiHoYo, developer of popular game “Genshin Impact,” is now joining the efforts.

According to Lu Bao-Liang, a professor at the university and director of the new lab, the team is currently using videos and interactive questions to collect data on indexes for diagnosing depression, a primary stage of their research.

“In the future, MiHoYo will design games for the program in which we can collect information such as brain waves and eye movement data to assess attention of patients from depression during playing,” he said.

In the process, Lu said, the company can also collect interactive data for future game desig

There is a computer equipped with devices tracking eye movements and brain waves at the lab. When a user put on a helmet to watch videos and answer the interactive questions, his brain waves and eye movements were recorded.

"We've found some differences in these indexes between healthy people and depression patients but will try to find out some definite rules or standards to help doctors make judgments," said Lu.

More indexes, including facial expression, voice and skin conductance, will be added to the system.

“Currently, the diagnosis of depression mainly depends on description by patients and observation of doctors, which are subjective,” said Lu. “Our research is expected to add more objective parameters to the process and help better treat depression — a short-term goal of our research.”

In the long run, the lab is looking forward to developing products for treating the illness.

“For example, we can develop a game to adjust patients’ emotions,” said Lu. "Or we can also create a robot which the patient can have at home to record his life so as to assist doctors monitoring his condition and therapy efficacy. The robot can also interact with the patient according to his condition.

“Also, we can help collect data to support deep-brain stimulation therapy for refractory depression patients — which uses a technique called neuromodulation to either enhance or reduce activity in the nervous system.”

Zhang Chencheng, a doctor at Ruijin's functional neurosurgery department, said the research was important for treating depression as a kind of digital therapeutics, a frontier in medicine featuring evidence-based therapeutic interventions driven by high-quality software programs to prevent, manage, or treat a medical disorder or disease.

"Depression cannot be diagnosed with conventional tests, such as blood tests," he said. "We have to make a judgment according to patients' behavior. Some digital approaches can help us collect information and analyze their behavior and then work out individualized therapies, including traditional therapies and new technologies. And also, curing depression takes a long time and we need such approaches to help us monitor the condition of patients and take preventative actions, such as a caring robot at home."

Lu said that when the brain-computer interface technology matures, it can be used to treat other mental diseases.

来源：上海日报SHINE

排版 | 董彦君

编辑 | 曾玉竹

点亮“在看”，为合作创新点赞！