报告题目:智能人机交互展望(Towards Intelligent Human-Machine Interactions)
报告时间地点:2017年8月18日上午9:00-11:00,机电学院二楼会议室
报告人:林英姿教授,人机智能交互实验室主任,美国东北大学
Professor Yingzi Lin, Director of Intelligent Human-Machine Systems (IHMS) Laboratory, Northeastern University, Boston, MA 02115 USA
(http://www1.coe.neu.edu/~yilin/)
在本次报告会上,林教授将对多年在智能人机交互方面的研究项目进行一个总体的概述,尤其是在非侵入式生物传感和多模态融合方面,同时也探讨到未来智能人机交互的科学和技术。
智能人机系统实验室(IHMS)的研究方向范围十分广泛,涉及从驾驶员行为分析到医疗安全等多方面应用。以人机交互作为研究重点,该实验室使用生理传感器用于收集相关的测试数据,并把它用于机器操作的输入。虽然实验室项目范围广泛,但是它们有着一致的目标:改善人机交互的水平和质量。一些项目包括:使用生理线索(心跳,呼吸速率,视觉和脑电图)用于推断人的主观意识和情感,例如恐惧,沮丧,或愤怒。通过了解在特定的受控的情况下(例如,开车,与机器人互动,记忆测试)实验者的认知状态可以很好地理解人们如何反应和处理某些特定的事件。通过给这些对机器的反应提供模型,我们可以用它来预测和调整操作员的状态,来达到人机操作期间的双向意识的沟通。其他的研究项目包括,用生理数据取代传统的人机操作的接口。通过视线和身体手势等,来取代传统的鼠标和键盘接口。这可以让更多的残障人士做到无障碍玩虚拟游戏,保持与外界有良好的沟通,也可以作为他们身体康复的方法。另外,我们开发的视觉传感器系统已经被证明可以替代手持控制器来控制一个四轴飞行器。
尽管人类状态和行为的建模有着强大的技术和社会意义,它依然是科学技术发展的最大挑战之一。众所周知,由于人类意识状态和行为的高度非线性,不确定性,随机性等特点,这在很多学科中是一个挑战。所幸的的是,人机交互已经获得了举世关注。本实验室秉承着更安全,更方便,更安全和更有效的人机交互目标,与天下英才合作。
In this seminar, I will give an overview of my research projects in the emerging research area of intelligent human-machine interactions, in particular nonintrusive biosensing, multimodal fusion, as well as sciences and technologies towards future intelligent human-machine interactions.
Work in my Intelligent Human Machine Systems (IHMS) Laboratory covers a wide range of applications, from driver performance analysis in transportation to patient safety in healthcare. With a focus on interaction between humans and machines, physiological sensors are used both to collect relevant data during testing, as well as an input for machine operation. While the nature of the work can seem broad, it is all working towards the same goal – to improve the level and quality of communication between humans and machines.
Sample projects include:Physiological cues such as heart rate, respiration rate, eye gaze state and electroencephalography can be used to infer a human subject’s cognitive state, for example, inference of levels of fear, frustration, or anger. Collecting this type of data while subjects run through one of the many simulations developed in my lab. Understanding cognitive state during specific, controlled scenarios while the subject is tasked to drive a car, interact with a robot, memorize and recall a list of words, or take a series of geometric based tests, can develop an understanding of how people react to and handle certain situations. Providing a model of these reactions to a machine can allow it to predict and adapt to the state of a human operator, allowing for 2-way awareness and assistance during human-machine operation. Other work uses physiological cues to replace traditional interfaces during human operation. Eye gaze and simple hand gestures have been proven to replace the traditional mouse and keyboard interface for playing virtual games, which can allow greater accessibility to disabled users, as well as serve as a foundation for new at home physical rehabilitation practices. A system of eye gestures has been proven to replace a hand held controller to pilot a quad copter, which increases accessibility of control.
Despite its great technical and social significance, the modeling of human states and behaviors remains one of the greatest challenges in science and technology development. It is known that human states and behaviors are highly nonlinear, uncertain, and random, which challenges many scientific disciplines. Human machine operation has a significant and ever growing presence in our world. My work aims safer, more accessible and productive cooperation between humans and machines for the future.
林英姿博士简介
林英姿博士是美国Northeastern University的终身教授,现任工学院机械与工业工程系智能人机系统实验室的主任。近年来,她的科研获得美国国家自然科学基金(NSF)、加拿大自然科学及工程基金(NSERC)及如通用GM、Bose公司等企业合作研究的项目资助。林英姿教授获得一系列科研奖项,其中包含美国国家自然科学基金NSF CAREER Award,加拿大自然科学及工程基金NSERC University Faculty Award。发表100篇以上期刊、书籍和会议论文。研究领域包括:智能人机系统,驾驶员车辆系统,智能结构和系统,传感器及传感系统,多模态信息融合,人机界面设计以及人机友好一体化等。林英姿教授曾是美国人机工程学会(HFES)虚拟环境技术分会主席,美国国家科学委员会交通研究学会TRB委员。她曾任IEEE Trans. on Systems, Man and Cybernetics - Part A: Systems and Humans的副主编,以及多个著名刊物以及国际会议的特邀审阅专家,同时一直活跃在先进传感器技术、机电一体化系统、动力与控制系统、高级智能材料及智能结构、以及人机交互领域等领域的国际会议的组织工作中。
Dr. Yingzi LINis the director of the Intelligent Human-Machine Systems (IHMS) Laboratory, and an Associate Professor (tenured) with the Department of Mechanical and Industrial Engineering, College of Engineering, Northeastern University, Boston, MA, USA. Her research has been funded by the National Science Foundation (NSF), Natural Sciences and Engineering Research Council of Canada (NSERC), and major industries. She is a recipient of a few prestigious research awards, including a NSF CAREER award and a NSERC UFA (University Faculty Award). She has published over 100 technical papers in referred journals and conference proceedings. Her area of expertise includes: intelligent human-machine systems, driver-vehicle systems, smart structures and systems, sensors and sensing systems, multimodality information fusion, human machine interface design, and human friendly mechatronics. Dr. Lin was the Chair of the Virtual Environments Technical Group of the Human Factors and Ergonomics Society (HFES). She was on the committees of the Transportation Research Board (TRB) of the National Academy of Sciences. She served as an Associate Editor of the IEEE Trans. on Systems, Man and Cybernetics - Part A: Systems and Humans. In addition, Professor Lin has been a reviewer for many professional journals and conferences. She has also been on the organizing committee of a number of professional meetings in the areas of Advanced Sensors, Mechatronic Systems, Dynamic Systems and Control, Advanced Smart Materials and Smart Structures, and human-machine interaction.