基于语料语义的脑电反应一致性研究
作者单位:

清华大学 电子工程系


A Study of EEG Response Coherence Based on Corpus Semantics
Author:
Affiliation:

Department of Electronie Engineering, Tsinghua University

  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献
  • | |
  • 引证文献
  • | |
  • 文章评论
    摘要:

    本研究通过测量语音相关的脑电信号变化来研究人脑对于标准语料的反应趋势。有16名被测者分别聆听了120条标准语音,每条8秒钟,语音之间有1-2秒的间隔且随机播放。提取被测者在聆听过程中的脑电信号,对1-40Hz频段的脑电信号进行预处理并将其与语音信号进行分析比对。结果显示被测者听到相同标准语音时,有相同的脑电反应趋势。此外,本文还通过相锁值方法对脑电信号和语音信号进行相位差分析,证明了脑电信号与语音质量之间的功能连接性,并且脑电信号能正确区分语音质量的正确率达到99.62%。

    Abstract:

    This study investigated the tendency of the human brain to respond to a standardized corpus of speech by measuring changes in speech-related EEG signals. Sixteen subjects listened to 120 standardized speech items for 8 seconds each, with 1-2 second intervals between the items and played randomly. The EEG signals were extracted during the listening process, the EEG signals in the frequency band of 1-40 Hz were preprocessed and analyzed, then compared them with speech signals. The results show that subjects have the same trend of EEG response when they hear the same standard speech. In addition, this paper also measured the phase difference between the EEG and speech signals by the phase-locked value method, which proved the functional connectivity between the EEG signals and speech quality. Furthermore, the EEG signals could distinguish the speech quality with a correct rate of 99.62%.

    参考文献
    Bar O, Shallom I D. Speech quality assessment using EEG signals[C]//2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE). IEEE, 2016: 1-5.
    Uhrig S, M?ller S, Voigt-Antons J N. Dissociating Perceptual Quality Dimensions of Transmitted Speech Using Electroencephalography[C]//2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 2018: 1-3.
    Medina J. Brain Rules [M]. 2016.
    Keitel A., Gross J., Kayser C. Perceptually relevant speech tracking in auditory and motor cortex reflects distinct linguistic features [J]. PLOS Biology, 2018, 16(3).
    Luo H., Poeppel D. Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex [J]. Neuron, 2007, 54(6): 1001-10.
    Liberto G. M. D., O''Sullivan J., Lalor E. C. Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing [J]. Current Biology, 2015, 25(19): 2457-65.
    Ding N., Simon J. Z. Emergence of neural encoding of auditory objects while listening to competing speakers [J]. Proceedings of the National Academy of Sciences of the United States of America, 2012, 109(29): 11854-9.
    Destoky F., Philippe M., Bertels J., et al. Comparing the potential of MEG and EEG to uncover brain tracking of speech temporal envelope [J]. NeuroImage, 2019, 184(201-13).
    Nourski K. V., Reale R. A., Oya H., et al. Temporal envelope of time-compressed speech represented in the human auditory cortex [J]. The Journal of Neuroscience, 2009, 29(49): 15564-74.
    Peelle J. E., Gross J., Davis M. H. Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension [J]. Cerebral Cortex, 2013, 23(6): 1378-87.
    Koskinen M., Seppa M. Uncovering cortical MEG responses to listened audiobook stories [J]. NeuroImage, 2014, 100(263-70).
    Lachaux J P, Rodriguez E, Martinerie J, et al. Measuring Phase Synchrony in Brain Signals[J]. Hum Brain Mapping, 1999, 8(4): 194-208.
    Allefeld C, Kurths J. Multivariate Phase Synchronization Analysis of EEG Data[J]. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2003, 86(9): 2218-2221.
    Allefeld C, Kurths J. An Approach to Multivariate Phase Synchronization Analysis and Its Application to Event-Related Potentials[J]. International Journal of Bifurcation and Chaos, 2004, 14(2): 417-426.
    Rosenblum M G, Pikovsky A S, Kurths J. Phase Synchronization of Chaotic Oscillators[J]. Physical Review Letters, 1996, 76(11): 1804-1087.
    Li D, Li X, Cui D, et al. Phase Synchronization with Harmonic Wavelet Transform with Application to Neuronal Populations[J]. Neurocomputing, 2011, 74(17): 3389-3403.
    Huang N E, Shen Zhen, Long S R, et al. The Empirical Mode Decomposition and the Hilbert Spectrum for Nonlinear and Non-Stationary Time Series Analysis[J]. Proceedings of The Royal Society A Mathematical Physical and Engineering Sciences, 1998, 454: 903-995.
    李昕,范梦頔,孙小棋等.基于改进锁相位算法的脑区功能同步性研究[J].生物医学工程学杂志,2018,35(03):350-357.
    陈东毅,陈建国,李玉榕.结合经验模态分解能量矩占比和方差贡献率法的步态信号特征向量提取[J].物联网技术,2019,9(02):35-39+42.DOI:10.16667/j.issn.2095-1302.2019.02.007
    Zoefel B, Huster R J, Herrmann C S. Neurofeedback Training of the Upper Alpha Frequency Band in EEG Improves Cognitive Performance[J]. NeuroImage, 2011, 54(2): 1427-1431.
    Aviyente S, Bernat E M, Evans W S, et al. A Phase Synchrony Measure for Quantifying Dynamic Functional Integration in the Brain[J]. Human Brain Mapping, 2001, 32(3):80-93.
    Lachaux J P, Rodriguez E, Martinerie J, et al. Measuring Phase Synchrony in Brain Signals[J]. Human Brain Mapping, 1999, 8(11):194-208.
    相似文献
    引证文献
    引证文献 [0]
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

宋奇蔚,葛宁,向涛.基于语料语义的脑电反应一致性研究[J].南京信息工程大学学报,,():

复制
分享
文章指标
  • 点击次数:11
  • 下载次数: 0
  • HTML阅读次数: 0
  • 引用次数: 0
历史
  • 收稿日期:2024-07-05
  • 最后修改日期:2024-10-08
  • 录用日期:2024-10-08

地址:江苏省南京市宁六路219号    邮编:210044

联系电话:025-58731025    E-mail:nxdxb@nuist.edu.cn

南京信息工程大学学报 ® 2025 版权所有  技术支持:北京勤云科技发展有限公司