TY - GEN
T1 - Investigating the temporal dynamics of auditory cortical activation to silent lipreading
AU - Crosse, Michael J.
AU - Elshafei, Hesham A.
AU - Foxe, John J.
AU - Lalor, Edmund C.
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2015/7/1
Y1 - 2015/7/1
N2 - Neuroimaging research has demonstrated that observing visual speech in the absence of auditory speech activates primary auditory cortex. However, it remains unclear what this activation precisely reflects. It is well established that, during continuous auditory speech, neural activity in auditory cortex tracks the temporal envelope of the speech signal. Recently, it has been suggested that this process may in fact reflect an internal synthesis of the speech stream rather than the encoding of the envelope per se. Could silent lipreading therefore elicit a similar 'entrainment' to the envelope in the absence of auditory speech? Here, we test this hypothesis by examining the impact of lipreading accuracy on envelope tracking using electroencephalography (EEG). We provide evidence to suggest that the EEG response over left temporal scalp tracks the unheard speech more faithfully during accurate lipreading. We also demonstrate that the envelope can be reconstructed from EEG data recorded during silent lipreading with accuracy above chance level. This could have implications for brain-computer interface technology.
AB - Neuroimaging research has demonstrated that observing visual speech in the absence of auditory speech activates primary auditory cortex. However, it remains unclear what this activation precisely reflects. It is well established that, during continuous auditory speech, neural activity in auditory cortex tracks the temporal envelope of the speech signal. Recently, it has been suggested that this process may in fact reflect an internal synthesis of the speech stream rather than the encoding of the envelope per se. Could silent lipreading therefore elicit a similar 'entrainment' to the envelope in the absence of auditory speech? Here, we test this hypothesis by examining the impact of lipreading accuracy on envelope tracking using electroencephalography (EEG). We provide evidence to suggest that the EEG response over left temporal scalp tracks the unheard speech more faithfully during accurate lipreading. We also demonstrate that the envelope can be reconstructed from EEG data recorded during silent lipreading with accuracy above chance level. This could have implications for brain-computer interface technology.
UR - http://www.scopus.com/inward/record.url?scp=84940386154&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84940386154&partnerID=8YFLogxK
U2 - 10.1109/NER.2015.7146621
DO - 10.1109/NER.2015.7146621
M3 - Conference contribution
AN - SCOPUS:84940386154
T3 - International IEEE/EMBS Conference on Neural Engineering, NER
SP - 308
EP - 311
BT - 2015 7th International IEEE/EMBS Conference on Neural Engineering, NER 2015
PB - IEEE Computer Society
T2 - 7th International IEEE/EMBS Conference on Neural Engineering, NER 2015
Y2 - 22 April 2015 through 24 April 2015
ER -