{"id":1214,"date":"2016-10-27T18:34:20","date_gmt":"2016-10-27T22:34:20","guid":{"rendered":"https:\/\/sites.bu.edu\/guentherlab\/?page_id=1214"},"modified":"2016-10-28T17:30:52","modified_gmt":"2016-10-28T21:30:52","slug":"neural-prosthetics-for-speech-restoration","status":"publish","type":"page","link":"https:\/\/sites.bu.edu\/guentherlab\/research-projects\/neural-prosthetics-for-speech-restoration\/","title":{"rendered":"Neural Prosthetics for Speech Restoration"},"content":{"rendered":"<p>In collaboration with Dr. Philip Kennedy and colleagues at <a href=\"http:\/\/www.neuralsignals.com\/\" target=\"_blank\">Neural Signals, Inc.<\/a>, we created the world&#8217;s first brain-computer interface for real-time speech generation in 2007. This system decoded neural signals recorded from an electrode implanted in the speech motor cortex of a human volunteer with locked-in syndrome (characterized by full consciousness with near-complete paralysis) while he imagined speaking. This work received widespread coverage in the popular media, including pieces by\u00a0<a href=\"http:\/\/www.cnn.com\/2007\/HEALTH\/conditions\/12\/14\/locked.in\/index.html\" target=\"_new\">CNN<\/a>,\u00a0the<span>\u00a0<\/span><a href=\"http:\/\/www.boston.com\/news\/health\/articles\/2008\/07\/27\/out_of_silence_the_sounds_of_hope\/\" target=\"_new\">Boston Globe<\/a>, and\u00a0<a href=\"http:\/\/www.esquire.com\/news-politics\/a4972\/unspeakable-odyssey-motionless-boy-1008\/\" target=\"_blank\">Esquire Magazine<\/a>. A schematic of the brain-computer interface is provided below; further details about the system can be found in <a href=\"http:\/\/www.plosone.org\/article\/info:doi\/10.1371\/journal.pone.0008218\" target=\"_blank\">Guenther et al. (2009)<\/a>.<\/p>\n<p><img loading=\"lazy\" src=\"\/guentherlab\/files\/2016\/10\/Guenther_fig1-633x636.jpg\" alt=\"Guenther_fig1\" width=\"633\" height=\"636\" class=\"alignnone size-medium wp-image-1292\" srcset=\"https:\/\/sites.bu.edu\/guentherlab\/files\/2016\/10\/Guenther_fig1-633x636.jpg 633w, https:\/\/sites.bu.edu\/guentherlab\/files\/2016\/10\/Guenther_fig1-150x150.jpg 150w, https:\/\/sites.bu.edu\/guentherlab\/files\/2016\/10\/Guenther_fig1-1020x1024.jpg 1020w, https:\/\/sites.bu.edu\/guentherlab\/files\/2016\/10\/Guenther_fig1.jpg 1897w\" sizes=\"(max-width: 633px) 100vw, 633px\" \/><\/p>\n<p><strong>Schematic of a brain-computer interface for real-time speech generation (Guenther et al., 2009).<\/strong><\/p>\n<p>In more recent work, we developed a novel speech synthesizer that provides natural-sounding speech using a simple 2-dimensional input\u00a0that can be generated via brain signals or muscle signals collected with electromyography (EMG). The video below, created by members of the <a href=\"http:\/\/sites.bu.edu\/stepplab\/\" target=\"_blank\">Stepp Lab<\/a> at Boston University, shows a user controlling this synthesizer via EMG signals from the face.<\/p>\n<div style=\"width: 1920px;\" class=\"wp-video\"><!--[if lt IE 9]><script>document.createElement('video');<\/script><![endif]-->\n<video class=\"wp-video-shortcode\" id=\"video-1214-1\" width=\"1920\" height=\"1080\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"\/guentherlab\/files\/2016\/10\/FrankSynth-video.mp4?_=1\" \/><a href=\"\/guentherlab\/files\/2016\/10\/FrankSynth-video.mp4\">\/guentherlab\/files\/2016\/10\/FrankSynth-video.mp4<\/a><\/video><\/div>\n<h4>Publications<\/h4>\n<ul>\n<li><span>Cler M.J., Nieto-Castanon A., Guenther F.H., Fager, S., and Stepp C.E. (2016). <\/span><a href=\"http:\/\/www.tandfonline.com\/doi\/abs\/10.3109\/07434618.2016.1170205\" target=\"_blank\">Surface electromyographic control of a novel phonemic interface for speech synthesis<\/a><span>. <em>Augmentative and Alternative Communication<\/em>,\u00a0<\/span><strong>32<\/strong><span>, pp. 120-130. NIHMSID: NIHMS802522<\/span><\/li>\n<li><span>Brumberg, J.S., Wright, E.J., Andreasen, D.S., Guenther, F.H., and Kennedy, P.R. (2011). <\/span><a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/21629876\" target=\"_blank\">Classification of intended phoneme production from chronic intracortical microelectrode recordings in speech motor cortex. <\/a><i>Frontiers in Neuroscience<\/i><span>, <\/span><b>5<\/b><span>, Article 65. PMCID: PMC3096823<\/span><\/li>\n<li><span>Brumberg, J.S., Nieto-Castanon, A., Kennedy, P.R. and Guenther, F.H. (2010) <\/span><a href=\"http:\/\/www.bu.edu\/speechlab\/files\/2011\/10\/Brumberg-et-al-2010-BCIs-for-Speech.pdf\" target=\"_blank\">Brain-computer interfaces for speech communication.<\/a><span> <\/span><em>Speech Communication,<\/em><span> <\/span><strong>52 <\/strong><span>(4), 367-379. PMCID:PMC2829990<\/span><\/li>\n<li><span>Guenther, F.H., Brumberg, J.S., Wright, E.J., Nieto-Castanon, A., Tourville, J.A., Panko, M., Law, R., Siebert, S.A., Bartels, J.L., Andreasen, D.S., Ehirim, P., Mao, H., and Kennedy, P.R. (2009). \u00a0<\/span><a href=\"http:\/\/www.plosone.org\/article\/info:doi\/10.1371\/journal.pone.0008218\" target=\"_blank\">A wireless brain-machine interface for real-time speech synthesis.<\/a><span> <\/span><em>PLoS ONE,<\/em><span> <\/span><strong>4 <\/strong><span>(12), e8218. PMCID:PMC2784218<\/span><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>In collaboration with Dr. Philip Kennedy and colleagues at Neural Signals, Inc., we created the world&#8217;s first brain-computer interface for real-time speech generation in 2007. This system decoded neural signals recorded from an electrode implanted in the speech motor cortex of a human volunteer with locked-in syndrome (characterized by full consciousness with near-complete paralysis) while [&hellip;]<\/p>\n","protected":false},"author":3849,"featured_media":0,"parent":1211,"menu_order":7,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/pages\/1214"}],"collection":[{"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/users\/3849"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/comments?post=1214"}],"version-history":[{"count":11,"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/pages\/1214\/revisions"}],"predecessor-version":[{"id":1347,"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/pages\/1214\/revisions\/1347"}],"up":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/pages\/1211"}],"wp:attachment":[{"href":"https:\/\/sites.bu.edu\/guentherlab\/wp-json\/wp\/v2\/media?parent=1214"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}