{"id":11065,"date":"2023-08-29T01:31:05","date_gmt":"2023-08-29T01:31:05","guid":{"rendered":"https:\/\/nft.runfyers.com\/index.php\/2023\/08\/29\/stroke-survivors-thoughts-transformed-into-talking-digital-avatar\/"},"modified":"2023-08-29T01:31:05","modified_gmt":"2023-08-29T01:31:05","slug":"stroke-survivors-thoughts-transformed-into-talking-digital-avatar","status":"publish","type":"post","link":"https:\/\/nft.runfyers.com\/index.php\/2023\/08\/29\/stroke-survivors-thoughts-transformed-into-talking-digital-avatar\/","title":{"rendered":"Stroke Survivor&#8217;s Thoughts Transformed into Talking Digital Avatar"},"content":{"rendered":"<p><\/p>\n<div>\n<p>The technology to transform brain waves into speech has been in development for a number of years. Now, there has been a great leap in advancement, thanks to video game technology and AI. Read on to find out more about this groundbreaking discovery.<\/p>\n<p><strong>TL;DR:<\/strong><\/p>\n<ul>\n<li>Video game technology aids paralysed woman in regaining communication abilities.<\/li>\n<li>Brain-computer interface developed by Speech Graphics, UCSF, and UC Berkeley generates speech and facial expressions from brain signals.<\/li>\n<li>Avatar-based communication through synthesized voice and facial animation marks a significant advancement in restoring natural communication for those unable to speak.<\/li>\n<\/ul>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" fetchpriority=\"high\" class=\"aligncenter size-full wp-image-124838\" src=\"https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am.png\" alt=\"image of a brain to demonstrates brainwaves and speech\" width=\"915\" height=\"540\" srcset=\"https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am.png 915w,   https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am-300x177.png 300w,   https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am-768x453.png 768w,   https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am-95x56.png 95w,   https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am-150x89.png 150w,   https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am-450x266.png 450w\" sizes=\"(max-width: 915px) 100vw, 915px\"\/><\/noscript><\/p>\n<h2><span id=\"Transforming_Brain_Waves_to_Speech_Through_a_Digital_Avatar\">Transforming Brain Waves to Speech Through a Digital Avatar<\/span><\/h2>\n<p>Video game technology has played a groundbreaking role in helping a woman regain her ability to communicate, after she was left paralysed following a stroke. Now, she can communicate again \u2013 through a digital avatar.<\/p>\n<p>Researchers from Edinburgh-based Speech Graphics, UC San Francisco (UCSF), and <a href=\"https:\/\/www.berkeley.edu\" target=\"_blank\" rel=\"noopener\">UC Berkeley<\/a> have developed the world\u2019s first brain-computer interface that generates speech and facial expressions from brain signals. Therefore, this development offers hope for restoring natural communication among those unable to speak.<\/p>\n<h2><span id=\"How_Does_the_Software_Work\">How Does the Software Work?<\/span><\/h2>\n<p>Utilizing software akin to that used in video games like The Last Of Us Part II and Hogwarts Legacy, brain waves are transformed into a <a href=\"https:\/\/nftevening.com\/one-avatar-many-worlds-decentralands-vrm-update-brings-metaverse-unity\/\" target=\"_blank\" rel=\"noopener\">digital avatar.<\/a> This avatar is capable of speech and also facial animation. The study focused on a woman named Ann, converting her brain signals into three forms of communication. The communication forms are text, synthetic voice, and also facial animation on a digital avatar. This further includes lip sync and emotional expressions. Remarkably, this marks the first time facial animation has been synthesized from brain signals.<\/p>\n<p>Led by UCSF\u2019s chairman of neurological surgery, Edward Chang, the team implanted a paper-thin rectangle of 253 electrodes onto the woman\u2019s brain surface. The electrodes intercept signals that would have otherwise reached facial muscles. These electrodes are then connected to computers via a cable. Following this, AI algorithms were trained over weeks to recognize brain activity.<\/p>\n<h2><span id=\"Real-Time_Facial_Expressions_and_Speech_From_Brain_Waves\">Real-Time Facial Expressions and Speech From Brain Waves<\/span><\/h2>\n<p>The woman achieved text writing and speaking using a synthesized voice based on past recordings. Moreover, the AI decoded her brain activity into facial movements, transforming her thoughts into real-time facial expressions. One method involved using the subject\u2019s synthesized voice to drive muscle actions. These actions were then converted into 3D animation in a video game engine. The end result was \u00a0a lifelike avatar that could pronounce words in sync with the synthesized voice.<\/p>\n<p>This technology represents a major leap in restoring communication to individuals affected by paralysis, offering real-time expression of emotions and nuanced muscle movement.<\/p>\n<p><iframe data-test-id=\"beehiiv-embed\" width=\"100%\" height=\"320\" frameborder=\"0\" scrolling=\"no\" style=\"border-radius: 4px; border: 2px solid #e5e7eb; margin: 0; background-color: transparent;\" class=\"perfmatters-lazy\" data-src=\"https:\/\/embeds.beehiiv.com\/37fed65e-f01c-4c4c-b8f1-1b71da0be0a4\"><\/iframe><noscript><iframe loading=\"lazy\" src=\"https:\/\/embeds.beehiiv.com\/37fed65e-f01c-4c4c-b8f1-1b71da0be0a4\" data-test-id=\"beehiiv-embed\" width=\"100%\" height=\"320\" frameborder=\"0\" scrolling=\"no\" style=\"border-radius: 4px; border: 2px solid #e5e7eb; margin: 0; background-color: transparent;\"><\/iframe><\/noscript><\/p>\n<div class=\"bottom-text__wrapper post-content\">\n<p>\u00a0<\/p>\n<hr\/>\n<p><em>All investment\/financial opinions expressed by NFTevening.com are not recommendations.<\/em><\/p>\n<p><em>This article is educational material.<\/em><\/p>\n<p><em>As always, make your own research prior to making any kind of investment.<\/em><\/p>\n<\/div>\n<\/div>\n<p><a href=\"https:\/\/nftevening.com\/stroke-survivors-thoughts-transformed-into-talking-digital-avatar\/\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The technology to transform brain waves into speech has been in development for a number of years. Now, there has been a great leap in advancement, thanks to video game technology and AI. Read on to find out more about this groundbreaking discovery. TL;DR: Video game technology aids paralysed woman in regaining communication abilities. Brain-computer [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":11066,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true},"categories":[9],"tags":[21],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/nftevening.com\/wp-content\/uploads\/2023\/08\/Screen-Shot-2023-08-29-at-11.29.28-am.png","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/11065"}],"collection":[{"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=11065"}],"version-history":[{"count":0,"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/11065\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/11066"}],"wp:attachment":[{"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=11065"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=11065"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nft.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=11065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}