神经解码器最新进展:可将对话脑活动实时转为文字
2898
VR 2019-08-01 00:07:50 字数:762

据英国《自然·通讯》杂志30日发表的一项神经学研究,美国加州大学旧金山分校科学家报告了神经解码器方面的最新进展,其可以将问答对话的相关脑活动,实时转化为文字记录。


神经解码器最新进展:可将对话脑活动实时转为文字


大脑皮层包含不同的区域,其中的神经活动会编码语音感知与生成。此前研究表明,这种脑活动可以被解码,但是一直以来的研究都侧重于将听说任务分开进行解码。

此次,研究人员爱德华·张(音译)及同事,在模拟的问答对话试验中,通过脑活动解码了语音感知与生成。研究的被试者为3名正在接受癫痫治疗的患者,他们要听一系列问题,并通过一套规定的答案,口头回答问题。研究团队则将被试在这个过程中的脑皮层活动记录下来,之后这些数据被用于训练语音检测和解码模型。随后,被试再听一系列问题,并大声地用自己所选的答案作答。

结果显示,仅使用在对话中记录下的神经信号,研究团队便能够检测被试何时在听,何时在说,并且能够预测所听或所说的具体内容是什么。通过解码问题,他们能够利用所得信息提高被解码答案的准确性(部分答案只适用于特定问题)。而且,对于生成语音和感知语音的解码,其准确性分别提高到61%和76%。

现阶段还需要开展进一步工作来解码想象的语音回答,这样在实际应用中,才能让因为损伤或神经退行性疾病而无法说话的患者顺利使用这项技术。

今年4月,该研究团队首次报告研发出一种能将脑活动转化为语音的解码器,当时科学界评价其为“一项非常有力的概念验证”,但“该系统距离真正成为一种临床可行的设备,尚面临许多挑战”。

总编辑圈点

又一项科幻电影里的技术即将成真。最近十年,科学家做到了解码人类大脑中的运动信号,让失去肢体的障碍人士能通过脑电感应设备来控制电动假肢和轮椅。这已经很神奇了。而语音是复杂得多的编码,它从脑电中被还原,令我们意想不到。未来人脑中的视觉印象能否被侦测到呢?如果这也行,那就太惊人了!




0人参与回答
  • 未添加任何数据~~


提示信息

联系电话:
1585150508*
QQ交谈:
小编
站长微信:
站长邮箱: service@qingjiuzhubei.com
449.22msRequest Duration2MBMemory UsageGET zixun/detail/{id?}.htmlRouteAuth status
    • Booting (11.15ms)
    • Application (440.5ms)
      6 templates were rendered
      • site.zixun.detail (resources/views/site/zixun/detail.blade.php)8blade
        Params
        0
        prevArticle
        1
        nextArticle
        2
        newDetail
        3
        comment
        4
        hotnews
        5
        t
        6
        d
        7
        k
      • layouts.site.layout (resources/views/layouts/site/layout.blade.php)18blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        device
        4
        isMobile
        5
        errors
        6
        prevArticle
        7
        nextArticle
        8
        newDetail
        9
        comment
        10
        hotnews
        11
        t
        12
        d
        13
        k
        14
        __empty_1
        15
        __currentLoopData
        16
        loop
        17
        hotnewsVal
      • layouts.site.top (resources/views/layouts/site/top.blade.php)18blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        device
        4
        isMobile
        5
        errors
        6
        prevArticle
        7
        nextArticle
        8
        newDetail
        9
        comment
        10
        hotnews
        11
        t
        12
        d
        13
        k
        14
        __empty_1
        15
        __currentLoopData
        16
        loop
        17
        hotnewsVal
      • layouts.site.bottom (resources/views/layouts/site/bottom.blade.php)18blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        device
        4
        isMobile
        5
        errors
        6
        prevArticle
        7
        nextArticle
        8
        newDetail
        9
        comment
        10
        hotnews
        11
        t
        12
        d
        13
        k
        14
        __empty_1
        15
        __currentLoopData
        16
        loop
        17
        hotnewsVal
      • common.upgrade_vip (resources/views/common/upgrade_vip.blade.php)18blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        device
        4
        isMobile
        5
        errors
        6
        prevArticle
        7
        nextArticle
        8
        newDetail
        9
        comment
        10
        hotnews
        11
        t
        12
        d
        13
        k
        14
        __empty_1
        15
        __currentLoopData
        16
        loop
        17
        hotnewsVal
      • kefu.kefu (resources/views/kefu/kefu.blade.php)18blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        device
        4
        isMobile
        5
        errors
        6
        prevArticle
        7
        nextArticle
        8
        newDetail
        9
        comment
        10
        hotnews
        11
        t
        12
        d
        13
        k
        14
        __empty_1
        15
        __currentLoopData
        16
        loop
        17
        hotnewsVal
      uri
      GET zixun/detail/{id?}.html
      middleware
      web
      controller
      App\Http\Controllers\Site\ZixunController@detail
      namespace
      App\Http\Controllers
      prefix
      /zixun
      where
      as
      zixunDetail
      file
      app/Http/Controllers/Site/ZixunController.php:105-132
      7 statements were executed427.59ms
      • select * from `news` where `news`.`id` = '53967' and `news`.`deleted_at` is null limit 11.7ms/app/Http/Controllers/Site/ZixunController.php:109zzshuju
        Metadata
        Bindings
        • 0. 53967
        Hints
        • Use SELECT * only if you need all columns from table
        • LIMIT without ORDER BY causes non-deterministic results, depending on the query execution plan
        Backtrace
        • 14. /app/Http/Controllers/Site/ZixunController.php:109
        • 22. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 56. /public/index.php:53
      • select * from `new_cates` where `new_cates`.`id` in ('48') and `new_cates`.`deleted_at` is null400μs/app/Http/Controllers/Site/ZixunController.php:109zzshuju
        Metadata
        Bindings
        • 0. 48
        Hints
        • Use SELECT * only if you need all columns from table
        Backtrace
        • 19. /app/Http/Controllers/Site/ZixunController.php:109
        • 27. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 61. /public/index.php:53
      • select * from `news` where `news`.`deleted_at` is null order by `browse` desc limit 10387.6ms/app/Http/Controllers/Site/ZixunController.php:110zzshuju
        Metadata
        Hints
        • Use SELECT * only if you need all columns from table
        Backtrace
        • 12. /app/Http/Controllers/Site/ZixunController.php:110
        • 20. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 54. /public/index.php:53
      • update `news` set `browse` = `browse` + 1, `updated_at` = '2025-05-15 03:06:25' where `id` = '53967' and `news`.`deleted_at` is null8.89ms/app/Http/Model/News/News.php:170zzshuju
        Metadata
        Bindings
        • 0. 2025-05-15 03:06:25
        • 1. 53967
        Backtrace
        • 12. /app/Http/Model/News/News.php:170
        • 13. /app/Http/Controllers/Site/ZixunController.php:111
        • 21. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 55. /public/index.php:53
      • select * from `news` where `id` < '53967' and `newscate_id` = '48' and `news`.`deleted_at` is null order by `id` desc limit 123.42ms/app/Http/Controllers/Site/ZixunController.php:115zzshuju
        Metadata
        Bindings
        • 0. 53967
        • 1. 48
        Hints
        • Use SELECT * only if you need all columns from table
        Backtrace
        • 13. /app/Http/Controllers/Site/ZixunController.php:115
        • 21. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 55. /public/index.php:53
      • select * from `news` where `id` > '53967' and `newscate_id` = '48' and `news`.`deleted_at` is null order by `id` asc limit 15.1ms/app/Http/Controllers/Site/ZixunController.php:116zzshuju
        Metadata
        Bindings
        • 0. 53967
        • 1. 48
        Hints
        • Use SELECT * only if you need all columns from table
        Backtrace
        • 13. /app/Http/Controllers/Site/ZixunController.php:116
        • 21. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 55. /public/index.php:53
      • select * from `comments` where `news_id` = '53967'480μs/app/Http/Controllers/Site/ZixunController.php:117zzshuju
        Metadata
        Bindings
        • 0. 53967
        Hints
        • Use SELECT * only if you need all columns from table
        Backtrace
        • 12. /app/Http/Controllers/Site/ZixunController.php:117
        • 20. /vendor/silber/page-cache/src/Middleware/CacheResponse.php:38
        • 54. /public/index.php:53
        web
        array:2 [ "name" => "Guest" "user" => array:1 [ "guest" => true ] ]
        api
        array:2 [ "name" => "Guest" "user" => array:1 [ "guest" => true ] ]
          _token
          e5I6p61B8XqE2bkFk65ULEjPQGwFgprwOiyQ2mZv
          _previous
          array:1 [ "url" => "http://data.winndoo.cn/zixun/detail/53967.html" ]
          PHPDEBUGBAR_STACK_DATA
          []
          format
          html
          content_type
          text/html; charset=UTF-8
          status_text
          OK
          status_code
          200
          request_query
          []
          request_request
          []
          request_headers
          array:10 [ "accept-encoding" => array:1 [ 0 => "gzip, deflate" ] "accept" => array:1 [ ...
          request_server
          array:33 [ "USER" => "apache" "HOME" => "/usr/share/httpd" "HTTP_ACCEPT_ENCODING" => "gzip, de...
          request_cookies
          []
          response_headers
          array:5 [ "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ ...
          path_info
          /zixun/detail/53967.html
          session_attributes
          array:3 [ "_token" => "e5I6p61B8XqE2bkFk65ULEjPQGwFgprwOiyQ2mZv" "_previous" => array:1 [ "u...