From an evolutionary perspective, language and gesture belong together as a system, serving communication on both an abstract and a physical level. In aphasia, when language is impaired, patients make use of gestures. Laboratory research has provided evidence that gesture can support aphasia rehabilitation, or more specifically, anomia rehabilitation. Here, we test an anomia gesture-based rehabilitation scenario with a virtual trainer (VT) in augmented reality (AR) as a therapy simulation. Thirty German-speaking participants were trained on 27 biand three-syllabic words of Vimmi, an artificial language. Each Vimmi word was paired to a function word in German. The participants were divided into two Groups of 15 and 15 persons. Group A learned word pairs by observing the gestures performed by the VT and additionally imitating them. Group B learned 27 word-pairs by observing the VT standing still and listening to them. Participants were trained singularly for 3 days, alternating one day of training with one day of rest for memory consolidation. Word retention was assessed immediately after each training session by means of free and cued recall tests administered electronically. Group A and Group B did not differ in word retention. When subdividing participants in high and low performers, interactions showed that high performers benefitted more from gesture-based training than low performers. The data in this preliminary study do not speak in favour of VTs as possible tools in gesture-based AR language rehabilitation. Technology might have, in this case, detrimental effects on word learning.

Macedonia, M., Greiner, J., Repetto, C., Wriessnegger, S. C., Gesture based word (re)acquisition with a virtual agent in augmented reality: A preliminary study, Contributed paper, in Annual Review of Cybertherapy and Telemedicine 2022Metaverse Creates New Opportunities in Healthcare, (milano, 13-15 September 2021), Interactive Media Institute, San Diego 2022:20 83-86 [http://hdl.handle.net/10807/212184]

Gesture based word (re)acquisition with a virtual agent in augmented reality: A preliminary study

Repetto C.;
2022

Abstract

From an evolutionary perspective, language and gesture belong together as a system, serving communication on both an abstract and a physical level. In aphasia, when language is impaired, patients make use of gestures. Laboratory research has provided evidence that gesture can support aphasia rehabilitation, or more specifically, anomia rehabilitation. Here, we test an anomia gesture-based rehabilitation scenario with a virtual trainer (VT) in augmented reality (AR) as a therapy simulation. Thirty German-speaking participants were trained on 27 biand three-syllabic words of Vimmi, an artificial language. Each Vimmi word was paired to a function word in German. The participants were divided into two Groups of 15 and 15 persons. Group A learned word pairs by observing the gestures performed by the VT and additionally imitating them. Group B learned 27 word-pairs by observing the VT standing still and listening to them. Participants were trained singularly for 3 days, alternating one day of training with one day of rest for memory consolidation. Word retention was assessed immediately after each training session by means of free and cued recall tests administered electronically. Group A and Group B did not differ in word retention. When subdividing participants in high and low performers, interactions showed that high performers benefitted more from gesture-based training than low performers. The data in this preliminary study do not speak in favour of VTs as possible tools in gesture-based AR language rehabilitation. Technology might have, in this case, detrimental effects on word learning.
Inglese
Annual Review of Cybertherapy and Telemedicine 2022 Metaverse Creates New Opportunities in Healthcare
25th Annual International CyberPsychology, CyberTherapy & Social Networking Conference
milano
Contributed paper
13-set-2021
15-set-2021
Interactive Media Institute
Macedonia, M., Greiner, J., Repetto, C., Wriessnegger, S. C., Gesture based word (re)acquisition with a virtual agent in augmented reality: A preliminary study, Contributed paper, in Annual Review of Cybertherapy and Telemedicine 2022Metaverse Creates New Opportunities in Healthcare, (milano, 13-15 September 2021), Interactive Media Institute, San Diego 2022:20 83-86 [http://hdl.handle.net/10807/212184]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/10807/212184
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact