RoDiCA: a Human-Robot Interaction System for Treatment

of Childhood Autism Spectrum Disorders

Isura Ranatunga Nahum A. Torres Rita Patterson
Next Gen Systems Group Next Gen Systems Group UNT Health Science Center
University of Texas at Arlington University of Texas at Arlington 3500 Camp Bowie Blvd.
Arlington, TX 76010 Arlington, TX 76010 Fort Worth, TX 76107
isura.ranatunga nahum.torres-arenas rita.patterson
@mavs.uta.edu @mavs.uta.edu @unthsc.edu

Nicoleta Bugnariu Matt Stevenson Dan O. Popa

UNT Health Science Center Hanson RoboKind Next Gen Systems Group
3500 Camp Bowie Blvd. 1201 Creekfield Dr. University of Texas at Arlington
Fort Worth, TX 76107 Plano, TX 75075 Arlington, TX 76010
nicoleta.bugnariu@unthsc.edu matt@hansonRoboKind.com popa@uta.edu

ABSTRACT
,Q WKLV SDSHU ZH GHVFULEH WKH LPSOHPHQWDWLRQ RI LQWHUDFWLYH
Keywords
URERWLFV LQ YLUWXDO HQYLURQPHQWV DFFRPSOLVKLQJ KXPDQURERW +XPDQ5RERW ,QWHUDFWLRQ $XWLVP 6SHFWUXP 'LVRUGHU 3K\VLFDO
LQWHUDFWLRQ IRU WUHDWPHQW RI $XWLVP 6SHFWUXP 'LVRUGHUV $6'V 7KHUDS\
,QWHUDFWLRQEHWZHHQRXUV\VWHPDQGFKLOGUHQVXIIHULQJIURP$6'V
LV DFFRPSOLVKHG E\ WHDFKLQJ WKHP ERG\ ODQJXDJH VXFK DV KDQG
1. INTRODUCTION
,QUHFHQW\HDUVURERWLFWHFKQRORJLHVKDYHFRPHWRWKHIRUHIURQWLQ
DQGDUPPRWLRQIDFLDOH[SUHVVLRQVDQGVSHHFKWRHQFRXUDJHWKHP
WKHTXHVWWRVROYHYDULRXVSUREOHPVIDFHGE\KXPDQLW\2QHVXFK
WR HQJDJH LQ VRFLDO LQWHUDFWLRQ ZLWK RWKHU KXPDQV DQG IRU
SUREOHP LV D JURXS RI GHYHORSPHQWDO GLVRUGHUV FDOOHG $XWLVP
LPSURYLQJ WKHLU PRWRU VNLOOV $ .LQHFW VHQVRU LV XVHG WR DOORZ
6SHFWUXP 'LVRUGHUV $6'V 7KHVH FRQGLWLRQV DUH GHILQHG E\
GLUHFW FRQWURO RI WKH KXPDQRLG URERW =HQR E\ WKH WKHUDSLVW RU
LPSDLUPHQWV LQ VRFLDO LQWHUDFWLRQ FRPPXQLFDWLRQ DQG UHVWULFWLYH
FKLOGWRHQDEOHG\QDPLFLQWHUDFWLRQ7KHPRWLRQVRI=HQRDQGWKH
DQG UHSHWLWLYHREVHVVLYH EHKDYLRUV $FFRUGLQJ WR WKH &HQWHUV IRU
FKLOGDUHUHFRUGHG VLPXOWDQHRXVO\E\D PRWLRQFDSWXUHV\VWHPWR
DVVHVV WKH LQWHUDFWLRQ 6SHFLILFDOO\ ZH FRPSDUH DUP DQG WRUVR
PRWLRQV RI WKH FKLOG ZKLFK VKRXOG FORVHO\ IROORZ WKRVH RI WKH
URERW 7KLV EHKDYLRU FDQ EH XVHG IRU FOLQLFDO WUHDWPHQW DQG
GLDJQRVLV GXULQJ URERW DVVLVWHG WKHUDS\ 7KHUDSLVWV FDQ WDNH
DGYDQWDJHRIWKLVLQWHUDFWLYHEHKDYLRUWRDFKLHYHGHVLUHGSRVHVRI
WKHURERWWKDWPD\EHEHQHILFLDOWRFKLOGUHQZLWK$6'VWRHQKDQFH
WKHLUPRWRUVNLOOVDVZHOODVWKHLUVRFLDOLQWHUDFWLRQVNLOOV,QRUGHU
WR FRPSDUH WKH PRWLRQ FKDUDFWHULVWLFV RI URERWV DQG VXEMHFWV ZH
XVH YDULRXV PHWULFV VXFK DV FURVV FRUUHODWLRQ DQG VLJQDO QRUP
5HVXOWV VKRZ WKDW WKH FKLOG¶V PRWLRQ IROORZV WKH URERW¶V PRWLRQ
FORVHO\ DQG WKH DQDO\VLV WHFKQLTXHV DUH UHDVRQDEOH LQGLFDWRUV WR
FRPSDUHWKHVLPLODULW\RIWKHKXPDQDQGURERWPRWLRQV
Categories and Subject Descriptors
,>Artificial Intelligence@5RERWLFV±Commercial robots and
applications, Kinematics and dynamics and Operator interfaces.
General Terms
$OJRULWKPV0HDVXUHPHQW3HUIRUPDQFH

3HUPLVVLRQWRPDNHGLJLWDORUKDUGFRSLHVRIDOORUSDUWRIWKLVZRUNIRU
SHUVRQDORUFODVVURRPXVHLVJUDQWHGZLWKRXWIHHSURYLGHGWKDWFRSLHVDUH
QRW PDGH RU GLVWULEXWHG IRU SURILW RU FRPPHUFLDO DGYDQWDJH DQG WKDW
FRSLHV EHDU WKLV QRWLFH DQG WKH IXOO FLWDWLRQ RQ WKH ILUVW SDJH 7R FRS\
RWKHUZLVH WR UHSXEOLVK WR SRVW RQ VHUYHUV RU WR UHGLVWULEXWH WR OLVWV
UHTXLUHVSULRUVSHFLILFSHUPLVVLRQDQGRUDIHH
3(75$-XQH+DUDNOLRQ&UHWH*UHHFH
&RS\ULJKW$&0
'LVHDVH &RQWURO DQG 3UHYHQWLRQ &'& DQ DYHUDJH RI  LQ 
FKLOGUHQ LQ WKH 86 LV GLDJQRVHG ZLWK DQ $6' >@  7KHUH LV
JURZLQJ HYLGHQFH WKDW LQGLYLGXDOV ZLWK $6'V H[SHULHQFH PRWRU
GLIILFXOWLHV VXFK DV EDODQFH JDLW DQG DUP UHDFKLQJ GLIILFXOWLHV
LQFRRUGLQDWLRQDQGVORZHUYROXQWDU\PRYHPHQWV>@&RQWUDU\
WRW\SLFDOO\GHYHORSLQJFKLOGUHQWKRVHZLWK $6'VGRQRWLPLWDWH
WKHPRYHPHQWVRIRWKHUSHRSOHGRQRWSRLQWWRZDUGVDQREMHFWRI
LQWHUHVWDQGWKHLUPRWRUGLIILFXOWLHVFRQWULEXWHWRODFNRISOD\DQG
LQWHUDFWLRQ ZLWK RWKHU FKLOGUHQ 0RWRU GLIILFXOWLHV DUH RQH RI WKH
FRPPRQVRXUFHVRIUHIHUUDOIRUSK\VLFDODQGRFFXSDWLRQDOWKHUDS\
>@ 5HOLDEOH DQG YDOLG GLDJQRVLV RI $6'V LV RIWHQ GHOD\HG
EHFDXVHHDUO\VRFLDOFRPPXQLFDWLYHEHKDYLRUVORRNODUJHO\LQWDFW
LQ PRVW LQIDQWV ODWHU GLDJQRVHG ZLWK DXWLVP > @ %HFDXVH WKH
LQIDQW¶V PRWRUEHKDYLRU LV SUHOLQJXDO DQG SUHVRFLDO WKH
DVVHVVPHQW RI PRWRU IXQFWLRQ ZKLFK LV WKH LQIDQW¶V µµILUVW
ODQJXDJH¶¶FDQVHUYHDVDFRPPRQEDVHOLQHZKHQFRPSDULQJDQG
VWXG\LQJ GLIIHUHQW $6'V 7KH SRWHQWLDO LGHQWLILFDWLRQ RI D PRWRU
PDUNHUWKDWFDQLGHQWLI\$6'VHDUO\ZLOOKDYHDPDMRULPSDFWRQ
WKH DELOLW\ WR GLDJQRVH DQG LPSOHPHQW WUHDWPHQW LQWHUYHQWLRQV
(DUO\ DQG LQWHQVLYH EHKDYLRUDOO\ EDVHG WUHDWPHQW LV HIIHFWLYH LQ
UHGXFLQJ SUREOHPDWLF EHKDYLRUV DQG DOWHULQJ WKH GHYHORSPHQWDO
WUDMHFWRU\RIFKLOGUHQZLWK$6'V>@
6WXGLHVKDYHEHHQFRQGXFWHGVXJJHVWLQJWKDWWKHXVHRIURERWVLQ
$6' WKHUDS\ KDYH SRVLWLYH UHVXOWV >@ 0RUHRYHU ZH KDYH
H[SHULHQFHG WKDW WKH URERW NHHSV WKH FKLOG LQWHUHVWHG LQ WKH
H[SHULPHQWVZKLFKLVLPSHUDWLYHWRDFKLHYHWKHJRDORIRXUVWXG\
7KH DGYDQFHPHQW DQG FRVWHIIHFWLYHQHVV RI VHQVRUDFWXDWRU DQG
FRPSXWLQJWHFKQRORJ\KDYHSOD\HGDQLPSRUWDQWUROHLQWKHUHFHQW
HPHUJHQFH RI KXPDQRLG DQG QRQKXPDQRLG URERWV XVHG LQ WKH
WUHDWPHQW RI $6'V > @ 7KHVH VWXGLHV FRQFOXGHG WKDW WKH
DSSHDUDQFH RI WKH URERW SOD\V DQ LPSRUWDQW UROH LQ KRZ FKLOGUHQ
UHODWHWRDQGLQWHUDFWZLWKVXFKURERWV)XUWKHUPRUHWKHVHVWXGLHV
VXJJHVW WKDW LPLWDWLRQ DQG WXUQWDNLQJ DUH W\SHV RI LQWHUDFWLRQV
XVHIXO LQ PRWLYDWLQJ DQG HQJDJLQJ FKLOGUHQ ZLWK $6' )RU
LQVWDQFHWKHVHLQWHUDFWLRQVSURYLGHWKHEDVLVIRUDVNLQJWKH FKLOG
WR SHUIRUP EHQHILFLDO JHVWXUHV PRWLRQV DQG EXLOG VRFLDO VNLOOV
ZKLOHSOD\LQJZLWKWKHURERW
6HYHUDO URERWLF V\VWHPV DUH FXUUHQWO\ XQGHU GHYHORSPHQW IRU
WUHDWPHQWRI$6'FRQGLWLRQVLQFOXGLQJ)$&($X5R5D.DVSDU
DQG .HHSRQ EXW PDQ\ RI WKHP KDYH RQO\ EHHQ WHVWHG XQGHU
PDQXDO RSHUDWRU FRQWURO UDWKHU WKDQ LQ D WUXO\ DXWRQRPRXV
LQWHUDFWLYHPDQQHU>@
7KLVSURMHFWDLPVWRFUHDWHWKHWHFKQRORJLFDODQGFOLQLFDOEDVLVIRU
DQRYHO+XPDQ5RERW,QWHUDFWLRQ6\VWHP±5R'L&$ZKLFKZLOO
EHXVHGLQWKHIXWXUHDVDQHDUO\GLDJQRVWLFDQGWUHDWPHQWWRROIRU
FKLOGUHQZLWK$6'
7KHFOLQLFDOK\SRWKHVLVLVWKDWPRWRUGHYHORSPHQWDOSUREOHPVDUH
SUHVHQW DQG FDQ EH XVHG LQ HDUO\ LGHQWLILFDWLRQ DQG GLDJQRVLV RI
$6'
7KH WHFKQRORJLFDO K\SRWKHVLV LV WKDW D OLIHOLNH URERW LQ ERWK
DSSHDUDQFH DQG PRGDOLW\ RI LQWHUDFWLRQ ZLWK DQ LQFUHDVHG
LQWHUDFWLYLW\YLDUHDOWLPHYLVXDODQGIRUFHIHHGEDFNZLOOPRWLYDWH
FKLOGUHQZLWK$6'WRHQJDJHLQPRWRUDFWLYLWLHVOHDGLQJWRPRUH
HIIHFWLYHWUHDWPHQWRSWLRQV,QWKHFRXUVHRIWKLVUHVHDUFKZHZLOO
LQYHVWLJDWHWKHHIIHFWLYHQHVVRIXVLQJDSK\VLFDOURERWDVRSSRVHG
WRDFRPSXWHUDYDWDUWR$6'WKHUDS\
7KLV SURMHFW EXLOGV RQ RXU ZRUN LQ >  @ :H KDYH
LQWHJUDWHGWKHGLIIHUHQWIXQFWLRQDOLWLHVGHYHORSHGE\WKH1*6/DE
DW 87 $UOLQJWRQ +DQVRQ 5RER.LQG //& DQG WKH 2VWHRSDWKLF
+HULWDJH )RXQGDWLRQ 3K\VLFDO 0HGLFLQH &RUH 5HVHDUFK )DFLOLW\
GHJUHHV RI IUHHGRP '2) LQ WKH XSSHU ERG\ KDV DQ H[SUHVVLYH
IDFHZLWK'2)DQGULJLGORZHUERG\>@7KHXSSHUERG\'2)
FRQVLVWRI'2)SHUDUPDVGHSLFWHGLQ)LJXUHDQG'2)LQ
WKH WRUVR 7KH URERW LWVHOI KDV D  *+] ,QWHO $WRP =
SURFHVVRURQERDUGDQGDQH[WHUQDO'HOO;36TXDGFRUHODSWRSWKDW
FRQQHFWVWRWKHURERWWRFRQWUROLW
2.2 Interaction Modes
=HQR KDV WZR GLIIHUHQW PRGHV RI LQWHUDFWLRQ ZLWK WKH KXPDQ
VXEMHFW 7KH ILUVW PRGH RI LQWHUDFWLRQ FDOOHG ³'\QDPLF
,QWHUDFWLRQ´ LV EDVHG RQ VNHOHWDO IHHGEDFN IURP D .LQHFW VHQVRU
VHQW WR /DE9,(: IURP ZKLFK WKH PRWLRQ RI WKH WKHUDSLVW LV
FDSWXUHGDQGPLPLFNHGE\WKHURERWWRWHDFKWKHFKLOG7KLVPRGH
DOORZVWKHWKHUDSLVWWRFRQWURO=HQRGLUHFWO\JLYLQJWKHIUHHGRPWR
LPSOHPHQW D GHVLUHG DUP PRWLRQ ZLWKRXW KDYLQJ WR VSHQG WLPH
VFULSWLQJ VXFK PRWLRQV DQG PRVW LPSRUWDQWO\ LW DOORZV WKH
WKHUDSLVWWRDGDSWWRWKHXQSUHGLFWHGEHKDYLRURIFKLOGUHQVXIIHULQJ
IURP $6' 7KH VHFRQG PRGH FDOOHG ³6FULSWHG ,QWHUDFWLRQ´ LV
EDVHG RQ WKH QDWLYH =HQR 5RER.LQG VRIWZDUH ZKLFK DOORZV SUH
SURJUDPPLQJ RI VFULSWHG PRWLRQV DV ZHOO DV FRQYHUVDWLRQ XVLQJ
YRLFHUHFRJQLWLRQDQGWH[WWRVSHHFKVRIWZDUH
α ߚ
ߛ
ߠ
2+)30&5) DW 817 +HDOWK 6FLHQFHV LQ D IUDPHZRUN WKDW
HQDEOHVXVWRVWXG\WKHHIIHFWRIWKHURERW=HQRRQWKHWHVWVXEMHFW 
7KLV SDSHU LV RUJDQL]HG DV IROORZV VHFWLRQ  GHVFULEHV WKH Figure 2. 4-DOF Zeno arm joint angles
H[SHULPHQWDOSODWIRUPKDUGZDUHDQGWKHVRIWZDUHDQGDOJRULWKPV
WKDW UXQ RQ WKH URERW H[SHULPHQWDO GDWD FROOHFWLRQ DQG JLYHV
GHWDLOV DERXW WKH VXEMHFWV RI WKH VWXG\ VHFWLRQ  VKRZV
SUHOLPLQDU\ UHVXOWV IURP WKH H[SHULPHQW DQG WKH LQLWLDO UHDFWLRQV
IURP $6' FKLOGUHQ VHFWLRQ FRQFOXGHV WKH SDSHU DQGGHVFULEHV
RXUIXWXUHZRUN

2. METHODS
2.1 Hardware Description

Figure 3. Zeno therapist controlled interaction
2.2.1 Dynamic Interaction Mode
,Q WKLV PRGH WKH URERW FDQ EH FRQWUROOHG E\ XVLQJ WKH .LQHFW D
YLVLRQEDVHGSHULSKHUDOGHVLJQHGIRUWKH0LFURVRIW;ER[,W
FDQSURYLGHDGHSWKPDSRIWKHDUHDLQIURQWRILWZKLFKFDQWKHQ
EH XVHG WR ILQG D VNHOHWDO UHSUHVHQWDWLRQ RI D XVHU 7KH .LQHFW
DORQJ ZLWK 2SHQ1, >@ KDV EHHQ XVHG WR REWDLQ D WDEOH RI
FRRUGLQDWHV RI PDMRU MRLQWV DQG SDUWV RI WKH KXPDQ ERG\  )URP
WKHVH FRRUGLQDWHV GHVFULEHGLQ WKH &DUWHVLDQ VSDFH RI WKH .LQHFW
ZH FDQ DSSUR[LPDWH WKH SRVH SURYLGHG E\ WKH XVHU LQ WKH MRLQW
VSDFHRIWKHURERW7KHSRVHLVRQO\DQDSSUR[LPDWLRQGXHWRWKH
 NLQHPDWLFV RI =HQR¶V DUPV QRW EHLQJ D UHSOLFD RI WKH KXPDQ¶V
Figure 1. Zeno R30 DUPV )LJXUH  VKRZV D EORFN GLDJUDP GHVFULSWLRQ RI WKH +5,
LPSOHPHQWDWLRQLQZKLFKILOWHUHG.LQHFWVNHOHWDOGDWDLVXVHGE\
7KHURERWXVHGLQWKLVVWXG\LVWKH=HQR5FKLOGOLNHKXPDQRLG WKH ,QYHUVH .LQHPDWLFV EORFN WR JHQHUDWH D VHW RI DQJOHV LQ MRLQW
URERW E\ +DQVRQ 5RER.LQG 7KLV YHUVLRQ RI WKH URERW KDV 
VSDFHWKDWUHSUHVHQWWKHMRLQWVHUYRGHVLUHGWUDMHFWRU\SRLQWV0RUH LVRODWLRQ IRU FRGH EXQGOHV WR DYRLG YHUVLRQ FRQIOLFWV DQG RWKHU
GHWDLOVRIWKHFRQWURODOJRULWKPVDUHSUHVHQWHGLQ>@ LVVXHV IURP WUDQVLWLYH GHSHQGHQFLHV LQ ODUJH SURMHFWV DQG
$XWRPDWLF GHSHQGHQF\ UHVROXWLRQ 26*L LV EXLOW RQ D VHFXULW\
Therapist Dell XPS OD\HUZKLFKFRQWUROVSDFNDJHDFFHVVEHWZHHQFRGHEXQGOHVZKLFK
FDQ EH HQIRUFHG WKURXJK VLJQDWXUHV 1RW OHDVW RI DOO 26*L
LabVIEW
SURYLGHV D FHQWUDO VHUYLFH UHJLVWU\ 6HUYLFHV DUH UHJLVWHUHG ZLWK
LP BW
Kinect Filter WKHLU FODVV QDPHV DQG D SURSHUW\ VHW DQG VHUYLFHV PD\ EH
TXHULHG ZLWK DQ /'$3 ILOWHU 5RER.LQG XVHV WKH $SDFKH )HOL[
26*LLPSOHPHQWDWLRQ
Inverse
Kinematics 4SLGLVDEURNHUEDVHGPHVVDJLQJV\VWHPZLWKDSXEOLVKVXEVFULEH
PRGHO 4SLG IXOO\ LPSOHPHQWV WKH $GYDQFHG 0HVVDJH 4XHXLQJ
Joints’ Angle 3URWRFRO$043ZKLFKLVDSODWIRUPDQGODQJXDJHLQGHSHQGHQW
Radian to Degrees Human Subject PHVVDJLQJ SURWRFRO 4SLG RIIHUV PHVVDJH TXHXLQJ WUDQVDFWLRQV
VHFXULW\UHSOLFDWLRQIHGHUDWLRQDQGFOXVWHULQJ
Angle
Offset Zeno R30 $YUR LV WKH GDWD VHULDOL]DWLRQ SURMHFW IRU WKH $SDFKH +DGRRS
SURMHFW DQ RSHQVRXUFH LPSOHPHQWDWLRQ RI WKH *RRJOH 0DS
Generate 5HGXFHDOJRULWKP,WSURYLGHVSODWIRUPDQGODQJXDJHLQGHSHQGHQW
RX 28 Servos
Serial Packet GDWD VHULDOL]DWLRQ VWDQGDUGV 0DQ\ GDWD DQDO\VLV SURMHFWV DUH
 PRYLQJ WR DGRSW $YUR DV ZHOO $YUR DQG 4SLG FOLHQWV H[LVW IRU
-DYD&&&3\WKRQDQG5XE\
Figure 4. Interactive System Block Diagram
0DYHQ KDV EHFRPH WKH GHIDFWR VWDQGDUG LQ UHSRVLWRU\EDVHG
2.2.2 Scripted interaction mode SURMHFW GLVWULEXWLRQ LQ -DYD IRU ELQDULHV VRXUFH DQG MDYDGRFV
0DYHQ SHUIRUPV GHSHQGHQF\ PDQDJHPHQW DQG SURMHFW EXLOGV
Zeno R30
WHVWV DQG SDFNDJLQJ 0DYHQ
V EXLOG SURFHVV KDV D EXLOG SOXJLQ
RX 28 Servos V\VWHPZKLFKLQFOXGHVSOXJLQVWRVLPSOLI\EXLOGLQJ26*LEXQGOHV
Dell XPS 5RER.LQG FRPELQHV WKHVH SURMHFWV DQG GHILQHV VHYHUDO VHUYLFH
LQWHUIDFHV DQG FODVVHV WR SURYLGH D FRKHUHQW URERWLFV IUDPHZRUN
Motion RoboKind &RPPRQ VHUYLFHV DUH GHILQHG IRU PHVVDJLQJ PRWLRQ DQLPDWLRQ
Script Controller VSHHFKDQGYLVLRQ
Java
Speech
2.3 Data Collection System Description
Script
Speech Server 7KH H[SHULPHQWV DUH SHUIRUPHG DW WKH 2VWHRSDWKLF +HULWDJH
)RXQGDWLRQ 3K\VLFDO 0HGLFLQH &RUH 5HVHDUFK )DFLOLW\
2+)30&5) DW 7KH 8QLYHUVLW\ RI 1RUWK 7H[DV &HQWHU IRU
%LRKHDOWK 7KH GDWD LV FROOHFWHG XVLQJ WKH &$5(1 ([WHQGHG
Human Subject &RPSXWHU $VVLVWHG 5HKDELOLWDWLRQ (QYLURQPHQW E\ 0RWHN
 0HGLFDO%9VKRZQLQ)LJXUH>@7KLVV\VWHPXVHVWKH5DSWRU
Figure 5. Scripted System Block Diagram  'LJLWDO 5HDO7LPH 6\VWHP E\ 0RWLRQ $QDO\VLV FRQVLVWLQJ RI
WZHOYH5DSWRU'LJLWDO&DPHUDVZKLFKFDSWXUHPRWLRQDW+]
7KH=HQR5DOVRUXQVWKH 5RER.LQGVRIWZDUHSODWIRUP RQLWV 7KHVH V\VWHPV KDYH EHHQ XVHG LQ WKH UHKDELOLWDWLRQ RI ZRXQGHG
HPEHGGHG3&)LJXUHJLYHVDQRYHUYLHZRIWKHVFULSWHGV\VWHP VROGLHUVDQGFLYLOLDQV
VRIWZDUH DUFKLWHFWXUH 6LQFH WKH 5RER.LQG SODWIRUP LV GHVLJQHG
DURXQG GLVWULEXWHG SURFHVVLQJ WKH FRPSXWDWLRQV DUH GLYLGHG
EHWZHHQ =HQR¶V RQERDUG SURFHVVRU DQG WKH H[WHUQDO 3& 7KH
FRPPXQLFDWLRQ LV WKURXJK ZLUHOHVV /$1 $V VHHQ LQ WKH EORFN
GLDJUDPLQ)LJXUH=HQRUXQVWKH5RER.LQGVRIWZDUHIUDPHZRUN
ZKLFK FRQVLVWV RI WKH 5RER.LQG &RQWUROOHU ZKLFK H[SRVHV WKH
DFWXDWRUV DQG VHQVRUV RI =HQR WR 5RER.LQG FOLHQW VRIWZDUH
UXQQLQJRQQHWZRUNHG3&V7KHUHLVDOVRDVHSDUDWHVHUYHUZKLFK
SURFHVVHVWH[WWRVSHHFKDQGKDQGOHVWKHSDVVLQJRIYLVHPHVWRWKH
5RER.LQG &RQWUROOHU 7KH VFULSWV DQG RWKHU FRQWUROWKHUDS\
UHODWHG IXQFWLRQV DUH SURFHVVHG E\ WKH H[WHUQDO 3& LQ -DYD DQG
FRPPXQLFDWHGWR=HQRRYHUWKHQHWZRUN
7KH 5RER.LQG SODWIRUP LV DQ RSHQVRXUFH -DYDEDVHG URERWLFV 
IUDPHZRUN VWLOO LQ DQ HDUO\ VWDJH RI GHYHORSPHQW ,W LV GHVLJQHG Figure 6. CAREN System for motion analysis >@
IRU PRGXODULW\ DQG SRUWDELOLW\ DGRSWLQJ VHYHUDO RSHQ VWDQGDUGV 7RFRQGXFWWKHH[SHULPHQWVZHDWWDFKHGPDUNHUVWR=HQRDQGWKH
5RER.LQG LV EXLOW RQ WRS RI VHYHUDO RSHQVRXUFH SURMHFWV PRVW KXPDQVXEMHFW LQRUGHUWRVLPXOWDQHRXVO\UHFRUGWKHLULQWHUDFWLRQ
QRWDEOH EHLQJ 2SHQ 6HUYLFH *DWHZD\ LQWHUIDFH 26*L
VSHFLILFDWLRQV4SLG$YURDQG0DYHQ
26*L RIIHUV D VHFXUH DQG PRGXODU UXQWLPH HQYLURQPHQW IRU D
VHUYLFH RULHQWHG DSSOLFDWLRQ 6RPH NH\ IHDWXUHV RI 26*L DUH
'\QDPLFLQVWDOODWLRQDQGUHPRYDORIFRGHEXQGOHV&ODVV/RDGHU
XVLQJ WKH PRWLRQ FDSWXUH V\VWHP )LJXUH  VKRZV WKH KXPDQ
VXEMHFWDQG=HQRRQWKH9JDLWSODWIRUP ZHDULQJ PRWLRQFDSWXUH
PDUNHUV)LJXUHVKRZVWKH&RUWH[V\VWHPFDSWXULQJWKHPDUNHUV
XVLQJ9LFRQFDPHUDVDQGJHQHUDWLQJVNHOHWDOPRGHOVRI=HQRDQG
WKHKXPDQVXEMHFW

 FKLOG¶VPRYHPHQWLQVXFFHVVLYHH[SHULPHQWVZHFRPSDUHVHOHFWHG
Figure 7. Zeno and Subject motion capture markers.
Figure 8. Zeno wave motion capture based on markers.
2.4 Experiment
)RU WKH SUHVHQW SLORW VWXG\ WKH REMHFWLYH LV WR HYDOXDWH WKH
K\SRWKHVLV WKDW FKLOGUHQ ZLWK $6'V FDQ LQWHUDFW ZLWK WKH =HQR
URERW DQG WKHLU SHUIRUPDQFH RI PRWRU PRYHPHQWV GXULQJ WKLV
LQWHUDFWLRQFDQEHXVHGIRUGLDJQRVWLFDQGWUHDWPHQWSXUSRVHV,Q
WKH URERWLFV ILHOG WKHUH LV D K\SRWKHVLV FDOOHG 0RUL¶V XQFDQQ\
YDOOH\ ZKLFK VXJJHVWV WKDW URERWV ZKLFK DUH FORVH WR KXPDQV LQ
DSSHDUDQFHZLOOEHUHMHFWHGE\SHRSOH>@,QWKLVUHVHDUFK0RUL¶V
XQFDQQ\ YDOOH\ K\SRWKHVLV DQG WKH HIIHFWLYHQHVV RI WKH URERW WR
PRWLYDWHDQGHQFRXUDJHFKLOGUHQWRLQWHUDFWZLOOEHDVVHVVHG:H
DQWLFLSDWHWKDWWKHUHDFWLRQRIFKLOGUHQWR=HQR¶VH[SUHVVLYHIDFH
KXPDQ OLNH VNLQ WRQH DQG G\QDPLF LQWHUDFWLYLW\ ZLOO JLYH LQVLJKW
LQWR WKH YDOLGLW\ RI WKH XQFDQQ\ YDOOH\ K\SRWKHVLV 'DWD DQDO\VLV
ZLOO DOVR DGGUHVV WKH K\SRWKHVLV WKDW $6' VXEMHFWV ZLOO DSSHDU
GHYHORSPHQWDOO\GHOD\HGLQWKHLUPRWRUFRQWUROUHODWLYHWRKHDOWK\
FRQWUROVXEMHFWV$UHSHDWHGPHDVXUHDQDO\VLVRIYDULDQFHZLOOEH
XVHG WR GHWHUPLQH ZKHWKHU WKHUH DUH DQ\ VLJQLILFDQW PDLQ RU
LQWHUDFWLRQ HIIHFWV GXH WR DJH DQG JURXS QRUPDO GHYHORSPHQW
RIWKHKHDGWUXQNDQGOLPEVLVFDSWXUHGZLWKDFDPHUDPRWLRQ
DQDO\VLV V\VWHP DW  +] 7KH PDLQ IRFXV RI WKLV VWXG\ LV WKH
HYDOXDWLRQRIWKHPRWRUDELOLWLHVRIWKHFKLOGUHQEHWZHHQWHVWVWKDW
DUHVHSDUDWHGE\SHULRGVRIWKUHHPRQWKV7RGRWKLVZHXVH=HQR
DV WKH EDVHOLQH VLQFH ZH DUH DEOH WR UHSOLFDWH KLV PRWLRQV
UHDVRQDEO\DFFXUDWHO\DWHYHU\H[SHULPHQW7RVWXG\WKHFORVHQHVV
RIWKHFKLOG¶V PRWLRQVEHWZHHQH[SHULPHQWVLWLVXVHIXOWRREWDLQ
DQREMHFWLYHPHDVXUHRIPRWRUSHUIRUPDQFH7RFRPSDUHWKHFKLOG
WR =HQR ZH XVH WKH HOERZ DQG KDQG PRYHPHQWV RI WKH FKLOG LQ
WKUHH GLPHQVLRQV DQG FRPSDUH WKHP WR =HQR¶V HOERZ DQG KDQG
WUDLOV LQ ' VSDFH 7KLV LV QRW VWUDLJKW IRUZDUG VLQFH =HQR¶V
PRWLRQLVQRWVLPLODUWRKXPDQPRWLRQGXHWRKLVOLPLWHG'2)
7R REWDLQ DQ DOOHQFRPSDVVLQJ PHDVXUH RI WKH FORVHQHVV RI WKH
GDWD SRLQWV DQG FRPSXWH WKH FXPXODWLYH GLVWDQFH PHDVXUH XVLQJ
WKHQRUP:HDOVRSURSRVHPRUHTXDOLWDWLYHVLPLODULW\PHDVXUHV
WR FRPSDUH WKH FORVHQHVV RI WKH FKLOG¶V PRYHPHQW WR =HQR¶V DV
ZHOO DV WKH FORVHQHVV WR WKH PRYHPHQW RI WKH FKLOG IURP
H[SHULPHQW WR H[SHULPHQW 8VLQJ WKHVH FULWHULD ZH FDQ REWDLQ D
JRRGPHDVXUHRIWKHFKLOG¶VPRWRUSHUIRUPDQFH
2.4.3 Motion Analysis
%HIRUH SURFHVVLQJ WKH GDWD ZH SHUIRUPHG QRUPDOL]DWLRQ E\
VXEWUDFWLQJ WKH PHDQ IURP WKH VLJQDOV WR UHPRYH DQ\ RIIVHWV DQG
WKHQGLYLGLQJWKHVLJQDOVE\WKHLUUHVSHFWLYHVWDQGDUGGHYLDWLRQVWR
VFDOH WKHP XVLQJ HTXDWLRQ  7KLV SUHSURFHVVLQJ LV XVHIXO WR
UHPRYH WKH RIIVHWV FDXVHG E\ WKH GLIIHUHQFH LQ WKH NLQHPDWLF
VWUXFWXUHRIWKHURERWDQGKXPDQVXEMHFWDQGDOVRFRPSHQVDWHIRU
WKH GLIIHUHQFH LQ WKH UDQJH RI PRWLRQ 7KH HIIHFW RI QRUPDOL]LQJ
WKH GDWD FDQ EH VHHQ IURP )LJXUH  ZKLFK VKRZV WKH UDZ HOERZ
DQJOHV RI WKH VXEMHFW DQG =HQR RQ WKH WRS DQG WKH QRUPDOL]HG
HOERZDQJOHVRQWKHERWWRP
Subject vs Zeno Elbow Angles for Right Wave
150
Subject
Zeno
100
Angle
50
0
6 8 10 12 14 16 18 20
Time (s)
Normalized Subject vs Zeno Elbow Angles for Right Wave
2
Subject
Normalized Angle
1 Zeno
FKLOGUHQDQGFKLOGUHQZLWK$6'V 0

-1
2.4.1 Description of experiment
7KHFKLOGDQG=HQRIDFHHDFKRWKHUDQGWDNHWXUQVLPLWDWLQJHDFK -2
6 8 10 12 14 16 18 20
RWKHU¶V PRYHPHQWV )LUVW WKH FKLOG LV DVNHG WR LPLWDWH WKH
PRYHPHQWV WKDW =HQR LV SHUIRUPLQJ WKHQ WKH FKLOG KDV WR WHDFK
Time (s) 
=HQR VRPH PRYHPHQWV RI KLVKHU FKRLFH LQ ZKLFK WKH URERW Figure 9. Raw and normalized elbow angles
PLPLFVWKHFKLOG¶VPRYHPHQWWKURXJKWKHXVHRIWKH.LQHFW=HQR
* N
s n  P s*
LQWHUDFWV ZLWK FKLOGUHQ LQ WKUHH GLIIHUHQW PRGHV L SHUIRUPLQJ
PRYHPHQWV WKDW DUH DOUHDG\ VFULSWHG LL SHUIRUPLQJ PRYHPHQWV
snorm ¦
n  V s* 
WKDWDUHGULYHQE\DWKHUDSLVWWKURXJK.LQHFWDQGLLLPLUURULQJWKH 
:KHUH
FKLOG¶V PRYHPHQWV 6LPSOH DUP PRYHPHQWV VXFK DV ³ZDYLQJ *
KHOORJRRGE\H´ VLJQDOLQJ ³, DP KXQJU\´ DQG GRLQJ D ³JRRG MRE s n  n th HOHPHQWRIYHFWRU
* s 
ILVW EXPS´ ZLWK WKH OHIW DQG ULJKW DUPV ZHUH LPSOHPHQWHG LQ WKH
N OHQJWKRIYHFWRU s 
VFULSWHGPRGH *
P s* PHDQRIWKHYHFWRU s DQG
2.4.2 Data Collection and Analysis *
5HIOHFWLYHPDUNHUVDUHSODFHGRQHTXLYDOHQWDQDWRPLFDOORFDWLRQV V s* VWDQGDUGGHYLDWLRQRIWKHYHFWRU s 
RQWKHFKLOG¶VERG\DQG=HQRVWUXFWXUH7KH'MRLQWSRVLWLRQGDWD
2.4.3.1 Range of Motion (ROM) *
N OHQJWKRIYHFWRU si DQG
)RU WKH UDQJH RI PRWLRQ DQDO\VLV ZH XVH WKH UDZ DQJOH GDWD WR * *
FRPSDUH WKH DQJOHV GLUHFWO\ ZKLFK LV QRW SRVVLEOH DIWHU D QRUPGLVWDQFHEHWZHHQ s DQG t 
QRUPDOL]DWLRQ )RU WKLV ZH ORRN DW HDFK DQJOH DQG GHWHUPLQH WKH
PD[LPXP DQG PLQLPXP YDOXHV LQ WKH WLPH VHULHV WR REWDLQ WKH 3. RESULTS
PD[LPDOYDOXHVRIWKHDQJOHVRIHDFKMRLQW 7KH H[SHULPHQW ZDV FRQGXFWHG ZLWK =HQR IDFLQJ WKH VXEMHFW DV
VHHQ LQ )LJXUH  7KH IROORZLQJ  VHFRQG VFULSWHG URXWLQH ZDV
2.4.3.2 Response delay UXQRQ=HQR
:H ZDQW WR FRPSDUH KRZ IDVW WKH VXEMHFW UHDFWV WR WKH URERW¶V  :DYHKHOORZLWKULJKWDUP>VWRV@
PRYHPHQWV 7R JHW WKLV SDUDPHWHU ZH SHUIRUP FURVV FRUUHODWLRQ  ³7XPP\UXE´ZLWKULJKWDUP>VWRV@
RQWKHWZRVHWVRIQRUPDOL]HGGDWDDQGLGHQWLI\WKHWLPHIRUZKLFK  )LVWEXPSULJKWDUP>VWRV@
WKHFURVVFRUUHODWLRQJLYHVWKHPD[LPXPYDOXHDVWKHWLPHGHOD\  )LVWEXPSOHIWDUP>VWRV@
 N
* *  :DYHJRRGE\HZLWKOHIWDUP>VWRV@

N
¦ >sn  s t n  W   t @ 7KH³7XPP\UXE´DFWLRQLVXVHGWRVLJQDOKXQJHULWLVSHUIRUPHG
Rrx W  n  E\PRYLQJDKDQGLQDFLUFXODUPRWLRQRYHUWKHVWRPDFK)RUWKLV
 N
* *  SKDVH RI WKH DQDO\VLV ZH RQO\ XVHG WKH WLPH VHULHV RI WKH HOERZ
N
¦ sn  s t n  t 
n 
 DQJOHVRI=HQR¶VDQGWKHVXEMHFW¶VPRWLRQ
Table 1. Elbow angles during scripted mode
:KHUH
* 0RWLRQ 520 'HOD\IJ
N OHQJWKRIYHFWRU s  =HQR 6XEMHFW VHF
QRUP
,QWKLVVHWRIGDWDWKHFRUUHODWLRQLVKLJKHVWDWVDPSOHVKRZQ 5LJKW:DYH    
LQ)LJXUH6XEWUDFWLQJWKLVIURPWKHOHQJWKRIWKHVKRUWHUVLJQDO
DQGPXOWLSO\LQJE\WKHVDPSOLQJSHULRGVHFJLYHVDGHOD\RI ³7XPP\5XE´    
W   VHF 7KLV YDOXH JLYHV DQ LGHD RI KRZ IDVW WKH VXEMHFW 5LJKW)LVW%XPS    
IROORZV=HQR¶VPRWLRQ
6
/HIW)LVW%XPS    
x 10 Crosscorrelation Rrx
6
X: 1259 /HIW:DYH    
Y: 5.938e+006

5
Table 2. Elbow angles during Interactive mode

4 0RWLRQ 'HOD\IJ
QRUP
VHF
Correlation

3
5LJKW:DYH  

2 ,Q WKH SUHOLPLQDU\ H[SHULPHQW ZLWK UHVXOWV VKRZQ LQ 7DEOH  D
KXPDQ WHVW VXEMHFW DQ DGXOW QRW DQ $6' VXIIHUHU IROORZV DUP
1 PRWLRQTXHXHVIURP=HQRWKURXJKVFULSWHGFRPPDQGV
5HVXOWV VKRZ WKDW WKH SHUVRQ FDQ IROORZ VLPSOH PRWLRQV RI WKH
0
0 500 1000 1500 2000 2500 3000 URERW ZLWK UHODWLYHO\ ORZ WLPH GHOD\ DQG WKDW WKH MRLQW UDQJH RI
Samples  PRWLRQGLIIHUHQFHVDUHFRUUHODWHGZLWKWKHQRUPGLVWDQFHPHWULF
Figure 10. Cross correlation plot )RU LQVWDQFH WKH ODUJHVW 520 GLVFUHSDQF\ ZDV UHFRUGHG GXULQJ
WKH ULJKW ZDYH PRWLRQ FRUUHVSRQGLQJ WR WKH ODUJHVW GLVWDQFH
2.4.3.3 2-norm distance metric PHDVXUH)XUWKHUPRUHWKHWLPHGHOD\VIRUWKHULJKWKDQGZDYHLQ
7KHUH LV D QHHG WR TXDQWLWDWLYHO\ PHDVXUH WKH VLPLODULW\ RI WKH LQWHUDFWLYH PRGH VKRZQ LQ 7DEOH  HJ WKH URERW IROORZV WKH
PRWLRQJHQHUDWHGE\WKHVXEMHFWWRWKHPRWLRQJHQHUDWHGE\=HQR KXPDQPRWLRQLVVLPLODUWRWKHWLPHGHOD\GXULQJVFULSWHGPRGH
RQH VXFK PHDVXUH LV WKH QRUP GLVWDQFH EHWZHHQ WKH WZR WLPH
VHULHV PRWLRQ VLJQDOV ,Q WKLV DQDO\VLV ZH FRQVLGHU WKH DQJOH
SRVLWLRQVJHQHUDWHGE\WKHVXEMHFWDQGURERWDVDWLPHVHULHV6LQFH
WKH DQJOHV DUH DOZD\V SRVLWLYH DQG OHVV WKDQ  GHJUHHV ZH XVH
WKHQRUPGLVWDQFHWRFRPSDUHWKHPRWLRQV7KHQRUPGLVWDQFH
LVFDOFXODWHGXVLQJHTXDWLRQ
HJWKHKXPDQIROORZVWKHURERW
4. CONCLUSION AND FUTURE WORK
7KLV SDSHU SUHVHQWV WKH LQLWLDO KDUGZDUH VRIWZDUH DQG WHVW
SURFHGXUHVWKDWZLOOEHXVHGLQWKH5R'L&$SURMHFW7KLVZRUNLV
SDUWRIDODUJHUHIIRUWWKDWLQYROYHVWKHXVHRIYLUWXDOHQYLURQPHQWV
LQWKH&$5(1V\VWHPWRGLDJQRVHFKLOGKRRG$6'E\LGHQWLI\LQJ
¦ s     
N
  
n
x  t xn  s yn  t yn  s zn  t zn SRWHQWLDOPRWRUPDUNHUVLQWKHWHVWVXEMHFWV
n   ,Q GHYHORSLQJ WKH SURFHGXUH IRU DQDO\]LQJ WKH WLPH VHULHV GDWD LW
D EHFDPH FOHDU WKDW D PHWKRG ZDV QHHGHG WR REWDLQ TXDQWLWDWLYH
N DQDO\VLV WHFKQLTXHV WR DQDO\]H WKH KXPDQ URERW LQWHUDFWLRQ
:KHUH
VFHQDULR 7KLV DQDO\VLV WHFKQLTXH VKRXOG EH DEOH WR JLYH DQ
n *
si  n th HOHPHQWRIYHFWRU si  REMHFWLYH PHDVXUHPHQW DERXW WKH PRWLRQ SHUIRUPDQFH RI WKH WHVW
* VXEMHFW GXULQJ WKH LQWHUDFWLRQ 7KLV REMHFWLYH PHDVXUHPHQW ZLOO
n
ti  n th HOHPHQWRIYHFWRU ti 
\LHOG LQVLJKW LQWR WKH PRWRU GHYHORSPHQW RI WKH FKLOG GXULQJ RI$XWLVPDQG'HYHORSPHQWDO'LVRUGHUV
VXFFHVVLYHH[SHULPHQWV '2, %-$''F
)XUWKHU H[SHULPHQWV DUH EHLQJ FRQGXFWHG WR YHULI\ WKH DQDO\VLV >@ 0RUL07KH8QFDQQ\9DOOH\
WHFKQLTXHV RXWOLQHG LQ WKLV SDSHU 7KHUH LV DQ RQJRLQJ HIIRUW WR >@ 0RWHN0HGLFDO&$5(1&RPSXWHU$VVLVWHG5HKDELOLWDWLRQ
FROOHFWGDWDIURPPRUHVXEMHFWVLQSHULRGVRIWKUHHPRQWKVZKHUH (1YLURQPHQW'HF
WZRVXEMHFWVKDYHJRQHWKURXJKWKHILUVWSKDVHRIWKHH[SHULPHQW
>@ 1DLW\&RPPXQLW\8VHU7UDFNLQJZLWK/DE9,(:DQG
7KLVZRUNRQKXPDQPRWLRQVLPLODULW\PHWULFZLOOEHXVHGLQWKH
IXWXUH WRTXDQWLI\ WKH ³KXPDQQHVV´ RI WKH PRWLRQV SHUIRUPHG E\
URERWVDQGWKHWKHUDSHXWLFEHQHILWVRISHUIRUPLQJWKHVHPRWLRQVLQ
IURQW RI $6' VXEMHFWV 6XFK DQ LQGH[ ZLOO KHOS XV LPSURYH WKH
FXUUHQW PRWLRQ DOJRULWKPV RQ RXU URERWV DQG DFKLHYH FORVH WR
KXPDQPRWLRQ
.LQHFWEDVHGRQWKH2SHQ1,,QWHUIDFH-XO
>@ 2]RQRII6<RXQJ**ROGULQJ6*UHLVV+HVV/
+HUUHUD$6WHHOH-0DFDUL6+HSEXUQ6DQG5RJHUV6
*URVV0RWRU'HYHORSPHQW0RYHPHQW$EQRUPDOLWLHVDQG
(DUO\,GHQWLILFDWLRQRI$XWLVP-RXUQDORI$XWLVPDQG
'HYHORSPHQWDO'LVRUGHUV
5. ACKNOWLEDGMENTS '2, V
7KLV ZRUN ZDV VXSSRUWHG E\ WKH 7[05& FRQVRUWLXP JUDQW >@ 3LRJJLD*6LFD0/)HUUR0,JOLR]]L50XUDWRUL)
³+XPDQ5RERW ,QWHUDFWLRQ 6\VWHP IRU (DUO\ 'LDJQRVLV DQG $KOXZDOLD$DQG'H5RVVL'+XPDQ5RERW,QWHUDFWLRQLQ
7UHDWPHQW RI &KLOGKRRG $XWLVP 6SHFWUXP 'LVRUGHUV 5R'L&$´
DQG E\ WKH 86 1DWLRQDO 6FLHQFH )RXQGDWLRQ *UDQWV &36
DQG&16
7KH DXWKRUV ZLVK WR WKDQN 'DYLG +DQVRQ 5LFKDUG0DUJROLQ DQG
-RVKXD -DFK RI +DQVRQ 5RER.LQG DQG ,QWHOOLJHQW %RWV //& IRU
WKHLU KHOS ZLWK =HQR 5 7KH DXWKRUV DOVR WKDQN 5REHUW
/RQJQHFNHU -DQHW 7UDPPHOO DQG 'DYLG &XPPLQJV IURP
$XWLVP)$&(DQ$QGURLGEDVHG6RFLDO7KHUDS\,Q
$QRQ\PRXVRobot and Human interactive Communication,
2007. RO-MAN 2007. The 16th IEEE International
Symposium on. 
>@ 5DMUXDQJUDELQ-DQG3RSD'5RERW+HDG0RWLRQ&RQWURO
ZLWKDQ(PSKDVLVRQ5HDOLVPRI1HFN(\H&RRUGLQDWLRQ
GXULQJ2EMHFW7UDFNLQJ-RXUQDORI,QWHOOLJHQW 5RERWLF
817+6& IRU WKHLU KHOS ZLWK WKH H[SHULPHQWDO GDWD FROOHFWLRQ
SUHVHQWHG LQ WKLV SDSHU 7KH ILUVW DXWKRU ZRXOG OLNH WR WKDQN -RH
6DQIRUGIRUKLVKHOSLQSURRIUHDGLQJWKHSDSHU
6. REFERENCES
6\VWHPV
>@ 5DQDWXQJD,5DMUXDQJUDELQ-3RSD'2DQG0DNHGRQ
)(QKDQFHGWKHUDSHXWLFLQWHUDFWLYLW\XVLQJVRFLDOURERW
=HQR,Q$QRQ\PRXVProceedings of the 4th International
Conference on PErvasive Technologies Related to Assistive
>@ %DUDQHN*7(IILFDF\RI6HQVRU\DQG0RWRU,QWHUYHQWLRQV Environments. +HUDNOLRQ&UHWH*UHHFH$&01HZ<RUN
IRU&KLOGUHQZLWK$XWLVP-RXUQDORI$XWLVPDQG 1<86$
'HYHORSPHQWDO'LVRUGHUV
'2, $
>@ %U\VRQ6=ZDLJHQEDXP/%ULDQ-5REHUWV:
6]DWPDUL35RPERXJK9DQG0F'HUPRWW&$
3URVSHFWLYH&DVH6HULHVRI+LJKULVN,QIDQWVZKR'HYHORSHG
$XWLVP-RXUQDORI$XWLVPDQG'HYHORSPHQWDO'LVRUGHUV
>@ 5LFNV'-DQG&ROWRQ0%7UHQGVDQGFRQVLGHUDWLRQVLQ
URERWDVVLVWHGDXWLVPWKHUDS\,Q$QRQ\PRXVRobotics and
Automation (ICRA), 2010 IEEE International Conference on.

>@ 5LQHKDUW1%UDGVKDZ-%UHUHWRQ$DQG7RQJH%
'2, V 0RYHPHQW3UHSDUDWLRQLQ+LJK)XQFWLRQLQJ$XWLVPDQG
$VSHUJHU'LVRUGHU$6HULDO&KRLFH5HDFWLRQ7LPH7DVN
>@ &HQWHUVIRU'LVHDVH&RQWURODQG3UHYHQWLRQ&'&'DWDDQG ,QYROYLQJ0RWRU5HSURJUDPPLQJ-RXUQDORI$XWLVPDQG
6WDWLVWLFV$XWLVP6SHFWUXP'LVRUGHUV1&%''' 'HYHORSPHQWDO'LVRUGHUV
0D\ '2, $
>@ 'DXWHQKDKQ.5RERWVDVVRFLDODFWRUV$8525$DQGWKH >@ 5RELQV%'DXWHQKDKQ.DQG'XERZVNL-'RHV
FDVHRIDXWLVP,Q$QRQ\PRXVThe Third International DSSHDUDQFHPDWWHULQWKHLQWHUDFWLRQRIFKLOGUHQZLWKDXWLVP
Cognitive Technology Conference. 6DQ)UDQFLVFR86$

>@ +DUULV6/DQG'HOPROLQR/$SSOLHG%HKDYLRU$QDO\VLV
,WV$SSOLFDWLRQLQWKH7UHDWPHQWRI$XWLVPDQG5HODWHG
'LVRUGHUVLQ<RXQJ&KLOGUHQ,QIDQWV <RXQJ&KLOGUHQ
ZLWKDKXPDQRLGURERW",QWHUDFWLRQ6WXGLHV
'2, GRLLVURE
>@ 7RUUHV1$&ODUN15DQDWXQJD,DQG3RSD'
,PSOHPHQWDWLRQRI,QWHUDFWLYH$UP3OD\EDFN%HKDYLRUVRI
6RFLDO5RERW=HQRIRU$XWLVP6SHFWUXP'LVRUGHU7KHUDS\
 ,Q$QRQ\PRXVProceedings of the 5th International
>@ -HQVHQ9.DQG6LQFODLU/97UHDWPHQWRI$XWLVPLQ Conference on PErvasive Technologies Related to Assistive
<RXQJ&KLOGUHQ%HKDYLRUDO,QWHUYHQWLRQDQG$SSOLHG Environments. +HUDNOLRQ&UHWH*UHHFH
%HKDYLRU$QDO\VLV,QIDQWV <RXQJ&KLOGUHQ >@ :DLQHU-'DXWHQKDKQ.5RELQV%DQG$PLUDEGROODKLDQ
 )&ROODERUDWLQJZLWK.DVSDU8VLQJDQDXWRQRPRXV
>@ .R]LPD+0LFKDORZVNL0DQG1DNDJDZD&.HHSRQ KXPDQRLGURERWWRIRVWHUFRRSHUDWLYHG\DGLFSOD\DPRQJ
,QWHUQDWLRQDO-RXUQDORI6RFLDO5RERWLFV
'2, V
>@ 0ROOR\&$'LHWULFK.1DQG%KDWWDFKDU\D$3RVWXUDO
6WDELOLW\LQ&KLOGUHQZLWK$XWLVP6SHFWUXP'LVRUGHU-RXUQDO

FKLOGUHQZLWKDXWLVP,Q$QRQ\PRXVHumanoid Robots
(Humanoids), 2010 10th IEEE-RAS International Conference
on