Gesture-Based Computing

Alicia Heintjes, Tony Pagnotta, Emily Earwood, Alexis Brown, Sean Doherty

What is it?
Uses the human body to interact with the digital resource without any input devices. Eliminates keyboard, mouse, game controller, or voice mechanism. Scans a limited space to analyze the human movement. The bodys movement determines the input.

How does it Work?

Uses different human motions to command technology may zoom in and out by stepping forward or backwards for videos could point left to replay flat hand to pause, and point right to continue Currently used in games and entertainment purposes Microsoft Kinect Leap Motion

Technology can capture multiple points of interaction simultaneously, which helps in dance or athletic technique physical therapy

Who is doing it?

The Tangible Media Group at the MIT Media Lab inFORM interface, uses a digital display and a pinscreen pins are attached to motors that lift in response to gestures made by remote operator, making effect of hands reaching out from display Technological Educational Institute of Crete and Aalborg University made gesture based game for teaching emotion recognition skills to preschoolers Ohio Universitys Language Resource Center uses holodeck, or environment created by images on multiple surfaces

Why is it significant?
3D computing skills see results of actions taken as they occur communicate with computer via sign language use hand gestures to control computer realistic fast response time more personalized enabled for multiple participants at once equipped for handicapped easy for all ages expand classroom resources visual learners easy to apply to any application or device encourages more developmental technology for the future

What are the downsides?

Some systems have difficulty discerning fine motor movements. Users, with disabilities, who are limited with fine motor skills Health concerns caused by everyday use. - Stress issues - Repetitive-motion injuries Recognizing and interpreting gestures might strike some users as invasive. - sparking concerns about privacy Determining what gestures mean may require a new vocabulary for interaction. Could conflict with gestures some cultures interpret as inappropriate.

Where is it going?
Possibilities are endless. Gesture Based Computing & Augmented Reality Medical Students Safety Drills Civil Engineering

Customization is key.

What are the Implications for teaching and learning?

Asset for hands on work design, construction, medical professionals. Aids in the speed in which physical skills are picked up. Provides practices and techniques available for copy. Athletics, rehabilitation Increases dexterity instruments. Assists languages by evaluating facial expressions while speaking.

Jeopardy
What is it? How does it work? Who is doing it? Why is it significant? What are the downsides? Where is it going? What are the implications for teaching and learning?

500 Emily

500 Tony

500 Tony

500 Alicia

500 Alexis

500 Sean

500 Emily

Q1
True or False: Gesture-based computing has no need for controllers or keyboards.

Click here to see answer

A1

TRUE!
Uses the human body to interact with the digital resource

Home

Q2
True or False: Gesture based computing can be used for entertainment, physical therapy, dance techniques and athletic techniques.
Click Here to see the Answer

A2

True!

Home

Q3
Name a school or organization mentioned in the powerpoint, that is using and improving gesture based computing.
Click Here to see the Answer!

A3
- The Tangible Media Group at the MIT Media Lab - Technological Educational Institute of Crete and Aalborg University - Ohio Universitys Language Resource Center (are all acceptable)
Home

Q4
True or False: Gesture-Based Computing is NOT equipped for those that are physically handicapped?

Click Here to See the Answer!

A4

False!
Gesture-Based Computing will be easily accessible by those that are physically handicapped.

home

Q5
True or False:

There are NO health concerns from everyday use

Click Here To See The Answer!

A5
FALSE!

Health concerns caused by everyday use. Stress issues Repetitive-motion injuries

Home

Q6
The possibilities are endless with Gesture Based Computing. One particularly promising area we discussed was the combination of Gesture Based Computing and _________?

Click Here For Answer

A6
Augmented Reality Medical Students Safety Drills Civil Engineering

Home

Q7

Why is gesture-based learning helpful in learning a language?

Click here to see answer

A7

It can evaluate your facial expression as you speak!

Home