SIXTH SENSE DEVICE

GROUP MEMBERS: SATISH PEDNEKAR

ADITYA MALGE SOHUM PRABHUDESAI ROSHAN TAKEKAR

INTERNAL GUIDE: MANJUSHA SANVORDEKAR

Contents:
INTRODUCTION

PURPOSE
MODULES

/ SCOPE

REQUIREMENTS

ADVANTAGES

/ DISADVANTAGES DIVISION OF WORK DATEWISE COMMITMENT REFERENCES

Introduction:

Sixth Sense is a wearable gestural interface that augments the physical world with digital information. User uses natural hand gestures to interact with the information and to perform operations. The hardware component are coupled in a pendent like mobile wearable device. It comprises of a camera, a pocket projector, a mirror and colored markers.

Purpose/ Scope

The purpose is to create a system that can identify human gestures and use this information for device control. It integrates the digital information to the physical world which will help us to get rid of the gap between these two worlds. We aim at designing a simple and easy to use product with features like understanding visual and audio input and to take computer-human interaction to a new level.

Modules

Building Device Configuring Camera and Projector Image Processing Event Handling

Building Device

The hardware comprises of pocket projector, camera, markers and mobile computing device coupled together. A Pocket Projector -Projects visual information onto interfaces like walls. A camera -Captures images and tracks user hand gestures. Colored Markers -Marker movements are interpreted into gestures. Laptop/Mobile -For processing of data.

Configuring Camera and Projector

Install camera and projector drivers. Connect camera to USB and projector to HDMI port. Run the software on mobile computing device.

Image Processing
Captured image will be preprocessed by standard resizing and making grayscale. Algorithms such as Block Pattern, The Histogram analysis are used for image processing. Open CV library is used for implementing these algorithms.

Event Handling

Once the gesture is identified appropriate command for it gets executed. Action includes running applications, displaying menu or any user specified action. The system continuously track markers for recognizing any more known gestures.

How it Works
Sends for Processing Camera

Captures
Gestures Images Pictures

Mobile Computing Device

Sends info Project on the surface Reflect the Image

Projector Project Image

Mirror

Hardware Requirements

USB Camera of at least 1.3 megapixel resolution. Portable pocket projector with standard HDMI or USB port Mirror of size 1x1 inch. Mobile computing device like Laptop, Tablet PC or Windows smart phone.

Software Requirements

Microsoft visual studio 2008. Dot Net Framework 2.0 or above. Open CV library. Windows XP or Windows Seven OS.

Use Case Diagram

Activity Diagram

Advantages
Portability. Support Multi-Touch and Multi-User Interaction. Cost effective. Connectedness between Real world and Digital world. Data access directly from the Machines in Real time. Mind Map the idea anywhere.

Concerns/Issues/Disadvantages

Invasion of others privacy. Also not enough privacy for the user. Data visibility problem : Projection better in the night time rather than mornings.

Division of work

Aditya and Sohum :Information On Hardware requirements. Satish and Roshan: Found out techniques needed and working on procedure that employs these techniques.

Date-wise Commitment

References
http://www.ted.com/talks/pranav_mistry_the_thrilling_po tential_of_sixthsense_technology.htm http://www.commoncraft.com/augmented-reality-video http://www.gesturetek.com http://www.ted.com/talks/pattie_maes_demos_the_sixth _sense.html

http://www.arcane-technologies.com/en/ http://en.wikipedia.org/wiki/SixthSense http://en.wikipedia.org/wiki/Augmented_reality

THANK YOU