SEMINAR 2015

TELE-IMMERSION

TELE-IMMERSION
SANU.P.S
CUAMMCA023

studies in the U.S. If a computer network

Abstract

can
Tele-immersion, a new medium for
human interaction enabled by digital
technologies, approximates the illusion
that a user is in the same physical space as
other people, even through the other
participants might in fact be hundreds or

support

tele-immersion,

it

can

probably support any other application.

This is because tele-immersion demands as
little delay as possible from flows of
information (and as little inconsistency in
delay), in addition to the more common
demands for very large and reliable flows.

thousands of miles away. It combines the

display and interaction techniques of
virtual

reality

with

new

Keywords:TIDE,TIC,Ic3D,HiBALL

vision

technologies that transcend the traditional

1. INTRODUCTION

limitations of a camera. Rather than

merely

observing

their

that enables a user to share a virtual space

immediate environment from one vantage

with remote participants. The user is

point, tele-immersion stations convey them

immersed in a 3D world that is transmitted

as moving sculptures, without favouring

from a remote site. This medium for

a single point of view. The result is that all

human interaction, enabled by digital

the participants, however distant, can share

technology, approximates the illusion that

and explore a life-size space.

a person is in the same physical space as

Beyond
videoconferencing,

people

and

Tele-Immersion is a new medium

improving

on

tele-immersion

was

conceived as an ideal application for

driving

network-engineering

research,

specifically for Internet2, the primary

research consortium for advanced network

others, even though they may be thousands

of miles distant. It combines the display
and interaction techniques of virtual reality
with new computer-vision technologies.
Thus with the aid of this new technology,
users at geographically distributed sites

1
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

can collaborate in real time in a shared,

3D environment scanning.

simulated, hybrid environment submerging

Projective and display

in one anothers presence and feel as if

technologies.

they are sharing the same physical space.

Tracking technologies.

Tele-immersion technology utilizes arrays

Audio technologies.

of cameras and microphones to capture 3D

Powerful networking.

scenes in real time. By having this setup at

multiple remote sites and streaming the 3D
data between the various locations one can
provide users with a level of interaction
currently not attainable by conventional
2D systems. In a tele-immersive system
users, represented as 3D data, are merged
into a common virtual environment where
they can interact with other remote users
and/or interact with shared non-existent
virtual objects placed in the environment
with them. The main goal of their work is
to

design

and

build

configurable and

a portable, re-

inexpensive

tele-

immersive system from commercial offthe-shelf components.

The considerable requirements for

tele-immersion system, such as high
bandwidth, low latency and low latency
variation make it one of the most
challenging

applications.

This

application is therefore considered to be an

ideal driver for the research agendas of the
Internet2 community.
Tele-immersion is that sense of
shared presence with distant individuals
and

their

environments

that

feels

substantially as if they were in ones own

local space. This kind of tele-immersion
differs significantly from conventional
video teleconferencing in that the users
view of the remote environment changes

2. WHAT IS TELE-IMMERSION
Tele-immersion enables users at
geographically distributed sites to

dynamically as he moves his head.

3. HISTORY

collaborate in real time in a shared,

simulated, hybrid environment as if they
were in the same physical room.

It was way back in 1965 that the

great pioneer of computer graphics, Ivan
Sutherland, proposed the concept of the

It is the ultimate synthesis of media

technologies:

net

ultimate display. It described a graphics

display that would allow the user to

2
CCSIT,CU CAMPUS

SEMINAR 2015

experience

TELE-IMMERSION

completely

computer

rendered environment.

two partners separated by 1,000 miles

collaborate on a new engine design.

In 1998, Abilene, a

backbone

Following the flow of information tele-

research project, was launched and now

immersion

serves as a base for Internet2 research.

processing at each end of a connection,

Internet2 needed an application that would

mediated by high performance network.

challenge

and

stretch

its

networks

capabilities.The head of advanced network

and services proposed tele-immersion at the
application that could drive internet2
research forward. That is how the national

depends

on

intense

data

From the sender: Parallel processors

accept visual inputs from the cameras and
reinterpret the scene as a 3-Dimensional
computer model.

tele-immersion initiative as formed in

may2000, researchers at the Universities of
North Carolina (UNC), the Universities of
Pennsylvania and advanced network and

Figure 1

services reached a milestone in developing

this technology. A user sitting in an office at

To the receiver: Specific rendering of

UNC in Chapel Hill, NC, was able to see

remote people and places are synthesized

life like, 3D images of colleagues hundreds

from the model as it is received to match

of miles away, one in Philadelphia and the

the point of view of each eye of a user. The

other in New York. Today scientists are still

whole process repeats many times a

developing

second to keep up with the user head

this

new

communication

technology. There are

several groups

working together on the national tele-

motion.
4.1 Generating the 3-D Image:

immersion initiative (NTII) to make this

wonderful technology available to the
common men.
4. HOW DOES TELEIMMERSION WORKS?
In this simplified scheme for how a
future tele-immersion scheme might work,
3
CCSIT,CU CAMPUS

Figure2 Array of cameras

SEMINAR 2015

TELE-IMMERSION

An array of cameras views people

and

their

surroundings

the Disparity map

visual field.

The disparities are then analyzed to

from

different angles . Each camera

yield depths

generates an image from its point

for the differences between what

of

each camera sees. These depth

second.
Each set of the images taken at a

values are combined into a bas

view

many

times

in

that would account

relief depth map of the scene.

given instant is sorted into subsets

Figure 4 depict it.

of overlapping trios of
images

Figure 3 Views taken by cameras

Figure 5 combined view point

All the depth maps are combined

into a single viewpoint independent
sculptural model of the scene at a
given

moment.

Process

of

combining the depth maps provide

Figure 4 disparity map

maps opportunities for removing

spurious points and noise. Figure 5
depicts the combined view point

From each trio of images, a

disparity

map

is

calculated,

5. SCIENCE OF TELE-IMMERSION

reflecting the degree of variation

among the images at all points in
4
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

Tele-Immersion has an environment

TELE-IMMERSION

called TIDE. TIDE stands for TeleImmersive Data exploration Environment.

(TIS)
TELE-IMMERSION

The goal of TIDE is to employ Tele-

(TIC)

Immersion techniques to create a persistent

REMOTE

environment in which collaborators around

the

world

can

engage

exploration

and

analysis

in

SERVER
CLIENT

DATA

AND

COMPUTATIONAL SERVICES

long-term

of

massive

scientific data-sets. When participants are

tele-immersed, they are able to see and
interact with each other and objects in a
shared

virtual

environment.

The

environment will persist even when all the

participants have left it. The environment
may autonomously control supercomputing
computations, query databases and gather
the results for visualization when the
participants return. Participants may even

Figure 6 Tele-Immersion

Data

Exploration

Environment

leave messages for their colleagues who

can then replay them as a full audio, video
and gestural stream.

5.1.1 TELE-IMMERSION SERVER

Digital audio is streamed between

the sites to allow them to speak to each
other. TIDE will engage users in CAVEs,
ImmersiveDesks and desktop workstations
around the world connected by the Science
and Technology Transit Access Point
(STARTAP) - a system of high speed
national and international networks.
5.1 TIDE
Tide has three components they are:

The

Tele-Immersion

Servers

primary responsibility is to create a

persistent entry point for the TICs. That is,
when a client is connected to the TIS, a
user

can

work

synchronously

or

asynchronously with other users. The

environment will persist even when all
participants have left it. The server also
maintains the consistent state that is shared
across all participating TICs. Finally the
TIS stores the data subsets that are

5
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

extracted from the external data sources.

6. VIDEO CONFERENCING VS TELE-

The data subsets may consist of raw and

IMMERSION

derived

data

sets,

three

dimensional

models or images.

Human interaction has both verbal

and

5.1.2 TELE-IMMERSION CLIENT

nonverbal

videoconferencing

elements,
seems

and
precisely

configured to confound the nonverbal

The Tele-Immersion Client (TIC)
consists of the VR display device (either
CAVE, ImmersiveDesk, etc) and the
software tools necessary to allow humanin-the

loop

computational

steering,

retrieval, visualization, and annotation of

the data. The TIC also provides the basic
capabilities for streaming audio and video,
and

for

rendering

avatars

to

allow

participants to communicate effectively

with one another while they are immersed
in the environment. These capabilities
come

ones. It is impossible to make eye contact

perfectly,

software framework called CAVERNsoft.

instance,

in

todays

videoconferencing systems, because the

camera and the display screen cannot be in
the same spot. This usually leads to a
deadened and formal affect in interactions,
eye contact being a nearly ubiquitous
subconscious method of affirming trust.
Furthermore, participants arent able to
establish a sense of position relative to one
another and therefore have no clear way to
direct attention, approval or disapproval.

as part of EVLs (Electronic

Visualization Laboratory)Tele-Immersion

for

Tele-immersion is an improved
version of digital technology. We can make
an eye contact, which will give a feeling of
trust. This approximates the illusion that a

5.1.3 REMOTE DATA AND-

user is in the same physical space as other

COMPUTATION SERVICES

people, even though they may be far apart.

Here rather than merely observing the

Remote Data and Computation

Services refer to external databases and/or
simulations/compute-intensive

tasks

running on supercomputers or compute

clusters that may be called upon to
participate in a TIDE work session.

people and their immediate environment

from one vantage point, tele-immersion
stations

convey

them

as

moving

sculptures, without favoring a single point

of view. They can share a life cycle space.
They are able to convey emotions in its

6
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

right intensity. A three dimensional view of

In order to fully utilize the tele-

the room is obtained. It can simulate

immersion, we need to provide interaction

shared models also.

that is both as seamless as real world but

allows

even

more

effective

7. NEW CONCEPTS AND

communication. For example, in the real

CHALLENGES

world someone involved in a meeting

might draw a picture on a paper and then

In a tele-immersive environment

show the paper to the other people in the

computers recognize the presence and

meeting. In tele-immersion spaces people

movements

have the opportunity to communicate in

of

individuals

and

both

physical and virtual objects, track those

fundamentally new ways.

individuals and objects, and project them

in

realistic,

multiple,

geographically

distributed immersive environments on

8.

REQUIREMENTS OF

TELE-IMMERSION

stereo-immersive surfaces. This requires

sampling and re synthesis of the physical
Tele-immersion is the ultimate

environment as well as the users faces and

bodies, which is a new challenge that will
move the range of emerging technologies,
such as scene depth extraction and warp

synthesis of media technologies. It needs

the best out of every media technology.
The requirements are given below.

rendering, to the next level.

Tele-immersive environments will
therefore facilitate not only interaction
between users themselves but also between
users and computer-generated models and
simulations. This will require expanding
the

boundaries

tracking,

of

display,

computer
and

vision,

8.1 3D environment scanning:

rendering

technologies. As a result, all of this will

enable users to achieve a compelling
experience and it will lay the groundwork
for a higher degree of their inclusion into

For a better exploring of the environment a

stereoscopic view is required. For this, a
mechanism for 3D environment scanning
method is to be used. It is by using

the entire system.

7
CCSIT,CU CAMPUS

SEMINAR 2015

multiple cameras

TELE-IMMERSION

for producing

two

separate images for each of eyes. By using

robust at about 25 fps and better still at

faster rates.

polarized glasses we can separate each of

the views and get a 3D view.

Measuring

the

moving

three-

dimensional contours of the inhabitants of

The key is that in tele-immersion,

a room and its other contents can be

each participant must have a personal view

accomplished in a variety of ways. In

point of remote scenes-in fact, two of

1993, Henry Fuchs of the University of

them, because each eye must see from its

North

own perspective to preserve a sense of

proposed one method, known as the sea

depth. Furthermore, participants should be

of cameras approach, in which the

free to move about, so each persons

viewpoints

perspective will be in constant motion.

compared. In typical scenes in a human

Tele-immersion demands that each scene

environment, there will tend to be visual

be sensed in a manner that is not biased

features, such as a fold in a sweater, that

toward any particular viewpoint (a camera,

are visible to more than one camera. By

in contrast, is locked into portraying a

comparing the angle at which these

scene from its own position). Each place,

features are seen by different cameras,

and the people and things in it, has to be

algorithms can piece together a three-

sensed from all directions at once and

dimensional model of the scene.

Carolina

of

at

Chapel Hill had

many

cameras

are

conveyed as if it were an animated three-

This technique had been explored

dimensional sculpture. Each remote site

in non-real-time configurations, which

receives information describing the whole

later culminated in the Virtualized

moving sculpture and renders viewpoints

Reality demonstration at Carnegie

as needed locally. The scanning process

Mellon University, reported in 1995. That

has to be accomplished fast enough to take

setup consisted of 51 inward-looking

place in real time at most within a small

cameras mounted on a geodesic dome.

fraction of a second.

Because it was not a real time device, it

The sculpture representing a person

could not be used for tele-immersion.

can then be updated quickly enough to

Ruzena Bajcsy, head of GRASP

achieve the illusion of continuous motion.

(General Robotics, Automation, Sensing

This illusion starts to appear at about 12.5

and Perception ) Laboratory at the

frames per second (fps) but becomes

University of Pennsylvania, was intrigued

by the idea of real-time seas of cameras.

8
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

Starting in 1994, small scale puddles of

patterns

visible

only

to

specialized,

two or three cameras to gather real-world

carefully synchronized cameras. These

data for virtual reality applications was

patterns fill in voids such as white wall

introduced.

with imposed features that allow a sea of

But a sea of cameras in itself isnt

cameras to complete the measurements. If

complete solution. Suppose a sea of

imperceptible structured light is not used,

cameras is looking at a clean white wall.

then there may be holes in reconstruction

Because there are no surface futures, the

data that result from occlusions, areas that

cameras have no information with which

arent seen by enough cameras, or areas

to build a sculptural model. A person can

that dont provide distinguishing surface

look at a white wall without being

features.

confused. Humans dont worry that a wall

might actually be a passage to an infinitely
deep white chasm, because we dont rely
on geometric cues alone we also have a
model of a room in our minds that can rein
in

errant

mental

interpretations.

Unfortunately, to todays digital cameras, a

persons forehead or Tshirt can present
the same challenge as a white wall, and
todays software isnt smart enough to
undo the confusion that results.
Researchers at Chapel Hill came
with a novel method that has shown
promise for overcoming this obstacle,
called imperceptible structured light or
ISL. Conventional light bulbs flicker 50 or
60 times a second, fast enough for the
flickering to be generally invisible to the
human eye. Similarly, ISL appears to the
human eye as a continuous source of white
light, like an ordinary light bulb, but in
fact it is filled with quickly changing
9
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

To accomplish the simultaneous

capture and display an office of the future
is envisioned where ceiling lights are
controlled cameras and smart projectors
that are used to capture dynamic imageimperceptible

At the transmitting end, the 3d

structured light techniques, and to display

image scanned is generated using two

high-resolution

techniques:

based

models

with
images

on

designated

display surfaces. By doing simultaneously

8.2.1 Shared table approach

on the designated display surfaces, one can

Here, the depth of the 3d

dynamically adjust or auto calibrate for

resolution

image is calculated using 3d wire frames.

variations resulting from irregular or

this technique uses various camera views

changing display surfaces, or overlapped

and complex image analysis algorithms to

projector images.

calculate the depth.

geometric,

intensity,

and

Now the current approach to

8.2.2Ic3d (incomplete 3d) approach

dynamic image-based modeling is to use

an optimized structured light scheme that

In this case, a common texture

can capture per-pixel depth and reflectance

surface is extracted from the available

at interactive rates. The approach to

camera views and the depth information is

rendering on the designated (potentially

coded in an associated disparity map. This

irregular) display surface is to employ a

representation can be encoded into a

two-pass projective texture scheme to

mpeg-4 video object, which is then

generate images that when projected onto

transmitted.

the surfaces appear correct to a moving

8.3 Reconstruction in a holographic

head-tracked observer.

environment:
Figure 7 Camera setup in Chapel Hill.

The process of reconstruction of

8.2 Image processing:

image occurs in a holographic environment.

The reconstruction process is different for
shared table and ic3d approach.
10
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

8.3.1 Shared Table Approach

persons world. For this, a projected view

of the other users world is needed. For

Assuming

that

the

geometrical

parameters of the multi-view capture

device, the virtual scene and the virtual
camera are well

fitted to each other, it

is ensured that the scene is viewed in the

right perspective view, even 3while

producing a projected view, big screen is

needed. For better projection, the screen
must be curved and special projection
cameras are to be used.
8.5 Tracking technologies:

changing the viewing position.

It is great necessity that each of the

8.3.2 Ic3d Approach

objects in the immersive environment be

tracked so that we get a real world

The decoded disparities are scaled

experience. This is done by tracking the

according to the users 3d viewpoint in the

movement of the user and adjusting the

virtual scene, and a disparity-controlled

camera accordingly.

projection

is

carried

out.

The

3d

perspective of the person changes with the

8.5.1 Moving Sculptures:

movement of the virtual camera.

In both the approaches, at the

It

combines

the

display

and

receiving end the entirely composed 3d

interaction techniques of virtual reality

scene is rendered onto the 2d display of the

with

terminal by using a virtual camera. the

transcend the traditional limitations of a

position of the virtual camera coincides

camera. Rather than merely observing

with the current position of the conferee's

people and their immediate environment

head. for this purpose the head position is

from one vantage point, tele-immersion

permanently registered by a head tracker

stations

and the virtual camera is moved with the

sculptures, without favoring a single point

head.

of view. The result is that all the

new

vision

convey

technologies

them

as

that

moving

participants, however distant, can share

8.4 Projective & display technologies:
By using tele-immersion a user

and explore a life size space.

8.5.2 Head & Hand tracking :

must feel that he is immersed in the other

11
CCSIT,CU CAMPUS

SEMINAR 2015

The

sites

dimension, i.e., a 3D sound capturing and

collaborated on several joint design-and-

reproduction method has to be used. This

manufacture efforts, including the design

is necessary to track each sound sources

and rapid production of a head-tracker

relative position.

component (HiBall) (now used in the

8.7 Powerful networking:

experimental

UNC

TELE-IMMERSION

UNC

and

Utah

wide-area

ceiling

tracker). Precise, unencumbered tracking

If a computer network can support

of a users head and hands over a room

tele-immersion it can probably support any

sized working area has been an elusive

other application. This is because tele-

goal in modern technology and the weak

immersion demands as little delay as

link in most virtual reality systems.

possible from flows of information (and as

Currant commercial offerings based on

little inconsistency in delay), in addition to

magnetic technologies perform poorly

the more common demands for very large

around

magnetically

and reliable flows. The considerable

noisy computer components as CRTs,

requirements for tele-immersion system,

while optical-based products have a very

such as high bandwidth, low latency and

small working volume and illuminated

low variation (jitter), make it one of the

beacon targets (LEDs). Lack of an

most challenging net applications.

effective tracker has crippled a host of

8.7.1 Internet 2

augmented reality applications in which

behind Tele-immersion

such

ubiquitous,

the driving force

the users views of the local surroundings

are augmented by synthetic data (e.g.,

It is the next generation internet.

location of a tumor in the patients breast

Tele-immersion was conceived as ideal

or the removal path of a part from within a

application

complicated piece of machinery).

engineering

research.

consortium

consisting

for

driving

network

Internet2
of

the

is

a
US

government, industries and around 200

universities and colleges.
It has high bandwidth and speed. It
8.6 Audio technologies:

enables revolutionary internet applications.

For true immersive effect the audio

8.7.2 Need for speed:

system has to be extended to another

12
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

If a computer network can support

to support research were the NSFnet in the

tele-immersion, it can probably support

late 1980s and the vBNS in the mid-

any other application. This is because tele-

1990s. Each of these played a part in

immersion demands as little delay as

inspiring new applications for the Internet,

possible from flows of information (and as

such as the World Wide Web. Another

little inconsistency in delay), in addition to

backbone research project, called Abilene,

the more common demands for very large

began in 1998, and it was to serve a

and reliable flows.

university

consortium

called

Internet2.Abilene now reaches more than

8.7.3 Strain to Network:

170 American research universities. If the

only goal of Internet2 were to offer a high

In

tele-immersion

only

level of bandwidth (that is, a large number

participants motion but also the entire

of bits per second), then the mere existence

surface of each participant had to sent. So

of Abilene and related resources be

it strained a network very strongly.

sufficient. But Internet2 research targeted

Bandwidth is a crucial concern. Our

additional

demand for bandwidth varies with the

development of new protocols for handling

scene and application; a more complex

applications

scene

bandwidth

requires

more

not

bandwidth.

goals,
that
and

among

them

demand
very

very

low,

the
high

controlled

Conveying a single person at a desk,

latencies (delays imposed by processing

without the surrounding room, at a slow

signals en route).

frame rate of about two frames per second

The

last

mile

of

network

has proved to require around 20 megabits

connection that runs into computer science

per second but with up to 8-megabit-per-

departments currently tends to be an OC3

second peaks.

line, which can carry 155 megabits per

second-just about right for sustaining a

8.7.4 Network backbone:

three-way conversation at a slow frame

rate. But an OC3 line has approximately

A backbone is a network within a

100 times more capacity than what is

network that lets information travel over

usually considered a broadband connection

exceptionally powerful, widely shared

now, and it is correspondingly more

connections to go long distances more

expensive.

quickly. Some notable backbones designed

13
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

scene and application; a more complex

scene requires more bandwidth. We can
8.7.5 Computational Needs:

assume that much of the scene, particularly

the

Beyond the scene-capture system,

the principal components of a tele-

background

walls

and

such,

is

unchanging and does not need to be resent

with each frame.

immersion setup are the computers, the

Conveying a single person at a

network services, and the display and

desk, without the surrounding room, at a

interaction

these

slow frame rate of about two frames per

components has been advanced in the

second has proved to require around 20

cause of tele-immersion and must advance

megabits per second but with up to 80-

further. Tele-immersion is a voracious

megabit-per-second peaks. With time,

consumer of computer resources. Literally

however, that number will fall as better

dozens of such processors are currently

compression

needed at each site to keep up with the

established. Each site must receive the

demands

streams from all the others, so in a three-

devices.

of

Each

of

tele-immersion.

Roughly

techniques

speaking, a cluster of eight two-gigahertz

way

Pentium processors with shared memory

requirement

should be able to process a trio within a

accordingly. The last mile of network

sea of cameras in approximately real time.

connection that runs into computer science

Such

departments currently tends to be an OC3

processor

clusters

should

be

available in the later year.

One

promising

conversation

become

must

the

bandwidth

be

multiplied

line, which can carry 155 megabits per

avenue

of

second-just about right for sustaining a

exploration in the next few years will be

three-way conversation at a slow frame

routing tele-immersion processing through

rate. But on OC3 line is approximately 100

remote supercomputer centers in real time

times more capacious than what is usually

to gain access to superior computing

considered a broadband connection now,

power. In this case, a supercomputer will

and it is correspondingly more expensive.

have to be fast enough to compensate for

the extra delay caused by the travel time to

8.7.6 Tele Cubicle:

and from its location.

Bandwidth is a crucial concern.

The tele-cubicle represents the next

Our demand for bandwidth varies with the

generation immersive interface. It can also

14
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

be seen as a subset of all possible

9.2 Video Conferencing

immersive interfaces. An office appears as

In fact, tele-immersion might come

one quadrant in a larger shared virtual

to be seen as real competition for air

office space. The canvases onto which the

travel-unlike videoconferencing. Although

imagery can be displayed are a stereo-

few would claim that tele-immersion will

immersive desk surface as well as at least

be absolutely as good as being there in

two stereo. Such a system represents the

the near term, it might be good enough for

unification

business

of

Virtual

Reality

and

meetings,

professional

videoconferencing, and it provides an

consultations, training sessions, trade show

opportunity for the full integration of VR

exhibits and the like. Business travel might

into the workflow. Physical and virtual

be replaced to a significant degree by tele-

environments appear united for both input

immersion in 10 years. This is not only

and display. This combination, we believe,

because tele-immersion will become better

offers

and cheaper but because air travel will face

new

paradigm

for

human

communications and collaboration.

limits to growth because of safety, land use

and environmental concerns.

9. APPLICATIONS

9.3 Immersive Electronic Book:

9.1 Collaborative Engineering Works:

Applications of tele-immersion will

include immersive electronic books that in

Teams
collaborate

of
at

engineers

great

might

distances

on

computerized designs for new machines

that can be tinkered with as though they
were real models on a shared workbench.
Archaeologists from around the world
might experience being present during a
crucial dig. Rarefied experts in building
inspection or engine repair might be able
to visit locations without losing time to air
travel.

effect blend a time machine with 3D

hypermedia, to add an additional important
dimension, that of being able to record
experiences in which a viewer, immersed
in the 3D reconstruction, can literally walk
through the scene or move backward and
forward in time. While there are many
potential application areas for such novel
technologies (e.g., design and virtual
prototyping,

maintenance

paleontological

and

and

repair,

archaeological

reconstruction), the focus here will be on a

15
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

socially important and technologically

challenging driving application, teaching
surgical

management

of

difficult,

potentially lethal, injuries.

Tele immersion can be of immense

use to the field of medicine. The way
medicine is taught and practiced has
always

9.4 Collaborative mechanical CAD:

been

very

hands-on.

It

is

impossible to treat a patient over the phone

A group of designers will be able to

or give instructions for a tumour to be

collaborate from remote sites in an

removed without physically being there.

interactive design process. They will be

With the help of tele-immersion, 3D

able to manipulate a virtual model starting

surgical learning for virtual operations is

from the conceptual design, review and

now in place and, in the future, the hope is

discuss the design at each stage, perform

to be able to carry out real surgery on real

desired evaluation and simulation, and

patients.

even finish off the cycle with the

surgeon could be tele-immersed into an

production of the concrete part on the

operation theatre to perform an operation.

milling machines.

This could potentially be lifesaving if the

geographically

distanced

patient is in need of special care (either a

9.5 Entertainment:

19 technique or a piece of equipment),

which is not available at that particular

Tele-immersive holographic environments

location.

Tele-immersion

'will

have a number of applications. Imagine a

surgeons

the

superimpose

video game free of joysticks, in which

anatomic images right on their patients

youbecome a participant in the game,

while they are being operated on'.

fighting monsters or scoring touchdowns.

9.6 Live Chat:
Instead of travelling hundreds of
miles to visit your relatives during the
holidays, you can simply call them up and
join them in a shared holographic room.
9.7 Medicine :
16
CCSIT,CU CAMPUS

ability

to

give

SEMINAR 2015

TELE-IMMERSION

Fig.8 Medical Use

present in another city, is sitting right

across you as if he or she is right there.

9.8 Uses In Education

The person at the other end will experience

the same immersive connection. With tele-

In education, tele-immersion can be used

immersion bringing two or more distant

to bring together students at remote sites in

people together in a single, simulated

a single environment. Relationships among

office setting, business travel will become

educational institutions could improve

quite redundant.

tremendously in the future with the use of

tele-immersion. Already, the academic
world is sharing information on research
and development to better the end results.
With tele-immersion in schools, students
could have access to data or control a
telescope from a remote location.
Fig 10 Office Use

9.10 Other Applications

Building inspectors could tour
structures without leaving their desks.
Automobile

designers

from

different

continents could meet to develop the next

generation
Fig 9 Educational Use

of

vehicles.

In

the

entertainment industry, ballroom dancers

could train together from separate physical

9.9 Future Office -

spaces. Instead of commuting to work for a

board meeting, businesspersons could

In years to come, instead of asking for a

attend it by projecting themselves into the

colleague on the phone you will find it

conference room. The list of applications

easier to instruct your computer to find

is large and varied, and one thing is crystal

him or her. Once you do that, you'll

clear this technology will significantly

probably see a flicker on one of your office

walls and find that your colleague, who's
17
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

affect the educational, scientific and

medical sectors.

The computers, too, are bandwidth

limited with regard to handling very
large data for collaboration Simulation

11. CHALLENGES OF TELE-

and data mining are open-ended in

computational and bandwidth needs

IMMERSION

there will never be quite enough

Tele-immersion has emerged

computing and bits/second to fully

as a high-end driver for die Quality of

analyze,

Service (QoS), bandwidth, and reservation

scientific purposes.

efforts envisioned by the "NGI and

lnternet2 leadership. From a networking
perspective, tele-immersion is a very
challenging technology for several reasons.
The networks must be in place and
tuned

to

support

applications.
Low latency,

high-bandwidth

needed

for

In

transoceanic distances.

Multicast, unicast,

reliable

"flows") need to be provided for and

managed by the networks and the

audio reconstruction ("streaming") are

critical

to

achieving

the

feel

of

the

of

supercomputers.

Large network bandwidth

requirement reasons.

10. CONCLUSION
Tele immersion is a dynamic
concept,

which

will

transform the way

humans, interact with each other and the

world in general.
Tele

immersion

takes

video

conferencing to the next higher level. It

helps in simulation of office environment
so it can reduce business travel.

telepresence, whether synchronous or

recorded and played back .

language

networks.
The
non-availability

operating systems of supercomputerclass workstations.

Real-time considerations for video and

for

The non-availability of high speed

and

unreliable data transmissions (called

Layman's

reality

today due to the following reasons:

guarantee given current middleware.

The speed of light in fiber itself is a
limiting factor over transcontinental and

simulate

realization of tele-immersion is impossible

2-way

collaboration, is hard to specify and

and

Tele
expected

18
CCSIT,CU CAMPUS

to

be

immersion
very

expensive

is
to

SEMINAR 2015

compete

with

TELE-IMMERSION

other communication

technologies when implemented.

[Dhond and Aggrawal, 1989] Dhond, U. and

Aggrawal, J. (1989). Structure from stereo: a
review. IEEE
Transactions on Systems, Man, and
Cybernetics, 19(6):14891510.
[Faugeras, 1993] Faugeras, O. (1993). Threedimensional Computer Vision. MIT-Press,
Cambridge, MA.
[Konolige, 1997] Konolige, K. (1997). Small
vision system: Hardware and implementation.
Eighth International
Symposium on Robotics Research, Hayama,
Japan.

12. REFERENCES
[Ayache and Hansen, 1988] Ayache, N. and
Hansen, C. (1988). Rectification of images
for binocular and trinocular stereovision.
Proc. of 9th International Conference on
Pattern Recognition, 1:1116.
[Belhumeur, 1996] Belhumeur, P. (1996). A
bayesian approach to binocular stereopsis. Intl.
J. of Computer
Vision, 19(3):237260.
[Chen and Williams, 1993] Chen, E. and
Williams, L. (1993). View interpolation for
image synthesis. In
ACM SIGGRAPH, pages 279-288, 1993.

[Kutulakos and Vallino, 1998] Kutulakos, K.

and Vallino, J. (1998). Calibration-free
augmented reality.
IEEE Trans. on Visualization and Computer
Graphics, 4(1):120.
[Macedonia and Noll, 1998] Macedonia, M.
and Noll, S. (1998). Real-time 60hz distortion
correction on a
silicon graphics ig. IEEE Computer Graphics
and Applications, 5:7682.
[Matthies, 1992] Matthies, L. (1992). Stereo
vision for planetary rovers: Stochastic
modeling to near realtime
implementation. International Journal of
Computer Vision, 8:7191.
[Maybank and Faugeras, 1992] Maybank, S.
and Faugeras, O. (1992). A theory of selfcalibration of a
moving camera. Intl. J. of Computer Vision,
8(2):123151.
[Moravec, 1981] Moravec, H. (1980/1981).
Robot rover visual navigation. Computer
Science: Artificial
Intelligence, pages 105108.
[Narayanan et al., 1998] Narayanan, P.,
Rander, P., and Kanade, T. (1998).
Constructing virtual worlds
using dense stereo. Proc, Intl. Conf. Computer
Vision ICCV98, pages 310.

[Devernay, 1994] Devernay, F. (1994).

Computing differential properties of 3-D
shapes from stereoscopic
images without 3-D models. INRIA, Sophia
Antipolis, RR-2304.
19
CCSIT,CU CAMPUS

SEMINAR 2015

TELE-IMMERSION

20
CCSIT,CU CAMPUS