www.open.ac.

uk

SCALABLE
MULTIVIEW IMAGING
BY:
MOBOLAJI AKINOLA

SUPERVISORS:
PROF. LAURENCE DOOLEY
DR. PATRICK WONG ©2009 by Mobolaji Akinola
 Content of Presentation
• Background: History and trends
• Literature Review: Challenges
• Research Questions
• Potential Openings
• Distributed Video Coding (DVC)
• Research Plan
• Current Work: Full Implementation of Enhanced
Wyner-Ziv DVC

©2009 by Mobolaji Akinola

BACKGROUND
Multimedia Imaging : History and trends

• Major interest in the use of imaging technologies.

• Availability of cheaper cameras and increasingly powerful
computers.
• New emerging applications: video conferencing, multi-
sensor surveillance, and free viewpoint TV.
• Convergence of various Imaging technologies.
• Emergence and rapid evolution of various video coding
standards including MPEG.
• Emergence of various devices with different capabilities
and competing resources.
©2009 by Mobolaji Akinola
BACKGROUND…. Chronology.
Multimedia Imaging : History and trends

1992 1994 1999 2003 2005 2010

MVC***(?)
MPEG1 H.263 MPEG2 H.264
MPEG4
JVT***(?)

DVD, SVCD Mixed MULTIVIEW

VCD Video AVC,
Conf. & Media, HD,
& Storage Animations Interactive ALL MEDIA
Internet & &
Appl. Text SVC` SCALABLE
ADAPTIVE
©2009 by Mobolaji Akinola
BACKGROUND….. Cont’d.
What is Multiview imaging??

©2009 by Mobolaji Akinola

Literature Review: CHALLENGES
• Paradigm shift from more pixels & higher
resolutions to more views.
• Higher coding efficiencies due to new
applications like 3-D TV, free viewpoint TV and
Holographic projections. **The bit rate for
projecting reality is 1.36 X 1012 bits/second!!
• Encoders are typically 5 to 10 times more
complex than decoders.
• The challenge of scalability for resource limited
devices.
©2009 by Mobolaji Akinola
Research Questions
• Can more efficient codes be developed to meet
emerging technologies demand? i.e. Free
viewpoint TV
• How to reduce encoder complexity and balance
the encoder-decoder computational overhead?
• Can low resolution multiple views be exploited to
give high resolution at the decoder?
• Under which platform and what architecture will
emerging technologies thrive?
• Do we start from the scratch i.e. new paradigm or
adapt existing techniques?
©2009 by Mobolaji Akinola
Potential Openings
One potential in the literature is Distributed Video
Coding (DVC):
– In conventional coding frameworks, the encoder has
the task to exploit both the temporal and spatial
redundancies.
– The DVC paradigm proposed to allow decoder take on
some of the computationally intensive encoder work.
• Based on proven theories of Slepian-Wolf and Wyner-Ziv
• Theories have been around for more than 30 years BUT
until recently there are no practical implementations
• Currently the overall performance of DVC in (video quality,
bit-rate, distortion…) is low compare to conventional codecs
©2009 by Mobolaji Akinola
 Current Work: Full Implementation of an
Enhanced Wyner-Ziv DVC
• Conceptual diagram of DVC

CHEAP POWERFUL
ENCODER DECODER

WZ
R ≥ H(X|Y)
OUTPUT
X Encoder
Encoder Decoder
Decoder X
Statistically
dependent
Y Side Information Y
INPUT ©2009 by Mobolaji Akinola
Research Plan Plan

& Goals
done

Months
plan
1-2 3-4 5-6 7-8 9-10 11-12 13-14 15-16 17-18 19-20 21-22

Literature Review
- survey Scalable Multi-view Imaging
- Identify Challenges and Questions
- Identify Gaps in literature
- Continuous review of literature

Implementation of test bed
- architecture
- algorithm & coding
- analysis

Testing Ideas and Controlling Results
- Performance comparison
- Investigate the characteristics and explain results
- Efficiency incremental
- Check bottlenecks
- Rate control

Publication and Dissemination of Results

- Technical Reports for in-depth report of Implementation
- Peer Reviewed Conference
- Journal Publication

©2009 by Mobolaji Akinola

REFERENCES
• [1] T. Holman, “The bit rate of reality [picture/sound reproduction]”
Intl. Conference on consumer electronics, ICCE 2000.
• [2] Christine Guillermot et all, “Distributed Mono-view and multi-
view video coding, IEEE Signal Processing Magazine 2007.
• [3] Bernd Girod et all, “Distributed Video Coding”, IEEE special
issue on advances in Video coding and delivery 2005.
• [4] Slepian and Wolf, “Noiseless coding of correlated information
sources”, IEEE Trans. Inform. Theory 1973.
• [5] Pradhan and Ramchandran, “Distributed source coding using
syndromes (DISCUS): Design and construction”, IEEE data comp.
conf. 1999
• [6] R. Zamir, “The rate loss in Wyner-Ziv problem”, IEEE
transactions on information theory 1996.

©2009 by Mobolaji Akinola

THANK YOU

©2009 by Mobolaji Akinola