Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
MULTI-MEDIA PRODUCTION
Basic Multimedia Elements
i. Text
ii. Graphics
iii. Sound
iv. Video
v. Animations
Digitization
Analogue signals Digital signals
Sample Digitization
analogue signals digitizing device digital signals
video in video tape video capture card digital video files (.mpg, .avi)
sound captured by microphone sound card digital audio files (.wav, .mp3)
image from books scanner digital images (.jpg, .gif, .bmp)
real life image digital camera digital images (.jpg, .gif, .bmp)
In general, the higher the quality of the digitized information, the larger the size of
the digital file
Text
Merits of Text:
Text is used in conveying messages in an accurate and unambiguous way.
Compared to other multimedia elements, text is much smaller in size (1 byte for 1 English character, 2
bytes for 1 Chinese character) takes up smaller amount of store and is transmitted quickly.
ii. ASCII codes can encode a total of 256 (28) characters, including English alphabets (both upper and
lower cases), Arabic digits and some common symbols.
iii. For a web page that consists of Chinese characters, the web page constructors must specify the character
set used in order to ensure that the users browsers can display the text properly.
Formatting Features
Character Formatting. It determines the appearance of characters, like colour, typeface, font size and font
style.
Paragraph Formatting. New paragraphs are created by pressing the Enter key. It includes line
spacing, paragraph width and text alignment.
Page Formatting. It specifies the size of paper used, orientation (landscape/portrait), margins, header and
footer.
Rich Text Format (.rtf). It is developed for cross-platform document interchange RTF files are actually
ASCII files with special encoding codes to indicate formatting information such as fonts and margins.
Word Processing Document (.doc). The files can be edited easily. The formatting codes are software-
specific.
Portable Document Format (.pdf). The files cannot be edited. The plug-in player to view the documents
can be downloaded freely. The original format of the source document is preserved.
Hypertext Document (.html). An HTML document is also a plain text document containing special codes
(HTML tags) which tells Web browsers how to display the document.
Scanning and then using OCR. Image of text is first captured by a scanner and then changed to
text by an OCR (Optical Character Recognition) software.
Handwriting (). A handwriting recognition device is used. It consists of a touch sensitive plate and
a handwriting recognition software.
Speech. Voice is captured by a microphone and a sound card. The text is then produced by a voice
recognition software.
Note that the correctness of spelling can be checked by most word processors. They checks your document for
spelling errors by using their main dictionaries, i.e. a file containing most common words. (Refer to notes of
Microsoft word.
Graphics
Computer graphic images are usually captured
i. using digital devices, e.g. stills from digital camera or individual frames of a video from
digital video recorder .
iii. from screen images by pressing the Print Screen key and then pasted on documents of
various applications.
iv. from clipart and stock photographs from CD-ROMs or web pages.
v. from computer drawing using various graphics programs, e.g. Paintbrush (), Flash, etc.
i. Under this system, images are represented as an array of pixels of various colours, e.g. images obtained
from digital camera.
Vector graphics.
i. Under this system, images are geometric objects such as straight lines, ovals and arcs, e.g. graphs drawn
with drawing tools of Word.
ii. Advantage:
a. The vector graphics can be magnified without the loss of image quality. (no zig-zag along edges)
b. In general, for the same graphical image, the vector graphics version occupies less storage space.
iii. Common file formats: fh (Freehand), swf (Flash) and wmf (Windows Metafile).
outline tracing
vector graphics bitmap graphics
rasterisation
i. The dimension of a bitmap graph, i.e. the number of pixels in length times the number of pixels in width,
e.g. 300 x 200.
Aspect ratio.
ii. If a image has a resolution of 2272 x 1704, its aspect ratio is found as follows:
2272 4
AspectRatio = 2272 : 1704 = = = 4:3
1704 3
Colour depth.
i. The number of bits used to represent the colour of each pixel.
ii. It can also be regarded as the maximum number of unique colours.
iii. The number of different colours can be assigned to each pixel depends on the number of bits used to
represent it. (8 bits 28 = 256 colours, 24 bits 224 = 16,777,216 colours)
ii. It is usually smaller than that appears on the screen. (Minimum printing resolution may be 150 dpi while
that of screen may be around 72 dpi.)
For example, the uncompressed file size of a 24-bit bitmap image with 800 x 600 pixels is,
Short Exercise: find the uncompressed file size of a bitmap image with the following attributes
1600 x 1200 pixels x 32 bits/pixel = 1920000 x 32 / 8 B = 7680000 B = 7500 KB 7.32MB (cor. to 2 d.p.)
Figure 1: Open a jpeg file using Microsoft Image Editor, then choose properties () under the file ()
menu, the following dialog box will be displayed,
Image size:
Colour depth: 1024 x 768 pixels
224 = 16777216
Joint Photographic Experts Group ( JPG ). Lossy compressed format, i.e. not capable to get back
the original uncompressed format. Suitable for compressing photos.
Graphics Interchange Format ( GIF ). Lossless compressed format. Suitable for drawings. Supporting
animation, transparent background and interlaced image.
Portable Network Graphics ( PNG ). Similar to GIF. Lossless compressed format with smaller file
size than GIF. Not supporting animation. Supporting different degrees of colour transparency.
Tag Imge File format ( TIF ). Common format for exchanging bitmaps between application programs.
Original image format from scanner and fax. Capable of storing multiple images.
Note that:
i. For lossy compression using JPEG, compression ratio = uncompressed file size : compressed file size
ii. compression ratio image quantity
iii. If an image needs to be edited repeatedly, use uncompressed or lossless compression format. The JPEG
conversion should be reserved for final publishing.
**Note that text on some web pages were saved in graphic format. Why?
The text format can be shown exactly even the file is opened by different browsers. Moreover, more special
effects can be added to the text to make it more attractive.
Sound (Ch. 4)
Nature of sound
When we make a sound, vibrations, called sound waves , are created as follows,
wavelength
amplitude
time
The Loudness, or volume, is related to the height of the wave, i.e. amplitude . The higher the wave
peaks, the louder the sound is.
The pitch is related to the frequency . The higher the frequency, the higher the pitch is. It is measured
in hertz (Hz), i.e. number of vibrations in 1 second.
Sampling rate: the number of times a sample is taken for one-second audio signal (e.g. 44.1 kHz, 96 kHz).
Sample size: the amount of information stored for each sample of a time interval. (e.g. 8 bits, 16 bits)
The higher the sampling rate and the larger sampling size, the higher the sampling quality will be.
E.g.
ii. For example, the uncompressed file size of a 3-minute stereo recording at a sampling rate of 44.1 kHz
and with 16-bit sample size is:
Bit rate
i. It is the amount of data passing through a particular point in an audio stream in one second.
iii. For example, if the bit rate of a song is constant and the song lasts for 4 minutes is 128 kbps, the file size
should be:
Encoding bit rate. The bit rate used in compressing the audio file.
A MIDI file can be view as a musical score storing digital musical instructions which represent the volume ,
pitch and duration of the sound from various specific musical instruments.
By using MIDI software, the musical notes from the score can be edited.
Recording MIDI files using MIDI keyboard and other digital musical instruments.
MPEG-1 Audio Layer-3 ( .mp3 ). It is a popular standard for lossy audio compression, which reduces the
storage space required for recorded WAV audio. It removes part of the sound signals that our ears cannot detect.
It supports streaming.
RealAudio / RealMedia ( .ra, .rm ). RealAudio is a streaming audio format developed by RealNetworks
for delivering quality music efficiently on the Web. It supports lossy compression only. An audio
decompression software, RealPlayer, is necessary to play RealAudio. Same audio source may be encoded in
different bit-rates.
Windows Media Audio ( .wma, .asx ). WMA is a compressed streaming format developed by Microsoft
and supports both lossless and lossy compression.
Advanced Audio Coding ( .aac, .m4a ). AAC is a lossy compressed streaming audio format developed by
MPEG as successor of MP3. It is used as the default format in iPhone and iPod.
Video (Ch. 5)
A video is a full motion recording of an event.
A frame is one of the still images displayed on the screen.
Unlike animation, video begins with continuous motion and breaks it up into frames.
Frame rate. The number of frames displayed per second. E.g. 12 fps( frames per second ), 30 fps.
Audio sampling size and rate. Video frames can be accompanied by audio tracks.
Video standards. Different countries use different video standards for broadcasting. E.g. PAL, NTSC.
Bit rate. Similar to compressed audio, it is the amount of data passing through a particular point in a video
stream in one second.
For example, the uncompressed silent video file size of a two-minute video with frame size 800 x 600,
colour depth 24 bits and frame rate 30 fps is,
Short Exercise: find the uncompressed silent video file size of a video with the following attributes:
i. 30-second video with frame size 320 x 240, colour depth 24 bits and frame rate 25 fps
ii. four-minute video with frame size 1024 x 576, colour depth 32 bits and frame rate 24 fps
Analogue video signals are sent to the computer through a video capture card, which converts the analogue
signals into digital signals, and thus can be processed by the computer.
It may still take too long time to download a entire compressed video file on the Internet. Video
streaming allow the client browser start displaying the video before entire file has been transmitted.
(Sample file type: ASF, WMV, RM)
Sources of Video
Digital video clips from CD-ROM or the web.
Recording video using digital devices like digital video recorder or digital camera..
Capturing video from various analogue video source (e.g. TV signals) using video capture cards.
Motion Picture Experts Group ( .mpg ). The group develops standards for digital video and digital audio. It
is a lossy compression file format. It stores only the changes between successive frames.
RealVideo ( .rv, .rm ). It is a compressed streaming video format developed by RealNetwork and
can be played by RealPlayer.
Window Media Video ( .wmv, .asf ). It is a streaming compressed video format developed by
Microsoft and can be played by Microsoft Windows Media Player.
QuickTime ( .mov ). It is a compressed streaming video format developed by Apple and can be played by
QuickTime player. It can also store other multimedia elements including text, still images and animation.
Flash video ( .flv ). It is used to deliver videos over the Internet with Adobe Flash Player. Highly
compressed. Popular in YouTube and Google Video.
Animation (Ch. 6)
An animation is the simulation of the movement of figure objects, which is created by displaying a series of
pictorial frames sequentially.
Animation attributes
Animation file formats. GIF animation and Flash animation.
Frame Rate. A higher frame rate makes the animation smoother. E.g. 12 fps.
Frame size. For bitmap graphics animation it is the graphic resolution. For vector graphics, it is resolution
independent.
Frame rate. The number of frames displayed per second. E.g. 12 fps(frames per second), 30 fps.
Sound Effects
Looping and autoplay. An animation starts over again and starts automatically.
ii. Shape Tween. The shape and colour of an object can be changed gradually (morphing).
Creating Buttons. A user can interact with an animation by clicking the appropriate button, which in turn
controls the flow of the animation.
Using ActionScripts. The set of commands used in flash movies is called ActionScript.
Adding Sound.