JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY (An ISO 9001:2000 Certified Institution) DHARMAPURI 636 813 COURSE CODE: IF-364 COURSE NAME: MULTIMEDIA SYSTEM DEPARTMENT: INFORMATION TECHNOLOGY SEMESTER/YEAR: VI / III ACADEMIC YEAR: 2005 2006 UNIT-1 CONTENTS v Elements of multimedia system v Needs of multimedia v Benefits of multimedia v Converging technologies v Multimedia applications v Multimedia building blocks DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY v MULTIMEDIA ELEMENTS High-impact multimedia applications, such as presentations, training, and messaging, require the use of moving images such as video and image animation, as well as sound (from the video images as well as overlaid sound by a narrator) intermixed with document images and graphical text displays. Multimedia applications require dynamic handling of data consisting of a mix of text, voice, audio components, video components, and image animation, kite-grated multimedia applications allow the user to cut sections of all or any of these components and paste them in a new document or in another application such as an animated sequence of events, a desktop publishing system, or a spreadsheet Facsimile: Facsimile transmissions were the first practical means of transmitting document images over a telephone line. The basic technology, now widely used, has evolved to allow higher scanning density for better-quality fax. Facsimile transmission was standardized at a very early stage to CCITl Group 3 compression standards. Also known as run-length encoding, this is a medium level of compression that can easily be achieved in software. Typical pixel densities used for facsimile are in the 100 to 200 dpi (pixels/inch) range. Document images: Document images are used for storing business documents that must be retained for long periods of time or may need to be accessed by a large number of people. Providing multimedia access to such documents removes the need for making several copies of the original for storage or distribution. Photographic images: Photographic images are used for a wide range of applications such as employee records for instant identification at a security desk, real estate systems with DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY photographs of houses in the database containing the descriptions of houses, medical case histories, and soon. Photographic images are used frequently for imaging systems that are used for identification such as security badges, fingerprint cards, photo identification systems, bank signature cards, patient medical histories, and so on. The requirements of photographic images are much more intense than those for typed documents. Besides being gray- scaled or color, photographic images require proper handling of soft shades and tones. A resolution of 600 dpi is considered essential for reproducing a photographic image on a laser printer. Higher resolutions are preferable. Few displays have this high a level of resolution; in most systems, a laser printer is used as a backup when the image quality on a display is not considered sufficient. Geographic information system maps: It is known as GIS systems; maps created in a GIS system are being used widely for natural resource and wildlife management as well as urban planning. These systems store the graphical information of the map along with a database containing information relating high lighted map elements with statistical or item information such as wildlife statistics or details of the floors and rooms and workers in an office building. Geographic Information Systems Maps Two kinds of technologies are used for storage and display of geographic maps. Raster storage allows a map to be displayed on a graphical display system just like any other GUI application. These applications consist of road maps used by travel assistants and area maps used to track natural resources. Attribute data is assigned and identified, usually by map coordinates. Attribute data, describing features in a map, is stored in an object (or relational) data management system. Another application combines a raster image that has the basic color map and a vector overlay showing the railroads DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY or highways and other human-made structures, and text display showing attributes of features in the map. These GIS applications associate attribute data with the man-made structures and relate them to coordinates in a map Voice commands and voice synthesis Voice commands and voice synthesis are used for hands- free operation of a computer program. Voice synthesis is used for presenting the results of an action to the user in a synthesized voice. Applications such as a patient monitoring system in a surgical theatre will be prime beneficiaries of these capabilities. Voice commands allow the user to direct computer operation by spoken commands. Voice Commands Voice commands are primarily an input voice recognition consideration. Voice commands allow hands-free usage of computer applications by allowing command entry via short voice commands rather than a keyboard or pointing device. Recognition of the command requires specialized techniques and powerful processing capabilities to compensate for differences in pitch, accents, and voice modulation of users. Voice Synthesis Voice synthesis is easier to achieve than voice recognition. The initial attempts used fully stored messages or actual voice clips that were strung together. In either approach, the cadence (the consistency with which the spoken words are strung together) of the composite output has to be very good for the message to be clear. Another approach is to break down the message completely to a canonical form based on phonetics. Digital signal processors designed specifically for such an application have the processing power to perform the computations and maintain correct cadence. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY Audio messages: Annotated voice mail already uses audio or voice messages as attachments to memos and documents such as maintenance manuals. Audio Messages Audio messages are a substitute for text messages. Computers equipped with microphones can record an audio message and embed it in or attach it to an electronic mail message. We have seen that images require very large volumes of storage. Audio messages also require large volumes of storage. Compression techniques attempt to manage the storage more effectively. While in images the speed of decompression and display is important, speed of decompression and playback of audio messages with proper cadence (isochronicity) is crucial for the audio message playback to be comprehensible. Video messages: Video messages are being used in a manner similar to annotated voice mail. Video Messages Similar to audio messages, video messages can be embedded in or attached to electronic mail messages. Video messages can range from a single snapshot to full- motion video clips. The storage and playback requirements are even more complex for video messages because of the storage for each video shot. Video messages are almost always stored in a shared video data server and displayed at the receiver workstation at a later time. Audio and video messages have a temporal dimension and require isochronous playback. Isochronous playback is defined as playback at a constant rate. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY Full-motion stored and live video Full-motion video started out as a very useful idea for on- line training and maintenance manuals. The capability to use full-motion stored video for electronic mail or live video for presentations and videoconferencing are important evolutionary steps. Three-dimensional video techniques are being adapted to create the concept of virtual reality. Full-motion Stored and Live Video CD-ROM technology has provided the basis for the development of full-motion video. The primary application for this technology is in CD-ROM games, courseware, training manuals, multimedia on-line manuals and reference material, video conferencing, multimedia e-mail, video karaoke systems, and so on. The technology is pervasive and is equally applicable to the office environment as it is to the play den. An important consideration for full motion video is the need for large bandwidths for communications media, massive storage requirements, and high-density high- performance compression technologies. Holographic images: All of the technologies so far essentially present a flat view of information. Holographic images extend the concept of virtual reality by allowing the user to get inside a part, such as, an engine and view its operation from the inside. Holography is defined as the means of creating a unique photo graphic image with out the use of a lens. The photographic recording of the image is called a hologram, which appears to be an unrecognizable pattern of stripes and whorls but which, when illuminated by coherent light as by a laser beam, organizes the light into a three-dimensional representation of the original object. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY Holography records not only the intensity of light as it is reflected from an object, but also the phase (that is, the degree to which the reflected wave fronts are in step with each other, or coherent). Note that ordinary light is incoherent. In continuous-wave laser holography, a beam of coherent laser light is directed on an object in a darkened room. The beam is reflected, scattered, and diffracted by the physical features of the object and arrives on a photographic plate at the same time that a part of the original beam also arrives at the photographic plate. The two beams cause interference, which results in a complex pattern of stripes and whorls. The developed plate is called a hologram. When coherent light passes through the hologram, the hologram acts as a diffraction grating, bending or diffracting some of the light beams to exactly reverse the original condition of the light waves that created the object. In other words, the light beams create a three- dimensional rendition of the object that is visible to the human eye on the light beam side and a similar rendition on the other side, which can be photographed. Holography can also be achieved in color. Fractals: Fractals started as a technology in the early 1980s but have received serious attention only recently. This technology is based on synthesizing and storing algorithms that describe the information Fractals are regular objects with a high degree of irregular shape. Fractals are the decompressed images that result from a compression format that uses arithmetic algorithms to define repeated patterns in the image. In fractal compression, a digitized image is broken into segments. A segment can be a fern or a leaf. After breaking up the image into segments, the individual segments are checked against a library of fractals. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY The library contains a com pact set of numbers called iterated function systems codes, which will reproduce the corresponding fractal. The mathematical processing required to convert an image to a fractal makes compression a very demanding and time-consuming task. However, once compressed, even a very complex fractal can be decompressed very rapidly; the algorithms for decompression are part of the stored image. In other words, unlike other compression schemes that compress data based on the similarity of successive pixels, fractal compression is based on image content more precisely, on the similarity of patterns within an image. v Needs of Multimedia We need hardware, software and good ideas to make multimedia. To make good multimedia, we need talent and skills We may also need the help of other people. Multimedia is often a team effort: artwork is performed by graphics artist, Video shoots by video producers, sound editing by audio producers, and programming by programmers Hardware The basic principles for creating and editing multimedia elements are the same for Macintoshes and PCs. Many software tools readily convert picture, sound, and other multimedia files from Macintosh to windows format, and vice versa using known file formats or even binary compatible files that require no conversion at all The Macintosh OS from Apple and any Intel-based IBM PC or PC clone running Microsoft Windows. These computers, with their graphical user interfaces and huge installed base of many millions of users throughout the world, are the most used platforms today for the development and delivery of multimedia. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY Certainly, detailed and animated multimedia is also created on specialized workstations from Silicon Graphics, Sun Microsystems, and even on main frames, but the Macintosh and the PC offer a compelling combination of affordability, software availability, and worldwide availability. Regardless of the delivery vehicle for your multimedia whether it is destined to play on a computer, on a television set-top box such as Sega, Nintendo, or Sony, or as bits moving down the data highway most multimedia will probably be made on a Macintosh or on a PC. Software Multimedia software tells that the hardware what to do The basic software tools used to work with text, images, sounds, and video; we will also learn about handy tools for capturing screen images, translating between file formats, and editing our resources. We do not have to be a programmer or a computer scientist to make multimedia work for you, but you do need some familiarity with terms and building blocks; even the simplest multimedia tools require a modicum of knowledge to operate Creativity Good ideas to make multimedia Before beginning a multimedia project, you must first develop a sense of its scope and content. Let the project take shape in your head as you think through the various methods available to get your message across to your viewers. The most precious asset you can bring to the multimedia workshop is your creativity. It what separates run-of-the- mill and underwhelming multi media from compelling, engaging, and award-winning products, whether for a short sales presentation viewed solely by colleagues within your firm or for a full-blown CD-ROM title. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY You have a lot of room for creative risk taking, because the rules for what works and what doesnt work are still being empirically discovered; there are few known formulas for the success of multimedia. v BENEFITS OF MULTIMEDIA Multimedia is appropriate whenever a human interface connects a human user to electronic information of any kind. Multimedia enhances minimalist text-only computer interfaces and yields measurable benefit by gaining and holding attention and interest; Multimedia improves information retention. When properly woven, multimedia can also be profoundly entertaining. Multimedia in Business Business applications for multimedia include presentations, training, marketing, advertising, product demos, databases, catalogues, and networked communications. Voice mail and video conferencing will soon be provided on many local and wide area networks (LANs and WANs) using Internet protocols. Multimedia around the office has become more commonplace. Laptop computers equipped with the fastest processors come complete with CD-ROM drives and are ready for multimedia presentations on the road. As companies and businesses catch on to the power of multimedia, and the cost of installing multimedia capability decreases, more applications will be developed both in-house and by third parties to allow businesses to run more smoothly and efficiently Multimedia in Schools Schools are perhaps the most needy destination for multimedia. Many schools in the United States today are chronically under funded and occasionally slow to adopt new technologies, but it is here that the power of multimedia DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY can be maximized for the greatest long-term benefit to all. Multimedia in public places In hotels train stations shopping halls and grocery stores multimedia will become available at standalone terminals or kiosks to provide in information and help. The power of multimedia has been part of human experience for many thousands of years Virtual reality At the convergence technology and creative invention in multimedia is virtual reality. VR requires terrific computing horse power to be realistic CONVERGING TECHNOLOGIES: Multimedia technology is breaking down the traditional boundaries between devices for computing, personal communications and consumer entertainment. Multimedia devices are expected to replace ubiquitous such as the telephone and television and change many of the activities associated with them. The large scale of these trends and the many participates in these developments have added to the complexity of the possibilities. TECHNOLOGY TRENDS: Multimedia devices and communications are becoming practical because of trends is electronics, telecommunications, displays.. Electronics: Mr. Moore is 1964 predicted that the number of on a chip will double every three years. Mr. Moores law has rarely failed. So, electronics are increasing day by day. While many semiconductor vendors may disagree with this convent, Mr. Rapp ports claims is that technology has progressed so far that instead of being limited by the technology, we are limited by our ability to fill all of the available silicon with good ideas. COMMUNICATIONS: Due to the advances is digital signal processing techniques, it is possible to produce low-cost 9600 - band V.32 Modes. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY What is perhaps silly about this is that modem technology is trying to cope with phone lines from the 1950s, when is actually the Bell system has not been standing still all these years. One way is with a technology called Data unit developed at Bell cabs. With a more appropriate modern, it is possible to get 9600 band full duplex data on the same twisted pair of phone wire and have this data be completely independent of the phone noise signal. Its a low-end ISDN. The lowest cheap forward in communications band width- though is available with fiber optics, which, while requiring the replacement of the existing wiring, Will lead to orders of magnitude more data capacity. A switching fabric for fiber optic data rates. Asynchronous transfer mode (ATM), is making gigabit rate packet switched fiber optic networks feasible. PRESENTATION TECHNOLOGY The applications for video will be expanding is the next decade due to its digital future, and hence will create the reversely for improved presentation technology, color LCP displays from postage stamp size to 13 digital source are available today. v Multimedia Building Blocks: The following are the building blocks of multimedia: Text Sound Images Animation Video v Text: Although it is possible to have multimedia without text, most multimedia systems use text because it is such an effective way to communicate ideas and provide instructions to users. There are four kinds of text: printed, scanned, electronic and hyper text. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY Printed Text: Printed text, like the words in this paragraph, appears on paper. Suppose you want to use printed text as the basis for a multimedia document, suitable technique must be used. In order for a multimedia to read printed text, you need to transform the text into machine - readable form. The most obvious way to do this is to type the text into a word processor or text editor, but this is tedious and time consuming. A alternate way would be to scan the text. Scanned text: Low-cost scanners that can read printed text and convert it into machine- readable form to produce scanned text are widely available. There are three basic kinds of scanners; flat bed, hand held and sheir-fed. Regard less of the kind of scanner you have, advances in the optical character recognition (OCR) software that comes with scanners have increased scanning accuracy. Example. Consider the newspaper in the figure. The next figure shows it being scanned by a hand held scanner. The result of the scan is shown in the figure. Electronic Text: A tremendous number of text are available is machine- readable form, because almost everyone who writes books or publishes manuscripts today does so with word processing and electronic publishing equipment. Because they can be read by a computer and transmitted electronically over networks, such texts are referred to as electronic texts. Electronic text was used extensively for writing many books. Internet news feeds and other networked resources provided a rich store of information that would otherwise have taken years to research. Hyper text: The prefix hyper may be the most important word used in multimedia, because it refers to the process of linking, which makes multimedia interactive. The word hypertext was learned by Ted Nelson (1965). Hypertext refers to text that has been linked. The links DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY give the text an added diversion, which is why it is called hyper v Sound: There are four types of sound objects that can be used in multimedia productions, wave form audio, MIDI sound tracks, compact disc (CD) audio and MP3 files. Wave form audio: Just as video digitizers can be used to grab any picture a camera can see, wave form audio digitizers can record any sound you can hear. Every sound has a waveform that describes its frequency, amplitude and harmonic content. Wave form audio digitizers capture sound by sampling this wave form thousands of times per second; this samples are stored on a computers hard disk in a file that usually has a wav filename extension, which stands for wave form. MIDI MIDI stands for Musical Instrument Digital Interface. If provides a very efficient way of recording music. Instead of recording the wave form of the sand, which requires a lot of storage, MIDI records the performance information required for the computers sand ship to play the music. MIDI files have a Mid extension. They can be randomly accessed down to an accuracy of 1/128 sound. Audio CD can hold up to 75 minutes of high quality, high-fidelity recorded sound. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY The sampling rate is 44, 100 samples per second, which is fast enough to record any sound audible to humans. The samples are 16 bits, producing a dynamic range of 98 dB, which is discrete enough to record faithfully a quiet whisper or a loud screen. The addressing used is CD-ROM drives permits multimedia computers to randomly access a song on the Cd with split- sound accuracy down to 1/75 of a sound. Mp 3 Mp3 stands for MPEG audio layer 3. It is an audio file format that uses an MPEF audio coder to encode (compress) and decode (decompress) recorded music. Mp3 can compress a CD audio trade into a substantially smaller sized file requiring significantly less band width to transmit over the internet without degrading the original sound tracks quality. Hyper audio Sound tracks are played over time. Many multimedia creation tools allow you to time the occurrence of objects to sync points in the music. When audio is used to trigger multimedia objects, it is referred to as hyper audio. v Graphics or images Images or graphics are classified as, Bitmaps: A bitmap is a picture stored as a sit of pixels that correspond to the grid of dots on a computer screen. To display the picture, the computer sets each dot on the screen to the color specified for it in the bitmap. We can create bitmaps with any graphics editor, such as the paint program that times with windows or commercial drawing progress such as Adobe photoshop or Corel draw. Vector images: Vector images are stored as a sit of mathematical equations called a1gorithms that define the curves, lines and shapes in a picture, for images that do not contain a lot of Continuous color changes, vectors are a more- efficient way to store the image than Bitmaps. Vector images have two advantages over bitmaps Vector images are scalable, if you can use graphics programs to enlarge or reduce the size of the image without any less of quality. Because Vector images normally have smaller file sizes than bitmapped graphics, vectors download more quickly over the internet. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY Clip Art Creating graphics by hard is time-consuming. To same time there are extensive libraries of clip art that you can use is multimedia productions. Many have broad, general categories including photographs, icons, animations, background tables, buttons and bullets, while other libraries focus on a visual theme such as nature or scientific images. Digitized Pictures: Video capture boards cut you count a video camera, VCR, video disc player, or live video feed to your computer and grab granes instantly into bitmaps that can be used in multimedia applications. Any photograph, slide, or picture from any book or magazine can be digitized is full color and linked into the multimedia application 1. Eckerds e - photo web, which will lead to online photo source. 2. The previous link also takes us to Kodak photonet online. Hyper pictures Just as words can serve as triggers is a hyper text, so also can parts of pictures. When parts of pictures are used to trigger multimedia events, they are called hyper pictures. The triggers can be any size or shape, and you can make them invisible. There is no limit to the number of triggers you can put on a hyper picture. When the user mouses over a trigger, the luxor changes shape to tell the user that spot is a hyperlink. If the user clicks there, your link will trigger. v ANIMATION In multimedia, animations is the use of a computer to create movement on the screen. There are four kinds of animations: frame, vector, computational, and morph. Frame Animation Frame Animation makes objects move by displaying a series ofpredown pictures, called frames, in which the objects appear in different locations on the screen, DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY In a movie, a series of frames. Moves through the film projector at about 24 frames per second. We see the movement on the screen because each frame contains a picture of what the screen should lookslike at the movement that frame appears. Vector Animation: A vector is a line that has a beginning a directions, and a length. Vector animation makes objects move by varying these three parameters for the line segments that define the object; Macromedia is the industry leader is vector-based animation software. Macromedias flash software uses vector graphics to create animations and interactive graphics for use on the web. Computational Animation Suppose you want to move a word across the screen. There are few ways to do that. You could create a series of frames that show the word itching its way across the screen, with each frame representing one movement in time as the word moves. In computational animation, we have objects across the screen simply by varying their X and Y coordinates. The X coordinate specifies the horizontal position by the object, that is, how far across the screen. The Y coordinate specifies the vertical position that is, how far down the screen. Morphing Morphing means to transition are shape into another by displaying a series of frames that creates a smooth movement as the first shape transforms itself into the other shape. Morphing software creates the transitional frames automatically. v VIDEO Video provides a lively resource for multimedia applications. There are four types of video that you can use as the objects video feeds, videotape, videodisc, and digital video. Line video Feeds Line video feeds provide interesting real-time objects of multimedia links. Any television channel or line camera feed can be the object of a link. Web Cams let us watch line video feeds from all over the world. From free way traffic to surfIng beaches, day care DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY centre to college storm roars, web cams can be found just about anywhere. Video tape The most broad and industries video Medias is videotape. It is like a cassette in the audio, tape recorder. Video tapes are now very common. They are used in VCRs. Videotapes can be the object of multimedia links. This media is limited by two factors, how ever. First, videotape is linear. The information is stored or tape is a serial fashion, and in order to accuses it, you may have to wait a long time for the tape to fast-forward or rewind to the spot you want; this can table as long as three minutes. Second, most videotape players are not computer controllable. This means that all the operations are manual. Video disc There are two industry guide formats for videodisc: CAV and CLV.CAV disc can store up to 54000 still frames or 30 minutes of motion video with a stereo with a sound trank. The addressed by specifying numbers frames 1 to 54,000. The CAV format lets you display still frames as well as play motion sequences. CLV disc can store up to an hour of video on each disc side, which is twice as much video as CAV discs hold. The popularity of video disc has owned, however, due to the emergence of digital video and DVD, which are discussed later. Digital Video Digital video is the most promising and exiting video storage medias, like wave form audio, digital video is stored in files on a hard disc CD-ROM and DVD. Because the video is digital it can be secured over computer network, alleviating the need for video taps and videodisc players. Digital video can be randomly accessed by frame setting up play specific chips. DVD DVD stands for digital versatile Disc, but when a DVDs Purpose is to play back a movie, it can properly stand digital video disc. DVD uses MPEG-2 to compress a full length feature film upto a 4.7 inch disc. DEPARTMENT OF INFORMATION TECHNOLOGY IF-364\MS JAYAM COLLEGE OF ENGINEERING AND TECHNOLOGY The movie plays back beautifully with surround sound and 540 horizontal lines of full color video. More over DVD offers the viewer a choice of languages, with or without subtitles, and sometimes the user can choose to view alternate endings to a movie. Just as CD audio provided multi media developers with split second access to practically all recorded music, so also does DVD promise to create a digitally accessible store of all feature movies. Hyper Video Like sound tracks, video clips are played over time. Many multimedia creation tools allow us to time the occurrences of objects to sync points in the video. When video is used to trigger other multimedia events, it is regarded to as hyper video.