Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
October ,2011 First edition 2011 Sony Corporation. All rights reserved. Reproduction in whole or in part without written permissions is prohibited. Features and specifications are subject to change without notice. Sony and Sony logo are trademarks of Sony Corporation. G Lens, Exmor, InfoLITHIUM, Memory Stick, Memory Stick PRO Duo, Memory Stick PRO-HG Duo are registered trademark of Sony Corporation. AVCHD and AVCHD logo are trademarks of Panasonic Corporation and Sony Corporation. All other trademarks are the property of their respective owners.
Contents
Introduction 4 Basic Knowledge on 3D 5 Shooting 3D Videos 10 Editing 3D Videos 15 Notes on Editing 3D Videos 34 3D Live Application 36 FAQ 37
Introduction
A compact 3D camera with two parallel built-in lenses has resulted in a new market which differs from that of conventional movies and TV broadcasts and entered the world of 3D videos. The new market can be expected to steadily grow with the development of technology that mitigates visual fatigue resulting from stereoscopic viewing and technology used to process complex stereoscopic viewing data on a file basis. This Guidebook introduces the basic knowledge and features of 3D video and unleashes the potential of the production flow of 3D content.
Introduction
4 3D Workflow guide book
Basic Knowledge on 3D
Both our eyes are slightly apart from each other, and hence everything seen by our brains has a small left-right disparity. Our brains actually then instantaneously judge the perspective according to that left-right disparity, thus providing us with a stereoscopic view. Basically a stereoscopic view video is realized through capturing images from both the left and right with twin lenses, just like our eyes do, and then showing the images independently to our left and right eyes.
Convergence point
Stereo base
Disparity
3D Workflow guide book 5
Basic Knowledge on 3D
Basic Knowledge on 3D
6 3D Workflow guide book
The methods used with currently available 3D cameras equipped with two lenses include Toe-in setting and Parallel setting, whose individual features differ from each other.
Toe-in setting
The shooting method used to cross the optical axes over by setting the left and right lenses slightly inside, as explained on the preceding page, with the advantage of the method being that zooming does not change the Convergence point. However, a disadvantage of the method is the occurrence of trapezoidal distortion in the logic due the optical axes crossing over each other. When the Stereo base is wide and the convergence angle (toe-in angle) therefore large the difference in size and unevenness between the upper and lower sides becomes quite conspicuous at both ends of the left and right displays, thus requiring adjustment.
Trapezoidal distortion in the lattice patterns shot using the Toe-in setting
Basic Knowledge on 3D
7
Basic Knowledge on 3D
The Virtual convergence point is infinite and hence all the objects look as they are popping up.
NG near area regarding position of zoom ratio Cannot shooting under approx.
7.5m
Basic Knowledge on 3D
9
2.5m 0.8m
NG area NG area
NG area
Zoom position :
wide
middle(x3)
tele(x10)
Shooting 3D Videos
Compact
A very compact twin-lens 3D camcorder with a built-in 1/4 CMOS sensor and left and right 10-power lenses. The small distance between the left and right lenses (Stereo base: Inter Axial Distance) of 31 mm and parallel setting of the lenses 3D videos to be shot quite close to the subject.
Functionality optimized for 3D shooting in thus avoiding any blurred images due to hand movements
Active SteadyShot, or the technology used to correct any blurring of the images due to hand movements in the three directions that include the turning direction in addition to up, down, left and right, can be activated during 3D shooting, thus ensuring stable 3D images of moving objects.
Disparity adjustment
Disparity can be adjusted by shifting the cutout area of an image being shot on the imager.By turning the adjustment dial in the + direction to move the cutout area to the outer side the Virtual convergence point moves to the back, thus increasing the pop up effect.
Shooting 3D Videos
Recording of left and right 3D images in the MVC format of 1920 x 1080
The MVC (Multiview Video Coding) system is used as the recording format of 3D images and can record images as a single video stream at a resolution of 1920 x 1080 for both left and right eyes.
* MXR-NX3D1 supports recording of 1080/60i, 50i, and 24p. In addition, images can be separated into left and right images via use of the accessory software CMU (Content Management Utility).
10
Liquid-crystal panel supports glassless 3D display for use in checking stereoscopic images on the spot
The HXR-NX3D1 is equipped with a 3.5-inch liquid-crystal HD panel of disparity the barrier type at 1,229,000 pixels (2562 x 480). The panel thus provides highresolution stereoscopic viewing on the spot while supporting the disparity adjustments which are so critical to 3D video shooting.
3D
L+R MIX(2D)
* The left-right disparity can be checked using the L+R MIX, which displays the left and right images vertically in turn.
L (2D)
R (2D)
Shooting 3D Videos
11
0.8m
Shooting 3D Videos
* Adjust the disparity to be within 30 - 50 pixels by checking the image in L+R MIX mode.
NG area
OK area
How to resolve this problem Shoot using an angle where infinity does not overly stand out by making the effort to exclude the ruined image.
12
How to resolve this problem Switch the liquid-crystal panel between L and R of 2D in turn while recording the image and then adjust the angle and framing to exclude any distinct halfwaycut objects at the left/right edges of the image.
Shooting 3D Videos
13
Shooting 3D Videos
14
Editing 3D Videos
The methods that can be used to edit 3D videos taken with the HXRNX3D1 include direct editing of the MVC format and editing of the two AVCHD files for the left and right images. The format and image size of any footage taken will be converted in accordance with the hardware and software environment used for editing.
* 3D BD (MVC) created using VEGAS Pro 11 should be shot in 24p mode.
3D
Edit the MVC le loaded with CMU. *Direct loading and editing of MVC les from VEGAS is also supported.
2D X 2
Convert the respective images to a side width of 50%. Place them in two video tracks beside each other. Make a nest of the timeline and then position a new timeline for use with the editing. Edit at half resolution x 2 after separating the left and right images (Half resolution, 2 les)
Editing 3D Videos
15
(1) After connecting the camcorder and a computer with a USB cable or setting the memory card into the computer, start the Content Management Utility. Click [Import Media Files] on the upper part of the screen to display the [Import] screen.
Editing 3D Videos
(2) After your camcorder or memory card has been selected the videos will display as thumbnails. Select the videos to be imported and specify the folder in which to save them. Next, click [Start importing].
* If you register the folder into which the imported videos are saved as [Browsing Folder] the video information will register in the database and will be viewable using the Content Management Utility. 16 3D Workflow guide book
Separate 2D videos for left and right points of view from 3D video
(1) Select the 3D video from which separate left and right points of view videos will be created (press-hold the shift key to select multiple videos) and click [Create Separate 2D Videos for Left & Right] on the [Tool] menu to start.
(2) The created video files will be saved with a new file name in the same folder as the original video. The created file name will have _L for left point of view and _R for right point of view in addition to the source file.
Source 3D video file (MVU) Created 2D video file (AVC) For left view For right view
* This function is only available for 3D videos imported using the Content Management Utility.
Editing 3D Videos
17
VEGAS Pro 11
Direct 3D editing of MVC files imported using CMU (1) Starting up and Project configuration After setting up VEGAS Pro 11 configure as a 3D editing project. When directly editing MVC-format videos [HD1080-24p (1920 x 1080, 23.976 fps)] from project templates should be selected. Set [Stereoscopic 3D mode] to the video signal that suits the 3D monitor to be used in the editing.
Editing 3D Videos
Connecting the HDMI output of a corresponding video card with a 3D TV enables the video to be edited while being watched and checked as a 3D video. 18 3D Workflow guide book
(2) Reading MVC files Select the media file for use in the project in the Import window, which is then read by the project. VEGAS Pro 11 can read MVC files in the same manner as a regular media file and be used and edited as a video track.
Editing 3D Videos
19
(3) Configuration of 3D preview Activate the video output to the external monitor used. Click [Option] [User Setting] [Preview Device]. Select the connected external monitor ([2. 1920 x 1080 (60)] in this case) from [Display Adaptor] of [Preview Device]. Set stereoscopic 3D mode in external monitor to the video signal that suits the monitor to be used.
Editing 3D Videos
20 3D Workflow guide book
(4) Disparity adjustment for titles using [Stereoscopic 3D Adjust] [Stereoscopic 3D Adjust] of the Video Track FX can be used to adjust Disparity using a slider. [Horizontal offset], in particular, can control the extent of popping up of the title text by adjusting the horizontal left-right disparity in the images.
* Disparity adjustment during editing of 3D videos leads to degradation of image quality. You cannot modify any 3D images that have been ruined.
Editing 3D Videos
21
(5)Making 3D Titles with Track Motion Vegas Pro 11 can be used to view 2D titles with a stereoscopic effect by adding track motion to the clip. Set to [3D Source Alpha] from the track motion window and set the [Lens Distance] of the [Stereoscopic 3D Camera] to create a simulated stereoscopic view. Setting [Z:] of [Position] to a negative value will create a concave image whereas a positive value will create a convex image. The amount of concavity or convexity can be changed using that value. his method suits a stereoscopic view of a 2D object moved via track motion and a motion title using Pro Type Titler.
Editing 3D Videos
(6) Exporting/For MVC 3D BD (without Menu screen) VEGAS Pro 11 can be used to export an edit video in MVC format to a Bluray disc. The video is output as an ISO image, and hence will require use of separate writing software.
22
(7) Output after editing Output configuration can be prepared using [Render As]. Select the appropriate configuration for the usage.
To upload to YouTube
Output Format : Windows Media Video V 11 6.4 Mbps HD 1080-24p Video Adjust [Video], [Bit rate], and [Project] from [Customize Template].
Width 1920 Height 1080 Pixel aspect ratio 1.000 [Bit rate] Target bit rate Internet / LAN
20M
Add yt3d:enable=LR as a tag when uploading to enable 3D display. Adding yt3d:aspect=16:9 enables the aspect rate of the frame display to be set. 3D Workflow guide book 23
Editing 3D Videos
Saving as BD
Output Format : Sony AVC/MVC Blu-ray 1920 x 1080-24p, 16Mbps video stream Adjust [Video] and [Project] from [Customize Template].
Editing 3D Videos
[Video] Profile
High
24
Editing via the creation of a pair of files that have been separated using CMU
(1) Converting into CineForm Codec format After starting up [HDLink], Select the AVCHD L/R separated using CMU on the [Select File] window; and Click [Start] to convert into CineForm Codec format.
(2) Pairing L and R After starting up FirstLight, Drag and drop the CineForm Codec files (.avi) for left and right after their conversion into [Clip Library]; Click [3D] and select [3D Mixer]; and Register on the queue list of the Pairing Setting Screen of 3D Mixer.
Editing 3D Videos
25
Repeat the selection and registration steps described in as necessary. After registering the pair files, Click [Start Queue] in the lower area of the screen to execute pairing.
(3) Editing with a clip after pairing Set the 3D Display Type to [Side-by-Side] on FirstLight and open your video editing software (Adobe Premiere, Final Cat Pro, etc.). Next, read in the files after having been paired with the editing software to display as a side by side preview.
Editing 3D Videos
* In the case that the files have no audio after having been paired use the audio from the original files
26
(4) Output after editing Output configuration takes place in the Export Settings. Select the necessary configuration.
To upload to YouTube
Format: H.264 Preset: YouTube Widescreen HD Add yt3d:enable=LR as a tag when uploading to enable 3D display. Adding yt3d:aspect=16:9 enables the aspect rate of the frame display to be set.
Saving as BD
Editing 3D Videos
27
Editing 3D Videos
(2) Positioning the L and R images on the timeline Position the L footage in Video 1 and 3 of the timeline and the R footage in Video 2. Mute Audio 1 and 2.
28
(3) Adjusting the video tracks to be beside each other Reduce the horizontal width of L footage in Video 1 and R footage in Video 2 and accurately align them to their respective left/right sides. Do not change the horizontal width of the L footage in Video 3 to enable it to be used as an editing viewer.
Video1
Video2
Side by side
Editing 3D Videos
29
(4) Placing of remaining footage and pasting the Video 1 and 2 settings Use [Paste Attributes] and set the size and position in aligning all the footage in Video 1 to the left side.
Editing 3D Videos
30
(5) Configuration of Sequence 01 display After setting the Video 1 and 2 display to Off place the footage in Video 3 and set the display to On. Mute all the Audio except Audio 3.
(6) Creating of Sequence 02 for editing Create a new sequence and position Sequence 01 in Sequence 02. Editing and previews using the timeline can now take place in a similar manner to typical 2D editing procedures.
Editing 3D Videos
31
(7) Output after editing Set the Video 1 and 2 display to On and switch the Video 3 display to Off. Output configuration takes place in Export Settings. Select the appropriate configuration for the usage.
To upload to YouTube
Format: H.264 Preset: YouTube Widescreen HD Add yt3d:enable=LR as a tag when uploading to enable 3D display. Adding yt3d:aspect=16:9 enables the aspect rate of the frame display to be set.
Editing 3D Videos
Saving as BD
32
Editing 3D Videos
33
Caution!
34
Do not mix!
Screens of different disparity on a multiscreen
The screens on PinP or a multiscreen being of individual disparity will result in the viewer being unable to look at all the screens in 3D at the same time. Set all the screens to a similar level disparity or create the screens in 2D.
*If a number of screens are displayed the individual disparity can be ignored as long as each screen size gets smaller.
Avoid!
Transition that divides the Disparity
Transitions such as slides and wipes divide the normal disparity during the transition effect. Because of this no transition should be used as the stereoscopic viewing will be ruined in the middle of the effect. Other transitions where a pseudo 3D effect is created in 2D will look unnatural because the 3D space has no disparity. A longer dissolve can change the amount of disparity during the effect and produce a stereoscopic effect for forward and backward movements.
Organize!
Amount of popping up of a title
Lay out the title text nearest to the image by arranging it to be a constant amount of popping up. If any object is near the text it will look like its cutting into the object. In addition, if the amount of popping up of the text varies in every cut viewers will incur eye strain because the Convergence point will constantly changing while they read the text. Note that large disparities will tire viewers when the distance between the background and the text in the front is large. You can produce a great impact for the title utilizing the 3D effect. Dynamic expressions can be produced via effective control of the changes in size and disparity. 3D Workflow guide book
3D Live Application
Menu screen of HDMI 3D Setting Either Frame Packing or Side-by-Side can be selected as the 3D video output format for the HXR-NX3D1. Output with Side-by-Side The equipment can be used with 2D environments too, thus making it more efficient. Output with Frame Packing Use of two full resolution streams packed in one track as separate left and right 3D HD-SDI can lead to higher-quality3D solutions.
HDMI to HD-SDI Converter HDMI
(Side by Side)
960
1080
960
3D Monitor
3D Live Application
SONY LMD-2451TD
3D Processor
36
1080 1080
L
Active Space
SONY MPE-200
SDI 3D Switcher
(Frame packing)
HDMI
doremi Dimension 3D
*Firmware Ver.1.8.0
FAQ
L R
Top and bottom Line by line
Side by side
FAQ
37
Electrically opened/closed shutters are equipped on the left and right lenses of the glasses for use in switching the left and right images of every frame in synchronization with the monitor. The shutter on each of the left and right lens open/close 30 times per second, the combination of which provides the clear images.
Frame 2 sequential
L R
Open
Close
Glass-less 3D displays
FAQ
Glass-less 3D displays show different images to the left and right eyes using one screen by overlapping plate lens called Lenticular lens or a verticalstriped filter (Aperture grille) called a disparity barrier on a regular display.
* The HXR-NX3D1 utilizes the Disparity barrier system.
38
Camera
Shooting
FAQ
Editing
Notes for conversion into 2D images using CMU (Content Management Utility)
When the files separated into left and right images using CMU (Content Management Utility) are played back with editing software the final end left and right frames may mismatch. (The top frames will always match.) When you use separated left and right files as a pair you should not use the files all the way to the end and instead set the out point to be a few frames back.
FAQ
40 3D Workflow guide book
FAQ
41