Sei sulla pagina 1di 4

818 IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, VOL. 13, NO.

5, SEPTEMBER 2009

A Lossless Compression Method for Medical Image


Sequences Using JPEG-LS and Interframe Coding
Shaou-Gang Miaou, Member, IEEE, Fu-Sheng Ke, and Shu-Ching Chen

Abstract—Hospitals and medical centers produce an enormous In the regular mode of JPEG-LS, a nonzero prediction error is
amount of digital medical images every day, especially in the form treated as an integer random variable that is entropy coded by
of image sequences, which requires considerable storage space. One the efficient Golomb–Rice codes [6] using a context-based prob-
solution could be the application of lossless compression. Among
available methods, JPEG-LS has excellent coding performance. abilistic model. The Golomb–Rice codes can be implemented
However, it only compresses a single picture with intracoding and at low computational cost. In the run mode of JPEG-LS, a run-
does not utilize the interframe correlation among pictures. There- length coding scheme with low computational cost is used to
fore, this paper proposes a method that combines the JPEG-LS and encode constant regions when a zero prediction error occurs.
an interframe coding with motion vectors to enhance the compres- Most lossless image compression techniques deal with sin-
sion performance of using JPEG-LS alone. Since the interframe
correlation between two adjacent images in a medical image se- gle image independently without utilizing the relation among
quence is usually not as high as that in a general video image images in an image sequence. However, some literature does
sequence, the interframe coding is activated only when the in- exploit the interframe correlation for lossless compression of
terframe correlation is high enough. With six capsule endoscope CE images [7] and video [5], [8], [9]. The compression ratio
image sequences under test, the proposed method achieves aver- (CR) obtained in [7] is about 2.5, which is unsatisfactory be-
age compression gains of 13.3% and 26.3% over the methods of
using JPEG-LS and JPEG2000 alone, respectively. Similarly, for cause using JPEG-LS alone can obtain a CR value higher than
an MRI image sequence, coding gains of 77.5% and 86.5% are 2.7 according to our experiment. Memon and Sayood [8] elab-
correspondingly obtained. orated a promising entropy analysis for exploiting interframe
Index Terms—Interframe coding, JPEG-LS, lossless compres- correlation, but no real encoding/decoding development was de-
sion, medical image sequences. scribed. The compression technique proposed by Brunello et al.
is based on motion compensation, optimal 3-D linear prediction,
I. INTRODUCTION and context-based entropy coding [5]. A small compression gain
with respect to the static JPEG-LS coding, applied on a frame-
OSPITALS and medical centers produce large volume
H of digital medical image sequences, including computed
tomography, MRI, ultrasound, and capsule endoscope (CE) im-
by-frame basis, is obtained at the price of significant increase of
computational complexity, delay time, and memory cost. Zhang
et al. used the combination of temporal and spatial prediction
ages [1], etc. Theses sequences require considerable storage
and context-based entropy coding [9], resulting in a 10% coding
space. One solution to this problem could be the application
gain over the state-of-the-art techniques, such as JPEG-LS and
of lossless compression. In fact, the need to compress medical
context-based, adaptive, lossless image coding (CALIC). How-
images is a driving force to develop lossless image compression
ever, a 5% loss (not a gain) was obtained for one of the five video
standards, such as JPEG-LS and JPEG2000. In addition, these
sequences under test. Thus, exploiting temporal correlation does
standards are considered in digital imaging and communica-
not always work very well in lossless compression.
tion in medicine (DICOM), which is an industrial international
In this paper, a new lossless compression method based on
standard for medical image representation and coding [2].
JPEG-LS and motion estimation is proposed. To avoid the pos-
JPEG-LS has excellent coding and computational efficiency,
sible coding loss and significant increase of computational cost
and it outperforms JPEG2000 and many other image compres-
like those in [5] and [9], respectively, we only exploit high
sion methods [3], [4]. JPEG-LS mainly consists of context mod-
enough correlation between adjacent image frames by using a
eling, pixel prediction, and prediction error encoding [4], [5].
correlation estimation approach.
Manuscript received August 17, 2007. First published May 15, 2009; cur-
rent version published September 2, 2009. This work was supported in part by
the Chung-Shan Institute of Science and Technology, Lung-Tan, Taiwan, under II. SEQUENCE COMPRESSION WITH JPEG-LS
Grant BV95H02P. AND MOTION ESTIMATION
S.-G. Miaou is with the Electronic Engineering Department, Chung-Yuan
Christian University, Chung-Li 32023, Taiwan (e-mail: miaou@wavelet.el. A. Overview of the Proposed Approach
cycu.edu.tw).
F.-S. Ke was with the Electronic Engineering Department, Chung-Yuan A processing flow chart for the encoder side of the proposed
Christian University, Chung-Li 32023, Taiwan. He is now with Top Victory method is shown in Fig. 1. Here, an 8-bit grey-level image or
Electronics, Taipei County 23553, Taiwan (e-mail: alanke8@msn.com).
S.-C. Chen was with the Electronic Engineering Department, Chung-Yuan an 8-bit color component of a color image is considered. Given
Christian University, Chung-Li 32023, Taiwan. She is now with the CyberLink, an image sequence, the first input image is always compressed
Taipei 231, Taiwan (e-mail: meet0512angel@yahoo.com.tw). by 8-bit JPEG-LS coding alone due to no reference frame, then
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org. the second frame will be the current frame, and the first frame
Digital Object Identifier 10.1109/TITB.2009.2022971 becomes the reference frame, and so on. First, estimate the
1089-7771/$26.00 © 2009 IEEE

Authorized licensed use limited to: R.V.S. College of Engineering and Tech. Downloaded on April 29,2010 at 10:24:27 UTC from IEEE Xplore. Restrictions apply.
MIAOU et al.: LOSSLESS COMPRESSION METHOD FOR MEDICAL IMAGE SEQUENCES USING JPEG-LS AND INTERFRAME CODING 819

Fig. 2. Example images of the two CE image sequences used in the preliminary
tests: (a) #4, (b) #6, and (c) MRI.

(#4 and #6), as shown in Fig. 2, are tested. One sequence is


smooth in the sense that images are similar and change gradu-
ally, while the other contains complex pathological images that
change abruptly. The best CR occurs when σT2 = 180. Thus, we
set σT2 = 180 as our desired threshold.
2) Macroblock Size and Searching Range: Again, the CE
image sequences of #4 and #6 are tested. Various search ranges
and MB sizes are considered in the test. The macroblock (MB)
size and the searching range of our choice are 16 × 16 and
Fig. 1. Processing flow chart for the encoder side of the proposed method. [−7, 7], respectively, because they provide the largest average
CR.
correlation (see Section II-B) between the current frame to be 3) Encoding of MVs: First, the x and y components of a
encoded and the reference frame in the buffer. If it is lower than a MV are treated separately. For the x component, a bit 0 is
correlation threshold, we mark bit “1” as a flag and compress the sent or stored if it is zero; a bit 1 is sent or stored, otherwise,
current frame with 8-bit JPEG-LS coding. Otherwise, we mark followed by the 4-bit binary representation of x component.
bit “0” and perform motion estimation and motion compensation This coding scheme is applied to y component as well. This
(MEMC) as in traditional video coding, followed by subtract- coding design is based on the observation that a zero MV in
ing the reconstructed frame (which has gone through the MEMC x- or y-direction occurs much more frequently than other MVs.
process) from the current frame to obtain a difference image. This coding approach is more efficient than the direct 4-bit
The difference image is then preprocessed and encoded by using natural code for each component but could be less efficient than
9-bit JPEG-LS compression (see Section II-B). The motion vec- a more powerful entropy code. However, the proposed approach
tor (MV) derived from motion estimation will be encoded (see is essentially a fixed length code, and it is thus simple and easier
Section II-B). Finally, all the flag bits and the encoded bits for to encode and decode than the more powerful variable length
one image frame are concatenated into single bit stream. This entropy code.
processing cycle repeats for next image frame until the end of the 4) Preprocessing of Difference Images: Since the pixel value
image sequence. The decoder simply implements a reverse oper- of a difference image is in the range from −255 to 255 and a
ation of encoding, including standard 8-bit JPEG-LS decoding P-bit JPEG-LS coding can only handle the input with sample
or MV-based decoding plus 9-bit standard JPEG-LS decoding. value from 0 to 2P –1 for a positive integer P, each pixel value
of a difference image is added by 28 –1 = 255, resulting in the
B. Further Details new value range of [0, 510]. Then, we apply a 9-bit JPEG-LS
coding to the resulting image.
1) Determining Correlation Between Adjacent Image
Frames: The correlation is determined by estimating the vari-
III. EXPERIMENTS AND RESULTS
ance of the difference image. To find a proper threshold σT2
for separating high and low correlation, we examine the com- The personal computer we used for the experiment is
pression results obtained when the two CE image sequences equipped with 2.4-GHz CPU, 266-MHz double data rate II

Authorized licensed use limited to: R.V.S. College of Engineering and Tech. Downloaded on April 29,2010 at 10:24:27 UTC from IEEE Xplore. Restrictions apply.
820 IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, VOL. 13, NO. 5, SEPTEMBER 2009

TABLE I TABLE II
CRS OBTAINED BY COMPRESSING R, G, AND B COMPONENTS INDEPENDENTLY PERFORMANCE IN AVERAGE CR FOR THE CE IMAGE SEQUENCES
USING JPEG-LS

TABLE III
PERFORMANCE IN AVERAGE CR FOR THE MRI SEQUENCE

Fig. 3. Comparison of compression results for CE image sequence #1.

(DDRII), and 512-MB RAM, and the main software used is


Microsoft Visual Studio .Net 2003. The image data for testing
include six color CE image sequences #1–#6 with different im-
age characteristics and one set of gray-level MRI sequence (as
shown in Fig. 2). Each CE image sequence consists of 100 im-
age frames and the MRI sequence contains 75 frames. All the
Fig. 4. Compression results for the MRI sequence.
images are 256 × 256 and 8 bit for each color component.
The R, G, and B components of the CE image sequences
are compressed independently with JPEG-LS coding and the However, in general, most decisions based on our correlation
resulting CRs are given in Table I. Obviously R component estimation result are correct. In fact, all wrong judgments can
is somewhat more difficult to compress than the other two. be avoided if both approaches are applied to the same frame and
For simplicity, we will present the compression results for R choose the one with better performance. However, this would
component of the CE images from now on and expect to have add a little coding gain at the expense of too much computational
slightly better results for G and B components. effort.

A. Correlation Estimation Between Adjacent Frames B. Performance Comparison and Discussion


The compression performance for CE Sequence #1 is shown Fig. 3 has demonstrated that JPEG-LS performs better than
in Fig. 3, where the dashed line denoted as JPEG-LS shows the JPEG2000 on a frame-by-frame basis for sequence #1. Next,
result obtained by applying JPEG-LS directly and separately we examine the performance of average CR and the results
to each image frame; the solid line denoted as JPEG-LS+MV are shown in Table II, where JPEG-LS and JPEG2000 mean
gives the result obtained by applying MEMC and JPEG-LS using JPEG-LS and JPEG2000 alone, respectively, and JPEG-
for every image frame in the sequence; the solid line denoted LS+VAR+MV represents the proposed method. The results
as JPEG-LS+VAR+MV shows the result obtained by either show that the proposed method can provide a coding gain rang-
applying JPEG-LS directly or MEMC plus JPEG-LS according ing from 4% to 31.6% over JPEG-LS and 15% to 51.9% over
to the result of correlation estimation; and the solid line denoted JPEG2000.
as JPEG2000 gives the results obtained by applying JPEG2000 We also test the proposed method with the MRI sequence. The
to each image. The results for other CE image sequences are result of average CR is shown in Table III, and the result for each
similar and are not shown here. As expected, MEMC does not image frame is shown in Fig. 4. The coding gain provided by the
work very well in some image frames and the successful result proposed method is very significant. Although the parameters
of correlation estimation can be verified easily from Fig. 3. of the proposed approach are tailored for the CE images, they
Note that not every decision based on correlation estimation is also work well for the MRI images.
satisfactory. See the results for the 41th and the 81th frames, and Next, we consider the computing time. In order to have
for the frames around the 70th frame in Fig. 3 as an example. the most accurate searching result and the best compression

Authorized licensed use limited to: R.V.S. College of Engineering and Tech. Downloaded on April 29,2010 at 10:24:27 UTC from IEEE Xplore. Restrictions apply.
MIAOU et al.: LOSSLESS COMPRESSION METHOD FOR MEDICAL IMAGE SEQUENCES USING JPEG-LS AND INTERFRAME CODING 821

efficiency, this paper uses the full search and mean absolute er- [7] Y. D. Wang, “The implementation of undistorted dynamic compression
ror (MAE) computation in MEMC. However, it is well known technique for biomedical image,” Master’s thesis, Dept. Electr. Eng., Nat.
Cheng Kung Univ., Taiwan, 2005.
that the full search and MAE operation is quite time consuming. [8] N. D. Memon and K. Sayood, “Lossless compression of video sequences,”
The time for compressing a 100-image sequence is 29.83 ± 0.47, IEEE Trans. Commun., vol. 44, no. 10, pp. 1340–1345, Oct. 1996.
24.75 ± 2.61, and 4.93 ± 0.33 s when we use JPEG-LS+MV, [9] M. F. Zhang, J. Hu, and L. M. Zhang, “Lossless video compression using
combination of temporal and spatial prediction,” in Proc. IEEE Int. Conf.
JPEG-LS+VAR+MV, and JPEG-LS only, respectively. This Neural Netw. Signal Process., Dec. 2003, vol. 2, pp. 1193–1196.
result demonstrates the expensive time demanding of the full [10] L. M. Po and W. C. Ma, “A novel four-step search algorithm for fast block
search and MAE computation in the MEMC process. The com- motion estimation,” IEEE Trans. Circuits Syst. Video Technol., vol. 6,
no. 3, pp. 313–317, Jun. 1996.
pression time difference between the use of JPEG-LS and the [11] S. Zhu and K. K. Ma, “A new diamond search algorithm for fast block-
proposed method for one image frame may be ignored, but if matching motion estimation,” IEEE Trans. Image Process., vol. 9, no. 2,
an 8-h long sequence of CE images is considered, this time dif- pp. 287–290, Feb. 2000.
[12] J. L. Guo, “Thresholded two-path search method for video block motion
ference is too significant to be neglected. Fortunately, there are estimation,” Master’s thesis, Dept. Comput. Commun. Eng., Kaohsing
many fast searching methods for block matching. First Univ. Sci. Technol., Taiwan, 2001.
The authors in [10]–[12] study how accurate can a fast search-
ing method find the best matched MB (obtained by the full
searching method, i.e., full search and MAE) and the searching Shaou-Gang Miaou (M’94) was born in Taipei,
time saved by using the fast searching methods. It is concluded Taiwan, in 1961. He graduated from the Cheing-
Kuo Senior High School, Taipei, in 1979, and re-
that the diamond search (DS) method [10] is the best among ceived the B.S. degree in electronic engineering from
the methods under study in terms of both accuracy and speed. the Chung-Yuan Christian University, Chung-Li,
With the DS method, the accuracy is 90% and the time saved Taiwan, in 1983, and the M.S. and Ph.D. degrees in
electrical engineering from the University of Florida,
is 93% on the average. Therefore, if we took DS as the search Gainesville, FL, in 1990 and 1993, respectively.
method, the compression time of the proposed method might From 1983 to 1988, he was a Research Assistant at
become comparable to that of using JPEG-LS only and the CR the Chung-Shan Institute of Science and Technology,
Lung-Tan, Taiwan. From 1989 to 1993, he was either
performance might degrade slightly. a Teaching Assistant in the Department of Electrical Engineering, University of
Florida, or a Research Assistant in the Center for Information Research, Uni-
versity of Florida. In 1993, he joined the Department of Electronic Engineering,
IV. CONCLUSION Chung-Yuan Christian University, Chung-Li, Taiwan, as an Associate Professor.
He is currently a Professor and the Chairman of the Department of Electronic
The proposed method performs better than using JPEG-LS Engineering, Chung-Yuan Christian University. His current research interests
and JPEG2000 alone in CR by about 13.3% and 26.3% on the include data compression, pattern recognition, and wireless multimedia commu-
average for CE images, respectively. Similarly, the coding gains nications. He is an Editor for the International Journal of Electrical Engineering
and the Journal of Advanced Engineering. He has authored or coauthored over
for MRI images are about 77.5% and 86.5%, respectively. Since 100 technical papers in referred journals and conference proceedings. He holds
not every correlation in adjacent frames can be exploited effec- two invention patents with nine others pending. He is the author or coauthor of
tively in lossless compression, the proposed method achieves several books on digital image processing, communication systems, probability
and statistics, and engineering mathematics.
such coding gains by judiciously exploiting the correlation be- Prof. Miaou is a permanent member of the Image Processing and Pattern
tween adjacent frames with a low cost correlation estimation Recognition Society of R.O.C., and a member of the Biomedical Engineering
method. Society of R.O.C. He has been a Reviewer for many technical projects, con-
ferences, and prestigious journals, including IEEE TRANSACTIONS ON BIOMED-
The MEMC process could be implemented by a faster version ICAL ENGINEERING, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, IEEE
for some applications. Better correlation estimation methods TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, IEEE TRANS-
could be developed for more image types. To further improve the ACTIONS ON MEDICAL IMAGING, IEEE TRANSACTIONS ON MULTIMEDIA, and
IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS.
coding performance of the proposed method, we may consider
sharing MVs among multiple color components, using color
transformation, reordering image frames, and designing entropy Fu-Sheng Ke was born in Taipei County, Taiwan,
in 1982. He received the B.S. and M.S. degrees
codes for the MVs. in electronic engineering from the Chung-Yuan
Christian University, Chung-Li, Taiwan, in 2004 and
REFERENCES 2006, respectively.
He was involved in the research of data com-
[1] D. G. Adler and C. J. Goustout, “Wireless capsule endoscopy,” Hosp.
pression and its application to medical images. He
Phys., vol. 39, no. 5, pp. 14–22, 2003.
is currently an R&D Engineer with the Top Victory
[2] (2008, Feb. 6). [Online]. Available: http://dicom.nema.org/
Electronics, Taipei County, Taiwan.
[3] G. Schaefer, R. Starosolski, and S. Y. Zhu, “An evaluation of lossless
compression algorithms for medical infrared images,” in Proc. IEEE Eng.
Med. Biol. Conf., Sep. 2005, pp. 1673–1676.
[4] M. J. Weinberger, G. Seroussi, and G. Sapiro, “The LOCO-I lossless
image compression algorithm: Principles and standardization into JPEG- Shu-Ching Chen was born in Taipei, Taiwan, in
LS,” IEEE Trans. Image Process., vol. 9, no. 8, pp. 1309–1324, Aug. 1983. She received the B.S. and M.S. degrees in elec-
2000. tronic engineering from the Chung-Yuan Christian
[5] D. Brunello, G. Calvagno, G. A. Mian, and R. Rinaldo, “Lossless compres- University, Chung-Li, Taiwan, in 2005 and 2007,
sion of video using temporal information,” IEEE Trans. Image Process., respectively.
vol. 12, no. 2, pp. 132–139, Feb. 2003. She was involved in the research of digital wa-
[6] M. Weinberger, G. Seroussi, and G. Sapiro, “LOCO-I: A low complex- termarking for medical images. She is currently an
ity, context-based, lossless image compression algorithm,” in Proc. IEEE R&D Engineer with the CyberLink, Taipei, Taiwan.
Data Compression Conf., Snowbird, UT, Mar./Apr. 1996, pp. 140–149.

Authorized licensed use limited to: R.V.S. College of Engineering and Tech. Downloaded on April 29,2010 at 10:24:27 UTC from IEEE Xplore. Restrictions apply.

Potrebbero piacerti anche