USRE40081E1 - Fast signal transforms with lifting steps - Google Patents

Fast signal transforms with lifting steps Download PDF

Info

Publication number
USRE40081E1
USRE40081E1 US10/629,303 US62930303A USRE40081E US RE40081 E1 USRE40081 E1 US RE40081E1 US 62930303 A US62930303 A US 62930303A US RE40081 E USRE40081 E US RE40081E
Authority
US
United States
Prior art keywords
transform
coefficients
lifting
butterfly
rational
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US10/629,303
Inventor
Trac D. Tran
Pankaj Topiwala
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
RPX Corp
Original Assignee
FastVDO LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=22790031&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=USRE40081(E1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by FastVDO LLC filed Critical FastVDO LLC
Priority to US10/629,303 priority Critical patent/USRE40081E1/en
Assigned to FASTVDO, LLC reassignment FASTVDO, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PT-IP, LLC
Priority to US11/896,522 priority patent/US20080075377A1/en
Application granted granted Critical
Publication of USRE40081E1 publication Critical patent/USRE40081E1/en
Assigned to RPX CORPORATION reassignment RPX CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FASTVDO LLC
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/14Fourier, Walsh or analogous domain transformations, e.g. Laplace, Hilbert, Karhunen-Loeve, transforms
    • G06F17/147Discrete orthonormal transforms, e.g. discrete cosine transform, discrete sine transform, and variations therefrom, e.g. modified discrete cosine transform, integer transforms approximating the discrete cosine transform
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/114Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
    • H04N19/635Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by filter definition or implementation details

Definitions

  • the current invention relates to the processing of images such as photographs, drawings, and other two dimensional displays. It further relates to the processing of such images which are captured in digital format or after they have been converted to or expressed in digital format. This invention further relates to use of novel coding methods to increase the speed and compression ratio for digital image storage and transmission while avoiding introduction of undesirable artifacts into the reconstructed images.
  • image processing is the analysis and manipulation of two-dimensional representations, which can comprise photographs, drawings, paintings, blueprints, x-rays of medical patients, or indeed abstract art or artistic patterns. These images are all two-dimensional arrays of information.
  • images have comprised almost exclusively analog displays of analog information, for example, conventional photographs and motion pictures. Even the signals encoding television pictures, notwithstanding that the vertical scan comprises a finite number of lines, are fundamentally analog in nature.
  • images began to be captured or converted and stored as two-dimensional digital data, and digital image processing followed. At first, images were recorded or transmitted in analog form and then converted to digital representation for manipulation on a computer.
  • digital capture and transmission are on their way to dominance, in part because of the advent of charge coupled device (CCD) image recording arrays and in part because of the availability of inexpensive high speed computers to store and manipulate images.
  • CCD charge coupled device
  • An important task of image processing is the correction or enhancement of a particular image.
  • digital enhancement of images of celestial objects taken by space probes has provided substantial scientific information.
  • the current invention relates primarily to compression for transmission or storage of digital images and not to enhancement.
  • One of the problems with digital images is that a complete single image frame can require up to several megabytes of storage space or transmission bandwidth. That is, one of today's 31 ⁇ 2 inch floppy discs can hold at best a little more than one gray-scale frame and sometimes substantially less than one whole frame. A full-page color picture, for example, uncompressed, can occupy 30 megabytes of storage space. Storing or transmitting the vast amounts of data which would be required for real-time uncompressed high resolution digital video is technologically daunting and virtually impossible for many important communication channels, such as the telephone line. The transmission of digital images from space probes can take many hours or even days if insufficiently compressed images are involved. Accordingly, there has been a decades long effort to develop methods of extracting from images the information essential to an aesthetically pleasing or scientifically useful picture without degrading the image quality too much and especially without introducing unsightly or confusing artifacts into the image.
  • the basic approach has usually involved some form of coding of picture intensities coupled with quantization.
  • One approach is block coding; another approach, mathematically equivalent with proper phasing, is multiphase filter banks.
  • Frequency based multi-band transforms have long found application in image coding.
  • the JPEG image compression standard W. B. Pennebaker and J. L. Mitchell, “JPEG: Still Image Compression Standard,” Van Nostrand Reinhold, 1993, employs the 8 ⁇ 8 discrete cosine transform (DCT) at its transformation stage.
  • DCT discrete cosine transform
  • JPEG offers almost lossless reconstructed image quality.
  • annoying blocking artifacts appear since the DCT bases are short and do not overlap, creating discontinuities at block boundaries.
  • the wavelet transform on the other hand, with long, varying-length, and overlapping bases, has elegantly solved the blocking problem.
  • the transform's computational complexity can be significantly higher than that of the DCT. This complexity gap is partly in terms of the number of arithmetical operations involved, but more importantly, in terms of the memory buffer space required.
  • some implementations of the wavelet transform require many more operations per output coefficient as well as a large buffer.
  • the lapped transforms outperform the DCT on two counts: (i) from the analysis viewpoint, they take into account inter-block correlation and hence provide better energy compaction; (ii) from the synthesis viewpoint, their overlapping basis functions decay asymptotically to zero at the ends, reducing blocking discontinuities dramatically.
  • the current invention we use a family of lapped biorthogonal transforms implementing a small number of dyadic-rational lifting steps.
  • the resulting transform called the LiftLT, not only has high computation speed but is well-suited to implementation via VLSI.
  • the LiftLT is a lapped biorthogonal transform using lifting steps in a modular lattice structure, the result of which is a fast, efficient, and robust encoding system. With only 1 more multiplication (which can also be implemented with shift-and-add operations), 22 more additions, and 4 more delay elements compared to the bare DCT, the LiftLT offers a fast, low-cost approach capable of straightforward VLSI implementation while providing reconstructed images which are high in quality, both objectively and subjectively.
  • the LiftLT provides a significant improvement in reconstructed image quality over the traditional DCT in that blocking is completely eliminated while at medium and high compression ratios ringing artifacts are reasonably contained.
  • the performance of the LiftLT surpasses even that of the well-known 9/7-tap biorthogonal wavelet transform with irrational coefficients.
  • the LiftLT's block-based structure also provides several other advantages: supporting parallel processing mode, facilitating region-of-interest coding and decoding, and processing large images under severe memory constraints.
  • the current invention is an apparatus for block coding of windows of digitally represented images comprising a chain of lattices of lapped transforms with dyadic rational lifting steps. More particularly, this invention is a system of electronic devices which codes, stores or transmits, and decodes M ⁇ M sized blocks of digitally represented images, where M is an even number.
  • the main block transform structure comprises a transform having M channels numbered 0 through M ⁇ 1, half of said channel numbers being odd and half being even; a normalizer with a dyadic rational normalization factor in each of said M channels; two lifting steps with a first set of identical dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration, M/2 delay lines in the odd numbered channels; two inverse lifting steps with the first set of dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration; and two lifting steps with a second set of identical dyadic rational coefficients connecting each pair of adjacent odd numbered channels; means for transmission or storage of the transform output coefficients; and an inverse transform comprising M channels numbered 0 through M ⁇ 1, half of said channel numbers being odd and half being even; two inverse lifting steps with dyadic rational coefficients connecting each pair of adjacent odd numbered channels; two lifting steps with dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration; M/2 delay lines
  • FIG. 1 is a polyphase representation of a linear phase perfect reconstruction filter bank.
  • FIG. 3 shows the parameterization of an invertible matrix via the singular value decomposition.
  • FIG. 4 portrays the basic butterfly lifting configuration.
  • FIG. 7 depicts a VLSI implementation of the analysis filter bank operations.
  • FIG. 8 shows frequency and time responses of the 8 ⁇ 16 LiftLT: Left: analysis bank. Right: synthesis bank.
  • FIG. 9 portrays reconstructed “Barbara” images at 1:32 compression ratio.
  • a block transform for image processing is applied to a block (or window) of, for example, 8 ⁇ 8 group of pixels and the process is iterated over the entire image.
  • a biorthogonal transform in a block coder uses as a decomposition basis a complete set of basis vectors, similar to an orthogonal basis. However, the basis vectors are more general in that they may not be orthogonal to all other basis vectors. The restriction is that there is a “dual” basis to the original biorthogonal basis such that every vector in the original basis has a “dual” vector in the dual basis to which it is orthogonal. The basic idea of combining the concepts of biorthogonality and lapped transforms has already appeared in the prior art.
  • SVD singular value decomposition
  • any M/2 ⁇ M/2 orthogonal matrix can be factorized into M(M ⁇ 2)/8 plane rotations ⁇ i and that the diagonal matrices represent simply scaling factors ⁇ i .
  • the most general LT lattice consists of KM(M ⁇ 2)/2 two dimensional rotations and 2M diagonal scaling factors ⁇ i .
  • Any invertible matrix can be expressed as a sequence of pairwise plane rotations ⁇ and scaling factors ⁇ i as shown in FIG. 3 .
  • Each of the factors above is capable of a “lifting” step in signal processing terminology.
  • the signal processing flow diagram of this operation is shown in FIG. 4 .
  • the crossing arrangement of these flow paths is also referred to as a butterfly configuration.
  • Each of the above “shears” can be written as a lifting step.
  • the shears referred to can be expressed as computationally equivalent “lifting steps” in signal processing.
  • V 1 is factorizable into a series of lifting steps and diagonal scalings.
  • problems (i) the large number of lifting steps is costly in both speed and physical real-estate in VLSI implementation; (ii) the lifting steps are related; (iii) and it is not immediately obvious what choices of rotation angles will result in dyadic rational lifting multipliers.
  • V 1 we approximate V 1 by (M/2) ⁇ 1 combinations of block-diagonal predict-and-update lifting steps, i.e., [ 1 u i 0 1 ] ⁇ [ 1 0 - p i 1 ] .
  • the free parameters u i and p i can be chosen arbitrarily and independently without affecting perfect reconstruction.
  • the inverses are trivially obtained by switching the order and the sign of the lifting steps.
  • all of our lifting steps are of zero-order, namely operating in the same time epoch.
  • the resulting LiftLT lattice structures are presented in FIGS. 5 and 6 .
  • the analysis filter shown in FIG. 5 comprises a DCT block 1 , 25/16 normalization 2 , a delay line 3 on four of the eight channels, a butterfly structured set of lifting steps 5 , and a set of four fast dyadic lifting steps 6 .
  • the frequency and impulse responses of the 8 ⁇ 16 LiftLT's basis functions are depicted in FIG. 8 .
  • the inverse or synthesis lattice is shown in FIG. 6 .
  • This system comprises a set of four fast dyadic lifting steps 11 , a butterfly-structured set of lifting steps 12 , a delay line 13 on four of the eight channels, 16/25 inverse normalization 14 , and an inverse DCT block 15 .
  • FIG. 7 also shows the frequency and impulse responses of the synthesis lattice.
  • the LiftLT is sufficiently fast for many applications, especially in hardware, since most of the incrementally added computation comes from the 2 butterflies and the 6 shift-and-add lifting steps. It is faster than the type-I fast LOT described in H. S. Malvar, Signal Processing with Lapped Transforms, Artech House, 1992. Besides its low complexity, the LiftLT possesses many characteristics of a high-performance transform in image compression: (i) it has high energy compaction due to a high coding gain and a low attenuation near DC where most of the image energy is concentrated; (ii) its synthesis basis functions also decay smoothly to zero, resulting in blocking-free reconstructed images.
  • Table 1 contains a comparison of the complexity of these four coding systems, comparing numbers of operations needed per 8 transform coefficients:
  • Table 2 sets forth a number of different performance measures for each of the four methods:
  • FIG. 9 Reconstructed images for a standard 512 ⁇ 512 “Barbara” test image at 1:32 compression ratio are shown in FIG. 9 for aesthetic and heuristic evaluation.
  • Top left 21 is the reconstructed image for the 8 ⁇ 8 DCT (27.28 dB PSNR); top right shows the result for the 8 ⁇ 16 LOT(28.71 dB PSNR); bottom left is the 9/7 tap wavelet reconstruction (27.58 dB PSNR); and bottom right, 8 ⁇ 16 LiftLT (28.93 dB PSNR).
  • the objective coding results for standard 512 ⁇ 512 “Lena,” “Goldhill,” and “Barbara” test image (PSNR in dB's) are tabulated in Table 3:
  • the LiftLT outperforms its block transform relatives for all test images at all bit rates. Comparing to the wavelet transform, the LiftLT is quite competitive on smooth images—about 0.2 dB below on Lena. However, for more complex images such as Goldhill or Barbara, the LiftLT consistently surpasses the 9/7-tap wavelet. The PSNR improvement can reach as high as 1.5 dB.
  • FIG. 9 also shows pictorially the reconstruction performance in Barbara images at 1:32 compression ratio for heuristic comparison.
  • the visual quality of the LiftLT reconstructed image is noticeably superior. Blocking is completely avoided whereas ringing is reasonably contained.
  • Visual inspection indicates that the LiftLT coder gives at least as good performance as the wavelet coder.
  • the appearance of blocking artifacts in the DCT reconstruction (upper left) is readily apparent.
  • the LOT transform result (upper right) suffers visibly from the same artifacts even though it is lapped.
  • the wavelet transform reconstruction shows no blocking and is of generally high quality for this level of compression. It is faster than the LOT but significantly slower than the DCT.
  • the results of the LiftLT transform are shown at lower right. Again, it shows no blocking artifacts, and the picture quality is in general comparable to that of the wavelet transform reconstruction, while its speed is very close to that of the bare DCT.

Abstract

This invention introduces a class of multi-band linear phase lapped biorthogonal transforms with fast, VLSI-friendly implementations via lifting steps called the LiftLT. The transform is based on a lattice structure which robustly enforces both linear phase and perfect reconstruction properties. The lattice coefficients are parameterized as a series of lifting steps, providing fast, efficient in-place computation of the transform coefficients as well as the ability to map integers to integers. Our main motivation of the new transform is its application in image and video coding. Comparing to the popular 8×8 DCT, the 8×16 LiftLT only requires 1 more multiplication, 22 more additions, and 6 more shifting operations. However, image coding examples show that the LiftLT is far superior to the DCT in both objective and subjective coding performance. Thanks to properly designed overlapping basis functions, the LiftLT can completely eliminate annoying blocking artifacts. In fact, the novel LiftLT's coding performance consistently surpasses that of the much more complex 9/7-tap biorthogonal wavelet with floating-point coefficients. More importantly, our transform's block-based nature facilitates one-pass sequential block coding, region-of-interest coding/decoding as well as parallel processing.

Description

FIELD OF THE INVENTION
More than one reissue application has been filed for the reissue of U.S. Pat. No. 6,421,464. The Instant Reissue application Ser. No. 10/629,303 filed Jul. 29, 2003 and U.S. application Ser. No. 11/896,522, filed Sep. 4, 2007 which is a Continuation of U.S. Reissue application Ser. No. 10/629,303.
The current invention relates to the processing of images such as photographs, drawings, and other two dimensional displays. It further relates to the processing of such images which are captured in digital format or after they have been converted to or expressed in digital format. This invention further relates to use of novel coding methods to increase the speed and compression ratio for digital image storage and transmission while avoiding introduction of undesirable artifacts into the reconstructed images.
BACKGROUND OF THE INVENTION
In general, image processing is the analysis and manipulation of two-dimensional representations, which can comprise photographs, drawings, paintings, blueprints, x-rays of medical patients, or indeed abstract art or artistic patterns. These images are all two-dimensional arrays of information. Until fairly recently, images have comprised almost exclusively analog displays of analog information, for example, conventional photographs and motion pictures. Even the signals encoding television pictures, notwithstanding that the vertical scan comprises a finite number of lines, are fundamentally analog in nature.
Beginning in the early 1960's, images began to be captured or converted and stored as two-dimensional digital data, and digital image processing followed. At first, images were recorded or transmitted in analog form and then converted to digital representation for manipulation on a computer. Currently digital capture and transmission are on their way to dominance, in part because of the advent of charge coupled device (CCD) image recording arrays and in part because of the availability of inexpensive high speed computers to store and manipulate images.
An important task of image processing is the correction or enhancement of a particular image. For example, digital enhancement of images of celestial objects taken by space probes has provided substantial scientific information. However, the current invention relates primarily to compression for transmission or storage of digital images and not to enhancement.
One of the problems with digital images is that a complete single image frame can require up to several megabytes of storage space or transmission bandwidth. That is, one of today's 3½ inch floppy discs can hold at best a little more than one gray-scale frame and sometimes substantially less than one whole frame. A full-page color picture, for example, uncompressed, can occupy 30 megabytes of storage space. Storing or transmitting the vast amounts of data which would be required for real-time uncompressed high resolution digital video is technologically daunting and virtually impossible for many important communication channels, such as the telephone line. The transmission of digital images from space probes can take many hours or even days if insufficiently compressed images are involved. Accordingly, there has been a decades long effort to develop methods of extracting from images the information essential to an aesthetically pleasing or scientifically useful picture without degrading the image quality too much and especially without introducing unsightly or confusing artifacts into the image.
The basic approach has usually involved some form of coding of picture intensities coupled with quantization. One approach is block coding; another approach, mathematically equivalent with proper phasing, is multiphase filter banks. Frequency based multi-band transforms have long found application in image coding. For instance, the JPEG image compression standard, W. B. Pennebaker and J. L. Mitchell, “JPEG: Still Image Compression Standard,” Van Nostrand Reinhold, 1993, employs the 8×8 discrete cosine transform (DCT) at its transformation stage. At high bit rates, JPEG offers almost lossless reconstructed image quality. However, when more compression is needed, annoying blocking artifacts appear since the DCT bases are short and do not overlap, creating discontinuities at block boundaries.
The wavelet transform, on the other hand, with long, varying-length, and overlapping bases, has elegantly solved the blocking problem. However, the transform's computational complexity can be significantly higher than that of the DCT. This complexity gap is partly in terms of the number of arithmetical operations involved, but more importantly, in terms of the memory buffer space required. In particular, some implementations of the wavelet transform require many more operations per output coefficient as well as a large buffer.
An interesting alternative to wavelets is the lapped transform, e.g., H. S. Malvar, Signal Processing with Lapped Transforms, Artech House, 1992, where pixels from adjacent blocks are utilized in the calculation of transform coefficients for the working block. The lapped transforms outperform the DCT on two counts: (i) from the analysis viewpoint, they take into account inter-block correlation and hence provide better energy compaction; (ii) from the synthesis viewpoint, their overlapping basis functions decay asymptotically to zero at the ends, reducing blocking discontinuities dramatically.
Nevertheless, lapped transforms have not yet been able to supplant the unadorned DCT in international standard coding routines. The principal reason is that the modest improvement in coding performance available up to now has not been sufficient to justify the significant increase in computational complexity. In the prior art, therefore, lapped transforms remained too computationally complex for the benefits they provided. In particular, the previous lapped transformed somewhat reduced but did not eliminate the annoying blocking artifacts.
It is therefore an object of the current invention to provide a new transform which is simple and fast enough to replace the bare DCT in international standards, in particular in JPEG and MPEG-like coding standards. It is another object of this invention to provide an image transform which has overlapping basis functions so as to avoid blocking artifacts. It is a further object of this invention to provide a lapped transform which is approximately as fast as, but more efficient for compression than, the bare DCT. It is yet another object of this invention to provide dramatically improved speed and efficiency using a lapped transform with lifting steps in a butterfly structure with dyadic-rational coefficients. It is yet a further object of this invention to provide a transform structure such that for a negligible complexity surplus over the bare DCT a dramatic coding performance gain can be obtained both from a subjective and objective point of view while blocking artifacts are completely eliminated.
SUMMARY OF THE INVENTION
In the current invention, we use a family of lapped biorthogonal transforms implementing a small number of dyadic-rational lifting steps. The resulting transform, called the LiftLT, not only has high computation speed but is well-suited to implementation via VLSI.
Moreover, it also consistently outperforms state-of-the-art wavelet based coding systems in coding performance when the same quantizer and entropy coder are used. The LiftLT is a lapped biorthogonal transform using lifting steps in a modular lattice structure, the result of which is a fast, efficient, and robust encoding system. With only 1 more multiplication (which can also be implemented with shift-and-add operations), 22 more additions, and 4 more delay elements compared to the bare DCT, the LiftLT offers a fast, low-cost approach capable of straightforward VLSI implementation while providing reconstructed images which are high in quality, both objectively and subjectively. Despite its simplicity, the LiftLT provides a significant improvement in reconstructed image quality over the traditional DCT in that blocking is completely eliminated while at medium and high compression ratios ringing artifacts are reasonably contained. The performance of the LiftLT surpasses even that of the well-known 9/7-tap biorthogonal wavelet transform with irrational coefficients. The LiftLT's block-based structure also provides several other advantages: supporting parallel processing mode, facilitating region-of-interest coding and decoding, and processing large images under severe memory constraints.
Most generally, the current invention is an apparatus for block coding of windows of digitally represented images comprising a chain of lattices of lapped transforms with dyadic rational lifting steps. More particularly, this invention is a system of electronic devices which codes, stores or transmits, and decodes M×M sized blocks of digitally represented images, where M is an even number. The main block transform structure comprises a transform having M channels numbered 0 through M−1, half of said channel numbers being odd and half being even; a normalizer with a dyadic rational normalization factor in each of said M channels; two lifting steps with a first set of identical dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration, M/2 delay lines in the odd numbered channels; two inverse lifting steps with the first set of dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration; and two lifting steps with a second set of identical dyadic rational coefficients connecting each pair of adjacent odd numbered channels; means for transmission or storage of the transform output coefficients; and an inverse transform comprising M channels numbered 0 through M−1, half of said channel numbers being odd and half being even; two inverse lifting steps with dyadic rational coefficients connecting each pair of adjacent odd numbered channels; two lifting steps with dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration; M/2 delay lines in the even numbered channels; two inverse lifting steps with dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration; a denormalizer with a dyadic rational inverse normalization factor in each of said M channels; and a base inverse transform having M channels numbered 0 through M−1.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a polyphase representation of a linear phase perfect reconstruction filter bank.
FIG. 2 shows the most general lattice structure for linear phase lapped transforms with filter length L=KM.
FIG. 3 shows the parameterization of an invertible matrix via the singular value decomposition.
FIG. 4 portrays the basic butterfly lifting configuration.
FIG. 5 depicts the analysis LiftLT lattice drawn for M=8.
FIG. 6 depicts the synthesis LiftLT lattice drawn for M=8.
FIG. 7 depicts a VLSI implementation of the analysis filter bank operations.
FIG. 8 shows frequency and time responses of the 8×16 LiftLT: Left: analysis bank. Right: synthesis bank.
FIG. 9 portrays reconstructed “Barbara” images at 1:32 compression ratio.
DESCRIPTION OF THE PREFERRED EMBODIMENT
Typically, a block transform for image processing is applied to a block (or window) of, for example, 8×8 group of pixels and the process is iterated over the entire image. A biorthogonal transform in a block coder uses as a decomposition basis a complete set of basis vectors, similar to an orthogonal basis. However, the basis vectors are more general in that they may not be orthogonal to all other basis vectors. The restriction is that there is a “dual” basis to the original biorthogonal basis such that every vector in the original basis has a “dual” vector in the dual basis to which it is orthogonal. The basic idea of combining the concepts of biorthogonality and lapped transforms has already appeared in the prior art. The most general lattice for M-channel linear phase lapped biorthogonal transforms is presented in T. D. Tran, R. de Queiroz, and T. Q. Nguyen, “The generalized lapped biorthogonal transform,” ICASSP, pp. 1441-1444, Seattle, May 1998, and in T. D. Tran, R. L. de Queiroz, and T. Q. Nguyen, “Linear phase perfect reconstruction filter bank: lattice structure, design, and application in image coding” (submitted to EEE Trans. on Signal Processing, April 1998). A signal processing flow diagram of this well-known generalized filter bank is shown in FIG. 2.
In the current invention, which we call the Fast LiftLT, we apply lapped transforms based on using fast lifting steps in an M-channel uniform linear-phase perfect reconstruction filter bank, according to the generic polyphase representation of FIG. 1. In the lapped biorthogonal approach, the polyphase matrix E(z) can be factorized as E ( z ) = G K - 1 ( z ) G K - 2 ( z ) G ( z ) E o ( z ) , where ( 1 ) G i ( z ) = 1 2 [ U i 0 0 V i ] [ I I I - I ] [ I 0 0 z - 1 I ] [ I I I - I ] = 1 2 Φ i × W × Λ × W , and ( 2 ) E 0 ( z ) = 1 2 [ U 0 U 0 J M / 2 V 0 J M / 2 - V 0 ] . ( 3 )
In these equations, I is the identity matrix, and J is the matrix with 1's on the anti-diagonal.
The transform decomposition expressed by equations (1) through (3) is readily represented, as shown in FIG. 2, as a complete lattice replacing the “analysis” filter bank E(z) of FIG. 1. This decomposition results in a lattice of filters having length L=KM. (K is often called the overlapping factor.) Each cascading structure G1(z) increases the filter length by M. All Ui and Vi, i=0,1, . . . , K−1, are arbitrary M/2×M/2 invertible matrices. According to a theorem well known in the art, invertible matrices can be completely represented by their singular value decomposition (SVD), given by
Ui=Ui0ΓiUi1, Vi=Vi0ΔiVi1
where Ui0, Ui1, Vi0, Vi1 are diagonalizing orthogonal matrices and Γi, Δi are diagonal matrices with positive elements.
It is well known that any M/2×M/2 orthogonal matrix can be factorized into M(M−2)/8 plane rotations θi and that the diagonal matrices represent simply scaling factors αi. Accordingly, the most general LT lattice consists of KM(M−2)/2 two dimensional rotations and 2M diagonal scaling factors αi. Any invertible matrix can be expressed as a sequence of pairwise plane rotations θ and scaling factors αi as shown in FIG. 3.
It is also well known that a plane rotation can be performed by 3 “shears”: [ cos θ i - sin θ i sin θ i cos θ i ] = [ 1 cos θ i - 1 sin θ i 0 1 ] [ 1 0 sin θ i 1 ] [ 1 cos θ i - 1 sin θ i 0 1 ] .
This can be easily verified by computation
Each of the factors above is capable of a “lifting” step in signal processing terminology. The product of two which effects a linear transform of pairs of coefficients: [ a b ] [ 1 + km k m 1 ] × [ a b ] .
The signal processing flow diagram of this operation is shown in FIG. 4. The crossing arrangement of these flow paths is also referred to as a butterfly configuration. Each of the above “shears” can be written as a lifting step.
Combining the foregoing, the shears referred to can be expressed as computationally equivalent “lifting steps” in signal processing. In other words, we can replace each “rotation” by 3 closely-related lifting steps with butterfly structure. It is possible therefore to implement the complete LT lattice shown in FIG. 2 by 3KM(−2)/2 lifting steps and 2M scaling multipliers.
In the simplest but currently preferred embodiment, to minimize the complexity of the transform we choose a small overlapping factor K=2 and set the initial stage E0 to be the DCT itself Many other coding transforms can serve for the base stage instead of the DCT, and it should be recognized that many other embodiments are possible and can be implemented by one skilled in the art of signal processing.
Following the observation in H. S. Malvar, “Lapped biorthogonal transforms for transform coding with reduced blocking and ringing artifacts,” ICASSP97, Munich, April 1997, we apply a scaling factor to the first DCT's antisymmetric basis to generate synthesis LT basis functions whose end values decay smoothly to exact zero—a crucial advantage in blocking artifacts elimination. However, instead of scaling the analysis by √{square root over (2)} and the synthesis by 1/√{square root over (2)}, we opt for 25/16 and its inverse 16/25 since they allow the implementation of both analysis and synthesis banks in integer arithmetic. Another value that works almost as well as 25/16 is 5/4. To summarize, the following choices are made in the first stage: the combination of U00 and V00 with the previous butterfly form the DCT; Δ 0 = diag [ 25 16 , 1 , , 1 ] ,
and Γo=U00=V00=IM/2. See FIG. 2.
After 2 series of ±1 butterflies W and the delay chain Λ(z), the LT symmetric basis functions already have good attenuation, especially at DC (ω=0). Hence, we can comfortably set U1=IM/2.
As noted, V1 is factorizable into a series of lifting steps and diagonal scalings. However, there are several problems: (i) the large number of lifting steps is costly in both speed and physical real-estate in VLSI implementation; (ii) the lifting steps are related; (iii) and it is not immediately obvious what choices of rotation angles will result in dyadic rational lifting multipliers. In the current invention, we approximate V1 by (M/2)−1 combinations of block-diagonal predict-and-update lifting steps, i.e., [ 1 u i 0 1 ] × [ 1 0 - p i 1 ] .
Here, the free parameters ui and pi can be chosen arbitrarily and independently without affecting perfect reconstruction. The inverses are trivially obtained by switching the order and the sign of the lifting steps. Unlike popular lifting implementations of various wavelets, all of our lifting steps are of zero-order, namely operating in the same time epoch. In other words, we simply use a series of 2×2 upper or lower diagonal matrices to parameterize the invertible matrix V1.
Most importantly, fast-computable VLSI-friendly transforms are readily available when ui and pi are restricted to dyadic rational values, that is, rational fractions having (preferably small) powers of 2 denominators. With such coefficients, transform operations can for the most part be reduced to a small number of shifts and adds. In particular, setting all of the approximating lifting step coefficients to −1/2 yields a very fast and elegant lapped transform. With this choice, each lifting step can be implemented using only one simple bit shift and one addition.
The resulting LiftLT lattice structures are presented in FIGS. 5 and 6. The analysis filter shown in FIG. 5 comprises a DCT block 1, 25/16 normalization 2, a delay line 3 on four of the eight channels, a butterfly structured set of lifting steps 5, and a set of four fast dyadic lifting steps 6. The frequency and impulse responses of the 8×16 LiftLT's basis functions are depicted in FIG. 8.
The inverse or synthesis lattice is shown in FIG. 6. This system comprises a set of four fast dyadic lifting steps 11, a butterfly-structured set of lifting steps 12, a delay line 13 on four of the eight channels, 16/25 inverse normalization 14, and an inverse DCT block 15. FIG. 7 also shows the frequency and impulse responses of the synthesis lattice.
The LiftLT is sufficiently fast for many applications, especially in hardware, since most of the incrementally added computation comes from the 2 butterflies and the 6 shift-and-add lifting steps. It is faster than the type-I fast LOT described in H. S. Malvar, Signal Processing with Lapped Transforms, Artech House, 1992. Besides its low complexity, the LiftLT possesses many characteristics of a high-performance transform in image compression: (i) it has high energy compaction due to a high coding gain and a low attenuation near DC where most of the image energy is concentrated; (ii) its synthesis basis functions also decay smoothly to zero, resulting in blocking-free reconstructed images.
Comparisons of complexity and performance between the LiftLT and other popular transforms are tabulated in Table 1 and Table 2. The LiftLT's performance is already very close to that of the optimal generalized lapped biorthogonal transform, while its complexity is the lowest amongst the transforms except for the DCT.
To assess the new method in image coding, we compared images coded and decoded with four different transforms:
    • DCT: 8-channel, 8-tap filters
    • Type-I Fast LOT: 8-channel, 16-tap filters
    • LiftLT: 8-channel, 16-tap filters
    • Wavelet: 9/7-tap biorthogonal.
      In this comparison, we use the same SPIHT's quantizer and entropy coder, A. Said and W. A. Pearlman, “A new fast and efficient image coder based on set partitioning in hierarchical trees,” IEEE Trans on Circuits Syst. Video Tech., vol. 6, pp. 243-250, June 1996, for every transform. In the block-transform cases, we use the modified zero-tree structure in T. D. Tran and T. Q. Nguyen, “A lapped transform embedded image coder,” ISCAS, Monterey, May 1998, where each block of transform coefficients is treated analogously to a full wavelet tree and three more levels of decomposition are employed to decorrelate the DC subband further.
Table 1 contains a comparison of the complexity of these four coding systems, comparing numbers of operations needed per 8 transform coefficients:
No.
Transform Multiplications No. Additions No. Shifts
8 × 8 DCT 13 29 0
8 × 16 Type-I Fast LOT 22 54 0
917 Wavelet, 1-level 36 56 0
8 × 6 Fast LiftLT 14 51 6

In such a comparison, the number of multiplication operations dominates the “cost” of the transform in terms of computing resources and time, and number of additions and number of shifts have negligible effect. In this table, it is clear that the fast LiftLT is almost as low as the DCT in complexity and more than twice as efficient as the wavelet transform.
Table 2 sets forth a number of different performance measures for each of the four methods:
DC Stopband
Coding Atten. Atten. Mir. Freq.
Transform Gain (dB) (−dB) (−dB) Atten. (−dB)
8 × 8 DCT 8.83 310.62 9.96 322.1
8 × 16 Type-I Fast LOT 9.2 309.04 17.32 314.7
8 × 16 Optional LT 9.62 327.4 13.5 55.54
8 × 16 Fast LiftLT 9.54 312.56 13.21 304.85

The fast LiftLT is comparable to the optional 8×16 LT transform in coding gain and stopband attenuation an significantly better than the DCT.
Reconstructed images for a standard 512×512 “Barbara” test image at 1:32 compression ratio are shown in FIG. 9 for aesthetic and heuristic evaluation. Top left 21 is the reconstructed image for the 8×8 DCT (27.28 dB PSNR); top right shows the result for the 8×16 LOT(28.71 dB PSNR); bottom left is the 9/7 tap wavelet reconstruction (27.58 dB PSNR); and bottom right, 8×16 LiftLT (28.93 dB PSNR). The objective coding results for standard 512×512 “Lena,” “Goldhill,” and “Barbara” test image (PSNR in dB's) are tabulated in Table 3:
Lena Goldhill Barbara
Comp. 9/7 WL 8 × 8 8 × 16 8 × 16 9/7 WL 8 × 8 8 × 16 8 × 16 9/7 WL 8 × 8 8 × 16 8 × 16
Ratio SPIHT DCT LOT LiftLT SPIHT DCT LOT LiftLT SPIHT DCT LOT LiftLT
8 40.41 39.91 40.02 40.21 36.55 36.25 36.56 36.56 36.41 36.31 37.22 37.57
16 37.21 36.38 36.69 37.11 33.13 32.76 33.12 33.22 31.4 31.11 32.52 32.82
32 34.11 32.9 33.49 34 30.56 30.07 30.52 30.63 27.58 27.28 28.71 28.93
64 31.1 29.67 30.43 30.9 28.48 27.93 28.34 28.54 24.86 24.58 25.66 25.93
100 29.35 27.8 28.59 29.03 27.38 26.65 27.08 27.28 23.76 23.42 24.32 24.5
128 28.38 26.91 27.6 28.12 26.73 26.01 26.46 26.7 23.35 22.68 23.36 23.47

PSNR is an acronym for power signal to noise r-atio and represents the logarithm of the ratio of maximum amplitude squared to the mean square error of the reconstructed signal expressed in decibels (dB).
The LiftLT outperforms its block transform relatives for all test images at all bit rates. Comparing to the wavelet transform, the LiftLT is quite competitive on smooth images—about 0.2 dB below on Lena. However, for more complex images such as Goldhill or Barbara, the LiftLT consistently surpasses the 9/7-tap wavelet. The PSNR improvement can reach as high as 1.5 dB.
FIG. 9 also shows pictorially the reconstruction performance in Barbara images at 1:32 compression ratio for heuristic comparison. The visual quality of the LiftLT reconstructed image is noticeably superior. Blocking is completely avoided whereas ringing is reasonably contained. Top left: 8×8 DCT, 27.28 dB. Top right: 8×16 LOT, 28.71 dB. Bottom left: 9/7-tap wavelet, 27.58 dB. Bottom right: 8×16 LiftLT, 28.93 dB. Visual inspection indicates that the LiftLT coder gives at least as good performance as the wavelet coder. The appearance of blocking artifacts in the DCT reconstruction (upper left) is readily apparent. The LOT transform result (upper right) suffers visibly from the same artifacts even though it is lapped. In addition, it is substantially more complex and therefore slower than the DCT transform. The wavelet transform reconstruction (lower left) shows no blocking and is of generally high quality for this level of compression. It is faster than the LOT but significantly slower than the DCT. Finally, the results of the LiftLT transform are shown at lower right. Again, it shows no blocking artifacts, and the picture quality is in general comparable to that of the wavelet transform reconstruction, while its speed is very close to that of the bare DCT.

Claims (39)

1. An apparatus for coding, storing or transmitting, and decoding M×M sized blocks of digitally represented images, where M is an even number, comprising
a. a forward transform comprising
i. a base transform having M channels numbered 0 through M−1, half of said channel numbers being odd and half being even;
ii. an equal normalization factor in each of the M channels selected to be dyadic-rational;
iii. a full-scale butterfly implemented as a series of lifting steps with a first set of dyadic rational coefficients;
iv. M/2 delay lines in the odd numbered channels;
v. a full-scale butterfly implemented as a series of lifting steps with said first set of dyadic rational coefficients; and
vi. a series of lifting steps in the odd numbered channels with a second specifically selected set of dyadic-rational coefficients;
b. means for transmission or storage of the transform output coefficients; and
c. an inverse transform comprising
i. M channels numbered 0 through M−1, half of said channel numbers being odd and half being even;
ii. a series of inverse lifting steps in the odd numbered channels with said second set of specifically selected dyadic-rational coefficients;
iii. a full-scale butterfly implemented as a series of lifting steps with said first set of specifically selected dyadic-rational coefficients;
iv. M/2 delay lines in the even numbered channels;
v. a full-scale butterfly implemented as a series of lifting steps with said first set of specifically selected dyadic-rational coefficients;
vi. an equal denormalization factor in each of the M channels specifically selected to be dyadic-rational; and
vii. a base inverse transform having M channels numbered 0 through M−1.
2. The apparatus of claim 1 in which the normalizing factor takes the value 25/16 and simultaneously the denormalizing factor takes the value 16/25.
3. The apparatus of claim 1 in which the normalizing factor takes the value 5/4 and simultaneously the denormalizing factor takes the value 4/5.
4. The apparatus of claim 1 in which the first set of dyadic rational coefficients are all equal to 1.
5. The apparatus of claim 1 in which the second set of dyadic rational coefficients are all equal to ½.
6. The apparatus of claim 1 in which the base transform is any M×M invertible matrix of the form of a linear phase filter and the inverse base transform is the inverse of said M×M invertible matrix.
7. The apparatus of claim 1 in which the base transform is the forward M×M discrete cosine transform and the inverse base transform is the inverse M×M discrete cosine transform.
8. An apparatus for coding, compressing, storing or transmitting, and decoding a block of M×M intensities from a digital image selected by an M×M window moving recursively over the image, comprising:
a. an M×M block transform comprising:
i. an initial stage
ii. a normalizing factor in each channel
b. a cascade comprising a plurality of dyadic rational lifting transforms, each of said plurality of dyadic rational lifting transforms comprising
i. a first bank of pairs of butterfly lifting steps with unitary coefficients between adjacent lines of said transform;
ii. a bank of delay lines in a first group of M/2 alternating lines;
iii. a second bank of butterfly lifting steps with unitary coefficients, and
iv. a bank of pairs of butterfly lifting steps with coefficients of 1/2 between M/2−1 pairs of said M/2 alternating lines;
c. means for transmission or storage of the output coefficients of said M×M block transform; and
d. an inverse transform comprising
i. a cascade comprising a plurality of dyadic rational lifting transforms, each of said plurality of dyadic rational lifting transforms comprising
a) a bank of pairs of butterfly lifting steps with coefficients of 1/2 between said M/2−1 pairs of said M/2 alternating lines;
b) a first bank of pairs of butterfly lifting steps with unitary coefficients between adjacent lines of said transform;
c) a bank of delay lines in a second group of M/2 alternating lines, ; and
d) a second bank of pairs of butterfly lifting steps with unitary coefficients between adjacent lines of said transform;
ii. a de-scaling bank, ; and
iii. an inverse initial stage.
9. A method of coding, storing or transmitting, and decoding M×M sized blocks of digitally represented images, where M is an even number a power of 2, comprising
a. transmitting the original picture signals to a coder, which effects the steps of
i. converting the signals with a base transform having M channels numbered 0 through M−1, half of said channel numbers being odd and half being even, ;
ii. normalizing the output of the preceding step with a dyadic rational normalization factor in each of said M channels;
iii. processing the output of the preceding step through two lifting steps with a first set of identical dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration;
iv. transmitting the resulting coefficients through M/2 delay lines in the odd numbered channels;
v. processing the output of the preceding step through two inverse lifting steps with the first set of dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration; and
vi. applying two lifting steps with a second set of identical dyadic rational coefficients connecting each pair of adjacent odd numbered channels to the output of the preceding step;
b. transmitting or storing the transform output coefficients;
c. receiving the transform output coefficients in a decoder; and
d. processing the output coefficients in a decoder, comprising the steps of
i. receiving the coefficients in M channels numbered 0 through M−1, half of said channel numbers being odd and half being even;
ii. applying two inverse lifting steps with dyadic rational coefficients connecting each pair of adjacent odd numbered channels;
iii. applying two lifting steps with dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration;
iv. transmitting the result of the preceding step through M/2 delay lines in the even numbered channels;
v. applying two inverse lifting steps with dyadic rational coefficients connecting each pair of adjacent numbered channels in a butterfly configuration;
vi. denormalizing the result of the preceding step with a dyadic rational inverse normalization factor in each of said M channels; and
vii. processing the result of the preceding step through a base inverse transform having M channels numbered 0 through M−1.
10. A method of coding, compressing, storing or transmitting, and decoding a block of M×M intensities from a digital image selected by an M×M window moving recursively over the image, comprising the steps of:
a. Processing the intensities in an M×M block coder comprising the steps of:
i. processing the intensities through an initial stage;
ii. scaling the result of the preceding step in each channel;
b. processing the result of the preceding step through a cascade comprising a plurality of dyadic rational lifting transforms, each of said plurality of dyadic rational lifting transforms comprising
i. a first bank of pairs of butterfly lifting steps with unitary coefficients between adjacent lines of said transform;
ii. a bank of delay lines in a first group of M/2 alternating lines;
iii. a second bank of butterfly lifting steps with unitary coefficients, and
iv. a bank of pairs of butterfly lifting steps with coefficients of 1/2 between M/2−1 pairs of said M/2 alternating lines;
c. transmitting or storing the output coefficients of said M×M block coder;
d. receiving the output coefficients in a decoder; and
e. processing the output coefficients in the decoder, comprising the steps of
i. processing the output coefficients through a cascade comprising a plurality of dyadic rational lifting transforms, each of said plurality of dyadic rational lifting transforms comprising
a) a bank of pairs of butterfly lifting steps with coefficients of 1/2 between said M/2−1 pairs of said M/2 alternating lines;
b) a first bank of pairs of butterfly lifting steps with unitary coefficients between adjacent lines of said transform;
c) a bank of delay lines in a second group of M/2 alternating lines;
d) a second bank of pairs of butterfly lifting steps with unitary coefficients between adjacent lines of said transform;
e) a de-scaling bank; and
f. processing the results of the preceding step in an inverse initial stage.
11. The apparatus of claim 1 in which the constants coefficients are approximations chosen for rapid computing rather than exact constants coefficients.
12. A method of coding, storing or transmitting, and decoding a block of M×M intensities from a digital image selected by an M×M window moving recursively over the image, comprising:
a. processing the intensities in an M×M block coder comprising the steps of:
i. processing the intensities through an initial stage;
ii. scaling the result of the preceding step in each channel;
b. processing the result of the preceding step through a transform coder using a method of processing blocks of samples of digital signals of integer length M comprising processing the digital samples of length M with an invertible linear transform of dimension M, said transform being representable as a cascade, using the steps, in arbitrary order, of:
i) at least one +/−1 butterfly step,
ii) at least one lifting step with rational complex coefficients, and
iii) at least one scaling factor;
c. transmitting or storing the output coefficients of said M×M block coder;
d. receiving the output coefficients in a decoder; and
e. processing the output coefficients in the decoder into a reconstructed image using the inverse of the coder of steps a. and b.
13. The method of claim 12 wherein the method of processing blocks of samples of digital signals of integer length M additionally comprises the step of at least one time delay.
14. The method of claim 12, wherein the rational complex coefficients in the at least one lifting step are dyadic.
15. The method of claim 12, wherein
a) said invertible transform is an approximation of a biorthogonal transform;
b) said biorthogonal transformation comprises a representation as a cascade of at least one butterfly step, at least one orthogonal transform, and at least one scaling factor;
c) said at least one orthogonal transform comprises a cascade of
i) at least one ±1 butterfly step,
ii) at least one planar rotation, and
iii) at least one scaling factor;
b) said at least one planar rotation being represented by equivalent lifting steps and scale factors; and,
c) said approximation is obtained by replacing floating point coefficients in the lifting steps with rational coefficients.
16. The method of claim 15, wherein the coefficients of the lifting steps are chosen to be dyadic rational.
17. The method of claim 12, wherein the invertible transform is a unitary transform.
18. The method of claim 12, wherein
a) said invertible transform is an approximation of a unitary transform;
b) said approximation of the unitary transform comprises a representation of the unitary transform as a cascade of at least one butterfly step, at least one orthogonal transform, and at least one scale factor;
c) said at least one orthogonal transform being represented as a cascade of
( 1 ) at least one ±1 butterfly steps,
( 2 ) at least one planar rotation, and
( 3 ) at least one scaling factor;
d) said at least one planar rotation being represented by equivalent lifting steps and scale factors; and,
e) said approximation being derived by using approximate rational values for the coefficients in the lifting steps.
19. The method of claim 18, wherein the invertible transform is an approximation of a transform selected from the group of special unitary transforms: discrete cosine transform (DCT); discrete Fourier transform (DFT); discrete sine transform (DST).
20. The method of claim 18, wherein the coefficients of the lifting steps are dyadic rational.
21. The method of claim 18, wherein at least one of the following lifting steps is used, whose matrix representations take on the form: [ 1 a 0 1 ] , [ 1 0 b 1 ] ,
where a, b are selected from the group:
±{8, 5, 4, 2, 1, 1/2, 1/4, 3/4, 5/4, 1/8, 3/8, 2/5, 5/8, 7/8, 1/16, 3/16, 5/16, 7/16, 9/16, 11/16, 13/16, 15/16, 25/16}.
22. The method of claim 21, wherein the invertible transform is an approximation of a transform selected from the group: discrete cosine transform (DCT); discrete Fourier transform (DFT); discrete sine transform (DST).
23. The method of claim 22, wherein the approximation of the 4 point DCT is selected from the group of matrices: { [ 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 1 - 1 1 - 1 ] , [ 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 1 - 2 2 - 1 ] , [ 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 5 - 2 2 - 5 ] } .
24. The method of claim 19 in which the invertible transform is an approximation of a transform selected from the group three point DCT, 4 point DCT, 8 point DCT, and 16 point DCT.
25. The method of claim 19 in which the invertible transform is an approximation of a transform selected from the group 512 point FFT, 1024 point FFT, 2048 point FFT, and 4096 point FFT.
26. A method of coding, storing or transmitting, and decoding sequences of intensities of integer length M recursively selected from a time ordered string of intensities arising from electrical signals, the method comprising the steps of
a) recursively processing the sequences of intensities of integer length M with an invertible forward linear transform of dimension M, said transform being representable as a cascade using the steps, in a preselected arbitrary order, of:
ii) at least one ±1 butterfly step,
iii) at least one lifting step with rational complex coefficients, and
iv) applying at least one scaling factor;
b) compressing the resulting transform coefficients;
c) storing or transmitting the compressed transform coefficients;
d) receiving or recovering from storage the transmitted or stored compressed transform coefficients;
e) decompressing the received or recovered compressed transform coefficients; and
f) recursively processing the decompressed transform coefficients with the inverse of the forward linear transform of dimension M, said inverse transform being representable as a cascade using the steps, in the exact reverse order of the preselected arbitrary order, of:
ii) at least one inverse butterfly corresponding to each of the at least one ±1 butterfly step;
iii) at least one inverse lifting step corresponding to each of the at least one lifting step with rational complex coefficients; and,
iv) applying at least on inverse scaling factor corresponding to the at least one scaling factor.
27. The method of claim 26 wherein the method of processing blocks of samples of digital signals of integer length M additionally comprises the step of at least one time delay.
28. The method of claim 26, wherein the rational complex coefficients in the at least one lifting step are dyadic.
29. The method of claim 26, wherein
a) said invertible transform is an approximation of a biorthogonal transform;
b) said biorthogonal transformation comprises a representation as a cascade of at least one butterfly step, at least one orthogonal transform, and at least one scaling factor;
c) said at least one orthogonal transform comprising a cascade of
i) at least one ±1 butterfly step,
ii) at least one planar rotation, and
iii) at least one scaling factor;
b) said at least one planar rotation being represented by equivalent lifting steps and scale factors; and,
c) said approximation being obtained by replacing floating point coefficients in the lifting steps with rational coefficients.
30. The method of claim 29, wherein the coefficients of the lifting steps are chosen to be dyadic rational.
31. The method of claim 26, wherein the invertible transform is a unitary transform.
32. The method of claim 26, wherein
a) said invertible transform is an approximation of a unitary transform;
b) said approximation of the unitary transform comprises a representation of the unitary transform as a cascade of at least one butterfly step, at least one orthogonal transform, and at least one scale factor;
c) said at least one orthogonal transform being represented as a cascade of
( 1 ) at least one ±1 butterfly steps,
( 2 ) at least one planar rotation, and
( 3 ) at last one scaling factor;
d) said at least one planar rotation being represented by equivalent lifting steps and scale factors; and,
e) said approximation being derived by using approximate rational values for the coefficients in the lifting steps.
33. The method of claim 32, wherein the invertible transform is an approximation of a transform selected from the group of special unitary transforms: discrete cosine transform (DCT); discrete Fourier transform (DFT); discrete sine transform (DST).
34. The method of claim 32, wherein the coefficients of the lifting steps are dyadic rational.
35. The method of claim 32, wherein at least one of the following lifting steps is used, whose matrix representations take on the form: [ 1 a 0 1 ] , [ 1 0 b 1 ] ,
where a, b are selected from the group:
±{8, 5, 4, 2, 1, 1/2, 1/4, 3/4, 5/4, 1/8, 3/8, 2/5, 5/8, 7/8, 1/16, 3/16, 5/16, 7/16, 9/16, 11/16, 13/16, 15/16, 25/16}.
36. The method of claim 35, wherein the invertible transform is an approximation of a transform selected from the group: discrete cosine transform (DCT); discrete Fourier transform (DFT); discrete sine transform (DST).
37. The method of claim 36, wherein the approximation of the 4 point DCT is selected from the group of matrices: { [ 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 1 - 1 1 - 1 ] , [ 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 1 - 2 2 - 1 ] , [ 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 5 - 2 2 - 5 ] } .
38. The method of claim 33 in which the invertible transform is an approximation of a transform selected from the group three point DCT, 4 point DCT, 8 point DCT, and 16 point DCT.
39. The method of claim 33 in which the invertible transform is an approximation of a transform selected from the group 512 point FFT, 1024 point FFT, 2048 point FFT, and 4096 point FFT.
US10/629,303 1998-12-16 2003-07-29 Fast signal transforms with lifting steps Expired - Lifetime USRE40081E1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US10/629,303 USRE40081E1 (en) 1998-12-16 2003-07-29 Fast signal transforms with lifting steps
US11/896,522 US20080075377A1 (en) 2003-07-29 2007-09-04 Fast lapped image transforms using lifting steps

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/212,210 US6421464B1 (en) 1998-12-16 1998-12-16 Fast lapped image transforms using lifting steps
US10/629,303 USRE40081E1 (en) 1998-12-16 2003-07-29 Fast signal transforms with lifting steps

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/212,210 Reissue US6421464B1 (en) 1998-12-16 1998-12-16 Fast lapped image transforms using lifting steps

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US11/896,522 Continuation US20080075377A1 (en) 2003-07-29 2007-09-04 Fast lapped image transforms using lifting steps

Publications (1)

Publication Number Publication Date
USRE40081E1 true USRE40081E1 (en) 2008-02-19

Family

ID=22790031

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/212,210 Ceased US6421464B1 (en) 1998-12-16 1998-12-16 Fast lapped image transforms using lifting steps
US10/629,303 Expired - Lifetime USRE40081E1 (en) 1998-12-16 2003-07-29 Fast signal transforms with lifting steps

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/212,210 Ceased US6421464B1 (en) 1998-12-16 1998-12-16 Fast lapped image transforms using lifting steps

Country Status (1)

Country Link
US (2) US6421464B1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050141609A1 (en) * 2001-09-18 2005-06-30 Microsoft Corporation Block transform and quantization for image and video coding
US20070081734A1 (en) * 2005-10-07 2007-04-12 Microsoft Corporation Multimedia signal processing using fixed-point approximations of linear transforms
US20070276894A1 (en) * 2003-09-29 2007-11-29 Agency For Science, Technology And Research Process And Device For Determining A Transforming Element For A Given Transformation Function, Method And Device For Transforming A Digital Signal From The Time Domain Into The Frequency Domain And Vice Versa And Computer Readable Medium
US20080198935A1 (en) * 2007-02-21 2008-08-21 Microsoft Corporation Computational complexity and precision control in transform-based digital media codec
US9609336B2 (en) 2013-04-16 2017-03-28 Fastvdo Llc Adaptive coding, transmission and efficient display of multimedia (acted)
US10834400B1 (en) 2016-08-19 2020-11-10 Fastvdo Llc Enhancements of the AV1 video codec
US10880557B2 (en) 2015-06-05 2020-12-29 Fastvdo Llc High dynamic range image/video coding

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6882688B1 (en) * 1998-12-11 2005-04-19 Matsushita Electric Industrial Co., Ltd. Deblocking filter arithmetic apparatus and deblocking filter arithmetic method
US6587588B1 (en) * 1999-03-16 2003-07-01 At&T Corp. Progressive image decoder for wavelet encoded images in compressed files and method of operation
US6771828B1 (en) * 2000-03-03 2004-08-03 Microsoft Corporation System and method for progessively transform coding digital data
US6826584B1 (en) * 2000-12-22 2004-11-30 Sony Corporation Refinement of interpolated signals
JP3450831B2 (en) * 2001-02-08 2003-09-29 株式会社東芝 Information storage device, control program thereof, and program recording medium
US8705613B2 (en) * 2003-06-26 2014-04-22 Sony Corporation Adaptive joint source channel coding
US7471726B2 (en) * 2003-07-15 2008-12-30 Microsoft Corporation Spatial-domain lapped transform in digital media compression
US20080075377A1 (en) * 2003-07-29 2008-03-27 Topiwala Pankaj N Fast lapped image transforms using lifting steps
US7369709B2 (en) 2003-09-07 2008-05-06 Microsoft Corporation Conditional lapped transform
US7724827B2 (en) * 2003-09-07 2010-05-25 Microsoft Corporation Multi-layer run level encoding and decoding
EP1538826A3 (en) 2003-12-05 2007-03-07 Samsung Electronics Co., Ltd. Color transformation method and apparatus
US8582640B2 (en) * 2003-12-16 2013-11-12 Sony Corporation Adaptive joint source channel coding
US7564874B2 (en) 2004-09-17 2009-07-21 Uni-Pixel Displays, Inc. Enhanced bandwidth data encoding method
US7471850B2 (en) * 2004-12-17 2008-12-30 Microsoft Corporation Reversible transform for lossy and lossless 2-D data compression
US7428342B2 (en) * 2004-12-17 2008-09-23 Microsoft Corporation Reversible overlap operator for efficient lossless data compression
US20060262860A1 (en) * 2005-02-23 2006-11-23 Chou Jim C Macroblock adaptive frame/field coding architecture for scalable coding
US20060288065A1 (en) * 2005-06-17 2006-12-21 Docomo Communications Laboratories Usa, Inc. Method and apparatus for lapped transform coding and decoding
US8036274B2 (en) * 2005-08-12 2011-10-11 Microsoft Corporation SIMD lapped transform-based digital media encoding/decoding
US8548265B2 (en) * 2006-01-05 2013-10-01 Fastvdo, Llc Fast multiplierless integer invertible transforms
KR100715743B1 (en) 2006-01-16 2007-05-08 한국과학기술연구원 Image processing system and method for changing size of image using liftlt transform
US8155462B2 (en) * 2006-12-29 2012-04-10 Fastvdo, Llc System of master reconstruction schemes for pyramid decomposition
US8139880B2 (en) * 2008-03-24 2012-03-20 Microsoft Corporation Lifting-based directional lapped transforms
US8369638B2 (en) 2008-05-27 2013-02-05 Microsoft Corporation Reducing DC leakage in HD photo transform
US8447591B2 (en) * 2008-05-30 2013-05-21 Microsoft Corporation Factorization of overlapping tranforms into two block transforms
US8275209B2 (en) 2008-10-10 2012-09-25 Microsoft Corporation Reduced DC gain mismatch and DC leakage in overlap transform processing
RU2583734C1 (en) * 2015-05-18 2016-05-10 Акционерное общество "Научно-исследовательский институт телевидения" Method of generating noise-immune radio signals

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5081645A (en) * 1990-08-06 1992-01-14 Aware, Inc. Novel spread spectrum codec apparatus and method
US5339265A (en) * 1992-08-31 1994-08-16 University Of Maryland At College Park Optimal unified architectures for the real-time computation of time-recursive discrete sinusoidal transforms
US5592569A (en) * 1993-05-10 1997-01-07 Competitive Technologies, Inc. Method for encoding and decoding images
US5604824A (en) * 1994-09-22 1997-02-18 Houston Advanced Research Center Method and apparatus for compression and decompression of documents and the like using splines and spline-wavelets
US5764698A (en) * 1993-12-30 1998-06-09 International Business Machines Corporation Method and apparatus for efficient compression of high quality digital audio
US5805739A (en) * 1996-04-02 1998-09-08 Picturetel Corporation Lapped orthogonal vector quantization
US5812219A (en) * 1994-11-09 1998-09-22 U.S. Philips Corporation System and method for transmitting picture or sound signals
US5857036A (en) * 1996-03-04 1999-01-05 Iterated Systems, Inc. System and method for the fractal encoding of datastreams
US5859788A (en) * 1997-08-15 1999-01-12 The Aerospace Corporation Modulated lapped transform method
US5883981A (en) * 1995-10-20 1999-03-16 Competitive Technologies Of Pa, Inc. Lattice vector transform coding method for image and video compression
US5898798A (en) * 1995-10-18 1999-04-27 U.S. Philips Corporation Region-based texture coding and decoding method and corresponding systems
US5901251A (en) * 1997-03-18 1999-05-04 Hewlett-Packard Company Arithmetic coding compressor using a context model that is adaptive to variable length patterns in bi-level image data
US5903669A (en) * 1995-01-31 1999-05-11 Canon Kabushiki Kaisha Image processing apparatus and method
US5946038A (en) * 1996-02-27 1999-08-31 U.S. Philips Corporation Method and arrangement for coding and decoding signals
US5960123A (en) * 1995-07-27 1999-09-28 Fuji Photo Film Co., Ltd. Method and apparatus for enhancing contrast in images by emphasis processing of a multiresolution frequency band
US5973755A (en) * 1997-04-04 1999-10-26 Microsoft Corporation Video encoder and decoder using bilinear motion compensation and lapped orthogonal transforms
US5995668A (en) * 1995-10-25 1999-11-30 U.S. Philips Corporation Segmented picture coding method and system, and corresponding decoding method and system
US5999656A (en) * 1997-01-17 1999-12-07 Ricoh Co., Ltd. Overlapped reversible transforms for unified lossless/lossy compression
US6018753A (en) * 1997-07-29 2000-01-25 Lucent Technologies Inc. Interpolating filter banks in arbitrary dimensions
US6094631A (en) * 1998-07-09 2000-07-25 Winbond Electronics Corp. Method of signal compression
US6104982A (en) * 1995-12-01 2000-08-15 Schlumberger Technology Corporation Compression method and apparatus for seismic data
US6144771A (en) * 1996-06-28 2000-11-07 Competitive Technologies Of Pa, Inc. Method and apparatus for encoding and decoding images
US6144773A (en) * 1996-02-27 2000-11-07 Interval Research Corporation Wavelet-based data compression
US6198412B1 (en) * 1999-01-20 2001-03-06 Lucent Technologies Inc. Method and apparatus for reduced complexity entropy coding

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5081645A (en) * 1990-08-06 1992-01-14 Aware, Inc. Novel spread spectrum codec apparatus and method
US5339265A (en) * 1992-08-31 1994-08-16 University Of Maryland At College Park Optimal unified architectures for the real-time computation of time-recursive discrete sinusoidal transforms
US5592569A (en) * 1993-05-10 1997-01-07 Competitive Technologies, Inc. Method for encoding and decoding images
US5764698A (en) * 1993-12-30 1998-06-09 International Business Machines Corporation Method and apparatus for efficient compression of high quality digital audio
US5604824A (en) * 1994-09-22 1997-02-18 Houston Advanced Research Center Method and apparatus for compression and decompression of documents and the like using splines and spline-wavelets
US5812219A (en) * 1994-11-09 1998-09-22 U.S. Philips Corporation System and method for transmitting picture or sound signals
US5903669A (en) * 1995-01-31 1999-05-11 Canon Kabushiki Kaisha Image processing apparatus and method
US5960123A (en) * 1995-07-27 1999-09-28 Fuji Photo Film Co., Ltd. Method and apparatus for enhancing contrast in images by emphasis processing of a multiresolution frequency band
US5898798A (en) * 1995-10-18 1999-04-27 U.S. Philips Corporation Region-based texture coding and decoding method and corresponding systems
US5883981A (en) * 1995-10-20 1999-03-16 Competitive Technologies Of Pa, Inc. Lattice vector transform coding method for image and video compression
US5995668A (en) * 1995-10-25 1999-11-30 U.S. Philips Corporation Segmented picture coding method and system, and corresponding decoding method and system
US6104982A (en) * 1995-12-01 2000-08-15 Schlumberger Technology Corporation Compression method and apparatus for seismic data
US6144773A (en) * 1996-02-27 2000-11-07 Interval Research Corporation Wavelet-based data compression
US5946038A (en) * 1996-02-27 1999-08-31 U.S. Philips Corporation Method and arrangement for coding and decoding signals
US5857036A (en) * 1996-03-04 1999-01-05 Iterated Systems, Inc. System and method for the fractal encoding of datastreams
US5805739A (en) * 1996-04-02 1998-09-08 Picturetel Corporation Lapped orthogonal vector quantization
US6144771A (en) * 1996-06-28 2000-11-07 Competitive Technologies Of Pa, Inc. Method and apparatus for encoding and decoding images
US5999656A (en) * 1997-01-17 1999-12-07 Ricoh Co., Ltd. Overlapped reversible transforms for unified lossless/lossy compression
US5901251A (en) * 1997-03-18 1999-05-04 Hewlett-Packard Company Arithmetic coding compressor using a context model that is adaptive to variable length patterns in bi-level image data
US5973755A (en) * 1997-04-04 1999-10-26 Microsoft Corporation Video encoder and decoder using bilinear motion compensation and lapped orthogonal transforms
US6018753A (en) * 1997-07-29 2000-01-25 Lucent Technologies Inc. Interpolating filter banks in arbitrary dimensions
US5859788A (en) * 1997-08-15 1999-01-12 The Aerospace Corporation Modulated lapped transform method
US6094631A (en) * 1998-07-09 2000-07-25 Winbond Electronics Corp. Method of signal compression
US6198412B1 (en) * 1999-01-20 2001-03-06 Lucent Technologies Inc. Method and apparatus for reduced complexity entropy coding

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
Liang et al., "ITU-Telecommunications Standardization Sector", A 16-bit architecture for H.26L treating DCT Transforms and quantization, pp. 1-12, May 29, 2001. *
Liang, et al., "ITU-Telecommunications Standardization Sector", A 16-bit architecture for H.26L treating DCT Transforms anf quantization, pp. 1-2, May 29, 2001. *
Nayebi et al., "A time domain view of filter banks and wavelets", Signals, Systems and Computers, 1991. 1991 Conference Record of the Twenty-Fifth Asimolar Conference on, 1991, pp. 736-740 vol. 2. *
Sweldens, Wim, "The Lifting Scheme: A custom design construction of biorthogonal wavelets", pp. 1-29, Nov. 1994. *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8971405B2 (en) 2001-09-18 2015-03-03 Microsoft Technology Licensing, Llc Block transform and quantization for image and video coding
US20050141609A1 (en) * 2001-09-18 2005-06-30 Microsoft Corporation Block transform and quantization for image and video coding
US7839928B2 (en) 2001-09-18 2010-11-23 Microsoft Corporation Block transform and quantization for image and video coding
US7881371B2 (en) 2001-09-18 2011-02-01 Microsoft Corporation Block transform and quantization for image and video coding
US20050180503A1 (en) * 2001-09-18 2005-08-18 Microsoft Corporation Block transform and quantization for image and video coding
US20110116543A1 (en) * 2001-09-18 2011-05-19 Microsoft Corporation Block transform and quantization for image and video coding
US20050213659A1 (en) * 2001-09-18 2005-09-29 Microsoft Corporation Block transform and quantization for image and video coding
US7773671B2 (en) 2001-09-18 2010-08-10 Microsoft Corporation Block transform and quantization for image and video coding
US20070276894A1 (en) * 2003-09-29 2007-11-29 Agency For Science, Technology And Research Process And Device For Determining A Transforming Element For A Given Transformation Function, Method And Device For Transforming A Digital Signal From The Time Domain Into The Frequency Domain And Vice Versa And Computer Readable Medium
US20070081734A1 (en) * 2005-10-07 2007-04-12 Microsoft Corporation Multimedia signal processing using fixed-point approximations of linear transforms
US7689052B2 (en) 2005-10-07 2010-03-30 Microsoft Corporation Multimedia signal processing using fixed-point approximations of linear transforms
US20080198935A1 (en) * 2007-02-21 2008-08-21 Microsoft Corporation Computational complexity and precision control in transform-based digital media codec
US8942289B2 (en) 2007-02-21 2015-01-27 Microsoft Corporation Computational complexity and precision control in transform-based digital media codec
US9609336B2 (en) 2013-04-16 2017-03-28 Fastvdo Llc Adaptive coding, transmission and efficient display of multimedia (acted)
US10880557B2 (en) 2015-06-05 2020-12-29 Fastvdo Llc High dynamic range image/video coding
US11265559B2 (en) 2015-06-05 2022-03-01 Fastvdo Llc High dynamic range image/video coding
US10834400B1 (en) 2016-08-19 2020-11-10 Fastvdo Llc Enhancements of the AV1 video codec

Also Published As

Publication number Publication date
US6421464B1 (en) 2002-07-16

Similar Documents

Publication Publication Date Title
USRE40081E1 (en) Fast signal transforms with lifting steps
Adelson et al. Orthogonal Pyramid Transforms For Image Coding.
Tran et al. Linear phase paraunitary filter bank with filters of different lengths and its application in image compression
AU2005237164B2 (en) Reversible overlap operator for efficient lossless data compression
Krupnik et al. Fractal representation of images via the discrete wavelet transform
Tran et al. A progressive transmission image coder using linear phase uniform filterbanks as block transforms
US20080075377A1 (en) Fast lapped image transforms using lifting steps
US6813387B1 (en) Tile boundary artifact removal for arbitrary wavelet filters
US4703349A (en) Method and apparatus for multi-dimensional signal processing using a Short-Space Fourier transform
US20020071610A1 (en) Systems and methods for compressing and decompressing images
Oraintara et al. A class of regular biorthogonal linear-phase filterbanks: Theory, structure, and application in image coding
US7634525B2 (en) Haar wavelet transform embedded lossless type IV discrete cosine transform
US6768817B1 (en) Fast and efficient computation of cubic-spline interpolation for data compression
Vrindavanam et al. A survey of image compression methods
Tran The LiftLT: Fast-lapped transforms via lifting steps
Tran Fast multiplierless approximation of the DCT
US7640283B2 (en) Shared Haar wavelet transform
EP1202219A1 (en) Fast lapped image transforms
Gawande et al. A review on lossy to lossless image coding
US6961472B1 (en) Method of inverse quantized signal samples of an image during image decompression
Tran Modern transform design for practical audio/image/video coding applications
Tran Linear phase perfect reconstruction filter banks: theory, structure, design, and application in image compression
Viswanath et al. Wavelet to DCT transcoding in transform domain
Sunkara Image compression using hand designed and Lifting Based Wavelet Transforms
Brislawn et al. Resolution scalability for arbitrary wavelet transforms in the JPEG 2000 standard

Legal Events

Date Code Title Description
AS Assignment

Owner name: FASTVDO, LLC, MARYLAND

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PT-IP, LLC;REEL/FRAME:019747/0027

Effective date: 20070816

FPAY Fee payment

Year of fee payment: 8

FEPP Fee payment procedure

Free format text: PETITION RELATED TO MAINTENANCE FEES FILED (ORIGINAL EVENT CODE: PMFP); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
REIN Reinstatement after maintenance fee payment confirmed
FPAY Fee payment

Year of fee payment: 12

SULP Surcharge for late payment
FEPP Fee payment procedure

Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PETITION RELATED TO MAINTENANCE FEES GRANTED (ORIGINAL EVENT CODE: PMFG); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: RPX CORPORATION, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FASTVDO LLC;REEL/FRAME:038249/0458

Effective date: 20140912

PRDP Patent reinstated due to the acceptance of a late maintenance fee

Effective date: 20080219