US20110298972A1 - System and process for image rescaling using adaptive interpolation kernel with sharpness and de-ringing control - Google Patents
System and process for image rescaling using adaptive interpolation kernel with sharpness and de-ringing control Download PDFInfo
- Publication number
- US20110298972A1 US20110298972A1 US12/802,382 US80238210A US2011298972A1 US 20110298972 A1 US20110298972 A1 US 20110298972A1 US 80238210 A US80238210 A US 80238210A US 2011298972 A1 US2011298972 A1 US 2011298972A1
- Authority
- US
- United States
- Prior art keywords
- shp
- interpolated pixel
- dev
- accordance
- generate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4007—Interpolation-based scaling, e.g. bilinear interpolation
Definitions
- the present invention generally relates to the field of digital image processing, and more particularly to a system and process for rescaling digital images for display.
- Digital images have become more popular in the field of image display because they offer clarity and less distortion during processing. Furthermore, a wider range of image processing algorithms can be applied to digital images. Interpolation is a common stage in image processing to improve the appearance of the processed image on the output imaging medium. Interpolation is often performed during rescaling or resizing of digital images.
- Rescaling or resizing of digital images includes magnification or reduction of image.
- large screen displays have a native resolution that reaches or exceeds the well-known high-definition TV (HDTV) standard.
- HDTV high-definition TV
- bilinear interpolation method interpolates an input signal using a 2-tap filter. In this method, only the two pixels immediately on either side of the location of the new pixel are used.
- the bicubic interpolation method interpolates an input signal using a 4-tap filter. In this method, two pixels on either side of the location of the new pixel are used.
- 2-tap and 4-tap filters all have degradation in the high frequency region. These filters often suffer from image quality issues, such as blurring, aliasing, and staircase edges. 8-tap interpolation, such as that performed by an 8-tap polyphase filter, improves reconstruction in the high frequency region and reduces the staircase and aliasing issues. However, 8-tap interpolation introduces ringing artifacts along the edges, and the conventional 8-tap interpolation is not flexible in sharpness control.
- a digital video rescaling system includes an image data input configured to receive input support pixels y 1 to y n and a sharpness control module configured to generate a sharpness control parameter Kshp.
- the system further includes an interpolated pixel generator configured to use an adaptive interpolation kernel to generate an interpolated pixel y s based on the input support pixels, and adjust a sharpness of the interpolated pixel y s based at least partly upon the sharpness control parameter Kshp.
- the system also includes an output module configured to output the adjusted interpolated pixel y s for display.
- a method of rescaling digital video includes receiving input support pixels y 1 to y n at an image data input, generating a sharpness control parameter Kshp at a sharpness control module, and generating an interpolated pixel y s based on the input support pixels y 1 to y n at an interpolated pixel generator.
- the method further includes adjusting a sharpness of the interpolated pixel y s based at least partly upon the sharpness control parameter Kshp at the interpolated pixel generator, and outputting the adjusted interpolated pixel y s for display.
- a digital video rescaling system includes an image data input configured to receive input support pixels y 1 to y n , and an interpolated pixel generator configured to use an adaptive interpolation kernel to generate an interpolated pixel value y s based on the input support pixels y 1 to y n .
- the system also includes a de-ringing control unit configured to modify the interpolated pixel value y s adaptively to a local image feature Kfreq to generate an output y out , and an output module configured to output the output y out for display.
- a method of rescaling digital video includes receiving support pixels y 1 to y n at an image data input, and using an adaptive interpolation kernel to generate an interpolated pixel y s based on the input support pixels y 1 to y n at an interpolated pixel generator.
- the method also includes modifying the interpolated pixel y s adaptively to a local image feature Kfreq to generate an output y out at a de-ringing control unit, and outputting the output y out for display.
- FIG. 1 illustrates a digital video rescaling system according to an embodiment of this disclosure
- FIG. 2 illustrates the generation of an interpolated pixel based on eight input support pixels according to an embodiment of the present disclosure
- FIG. 3 illustrates an interpolation kernel generated according to an embodiment of the present disclosure
- FIG. 4 illustrates an interpolation kernel driven by a sharpness control kernel according to an embodiment of the present disclosure
- FIG. 5 illustrates interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure
- FIG. 6 illustrates the frequency responses of interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure
- FIG. 7 illustrates an implementation of an adaptive 8-tap interpolation according to an embodiment of the present disclosure
- FIG. 8 illustrates an implementation of a de-ringing system according to an embodiment of the present disclosure.
- FIG. 9 illustrates a method of rescaling digital video according to an embodiment of the present disclosure.
- FIGS. 1 through 9 discussed below, and the various embodiments used to describe the principles of the present disclosure in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged system.
- the present disclosure provides an effective system and method of video image rescaling.
- the present disclosure describes the use of adaptive interpolation kernels with sharpness and de-ringing control to reduce ringing artifacts while maintaining the quality of the reconstruction in the high frequency region.
- the sharpness and ringing effect of the interpolated image are controlled using a sharpness control parameter and a de-ringing control parameter.
- a controllable interpolation kernel is used to generate the interpolated outputs, which solves the issues of aliasing and staircase edges.
- the present disclosure provides a system and method to improve the sharpness of the output image without introducing ringing artifacts that are a common issue in conventional 8-tap interpolation methods.
- controllable interpolation kernel with the following key components is provided:
- de-ringing control functionality to adjust the levels of ringing effects along the edges in the interpolated images.
- the system and method of the present disclosure can be applied to a generic video image processing system and can be used to both upscale and downscale images with controllable sharpness levels.
- FIG. 1 illustrates a digital video rescaling system 100 according to an embodiment of this disclosure.
- the rescaling system 100 includes an image data input 101 , an adaptive 8-tap interpolation unit 102 , a de-ringing control unit 103 , and a local feature analysis unit 104 .
- the final output of the system 100 is sent from an image data output module 105 .
- the image data input 101 receives a plurality of discrete sample values and sends the sample values to the adaptive 8-tap interpolation unit 102 and the local feature analysis 104 .
- the adaptive 8-tap interpolation unit 102 uses the discrete sample values received from the image data input 101 to generate an interpolated pixel with controllable sharpness value.
- the de-ringing control unit 103 receives the interpolated pixel from the adaptive 8-tap interpolation unit 102 and modifies the interpolated pixel according to the local feature that was estimated by the local feature analysis unit 104 .
- the local feature analysis unit 104 uses the discrete sample values received from the image data input 101 to estimate local features used by the de-ringing control unit 103 .
- FIG. 2 illustrates the generation of an interpolated pixel 200 based on eight input support pixels 201 - 208 according to an embodiment of the present disclosure.
- the adaptive 8-tap interpolation unit 102 uses controllable third order polynomial functions based on the eight input support pixels 201 - 208 to generate the interpolated pixel 200 .
- the interpolated pixel 200 can be calculated, for example, by Equation 1 below:
- Equation 10 The C(i,j) coefficient metrics of the above control synthesis functions can be calculated, for example, by Equation 10 below:
- coefficient matrices for example, used to generate interpolation kernel and sharpness control kernel.
- coefficient matrices A and B are defined, for example, as shown in Equations 11 and 12 below:
- matrices A and B are just one example of coefficient matrices that may be used to generate an 8-tap interpolation kernel and an 8-tap sharpness control kernel, respectively, and that any number of coefficient matrices may be used without departing from the scope or spirit of the present disclosure.
- the interpolated pixel 200 also can be calculated, for example, by Equation 13 below:
- s is the phase of the interpolation which is the distance from interpolation position to the position of the support pixel y 4 .
- the range of phase is from 0 to 1.
- the number of phases can be defined by the precision of the interpolation.
- FIG. 3 illustrates an interpolation kernel 300 generated according to an embodiment of the present disclosure.
- the interpolation kernel 300 was generated by the coefficient matrix A.
- FIG. 4 illustrates an interpolation kernel 401 driven by a sharpness control kernel 403 according to an embodiment of the present disclosure.
- an interpolation kernel 401 is driven by a sharpness control kernel 403 .
- the interpolation kernel 401 may be generated, for example, by coefficient matrix A, and the sharpness control kernel 403 may be generated, for example, by coefficient matrix B.
- the sharpness control kernel 403 is combined with the interpolation kernel 401 to generate a resulting interpolation kernel 405 having sharpness control.
- EAT in Equation 13 is the sharpness control parameter used to adjust the sharpness of the interpolated pixel.
- FIG. 5 illustrates adaptive interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure.
- FIG. 6 illustrates the frequency responses of adaptive interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure.
- the adaptive interpolation kernels are driven by varying sharpness control values, and their frequency responses vary with the sharpness control values. From the frequency responses, it can be seen that the magnitudes of the high frequency region are adjusted accordingly to the sharpness control parameter.
- FIG. 7 illustrates an implementation of an adaptive 8-tap interpolation according to an embodiment of the present disclosure.
- coefficient A and B are stored in two register arrays 701 and 703 .
- the f i (s) are then used as filter coefficients in interpolated pixel generator 711 to generate the interpolated pixel y s by an 8-tap filter.
- the process at de-ringing control unit 103 is used to modify the interpolated pixel adaptively to the local image feature, the local image feature being related to the local frequency characteristics.
- the control in the high frequency region should be less to maintain quality reconstruction in the high frequency region. In the edge or low frequency region, the control should be higher to reduce the ringing effect.
- FIG. 8 illustrates an implementation of a de-ringing process according to an embodiment of the present disclosure.
- FIG. 8 shows a local frequency analysis unit 801 , a local max/min analysis unit 802 , a comparator 803 and a de-ringing control unit 804 .
- the local frequency analysis 801 is used to calculate a feature value that is related to the local frequency.
- the local feature is estimated, for example, using Equation 22 below:
- dev1, dev2, dev3 and dev4 are defined as shown in Equations 23-26 below:
- N is a constant value used to normalize Kfreq so that Kfreq is in the range of [0,1].
- the local max/min analysis unit 802 is used to discriminate between the larger and smaller value of the support pixels y 4 and y 5 as shown in Equations 27 and 28 below:
- the outputs of the local max/min analysis unit 802 are then compared with the output of the adaptive 8-tap interpolation unit 102 (y s ) in the comparator 803 to generate the output (y m ) as shown in Equation 29 below:
- FIG. 9 illustrates a method 900 of rescaling digital video according to an embodiment of the present disclosure.
- the method 900 includes receiving input support pixels y 1 to y n (block 901 ), generating a sharpness control parameter Kshp (block 903 ), and generating an interpolated pixel y s based on the input support pixels y 1 to y n (block 905 ).
- the method 900 also includes adjusting a sharpness of the interpolated pixel y s based at least partly upon the sharpness control parameter Kshp (block 907 ).
- the method 900 further includes generating a local image feature Kfreq (block 909 ) and modifying the interpolated pixel y s adaptively to the local image feature Kfreq to generate an output y out (block 911 ).
- the method 900 also includes outputting the output y out for display (block 913 ).
Abstract
A digital video rescaling system is provided. The system includes an image data input configured to receive input support pixels y1 to yn and a sharpness control module configured to generate a sharpness control parameter Kshp. The system further includes an interpolated pixel generator configured to use an adaptive interpolation kernel to generate an interpolated pixel ys based on the input support pixels, and adjust a sharpness of the interpolated pixel ys based at least partly upon the sharpness control parameter Kshp. The system also includes a de-ringing control unit to adjust the ringing effect of the interpolated pixel based on a local image feature Kfreq, and an output module configured to output the adjusted interpolated pixel for display.
Description
- The present invention generally relates to the field of digital image processing, and more particularly to a system and process for rescaling digital images for display.
- Digital images have become more popular in the field of image display because they offer clarity and less distortion during processing. Furthermore, a wider range of image processing algorithms can be applied to digital images. Interpolation is a common stage in image processing to improve the appearance of the processed image on the output imaging medium. Interpolation is often performed during rescaling or resizing of digital images.
- Rescaling or resizing of digital images includes magnification or reduction of image. For example, large screen displays have a native resolution that reaches or exceeds the well-known high-definition TV (HDTV) standard. In order to display a low-resolution digital image on a large screen display, it is desirable to rescale the image to a full screen resolution.
- Traditionally, linear interpolation techniques such as bilinear or bicubic interpolation are used to rescale digital images. The bilinear interpolation method interpolates an input signal using a 2-tap filter. In this method, only the two pixels immediately on either side of the location of the new pixel are used. The bicubic interpolation method interpolates an input signal using a 4-tap filter. In this method, two pixels on either side of the location of the new pixel are used.
- 2-tap and 4-tap filters all have degradation in the high frequency region. These filters often suffer from image quality issues, such as blurring, aliasing, and staircase edges. 8-tap interpolation, such as that performed by an 8-tap polyphase filter, improves reconstruction in the high frequency region and reduces the staircase and aliasing issues. However, 8-tap interpolation introduces ringing artifacts along the edges, and the conventional 8-tap interpolation is not flexible in sharpness control.
- A digital video rescaling system is provided. The system includes an image data input configured to receive input support pixels y1 to yn and a sharpness control module configured to generate a sharpness control parameter Kshp. The system further includes an interpolated pixel generator configured to use an adaptive interpolation kernel to generate an interpolated pixel ys based on the input support pixels, and adjust a sharpness of the interpolated pixel ys based at least partly upon the sharpness control parameter Kshp. The system also includes an output module configured to output the adjusted interpolated pixel ys for display.
- A method of rescaling digital video is provided. The method includes receiving input support pixels y1 to yn at an image data input, generating a sharpness control parameter Kshp at a sharpness control module, and generating an interpolated pixel ys based on the input support pixels y1 to yn at an interpolated pixel generator. The method further includes adjusting a sharpness of the interpolated pixel ys based at least partly upon the sharpness control parameter Kshp at the interpolated pixel generator, and outputting the adjusted interpolated pixel ys for display.
- A digital video rescaling system is provided. The system includes an image data input configured to receive input support pixels y1 to yn, and an interpolated pixel generator configured to use an adaptive interpolation kernel to generate an interpolated pixel value ys based on the input support pixels y1 to yn. The system also includes a de-ringing control unit configured to modify the interpolated pixel value ys adaptively to a local image feature Kfreq to generate an output yout, and an output module configured to output the output yout for display.
- A method of rescaling digital video is provided. The method includes receiving support pixels y1 to yn at an image data input, and using an adaptive interpolation kernel to generate an interpolated pixel ys based on the input support pixels y1 to yn at an interpolated pixel generator. The method also includes modifying the interpolated pixel ys adaptively to a local image feature Kfreq to generate an output yout at a de-ringing control unit, and outputting the output yout for display.
- Before undertaking the DETAILED DESCRIPTION OF THE INVENTION below, it may be advantageous to set forth definitions of certain words and phrases used throughout this patent document: the terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation; the term “or,” is inclusive, meaning and/or; the phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like; and the term “controller” means any device, system or part thereof that controls at least one operation, such a device may be implemented in hardware, firmware or software, or some combination of at least two of the same. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely. Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases.
- For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts:
-
FIG. 1 illustrates a digital video rescaling system according to an embodiment of this disclosure; -
FIG. 2 illustrates the generation of an interpolated pixel based on eight input support pixels according to an embodiment of the present disclosure; -
FIG. 3 illustrates an interpolation kernel generated according to an embodiment of the present disclosure; -
FIG. 4 illustrates an interpolation kernel driven by a sharpness control kernel according to an embodiment of the present disclosure; -
FIG. 5 illustrates interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure; -
FIG. 6 illustrates the frequency responses of interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure; -
FIG. 7 illustrates an implementation of an adaptive 8-tap interpolation according to an embodiment of the present disclosure; -
FIG. 8 illustrates an implementation of a de-ringing system according to an embodiment of the present disclosure; and -
FIG. 9 illustrates a method of rescaling digital video according to an embodiment of the present disclosure. -
FIGS. 1 through 9 , discussed below, and the various embodiments used to describe the principles of the present disclosure in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged system. - The present disclosure provides an effective system and method of video image rescaling. The present disclosure describes the use of adaptive interpolation kernels with sharpness and de-ringing control to reduce ringing artifacts while maintaining the quality of the reconstruction in the high frequency region. The sharpness and ringing effect of the interpolated image are controlled using a sharpness control parameter and a de-ringing control parameter.
- In some embodiments, a controllable interpolation kernel is used to generate the interpolated outputs, which solves the issues of aliasing and staircase edges. With the adaptive sharpness and de-ringing control, the present disclosure provides a system and method to improve the sharpness of the output image without introducing ringing artifacts that are a common issue in conventional 8-tap interpolation methods.
- In particular embodiments, a controllable interpolation kernel with the following key components is provided:
- (1): an 8-tap interpolation filter to maintain the quality of the reconstruction in the high frequency region and solve aliasing and staircase problems in the interpolated images;
- (2) sharpness control functionality to generate the interpolated images with the visual qualities ranging from relative sharpness to softness; and
- (3) de-ringing control functionality to adjust the levels of ringing effects along the edges in the interpolated images.
- The system and method of the present disclosure can be applied to a generic video image processing system and can be used to both upscale and downscale images with controllable sharpness levels.
-
FIG. 1 illustrates a digitalvideo rescaling system 100 according to an embodiment of this disclosure. - As shown in
FIG. 1 , therescaling system 100 includes animage data input 101, an adaptive 8-tap interpolation unit 102, ade-ringing control unit 103, and a localfeature analysis unit 104. The final output of thesystem 100 is sent from an imagedata output module 105. Theimage data input 101 receives a plurality of discrete sample values and sends the sample values to the adaptive 8-tap interpolation unit 102 and thelocal feature analysis 104. The adaptive 8-tap interpolation unit 102 uses the discrete sample values received from theimage data input 101 to generate an interpolated pixel with controllable sharpness value. Thede-ringing control unit 103 receives the interpolated pixel from the adaptive 8-tap interpolation unit 102 and modifies the interpolated pixel according to the local feature that was estimated by the localfeature analysis unit 104. The localfeature analysis unit 104 uses the discrete sample values received from theimage data input 101 to estimate local features used by thede-ringing control unit 103. -
FIG. 2 illustrates the generation of an interpolatedpixel 200 based on eight input support pixels 201-208 according to an embodiment of the present disclosure. - As shown in
FIG. 2 in particular embodiments, the adaptive 8-tap interpolation unit 102 uses controllable third order polynomial functions based on the eight input support pixels 201-208 to generate the interpolatedpixel 200. - In one embodiment, the interpolated
pixel 200 can be calculated, for example, byEquation 1 below: -
- The eight control synthesis functions fn(s) that can be expressed, for example, by Equations 2-9 below:
-
f 1(s)=C(0,0)*s 3 +C(0,1)*s 2 +C(0,2)*s+C(0,3), [Eqn. 2], -
f 2(S)=C(1,0)*s 3 +C(1,1)*s 2 +C(1,2)*s+C(1,3), [Eqn. 3] -
f 3(S)=C(2,0)*s 3 +C(2,1)*s 2 +C(2,2)*s+C(2,3), [Eqn. 4] -
f 4(s)=C(3,0)*s 3 +C(3,1)*s 2 +C(3,2)*s+C(3,3), [Eqn. 5] -
f 5(s)=f 4(1−s), [Eqn. 6] -
f 6(s)=f 3(1−s), [Eqn. 7] -
f 7(s)=f 2(1−s), and [Eqn. 8] -
f 8(s)=f 1(1−s). [Eqn. 9] - The C(i,j) coefficient metrics of the above control synthesis functions can be calculated, for example, by
Equation 10 below: -
C(i,j)=A(i,j)+Kshp*B(i,j), [Eqn. 10] - In
Equation 10, -
- are two coefficient matrices, for example, used to generate interpolation kernel and sharpness control kernel.
- The coefficient matrices A and B are defined, for example, as shown in Equations 11 and 12 below:
-
- Of course one of ordinary skill in the art would recognize that matrices A and B are just one example of coefficient matrices that may be used to generate an 8-tap interpolation kernel and an 8-tap sharpness control kernel, respectively, and that any number of coefficient matrices may be used without departing from the scope or spirit of the present disclosure.
- Accordingly, the interpolated
pixel 200 also can be calculated, for example, by Equation 13 below: -
- where yn, n=(1 . . . 8) are the eight support pixels 201-208 from the
image data input 101. s is the phase of the interpolation which is the distance from interpolation position to the position of the support pixel y4. The range of phase is from 0 to 1. The number of phases can be defined by the precision of the interpolation. fn(s,Kshp) (n=1 . . . 8) are eight control synthesis functions that can be expressed, for example, by Equations 14-21 below: -
f 1(s,Kshp)=(a(0,0)+Kshp*b(0,0))*s 3+(a(0,1)+Kshp*b(0,1))*s 2+(a(0,2)+Kshp*b(0,2)*s+(a(0,3)+Kshp*b(0,3)) [Eqn. 14] -
f 2(s,Kshp)=(a(1,0)+Kshp*b(1,0))*s 3+(a(1,1)+Kshp*b(1,1))*s 2+(a(1,2)+Kshp*b(1,2)*s+(a(0,3)+Kshp*b(1,3)) [Eqn. 15] -
f 3(s,Kshp)=(a(2,0)+Kshp*b(2,0))*s 3+(a(2,1)+Kshp*b(2,1))*s 2+(a(2,2)+Kshp*b(2,2)*s+(a(2,3)+Kshp*b(2,3)) [Eqn. 16] -
f 4(s,Kshp)=(a(3,0)+Kshp*b(3,0))*s 3+(a(3,1)+Kshp*b(3,1))*s 2+(a(3,2)+Kshp*b(3,2)*s+(a(3,3)+Kshp*b(3,3)) [Eqn. 17] -
f 5(s,Kshp)=f 4((1−s),Kshp), [Eqn. 18] -
f 6(s,Kshp)=f 3((1−s),Kshp), [Eqn. 19] -
f 7(s,Kshp)=f 2((1−s),Kshp), and [Eqn. 20] -
f 8(s,Kshp)=((1−s),Kshp). [Eqn. 21] -
FIG. 3 illustrates aninterpolation kernel 300 generated according to an embodiment of the present disclosure. - In this particular embodiment, the
interpolation kernel 300 was generated by the coefficient matrix A. -
FIG. 4 illustrates aninterpolation kernel 401 driven by asharpness control kernel 403 according to an embodiment of the present disclosure. - As shown in
FIG. 4 , aninterpolation kernel 401 is driven by asharpness control kernel 403. Theinterpolation kernel 401 may be generated, for example, by coefficient matrix A, and thesharpness control kernel 403 may be generated, for example, by coefficient matrix B. Thesharpness control kernel 403 is combined with theinterpolation kernel 401 to generate a resultinginterpolation kernel 405 having sharpness control. In a particular embodiment, EAT in Equation 13 is the sharpness control parameter used to adjust the sharpness of the interpolated pixel. -
FIG. 5 illustrates adaptive interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure. -
FIG. 6 illustrates the frequency responses of adaptive interpolation kernels having varying sharpness control values according to an embodiment of the present disclosure. - As shown in
FIGS. 5 and 6 , the adaptive interpolation kernels are driven by varying sharpness control values, and their frequency responses vary with the sharpness control values. From the frequency responses, it can be seen that the magnitudes of the high frequency region are adjusted accordingly to the sharpness control parameter. -
FIG. 7 illustrates an implementation of an adaptive 8-tap interpolation according to an embodiment of the present disclosure. - In this embodiment, coefficient A and B are stored in two
register arrays calculation unit 705, for example, by C=A+Kshp*B. Kshp is provided by a sharpness control module 707. The coefficient C is passed tosynthesis function unit 709 to generate the synthesis functions fi(s) (i=1 . . . 8). The fi(s) are then used as filter coefficients in interpolatedpixel generator 711 to generate the interpolated pixel ys by an 8-tap filter. - As shown in
FIG. 1 , the process atde-ringing control unit 103 is used to modify the interpolated pixel adaptively to the local image feature, the local image feature being related to the local frequency characteristics. In particular embodiments, the control in the high frequency region should be less to maintain quality reconstruction in the high frequency region. In the edge or low frequency region, the control should be higher to reduce the ringing effect. -
FIG. 8 illustrates an implementation of a de-ringing process according to an embodiment of the present disclosure. -
FIG. 8 shows a localfrequency analysis unit 801, a local max/min analysis unit 802, acomparator 803 and ade-ringing control unit 804. Thelocal frequency analysis 801 is used to calculate a feature value that is related to the local frequency. In some embodiments, the local feature is estimated, for example, using Equation 22 below: -
Kfreq=min(dev1,dev2,dev3,dev4)/N, [Eqn. 22] - where dev1, dev2, dev3 and dev4 are defined as shown in Equations 23-26 below:
-
dev1=max(|y 1−2*y 2 +y 3 |,|y 2−2*y 3 +y 4|), [Eqn. 23] -
dev2=max(|y 3−2*y 4 +y 5 |,|y 4−2*y 5 +y 6|) [Eqn. 24] -
dev3=max(|y 5−2*y 6 +y 7 |,|y 6−2*y 7 +y 8|), and [Eqn. 25] -
dev4=min(|y 2 −y 4 |,|y 3 −y 5|). [Eqn. 26] - N is a constant value used to normalize Kfreq so that Kfreq is in the range of [0,1]. Of course one of ordinary skill in the art would recognize that this is just one way of determining the local feature and that other means of determining the local feature may be utilized without departing from the scope or spirit of the present disclosure.
- The local max/
min analysis unit 802 is used to discriminate between the larger and smaller value of the support pixels y4 and y5 as shown in Equations 27 and 28 below: -
Lmax=max(y 4 y 5), and [Eqn. 27] -
Lmin=min(y 4 ,y 5). [Eqn. 28] - The outputs of the local max/
min analysis unit 802 are then compared with the output of the adaptive 8-tap interpolation unit 102 (ys) in thecomparator 803 to generate the output (ym) as shown in Equation 29 below: -
- The outputs ys and ym are then subtracted and multiplied by the local image feature Kfreq in the
de-ringing control unit 804 to generate the final output yout as shown inEquation 30 below: -
y out =Kfreq*(y s −y m)+y m [Eqn. 30] -
FIG. 9 illustrates amethod 900 of rescaling digital video according to an embodiment of the present disclosure. - As shown in
FIG. 9 , themethod 900 includes receiving input support pixels y1 to yn (block 901), generating a sharpness control parameter Kshp (block 903), and generating an interpolated pixel ys based on the input support pixels y1 to yn (block 905). Themethod 900 also includes adjusting a sharpness of the interpolated pixel ys based at least partly upon the sharpness control parameter Kshp (block 907). Themethod 900 further includes generating a local image feature Kfreq (block 909) and modifying the interpolated pixel ys adaptively to the local image feature Kfreq to generate an output yout (block 911). Themethod 900 also includes outputting the output yout for display (block 913). - Although the present disclosure has been described with an exemplary embodiment, various changes and modifications may be suggested to one skilled in the art. It is intended that the present disclosure encompass such changes and modifications as fall within the scope of the appended claims.
Claims (20)
1. A digital video rescaling system comprising:
an image data input configured to receive input support pixels y1 to yn;
a sharpness control module configured to generate a sharpness control parameter Kshp;
an interpolated pixel generator configured to use an 8-tap filter to
generate an interpolated pixel ys based on the input support pixels, and
adjust a sharpness of the interpolated pixel ys based at least partly upon the sharpness control parameter Kshp; and
an output module configured to output the adjusted interpolated pixel ys for display.
2. A system in accordance with claim 1 wherein the interpolated pixel generator is configured to generate the interpolated pixel ys using third order polynomial functions based at least partly upon eight input support pixels y1 to y8.
3. A system in accordance with claim 1 wherein the interpolated pixel ys is generated as follows:
where yn, n=(1 . . . 8) are eight support pixels. S is the phase of the interpolation which is the distance from interpolation position to the position of the support pixel y4. fn(s,Kshp) (n=1 . . . 8) are eight control synthesis functions that can be expressed as follows:
f 1(s,Kshp)=(a(0,0)+Kshp*b(0,0))*s 3+(a(0,1)+Kshp*b(0,1))*s 2+(a(0,2)+Kshp*b(0,2)*s+(a(0,3)+Kshp*b(0,3))
f 2(s,Kshp)=(a(1,0)+Kshp*b(1,0))*s 3+(a(1,1)+Kshp*b(1,1))*s 2+(a(1,2)+Kshp*b(1,2)*s+(a(0,3)+Kshp*b(1,3))
f 3(s,Kshp)=(a(2,0)+Kshp*b(2,0))*s 3+(a(2,1)+Kshp*b(2,1))*s 2+(a(2,2)+Kshp*b(2,2)*s+(a(2,3)+Kshp*b(2,3))
f 4(s,Kshp)=(a(3,0)+Kshp*b(3,0))*s 3+(a(3,1)+Kshp*b(3,1))*s2+(a(3,2)+Kshp*b(3,2)*s+(a(3,3)+Kshp*b(3,3))
f 5(s,Kshp)=f 4((1−s),Kshp),
f 6(s,Kshp)=f 3((1−s),Kshp),
f 7(s,Kshp)=f 2((1−s),Kshp), and
f 8(s,Kshp)=f 1((1−s),Kshp).
f 1(s,Kshp)=(a(0,0)+Kshp*b(0,0))*s 3+(a(0,1)+Kshp*b(0,1))*s 2+(a(0,2)+Kshp*b(0,2)*s+(a(0,3)+Kshp*b(0,3))
f 2(s,Kshp)=(a(1,0)+Kshp*b(1,0))*s 3+(a(1,1)+Kshp*b(1,1))*s 2+(a(1,2)+Kshp*b(1,2)*s+(a(0,3)+Kshp*b(1,3))
f 3(s,Kshp)=(a(2,0)+Kshp*b(2,0))*s 3+(a(2,1)+Kshp*b(2,1))*s 2+(a(2,2)+Kshp*b(2,2)*s+(a(2,3)+Kshp*b(2,3))
f 4(s,Kshp)=(a(3,0)+Kshp*b(3,0))*s 3+(a(3,1)+Kshp*b(3,1))*s2+(a(3,2)+Kshp*b(3,2)*s+(a(3,3)+Kshp*b(3,3))
f 5(s,Kshp)=f 4((1−s),Kshp),
f 6(s,Kshp)=f 3((1−s),Kshp),
f 7(s,Kshp)=f 2((1−s),Kshp), and
f 8(s,Kshp)=f 1((1−s),Kshp).
are two coefficient matrices.
4. A system in accordance with claim 3 wherein the coefficient matrices A and B are defined as follows:
5. A method of rescaling digital video, the method comprising:
receiving input support pixels y1 to yn at an image data input;
generating a sharpness control parameter Kshp at a sharpness control module;
generating an interpolated pixel ys based on the input support pixels y1 to yn at an 8-tap filter;
adjusting a sharpness of the interpolated pixel ys based at least partly upon the sharpness control parameter Kshp at the interpolated pixel generator; and
outputting the adjusted interpolated pixel ys for display.
6. A method in accordance with claim 5 wherein generating the interpolated pixel ys comprises using third order polynomial functions based at least partly upon eight input support pixels y1 to y8.
7. A method in accordance with claim 5 wherein generating the interpolated pixel ys comprises using the following relationship:
where yn, n=(1 . . . 8) are eight support pixels. S is the phase of the interpolation which is the distance from interpolation position to the position of the support pixel y4. fn(s,Kshp) (n=1 . . . 8) are eight control synthesis functions that can be expressed as follows:
f 1(s,Kshp)=(a(0,0)+Kshp*b(0,0))*s 3(a(0,1)+Kshp*b(0,1))*s 2+(a(0,2)+Kshp*b(0,2)*s+(a(0,3)+Kshp*b(0,3))
f 2(s,Kshp)=(a(1,0)+Kshp*b(1,0))*s 3+(a(1,1)+Kshp*b(1,1))*s 2+(a(1,2)+Kshp*b(1,2)*s+(a(0,3)+Kshp*b(1,3))
f 3(s,Kshp)=(a(2,0)+Kshp*b(2,0))*s 3+(a(2,1)+Kshp*b(2,1))*s 2+(a(2,2)+Kshp*b(2,2)*s+(a(2,3)+Kshp*b(2,3))
f a(s,Kshp)=(a(3,0)+Kshp*b(3,0))*s 3+(a(3,1)+Kshp*b(3,1))*s 2+(a(3,2)+Kshp*b(3,2)*s+(a(3,3)+Kshp*b(3,3))
f 5(s,Kshp)=f 4((1−s),Kshp),
f 6(s,Kshp)=f 3((1−s),Kshp),
f 7(s,Kshp)=f 2((1−s),Kshp), and
f 8(s,Kshp)=f 1((1−s),Kshp).
f 1(s,Kshp)=(a(0,0)+Kshp*b(0,0))*s 3(a(0,1)+Kshp*b(0,1))*s 2+(a(0,2)+Kshp*b(0,2)*s+(a(0,3)+Kshp*b(0,3))
f 2(s,Kshp)=(a(1,0)+Kshp*b(1,0))*s 3+(a(1,1)+Kshp*b(1,1))*s 2+(a(1,2)+Kshp*b(1,2)*s+(a(0,3)+Kshp*b(1,3))
f 3(s,Kshp)=(a(2,0)+Kshp*b(2,0))*s 3+(a(2,1)+Kshp*b(2,1))*s 2+(a(2,2)+Kshp*b(2,2)*s+(a(2,3)+Kshp*b(2,3))
f a(s,Kshp)=(a(3,0)+Kshp*b(3,0))*s 3+(a(3,1)+Kshp*b(3,1))*s 2+(a(3,2)+Kshp*b(3,2)*s+(a(3,3)+Kshp*b(3,3))
f 5(s,Kshp)=f 4((1−s),Kshp),
f 6(s,Kshp)=f 3((1−s),Kshp),
f 7(s,Kshp)=f 2((1−s),Kshp), and
f 8(s,Kshp)=f 1((1−s),Kshp).
are two coefficient matrices.
8. A method in accordance with claim 7 wherein the coefficient matrices A and B are defined as follows:
9. A digital video rescaling system comprising:
an image data input configured to receive input support pixels y1 to yn;
an interpolated pixel generator configured to use an 8-tap filter to generate an interpolated pixel value ys based on the input support pixels y1 to yn;
a de-ringing control unit configured to modify the interpolated pixel ys adaptively to a local image feature Kfreq to generate an output yout; and
an output module configured to output the output yout for display.
10. A system in accordance with claim 9 wherein the local image feature Kfreq is related to local frequency characteristics.
11. A system in accordance with claim 9 further comprising:
a local frequency analysis unit configured to calculate the local image feature Kfreq;
a local max/min analysis unit configured to distinguish between a larger and a smaller value of two support pixels ya and yb and generate an output Lmax and Lmin; and
a comparator configured to compare the interpolated pixel value ys with the output Lmax and Lmin and generate a comparison result ym.
12. A system in accordance with claim 11 further wherein the comparator is configured to generate the comparison result ym as follows:
13. A system in accordance with claim 11 further wherein the de-ringing control unit is further configured to:
subtract the comparison result ym from the interpolated pixel value ys;
multiply the difference by the local image feature Kfreq; and
add the product to comparison result ym to generate gout.
14. A system in accordance with claim 9 wherein the local frequency analysis unit is configured to calculate the local image feature Kfreq as follows:
Kfreq=min(dev1,dev2,dev3,dev4)/N,
Kfreq=min(dev1,dev2,dev3,dev4)/N,
where dev1, dev2, dev3 and dev4 are defined as follows:
dev1=max(|y 1−2*y 2 +y 3 |,|y 2−2*y 3 +y 4|),
dev2=max(|y 3−2*y 4 +y 5 |,|y 4−2*y 5 +y 6|),
dev3=max(|y 5−2*y 6 +y 7 |,|y 6−2*y 7 +y 8|), and
dev4=min(|y 2 −y 4 |,|y 3 −y 5|),
dev1=max(|y 1−2*y 2 +y 3 |,|y 2−2*y 3 +y 4|),
dev2=max(|y 3−2*y 4 +y 5 |,|y 4−2*y 5 +y 6|),
dev3=max(|y 5−2*y 6 +y 7 |,|y 6−2*y 7 +y 8|), and
dev4=min(|y 2 −y 4 |,|y 3 −y 5|),
where N is a constant value used to normalize Kfreq so that Kfreq is in the range of [0,1].
15. A method of rescaling digital video, the method comprising:
receiving support pixels y1 to yn at an image data input;
using an 8-tap filter to generate an interpolated pixel ys based on the input support pixels y1 to yn at an interpolated pixel generator;
modifying the interpolated pixel ys adaptively to a local image feature Kfreq to generate an output yout at a de-ringing control unit; and
outputting the output yout for display.
16. A method in accordance with claim 15 wherein the local image feature Kfreq is related to local frequency characteristics.
17. A method in accordance with claim 15 further comprising:
distinguishing between a larger and a smaller value of two support pixels ya and yb and generating an output Lmax and Lmin at a local max/min analysis unit; and
comparing the interpolated pixel value ys with the output Lmax and Lmin and generating a comparison result ym at a comparator.
18. A method in accordance with claim 17 further wherein the comparison result ym is generated as follows:
19. A method in accordance with 17 further comprising:
subtracting the comparison result ym from the interpolated pixel value ys;
multiplying the difference by the local image feature Kfreg; and
adding the product to comparison result ym to generate yout at the de-ringing control unit.
20. A method in accordance with claim 15 wherein calculating the local image feature Kfreq comprises using the following relationship:
Kfreq=min(dev1,dev2,dev3,dev4)/N,
Kfreq=min(dev1,dev2,dev3,dev4)/N,
where dev1, dev2, dev3 and dev4 are defined as follows:
dev1=max(|y 1−2*y 2 +y 3 |,|y 2−2*y 3 +y 4|),
dev2=max(|y 3−2*y 4 +y 5 |,|y 4−2*y 5 +y 6|),
dev3=max(|y 5−2*y 6 +y 7 |,|y 6−2*y 7 +y 8|), and
dev4=min(|y 2 −y 4 |,|y 3 −y 5|),
dev1=max(|y 1−2*y 2 +y 3 |,|y 2−2*y 3 +y 4|),
dev2=max(|y 3−2*y 4 +y 5 |,|y 4−2*y 5 +y 6|),
dev3=max(|y 5−2*y 6 +y 7 |,|y 6−2*y 7 +y 8|), and
dev4=min(|y 2 −y 4 |,|y 3 −y 5|),
where N is a constant value used to normalize Kfreq so that Kfreq is in the range of [0,1].
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/802,382 US20110298972A1 (en) | 2010-06-04 | 2010-06-04 | System and process for image rescaling using adaptive interpolation kernel with sharpness and de-ringing control |
US14/466,274 US9390469B2 (en) | 2010-06-04 | 2014-08-22 | System and process for image rescaling using adaptive interpolation kernal with sharpness and de-ringing control |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/802,382 US20110298972A1 (en) | 2010-06-04 | 2010-06-04 | System and process for image rescaling using adaptive interpolation kernel with sharpness and de-ringing control |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/466,274 Continuation US9390469B2 (en) | 2010-06-04 | 2014-08-22 | System and process for image rescaling using adaptive interpolation kernal with sharpness and de-ringing control |
Publications (1)
Publication Number | Publication Date |
---|---|
US20110298972A1 true US20110298972A1 (en) | 2011-12-08 |
Family
ID=45064198
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/802,382 Abandoned US20110298972A1 (en) | 2010-06-04 | 2010-06-04 | System and process for image rescaling using adaptive interpolation kernel with sharpness and de-ringing control |
US14/466,274 Active 2030-07-24 US9390469B2 (en) | 2010-06-04 | 2014-08-22 | System and process for image rescaling using adaptive interpolation kernal with sharpness and de-ringing control |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/466,274 Active 2030-07-24 US9390469B2 (en) | 2010-06-04 | 2014-08-22 | System and process for image rescaling using adaptive interpolation kernal with sharpness and de-ringing control |
Country Status (1)
Country | Link |
---|---|
US (2) | US20110298972A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8682111B2 (en) | 2012-06-05 | 2014-03-25 | STMicroelectronics Asia Pacific Pte, Ltd | 2D ringing and overshoot control in image rescaling |
EP2795917A4 (en) * | 2011-12-22 | 2015-09-16 | Silicon Image Inc | Ringing suppression in video scalers |
US9659348B1 (en) * | 2014-05-12 | 2017-05-23 | Marvell International Ltd. | Methods and systems for high definition scaling with low hardware complexity |
CN109688412A (en) * | 2017-10-19 | 2019-04-26 | 上海富瀚微电子股份有限公司 | A kind of effective method, encoder and coding method for inhibiting coded ringing effect |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10417740B2 (en) * | 2014-09-26 | 2019-09-17 | Lachlan BARRATT | Image processing |
CN105808834B (en) * | 2016-03-04 | 2018-07-24 | 北京师范大学 | One kind carrying out processing and visualization method based on kernel-driven model to data of multiple angles |
Citations (47)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5008752A (en) * | 1989-06-16 | 1991-04-16 | Eastman Kodak Company | Digital image interpolator with multiple interpolation algorithms |
US5054100A (en) * | 1989-11-16 | 1991-10-01 | Eastman Kodak Company | Pixel interpolator with edge sharpening |
JPH04157988A (en) * | 1990-10-22 | 1992-05-29 | Matsushita Electric Ind Co Ltd | Horizontal line interpolating circuit and image pickup device |
US5268758A (en) * | 1990-09-26 | 1993-12-07 | Matsushita Electric Industrial Co., Ltd. | Horizontal line interpolation circuit and image pickup apparatus including it |
US5294998A (en) * | 1990-12-31 | 1994-03-15 | E. I. Du Pont De Nemours And Company | Method for designing and applying a Kaiser window filter for enlarging or reducing an image |
US5327257A (en) * | 1992-02-26 | 1994-07-05 | Cymbolic Sciences International Ltd. | Method and apparatus for adaptively interpolating a digital image |
US5418714A (en) * | 1993-04-08 | 1995-05-23 | Eyesys Laboratories, Inc. | Method and apparatus for variable block size interpolative coding of images |
US5422827A (en) * | 1993-02-12 | 1995-06-06 | Cirrus Logic, Inc. | Integrated video scaling and sharpening filter |
US5768482A (en) * | 1995-06-14 | 1998-06-16 | Hewlett-Packard Company | Resolution-triggered sharpening for scaling of a digital-matrix image |
US5774601A (en) * | 1994-11-23 | 1998-06-30 | Imation Corp. | System and method for adaptive interpolation of image data |
US5838371A (en) * | 1993-03-05 | 1998-11-17 | Canon Kabushiki Kaisha | Image pickup apparatus with interpolation and edge enhancement of pickup signal varying with zoom magnification |
US5949924A (en) * | 1995-10-06 | 1999-09-07 | Ricoh Company, Ltd. | Image processing apparatus, method and computer program product |
US6195394B1 (en) * | 1998-11-30 | 2001-02-27 | North Shore Laboratories, Inc. | Processing apparatus for use in reducing visible artifacts in the display of statistically compressed and then decompressed digital motion pictures |
US6198545B1 (en) * | 1994-03-30 | 2001-03-06 | Victor Ostromoukhov | Method and apparatus for generating halftone images by evolutionary screen dot contours |
US6233277B1 (en) * | 1999-04-02 | 2001-05-15 | Sony Corporation | Reduced-memory video decoder for compressed high-definition video data |
US20020012464A1 (en) * | 2000-06-12 | 2002-01-31 | Samsung Electronics Co., Ltd. | Two-dimensional non-linear interpolation system based on edge information and two-dimensional mixing interpolation system using the same |
US20020030762A1 (en) * | 1996-11-22 | 2002-03-14 | Sony Corporation | Video processing apparatus for processing pixel for generating high-picture-quality image, method thereof, and video printer to which they are applied |
US6373535B1 (en) * | 1999-08-21 | 2002-04-16 | Samsun Electronics Co., Ltd. | Apparatus and method for adjusting convergence utilizing spine interpolation |
US20030001867A1 (en) * | 2001-06-25 | 2003-01-02 | Atsushi Matsumoto | Image processing apparatus and its processing method |
US20030231714A1 (en) * | 2002-03-29 | 2003-12-18 | Kjeldsen Erik H. | System and method for orthogonally multiplexed signal transmission and reception |
US20040091174A1 (en) * | 2003-10-30 | 2004-05-13 | Samsung Electronics Co., Ltd. | Method and apparatus for image interpolation based on adaptive polyphase filters |
US20040207758A1 (en) * | 2002-12-25 | 2004-10-21 | Hitachi, Ltd. | Video signal processing apparatus |
US6810155B1 (en) * | 1999-01-08 | 2004-10-26 | Macronix International Co., Ltd. | Method and apparatus for scaling an image with locally selected interpolation functions |
US20040234165A1 (en) * | 2003-05-24 | 2004-11-25 | Samsung Electronics Co., Ltd. | Image interpolation apparatus and method |
US6928196B1 (en) * | 1999-10-29 | 2005-08-09 | Canon Kabushiki Kaisha | Method for kernel selection for image interpolation |
US20050226538A1 (en) * | 2002-06-03 | 2005-10-13 | Riccardo Di Federico | Video scaling |
US20060018562A1 (en) * | 2004-01-16 | 2006-01-26 | Ruggiero Carl J | Video image processing with parallel processing |
US20060022984A1 (en) * | 2004-01-16 | 2006-02-02 | Ruggiero Carl J | Video image processing with utility processing stage |
US20060033936A1 (en) * | 2004-08-12 | 2006-02-16 | Samsung Electronics Co., Ltd. | Resolution-converting apparatus and method |
US20060061690A1 (en) * | 2002-05-24 | 2006-03-23 | Gerard De Haan | Unit for and method of sharpness enchancement |
US20060133693A1 (en) * | 2004-12-16 | 2006-06-22 | Hunt Neil Edmund J | System and method for image transformation |
US20060146935A1 (en) * | 2005-01-05 | 2006-07-06 | Lsi Logic Corporation | Method and apparatus for sub-pixel motion compensation |
US20060153473A1 (en) * | 2005-01-13 | 2006-07-13 | Ruggiero Carl J | Video processing system and method with dynamic tag architecture |
US20060269166A1 (en) * | 2005-05-31 | 2006-11-30 | Sheng Zhong | System and method for implementing graphics and video scaling algorithm using interpolation based on symmetrical polyphase filtering |
US7151863B1 (en) * | 1999-10-29 | 2006-12-19 | Canon Kabushiki Kaisha | Color clamping |
US7197194B1 (en) * | 2001-05-14 | 2007-03-27 | Lsi Logic Corporation | Video horizontal and vertical variable scaling filter |
US20070081743A1 (en) * | 2005-10-08 | 2007-04-12 | Samsung Electronics Co., Ltd. | Image interpolation apparatus and method thereof |
US7224371B2 (en) * | 2003-12-26 | 2007-05-29 | Sanyo Electric Co., Ltd. | Picture signal processor, picture signal processing method, and picture signal processing program product |
US7321400B1 (en) * | 2005-02-22 | 2008-01-22 | Kolorific, Inc. | Method and apparatus for adaptive image data interpolation |
US7379626B2 (en) * | 2004-08-20 | 2008-05-27 | Silicon Optix Inc. | Edge adaptive image expansion and enhancement system and method |
US7437018B1 (en) * | 2003-09-26 | 2008-10-14 | Adobe Systems Incorporated | Image resampling using variable quantization bins |
US20090027559A1 (en) * | 2007-07-23 | 2009-01-29 | Nec Electronics Corporation | Video signal processing apparatus performing gamma correction by cubic interpolation computation, and method thereof |
US20090262247A1 (en) * | 2008-03-20 | 2009-10-22 | Stmicroelectronics Asia Pacific Pte., Ltd. | System and process for image rescaling with edge adaptive phase control in interpolation process |
US20100165204A1 (en) * | 2008-12-31 | 2010-07-01 | Stmicroelectronics Asia Pacific Pte. Ltd. | System and process for image rescaling using adaptive interpolation kernel with sharpness and overshoot control |
US7782401B1 (en) * | 2006-06-20 | 2010-08-24 | Kolorific, Inc. | Method and system for digital image scaling with sharpness enhancement and transient improvement |
US20100272376A1 (en) * | 2009-04-24 | 2010-10-28 | Silicon Integrated Systems Corp. | Image processing system having scaling and sharpness device and method thereof |
US8249395B2 (en) * | 2010-03-05 | 2012-08-21 | Intel Corporation | System, method, and computer program product for picture resizing |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4866647A (en) | 1988-02-04 | 1989-09-12 | American Telephone And Telegraph Company | Continuously variable digital delay circuit |
JPH0556306A (en) * | 1991-08-26 | 1993-03-05 | Mitsubishi Electric Corp | Adaptive ringing controller |
JP2002535896A (en) * | 1999-01-15 | 2002-10-22 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Method and apparatus for improving sharpness |
KR100519776B1 (en) * | 2003-11-24 | 2005-10-07 | 삼성전자주식회사 | Method and apparatus for converting resolution of video signal |
US7545391B2 (en) * | 2004-07-30 | 2009-06-09 | Algolith Inc. | Content adaptive resizer |
US7620261B2 (en) * | 2004-11-23 | 2009-11-17 | Stmicroelectronics Asia Pacific Pte. Ltd. | Edge adaptive filtering system for reducing artifacts and method |
US9131164B2 (en) * | 2006-04-04 | 2015-09-08 | Qualcomm Incorporated | Preprocessor method and apparatus |
US8346021B2 (en) * | 2009-05-05 | 2013-01-01 | Analog Devices, Inc. | Content adaptive scaler based on a farrow structure |
-
2010
- 2010-06-04 US US12/802,382 patent/US20110298972A1/en not_active Abandoned
-
2014
- 2014-08-22 US US14/466,274 patent/US9390469B2/en active Active
Patent Citations (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5008752A (en) * | 1989-06-16 | 1991-04-16 | Eastman Kodak Company | Digital image interpolator with multiple interpolation algorithms |
US5054100A (en) * | 1989-11-16 | 1991-10-01 | Eastman Kodak Company | Pixel interpolator with edge sharpening |
US5268758A (en) * | 1990-09-26 | 1993-12-07 | Matsushita Electric Industrial Co., Ltd. | Horizontal line interpolation circuit and image pickup apparatus including it |
JPH04157988A (en) * | 1990-10-22 | 1992-05-29 | Matsushita Electric Ind Co Ltd | Horizontal line interpolating circuit and image pickup device |
US5294998A (en) * | 1990-12-31 | 1994-03-15 | E. I. Du Pont De Nemours And Company | Method for designing and applying a Kaiser window filter for enlarging or reducing an image |
US5327257A (en) * | 1992-02-26 | 1994-07-05 | Cymbolic Sciences International Ltd. | Method and apparatus for adaptively interpolating a digital image |
US5422827A (en) * | 1993-02-12 | 1995-06-06 | Cirrus Logic, Inc. | Integrated video scaling and sharpening filter |
US5838371A (en) * | 1993-03-05 | 1998-11-17 | Canon Kabushiki Kaisha | Image pickup apparatus with interpolation and edge enhancement of pickup signal varying with zoom magnification |
US5418714A (en) * | 1993-04-08 | 1995-05-23 | Eyesys Laboratories, Inc. | Method and apparatus for variable block size interpolative coding of images |
US6198545B1 (en) * | 1994-03-30 | 2001-03-06 | Victor Ostromoukhov | Method and apparatus for generating halftone images by evolutionary screen dot contours |
US5774601A (en) * | 1994-11-23 | 1998-06-30 | Imation Corp. | System and method for adaptive interpolation of image data |
US5768482A (en) * | 1995-06-14 | 1998-06-16 | Hewlett-Packard Company | Resolution-triggered sharpening for scaling of a digital-matrix image |
US5949924A (en) * | 1995-10-06 | 1999-09-07 | Ricoh Company, Ltd. | Image processing apparatus, method and computer program product |
US20020030762A1 (en) * | 1996-11-22 | 2002-03-14 | Sony Corporation | Video processing apparatus for processing pixel for generating high-picture-quality image, method thereof, and video printer to which they are applied |
US6195394B1 (en) * | 1998-11-30 | 2001-02-27 | North Shore Laboratories, Inc. | Processing apparatus for use in reducing visible artifacts in the display of statistically compressed and then decompressed digital motion pictures |
US6810155B1 (en) * | 1999-01-08 | 2004-10-26 | Macronix International Co., Ltd. | Method and apparatus for scaling an image with locally selected interpolation functions |
US6233277B1 (en) * | 1999-04-02 | 2001-05-15 | Sony Corporation | Reduced-memory video decoder for compressed high-definition video data |
US6373535B1 (en) * | 1999-08-21 | 2002-04-16 | Samsun Electronics Co., Ltd. | Apparatus and method for adjusting convergence utilizing spine interpolation |
US6928196B1 (en) * | 1999-10-29 | 2005-08-09 | Canon Kabushiki Kaisha | Method for kernel selection for image interpolation |
US7151863B1 (en) * | 1999-10-29 | 2006-12-19 | Canon Kabushiki Kaisha | Color clamping |
US20020012464A1 (en) * | 2000-06-12 | 2002-01-31 | Samsung Electronics Co., Ltd. | Two-dimensional non-linear interpolation system based on edge information and two-dimensional mixing interpolation system using the same |
US7197194B1 (en) * | 2001-05-14 | 2007-03-27 | Lsi Logic Corporation | Video horizontal and vertical variable scaling filter |
US20030001867A1 (en) * | 2001-06-25 | 2003-01-02 | Atsushi Matsumoto | Image processing apparatus and its processing method |
US20030231714A1 (en) * | 2002-03-29 | 2003-12-18 | Kjeldsen Erik H. | System and method for orthogonally multiplexed signal transmission and reception |
US20060061690A1 (en) * | 2002-05-24 | 2006-03-23 | Gerard De Haan | Unit for and method of sharpness enchancement |
US20050226538A1 (en) * | 2002-06-03 | 2005-10-13 | Riccardo Di Federico | Video scaling |
US20040207758A1 (en) * | 2002-12-25 | 2004-10-21 | Hitachi, Ltd. | Video signal processing apparatus |
US20040234165A1 (en) * | 2003-05-24 | 2004-11-25 | Samsung Electronics Co., Ltd. | Image interpolation apparatus and method |
US7437018B1 (en) * | 2003-09-26 | 2008-10-14 | Adobe Systems Incorporated | Image resampling using variable quantization bins |
US7391933B2 (en) * | 2003-10-30 | 2008-06-24 | Samsung Electronics Co., Ltd. | Method and apparatus for image interpolation based on adaptive polyphase filters |
US20040091174A1 (en) * | 2003-10-30 | 2004-05-13 | Samsung Electronics Co., Ltd. | Method and apparatus for image interpolation based on adaptive polyphase filters |
US7224371B2 (en) * | 2003-12-26 | 2007-05-29 | Sanyo Electric Co., Ltd. | Picture signal processor, picture signal processing method, and picture signal processing program product |
US20060018562A1 (en) * | 2004-01-16 | 2006-01-26 | Ruggiero Carl J | Video image processing with parallel processing |
US20060022984A1 (en) * | 2004-01-16 | 2006-02-02 | Ruggiero Carl J | Video image processing with utility processing stage |
US20060033936A1 (en) * | 2004-08-12 | 2006-02-16 | Samsung Electronics Co., Ltd. | Resolution-converting apparatus and method |
US7379626B2 (en) * | 2004-08-20 | 2008-05-27 | Silicon Optix Inc. | Edge adaptive image expansion and enhancement system and method |
US20060133693A1 (en) * | 2004-12-16 | 2006-06-22 | Hunt Neil Edmund J | System and method for image transformation |
US20060146935A1 (en) * | 2005-01-05 | 2006-07-06 | Lsi Logic Corporation | Method and apparatus for sub-pixel motion compensation |
US20060153473A1 (en) * | 2005-01-13 | 2006-07-13 | Ruggiero Carl J | Video processing system and method with dynamic tag architecture |
US7321400B1 (en) * | 2005-02-22 | 2008-01-22 | Kolorific, Inc. | Method and apparatus for adaptive image data interpolation |
US20060269166A1 (en) * | 2005-05-31 | 2006-11-30 | Sheng Zhong | System and method for implementing graphics and video scaling algorithm using interpolation based on symmetrical polyphase filtering |
US20070081743A1 (en) * | 2005-10-08 | 2007-04-12 | Samsung Electronics Co., Ltd. | Image interpolation apparatus and method thereof |
US7782401B1 (en) * | 2006-06-20 | 2010-08-24 | Kolorific, Inc. | Method and system for digital image scaling with sharpness enhancement and transient improvement |
US20090027559A1 (en) * | 2007-07-23 | 2009-01-29 | Nec Electronics Corporation | Video signal processing apparatus performing gamma correction by cubic interpolation computation, and method thereof |
US8248493B2 (en) * | 2007-07-23 | 2012-08-21 | Renesas Electronics Corporation | Video signal processing apparatus performing gamma correction by cubic interpolation computation, and method thereof |
US20090262247A1 (en) * | 2008-03-20 | 2009-10-22 | Stmicroelectronics Asia Pacific Pte., Ltd. | System and process for image rescaling with edge adaptive phase control in interpolation process |
US20100165204A1 (en) * | 2008-12-31 | 2010-07-01 | Stmicroelectronics Asia Pacific Pte. Ltd. | System and process for image rescaling using adaptive interpolation kernel with sharpness and overshoot control |
US20100272376A1 (en) * | 2009-04-24 | 2010-10-28 | Silicon Integrated Systems Corp. | Image processing system having scaling and sharpness device and method thereof |
US8249395B2 (en) * | 2010-03-05 | 2012-08-21 | Intel Corporation | System, method, and computer program product for picture resizing |
Non-Patent Citations (1)
Title |
---|
"An arbitrary ratio resizer for MPEG applications," Renxiang Li ; Levi, S., IEEE Transactions on Consumer Electronics, Volume: 46 , Issue: 3, Publication Year: 2000 , Page(s): 467 - 473. * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2795917A4 (en) * | 2011-12-22 | 2015-09-16 | Silicon Image Inc | Ringing suppression in video scalers |
US8682111B2 (en) | 2012-06-05 | 2014-03-25 | STMicroelectronics Asia Pacific Pte, Ltd | 2D ringing and overshoot control in image rescaling |
US9659348B1 (en) * | 2014-05-12 | 2017-05-23 | Marvell International Ltd. | Methods and systems for high definition scaling with low hardware complexity |
CN109688412A (en) * | 2017-10-19 | 2019-04-26 | 上海富瀚微电子股份有限公司 | A kind of effective method, encoder and coding method for inhibiting coded ringing effect |
Also Published As
Publication number | Publication date |
---|---|
US20140362288A1 (en) | 2014-12-11 |
US9390469B2 (en) | 2016-07-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9390469B2 (en) | System and process for image rescaling using adaptive interpolation kernal with sharpness and de-ringing control | |
US7782401B1 (en) | Method and system for digital image scaling with sharpness enhancement and transient improvement | |
US7477323B2 (en) | Method and system for digital image magnification and reduction | |
US7876979B2 (en) | Resolution-converting apparatus and method | |
US7411628B2 (en) | Method and system for scaling, filtering, scan conversion, panoramic scaling, YC adjustment, and color conversion in a display controller | |
KR100519776B1 (en) | Method and apparatus for converting resolution of video signal | |
JP4558806B2 (en) | Visual processing device, visual processing method, program, display device, and integrated circuit | |
JP3003561B2 (en) | Gradation conversion method and circuit, image display method and apparatus, and image signal conversion apparatus | |
US7881550B2 (en) | Visual processing apparatus, visual processing method, program, recording medium, display device, and integrated circuit | |
US20100322536A1 (en) | Image enlargement apparatus, method, integrated circuit, and program | |
US20090092337A1 (en) | Image processing apparatus, image processing method, and computer program | |
US8300987B2 (en) | Apparatus and method for generating a detail-enhanced upscaled image | |
JP4498361B2 (en) | How to speed up Retinex-type algorithms | |
US8587726B2 (en) | System and process for image rescaling using adaptive interpolation kernel with sharpness and overshoot control | |
US7408590B2 (en) | Combined scaling, filtering, and scan conversion | |
US8897569B2 (en) | Image enlargement device, image enlargement program, memory medium on which an image enlargement program is stored, and display device | |
US8265419B2 (en) | Image processing apparatus and image processing method | |
US20080309817A1 (en) | Combined scaling, filtering, and scan conversion | |
US9600858B1 (en) | Visually comfortable content-adaptive dithering for super-resolution | |
WO2013151163A1 (en) | Image processing device, image display device, image processing method, computer program, and recording medium | |
US20120147051A1 (en) | Image enlargement device, image enlargement program and display apparatus | |
JP2008211840A (en) | Image processing apparatus | |
JP2000004379A (en) | Method and device for image display | |
JP5603414B2 (en) | Content Adaptive Scaler Based on Fallow Structure | |
JPH11341307A (en) | Image display method and device thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: STMICROELECTRONICS ASIA PACIFIC PTE., LTD., SINGAP Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HUANG, YONG;REEL/FRAME:024549/0960 Effective date: 20100602 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |