US6532262B1 - Coding method and apparatus and recorder - Google Patents
Coding method and apparatus and recorder Download PDFInfo
- Publication number
- US6532262B1 US6532262B1 US09/357,887 US35788799A US6532262B1 US 6532262 B1 US6532262 B1 US 6532262B1 US 35788799 A US35788799 A US 35788799A US 6532262 B1 US6532262 B1 US 6532262B1
- Authority
- US
- United States
- Prior art keywords
- quantization parameter
- scene change
- coding
- scene
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/87—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/142—Detection of scene cut or scene change
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/179—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scene or a shot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the present invention relates to technology of coding a signal such as a video or audio signal and technology of recording coded data on a storage medium.
- transform coding is usually employed.
- an image is divided into a plurality of blocks, each composed of a multiplicity of pixels neighboring each other, and an orthogonal transform, like discrete cosine transform, is performed on each of these blocks.
- a transform coefficient is quantized based on a predetermined quantization unit (quantization parameter), and then compression-coded by a variable-length encoding technique such as Huffman coding.
- inter-frame coding is performed by utilizing a correlation between frames.
- an image at a frame to be coded is predicted using, as a reference frame, another frame preceding or succeeding the frame in question on the time axis, and a prediction error thereof is coded and transmitted or recorded.
- the inter-frame coding is performed on the basis of a block composed of a plurality of pixels. And the motion quantity of each block is also transmitted or recorded along with the prediction error.
- FIG. 22 illustrates a coding technique according to the MPEG-2 (Moving Picture Experts Group) standard, which is an international standard of moving picture coding.
- MPEG-2 Motion Picture Experts Group
- intra-frame coding, inter-frame forward predictive coding and inter-frame bidirectional coding are performed.
- a frame, on which intra-frame coding is performed is called an “I-frame”.
- a frame, on which inter-frame forward predictive coding is performed is called a “P-frame”.
- a frame, on which inter-frame bidirectional coding is performed is called a “B-frame”.
- a GOP group of pictures
- at least one of the frames is intra-frame-coded.
- variable-length encoding is employed, and therefore, the number of bits generated cannot be recognized accurately until the coding processing is over.
- feedback control is performed such that a cumulative error, which is an accumulation of errors between numbers of bits generated and target numbers of bits, becomes zero and that an average coding rate during a predetermined interval can be approximated at a target coding rate.
- variable-rate coding technique for coding a video at a coding rate variable with the complexity of coding an individual scene thereof is lately applied to a DVD (digital video disc) and so on.
- a coding rate is increased for a scene with a high complexity of coding, thereby reducing coding noise.
- the coding rate is decreased, thereby balancing the overall image quality of the video and reducing an average bit rate.
- Variable-rate coding is implementable most easily by fixing a quantization parameter for quantization processing. If the quantization parameter is fixed, then the resolution of quantization is also fixed, but the coding rate for a scene with a high complexity of coding gets higher than a scene with a low complexity of coding. Accordingly, the coding rate becomes variable.
- FIG. 23 is a block diagram illustrating a configuration for a conventional coder for controlling an average rate by a feedback control technique.
- an input video signal is quantized by a quantizer 701 using a quantization parameter Q, which has been determined by a rate-controlling-parameter determiner 704 .
- the output of the quantizer 701 is variable-length encoded by a variable-length encoder 702 and then output as coded data.
- a bit number calculator 703 calculates a number of bits B of the coded data generated per unit time t.
- a cumulative error calculator 712 accumulates the errors d, thereby obtaining a cumulative error D.
- a quantization parameter determiner 713 controls the quantization parameter Q such that the cumulative error D becomes zero.
- the quantization parameter Q is increased to reduce the number of bits generated B. Conversely, if the cumulative error D is negative, then the quantization parameter Q is decreased to increase the number of bits generated B.
- the quantization parameter Q may be given by the following equation:
- variable-rate coding can be performed during the interval T. This is because if the time constant T is large enough, the quantization parameter Q hardly varies and is converged at a substantially constant value. As a result, a coding rate increases for a scene with a relatively high complexity of coding, but decreases for a scene with a relatively low complexity of coding. That is to say, coding processing can be performed at a rate variable with the complexity of coding an individual video scene.
- the conventional coding processing with average rate control has the following drawbacks.
- coding noise generated in a scene with a low complexity of coding e.g., a substantially uniform picture with almost no motion such as “blue sky”
- a scene with a high complexity of coding e.g., a complicated picture with a lot of motion such as “crowd”.
- the human vision is more sensitive to coding noise generated in a scene with a low complexity of coding than that of a scene with a high complexity of coding.
- the quantization parameter is controlled at a larger value.
- the average coding rate can be controlled at a value closer to the target coding rate, deterioration in image quality might surpass the advantageous effects attained by the rate control.
- the feedback control might cause oscillation in quantization parameter or number of bits generated, and the image quality might considerably change in such a case.
- optimum number of bits and quantization parameter may be determined for an individual scene by estimating the complexity of coding a signal in advance. In such a case, however, since an additional time is needed to estimate the complexity of coding, it is difficult to perform coding processing in real time.
- An object of the present invention is to reproduce a signal of quality at a low coding rate even when a signal continuously supplied should be coded in real time.
- a method according to the present invention is adapted to code a signal, representing a video or being accompanied with a video, by quantization processing.
- the method includes the steps of: detecting a scene change in the video; if the scene change has been detected, determining a quantization parameter adaptively to a scene newly appearing after the scenes have been changed; or unless the scene change is detected, determining the quantization parameter at such a value as to stabilize a coding rate; and performing the quantization processing using the quantization parameter determined.
- the quantization parameter is controlled at such a value as to stabilize a coding rate within the same scene.
- the quantization parameter is determined adaptively to the newly appearing scene.
- the quantization parameter is preferably determined based on an assigned coefficient, corresponding to a complexity of coding the signal, and a number of bits generated and calculated during a predetermined interval after the scene change.
- the assigned coefficient is preferably obtained based on an average of quantization parameters during a predetermined interval before the scene change is detected and an average of numbers of bits generated during the predetermined interval.
- an accumulation of errors, each representing a difference between a number of bits generated and a target number of bits, is preferably obtained, and the quantization parameter is preferably determined by a feedback control using the accumulation.
- a characteristic of the feedback control is preferably modified based on the errors.
- the average rate can be controlled based on the complexity of coding an individual scene. Accordingly, it is possible to prevent the image quality of a scene with a low complexity of coding, in particular, from being deteriorated. In addition, the oscillation of the number of bits generated and quantization parameter can be suppressed during the feedback control.
- a time passed since coding processing was started is preferably clocked, and the characteristic of the feedback control is preferably modified based on the passed time clocked.
- the range of the variable coding rate may be broadened by performing the feedback control gently at the beginning of coding.
- the coding processing can be performed at a rate better suited to the individual scene.
- the feedback control is gradually enhanced along with the progress of coding processing, the average coding rate gets closer to the target coding rate, and the resulting error can be smaller when the coding processing is finished.
- a distortion sensitivity of the newly appearing video after the scene change is preferably detected, and the quantization parameter is preferably determined based on the distortion sensitivity detected.
- the quantization parameter is decreased for a scene with a high distortion sensitivity and increased for a scene with a low distortion sensitivity, then the number of bits generated can be suppressed while making the overall image quality more uniform. As a result, a signal of quality can be reproduced at a low coding rate.
- a distortion sensitivity of the video after the scene change is preferably detected.
- a first quantization parameter is preferably determined based on the distortion sensitivity detected.
- a number of bits generated is preferably calculated during a predetermined interval after the scene change, and a second quantization parameter is preferably determined based on the number of bits generated and calculated.
- the coding method preferably further includes the step of estimating a storable capacity of a storage medium while recording coded data on the storage medium.
- the quantization parameter is preferably determined considering the storable capacity estimated as well.
- Another method according to the present invention is adapted to code a signal by quantization processing.
- the method includes the steps of: determining a quantization parameter based on an assigned coefficient, corresponding to a complexity of coding the signal, and a number of bits generated; and performing the quantization processing using the quantization parameter determined.
- the assigned coefficient is obtained based on an average of quantization parameters during a predetermined interval and an average of numbers of bits generated during the interval.
- Still another method according to the present invention is adapted to code a signal by quantization processing.
- the method includes the steps of: obtaining an accumulation of errors, each representing a difference between a number of bits generated and a target number of bits; determining a quantization parameter by a feedback control using the accumulation; and performing the quantization processing using the quantization parameter determined.
- a characteristic of the feedback control is modified based on the errors.
- Still another method is adapted to code a signal by quantization processing.
- the method includes the steps of: obtaining an accumulation of errors, each representing a difference between a number of bits generated and a target number of bits; determining a quantization parameter by a feedback control using the accumulation; and performing the quantization processing using the quantization parameter determined.
- a time passed since coding processing was started is clocked, and a characteristic of the feedback control is modified based on the passed time clocked.
- Still another method according to the present invention is adapted to code a video signal by quantization processing.
- the method includes the steps of: detecting a distortion sensitivity of a video; determining a quantization parameter based on the distortion sensitivity detected; and performing the quantization processing using the quantization parameter determined.
- a coder is adapted to code a signal representing a video or being accompanied with a video.
- the coder includes: a quantizer for quantizing the signal; an encoder for encoding the output of the quantizer and outputting coded data; means for supplying a quantization parameter to the quantizer; and means for detecting a scene change in the video. If the detecting means has detected the scene change, the supplying means supplies a quantization parameter, which has been determined adaptively to a scene newly appearing after the scene change, to the quantizer. Unless the detecting means detects the scene change, the supplying means supplies a quantization parameter, which has been determined at such a value as to stabilize a coding rate, to the quantizer.
- the quantization parameter supplying means supplies a quantization parameter at such a value as to stabilize a coding rate to the quantizer within the same scene.
- the quantization parameter which has been determined adaptively to the newly appearing scene, is supplied to the quantizer.
- the coder preferably further includes a bit number calculator for calculating a number of bits of the coded data.
- the supplying means preferably determines the quantization parameter based on an assigned coefficient, corresponding to a complexity of coding the signal, and the number of bits calculated by the calculator during a predetermined interval after the scene change.
- the supplying means preferably obtains the assigned coefficient based on an average of quantization parameters during a predetermined interval before the scene change is detected and an average of numbers of bits generated during the predetermined interval.
- the supplying means preferably obtains an accumulation of errors, each representing a difference between a number of bits generated and a target number of bits, and preferably determines the quantization parameter by a feedback control using the accumulation.
- the supplying means preferably modifies a characteristic of the feedback control based on the errors.
- the supplying means preferably clocks a time passed since coding processing was started, and preferably modifies the characteristic of the feedback control based on the passed time clocked.
- the supplying means when the detecting means detects the scene change, the supplying means preferably detects a distortion sensitivity of the video after the scene change, and preferably determines the quantization parameter based on the distortion sensitivity detected.
- the coder preferably further includes a bit number calculator for calculating a number of bits of the coded data.
- the detecting means detects the scene change
- the supplying means preferably detects a distortion sensitivity of the video after the scene change, and preferably determines a first quantization parameter based on the distortion sensitivity detected.
- the detecting means preferably determines a second quantization parameter based on the number of bits calculated by the bit number calculator.
- a recorder is adapted to record a signal, representing a video or being accompanied with a video, on a storage medium.
- the recorder includes the coder of the present invention, and records the coded data, which has been output from the coder, on the storage medium.
- coded data obtained by controlling the average coding rate and performing the coding processing adaptively to the individual scenes at the same time, is recorded on the storage medium.
- a signal of good quality can be reproduced at an even lower coding rate.
- the recorder preferably further includes means for estimating a storable capacity of the storage medium.
- the means for supplying a quantization parameter of the coder preferably determines the quantization parameter considering the storable capacity estimated by the estimating means as well.
- the quantization parameter for coding processing is determined based on the storable capacity of the storage medium. Accordingly, it is possible to record a signal on a storage medium with a limited storable capacity.
- Another coder for coding a signal includes: a quantizer for quantizing the signal; an encoder for encoding the output of the quantizer and outputting coded data; a bit number calculator for calculating the number of bits of the coded data; and means for supplying a quantization parameter to the quantizer.
- the supplying means determines the quantization parameter based on an assigned coefficient, corresponding to a complexity of coding the signal, and the number of bits calculated by the bit number calculator, and obtains the assigned coefficient based on an average of quantization parameters during a predetermined interval and an average of numbers of bits generated during the interval.
- Still another coder for coding a signal includes: a quantizer for quantizing the signal; an encoder for encoding the output of the quantizer and outputting coded data; a bit number calculator for calculating the number of bits of the coded data; and means for supplying a quantization parameter to the quantizer.
- the supplying means obtains an accumulation of errors, each representing a difference between a number of bits calculated by the bit number calculator and a target number of bits, determines the quantization parameter by a feedback control using the accumulation, and modifies a characteristic of the feedback control based on the errors.
- Still another coder for coding a signal includes: a quantizer for quantizing the signal; an encoder for encoding the output of the quantizer and outputting coded data; a bit number calculator for calculating the number of bits of the coded data; and means for supplying a quantization parameter to the quantizer.
- the supplying means obtains an accumulation of errors, each representing a difference between a number of bits calculated by the bit number calculator and a target number of bits, determines the quantization parameter by a feedback control using the accumulation, clocks a time passed since coding processing was started, and modifies a characteristic of the feedback control based on the passed time clocked.
- a video signal coder includes: a quantizer for quantizing the video signal; an encoder for encoding the output of the quantizer and outputting coded data; and means for supplying a quantization parameter to the quantizer.
- the supplying means detects a distortion sensitivity of a video, and determines the quantization parameter based on the distortion sensitivity detected.
- FIG. 1 is a block diagram illustrating a configuration for a coder according to a first embodiment of the present invention.
- FIGS. 2A and 2B illustrate the operation of selecting a quantization parameter in the coder shown in FIG. 1 :
- FIG. 2A illustrates a variation in complexity of coding respective frames
- FIG. 2B illustrates respective quantization parameters selected.
- FIG. 3 is a block diagram illustrating an exemplary configuration for a scene parameter determiner.
- FIG. 4 is a block diagram illustrating an exemplary configuration for a rate-controlling-parameter determiner.
- FIG. 5 is a block diagram illustrating another exemplary configuration for the rate-controlling-parameter determiner.
- FIG. 6 illustrates how the time constant changes with time during a feedback control performed by the rate-controlling-parameter determiner shown in FIG. 5 .
- FIG. 7 illustrates how an inter-frame difference is estimated to detect a scene change.
- FIG. 8A illustrates how the inter-frame difference changes with time in an image signal
- FIG. 8B illustrates how the variation in inter-frame difference changes with time.
- FIG. 9 is a block diagram illustrating a first exemplary configuration for a scene change detector.
- FIG. 10 is a block diagram illustrating a second exemplary configuration for the scene change detector.
- FIG. 11 is a block diagram illustrating a third exemplary configuration for the scene change detector.
- FIG. 12 is a block diagram illustrating a configuration for a coder according to a second embodiment of the present invention.
- FIG. 13 is a block diagram illustrating a configuration for a coder according to a third embodiment of the present invention.
- FIG. 14 is a block diagram illustrating an exemplary configuration for a distortion sensitivity estimator.
- FIG. 15 is a block diagram illustrating another exemplary configuration for the distortion sensitivity estimator.
- FIG. 16 is a block diagram illustrating still another exemplary configuration for the distortion sensitivity estimator.
- FIG. 17 is a block diagram illustrating a configuration for a coder according to a fourth embodiment of the present invention.
- FIG. 18 illustrates the operation of selecting a quantization parameter in the coder shown in FIG. 17 .
- FIG. 19 illustrates the operation of selecting a quantization parameter in the coder shown in FIG. 17 .
- FIG. 20 is a block diagram illustrating a configuration for a coder according to a fifth embodiment of the present invention.
- FIG. 21 is a block diagram illustrating a configuration for a recorder including a coder according to any of the embodiments of the present invention.
- FIG. 22 illustrates respective frames appearing one after another with the passage of time according to the MPEG2 standard.
- FIG. 23 is a block diagram illustrating a configuration for a conventional coder.
- any signal other than a video signal e.g., an audio signal accompanied with a video, can also be processed similarly.
- FIG. 1 is a block diagram illustrating a configuration for a coder according to a first embodiment of the present invention.
- the coder includes: a quantizer 101 ; a variable-length encoder 102 ; a bit number calculator 103 ; a scene parameter determiner 110 for determining a quantization parameter; a rate-controlling-parameter determiner 111 ; a memory 112 ; a selector 113 ; and a scene change detector 114 .
- the scene parameter determiner 110 , rate-controlling-parameter determiner 111 , memory 112 and selector 113 together constitute quantization parameter supplying means 10 as defined in the appended claims.
- An input video signal Sv is quantized by the quantizer 101 using a quantization parameter Q, which is the output of the selector 113 , variable-length encoded by the variable-length encoder 102 and then output as coded data Sc.
- the bit number calculator 103 calculates and outputs a number of bits B of the coded data generated during a predetermined interval.
- the memory 112 stores thereon quantization parameters Q and outputs a quantization parameter Q, which was defined a predetermined time ahead, as a first quantization parameter Q 1 to the selector 113 .
- the scene parameter determiner 110 outputs a second quantization parameter Q 2 , which has been defined based on the complexities of coding individual scenes of the input video signal Sv that have been determined based on the scene information characterizing these scenes.
- the rate-controlling-parameter determiner 111 outputs a third quantization parameter Q 3 , which has been determined such that an average coding rate during the predetermined interval comes closer to a target coding rate.
- the scene parameter determiner 110 determines the second quantization parameter Q 2 depending on the complexity of coding by using the number of bits B of the coded data Sc generated during the predetermined interval as the scene information of the video signal Sv. For example, if the complexity is high, then the determiner 110 determines the quantization parameter Q 2 at such a value as increasing the coding rate.
- the quantization parameter Q 2 may be determined considering the target coding rate in addition to the complexity. For example, if the target coding rate is low, then the determiner 110 corrects the quantization parameter Q 2 in such a manner as not to increase the coding rate too much even though the complexity is high. In this manner, it is possible to prevent the coding rate from being greatly deviated from the target coding rate.
- the scene change detector 114 detects a scene change by calculating a variation between the frames of the input video signal Sv.
- the selector 113 is controlled responsive to the output of the scene change detector 114 . And the selector 113 selectively outputs, as the quantization parameter Q, any of the first, second and third quantization parameters Q 1 , Q 2 and Q 3 , which are the outputs of the memory 112 , scene parameter determiner 110 and rate-controlling-parameter determiner 11 , respectively.
- the selector 113 usually selects the output Q 1 of the memory 112 , but occasionally selects the output Q 3 of the rate-controlling-parameter determiner 111 at regular intervals. This is done to suppress deterioration in image quality by minimizing the variation in quantization parameter Q. For example, supposing intra-frame coding and inter-frame coding are performed alternately and periodically during the same coding processing, the output Q 3 of the rate-controlling-parameter determiner 111 may be selected during the intervals in which the intra-frame coding is performed.
- the selector 113 selects the second quantization parameter Q 2 , which is the output of the scene Parameter determiner 110 .
- FIGS. 2A and 2B illustrate the operation of the selector 113 : FIG. 2A illustrates a variation in complexity of coding respective frames; and FIG. 2B illustrates respective quantization parameters Q selected.
- scenes are supposed to be changed within a second group of pictures GOP 2 and a newly appearing scene is supposed to have a high complexity of coding.
- the selector 113 selects the output Q 2 of the scene parameter determiner 110 at the first frame appearing after the scenes have been changed. Since the newly appearing scene is more difficult to code, the scene parameter determiner 110 determines the second quantization parameter Q 2 in such a manner as to increase the coding rate. In general, to increase a coding rate of the same scene, the quantization parameter needs to be decreased. In a scene that is more difficult to code than other scenes, however, even if the quantization parameter is increased, a sufficiently high coding rate still can be attained. Accordingly, after the scenes have been changed, the second quantization parameter Q 2 is set larger than the previous one as shown in FIG. 2 B.
- the second quantization parameter Q 2 which is selected at the first frame appearing after the scene change, is stored on the memory 112 .
- the selector 113 selectively outputs the quantization parameter Q 2 that was stored on the memory 112 as Q 1 .
- the second quantization parameter Q 2 that was stored on the memory 112 at the time of scene change is output as the quantization parameter Q.
- the output Q of the selector 113 is stored again in the memory 112 . Accordingly, in the GOP 2 coming up next to the scene change, the quantization parameter Q 2 , which was determined by the scene parameter determiner 110 at the time of scene change, is continuously used for quantization processing.
- the selector 113 selects the output Q 3 of the rate-controlling-parameter determiner 111 .
- the second quantization parameter Q 2 is selected to increase the coding rate, since a scene with a higher complexity of coding newly appears at the time of scene change.
- the rate-controlling-parameter determiner 111 determines the third quantization parameter Q 3 at a value larger than the previous one.
- the third quantization parameter Q 3 is stored on the memory 112 .
- the selector 113 selectively outputs the quantization parameter Q 3 that was stored on the memory 112 as Q 1 .
- the third quantization parameter Q 3 that was stored on the memory 112 at the first frame of the GOP 3 is output as the quantization parameter Q.
- the output of the selector 113 is stored again in the memory 112 . Accordingly, the quantization parameter Q 3 , which was determined by the rate-controlling-parameter determiner 111 at the first frame of the GOP 3 , is continuously used for quantization processing in the GOP 3 .
- the output Q 3 of the rate-controlling-parameter determiner 111 is supposed to be selected every GOP.
- the output Q 3 may be selected every predetermined number of frames.
- the average coding rate is controlled to come as close to the target coding rate as possible within the same scene, and if scenes have been changed, an appropriate quantization parameter, which is best suited to the complexity of coding the newly appearing scene, is selected.
- coding processing can be performed adaptively to the individual scenes, while controlling an average coding rate at the same time.
- the coder shown in FIG. 1 is supposed to perform the quantization processing using the quantization parameter Q 1 , which was stored on the memory 112 a predetermined time ago.
- the selector 113 may always select the output Q 3 of the rate-controlling-parameter determiner 111 within the same scene, and select the output Q 2 of the scene parameter determiner 110 after the scenes have been changed.
- the scene parameter determiner 110 includes an assigned coefficient calculator 121 and a quantization parameter determiner 122 .
- the assigned coefficient calculator 121 outputs an assigned coefficient a in accordance with a predetermined target coding rate.
- the quantization parameter determiner 122 outputs the second quantization parameter Q 2 best suited to an individual scene responsive to the quantization parameter Q 1 stored on the memory 112 a predetermined time ago and output therefrom, the number of bits generated B and the assigned coefficient a output from the assigned coefficient calculator 121 .
- bit assignment can be performed in an optimized manner based on the relationship between the number of bits generated and the quantization parameter. Coding noise increases proportionally to the quantization parameter. Accordingly, to minimize the coding noise over the entire image, the sum of quantization parameters should be minimized. Then, the bits can be assigned in an optimized manner.
- the number of bits generated b and the quantization parameter q substantially meet the following relationship:
- X is a value called “complexity”, representing how difficult to code a given image is, and is equal to the product of the number of bits generated b and the quantization parameter q.
- An individual image is associated with a unique complexity X. For example, two images meet the following equations.
- the inclination a of the line corresponds to the assigned coefficient derived by the assigned coefficient calculator 121 .
- the assigned coefficient a is determined depending on the average coding rate of the overall image and the type of each image (i.e., the complexity of coding). Accordingly, to obtain the assigned coefficient a precisely, the complexities of coding individual scenes included in the video signal to be coded should be estimated. However, the assigned coefficient a may be defined at a statistically approximated value for an ordinary video signal to be presented for a long time. In the following example, the assigned coefficient calculator 121 is supposed to calculate the assigned coefficient a based on only the target coding rate.
- the quantization parameter determiner 122 obtains an intersection between the curve representing the following relationship between the quantization parameter Q 1 that has been output from the memory 112 and the number of bits generated B that has been calculated by the bit number calculator 103
- the assigned coefficient a may also be obtained based on the quantization parameter Q 1 and the number of bits generated B.
- FIG. 3 illustrates another exemplary configuration for the scene parameter determiner.
- the scene parameter determiner 110 A obtains the assigned coefficient a based on the quantization parameter Q 1 and the number of bits generated B.
- the memory 112 stores thereon the quantization parameters, and outputs the quantization parameter Q 1 that was stored thereon a predetermined time ago (e.g., one GOP ahead).
- An average quantization parameter calculator 131 calculates and outputs an average QA of quantization parameters during a predetermined interval T.
- An average bit number calculator 132 calculates and outputs an average number of bits generated BA during the predetermined interval T.
- the interval T may be one minute, for example.
- An assigned coefficient calculator 133 calculates the assigned coefficient a based on the average quantization parameter QA and the average number of bits BA in the following manner.
- the assigned coefficient calculator 133 obtains the assigned coefficient a by
- the assigned coefficient a may be calculated using a target number of bits BT corresponding to a target coding rate as well.
- the product of an average quantization parameter QA and an average number of bits BA is obtained as an average complexity XA during the interval T. That is to say,
- a quantization parameter QT which is associated with an average number of bits BA equal to the target number of bits BT, can be obtained based on the average complexity XA
- the target number of bits BT, quantization parameter QT and assigned coefficient a have the following relationship
- the actual coding rate can be even closer to the target coding rate.
- a quantization parameter determiner 134 receives the assigned coefficient a, the quantization parameter Q 1 that was stored a predetermined time ago, and the number of bits B that was calculated a predetermined time ago. Based on these values, the determiner 134 calculates and outputs the second quantization parameter Q 2 as the quantization parameter determiner 121 shown in FIG. 1 does. By utilizing such a configuration, a quantization parameter Q 2 can be obtained adaptively to an individual scene.
- the rate-controlling-parameter determiner 111 may have a similar configuration to that of the conventional rate-controlling-parameter determiner 704 shown in FIG. 23 .
- the quantization parameter Q 3 is fed back and controlled such that the cumulative error D becomes zero.
- FIG. 4 illustrates another exemplary configuration for the rate-controlling-parameter determiner.
- the configuration shown in FIG. 4 is different from the conventional configuration shown in FIG. 23 in that a quantization parameter determiner 143 uses not only the cumulative error D but also an error d in determining the quantization parameter Q 3 .
- a cumulative error calculator 142 accumulates the errors d and outputs the cumulative error D.
- a quantization parameter determiner 143 determines the quantization parameter Q 3 based on the error d and the cumulative error D.
- the quantization parameter is fed back and controlled in accordance with the cumulative error D such that the quantization parameter increases proportionally to the cumulative error D.
- the coding rate is ordinarily smaller than a target coding rate. If the cumulative error D is large, then the quantization parameter is controlled to further increase such that the coding rate further decreases.
- the quantization parameter is increased for an image with a low complexity of coding, then image quality deteriorates more seriously than an image with a high complexity of coding, although the decrease in coding rate of the former image is smaller than that of the latter.
- the characteristic of the feedback control of the quantization parameter Q 3 based on the cumulative error D is modified depending on the magnitude of the error d obtained by the error calculator 141 .
- the average rate can be controlled in accordance with individual scenes.
- the quantization parameter may be determined using the cumulative error D as a feedback quantity as in the conventional method.
- a number of bits can be controlled at a value best adapted to the scene.
- oscillation may be caused in the number of bits generated and the quantization parameter.
- the configuration shown in FIG. 4 can also suppress the oscillation of these values.
- the feedback quantity is supposed to be changed in accordance with the magnitude of the error.
- any other method of regulating the feedback control characteristic with the cumulative error may be used instead.
- a time constant may also be changed for that purpose.
- FIG. 5 illustrates another exemplary configuration for the rate-controlling-parameter determiner.
- the configuration shown in FIG. 5 is different from the conventional configuration shown in FIG. 23 in that a quantization parameter determiner 154 uses not only the cumulative error D but also a coding time t in determining the quantization parameter Q 3 .
- a cumulative error calculator 152 accumulates the errors d and outputs the cumulative error D.
- a coding time clock 153 clocks and outputs a passed time t, during which the input video signal has been coded.
- a quantization parameter determiner 154 determines the quantization parameter Q 3 based on the passed time t and the cumulative error D.
- a counter 153 a receives a coding start/end instruction signal Sse, which has been supplied as a control signal to the coder.
- the counter 153 a resets the count at zero, and then counts the clock pulses supplied from a reference clock generator 153 b , thereby clocking the time t passed since the start of coding.
- the quantization parameter determiner 154 performs a feedback control using the cumulative error D as a feedback quantity and the time constant T.
- the determiner 154 changes the time constant T as the time t passes. Specifically, the determiner 154 sets the time constant T smaller as the passed time t is mounting.
- FIG. 6 illustrates how the time constant T changes with time.
- the time constant T is initialized at Ti when coding is started. As the time t passes, the time constant T is gradually decreased. And at the end of coding, the time constant T is set equal to the predetermined time constant Te.
- the time constant T may be set in the following manner. At the start of coding, the time constant T is set at such a value that the cumulative error D will reach zero in 15 minutes. Thereafter, at a point in time the video signal has been coded for 30 minutes, the time constant T is changed to such a value that the cumulative error D will reach zero in 5 minutes. And when only 5 minutes is left to finish coding the video signal, the time constant T is changed again to such a value that the cumulative error D will reach zero in just 1 minute.
- the feedback control may be performed gently at the start of coding to increase the flexibility of the variable coding rate.
- coding may be performed at a rate, which is better suited to a particular scene. Thereafter, if the feedback control is enhanced along with the progress of coding processing, then an average coding rate comes even closer to a target coding rate. Accordingly, a resultant error between the average and target coding rates can be reduced at the end of coding processing.
- the quantization parameter Q 3 may be determined using not only the cumulative error D and the coding time t, but also the error d as in the configuration shown in FIG. 4 .
- the feedback control characteristic of the cumulative error D may be modified using the error d, and the time constant T for the feedback control may be changed with the passage of the coding time t. In this manner, the average coding rate can be controlled even more adaptively to an individual scene.
- the time constant T for the feedback control is supposed to be changed with the coding time t.
- any other method of modifying the feedback control characteristic may be employed instead.
- the feedback quantity may be changed for that purpose.
- the rate-controlling-parameter determiner shown in FIG. 4 or 5 may be used by itself in place of the conventional rate-controlling-parameter determiner. Also, another rate-controlling-parameter determiner for determining the quantization parameter using the coding time, cumulative error and error (i.e., a combination of the determiners shown in FIGS. 4 and 5) may also be used by itself.
- a change of scenes may be detected by spotting a large variation in a parameter characterizing each frame of the input video signal Sv.
- the scene change detector 114 may detect a variation in some signal level such as a luminance or chromativity level of an image.
- a change of scenes may be detected using a variation in average luminance level or an inter-frame (or inter-field) difference.
- a change of scenes may be detected based on a level variation between frames.
- FIG. 7 illustrates how an inter-frame difference is calculated.
- an image signal is represented as a series of frames appearing one after another. Also, each frame is composed of a plurality of pixels, which are minimum units of the image signal.
- an inter-frame difference is a sum or average of absolute differences d[i, j], each representing a difference between the level x 1 [i, j] of a pixel at a location [i, j] within a current frame and the level x 2 [i, j] of an associated pixel at the same location within a previous frame.
- FIG. 8A illustrates how the inter-frame difference D changes with time in an image signal.
- the image signal is composed of Scenes 0 through 3
- the scenes are changes at respective frames f 1 , f 2 , f 3
- Scene 1 shows a lot of motion.
- the inter-frame differences D are large at the scene change frames f 1 , f 2 and f 3 .
- the inter-frame difference D is also large and at almost the same level as that of the scene change frame f 3 . Accordingly, if the occurrence of scene change is determined only by the inter-frame difference D, then the scene change may be detected erroneously.
- FIG. 8B illustrates how the variation ⁇ in inter-frame difference (i.e., a difference between the. inter-frame difference D of a frame and that of the succeeding frame) changes with time.
- the variation ⁇ in inter-frame difference is large enough to exceed a threshold value k. Accordingly, by comparing the variation ⁇ in inter-frame difference to the threshold value k, the scene change can be detected accurately.
- the scene change detection processing includes the following steps of:
- FIG. 9 illustrates a first exemplary configuration for the scene change detector.
- a memory 161 stores thereon the input video signal Sv and outputs the signal after delaying it for just one frame interval.
- An inter-frame difference calculator 162 calculates an absolute difference d[i, j] between a pixel level x 1 [i, j] within an f th frame of the input video signal Sv and a pixel level x 2 [i, j] within an (f ⁇ 1 ) th frame output from the memory 162 .
- An accumulator 163 accumulates the absolute differences d[i, j] for one frame and outputs the accumulation as an inter-frame difference D[f].
- a memory 164 stores thereon the inter-frame difference D[f] supplied from the accumulator 163 and outputs the difference D[f] after delaying it for just one frame interval.
- a subtractor 165 subtracts the inter-frame difference D[f ⁇ 1], which has been supplied from the memory 164 , from the inter-frame difference D[f], which has been supplied from the accumulator 163 , thereby obtaining and outputting a variation ⁇ [f] in inter-frame difference.
- a comparator 166 compares the variation ⁇ [f] in inter-frame difference to the predetermined value k, thereby outputting a scene change detection signal. Specifically, if the variation ⁇ [f] in inter-frame difference is larger than the predetermined value k, then it is determined that the scenes have been changed between the (f ⁇ 1) th and f th frames.
- the predetermined value k may be defined at the 18 th level.
- the video signal is supposed to be processed on a frame basis.
- the signal may be processed on a field basis.
- the scene change is supposed to be detected from the input video signal Sv.
- scene change information may be externally supplied to the scene change detector 114 .
- a variation in any other signal related to the video signal e.g., an audio signal, may be detected.
- the scene change may also be detected by estimating the complexity of coding.
- the scene change may be detected in accordance with a variation in number of bits of coded data on the basis of a frame or a GOP (in coding according to the MPEG-2 standard).
- the complexity of coding differs depending on the type of the scene in question. That is to say, a scene difficult to code, e.g., a scene with a lot of motion or a lot of complex patterns, has generated a large number of bits to be coded. In contrast, a scene easy to code, e.g., a scene with little motion or a lot of flat patterns, has generated a small number of bits to be coded. Thus, it is also possible to detect a scene change based on a variation in number of bits generated.
- FIG. 10 illustrates a second exemplary configuration for the scene change detector.
- the scene change detector 114 A is supposed to receive a number of bits Bg, which have been generated during a period of time corresponding to one GOP interval (hereinafter, simply referred to as a “GOP bit number”), from the bit number calculator 103 on a frame-to-frame basis.
- Bg[i] denotes a GOP bit number calculated at an i th frame.
- a memory 171 stores thereon the GOP bit number Bg[i] and outputs it after delaying it for just one frame interval.
- a subtractor 172 calculates an absolute difference between the GOP bit number Bg[i] supplied and a GOP bit number Bg[i ⁇ 1] of the previous frame, which has been supplied from the memory 171 , as a variation ⁇ Bg in number of bits between these frames.
- a comparator 173 compares the variation ⁇ Bg in number of bits between the frames to a predetermined threshold value. Specifically, if the variation ⁇ Bg is larger than the threshold value, then the comparator 173 determines that the scenes have been changed between these frames and outputs a scene change detection signal.
- a number of bits generated in each frame greatly differs depending on the type of a picture in question, namely, I-, P- or B- picture.
- the GOP bit number should be calculated every GOP interval, it is difficult to characterize each scene on a frame-by-frame basis.
- a GOP bit number Bg is calculated using the following conversion equation:
- the GOP bit number Bg can be calculated as a bit number characterizing each scene on a frame basis.
- the complexity X is substantially constant irrespective of the quantization parameter Q and is used as a parameter representing a difficulty in coding. That is to say, the more difficult to code a scene, the higher the complexity X.
- FIG. 11 illustrates a third exemplary configuration for the scene change detector, which is modified to detect a scene change based on a variation in complexity.
- the scene change detector 114 B is almost the same as the scene change detector 114 A shown in FIG. 10, but is different from the detector 114 A in that the detector 114 B further includes a multiplier 181 and that the complexity is calculated to detect a scene change.
- the multiplier 181 multiplies together the GOP bit number Bg calculated by the bit number calculator 103 and the quantization parameter Q used by the quantizer 101 , and outputs the product as the complexity X.
- Xg[i] is a complexity measured at the i th frame.
- a memory 182 stores thereon the complexity Xg[i] supplied from the multiplier 181 and outputs it after delaying it for just one frame interval.
- a subtractor 183 calculates an absolute difference between the complexity Xg[i] supplied from the multiplier 181 and the complexity Xg[i ⁇ 1] of the previous frame supplied from the memory 182 as a variation ⁇ Xg in complexity between these frames.
- a comparator 184 compares the variation ⁇ Xg in complexity to a predetermined threshold value. Specifically, if the variation ⁇ Xg is larger than the threshold value, then the comparator 184 determines that the scenes have been changed between these frames and outputs a scene change detection signal.
- the scene change detector 114 may be formed by combining the respective configurations shown in FIGS. 9, 10 and 11 in an arbitrary manner. In such a case, it can be determined that the scenes have been changed when the scene change detection signal is output from one of these configurations combined or all of these configurations at a time.
- FIG. 12 is a block diagram illustrating a configuration for a coder according to a second embodiment of the present invention.
- the same components as those illustrated in FIG. 1 are identified by the same reference numerals.
- the coder shown in FIG. 12 is different from the coder shown in FIG. 1 in the following respects.
- a selector 202 selectively outputs, as a quantization parameter Q 3 , either the quantization parameter Q 1 output from the memory 112 or the quantization parameter Q 2 output from the scene parameter determiner 110 .
- a rate-controlling-parameter determiner 201 determines and outputs a quantization parameter Q used for quantization processing such that an average coding rate during a predetermined interval is as close to a target coding rate as possible.
- the scene parameter determiner 110 , memory 112 , rate-controlling-parameter determiner 201 and selector 202 together constitute quantization parameter supplying means 20 as defined in the appended claims.
- the selector 202 usually selectively outputs the first quantization parameter Q 1 , which is the output of the memory 112 , as the quantization parameter Q. However, if the scene change detector 114 has detected a scene change, then the selector 202 selectively outputs the second quantization parameter Q 2 , which is the output of the scene parameter determiner 110 , as the quantization parameter Q.
- the rate-controlling-parameter determiner 201 includes an error calculator 211 , a cumulative error calculator 212 and a quantization parameter determiner 213 . Responsive to the quantization parameter Q 3 output from the selector 202 , the determiner 201 determines and outputs a quantization parameter Q such that an average coding rate during a predetermined interval is as close to a target coding rate as possible.
- the quantization parameter Q may be calculated by:
- D is a cumulative error, which is an accumulation of errors between a target number of bits, associated with a target coding rate, and a number of bits actually generated. That is to say, the feedback control is carried out to reduce the cumulative error to zero.
- T is a time constant used for the feedback control. The feedback control is carried out to reduce the cumulative error to zero during the interval T.
- the average coding rate can be controlled to come as close to the target coding rate as possible by feeding back the quantization parameter, which was defined a predetermined time ago, within the same scene. And if scenes have been changed, the average rate can be controlled based on an appropriate quantization parameter, which is most closely associated with the complexity of coding the newly appearing scene. As a result, coding processing can be performed adaptively to the individual scenes, while controlling an average coding rate at the same time.
- FIG. 13 is a block diagram illustrating a configuration for a coder according to a third embodiment of the present invention.
- a scene parameter determiner 301 includes a distortion sensitivity estimator 302 and a quantization parameter determiner 303 , and determines the second quantization parameter Q 2 directly based on the input video signal Sv without using the number of bits generated B.
- the distortion sensitivity estimator 302 estimates the distortion of each scene that is sensed by the human eyes.
- the quantization parameter determiner 303 determines the quantization parameter Q 2 based on the distortion sensitivity estimated by the distortion sensitivity estimator 302 .
- the rate-controlling-parameter determiner 111 , memory 112 , selector 113 and scene parameter determiner 301 together constitute quantization parameter supplying means 30 as defined in the appended claims.
- the distortion sensitivity estimator 302 estimates and outputs the distortion of a video to be sensed by the human eyes during a predetermined interval with reference to the level of the input video signal Sv.
- the estimator 302 estimates the distortion sensed by the human eyes based on various values characterizing a video signal during a predetermined interval, e.g., average or variation of luminance or chromaticity levels and motion quantity of a pattern.
- the higher a luminance level the lower the distortion sensitivity. That is to say, the darker a picture, the more seriously the image quality of the picture, perceivable to the human eyes, is affected by noise generated. Accordingly, in a situation where a bright picture in a scene is changed into a dark picture in the next scene, the perceivable noise can be reduced if the quantization processing is performed using a quantization parameter smaller than that used for the bright picture. Conversely, if a dark picture is changed into a bright picture, the noise generated in the previous, dark picture is less likely to be perceived even if the quantization parameter is increased.
- FIG. 14 illustrates an exemplary configuration for the distortion sensitivity estimator 302 .
- the following relationship is met between the human sensation of brightness I and the luminance L:
- an average of luminance levels of respective pixels within a frame may be estimated as brightness and the distortion sensitivity may be detected as a characteristic inversely proportional to the brightness estimated.
- a pixel level detector 311 detects a pixel level, e.g., the luminance level of each pixel of the input video signal Sv.
- the quantization parameter determiner 303 controls the quantization parameter Q 2 depending on the distortion sensitivity I estimated. Specifically, if the distortion sensitivity I is small, then the determiner 303 increases the quantization parameter Q 2 . Conversely, if the distortion sensitivity I is large, then the determiner 303 decreases the quantization parameter Q 2 . As a result, noise resulting from the quantization processing is less perceivable to the human eyes.
- the pixel level detector 311 may also detect the chromaticity levels of respective pixels. This is because the human sensation of distortion is also variable depending on the chromaticity levels. For example, the human eyes are more sensitive to distortion of red components than that of blue components. Accordingly, if there are many red components within an overall frame, then the distortion thereof is more likely to be perceived by the human eyes. Thus, in such a case, the quantization parameter is controlled at a smaller value.
- FIG. 15 illustrates another exemplary configuration for the distortion sensitivity estimator.
- the distortion sensitivity estimator 302 A shown in FIG. 15 is adapted to estimate the distortion sensitivity based on the level variation.
- a luminance level detector 321 detects a pixel level, e.g., the luminance level of each pixel of the input video signal Sv.
- a memory 322 outputs the luminance level after delaying it for just one pixel interval.
- a subtractor 323 calculates an absolute difference between the luminance level of a current pixel and that of the previous pixel, which is output of the memory 322 , as a differential level.
- a frame average calculator 324 calculates a frame average of differential levels and outputs it as a level variation. Responsive to the level variation, a distortion sensitivity output device 325 estimates and outputs a distortion sensitivity, which is inversely proportional to the level variation.
- the memory 322 is supposed to delay the output of the luminance level for one pixel interval.
- the luminance level may be output after delaying it for one horizontal line interval.
- the luminance level of a pixel which is located one line above the current pixel, may be output.
- the output of the luminance level may be delayed for a predetermined interval to output the luminance levels of pixels located around the current pixel.
- FIG. 16 illustrates another exemplary configuration for the distortion sensitivity estimator for estimating the distortion sensitivity based on the level variation.
- the estimator 302 B shown in FIG. 16 is substantially the same as the counterpart 302 A shown in FIG. 15, but the estimator 302 B further includes another memory 331 . Accordingly, the distortion sensitivity output device 332 operates in a different manner.
- the memory 331 stores thereon the level variations and outputs a previous level variation, which is one frame ahead of the current frame.
- a distortion sensitivity output device 332 estimates the distortion sensitivity based on the level variation Vc of the current frame and the level variation Vp of the previous frame.
- the quantization parameter Qp was used in the previous frame, the quantization parameter Qc of the current frame is given by the following equations using a predetermined value k 4 ,
- the quantization parameter may also be determined by estimating the distortion sensitivity based on a change of level variation between frames.
- the memory 331 is supposed to output a previous level variation, which ahead of the current frame by one.
- the level variation output may be that of a GOP ahead of the current GOP by one.
- any unit may be used as long as the output of the level variation is delayed for a predetermined interval.
- the coding rate can be controlled to make the overall image quality more uniform and the number of bits generated can be suppressed.
- FIG. 17 is a block diagram illustrating a configuration for a coder according to a fourth embodiment of the present invention.
- the coder shown in FIG. 17 is based on the configuration shown in FIG. 1, but is characterized by including a plurality of scene parameter determiners.
- the coder shown in FIG. 17 further includes a second scene parameter determiner 301 similar to the counterpart according to the third embodiment, in addition to the first scene parameter determiner 110 .
- the first scene parameter determiner 110 , rate-controlling-parameter determiner 111 , memory 112 , and second scene parameter determiner 301 together constitute quantization parameter supplying means 40 as defined in the appended claims.
- a selector 401 selectively outputs the quantization parameters Q 1 through Q 4 as the quantization parameter Q. That is to say, the parameter Q 1 a predetermined time ago, the parameter Q 2 determined and output by the first scene parameter determiner 110 , the parameter Q 3 determined and output by the second scene parameter determiner 301 , or the parameter Q 4 output from the rate-controlling-parameter determiner 111 is selectively output.
- the selector 401 selectively outputs the quantization parameter Q 3 supplied from the second scene parameter determiner 301 for the first frame or field coming up after the scene change.
- the first scene parameter determiner 110 determines the quantization parameter Q 2 based on this number of bits generated and calculated. Thereafter, the selector 401 selectively outputs the quantization parameter Q 2 .
- FIG. 18 illustrates the operation of the selector 401 .
- scenes are supposed to be changed within a GOP 2 and the newly appearing scene is supposed to be more difficult to code as in FIG. 2 A.
- the selector 401 selects the output Q 3 of the second scene parameter determiner 301 at the first frame after the scenes have been changed within the GOP 2 . Since the newly appearing scene has low distortion sensitivity but is more difficult to code, the quantization parameter Q 3 is set larger than the previous one as shown in FIG. 18 .
- the quantization parameter Q 3 which is selected at the first frame after the scene change, is stored on the memory 112 .
- the selector 401 selects the output Q 1 of the memory 112 as the quantization parameter Q.
- the quantization parameter Q 3 that was stored on the memory 112 at the time of scene change is output as the quantization parameter Q 1 , and is used as the quantization parameter Q for quantization processing.
- the bit number calculator 103 calculates the number of bits generated after the scene change.
- the first scene parameter determiner 110 determines the quantization parameter Q 2 based on the number of bits generated after the scene change.
- the selector 401 selects the output Q 2 of the first scene parameter determiner 110 as the quantization parameter Q.
- the selector 401 selects the output Q 1 of the memory 112 as the quantization parameter Q.
- the quantization parameter Q 2 which was stored on the memory 112 after the interval DT had. passed, is continuously output as the quantization parameter Q 1 until the last frame of the GOP 2 , and is used as the quantization parameter Q for quantization processing.
- the selector 401 selects the output Q 4 of the rate-controlling-parameter determiner 111 as the quantization parameter Q.
- quantization processing is performed using the output Q 3 of the second scene parameter determiner 301 as the quantization parameter until the interval DT has passed since the scene change. During this interval DT, the number of bits generated is calculated. And after the first scene parameter determiner 110 has determined the quantization parameter Q 2 based on the number of bits generated, the quantization processing is carried out using the quantization parameter Q 2 as the quantization parameter Q.
- the interval DT lasts two frames.
- the interval DT may be of an arbitrary length corresponding to a predetermined number of frames.
- the interval DT may overlap with a pair of adjacent GOPs.
- FIG. 19 illustrates how a quantization parameter is selected where the interval DT lasts six frames. In the example illustrated in FIG. 19, the interval DT reaches the next GOP 3 .
- the output Q 3 of the second scene parameter determiner 301 is selected as the quantization parameter Q at the first frame after the scenes have been changed within the GOP 2 .
- the output Q 4 of the rate-controlling-parameter determiner 111 is selected as the quantization parameter Q.
- the output Q 2 of the first scene parameter determiner 110 is selected as the quantization parameter Q.
- the interval DT may be determined depending on the type of an individual frame, i.e., I-, P- or B-frame.
- the interval DT may be defined as a period of time after the scenes was changed and until an I-frame has been coded.
- the interval DT may terminate when the coding of a P- or B-frame is completed.
- the interval DT may be an interval after the coding of an I-frame was completed and until the coding of at least one of P- and B-frames is completed.
- the interval DT may be defined as an interval after the scenes were been changed and until the coding of one GOP is completed.
- a number of bits generated in each frame greatly differs depending on the picture type of the frame in question.
- a number of bits generated should preferably be calculated on a GOP basis and used as an index characterizing an individual scene.
- a GOP bit number Bg may be calculated by the following conversion equation:
- Bi, Bp and Bb are respective numbers of bits of I-, P- and B-frames
- Np and Nb are respective numbers of P-frames and B-frames included in the GOP.
- the GOP bit number Bg can be calculated on a frame basis as a bit number characterizing each scene.
- the interval DT can be shortened and a quantization parameter best suited to an individual scene can be determined quickly.
- a first frame or field appearing after a scene change is quantized according to this embodiment using the quantization parameter Q 3 .
- the quantization parameter Q 2 is selected.
- an average coding rate can be controlled to come as close to a target coding rate as possible within the same scene, and if scenes have been changed, an appropriate quantization parameter, which is most closely associated with the distortion sensitivity of the newly appearing scene, can be selected.
- coding processing can be performed adaptively to the individual scenes, while controlling an average coding rate at the same time.
- the quantization processing is carried out just after the scene change using an optimum quantization parameter selected based on the distortion sensitivity. And when the number of bits generated after the scene change is calculated after that, the quantization processing is performed using an optimum quantization parameter selected based on the number of bits generated.
- the selector 401 may continuously select the output Q 3 of the second scene parameter determiner 301 or the output Q 4 of the rate-controlling-parameter determiner 111 as the quantization parameter Q all through the interval DT. Also, the selector 401 may always select the output Q 4 of the rate-controlling-parameter determiner 111 within the same scene without supplying the output Q 1 of the memory 112 to the selector 401 .
- the first scene parameter determiner 110 may have the configuration shown in FIG. 3 .
- FIG. 20 is a block diagram illustrating a configuration for a coder according to a fifth embodiment of the present invention.
- the coder shown in FIG. 20 is based on the configuration shown in FIG. 12, but is characterized by including a plurality of scene parameter determiners as in the fourth embodiment.
- the coder shown in FIG. 20 further includes the second scene parameter determiner 301 similar to the counterpart according to the third embodiment, in addition to the first scene parameter determiner 110 .
- the first scene parameter determiner 110 , memory 112 , rate-controlling-parameter determiner 201 , second scene parameter determiner 301 and selector 501 together constitute quantization parameter supplying means 50 as defined in the appended claims.
- a selector 501 selectively outputs the quantization parameter Q 3 as the output Q 4 at the first frame or field appearing after the scene change. Responsive to the output Q 4 of the selector 501 , the rate-controlling-parameter determiner 201 determines and outputs a quantization parameter Q by performing feedback control in such a manner that a cumulative error becomes zero relative to the target coding rate. The quantizer 101 performs quantization processing using the quantization parameter Q determined by the rate-controlling-parameter determiner 201 . During the interval DT as defined in the fourth embodiment, the bit number calculator 103 calculates a number of bits generated after the scene change. When the first scene parameter determiner 110 determines the quantization parameter Q 2 based on this number of bits generated, the selector 501 selectively outputs this quantization parameter Q 2 .
- quantization is performed according to this embodiment using the quantization parameter Q 3 at the first frame or field appearing after a scene change. And after a predetermined interval has passed, the quantization parameter Q 2 is selected. In this manner, an average coding rate is controlled to come as close to a target coding rate as possible within the same scene, and if scenes have been changed, an appropriate quantization parameter, which is most closely associated with the distortion sensitivity of the newly appearing scene, is selected. As a result, coding processing can be performed adaptively to the individual scenes while controlling an average coding rate at the same time. Furthermore, the quantization processing is carried out just after the scene change using an optimum quantization parameter selected based on the distortion sensitivity. And when the number of bits generated after the scene change is calculated after that, the quantization processing is performed using an optimum quantization parameter selected based on the number of bits generated.
- the selector 501 may continuously select the quantization parameter Q 3 or the output Q 1 of the memory 112 during the predetermined interval after the quantization parameter Q 3 was selected and until the quantization parameter Q 2 is selected.
- the first scene parameter determiner may have the configuration shown in FIG. 3 .
- the coders according to the foregoing embodiments are applicable to a recorder.
- FIG. 21 is a block diagram illustrating a configuration for a recorder including a coder 600 according to any of the foregoing embodiments of the present invention.
- the coder 600 codes an input video signal Sv and outputs it as coded data Sc.
- a recording processor 601 adds an error correction code to the coded data Sc and modulates the error-corrected data into a recording signal, which is recorded by a recording head 602 on a storage medium 604 .
- coding processing can be performed adaptively to individual scenes of a video signal, and a signal, the average coding rate of which has been controlled to be as close to the target coding rate as possible, can be recorded on the storage medium 604 .
- the recorder may further include a storable capacity estimator 603 for estimating a capacity of the storage medium 604 that is available for recording. And based on the storable capacity estimated, the characteristic of the quantization parameter determination processing performed by the coder 600 may be modified.
- the rate-controlling-parameter determiner determines the quantization parameter by feeding back the cumulative error relative to the target coding rate. In this configuration, this feedback control characteristic may be modified based on the storable capacity estimated by the storable capacity estimator 603 .
- the feedback control is performed gently so as to decrease a variation in quantization parameter.
- the feedback control is enhanced. That is to say, when there is a lot of storable capacity left, the coding processing is performed adaptively to individual scenes. And when there is little storable capacity left, the feedback control is performed more precisely such that the average rate comes even closer to the target rate. In this manner, the recording signal can be recorded on the storage medium with much more certainty.
- the characteristic of the feedback control may be modified in any arbitrary manner.
- the time constant or quantity of the feedback control may be changed.
- the feedback control characteristic of the rate-controlling-parameter determiner is supposed to be modified based on the storable capacity.
- the characteristic of quantization parameter determination performed by the scene parameter determiner may be modified instead. For example, when there is not so much storable capacity left, the quantization parameter to be output may be increased so as to decrease the coding rate and thereby extend the video signal recordable time.
- the target coding rate may be corrected based on the storable capacity. For example, as the error between the target coding rate and the actual coding rate is getting non-negligible along with the progress of the coding processing, the estimated storable capacity is also getting more and more erroneous. Accordingly, if the target coding rate is changed in accordance with the storable capacity and the remaining video signal recording time, then the video signal can be recorded on the storage medium with a lot more certainty.
- coder and recorder hardware implementations of the coder and recorder according to the present invention are exemplified.
- inventive coder and recorder may be implemented by means of software, or computer-executable programs.
- the respective components of the coder or recorder are equivalent to, and easily replaceable with, respective processing steps of coding and recording methods according to the present invention.
- each image may be divided into a plurality of blocks each composed of a multiplicity of pixels, an orthogonal transform such as discrete cosine transform may be performed on a block-by-block basis, and then the transform coefficients may be quantized and variable-length encoded.
- quantization parameters may be defined for respective transform coefficients using the coder according to any of the foregoing embodiments of the present invention.
- quantization parameters may be defined for respective blocks by the method of the present invention and the quantization parameter of each transform coefficient may be determined adaptively to the quantization parameter of an associated block.
- the present invention is applicable to various types of coding processing, e.g., transform coding based on orthogonal transform, sub-band coding using a plurality of frequency bands divided, and vector quantization for quantizing a plurality of pixel levels into representative vectors.
- a quantization parameter is just an exemplary parameter used for controlling the compression ratio in coding processing. Accordingly, if the compression ratio of a signal should be controlled using any other parameter, then the present invention is implementable as a method for determining the compression ratio control parameter.
- the present invention can perform coding processing adaptively to individual scenes while controlling an average coding rate at the same time. Accordingly, a well-balanced signal of quality can be reproduced at an even lower coding rate.
Abstract
Description
Claims (23)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/141,000 US20020131493A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
US10/141,076 US20020131494A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP20600498 | 1998-07-22 | ||
JP10-206004 | 1998-07-22 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/141,000 Division US20020131493A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
US10/141,076 Division US20020131494A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
Publications (1)
Publication Number | Publication Date |
---|---|
US6532262B1 true US6532262B1 (en) | 2003-03-11 |
Family
ID=16516323
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/357,887 Expired - Lifetime US6532262B1 (en) | 1998-07-22 | 1999-07-21 | Coding method and apparatus and recorder |
US10/141,076 Abandoned US20020131494A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
US10/141,000 Abandoned US20020131493A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/141,076 Abandoned US20020131494A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
US10/141,000 Abandoned US20020131493A1 (en) | 1998-07-22 | 2002-05-09 | Coding method and apparatus and recorder |
Country Status (2)
Country | Link |
---|---|
US (3) | US6532262B1 (en) |
EP (1) | EP0975177A3 (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020044605A1 (en) * | 2000-09-14 | 2002-04-18 | Pioneer Corporation | Video signal encoder and video signal encoding method |
US20020131493A1 (en) * | 1998-07-22 | 2002-09-19 | Matsushita Electric Industrial Co., Ltd. | Coding method and apparatus and recorder |
US20030043904A1 (en) * | 2001-08-28 | 2003-03-06 | Nec Corporation | Moving picture coding apparatus and method |
US6625322B1 (en) * | 1999-06-08 | 2003-09-23 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
US20040062448A1 (en) * | 2000-03-01 | 2004-04-01 | Wenjun Zeng | Distortion-adaptive visual frequency weighting |
US20040156551A1 (en) * | 2002-11-07 | 2004-08-12 | Fuji Photo Film Co., Ltd. | Image compression method and image compression apparatus |
US20050175091A1 (en) * | 2004-02-06 | 2005-08-11 | Atul Puri | Rate and quality controller for H.264/AVC video coder and scene analyzer therefor |
US20050175092A1 (en) * | 2004-02-06 | 2005-08-11 | Atul Puri | H.264/AVC coder incorporating rate and quality controller |
US20050180502A1 (en) * | 2004-02-06 | 2005-08-18 | Atul Puri | Rate control for video coder employing adaptive linear regression bits modeling |
US20050201460A1 (en) * | 2004-03-10 | 2005-09-15 | Lg Electronics Inc. | System and method for controlling bit rate of an image |
US20060209954A1 (en) * | 2005-03-16 | 2006-09-21 | Limin Wang | Method and apparatus for providing a rate control for interlace coding |
US20070014481A1 (en) * | 2005-07-12 | 2007-01-18 | Samsung Electronics Co., Ltd. | Apparatus and method for encoding and decoding image data |
US20070019871A1 (en) * | 2005-07-12 | 2007-01-25 | Samsung Electronics Co., Ltd. | System, medium, and method encoding and/or decoding image data |
US20090225825A1 (en) * | 2008-03-05 | 2009-09-10 | Megachips Corporation | Encoder |
US8634481B1 (en) * | 2000-11-16 | 2014-01-21 | Alcatel Lucent | Feedback technique for wireless systems with multiple transmit and receive antennas |
US10264255B2 (en) * | 2013-03-15 | 2019-04-16 | Divx, Llc | Systems, methods, and media for transcoding video data |
US10368096B2 (en) | 2011-01-05 | 2019-07-30 | Divx, Llc | Adaptive streaming systems and methods for performing trick play |
US10687095B2 (en) | 2011-09-01 | 2020-06-16 | Divx, Llc | Systems and methods for saving encoded media streamed using adaptive bitrate streaming |
US10805368B2 (en) | 2012-12-31 | 2020-10-13 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
US10856020B2 (en) | 2011-09-01 | 2020-12-01 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US10893305B2 (en) | 2014-04-05 | 2021-01-12 | Divx, Llc | Systems and methods for encoding and playing back video at different frame rates using enhancement layers |
US11102553B2 (en) | 2009-12-04 | 2021-08-24 | Divx, Llc | Systems and methods for secure playback of encrypted elementary bitstreams |
USRE48761E1 (en) | 2012-12-31 | 2021-09-28 | Divx, Llc | Use of objective quality measures of streamed content to reduce streaming bandwidth |
US11457054B2 (en) | 2011-08-30 | 2022-09-27 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
US11470405B2 (en) | 2013-05-30 | 2022-10-11 | Divx, Llc | Network video streaming with trick play based on separate trick play files |
US11886545B2 (en) | 2006-03-14 | 2024-01-30 | Divx, Llc | Federated digital rights management scheme including trusted systems |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1159916C (en) * | 1999-06-22 | 2004-07-28 | 日本胜利株式会社 | Moving image coding apparatus and method thereof |
TW573433B (en) * | 2000-12-20 | 2004-01-21 | Pulsent Corp | Efficiently adaptive double pyramidal coding |
US7130472B2 (en) * | 2002-01-21 | 2006-10-31 | Canon Kabushiki Kaisha | Image distribution apparatus, communication terminal apparatus, and control method thereof |
US7889792B2 (en) * | 2003-12-24 | 2011-02-15 | Apple Inc. | Method and system for video encoding using a variable number of B frames |
US20050286629A1 (en) * | 2004-06-25 | 2005-12-29 | Adriana Dumitras | Coding of scene cuts in video sequences using non-reference frames |
WO2006096612A2 (en) * | 2005-03-04 | 2006-09-14 | The Trustees Of Columbia University In The City Of New York | System and method for motion estimation and mode decision for low-complexity h.264 decoder |
US8363717B2 (en) * | 2005-05-17 | 2013-01-29 | Canon Kabushiki Kaisha | Image processing apparatus |
US8532169B2 (en) * | 2009-12-23 | 2013-09-10 | General Instrument Corporation | Rate control for two-pass encoder using adaptive quantization parameters |
US8681858B2 (en) * | 2009-12-23 | 2014-03-25 | General Instrument Corporation | Rate control for two-pass encoder |
GB2514557A (en) * | 2013-05-28 | 2014-12-03 | Snell Ltd | Image processing |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5650860A (en) * | 1995-12-26 | 1997-07-22 | C-Cube Microsystems, Inc. | Adaptive quantization |
JPH10215460A (en) | 1996-11-26 | 1998-08-11 | Matsushita Electric Ind Co Ltd | Moving image variable bit rate encoding device and method, and recording medium for moving image variable bit rate encoding program |
US5844607A (en) * | 1996-04-03 | 1998-12-01 | International Business Machines Corporation | Method and apparatus for scene change detection in digital video compression |
US6115420A (en) * | 1997-03-14 | 2000-09-05 | Microsoft Corporation | Digital video signal encoder and encoding method |
US6118817A (en) * | 1997-03-14 | 2000-09-12 | Microsoft Corporation | Digital video signal encoder and encoding method having adjustable quantization |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5038209A (en) * | 1990-09-27 | 1991-08-06 | At&T Bell Laboratories | Adaptive buffer/quantizer control for transform video coders |
KR940011605B1 (en) * | 1991-12-20 | 1994-12-22 | 삼성전자 주식회사 | Image compressing method |
US5592226A (en) * | 1994-01-26 | 1997-01-07 | Btg Usa Inc. | Method and apparatus for video data compression using temporally adaptive motion interpolation |
KR100307618B1 (en) * | 1994-05-31 | 2001-11-30 | 윤종용 | Device and method for encoding image |
JP3711571B2 (en) * | 1994-09-29 | 2005-11-02 | ソニー株式会社 | Image coding apparatus and image coding method |
US6222881B1 (en) * | 1994-10-18 | 2001-04-24 | Intel Corporation | Using numbers of non-zero quantized transform signals and signal differences to determine when to encode video signals using inter-frame or intra-frame encoding |
US5629736A (en) * | 1994-11-01 | 1997-05-13 | Lucent Technologies Inc. | Coded domain picture composition for multimedia communications systems |
JP2907063B2 (en) * | 1995-05-24 | 1999-06-21 | 日本ビクター株式会社 | Video encoding apparatus for controlling total code amount |
BR9707821A (en) * | 1996-03-02 | 1999-07-27 | Thomson Brandt Gmbh | Method and apparatus for encoding or decoding digital video data |
US6337879B1 (en) * | 1996-08-14 | 2002-01-08 | Sony Corporation | Video data compression apparatus and method of same |
US6167088A (en) * | 1998-04-03 | 2000-12-26 | Sarnoff Corporation | Method and apparatus for performing adaptive encoding rate control of a video information stream including 3:2 pull-down video information |
US6532262B1 (en) * | 1998-07-22 | 2003-03-11 | Matsushita Electric Industrial Co., Ltd. | Coding method and apparatus and recorder |
-
1999
- 1999-07-21 US US09/357,887 patent/US6532262B1/en not_active Expired - Lifetime
- 1999-07-22 EP EP99114431A patent/EP0975177A3/en not_active Withdrawn
-
2002
- 2002-05-09 US US10/141,076 patent/US20020131494A1/en not_active Abandoned
- 2002-05-09 US US10/141,000 patent/US20020131493A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5650860A (en) * | 1995-12-26 | 1997-07-22 | C-Cube Microsystems, Inc. | Adaptive quantization |
US5844607A (en) * | 1996-04-03 | 1998-12-01 | International Business Machines Corporation | Method and apparatus for scene change detection in digital video compression |
JPH10215460A (en) | 1996-11-26 | 1998-08-11 | Matsushita Electric Ind Co Ltd | Moving image variable bit rate encoding device and method, and recording medium for moving image variable bit rate encoding program |
US6115420A (en) * | 1997-03-14 | 2000-09-05 | Microsoft Corporation | Digital video signal encoder and encoding method |
US6118817A (en) * | 1997-03-14 | 2000-09-12 | Microsoft Corporation | Digital video signal encoder and encoding method having adjustable quantization |
US6317459B1 (en) * | 1997-03-14 | 2001-11-13 | Microsoft Corporation | Digital video signal encoder and encoding method |
Cited By (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020131493A1 (en) * | 1998-07-22 | 2002-09-19 | Matsushita Electric Industrial Co., Ltd. | Coding method and apparatus and recorder |
US20040161158A1 (en) * | 1999-06-08 | 2004-08-19 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
US6625322B1 (en) * | 1999-06-08 | 2003-09-23 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
US6937771B2 (en) | 1999-06-08 | 2005-08-30 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
US7313283B2 (en) | 1999-06-08 | 2007-12-25 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
US20050238243A1 (en) * | 1999-06-08 | 2005-10-27 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
US20040062448A1 (en) * | 2000-03-01 | 2004-04-01 | Wenjun Zeng | Distortion-adaptive visual frequency weighting |
US7062104B2 (en) * | 2000-03-01 | 2006-06-13 | Sharp Laboratories Of America, Inc. | Distortion-adaptive visual frequency weighting |
US20020044605A1 (en) * | 2000-09-14 | 2002-04-18 | Pioneer Corporation | Video signal encoder and video signal encoding method |
US8634481B1 (en) * | 2000-11-16 | 2014-01-21 | Alcatel Lucent | Feedback technique for wireless systems with multiple transmit and receive antennas |
US20030043904A1 (en) * | 2001-08-28 | 2003-03-06 | Nec Corporation | Moving picture coding apparatus and method |
US7408985B2 (en) * | 2001-08-28 | 2008-08-05 | Nec Corporation | Moving picture coding apparatus and method |
US20040156551A1 (en) * | 2002-11-07 | 2004-08-12 | Fuji Photo Film Co., Ltd. | Image compression method and image compression apparatus |
US7986731B2 (en) | 2004-02-06 | 2011-07-26 | Apple Inc. | H.264/AVC coder incorporating rate and quality controller |
US20050175092A1 (en) * | 2004-02-06 | 2005-08-11 | Atul Puri | H.264/AVC coder incorporating rate and quality controller |
US20050175091A1 (en) * | 2004-02-06 | 2005-08-11 | Atul Puri | Rate and quality controller for H.264/AVC video coder and scene analyzer therefor |
US8036267B2 (en) | 2004-02-06 | 2011-10-11 | Apple, Inc. | Rate control for video coder employing adaptive linear regression bits modeling |
US7869503B2 (en) | 2004-02-06 | 2011-01-11 | Apple Inc. | Rate and quality controller for H.264/AVC video coder and scene analyzer therefor |
US7492820B2 (en) * | 2004-02-06 | 2009-02-17 | Apple Inc. | Rate control for video coder employing adaptive linear regression bits modeling |
US20050180502A1 (en) * | 2004-02-06 | 2005-08-18 | Atul Puri | Rate control for video coder employing adaptive linear regression bits modeling |
US20050201460A1 (en) * | 2004-03-10 | 2005-09-15 | Lg Electronics Inc. | System and method for controlling bit rate of an image |
US20060209954A1 (en) * | 2005-03-16 | 2006-09-21 | Limin Wang | Method and apparatus for providing a rate control for interlace coding |
WO2006101650A1 (en) * | 2005-03-16 | 2006-09-28 | General Instrument Corporation | Method and apparatus for providing a rate control for interlace coding |
US20070014481A1 (en) * | 2005-07-12 | 2007-01-18 | Samsung Electronics Co., Ltd. | Apparatus and method for encoding and decoding image data |
US7995847B2 (en) | 2005-07-12 | 2011-08-09 | Samsung Electronics Co., Ltd. | Apparatus and method for encoding and decoding image data with selected quantization based on pixel bit depth |
US20070019871A1 (en) * | 2005-07-12 | 2007-01-25 | Samsung Electronics Co., Ltd. | System, medium, and method encoding and/or decoding image data |
US7848586B2 (en) * | 2005-07-12 | 2010-12-07 | Samsung Electronics Co., Ltd. | System, medium, and method encoding and/or decoding image data |
US11886545B2 (en) | 2006-03-14 | 2024-01-30 | Divx, Llc | Federated digital rights management scheme including trusted systems |
US8619864B2 (en) * | 2008-03-05 | 2013-12-31 | Megachips Corporation | Transcoding/encoding with code amount adjustment and stuffing bits |
US20090225825A1 (en) * | 2008-03-05 | 2009-09-10 | Megachips Corporation | Encoder |
US11102553B2 (en) | 2009-12-04 | 2021-08-24 | Divx, Llc | Systems and methods for secure playback of encrypted elementary bitstreams |
US10368096B2 (en) | 2011-01-05 | 2019-07-30 | Divx, Llc | Adaptive streaming systems and methods for performing trick play |
US10382785B2 (en) | 2011-01-05 | 2019-08-13 | Divx, Llc | Systems and methods of encoding trick play streams for use in adaptive streaming |
US11638033B2 (en) | 2011-01-05 | 2023-04-25 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US11457054B2 (en) | 2011-08-30 | 2022-09-27 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
US11178435B2 (en) | 2011-09-01 | 2021-11-16 | Divx, Llc | Systems and methods for saving encoded media streamed using adaptive bitrate streaming |
US10856020B2 (en) | 2011-09-01 | 2020-12-01 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US11683542B2 (en) | 2011-09-01 | 2023-06-20 | Divx, Llc | Systems and methods for distributing content using a common set of encryption keys |
US10687095B2 (en) | 2011-09-01 | 2020-06-16 | Divx, Llc | Systems and methods for saving encoded media streamed using adaptive bitrate streaming |
US11438394B2 (en) | 2012-12-31 | 2022-09-06 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
USRE48761E1 (en) | 2012-12-31 | 2021-09-28 | Divx, Llc | Use of objective quality measures of streamed content to reduce streaming bandwidth |
US10805368B2 (en) | 2012-12-31 | 2020-10-13 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
US11785066B2 (en) | 2012-12-31 | 2023-10-10 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
US10715806B2 (en) * | 2013-03-15 | 2020-07-14 | Divx, Llc | Systems, methods, and media for transcoding video data |
US20190268596A1 (en) * | 2013-03-15 | 2019-08-29 | Divx, Llc | Systems, Methods, and Media for Transcoding Video Data |
US20200396454A1 (en) * | 2013-03-15 | 2020-12-17 | Divx, Llc | Systems, Methods, and Media for Transcoding Video Data |
US11849112B2 (en) * | 2013-03-15 | 2023-12-19 | Divx, Llc | Systems, methods, and media for distributed transcoding video data |
US10264255B2 (en) * | 2013-03-15 | 2019-04-16 | Divx, Llc | Systems, methods, and media for transcoding video data |
US11470405B2 (en) | 2013-05-30 | 2022-10-11 | Divx, Llc | Network video streaming with trick play based on separate trick play files |
US10893305B2 (en) | 2014-04-05 | 2021-01-12 | Divx, Llc | Systems and methods for encoding and playing back video at different frame rates using enhancement layers |
US11711552B2 (en) | 2014-04-05 | 2023-07-25 | Divx, Llc | Systems and methods for encoding and playing back video at different frame rates using enhancement layers |
Also Published As
Publication number | Publication date |
---|---|
EP0975177A3 (en) | 2006-04-05 |
US20020131494A1 (en) | 2002-09-19 |
US20020131493A1 (en) | 2002-09-19 |
EP0975177A2 (en) | 2000-01-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6532262B1 (en) | Coding method and apparatus and recorder | |
US7023914B2 (en) | Video encoding apparatus and method | |
EP1372113B1 (en) | Variable bit rate video encoding method and device | |
US6678322B1 (en) | Video data coding device, video data coding method, video data transmitting device, and video data recording medium | |
US6922442B2 (en) | Apparatus and method of encoding moving picture signal | |
JP4543971B2 (en) | Encoding method, encoding apparatus, encoding processing program, and recording medium recording the encoding processing program | |
US6510176B1 (en) | Variable-bit-rate coding apparatus | |
JP2001008215A (en) | Dynamic image encoder and method therefor | |
JP2000197048A (en) | Coding rate controller and information coder | |
JP2000350211A (en) | Method and device for encoding moving picture | |
US7593463B2 (en) | Video signal coding method and video signal encoder | |
JP3173369B2 (en) | Image compression coding device | |
JP3895414B2 (en) | Video decoding device | |
US8116577B2 (en) | Encoding method, encoding device, encoding process program, and recording medium on which encoding process program is recorded | |
JP3815665B2 (en) | Variable bit rate video encoding apparatus and recording medium | |
JP2000261799A (en) | Variable rate moving image encoding device | |
JP3218994B2 (en) | Image coding method and apparatus | |
JP2000115786A (en) | Coder, recorder and coding method | |
JP2001025016A (en) | Moving image encoder and method therefor | |
JPH05183872A (en) | Device and method for moving picture encoding | |
JP2001238215A (en) | Moving picture coding apparatus and its method | |
JP3428332B2 (en) | Image encoding method and apparatus, and image transmission method | |
JP2004015351A (en) | Encoding apparatus and method, program, and recording medium | |
JPH08317387A (en) | Dynamic image compression encoding system | |
JP2000308047A (en) | Method and device for encoding image and data storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FUKUDA, HIDEKI;SHIBATA, HIDEAKI;NAKAMURA, KAZUHIKO;AND OTHERS;REEL/FRAME:010292/0704 Effective date: 19990921 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 12 |
|
AS | Assignment |
Owner name: PANASONIC CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:047346/0494 Effective date: 20081001 |
|
AS | Assignment |
Owner name: SOVEREIGN PEAK VENTURES, LLC, TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:047914/0675 Effective date: 20181012 |