EP0613294A1 - Gradation correction device and image sensing device therewith - Google Patents
Gradation correction device and image sensing device therewith Download PDFInfo
- Publication number
- EP0613294A1 EP0613294A1 EP94102684A EP94102684A EP0613294A1 EP 0613294 A1 EP0613294 A1 EP 0613294A1 EP 94102684 A EP94102684 A EP 94102684A EP 94102684 A EP94102684 A EP 94102684A EP 0613294 A1 EP0613294 A1 EP 0613294A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- correction
- gradation correction
- gradation
- signals
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012937 correction Methods 0.000 title claims abstract description 353
- 238000000605 extraction Methods 0.000 claims abstract description 26
- 230000015654 memory Effects 0.000 claims description 27
- 238000013139 quantization Methods 0.000 claims description 17
- 239000011159 matrix material Substances 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 6
- 238000012935 Averaging Methods 0.000 claims description 4
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims 2
- 230000002194 synthesizing effect Effects 0.000 claims 1
- 235000019557 luminance Nutrition 0.000 description 109
- 238000010586 diagram Methods 0.000 description 27
- 230000002542 deteriorative effect Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 239000007787 solid Substances 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 101000860173 Myxococcus xanthus C-factor Proteins 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000001934 delay Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007423 decrease Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000006866 deterioration Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/20—Circuitry for controlling amplitude response
Definitions
- the present invention relates to a gradation correction device for correcting gradation of input picture signals and a device therewith such as a camcorder or a video printer.
- a gradation correction device is needed to be installed in a camcorder or the like which processes picture signals of a 1-field picture.
- gradation correction circuits have been developed.
- a prior art gradation correction circuit is disclosed in Japanese Patent laid open Publication No. 125,589/1990 on the correction of image quality of an image sensing device.
- a luminance signal Y is first attenuated and next amplified nonlinearly.
- a nonlinear portion is extracted from amplified signal and added to the luminance signal Y.
- half-tone signals are emphasized while signals of high and low luminances are preserved.
- the image quality of a main object and background under back light can be improved.
- a second prior art gradation correction circuit is disclosed in Japanese Patent laid open Publication No. 206282/1990.
- image signals are divided into predetermined ranges of signal levels, and an average or an integrated value of image signals in each level range is detected.
- a gain control data ROM has stored a gain or attenuation amount for a gamma correction controller in correspondence to the average of image signals in each level range.
- the deterioration of image due to extreme black portions can be prevented by increasing the gain at low luminance, while the deterioration of image at extreme white portions can be prevented by controlling the attenuation at intermediate and high luminances.
- gradation at high luminance becomes poor.
- gradation correction characteristic has to be changed for front-lit objects and for back-lit objects, it is not easy to change gradation correction characteristic for front-lit objects and for back-lit objects.
- an output picture becomes unstable and unnatural if the prior art gradation correction circuit is applied to a video camera which deals a moving picture.
- An object of the present invention is to provide a gradation correction device which can supply an output image of good gradation expression in an entire picture for a front-lit object and for a back-lit object.
- Another object of the present invention is to provide a gradation correction device which can vary gradation characteristic easily for various kinds of pictures for example a back-lit object or a front-lit object.
- Still another object of the present invention is to provide a gradation correction device which can correct gradation of a moving picture.
- a further object of the present invention is to provide an image sensing device with a gradation correction circuit which can supply an output image of good gradation expression in an entire picture of various kinds of pictures for example a front-lit object and a back-lit object.
- a feature quantity extraction means extracts feature quantities (for example frequency values of a histogram of luminance) from input digital picture signals of a 1-frame picture or of a 1-field picture.
- the feature quantities reflect luminance level distribution of the input digital picture signals.
- a gradation correction characteristic is determined based on the feature quantities.
- a gradation correction characteristic defines an output signal for an input signal.
- each of the input digital picture signals is corrected by using the gradation correction characteristic.
- the gradation correction characteristic for the input digital picture signals is changed naturally for an input picture such as a moving picture according to features thereof.
- An image sensing device comprises such a gradation correction device.
- a gradation correction characteristic is changed preferably only after successive increase or decrease in the correction amount of input picture signals by many times more than a prescribed number of pictures in order to stabilize the gradation correction characteristic even when the input picture signal includes some noise signals.
- a gradation correction characteristic is determined according to the feature quantities by averaging two prescribed gradation correction characteristic with a weight.
- the weight is determined according to an input digital picture signal or an average of input digital picture signals.
- a correction coefficient characterizing a gradation correction characteristic used for gradation correction is determined based on the feature quantities, and an input picture signal is corrected by using a gain for the signal determined according to the correction coefficient.
- An advantage of a gradation correction device or an image sensing device therewith is that it can determine a most suitable gradation correction characteristic automatically according to feature quantities obtained from input picture signals.
- Another advantage of a gradation correction device or an image sensing device therewith according to the present invention is that an output picture of good color balance and rich gradation expression can be obtained for every picture from back-lit object to front-lit object without deteriorating gradation and that extreme black or white portions in an output picture can be prevented by using a simple structure.
- Still another advantage of a gradation correction characteristic according to the present invention is that gradation correction can be performed naturally even for a moving picture because gradation correction characteristic can be changed gradually.
- Fig. 1 shows a block diagram of a camcorder including a gradation correction device 204 of a first embodiment of the present invention.
- R, G and B signals as input picture signals detected by a solid state image sensor 201 such as a charge coupled device (CCD) is supplied through an analog circuit 202 to an analog-to-digital converter 203.
- the converter 203 converts the R, G and B signals to digital data of 0 - 255 level to be supplied to the gradation correction device 204.
- a gradation correction characteristic most appropriate to the input picture signals is determined and gradation correction is performed according thereto.
- a gradation correction characteristic is referred hereinafter to a relation of output signal against input signal, as shown in Fig. 5.
- a signal processor 205 performs signal processing such as aperture processing.
- the processed digital R, G and B signals are converted to analog R, G and B signals by a digital-to-analog converter 206.
- an encoder 207 converts the analog R, G and B signals to Y signal (luminance signal) and C signals (color signals) and a VCR circuit 208 records them in a video tape.
- Fig. 2 shows an example of a 1-frame picture of input picture signals in a frame plane 501.
- This picture shows a person standing in front of a window. Due to strong back-light , the person becomes very dark while a landscape which can be seen through the window becomes very bright.
- the number of samples in the frame plane 501 is 640 points along a horizontal direction and 480 points along a vertical direction.
- Fig. 3 shows effective pixels in the frame plane 501, wherein effective pixels are represented as open circles ( ⁇ ).
- the effective pixels selected consists of every other pixel in the horizontal direction and every other line in a central region of 512 pixels in the horizontal direction and 400 lines along a vertical lines. Therefore, the number of samples in the effective area is 256 points along the horizontal direction and 200 points along the vertical direction.
- the effective area consists of 256 points times 200 points.
- the area size or point number of signals for expressing the number of pixels may be selected to be any number large enough to extract features of an input picture, and feature quantities can be extracted by counting the frequencies of pixels in different level ranges in the effective area in a histogram.
- the bit number of feature quantities or frequencies of pixels may also be any number large enough to express features of a picture.
- Fig. 4 shows a block diagram of the gradation correction device 204.
- a known matrix circuit 101 receives input picture signals and provides luminance signal Y to a feature quantity extraction circuit 102 and to a correction gain generation circuit 104.
- the feature quantity extraction circuit 102 extracts feature quantities from the luminance signals Y in the above-mentioned effective area.
- the feature quantities which are used to determine gradation correction characteristic are defined to represent the kind of a picture.
- the feature quantities represent level distribution of the luminance signals Y in the effective pixels of 256 * 200 dots.
- a correction coefficient determination circuit 103 determines a gradation correction characteristic appropriate for the input digital picture signals of the picture according to the extracted feature quantities.
- the correction coefficient determination circuit 103 determines a correction coefficient characterizing the appropriate gradation correction characteristic and the correction coefficient is used to correct the input picture signals. Then, input digital picture signals are corrected according to the appropriate gradation correction characteristic. That is, first, the correction gain generation circuit 104 receives the luminance signal Y and the correction coefficient received from the correction coefficient determination circuit 103 and sends a correction gain (Y'/Y) to a correction circuit 105.
- the correction circuit 105 adjusts the timing of the R, G and B signals with the correction gain by delays 106 by a delay time for calculating the gradation correction characteristic, and it multiplies them with the correction gain (Y'/Y) by the multipliers 107 to supply R', G' and B' signals after gradation correction to the signal processor 205.
- the delays 106 are used for timing control in the circuit 105, 1-field or 1-frame memories may be used instead of the delays 106. In such a case, a same picture is read twice.
- it is a characteristic of the gradation correction device 204 that it processes digital data.
- it is relatively easy to change gradation characteristic according to the features of various kinds of a picture.
- gradation correction characteristic is determined automatically according to feature quantities extracted from input digital picture signals.
- the gradation correction characteristic represents a relation of output level against input level of picture signals.
- Fig. 5 shows gradation correction characteristic in the present embodiment, wherein reference sign Y1 denotes a first gradation correction characteristic and reference sign Y2 denotes a second gradation correction characteristic.
- a corrected value of input picture signal can easily be obtained, as will be explained later, by using the gradation correction coefficient which characterizes an interpolation characteristic between the two Y1 and Y2. Therefore, an output picture of good color balance and rich gradation expression can be supplied for all objects from a back-lit object to a front-lit object without deteriorating gradation.
- the gradation correction device 204 is explained in detail below.
- the matrix circuit 101 calculates luminance signal Y from R, G and B signals.
- the luminance Y ranges also between 0 and 255.
- the luminance Y is supplied to the feature quantity extraction circuit 102 and to the correction gain generation circuit 103.
- Fig. 6 shows the feature quantity extraction circuit 102 for extracting feature quantities from the luminance signals Y of a picture.
- frequencies of luminance signal at three sections of low, middle and high luminances are counted over an effective area in a 1-frame picture, and the frequencies are used as feature quantities.
- the input luminance signal Y is compared with first and second threshold values by a comparator 701. If the luminance signal Y is smaller than the first threshold value, a count signal for low luminance section is supplied to a first counter 702. If the luminance signal Y is between the first and second threshold values, a count signal for middle luminance section is supplied to a second counter 703. If the luminance signal is larger than the second threshold value, a count signal for high luminance section is supplied to a third counter 704.
- the counters 702, 703 and 704 provide the frequencies of low, middle and high luminance sections for an effective area.
- Fig. 7 shows an example of a histogram of luminance obtained by the feature quantity extraction circuit 102.
- a histogram "a” obtained by counting frequencies at each luminance level is illustrated for comparison.
- Reference signs "b", "c” and “d” denote frequencies of pixels of low luminance section from 0 to 63, of middle luminance section from 64 to 191 and of high luminance section from 192 to 255, respectively.
- the histogram shown in Fig. 7 has two peaks at low and high luminance sections larger than the number at middle luminance section. Therefore, it is guessed that this picture is taken for a back-lit object.
- the feature quantity extraction circuit 102 provides frequencies of pixels for three luminance levels.
- the two threshold values for determining sections for extraction can be changed suitably.
- the number of luminance level sections may also be different from three.
- Fig. 8 shows a correction coefficient determination circuit 103.
- a correction coefficient table ROM 801 stores correction coefficients for a front-lit object, for a back-lit object, for a dark object and the like while receiving frequencies of pixels of low, middle and high luminance sections as input signals. Therefore, when the three frequencies of pixels of low, middle and high luminance sections are received by the correction coefficient table ROM 801 from the feature quantity extraction circuit 102, a correction coefficient is determined for gradation correction of an input picture.
- the correction coefficient is filtered by the filter 802 so as to keep gradation continuity of moving pictures with respect to previous frames, as will be explained later.
- Fig. 9 shows an internal structure of an example of the correction coefficient table ROM 801 including an M-L calculator 13, a first quantization memory 14, a second quantization memory 15, a decision memory 16 and a bit shift circuit 42 for shifting 6-bit data to the left.
- the M-L calculator 13 receives 16-bit data of the frequencies of pixels of low, middle and high luminance sections and generates values L, M and H as most significant 8-bit data of the 16-bit data. It also calculates (100 + M/4 - L/2) . Then, it provides 8-bit data of (100 + M/4 - L/2) and of H to the quantization memories 14 and 15 as addresses.
- Fig. 10 shows an example of the contents of the quantization memories 14 and 15.
- the first quantization memory 14 provides "0" if 0 ⁇ (100 + M/4 - L/2) ⁇ 5 .
- the level width of middle luminance section is double that of low luminance range.
- the value "100" is a constant added for convenience.
- the memories 14 and 15 provide quantization values of a 4-bit data and of a 3-bit data, respectively.
- the capacity of the first quantization memory 14 is 128 bytes (or 256 words times 4 bits), while that of the second one 15 is 96 bytes (or 256 words times 3 bits).
- Fig. 11 shows the content of the decision memory 16.
- the decision memory 16 receives the 4-bit quantization value from the first quantization memory 14 and the 3-bit quantization value from the second one 15 as a 7-bit address signal, and it provides a 5-bit parameter ( ⁇ ) in correspondence to the address. For example, if "0" is received from the first quantization memory 14 and "0" is also received from the second one 15, the decision memory 16 provides "-4.0". It is shown that an output value increases from -4.0 to +4.0 from a back-lit object (M/4 ⁇ L/2) to a front-lit object (M/4 > L/2). It is also shown that an output value increases with increasing H.
- the capacity of the decision memory 16 is 80 bytes (or 128 words times 5 bits).
- Fig. 12 shows a circuit diagram of the filter 802 in detail.
- a synchronous pulse generator 37 generates pulse signals (VD) and master clock signals (f ck ), both having rising edges in synchronization with the start of a frame.
- reference numeral 18 denotes a comparator
- reference numerals 21, 22 and 23 denote inverters
- reference numerals 23, 25 and 34 denote AND gates.
- a subtractor 30 receives a 5-bit parameter ⁇ from the correction coefficient table ROM 801 and the correction coefficient ( ⁇ ) for the previous frame held in a correction gamma register 17 and calculates a difference ( ⁇ - ⁇ ).
- a shift bit number counter 32 counts master clock signals, and a shift bit number comparator 33 compares the count of the counter 32 with a number set in a shift bit number register 31 and supplied shift clocks to a shift register 35.
- the shift register 35 shifts the difference ( ⁇ - ⁇ ) to right by a bit number set in the shift bit number register 31.
- An adder 36 adds the ⁇ of the previous frame with the shifted difference ( ⁇ - ⁇ ) and supplies a sum to the correction gamma register 17 to update the correction coefficient for each frame.
- a plus frame number counter 19 counts a number of frames which has ⁇ larger than ⁇ continuously
- a minus frame number counter 20 counts a number of frames which has ⁇ smaller than ⁇ continuously.
- a plus frame number comparator 27 and a minus frame number comparator 28 compare the counts in the plus and minus frame number counters 19 and 20 with the inoperative frame number set previously in a register 26, respectively. If the number set in the inoperative frame number register 26 is smaller than the values set in the plus and minus frame number counters 19 and 20, the shift register 35 is cleared according to a pulse signal received from a NAND gate 29, and the adder 36 provides the same correction coefficient as that of the previous frame. Thus, the correction coefficient does not change until frames of ⁇ > ⁇ or ⁇ ⁇ ⁇ continue by more than the inoperative frame number.
- Fig. 13 shows a block diagram of the gradation correction gain generation circuit 104 of the first embodiment including a first gradation correction characteristic circuit 301, a second gradation correction characteristic circuit 302, an adder 303 and a weighted average circuit 304.
- An input luminance signal Y is supplied to the first and second gradation correction characteristic circuits 301 and 302.
- a first correction gain (Y1/Y) is sent according to the input luminance signal Y and Y1 obtained from a first gradation correction characteristic.
- a second correction gain (Y2/Y) is sent according to the input luminance signal Y and Y2 obtained from a second gradation correction characteristic.
- the first correction gain (Y1/Y) follows Equation (4) while the second correction gain (Y2/Y) follows Equation (5).
- (Y1/Y) ⁇ 1/2552*(Y-255)3 + 255 ⁇ /Y.
- Fig. 5 shows gradation correction characteristics used in the present embodiment, wherein Y1 and Y2 denote the first and second gradation correction characteristics, respectively.
- Y1 and Y2 denote the first and second gradation correction characteristics, respectively.
- the gradation correction characteristic is represented as "a”. If the correction coefficient is positive, the gradation correction characteristic decreases below the characteristic "a", as illustrated for example as "c”. If the correction coefficient is negative, the gradation correction characteristic increases above the characteristic "a", as illustrated for example as "b".
- the gradation correction characteristic can easily be changed gradually and continuously.
- every object can be corrected to express rich gradation by using for example the gradation correction characteristic "Y2" for a front-lit object, the gradation correction characteristic "a” for a back-lit object and the gradation correction characteristic "Y1" for a dark object.
- the correction gain generation circuit 104 generates the correction gain for an input picture signal by using the correction coefficient, and the correction gain is used in the correction circuit 105 to correct the input picture signal by multiplying it with the correction gain. It is to be noted on the correction gain generation circuit 104 that it does not need ROMs or the like to store a plurality of kinds of gradation correction characteristics, and the scale of the circuit can be made very compact. Still further, because a gradation correction characteristic can be generated for front-lit and back-lit objects by changing the correction coefficient, an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit object to front-lit object without deteriorating gradation.
- the gradation correction characteristic can be changed gradually and continuously, gradation correction can be performed naturally even for a moving picture. Still further, the contrast at high luminance is preserved by the gradation correction characteristic "a" in Fig. 5 for back-lit object. On the other hand, in a prior art so-called auto-knee control, the gradation at high luminance is deteriorated.
- a second embodiment of the gradation correction device 204 is explained. It is similar to the first embodiment except the correction gain generation circuit 104'.
- Fig. 14 shows a block diagram of the gradation correction gain generation circuit 104' of this embodiment This circuit is different from that of the first example shown in Fig. 13 in that an average detection circuit (low pass filter) 1305 is provided newly to generate a weight.
- An input luminance signal Y is supplied to first and second gradation correction characteristic circuits 1301 and 1302.
- a first correction gain (Y1/Y) is sent according to the input luminance signal Y.
- a second correction gain (Y2/Y) is sent according to the input luminance signal Y.
- the average detection circuit (LPF) 1305 obtains an average luminance Ya from luminance signals Y. That is, it averages luminance signals of say three or five pixels around a pixel of interest.
- a weighted average circuit 1304 averages the first and second correction gains with a weight determined according to Equation (2') by using the signal X and supplies a correction gain (Y'/Y) to the correction circuit 105.
- Fig. 15 illustrates gradation correction characteristics and input/output characteristic in an example.
- output picture signals show edge emphasis.
- the average luminance Ya obtained by the average detection circuit (LPF) 1305 is equal to a luminance signal Y of a pixel of interest
- the gradation characteristic "a" shown in Fig. 15 is adopted.
- the average luminance Ya is smaller than a luminance signal Y of a pixel of interest
- the gradation characteristic "b” shown in Fig. 15 is adopted.
- the average luminance Ya is larger than a luminance signal Y of a pixel of interest
- the gradation characteristic "c" shown in Fig. 15 is adopted.
- the gradation correction characteristic can be changed for each pixel appropriately. Even if a gradation correction characteristic curve has a small slope, the contrast of an output picture is good, and output signals can express gradation richly.
- Fig. 16 shows a block diagram of an example of the gradation correction gain generation circuit 104'.
- the circuit calculates Equations (2'), (3), (4) and (5).
- the circuit is simplified by using bit shift for multiplication or division of 255 and the like.
- a luminance signal Y is received, an average Ya is obtained by an average detection circuit (low pass filter) 401.
- a first adder 402 adds the average luminance Ya with the correction coefficient.
- a clip circuit 403 clips an output signal of the first adder with a value "0" for smaller values and with a value "255" for larger values.
- the luminous signal Y is delayed via a delay 400 for synchronization and a signal 2Y obtained by one-bit shift of Y are received by a second adder 404, and a signal 2Y is added with Y to send a signal 3Y of three times Y.
- a first multiplier 405 multiplies the luminance signal Y twice to generate a luminance signal Y2.
- a third adder 406 adds the output of the first multiplier 405 with a value "3".
- a first subtractor 407 subtracts the output signal "Y2 + 3" of the third adder 406 with "3Y" of the second adder 404.
- the first gradation correction characteristic circuit 1301 of this example consists of the second adder 404, the first multiplier 405, the third adder 406 and the first subtractor 407. Then, the second subtractor 409 subtracts the output signal of the clip circuit 403 from "255". Then, a second multiplier 408 multiplies the output signal of a second subtractor 409 with that of the first subtractor 407. Finally, a fourth adder 410 adds the output signal of the clip circuit 403 with that of the second multiplier 408 to send a product as a correction gain.
- the weighted average circuit 1404 consists of the second multiplier 408, the second subtractor 409 and the fourth adder 410.
- the correction gain is controlled according the correction coefficient with use of the gradation correction characteristics shown in Figs. 5 and 15. Because a gradation correction characteristic can be generated for every object by changing the correction coefficient, an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit objects to front-lit objects without deteriorating gradation.
- the average detection circuit 1305 averages input luminance signals including an input luminance signal of interest and input luminance signals thereabout. In other words, the circuit 1305 outputs an average of luminance signals around the input luminance signal of interest. Therefore, the luminance is corrected smaller or larger if the average luminance is larger or smaller. Therefore, even the gradation correction keeps contrast even if the slope of the gradation correction characteristic is small and output signals of rich gradation expression can be obtained.
- the above-mentioned correction gain generation circuit 104' generates the correction gain by using the correction coefficient without ROMs and the like to store a plurality of kinds of gradation correction characteristics. Therefore, the scale of the circuit can be made very compact. Still further, the contrast at high luminance is preserved for a back-lit object. On the other hand, in a prior art so-called auto-knee control, the gradation at high luminance is deteriorated. Further, gradation correction is performed in the unit of pixel by changing the gradation correction characteristic suitably according to the average luminance Ya. Therefore, the gradation correction keeps contrast even if the slope of the gradation correction characteristic is small, and output signals of rich gradation expression can be obtained.
- Fig. 17 shows a block diagram of an image sensing device which can correct gradation according to a third embodiment of the present invention.
- This device is similar to that of the first embodiment shown in Fig. 1 except that feature extraction and correction determination are carried out by using a software program.
- R, G and B signals as input picture signals are sensed by a solid state image sensor 1101 through an analog circuit 1102.
- the R, G and B signals are converted by an analog-to-digital converter 1103 to digital data of 0 - 255, which are supplied as input picture signals to a matrix circuit 1104 and to the gradation correction means 1108.
- a matrix circuit 1104 calculates a luminance signal Y from the digital R, G and B signals, and it supplies the luminance signal Y to a feature quantity extraction means 1105 for extracting feature quantities and to a correction gain generation means 1107 for generating a correction gain.
- the feature quantity extraction means 1105 extracts features of pixels of low, middle and high luminance sections of the luminance signal Y and supplies them as feature quantities to a correction coefficient determination means 1106.
- This means 1106 decides a gradation correction characteristic most appropriate to the input picture signal and sends a gradation correction coefficient characterizing the gradation correction characteristic.
- a correction gain generation means 1107 outputs a correction gain according to the luminance signal Y and the correction coefficient, and a gradation correction means 1108 multiplies the input picture signals with the correction gain for gradation correction.
- the signal processor 1109 performs signal processing such as aperture processing.
- the processed digital R, G and B signals are converted to analog R, G and B signals by a digital-to-analog converter 1110.
- an encoder 1111 converts the R, G and B signals to Y signal (luminance signal) and C signal (C signal).
- a VCR circuit 1112 records them in a video tape.
- Fig. 18 shows a block diagram of an image sensing device of an example according to a third embodiment of the present invention, wherein a solid state image sensor 1201, an analog circuit 1202, an analog-to-digital (A/D) converter 1203, a gradation correction circuit 1204, a signal processor 1205, a digital-to-analog (D/A) converter 1206, an encoder 1207 and a VCR circuit 1208 are similar to the counterparts shown in Fig. 17.
- A/D analog-to-digital
- D/A digital-to-analog
- the R, G and B signals are converted by the analog-to-digital converter 1203 to digital data of 0 - 255 level, which are supplied as input picture signals to a histogram generation means 1209 and to a gradation correction means 1204.
- the histogram generation means 1209 calculates a luminance signal Y from the R, G and B signals to generates frequencies of pixels of low, middle and high luminance sections for a 1-frame of an effective picture plane to extract feature quantities.
- a microprocessor 1212 is connected via a bus 1215 to a ROM 1213, a RAM 1214, an input means 1210 such as a key board and a correction gain generation circuit 1211.
- the ROM 1213 stores templates which includes features of gradation correction characteristic, while the RAM 1214 stores the numbers of pixels of low, middle and high luminances received from the histogram generation means 1209.
- the microprocessor 1212 determines a correction coefficient according to a flowchart shown in Fig. 19.
- the microprocessor 1212 determines the gradation correction characteristic by using template matching with reference to Fig. 19.
- the frequencies of pixels of low, middle and high luminance sections are read from the histogram generation means 1209 and stored in the RAM 1214 (step S10).
- the distances of the numbers stored in the RAM 1214 from templates stored in the ROM 1213 are calculated (step S12).
- the templates represent gradation correction characteristics to be selected according to feature quantities of input picture signals.
- a gradation correction characteristic of the shortest distance is determined (step S14).
- a processing is performed for keeping gradation continuity with the gradation correction characteristic of a previous field.
- a correction coefficient is sent for the correction gain generation circuit 1211 (step S16).
- the correction gain generation circuit 1211 averages the first and second gradation correction characteristics with a weight according to a sum of the average of the input luminance signal and the correction coefficient and supplies a correction gain to the gradation correction circuit 1204.
- the circuit 1204 adjusts the timing of the R, G and B signals according to the correction gain, and multiplies each of the R, G and B signals with the correction gain to send corrected R, G and B signals after gradation correction.
- the signal processor 1205 performs signal processing such as aperture processing.
- the processed digital R, G and B signals are converted to analog R, G and B signals by the digital-to-analog converter 1206.
- the encoder 1207 converts the R, G and B signals to Y signal (luminance signal) and C signal (C signal).
- the VCR circuit 1208 records them in a video tape.
- the image sensing device can provide an output picture of good color balance and rich gradation expression for all objects from back-lit object to front-lit object without deteriorating gradation. Still further, the contrast at high luminance is preserved for a back-lit object.
- the gradation at high luminance is deteriorated.
- gradation correction is performed in the unit of pixel by changing the gradation correction characteristic according to the average luminance Ya. Then, the gradation correction keeps contrast even if the slope of the correction gain is small, and output signals of rich gradation expression can be obtained.
- a natural picture can be provided with use of gradation correction.
- Fig. 20 shows a block diagram of a gradation correction device according to a fourth embodiment of the present invention.
- the gradation correction device includes a feature quantity extraction circuit 1401, a correction coefficient determination circuit 1402, a correction gain generation circuit 1403, a correction circuit 1404, delays 1405 and multipliers 1406.
- This gradation correction device is different from that shown in Fig. 4 in that a matrix circuit is omitted because input picture signal includes luminance and color signals.
- a luminance signal Y and color difference signals R-Y, B-Y are received by the gradation correction device. Therefore, a matrix circuit for calculating luminous signal can be omitted because the luminance signal Y is received.
- the functions of a feature quantity extraction circuit 1401, a correction coefficient determination circuit 1402, a correction gain generation circuit 1403 and a gradation correction means 1404 are similar to the counterparts in the first embodiment. That is, the luminance signal Y to the feature quantity extraction circuit 1401 and to the correction gain generation circuit 1403.
- the feature quantity extraction circuit 1401 extracts features of pixels of low, middle and high luminance sections of the luminance signal Y and supplies them to the correction coefficient determination circuit 1402.
- the circuit 1402 decides a gradation correction characteristic most appropriate to the input picture signals and sends a correction coefficient to the gradation gain generation circuit 1403.
- the circuit 1403 outputs a correction gain according to the luminance signal Y and the correction coefficient to the correction circuit 1404.
- the delay circuits 1405 adjust the timings of input picture signals and the multipliers 1406 multiply the picture signals with the correction gain to send corrected luminance signal Y' and color difference signals (R-Y)' and (B-Y)'.
- an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit object to front-lit object without deteriorating gradation.
- R, G and B signals or luminance signal and color difference signals are used as input digital picture signals.
- other signals which vary with luminance can also be used as input digital picture signals.
- Such signals include a composite signal or a signal synthesized from the luminance and color signals.
- the correction circuit multiplies each of input picture signals with the correction gain.
- a correction value (Y-Y') is calculated and gradation is corrected by adding the correction value (Y-Y') to each of the input picture signals, instead of the above-mentioned multiplication with the correction gain (Y'/Y).
- a correction difference circuit is provided to calculate (Y-Y') instead of the correction gain circuit 104 and adders are used for the addition of (Y-Y') instead of the multipliers 107 provided in the correction circuit 105.
- an input picture signal is converted to an 8-bit digital signal.
- the bit number for quantization may be a number different from eight.
- the bit number to be processed in the correction gain generation circuit and the like can be adjusted according to the bit number for quantization.
- a gradation correction device is provided for gradation correction in a camcorder. Therefore, gradation correction device receives input picture signals from the solid state image sensor 201 through the analog circuit 202.
- a different recording medium can also be used to provide input picture signals: for example, a laser disc, a video tape, a magnetic disc or the like for analog picture recording and a magnetic disc such as a hard disc or an optical disc for a digital recording after analog-to-digital conversion.
- input recording signals are supplied from such a recording medium.
- the gradation correction device of the invention can be applied to any recording medium which stores a 1-frame or a 1-field picture data, wherein the solid state image sensor 201 and the analog circuit 202 can be replaced with an appropriate device.
- the correction coefficient determination circuit decides the correction coefficient of input picture signals according to a luminance histogram.
- other feature quantities which can classify a picture or which reflect luminance level distribution may be used instead of the luminance histogram.
- each histogram of red (R), green (G) and blue(B) signals, or one of them (say green (G)) can used.
- the correction coefficient determination circuit can use any process for determining an appropriate gradation correction characteristic from input picture signals.
- a neural network or fuzzy control can be used to determine appropriate gradation correction characteristic besides the above-mentioned template matching.
- a gradation correction circuit according to the present invention and of an image sensing device therewith that it can determine a most suitable gradation correction characteristic automatically by deciding a picture according to feature quantities obtained from input picture signals.
- extreme black or white can be prevented in a reproduced picture, and an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit object to front-lit object without deteriorating gradation.
Abstract
a gradation correction characteristic determination means (1106) for determining a gradation correction characteristic based on the feature quantities received from the feature quantity extraction means, which gradation correction characteristic defining an output signal for an input signal; and
a correction means for correcting each of the input digital picture signals by using the gradation correction characteristic determined by the gradation correction characteristic determination means;
whereby the gradation correction characteristic for the input picture digital signals is varied according to features thereof.
Description
- The present invention relates to a gradation correction device for correcting gradation of input picture signals and a device therewith such as a camcorder or a video printer.
- When a dark object is taken in a picture with a camcorder or the like, the object in an output picture becomes darkened with poor gradation. In particular, when a back-lit object is taken in a picture, extreme black or white portions appear in the picture and an output picture becomes unnatural. Therefore, a gradation correction device is needed to be installed in a camcorder or the like which processes picture signals of a 1-field picture.
- Many gradation correction circuits have been developed. For example, a prior art gradation correction circuit is disclosed in Japanese Patent laid open Publication No. 125,589/1990 on the correction of image quality of an image sensing device. In the gradation correction circuit, a luminance signal Y is first attenuated and next amplified nonlinearly. A nonlinear portion is extracted from amplified signal and added to the luminance signal Y. Thus, half-tone signals are emphasized while signals of high and low luminances are preserved. Thus, the image quality of a main object and background under back light can be improved.
- However, in the above-mentioned prior art, only intermediate luminance levels are expanded. Therefore, it is a problem for a strongly back-lit object that gradation becomes poor between intermediate and high levels of picture signals. Further, though image quality can be increased a little for an object under back light, gradation for a front-lit object or for an object having gradation ranging from low to high levels becomes poor in some portions or an output image becomes unnatural.
- A second prior art gradation correction circuit is disclosed in Japanese Patent laid open Publication No. 206282/1990. In the above-mentioned circuit, image signals are divided into predetermined ranges of signal levels, and an average or an integrated value of image signals in each level range is detected. A gain control data ROM has stored a gain or attenuation amount for a gamma correction controller in correspondence to the average of image signals in each level range. By controlling the gamma correction characteristic in correspondence to the output signal of the gain control data ROM, extreme white or black portions can be prevented to appear in an output picture.
- In the above-mentioned second prior art, the deterioration of image due to extreme black portions can be prevented by increasing the gain at low luminance, while the deterioration of image at extreme white portions can be prevented by controlling the attenuation at intermediate and high luminances. However, it is a problem that gradation at high luminance becomes poor. Further, though gradation correction characteristic has to be changed for front-lit objects and for back-lit objects, it is not easy to change gradation correction characteristic for front-lit objects and for back-lit objects. It is also a problem that an output picture becomes unstable and unnatural if the prior art gradation correction circuit is applied to a video camera which deals a moving picture.
- An object of the present invention is to provide a gradation correction device which can supply an output image of good gradation expression in an entire picture for a front-lit object and for a back-lit object.
- Another object of the present invention is to provide a gradation correction device which can vary gradation characteristic easily for various kinds of pictures for example a back-lit object or a front-lit object.
- Still another object of the present invention is to provide a gradation correction device which can correct gradation of a moving picture.
- A further object of the present invention is to provide an image sensing device with a gradation correction circuit which can supply an output image of good gradation expression in an entire picture of various kinds of pictures for example a front-lit object and a back-lit object.
- In one aspect of a gradation correction device of the invention, a feature quantity extraction means extracts feature quantities (for example frequency values of a histogram of luminance) from input digital picture signals of a 1-frame picture or of a 1-field picture. The feature quantities reflect luminance level distribution of the input digital picture signals. Then, a gradation correction characteristic is determined based on the feature quantities. A gradation correction characteristic defines an output signal for an input signal. Then, each of the input digital picture signals is corrected by using the gradation correction characteristic. Thus, the gradation correction characteristic for the input digital picture signals is changed naturally for an input picture such as a moving picture according to features thereof. An image sensing device according to the present invention comprises such a gradation correction device. For a moving picture, a gradation correction characteristic is changed preferably only after successive increase or decrease in the correction amount of input picture signals by many times more than a prescribed number of pictures in order to stabilize the gradation correction characteristic even when the input picture signal includes some noise signals.
- In another aspect of a gradation correction device of the present invention, a gradation correction characteristic is determined according to the feature quantities by averaging two prescribed gradation correction characteristic with a weight. The weight is determined according to an input digital picture signal or an average of input digital picture signals. In concrete, a correction coefficient characterizing a gradation correction characteristic used for gradation correction is determined based on the feature quantities, and an input picture signal is corrected by using a gain for the signal determined according to the correction coefficient.
- An advantage of a gradation correction device or an image sensing device therewith is that it can determine a most suitable gradation correction characteristic automatically according to feature quantities obtained from input picture signals.
- Another advantage of a gradation correction device or an image sensing device therewith according to the present invention is that an output picture of good color balance and rich gradation expression can be obtained for every picture from back-lit object to front-lit object without deteriorating gradation and that extreme black or white portions in an output picture can be prevented by using a simple structure.
- Still another advantage of a gradation correction characteristic according to the present invention is that gradation correction can be performed naturally even for a moving picture because gradation correction characteristic can be changed gradually.
- These and other objects and features of the present invention will become clear from the following description taken in conjunction with the preferred embodiments thereof with reference to the accompanying drawings, and in which:
- Fig. 1 is a block diagram of a camcorder using a gradation correction device of a first embodiment of the present invention;
- Fig. 2 is a diagram of a 1-frame image of input picture signals;
- Fig. 3 is a diagram of effective pixels in the 1-frame image;
- Fig. 4 is a block diagram of a gradation correction device in the first embodiment of the present invention;
- Fig. 5 is a diagram of gradation correction characteristic;
- Fig. 6 is a block diagram of a feature quantity extraction circuit;
- Fig. 7 is a histogram of luminance in an example;
- Fig. 8 is a block diagram of a correction coefficient determination circuit;
- Fig. 9 is a block diagram of an internal structure of a correction coefficient table ROM;
- Fig. 10 is a diagram for illustrating the contents of two quantization memories;
- Fig. 11 is a diagram for illustrating the content of a decision memory;
- Fig. 12 is a circuit diagram of a filter;
- Fig. 13 is a block diagram of a gradation correction gain generation circuit of a first embodiment;
- Fig. 14 is a block diagram of a gradation correction gain generation circuit of a second embodiment;
- Fig. 15 is a diagram of gradation correction characteristic and input/output characteristic in the embodiment;
- Fig. 16 is a block diagram of the gradation correction gain generation circuit of a second embodiment;
- Fig. 17 is a block diagram of the functions of an image sensing device which can correct gradation according to a third embodiment of the present invention;
- Fig. 18 is a block diagram of the image sensing device which can correct gradation according to a third embodiment of the present invention;
- Fig. 19 is a flowchart of a process for determining correction coefficients in the third embodiment of the present invention; and
- Fig. 20 is a block diagram of a gradation correction circuit according to a fourth embodiment of the present invention.
- Referring now to the drawings, wherein like reference characters designate like or corresponding parts throughout the views, Fig. 1 shows a block diagram of a camcorder including a
gradation correction device 204 of a first embodiment of the present invention. First, R, G and B signals as input picture signals detected by a solidstate image sensor 201 such as a charge coupled device (CCD) is supplied through ananalog circuit 202 to an analog-to-digital converter 203. Theconverter 203 converts the R, G and B signals to digital data of 0 - 255 level to be supplied to thegradation correction device 204. In thegradation correction device 204, a gradation correction characteristic most appropriate to the input picture signals is determined and gradation correction is performed according thereto. A gradation correction characteristic is referred hereinafter to a relation of output signal against input signal, as shown in Fig. 5. On the corrected R, G and B signals, asignal processor 205 performs signal processing such as aperture processing. The processed digital R, G and B signals are converted to analog R, G and B signals by a digital-to-analog converter 206. Next, anencoder 207 converts the analog R, G and B signals to Y signal (luminance signal) and C signals (color signals) and aVCR circuit 208 records them in a video tape. - Fig. 2 shows an example of a 1-frame picture of input picture signals in a
frame plane 501. This picture shows a person standing in front of a window. Due to strong back-light , the person becomes very dark while a landscape which can be seen through the window becomes very bright. - The number of samples in the
frame plane 501 is 640 points along a horizontal direction and 480 points along a vertical direction. Fig. 3 shows effective pixels in theframe plane 501, wherein effective pixels are represented as open circles (○). The effective pixels selected consists of every other pixel in the horizontal direction and every other line in a central region of 512 pixels in the horizontal direction and 400 lines along a vertical lines. Therefore, the number of samples in the effective area is 256 points along the horizontal direction and 200 points along the vertical direction. - In the above-mentioned example, the effective area consists of 256
points times 200 points. However, the area size or point number of signals for expressing the number of pixels may be selected to be any number large enough to extract features of an input picture, and feature quantities can be extracted by counting the frequencies of pixels in different level ranges in the effective area in a histogram. The bit number of feature quantities or frequencies of pixels may also be any number large enough to express features of a picture. - Fig. 4 shows a block diagram of the
gradation correction device 204. A knownmatrix circuit 101 receives input picture signals and provides luminance signal Y to a featurequantity extraction circuit 102 and to a correctiongain generation circuit 104. The featurequantity extraction circuit 102 extracts feature quantities from the luminance signals Y in the above-mentioned effective area. The feature quantities which are used to determine gradation correction characteristic are defined to represent the kind of a picture. In the present embodiment, the feature quantities represent level distribution of the luminance signals Y in the effective pixels of 256 * 200 dots. Then, a correctioncoefficient determination circuit 103 determines a gradation correction characteristic appropriate for the input digital picture signals of the picture according to the extracted feature quantities. In concrete, the correctioncoefficient determination circuit 103 determines a correction coefficient characterizing the appropriate gradation correction characteristic and the correction coefficient is used to correct the input picture signals. Then, input digital picture signals are corrected according to the appropriate gradation correction characteristic. That is, first, the correctiongain generation circuit 104 receives the luminance signal Y and the correction coefficient received from the correctioncoefficient determination circuit 103 and sends a correction gain (Y'/Y) to acorrection circuit 105. Finally, thecorrection circuit 105 adjusts the timing of the R, G and B signals with the correction gain bydelays 106 by a delay time for calculating the gradation correction characteristic, and it multiplies them with the correction gain (Y'/Y) by themultipliers 107 to supply R', G' and B' signals after gradation correction to thesignal processor 205. Thus, by using the correction gain commonly for the digital R, G and B signals, an output picture of good color balance and rich gradation expression can be supplied. Though thedelays 106 are used for timing control in thecircuit 105, 1-field or 1-frame memories may be used instead of thedelays 106. In such a case, a same picture is read twice. As explained below, it is a characteristic of thegradation correction device 204 that it processes digital data. Thus, it is relatively easy to change gradation characteristic according to the features of various kinds of a picture. - In the
gradation correction device 204 of the present embodiment, gradation correction characteristic is determined automatically according to feature quantities extracted from input digital picture signals. The gradation correction characteristic represents a relation of output level against input level of picture signals. Fig. 5 shows gradation correction characteristic in the present embodiment, wherein reference sign Y1 denotes a first gradation correction characteristic and reference sign Y2 denotes a second gradation correction characteristic. In the present embodiment, a corrected value of input picture signal can easily be obtained, as will be explained later, by using the gradation correction coefficient which characterizes an interpolation characteristic between the two Y1 and Y2. Therefore, an output picture of good color balance and rich gradation expression can be supplied for all objects from a back-lit object to a front-lit object without deteriorating gradation. - The
gradation correction device 204 is explained in detail below. Thematrix circuit 101 receives R, G and B digital signals of levels 0 - 255 as input picture signals. Ifmatrix circuit 101 calculates luminance signal Y from R, G and B signals. The luminance signal Y can be obtained for example by using a following relation:
The luminance Y ranges also between 0 and 255. The luminance Y is supplied to the featurequantity extraction circuit 102 and to the correctiongain generation circuit 103. - Fig. 6 shows the feature
quantity extraction circuit 102 for extracting feature quantities from the luminance signals Y of a picture. In this example, frequencies of luminance signal at three sections of low, middle and high luminances are counted over an effective area in a 1-frame picture, and the frequencies are used as feature quantities. In particular, the input luminance signal Y is compared with first and second threshold values by acomparator 701. If the luminance signal Y is smaller than the first threshold value, a count signal for low luminance section is supplied to a first counter 702. If the luminance signal Y is between the first and second threshold values, a count signal for middle luminance section is supplied to asecond counter 703. If the luminance signal is larger than the second threshold value, a count signal for high luminance section is supplied to a third counter 704. Thus, thecounters 702, 703 and 704 provide the frequencies of low, middle and high luminance sections for an effective area. - Fig. 7 shows an example of a histogram of luminance obtained by the feature
quantity extraction circuit 102. A histogram "a" obtained by counting frequencies at each luminance level is illustrated for comparison. Reference signs "b", "c" and "d" denote frequencies of pixels of low luminance section from 0 to 63, of middle luminance section from 64 to 191 and of high luminance section from 192 to 255, respectively. The histogram shown in Fig. 7 has two peaks at low and high luminance sections larger than the number at middle luminance section. Therefore, it is guessed that this picture is taken for a back-lit object. - In the example explained above, the feature
quantity extraction circuit 102 provides frequencies of pixels for three luminance levels. The two threshold values for determining sections for extraction can be changed suitably. The number of luminance level sections may also be different from three. - Fig. 8 shows a correction
coefficient determination circuit 103. A correctioncoefficient table ROM 801 stores correction coefficients for a front-lit object, for a back-lit object, for a dark object and the like while receiving frequencies of pixels of low, middle and high luminance sections as input signals. Therefore, when the three frequencies of pixels of low, middle and high luminance sections are received by the correctioncoefficient table ROM 801 from the featurequantity extraction circuit 102, a correction coefficient is determined for gradation correction of an input picture. The correction coefficient is filtered by thefilter 802 so as to keep gradation continuity of moving pictures with respect to previous frames, as will be explained later. - Fig. 9 shows an internal structure of an example of the correction
coefficient table ROM 801 including anM-L calculator 13, afirst quantization memory 14, asecond quantization memory 15, adecision memory 16 and abit shift circuit 42 for shifting 6-bit data to the left. This combination of thememories M-L calculator 13 receives 16-bit data of the frequencies of pixels of low, middle and high luminance sections and generates values L, M and H as most significant 8-bit data of the 16-bit data. It also calculatesquantization memories - Fig. 10 shows an example of the contents of the
quantization memories first quantization memory 14 provides "0" ifmemories first quantization memory 14 is 128 bytes (or 256words times 4 bits), while that of thesecond one 15 is 96 bytes (or 256words times 3 bits). - Fig. 11 shows the content of the
decision memory 16. Thedecision memory 16 receives the 4-bit quantization value from thefirst quantization memory 14 and the 3-bit quantization value from thesecond one 15 as a 7-bit address signal, and it provides a 5-bit parameter (Γ) in correspondence to the address. For example, if "0" is received from thefirst quantization memory 14 and "0" is also received from thesecond one 15, thedecision memory 16 provides "-4.0". It is shown that an output value increases from -4.0 to +4.0 from a back-lit object (M/4 < L/2) to a front-lit object (M/4 > L/2). It is also shown that an output value increases with increasing H. The capacity of thedecision memory 16 is 80 bytes (or 128words times 5 bits). - As explained above, the correction
coefficient table ROM 801 includes series connection of thequantization memories decision memory 16. Therefore, the memory capacity becomes as small as - Fig. 12 shows a circuit diagram of the
filter 802 in detail. Asynchronous pulse generator 37 generates pulse signals (VD) and master clock signals (fck), both having rising edges in synchronization with the start of a frame. Further,reference numeral 18 denotes a comparator,reference numerals reference numerals subtractor 30 receives a 5-bit parameter Γ from the correctioncoefficient table ROM 801 and the correction coefficient (γ) for the previous frame held in acorrection gamma register 17 and calculates a difference (Γ - γ). A shift bit number counter 32 counts master clock signals, and a shiftbit number comparator 33 compares the count of thecounter 32 with a number set in a shiftbit number register 31 and supplied shift clocks to ashift register 35. Theshift register 35 shifts the difference (Γ - γ) to right by a bit number set in the shiftbit number register 31. Anadder 36 adds the γ of the previous frame with the shifted difference (Γ - γ) and supplies a sum to thecorrection gamma register 17 to update the correction coefficient for each frame. Thus, if the difference (Γ - γ) is large, the correction coefficient changes much, while if the difference (Γ - γ) is small, the correction coefficient changes little. In other words, a change amount of correction coefficient varies with the difference. - On the other hand, a plus frame number counter 19 counts a number of frames which has Γ larger than γ continuously, while a minus frame number counter 20 counts a number of frames which has Γ smaller than γ continuously. A plus frame number comparator 27 and a minus
frame number comparator 28 compare the counts in the plus and minus frame number counters 19 and 20 with the inoperative frame number set previously in a register 26, respectively. If the number set in the inoperative frame number register 26 is smaller than the values set in the plus and minus frame number counters 19 and 20, theshift register 35 is cleared according to a pulse signal received from aNAND gate 29, and theadder 36 provides the same correction coefficient as that of the previous frame. Thus, the correction coefficient does not change until frames of Γ > γ or Γ < γ continue by more than the inoperative frame number. - Fig. 13 shows a block diagram of the gradation correction
gain generation circuit 104 of the first embodiment including a first gradation correctioncharacteristic circuit 301, a second gradation correctioncharacteristic circuit 302, anadder 303 and a weightedaverage circuit 304. An input luminance signal Y is supplied to the first and second gradation correctioncharacteristic circuits characteristic circuit 301, a first correction gain (Y1/Y) is sent according to the input luminance signal Y and Y1 obtained from a first gradation correction characteristic. Similarly, in the second gradation correctioncharacteristic circuit 302, a second correction gain (Y2/Y) is sent according to the input luminance signal Y and Y2 obtained from a second gradation correction characteristic. On the other hand, theadder 303 adds the luminance signal Y with the correction coefficient γ to send the sum as a signal X:
Finally, the weightedaverage circuit 304 averages the first and second correction gains with a weight according to Equation (3) including a signal X and sends a correction gain (Y'/Y):
In the present embodiment, the first correction gain (Y1/Y) follows Equation (4) while the second correction gain (Y2/Y) follows Equation (5).
Fig. 5 shows gradation correction characteristics used in the present embodiment, wherein Y1 and Y2 denote the first and second gradation correction characteristics, respectively. For example, if the correction coefficient supplied from thedetermination circuit 103 is zero, the gradation correction characteristic is represented as "a". If the correction coefficient is positive, the gradation correction characteristic decreases below the characteristic "a", as illustrated for example as "c". If the correction coefficient is negative, the gradation correction characteristic increases above the characteristic "a", as illustrated for example as "b". Thus, by changing the gradation correction coefficient, the gradation correction characteristic can easily be changed gradually and continuously. By decreasing the correction coefficient, the correction gain at low and middle luminances increases gradually, and finally it is enhanced in the entire range. Therefore, every object can be corrected to express rich gradation by using for example the gradation correction characteristic "Y2" for a front-lit object, the gradation correction characteristic "a" for a back-lit object and the gradation correction characteristic "Y1" for a dark object. - As explained above, the correction
gain generation circuit 104 generates the correction gain for an input picture signal by using the correction coefficient, and the correction gain is used in thecorrection circuit 105 to correct the input picture signal by multiplying it with the correction gain. It is to be noted on the correctiongain generation circuit 104 that it does not need ROMs or the like to store a plurality of kinds of gradation correction characteristics, and the scale of the circuit can be made very compact. Still further, because a gradation correction characteristic can be generated for front-lit and back-lit objects by changing the correction coefficient, an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit object to front-lit object without deteriorating gradation. Still further, because the gradation correction characteristic can be changed gradually and continuously, gradation correction can be performed naturally even for a moving picture. Still further, the contrast at high luminance is preserved by the gradation correction characteristic "a" in Fig. 5 for back-lit object. On the other hand, in a prior art so-called auto-knee control, the gradation at high luminance is deteriorated. - Next, a second embodiment of the
gradation correction device 204 is explained. It is similar to the first embodiment except the correction gain generation circuit 104'. Fig. 14 shows a block diagram of the gradation correction gain generation circuit 104' of this embodiment This circuit is different from that of the first example shown in Fig. 13 in that an average detection circuit (low pass filter) 1305 is provided newly to generate a weight. An input luminance signal Y is supplied to first and second gradation correctioncharacteristic circuits characteristic circuit 1301, a first correction gain (Y1/Y) is sent according to the input luminance signal Y. Similarly, in the second gradation correctioncharacteristic circuit 1302, a second correction gain (Y2/Y) is sent according to the input luminance signal Y. On the other hand, the average detection circuit (LPF) 1305 obtains an average luminance Ya from luminance signals Y. That is, it averages luminance signals of say three or five pixels around a pixel of interest. Anadder 1303 adds the average luminance Ya with the correction coefficient γ to supply a signal X:
Finally, a weightedaverage circuit 1304 averages the first and second correction gains with a weight determined according to Equation (2') by using the signal X and supplies a correction gain (Y'/Y) to thecorrection circuit 105. - Fig. 15 illustrates gradation correction characteristics and input/output characteristic in an example. In an example shown in Fig. 15, when input picture signals along a horizontal line has a stepwise edge, output picture signals show edge emphasis. If the average luminance Ya obtained by the average detection circuit (LPF) 1305 is equal to a luminance signal Y of a pixel of interest, the gradation characteristic "a" shown in Fig. 15 is adopted. If the average luminance Ya is smaller than a luminance signal Y of a pixel of interest, the gradation characteristic "b" shown in Fig. 15 is adopted. If the average luminance Ya is larger than a luminance signal Y of a pixel of interest, the gradation characteristic "c" shown in Fig. 15 is adopted. Thus, the gradation correction characteristic can be changed for each pixel appropriately. Even if a gradation correction characteristic curve has a small slope, the contrast of an output picture is good, and output signals can express gradation richly.
- Fig. 16 shows a block diagram of an example of the gradation correction gain generation circuit 104'. The circuit calculates Equations (2'), (3), (4) and (5). The second gradation correction
characteristic circuit 1402 in this example provides a second correction gain Y2/Y = 1 according to the gradation correction characteristic shown in Fig. 5. - Next, the correction gain generation circuit 104' is explained further. The circuit is simplified by using bit shift for multiplication or division of 255 and the like. First, when a luminance signal Y is received, an average Ya is obtained by an average detection circuit (low pass filter) 401. Next, a
first adder 402 adds the average luminance Ya with the correction coefficient. Aclip circuit 403 clips an output signal of the first adder with a value "0" for smaller values and with a value "255" for larger values. On the other hand, the luminous signal Y is delayed via adelay 400 for synchronization and a signal 2Y obtained by one-bit shift of Y are received by asecond adder 404, and a signal 2Y is added with Y to send a signal 3Y of three times Y. Further, afirst multiplier 405 multiplies the luminance signal Y twice to generate a luminance signal Y². Athird adder 406 adds the output of thefirst multiplier 405 with a value "3". Next, afirst subtractor 407 subtracts the output signal "Y² + 3" of thethird adder 406 with "3Y" of thesecond adder 404. The first gradation correctioncharacteristic circuit 1301 of this example consists of thesecond adder 404, thefirst multiplier 405, thethird adder 406 and thefirst subtractor 407. Then, thesecond subtractor 409 subtracts the output signal of theclip circuit 403 from "255". Then, asecond multiplier 408 multiplies the output signal of asecond subtractor 409 with that of thefirst subtractor 407. Finally, afourth adder 410 adds the output signal of theclip circuit 403 with that of thesecond multiplier 408 to send a product as a correction gain. The weighted average circuit 1404 consists of thesecond multiplier 408, thesecond subtractor 409 and thefourth adder 410. - As explained above, the correction gain is controlled according the correction coefficient with use of the gradation correction characteristics shown in Figs. 5 and 15. Because a gradation correction characteristic can be generated for every object by changing the correction coefficient, an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit objects to front-lit objects without deteriorating gradation.
- In particular, the
average detection circuit 1305 averages input luminance signals including an input luminance signal of interest and input luminance signals thereabout. In other words, thecircuit 1305 outputs an average of luminance signals around the input luminance signal of interest. Therefore, the luminance is corrected smaller or larger if the average luminance is larger or smaller. Therefore, even the gradation correction keeps contrast even if the slope of the gradation correction characteristic is small and output signals of rich gradation expression can be obtained. - The above-mentioned correction gain generation circuit 104' generates the correction gain by using the correction coefficient without ROMs and the like to store a plurality of kinds of gradation correction characteristics. Therefore, the scale of the circuit can be made very compact. Still further, the contrast at high luminance is preserved for a back-lit object. On the other hand, in a prior art so-called auto-knee control, the gradation at high luminance is deteriorated. Further, gradation correction is performed in the unit of pixel by changing the gradation correction characteristic suitably according to the average luminance Ya. Therefore, the gradation correction keeps contrast even if the slope of the gradation correction characteristic is small, and output signals of rich gradation expression can be obtained.
- Fig. 17 shows a block diagram of an image sensing device which can correct gradation according to a third embodiment of the present invention. This device is similar to that of the first embodiment shown in Fig. 1 except that feature extraction and correction determination are carried out by using a software program. First, R, G and B signals as input picture signals are sensed by a solid
state image sensor 1101 through ananalog circuit 1102. The R, G and B signals are converted by an analog-to-digital converter 1103 to digital data of 0 - 255, which are supplied as input picture signals to amatrix circuit 1104 and to the gradation correction means 1108. Amatrix circuit 1104 calculates a luminance signal Y from the digital R, G and B signals, and it supplies the luminance signal Y to a feature quantity extraction means 1105 for extracting feature quantities and to a correction gain generation means 1107 for generating a correction gain. The feature quantity extraction means 1105 extracts features of pixels of low, middle and high luminance sections of the luminance signal Y and supplies them as feature quantities to a correction coefficient determination means 1106. This means 1106 decides a gradation correction characteristic most appropriate to the input picture signal and sends a gradation correction coefficient characterizing the gradation correction characteristic. A correction gain generation means 1107 outputs a correction gain according to the luminance signal Y and the correction coefficient, and a gradation correction means 1108 multiplies the input picture signals with the correction gain for gradation correction. On the corrected R, G and B signals, thesignal processor 1109 performs signal processing such as aperture processing. The processed digital R, G and B signals are converted to analog R, G and B signals by a digital-to-analog converter 1110. Next, anencoder 1111 converts the R, G and B signals to Y signal (luminance signal) and C signal (C signal). Finally, aVCR circuit 1112 records them in a video tape. - Fig. 18 shows a block diagram of an image sensing device of an example according to a third embodiment of the present invention, wherein a solid
state image sensor 1201, an analog circuit 1202, an analog-to-digital (A/D)converter 1203, agradation correction circuit 1204, asignal processor 1205, a digital-to-analog (D/A)converter 1206, anencoder 1207 and aVCR circuit 1208 are similar to the counterparts shown in Fig. 17. First, R, G and B signals as input picture signals are sensed by the solidstate image sensor 1101 through the analog circuit 1202. The R, G and B signals are converted by the analog-to-digital converter 1203 to digital data of 0 - 255 level, which are supplied as input picture signals to a histogram generation means 1209 and to a gradation correction means 1204. The histogram generation means 1209 calculates a luminance signal Y from the R, G and B signals to generates frequencies of pixels of low, middle and high luminance sections for a 1-frame of an effective picture plane to extract feature quantities. Amicroprocessor 1212 is connected via abus 1215 to aROM 1213, aRAM 1214, an input means 1210 such as a key board and a correctiongain generation circuit 1211. TheROM 1213 stores templates which includes features of gradation correction characteristic, while theRAM 1214 stores the numbers of pixels of low, middle and high luminances received from the histogram generation means 1209. Themicroprocessor 1212 determines a correction coefficient according to a flowchart shown in Fig. 19. - Next, it is explained how the
microprocessor 1212 determines the gradation correction characteristic by using template matching with reference to Fig. 19. First, the frequencies of pixels of low, middle and high luminance sections are read from the histogram generation means 1209 and stored in the RAM 1214 (step S10). Next, the distances of the numbers stored in theRAM 1214 from templates stored in theROM 1213 are calculated (step S12). The templates represent gradation correction characteristics to be selected according to feature quantities of input picture signals. Next, a gradation correction characteristic of the shortest distance is determined (step S14). Finally, a processing is performed for keeping gradation continuity with the gradation correction characteristic of a previous field. Then, a correction coefficient is sent for the correction gain generation circuit 1211 (step S16). - The correction
gain generation circuit 1211 averages the first and second gradation correction characteristics with a weight according to a sum of the average of the input luminance signal and the correction coefficient and supplies a correction gain to thegradation correction circuit 1204. Thecircuit 1204 adjusts the timing of the R, G and B signals according to the correction gain, and multiplies each of the R, G and B signals with the correction gain to send corrected R, G and B signals after gradation correction. On the corrected R, G and B signals, thesignal processor 1205 performs signal processing such as aperture processing. The processed digital R, G and B signals are converted to analog R, G and B signals by the digital-to-analog converter 1206. Next, theencoder 1207 converts the R, G and B signals to Y signal (luminance signal) and C signal (C signal). Finally, theVCR circuit 1208 records them in a video tape. - As in the previous embodiments, the image sensing device according to the present embodiment can provide an output picture of good color balance and rich gradation expression for all objects from back-lit object to front-lit object without deteriorating gradation. Still further, the contrast at high luminance is preserved for a back-lit object. On the other hand, in a prior art so-called auto-knee control, the gradation at high luminance is deteriorated. Preferably, gradation correction is performed in the unit of pixel by changing the gradation correction characteristic according to the average luminance Ya. Then, the gradation correction keeps contrast even if the slope of the correction gain is small, and output signals of rich gradation expression can be obtained. When a moving picture is corrected, a natural picture can be provided with use of gradation correction.
- Fig. 20 shows a block diagram of a gradation correction device according to a fourth embodiment of the present invention. The gradation correction device includes a feature
quantity extraction circuit 1401, a correctioncoefficient determination circuit 1402, a correctiongain generation circuit 1403, a correction circuit 1404,delays 1405 andmultipliers 1406. This gradation correction device is different from that shown in Fig. 4 in that a matrix circuit is omitted because input picture signal includes luminance and color signals. - Next, the gradation correction circuit of the fourth embodiment is explained. A luminance signal Y and color difference signals R-Y, B-Y are received by the gradation correction device. Therefore, a matrix circuit for calculating luminous signal can be omitted because the luminance signal Y is received. The functions of a feature
quantity extraction circuit 1401, a correctioncoefficient determination circuit 1402, a correctiongain generation circuit 1403 and a gradation correction means 1404 are similar to the counterparts in the first embodiment. That is, the luminance signal Y to the featurequantity extraction circuit 1401 and to the correctiongain generation circuit 1403. The featurequantity extraction circuit 1401 extracts features of pixels of low, middle and high luminance sections of the luminance signal Y and supplies them to the correctioncoefficient determination circuit 1402. Thecircuit 1402 decides a gradation correction characteristic most appropriate to the input picture signals and sends a correction coefficient to the gradationgain generation circuit 1403. Thecircuit 1403 outputs a correction gain according to the luminance signal Y and the correction coefficient to the correction circuit 1404. Then, in the gradation correction means 1404, thedelay circuits 1405 adjust the timings of input picture signals and themultipliers 1406 multiply the picture signals with the correction gain to send corrected luminance signal Y' and color difference signals (R-Y)' and (B-Y)'. Similarly to in previous embodiments, an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit object to front-lit object without deteriorating gradation. - The above-mentioned embodiments can be varied in many ways. For example, in the above-mentioned embodiments, R, G and B signals or luminance signal and color difference signals are used as input digital picture signals. However, other signals which vary with luminance can also be used as input digital picture signals. Such signals include a composite signal or a signal synthesized from the luminance and color signals.
- In the embodiments mentioned above, the correction circuit multiplies each of input picture signals with the correction gain. However, in a modified example, a correction value (Y-Y') is calculated and gradation is corrected by adding the correction value (Y-Y') to each of the input picture signals, instead of the above-mentioned multiplication with the correction gain (Y'/Y). In this case, a correction difference circuit is provided to calculate (Y-Y') instead of the
correction gain circuit 104 and adders are used for the addition of (Y-Y') instead of themultipliers 107 provided in thecorrection circuit 105. - In the embodiments explained above, an input picture signal is converted to an 8-bit digital signal. However, the bit number for quantization may be a number different from eight. The bit number to be processed in the correction gain generation circuit and the like can be adjusted according to the bit number for quantization.
- In the embodiments described above, a gradation correction device is provided for gradation correction in a camcorder. Therefore, gradation correction device receives input picture signals from the solid
state image sensor 201 through theanalog circuit 202. However, a different recording medium can also be used to provide input picture signals: for example, a laser disc, a video tape, a magnetic disc or the like for analog picture recording and a magnetic disc such as a hard disc or an optical disc for a digital recording after analog-to-digital conversion. In other words, input recording signals are supplied from such a recording medium. The gradation correction device of the invention can be applied to any recording medium which stores a 1-frame or a 1-field picture data, wherein the solidstate image sensor 201 and theanalog circuit 202 can be replaced with an appropriate device. - In the embodiments explained above, the correction coefficient determination circuit decides the correction coefficient of input picture signals according to a luminance histogram. However, other feature quantities which can classify a picture or which reflect luminance level distribution may be used instead of the luminance histogram. For example, each histogram of red (R), green (G) and blue(B) signals, or one of them (say green (G)) can used. Further, if an effective picture area of picture data is divided into a plurality of blocks, a maximum, an average, a minimum and the like of luminance signal, R, G and B signals or color difference signals may be extracted in each block. For example, if a picture plane is divided into 4 * 4 = 16 blocks and a maximum, an average and a minimum in each block are determined, 48 data are extracted from a picture. Then, these data may be used to decide features of the picture.
- The correction coefficient determination circuit can use any process for determining an appropriate gradation correction characteristic from input picture signals. For example, a neural network or fuzzy control can be used to determine appropriate gradation correction characteristic besides the above-mentioned template matching.
- As explained above, it is an advantage of a gradation correction circuit according to the present invention and of an image sensing device therewith that it can determine a most suitable gradation correction characteristic automatically by deciding a picture according to feature quantities obtained from input picture signals. By using such a simple structure, extreme black or white can be prevented in a reproduced picture, and an output picture of good color balance and rich gradation expression can be obtained for all objects from back-lit object to front-lit object without deteriorating gradation. Further, it is also an advantage of the present invention that because gradation correction characteristic can be changed gradually and continuously, gradation correction can be performed naturally even for a moving picture.
- Although the present invention has been fully described in connection with the preferred embodiments thereof with reference to the accompanying drawings, it is to be noted that various changes and modifications are apparent to those skilled in the art. Such changes and modifications are to be understood as included within the scope of the present invention as defined by the appended claims unless they depart therefrom.
Claims (19)
- A gradation correction device comprising:
a feature quantity extraction means for extracting feature quantities from input digital picture signals of a picture, which feature quantities reflecting luminance level distribution of the input digital picture signals;
a gradation correction characteristic determination means for determining a gradation correction characteristic based on the feature quantities received from the feature quantity extraction means, which gradation correction characteristic defining an output signal for an input signal; and
a correction means for correcting each of the input digital picture signals by using the gradation correction characteristic determined by the gradation correction characteristic determination means;
whereby the gradation correction characteristic for the input picture digital signals is varied according to features thereof. - The gradation correction device according to Claim 1, wherein said input picture signals comprise a luminance signal and color difference signals.
- The gradation correction device according to Claim 1, further comprising a luminance signal generation means for separating or synthesizing the luminance signal from the input digital picture signals.
- The gradation correction device according to Claim 3, wherein said luminance signal generation means comprises a matrix circuit for generating the luminance signal from R, G and B signals.
- The gradation correction device according to Claim 1, wherein said feature quantity extraction means determines the luminance level distribution by calculating a histogram of the luminance signals of the picture, the luminance signals being classified into a plurality of sections, frequency values of the sections being used as said feature quantities.
- The gradation correction device according to Claim 5, wherein a number of said sections is three.
- The gradation correction device according to Claim 1, wherein sad gradation correction characteristic determination means determines a gradation correction characteristic by averaging two prescribed gradation correction characteristic with a weight determined according to the feature quantities received from said feature quantity extraction means.
- The gradation correction device according to Claim 1, said gradation correction characteristic determination means comprising a correction coefficient determination means comprising:
a quantization means for quantizing the feature quantities received from said feature quantity extraction means; and
a table means for providing a correction coefficient to determine the gradation correction characteristic according to quantized values quantized by the quantization means. - The gradation correction circuit according to Claim 8, said correction coefficient determination means further comprising:
a memory means for storing a correction coefficient in a previous picture
a counting means for counting a number of successive pictures where the correction coefficient received from said table means is successively greater than or successively less than the correction coefficient stored in the memory means; and
an updating means for determining the correction coefficient to be sent to said correction means according to the number of successive pictures received from said counting means. - The gradation correction circuit according to Claim 8, said correction coefficient determination means further comprising:
a memory means for storing a correction coefficient in a previous picture; and
an updating means for determining the correction coefficient to be sent to said correction means according to a difference of the correction coefficient received from said table means with the correction coefficient stored in the memory means. - The gradation correction device according to Claim 1, said correction means comprising:
a correction gain generation means for generating a correction gain for the input digital picture signals according to the input digital picture signals and the correction coefficient determined by said gradation correction characteristic determination means; and
a multiplication means for multiplying the input digital picture signals with the correction gain received from the correction gain generation means. - The gradation correction device according to Claim 11, said correction gain generation means comprising:
a first means for generating a first output value of a first gradation correction characteristic for an input digital picture signal;
a second means for generating a second output value of a second gradation correction characteristic for the input digital picture signal;
an adder means for adding the input digital picture signal and the correction coefficient determined by said gradation correction characteristic determination means to provide a weight; and
a weighted average means for determining the correction gain by averaging the first and second output values with the weight. - The gradation correction device according to Claim 11, said correction gain generation means comprising:
a first means for generating an output value of a first gradation correction characteristic for an input digital picture signal;
a second means for generating an output value of a second gradation correction characteristic for the input digital picture signal;
an average means for obtaining an average of input digital picture signals including the input digital picture signal and those thereabout;
an adder means for adding the average received from the average means and the correction coefficient determined by said gradation correction characteristic determination means to provide a weight; and
a weighted average means for determining the correction gain by averaging the two output values with the weight. - The gradation correction circuit according to Claim 12, wherein said first gradation characteristic Y1 of the input picture signal Y changes according to a following cubic equation:
wherein "a" is a constant, and said second gradation characteristic Y2 changes according to a following linear equation:
wherein "b" is a constant. - The gradation correction circuit according to Claim 13, wherein said first gradation characteristic Y1 changes with the input picture signal Y according to a following cubic equation:
wherein "a" is a constant, and said second gradation characteristic Y2 changes with the input picture signal Y according to a following linear equation:
wherein "b" is a constant. - The gradation correction circuit according to Claim 11, said correction gain generation means comprising:
an average detection circuit for obtaining an average Ya of an input picture signal Y and input digital picture signals thereabout;
a first adder for adding the average Ya with said correction coefficient;
a clip circuit for clipping an output signal of the first adder with a value "0" and a maximum level of the input picture signal Y;
a second adder for adding the input picture signal Y to provide 3Y;
a first multiplier for multiplying the input picture signal Y two times to provide Y²;
a third adder for adding an output signal of the first multiplier to a constant;
a first subtractor for subtracting an output signal of the second adder from an output signal of the third adder;
a second subtractor for subtracting an output signal of the clip circuit from the maximum level of the input picture signal;
a second multiplier for multiplying an output signal of the first subtractor with an output signal of the second subtractor; and
a fourth adder for adding an output signal of the clip circuit with an output signal of the second multiplier to provide the correction gain. - The gradation correction device according to Claim 1, said correction means comprising:
a correction difference generation means for generating a correction difference of a corrected signal from the input digital picture signals, which corrected signal being calculated according to the input digital picture signals and the correction coefficient determined by said gradation correction characteristic determination means; and
an adder means for adding the input digital picture signals with the correction difference received from the correction difference generation means. - An image sensing device comprising:
an image sensor means for detecting input picture signals of a picture and for providing input digital picture signals;
a feature quantity extraction means for extracting feature quantities from the input digital picture signals of a picture, which feature quantities reflecting luminance level distribution of the input picture digital signals;
a gradation correction characteristic determination means for determining a gradation correction characteristic based on the feature quantities received from the feature quantity extraction means, which gradation correction characteristic defining an output signal for an input signal; and
a correction means for correcting each of the input picture signals by using the gradation correction characteristic determined by the gradation correction characteristic determination means to provide corrected picture signals of the picture. - The image sensing device, further comprising a means for recording the corrected picture signals of the picture in an external recording medium.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP35105/93 | 1993-02-24 | ||
JP03510593A JP3201049B2 (en) | 1993-02-24 | 1993-02-24 | Gradation correction circuit and imaging device |
JP5133096A JPH06350875A (en) | 1993-06-03 | 1993-06-03 | Gradation correction circuit for video signal |
JP133096/93 | 1993-06-03 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP0613294A1 true EP0613294A1 (en) | 1994-08-31 |
EP0613294B1 EP0613294B1 (en) | 1998-10-28 |
Family
ID=26374025
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP94102684A Expired - Lifetime EP0613294B1 (en) | 1993-02-24 | 1994-02-23 | Gradation correction device and image sensing device therewith |
Country Status (3)
Country | Link |
---|---|
US (1) | US5517333A (en) |
EP (1) | EP0613294B1 (en) |
DE (1) | DE69414153T2 (en) |
Cited By (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0720358A2 (en) * | 1994-12-26 | 1996-07-03 | Sony Corporation | Video signal compression apparatus utilizing multiple compression ratios |
EP0784399A1 (en) * | 1994-09-30 | 1997-07-16 | Matsushita Electric Industrial Co., Ltd. | Image pickup device |
WO1998039925A1 (en) * | 1997-03-06 | 1998-09-11 | Matsushita Electric Industrial Co., Ltd. | Gamma compensation apparatus |
EP1017228A2 (en) * | 1998-12-31 | 2000-07-05 | Eastman Kodak Company | A method for preserving image detail when adjusting the tone scale of a digital color image |
EP1021032A2 (en) * | 1999-01-18 | 2000-07-19 | Eastman Kodak Company | A method for adjusting the tone scale of a digital image |
EP1152604A1 (en) * | 2000-04-24 | 2001-11-07 | Pulnix America, Inc. | Video glare reduction |
EP1164784A1 (en) * | 2000-06-13 | 2001-12-19 | Koninklijke Philips Electronics N.V. | Preventing doming phenomena |
WO2003085963A1 (en) * | 2002-04-02 | 2003-10-16 | Freescale Semiconductor, Inc. | Digital color image pre-processing |
WO2005074257A1 (en) * | 2004-01-16 | 2005-08-11 | Sony Computer Entertainment Inc. | Method and apparatus for optimizing capture device settings through depth information |
US7102615B2 (en) | 2002-07-27 | 2006-09-05 | Sony Computer Entertainment Inc. | Man-machine interface using a deformable device |
EP1874038A1 (en) | 2006-06-26 | 2008-01-02 | Genesis Microchip, Inc. | Integrated histogram auto adaptive contrast control (ACC) |
US7646372B2 (en) | 2003-09-15 | 2010-01-12 | Sony Computer Entertainment Inc. | Methods and systems for enabling direction detection when interfacing with a computer program |
US7803050B2 (en) | 2002-07-27 | 2010-09-28 | Sony Computer Entertainment Inc. | Tracking device with sound emitter for use in obtaining information for controlling game program execution |
US7850526B2 (en) | 2002-07-27 | 2010-12-14 | Sony Computer Entertainment America Inc. | System for tracking user manipulations within an environment |
US7854655B2 (en) | 2002-07-27 | 2010-12-21 | Sony Computer Entertainment America Inc. | Obtaining input for controlling execution of a game program |
US7874917B2 (en) | 2003-09-15 | 2011-01-25 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
US7881547B2 (en) | 2006-07-28 | 2011-02-01 | Genesis Microchip Inc. | Video window detector |
US7918733B2 (en) | 2002-07-27 | 2011-04-05 | Sony Computer Entertainment America Inc. | Multi-input game control mixer |
US7920755B2 (en) | 2006-06-26 | 2011-04-05 | Genesis Microchip Inc. | Video content detector |
US8072470B2 (en) | 2003-05-29 | 2011-12-06 | Sony Computer Entertainment Inc. | System and method for providing a real-time three-dimensional interactive environment |
US8139793B2 (en) | 2003-08-27 | 2012-03-20 | Sony Computer Entertainment Inc. | Methods and apparatus for capturing audio signals based on a visual image |
US8160269B2 (en) | 2003-08-27 | 2012-04-17 | Sony Computer Entertainment Inc. | Methods and apparatuses for adjusting a listening area for capturing sounds |
US8159617B2 (en) | 2006-06-26 | 2012-04-17 | Genesis Microchip Inc. | Universal, highly configurable video and graphic measurement device |
US8233642B2 (en) | 2003-08-27 | 2012-07-31 | Sony Computer Entertainment Inc. | Methods and apparatuses for capturing an audio signal based on a location of the signal |
US8686939B2 (en) | 2002-07-27 | 2014-04-01 | Sony Computer Entertainment Inc. | System, method, and apparatus for three-dimensional input control |
US8797260B2 (en) | 2002-07-27 | 2014-08-05 | Sony Computer Entertainment Inc. | Inertially trackable hand-held controller |
US9177387B2 (en) | 2003-02-11 | 2015-11-03 | Sony Computer Entertainment Inc. | Method and apparatus for real time motion capture |
USRE48417E1 (en) | 2006-09-28 | 2021-02-02 | Sony Interactive Entertainment Inc. | Object direction using video input combined with tilt angle information |
Families Citing this family (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2748678B2 (en) * | 1990-10-09 | 1998-05-13 | 松下電器産業株式会社 | Gradation correction method and gradation correction device |
DE4310727C2 (en) * | 1992-04-06 | 1996-07-11 | Hell Ag Linotype | Method and device for analyzing image templates |
JP3113835B2 (en) * | 1997-03-14 | 2000-12-04 | 松下電器産業株式会社 | Imaging device |
JP2951909B2 (en) * | 1997-03-17 | 1999-09-20 | 松下電器産業株式会社 | Gradation correction device and gradation correction method for imaging device |
JP2951910B2 (en) * | 1997-03-18 | 1999-09-20 | 松下電器産業株式会社 | Gradation correction device and gradation correction method for imaging device |
EP0963111A1 (en) | 1998-06-02 | 1999-12-08 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for dynamic contrast improvement in video pictures |
EP0963112B1 (en) * | 1998-06-02 | 2004-04-21 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for dynamic contrast improvement in video pictures |
US7440612B2 (en) * | 1998-11-13 | 2008-10-21 | Sony Corporation | Image processing apparatus and method capable of correcting gradation of image data |
JP3208762B2 (en) * | 1998-11-18 | 2001-09-17 | ソニー株式会社 | Image processing apparatus and image processing method |
JP4131348B2 (en) * | 1998-11-18 | 2008-08-13 | ソニー株式会社 | Image processing apparatus and image processing method |
JP4356134B2 (en) * | 1999-04-16 | 2009-11-04 | ソニー株式会社 | Image processing apparatus and image processing method |
JP3714657B2 (en) * | 1999-05-12 | 2005-11-09 | パイオニア株式会社 | Tone correction device |
KR20020019517A (en) * | 1999-09-17 | 2002-03-12 | 모리시타 요이찌 | Image display device |
WO2001039495A1 (en) * | 1999-11-25 | 2001-05-31 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for gradation correction, and video display |
US20020012126A1 (en) * | 1999-12-20 | 2002-01-31 | Hiroaki Nakamura | Image processing method and apparatus |
US6721000B1 (en) | 2000-02-23 | 2004-04-13 | Neomagic Corp. | Adaptive pixel-level color enhancement for a digital camera |
JP3757747B2 (en) * | 2000-04-03 | 2006-03-22 | 株式会社ニコン | Electronic camera, recording medium storing image processing program, and image processing method |
JP3938833B2 (en) * | 2000-04-27 | 2007-06-27 | 株式会社リコー | Exposure control device |
JP3642060B2 (en) * | 2000-08-29 | 2005-04-27 | セイコーエプソン株式会社 | Image reading device |
DE10064678C1 (en) * | 2000-12-22 | 2002-07-11 | Kappa Opto Electronics Gmbh | Process for signal improvement in an image sequence recorded with a digital color video camera |
JP2002232906A (en) * | 2001-01-31 | 2002-08-16 | Ricoh Co Ltd | White balance controller |
CN100382568C (en) * | 2001-11-01 | 2008-04-16 | 汤姆森特许公司 | Method for dynamic contrast improvement |
JP4550350B2 (en) * | 2002-02-01 | 2010-09-22 | 株式会社ニコン | Electronic camera |
JP4153715B2 (en) * | 2002-04-08 | 2008-09-24 | 松下電器産業株式会社 | Video signal processing apparatus and video signal processing method |
KR100469391B1 (en) * | 2002-05-10 | 2005-02-02 | 엘지전자 주식회사 | Driving circuit for mim fed and driving method thereof |
US7161579B2 (en) * | 2002-07-18 | 2007-01-09 | Sony Computer Entertainment Inc. | Hand-held computer interactive device |
US7623115B2 (en) * | 2002-07-27 | 2009-11-24 | Sony Computer Entertainment Inc. | Method and apparatus for light input device |
US8947347B2 (en) | 2003-08-27 | 2015-02-03 | Sony Computer Entertainment Inc. | Controlling actions in a video game unit |
US8570378B2 (en) | 2002-07-27 | 2013-10-29 | Sony Computer Entertainment Inc. | Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera |
US9393487B2 (en) | 2002-07-27 | 2016-07-19 | Sony Interactive Entertainment Inc. | Method for mapping movements of a hand-held controller to game commands |
US7627139B2 (en) * | 2002-07-27 | 2009-12-01 | Sony Computer Entertainment Inc. | Computer image and audio processing of intensity and input devices for interfacing with a computer program |
US7760248B2 (en) | 2002-07-27 | 2010-07-20 | Sony Computer Entertainment Inc. | Selective sound source listening in conjunction with computer interactive processing |
US9474968B2 (en) | 2002-07-27 | 2016-10-25 | Sony Interactive Entertainment America Llc | Method and system for applying gearing effects to visual tracking |
US8313380B2 (en) | 2002-07-27 | 2012-11-20 | Sony Computer Entertainment America Llc | Scheme for translating movements of a hand-held controller into inputs for a system |
US9174119B2 (en) | 2002-07-27 | 2015-11-03 | Sony Computer Entertainement America, LLC | Controller for providing inputs to control execution of a program when inputs are combined |
US9682319B2 (en) | 2002-07-31 | 2017-06-20 | Sony Interactive Entertainment Inc. | Combiner method for altering game gearing |
KR101051604B1 (en) * | 2003-01-09 | 2011-07-22 | 소니 주식회사 | Image processing apparatus and method |
US8323106B2 (en) | 2008-05-30 | 2012-12-04 | Sony Computer Entertainment America Llc | Determination of controller three-dimensional location using image analysis and ultrasonic communication |
US10279254B2 (en) * | 2005-10-26 | 2019-05-07 | Sony Interactive Entertainment Inc. | Controller having visually trackable object for interfacing with a gaming system |
JP4078649B2 (en) * | 2004-01-28 | 2008-04-23 | 日本ビクター株式会社 | Video signal processing apparatus and method |
JP4250595B2 (en) * | 2004-02-16 | 2009-04-08 | キヤノン株式会社 | Signal processing method and signal processing circuit |
WO2006025486A1 (en) * | 2004-09-01 | 2006-03-09 | Nec Corporation | Image correction system and image correction method |
JP2006157450A (en) * | 2004-11-29 | 2006-06-15 | Sony Corp | Imaging apparatus and image processing method |
EP1833264B1 (en) * | 2004-12-17 | 2012-11-07 | Nikon Corporation | Image processing method |
KR100718130B1 (en) * | 2005-06-04 | 2007-05-14 | 삼성전자주식회사 | Display driving apparatus and method |
EP1898624B1 (en) * | 2005-06-20 | 2015-08-26 | Nikon Corporation | Image processing device, image processing method, image processing program product, and image-capturing device |
JP4551836B2 (en) * | 2005-07-29 | 2010-09-29 | 株式会社東芝 | Video signal processing apparatus and video signal processing method |
US8203574B2 (en) * | 2005-09-30 | 2012-06-19 | Nxp B.V. | Dynamic softclipping of video levels |
US7755670B2 (en) * | 2005-10-24 | 2010-07-13 | Nikon Corporation | Tone-conversion device for image, program, electronic camera, and tone-conversion method |
WO2007142134A1 (en) * | 2006-06-02 | 2007-12-13 | Rohm Co., Ltd. | Image processing circuit, semiconductor device, and image processing device |
US8023733B2 (en) * | 2006-06-08 | 2011-09-20 | Panasonic Corporation | Image processing device, image processing method, image processing program, and integrated circuit |
US8781151B2 (en) | 2006-09-28 | 2014-07-15 | Sony Computer Entertainment Inc. | Object detection using video input combined with tilt angle information |
US8310656B2 (en) | 2006-09-28 | 2012-11-13 | Sony Computer Entertainment America Llc | Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen |
JP5103984B2 (en) * | 2007-03-29 | 2012-12-19 | 株式会社ニコン | Image processing apparatus, imaging apparatus, and image processing program |
JP2008258828A (en) * | 2007-04-03 | 2008-10-23 | Nikon Corp | Imaging apparatus |
JP5076650B2 (en) * | 2007-06-01 | 2012-11-21 | 株式会社ニコン | Imaging apparatus and image processing program |
JP4785799B2 (en) * | 2007-07-17 | 2011-10-05 | 富士フイルム株式会社 | Image processing apparatus, image processing method, and photographing apparatus |
JP2010039329A (en) * | 2008-08-07 | 2010-02-18 | Sony Corp | Projector display device and image display control method |
JP5067886B2 (en) * | 2008-10-30 | 2012-11-07 | キヤノン株式会社 | Image processing apparatus and image processing method |
KR101350335B1 (en) * | 2009-12-21 | 2014-01-16 | 한국전자통신연구원 | Content based image retrieval apparatus and method |
JP5594055B2 (en) | 2010-10-22 | 2014-09-24 | 富士通セミコンダクター株式会社 | Image processing apparatus, electronic apparatus, and image processing method |
JP2012095200A (en) * | 2010-10-28 | 2012-05-17 | Canon Inc | Image processing device, image processing method, and program |
CN104021761B (en) | 2014-05-30 | 2016-03-09 | 京东方科技集团股份有限公司 | A kind of luminance compensation method of display device, device and display device |
CN104021773B (en) * | 2014-05-30 | 2015-09-09 | 京东方科技集团股份有限公司 | A kind of luminance compensation method of display device, luminance compensating mechanism and display device |
US10791250B2 (en) * | 2016-05-17 | 2020-09-29 | Ricoh Company, Ltd. | Image processing apparatus, image forming apparatus, and image processing method which correct tone jump |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4365304A (en) * | 1979-08-27 | 1982-12-21 | Yeda Research & Development Co., Ltd. | Method and apparatus for on-line data enhancement |
JPS61285880A (en) * | 1985-06-12 | 1986-12-16 | Mitsubishi Electric Corp | Video printer device |
JPS6342575A (en) * | 1986-08-08 | 1988-02-23 | Dainippon Screen Mfg Co Ltd | Method and device for gradation conversion |
JPS63177679A (en) * | 1987-01-19 | 1988-07-21 | Matsushita Electric Ind Co Ltd | Gradation conversion circuit for color video signal |
US4903145A (en) * | 1986-08-06 | 1990-02-20 | Canon Kabushiki Kaisha | Image quality control apparatus capable of density-correcting plural areas of different types |
US4941037A (en) * | 1985-03-21 | 1990-07-10 | Canon Kabushiki Kaisha | Color image processing method and apparatus in which a gradation-converted luminance signal and two non-linearly quantized color-difference signals having fewer bits than the luminance signal are used to address a color masking ROM |
US4963036A (en) * | 1989-03-22 | 1990-10-16 | Westinghouse Electric Corp. | Vision system with adjustment for variations in imaged surface reflectivity |
JPH04229788A (en) * | 1990-08-06 | 1992-08-19 | Sanyo Electric Co Ltd | Video signal processing circuit |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0225949A1 (en) * | 1985-12-09 | 1987-06-24 | American Hospital Supply Corporation | Linear pressurizing and depressurizing device |
JPH0657046B2 (en) * | 1987-06-05 | 1994-07-27 | キヤノン株式会社 | Digital color signal processing circuit |
JPH0220977A (en) * | 1988-01-07 | 1990-01-24 | Fuji Photo Film Co Ltd | Back light correction system |
AU607033B2 (en) * | 1988-01-12 | 1991-02-21 | Sanyo Electric Co., Ltd. | Auto iris/gamma correction apparatus for making automatic exposure adjustment and/or automatic gamma correction in response to video signal and image sensing apparatus comprising such auto iris/gamma correction apparatus |
JPH01221986A (en) * | 1988-03-01 | 1989-09-05 | Canon Inc | Exposure controller |
JP2952488B2 (en) * | 1988-11-04 | 1999-09-27 | 富士写真フイルム 株式会社 | Image quality correction method for imaging device |
JP2696378B2 (en) * | 1989-02-06 | 1998-01-14 | キヤノン株式会社 | Non-linear processing unit |
JPH04271669A (en) * | 1991-02-27 | 1992-09-28 | Matsushita Electric Ind Co Ltd | Gradation corrector |
JPH0799862B2 (en) * | 1991-03-22 | 1995-10-25 | 松下電器産業株式会社 | Gradation correction device |
US5289282A (en) * | 1991-05-28 | 1994-02-22 | Matsushita Electric Industrial Co., Ltd. | Video signal gradation corrector |
-
1994
- 1994-02-23 DE DE69414153T patent/DE69414153T2/en not_active Expired - Fee Related
- 1994-02-23 EP EP94102684A patent/EP0613294B1/en not_active Expired - Lifetime
- 1994-02-24 US US08/201,426 patent/US5517333A/en not_active Expired - Lifetime
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4365304A (en) * | 1979-08-27 | 1982-12-21 | Yeda Research & Development Co., Ltd. | Method and apparatus for on-line data enhancement |
US4941037A (en) * | 1985-03-21 | 1990-07-10 | Canon Kabushiki Kaisha | Color image processing method and apparatus in which a gradation-converted luminance signal and two non-linearly quantized color-difference signals having fewer bits than the luminance signal are used to address a color masking ROM |
JPS61285880A (en) * | 1985-06-12 | 1986-12-16 | Mitsubishi Electric Corp | Video printer device |
US4903145A (en) * | 1986-08-06 | 1990-02-20 | Canon Kabushiki Kaisha | Image quality control apparatus capable of density-correcting plural areas of different types |
JPS6342575A (en) * | 1986-08-08 | 1988-02-23 | Dainippon Screen Mfg Co Ltd | Method and device for gradation conversion |
JPS63177679A (en) * | 1987-01-19 | 1988-07-21 | Matsushita Electric Ind Co Ltd | Gradation conversion circuit for color video signal |
US4963036A (en) * | 1989-03-22 | 1990-10-16 | Westinghouse Electric Corp. | Vision system with adjustment for variations in imaged surface reflectivity |
JPH04229788A (en) * | 1990-08-06 | 1992-08-19 | Sanyo Electric Co Ltd | Video signal processing circuit |
Non-Patent Citations (4)
Title |
---|
PATENT ABSTRACTS OF JAPAN vol. 11, no. 148 (E - 506) 14 May 1987 (1987-05-14) * |
PATENT ABSTRACTS OF JAPAN vol. 12, no. 256 (E - 635) 19 July 1988 (1988-07-19) * |
PATENT ABSTRACTS OF JAPAN vol. 12, no. 449 (E - 686) 25 November 1988 (1988-11-25) * |
PATENT ABSTRACTS OF JAPAN vol. 16, no. 579 (E - 1299) 18 December 1992 (1992-12-18) * |
Cited By (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0784399A1 (en) * | 1994-09-30 | 1997-07-16 | Matsushita Electric Industrial Co., Ltd. | Image pickup device |
EP0784399A4 (en) * | 1994-09-30 | 1999-10-06 | Matsushita Electric Ind Co Ltd | Image pickup device |
US6040860A (en) * | 1994-09-30 | 2000-03-21 | Matsushita Electric Industrial Co., Ltd. | Imaging apparatus for supplying images with rich gradation across the entire luminance range for all subject types |
EP0720358A3 (en) * | 1994-12-26 | 1998-04-01 | Sony Corporation | Video signal compression apparatus utilizing multiple compression ratios |
US6002796A (en) * | 1994-12-26 | 1999-12-14 | Sony Corporation | Video signal compression apparatus utilizing multiple compression ratios |
EP0720358A2 (en) * | 1994-12-26 | 1996-07-03 | Sony Corporation | Video signal compression apparatus utilizing multiple compression ratios |
CN1096187C (en) * | 1994-12-26 | 2002-12-11 | 索尼公司 | Video signal compression apparatus utilizing multiple compression rations |
WO1998039925A1 (en) * | 1997-03-06 | 1998-09-11 | Matsushita Electric Industrial Co., Ltd. | Gamma compensation apparatus |
EP1017228A3 (en) * | 1998-12-31 | 2002-05-02 | Eastman Kodak Company | A method for preserving image detail when adjusting the tone scale of a digital color image |
EP1017228A2 (en) * | 1998-12-31 | 2000-07-05 | Eastman Kodak Company | A method for preserving image detail when adjusting the tone scale of a digital color image |
US6453075B1 (en) | 1998-12-31 | 2002-09-17 | Eastman Kodak Company | Method for preserving image detail when adjusting the tone scale of a digital color image |
EP1021032A3 (en) * | 1999-01-18 | 2002-10-09 | Eastman Kodak Company | A method for adjusting the tone scale of a digital image |
EP1021032A2 (en) * | 1999-01-18 | 2000-07-19 | Eastman Kodak Company | A method for adjusting the tone scale of a digital image |
EP1152604A1 (en) * | 2000-04-24 | 2001-11-07 | Pulnix America, Inc. | Video glare reduction |
US6741295B2 (en) | 2000-06-13 | 2004-05-25 | Koninklijke Philips Electronics N.V. | Preventing doming phenomena |
EP1164784A1 (en) * | 2000-06-13 | 2001-12-19 | Koninklijke Philips Electronics N.V. | Preventing doming phenomena |
WO2001097508A1 (en) * | 2000-06-13 | 2001-12-20 | Koninklijke Philips Electronics N.V. | Preventing doming phenomena |
US7102669B2 (en) | 2002-04-02 | 2006-09-05 | Freescale Semiconductor, Inc. | Digital color image pre-processing |
WO2003085963A1 (en) * | 2002-04-02 | 2003-10-16 | Freescale Semiconductor, Inc. | Digital color image pre-processing |
US9682320B2 (en) | 2002-07-22 | 2017-06-20 | Sony Interactive Entertainment Inc. | Inertially trackable hand-held controller |
US7102615B2 (en) | 2002-07-27 | 2006-09-05 | Sony Computer Entertainment Inc. | Man-machine interface using a deformable device |
US8797260B2 (en) | 2002-07-27 | 2014-08-05 | Sony Computer Entertainment Inc. | Inertially trackable hand-held controller |
US8686939B2 (en) | 2002-07-27 | 2014-04-01 | Sony Computer Entertainment Inc. | System, method, and apparatus for three-dimensional input control |
US7803050B2 (en) | 2002-07-27 | 2010-09-28 | Sony Computer Entertainment Inc. | Tracking device with sound emitter for use in obtaining information for controlling game program execution |
US7918733B2 (en) | 2002-07-27 | 2011-04-05 | Sony Computer Entertainment America Inc. | Multi-input game control mixer |
US7850526B2 (en) | 2002-07-27 | 2010-12-14 | Sony Computer Entertainment America Inc. | System for tracking user manipulations within an environment |
US7854655B2 (en) | 2002-07-27 | 2010-12-21 | Sony Computer Entertainment America Inc. | Obtaining input for controlling execution of a game program |
US9177387B2 (en) | 2003-02-11 | 2015-11-03 | Sony Computer Entertainment Inc. | Method and apparatus for real time motion capture |
US8072470B2 (en) | 2003-05-29 | 2011-12-06 | Sony Computer Entertainment Inc. | System and method for providing a real-time three-dimensional interactive environment |
US11010971B2 (en) | 2003-05-29 | 2021-05-18 | Sony Interactive Entertainment Inc. | User-driven three-dimensional interactive gaming environment |
US8233642B2 (en) | 2003-08-27 | 2012-07-31 | Sony Computer Entertainment Inc. | Methods and apparatuses for capturing an audio signal based on a location of the signal |
US8139793B2 (en) | 2003-08-27 | 2012-03-20 | Sony Computer Entertainment Inc. | Methods and apparatus for capturing audio signals based on a visual image |
US8160269B2 (en) | 2003-08-27 | 2012-04-17 | Sony Computer Entertainment Inc. | Methods and apparatuses for adjusting a listening area for capturing sounds |
US7874917B2 (en) | 2003-09-15 | 2011-01-25 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
US7646372B2 (en) | 2003-09-15 | 2010-01-12 | Sony Computer Entertainment Inc. | Methods and systems for enabling direction detection when interfacing with a computer program |
CN1926851B (en) * | 2004-01-16 | 2011-10-05 | 索尼电脑娱乐公司 | Method and apparatus for optimizing capture device settings through depth information |
WO2005074257A1 (en) * | 2004-01-16 | 2005-08-11 | Sony Computer Entertainment Inc. | Method and apparatus for optimizing capture device settings through depth information |
US7663689B2 (en) | 2004-01-16 | 2010-02-16 | Sony Computer Entertainment Inc. | Method and apparatus for optimizing capture device settings through depth information |
EP1874038A1 (en) | 2006-06-26 | 2008-01-02 | Genesis Microchip, Inc. | Integrated histogram auto adaptive contrast control (ACC) |
US8159617B2 (en) | 2006-06-26 | 2012-04-17 | Genesis Microchip Inc. | Universal, highly configurable video and graphic measurement device |
US7826680B2 (en) | 2006-06-26 | 2010-11-02 | Genesis Microchip Inc. | Integrated histogram auto adaptive contrast control (ACC) |
US7920755B2 (en) | 2006-06-26 | 2011-04-05 | Genesis Microchip Inc. | Video content detector |
US8170361B2 (en) | 2006-07-28 | 2012-05-01 | Greg Neal | Video window detector |
US7881547B2 (en) | 2006-07-28 | 2011-02-01 | Genesis Microchip Inc. | Video window detector |
USRE48417E1 (en) | 2006-09-28 | 2021-02-02 | Sony Interactive Entertainment Inc. | Object direction using video input combined with tilt angle information |
Also Published As
Publication number | Publication date |
---|---|
US5517333A (en) | 1996-05-14 |
DE69414153D1 (en) | 1998-12-03 |
EP0613294B1 (en) | 1998-10-28 |
DE69414153T2 (en) | 1999-06-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0613294B1 (en) | Gradation correction device and image sensing device therewith | |
US7570390B2 (en) | Image processing device and method | |
US6040860A (en) | Imaging apparatus for supplying images with rich gradation across the entire luminance range for all subject types | |
US7551794B2 (en) | Method apparatus, and recording medium for smoothing luminance of an image | |
EP1383341B1 (en) | Method and apparatus for adaptively enhancing colors in color images | |
EP1418543B1 (en) | Contrast compensation in a digital image using histogram equalization | |
US7023580B2 (en) | System and method for digital image tone mapping using an adaptive sigmoidal function based on perceptual preference guidelines | |
US7421120B2 (en) | Apparatus correcting image by luminance histogram | |
US20040032982A1 (en) | Image processing method, image processing apparatus, and projector | |
EP1188147B1 (en) | Video-apparatus with histogram modification means | |
EP0442369B1 (en) | Gradation correcting apparatus | |
CA2085754C (en) | Gradation compensation apparatus of video image | |
JPH0974501A (en) | Gamma correction circuit | |
JP2004007202A (en) | Image processor | |
JP3255258B2 (en) | Image display device | |
JP3201049B2 (en) | Gradation correction circuit and imaging device | |
US7042524B2 (en) | Video data correction device and video data correction method | |
JP4017810B2 (en) | Gradation correction apparatus and recording medium | |
JPH11136511A (en) | Picture rrocessor | |
KR20030051156A (en) | Contrast compensation circuit | |
US6115063A (en) | Color spectrum detecting circuit and image sensing apparatus | |
JPH06350875A (en) | Gradation correction circuit for video signal | |
JP3021769B2 (en) | Gradation correction device | |
JP2003158642A (en) | Camera signal processing apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 19940223 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): DE FR GB |
|
17Q | First examination report despatched |
Effective date: 19961128 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REF | Corresponds to: |
Ref document number: 69414153 Country of ref document: DE Date of ref document: 19981203 |
|
ET | Fr: translation filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20060216 Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20060220 Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20060222 Year of fee payment: 13 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20070223 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20071030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070901 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070223 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070228 |