US7274393B2 - Four-color mosaic pattern for depth and image capture - Google Patents
Four-color mosaic pattern for depth and image capture Download PDFInfo
- Publication number
- US7274393B2 US7274393B2 US10/664,023 US66402303A US7274393B2 US 7274393 B2 US7274393 B2 US 7274393B2 US 66402303 A US66402303 A US 66402303A US 7274393 B2 US7274393 B2 US 7274393B2
- Authority
- US
- United States
- Prior art keywords
- location
- given
- pixel
- intensity corresponding
- intensity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/843—Demosaicing, e.g. interpolating colour pixel values
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
Definitions
- the invention relates to the field of image capture. More particularly, the invention relates to a sensor for capture of an image and depth information and uses thereof.
- Digital cameras and other image capture devices operate by capturing electromagnetic radiation and measuring the intensity of the radiation.
- the spectral content of electromagnetic radiation focused onto a focal plane depends on, among other things, the image to be captured, the illumination of the subject, the transmission characteristics of the propagation path between the image subject and the optical system, the materials used in the optical system, as well as the geometric shape and size of the optical system.
- the spectral range of interest is the visible region of the electromagnetic spectrum.
- a common method for preventing difficulties caused by radiation outside of the visual range is to use ionically colored glass or a thin-film optical coating on glass to create an optical element that passes visible light (typically having wavelengths in the range of 380 nm to 780 nm).
- This element can be placed in front of the taking lens, within the lens system, or it can be incorporated into the imager package.
- the principal disadvantage to this approach is increased system cost and complexity.
- a color filter array is an array of filters deposited over a pixel sensor array so that each pixel sensor is substantially sensitive to only the electromagnetic radiation passed by the filter.
- a filter in the CFA can be a composite filter manufactured from multiple filters so that the transfer function of the resulting filter is the product of the transfer functions of the constituent filters.
- Each filter in the CFA passes electromagnetic radiation within a particular spectral range (e.g., wavelengths that are interpreted as red).
- a CFA may be composed of red, green and blue filters so that the pixel sensors provide signals indicative of the visible color spectrum.
- infrared radiation typically considered to be light with a wavelength greater than 780 nm
- Imaging sensors or devices based on silicon technology typically require the use of infrared blocking elements to prevent IR from entering the imaging array. Silicon-based devices will typically be sensitive to light with wavelengths up to 1200 nm. If the IR is permitted to enter the array, the device will respond to the IR and generate an image signal including the IR.
- the depth information is captured separately from the color information.
- a camera can capture red, green and blue (visible color) images at fixed time intervals. Pulses of IR light are transmitted between color image captures to obtain depth information. The photons from the infrared light pulse are collected between the capture of the visible colors.
- the number of bits available to the analog-to-digital converter determines the depth increments that can be measured.
- the infrared light can directly carry shape information.
- the camera can determine what interval of distance will measure object depth and such a technique can provide the shape of the objects in the scene being captured. This depth generation process is expensive and heavily dependent on non-silicon, mainly optical and mechanical systems for accurate shutter and timing control.
- FIG. 1 is an example Bayer pattern that can be used to capture color image data.
- FIG. 2 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- FIG. 3 is a block diagram of one embodiment of an image capture device.
- FIG. 4 is a flow diagram of one embodiment of an image capture operation that includes interpolation of multiple color intensity values including infrared intensity values.
- FIG. 5 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- FIG. 6 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- FIG. 7 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- FIG. 8 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- a sensor for color and depth information capture is disclosed.
- a filter passes selected wavelengths according to a predetermined pattern to the sensor.
- the sensor measures light intensities passed by the filter.
- the wavelengths passed by the filter correspond to red, green, blue and infrared light.
- the intensity values can be used for interpolation operations to provide intensity values for areas not captured by the sensor. For example, in an area corresponding to a pixel for which an intensity of red light is captured, interpolation operations using neighboring intensity values can be used to provide an estimation of blue, green and infrared intensities. Red, green and blue intensity values, whether captured or interpolated, are used to provide visible color image information. Infrared intensity values, whether captured or interpolated, are used to provide depth and/or surface texture information.
- a color image pixel consists of three basic color components—red, green and blue. High-end digital cameras capture these colors with three independent and parallel sensors each capturing a color plane for the image being captured. However, lower-cost image capture devices use sub-sampled color components so that each pixel has only one color component captured and the two other missing color components are interpolated based on the color information from the neighboring pixels.
- One pattern commonly used for sub-sampled color image capture is the Bayer pattern.
- FIG. 1 is an example Bayer pattern that can be used to capture color image data.
- sensors are described as capturing color intensity values for individual pixels.
- the areas for which color intensity is determined can be of any size or shape.
- Each pixel in the Bayer pattern consists of only one color component—either red (R), green (G) or blue (B).
- the missing components are reconstructed based on the values of the neighboring pixel values. For example, the pixel at location ( 3 , 2 ) contains only blue intensity information and the red and green components have been filtered out.
- the missing red information can be obtained by interpolation.
- the red intensity information can be obtained by determining the average intensity of the four adjacent red pixels at locations ( 2 , 1 ), ( 2 , 3 ), ( 4 , 1 ) and ( 4 , 3 ).
- the missing green intensity information can be obtained by determining the average intensity of the four adjacent green pixels at locations ( 2 , 2 ), ( 3 , 1 ), ( 3 , 3 ) and ( 4 , 2 ).
- Other, more complex interpolation techniques can also be used.
- an image capture device using the standard Bayer pattern cannot capture depth information without additional components, which increases the cost and complexity of the device.
- FIG. 2 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- Use of a four-color (R, G, B, IR) mosaic pattern can be used to capture color information and depth information using a single sensor.
- missing color intensity information can be interpolated using neighboring intensity values.
- intensity values for the four colors are captured contemporaneously.
- the pixel in location ( 7 , 3 ) corresponds to blue intensity information (row 7 and column 3 ).
- Recovery of IR intensity information provides depth information.
- the average intensity of the values of the four neighboring green pixel locations ( 7 , 2 ), ( 7 , 4 ), ( 6 , 3 ) and ( 8 , 3 ) is used for the green intensity value of pixel ( 7 , 3 ).
- the average of the intensity values of the nearest neighbor red pixel locations ( 7 , 1 ), ( 7 , 5 ), ( 5 , 3 ) and ( 9 , 3 ) is used for the red intensity value of pixel ( 7 , 3 ).
- the IR intensity information for pixel ( 7 , 3 ) can be determined as the average intensity of the nearest neighbor IR pixel locations ( 6 , 2 ), ( 6 , 4 ), ( 8 , 2 ) and ( 8 , 4 ).
- X X(m,n)
- IR X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- G X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) + X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 4 ;
- R X ⁇ ( m - 2 , n ) + X ⁇ ( m + 2 , n ) + X ⁇ ( m , n - 2 ) , X ⁇ ( m , n + 2 ) 4 ;
- G X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) + X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 4 ;
- R X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 2 ;
- B X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) 2 ; else
- B X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 2 ;
- R X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) 2 ;
- FIG. 3 is a block diagram of one embodiment of an image capture device.
- Lens system 310 focuses light from a scene on sensor unit 320 .
- Sensor unit 320 includes one or more sensors and one or more filters such that the image is captured using the pattern of FIG. 2 or similar pattern.
- sensor unit 320 includes a complementary metal-oxide semiconductor (CMOS) sensor and a color filter array.
- CMOS complementary metal-oxide semiconductor
- Sensor unit 320 captures pixel color information in the pattern described above.
- Color intensity information from sensor unit 320 can be output from sensor unit 320 and sent to interpolation unit 330 in any manner known in the art.
- CMOS complementary metal-oxide semiconductor
- Interpolation unit 330 is coupled with sensor unit 320 to interpolate the pixel color information from the sensor unit.
- interpolation unit 330 operates using the equations set forth above. In alternate embodiments, other interpolation equations can also be used. Interpolation of the pixel data can be performed in series or in parallel. The collected and interpolated pixel data are stored in the appropriate buffers coupled with interpolation unit 330 .
- interpolation unit 330 is implemented as hardwired circuitry to perform the interpolation operations described herein.
- interpolation unit 330 is a general purpose processor or microcontroller that executes instructions that cause interpolation unit 330 to perform the interpolation operations described herein.
- the interpolation instructions can be stored in a storage medium in, or coupled with, image capture device 300 , for example, storage medium 360 .
- interpolation unit 330 can perform the interpolation operations as a combination of hardware and software.
- Infrared pixel data is stored in IR buffer 342
- blue pixel data is stored in B buffer 344
- red pixel data is stored in R buffer 346
- green pixel data is stored in G buffer 348 .
- the buffers are coupled with signal processing unit 350 , which performs signal processing functions on the pixel data from the buffers. Any type of signal processing known in the art can be performed on the pixel data.
- the red, green and blue color pixel data are used to generate color images of the scene captured.
- the infrared pixel data are used to generate depth and/or texture information.
- an image capture device can capture a three-dimensional image.
- the processed pixel data are stored on storage medium 360 .
- the processed pixel data can be displayed by a display device (not shown in FIG. 3 ), transmitted by a wired or wireless connection via an appropriate interface (not shown in FIG. 3 ), or otherwise used.
- FIG. 4 is a flow diagram of one embodiment of an image capture operation that includes interpolation of multiple light intensity values including infrared intensity values.
- the process of FIG. 4 can be performed by any device that can be used to capture an image in digital format, for example, a digital camera, a digital video camera, or any other device having digital image capture capabilities.
- Color intensity values are received by the interpolation unit, 410 .
- light from an image to be captured is passed through a lens to a sensor.
- the sensor can be, for example, a complementary metal-oxide semiconductor (CMOS) sensor a charge-coupled device (CCD), etc.
- CMOS complementary metal-oxide semiconductor
- CCD charge-coupled device
- the intensity of the light passed to the sensor is captured in multiple locations on the sensor.
- light intensity is captured for each pixel of a digital image corresponding to the image captured.
- each pixel captures the intensity of light corresponding to a single wavelength range (e.g., red light, blue light, green light, infrared light).
- the colors corresponding to the pixel locations follows a predetermined pattern.
- One pattern that can be used is described with respect to FIG. 2 .
- the pattern of the colors can be determined by placing one or more filters (e.g., a color filter array) between the image and the sensor unit. Alternate patterns are described below with respect to FIGS. 5 , 6 , 7 and 8 . Additional alternate patterns can also be used.
- the captured color intensity values from the sensor unit are sent to an interpolation unit in any manner known in the art.
- the interpolation unit performs color intensity interpolation operations on the captured intensity values, 420 .
- the interpolation operations are performed for the pattern of FIG. 2 as described with respect to the equations above.
- FIGS. 5 , 6 , 7 and 8 corresponding alternate interpolation equations are provided below.
- other interpolation equations can be used.
- the sensor unit captures intensity values for visible colors as well as for infrared wavelengths.
- the visible color intensities are interpolated such that each of the pixel locations have two interpolated color intensity values and one captured color intensity value.
- color intensity values can be selectively interpolated such that one or more of the pixel locations does not have two interpolated color intensity values.
- the infrared intensity values are also interpolated as described herein.
- the infrared intensity values provide depth, or distance information, that can allow the surface features of the image to be determined.
- an infrared value is either captured or interpolated for each pixel location. In alternate embodiments, the infrared values can be selectively interpolated.
- the captured color intensity values and the interpolated color intensity values are stored in a memory, 430 .
- the color intensity values can be stored in a memory that is part of the capture device or the memory can be external to, or remote from, the capture device.
- four buffers are used to store red, green, blue and infrared intensity data. In alternate embodiments, other storage devices and/or techniques can be used.
- An output image is generated using, for example, a signal processing unit, from the stored color intensity values, 440 .
- the output image is a reproduction of the image captured; however, one or more “special effects” changes can be made to the output image.
- the output image can be displayed, stored, printed, etc.
- FIG. 5 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- Use of a four-color (R, G, B, IR) mosaic pattern can be used to capture color information and depth information using a single sensor.
- missing color intensity information can be interpolated using neighboring intensity values.
- intensity values for the four colors are captured contemporaneously.
- One embodiment of a technique for interpolating color and/or depth information follows. Alternate techniques can also be used.
- IR X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- R X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- G X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- B X ( m,n );
- IR X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- R X ( m,n );
- G X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- B X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- R X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- G X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- B X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- IR X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- R X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- G X ( m,n );
- FIG. 6 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- Use of a four-color (R, G, B, IR) mosaic pattern can be used to capture color information and depth information using a single sensor.
- missing color intensity information can be interpolated using neighboring intensity values.
- intensity values for the four colors are captured contemporaneously.
- One embodiment of a technique for interpolating color and/or depth information follows. Alternate techniques can also be used.
- G X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- IR X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) + X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 4 ;
- G X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- R X ⁇ ( m - 2 , n ) + X ⁇ ( m + 2 , n ) + X ⁇ ( m , n - 2 ) + X ⁇ ( m , n + 2 ) 4 ;
- IR X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) + X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 4 ;
- G X ( m,n );
- R X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) 2 ;
- R X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 2 ;
- G X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- FIG. 7 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- Use of a four-color (R, G, B, IR) mosaic pattern can be used to capture color information and depth information using a single sensor.
- missing color intensity information can be interpolated using neighboring intensity values.
- intensity values for the four colors are captured contemporaneously.
- One embodiment of a technique for interpolating color and/or depth information follows. Alternate techniques can also be used.
- IR X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 4 ;
- R X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- G X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- B X ( m,n );
- G X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- B X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- IR X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- R X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 4 ;
- G X( m,n );
- R X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- G X ⁇ ( m , n + 1 ) + X ⁇ ( m , n - 1 ) 2 ;
- B X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 4 ;
- FIG. 8 illustrates one embodiment of a sub-sampling pattern that can be used to capture color and depth information.
- Use of a four-color (R, G, B, IR) mosaic pattern can be used to capture color information and depth information using a single sensor.
- missing color intensity information can be interpolated using neighboring intensity values.
- intensity values for the four colors are captured contemporaneously.
- One embodiment of a technique for interpolating color and/or depth information follows. Alternate techniques can also be used.
- IR X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- R X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) 4 ;
- G X ⁇ ( m , n - 1 ) + X ⁇ ( m , n + 1 ) 2 ;
- B X ( m,n );
- IR X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- R X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- G X ( m,n );
- G X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) + X ⁇ ( m + 1 , n + 1 ) 4 ;
- B X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- G X ⁇ ( m - 1 , n ) + X ⁇ ( m + 1 , n ) 2 ;
- B X ⁇ ( m - 1 , n - 1 ) + X ⁇ ( m + 1 , n + 1 ) + X ⁇ ( m + 1 , n - 1 ) + X ⁇ ( m - 1 , n + 1 ) 4 ;
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
Description
- case 1: (both m and n are odd integers)
-
- if X(m,n) is RED, then
R=X(m,n);
- if X(m,n) is RED, then
else
B=X(m,n);
-
- end if
- case 2: (m is odd and n is even)
G=X(m,n);
-
- if X(m,n−1) is RED, then
R=X(m,n−1);
B=X(m,n+1);
else
B=X(m,n−1);
R=X(m,n+1); - end if
- if X(m,n−1) is RED, then
- case 3: (m is even and n is odd)
G=X(m,n);
-
- if X(m−1,n) is RED, then
R=X(m−1,n);
B=X(m+1,n);
else
B=X(m−1,n);
R=X(m+1,n); - end if
- if X(m−1,n) is RED, then
- case 4: (both m and n are even integers)
IR=X(m,n);
-
- if X(m−1,n+1) is RED, then
-
- end if
end
- end if
- case 1: (both m and n are odd integers)
B=X(m,n);
- case 2: (m is odd and n is even)
R=X(m,n);
- case 3: (m is even and n is odd)
IR=X(m,n);
- case 4: (both m and n are even integers)
G=X(m,n);
end
- case 1: (both m and n are odd integers)
IR=X(m,n);
-
- if X(m,n−1) is RED, then
R=X(m,n−1);
B=X(m,n+1);
else
B=X(m,n−1);
R=X(m,n+1); - end if
- if X(m,n−1) is RED, then
- case 2: (m is odd and n is even)
-
- if X(m,n) is RED, then
R=X(m,n);
- if X(m,n) is RED, then
else
B=X(m,n);
-
- end if
- case 3: (m is even and n is odd)
G=X(m,n);
-
- if X(m−1,n−1) is RED, then
- case 4: (both m and n are even integers)
IR=X(m,n);
-
- if X(m−1,n) is RED, then
R=X(m−1,n);
B=X(m+1,n);
else
B=X(m−1,n);
R=X(m+1,n); - end if
end
- if X(m−1,n) is RED, then
- case 1: (both m and n are odd integers)
B=X(m,n);
- case 2: (m is odd and n is even)
R=X(m,n);
- case 3: (m is even and n is odd)
G=X(m,n);
- case 4: (both m and n are even integers)
IR=X(m,n);
end
- case 1: (both m and n are odd integers)
B=X(m,n);
- case 2: (m is odd and n is even)
G=X(m,n);
- case 3: (m is even and n is odd)
IR=X(m,n);
R=X(m−1,n);
- case 4: (both m and n are even integers)
R=X(m,n);
end
Claims (48)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/664,023 US7274393B2 (en) | 2003-02-28 | 2003-09-15 | Four-color mosaic pattern for depth and image capture |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/376,156 US20040174446A1 (en) | 2003-02-28 | 2003-02-28 | Four-color mosaic pattern for depth and image capture |
US10/664,023 US7274393B2 (en) | 2003-02-28 | 2003-09-15 | Four-color mosaic pattern for depth and image capture |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/376,156 Continuation-In-Part US20040174446A1 (en) | 2003-02-28 | 2003-02-28 | Four-color mosaic pattern for depth and image capture |
Publications (2)
Publication Number | Publication Date |
---|---|
US20040169749A1 US20040169749A1 (en) | 2004-09-02 |
US7274393B2 true US7274393B2 (en) | 2007-09-25 |
Family
ID=46299963
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/664,023 Active 2025-06-29 US7274393B2 (en) | 2003-02-28 | 2003-09-15 | Four-color mosaic pattern for depth and image capture |
Country Status (1)
Country | Link |
---|---|
US (1) | US7274393B2 (en) |
Cited By (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050029456A1 (en) * | 2003-07-30 | 2005-02-10 | Helmuth Eggers | Sensor array with a number of types of optical sensors |
US20050231618A1 (en) * | 2004-03-30 | 2005-10-20 | Toshinobu Sugiyama | Image-capturing apparatus |
US20060124833A1 (en) * | 2004-12-10 | 2006-06-15 | Atsushi Toda | Method and apparatus for acquiring physical information, method for manufacturing semiconductor device including array of plurality of unit components for detecting physical quantity distribution, light-receiving device and manufacturing method therefor, and solid-state imaging device and manufacturing method therefor |
US20060221250A1 (en) * | 2004-01-28 | 2006-10-05 | Canesta, Inc. | Method and system to increase X-Y resolution in a depth (Z) camera using red, blue, green (RGB) sensing |
US20070183657A1 (en) * | 2006-01-10 | 2007-08-09 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Color-image reproduction apparatus |
US20070273781A1 (en) * | 2006-05-26 | 2007-11-29 | Samsung Electronics Co., Ltd. | Image capturing device and method |
US20070285540A1 (en) * | 2006-06-01 | 2007-12-13 | Samsung Electronics Co., Ltd. | Image photographing device and method |
US20080111894A1 (en) * | 2006-11-10 | 2008-05-15 | Sanyo Electric Co., Ltd | Imaging apparatus and image signal processing device |
US20080285056A1 (en) * | 2007-05-17 | 2008-11-20 | Ilya Blayvas | Compact 3D scanner with fixed pattern projector and dual band image sensor |
US20090073284A1 (en) * | 2007-09-19 | 2009-03-19 | Kenzo Isogawa | Imaging apparatus and method |
US20090114799A1 (en) * | 2007-11-07 | 2009-05-07 | Fujifilm Corporation | Image capturing system, image capturing method, and recording medium |
US20090114803A1 (en) * | 2007-11-07 | 2009-05-07 | Fujifilm Corporation | Image capturing system, image capturing method, and recording medium |
US20090278048A1 (en) * | 2008-05-09 | 2009-11-12 | Won-Hee Choe | Multilayer image sensor |
US20100102366A1 (en) * | 2008-10-24 | 2010-04-29 | Jong-Jan Lee | Integrated Infrared and Color CMOS Imager Sensor |
US20100295947A1 (en) * | 2009-05-21 | 2010-11-25 | Pierre Benoit Boulanger | Multi-Spectral Color and IR Camera Based on Multi-Filter Array |
US20110079714A1 (en) * | 2009-10-01 | 2011-04-07 | Microsoft Corporation | Imager for constructing color and depth images |
US20110085063A1 (en) * | 2009-10-14 | 2011-04-14 | Dong Ki Min | Color filter array, image sensor having the same, and signal interpolating method |
US20120026357A1 (en) * | 2009-04-07 | 2012-02-02 | Konica Minolta Opto, Inc. | Image input device |
US20120228505A1 (en) * | 2011-03-09 | 2012-09-13 | Samsung Electronics Co., Ltd. | Optical sensor |
US8542348B2 (en) | 2010-11-03 | 2013-09-24 | Rockwell Automation Technologies, Inc. | Color sensor insensitive to distance variations |
US20130334645A1 (en) * | 2009-02-24 | 2013-12-19 | Taiwan Semiconductor Manufacturing Company, Ltd. | Front side implanted guard ring structure for backside |
US20140009662A1 (en) * | 2005-07-21 | 2014-01-09 | Sony Corporation | Physical information acquistision method, physical information acquisition device, and semiconductor device |
US8666153B2 (en) * | 2008-11-04 | 2014-03-04 | Konica Minolta Opto, Inc. | Image input apparatus |
US20140118493A1 (en) * | 2009-04-16 | 2014-05-01 | Primesense Ltd. | Three-dimensional mapping and imaging |
US8823845B2 (en) | 2010-12-01 | 2014-09-02 | Samsung Electronics Co., Ltd. | Color filter array, image sensor having the same, and image processing system having the same |
US9013620B2 (en) | 2011-04-20 | 2015-04-21 | Trw Automotive U.S. Llc | Multiple band imager and method |
US20150146054A1 (en) * | 2013-11-27 | 2015-05-28 | Aptina Imaging Corporation | Image sensors with color filter elements of different sizes |
US20150181187A1 (en) * | 2013-07-01 | 2015-06-25 | Omnivision Technologies, Inc. | Color and infrared filter array patterns to reduce color aliasing |
US9247109B2 (en) | 2013-03-15 | 2016-01-26 | Samsung Electronics Co., Ltd. | Performing spatial and temporal image contrast detection in pixel array |
US9402067B2 (en) | 2012-10-22 | 2016-07-26 | Samsung Electronics Co., Ltd. | Imaging optical system for 3D image acquisition apparatus, and 3D image acquisition apparatus including the imaging optical system |
US9425233B2 (en) * | 2014-12-22 | 2016-08-23 | Google Inc. | RGBZ pixel cell unit for an RGBZ image sensor |
US9508681B2 (en) | 2014-12-22 | 2016-11-29 | Google Inc. | Stacked semiconductor chip RGBZ sensor |
US9581696B2 (en) * | 2014-12-22 | 2017-02-28 | Google Inc. | Image sensor and light source driver integrated in a same semiconductor package |
US9591247B2 (en) | 2014-12-22 | 2017-03-07 | Google Inc. | Image sensor having an extended dynamic range upper limit |
US9615013B2 (en) * | 2014-12-22 | 2017-04-04 | Google Inc. | Image sensor having multiple output ports |
US9692992B2 (en) | 2013-07-01 | 2017-06-27 | Omnivision Technologies, Inc. | Color and infrared filter array patterns to reduce color aliasing |
US20170205886A1 (en) * | 2016-01-15 | 2017-07-20 | Google Inc. | Virtual reality head-mounted devices having reduced numbers of cameras, and methods of operating the same |
US9741755B2 (en) | 2014-12-22 | 2017-08-22 | Google Inc. | Physical layout and structure of RGBZ pixel cell unit for RGBZ image sensor |
US9871065B2 (en) | 2014-12-22 | 2018-01-16 | Google Inc. | RGBZ pixel unit cell with first and second Z transfer gates |
US9871980B2 (en) | 2011-04-04 | 2018-01-16 | Apple Inc. | Multi-zone imaging sensor and lens array |
US9904981B2 (en) | 2012-11-20 | 2018-02-27 | Samsung Electronics Co., Ltd. | Image processing apparatus and method for color-depth demosaicing |
US10291870B2 (en) | 2014-12-22 | 2019-05-14 | Google Llc | Monolithically integrated RGB pixel array and Z pixel array |
US10412280B2 (en) | 2016-02-10 | 2019-09-10 | Microsoft Technology Licensing, Llc | Camera with light valve over sensor array |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6636167B1 (en) * | 2000-10-31 | 2003-10-21 | Intel Corporation | Method of generating Huffman code length information |
JP4131192B2 (en) * | 2003-04-25 | 2008-08-13 | コニカミノルタオプト株式会社 | Imaging apparatus, image processing apparatus, and image recording apparatus |
WO2005072358A2 (en) * | 2004-01-28 | 2005-08-11 | Canesta, Inc. | Single chip red, green, blue, distance (rgb-z) sensor |
JP2006208085A (en) * | 2005-01-26 | 2006-08-10 | Mitsutoyo Corp | Picture image measuring instrument and picture image measuring method |
JP4730082B2 (en) * | 2005-12-22 | 2011-07-20 | ソニー株式会社 | Image signal processing apparatus, imaging apparatus, image signal processing method, and computer program |
US8139142B2 (en) * | 2006-06-01 | 2012-03-20 | Microsoft Corporation | Video manipulation of red, green, blue, distance (RGB-Z) data including segmentation, up-sampling, and background substitution techniques |
JP4983141B2 (en) * | 2006-08-04 | 2012-07-25 | ソニー株式会社 | Color filter |
JP4946581B2 (en) * | 2007-04-05 | 2012-06-06 | ソニー株式会社 | Image processing device |
US7889921B2 (en) * | 2007-05-23 | 2011-02-15 | Eastman Kodak Company | Noise reduced color image using panchromatic image |
WO2010052593A1 (en) * | 2008-11-04 | 2010-05-14 | Ecole Polytechnique Federale De Lausanne (Epfl) | Camera design for the simultaneous capture of near-infrared and visible images |
US9077916B2 (en) * | 2009-01-16 | 2015-07-07 | Dual Aperture International Co. Ltd. | Improving the depth of field in an imaging system |
KR20120084216A (en) * | 2011-01-19 | 2012-07-27 | 삼성전자주식회사 | Method of 3d image signal processing for removing pixel noise of depth information and 3d image processor of the same |
CN103621078B (en) * | 2011-04-14 | 2016-01-13 | 株式会社尼康 | Image processing apparatus and image processing program |
JP2013183353A (en) * | 2012-03-02 | 2013-09-12 | Toshiba Corp | Image processor |
KR102019186B1 (en) * | 2012-08-16 | 2019-09-06 | 엘지이노텍 주식회사 | Image sensor and camera apparatus having the same |
JP6368115B2 (en) | 2013-05-10 | 2018-08-01 | キヤノン株式会社 | Solid-state imaging device and camera |
US20150022869A1 (en) * | 2013-07-17 | 2015-01-22 | Samsung Electronics Co., Ltd. | Demosaicing rgbz sensor |
US9485439B2 (en) | 2013-12-03 | 2016-11-01 | Sensors Unlimited, Inc. | Shortwave infrared camera with bandwidth restriction |
US20160255323A1 (en) | 2015-02-26 | 2016-09-01 | Dual Aperture International Co. Ltd. | Multi-Aperture Depth Map Using Blur Kernels and Down-Sampling |
JP2017118191A (en) * | 2015-12-21 | 2017-06-29 | ソニー株式会社 | Imaging device, driving method therefor, and imaging apparatus |
WO2017203936A1 (en) * | 2016-05-25 | 2017-11-30 | パナソニック・タワージャズセミコンダクター株式会社 | Solid-state imaging element |
US10574909B2 (en) * | 2016-08-08 | 2020-02-25 | Microsoft Technology Licensing, Llc | Hybrid imaging sensor for structured light object capture |
US10580807B2 (en) | 2017-10-24 | 2020-03-03 | Stmicroelectronics, Inc. | Color pixel and range pixel combination unit |
CN113115010B (en) * | 2020-01-11 | 2023-04-18 | 晋城三赢精密电子有限公司 | Image format conversion method and device based on RGB-IR image sensor |
FR3120989B1 (en) * | 2021-03-16 | 2024-03-08 | Commissariat Energie Atomique | Color and near-infrared pattern for image sensor |
Citations (44)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5373322A (en) * | 1993-06-30 | 1994-12-13 | Eastman Kodak Company | Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients |
US5801373A (en) * | 1993-01-01 | 1998-09-01 | Canon Kabushiki Kaisha | Solid-state image pickup device having a plurality of photoelectric conversion elements on a common substrate |
US5875122A (en) | 1996-12-17 | 1999-02-23 | Intel Corporation | Integrated systolic architecture for decomposition and reconstruction of signals using wavelet transforms |
US5926238A (en) * | 1992-12-11 | 1999-07-20 | Canon Kabushiki Kaisha | Image display device, semiconductor device and optical element |
US5995210A (en) | 1998-08-06 | 1999-11-30 | Intel Corporation | Integrated architecture for computing a forward and inverse discrete wavelet transforms |
US6009206A (en) | 1997-09-30 | 1999-12-28 | Intel Corporation | Companding algorithm to transform an image to a lower bit resolution |
US6009201A (en) | 1997-06-30 | 1999-12-28 | Intel Corporation | Efficient table-lookup based visually-lossless image compression scheme |
US6047303A (en) | 1998-08-06 | 2000-04-04 | Intel Corporation | Systolic architecture for computing an inverse discrete wavelet transforms |
US6091851A (en) | 1997-11-03 | 2000-07-18 | Intel Corporation | Efficient algorithm for color recovery from 8-bit to 24-bit color pixels |
US6094508A (en) | 1997-12-08 | 2000-07-25 | Intel Corporation | Perceptual thresholding for gradient-based local edge detection |
US6108453A (en) | 1998-09-16 | 2000-08-22 | Intel Corporation | General image enhancement framework |
US6124811A (en) | 1998-07-02 | 2000-09-26 | Intel Corporation | Real time algorithms and architectures for coding images compressed by DWT-based techniques |
US6130960A (en) | 1997-11-03 | 2000-10-10 | Intel Corporation | Block-matching algorithm for color interpolation |
US6151415A (en) | 1998-12-14 | 2000-11-21 | Intel Corporation | Auto-focusing algorithm using discrete wavelet transform |
US6151069A (en) | 1997-11-03 | 2000-11-21 | Intel Corporation | Dual mode digital camera for video and still operation |
US6154493A (en) | 1998-05-21 | 2000-11-28 | Intel Corporation | Compression of color images based on a 2-dimensional discrete wavelet transform yielding a perceptually lossless image |
US6166664A (en) | 1998-08-26 | 2000-12-26 | Intel Corporation | Efficient data structure for entropy encoding used in a DWT-based high performance image compression |
US6178269B1 (en) | 1998-08-06 | 2001-01-23 | Intel Corporation | Architecture for computing a two-dimensional discrete wavelet transform |
US6195026B1 (en) | 1998-09-14 | 2001-02-27 | Intel Corporation | MMX optimized data packing methodology for zero run length and variable length entropy encoding |
US6215908B1 (en) | 1999-02-24 | 2001-04-10 | Intel Corporation | Symmetric filtering based VLSI architecture for image compression |
US6215916B1 (en) | 1998-02-04 | 2001-04-10 | Intel Corporation | Efficient algorithm and architecture for image scaling using discrete wavelet transforms |
US6229578B1 (en) | 1997-12-08 | 2001-05-08 | Intel Corporation | Edge-detection based noise removal algorithm |
US6233358B1 (en) | 1998-07-13 | 2001-05-15 | Intel Corporation | Image compression using directional predictive coding of the wavelet coefficients |
US6236765B1 (en) | 1998-08-05 | 2001-05-22 | Intel Corporation | DWT-based up-sampling algorithm suitable for image display in an LCD panel |
US6236433B1 (en) | 1998-09-29 | 2001-05-22 | Intel Corporation | Scaling algorithm for efficient color representation/recovery in video |
US6275206B1 (en) | 1999-03-17 | 2001-08-14 | Intel Corporation | Block mapping based up-sampling method and apparatus for converting color images |
US6285796B1 (en) | 1997-11-03 | 2001-09-04 | Intel Corporation | Pseudo-fixed length image compression scheme |
US6292114B1 (en) | 1999-06-10 | 2001-09-18 | Intel Corporation | Efficient memory mapping of a huffman coded list suitable for bit-serial decoding |
US6292212B1 (en) * | 1994-12-23 | 2001-09-18 | Eastman Kodak Company | Electronic color infrared camera |
US6301392B1 (en) | 1998-09-03 | 2001-10-09 | Intel Corporation | Efficient methodology to select the quantization threshold parameters in a DWT-based image compression scheme in order to score a predefined minimum number of images into a fixed size secondary storage |
US6348929B1 (en) | 1998-01-16 | 2002-02-19 | Intel Corporation | Scaling algorithm and architecture for integer scaling in video |
US6351555B1 (en) | 1997-11-26 | 2002-02-26 | Intel Corporation | Efficient companding algorithm suitable for color imaging |
US6356276B1 (en) | 1998-03-18 | 2002-03-12 | Intel Corporation | Median computation-based integrated color interpolation and color space conversion methodology from 8-bit bayer pattern RGB color space to 12-bit YCrCb color space |
US6366694B1 (en) | 1998-03-26 | 2002-04-02 | Intel Corporation | Integrated color interpolation and color space conversion algorithm from 8-bit Bayer pattern RGB color space to 24-bit CIE XYZ color space |
US6366692B1 (en) | 1998-03-30 | 2002-04-02 | Intel Corporation | Median computation-based integrated color interpolation and color space conversion methodology from 8-bit bayer pattern RGB color space to 24-bit CIE XYZ color space |
US6373481B1 (en) | 1999-08-25 | 2002-04-16 | Intel Corporation | Method and apparatus for automatic focusing in an image capture system using symmetric FIR filters |
US6377280B1 (en) | 1999-04-14 | 2002-04-23 | Intel Corporation | Edge enhanced image up-sampling algorithm using discrete wavelet transform |
US6381357B1 (en) | 1999-02-26 | 2002-04-30 | Intel Corporation | Hi-speed deterministic approach in detecting defective pixels within an image sensor |
US6392699B1 (en) | 1998-03-04 | 2002-05-21 | Intel Corporation | Integrated color interpolation and color space conversion algorithm from 8-bit bayer pattern RGB color space to 12-bit YCrCb color space |
US6449380B1 (en) | 2000-03-06 | 2002-09-10 | Intel Corporation | Method of integrating a watermark into a compressed image |
US6535648B1 (en) | 1998-12-08 | 2003-03-18 | Intel Corporation | Mathematical model for gray scale and contrast enhancement of a digital image |
US6659940B2 (en) * | 2000-04-10 | 2003-12-09 | C2Cure Inc. | Image sensor and an endoscope using the same |
US6759646B1 (en) * | 1998-11-24 | 2004-07-06 | Intel Corporation | Color interpolation for a four color mosaic pattern |
US7109470B2 (en) * | 2000-09-19 | 2006-09-19 | Siemens Aktiengesellschaft | Sensor arrangement and control and analysis unit for image recognition of an object |
-
2003
- 2003-09-15 US US10/664,023 patent/US7274393B2/en active Active
Patent Citations (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5926238A (en) * | 1992-12-11 | 1999-07-20 | Canon Kabushiki Kaisha | Image display device, semiconductor device and optical element |
US5801373A (en) * | 1993-01-01 | 1998-09-01 | Canon Kabushiki Kaisha | Solid-state image pickup device having a plurality of photoelectric conversion elements on a common substrate |
US5373322A (en) * | 1993-06-30 | 1994-12-13 | Eastman Kodak Company | Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients |
US6292212B1 (en) * | 1994-12-23 | 2001-09-18 | Eastman Kodak Company | Electronic color infrared camera |
US5875122A (en) | 1996-12-17 | 1999-02-23 | Intel Corporation | Integrated systolic architecture for decomposition and reconstruction of signals using wavelet transforms |
US6009201A (en) | 1997-06-30 | 1999-12-28 | Intel Corporation | Efficient table-lookup based visually-lossless image compression scheme |
US6009206A (en) | 1997-09-30 | 1999-12-28 | Intel Corporation | Companding algorithm to transform an image to a lower bit resolution |
US6130960A (en) | 1997-11-03 | 2000-10-10 | Intel Corporation | Block-matching algorithm for color interpolation |
US6091851A (en) | 1997-11-03 | 2000-07-18 | Intel Corporation | Efficient algorithm for color recovery from 8-bit to 24-bit color pixels |
US6269181B1 (en) | 1997-11-03 | 2001-07-31 | Intel Corporation | Efficient algorithm for color recovery from 8-bit to 24-bit color pixels |
US6285796B1 (en) | 1997-11-03 | 2001-09-04 | Intel Corporation | Pseudo-fixed length image compression scheme |
US6151069A (en) | 1997-11-03 | 2000-11-21 | Intel Corporation | Dual mode digital camera for video and still operation |
US6351555B1 (en) | 1997-11-26 | 2002-02-26 | Intel Corporation | Efficient companding algorithm suitable for color imaging |
US6094508A (en) | 1997-12-08 | 2000-07-25 | Intel Corporation | Perceptual thresholding for gradient-based local edge detection |
US6229578B1 (en) | 1997-12-08 | 2001-05-08 | Intel Corporation | Edge-detection based noise removal algorithm |
US6348929B1 (en) | 1998-01-16 | 2002-02-19 | Intel Corporation | Scaling algorithm and architecture for integer scaling in video |
US6215916B1 (en) | 1998-02-04 | 2001-04-10 | Intel Corporation | Efficient algorithm and architecture for image scaling using discrete wavelet transforms |
US6392699B1 (en) | 1998-03-04 | 2002-05-21 | Intel Corporation | Integrated color interpolation and color space conversion algorithm from 8-bit bayer pattern RGB color space to 12-bit YCrCb color space |
US6356276B1 (en) | 1998-03-18 | 2002-03-12 | Intel Corporation | Median computation-based integrated color interpolation and color space conversion methodology from 8-bit bayer pattern RGB color space to 12-bit YCrCb color space |
US6366694B1 (en) | 1998-03-26 | 2002-04-02 | Intel Corporation | Integrated color interpolation and color space conversion algorithm from 8-bit Bayer pattern RGB color space to 24-bit CIE XYZ color space |
US6366692B1 (en) | 1998-03-30 | 2002-04-02 | Intel Corporation | Median computation-based integrated color interpolation and color space conversion methodology from 8-bit bayer pattern RGB color space to 24-bit CIE XYZ color space |
US6154493A (en) | 1998-05-21 | 2000-11-28 | Intel Corporation | Compression of color images based on a 2-dimensional discrete wavelet transform yielding a perceptually lossless image |
US6124811A (en) | 1998-07-02 | 2000-09-26 | Intel Corporation | Real time algorithms and architectures for coding images compressed by DWT-based techniques |
US6233358B1 (en) | 1998-07-13 | 2001-05-15 | Intel Corporation | Image compression using directional predictive coding of the wavelet coefficients |
US6236765B1 (en) | 1998-08-05 | 2001-05-22 | Intel Corporation | DWT-based up-sampling algorithm suitable for image display in an LCD panel |
US5995210A (en) | 1998-08-06 | 1999-11-30 | Intel Corporation | Integrated architecture for computing a forward and inverse discrete wavelet transforms |
US6047303A (en) | 1998-08-06 | 2000-04-04 | Intel Corporation | Systolic architecture for computing an inverse discrete wavelet transforms |
US6178269B1 (en) | 1998-08-06 | 2001-01-23 | Intel Corporation | Architecture for computing a two-dimensional discrete wavelet transform |
US6166664A (en) | 1998-08-26 | 2000-12-26 | Intel Corporation | Efficient data structure for entropy encoding used in a DWT-based high performance image compression |
US6301392B1 (en) | 1998-09-03 | 2001-10-09 | Intel Corporation | Efficient methodology to select the quantization threshold parameters in a DWT-based image compression scheme in order to score a predefined minimum number of images into a fixed size secondary storage |
US6195026B1 (en) | 1998-09-14 | 2001-02-27 | Intel Corporation | MMX optimized data packing methodology for zero run length and variable length entropy encoding |
US6108453A (en) | 1998-09-16 | 2000-08-22 | Intel Corporation | General image enhancement framework |
US6236433B1 (en) | 1998-09-29 | 2001-05-22 | Intel Corporation | Scaling algorithm for efficient color representation/recovery in video |
US6759646B1 (en) * | 1998-11-24 | 2004-07-06 | Intel Corporation | Color interpolation for a four color mosaic pattern |
US6535648B1 (en) | 1998-12-08 | 2003-03-18 | Intel Corporation | Mathematical model for gray scale and contrast enhancement of a digital image |
US6151415A (en) | 1998-12-14 | 2000-11-21 | Intel Corporation | Auto-focusing algorithm using discrete wavelet transform |
US6215908B1 (en) | 1999-02-24 | 2001-04-10 | Intel Corporation | Symmetric filtering based VLSI architecture for image compression |
US6381357B1 (en) | 1999-02-26 | 2002-04-30 | Intel Corporation | Hi-speed deterministic approach in detecting defective pixels within an image sensor |
US6275206B1 (en) | 1999-03-17 | 2001-08-14 | Intel Corporation | Block mapping based up-sampling method and apparatus for converting color images |
US6377280B1 (en) | 1999-04-14 | 2002-04-23 | Intel Corporation | Edge enhanced image up-sampling algorithm using discrete wavelet transform |
US6292114B1 (en) | 1999-06-10 | 2001-09-18 | Intel Corporation | Efficient memory mapping of a huffman coded list suitable for bit-serial decoding |
US6373481B1 (en) | 1999-08-25 | 2002-04-16 | Intel Corporation | Method and apparatus for automatic focusing in an image capture system using symmetric FIR filters |
US6449380B1 (en) | 2000-03-06 | 2002-09-10 | Intel Corporation | Method of integrating a watermark into a compressed image |
US6659940B2 (en) * | 2000-04-10 | 2003-12-09 | C2Cure Inc. | Image sensor and an endoscope using the same |
US7109470B2 (en) * | 2000-09-19 | 2006-09-19 | Siemens Aktiengesellschaft | Sensor arrangement and control and analysis unit for image recognition of an object |
Non-Patent Citations (89)
Title |
---|
Acharya et al., "A Fuzzy Based Thresholding Technique for Image Segmentation," Filed Sep. 10, 1999, U.S. Appl. No. 09/393,136, pp. 1-28. |
Acharya et al., "A Fuzzy Distinction Based Thresholding Technique for Image Segmentation," Filed Sep. 10, 1999, U.S. Appl. No. 09/393,017, pp. 1-29. |
Acharya et al., "A Method for Block-Based Digital Image Watermarking," Filed Nov. 29, 2000, U.S. Appl. No. 09/727,288, pp. 1-11. |
Acharya et al., "A Method of Generating Huffman Code Length Information," Filed Oct. 31, 2000, U.S. Appl. No. 09/704,392, pp. 1-25. |
Acharya et al., "A Method of Performing Huffman Decoding," Filed Oct. 31, 2000, U.S. Appl. No. 09/704,380, pp. 1-26. |
Acharya et al., "Architecture for Processing Fingerprint Images," Filed Sep. 13, 2001, U.S. Appl. No. 09/952,276, pp. 1-19. |
Acharya et al., "Chip Rate Selectable Square Root Raised Cosine Filter for Mobile Telecommunications," Filed Dec. 20, 1999, U.S. Appl. No. 09/467,487, pp. 1-44. |
Acharya et al., "Color Filter Array & Color Interpolation Algorithm," Filed Nov. 30, 2000, U.S. Appl. No. 09/727,038, pp. 1-36. |
Acharya et al., "Color Interpolation for a Four Color Mosaic Pattern," Filed Nov. 24, 1998, U.S. Appl. No. 09/199,836, pp. 1-26. |
Acharya et al., "Color Video Coding Scheme," Filed Jul. 25, 2002, U.S. Appl. No. 10/206,908, pp. 1-31. |
Acharya et al., "Computationally Fast & Effiecient DV to DVD Transcoding," Filed Apr. 11, 2002, U.S. Appl. No. 10/120,799, pp. 1-46. |
Acharya et al., "Computing the Euler Number of a Binary Image," Filed Nov. 27, 2000, U.S. Appl. No. 09/722,982, pp. 1-31. |
Acharya et al., "Developing an Euler Vector for Images," Filed Nov. 27, 2000, U.S. Appl. No. 09/722,979, pp. 1-45. |
Acharya et al., "Encoding of Wavelet Transformed Error Data," Filed Nov. 27, 2000, U.S. Appl. No. 09/723,123, pp. 1-38. |
Acharya et al., "Imagaing Device Connected to Processor-Based System Using High-Bandwidth Bus," Filed Nov. 29, 2000, U.S. Appl. No. 09/726,773, pp. 1-31. |
Acharya et al., "Image Color Matching Scheme," Filed Aug. 2, 2002, U.S. Appl. No. 10/211,161, pp. 1-14. |
Acharya et al., "Image Processing Method and Apparatus," Filed Jul. 23, 1999, U.S. Appl. No. 09/359,523, pp. 1-16. |
Acharya et al., "Image Retrieval Using Distance Measure," Filed Mar. 23, 2001, U.S. Appl. No. 09/817,000, pp. 1-28. |
Acharya et al., "Indexing Wavelet Compressed Video for Efficient Data Handling," Filed Nov. 10, 1999, U.S. Appl. No. 09/438,091, pp. 1-29. |
Acharya et al., "Method & Apparatus for Coding of Wavelet Transformed Coefficients," Filed May 29, 2001, U.S. Appl. No. 09/867,781, pp. 1-44. |
Acharya et al., "Method & Apparatus for Image Retrieval," Filed Apr. 22, 2002, U.S. Appl. No. 10/128,601, pp. 1-27. |
Acharya et al., "Method & Apparatus for Providing a Binary Fingerprint Image," Filed Sep. 13, 2001, U.S. Appl. No. 09/952,284, pp. 1-26. |
Acharya et al., "Method & Apparatus for Three-Dimensional Wavelet Transform," Filed May 29, 2001, U.S. Appl. No. 09/867,784, pp. 1-30. |
Acharya et al., "Method & Apparatus to Reduce False Minutiae in a Binary Fingerprint Image," Filed Sep. 13, 2001, U.S. Appl. No. 09/952,249, pp. 1-30. |
Acharya et al., "Method of Compressing a Color Image," Filed Oct. 1, 1999, U.S. Appl. No. 09/411,697, pp. 1-26. |
Acharya et al., "Method of Compressing an Image," Filed Jun. 19, 2000, U.S. Appl. No. 09/597,354, pp. 1-23. |
Acharya et al., "Method of Generating a Length-Constrained Huffman Coed," Filed Nov. 30, 2000, U.S. Appl. No. 09/705,314, pp. 1-17. |
Acharya et al., "Method of Integrating a Watermark into a Compressed Image," Filed Jul. 12, 2002, U.S. Appl. No. 10/194,179, pp. 1-25. |
Acharya et al., "Method of Integrating a Watermark into an Image," Filed Mar. 6, 2000, U.S. Appl. No. 09/519,874, pp. 1-27. |
Acharya et al., "Method of Intetpolating Color Pixel Signals from a Subsampled Color Image," Filed Oct. 1, 1999, U.S. Appl. No. 09/410,800. |
Acharya et al., "Method of Inverse Quantizing Quantized Signal Samples of an Image During Image Decompression," filed Feb. 18, 2000, U.S. Appl. No. 09/507,213, pp. 1-32. |
Acharya et al., "Method of Quantizing Signal Samples of an Image During Image Compression," Filed Feb. 18, 2000, U.S. Appl. No. 09/507,399, pp. 1-24. |
Acharya et al., "Method of Using Hue to Interpolate Color Pixel Signals," Filed Jun. 12, 2000, U.S. Appl. No. 09/591,867, pp. 1-23. |
Acharya et al., "Method of Video Coding Shoulder Movement from a Sequence of Images," Filed Jun. 30, 2000, U.S. Appl. No. 09/607,724, pp. 1-24. |
Acharya et al., "Method of Video Coding the Movement of a Human Face from a Sequence of Images," Filed Jun. 30, 2000, U.S. Appl. No. 09/608,989, pp. 1-25. |
Acharya et al., "Model-Based Video Image Coding," Filed Jun. 30, 2000, U.S. Appl. No. 09/608,991, pp. 1-36. |
Acharya et al., "Motion Estimation Using A Context Adaptive Search," Filed Sep. 23, 2002, U.S. Appl. No. 10/253,835, pp. 1-25. |
Acharya et al., "Motion Estimation Using a Logarithmic Search," Filed Sep. 11, 2002, U.S. Appl. No. 10/242,148, pp. 1-25. |
Acharya et al., "Motion Estimation," Filed Sep. 4, 2002, U.S. Appl. No. 10/235,121, pp. 1-22. |
Acharya et al., "Square Root Raised Cosine Symmetric Filter for Mobile Telecommunications," Filed Oct. 29, 1999, U.S. Appl. No. 09/429,058, pp. 1-26. |
Acharya et al., "Wavelet Coding of Video," Filed Nov. 27, 2000, U.S. Appl. No. 09/722,988, pp. 1-40. |
Acharya et al., "Zerotree Encoding of Wavelet Data," Filed Sep. 3, 1999, U.S. Appl. No. 09/390,255, pp. 1-22. |
Acharya, "Enhancing Image Compression Performance by Morphological Processing," Filed Apr. 14, 1999, U.S. Appl. No. 09/291,810, pp. 1-31. |
Acharya, "Euler Vector for Color Images," Filed Oct. 23, 2002, U.S. Appl. No. 10/279,536, pp. 1-16. |
Acharya, "Method & Apparatus for Image Scaling," Filed Jul. 27, 2001, U.S. Appl. No. 09/917,476, pp. 1-19. |
Bawolek et al., "Infrared Correction System," Filed Jul. 30, 1998, U.S. Appl. No. 09/126,203, pp. 1-23. |
Becker et al., "Variable Length Coding Packing Architecture," Filed Aug. 22, 2001, U.S. Appl. No. 09/935,524, pp. 1-29. |
Dunton et al., "Dual Mode Digital Camera for Video and Still Operation," Filed Jun. 16, 2000, U.S. Appl. No. 09/595,055, pp. 1-30. |
Kim et al., "Adaptive Video Bit-Rate Control," Filed Sep. 23, 2002, U.S. Appl. No. 10/253,943, pp. 1-32. |
Kim et al., "Method & Apparatus for Video Bit-Rate Control," Filed Dec. 28, 2001, U.S. Appl. No. 10/039,462, pp. 1-23. |
Kim et al., "Method of Performing Motion Estimation," Filed Jun. 16, 2000, U.S. Appl. No. 09/596,127, pp. 1-28. |
Kim et al., "Method of Performing Video Encoding Rate Control Using Bit Budget," Filed Jan. 3, 2001, U.S. Appl. No. 09/754,682, pp. 1-25. |
Kim et al., "Method of Performing Video Encoding Rate Control Using Motion Estimation," Filed Jan. 3, 2001, U.S. Appl. No. 09/754,683, pp. 1-27. |
Kim et al., "Method of Performing Video Encoding Rate Control," Filed Jan. 3, 2001, U.S. Appl. No. 09/754,227, pp. 1-28. |
Metz et al., "Image Processing Architecture," Filed Dec. 28, 1999, U.S. Appl. No. 09/473,643, pp. 1-16. |
Miao et al., "Dual Mode Filter for Mobile Telecommunications," Filed Nov. 18, 1999, U.S. Appl. No. 09/467,611, pp. 1-31. |
Pazmino et al., "Method of Compressing and/or Decompressing a Data Set Using Significance Mapping," Filed Sep. 11, 1998, U.S. Appl. No. 08/151,336, pp. 1-26. |
Tan et al., "A Hardware Efficient Wavelet-Based Video Compression Scheme," Filed Jun. 29, 1999, U.S. Appl. No. 09,342,863, pp. 1-32. |
Tan et al., "A Methodolgy for Color Correction with Noise Regulation," Filed Jul. 23, 1999, U.S. Appl. No. 09/359,231, pp. 1-30. |
Tan et al., "Method and Appartus for Adaptively Sharpening Local Image Content of an Image," Filed Jun. 9, 1999, U.S. Appl. No. 09/328,935, pp. 1-29. |
Tan et al., "Reduction of Ringing Artifacts After Decompression of a DWT-Based Compressed Image," Filed May 22, 2001, U.S. Appl. No. 09/863,478, pp. 1-24. |
Tan et al., "Reduction of Ringing Artifacts After Decompression of a DWT-Based Compressed Image," Filed Oct. 2, 1998, U.S. Appl. No. 09/165,511, pp. 1-20. |
Tan et al., "Robust Sequential Approach in Detecting Defective Pixels within an Image Sensor," Filed Nov. 13, 1998, U.S. Appl. No. 09/191,310, pp. 1-35. |
Tan et al., "Using an Electronic Camera to Build a File Containing Text," Filed Apr. 29, 1999, U.S. Appl. No. 09/301,753, pp. 1-21. |
Tinku Acharya, "A Block-Matching Algorithum for Color Interpolation," Filed Jan. 28, 2000, U.S. Appl. No. 09/494,087, pp. 1-45. |
Tinku Acharya, "A Memory Based VLSI Architecture for Image Compression," Filed Jun. 30, 1997, U.S. Appl. No. 08/885,415, pp. 1-36. |
Tinku Acharya, "An Integrated Color Interpolation & Color Space Conversion Algorithm from 8-Bit Bayer Pattern RGB Color Space to 12-Bit YCrCb Color Space," Filed Dec. 14, 2001, U.S. Appl. No. 10/022,154, pp. 1-32 |
Tinku Acharya, "Discrete Filter," Filed Nov. 2, 1999, U.S. Appl. No. 09/432,337, pp. 1-16. |
Tinku Acharya, "Fast Half-Pixel Motion Estimation Using Steepest Descent," Filed Sep. 5, 2001, U.S. Appl. No. 09/947,266, pp. 1-18. |
Tinku Acharya, "Method & Apparatus for Image Scaling," Filed Jul. 27, 2001, U.S. Appl. No. 09/917,476, pp. 1-19. |
Tinku Acharya, "Method & Apparatus for Multiply-Accumulate Two-Dimensional Separable Symmetric Filtering," Filed Nov. 20, 2000, U.S. Appl. No. 09/718,877, pp. 1-13. |
Tinku Acharya, "Method & Apparatus for Two-Dimensional Seperable Symmetric Filtering," Filed Nov. 15, 2000, U.S. Appl. No. 09/713,663, pp. 1-20. |
Tinku Acharya, "Method of Converting a Sub-Sampled Color Image," Filed Dec. 14, 1999, U.S. Appl. No. 09/461,068, pp. 1-22. |
Tinku Acharya, "Method of Upscaling a Color Image," Filed Dec. 14, 1999, U.S. Appl. No. 09/461,080, pp. 1-22. |
Tinku Acharya, "Multiplierless Pyramid Filter," Filed Jan. 3, 2001, U.S. Appl. No. 09/754,684, pp. 1-22. |
Tinku Acharya, "Pyramid Filter," Filed Mar. 28, 2001, U.S. Appl. No. 09/820,108, pp. 1-23. |
Tinku Acharya, "SAD Computation Architectue," Filed Sep. 29, 2000, U.S. Appl. No. 09/677,829, pp. 1-24. |
Tinku Acharya, "SAD Computation Architecture," Filed Sep. 29, 2000, U.S. Appl. No. 09/677,830, pp. 1-27. |
Tinku Acharya, "Signal to Noise Ration Optimization for Video Compression Bit-Rate Control," Filed Sep. 5, 2001, U.S. Appl. No. 09/947,331, pp. 1-25. |
Tinku Acharya, "Sub-Sampled Infrared Sensor for Use in a Digital Image Capture Device," Filed Feb. 28, 2003, U.S. Appl. No. 10/376,127, pp. 1-33. |
Tinku Acharya, "Techniques to Implement One-Dimensional Compression," Filed Sep. 18, 2000, U.S. Appl. No. 09/666,486, pp. 1-18. |
Tinku Acharya, "Techniques to Implement Two-Dimensional Compression," Filed Sep. 18, 2000, U.S. Appl. No. 09/664,131, pp. 1-24. |
Tinku Acharya, "Two-Dimensional Pyramid Filter Architecture," Filed Apr. 30, 2001, U.S. Appl. No. 09/846,609, pp. 1-37. |
Tinku Acharya, "Two-Dimensional Pyramid Filter Architecture," Filed Mar. 26, 2001, U.S. Appl. No. 09/817,711, pp. 1-32. |
Tinku Acharya, "Two-Dimensional Pyramid Filter Architecture," Filed Mar. 30, 2001, U.S. Appl. No. 09/823,212, pp. 1-37. |
Tinku Acharya, "Two-Dimensional Pyramid Filter Architecture," Filed Mar. 30, 2001, U.S. Appl. No. 09/823,390, pp. 1-38. |
Tinku Acharya, "Video Motion Estimation," Filed Sep. 27, 1999, U.S. Appl. No. 09/406,032, pp. 1-24. |
Tsai et al., "Method and Apparatus for Adaptively Sharpening an Image," Filed May 26, 1999, U.S. Appl. No. 09/320,192, pp. 1-29. |
Wang et al., "Progressive Two-Dimensional (2D) Pyramid Filter," Filed Dec. 28, 2001, U.S. Appl. No. 10/039,434, pp. 1-26. |
Cited By (82)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050029456A1 (en) * | 2003-07-30 | 2005-02-10 | Helmuth Eggers | Sensor array with a number of types of optical sensors |
US20060221250A1 (en) * | 2004-01-28 | 2006-10-05 | Canesta, Inc. | Method and system to increase X-Y resolution in a depth (Z) camera using red, blue, green (RGB) sensing |
US8134637B2 (en) * | 2004-01-28 | 2012-03-13 | Microsoft Corporation | Method and system to increase X-Y resolution in a depth (Z) camera using red, blue, green (RGB) sensing |
US20090303553A1 (en) * | 2004-03-30 | 2009-12-10 | Sony Corporation | Pixel array and image processing apparatus for image-capturing |
US20050231618A1 (en) * | 2004-03-30 | 2005-10-20 | Toshinobu Sugiyama | Image-capturing apparatus |
US8638378B2 (en) * | 2004-04-02 | 2014-01-28 | Sony Corporation | Pixel array and image processing apparatus for image-capturing |
US7746394B2 (en) * | 2004-04-02 | 2010-06-29 | Sony Corporation | Pixel array and image processing apparatus for image-capturing |
US7456384B2 (en) * | 2004-12-10 | 2008-11-25 | Sony Corporation | Method and apparatus for acquiring physical information, method for manufacturing semiconductor device including array of plurality of unit components for detecting physical quantity distribution, light-receiving device and manufacturing method therefor, and solid-state imaging device and manufacturing method therefor |
US20060124833A1 (en) * | 2004-12-10 | 2006-06-15 | Atsushi Toda | Method and apparatus for acquiring physical information, method for manufacturing semiconductor device including array of plurality of unit components for detecting physical quantity distribution, light-receiving device and manufacturing method therefor, and solid-state imaging device and manufacturing method therefor |
US9591239B2 (en) * | 2005-07-21 | 2017-03-07 | Sony Corporation | Physical information acquisition method, physical information acquisition device, and semiconductor device |
US20140009662A1 (en) * | 2005-07-21 | 2014-01-09 | Sony Corporation | Physical information acquistision method, physical information acquisition device, and semiconductor device |
US8981278B2 (en) * | 2005-07-21 | 2015-03-17 | Sony Corporation | Physical information acquisition method, physical information acquisition device, and semiconductor device |
US20070183657A1 (en) * | 2006-01-10 | 2007-08-09 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Color-image reproduction apparatus |
US20070273781A1 (en) * | 2006-05-26 | 2007-11-29 | Samsung Electronics Co., Ltd. | Image capturing device and method |
US8068159B2 (en) * | 2006-05-26 | 2011-11-29 | Samsung Electronics Co., Ltd. | Image capturing device and method with infrared detection thorugh plural filter regions |
US7864233B2 (en) | 2006-06-01 | 2011-01-04 | Samsung Electronics Co., Ltd. | Image photographing device and method |
US20070285540A1 (en) * | 2006-06-01 | 2007-12-13 | Samsung Electronics Co., Ltd. | Image photographing device and method |
US20080111894A1 (en) * | 2006-11-10 | 2008-05-15 | Sanyo Electric Co., Ltd | Imaging apparatus and image signal processing device |
US7956325B2 (en) * | 2006-11-10 | 2011-06-07 | Sanyo Electronic Co., Ltd. | Imaging apparatus and image signal processing device |
US9103666B2 (en) | 2007-05-17 | 2015-08-11 | Technion Research And Development Foundation, Ltd. | Compact 3D scanner with fixed pattern projector and dual band image sensor |
US8659698B2 (en) * | 2007-05-17 | 2014-02-25 | Ilya Blayvas | Compact 3D scanner with fixed pattern projector and dual band image sensor |
US20080285056A1 (en) * | 2007-05-17 | 2008-11-20 | Ilya Blayvas | Compact 3D scanner with fixed pattern projector and dual band image sensor |
US20090073284A1 (en) * | 2007-09-19 | 2009-03-19 | Kenzo Isogawa | Imaging apparatus and method |
US20090114803A1 (en) * | 2007-11-07 | 2009-05-07 | Fujifilm Corporation | Image capturing system, image capturing method, and recording medium |
US7667180B2 (en) * | 2007-11-07 | 2010-02-23 | Fujifilm Corporation | Image capturing system, image capturing method, and recording medium |
US20090114799A1 (en) * | 2007-11-07 | 2009-05-07 | Fujifilm Corporation | Image capturing system, image capturing method, and recording medium |
US7675017B2 (en) * | 2007-11-07 | 2010-03-09 | Fujifilm Corporation | Image capturing system, image capturing method, and recording medium |
US20090278048A1 (en) * | 2008-05-09 | 2009-11-12 | Won-Hee Choe | Multilayer image sensor |
US8436308B2 (en) * | 2008-05-09 | 2013-05-07 | Samsung Electronics Co., Ltd. | Multilayer image sensor |
US20100102366A1 (en) * | 2008-10-24 | 2010-04-29 | Jong-Jan Lee | Integrated Infrared and Color CMOS Imager Sensor |
US7915652B2 (en) | 2008-10-24 | 2011-03-29 | Sharp Laboratories Of America, Inc. | Integrated infrared and color CMOS imager sensor |
US8666153B2 (en) * | 2008-11-04 | 2014-03-04 | Konica Minolta Opto, Inc. | Image input apparatus |
US8810700B2 (en) * | 2009-02-24 | 2014-08-19 | Taiwan Semiconductor Manufacturing Company, Ltd. | Front side implanted guard ring structure for backside |
US20130334645A1 (en) * | 2009-02-24 | 2013-12-19 | Taiwan Semiconductor Manufacturing Company, Ltd. | Front side implanted guard ring structure for backside |
US20120026357A1 (en) * | 2009-04-07 | 2012-02-02 | Konica Minolta Opto, Inc. | Image input device |
US8411176B2 (en) * | 2009-04-07 | 2013-04-02 | Konica Minolta Opto, Inc. | Image input device |
US20140118493A1 (en) * | 2009-04-16 | 2014-05-01 | Primesense Ltd. | Three-dimensional mapping and imaging |
US9350973B2 (en) * | 2009-04-16 | 2016-05-24 | Apple Inc. | Three-dimensional mapping and imaging |
US20100295947A1 (en) * | 2009-05-21 | 2010-11-25 | Pierre Benoit Boulanger | Multi-Spectral Color and IR Camera Based on Multi-Filter Array |
US20110079714A1 (en) * | 2009-10-01 | 2011-04-07 | Microsoft Corporation | Imager for constructing color and depth images |
CN102812697A (en) * | 2009-10-01 | 2012-12-05 | 微软公司 | Imager For Constructing Color And Depth Images |
US8723118B2 (en) | 2009-10-01 | 2014-05-13 | Microsoft Corporation | Imager for constructing color and depth images |
WO2011041066A3 (en) * | 2009-10-01 | 2011-06-23 | Microsoft Corporation | Imager for constructing color and depth images |
US20110085063A1 (en) * | 2009-10-14 | 2011-04-14 | Dong Ki Min | Color filter array, image sensor having the same, and signal interpolating method |
US8599291B2 (en) * | 2009-10-14 | 2013-12-03 | Samsung Electronics Co., Ltd. | Color filter array, image sensor having the same, and signal interpolating method |
US8542348B2 (en) | 2010-11-03 | 2013-09-24 | Rockwell Automation Technologies, Inc. | Color sensor insensitive to distance variations |
US8823845B2 (en) | 2010-12-01 | 2014-09-02 | Samsung Electronics Co., Ltd. | Color filter array, image sensor having the same, and image processing system having the same |
US8796626B2 (en) * | 2011-03-09 | 2014-08-05 | Samsung Display Co., Ltd. | Optical sensor |
US20120228505A1 (en) * | 2011-03-09 | 2012-09-13 | Samsung Electronics Co., Ltd. | Optical sensor |
US9871980B2 (en) | 2011-04-04 | 2018-01-16 | Apple Inc. | Multi-zone imaging sensor and lens array |
US9013620B2 (en) | 2011-04-20 | 2015-04-21 | Trw Automotive U.S. Llc | Multiple band imager and method |
US9402067B2 (en) | 2012-10-22 | 2016-07-26 | Samsung Electronics Co., Ltd. | Imaging optical system for 3D image acquisition apparatus, and 3D image acquisition apparatus including the imaging optical system |
US9904981B2 (en) | 2012-11-20 | 2018-02-27 | Samsung Electronics Co., Ltd. | Image processing apparatus and method for color-depth demosaicing |
US9247109B2 (en) | 2013-03-15 | 2016-01-26 | Samsung Electronics Co., Ltd. | Performing spatial and temporal image contrast detection in pixel array |
US9667933B2 (en) * | 2013-07-01 | 2017-05-30 | Omnivision Technologies, Inc. | Color and infrared filter array patterns to reduce color aliasing |
US9692992B2 (en) | 2013-07-01 | 2017-06-27 | Omnivision Technologies, Inc. | Color and infrared filter array patterns to reduce color aliasing |
US20150181187A1 (en) * | 2013-07-01 | 2015-06-25 | Omnivision Technologies, Inc. | Color and infrared filter array patterns to reduce color aliasing |
US20150146054A1 (en) * | 2013-11-27 | 2015-05-28 | Aptina Imaging Corporation | Image sensors with color filter elements of different sizes |
US10257455B2 (en) * | 2014-12-22 | 2019-04-09 | Google Llc | Image sensor and light source driver integrated in a same semiconductor package |
US10056422B2 (en) | 2014-12-22 | 2018-08-21 | Google Llc | Stacked semiconductor chip RGBZ sensor |
US9615013B2 (en) * | 2014-12-22 | 2017-04-04 | Google Inc. | Image sensor having multiple output ports |
USRE49748E1 (en) * | 2014-12-22 | 2023-12-05 | Google Llc | Image sensor and light source driver integrated in a same semiconductor package |
US9741755B2 (en) | 2014-12-22 | 2017-08-22 | Google Inc. | Physical layout and structure of RGBZ pixel cell unit for RGBZ image sensor |
US9843755B2 (en) | 2014-12-22 | 2017-12-12 | Google Inc. | Image sensor having an extended dynamic range upper limit |
US9866740B2 (en) * | 2014-12-22 | 2018-01-09 | Google Llc | Image sensor having multiple output ports |
US9871065B2 (en) | 2014-12-22 | 2018-01-16 | Google Inc. | RGBZ pixel unit cell with first and second Z transfer gates |
US9508681B2 (en) | 2014-12-22 | 2016-11-29 | Google Inc. | Stacked semiconductor chip RGBZ sensor |
US9876050B2 (en) | 2014-12-22 | 2018-01-23 | Google Llc | Stacked semiconductor chip RGBZ sensor |
US9591247B2 (en) | 2014-12-22 | 2017-03-07 | Google Inc. | Image sensor having an extended dynamic range upper limit |
US9425233B2 (en) * | 2014-12-22 | 2016-08-23 | Google Inc. | RGBZ pixel cell unit for an RGBZ image sensor |
USRE49664E1 (en) * | 2014-12-22 | 2023-09-19 | Google Llc | Image sensor and light source driver integrated in a same semiconductor package |
US10128287B2 (en) | 2014-12-22 | 2018-11-13 | Google Llc | Physical layout and structure of RGBZ pixel cell unit for RGBZ image sensor |
US10141366B2 (en) | 2014-12-22 | 2018-11-27 | Google Inc. | Stacked semiconductor chip RGBZ sensor |
US9581696B2 (en) * | 2014-12-22 | 2017-02-28 | Google Inc. | Image sensor and light source driver integrated in a same semiconductor package |
US10263022B2 (en) | 2014-12-22 | 2019-04-16 | Google Llc | RGBZ pixel unit cell with first and second Z transfer gates |
US10291870B2 (en) | 2014-12-22 | 2019-05-14 | Google Llc | Monolithically integrated RGB pixel array and Z pixel array |
US10368022B2 (en) | 2014-12-22 | 2019-07-30 | Google Llc | Monolithically integrated RGB pixel array and Z pixel array |
DE112015005713B4 (en) | 2014-12-22 | 2022-11-24 | Google LLC (n.d.Ges.d. Staates Delaware) | RGBZ pixel unit cell with first and second Z transfer gates |
US10990186B2 (en) | 2016-01-15 | 2021-04-27 | Google Llc | Virtual reality head-mounted devices having reduced numbers of cameras, and methods of operating the same |
US10114465B2 (en) * | 2016-01-15 | 2018-10-30 | Google Llc | Virtual reality head-mounted devices having reduced numbers of cameras, and methods of operating the same |
US20170205886A1 (en) * | 2016-01-15 | 2017-07-20 | Google Inc. | Virtual reality head-mounted devices having reduced numbers of cameras, and methods of operating the same |
US10412280B2 (en) | 2016-02-10 | 2019-09-10 | Microsoft Technology Licensing, Llc | Camera with light valve over sensor array |
Also Published As
Publication number | Publication date |
---|---|
US20040169749A1 (en) | 2004-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7274393B2 (en) | Four-color mosaic pattern for depth and image capture | |
US20040174446A1 (en) | Four-color mosaic pattern for depth and image capture | |
CN204697179U (en) | There is the imageing sensor of pel array | |
JP2019110564A (en) | Method of using array sensor to measure multiple types of data at full resolution of sensor | |
EP1530873B1 (en) | One chip, low light level color camera | |
US7362894B2 (en) | Image processing apparatus and method, recording medium, and program | |
US8339489B2 (en) | Image photographing apparatus, method and medium with stack-type image sensor, complementary color filter, and white filter | |
EP1241896B1 (en) | Colour image pickup device with improved colour filter array | |
US6765616B1 (en) | Electric camera | |
JP4139641B2 (en) | Solid-state image sensor | |
US20130278802A1 (en) | Exposure timing manipulation in a multi-lens camera | |
JP5501448B2 (en) | Imaging apparatus and solid-state imaging device driving method | |
US20040169748A1 (en) | Sub-sampled infrared sensor for use in a digital image capture device | |
US9324749B2 (en) | Color imaging element and imaging device | |
US9100558B2 (en) | Color imaging element and imaging apparatus | |
WO2005099247A2 (en) | The reproduction of alternative forms of light from an object using a digital imaging system | |
US20030151685A1 (en) | Digital video camera having only two CCDs | |
TW200818899A (en) | Method, imager and system providing paired-bayer color filter array and interlaced readout | |
JP5378626B2 (en) | Imaging apparatus and operation control method thereof | |
CA2443658C (en) | Method and apparatus for sensing and interpolating color image data | |
CN104025578A (en) | Color Imaging Element | |
EP2800376B1 (en) | Imaging device, method for controlling imaging device, and control program | |
US8711257B2 (en) | Color imaging device | |
US20130044244A1 (en) | Solid-state imaging device and imaging apparatus | |
Etoh | Progress beyond ISIS: combined triple-ISIS camera, video trigger, and terraced image sensor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INTEL CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ACHARYA, TINKU;REEL/FRAME:014959/0656 Effective date: 20040203 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |
|
AS | Assignment |
Owner name: TAHOE RESEARCH, LTD., IRELAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTEL CORPORATION;REEL/FRAME:061175/0176 Effective date: 20220718 |