US20060215049A1 - Constant resolution and space variant sensor arrays - Google Patents
Constant resolution and space variant sensor arrays Download PDFInfo
- Publication number
- US20060215049A1 US20060215049A1 US11/370,195 US37019506A US2006215049A1 US 20060215049 A1 US20060215049 A1 US 20060215049A1 US 37019506 A US37019506 A US 37019506A US 2006215049 A1 US2006215049 A1 US 2006215049A1
- Authority
- US
- United States
- Prior art keywords
- sensor element
- sensor
- element location
- series
- substantially constant
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000003491 array Methods 0.000 title claims description 14
- 230000003247 decreasing effect Effects 0.000 claims abstract description 5
- 230000005855 radiation Effects 0.000 claims description 8
- 238000003384 imaging method Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 239000007787 solid Substances 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 210000001525 retina Anatomy 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000001508 eye Anatomy 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
- G01J1/4228—Photometry, e.g. photographic exposure meter using electric radiation detectors arrangements with two or more detectors, e.g. for sensitivity compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/702—SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
Definitions
- the present invention relates to the provision of an array of sensor elements especially radiation sensitive elements. Such arrays may find advantageous use in cameras.
- Solid state image sensors are well known. Commonly solid state image sensors are implemented in a CCD-technology or in a CMOS— or MOS-technology. Solid state image sensors find a widespread use in camera systems. A matrix of pixels comprising light sensitive elements constitutes an image sensor, which is mounted in the camera system. The signal of the matrix is measured and transformed to a so-called video-signal.
- CCD-based camera systems have less noise fluctuations in the image compared to CMOS— or MOS-based camera systems. Therefore CCD-based camera systems are nowadays preferred in applications wherein a high image quality is required such as video or still camera applications. Due to the further miniaturization of the CMOS electronics technology, it is possible to realize complex CMOS— or MOS-based pixels as small as CCD-based pixels. It is a further advantage of CMOS— or MOS-based pixels that CMOS is a technology being widely offered whereas CCD-technology is rarely offered and is a more complex and expensive one.
- CMOS or MOS image sensors with passive pixels and CMOS or MOS image sensors with active pixels are known.
- An active pixel is configured with means integrated in the pixel to amplify the charge that is collected on the light sensitive element. Passive pixels do not have such means and require a charge-sensitive amplifier that is not integrated in the pixel but is connected with a line towards the pixel.
- space-variant visual sensors in image communication and processing is gaining more and more attention as a simple and direct way of reducing the visual information transmitted and/or processed while preserving both high resolution and a wide field of view.
- U.S. Pat. No. 4,267,573 describes an interesting device in which the sensors are located on logarithmic spirals. However, at the center of the sensor array the sensor density approaches infinity. Hence, for the central region another solution has to be found, e.g. a hole is left in the middle where there are no sensors.
- U.S. Pat. No. 5,587,580 shows a polar array of sensor elements. However, how the central region is dealt with is not described.
- U.S. Pat. No. 5,712,729 shows a non-spatially variant array based on a hexagonal geometrical pattern. Non-spatially variant arrays are wasteful of sensors at large radii. Further, a hexagonal geometry also includes a local discontinuity at each apex.
- the present invention has for its object to realize a spatially variant sensor array which is substantially free of local or global discontinuities.
- Still a further object of the present invention is to provide an electronic camera with a spatial arrangement which may have a similar functionality to that of the human retina.
- the present invention may provide a sensor array comprising: a substantially constant resolution portion comprising a first series of first concentric closed rings, each first closed ring comprising a monodimensional array of equally spaced sensor element locations, each location including at aleast one sensor element; and a spatially variant portion comprising a second series of second concentric closed rings, the second series being concentric with the first series and each second closed ring comprising a monodimensional array of equally spaced sensor element locations, each location having at least one sensor element, the spatially variant portion surrounding or being surrounded by the substantially constant resolution portion, and the density of sensor element locations continuously increasing or decreasing between the substantially constant resolution portion and the spatially variant portion.
- each sensor location site there may be one or more sensor elements, e.g. in a color sensor array each sensor location site may include three sensor elements, each one sensitive to a primal color such as red, green or blue.
- the sensor elements may be identical with respective filters arranged in the light path to select the wavelength or wavelength range to be detected by each sensor element.
- An efficient number of sensor elements may be used in accordance with certain embodiments of the present invention by varying the resolution from a central region having a substantially uniform resolution to an outer region having a spatially variant resolution
- the present invention may find advantageous use in an integrated design of a solid state sensor, which may be combined with a lens and driving electronics in a miniature camera device.
- the present invention may include a substantially constant resolution sensor array comprising a first series of concentric closed rings, each closed ring comprising a monodimensional array of equally spaced sensor element locations, each location having at least one sensor element, in which the number of sensor element locations in each closed ring is defined by the i th closed ring having n sensor element locations and the i+1 th closed ring having n+m sensor element locations where n is not equal to 1, and the envelope through the middle of the sensor element locations of one closed ring is a closed smooth curve.
- the closed smooth curve may be a circle, ellipse, oval, egg-shape or similar.
- FIG. 1 shows a diagram of the center of a conventional CMOS spatially variant imaging sensor.
- FIG. 2 shows a substantially constant resolution sensor array in accordance with an embodiment of the present invention.
- FIG. 3 shows a substantially constant resolution sensor array in accordance with an embodiment of the present invention having an elliptical form.
- FIGS. 4 to 9 each show a substantially constant resolution sensor array in accordance with an embodiment of the present invention
- FIG. 10 is a graph showing the relationship between aspect ratio and symmetry m for substantially constant resolution sensor arrays in accordance with individual embodiments of the present invention
- FIGS. 11A and B are, respectively, the representation of the sensor array and the variation of sensor spacing with radial distance in accordance with an embodiment of the present invention.
- FIGS. 11C and 11D are, respectively, the representation of the sensor array and the variation of sensor spacing with radial distance in accordance with another embodiment of the present invention in which the sensor spacing merges gradually from the substantially constant resolution portion into the space variant portion.
- FIGS. 12A and B are, respectively, the representation of the sensor array and the variation of sensor spacing with radial distance in accordance with another embodiment of the present invention in which the sensor spacing merges gradually from the substantially constant resolution portion into the space variant portion and back to a substantially constant resolution portion
- FIGS. 13A and 13B show individual embodiments of sensor arrays including a substantially constant resolution portion and an outer space variant portion whereby in
- FIG. 13B the sensor location sites in each ring are displaced by one half of the site spacing compared to the previous ring.
- FIGS. 14 and 15 show individual embodiments of sensor arrays including a substantially constant resolution portion and an outer space variant portion.
- FIG. 16 shows an embodiment of sensor location sites of a substantially constant resolution portion of a sensor array.
- FIG. 17 shows a further embodiment of sensor location sites of a substantially constant resolution portion of a sensor array.
- Aspect ratio the ratio between the radial and the angular distances dimension of each sensor element location site or of each sensor. Alternatively, the ratio between the mid-line to mid-line radial distance between neighboring rings and the angular distance between neighboring sensor element location sites or sensors.
- Sensor density number of sensor elements per unit area or the number of sensor element location sites per unit area. There can be a global and local density values.
- a global density is the density for the whole array or of a significant part of an array.
- Local density is the density of a small area of the array, e.g. defined by a sensor element location site or a sensor element and its neighbors. Sensor geometries with local discontinuities generally show local variations in local density.
- a log-polar array has a local resolution which varies linearly with radius.
- Resolution the inverse of the centre-centre distance between adjacent sensor element location sites or between sensor elements, for example it may be quoted as “dots per inch”, “pixels per inch” or similar.
- a global resolution is the resolution typically possible for the whole array or for large part of an array.
- Local resolution is the centre-centre distance between sensor elements or sensor element location sites in a small area of the array, e.g. between one sensor element location site or sensor element and its neighbors. Sensor geometries with local discontinuities generally show local variations in local resolution.
- Closed smooth curve a closed figure which is non-polygonal. Examples are circle, ellipse, oval, egg-shape
- the present invention will be described with reference to certain embodiments and drawings but is not limited to these but only by the claims.
- the drawings are schematic.
- the present invention will mainly be described with reference to a radiation sensitive sensor array but the present invention is not limited thereto.
- the sensor element geometries of the present invention may be made with any suitable sensor elements, e.g. tactile sensor elements, proximity sensors.
- the present invention relates to the provision of a synthetic sensor array with a substantially constant resolution portion.
- synthetic is meant that natural sensor arrays such as the human eye are excluded.
- the substantially constant resolution portion may be used with a spatially variant portion which either surrounds the substantially constant resolution portion on the outside or is enclosed by the substantially constant resolution portion.
- CMOS or MOS semiconductor processing technology it is preferred in the present invention to use conventional CMOS or MOS semiconductor processing technology but the present invention is not limited thereto and includes other manufacturing technologies and devices made therefrom, such as CCD arrays.
- the present invention is not limited to visual light sensors but may be used with any radiation sensitive elements, e.g. those sensitive to X-rays or infra-red or ultra-violet radiation.
- sensor arrays in accordance with the present invention need not be radiation sensitive, they may be used, for instance, with tactile sensors, e.g. to model a synthetic finger tip.
- the sensors of the present invention may be conveniently manufactured in 0.35 micron CMOS technology but the present invention is not limited thereto.
- An individual sensor with such technology may have a diameter of about 7 micron.
- CMOS technology e.g. 0.35 micron
- An individual sensor with such technology may have a diameter of about 7 micron.
- electronic re-mapping e.g. log-polar mapping
- Such an array makes poor use of the large number of outer sensor elements as these are at the extremes of the field of view of a camera where high resolution is not so relevant.
- the number of these elements increases as the square of the radius so the total number of elements of such a uniform array compared to a space variant one is significantly larger. This increases processing time and therefore the cost of the sensor array.
- sensor element location sites 14 and sensor elements An example will be described for sensor element location sites with a symmetry of 6 (see below) but the skilled person will appreciate that the principles may be extended to a range of symmetries.
- FIG. 16 a series of concentric rings 16 of areas 14 is shown. These areas 14 are locations in which at least one sensor element is located hence they are sensor element location sites 14 . More than one sensor element may be located in the each sensor element location site 14 . Also a sensor element need not be located at the center of a sensor element location site 14 . It is included within the present invention that a sensor element may be displaced from the center of a sensor element location, for example the displacements may be small, random in size and random in direction.
- FIG. 17 shows a further arrangement of sensor location sites 14 .
- the array consists of a series of concentric rings 16 each with a plurality of equally spaced sensor element sites 14 .
- Each site is contiguous with the next one.
- Each site contains at least one sensor element.
- the arrangement of the sites 14 is perfect in each ring and between rings provided a substantially constant resolution array is generated.
- An embodiment of the present invention relates to a circular (polar) and regular arrangement of sensor element location sites 14 covering a bi-dimensional sensor array.
- the center of each site 14 is marked with a dot.
- each site has an area determined by the bounds of the ring and its neighbors.
- one or more sensor elements may be located within each sensor element location site 14 .
- Such sensor elements are known, for example, from EP 739 039, EP 858 111, EP 773 669, for instance.
- This arrangement is intended primarily to implement at least one substantially constant resolution area 12 in a sensor 10 with a polar geometry (see FIG. 2 ).
- This constant resolution and polar arrangement is realized with sensor element location sites 14 arranged on concentric rings 16 which could be circles or any other closed curve, in particular closed, smooth curve, such as an ellipse as shown in FIG. 3 or an egg shape or an oval.
- “Substantially constant resolution” may be defined in accordance with the present invention as a polar array of sensor element locations 14 as described above wherein the radial displacement of any sensor element location site from a regular polar distribution is ⁇ 5% of the radius (defined by the distance from the center of the relevant ring) of the respective sensor element location site, more preferably ⁇ 3% of the radius and most preferably ⁇ 1% of the radius.
- the displacement of the sensor element location sites 14 from a regular polar distribution may be ⁇ 20% of the sensor element location site spacing in the angular direction (circumferential direction), more preferably ⁇ 10% and most preferably ⁇ 5% of the sensor element location site spacing in any ring.
- a substantially constant resolution portion 12 in accordance with an embodiment of the present invention may be characterized by a constant increase in the number of sensor element location sites per ring. For example if n (n ⁇ 1) is the number of sensor element location sites at the i th circle of an m-symmetric array circle i+1 has n+m sensor element location sites.
- FIGS. 4 to 9 Various different symmetries are shown in FIGS. 4 to 9 .
- each ring 16 (other than the second ring) has m more sensor element location sites 14 than the ring inside it.
- the sensor element location sites 14 are distributed evenly along the ring.
- FIGS. 4 to 9 show arrangements with m being 4, 5, 6, 7, 8, 9 respectively. The radius of each ring is calculated on the basis of equation 1.
- R n ⁇ 1 ⁇ 2 ⁇ +k Equation 1
- R is the radius
- n is the number of sensor element location sites per ring
- 1 is the minimum center-centre distance between sensor element location sites around a ring
- k is a constant which is usually zero. The constant “k” effectively increases the dimension “1” by a fixed amount.
- the different symmetries shown are also characterized by the aspect ratio of each single sensory element locations.
- the aspect ratio of one sensor element location site may be defined as the ratio between the radial and the angular distances between the one sensor element location site and neighboring sensor element location sites or, alternatively, between the radial and the angular dimension of each single sensor element location sites.
- a log polar mapping may be obtained by keeping the number of sensor element location sites per ring constant while the radius of each ring is defined in a log-polar manner, i.e. the ratio of the radii of adjacent ring is a constant. In such an arrangement the ratio of the diameters of adjacent rings is a constant.
- FIGS. 11 c and 11 d show a further embodiment of the present invention in which an even smoother transition between the central constant resolution area 12 and the spatially variant peripheral part 18 of the array is obtained by sensor element location site spacing adjustments at the interface between region 12 and 18 .
- the sensor element location site spacing may be gradually varied between the constant resolution portion and the spatially variant portion as shown in FIG. 11 d.
- This gradual change may be defined by any suitable smoothing function. If the example of a log-polar mapping is taken for the spatially variant portion then the ratio of the outer diameters of adjacent rings is a constant in this portion. In the transition region between the constant resolution portion and the spatially variant portion this constant ratio of the radii of adjacent rings is changed smoothly from the value achieved at the outer ring of the constant resolution portion to the value in the body of the spatially variant portion.
- Constant resolution spatial arrangements in accordance with the present invention can be used not only for inner regions (as shown in FIG. 2 ) but also for annular regions 20 surrounding, for example, a space-variant circular region 18 . This is shown in FIGS. 12 a and 12 b in which there is a constant resolution portion 12 at the center and at the outer portion 20 of the sensor array with a log-polar arrangement in-between.
- Sensor arrangements according to the present invention can be used as the basic sensor array of a color visual sensor.
- FIG. 13 a An array with a quasi-square tessellation
- FIG. 13 b An array with a quasi-hexagonal one
- each sensor element location site 14 includes one sensor element having a diameter of about 7 micron. This results in an diameter for the inner constant resolution portion of about 73 micron and about 100 micron for each design, respectively.
- Chip per ring radius element size Pixels Pixels - radius Rings - Rings - (periphery) micron micron micron center outer micron center outer 66 73 7 17 330 726 200 10 11 90 100 7 13 630 900 200 14 10
- the two sensor arrays shown in FIGS. 14 and 15 demonstrate the absence of local and global discontinuities. In these designs there is one sensor element per sensor element location site and this sensor element completely fills the location site.
- the sensor arrays as described above in accordance with any of the embodiments of the present invention may find advantageous use in cameras, especially miniature cameras.
- Such cameras may be included in surveillance schemes such as for door or intruder surveillance, cameras for mounting in mobile telephones or lap-top or palm-top computers for capturing still and video images for transmission over telecommunications networks or similar, “eye-ball” cameras for mounting close to a Personal Computer for capturing still or video images and for transmission over telecommunications networks such as company Intranets, WAN's or the Internet or via telephone lines.
- the sensor arrays as described above may be associated with active or passive read-out electronics and digital signal processing circuitry to provide an electronic digital output of the image sensed by the array.
Abstract
A sensor array is described comprising a substantially constant resolution portion comprising a first series of first concentric closed rings, each first closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location site including at aleast one sensor element; and a spatially variant portion comprising a second series of second concentric closed rings, the second series being concentric with the first series and each second closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location site having at least one sensor element, the spatially variant portion surrounding or being surrounded by the substantially constant resolution portion, and the density of sensor element location sites continuously increasing or decreasing between the substantially constant resolution portion and the spatially variant portion.
Description
- The present invention relates to the provision of an array of sensor elements especially radiation sensitive elements. Such arrays may find advantageous use in cameras.
- Solid state image sensors are well known. Commonly solid state image sensors are implemented in a CCD-technology or in a CMOS— or MOS-technology. Solid state image sensors find a widespread use in camera systems. A matrix of pixels comprising light sensitive elements constitutes an image sensor, which is mounted in the camera system. The signal of the matrix is measured and transformed to a so-called video-signal.
- CCD-based camera systems have less noise fluctuations in the image compared to CMOS— or MOS-based camera systems. Therefore CCD-based camera systems are nowadays preferred in applications wherein a high image quality is required such as video or still camera applications. Due to the further miniaturization of the CMOS electronics technology, it is possible to realize complex CMOS— or MOS-based pixels as small as CCD-based pixels. It is a further advantage of CMOS— or MOS-based pixels that CMOS is a technology being widely offered whereas CCD-technology is rarely offered and is a more complex and expensive one.
- Of the image sensors implemented in a CMOS— or MOS-technology, CMOS or MOS image sensors with passive pixels and CMOS or MOS image sensors with active pixels are known. An active pixel is configured with means integrated in the pixel to amplify the charge that is collected on the light sensitive element. Passive pixels do not have such means and require a charge-sensitive amplifier that is not integrated in the pixel but is connected with a line towards the pixel.
- The use of space-variant visual sensors in image communication and processing is gaining more and more attention as a simple and direct way of reducing the visual information transmitted and/or processed while preserving both high resolution and a wide field of view.
- Several attempts have been made to make visual sensors which are compact and which provide good resolution at least in a central portion of the sensor array. One such sensor array is known from U.S. Pat. No. 5,166,511 and includes a central square CCD array and outer rings of radiation sensitive elements. This device has the disadvantage that there is a significant discontinuity between the central Cartesian array and the outer polar array. A similar device in CMOS technology is described in the article by Wodnicki et al. entitled “A foveated image sensor in standard CMOS technology”, Proc. Custom Integrated Circuits Conf. pages 357-360, 1995. A further attempt has been made and an enlarged view of the central portion of the sensor array is shown in
FIG. 1 . As can be seen, radial lines of sensors end abruptly causing a local discontinuity in resolution. Although the transition between the central sensor array region and the outer region is better than previously mentioned examples, there are still local discontinuities which can affect picture quality. - U.S. Pat. No. 4,267,573 describes an interesting device in which the sensors are located on logarithmic spirals. However, at the center of the sensor array the sensor density approaches infinity. Hence, for the central region another solution has to be found, e.g. a hole is left in the middle where there are no sensors. U.S. Pat. No. 5,587,580 shows a polar array of sensor elements. However, how the central region is dealt with is not described. U.S. Pat. No. 5,712,729 shows a non-spatially variant array based on a hexagonal geometrical pattern. Non-spatially variant arrays are wasteful of sensors at large radii. Further, a hexagonal geometry also includes a local discontinuity at each apex.
- The present invention has for its object to realize a spatially variant sensor array which is substantially free of local or global discontinuities.
- Still a further object of the present invention is to provide an electronic camera with a spatial arrangement which may have a similar functionality to that of the human retina.
- The present invention may provide a sensor array comprising: a substantially constant resolution portion comprising a first series of first concentric closed rings, each first closed ring comprising a monodimensional array of equally spaced sensor element locations, each location including at aleast one sensor element; and a spatially variant portion comprising a second series of second concentric closed rings, the second series being concentric with the first series and each second closed ring comprising a monodimensional array of equally spaced sensor element locations, each location having at least one sensor element, the spatially variant portion surrounding or being surrounded by the substantially constant resolution portion, and the density of sensor element locations continuously increasing or decreasing between the substantially constant resolution portion and the spatially variant portion.
- Dependent claims relate to preferred embodiments of such a spatially variant sensor array. At each sensor location site there may be one or more sensor elements, e.g. in a color sensor array each sensor location site may include three sensor elements, each one sensitive to a primal color such as red, green or blue. The sensor elements may be identical with respective filters arranged in the light path to select the wavelength or wavelength range to be detected by each sensor element. An efficient number of sensor elements may be used in accordance with certain embodiments of the present invention by varying the resolution from a central region having a substantially uniform resolution to an outer region having a spatially variant resolution The present invention may find advantageous use in an integrated design of a solid state sensor, which may be combined with a lens and driving electronics in a miniature camera device.
- The present invention may include a substantially constant resolution sensor array comprising a first series of concentric closed rings, each closed ring comprising a monodimensional array of equally spaced sensor element locations, each location having at least one sensor element, in which the number of sensor element locations in each closed ring is defined by the ith closed ring having n sensor element locations and the i+1th closed ring having n+m sensor element locations where n is not equal to 1, and the envelope through the middle of the sensor element locations of one closed ring is a closed smooth curve. The closed smooth curve may be a circle, ellipse, oval, egg-shape or similar. Dependent claims relate to preferred embodiments of such a substantially constant resolution sensor array.
- Further advantages, features and details will become apparent in the light of a description of preferred embodiments according to the present invention, in reference is made to the following drawings.
-
FIG. 1 shows a diagram of the center of a conventional CMOS spatially variant imaging sensor. -
FIG. 2 shows a substantially constant resolution sensor array in accordance with an embodiment of the present invention. -
FIG. 3 shows a substantially constant resolution sensor array in accordance with an embodiment of the present invention having an elliptical form. - FIGS. 4 to 9 each show a substantially constant resolution sensor array in accordance with an embodiment of the present invention
-
FIG. 10 is a graph showing the relationship between aspect ratio and symmetry m for substantially constant resolution sensor arrays in accordance with individual embodiments of the present invention -
FIGS. 11A and B are, respectively, the representation of the sensor array and the variation of sensor spacing with radial distance in accordance with an embodiment of the present invention. -
FIGS. 11C and 11D are, respectively, the representation of the sensor array and the variation of sensor spacing with radial distance in accordance with another embodiment of the present invention in which the sensor spacing merges gradually from the substantially constant resolution portion into the space variant portion. -
FIGS. 12A and B are, respectively, the representation of the sensor array and the variation of sensor spacing with radial distance in accordance with another embodiment of the present invention in which the sensor spacing merges gradually from the substantially constant resolution portion into the space variant portion and back to a substantially constant resolution portion -
FIGS. 13A and 13B show individual embodiments of sensor arrays including a substantially constant resolution portion and an outer space variant portion whereby in -
FIG. 13B the sensor location sites in each ring are displaced by one half of the site spacing compared to the previous ring. -
FIGS. 14 and 15 show individual embodiments of sensor arrays including a substantially constant resolution portion and an outer space variant portion. -
FIG. 16 shows an embodiment of sensor location sites of a substantially constant resolution portion of a sensor array. -
FIG. 17 shows a further embodiment of sensor location sites of a substantially constant resolution portion of a sensor array. - Ring: closed curve covered by a monodimensional array (=a line) of equally spaced sensor element location sites, each location site including at least one sensor element.
- Aspect ratio: the ratio between the radial and the angular distances dimension of each sensor element location site or of each sensor. Alternatively, the ratio between the mid-line to mid-line radial distance between neighboring rings and the angular distance between neighboring sensor element location sites or sensors.
- Sensor density: number of sensor elements per unit area or the number of sensor element location sites per unit area. There can be a global and local density values. A global density is the density for the whole array or of a significant part of an array. Local density is the density of a small area of the array, e.g. defined by a sensor element location site or a sensor element and its neighbors. Sensor geometries with local discontinuities generally show local variations in local density. A log-polar array has a local resolution which varies linearly with radius.
- Resolution: the inverse of the centre-centre distance between adjacent sensor element location sites or between sensor elements, for example it may be quoted as “dots per inch”, “pixels per inch” or similar. There can be a global and local resolution. A global resolution is the resolution typically possible for the whole array or for large part of an array. Local resolution is the centre-centre distance between sensor elements or sensor element location sites in a small area of the array, e.g. between one sensor element location site or sensor element and its neighbors. Sensor geometries with local discontinuities generally show local variations in local resolution.
- Closed smooth curve: a closed figure which is non-polygonal. Examples are circle, ellipse, oval, egg-shape
- The present invention will be described with reference to certain embodiments and drawings but is not limited to these but only by the claims. The drawings are schematic. The present invention will mainly be described with reference to a radiation sensitive sensor array but the present invention is not limited thereto. For instance, the sensor element geometries of the present invention may be made with any suitable sensor elements, e.g. tactile sensor elements, proximity sensors.
- The present invention relates to the provision of a synthetic sensor array with a substantially constant resolution portion. By synthetic is meant that natural sensor arrays such as the human eye are excluded. The substantially constant resolution portion may be used with a spatially variant portion which either surrounds the substantially constant resolution portion on the outside or is enclosed by the substantially constant resolution portion. There are advantages for use in robotics if the radial change of the sensor element density or if the resolution of the array is spatially variant. Such a spatial variance may form an approximation of the resolution of radiation-sensitive elements occurring in the human retina but the present invention is not limited thereto. The size of the smallest sensor element or photosite is determined by the technology used to make the site. It is preferred in the present invention to use conventional CMOS or MOS semiconductor processing technology but the present invention is not limited thereto and includes other manufacturing technologies and devices made therefrom, such as CCD arrays. Also the present invention is not limited to visual light sensors but may be used with any radiation sensitive elements, e.g. those sensitive to X-rays or infra-red or ultra-violet radiation. In particular, sensor arrays in accordance with the present invention need not be radiation sensitive, they may be used, for instance, with tactile sensors, e.g. to model a synthetic finger tip.
- Semiconductor processing technology is continuously improving and the size of semiconductor elements which can be produced is constantly being made smaller. The sensors of the present invention may be conveniently manufactured in 0.35 micron CMOS technology but the present invention is not limited thereto. An individual sensor with such technology may have a diameter of about 7 micron. As the size of sensor elements becomes smaller it is tempting to use a uniform array of sensors, e.g. a Cartesian array, and then to use electronic re-mapping (e.g. log-polar mapping) to create a kind of spatial variance. However, such an array makes poor use of the large number of outer sensor elements as these are at the extremes of the field of view of a camera where high resolution is not so relevant. The number of these elements increases as the square of the radius so the total number of elements of such a uniform array compared to a space variant one is significantly larger. This increases processing time and therefore the cost of the sensor array.
- In the following reference will be made to sensor
element location sites 14 and sensor elements. An example will be described for sensor element location sites with a symmetry of 6 (see below) but the skilled person will appreciate that the principles may be extended to a range of symmetries. InFIG. 16 a series ofconcentric rings 16 ofareas 14 is shown. Theseareas 14 are locations in which at least one sensor element is located hence they are sensorelement location sites 14. More than one sensor element may be located in the each sensorelement location site 14. Also a sensor element need not be located at the center of a sensorelement location site 14. It is included within the present invention that a sensor element may be displaced from the center of a sensor element location, for example the displacements may be small, random in size and random in direction. This introduces a “dither” in the placement of sensor elements which may be of advantage, e.g. it breaks up any symmetries in the geometry thus eliminating Moire fringes caused by viewing an image with an almost identical geometry to that of the arrangement of sensor elements. -
FIG. 17 shows a further arrangement ofsensor location sites 14. The array consists of a series ofconcentric rings 16 each with a plurality of equally spacedsensor element sites 14. Each site is contiguous with the next one. The number of sites per ring increases four at a time, i.e. a symmetry of m=4 (see below). Each site contains at least one sensor element. As indicated it is not necessary in accordance with the present invention that the arrangement of thesites 14 is perfect in each ring and between rings provided a substantially constant resolution array is generated. - An embodiment of the present invention relates to a circular (polar) and regular arrangement of sensor
element location sites 14 covering a bi-dimensional sensor array. InFIG. 2 and following figures the center of eachsite 14 is marked with a dot. It will be appreciated fromFIGS. 16 and 17 that each site has an area determined by the bounds of the ring and its neighbors. Within each sensorelement location site 14 one or more sensor elements may be located. Such sensor elements are known, for example, from EP 739 039, EP 858 111, EP 773 669, for instance. This arrangement is intended primarily to implement at least one substantiallyconstant resolution area 12 in asensor 10 with a polar geometry (seeFIG. 2 ). This constant resolution and polar arrangement is realized with sensorelement location sites 14 arranged onconcentric rings 16 which could be circles or any other closed curve, in particular closed, smooth curve, such as an ellipse as shown inFIG. 3 or an egg shape or an oval. “Substantially constant resolution” may be defined in accordance with the present invention as a polar array ofsensor element locations 14 as described above wherein the radial displacement of any sensor element location site from a regular polar distribution is ±5% of the radius (defined by the distance from the center of the relevant ring) of the respective sensor element location site, more preferably ±3% of the radius and most preferably ±1% of the radius. In addition the displacement of the sensorelement location sites 14 from a regular polar distribution may be ±20% of the sensor element location site spacing in the angular direction (circumferential direction), more preferably ±10% and most preferably ±5% of the sensor element location site spacing in any ring. - A substantially
constant resolution portion 12 in accordance with an embodiment of the present invention may be characterized by a constant increase in the number of sensor element location sites per ring. For example if n (n≠1) is the number of sensor element location sites at the i th circle of an m-symmetric array circle i+1 has n+m sensor element location sites. Various different symmetries are shown in FIGS. 4 to 9. In each of these constant resolution arrays each ring 16 (other than the second ring) has m more sensorelement location sites 14 than the ring inside it. In eachring 16 the sensorelement location sites 14 are distributed evenly along the ring. FIGS. 4 to 9 show arrangements with m being 4, 5, 6, 7, 8, 9 respectively. The radius of each ring is calculated on the basis ofequation 1.
R=n×½π+k Equation 1
where R is the radius, “n” is the number of sensor element location sites per ring, “1” is the minimum center-centre distance between sensor element location sites around a ring and “k” is a constant which is usually zero. The constant “k” effectively increases the dimension “1” by a fixed amount. - The different symmetries shown are also characterized by the aspect ratio of each single sensory element locations. The aspect ratio of one sensor element location site may be defined as the ratio between the radial and the angular distances between the one sensor element location site and neighboring sensor element location sites or, alternatively, between the radial and the angular dimension of each single sensor element location sites. In the arrangements shown in FIGS. 4 to 9, the aspect ratio varies from about 2.1 to about 0.6 when going from m=3 to m=10 and is closer to the optimal value of 1 for m=6. More preferred is an aspect ratio of 0.8 to 1.6. See
FIG. 10 . It should be noted that the aspect ratio remains sensibly constant over each array. - Furthermore, the spatial arrangement of constant resolution sensor
element location sites 14 towards the outer diameter of the array is such that it may blend smoothly with a space-variant structure, such as an array of sensor element location sites with a log-polar density.FIG. 11 a shows, as an example, how a central constant resolutioncircular area 12 covered with the m=6-symmetric structure shown inFIG. 7 , joins with a space-variantannular region 18 realized with a log-polar geometry. A log polar mapping may be obtained by keeping the number of sensor element location sites per ring constant while the radius of each ring is defined in a log-polar manner, i.e. the ratio of the radii of adjacent ring is a constant. In such an arrangement the ratio of the diameters of adjacent rings is a constant. The outermost ring of the central constant resolutioncircular area 12 contains the same number of sensor element location sites as all the rings in the space-variant region 18.FIG. 11 b shows how the receptor's spacing varies in the radial direction in the case of an m=6 symmetric, substantially constant resolutioncentral region 12 and a log-polar periphery region 18. It will be noted that the spacing increases continuously when going from the constant resolution portion to the space variant portion.FIGS. 11 c and 11 d show a further embodiment of the present invention in which an even smoother transition between the centralconstant resolution area 12 and the spatially variantperipheral part 18 of the array is obtained by sensor element location site spacing adjustments at the interface betweenregion FIG. 11 d. This gradual change may be defined by any suitable smoothing function. If the example of a log-polar mapping is taken for the spatially variant portion then the ratio of the outer diameters of adjacent rings is a constant in this portion. In the transition region between the constant resolution portion and the spatially variant portion this constant ratio of the radii of adjacent rings is changed smoothly from the value achieved at the outer ring of the constant resolution portion to the value in the body of the spatially variant portion. - Constant resolution spatial arrangements in accordance with the present invention, can be used not only for inner regions (as shown in
FIG. 2 ) but also forannular regions 20 surrounding, for example, a space-variantcircular region 18. This is shown inFIGS. 12 a and 12 b in which there is aconstant resolution portion 12 at the center and at theouter portion 20 of the sensor array with a log-polar arrangement in-between. - The spatial arrangements for constant resolution areas of an image sensor have the following advantages:
- 1) they can have a better coverage of a constant resolution circular area;
- 2) they can blend well with a space-variant periphery thus avoiding the discontinuities present in conventional designs;
- 3) they can be used both in the center (fovea) and on the periphery of a sensor array or any position in-between;
- 4) they allow a very smooth transition between constant resolution and space-variant regions of the sensor array;
- 5) no semiconductor processing time or area is “wasted” and the maximum resolution is provided over all of the central region (fovea) and not just part of it; and
- 6) the aspect ratio of pixels can be very close to the optimal value of 1 which also results in better processing.
- Sensor arrangements according to the present invention can be used as the basic sensor array of a color visual sensor. In the case of a tri-chromatic color sensor the preferred arrangements are those corresponding to multiple-of-m=three symmetry (such as 3,6,9 etc.).
- Further embodiments of the present invention relate to a sensor arrangement of
concentric rings 16 of sensorelement location sites 14 of either aconstant resolution region 12 and/or aspace variant region 18 wherein the string of sensorelement location sites 14 of eachring 16 is rotated with respect to its neighboring rings 16 by half the spacing between the sensor element location sites. In this way it is possible to transform an array with a quasi-square tessellation (FIG. 13 a) into an array with a quasi-hexagonal one (FIG. 13 b). The advantage of this angular rotation between rings is a better structure for color reconstruction. - An example of a sensor array in accordance with embodiments of the present invention will now be described. For the outer spatially
variant region 18, the number of sensor element location sites per ring is chosen to be either 66 or 90. Each sensorelement location site 14 includes one sensor element having a diameter of about 7 micron. This results in an diameter for the inner constant resolution portion of about 73 micron and about 100 micron for each design, respectively. The central constant resolution regions are implemented with m=6. The results are shown in Table 1 and shown inFIGS. 14 and 15 respectively.TABLE 1 Min size of Pixels Fovea sensor Max. Chip per ring radius element size Pixels Pixels - radius Rings - Rings - (periphery) micron micron micron center outer micron center outer 66 73 7 17 330 726 200 10 11 90 100 7 13 630 900 200 14 10
The two sensor arrays shown inFIGS. 14 and 15 demonstrate the absence of local and global discontinuities. In these designs there is one sensor element per sensor element location site and this sensor element completely fills the location site. - The sensor arrays as described above in accordance with any of the embodiments of the present invention may find advantageous use in cameras, especially miniature cameras. Such cameras may be included in surveillance schemes such as for door or intruder surveillance, cameras for mounting in mobile telephones or lap-top or palm-top computers for capturing still and video images for transmission over telecommunications networks or similar, “eye-ball” cameras for mounting close to a Personal Computer for capturing still or video images and for transmission over telecommunications networks such as company Intranets, WAN's or the Internet or via telephone lines.
- The sensor arrays as described above may be associated with active or passive read-out electronics and digital signal processing circuitry to provide an electronic digital output of the image sensed by the array.
- While the invention has been shown and described with reference to preferred embodiments, it will be understood by those skilled in the art that various changes or modifications in form and detail may be made without departing from the scope and spirit of this invention.
Claims (19)
1. A sensor array comprising: a substantially constant resolution portion comprising a first series of first concentric closed rings, each first closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location site including at least one sensor element; and a spatially variant portion comprising a second series of second concentric closed rings, the second series being concentric with the first series and each second closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location having at least one sensor element, the spatially variant portion surrounding the substantially constant resolution portion, and the density of sensor element location sites continuously increasing or decreasing between the substantially constant resolution portion and the spatially variant portion.
2. The sensor array according to claim 1 , wherein the number of sensor element location sites in each first closed ring is defined by the ith closed ring having n sensor element location sites and the i+1th closed ring having n+m sensor element location sites where n is not equal to 1.
3. The sensor array according to claim 1 , wherein the aspect ratio of any sensor element location site with reference to its neighbors is between 2.1 and 0.6.
4. The sensor array according to claim 1 , wherein the closed rings are circles or ellipses
5. The sensor array according to claim 4 , wherein m is an integer lying in the range > or =3 and < or =10.
6. The sensor array according to claim 1 , wherein the spatially variant portion has a log polar sensor element location site density.
7. The sensor array according to claim 1 , wherein the number of sensor element location sites in each second closed ring of the second series is constant.
8. The sensor array according to claim 1 , wherein the density of sensor element location sites in the substantially constant resolution portion merges smoothly into the density of the sensor element location sites in the spatially variant portion.
9. The sensor array according to claim 8 , wherein a first ring of the first series which is adjacent to a second ring of the second series has the same number of sensor element location sites as that second ring.
10. The sensor array according to claim 1 , wherein the sensor element location sites in the ith+1 second closed ring has the sensor element location sites moved by half the distance between the sensor element location site of that ring compared with the ith second closed ring.
11. A substantially constant resolution sensor array comprising a first series of concentric closed rings, each closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location having at least one sensor element, in which the number of sensor element location sites in each closed ring is defined by the ith closed ring having n sensor element location sites and the i+1th closed ring having n+m sensor element location sites where n is not equal to 1, and the envelope through the middle of the sensor element location sites of one closed ring is a closed smooth curve, and wherein the substantially constant resolution sensor array is surrounded by a second series of concentric closed rings having separate sensor element location sites which are arranged to form a spatially variant sensor array, and the density of sensor element location sites being continuously increasing or decreasing between the arrays.
12. The substantially constant resolution sensor array according to claim 11 , wherein the aspect ratio of any sensor element location site with reference to its neighbors is between 2.1 and 0.6.
13. The substantially constant resolution sensor array according to claim 11 , wherein m lies in the range >3 and <10.
14. The substantially constant sensor array according to claim 13 , further comprising a sensor array with a spatially varying sensor element location site density which surrounds or is surrounded by the substantially constant resolution sensor.
15. The substantially constant resolution sensor array according to claim 11 , wherein the spatially variant array has a log polar sensor element location site density.
16. The substantially constant resolution sensor array according to claim 14 , wherein the spatially variant array comprises a second series of concentric closed rings which are concentric with the first series, each closed ring of the second series comprising a monodimensional array of equally spaced sensor element location sites.
17. The substantially constant resolution sensor array according to claim 1 , wherein the number of sensor element location sites in each closed ring of the second series is constant.
18. A camera comprising a sensor array in accordance with claim 17 , the sensor array including radiation sensitive sensor elements.
19. A sensor array, comprising:
a substantially constant resolution portion comprising a first series of first concentric closed rings, each first closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location site including at least one CMOS pixel element; and
a spatially variant portion comprising a second series of second concentric closed rings, the second series being concentric with the first series and each second closed ring comprising a monodimensional array of equally spaced sensor element location sites, each location having at least one CMOS pixel element,
wherein the spatially variant portion surrounds the substantially constant resolution portion,
and wherein the density of sensor element location sites is continuously increasing or decreasing between the substantially constant resolution portion and the spatially variant portion, and wherein the sensor array forms a CMOS imaging device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/370,195 US20060215049A1 (en) | 1999-09-30 | 2006-03-07 | Constant resolution and space variant sensor arrays |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP99203202A EP1089342B1 (en) | 1999-09-30 | 1999-09-30 | Sensor array comprising a constant resolution region |
EPEP99203202.9 | 1999-09-30 | ||
US16027699P | 1999-10-19 | 1999-10-19 | |
US09/675,095 US7009645B1 (en) | 1999-09-30 | 2000-09-28 | Constant resolution and space variant sensor arrays |
US11/370,195 US20060215049A1 (en) | 1999-09-30 | 2006-03-07 | Constant resolution and space variant sensor arrays |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/675,095 Continuation US7009645B1 (en) | 1999-09-30 | 2000-09-28 | Constant resolution and space variant sensor arrays |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060215049A1 true US20060215049A1 (en) | 2006-09-28 |
Family
ID=35966281
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/675,095 Expired - Lifetime US7009645B1 (en) | 1999-09-30 | 2000-09-28 | Constant resolution and space variant sensor arrays |
US11/370,195 Abandoned US20060215049A1 (en) | 1999-09-30 | 2006-03-07 | Constant resolution and space variant sensor arrays |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/675,095 Expired - Lifetime US7009645B1 (en) | 1999-09-30 | 2000-09-28 | Constant resolution and space variant sensor arrays |
Country Status (1)
Country | Link |
---|---|
US (2) | US7009645B1 (en) |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070053612A1 (en) * | 2001-12-13 | 2007-03-08 | Viktors Berstis | System and Method for Anti-Moire' Imaging in a One Dimensional Sensor Array |
CN102905086A (en) * | 2012-10-17 | 2013-01-30 | 中国人民解放军第四军医大学 | CCD (Charge-Coupled Device) photoreceptor for panorama shooting |
US20140028884A1 (en) * | 2004-10-08 | 2014-01-30 | Allan J. Cooper | Photodetector system, apparatus and method |
DE102014218459A1 (en) * | 2014-09-15 | 2016-03-17 | Conti Temic Microelectronic Gmbh | Assistance system of a motor vehicle, with a camera having an image sensor and image sensor of a camera |
US9331791B2 (en) | 2014-01-21 | 2016-05-03 | Nano Retina Ltd. | Transfer of power and data |
US9370417B2 (en) | 2013-03-14 | 2016-06-21 | Nano-Retina, Inc. | Foveated retinal prosthesis |
US9524439B2 (en) | 2004-05-25 | 2016-12-20 | Continental Automotive Gmbh | Monitoring unit and assistance system for motor vehicles |
CN107078140A (en) * | 2014-11-04 | 2017-08-18 | 索尼公司 | Solid state image pickup device, camera model and electronic installation |
US9787919B2 (en) | 2012-05-30 | 2017-10-10 | Fujifilm Corporation | Radiographic imaging device, radiographic imaging system, control method of radiographic imaging device and program storage medium |
CN109842766A (en) * | 2018-12-28 | 2019-06-04 | 上海集成电路研发中心有限公司 | A kind of polar coordinate image sensor and its method for carrying out image procossing |
RU2704582C1 (en) * | 2019-02-14 | 2019-10-29 | Вячеслав Михайлович Смелков | Method of generating a video signal in a television-computer system for monitoring of industrial products having the shape of a circular ring |
RU2706011C1 (en) * | 2019-02-25 | 2019-11-13 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system device |
RU2708630C1 (en) * | 2019-04-05 | 2019-12-10 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system device |
RU2709459C1 (en) * | 2019-04-09 | 2019-12-18 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system device |
RU2709461C1 (en) * | 2019-02-04 | 2019-12-18 | Вячеслав Михайлович Смелков | Method of forming a video signal on a sensor chip, made by the technology of a cmos |
RU2710779C1 (en) * | 2019-04-22 | 2020-01-13 | Вячеслав Михайлович Смелков | Device for "circular" photodetector of color image for panoramic television-computer surveillance |
RU2723645C1 (en) * | 2019-12-13 | 2020-06-17 | Вячеслав Михайлович Смелков | High-resolution panorama television surveillance computer system device |
RU2723640C1 (en) * | 2019-12-09 | 2020-06-17 | Вячеслав Михайлович Смелков | High-resolution panorama television surveillance computer system device |
RU2725973C1 (en) * | 2019-12-31 | 2020-07-08 | Вячеслав Михайлович Смелков | Method of generating a video signal in a television-computer system for monitoring industrial articles having a circular ring shape |
RU2727920C1 (en) * | 2020-01-27 | 2020-07-27 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system with selective image scaling |
RU2730177C1 (en) * | 2020-01-16 | 2020-08-19 | Вячеслав Михайлович Смелков | Television system with selective image scaling (versions) |
RU2743571C1 (en) * | 2020-06-23 | 2021-02-20 | Вячеслав Михайлович Смелков | Computing system device for panoramic video surveillance with selective image scaling |
RU2748754C1 (en) * | 2020-09-28 | 2021-05-31 | Вячеслав Михайлович Смелков | Selective zoom tv system (options) |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002290843A (en) * | 2001-03-26 | 2002-10-04 | Olympus Optical Co Ltd | Image input device |
US7129834B2 (en) * | 2002-03-28 | 2006-10-31 | Kabushiki Kaisha Toshiba | String wireless sensor and its manufacturing method |
US7408572B2 (en) * | 2002-07-06 | 2008-08-05 | Nova Research, Inc. | Method and apparatus for an on-chip variable acuity imager array incorporating roll, pitch and yaw angle rates measurement |
US7227573B2 (en) * | 2002-07-29 | 2007-06-05 | Hewlett-Packard Development Company, L.P. | Apparatus and method for improved-resolution digital zoom in an electronic imaging device |
ATE313833T1 (en) * | 2002-10-04 | 2006-01-15 | Siemens Schweiz Ag | METHOD FOR MONITORING GOODS |
TWI256248B (en) * | 2004-04-29 | 2006-06-01 | Novatek Microelectronics Corp | Apparatus for sensing image and method for sampling image signal |
US8169495B2 (en) * | 2006-12-01 | 2012-05-01 | Broadcom Corporation | Method and apparatus for dynamic panoramic capturing |
US8063968B2 (en) * | 2008-07-23 | 2011-11-22 | Lockheed Martin Corporation | Device for detecting an image of a nonplanar surface |
KR100988872B1 (en) | 2009-07-08 | 2010-10-20 | 주식회사 나노포토닉스 | Method and imaging system for obtaining complex images using rotationally symmetric wide-angle lens and image sensor for hardwired image processing |
US9036001B2 (en) | 2010-12-16 | 2015-05-19 | Massachusetts Institute Of Technology | Imaging system for immersive surveillance |
US9007432B2 (en) | 2010-12-16 | 2015-04-14 | The Massachusetts Institute Of Technology | Imaging systems and methods for immersive surveillance |
DE102011002824A1 (en) * | 2011-01-18 | 2012-07-19 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Image sensor, imaging system and method of taking an image |
HK1167067A2 (en) * | 2011-09-06 | 2012-11-16 | Smart Edge Invest Ltd | A system and method for processing a very wide angle image |
CH706734B1 (en) * | 2012-07-10 | 2017-09-29 | Awaiba Consultadoria Desenvolvimento E Comércio De Componentes Microelectrónicos Unipessoal Lda | Device comprising a set of detectors sensitive to electromagnetic radiation and endoscope tube equipped with such a device. |
CN105450924B (en) * | 2014-09-30 | 2019-04-12 | 北京智谷技术服务有限公司 | The acquisition methods and device of super-resolution image |
EP3171406B1 (en) * | 2015-11-23 | 2019-06-19 | ams AG | Photodiode array |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4267573A (en) * | 1978-06-14 | 1981-05-12 | Old Dominion University Research Foundation | Image processing system |
US4554585A (en) * | 1983-08-12 | 1985-11-19 | Rca Corporation | Spatial prefilter for variable-resolution sampled imaging systems |
US5063604A (en) * | 1989-11-08 | 1991-11-05 | Transitions Research Corporation | Method and means for recognizing patterns represented in logarithmic polar coordinates |
US5166511A (en) * | 1989-05-08 | 1992-11-24 | Interuniversitair Micro-Elektronica Centrum Vzw | Radiaton-sensitive sensor having a plurality of radiation sensitive elements arranged substantially circular with radially decreasing density |
US5587580A (en) * | 1994-10-25 | 1996-12-24 | Csem Centre Suisse D'electronique Et De Microtechnique Sa | Optoelectronic sensor for measuring the intensity and the direction of incidence of a light beam |
US5712729A (en) * | 1992-04-17 | 1998-01-27 | Olympus Optical Co., Ltd. | Artificial retina cell, artificial retina and artificial visual apparatus |
US5739852A (en) * | 1994-12-08 | 1998-04-14 | Motorola Inc. | Electronic imaging system and sensor for use therefor with a nonlinear distribution of imaging elements |
US5887078A (en) * | 1993-12-29 | 1999-03-23 | Korea Telecommunication Authority | Apparatus and method for classifying and recognizing image patterns using neural network |
US6455831B1 (en) * | 1998-09-11 | 2002-09-24 | The Research Foundation Of Suny At Buffalo | CMOS foveal image sensor chip |
US20020180877A1 (en) * | 2001-03-26 | 2002-12-05 | Susumu Kikuchi | Image acquisition apparatus |
US6522356B1 (en) * | 1996-08-14 | 2003-02-18 | Sharp Kabushiki Kaisha | Color solid-state imaging apparatus |
US6526160B1 (en) * | 1998-07-17 | 2003-02-25 | Media Technology Corporation | Iris information acquisition apparatus and iris identification apparatus |
US6563101B1 (en) * | 2000-01-19 | 2003-05-13 | Barclay J. Tullis | Non-rectilinear sensor arrays for tracking an image |
US20040095492A1 (en) * | 2002-07-06 | 2004-05-20 | Nova Research, Inc. | Method and apparatus for an on-chip variable acuity imager array incorporating roll, pitch and yaw angle rates measurement |
US6839452B1 (en) * | 1999-11-23 | 2005-01-04 | California Institute Of Technology | Dynamically re-configurable CMOS imagers for an active vision system |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03116781A (en) * | 1989-09-28 | 1991-05-17 | Toshiba Corp | Photosensitive device |
FR2830128A1 (en) * | 2001-09-26 | 2003-03-28 | Egg Solution Sa | Photoelectric sensor with sensing elements of pixels laid out in concentric circles, and device comprising such sensor for acquisition of panoramic images |
-
2000
- 2000-09-28 US US09/675,095 patent/US7009645B1/en not_active Expired - Lifetime
-
2006
- 2006-03-07 US US11/370,195 patent/US20060215049A1/en not_active Abandoned
Patent Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4267573A (en) * | 1978-06-14 | 1981-05-12 | Old Dominion University Research Foundation | Image processing system |
US4554585A (en) * | 1983-08-12 | 1985-11-19 | Rca Corporation | Spatial prefilter for variable-resolution sampled imaging systems |
US5166511A (en) * | 1989-05-08 | 1992-11-24 | Interuniversitair Micro-Elektronica Centrum Vzw | Radiaton-sensitive sensor having a plurality of radiation sensitive elements arranged substantially circular with radially decreasing density |
US5063604A (en) * | 1989-11-08 | 1991-11-05 | Transitions Research Corporation | Method and means for recognizing patterns represented in logarithmic polar coordinates |
US5712729A (en) * | 1992-04-17 | 1998-01-27 | Olympus Optical Co., Ltd. | Artificial retina cell, artificial retina and artificial visual apparatus |
US5887078A (en) * | 1993-12-29 | 1999-03-23 | Korea Telecommunication Authority | Apparatus and method for classifying and recognizing image patterns using neural network |
US5587580A (en) * | 1994-10-25 | 1996-12-24 | Csem Centre Suisse D'electronique Et De Microtechnique Sa | Optoelectronic sensor for measuring the intensity and the direction of incidence of a light beam |
US5739852A (en) * | 1994-12-08 | 1998-04-14 | Motorola Inc. | Electronic imaging system and sensor for use therefor with a nonlinear distribution of imaging elements |
US6522356B1 (en) * | 1996-08-14 | 2003-02-18 | Sharp Kabushiki Kaisha | Color solid-state imaging apparatus |
US6526160B1 (en) * | 1998-07-17 | 2003-02-25 | Media Technology Corporation | Iris information acquisition apparatus and iris identification apparatus |
US6455831B1 (en) * | 1998-09-11 | 2002-09-24 | The Research Foundation Of Suny At Buffalo | CMOS foveal image sensor chip |
US6839452B1 (en) * | 1999-11-23 | 2005-01-04 | California Institute Of Technology | Dynamically re-configurable CMOS imagers for an active vision system |
US6563101B1 (en) * | 2000-01-19 | 2003-05-13 | Barclay J. Tullis | Non-rectilinear sensor arrays for tracking an image |
US20020180877A1 (en) * | 2001-03-26 | 2002-12-05 | Susumu Kikuchi | Image acquisition apparatus |
US7173658B2 (en) * | 2001-03-26 | 2007-02-06 | Olympus Corporation | Arranging a plurality of imaging pixels in an imaging acquisition apparatus |
US20040095492A1 (en) * | 2002-07-06 | 2004-05-20 | Nova Research, Inc. | Method and apparatus for an on-chip variable acuity imager array incorporating roll, pitch and yaw angle rates measurement |
Cited By (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7558442B2 (en) * | 2001-12-13 | 2009-07-07 | Infoprint Solutions Company, Llc | System and method for anti-moire' imaging in a one dimensional sensor array |
US20070053612A1 (en) * | 2001-12-13 | 2007-03-08 | Viktors Berstis | System and Method for Anti-Moire' Imaging in a One Dimensional Sensor Array |
US10055654B2 (en) | 2004-05-25 | 2018-08-21 | Continental Automotive Gmbh | Monitoring unit for a motor vehicle, having partial color encoding |
US9524439B2 (en) | 2004-05-25 | 2016-12-20 | Continental Automotive Gmbh | Monitoring unit and assistance system for motor vehicles |
US9704048B2 (en) | 2004-05-25 | 2017-07-11 | Continental Automotive Gmbh | Imaging system for a motor vehicle, having partial color encoding |
US10387735B2 (en) | 2004-05-25 | 2019-08-20 | Continental Automotive Gmbh | Monitoring unit for a motor vehicle, having partial color encoding |
US20140028884A1 (en) * | 2004-10-08 | 2014-01-30 | Allan J. Cooper | Photodetector system, apparatus and method |
US10924694B2 (en) | 2012-05-30 | 2021-02-16 | Fujifilm Corporation | Radiographic imaging device, radiographic imaging system, control method of radiographic imaging device and program storage medium |
US10506183B2 (en) | 2012-05-30 | 2019-12-10 | Fujifilm Corporation | Radiographic imaging device, radiographic imaging system, control method of radiographic imaging device and program storage medium |
US9787919B2 (en) | 2012-05-30 | 2017-10-10 | Fujifilm Corporation | Radiographic imaging device, radiographic imaging system, control method of radiographic imaging device and program storage medium |
CN102905086A (en) * | 2012-10-17 | 2013-01-30 | 中国人民解放军第四军医大学 | CCD (Charge-Coupled Device) photoreceptor for panorama shooting |
US9370417B2 (en) | 2013-03-14 | 2016-06-21 | Nano-Retina, Inc. | Foveated retinal prosthesis |
US9331791B2 (en) | 2014-01-21 | 2016-05-03 | Nano Retina Ltd. | Transfer of power and data |
DE102014218459A1 (en) * | 2014-09-15 | 2016-03-17 | Conti Temic Microelectronic Gmbh | Assistance system of a motor vehicle, with a camera having an image sensor and image sensor of a camera |
US20170317127A1 (en) * | 2014-11-04 | 2017-11-02 | Sony Corporation | Solid-state imaging device, camera module, and electronic apparatus |
CN107078140A (en) * | 2014-11-04 | 2017-08-18 | 索尼公司 | Solid state image pickup device, camera model and electronic installation |
US10580816B2 (en) * | 2014-11-04 | 2020-03-03 | Sony Corporation | Solid-state imaging device, camera module, and electronic apparatus |
CN109842766A (en) * | 2018-12-28 | 2019-06-04 | 上海集成电路研发中心有限公司 | A kind of polar coordinate image sensor and its method for carrying out image procossing |
RU2709461C1 (en) * | 2019-02-04 | 2019-12-18 | Вячеслав Михайлович Смелков | Method of forming a video signal on a sensor chip, made by the technology of a cmos |
RU2704582C1 (en) * | 2019-02-14 | 2019-10-29 | Вячеслав Михайлович Смелков | Method of generating a video signal in a television-computer system for monitoring of industrial products having the shape of a circular ring |
RU2706011C1 (en) * | 2019-02-25 | 2019-11-13 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system device |
RU2708630C1 (en) * | 2019-04-05 | 2019-12-10 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system device |
RU2709459C1 (en) * | 2019-04-09 | 2019-12-18 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system device |
RU2710779C1 (en) * | 2019-04-22 | 2020-01-13 | Вячеслав Михайлович Смелков | Device for "circular" photodetector of color image for panoramic television-computer surveillance |
RU2723640C1 (en) * | 2019-12-09 | 2020-06-17 | Вячеслав Михайлович Смелков | High-resolution panorama television surveillance computer system device |
RU2723645C1 (en) * | 2019-12-13 | 2020-06-17 | Вячеслав Михайлович Смелков | High-resolution panorama television surveillance computer system device |
RU2725973C1 (en) * | 2019-12-31 | 2020-07-08 | Вячеслав Михайлович Смелков | Method of generating a video signal in a television-computer system for monitoring industrial articles having a circular ring shape |
RU2730177C1 (en) * | 2020-01-16 | 2020-08-19 | Вячеслав Михайлович Смелков | Television system with selective image scaling (versions) |
RU2727920C1 (en) * | 2020-01-27 | 2020-07-27 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system with selective image scaling |
RU2727920C9 (en) * | 2020-01-27 | 2020-08-06 | Вячеслав Михайлович Смелков | Panoramic television surveillance computer system with selective image scaling |
RU2743571C1 (en) * | 2020-06-23 | 2021-02-20 | Вячеслав Михайлович Смелков | Computing system device for panoramic video surveillance with selective image scaling |
RU2748754C1 (en) * | 2020-09-28 | 2021-05-31 | Вячеслав Михайлович Смелков | Selective zoom tv system (options) |
Also Published As
Publication number | Publication date |
---|---|
US7009645B1 (en) | 2006-03-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7009645B1 (en) | Constant resolution and space variant sensor arrays | |
US10666914B2 (en) | Solid state imaging device and electronic apparatus in which the area of the photodiode may be expanded | |
JP5471117B2 (en) | Solid-state imaging device, manufacturing method thereof, and camera | |
US9123610B2 (en) | Arrangement of circuits in pixels, each circuit shared by a plurality of pixels, in image sensing apparatus | |
US20050168618A1 (en) | Solid state image pick-up device and image pick-up system | |
TWI567955B (en) | Color filters for sub-diffraction limit sensors | |
US11043518B2 (en) | Image sensor including a pixel block having 8-shared pixel structure | |
US6838715B1 (en) | CMOS image sensor arrangement with reduced pixel light shadowing | |
US20100320368A1 (en) | Color filters for sub-diffraction limit sensors | |
US20100321542A1 (en) | Gradient color filters for sub-diffraction limit sensors | |
KR20000023440A (en) | Process-Scalable High Sparial Resolution and Low Bit Resolution CMOS Area Image Sensor | |
JP3144537B2 (en) | Solid-state imaging device | |
US20200243593A1 (en) | Cmos image sensor with compact pixel layout | |
US10854649B2 (en) | Image sensor including unit pixel block having common selection transistor | |
EP1089342B1 (en) | Sensor array comprising a constant resolution region | |
EP2304798B1 (en) | Wide aperture image sensor pixel | |
JP2002519853A (en) | Pixel structure without infrared filter | |
TWI236546B (en) | Image sensing device of improving image quality and reducing color shift effect | |
KR102358317B1 (en) | Image sensor | |
EP1676435B1 (en) | Image sensor array with substitutional circuit distribution | |
JP5705462B2 (en) | Solid-state imaging device and electronic information device | |
WO2022070815A1 (en) | Imaging device | |
JP6929337B2 (en) | Solid-state image sensor and imaging system | |
WO2020049904A1 (en) | Solid-state imaging element and electronic equipment | |
CN111294493A (en) | Image sensor, camera assembly and mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |