WO2002019030A1 - Dual band framing reconnaissance camera - Google Patents

Dual band framing reconnaissance camera Download PDF

Info

Publication number
WO2002019030A1
WO2002019030A1 PCT/US2001/023680 US0123680W WO0219030A1 WO 2002019030 A1 WO2002019030 A1 WO 2002019030A1 US 0123680 W US0123680 W US 0123680W WO 0219030 A1 WO0219030 A1 WO 0219030A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
optical
roll
axis
optical system
Prior art date
Application number
PCT/US2001/023680
Other languages
French (fr)
Other versions
WO2002019030A9 (en
WO2002019030B1 (en
Inventor
Andrew J. Partynski
Stephen R. Beran
Allie M. Baker
John Jones
Stephan Wyatt
Original Assignee
Recon/Optical, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/654,031 external-priority patent/US6658207B1/en
Priority claimed from US09/652,524 external-priority patent/US6477326B1/en
Priority claimed from US09/652,965 external-priority patent/US6366734B1/en
Priority claimed from US09/652,529 external-priority patent/US6374047B1/en
Application filed by Recon/Optical, Inc. filed Critical Recon/Optical, Inc.
Priority to CA002418917A priority Critical patent/CA2418917C/en
Priority to AU2002216609A priority patent/AU2002216609A1/en
Priority to EP01984574A priority patent/EP1323001A4/en
Publication of WO2002019030A1 publication Critical patent/WO2002019030A1/en
Publication of WO2002019030B1 publication Critical patent/WO2002019030B1/en
Publication of WO2002019030A9 publication Critical patent/WO2002019030A9/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • G01C11/025Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures by scanning the object
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B17/00Systems with reflecting surfaces, with or without refracting elements
    • G02B17/08Catadioptric systems
    • G02B17/0804Catadioptric systems using two curved mirrors
    • G02B17/0808Catadioptric systems using two curved mirrors on-axis systems with at least one of the mirrors having a central aperture
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B17/00Systems with reflecting surfaces, with or without refracting elements
    • G02B17/08Catadioptric systems
    • G02B17/0852Catadioptric systems having a field corrector only
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B17/00Systems with reflecting surfaces, with or without refracting elements
    • G02B17/08Catadioptric systems
    • G02B17/0896Catadioptric systems with variable magnification or multiple imaging planes, including multispectral systems
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/02Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with scanning movement of lens or cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6812Motion detection based on additional sensors, e.g. acceleration sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/685Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Definitions

  • A. Field of the Invention This invention relates generally to the field of aerial reconnaissance, remote sensing, mapping and surveillance camera systems.
  • aerial reconnaissance cameras are available in framing and pan scanning configurations, in both film and electro- optical implementations.
  • the present invention relates to both types of camera configurations, in that a roll framing camera such as described herein generates individual frames of imagery, while the smooth rolling operation provides similar scene coverage and inertial load reductions found in pan scanning cameras.
  • an exposure is taken over a large scene of fixed format.
  • the field of view of the camera is stepped across a large area using mechanically driven stepping hardware while using image motion compensation techniques to compensate for forward motion of the aircraft.
  • the field of view of the camera is a function of lens focal length and the geometrical format size of the image recording media.
  • the exposure time is generally controlled by a shutter and is a function of 1) the sensitivity of the photosensitive media, 2) lens transmittance and relative aperture, and 3) available scene brightness.
  • the photosensitive material can be film, an area array Charge Coupled Device (CCD), or any other media which records an image for later retrieval.
  • CCD Charge Coupled Device
  • Forward Motion Compensation is a technique used in framing cameras to correct for the image motion on the recording media caused by forward motion of the aircraft during the exposure interval. This correction is generally introduced by moving the film or the lens to keep the image stationary in the fore/aft direction while the exposure is taking place. In a framing camera, the correction is usually accomplished by moving the film to match the rate of image motion.
  • U.S. Patent No. 5,668,593 to Lareau et al. assigned to the assignee of the present invention, the contents of which hare incorporated by reference herein, describes a electro-optical step frame camera system in which the forward motion compensation is achieved electronically in the focal plane of the electro-optical detector.
  • the Lareau et al. '597 patent which is incorporated by reference herein, describes an electro-optical imaging array that accomplishes FMC electronically and without moving parts by dividing the columns of the array into multiple column groups, and by transferring pixel information in the column groups at a rate that substantially matches the rates of image motion in the column groups.
  • Another operational function of a framing camera is the generation of an overlap between successive frames of imagery.
  • the overlap is used to ensure complete coverage of all areas of the scene, and/or to provide a view of the scene from two different angular perspectives yielding stereo imagery.
  • the amount of overlap is selectable and nearly always takes place in the direction of flight.
  • the overlap L(OL) of the two frames of imagery is typically of 10% or 12%, or as much as 56%.
  • An overlap of at least 50% allows all imagery in the adjacent frames to be exposed from two different angular perspectives.
  • These images can be recombined by means of a stereo viewing system to achieve depth perception.
  • stereo images are often used by a photointerpreter to gather additional information about the scene.
  • Panoramic (pan) camera technology is another well-established means of imaging.
  • a panoramic scanning camera the scene is exposed continuously by rotating a scanning mechanism (such as a double dove prism) so as to scan the image across the photosensitive medium .
  • the photosensitive medium is moved in synchronism with the image.
  • this may be accomplished by moving the film at a constant rate past an exposure slit which is located on the lens optical axis.
  • a scan prism located in front of the lens is rotated in synchronism with the film rate such that the image of the scene remains stationary on the film during the exposure period.
  • the slit opening is adjusted to a predetermined width to control exposure time.
  • pan camera One major advantage of a pan camera is its ability to image a large area in the direction across the line of flight. Scan angles across the line of flight on the order of 120 to over 180 degrees are typical.
  • the lens field of view in a pan camera is generally only required to be large enough to cover the width of the film. Overlapping of images and stereo imagery may also be obtained with pan cameras. Image overlap in a conventional fixed mounted pan camera is obtained as in the case of a framing camera, that is, in the common area between successive scans.
  • FMC for both the film and electro-optical versions of the pan camera is usually accomplished by a conventional electro-mechanical means. Translating the lens during the scan is a popular means to achieve graded FMC as a function of instantaneous slant range to the scene. As noted above, the FMC can be done electronically as taught in the Lareau et al. US Patent 5,668,593. Prior art mechanically stepped framing panoramic cameras, such as described in the
  • the image motion due to camera roll is compensated for electronically in the detector array.
  • the invention is also particularly suitable for larger, more massive, and more complex cameras, including a camera which carries two or more imaging detectors in order to generate frames of imagery in two or more different bands of the electromagnetic spectrum simultaneously.
  • the present invention provides the capability for collection of imagery using a framing camera in which a continuous scan motion about the roll axis of the aerial reconnaissance vehicle is performed, a technique referred to herein as "roll framing".
  • roll framing As the camera rototes about the roll axis in a continuous fashion, the roll motion is compensated for electronically.
  • This enables high resolution imagery to be generated without loss of resolution or blur, due to the fact that relative motion of the image with respect to the image recording media caused by the roll motion is compensated for using the techniques described herein.
  • the continuous roll motion of the camera facilitates image collection without large inertial accelerations and decelerations or large power spikes, as are found in prior art step frame camera system when the camera mass is physically stepped across the terrain of interest in a series of start and stop movements.
  • the present invention is believed superior to prior art step framing cameras since the problems inherent with mechanical stepping are eliminated.
  • the camera and method are applicable to all sizes and arrangements of cameras, including cameras implementing single spectrum, multi-spectrum and hyperspectral optical systems.
  • the invention is also applicable to cameras with mechanical shutters, electronic shutters, acoustical/optical switches, and other electronic exposure controls.
  • a method for imaging a scene with a framing camera installed in an aerial reconnaissance vehicle.
  • the camera comprises a two dimensional array of photosensitive cells, an optical system directing scene radiation onto said array, and a mechanism for rolling the camera about a rotation axis.
  • the array of cells store pixel information and is arranged in a plurality of rows and columns.
  • the method comprises the steps of : (a) continuously rotating the camera about the rotation axis with the roll mechanism to thereby direct scene information onto the two dimensional array; (b) exposing the array while the camera is rotating and transferring pixel information in the array at a rate substantially equal to an image motion rate due to the rotation of the camera;
  • the camera is mounted to the aerial reconnaissance vehicle such that the step of continuously rotating comprises the step of rotating said camera about an axis substantially parallel to the direction of forward motion of the reconnaissance vehicle.
  • the camera could also be mounted in an orthogonal configuration such that the step of continuously rotating comprises the step of rotating the camera about an axis in a direction substantially orthogonal to the direction of forward motion of said aerial reconnaissance vehicle.
  • the camera could roll essentially about the pitch axis and generate a series of images in the forward oblique direction towards nadir.
  • the steps (a), (b), (c), and (d) recited above are performed in a a series of cycles as the aircraft flies past a scene of interest.
  • the frames overlap one another so as to avoid gaps in scene coverage. If the overlap is sufficient, it would be possible to obtain stereo imagery of the scene of interest.
  • the camera can be configured with just a single detector and generate imagery in a single band of the electro-magnetic spectrum.
  • the camera includes a second electro-optical detector and the camera generates imagery in two bands of the electromagnetic spectrum simultaneously from the first and second detectors.
  • the preferred embodiment described in detail herein is an example of a dual band imaging system.
  • the camera includes an electro-optical detector and optical system for generating imagery in a pan-chromatic spectral band, such as a hyperspectral electro- optical imaging array.
  • an electro-optical roll framing camera with electronic roll motion compensation is provided.
  • the camera is adapted for installation in an aerial reconnaissance vehicle.
  • the camera comprises an electro-optical detector comprising a two-dimensional array of photosensitive cells that store pixel information.
  • the array is arranged in a plurality of rows and columns and has at least one readout register for reading out pixel information from the array.
  • the camera further includes an optical system directing scene radiation onto the array.
  • a servo-mechanical system is provide which couples the camera to the aerial reconnaissance vehicle which is adapted or configured for continuously rolling the camera about a rotation axis to thereby direct scene info ⁇ nation onto the optical system and array.
  • roll motion compensation circuitry is provided for electronically transferring pixel information in the array of photosensitive cells at a rate substantially matching the rate of image motion due to the rotation of the camera, whereby the resolution of images generated by said array may be preserved.
  • the servo-mechanical subsystem includes a first motor system coupled to the camera housing that rotates the camera housing (including the optical system as recited above) about a first axis.
  • the camera housing is preferably installed in the aerial reconnaissance vehicle such that this first axis of rotation is parallel to the roll axis of the aerial reconnaissance vehicle (referred to herein for simplicity as "the roll axis").
  • the image recording media are exposed to the scene to generate frames of imagery as the first motor system rotates the camera housing in a continuous fashion about the roll axis.
  • the first and second image recording media have a means for compensating for image motion due to the rotation of the camera housing.
  • the roll motion compensation means is preferably comprised of electronic circuitry for clocking or transferring pixel information through the electro-optical detectors at a uniform rate substantially equal to the rate of image motion due to camera rotation.
  • a method of calculating the image motion rate, and thus pixel information transfer rate, due to roll of the camera housing is disclosed herein. If a film camera is used for the image recording media, a mechanical system is used to move the film at a rate substantially equal to the image motion rate.
  • the servo-mechanical subsystem also includes a second motor system coupled to a catoptric Cassegrain optical system.
  • the second motor system rotates the Cassegrain optical system about a second axis in the direction of forward motion of the reconnaissance vehicle to compensate for forward motion of the aerial reconnaissance vehicle.
  • the action of the first motor assembly to rotate the entire camera housing about the roll axis occurs at the same time (i.e., simultaneously with) the action of the second motor system to rotate the Cassegrain optical system in the line of flight to accomplish forward motion compensation.
  • the net effect of the action of the second motor system and the roll motion compensation system is that the image of the scene of interest is essentially frozen in the focal plane while the image recording media obtain the frames of imagery, allowing high resolution images of the scene to be obtained.
  • the camera is a dual band framing camera, and there are first and second image recording media each comprising two dimensional area array electro- optical detectors.
  • One may be manufactured from materials sensitive to radiation in the visible portion of the electromagnetic spectrum, and in a preferred embodiment is a charge- coupled device (CCD) detector of say 5,000 X 5,000 or 9,000 X 9,000 pixels.
  • CCD charge- coupled device
  • the other of the electro-optical detectors is made from a material sensitive to radiation in the infrared portion of the electromagnetic spectrum, and may be a platinum suicide array of photo diode detectors or other suitable type of electro-optical detector suitable for IR detection.
  • the detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is preferably sensitive to radiation having a wavelength of between 3.0 and 5.0 microns (MWIR), or from about 8.0 to about 14.0 microns (LWTR).
  • MWIR 3.0 and 5.0 microns
  • LWTR 14.0 microns
  • electro-optical detectors they will typically comprise an array of pixel elements arranged in a plurality of rows and columns.
  • the means for compensation for roll motion of the camera housing comprises electronic circuitry for transferring pixel information in the electro-optical detectors from row to adjacent row at a pixel information transfer rate (uniform across the array) substantially equal to the rate of image motion in the plane of the electro-optical detectors due to roll of the camera housing.
  • the roll motion compensation can be performed electronically on-chip.
  • electro-optical detectors with the capability for transferring pixel information in both row and column directions independently, such as described in Lareau et al., U.S. Patent No. 5,798,786, could be used for the image recording media. Forward motion compensation and roll motion compensation could be performed on- chip in the detectors.
  • the present invention required the solution to several difficult technical challenges, including optical, servo-mechanical and operational difficulties.
  • the challenge is to accurately compensate for the roll motion electronically at a focal plane detector with (1) good image quality and satisfactory modulation transfer function, (2) while minimizing inertial loading, and (3) enabling the use of a relatively large two-dimensional area array as a focal plane detector to get an adequate field of view and resolution.
  • these optical challenges were solved by an on-chip roll motion compensation described in more detail herein.
  • the inventive multi-band LOROP/Tactical camera using electronic roll motion compensation does not lend itself to the use of servo-mechanical systems developed for prior art LOROP systems, particularly those used in prior art step frame cameras (such as described in the Lareau et al. '593 patent).
  • the prior art step frame cameras use a stepping mirror to step across the line of flight and direct radiation onto the array, and require a de-rotation mechanism, such as a Pechan prism, to de-rotate the images.
  • a de-rotation mechanism such as a Pechan prism
  • the applications of the present invention are flexible enough to include both strategic and tactical aircraft, as well as the new breed of aircraft being used by the military for reconnaissance known as unmanned aerial vehicles (including low observables).
  • the diversity of these applications posed a power and stability problem that prevents application of prior art solutions.
  • the task of stepping a 400 lb. camera mass two to four times a second creates tremendous inertial loads as well as power spikes that would be unacceptable.
  • Even the inertia and associated settling times of a stepped scan head assembly pose problems in some applications.
  • the solution was to (1) rotate the entire camera (including the entire optical system and the image recording media) smoothly in a continuous fashion about an axis parallel to the aircraft roll axis, similar to the pan-type movement, but without the starts and stops used in a traditional step-frame camera system, and (2) operating the camera as a framing camera while the camera undergoes the smooth rotation. Frames of imagery are thus taken while the camera smoothly rotates about the roll axis at a constant angular velocity.
  • the present invention also electronically compensates for, i.e., stops, the image motion due to roll while the camera is scanning in a smooth motion.
  • a novel forward motion compensation technique is performed by the Cassegrain optical assembly to cancel out image motion effects due to the forward motion of the aircraft. The result enables exposures of the image recording media to the scene while compensating for roll and forward motion, enabling high-resolution images to be obtained.
  • the present invention thus solves the difficult optical, servo-mechanical and operational problems and provides a dual band framing electro-optical LOROP camera that delivers a performance and technical capability that has never before been achieved.
  • it provides a system by which high-resolution frames of imagery in two different portions of the electromagnetic spectrum can be generated simultaneously.
  • the inventive camera can be used in a quasi-stepping mode, in which overlapping frames of imagery are obtained across the line of flight. It can also be used in a spot mode, in which the camera is oriented in a particular direction to take an image of a target expected to be in the field of view.
  • the teachings of the present invention are particularly applicable to a dual band electro-optical framing reconnaissance camera, and such a camera is the preferred embodiment.
  • some of the techniques and methods of the subject camera system such as the roll-framing operation and unique roll and forward motion compensation techniques, are applicable to a camera system that images terrain in only one portion of the electromagnetic spectrum.
  • the camera is basically as set forth as described above, except that only a single detector is used and a spectrum-dividing prism and second optical path are not needed.
  • the inventive camera system can be adapted to use film or other types of detectors for the photosensitive recording medium.
  • roll motion compensation could be performed by moving the film in a manner such that the film velocity substantially matches the image velocity due to camera roll.
  • a dual-band framing aerial reconnaissance camera for installation in an aerial reconnaissance vehicle.
  • the camera includes an optical system incorporated into a camera housing.
  • the optical system comprises an objective optical subassembly that receives incident radiation from a scene external of the vehicle. Radiation from the scene is reflected from the objective optical subassembly to a spectrum-dividing prism.
  • the prism directs radiation in a first band of the electromagnetic spectrum, such as visible and near IR, into a first optical path and directs radiation in a second band of the electromagnetic spectrum, such as midwavelength IR or long wavelength IR, into a second optical path different from the first optical path.
  • the first optical path includes suitable image forming and focusing lenses and a first two-dimensional image-recording medium for generating frames of imagery in the first band of the electromagnetic spectrum.
  • the second optical path also includes suitable image forming and focusing lenses and a second two- dimensional image-recording medium generating frames of imagery in the second band of the electromagnetic spectrum.
  • the camera further includes a servo-mechanical subsystem including the first and second motor systems as described above.
  • the first and second image recording media comprise two dimensional area array electro-optical detectors.
  • One may be manufactured from materials sensitive to radiation in the visible and near-LR portion of the electromagnetic spectrum, and in a preferred embodiment is a charge-coupled device (CCD) detector of say 5,000 X 5,000 pixels.
  • CCD charge-coupled device
  • the other of the electro-optical detectors is made from a material sensitive to radiation in the infrared portion of the electromagnetic spectrum, and may be a platinum silicide array of photo diode detectors or other suitable type of electro-optical detector suitable for IR detection.
  • the reader is directed to U.S. Patent 5,925,883 to Woolaway, III, the contents of which are incorporated by reference herein, for a description of an IR detector.
  • the detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is preferably sensitive to radiation having a wavelength of between 1.0 and 2.0 microns (SWIR), 3.0 and 5.0 microns (MWIR), or from about 8.0 to about 14.0 microns (LWTR).
  • electro-optical detectors they will typically comprise an array of pixel elements arranged in a plurality of rows and columns.
  • the means for compensation for roll motion of the camera housing comprises electronic circuitry for transferring pixel information in the electro-optical detectors from row to adjacent row at a pixel information transfer rate (uniform across the array) substantially equal to the rate of image motion in the plane of the electro-optical detectors due to roll of the camera housing.
  • the transfer of pixel information occurs while the pixel elements are integrating charge representing scene information.
  • the roll motion compensation can be performed electronically on-chip.
  • electro-optical detectors with the capability for transferring pixel information in both row and column directions independently, such as described in Lareau et al., U.S. Patent No. 5,798,786, could be used for the image recording media. Forward motion compensation and roll motion compensation could be performed on-chip in the detectors.
  • the present invention required the solution to several difficult technical challenges, including optical, servo-mechanical and operational difficulties.
  • the optical challenge is to focus panchromatic energy (e.g. visible through IR) on a focal plane detector with (1) good image quality and satisfactory modulation transfer function, (2) while baffling stray energy, (3) meeting space constraints, and (4) enabling the use of a relatively large two- dimensional area array as a focal plane detector to get an adequate field of view and resolution.
  • these optical challenges were solved by a unique catoptric Cassegrain objective optical subassembly incorporating an azimuth mirror and utilizing separate field optics for each band of the spectrum, described in more detail herein.
  • a method for generating a frame of imagery of a scene of interest with a camera while compensating for forward motion of a reconnaissance aircraft.
  • the camera includes a Cassegrain objective optical subassembly having a primary mirror, a secondary mirror fixedly mounted relative to the primary mirror, and a flat azimuth mirror positioned in the optical path between the primary mirror and the secondary mirror.
  • the camera also includes at least one framing image recording medium, such as a two dimensional electro-optical detector.
  • the Cassegrain optical subassembly and framing image recording medium are incorporated into a camera housing mounted to the vehicle, with the camera housing defining an axis.
  • the method comprises the steps of:
  • step (3) while rotating the primary mirror and secondary mirror as recited in step (2), rotating the azimuth mirror in the direction of flight at a rate one half the rate of rotation in step (2).
  • the azimuth mirror is rotated about an axis coincident with the axis about which the primary and secondary mirrors are rotated.
  • the azimuth mirror is located substantially at the center of the primary mirror.
  • the method is performed in a camera implementing a roll-framing technique for generating sequential images of a terrain of interest.
  • the camera housing including the objective lens subassembly and the framing image recording media, is continuously rotated about a roll axis.
  • the invention can be practiced in conjunction with single band, dual band or hyperspectral imaging implementations.
  • the illustrated embodiment is a dual band system in which the camera includes first and second electro-optical detectors and first and second optical paths for different portions of the electromagnetic spectrum.
  • the detectors generating frames of imagery of the scene of interest in two different portions of the electro-magnetic spectrum simultaneously.
  • a dual band optical system for a framing aerial reconnaissance camera wherein the camera includes at least two two- dimensional image recording media for generating frames of imagery of a scene external of an aerial reconnaissance vehicle carrying the camera.
  • the optical system comprises a Cassegrain objective optical subsystem forming an objective lens for the optical system.
  • the Cassegrain optical system receives incident radiation from the scene and comprises a primary mirror having a central aperture and a secondary mirror, the primary and secondary mirrors aligned along an objective optical axis.
  • An azimuth mirror which receives radiation from the secondary mirror.
  • the azimuth mirror is placed in front of the central aperture of the primary mirror and directs radiation in a direction away from the objective optical axis.
  • a spectrum dividing element receives radiation from the azimuth mirror. This element directs radiation in a first band of the electromagnetic spectrum into a first optical path and directs radiation in a second band of the electromagnetic spectrum into a second optical path different from the first optical path.
  • the first two-dimensional image recording medium is placed in the first optical path and a second two-dimensional image recording medium is placed in the second optical path.
  • the first and second image recording media generate first and second frames of imagery in two different portions of the electromagnetic spectrum simultaneously.
  • the aerial reconnaissance vehicle defines a roll axis.
  • the first and second paths are oriented and extend for a spatial extent generally in the direction of the roll axis, and the objective optical axis is substantially orthogonal to the roll axis, whereby the dual band optical system provides a compact arrangement the camera.
  • the camera further includes a servo-mechanical subsystem.
  • This subsystem includes a first motor system coupled to the camera housing that rotates the entire camera housing (including the optical system as recited above) about a first axis.
  • the camera housing is installed in the aerial reconnaissance vehicle such that this first axis of rotation is parallel to the roll axis of the aerial reconnaissance vehicle (referred to herein for simplicity as "the roll axis").
  • the image recording media are exposed to the scene to generate frames of imagery as the first motor system rotates the camera housing in a continuous fashion about the roll axis.
  • the first and second image recording media have a means for compensating for image motion due to the rotation of the camera housing.
  • the roll motion compensation means is preferably comprised of electronic circuitry for clocking or transferring pixel information through the electro-optical detectors at a uniform rate substantially equal to the rate of image motion due to camera rotation.
  • a method of calculating the image motion rate, and thus pixel information transfer rate, due to roll of the camera housing is disclosed herein. If a film camera is used for the image recording media, a mechanical system is used to move the film at a rate substantially equal to the image motion rate.
  • the servo-mechanical subsystem also includes a second motor system coupled to the objective optical subassembly.
  • the objective optical subassembly comprises a catoptric Cassegrain optical system.
  • the second motor system rotates the Cassegrain optical system about a second axis in the direction of forward motion of the reconnaissance vehicle to compensate for the forward motion of the aerial reconnaissance vehicle.
  • the action of the first motor assembly to rotate the entire camera housing about the roll axis occurs at the same time (i.e., simultaneously with) the action of the second motor system to rotate the Cassegrain optical system in the line of flight to accomplish forward motion compensation.
  • the net effect of the action of the Cassegrain motor system and the roll motion compensation system is that the image of the scene of interest is essentially frozen relative to the focal plane of the image recording media while the media obtain the frames of imagery, allowing high resolution images of the scene in two different bands of the spectrum to be obtained simultaneously. Furthermore, the rotation of the image scene caused by the roll motion of the objective subassembly is simultaneously detrotated by the roll motion of the rest of the camera, in view of the fact that the entire camera assembly is rolled as a unit, thereby eliminating the need for a separate derotation mechanism such as a pechan prism. Other types of optical arrangements for the objective optical subassembly are possible, but are less preferred.
  • Figure 1 is a perspective view of an aircraft flying over a terrain of interest with a camera in accordance with the preferred embodiment operating to generate frames of imagery of the terrain in two bands of the electromagnetic spectrum simultaneously.
  • Figure 2 is a schematic representation of the aircraft of Figure 1 taking a series of 5 frames of images in a series of cycles while flying past the terrain of interest;
  • Figures 2A and 2B are perspective view of the camera system of Figure 1, shown isolated from the rest of the aircraft, and with protective covers removed in order to better illustrate the components of the camera;
  • Figure 2C is a perspective view of the camera of Figures 2 A and 2B, with the protective covers installed, and showing the entrance aperture for the catoptric Cassegrain optical system;
  • Figure 3 is a top plan view of a presently preferred embodiment of the dual band framing reconnaissance camera system of Figures 2A-2C, with the covers removed;
  • Figure 4 is a cross-sectional view of the camera system of Figure 3, taken along the lines 4-4 of Figure 3;
  • Figure 4A is a simplified ray diagram of the optical system of Figure 3 and 4;
  • Figures 4B and C are more detailed cross-sectional views of the optical elements in the visible and MWLR paths of Figures 4 and 4A;
  • Figure 5 is an end view of the camera system of Figure 3-4, shown from the right- hand end of the camera housing and with the roll motor and cover plate at that end removed in order to better illustrate the other structures in the camera;
  • Figure 6 is a perspective view of the assembly of the Cassegrain subsystem, showing in better detail the structure that retains the Cassegrain primary mirror and showing the secondary mirror, azimuth mirror, Cassegrain motor assembly and azimuth 2-1 drive assembly in greater detail.
  • the primary mirror itself is removed from Figure 6 in order to better illustrate the components of the Cassegrain optical system.
  • Figure 7 is another perspective view of the Cassegrain primary mirror retaining assembly of Figure 6;
  • Figure 8 is another perspective view of the Cassegrain primary mirror retaining assembly as seen generally from the rear, shown partially in section;
  • Figure 9 is a top view of the Cassegrain optical system of Figure 6;
  • Figure 10 is a cross-sectional view of the Cassegrain optical system of Figure 6, taken along the line 10- 10 of Figure 9 ;
  • Figure 11 is a detailed sectional view of the azimuth mirror 2-1 drive assembly that rotates the azimuth mirror at one half the rate of rotation of the entire Cassegrain optical subsystem;
  • Figure 12 is a detailed perspective view of one of the roll motor assemblies of Figure 2, showing the L shaped brackets that mount to the stator of the motor and rigidly couple the roll motor to the pod or aircraft;
  • Figure 13 is an elevational view of the roll motor of Figure 12;
  • Figure 14 is a cross-sectional view of the roll motor of Figure 14;
  • Figure 15 is a detailed illustration of a portion of the roll motor of Figure 14;
  • Figure 16A is a ray diagram of the visible path in the embodiment of Figure 4;
  • Figure 16B is a ray diagram of the MWIR path in the embodiment of Figure 4.
  • Figure 16C is a graph of the visible path diffraction modulation transfer function
  • Figure 17 is a block diagram of the electronics for the camera system of Figures 2-5;
  • Figure 18 is schematic representation on an image recording medium in the form of a two dimensional electro-optical array, showing the image motion in the array due to the roll of the camera;
  • Figure 19 is another schematic representation of the array of Figure 18, showing the electronic circuitry that controls the transfer of pixel information in the array at the same velocity as the image in order to provide roll motion compensation.
  • an aerial reconnaissance camera system 20 in accordance with a preferred embodiment of the invention is shown installed in a reconnaissance aircraft 22 flying over a terrain of interest 42 at an altitude H and with forward velocity V, moving in a direction of flight FL.
  • the aerial reconnaissance camera system 20 includes a camera 36, shown in greater detail in Figures 2A-2C and 3-5, a camera control computer 34 and associated electronics described in further detail in Figures 17 and 19.
  • the camera control computer receives certain navigational information from the aircraft avionics system 24, including current aircraft velocity and height data. Additional camera system inputs may come from a console 28 in the cockpit, such as start and stop commands or camera depression (roll angle) settings.
  • the aircraft body defines a roll axis R, a pitch axis PI and a yaw axis Y passing through the center of gravity CG of the aircraft.
  • the camera 36 is shown orientated at a camera depression angle ⁇ relative to a bilateral plane BP that is horizontal during level flight.
  • the line of sight LOS of the camera 36 is nominally orthogonal to the roll axis in a side oblique or nadir orientation.
  • the preferred embodiment of the subject camera system 20 operates like a step-frame electro-optic (E-O) sensor, capable of taking a sequence of overlapped frames in the cross- track, i.e., cross-line of flight, direction. This is shown in Figure 2.
  • E-O electro-optic
  • the camera is rotated about the roll axis in a continuous fashion (i.e., without starts and stops between frames), with frames of imagery taken at different depression (roll) angles, e.g., angles ⁇ l, ⁇ 2, ⁇ 3, ⁇ 4 and ⁇ 5, resulting in frames 1, 2, 3, 4 and 5.
  • a nominal rate of rotation about the roll axis is used (based on focal length, array frame size and framing rate, such as 8-10 degrees per second, but the roll rate is adjustable by the camera control computer.
  • the camera rotates back, i.e., retraces, to its initial roll position ( ⁇ l), and the second cycle of frames of imagery is obtained (IA, 2A, 3 A, 4A, 5 A).
  • the process repeats for a third and subsequent cycles of operation.
  • the cross-track framing sequence 1, 2, 3, 4, 5; IA, 2A, 3A, 4A, 5A; etc. (which is
  • V/H dependent can be made in either spectrum individually or in both spectrums simultaneously, dependent on the time of day and the purpose of the reconnaissance mission.
  • the roll action of the camera can encompass both sides of nadir, for example with frames 1-4 obtained at one side of nadir and frame 5 obtained at the other side of nadir.
  • the camera can also be used in a spot mode, in which the camera is rotated to a particular depression angle and frames of imagery obtained of the scene of interest.
  • the number of frames per cycle of roll, N can thus vary from 1 to say 5 or 10 or until horizon to horizon coverage is obtained.
  • Figure 2A shows the camera 36 in a perspective view as seen from below, with a set of protective cover plates removed in order to better illustrate the structure of the camera.
  • Figure 2B is another perspective view, shown from above, and
  • Figure 2C is a perspective view of the camera 36 with the cover plates 33 installed, showing the entrance pupil 35 for the camera.
  • the camera 36 per se is shown in top, sectional and end views, respectively.
  • a rear support plate 41 and a roll motor 70A are removed in order to better illustrate the rest of the camera 36.
  • the camera 36 mounts to the reconnaissance pod or airframe of the aerial reconnaissance vehicle via four mounting brackets 39, each connected to the pod or airframe via passive shock isolation mounts in conventional fashion.
  • the mounting brackets 39 are bolted to the sides of the stator of the roll motor assemblies 70A and 70B as shown in Figure 12 and described below.
  • the entire camera cylinder comprising all the components between the two support plates 41 and 41A can rotate relative to the roll axis 37 while the stator of the roll motors 70A and 70B and mounting brackets 39 remain in a fixed position relative to the aerial reconnaissance vehicle.
  • the basic configuration of the camera 36 is a cylinder, as perhaps best illustrated in Figure 2C, which in the illustrated embodiment is approximately 20 inches in diameter and 48 inches in length.
  • the camera 36 is installed in an aircraft reconnaissance pod via the mounting brackets 39 such that the cylinder axis 37 is oriented nominally parallel to the flight direction of the aircraft, i.e., the roll axis of the aircraft.
  • the fore/aft orientation of the camera can be either way.
  • the camera 36 can be installed such that it is oriented perpendicular to the line of flight.
  • a typical use of the camera is to take overlapping frames of images in the cross-track direction as the aircraft flies over the scene of interest as shown in Figure 2, similar in concept to the step frame operation described in the prior art patent of Lareau, et al. U.S. Patent No. 5,668,593 and earlier step frame film cameras.
  • the manner in which the camera achieves this result is very different from that taught in the prior art.
  • a stepping mirror is rotated in discrete steps to image the terrain, and forward motion compensation is performed in the array itself electronically
  • the entire camera 36 is rotated at a constant angular velocity, and in a continuous fashion, about the roll axis 37.
  • the roll rate is determined by the optical system focal length, frame size, frame rate and the desired cross-track overlap (typically 5%) between consecutive frames. Moreover, forward motion compensation is achieved by means of rotation of the Cassegrain optical system about an axis 75, as described below, not in the array.
  • the camera includes an optical system 50 which is incorporated into (i.e., mounted to) a camera housing or superstructure 52.
  • the optical system 50 in the preferred embodiment comprises a novel catoptric Cassegrain objective optical subassembly 54 which receives incident radiation from a scene external of the vehicle.
  • Figure 4A shows a simplified ray diagram for the optical system 50.
  • the Cassegrain objective optical subassembly includes a primary mirror 80, a secondary mirror 82 and a flat azimuth mirror 84.
  • the secondary mirror 82 is centrally located in the entrance aperture of the Cassegrain optical system. Radiation from the scene is reflected from the Cassegrain objective subassembly 54 to a spectrum-dividing prism 56.
  • the prism 56 directs radiation in a first band of the electromagnetic spectrum, such as visible and near LR, into a first optical path 58 and directs radiation in a second band of the electromagnetic spectrum, such as mid- wavelength IR or long wavelength IR, into a second optical path 60 different from the first optical path.
  • the first optical path 58 includes suitable image forming and focusing lenses 62 and a first two-dimensional image recording medium 64 for generating frames of imagery in the first band of the electromagnetic spectrum.
  • the second optical path 60 includes a fold prism 61, suitable image forming and focusing lenses 66 and a second two-dimensional image recording medium 68 which generates frames of imagery in the second band of the electromagnetic spectrum.
  • the camera further includes a novel servo-mechanical subsystem.
  • This subsystem includes a first motor system 70A and 70B coupled to the camera housing 52 that rotates the camera housing 52 (including the optical system 50 as recited above) about the roll axis 37.
  • the image recording media 64 and 68 are exposed to the scene to generate frames of imagery as the first motor system 70A and 70B rotates the camera housing 52 in a continuous fashion about the roll axis 37.
  • the first and second image recording media have a means for compensating for image motion due to the rotation of the camera housing.
  • the roll motion compensation means is preferably comprised of electronic circuitry for clocking or transferring pixel information through the electro-optical detectors at a uniform rate substantially equal to the rate of image motion due to camera rotation.
  • a method of calculating the image motion rate, and thus pixel information transfer rate, due to roll of the camera housing is described below. If a film camera is used for the image recording media, a mechanical system is used to move the film at a rate substantially equal to the image motion rate.
  • Film drive mechanisms for moving film for purposes of motion compensation are known in the art and can be adapted for a film framing camera for purposes of roll motion compensation by persons skilled in the art.
  • the servo-mechanical subsystem also includes a second motor system 74, shown best in Figure 3, 5 and 6, coupled to the front end of the Cassegrain optical system 54.
  • the second motor system 74 rotates the Cassegrain objective subassembly 54, including the primary, secondary and azimuth mirrors, about a second axis 75 in the direction of forward motion of the reconnaissance vehicle in a manner to compensate for forward motion of the aerial reconnaissance vehicle.
  • the azimuth mirror 84 is rotated about the axis 75 at one half the rate of rotation of the Cassegrain primary and secondary mirrors 80 and 82 in the direction of forward motion.
  • the action of the first motor assembly 70A and 70B to rotate the entire camera housing about the roll axis occurs at the same time (i.e., simultaneously with) the action of the second motor system 74 to rotate the Cassegrain optical system 80, 82 and 84 in the line of flight to accomplish forward motion compensation.
  • the net effect of the action of the Cassegrain motor system 74 and the roll motion compensation technique is that the image of the scene of interest is essentially frozen relative to the focal plane of the image recording media while the image recording media obtain the frames of imagery, allowing high resolution images of the scene in two different bands of the spectrum to be obtained simultaneously.
  • the entire camera 36 rotates by action of the roll motors 70A and
  • exposure of the detectors 64 and 68 at the two focal planes is made.
  • the exposure in the visible spectrum path 58 the exposure is executed by means of a mechanical focal plane shutter 88 which opens to allow incident photons to impinge on a two-dimensional charge-coupled device E-O detector array 64.
  • exposure is executed by electronic switching (on/off) of IR-sensitive photocells arranged in a two-dimensional array 68, basically by dumping charge accumulating prior to the initiation of exposure and then accumulating and storing charge when the exposure period commences.
  • any method of exposure control will work with this roll-framing camera.
  • the data is read out from the two focal plane detectors 64 and 68 and they are placed in condition for a second exposure.
  • the rotation of the entire camera assembly about the roll axis 37 continues smoothly (that is, without starting and stopping as for example found in a prior art step frame camera system).
  • the shutter is opened in the visible/near IR path; similarly, in the MWTR path the charge dumping ceases and charge is accumulated.
  • the data is then read out of the two focal plane sensors after the exposure period is over.
  • the camera system roll rate (the cylinder angular velocity), ⁇ , is established as follows. First, determine the cross-track field of view per frame, ⁇ , according to equation (1):
  • W detector array size in the cross-track direction
  • lens focal length i.e, the focal length of the overall aggregate of optical components in the particular band of interest, e.g., the visible band).
  • FR system frame rate (frames per second)
  • OL c overlap between consecutive cross-track frames (expressed as a decimal). Note that the cylinder angular velocity ⁇ is independent of the aircraft's velocity and height above the earth. Typical angular rotations between the successive exposures of the array will be less than 10 degrees.
  • the image motion due to camera roll is constant and uniform across the array.
  • this image motion is synchronized with the velocity at which charge representing scene information is transferred within the detector arrays, thus eliminating relative motion between the image and the pixels imaging the scene and thus eliminating the image smear that would otherwise take place at the detector.
  • pixel information in the entire array is transferred in the direction of image motion from row to adjacent row at a rate that substantially matches the image velocity v.
  • the cylinder continues rotating to the next scene position while the collected scene signals are read-out of the detector array(s). Note that there is no rotational start and stop between exposures, as found in prior art step frame camera systems, thereby avoiding the servo loop settling times, load current surges, and power spikes produced by mechanical stepping systems as noted earlier.
  • the two focal plane detectors 64 and 68 operate in the above manner, taking N consecutive cross-track frames, N being dependent on the time available or by the intended mode (maximum coverage, limited coverage or spot mode) of operation.
  • N is dependent on the time available or by the intended mode (maximum coverage, limited coverage or spot mode) of operation.
  • the result is a series of frames of images similar to that produced with a step frame camera system, as indicated in Figure 2, each frame taken in two different bands of the electromagnetic spectrum.
  • N is determined by the V/H ratio of the mission, the camera system depression angle range and the framing rate, and N can be as many as 10 frames/cycle (or more) in normal operation.
  • the camera system or cylinder is rotated back (reset) to the first frame angular position and the cycle repeats until the intended in-flight direction coverage is achieved.
  • a one or two frames/cycle is executed, with the camera aimed at a specific predete ⁇ nined depression (roll) angle and fore/aft azimuth angle where a target or specific interest is expected to be.
  • N will typically equal 1 or 2.
  • the cycle may repeat for as many times as needed.
  • the camera could be used in a traditional step frame operation. In this mode, the camera would rotate between successive angular positions, and the photosensitive media would generate two-dimensional images of the terrain. If the camera body rotation is stopped during scene exposure, forward motion compensation could be performed in the photosensitive media, such as described in the earlier Lareau et al. patents.
  • the preferred forward motion compensation method will now be described with a little more specificity. As the exposures are made at either of the two detectors 64 and 68, the aircraft is moving at some known velocity. The forward motion of the aircraft is neutralized in a novel way in the preferred embodiment. Whereas in the prior art Lareau et al.
  • the value of R can be derived from simple geometry from the known aircraft height and camera depression angle ( ⁇ ; ) and assuming the earth is flat in the scene of interest, from a Global Positioning System on board the aircraft, using an active range finder, or by computing range from successive frames of imagery as described in the patent of Lareau et al., US Patent No.
  • the Cassegrain optical system could remain fixed and both forward motion compensation and roll motion compensation could be performed in the focal plane detector by transferring pixel information in both row and column directions in accordance with the principles of the Lareau et al. patent, U.S. Patent No. 5,798,786.
  • Visible Channel 50.0 inches -//4.0 (Options) 72.0 inches -f/5.8 84.0 inches -f/6.1
  • Type Cassegrain objective lens with spectrum beam divider and individual visible channel and MWTR channel relay lenses. Operating Spectrums :
  • Visible Channel 5040 x 5040 pixels .010 mm x .010 mm pixel pitch 50.4 mm x 50.4 mm array size 4.0 frames/sec max.
  • MWTR Channel 2016 x 2016 pixels .025 mm x .025 pixel pitch 50.4 mm x 50.4 mm array size 4.0 frames/sec max.
  • MWTR Channel 2520 x 2520 pixels (future) .020 mm x .020 mm pixel pitch 50.4 mm x 50.4 mm array size 4.0 frames/sec max.
  • GRD Ground Resolvable Distance
  • VIS Channel 3 ft @ 31 N mi. (NILRS-5) (50”) 3 ft @ 45 N mi. (NIIRS-5) (72”) 3 ft @ 52 N mi. (NIIRS-5) (84”)
  • the optical system 50 including the Cassegrain optical system, spectrum dividing prism 56, and optical components in the optical paths 58 and 60, are rigidly mounted to a camera housing or superstructure 52.
  • This camera housing 52 takes the form of a pair of opposed, elongate C-shaped frames extending transversely on opposite sides of the roll axis substantially the entire length of the camera.
  • the C-shaped frame members 52 provide a structure in which to mount the various optical and mechanical components of the camera, including the end plates 41 and 41 A.
  • the end plate 41 is bolted to the right hand end of the C-shaped frames 52, as shown in Figure 3.
  • the rotor portion of the roll motor 70 A is in turn bolted to the end plate 41, thereby coupling the rotational portion of the roll motor 70A to the camera frame 52.
  • the stator portion of the roll motor 70A is fixedly coupled to the aircraft frame or pod via two L- shaped brackets 39 and the associated passive isolation mounts (conventional, not shown).
  • the left-hand end of the C-shaped frame 52 is similarly bolted to an end plate 41 A, and the rotor portion of the roll motor 70B is bolted to the end plate 41A, with the stator portion bolted to two L-shaped brackets 39.
  • Two roll motors 70A and 70B are conventional frameless DC torque motors, adapted to mount to the camera 36. Two are used in the illustrated embodiment in order supply enough torque to rotate the camera housing 52 and all the attached components, but one motor may suffice if it is powerful enough.
  • the roll motors 70A and 70B are frameless DC torque motors, adapted to fit to the camera housing, a task within the ability of persons skilled in the art. The roll motors are described below in further detail in conjunction with Figures 12-15.
  • Figure 3 is a top view of the camera 36, looking towards to the back side of the primary mirror 80.
  • the Cassegrain objective lens optical subassembly 54 includes a primary mirror cell 100 which includes four mounting flanges 102 with bolt holes 104 for mounting via bolts to the top flange 106 of the C-shaped frames 52.
  • the Cassegrain optical system is shown isolated in Figures 6-10. In Figures 6 and 7, the primary mirror is removed in order to better illustrate the rest of the structure in the Cassegrain optical system.
  • a spider 120 consisting of eight arms 122 extends between an inner primary mirror holding ring 110 and an azimuth mirror mounting plate 124 located at the center of the primary mirror 80.
  • the mounting plate 124 incorporates three adjustment screws 126 for adjusting the tilt of the azimuth mirror 84.
  • a fiber optic gyroscope 128 is also mounted to the plate 124 and is provided for purposes of inertial stiffness and stabilization of the Cassegrain optical system 50.
  • the secondary mirror assembly 113 includes a set of three adjustment screws 126 A for adjusting and aligning the orientation of the secondary mirror relative to the primary mirror.
  • the stator portion of the Cassegrain motor 74 is fixed with respect to the primary mirror cell 100.
  • the rotor portion of the motor 74 is mounted to an annular ring 111 shown in Figure 10, which is attached to the inner primary mirror holding ring 110.
  • the secondary mirror 82 is fixed with respect to the primary mirror by means of three arms 112.
  • the motor 74 rotates both the primary, secondary and azimuth mirrors about axis 75 in the direction of the line of flight in unison.
  • the Cassegrain motor 74 is based on a DC direct drive motor adapted as required to the Cassegrain primary mirror holding structure, again a task within the ability of persons skilled in the art.
  • the rotation of the inner mirror holding ring 110 by the Cassegrain motor 74 is reduced by a two-to-one reduction tape drive assembly 114, shown best in figures 5, 6 7, 9 and 11.
  • the tape drive assembly 114 rotates an azimuth mirror drive shaft 116 that extends from the tape drive assembly 114 to the azimuth mirror 84.
  • the azimuth tape drive assembly 114 rotates the azimuth mirror drive shaft 116 and thus the azimuth mirror 84 at one half of the rate of rotation of the primary and secondary mirrors by the Cassegrain motor 74.
  • the tape drive assembly 114 includes a two-to-one drive housing 150, two-to-one drive couplings 152 and 154, a shaft locking coupling 156, and a pair of stainless steel tapes 158 and 160, the thickness of which is shown exaggerated in Figure 11.
  • the roll motor 70A is shown isolated from the rest of the camera in a perspective view.
  • Figure 13 is an elevational view of the motor as seen from the other side.
  • Figure 14 is a cross-sectional view of the motor 70A.
  • the roll motor 70B is identical to the motor of Figures 12-14. Additional details concerning the tape drive assembly 114 are conventional and therefore omitted for the sake of brevity.
  • the motor 70A includes a trunnion 200, a journal 202 and a DC frameless motor 204.
  • the journal 202 bolts to the plate 41 ( Figure 3) via six bolt holes 208.
  • a set of apertures 210 is provided in the face of the journal 202 to reduce weight.
  • the sides of the trunnion 200 have opposed, parallel flat surfaces 212 with a series of mounting holes for enabling the L- shaped mounting brackets 39 to mount to the trunnion 200 in a plurality of different positions.
  • the motor 70A also includes an electronics module contained in a housing 214.
  • the module includes a power amplifier and associated DC electronic components, which are conventional.
  • the motor assembly 70A also includes an annular shim 220, an annular bearing 222, a lock washer 224 and locking nut 226, a trunnion sleeve 228, a bearing spacer 230, a bearing insert 232 and a bearing adjustment plate 234. Additional mechanical features shown in Figures 14 and 15 are not particularly important and therefore are omitted from the present discussion.
  • optical system design of the subject camera is driven by the need to illuminate a large focal plane image recording medium and by space constraints, namely the total axial length and the total diameter, which have to be accounted for in potential aircraft installation applications.
  • space constraints namely the total axial length and the total diameter, which have to be accounted for in potential aircraft installation applications.
  • the optical system 50 of Figure 3 and 4 represents a 50-inch, F/4 optical system designed to operate over an extended spectral region.
  • the objective lens module consists of the Cassegrain optical subsystem 54, comprising the primary and secondary mirrors 80 and 82.
  • the azimuth mirror 84 is utilized to redirect the image forming light bundles into the remainder of the optical system, namely the spectrum dividing prism and the relay lenses and other optical components in the optical paths 58 and 60.
  • radiation is reflected off the flat azimuth mirror 84 towards a calcium fluoride spectrum-dividing prism 56.
  • An image is formed at a Cassegrain image plane 130 immediately in front of the prism 56.
  • the spectrum- dividing prism 56 is constructed such that radiation in the visible and near LR band (about 0.5 to about 0.9 microns) passes through the prism 56 into the visible/near TR optical path 58 while radiation in the MWTR portion of the spectrum (about 3 to about 5 microns) is reflected upwards through a fold prism 132, made from an infrared transmitting material, into the MWTR optical path 60.
  • the radiation passes through a relay lens assembly 62 enclosed in a suitable enclosure 134, a focus element 136 adjusting a set of focus lenses 138, and finally to a shutter 88.
  • An image is formed on the focal plane of the image recording medium 64.
  • the shutter 88 opens and closes to control exposure of the visible spectrum image recording medium 64.
  • the medium 64 is a charge-coupled device E-O detector, comprising an array of pixels arranged in rows and columns.
  • the array 64 is cooled by a thermo-electric cooler 140.
  • the array and thermo-electric cooler are enclosed in their own housing 142, which includes electronics boards 144 and a set of heat dissipating cooling fans 146.
  • the light passes through a relay lens assembly 66 contained in a suitable housing, through a focus lens assembly 67 and an image is formed at the focal plane of an TR-detecting two dimensional array 68.
  • the MWTR sensor comprises the array 68, a cold stop 69, and an internal filter, all enclosed in a cryogenic dewar 63.
  • optical axis of the objective Cassegrain optical subassembly is shown vertical in Figure 4. This arrangement provides a very compact assembly; if the objective were arranged along a horizontal axis the total length required for the system would have been intolerably large.
  • the use of only reflecting components (catoptric) in the objective allows the collection of light from a very wide spectral region. Such imaging would be impractical or impossible with a refracting objective design.
  • the point of intersection of the visible relay optical axis and the objective optical axis is an important datum feature of this system.
  • the azimuth mirror 84 reflecting surface is designed to rotate about an axis that contains this intersection point.
  • the entire Cassegrain objective subassembly 54 is arranged to also rotate about this same axis for forward motion compensation. Rotation of the objective permits locking onto ground image detail while the camera and aircraft are moving forward. If the azimuth mirror 84 rotates at half the angular rate of the objective module with respect to the aircraft/camera frame of reference, the selected ground image is effectively locked or frozen onto the detectors. Consequently, the image can be recorded without blur of relative forward motion between the camera and the scene.
  • Presently preferred embodiments of the subject optical system have focal lengths of between 50 and 100 inches, and an f/number of between 4.0 and 8.0.
  • Figures 16A and 16B are ray diagrams for the visible and MWTR paths of the embodiment of Figure 4.
  • Figure 16C is a graph of the diffraction MTF for the visible path.
  • the MTF curves are wavelength-averaged over the visible/TR spectral range of 500 to 900 nm with system spectral weights.
  • the Cassegrain objective subsystem introduces a central obscuration into the light forming beams, and therefore reduces the diffraction-limited performance limits that can be achieved.
  • optical prescription, fabrication and aperture data are set forth below in the following tables for the embodiment of Figure 4.
  • the data set forth in the tables is by no means limiting of the scope of the invention, and departure thereof is expected in other embodiments of the invention.
  • selection and design of the optical components for any given implementation of the invention is considered to be a matter within the ability of persons skilled in the art of optical design of aerial reconnaissance cameras, with such additional designs being considered obvious modifications of the illustrated embodiment.
  • the numbering of the elements in the left-hand column corresponds to the optical elements shown in Figures 16A and 16B in progression from the entrance aperture to the detectors.
  • Thickness is axial distance to next surface
  • Thickness is axial distance to next surface
  • the electronics for the camera 36 of Figures 1 and 3 is shown in block diagram form in Figure 17.
  • the electronics includes an image processing unit (IPU) 401 which contains the master control computer 34 of Figure 1.
  • the master control computer 34 supplies control signals along a conductor 400 to a camera body and stabilization electronics module, represented by block 402.
  • the camera body and stabilization electronics 402 basically includes digital signal processing cards that provide commands to the roll motors 70A and 70B and the Cassegrain or azimuth motor 74 of Figures 3, 5 and 6, and receive signals from the stabilization system consisting of the azimuth fiber optic gyroscope 128 mounted on the azimuth mirror and a roll fiber optic gyroscope (not shown) mounted on the camera housing 52.
  • the camera body electronics 402 also receives current roll angle and roll rate data from resolvers in the roll motors 70A and 70B, and from the roll gyroscope, and supplies the roll information to the camera control computer.
  • the camera control computer 34 also generates control signals, such as start, stop, and counter values, and supplies them via conductor 406 to an IR sensor module (IRSM) 408 and a Visible Sensor Module 410.
  • IRSM IR sensor module
  • the IRSM 408 includes a cryogenic dewar or cooler 63, the IR detector 68 ( Figure 4) and associated readout circuitry, and electronic circuitry shown in Figure 19 and described subsequently for transferring charge through the IR array to achieve roll motion compensation. Pixel information representing IR imagery is read out of the array 68, digitized, and sent along a conductor 412 to the EPU 401.
  • the electronic circuitry shown in Figure 19 could be incorporated into the camera body electronics 402 or in the Image Processing Unit 401.
  • the visible sensor module 410 includes a mechanical shutter 88, a visible spectrum electro-optical detector 64 ( Figure 4) and associate readout registers, and electronic circuitry described in Figure 19 and described subsequently for transferring charge through the visible spectrum detector 64 to achieve roll motion compensation. Pixel information representing visible spectrum imagery is read out of the detector 64, digitized, and sent along a conductor 414 to the IPU 401.
  • Visible and LR imagery supplied by the Visible Sensor Module and the IR Sensor Module is received by a dual band input module 420 and supplied to an image processor 422 for purposes of contrast adjustment, filtering, radiometric correction, etc.
  • images generated by the arrays 64 and 68 are either stored for later retrieval or downlinked to a ground station.
  • the imagery is compressed by a data compression module 424, supplied to an output formatter 426 and sent along a conductor 428 to a digital recording module 430 for recording of the imagery on board the aircraft.
  • Aircraft inertial navigation system data such as aircraft velocity, height, aircraft attitude angles, and possibly other information, is obtained from an aircraft 1553 bus, represented by conductor 432.
  • Operator inputs such as start, stop and roll angle commands from a manual cockpit or camera console or control panel, can also be supplied along the conductor 432 or by an optional control conductor 434.
  • the INS and operator commands are processed in an INS interface circuit 436 and supplied to the camera control computer 34 and used in the algorithms described above.
  • the camera control computer also has a non-volatile memory (not shown) storing fixed parameters or constants that are used in generating the roll motion compensation commands, such as the pixel pitch, array size, master clock rate, and optical system focal length.
  • the image processor 422 and a graphics module 438 are used to generate thumbnail imagery and supply the imagery to an RS- 170 output 440 for viewing in near real time by the operator or pilot on board the reconnaissance vehicle, or for downloading to the ground station.
  • Other format options for the thumbnail imagery are also possible.
  • Aircraft power is supplied to a power conversion unit 442, which filters, converts and distributes it to two power modules 444.
  • the power modules 444 supply the required AC or DC voltages to the various electronic components in the camera 36.
  • An RS-232 diagnostic port 446 is provided in the LPU 401 for remote provisioning, diagnostics, and software downloads or upgrades or debugging by a technician.
  • the port 446 provides an interface to the master control computer 34, and the other modules in the LPU 401 and allows the technician to access these units with a general purpose computer. Changes to fixed parameters stored in non-volatile memory, such as a change in the focal length of the camera, are also made via the port 446.
  • the visible/near IR E-O detector 64 is shown in a plan view.
  • the detector consists of an array of pixel elements 300 arranged in a plurality of rows and columns, with the column direction chosen to be across the line of flight and the row direction in the direction of flight.
  • the array 64 can be any suitable imaging detector including a charge-coupled device, and preferably will comprise at least 5,000 pixels in the row direction and at least 5,000 pixels in the column direction.
  • the illustrated embodiment consists of 5040 x 5040 pixels, with a .010 mm x .010 mm pixel pitch and a 50.4 mm x 50.4 mm array size.
  • the architecture for the array is not critical, but a full frame imager, as opposed to an interline transfer architecture, is presently preferred.
  • the imager can use either a mechanical shutter or an electronic shutter to expose the array.
  • the roll motion caused by camera roll motors 70A and 70B produces an image motion indicated by the arrows 302 in the plane of the array 64.
  • the roll motion is in the cross-line of flight direction and the image velocity v is nearly constant throughout the array.
  • the velocity v is equal to the product of the optical system focal length /multiplied by the rate of rotation ⁇ . Since/ is fixed (and the value stored in memory for the camera control computer), and the rate of rotation is known by virtue of outputs of the fiber-optic gyroscope 128 or from resolvers in the roll motors, the velocity of the image due to roll can be precisely determined for every exposure.
  • the velocity can be expressed in terms of mm/sec, in terms of rows of pixels per second, or in terms of the fraction of a second it takes for a point in the image to move from one row of pixels to the adjacent row, given the known pixel pitch.
  • the pixel information (i.e., stored charge) in the individual pixels 300 is transferred row by row throughout the entire array 64 at the same rate and in the same direction of image motion during the exposure time, thereby avoiding image smear due to the roll motion.
  • the camera electronics includes a counter and clock driver circuit 304 (one for each detector 64, 68) which generates voltage pulses and supplies them to a set of three phase conductors 308 which are coupled to each row of the array.
  • One cycle of three-phase clocking effectuates a transfer of charge from one row to the adjacent row.
  • a master clock 306 generates clock signals at a master clock frequency and supplies them to a counter 310.
  • the camera control computer calculates a counter value which determines the number the counter 310 is supposed to count to at the known master clock rate to time the transfer of charge from one row to another in synchronism with the movement of the image by one row of pixels (0.010 mm).
  • the master computer 34 supplies the counter value to the counter 310, along with a start and stop commands.
  • the counter 310 starts counting at the clock rate up to the counter value.
  • a trigger signal is sent to a clock driver 312.
  • the clock driver 312 initiates one cycle of three phase clocking on conductors 308, causing the pixel information from row 1 to be transferred to row 2, from row 2 to row 3, etc.
  • the counter 310 resets itself and immediately begins counting again to the counter value, another cycle of clocking is triggered, and the process repeats continuously while the array is exposed and charge is integrated in the detectors.
  • a stop signal is sent to the counter 310.
  • the pixel information in the array 64 is read out of the array into read-out registers at the bottom of the array (not shown), converted into digital form, and either stored locally on a digital recording medium for later use or transmitted to a remote location such as a base station.
  • the process described for array 64 is essentially how the IR detector operates as well for accomplishing roll motion compensation, hi alternative embodiments, the image motion compensation could be performed in other readout structures depending on the architecture for the array.
  • the LR detector could be sensitive to radiation in the Short Wavelength Infra- Red (SWIR) band (1.0 to 2.5 microns), Mid-Wavelength LR (MWLR) band (3.0 to 5.0 microns) or Long Wavelength LR (LWLR) band (8.0 to 14.0 microns).
  • SWIR Short Wavelength Infra- Red
  • MWLR Mid-Wavelength LR
  • LWLR Long Wavelength LR
  • the output of the each photosensitive photodiode detector is coupled to a charge storage device, such as a capacitor or CCD structure, and the charge is shifted from one charge storage device to the adjacent charge storage device in synchronism with the image velocity while charge is being integrated in the charge storage devices.
  • a charge storage device such as a capacitor or CCD structure
  • the process of roll motion compensation can be more finely tuned by deriving the rate of rotation (co) used in the algorithm from the actual inertial rate sensed by a fiber optic gyroscope mounted to the camera housing or frame.
  • a gyroscope can count with a resolution of 1 microradian or better.
  • the gyroscope generates a signal that is supplied to a DSP card in the camera control electronics module 402 ( Figure 17).
  • a signal could also be constructed for imaging array clocking purposes in the form of a pulse train which the imaging array clock generator could phase lock to.
  • the roll motion compensation becomes, in effect, a fine stabilization system which removes the residual error from the more coarse electro-mechanical stabilization system. Having a fine system, based on a closed loop feedback from the roll fiber optic gyroscope, would allow for a larger range of roll motion without image degradation.
  • the principles of roll framing and forward motion compensation described above are applicable to a camera that images in a single band of the electromagnetic spectrum.
  • the spectrum dividing prism would not been needed and the objective optical subassembly (Cassegrain or otherwise) would direct the radiation in the band of interest to a single optical path having a photo-sensitive image recording medium placed herein.
  • the spectrum dividing prism and second optical channel are not needed. Otherwise, the operation of the camera in roll framing and spot modes of operation would be the same as described above.
  • three or more detectors could image the three or more bands of the electromagnetic spectrum simultaneously.
  • an additional spectrum separating prism would be placed in either the visible or LR paths to further subdivide the incident radiation into the desired bands and direct such radiation into additional optical paths, each with its own photo-sensitive image recording medium.
  • the visible/near LR band could be divided into a sub 700 nanometer band and a 700 to 1000 nanometer band, each associated with a distinct optical path and associated image forming and focusing lenses and an image recording medium.
  • the IR portion of the spectrum could be similarly divided into two separate bands, such as SWLR, MWLR, and/or LWLR bands, and each band associated with a distinct optical path and associated image forming and focusing lenses and an image recording medium.
  • the arrangement of optical components in the camera housing will be different from the illustrated embodiment due to the additional spectrum dividing prisms, additional optical paths and optical components, and additional detectors.
  • persons skilled in the art will be able to make such a modification from the illustrated embodiment using routine skill.
  • the camera may be designed for hyperspectral imaging.
  • one of the optical paths may be devoted to visible spectrum imaging, while the other path is fitted with a spectroradiometer, an imaging spectrometer, or spectrograph to divide the incident radiation into a large number of sub-bands in the spectrum, such as 50 of such sub-bands.
  • Each sub-band of radiation in the scene is imaged by the hyperspectral imaging array.
  • the camera could be mounted transverse to the roll axis of the aircraft.
  • Such a camera could be used for dual spectrum, full framing imaging in a forward oblique mode, either in a spot mode of operation or in a mode in which overlapping frames of images are generated in a forward oblique orientation.
  • the smooth roll motion and roll motion compensation feature could be adapted to a step framing camera, such as the KS-127A camera or the step frame camera of the Lareau et al. patent, U.S. No. 5,688,593.
  • the roll motors are coupled to the step frame scan head assembly, and continuously rotate the scan head about the roll axis in a smooth, continuous fashion.
  • the detector array and associated relay and focusing optical elements remain stationary with respect to the aircraft.
  • the image acquired by the scan head assembly would need to be derotated with a pechan prism, K mirror or other suitable element, as described in the '593 patent.
  • Roll motion compensation would be performed electronically in the array, as described at length above.
  • the roll motors are coupled to the step frame scan head and continuously rotate the step frame scan head assembly, while the image derotation is achieved by rotation of the imaging array in synchronism with the rotation of the scan head assembly.
  • Roll motion compensation is achieved by transferring pixel information in the array at substantially the same rate as the rate of image motion due to scan head rotation.
  • the catoptric Cassegrain optical system is the preferred embodiment, refractive optical systems, catadioptric optical systems, and still other types of optical arrangements may be used, for example where only single spectrum imaging is performed, where space requirements are not so important, or when other considerations dictate that a different type of optical arrangement for the objective lens is suitable.
  • the optical subassembly comprising the objective lens would be rotated in the direction of flight to accomplish forward motion compensation as described above, while the entire camera housing including the objective lens is rotated about an axis to thereby generate sweeping coverage of the field of interest, either about the roll axis or about an axis perpendicular to the roll axis.

Abstract

An electro-optical roll-framing camera (36) is described in which successive overlapping frames of scene imagery (1-5) are generated by an electro-optical imaging array (300). Image motion compensation is performed electronically to stop or freeze image motion caused by the roll motion. The image motion compensation is performed by the array (64) during the generation of the frames of imagery (1-5). The successive frames of imagery (1-5) are made during a continuous roll motion of the entire camera. The image motion due to roll is stopped or frozen without mechanically stopping the roll motion. The roll framing cycles (1-5) of the camera generate sweeping coverage of the terrain of interest (42). The roll rate for a given electro-optical array (300) is a function of the frame size and the framing rate, and is controllable by a master control computer (34). A novel catoptric Cassegrain optical system (50) which performs forward motion compensation is also described.

Description

DUAL BAND FRAMING RECONNAISSANCE CAMERA WITH ROLL MOTION COMPENSATION
BACKGROUND OF THE INVENTION
A. Field of the Invention This invention relates generally to the field of aerial reconnaissance, remote sensing, mapping and surveillance camera systems. Generally speaking, aerial reconnaissance cameras are available in framing and pan scanning configurations, in both film and electro- optical implementations. The present invention relates to both types of camera configurations, in that a roll framing camera such as described herein generates individual frames of imagery, while the smooth rolling operation provides similar scene coverage and inertial load reductions found in pan scanning cameras.
B. Description of Related Art
In prior art framing cameras, an exposure is taken over a large scene of fixed format. The field of view of the camera is stepped across a large area using mechanically driven stepping hardware while using image motion compensation techniques to compensate for forward motion of the aircraft. The field of view of the camera is a function of lens focal length and the geometrical format size of the image recording media. The exposure time is generally controlled by a shutter and is a function of 1) the sensitivity of the photosensitive media, 2) lens transmittance and relative aperture, and 3) available scene brightness. The photosensitive material can be film, an area array Charge Coupled Device (CCD), or any other media which records an image for later retrieval.
Forward Motion Compensation (FMC) is a technique used in framing cameras to correct for the image motion on the recording media caused by forward motion of the aircraft during the exposure interval. This correction is generally introduced by moving the film or the lens to keep the image stationary in the fore/aft direction while the exposure is taking place. In a framing camera, the correction is usually accomplished by moving the film to match the rate of image motion. U.S. Patent No. 5,668,593 to Lareau et al., assigned to the assignee of the present invention, the contents of which hare incorporated by reference herein, describes a electro-optical step frame camera system in which the forward motion compensation is achieved electronically in the focal plane of the electro-optical detector.
One limitation of a conventional film or CCD framing camera is that only a single FMC rate can be applied to any given frame regardless of the field of view. Consequently, the motion can exactly be corrected for only a portion of the image. When exposure times are short and the field angles small, this is acceptable. However, for larger fields of view and where longer exposure times are required (as at dusk or under other low light level conditions), the differential rate of motion between the film and the image increases with the field angle and can be large enough result in image blur at the edges of the field. A major advance in forward motion compensation in electro-optical framing cameras is disclosed in the Lareau et al. patent, U.S. Pat. No. 5,155,597, assigned to the assignee of the present invention. The Lareau et al. '597 patent, which is incorporated by reference herein, describes an electro-optical imaging array that accomplishes FMC electronically and without moving parts by dividing the columns of the array into multiple column groups, and by transferring pixel information in the column groups at a rate that substantially matches the rates of image motion in the column groups.
Another operational function of a framing camera is the generation of an overlap between successive frames of imagery. The overlap is used to ensure complete coverage of all areas of the scene, and/or to provide a view of the scene from two different angular perspectives yielding stereo imagery. In a conventional framing camera, the amount of overlap is selectable and nearly always takes place in the direction of flight.
In step frame cameras, the overlap L(OL) of the two frames of imagery is typically of 10% or 12%, or as much as 56%. An overlap of at least 50% allows all imagery in the adjacent frames to be exposed from two different angular perspectives. These images can be recombined by means of a stereo viewing system to achieve depth perception. Such stereo images are often used by a photointerpreter to gather additional information about the scene.
The operation of a film-type framing camera in a stepping mode is known in the art. For example, the article entitled "The KS-146A LOROP Camera System", Thomas C. Augustyn, SPIE Proceedings Vol.9, Aug. 27-28 1981, paper 309-11 p.76, describes an automatic stepping mode in which the camera cycle rate is proportional to aircraft velocity, altitude and selected depression angle, to achieve 56% overlap for stereo viewing or 12% overlap for maximum flight line coverage. With the camera line of sight normal to the flight path, the scan head provides either 1, 2, 4, or 6 lateral-step cycles. A similar stepping operation for a frame camera is described in the article entitled "KS-127A Long Range Oblique Reconnaissance Camera for RF-4 Aircraft", Richard C. Ruck and Oliver J. Smith, SPIE Proceedings Vol. 242, Jul. 29-30, 1980 San Diego Paper 242-02, p.22.
Panoramic (pan) camera technology is another well-established means of imaging. In a panoramic scanning camera, the scene is exposed continuously by rotating a scanning mechanism (such as a double dove prism) so as to scan the image across the photosensitive medium . The photosensitive medium is moved in synchronism with the image. In the case of a film camera, this may be accomplished by moving the film at a constant rate past an exposure slit which is located on the lens optical axis. A scan prism located in front of the lens is rotated in synchronism with the film rate such that the image of the scene remains stationary on the film during the exposure period. The slit opening is adjusted to a predetermined width to control exposure time.
One major advantage of a pan camera is its ability to image a large area in the direction across the line of flight. Scan angles across the line of flight on the order of 120 to over 180 degrees are typical. The lens field of view in a pan camera is generally only required to be large enough to cover the width of the film. Overlapping of images and stereo imagery may also be obtained with pan cameras. Image overlap in a conventional fixed mounted pan camera is obtained as in the case of a framing camera, that is, in the common area between successive scans. FMC for both the film and electro-optical versions of the pan camera is usually accomplished by a conventional electro-mechanical means. Translating the lens during the scan is a popular means to achieve graded FMC as a function of instantaneous slant range to the scene. As noted above, the FMC can be done electronically as taught in the Lareau et al. US Patent 5,668,593. Prior art mechanically stepped framing panoramic cameras, such as described in the
'593 patent and in the KS-146A camera are limited in size and the stepping rate by the mass and commensurate inertial loading created by trying to step that mass across the area of interest. Since the size and mass of the camera increases with operation in multiple spectral bands (i.e., with two or more detectors incorporated into the camera), the capability of mechanically stepped cameras is limited to smaller and more limited camera configurations. Thus, there exists a need in the art for an electro-optical camera which obtains broad area coverage in the manner of a panning or step framing camera without the above limitations. The present invention meets that need by providing a novel roll framing technique for generating broad area coverage with an area array image recording medium, described in more detail herein. The image motion due to camera roll is compensated for electronically in the detector array. The invention is also particularly suitable for larger, more massive, and more complex cameras, including a camera which carries two or more imaging detectors in order to generate frames of imagery in two or more different bands of the electromagnetic spectrum simultaneously.
SUMMARY OF THE INVENTION
The present invention provides the capability for collection of imagery using a framing camera in which a continuous scan motion about the roll axis of the aerial reconnaissance vehicle is performed, a technique referred to herein as "roll framing". As the camera rototes about the roll axis in a continuous fashion, the roll motion is compensated for electronically. This enables high resolution imagery to be generated without loss of resolution or blur, due to the fact that relative motion of the image with respect to the image recording media caused by the roll motion is compensated for using the techniques described herein. The continuous roll motion of the camera facilitates image collection without large inertial accelerations and decelerations or large power spikes, as are found in prior art step frame camera system when the camera mass is physically stepped across the terrain of interest in a series of start and stop movements. The present invention is believed superior to prior art step framing cameras since the problems inherent with mechanical stepping are eliminated. The camera and method are applicable to all sizes and arrangements of cameras, including cameras implementing single spectrum, multi-spectrum and hyperspectral optical systems. The invention is also applicable to cameras with mechanical shutters, electronic shutters, acoustical/optical switches, and other electronic exposure controls.
Thus, in a first aspect of the invention, a method is provided for imaging a scene with a framing camera installed in an aerial reconnaissance vehicle. The camera comprises a two dimensional array of photosensitive cells, an optical system directing scene radiation onto said array, and a mechanism for rolling the camera about a rotation axis. The array of cells store pixel information and is arranged in a plurality of rows and columns. The method comprises the steps of : (a) continuously rotating the camera about the rotation axis with the roll mechanism to thereby direct scene information onto the two dimensional array; (b) exposing the array while the camera is rotating and transferring pixel information in the array at a rate substantially equal to an image motion rate due to the rotation of the camera;
(c) reading out the pixel information from the array; and (d) repeating said steps (b), and (c) while the vehicle flies past a scene of interest and while the camera continuously rotates about the roll axis, thus generating a series of frames of imagery.
In a preferred embodiment, the camera is mounted to the aerial reconnaissance vehicle such that the step of continuously rotating comprises the step of rotating said camera about an axis substantially parallel to the direction of forward motion of the reconnaissance vehicle. However, the camera could also be mounted in an orthogonal configuration such that the step of continuously rotating comprises the step of rotating the camera about an axis in a direction substantially orthogonal to the direction of forward motion of said aerial reconnaissance vehicle. In this less preferred embodiment, the camera could roll essentially about the pitch axis and generate a series of images in the forward oblique direction towards nadir.
In a typical embodiment, the steps (a), (b), (c), and (d) recited above are performed in a a series of cycles as the aircraft flies past a scene of interest. The frames overlap one another so as to avoid gaps in scene coverage. If the overlap is sufficient, it would be possible to obtain stereo imagery of the scene of interest.
The camera can be configured with just a single detector and generate imagery in a single band of the electro-magnetic spectrum. Alternatively, the camera includes a second electro-optical detector and the camera generates imagery in two bands of the electromagnetic spectrum simultaneously from the first and second detectors. The preferred embodiment described in detail herein is an example of a dual band imaging system. As yet another alternative embodiment, the camera includes an electro-optical detector and optical system for generating imagery in a pan-chromatic spectral band, such as a hyperspectral electro- optical imaging array.
In another aspect of the invention, an electro-optical roll framing camera with electronic roll motion compensation is provided. The camera is adapted for installation in an aerial reconnaissance vehicle. The camera comprises an electro-optical detector comprising a two-dimensional array of photosensitive cells that store pixel information. The array is arranged in a plurality of rows and columns and has at least one readout register for reading out pixel information from the array. The camera further includes an optical system directing scene radiation onto the array. A servo-mechanical system is provide which couples the camera to the aerial reconnaissance vehicle which is adapted or configured for continuously rolling the camera about a rotation axis to thereby direct scene infoπnation onto the optical system and array. Further, roll motion compensation circuitry is provided for electronically transferring pixel information in the array of photosensitive cells at a rate substantially matching the rate of image motion due to the rotation of the camera, whereby the resolution of images generated by said array may be preserved.
In the illustrated embodiment, the servo-mechanical subsystem includes a first motor system coupled to the camera housing that rotates the camera housing (including the optical system as recited above) about a first axis. The camera housing is preferably installed in the aerial reconnaissance vehicle such that this first axis of rotation is parallel to the roll axis of the aerial reconnaissance vehicle (referred to herein for simplicity as "the roll axis"). The image recording media are exposed to the scene to generate frames of imagery as the first motor system rotates the camera housing in a continuous fashion about the roll axis. The first and second image recording media have a means for compensating for image motion due to the rotation of the camera housing. In an electro-optical embodiment of the image recording media, the roll motion compensation means is preferably comprised of electronic circuitry for clocking or transferring pixel information through the electro-optical detectors at a uniform rate substantially equal to the rate of image motion due to camera rotation. A method of calculating the image motion rate, and thus pixel information transfer rate, due to roll of the camera housing is disclosed herein. If a film camera is used for the image recording media, a mechanical system is used to move the film at a rate substantially equal to the image motion rate. In the preferred embodiment, the servo-mechanical subsystem also includes a second motor system coupled to a catoptric Cassegrain optical system. The second motor system rotates the Cassegrain optical system about a second axis in the direction of forward motion of the reconnaissance vehicle to compensate for forward motion of the aerial reconnaissance vehicle. The action of the first motor assembly to rotate the entire camera housing about the roll axis occurs at the same time (i.e., simultaneously with) the action of the second motor system to rotate the Cassegrain optical system in the line of flight to accomplish forward motion compensation. The net effect of the action of the second motor system and the roll motion compensation system is that the image of the scene of interest is essentially frozen in the focal plane while the image recording media obtain the frames of imagery, allowing high resolution images of the scene to be obtained.
In a preferred embodiment, the camera is a dual band framing camera, and there are first and second image recording media each comprising two dimensional area array electro- optical detectors. One may be manufactured from materials sensitive to radiation in the visible portion of the electromagnetic spectrum, and in a preferred embodiment is a charge- coupled device (CCD) detector of say 5,000 X 5,000 or 9,000 X 9,000 pixels. The other of the electro-optical detectors is made from a material sensitive to radiation in the infrared portion of the electromagnetic spectrum, and may be a platinum suicide array of photo diode detectors or other suitable type of electro-optical detector suitable for IR detection. The detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is preferably sensitive to radiation having a wavelength of between 3.0 and 5.0 microns (MWIR), or from about 8.0 to about 14.0 microns (LWTR). In either of the embodiment of electro-optical detectors, they will typically comprise an array of pixel elements arranged in a plurality of rows and columns. The means for compensation for roll motion of the camera housing comprises electronic circuitry for transferring pixel information in the electro-optical detectors from row to adjacent row at a pixel information transfer rate (uniform across the array) substantially equal to the rate of image motion in the plane of the electro-optical detectors due to roll of the camera housing. Thus, the roll motion compensation can be performed electronically on-chip.
As a further possible embodiment, electro-optical detectors with the capability for transferring pixel information in both row and column directions independently, such as described in Lareau et al., U.S. Patent No. 5,798,786, could be used for the image recording media. Forward motion compensation and roll motion compensation could be performed on- chip in the detectors.
The present invention required the solution to several difficult technical challenges, including optical, servo-mechanical and operational difficulties. For an electro-optical framing LOROP camera to operate in a continous sweep with a framing array with at least two discrete bands of the electromagnetic spectrum at the same time, the challenge is to accurately compensate for the roll motion electronically at a focal plane detector with (1) good image quality and satisfactory modulation transfer function, (2) while minimizing inertial loading, and (3) enabling the use of a relatively large two-dimensional area array as a focal plane detector to get an adequate field of view and resolution. In accordance with one aspect of the invention, these optical challenges were solved by an on-chip roll motion compensation described in more detail herein.
The inventive multi-band LOROP/Tactical camera using electronic roll motion compensation does not lend itself to the use of servo-mechanical systems developed for prior art LOROP systems, particularly those used in prior art step frame cameras (such as described in the Lareau et al. '593 patent). The prior art step frame cameras use a stepping mirror to step across the line of flight and direct radiation onto the array, and require a de-rotation mechanism, such as a Pechan prism, to de-rotate the images. The standard solution of stepping the entire LOROP camera system or even a large scan mirror assembly at the operational frame rate are not acceptable alternatives for large LOROP cameras, and in particular large dual band systems. In particular, the applications of the present invention are flexible enough to include both strategic and tactical aircraft, as well as the new breed of aircraft being used by the military for reconnaissance known as unmanned aerial vehicles (including low observables). The diversity of these applications posed a power and stability problem that prevents application of prior art solutions. The task of stepping a 400 lb. camera mass two to four times a second creates tremendous inertial loads as well as power spikes that would be unacceptable. Even the inertia and associated settling times of a stepped scan head assembly pose problems in some applications.
This servo-mechanical situation required a unique inventive solution, described in detail herein. The solution, as provided in one aspect of the present invention, was to (1) rotate the entire camera (including the entire optical system and the image recording media) smoothly in a continuous fashion about an axis parallel to the aircraft roll axis, similar to the pan-type movement, but without the starts and stops used in a traditional step-frame camera system, and (2) operating the camera as a framing camera while the camera undergoes the smooth rotation. Frames of imagery are thus taken while the camera smoothly rotates about the roll axis at a constant angular velocity. In addition to this novel "roll-framing" technique, the present invention also electronically compensates for, i.e., stops, the image motion due to roll while the camera is scanning in a smooth motion. Meanwhile, a novel forward motion compensation technique is performed by the Cassegrain optical assembly to cancel out image motion effects due to the forward motion of the aircraft. The result enables exposures of the image recording media to the scene while compensating for roll and forward motion, enabling high-resolution images to be obtained.
The present invention thus solves the difficult optical, servo-mechanical and operational problems and provides a dual band framing electro-optical LOROP camera that delivers a performance and technical capability that has never before been achieved. In particular, it provides a system by which high-resolution frames of imagery in two different portions of the electromagnetic spectrum can be generated simultaneously. The inventive camera can be used in a quasi-stepping mode, in which overlapping frames of imagery are obtained across the line of flight. It can also be used in a spot mode, in which the camera is oriented in a particular direction to take an image of a target expected to be in the field of view.
Many of the teachings of the present invention are particularly applicable to a dual band electro-optical framing reconnaissance camera, and such a camera is the preferred embodiment. However, as explained below, some of the techniques and methods of the subject camera system, such as the roll-framing operation and unique roll and forward motion compensation techniques, are applicable to a camera system that images terrain in only one portion of the electromagnetic spectrum. Thus, in an alternative embodiment the camera is basically as set forth as described above, except that only a single detector is used and a spectrum-dividing prism and second optical path are not needed. Furthermore, while a preferred embodiment uses a two-dimensional electro-optical imaging array for the detector in each of the bands of the electromagnetic spectrum, the inventive camera system can be adapted to use film or other types of detectors for the photosensitive recording medium. In the film camera embodiment, roll motion compensation could be performed by moving the film in a manner such that the film velocity substantially matches the image velocity due to camera roll.
In a second aspect, a dual-band framing aerial reconnaissance camera for installation in an aerial reconnaissance vehicle has been invented. The camera includes an optical system incorporated into a camera housing. The optical system comprises an objective optical subassembly that receives incident radiation from a scene external of the vehicle. Radiation from the scene is reflected from the objective optical subassembly to a spectrum-dividing prism. The prism directs radiation in a first band of the electromagnetic spectrum, such as visible and near IR, into a first optical path and directs radiation in a second band of the electromagnetic spectrum, such as midwavelength IR or long wavelength IR, into a second optical path different from the first optical path. The first optical path includes suitable image forming and focusing lenses and a first two-dimensional image-recording medium for generating frames of imagery in the first band of the electromagnetic spectrum. The second optical path also includes suitable image forming and focusing lenses and a second two- dimensional image-recording medium generating frames of imagery in the second band of the electromagnetic spectrum. The camera further includes a servo-mechanical subsystem including the first and second motor systems as described above. In a preferred embodiment, the first and second image recording media comprise two dimensional area array electro-optical detectors. One may be manufactured from materials sensitive to radiation in the visible and near-LR portion of the electromagnetic spectrum, and in a preferred embodiment is a charge-coupled device (CCD) detector of say 5,000 X 5,000 pixels. The other of the electro-optical detectors is made from a material sensitive to radiation in the infrared portion of the electromagnetic spectrum, and may be a platinum silicide array of photo diode detectors or other suitable type of electro-optical detector suitable for IR detection. The reader is directed to U.S. Patent 5,925,883 to Woolaway, III, the contents of which are incorporated by reference herein, for a description of an IR detector. The detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is preferably sensitive to radiation having a wavelength of between 1.0 and 2.0 microns (SWIR), 3.0 and 5.0 microns (MWIR), or from about 8.0 to about 14.0 microns (LWTR). In either of the embodiment of electro-optical detectors, they will typically comprise an array of pixel elements arranged in a plurality of rows and columns. The means for compensation for roll motion of the camera housing comprises electronic circuitry for transferring pixel information in the electro-optical detectors from row to adjacent row at a pixel information transfer rate (uniform across the array) substantially equal to the rate of image motion in the plane of the electro-optical detectors due to roll of the camera housing. The transfer of pixel information occurs while the pixel elements are integrating charge representing scene information. Thus, the roll motion compensation can be performed electronically on-chip. As a further possible embodiment, electro-optical detectors with the capability for transferring pixel information in both row and column directions independently, such as described in Lareau et al., U.S. Patent No. 5,798,786, could be used for the image recording media. Forward motion compensation and roll motion compensation could be performed on-chip in the detectors.
As noted above, the present invention required the solution to several difficult technical challenges, including optical, servo-mechanical and operational difficulties. For an electro-optical framing LOROP (Long Range Oblique Photography) camera to operate in at least two discrete bands of the electromagnetic spectrum at the same time, the optical challenge is to focus panchromatic energy (e.g. visible through IR) on a focal plane detector with (1) good image quality and satisfactory modulation transfer function, (2) while baffling stray energy, (3) meeting space constraints, and (4) enabling the use of a relatively large two- dimensional area array as a focal plane detector to get an adequate field of view and resolution. In accordance with one aspect of the invention, these optical challenges were solved by a unique catoptric Cassegrain objective optical subassembly incorporating an azimuth mirror and utilizing separate field optics for each band of the spectrum, described in more detail herein.
In still another aspect of the invention, a method is provided for generating a frame of imagery of a scene of interest with a camera while compensating for forward motion of a reconnaissance aircraft. The camera includes a Cassegrain objective optical subassembly having a primary mirror, a secondary mirror fixedly mounted relative to the primary mirror, and a flat azimuth mirror positioned in the optical path between the primary mirror and the secondary mirror. The camera also includes at least one framing image recording medium, such as a two dimensional electro-optical detector. The Cassegrain optical subassembly and framing image recording medium are incorporated into a camera housing mounted to the vehicle, with the camera housing defining an axis. The method comprises the steps of:
(1) orienting, e.g., installing, the camera housing such that the camera housing is substantially parallel to the roll axis of the aircraft;
(2) rotating the primary mirror and secondary mirror about an axis orthogonal to the roll axis in the direction of flight of the aircraft, while maintaining the image recording medium in a fixed condition relative to the camera housing; and
(3) while rotating the primary mirror and secondary mirror as recited in step (2), rotating the azimuth mirror in the direction of flight at a rate one half the rate of rotation in step (2). The azimuth mirror is rotated about an axis coincident with the axis about which the primary and secondary mirrors are rotated. In the illustrated embodiment, the azimuth mirror is located substantially at the center of the primary mirror.
In the illustrated embodiment, the method is performed in a camera implementing a roll-framing technique for generating sequential images of a terrain of interest. In this technique, the camera housing, including the objective lens subassembly and the framing image recording media, is continuously rotated about a roll axis.
The invention can be practiced in conjunction with single band, dual band or hyperspectral imaging implementations. The illustrated embodiment is a dual band system in which the camera includes first and second electro-optical detectors and first and second optical paths for different portions of the electromagnetic spectrum. The detectors generating frames of imagery of the scene of interest in two different portions of the electro-magnetic spectrum simultaneously.
In yet another aspect of the invention, a dual band optical system for a framing aerial reconnaissance camera is described, wherein the camera includes at least two two- dimensional image recording media for generating frames of imagery of a scene external of an aerial reconnaissance vehicle carrying the camera. The optical system comprises a Cassegrain objective optical subsystem forming an objective lens for the optical system. The Cassegrain optical system receives incident radiation from the scene and comprises a primary mirror having a central aperture and a secondary mirror, the primary and secondary mirrors aligned along an objective optical axis.
An azimuth mirror is provided which receives radiation from the secondary mirror. The azimuth mirror is placed in front of the central aperture of the primary mirror and directs radiation in a direction away from the objective optical axis. A spectrum dividing element receives radiation from the azimuth mirror. This element directs radiation in a first band of the electromagnetic spectrum into a first optical path and directs radiation in a second band of the electromagnetic spectrum into a second optical path different from the first optical path. The first two-dimensional image recording medium is placed in the first optical path and a second two-dimensional image recording medium is placed in the second optical path. The first and second image recording media generate first and second frames of imagery in two different portions of the electromagnetic spectrum simultaneously.
The aerial reconnaissance vehicle defines a roll axis. In the illustrated embodiment the first and second paths are oriented and extend for a spatial extent generally in the direction of the roll axis, and the objective optical axis is substantially orthogonal to the roll axis, whereby the dual band optical system provides a compact arrangement the camera.
The camera further includes a servo-mechanical subsystem. This subsystem includes a first motor system coupled to the camera housing that rotates the entire camera housing (including the optical system as recited above) about a first axis. The camera housing is installed in the aerial reconnaissance vehicle such that this first axis of rotation is parallel to the roll axis of the aerial reconnaissance vehicle (referred to herein for simplicity as "the roll axis"). The image recording media are exposed to the scene to generate frames of imagery as the first motor system rotates the camera housing in a continuous fashion about the roll axis. The first and second image recording media have a means for compensating for image motion due to the rotation of the camera housing. In an electro-optical embodiment of the image recording media, the roll motion compensation means is preferably comprised of electronic circuitry for clocking or transferring pixel information through the electro-optical detectors at a uniform rate substantially equal to the rate of image motion due to camera rotation. A method of calculating the image motion rate, and thus pixel information transfer rate, due to roll of the camera housing is disclosed herein. If a film camera is used for the image recording media, a mechanical system is used to move the film at a rate substantially equal to the image motion rate.
The servo-mechanical subsystem also includes a second motor system coupled to the objective optical subassembly. In the illustrated embodiment, the objective optical subassembly comprises a catoptric Cassegrain optical system. The second motor system rotates the Cassegrain optical system about a second axis in the direction of forward motion of the reconnaissance vehicle to compensate for the forward motion of the aerial reconnaissance vehicle. The action of the first motor assembly to rotate the entire camera housing about the roll axis occurs at the same time (i.e., simultaneously with) the action of the second motor system to rotate the Cassegrain optical system in the line of flight to accomplish forward motion compensation. The net effect of the action of the Cassegrain motor system and the roll motion compensation system is that the image of the scene of interest is essentially frozen relative to the focal plane of the image recording media while the media obtain the frames of imagery, allowing high resolution images of the scene in two different bands of the spectrum to be obtained simultaneously. Furthermore, the rotation of the image scene caused by the roll motion of the objective subassembly is simultaneously detrotated by the roll motion of the rest of the camera, in view of the fact that the entire camera assembly is rolled as a unit, thereby eliminating the need for a separate derotation mechanism such as a pechan prism. Other types of optical arrangements for the objective optical subassembly are possible, but are less preferred. The operation of the camera with the different type of objective subassembly is the same. While the foregoing summary has described some of the highlights of the inventive camera system, further details on these and other features will be described in the following detailed description of a presently preferred embodiment of the invention. BRIEF DESCRIPTION OF THE DRAWINGS
Presently preferred embodiments of the invention will be discussed below in conjunction with the appended drawing figures, wherein like reference numerals refer to like elements in the various views, and wherein: Figure 1 is a perspective view of an aircraft flying over a terrain of interest with a camera in accordance with the preferred embodiment operating to generate frames of imagery of the terrain in two bands of the electromagnetic spectrum simultaneously.
Figure 2 is a schematic representation of the aircraft of Figure 1 taking a series of 5 frames of images in a series of cycles while flying past the terrain of interest; Figures 2A and 2B are perspective view of the camera system of Figure 1, shown isolated from the rest of the aircraft, and with protective covers removed in order to better illustrate the components of the camera;
Figure 2C is a perspective view of the camera of Figures 2 A and 2B, with the protective covers installed, and showing the entrance aperture for the catoptric Cassegrain optical system;
Figure 3 is a top plan view of a presently preferred embodiment of the dual band framing reconnaissance camera system of Figures 2A-2C, with the covers removed;
Figure 4 is a cross-sectional view of the camera system of Figure 3, taken along the lines 4-4 of Figure 3; Figure 4A is a simplified ray diagram of the optical system of Figure 3 and 4;
Figures 4B and C are more detailed cross-sectional views of the optical elements in the visible and MWLR paths of Figures 4 and 4A;
Figure 5 is an end view of the camera system of Figure 3-4, shown from the right- hand end of the camera housing and with the roll motor and cover plate at that end removed in order to better illustrate the other structures in the camera;
Figure 6 is a perspective view of the assembly of the Cassegrain subsystem, showing in better detail the structure that retains the Cassegrain primary mirror and showing the secondary mirror, azimuth mirror, Cassegrain motor assembly and azimuth 2-1 drive assembly in greater detail. The primary mirror itself is removed from Figure 6 in order to better illustrate the components of the Cassegrain optical system.
Figure 7 is another perspective view of the Cassegrain primary mirror retaining assembly of Figure 6; Figure 8 is another perspective view of the Cassegrain primary mirror retaining assembly as seen generally from the rear, shown partially in section;
Figure 9 is a top view of the Cassegrain optical system of Figure 6;
Figure 10 is a cross-sectional view of the Cassegrain optical system of Figure 6, taken along the line 10- 10 of Figure 9 ;
Figure 11 is a detailed sectional view of the azimuth mirror 2-1 drive assembly that rotates the azimuth mirror at one half the rate of rotation of the entire Cassegrain optical subsystem;
Figure 12 is a detailed perspective view of one of the roll motor assemblies of Figure 2, showing the L shaped brackets that mount to the stator of the motor and rigidly couple the roll motor to the pod or aircraft;
Figure 13 is an elevational view of the roll motor of Figure 12;
Figure 14 is a cross-sectional view of the roll motor of Figure 14;
Figure 15 is a detailed illustration of a portion of the roll motor of Figure 14; Figure 16A is a ray diagram of the visible path in the embodiment of Figure 4;
Figure 16B is a ray diagram of the MWIR path in the embodiment of Figure 4;
Figure 16C is a graph of the visible path diffraction modulation transfer function;
Figure 17 is a block diagram of the electronics for the camera system of Figures 2-5;
Figure 18 is schematic representation on an image recording medium in the form of a two dimensional electro-optical array, showing the image motion in the array due to the roll of the camera; and
Figure 19 is another schematic representation of the array of Figure 18, showing the electronic circuitry that controls the transfer of pixel information in the array at the same velocity as the image in order to provide roll motion compensation.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT Overview and Method of Operation;
Referring now to Figure 1, an aerial reconnaissance camera system 20 in accordance with a preferred embodiment of the invention is shown installed in a reconnaissance aircraft 22 flying over a terrain of interest 42 at an altitude H and with forward velocity V, moving in a direction of flight FL. The aerial reconnaissance camera system 20 includes a camera 36, shown in greater detail in Figures 2A-2C and 3-5, a camera control computer 34 and associated electronics described in further detail in Figures 17 and 19. The camera control computer receives certain navigational information from the aircraft avionics system 24, including current aircraft velocity and height data. Additional camera system inputs may come from a console 28 in the cockpit, such as start and stop commands or camera depression (roll angle) settings.
The aircraft body defines a roll axis R, a pitch axis PI and a yaw axis Y passing through the center of gravity CG of the aircraft. The camera 36 is shown orientated at a camera depression angle δ relative to a bilateral plane BP that is horizontal during level flight. In the illustrated embodiment, the line of sight LOS of the camera 36 is nominally orthogonal to the roll axis in a side oblique or nadir orientation.
The preferred embodiment of the subject camera system 20 operates like a step-frame electro-optic (E-O) sensor, capable of taking a sequence of overlapped frames in the cross- track, i.e., cross-line of flight, direction. This is shown in Figure 2. As the aircraft flies by the terrain of interest, the camera is rotated about the roll axis in a continuous fashion (i.e., without starts and stops between frames), with frames of imagery taken at different depression (roll) angles, e.g., angles δl, δ2, δ3, δ4 and δ5, resulting in frames 1, 2, 3, 4 and 5. A nominal rate of rotation about the roll axis is used (based on focal length, array frame size and framing rate, such as 8-10 degrees per second, but the roll rate is adjustable by the camera control computer. When the fifth frame of imagery is obtained and the camera rolled to its roll limit position (either pre-set or commanded by the operator), the camera rotates back, i.e., retraces, to its initial roll position (δl), and the second cycle of frames of imagery is obtained (IA, 2A, 3 A, 4A, 5 A). The process repeats for a third and subsequent cycles of operation. The cross-track framing sequence 1, 2, 3, 4, 5; IA, 2A, 3A, 4A, 5A; etc. (which is
V/H dependent) can be made in either spectrum individually or in both spectrums simultaneously, dependent on the time of day and the purpose of the reconnaissance mission. As noted in Figure 2, the roll action of the camera can encompass both sides of nadir, for example with frames 1-4 obtained at one side of nadir and frame 5 obtained at the other side of nadir. The camera can also be used in a spot mode, in which the camera is rotated to a particular depression angle and frames of imagery obtained of the scene of interest. The number of frames per cycle of roll, N, can thus vary from 1 to say 5 or 10 or until horizon to horizon coverage is obtained.
Figure 2A shows the camera 36 in a perspective view as seen from below, with a set of protective cover plates removed in order to better illustrate the structure of the camera. Figure 2B is another perspective view, shown from above, and Figure 2C is a perspective view of the camera 36 with the cover plates 33 installed, showing the entrance pupil 35 for the camera. Referring now to Figures 3-5, the camera 36 per se is shown in top, sectional and end views, respectively. In the end view of Figure 5, a rear support plate 41 and a roll motor 70A are removed in order to better illustrate the rest of the camera 36.
As shown best in Figure 3, the camera 36 mounts to the reconnaissance pod or airframe of the aerial reconnaissance vehicle via four mounting brackets 39, each connected to the pod or airframe via passive shock isolation mounts in conventional fashion. The mounting brackets 39 are bolted to the sides of the stator of the roll motor assemblies 70A and 70B as shown in Figure 12 and described below. The entire camera cylinder comprising all the components between the two support plates 41 and 41A can rotate relative to the roll axis 37 while the stator of the roll motors 70A and 70B and mounting brackets 39 remain in a fixed position relative to the aerial reconnaissance vehicle.
The basic configuration of the camera 36 is a cylinder, as perhaps best illustrated in Figure 2C, which in the illustrated embodiment is approximately 20 inches in diameter and 48 inches in length. The camera 36 is installed in an aircraft reconnaissance pod via the mounting brackets 39 such that the cylinder axis 37 is oriented nominally parallel to the flight direction of the aircraft, i.e., the roll axis of the aircraft. The fore/aft orientation of the camera can be either way. Additionally, the camera 36 can be installed such that it is oriented perpendicular to the line of flight.
A typical use of the camera is to take overlapping frames of images in the cross-track direction as the aircraft flies over the scene of interest as shown in Figure 2, similar in concept to the step frame operation described in the prior art patent of Lareau, et al. U.S. Patent No. 5,668,593 and earlier step frame film cameras. However, the manner in which the camera achieves this result is very different from that taught in the prior art. Whereas in the Lareau '593 patent, a stepping mirror is rotated in discrete steps to image the terrain, and forward motion compensation is performed in the array itself electronically, in the preferred embodiment of the present invention the entire camera 36 is rotated at a constant angular velocity, and in a continuous fashion, about the roll axis 37. The roll rate is determined by the optical system focal length, frame size, frame rate and the desired cross-track overlap (typically 5%) between consecutive frames. Moreover, forward motion compensation is achieved by means of rotation of the Cassegrain optical system about an axis 75, as described below, not in the array.
Referring to Figures 3 and 4, the camera includes an optical system 50 which is incorporated into (i.e., mounted to) a camera housing or superstructure 52. The optical system 50 in the preferred embodiment comprises a novel catoptric Cassegrain objective optical subassembly 54 which receives incident radiation from a scene external of the vehicle. Figure 4A shows a simplified ray diagram for the optical system 50. The Cassegrain objective optical subassembly includes a primary mirror 80, a secondary mirror 82 and a flat azimuth mirror 84. The secondary mirror 82 is centrally located in the entrance aperture of the Cassegrain optical system. Radiation from the scene is reflected from the Cassegrain objective subassembly 54 to a spectrum-dividing prism 56. The prism 56 directs radiation in a first band of the electromagnetic spectrum, such as visible and near LR, into a first optical path 58 and directs radiation in a second band of the electromagnetic spectrum, such as mid- wavelength IR or long wavelength IR, into a second optical path 60 different from the first optical path. The first optical path 58 includes suitable image forming and focusing lenses 62 and a first two-dimensional image recording medium 64 for generating frames of imagery in the first band of the electromagnetic spectrum. The second optical path 60 includes a fold prism 61, suitable image forming and focusing lenses 66 and a second two-dimensional image recording medium 68 which generates frames of imagery in the second band of the electromagnetic spectrum.
The camera further includes a novel servo-mechanical subsystem. This subsystem includes a first motor system 70A and 70B coupled to the camera housing 52 that rotates the camera housing 52 (including the optical system 50 as recited above) about the roll axis 37. The image recording media 64 and 68 are exposed to the scene to generate frames of imagery as the first motor system 70A and 70B rotates the camera housing 52 in a continuous fashion about the roll axis 37. The first and second image recording media have a means for compensating for image motion due to the rotation of the camera housing. In an electro- optical embodiment of the image recording media, the roll motion compensation means is preferably comprised of electronic circuitry for clocking or transferring pixel information through the electro-optical detectors at a uniform rate substantially equal to the rate of image motion due to camera rotation. A method of calculating the image motion rate, and thus pixel information transfer rate, due to roll of the camera housing is described below. If a film camera is used for the image recording media, a mechanical system is used to move the film at a rate substantially equal to the image motion rate. Film drive mechanisms for moving film for purposes of motion compensation are known in the art and can be adapted for a film framing camera for purposes of roll motion compensation by persons skilled in the art.
The servo-mechanical subsystem also includes a second motor system 74, shown best in Figure 3, 5 and 6, coupled to the front end of the Cassegrain optical system 54. The second motor system 74 rotates the Cassegrain objective subassembly 54, including the primary, secondary and azimuth mirrors, about a second axis 75 in the direction of forward motion of the reconnaissance vehicle in a manner to compensate for forward motion of the aerial reconnaissance vehicle. In the illustrated embodiment, the azimuth mirror 84 is rotated about the axis 75 at one half the rate of rotation of the Cassegrain primary and secondary mirrors 80 and 82 in the direction of forward motion. The action of the first motor assembly 70A and 70B to rotate the entire camera housing about the roll axis occurs at the same time (i.e., simultaneously with) the action of the second motor system 74 to rotate the Cassegrain optical system 80, 82 and 84 in the line of flight to accomplish forward motion compensation. The net effect of the action of the Cassegrain motor system 74 and the roll motion compensation technique is that the image of the scene of interest is essentially frozen relative to the focal plane of the image recording media while the image recording media obtain the frames of imagery, allowing high resolution images of the scene in two different bands of the spectrum to be obtained simultaneously. During operation, as the entire camera 36 rotates by action of the roll motors 70A and
70B, exposure of the detectors 64 and 68 at the two focal planes is made. In the illustrated embodiment, in the visible spectrum path 58 the exposure is executed by means of a mechanical focal plane shutter 88 which opens to allow incident photons to impinge on a two-dimensional charge-coupled device E-O detector array 64. In the MWTR path 60, exposure is executed by electronic switching (on/off) of IR-sensitive photocells arranged in a two-dimensional array 68, basically by dumping charge accumulating prior to the initiation of exposure and then accumulating and storing charge when the exposure period commences. However, any method of exposure control will work with this roll-framing camera. When the initial exposure is complete, the data is read out from the two focal plane detectors 64 and 68 and they are placed in condition for a second exposure. The rotation of the entire camera assembly about the roll axis 37 continues smoothly (that is, without starting and stopping as for example found in a prior art step frame camera system). When the next exposure is ready to be taken, i.e., when depression angle δ2 of Figure 2 has been reached, the shutter is opened in the visible/near IR path; similarly, in the MWTR path the charge dumping ceases and charge is accumulated. The data is then read out of the two focal plane sensors after the exposure period is over. Meanwhile, the rotation of the entire camera system about the roll axis continues without interruption and a third and subsequent exposure of both cameras is taken if time permits The process continues until the angular limits of the framing cycle has been reached, at which time the roll motors 70A and 70B retrace their angular rotation and return to their original angular position. The process then repeats for a new cycle of framing, as indicated in Figure 2.
The camera system roll rate (the cylinder angular velocity), ω, is established as follows. First, determine the cross-track field of view per frame, Φ, according to equation (1):
(1) Φ = 2 ARCTAN (W/2 ), where
W = detector array size in the cross-track direction; and
/ = lens focal length (i.e, the focal length of the overall aggregate of optical components in the particular band of interest, e.g., the visible band).
Then, the cylinder angular velocity ω is computed according to equation (2):
(2) ω = Φ (FR) (1 -OLc), where
FR = system frame rate (frames per second)
OLc = overlap between consecutive cross-track frames (expressed as a decimal). Note that the cylinder angular velocity ω is independent of the aircraft's velocity and height above the earth. Typical angular rotations between the successive exposures of the array will be less than 10 degrees.
Since the focal plane detectors are rotating about the roll axis during the exposure period, the scene image is translating across each of the detector arrays in the cross-track direction at a fixed velocity v =/ω. The image motion due to camera roll is constant and uniform across the array. To compensate for this image motion, and thereby preserve resolution, this image motion is synchronized with the velocity at which charge representing scene information is transferred within the detector arrays, thus eliminating relative motion between the image and the pixels imaging the scene and thus eliminating the image smear that would otherwise take place at the detector. In other words, pixel information in the entire array is transferred in the direction of image motion from row to adjacent row at a rate that substantially matches the image velocity v. At the end of the exposure period (typically 0.0005 to 0.020 seconds), the cylinder continues rotating to the next scene position while the collected scene signals are read-out of the detector array(s). Note that there is no rotational start and stop between exposures, as found in prior art step frame camera systems, thereby avoiding the servo loop settling times, load current surges, and power spikes produced by mechanical stepping systems as noted earlier.
In this "roll-framing" type of operation, the two focal plane detectors 64 and 68 operate in the above manner, taking N consecutive cross-track frames, N being dependent on the time available or by the intended mode (maximum coverage, limited coverage or spot mode) of operation. The result is a series of frames of images similar to that produced with a step frame camera system, as indicated in Figure 2, each frame taken in two different bands of the electromagnetic spectrum. In maximum coverage mode, N is determined by the V/H ratio of the mission, the camera system depression angle range and the framing rate, and N can be as many as 10 frames/cycle (or more) in normal operation. At the end of the cross- track cycle, the camera system or cylinder is rotated back (reset) to the first frame angular position and the cycle repeats until the intended in-flight direction coverage is achieved. The camera can generate overlapping frames of imagery similar to that shown in Figure 1, where N in the illustrated example = 5.
In spot mode, a one or two frames/cycle is executed, with the camera aimed at a specific predeteπnined depression (roll) angle and fore/aft azimuth angle where a target or specific interest is expected to be. In this example, N will typically equal 1 or 2. The cycle may repeat for as many times as needed.
As another mode of operation, the camera could be used in a traditional step frame operation. In this mode, the camera would rotate between successive angular positions, and the photosensitive media would generate two-dimensional images of the terrain. If the camera body rotation is stopped during scene exposure, forward motion compensation could be performed in the photosensitive media, such as described in the earlier Lareau et al. patents. The preferred forward motion compensation method will now be described with a little more specificity. As the exposures are made at either of the two detectors 64 and 68, the aircraft is moving at some known velocity. The forward motion of the aircraft is neutralized in a novel way in the preferred embodiment. Whereas in the prior art Lareau et al. '586 patent forward motion compensation is performed on-chip in the array, the forward motion compensation of the preferred embodiment is performed by rotation of the Cassegrain objective subassembly, i.e, the Cassegrain primary and secondary mirror assembly, in the flight direction at a rate = V/R (in units of radians per second) where V is the aircraft velocity and R is the range to the scene of interest. The value of R can be derived from simple geometry from the known aircraft height and camera depression angle (δ ;) and assuming the earth is flat in the scene of interest, from a Global Positioning System on board the aircraft, using an active range finder, or by computing range from successive frames of imagery as described in the patent of Lareau et al., US Patent No. 5,692,062, which is incorporated by reference herein. As the Cassegrain primary and secondary mirrors 80 and 82, respectively, are rotated at the V/R rate in the direction of flight, the flat azimuth mirror 84, located in the optical path between the secondary reflector and the Cassegrain image plane 86, is rotated at a rate equal to Vz (V/R) in the same direction, thus "stopping" image motion due to aircraft forward motion at the image plane. Thus, the rotating Cassegrain objective lens and the half speed azimuth mirror provide the needed forward motion compensation function. As an alternative embodiment, the Cassegrain optical system could remain fixed and both forward motion compensation and roll motion compensation could be performed in the focal plane detector by transferring pixel information in both row and column directions in accordance with the principles of the Lareau et al. patent, U.S. Patent No. 5,798,786.
From the Figures 1-5 and 18 and the above discussion, it will be appreciated that we have invented a method of generating frames of imagery of a scene of interest with an aerial reconnaissance camera in two different bands of the electromagnetic spectrum simultaneously. The method includes the steps of:
(a) providing two photosensitive electro-optical detectors 64, 68 in the camera 36, each of the detectors comprising an array of pixel elements arranged in a plurality of rows and columns;
(b) rotating the camera 36 in a continuous fashion about a roll axis 37 either coincident with or parallel to a roll axis R of an aerial reconnaissance vehicle carrying the camera; (c) while rotating the camera 36, simultaneously exposing the electro-optical detectors 64, 68 to a scene of interest in a series of exposures;
(d) while rotating the camera 36 and while exposing the electro-optical detectors 64 and 68 to the scene, rotating an optical system 54 providing an objective lens for the camera in the direction of forward motion of the vehicle at a predetermined rate to cancel out image motion due to forward motion of the vehicle; and
(e) while the electro-optical detectors 64 and 68 are being exposed to the scene, moving pixel information in the arrays at a rate and in a direction substantially equal to the rate of image motion due to rotation of the camera about the roll axis, to thereby preserve resolution of images generated by the detectors.
Performance specifications for a presently preferred dual band step frame camera system in accordance with the invention are listed below.
Focal Length &//#
Visible Channel 50.0 inches -//4.0 (Options) 72.0 inches -f/5.8 84.0 inches -f/6.1
MWTR Channel 50.0 inches -/74.0 Optical System
Type: Cassegrain objective lens with spectrum beam divider and individual visible channel and MWTR channel relay lenses. Operating Spectrums :
Visible Channel - 0.50 to 0.90 microns MWTR Channel - 3.0 to 5.0 microns Entrance Pupil Diameter:
12.5 inches, both channels, all focal lengths.
Detectors:
Visible Channel: 5040 x 5040 pixels .010 mm x .010 mm pixel pitch 50.4 mm x 50.4 mm array size 4.0 frames/sec max. MWTR Channel: 2016 x 2016 pixels .025 mm x .025 pixel pitch 50.4 mm x 50.4 mm array size 4.0 frames/sec max.
MWTR Channel: 2520 x 2520 pixels (future) .020 mm x .020 mm pixel pitch 50.4 mm x 50.4 mm array size 4.0 frames/sec max.
FOV (per frame):
VIS Channel: 2.27° x 2.27° (50 inch F.L.) 1.58° x 1.58° (72 inch FX.) 1.35° x 1.35° (84 inch FX.)
MWTR Channel: 2.27° x 2.27° (50 inch FX.)
Frame Rates: Variable, up to 4.0 fr/sec
Both channels, all focal lengths.
Pixel IFOV:
VIS Channel: 7.9 x 10"s RAD (50 inch FX.) 5.5 x 10'6 RAD (72 inch F.L.) 4.7 x 10"6RAD (84 inch F.L.)
MWTR Channel: 19.7 x 10"6 RAD (50 inch F.L.)
15.8 x 10"6 RAD (50 inch FX.) (future)
Ground Resolvable Distance (GRD) (at range, perpendicular to the LOS).
VIS Channel: 3 ft @ 31 N mi. (NILRS-5) (50") 3 ft @ 45 N mi. (NIIRS-5) (72") 3 ft @ 52 N mi. (NIIRS-5) (84")
MWTR Channel: 3 ft @ 12.5 N mi. (NIIRS-5) (50") (Future) 3 ft @ 15.6 N mi. (NIIRS-5) (50")
Field of Regard: Horizon to Horizon, or as limited by vehicle windows (5° to 30° depression below horizon (δ) is typical).
Scene coverage rate: Variable cross-track.
Roll rate: 8.67sec - (50 inch focal length, 4 Fr/Sec.) Preferred Dual Band Camera Detailed Mechanical and Servo-Mechanical Description With the above overall description in mind, attention is directed primarily to Figures 2A, 2B, and 3-5. The more important mechanical aspects of the camera will now be described. The optical system 50, including the Cassegrain optical system, spectrum dividing prism 56, and optical components in the optical paths 58 and 60, are rigidly mounted to a camera housing or superstructure 52. This camera housing 52 takes the form of a pair of opposed, elongate C-shaped frames extending transversely on opposite sides of the roll axis substantially the entire length of the camera. The C-shaped frame members 52 provide a structure in which to mount the various optical and mechanical components of the camera, including the end plates 41 and 41 A.
The end plate 41 is bolted to the right hand end of the C-shaped frames 52, as shown in Figure 3. The rotor portion of the roll motor 70 A is in turn bolted to the end plate 41, thereby coupling the rotational portion of the roll motor 70A to the camera frame 52. The stator portion of the roll motor 70A is fixedly coupled to the aircraft frame or pod via two L- shaped brackets 39 and the associated passive isolation mounts (conventional, not shown). The left-hand end of the C-shaped frame 52 is similarly bolted to an end plate 41 A, and the rotor portion of the roll motor 70B is bolted to the end plate 41A, with the stator portion bolted to two L-shaped brackets 39. Two roll motors 70A and 70B are conventional frameless DC torque motors, adapted to mount to the camera 36. Two are used in the illustrated embodiment in order supply enough torque to rotate the camera housing 52 and all the attached components, but one motor may suffice if it is powerful enough. In the illustrated embodiment, the roll motors 70A and 70B are frameless DC torque motors, adapted to fit to the camera housing, a task within the ability of persons skilled in the art. The roll motors are described below in further detail in conjunction with Figures 12-15. Figure 3 is a top view of the camera 36, looking towards to the back side of the primary mirror 80. The Cassegrain objective lens optical subassembly 54 includes a primary mirror cell 100 which includes four mounting flanges 102 with bolt holes 104 for mounting via bolts to the top flange 106 of the C-shaped frames 52. The Cassegrain optical system is shown isolated in Figures 6-10. In Figures 6 and 7, the primary mirror is removed in order to better illustrate the rest of the structure in the Cassegrain optical system.
As is shown best in Figure 3 and 6, a spider 120 consisting of eight arms 122 extends between an inner primary mirror holding ring 110 and an azimuth mirror mounting plate 124 located at the center of the primary mirror 80. The mounting plate 124 incorporates three adjustment screws 126 for adjusting the tilt of the azimuth mirror 84. A fiber optic gyroscope 128 is also mounted to the plate 124 and is provided for purposes of inertial stiffness and stabilization of the Cassegrain optical system 50. The secondary mirror assembly 113 includes a set of three adjustment screws 126 A for adjusting and aligning the orientation of the secondary mirror relative to the primary mirror.
The stator portion of the Cassegrain motor 74 is fixed with respect to the primary mirror cell 100. The rotor portion of the motor 74 is mounted to an annular ring 111 shown in Figure 10, which is attached to the inner primary mirror holding ring 110. The secondary mirror 82 is fixed with respect to the primary mirror by means of three arms 112. Thus, the motor 74 rotates both the primary, secondary and azimuth mirrors about axis 75 in the direction of the line of flight in unison. The Cassegrain motor 74 is based on a DC direct drive motor adapted as required to the Cassegrain primary mirror holding structure, again a task within the ability of persons skilled in the art.
The rotation of the inner mirror holding ring 110 by the Cassegrain motor 74 is reduced by a two-to-one reduction tape drive assembly 114, shown best in figures 5, 6 7, 9 and 11. The tape drive assembly 114 rotates an azimuth mirror drive shaft 116 that extends from the tape drive assembly 114 to the azimuth mirror 84. The azimuth tape drive assembly 114 rotates the azimuth mirror drive shaft 116 and thus the azimuth mirror 84 at one half of the rate of rotation of the primary and secondary mirrors by the Cassegrain motor 74. The tape drive assembly 114 includes a two-to-one drive housing 150, two-to-one drive couplings 152 and 154, a shaft locking coupling 156, and a pair of stainless steel tapes 158 and 160, the thickness of which is shown exaggerated in Figure 11.
Referring to Figure 12, the roll motor 70A is shown isolated from the rest of the camera in a perspective view. Figure 13 is an elevational view of the motor as seen from the other side. Figure 14 is a cross-sectional view of the motor 70A. The roll motor 70B is identical to the motor of Figures 12-14. Additional details concerning the tape drive assembly 114 are conventional and therefore omitted for the sake of brevity.
The motor 70A includes a trunnion 200, a journal 202 and a DC frameless motor 204. The journal 202 bolts to the plate 41 (Figure 3) via six bolt holes 208. A set of apertures 210 is provided in the face of the journal 202 to reduce weight. The sides of the trunnion 200 have opposed, parallel flat surfaces 212 with a series of mounting holes for enabling the L- shaped mounting brackets 39 to mount to the trunnion 200 in a plurality of different positions. The motor 70A also includes an electronics module contained in a housing 214. The module includes a power amplifier and associated DC electronic components, which are conventional.
As shown in the cross-sectional view of Figure 14, and the detail of Figure 15, the motor assembly 70A also includes an annular shim 220, an annular bearing 222, a lock washer 224 and locking nut 226, a trunnion sleeve 228, a bearing spacer 230, a bearing insert 232 and a bearing adjustment plate 234. Additional mechanical features shown in Figures 14 and 15 are not particularly important and therefore are omitted from the present discussion.
Optical System Detailed Description
The optical system design of the subject camera is driven by the need to illuminate a large focal plane image recording medium and by space constraints, namely the total axial length and the total diameter, which have to be accounted for in potential aircraft installation applications. Thus, while the particular optical design described herein is optimized for a given set of spatial constraints, variation from the illustrated embodiment is considered to be within the scope of the invention.
The optical system 50 of Figure 3 and 4 represents a 50-inch, F/4 optical system designed to operate over an extended spectral region. The objective lens module consists of the Cassegrain optical subsystem 54, comprising the primary and secondary mirrors 80 and 82. The azimuth mirror 84 is utilized to redirect the image forming light bundles into the remainder of the optical system, namely the spectrum dividing prism and the relay lenses and other optical components in the optical paths 58 and 60.
Referring now again primarily Figures 4, 4A, 4B and 4C, radiation is reflected off the flat azimuth mirror 84 towards a calcium fluoride spectrum-dividing prism 56. An image is formed at a Cassegrain image plane 130 immediately in front of the prism 56. The spectrum- dividing prism 56 is constructed such that radiation in the visible and near LR band (about 0.5 to about 0.9 microns) passes through the prism 56 into the visible/near TR optical path 58 while radiation in the MWTR portion of the spectrum (about 3 to about 5 microns) is reflected upwards through a fold prism 132, made from an infrared transmitting material, into the MWTR optical path 60.
In the visible path, the radiation passes through a relay lens assembly 62 enclosed in a suitable enclosure 134, a focus element 136 adjusting a set of focus lenses 138, and finally to a shutter 88. An image is formed on the focal plane of the image recording medium 64. The shutter 88 opens and closes to control exposure of the visible spectrum image recording medium 64. In the illustrated embodiment, the medium 64 is a charge-coupled device E-O detector, comprising an array of pixels arranged in rows and columns. The array 64 is cooled by a thermo-electric cooler 140. The array and thermo-electric cooler are enclosed in their own housing 142, which includes electronics boards 144 and a set of heat dissipating cooling fans 146.
In the MWTR path, the light passes through a relay lens assembly 66 contained in a suitable housing, through a focus lens assembly 67 and an image is formed at the focal plane of an TR-detecting two dimensional array 68. The MWTR sensor comprises the array 68, a cold stop 69, and an internal filter, all enclosed in a cryogenic dewar 63.
The optical axis of the objective Cassegrain optical subassembly is shown vertical in Figure 4. This arrangement provides a very compact assembly; if the objective were arranged along a horizontal axis the total length required for the system would have been intolerably large. The use of only reflecting components (catoptric) in the objective allows the collection of light from a very wide spectral region. Such imaging would be impractical or impossible with a refracting objective design.
The point of intersection of the visible relay optical axis and the objective optical axis is an important datum feature of this system. The azimuth mirror 84 reflecting surface is designed to rotate about an axis that contains this intersection point. Furthermore, the entire Cassegrain objective subassembly 54 is arranged to also rotate about this same axis for forward motion compensation. Rotation of the objective permits locking onto ground image detail while the camera and aircraft are moving forward. If the azimuth mirror 84 rotates at half the angular rate of the objective module with respect to the aircraft/camera frame of reference, the selected ground image is effectively locked or frozen onto the detectors. Consequently, the image can be recorded without blur of relative forward motion between the camera and the scene.
Presently preferred embodiments of the subject optical system have focal lengths of between 50 and 100 inches, and an f/number of between 4.0 and 8.0.
Figures 16A and 16B are ray diagrams for the visible and MWTR paths of the embodiment of Figure 4. Figure 16C is a graph of the diffraction MTF for the visible path. The MTF curves are wavelength-averaged over the visible/TR spectral range of 500 to 900 nm with system spectral weights. The Cassegrain objective subsystem introduces a central obscuration into the light forming beams, and therefore reduces the diffraction-limited performance limits that can be achieved.
In the interest of completeness of the disclosure of the best mode contemplated for practicing the invention, optical prescription, fabrication and aperture data are set forth below in the following tables for the embodiment of Figure 4. Of course, the data set forth in the tables is by no means limiting of the scope of the invention, and departure thereof is expected in other embodiments of the invention. Furthermore, selection and design of the optical components for any given implementation of the invention is considered to be a matter within the ability of persons skilled in the art of optical design of aerial reconnaissance cameras, with such additional designs being considered obvious modifications of the illustrated embodiment. hi the tables for the visible and MWTR paths, the numbering of the elements in the left-hand column corresponds to the optical elements shown in Figures 16A and 16B in progression from the entrance aperture to the detectors.
TABLE 1 VISIBLE PATH PRESCRIPTION
FABRICATION DATA.
30 - g- 00 odified 50", F/4 VISIBLE PATH
ELEMENT RADIUS OF CURVATURE APERTURE 1 DIAMETER
NUMBER FRONT BACK THICKNESS FRONT BACK GLASS
OBJECT INF INFINITY*!
C- -1
11.3468
APERTURE STOP c- -2
1 A(l) -11.3468 c- -2 REFL
2 A(2) 10.3463 4. 8650 2 EFL
DECENTSRC 1)
3 INF 0.QQ00 C- -3 REFL
3. .3525
-8.2000
4 -14.5000 CX INF -0.3000 2.9916 3.0328 CAF2 -0.0200
5 INF INF -3.1000 3.0382 3.6125 CAF2 -0.4000
6 INF 5.6254 CX -0.6360 3.7191 3.7662 'F9474/30 ' -0.2QOO
7 INF INF -0.2500 3.6228 3.5785 'OG515' -0.3000
8 -5.4347 CX 33.2980 CX -0.5926 3.4210 3.3Q57 •A2334/2' -0.0200
9 -4.0545 CX 3.6785 CX -0.892O 3.0291 2.7699 ■B2601/1A'
10 3.6785 CC -1.4940 CC -0.25OO 2.7699 2.0369 • 12549414 ' -0.4633
11 -2.1854 CX 1.4016 CX -0.8744 1.9875 1.8522 '135662/A'
12 1.401S CC -0.8475 CC -0.2500 1.8522 1.4085 •B2651/2'
13 -0.8475 CX -1-5553 CC -0.4845 1.4085 1.3037 Α2334/2' -0.3747
14 1.2750 CC -1.5275 CC -0.3634 1.3029 1.6318 'B2650/1'
15 -l.v5275 CX 2.1577 CX -0.6838 1.6318 1.7456 '11646656' -0.0270
16 -5.0620 CX 3.3440 CX -0.4730 1.8086 1.8207 'A2334/2' -0.4251*2
17 -7.5223 CX 19.2220 CX -0.1985 1.6606 1.6522 'H9420/8' -0.5725*3
18 -2.5775 CX -1.1718 CC -0.2500 1..6800 1.5948 'D1741/4'
19 -1.1718 CX 2.7961 CX -0.7869 1.5948 1.5304 'B2601/1A'
20 2.7961 CC -2.2230 CC -0.2500 1.5304 1.4526 151741/4' -1.7614.
21 1.4142 CC 21.3497 CX -0.3802 1.7611 2.1-914 'H9418/35' -0.0245
22 -3.4440 CX 12.7030 CX -0.8500 2.4631 2.5450 •D1741/6' -0.0500
23 INF INF -0.0800 2.5554 2.5603 BK7 Schott
IMAGE DISTANCE = -0.9162
IMAGE INF 2. 6440
NOTES - Positive radius indicates the center of curvature is to the right Negative radius indicates the center of curvature is to the left
- Dimensions are given in inches
- Thickness is axial distance to next surface
- Image diameter shown above is a paraxial value, it is not a ray traced value
- .Other glass suppliers can be used if their materials are functionally equivalent to the extent needed by the design; contact the designer for approval of substitutions . APEHTDSS DATA
DIAMETER DECΞNTEH.
A5ΞRTORE ΞEABΞ X T X X HOTATIOST
C- 1 CIRCLE 13.168
CIRCLE (OBSC) 4:800 4.800
C- 2 CIRCLE (OBSC) 4.800 4.800
CIRCLE 12-SQO 12.500
C- 3 RECTANGLE 3.S00 . 4.000 0.000 0.100 0.0
ASBΞERIC CONSTANTS
2
(coRvjr s a lo z = + (A)Y + (B)Y + (C)ϊ + (D)Y
2 2 1/2 1 + (1-Cl+K) (C0RV) X )
ASBHERIC CORY K " A B C D
A{ 1) -0.Q28812S7 -1.000000
AC 2) -0.05583473 -3.328273
DECENTERING CONSTANTS
DECEH EE. X Y - Z ALPHA BETA GAMMA
D( 1) 0.0000 Q.0000 0.0000 35.0000 -0.0000 0.0000 (BEND)
TABLE 2
MWIR PRESCRIPTION
FABRICATION DATA
Modified SO", F/4 MWIR LENS 2 Fit to POD Testplαtes
ELEMENT RADIUS OF CURVATURE APERTURE DIAMETER
NUMBER FRONT BACK THICKNESS FRONT BACK GLASS
OBJECT ΓNF INFINITY*!
C-1 11-3468
1 A(l) {Paraboloid) -11.3468 C-2 ' REFL
2 A(2) (Ellipsoid) 10.3468 4.400Q REFL
DECENTER( 1)
3 INF -8.2000 3.9482 REFL Λzimuc Mirror)
4 14.5000 CX INF -0.3000 3.20SO 3.2480 CAF2 Field Lens) -0.02QO
5 INF INF -1.S30Q C-3' C-4 CAF2 DECENTER( 2) CaF2 Prism INF C-4 REFL
INF INF 1.5500 C-4 C-5 CAF2 0.6250
6 INF INF 2.400Q C-6 C-7 SILICON DECENTERt 3) Silicon Prism INF C-7 REFL
INF INF -2.5000 C-7 C-8 SILICON -O.IOOQ
7 -5.2363 CX -11.8133 CC -0.6000 .4.3400 4.1700' SILICON -1.26Q2
8 7.0285 CC A{3) -0.3500 3.1100 3.1800 GEKMMW -Q.4399
9* 3.57G8.CC 10.0404 CX -0.3500 3.2000 . 3.7400 ZNS -0.0638
10 27.Q2 5 CC S.1234 X -0.6000 4.1200 4.2400 SILICON -1.9286
11 AU) 10.1487 CX -0.4000 3.8400 3.8200 ZNS -0.9223
12 -2.2473 CX -2.5307 CC -0.3500 2.6700 2.4200 ZNSE
-0.2-702-2
13 -2.Q677 CX -1.4306 CC -0.5000 2.1000 1.5600 ZNS
-0.6180*3
14 INF INF -0.1180 1.1400 1.1400 SILICON -0.2290 APERTURE STOP C-9 (Cold Stop) -1.2070
15 INF INF -0.0400 C-10 C-ll SILICON
IMAGE DISTANCE = -2.1300
IMAGE INF 2.8293
NOTES - Positive radius indicates the center of curvature is to the right Negative radius indicates the center of curvature is co the left - Dimensions _?re given in inches
- Thickness is axial distance to next surface
- Image diameter shown above is a paraxial value, it is not a ray traced value
- Other glass suppliers can be used if their materials are functionally equivalent to tha extent needed by the design; contact the designer for approval of substitutions.
APERTURE DATA
DIAMETER DE ENTER
APERTURE SHAPE X X Y ROTATION,
C- 1 CIRCLE 12. 533 CIRCLE (OBSC) 4 . 8Q0 4 . S0C
C- 2 CIRCLE 12 . 500 12.500 CIRCLE (OBSC) 4 . 800 4 . 800
C- 3 RECTANGLE 2 .900 2 . 9Q0 |C5 iF2 Prism - Entrance Pace)
C- 4 RECTANGLE 2 .900 4 .101 (CaF2 Prism - Splitter Face)
C- 5 RECTANGLE 2.SO0 2.90Q (C≤F2 Prism - Ex t Face)
.C- S RECTANGLE 3.050 3.050 (Silicon Oris . - Entrance Face)
C- 7 RECTANGLE 3.300 5.S40 0.000 -0.14S 0.0
C- 3 RECTANGLE 3.410 3.410 {Silicon . Prism - Exic Face;
C- 9 CIRCLE 0.344 0.844 (Cold StOD)
CIRCLE (OBSC) 0-.320 Q.32Q (Occulciπg Disk)
C- 10 RECTANGLE 1.280 1.280
C- 11 RECTANGLE 1.280 1.280
ASPtlERIC CONSTANTS
2
(CURV)Y 4 5 8 10
Z = + (Λ)Y + CB)Y + (C)Y + (D)Y
Figure imgf000037_0001
ASPHERIC CURV K A fl c D
A( 1) -0.02881257 -1.Q0O0OO
A( 2) -0.05583473 -3.928273
A( 3) -0.02571578 0.000000 -3.39O14E-03 3.984S0E-O4 -2.25842E-05 O .QOOOOHTCO
A( 4) -O.0201893O 0.000000 S.40826E-04 8.94387Ξ-05 -1.85905E-05 2.93941E-06
Electronics System
The electronics for the camera 36 of Figures 1 and 3 is shown in block diagram form in Figure 17. The electronics includes an image processing unit (IPU) 401 which contains the master control computer 34 of Figure 1. The master control computer 34 supplies control signals along a conductor 400 to a camera body and stabilization electronics module, represented by block 402. The camera body and stabilization electronics 402 basically includes digital signal processing cards that provide commands to the roll motors 70A and 70B and the Cassegrain or azimuth motor 74 of Figures 3, 5 and 6, and receive signals from the stabilization system consisting of the azimuth fiber optic gyroscope 128 mounted on the azimuth mirror and a roll fiber optic gyroscope (not shown) mounted on the camera housing 52. The camera body electronics 402 also receives current roll angle and roll rate data from resolvers in the roll motors 70A and 70B, and from the roll gyroscope, and supplies the roll information to the camera control computer.
The camera control computer 34 also generates control signals, such as start, stop, and counter values, and supplies them via conductor 406 to an IR sensor module (IRSM) 408 and a Visible Sensor Module 410. The IRSM 408 includes a cryogenic dewar or cooler 63, the IR detector 68 (Figure 4) and associated readout circuitry, and electronic circuitry shown in Figure 19 and described subsequently for transferring charge through the IR array to achieve roll motion compensation. Pixel information representing IR imagery is read out of the array 68, digitized, and sent along a conductor 412 to the EPU 401. In an alternative embodiment, the electronic circuitry shown in Figure 19 could be incorporated into the camera body electronics 402 or in the Image Processing Unit 401.
The visible sensor module 410 includes a mechanical shutter 88, a visible spectrum electro-optical detector 64 (Figure 4) and associate readout registers, and electronic circuitry described in Figure 19 and described subsequently for transferring charge through the visible spectrum detector 64 to achieve roll motion compensation. Pixel information representing visible spectrum imagery is read out of the detector 64, digitized, and sent along a conductor 414 to the IPU 401.
Visible and LR imagery supplied by the Visible Sensor Module and the IR Sensor Module is received by a dual band input module 420 and supplied to an image processor 422 for purposes of contrast adjustment, filtering, radiometric correction, etc. Typically, images generated by the arrays 64 and 68 are either stored for later retrieval or downlinked to a ground station. In the illustrated embodiment, the imagery is compressed by a data compression module 424, supplied to an output formatter 426 and sent along a conductor 428 to a digital recording module 430 for recording of the imagery on board the aircraft.
Aircraft inertial navigation system data such as aircraft velocity, height, aircraft attitude angles, and possibly other information, is obtained from an aircraft 1553 bus, represented by conductor 432. Operator inputs such as start, stop and roll angle commands from a manual cockpit or camera console or control panel, can also be supplied along the conductor 432 or by an optional control conductor 434. The INS and operator commands are processed in an INS interface circuit 436 and supplied to the camera control computer 34 and used in the algorithms described above. The camera control computer also has a non-volatile memory (not shown) storing fixed parameters or constants that are used in generating the roll motion compensation commands, such as the pixel pitch, array size, master clock rate, and optical system focal length.
The image processor 422 and a graphics module 438 are used to generate thumbnail imagery and supply the imagery to an RS- 170 output 440 for viewing in near real time by the operator or pilot on board the reconnaissance vehicle, or for downloading to the ground station. Other format options for the thumbnail imagery are also possible.
Aircraft power is supplied to a power conversion unit 442, which filters, converts and distributes it to two power modules 444. The power modules 444 supply the required AC or DC voltages to the various electronic components in the camera 36. An RS-232 diagnostic port 446 is provided in the LPU 401 for remote provisioning, diagnostics, and software downloads or upgrades or debugging by a technician. The port 446 provides an interface to the master control computer 34, and the other modules in the LPU 401 and allows the technician to access these units with a general purpose computer. Changes to fixed parameters stored in non-volatile memory, such as a change in the focal length of the camera, are also made via the port 446.
Except as noted herein and elsewhere in this document, the individual modules and components in the electronics are considered to be conventional and therefore can be readily derived be persons skilled in the art. Accordingly, a detailed discussion of the modules per se is omitted from the present discussion.
Roll Motion Compensation
Referring now to Figure 18, a presently preferred implementation of roll motion compensation in an electro-optical area array detector will now be described. The visible/near IR E-O detector 64 is shown in a plan view. The detector consists of an array of pixel elements 300 arranged in a plurality of rows and columns, with the column direction chosen to be across the line of flight and the row direction in the direction of flight. The array 64 can be any suitable imaging detector including a charge-coupled device, and preferably will comprise at least 5,000 pixels in the row direction and at least 5,000 pixels in the column direction. The illustrated embodiment consists of 5040 x 5040 pixels, with a .010 mm x .010 mm pixel pitch and a 50.4 mm x 50.4 mm array size. The reader is directed to the Lareau et al. U.S. patent 5,155,597 patent for a suitable detector, however the array need not be organized into column groups as described in the '597 patent and could be configured as a single column group, all columns of pixels clocked at the same rate.
The architecture for the array is not critical, but a full frame imager, as opposed to an interline transfer architecture, is presently preferred. The imager can use either a mechanical shutter or an electronic shutter to expose the array.
The roll motion caused by camera roll motors 70A and 70B produces an image motion indicated by the arrows 302 in the plane of the array 64. The roll motion is in the cross-line of flight direction and the image velocity v is nearly constant throughout the array. The velocity v is equal to the product of the optical system focal length /multiplied by the rate of rotation ω. Since/ is fixed (and the value stored in memory for the camera control computer), and the rate of rotation is known by virtue of outputs of the fiber-optic gyroscope 128 or from resolvers in the roll motors, the velocity of the image due to roll can be precisely determined for every exposure. The velocity can be expressed in terms of mm/sec, in terms of rows of pixels per second, or in terms of the fraction of a second it takes for a point in the image to move from one row of pixels to the adjacent row, given the known pixel pitch. The pixel information (i.e., stored charge) in the individual pixels 300 is transferred row by row throughout the entire array 64 at the same rate and in the same direction of image motion during the exposure time, thereby avoiding image smear due to the roll motion.
To accomplish this, and with reference to Figure 19, the camera electronics includes a counter and clock driver circuit 304 (one for each detector 64, 68) which generates voltage pulses and supplies them to a set of three phase conductors 308 which are coupled to each row of the array. One cycle of three-phase clocking effectuates a transfer of charge from one row to the adjacent row. A master clock 306 generates clock signals at a master clock frequency and supplies them to a counter 310. The camera control computer calculates a counter value which determines the number the counter 310 is supposed to count to at the known master clock rate to time the transfer of charge from one row to another in synchronism with the movement of the image by one row of pixels (0.010 mm). The master computer 34 supplies the counter value to the counter 310, along with a start and stop commands. At the moment the array 64 is exposed to the scene, the counter 310 starts counting at the clock rate up to the counter value. When the counter value is reached, a trigger signal is sent to a clock driver 312. The clock driver 312 initiates one cycle of three phase clocking on conductors 308, causing the pixel information from row 1 to be transferred to row 2, from row 2 to row 3, etc. When the counter value is reached, the counter 310 resets itself and immediately begins counting again to the counter value, another cycle of clocking is triggered, and the process repeats continuously while the array is exposed and charge is integrated in the detectors. At the end of the exposure period, a stop signal is sent to the counter 310. The pixel information in the array 64 is read out of the array into read-out registers at the bottom of the array (not shown), converted into digital form, and either stored locally on a digital recording medium for later use or transmitted to a remote location such as a base station.
The process described for array 64 is essentially how the IR detector operates as well for accomplishing roll motion compensation, hi alternative embodiments, the image motion compensation could be performed in other readout structures depending on the architecture for the array. The LR detector could be sensitive to radiation in the Short Wavelength Infra- Red (SWIR) band (1.0 to 2.5 microns), Mid-Wavelength LR (MWLR) band (3.0 to 5.0 microns) or Long Wavelength LR (LWLR) band (8.0 to 14.0 microns). In such an array, the output of the each photosensitive photodiode detector is coupled to a charge storage device, such as a capacitor or CCD structure, and the charge is shifted from one charge storage device to the adjacent charge storage device in synchronism with the image velocity while charge is being integrated in the charge storage devices.
The process of roll motion compensation can be more finely tuned by deriving the rate of rotation (co) used in the algorithm from the actual inertial rate sensed by a fiber optic gyroscope mounted to the camera housing or frame. Such a gyroscope can count with a resolution of 1 microradian or better. The gyroscope generates a signal that is supplied to a DSP card in the camera control electronics module 402 (Figure 17). A signal could also be constructed for imaging array clocking purposes in the form of a pulse train which the imaging array clock generator could phase lock to. By doing this, any rate inaccuracy or stabilization shortcomings associate with the roll motion could be overcome. The roll motion compensation becomes, in effect, a fine stabilization system which removes the residual error from the more coarse electro-mechanical stabilization system. Having a fine system, based on a closed loop feedback from the roll fiber optic gyroscope, would allow for a larger range of roll motion without image degradation.
The above-described roll motion compensation will produce some minor edge effects at the bottom of the array, which are typically ignored since they are a very small fraction of the image generated by the array.
Other Embodiments
As noted above, the principles of roll framing and forward motion compensation described above are applicable to a camera that images in a single band of the electromagnetic spectrum. In such an embodiment, the spectrum dividing prism would not been needed and the objective optical subassembly (Cassegrain or otherwise) would direct the radiation in the band of interest to a single optical path having a photo-sensitive image recording medium placed herein. The spectrum dividing prism and second optical channel are not needed. Otherwise, the operation of the camera in roll framing and spot modes of operation would be the same as described above.
As another alternative embodiment, three or more detectors could image the three or more bands of the electromagnetic spectrum simultaneously. In such an embodiment, an additional spectrum separating prism would be placed in either the visible or LR paths to further subdivide the incident radiation into the desired bands and direct such radiation into additional optical paths, each with its own photo-sensitive image recording medium. As an example, the visible/near LR band could be divided into a sub 700 nanometer band and a 700 to 1000 nanometer band, each associated with a distinct optical path and associated image forming and focusing lenses and an image recording medium. Meanwhile, the IR portion of the spectrum could be similarly divided into two separate bands, such as SWLR, MWLR, and/or LWLR bands, and each band associated with a distinct optical path and associated image forming and focusing lenses and an image recording medium. Obviously, in such an embodiment the arrangement of optical components in the camera housing will be different from the illustrated embodiment due to the additional spectrum dividing prisms, additional optical paths and optical components, and additional detectors. However, persons skilled in the art will be able to make such a modification from the illustrated embodiment using routine skill.
As yet an another possible embodiment, the camera may be designed for hyperspectral imaging. In such an embodiment, one of the optical paths may be devoted to visible spectrum imaging, while the other path is fitted with a spectroradiometer, an imaging spectrometer, or spectrograph to divide the incident radiation into a large number of sub-bands in the spectrum, such as 50 of such sub-bands. Each sub-band of radiation in the scene is imaged by the hyperspectral imaging array.
As yet another alternative, the camera could be mounted transverse to the roll axis of the aircraft. Such a camera could be used for dual spectrum, full framing imaging in a forward oblique mode, either in a spot mode of operation or in a mode in which overlapping frames of images are generated in a forward oblique orientation.
As yet another alternative embodiment, the smooth roll motion and roll motion compensation feature could be adapted to a step framing camera, such as the KS-127A camera or the step frame camera of the Lareau et al. patent, U.S. No. 5,688,593. In this embodiment, the roll motors are coupled to the step frame scan head assembly, and continuously rotate the scan head about the roll axis in a smooth, continuous fashion. The detector array and associated relay and focusing optical elements remain stationary with respect to the aircraft. The image acquired by the scan head assembly would need to be derotated with a pechan prism, K mirror or other suitable element, as described in the '593 patent. Roll motion compensation would be performed electronically in the array, as described at length above.
As a variation on the above embodiment, the roll motors are coupled to the step frame scan head and continuously rotate the step frame scan head assembly, while the image derotation is achieved by rotation of the imaging array in synchronism with the rotation of the scan head assembly. Roll motion compensation is achieved by transferring pixel information in the array at substantially the same rate as the rate of image motion due to scan head rotation.
Less preferred embodiments of the invention include other types of optical arrangements. While the catoptric Cassegrain optical system is the preferred embodiment, refractive optical systems, catadioptric optical systems, and still other types of optical arrangements may be used, for example where only single spectrum imaging is performed, where space requirements are not so important, or when other considerations dictate that a different type of optical arrangement for the objective lens is suitable. In such embodiments, the optical subassembly comprising the objective lens would be rotated in the direction of flight to accomplish forward motion compensation as described above, while the entire camera housing including the objective lens is rotated about an axis to thereby generate sweeping coverage of the field of interest, either about the roll axis or about an axis perpendicular to the roll axis. Presently preferred and alternative embodiments of the invention have been described with particularity. Considerable variation from the disclosed embodiments is possible without departure from the spirit and scope of the invention. For example, the type and structure of the image recording medium is not critical. The details of the optical design, the mechanical system and the electronics may vary from the illustrated, presently preferred embodiments. This true scope and spirit is to be determined by the appended claims, interpreted in light of the foregoing.

Claims

CLAIMSWe Claim:
1. A method for imaging a scene with a framing camera installed in an aerial reconnaissance vehicle, the camera comprising a two dimensional framing array of photosensitive cells, an optical system directing scene radiation onto said array, and a mechanism for rolling said camera about a roll axis, said array of cells storing pixel information and arranged in a plurality of rows and columns, comprising the steps of :
(a) continuously rotating said camera about said roll axis with said roll mechanism to thereby direct scene information onto said two dimensional array;
(b) exposing said array while said camera is rotating and transferring pixel information in said array at a rate substantially equal to an image motion rate due to said rotation of said camera;
(c) reading out said pixel information from said array; and (d) repeating said steps (b), and (c) while said vehicle flies past a scene of interest and while said camera continuously rotates about said roll axis.
« 2. The method of claim 1, wherein said step of continuously rotating comprises the step of rotating said camera about an axis substantially parallel to the direction of forward motion of said aerial reconnaissance vehicle.
3. The method of claim 1, wherein said step of continuously rotating comprises the step of rotating said camera about an axis in the direction substantially orthogonal to the direction of forward motion of said aerial reconnaissance vehicle.
,
4. The method of claim 1, wherein said steps (a), (b), (c), and (d) are performed in a a series of cycles as said aircraft flies past a scene of interest.
5. The method of claim 1, wherein said camera generates imagery in a single band of the electro-magnetic spectrum.
6. The method of claim 1, wherein said camera includes a second electro-optical detector and wherein said camera generates imagery in two bands of the electromagnetic spectrum simultaneously from said first and second detectors.
7. The method of claim 1, wherein said camera includes an hyperspectral electro- optical detector and optical system.
8. The method of claim 1, wherein said optical system further comprises a derotation prism.
9. The method of claim 1, wherein said optical system further comprises a derotation mirror.
10. The method of claim 1, wherein the camera further comprises a catoptric Cassegrain objective subassembly, wherein said roll mechanism rotates said catoptric
Cassegrain objective subassembly, said optical system, and said array about said roll axis.
11. An electro-optical roll framing camera with electronic roll motion compensation, said camera for installation in an aerial recom aissance vehicle, comprising: a electro-optical detector comprising a two-dimensional array of photosensitive cells, said array of cells storing pixel information and arranged in a plurality of rows and columns and having at least one readout register for reading out pixel information from said array; an optical system directing scene radiation onto said array, a servo-mechanical system coupling said camera to said vehicle adapted for continuously rotating said camera about a rotation axis to thereby direct scene information onto said optical system and said array: and rotation motion compensation circuitry electronically transferring pixel information in said array of photosensitive cells at a rate substantially matching the rate of image motion due to said rotation of said camera, whereby the resolution of images generated by said array may be preserved.
12. The camera of claim 11, wherein said camera is installed in said vehicle such that said servo-mechanical system continuously rotates said camera about an axis substantially parallel to the direction of forward motion of said vehicle.
13. The camera of claim 11, wherein said camera is installed in said vehicle such that said servo-mechanical system continuously rotates said camera about an axis substantially orthogonal to the direction of forward motion of said vehicle
14. The camera of claim 11, wherein said array generates imagery in a single band of the electro-magnetic spectrum.
15. The camera of claim 11 , wherein said camera includes a second electro-optical detector and wherein said camera generates imagery in two bands of the electromagnetic spectrum simultaneously from said first and second detectors.
16. The camera of claim 11, wherein said camera includes a hyperspectral electro- optical detector and optical system.
17. The camera of claim 11, wherein said optical system further comprises a derotation prism.
18. The camera of claim 11, wherein said optical system further comprises a derotation mirror.
19. The method of claim 11, wherein the camera further comprise a catoptric
Cassegrain objective lens, wherein said servo-mechanical system rotates said catoptric Cassegrain objective lens, said optical system, and said array about said rotation axis.
20. A method of generating a frame of imagery of a scene of interest by an aerial recomiaissance camera installed in a moving airborne vehicle, said camera comprising an optical system and at least one framing image recording medium, said optical system and framing image recording medium incorporated into a camera housing mounted to the vehicle, comprising the steps of: (1) continuously rotating the camera housing, including said optical system and said framing image recording medium, about a roll axis parallel to the roll axis of said vehicle;
(2) simultaneously and independently rotating said optical system in an direction orthogonal to said roll axis and in a direction of flight of said vehicle to thereby compensate for forward motion of said vehicle;
(3) while said camera is rotating about said roll axis and said optical system is rotating in said direction of flight, exposing said image recording medium to radiation from said scene to thereby generate said frame of imagery; and (4) compensating for the roll motion of said camera housing to thereby prevent blurring of an image generated by said framing image recording medium due to said roll motion.
21. The method of claim 20, wherein said framing image recording medium is exposed to said scene in a series of exposures as said camera continuously rotates about said roll axis.
22. The method of claim 20, wherein said series of exposures overlap in the cross-line of flight direction.
23. The method of claim 20, wherein said camera incorporates a spectrum dividing element and a second framing image recording medium, and wherein said camera operates to generate two frames of imagery of said scene in two different portions of the electromagnetic spectrum simultaneously.
24. The method of claim 20, wherein said optical system forms an image at an image plane, and wherein said optical system comprises a Cassegrain optical system having a primary mirror, a secondary mirror rigidly coupled to said primary mirror, and a flat azimuth mirror located in the optical path between the secondary mirror and the Cassegrain image plane.
25.' The method of claim 24, wherein to compensate for forward motion of said vehicle said said primary and secondary mirrors are rotated in the flight direction at a rate equal to V/R (in units of radians per second) where V is the velocity of aerial reconnaissance vehicle and R is either the range to the scene of interest or an approximation of said range, and wherein said azimuth mirror rotates at a rate equal to lA (V/R) in the same direction as the rotation of said primary and secondary mirrors.
26. The method of claim 20, wherein said image recording medium comprises a two dimensional area framing array electro-optical detector.
27. The method of claim 23, wherein both of said framing image, recording media comprise two dimensional array electro-optical detectors, one of said electro-optical detectors sensitive to radiation in the visible portion of the electromagnetic spectrum and wherein the other of said electro-optical detectors is sensitive to radiation in the infrared portion of the electromagnetic spectrum.
28. The method of claim 27, wherein the detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is sensitive to radiation having a wavelength of between 1.0 and 2.5 microns, 3.0 and 5.0 microns, or 8.0 and 14.0 microns.
29. The method of claim 27, wherein said electro-optical detectors comprise an array of pixel elements arranged in a plurality of rows and columns, compensation for roll motion of said camera housing is performed by electronic circuitry transferring pixel information in said electro-optical detectors from row to adjacent row at a pixel information transfer rate substantially equal to the rate of image motion in the plane of said electro-optical detectors due to roll of said camera housing.
30. The method as claimed in claim 20, wherein said image recording medium comprises photo-sensitive film.
31. The method of claim 30, wherein compensation for roll motion of said camera housing is performed by moving the film at a rate substantially equal to the rate of image motion in the plane of said film due to roll of said camera housing.
32. The method of claim 20, wherein said camera further comprises: a spectrum dividing element receiving radiation from said optical system, said element directing radiation in a first band of the electromagnetic spectrum into a first optical path and directing radiation in a second band of the electromagnetic spectrum into a second optical path different from said first optical path; a first two-dimensional image recording medium in said first optical path for generating frames of imagery in said first band of the electromagnetic spectrum; and a second two-dimensional image recording medium in said second optical path for generating frames of imagery in said second band of the electromagnetic spectrum; a first motor system coupled to said camera housing rotating said camera housing about a first axis, said camera housing installed in said aerial reconnaissance vehicle such that said first axis of rotation is parallel to the roll axis of said aerial recomiaissance vehicle, wherein said image recording media are exposed to said scene to generate frames of imagery as said first motor system rotates said camera housing in a continuous fashion about said first axis, said first and second image recording media having a means for compensating for image motion due to said rotation of said camera housing; and a second motor system coupled to said optical system, said second motor system rotating said optical system about a second axis in the direction of forward motion of said vehicle to compensate for forward motion of said aerial reconnaissance vehicle.
33. A method for dual band framing reconnaissance in which frames of imagery of a scene of interest are taken by an aerial reconnaissance camera installed in a moving airborne vehicle, said camera comprising a Cassegrain optical system, a first framing image recording medium and a second framing image recording medium, said Cassegrain optical system and said first and second framing image recording media incorporated into a camera housing mounted to the vehicle, the method comprising the steps of: 1) continuously rotating the camera housing, including said optical system and said first and second framing image recording media, from a first position to a second position about a roll axis parallel to the roll axis of said vehicle; 2) dividing radiation from a scene of interest into two different optical paths including a first optical path and a second optical path, said first framing image recording medium placed in said first optical path and said second framing image recording medium placed in said second optical path; 3) simultaneously and independently rotating said Cassegrain optical system in an direction orthogonal to said roll axis and in a direction of flight of said vehicle to thereby compensate for forward motion of said vehicle;
4) while said camera is rotating about said roll axis and said Cassegrain optical system is rotating in said direction of flight, exposing said image recording media to radiation from said scene in a series of exposures to thereby generate said frames of imagery; and
5) compensating for the roll motion of said camera housing to thereby prevent smearing of an image generated by said first and second framing image recording media due to said roll motion.
34. The method of claim 33, further comprising the step of returning said camera housing to said first roll position after it has rotated from said first roll position to said second roll position, and thereafter repeating steps 1, 2, 3, 4 and 5.
35. The method of claim 33, wherein during said rotation of said camera housing from said first roll position to said second roll position, said first and second image recording media are exposed N times, where N is an integer number of frames between 2 and 20.
36. The method of claim 33, wherein the angular difference between said first roll position and said second roll position is less than 10 degrees.
37. The method of claim 33, wherein said camera is rotated through nadir.
38. The method of claim 33, wherein said series of exposures overlap in the cross-line of flight direction.
39. The method of claim 33, wherein said Cassegrain optical system forms an image at a Cassegrain image plane, and wherein said Cassegrain optical system comprises a primary mirror, a secondary mirror rigidly coupled to said primary mirror, and a flat azimuth mirror located in the optical path between the secondary mirror and the Cassegrain image plane.
40. The method of claim 39, wherein to compensate for forward motion of said vehicle said primary and secondary mirrors are rotated in the flight direction at a rate equal to V/R (in units of radians per second) where V is the velocity of aerial reconnaissance vehicle and R is either the range to the scene of interest or an approximation of said range, and wherein said azimuth mirror rotates at rate equal to V_ (V/R) in the same direction as the rotation of said primary and secondary mirrors.
41. The method of claim 33, wherein said first and second framing image recording media comprise two-dimensional array electro-optical detectors, one of said electro-optical detectors sensitive to radiation in the visible portion of the electromagnetic spectrum and wherein the other of said electro-optical detectors is sensitive to radiation in the infrared portion of the electromagnetic spectrum.
42. The method of claim 41, wherein the detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is sensitive to radiation having a wavelength of between 1.0 and 2.5 microns, 3.0 and 5.0 microns, or 8.0 and 14.0 microns.
43. The method of claim 41, wherein said electro-optical detectors comprise an array of pixel elements arranged in a plurality of rows and columns, and wherein compensation for roll motion of said camera housing is performed by electronic circuitry transferring pixel information in said electro-optical detectors from row to adjacent row at a pixel information transfer rate substantially equal to the rate of image motion in the plane of said electro-optical detectors due to roll of said camera housing.
44. A method for imaging a scene with a framing camera installed in an aerial reconnaissance vehicle, the camera comprising a two dimensional array of photosensitive cells, said array of cells storing pixel information and arranged in a plurality of rows and columns, a scan head directing scene radiation onto said array, and a mechanism for rotating said scan head about a rotation axis in a continuous manner, comprising the steps of: (a) continuously rotating said scan head about said rotation axis with said roll mechanism to thereby direct an image containing scene information towards said two dimensional array;
(b) derotating said image containing scene information;
(c) while said scan head is continuously rotating, transferring pixel information in said array at a rate substantially equal to an image motion rate;
(d) reading out said pixel information from said array; and
(e) repeating said steps (b), (c) and (d) while said vehicle flies past a scene of interest and while said scan head continuously rotates about said rotation axis.
45. The method of claim 44, wherein said step of continuously rotating comprises the step of rotating said scan head about an axis substantially parallel to the direction of forward motion of said aerial reconnaissance vehicle.
46. The method of claim 44, wherein said step of continuously rotating comprises the step of rotating said scan head about an axis in the direction substantially orthogonal to the direction of forward motion of said aerial reconnaissance vehicle.
47. The method of claim 44, wherein said steps (a), (b), (c), and (d) and (e) are performed in a series of cycles as said aircraft flies past a scene of interest.
48. A method for imaging a scene with a framing camera installed in an aerial reconnaissance vehicle, the camera comprising a two dimensional array of photosensitive cells, said array of cells storing pixel information and arranged in a plurality of rows and columns, a scan head directing scene radiation onto said array, and a mechanism for rotating said scan head about a rotation axis in a continuous manner, comprising the steps of :
(a) continuously rotating said scan head about said rotation axis with said roll mechanism to thereby direct an image containing scene information towards said two dimensional array; (b) rotating said two dimensional array in synchronism with said rotation of said scan head to thereby derotate said image containing scene information; (c) while said scan head and said two dimensional array are continuously rotating, transferring pixel information in said array at a rate substantially equal to an image motion rate due to said rotation of said scan head;
(d) reading out said pixel information from said array; and (e) repeating said steps (b), (c) and (d) while said vehicle flies past a scene of interest and while said scan head continuously rotates about said rotation axis.
49. The method of claim 48, wherein said step of continuously rotating comprises the step of rotating said scan head about an axis substantially parallel to the direction of forward motion of said aerial reconnaissance vehicle.
50. The method of claim 48, wherein said step of continuously rotating comprises the step of rotating said scan head about an axis in the direction substantially orthogonal to the direction of forward motion of said aerial reconnaissance vehicle.
51. The method of claim 48, wherein said steps (a), (b), (c), and (d) and (e) are performed in a series of cycles as said aircraft flies past a scene of interest.
52. A dual band framing aerial reconnaissance camera for installation in an aerial reconnaissance vehicle, comprising;
(a) an optical system incorporated into a camera housing, comprising:
(1) an objective optical subassembly for receiving incident radiation from a scene external of said vehicle; (2) a spectrum dividing element receiving radiation from said objective optical subassembly, said element directing radiation in a first band of the electromagnetic spectrum into a first optical path and directing radiation in a second band of the electromagnetic spectrum into a second optical path different from said first optical path; (3) a first two-dimensional image recording medium in said first optical path for generating frames of imagery in said first band of the electromagnetic spectrum; and
(4) a second two-dimensional image recording medium in said second optical path for generating frames of imagery in said second band of the electromagnetic spectrum;
(b) a first motor system coupled to said camera housing rotating said camera about a first axis, said camera housing installed in said aerial reconnaissance vehicle such that said first axis of rotation is parallel to the roll axis of said aerial reconnaissance vehicle, wherein said image recording media are exposed to said scene to generate frames of imagery as said first motor system rotates said camera in a continuous fashion about said first axis, said first and second image recording media having a means for compensating for image motion due to said rotation of said camera; and
(c) a second motor system coupled to said objective optical subassembly, said second motor system rotating said objective optical subassembly about a second axis in the direction of forward motion of said vehicle to compensate for forward motion of said aerial reconnaissance vehicle.
53. The camera of claim 52, wherein said first and second image recording media comprise two dimensional area array electro-optical detectors.
54. The camera of claim 53, wherein one of said electro-optical detectors is sensitive to radiation in the ultraviolet (UV) and/or visible portion of the electromagnetic spectrum and wherein the other of said electro-optical detectors is sensitive to radiation in the infrared portion of the electromagnetic spectrum.
55. The camera of claim 54, wherein the detector sensitive to radiation in the infrared portion of the electromagnetic spectrum is sensitive to radiation having a wavelength of between 1.0 to 2.5 microns, 3.0 and 5.0 microns, or 8.0 to 14.0 microns.
56. The camera as claimed in claim 53, wherein said electro-optical detectors comprise an array of pixel elements arranged in a plurality of rows and columns, and wherein said means for compensation for roll motion of said camera housing comprises electronic circuitry for transferring pixel information in said electro-optical detectors from row to adjacent row at a pixel information transfer rate substantially equal to the rate of image motion in the plane of said electro-optical detectors due to roll of said camera housing.
57. The camera as claimed in claim 5, wherein said camera further comprises a camera control computer calculating said pixel information transfer rate from system inputs
comprising/ the focal length of said optical system, and ω, the rate of rotation of said camera
housing about said roll axis.
58. The camera as claimed in claim 52, wherein at least one of said image- recording media comprises photosensitive film.
59. The camera as claimed in claim 58, wherein said means for compensating for roll motion of said camera housing comprises a mechanism for moving said film at a rate substantially equal to the rate of image motion in the plane of said film due to roll of said camera housing.
60. The camera as claimed in claim 59, wherein said camera further comprises a camera control computer calculating said rate of movement of said film from system inputs
comprising/ the focal length of said optical system, and ω, the rate of rotation of said camera
housing about said roll axis.
61. The camera as claimed in claim 52, wherein said objective optical subassembly comprises a catoptric Cassegrain optical system which forms an image at a Cassegrain image plane, and wherein said catoptric Cassegrain optical system comprises a primary mirror, a secondary mirror rigidly coupled to said primary mirror, and a flat azimuth mirror located in the optical path between the secondary mirror and the Cassegrain image plane.
62. The camera as claimed in claim 61, wherein said second motor system comprises a Cassegrain motor coupled to said primary mirror, said secondary mirror and said azimuth mirror, and wherein to compensate for forward motion of said vehicle said Cassegrain motor rotates said primary and secondary mirrors in the flight direction at a rate equal to V/R where V is the velocity of aerial reconnaissance vehicle and R is either the range to the scene of interest or an approximation of said range, and rotates said azimuth mirror at rate equal to lA (V/R) in the same direction as the rotation of said primary and secondary mirrors due to said Cassegrain motor.
63. The camera as claimed in claim 62, wherein the value of R is derived from the height of said vehicle above the earth and a camera depression angle below a horizontal reference frame.
64. The camera as claimed in claim 63, wherein the value of R is derived using a range finder on board the vehicle.
65. The camera as claimed in claim 63, wherein the value of R is derived from a global positioning system.
66. The camera as claimed in claim 63, wherein the value of R is derived from processing successive frames of imagery from at least one of said image-recording media.
67. The camera of claim 63, wherein said secondary mirror is centrally located in the entrance aperture of said catoptric Cassegrain optical system.
68. The camera as claimed in claim 52, wherein said optical system has an overall focal length of between 50 and 100 inches and a f/number of between 4.0 and 8.0.
69. The camera as claimed in claim 52, further comprising a camera control computer operative of said image recording media and said first and second motor systems to generate a series of overlapping frames of imagery across the line of flight of said vehicle as said camera housing is rotated about said first axis, and wherein each of said overlapping frames of imagery is recorded in two different portions of said electromagnetic spectrum by said first and second image recording media.
70. The camera as claimed in claim 69, wherein said camera further comprises a spot mode of operation, said camera control computer in said spot mode of operation operative of said first and second motor systems to orient said Cassegrain optical system at a selected camera depression angle below a horizontal reference plane and fore/aft azimuth angle, and operative of said first and second image recording media to generate first and second frames of imagery of said scene at said camera depression angle and fore/aft azimuth angle.
71. A framing aerial reconnaissance camera for installation in an aerial reconnaissance vehicle, comprising;
(a) an optical system incorporated into a camera housing, comprising:
(1) an objective optical subassembly receiving incident radiation from a scene external of said vehicle;
(2) an optical channel receiving radiation from said objective optical subassembly, and
(3) a two-dimensional image recording medium in said optical channel for generating frames of imagery in a band of the electromagnetic spectrum, said optical channel including one or more optical elements focusing radiation from said scene on said two-dimensional image recording medium;
(b) a first motor system coupled to said camera housing rotating said camera about a first axis, said camera housing installed in said aerial reconnaissance vehicle such that said first axis of rotation is parallel to the roll axis of said aerial reconnaissance vehicle, wherein said image recording medium is exposed to said scene to generate frames of imagery as said first motor system rotates said camera in a continuous fashion about said first axis, said image recording medium having a means for compensating for image motion due to said rotation of said camera housing; and
(c) a second motor system coupled to said objective optical subassembly, said second motor system rotating said objective optical subassembly about a second axis in the direction of forward motion of said vehicle about an axis to compensate for forward motion of said aerial reconnaissance vehicle.
72. The camera of claim 71, wherein said image recording medium comprises a two-dimensional area array electro-optical detector.
73. The camera of claim 72, wherein said electro-optical detector is sensitive to radiation in the ultraviolet and/or visible portion of the electromagnetic spectrum.
74. The camera of claim 71, wherein said electro-optical detector is sensitive to radiation in the infrared portion of the electromagnetic spectrum.
75. The camera of claim 71, wherein said electro-optical is sensitive to radiation having a wavelength of between 1.0 to 2.5 microns, 3.0 and 5.0 microns, or 8.0 to 14.0 microns.
76. The camera as claimed in claim 73, wherein electro-optical detector comprises an array of pixel elements arranged in a plurality of rows and columns, and wherein said means for compensation for roll motion of said camera housing comprises electronic circuitry for transferring pixel information in said electro-optical detector from row to adjacent row at a pixel information transfer rate substantially equal to the rate of image motion in the plane of said electro-optical detector due to roll of said camera housing.
77. The camera as claimed in claim 76, wherein said camera further comprises a camera control computer calculating said pixel information transfer rate from system inputs comprising/ the focal length of said optical system, and ω, the rate of rotation of said camera
housing about said roll axis.
78. The camera as claimed in claim 70, wherein said image recording medium comprises photosensitive film.
79. The camera as claimed in claim 78, wherein said means for compensating for roll motion of said camera housing comprises a mechanism for moving said film at a rate substantially equal to the rate of image motion in the plane of said film due to roll of said camera housing.
80. The camera as claimed in claim 79, wherein said camera further comprises a camera control computer calculating said rate of movement of said film from system inputs
comprising/ the focal length of said optical system, and ω, the rate of rotation of said camera
housing about said roll axis.
81. The camera as claimed in claim 71, wherein said objective optical subassembly comprises a Cassegrain optical system forms an image at a Cassegrain image plane, and wherein said Cassegrain optical system comprises a primary mirror, a secondary mirror rigidly coupled to said primary mirror, and a flat azimuth mirror located in the optical path between the secondary minor and the Cassegrain image plane.
82. The camera as claimed in claim 81, wherein said second motor system comprises a Cassegrain motor coupled to said primary mirror and said azimuth mirror, and wherein to compensate for forward motion of said vehicle said Cassegrain motor rotates said primary and secondary mirrors in the flight direction at a rate equal to V/R where V is the velocity of aerial recomiaissance vehicle and R is either the range to the scene of interest or an approximation of said range, and wherein said azimuth mirror is rotated at rate equal to Vi (N/R) in the same direction as the rotation of said primary and secondary mirrors due to said Cassegrain motor.
83. The camera as claimed in claim 82, wherein the value of R is derived from the height of said vehicle above the earth and a camera depression angle below a horizontal reference frame.
84. The camera as claimed in claim 82, wherein the value of R is derived using a range finder on board the vehicle.
85. The camera as claimed in claim 82, wherein the value of R is derived from a global positioning system.
86. The camera as claimed in claim 82, wherein the value of R is derived from a processing of successive images generated by at least one of said image-recording media.
87. The camera as claimed in claim 71, wherein said optical system has an overall focal length of between 50 and 100 inches and a f/number of between 4.0 and 8.0.
88. The camera as claimed in claim 71, further comprising a camera control computer operative of said image recording medium and said first and second motor systems to generate a series of overlapping frames of imagery across the line of flight of said vehicle as said camera housing is rotated about said first axis.
89. The camera as claimed in claim 88, wherein said camera further comprises a spot mode of operation, said camera control computer in said spot mode of operation operative of said first motor systems to orient said objective optical subassembly at a selected camera depression angle about the roll axis of said vehicle and fore/aft azimuth angle, and operative of said first and second image recording media to generate first and second frames of imagery of said scene at said camera depression angle and fore/aft azimuth angle.
90. The camera as claimed in claim 81, wherein said secondary mirror is centrally located in the entrance aperture of said Cassegrain optical system.
91. A framing aerial reconnaissance camera for installation in an aerial reconnaissance vehicle, comprising;
(a) an optical system incorporated into a camera housing, comprising:
(1) a Cassegrain optical system for receiving incident radiation from a scene external of said vehicle;
(2) an optical channel receiving radiation from said Cassegrain optical system, and
(3) a two-dimensional electro-optical detector in said optical channel for generating frames of imagery in a band of the electromagnetic spectrum, said optical channel including one or more optical elements focusing radiation from said scene on said two-dimensional electro-optical detector; (b) a first motor system coupled to said camera housing rotating said camera about a first axis, said camera housing installed in said aerial reconnaissance vehicle such that said first axis of rotation is parallel to the roll axis of said aerial reconnaissance vehicle, wherein said detector is exposed to said scene to generate frames of imagery as said first motor system rotates said camera in a continuous fashion about said first axis, and
(c) a second motor system coupled to said Cassegrain optical system, said second motor system rotating said Cassegrain optical system about a second axis in the direction of forward motion of said vehicle about an axis to compensate for forward motion of said aerial reconnaissance vehicle, wherein said electro-optical detector comprises an array of pixel elements arranged in a plurality of rows and columns, and wherein said detector further comprises electronic circuitry coupled to said array transferring pixel information in array from row to adjacent row at a pixel information transfer rate substantially equal to the rate of image motion in the plane of said electro-optical detectors due to roll of said camera; said electronic circuitry and said second motor system operative to achieve roll motion compensation and forward motion compensation simultaneously in said aπay to thereby enable high resolution images to be obtained from said electro-optical detector.
92. The camera as claimed in claim 91, wherein said camera further comprises a camera control computer calculating said pixel information transfer rate from system inputs
comprising/ the focal length of said optical system, and ω, the rate of rotation of said camera
housing about said roll axis.
93. A method of generating frames of imagery of a scene of interest with an aerial reconnaissance camera in two different bands of the electromagnetic spectrum simultaneously, comprising the steps of: providing two photosensitive electro-optical detectors in said camera, each of said detectors comprising an array of pixel elements arranged in a plurality of rows and columns; rotating said camera in a continuous fashion about a roll axis either coincident with or parallel to a roll axis of an aerial reconnaissance vehicle carrying said camera; while rotating said camera, simultaneously exposing said electro-optical detectors to a scene of interest in a series of exposures; while rotating said camera and while exposing said electro-optical detectors to said scene, rotating an optical system providing an objective lens for said camera in the direction of forward motion of said vehicle at a predetermined rate to cancel out image motion due to forward motion of said vehicle; and while said electro-optical detectors are being exposed to said scene, moving pixel information in said arrays at a rate and in a direction substantially equal to the rate of image motion due to rotation of said camera about said roll axis to thereby preserve resolution of an image generated by said detectors.
94. In aerial reconnaissance photography, a method of compensating for forward motion of a reconnaissance aircraft while generating a frame of imagery of a scene of interest by a camera installed in said aircraft, said camera comprising (a) an Cassegrain optical system having a primary mirror, a secondary mirror fixedly mounted relative to said primary minor, and a flat azimuth mirror positioned in the optical path between said primary mirror and said secondary mirror, and (b) at least one framing image recording medium, said Cassegrain optical system and framing image recording medium incorporated into a camera housing mounted to the vehicle, said camera housing defining an axis; comprising the steps of: (1) orienting said camera housing such that said camera housing is substantially parallel to the roll axis of said aircraft;
(2) rotating said primary minor and secondary minor about an axis orthogonal to said roll axis in the direction of flight of said aircraft, while maintaining said image recording medium in a fixed condition relative to said camera housing; and
(3) while rotating said primary minor and secondary minor as recited in step (2), rotating said azimuth minor in the direction of flight at a rate one half the rate of said rotation in step (2).
95. The method of claim 94, wherein said azimuth minor is rotated about an axis coincident with the axis about which said primary and secondary minors are rotated.
96. The method of claim 94, wherein said azimuth minor is located substantially at the center of said primary minor.
97. The method of claim 94, wherein said azimuth minor is coupled to a mounting plate, said mounting plat containing a gyroscope.
98. The method of claim 94, wherein said method is performed in a camera implementing a pan-framing technique for generating sequential images of a tenain of interest wherein said camera housing is continuously rotated about a roll axis.
99. The method of claim 94, wherein said camera includes first and second electro-optical detectors and first and second optical paths for different portions of the electromagnetic spectrum, said detectors generating frames of imagery of the scene of interest in two different portions of the electro-magnetic spectrum simultaneously.
100. An aerial reconnaissance camera with forward motion compensation, comprising; a Cassegrain optical system having a primary minor, a secondary minor fixedly mounted relative to said primary minor, and a flat azimuth minor positioned in the optical path between primary minor and said secondary minor; at least one framing image recording medium, said Cassegrain optical system and framing image recording medium incorporated into a camera housing for mounting to an aerial reconnaissance vehicle, said camera housing defining an axis; a motor having a first portion fixed with respect to said camera housing and a movable portion coupled to said primary minor, wherein said motor rotates said primary minor and said secondary minor about an axis in the direction of flight at a rate substantially equal to N/R, wherein N comprises the forward velocity of the vehicle and R comprises the range to the scene of interest or an approximation of said range; and wherein said azimuth minor is rotated about an axis in the direction of flight at a rate substantially equal to Vi N/R.
101. The camera of claim 100, wherein said azimuth minor is rotated by said motor.
102. The camera of claim 100, wherein said azimuth minor is placed at substantially the center of said primary minor.
103. The camera of claim 100, wherein said azimuth minor is coupled to a mounting plate, said mounting plate containing a gyroscope.
104. A dual band optical system for a framing aerial reconnaissance camera, said camera including at least two two-dimensional image recording media for generating frames of imagery of a scene external of an aerial reconnaissance vehicle carrying said camera, comprising;
(a) a Cassegrain optical system forming an objective lens for said optical system, said Cassegrain optical system receiving incident radiation from said scene and comprising a primary minor having a central aperture and a secondary minor, said primary and secondary minors aligned along an objective optical axis; (b) an azimuth minor receiving radiation from said secondary minor, said azimuth minor placed between said secondary minor and a Cassegrain image plane and directing radiation in a direction away from said objective optical axis; and
(c) a spectrum dividing element receiving radiation from said' azimuth minor, said element directing radiation in a first band of the electromagnetic spectrum into a first optical path and directing radiation in a second band of the electromagnetic spectrum into a second optical path different from said first optical path;
(d) wherein a first two-dimensional image recording medium is placed in said first optical path and a second two-dimensional image recording medium is placed in said second optical path, said first and second image recording media generating first and second images in two different portions of the electromagnetic spectrum simultaneously.
105. The dual band optical system of claim 104, wherein said aerial reconnaissance vehicle comprises a roll axis and wherein said first and second paths are oriented and extend for a spatial extent generally in the direction of said roll axis, and wherein said objective optical axis is substantially orthogonal to said roll axis, whereby said dual band optical system provides a compact anangement for said camera.
106. The dual band optical system of claim 104, wherein said first path comprises a visible spectrum path and wherein said second path comprises an infrared path, and wherein said visible spectrum path defines an axis which intersects said objective optical axis at a point, said azimuth minor located at said point.
107. The dual band optical system of claim 105, wherein said Cassegrain optical system is coupled to a motor, said motor rotating said primary and secondary minors about a rotation axis substantially orthogonal to said roll axis, and wherein said azimuth minor is rotated about said rotation axis, the rotation of said azimuth minor and said Cassegrain optical system providing a technique for compensation for forward motion of said aerial reconnaissance vehicle.
108. The dual band optical system of claim 104, wherein said optical system has an f/number of between 4 and 8 and a focal length of between 50 and 100 inches.
109. The dual band optical system of claim 104, wherein said Cassegrain optical system, azimuth minor, spectrum dividing element and first and second optical paths are incorporated into an aerial reconnaissance camera housing, and wherein said housing is coupled to a roll motor and to said aerial reconnaissance vehicle, said roll motor rotating said housing about the roll axis of said aerial reconnaissance vehicle.
110. The dual band optical system of claim 104, wherein said first and second image recording media comprise two-dimensional area anay electro-optical detectors.
111. The dual band optical system of claim 104, wherein said first portion of the electromagnetic spectrum includes radiation with a wavelength of between 500 and 900 nm, and wherein said second portion of the electro-magnetic spectrum includes radiation with a wavelength of between 1.0 and 2.5 microns, 3.0 and 5.0 microns, or 8.0 and 14.0 microns.
112. The dual band optical system of claim 108 wherein to compensate for forward motion of said vehicle said motor rotates said primary and secondary minors in the flight direction at a rate equal to N/R (in units of radians per second) where N is the velocity of aerial reconnaissance vehicle and R is either the range to the scene of interest or an approximation of said range, and rotates said azimuth minor at rate equal to Vz (N/R) in the same direction as the rotation of said primary and secondary minors due to said motor.
113. The camera of claim 104, wherein said secondary minor is centrally located in the entrance aperture of said Cassegrain optical system.
114. A Cassegrain optical system for a framing aerial reconnaissance camera, said camera including a rigid camera housing, comprising: a primary minor receiving incident radiation from a scene external of said vehicle; a secondary minor receiving radiation from said primary minor; an azimuth minor positioned between said primary minor and said secondary minor; said primary and secondary minors defining an objective optical axis; a primary minor cell fixedly mounted to said camera housing; a primary minor holding ring receiving said primary minor and movable with respect to said primary minor cell; structure rigidly coupling said secondary minor to said primary minor; and a motor system coupled to said Cassegrain optical system adapted for rotating said primary minor, secondary minor and azimuth minor about an axis orthogonal to said objective optical axis.
115. The optical system of claim 114, wherein said camera further comprises a spectrum-dividing prism receiving radiation from said azimuth minor and separating said radiation into a first optical path and a second optical path, and wherein said first optical path includes a first two-dimensional image recording medium and wherein said second optical path includes a second two-dimensional image recording medium.
116. The optical system of claim 114, wherein said camera housing is coupled to said aerial reconnaissance vehicle by at least one roll motor which rotates said housing about the roll axis of said vehicle.
117. The optical system of claim 114, wherein said cassegrain optical system has a prescription substantially as set forth herein.
118. The optical system of claim 114, further comprising relay optics in said first and second optical paths having a prescription substantially as set forth in Tables 1 and 2.
PCT/US2001/023680 2000-08-31 2001-07-26 Dual band framing reconnaissance camera WO2002019030A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA002418917A CA2418917C (en) 2000-08-31 2001-07-26 Dual band framing reconnaissance camera
AU2002216609A AU2002216609A1 (en) 2000-08-31 2001-07-26 Dual band framing reconnaissance camera
EP01984574A EP1323001A4 (en) 2000-08-31 2001-07-26 Dual band framing reconnaissance camera with roll motion compensation

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US09/654,031 2000-08-31
US09/654,031 US6658207B1 (en) 2000-08-31 2000-08-31 Method of framing reconnaissance with motion roll compensation
US09/652,529 2000-08-31
US09/652,965 2000-08-31
US09/652,524 US6477326B1 (en) 2000-08-31 2000-08-31 Dual band framing reconnaissance camera
US09/652,965 US6366734B1 (en) 2000-08-31 2000-08-31 Method of forward motion compensation in an aerial reconnaissance camera
US09/652,524 2000-08-31
US09/652,529 US6374047B1 (en) 2000-08-31 2000-08-31 Cassegrain optical system for framing aerial reconnaissance camera

Publications (3)

Publication Number Publication Date
WO2002019030A1 true WO2002019030A1 (en) 2002-03-07
WO2002019030B1 WO2002019030B1 (en) 2002-06-27
WO2002019030A9 WO2002019030A9 (en) 2002-08-29

Family

ID=27505276

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/023680 WO2002019030A1 (en) 2000-08-31 2001-07-26 Dual band framing reconnaissance camera

Country Status (4)

Country Link
EP (1) EP1323001A4 (en)
AU (1) AU2002216609A1 (en)
CA (1) CA2418917C (en)
WO (1) WO2002019030A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007101276A1 (en) * 2006-03-03 2007-09-07 Honeywell International, Inc. Single lens splitter camera
WO2008002697A2 (en) * 2006-06-27 2008-01-03 Motorola Inc. Image capture device with rolling band shutter
WO2008065651A2 (en) 2006-11-30 2008-06-05 Visionmap Ltd. Digital mapping system based on continuous scanning line of sight
US8223235B2 (en) 2007-12-13 2012-07-17 Motorola Mobility, Inc. Digital imager with dual rolling shutters
CN104486535A (en) * 2014-12-29 2015-04-01 中国科学院长春光学精密机械与物理研究所 Frame transfer type CCD aerial camera scanning image motion compensation method
EP3204786A4 (en) * 2014-10-08 2017-08-16 Spookfish Innovations Pty Ltd. An aerial camera system
US11320637B2 (en) 2019-08-11 2022-05-03 Youngwan Choi Small form factor 4-mirror based imaging systems
US11579430B2 (en) 2019-08-11 2023-02-14 Youngwan Choi Small form factor, multispectral 4-mirror based imaging systems
US11668915B2 (en) 2019-08-11 2023-06-06 Youngwan Choi Dioptric telescope for high resolution imaging in visible and infrared bands

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200210676A1 (en) * 2018-12-27 2020-07-02 Simplex Mapping Solutions Sb Ltd. Compact interval sweeping imaging system and method

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5155597A (en) 1990-11-28 1992-10-13 Recon/Optical, Inc. Electro-optical imaging array with motion compensation
US5668593A (en) 1995-06-07 1997-09-16 Recon/Optical, Inc. Method and camera system for step frame reconnaissance with motion compensation
US5692062A (en) 1994-10-03 1997-11-25 Recon/Optical, Inc. Electro-optical imaging array with profiled foward motion compensation
US5798786A (en) 1996-05-07 1998-08-25 Recon/Optical, Inc. Electro-optical imaging detector array for a moving vehicle which includes two axis image motion compensation and transfers pixels in row directions and column directions
US5806789A (en) * 1995-08-22 1998-09-15 Lockheed Corporation Optical apparatus for an aircraft
US5925883A (en) 1997-07-25 1999-07-20 Raytheon Company Staring IR-FPA with CCD-based image motion compensation
US6130705A (en) * 1998-07-10 2000-10-10 Recon/Optical, Inc. Autonomous electro-optical framing camera system with constant ground resolution, unmanned airborne vehicle therefor, and methods of use
US6256057B1 (en) * 1996-11-05 2001-07-03 Lockhead Martin Corporation Electro-optical reconnaissance system with forward motion compensation
US6320611B1 (en) * 1996-08-23 2001-11-20 Thomson-Csf Method and device for air-ground recognition for optoelectronic equipment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5841574A (en) * 1996-06-28 1998-11-24 Recon/Optical, Inc. Multi-special decentered catadioptric optical system
DE19902081A1 (en) * 1999-01-20 2000-07-27 Zeiss Carl Fa Stabilized camera

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5155597A (en) 1990-11-28 1992-10-13 Recon/Optical, Inc. Electro-optical imaging array with motion compensation
US5692062A (en) 1994-10-03 1997-11-25 Recon/Optical, Inc. Electro-optical imaging array with profiled foward motion compensation
US5668593A (en) 1995-06-07 1997-09-16 Recon/Optical, Inc. Method and camera system for step frame reconnaissance with motion compensation
US5806789A (en) * 1995-08-22 1998-09-15 Lockheed Corporation Optical apparatus for an aircraft
US5798786A (en) 1996-05-07 1998-08-25 Recon/Optical, Inc. Electro-optical imaging detector array for a moving vehicle which includes two axis image motion compensation and transfers pixels in row directions and column directions
US6088055A (en) * 1996-05-07 2000-07-11 Recon /Optical, Inc. Electro-optical imaging array and camera system with pitch rate image motion compensation
US6320611B1 (en) * 1996-08-23 2001-11-20 Thomson-Csf Method and device for air-ground recognition for optoelectronic equipment
US6256057B1 (en) * 1996-11-05 2001-07-03 Lockhead Martin Corporation Electro-optical reconnaissance system with forward motion compensation
US5925883A (en) 1997-07-25 1999-07-20 Raytheon Company Staring IR-FPA with CCD-based image motion compensation
US6130705A (en) * 1998-07-10 2000-10-10 Recon/Optical, Inc. Autonomous electro-optical framing camera system with constant ground resolution, unmanned airborne vehicle therefor, and methods of use

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of EP1323001A4
THOMAS C. AUGUSTYN: "The KS-146A LOROP Camera System", SPIE PROCEEDINGS, vol. 9, 27 August 1981 (1981-08-27), pages 76

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2448653B (en) * 2006-03-03 2011-03-23 Honeywell Int Inc Single lens splitter camera
WO2007101276A1 (en) * 2006-03-03 2007-09-07 Honeywell International, Inc. Single lens splitter camera
GB2448653A (en) * 2006-03-03 2008-10-22 Honeywell Int Inc Single lens splitter camera
WO2008002697A2 (en) * 2006-06-27 2008-01-03 Motorola Inc. Image capture device with rolling band shutter
WO2008002697A3 (en) * 2006-06-27 2008-04-17 Motorola Inc Image capture device with rolling band shutter
CN101479660B (en) * 2006-06-27 2011-12-28 摩托罗拉移动公司 Image capture device with rolling band shutter
US7830565B2 (en) 2006-06-27 2010-11-09 Motorola, Inc. Image capture device with rolling band shutter
EP2095622A4 (en) * 2006-11-30 2013-11-06 Visionmap Ltd Digital mapping system based on continuous scanning line of sight
EP2095622A2 (en) * 2006-11-30 2009-09-02 Visionmap Ltd. Digital mapping system based on continuous scanning line of sight
WO2008065651A2 (en) 2006-11-30 2008-06-05 Visionmap Ltd. Digital mapping system based on continuous scanning line of sight
US8223235B2 (en) 2007-12-13 2012-07-17 Motorola Mobility, Inc. Digital imager with dual rolling shutters
US11310427B2 (en) 2014-10-08 2022-04-19 Spookfish Innovations Pty Ltd Aerial camera system
EP3204786A4 (en) * 2014-10-08 2017-08-16 Spookfish Innovations Pty Ltd. An aerial camera system
EP3657195A1 (en) * 2014-10-08 2020-05-27 Spookfish Innovations Pty Ltd. An aerial camera system
AU2020200592B2 (en) * 2014-10-08 2021-11-04 Spookfish Innovations Pty Ltd An aerial camera system
US11265472B2 (en) 2014-10-08 2022-03-01 Spookfish Innovations Pty Ltd Aerial camera system
US11962903B2 (en) 2014-10-08 2024-04-16 Spookfish Innovation PTY LTD Aerial camera system
CN104486535B (en) * 2014-12-29 2017-07-14 中国科学院长春光学精密机械与物理研究所 Frame transfer type CCD aerial cameras scan IMC method
CN104486535A (en) * 2014-12-29 2015-04-01 中国科学院长春光学精密机械与物理研究所 Frame transfer type CCD aerial camera scanning image motion compensation method
US11320637B2 (en) 2019-08-11 2022-05-03 Youngwan Choi Small form factor 4-mirror based imaging systems
US11579430B2 (en) 2019-08-11 2023-02-14 Youngwan Choi Small form factor, multispectral 4-mirror based imaging systems
US11668915B2 (en) 2019-08-11 2023-06-06 Youngwan Choi Dioptric telescope for high resolution imaging in visible and infrared bands

Also Published As

Publication number Publication date
EP1323001A1 (en) 2003-07-02
CA2418917C (en) 2007-03-06
WO2002019030A9 (en) 2002-08-29
CA2418917A1 (en) 2002-03-07
WO2002019030B1 (en) 2002-06-27
AU2002216609A1 (en) 2002-03-13
EP1323001A4 (en) 2007-01-31

Similar Documents

Publication Publication Date Title
US6477326B1 (en) Dual band framing reconnaissance camera
US6658207B1 (en) Method of framing reconnaissance with motion roll compensation
US6366734B1 (en) Method of forward motion compensation in an aerial reconnaissance camera
US6130705A (en) Autonomous electro-optical framing camera system with constant ground resolution, unmanned airborne vehicle therefor, and methods of use
US6747686B1 (en) High aspect stereoscopic mode camera and method
US6374047B1 (en) Cassegrain optical system for framing aerial reconnaissance camera
EP0897596B1 (en) Electro-optical imaging detector array with two axis image motion compensation
CA2219813C (en) Electro-optical step-frame camera system with image motion compensation
US5155597A (en) Electro-optical imaging array with motion compensation
AU2015243032B2 (en) Wide-area aerial camera systems
US5692062A (en) Electro-optical imaging array with profiled foward motion compensation
US4527055A (en) Apparatus for selectively viewing either of two scenes of interest
US4989086A (en) Ultra wide field-of-regard multispectral imaging radiometer
US10670853B2 (en) Imaging system with an optical path and telescope shape optimized for nanosatellites
CA2418917C (en) Dual band framing reconnaissance camera
US6320611B1 (en) Method and device for air-ground recognition for optoelectronic equipment
Lareau Electro-optical imaging array with motion compensation
Lareau Optimum coverage EO framing camera
Hoefft et al. Multispectral EO LOROP camera
Uhl Digital EO camera system VOS 40/270 for tactical reconnaissance pod RecceLite

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: B1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: B1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

COP Corrected version of pamphlet

Free format text: PAGE 1, DESCRIPTION, REPLACED BY A NEW PAGE 1; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2418917

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2001984574

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001984574

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: JP