CA1314624C - System for geological defect detection utilizing composite video-infrared thermography - Google Patents

System for geological defect detection utilizing composite video-infrared thermography

Info

Publication number
CA1314624C
CA1314624C CA000612415A CA612415A CA1314624C CA 1314624 C CA1314624 C CA 1314624C CA 000612415 A CA000612415 A CA 000612415A CA 612415 A CA612415 A CA 612415A CA 1314624 C CA1314624 C CA 1314624C
Authority
CA
Canada
Prior art keywords
video
infrared
data
image
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CA000612415A
Other languages
French (fr)
Inventor
Gary J. Weil
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Entech Engineering Inc
Original Assignee
Entech Engineering Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Entech Engineering Inc filed Critical Entech Engineering Inc
Application granted granted Critical
Publication of CA1314624C publication Critical patent/CA1314624C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V9/00Prospecting or detecting by methods not provided for in groups G01V1/00 - G01V8/00
    • G01V9/005Prospecting or detecting by methods not provided for in groups G01V1/00 - G01V8/00 by thermal methods, e.g. after generation of heat by chemical reactions

Abstract

SYSTEM FOR GEOLOGICAL DEFECT DETECTION
UTILIZING COMPOSITE VIDEO-INFRARED THERMOGRAPHY

ABSTRACT

A selectively mobile system with an infrared scanner and video camera having a common area of focus and apparatus for detecting location permits detection of subterranean geological anomalies. Infrared and visual images are simultaneously successively recorded on videotape together with related location data and other relevant information. Video recorded infrared, video and location data are selectively captured on successive frames. Such frames are recorded for further analysis.

Description

131~62~

SYSTEM FOR GEOLOGICAL DEFECT DETECTION
UTILIZING COMPOSITE VIDEO-INFRARED THERMOGRAPHY

BACKGROUND OF THE INVENTION

This invention relates to the field of geological defect detection methods and devices, and more particularly to a novel and advantageous infrared thermographic sensing system and methodology using video cameras and infrared scanners to create both video and infrared images which are analyzed simultaneously with 10 location information for detection of subterranean anomalies in geological areas.
Geological areas often contain subterranean anomalies such as erosion cavities, small caves, or voids (large open spaces, for example, above old sewers), abandoned or leaking utility pipes, pulverized or deteriorating (~Ipunky~) concrete, buried storage tanks or other large objects. If ignored, these anomalies may deteriorate and the ground surrounding them may crumble until the surface eventually 20 collapses. At the very least, such cave-ins result in economic loss which could be avoided by early detection of the problem and subsequent remedial measures. If the defect results in a very large cave-in (sinX-hole) or perhaps an extenslve natural gas leak, there could also 2 131462~-1 be loss of life. Prevention of these disasters invariably is less expensive than remedial measures.
Historically, utility companies and highway departments have attempted to locate problem sites by a variety of methods. Other than waiting for a cave-in to occur or for a leak to come to the surface, the following methods have also been used: physical inspection of surface areas for cracks, bulges, or depressions; sending personnel literally to crawl through sewers and take photographs of suspicious areas;
"sounding" along the surface to detect differences in tone indicative of possible problem sites; boring out samples to detect variations in the subsoil; scanning the surface with metal detectors, penetrating the ground with a probe to transmit and receive radar or infrared signals and thus detect variations in stratigraphic trends, or electrical contrasts; and testing with a falling weight deflectometer to detect variations in pavement surfaces. Miscellaneous inadequacies exist with each of the above defect detection methods.
Crawl-through teams face the risks of poisonous gasses, scalding, flooding or collapse of the sewer around them, yet from inside a sewer they are unable to detect many voids which may exist in the surrounding earth. Other invasive methods such as taking core samples or penetrating the surface with a radar probe are time-consuming and inaccurate and may increase the risk of a cave-in. Metal detectors may detect buried drums or tanks but of course cannot reveal the presence of voids or other non-metallic objects, such as abandoned gravesites or plastic pipes or drums. The ground-probing radar method may suffer from electronic interference, for example due to water lines, and 3 1 3 1 462~

requires a trained geophysicist to interpret the results. Leaking gas or water lines which have not yet washed away the surrounding soil will very likely be missed by conventional defect detection methods. All of the above methods are inefficient in termC of time and personnel required, as well as being inaccurate to varying degrees.
More recently, various methods of infrared thermography have been used to detect subsurface geological anomalies. In one method, referred to herein as the "hand-held" method, still images have been taken of the same general area using both an infrared s~anner and a hand-held camera. The resultant infrared image, or thermogram, is analyzed for variations in relative temperature over the test area. The visual snapshot is later compared to the thermogram to attempt to locate a defect within the study area. For example, the image of a man seen standing in the snapshot will be noted on the thermogram by a different temperature "signature," or color. Likewise, as later explained, a geological anomaly will present its own unique thermographic signature.
The hand-held method of defect detection presents several problems. The infrared and visual images must be taken from a point well above the suspect geological surface area; this requires that two sets of personnel must be on hand, one to operate the equipment from, for example, a tower, roof-top or cherry-picker and another to work on the ground, marking comparison positions, etc. The t`wo crews must communicate by hand-signals, walkie-talkies, or the like. This hand-held imaging method is time-consuming and inefficient bec`ause only a limited area can be imaged from a given position. Then 1 31 462~

the crews m~st pack up their equipment and reposition at another site ~or a different angle of the same area or to view another test area. These llmitations made the method inadequate for evaluating very large geological areas, for example, long stretches of highway, sewer routes or airport runways.
A variation on the hand-held method is known, in which the infrared unit actually scans a test area as the unit is moved over the area by being mounted on a tripod on a truck or helicopter, for example. That method also requires comparison of thermograms with still photographs taken at various sites within t'he test area. In this method location markers may be manually applied to the test area, such as by setting flares to act as thermographic and visual markers or by painting footage markers along the entire section of pavement to be scanned, perhaps for miles.
In both of the above thermographic methods a great deal of time and manpower is required to perform even one test. Furthermore, because the thermogram and snapshots are not in good registration with each other, much time is spent in comparative analysis of the infrared and visual images to detect the precise anomalie location within the viewed area. A location error of even ten or twenty feet can result in maintenance crews wasting inordinate amounts of time and money while attempting to locate the problem.

SUMMARY OF THE INVENTION
Among the several fea-tures of the present invention may be noted the provision of a relatively fast, economical, safe, efficient, accurate, and reliable system and method for detection of subterranean anomalies, including voids; which system is highly automated and has integrated components, and which system and methods are non-invasive, non-destructive and can be used on very large areas, in daytime or nighttime, under a variety of weather and surface conditions. The invention seeks to provide such system and methods which are reasonably unobtrusive to the surrounding environment and cause minimal inconvenience to people in or passing through the area.
The invention in one broad aspect provides a selectively mobile system for infrared thermographic and visual scanning and comparative analysis for evaluating geological areas cGmprising an infrared scanner for scanning a selected area, a video camera for scanning such area, and mobile carrying means upon which the infrared scanner and the video camera are fixable for movement relative to such area while scanning. There is location means, and image and location data processing and preservation means for continuously capturing infrared and video images and location data, for superposing the infrared image, video image and location data on single composite video frames, and for successively video recording such composite video data frames for further use.

1 3 1 462~

Another aspect of the invention provides a method of infrared thermographic and video scanning and comparative analysis for evaluating geological areas for subterranean anomalies, comprising colocating an infrared scanner and a video carnera by affixing them on a mobile carrying means, aligning the infrared scanner and video camera to provide overlapping fields of view having a common area of focus, capturing successive infrared images of the common area of focus to provide infrared image data representative thereof, while concommitantly capturing successive video images of the common area of focus to provide video image data representative thereof, and while also concommitantly capturing successive location data uniquely representative of geologic locations within the common area of focus, superposing the infrared image, video image and location data on a composite video data frame, and successively video recording such video data frames for further use.
Further, the infrared and video images and location data may be for visual verification of the video data frames.
Other aspects and features will be in part apparent and in part pointed out hereinbelow.

7 1 3I'I62l~

BRIEF DESCRI~TION OF THE DRAWINGS
FIG. 1 is a schematic illustration of a van, showing a video camera and infrared scanner affixed to a front mounted boom in a system embodying the present invention, the system being shown as including a~
additional camera mounted for a driver's eye view and means for location detection.
FIG. 2 is a schematic illustration showing a close-up of an infrared scanner and conventional video camera colocated for carrying on a van or other mobile means.
FIG. 3 is a schematic diagram of a simplifi~ed infrared image data frame, or thermogram, shaded to illustrate various temperatures detected.
FIG. 4 is a s~hematic illustration of a single video camera data frame, corresponding to the infrared image of FIG. 3.
FIG. 5 is a simplified physical layout of electronic components of the image and location data processing and preservation means of the present invention.
FIG. ~ is a simplified pictorial representation of the composite color monitor of the present invention.
FIG. 7 is a block diagram of system components.

- 8 1 31462~

DESCRIPTION OF THE PREFERRED EMBODIMEN~
Referring to the drawings, illustrated schematically (FIG. 1) and generally at 10 is a selectively mobile infrared thermography system The system 10 includes an infrared ("IR") scanner 12 and a video camera 14 carried by a support boom 20 which is attached to a vehicle 22. The system 10 includes a fifth wheel 24, as illustrative of one possible type of location input means. The vehicle 22 carries within it location data processing and preservation means (generally designated 30) of the system 10.
A horizontal cross bar 20a fixed by elbow j.oints 20b at the top of two vertical members 20c of the boom 20 provides a site at which to fixedly colocate the front-mounted video camera 14 and IR scanner 12 (FIGS. 1 and 2) so that they may be aligned to provide overlapping fields of view having a common area of focus (indicated at F on FIG. 6). The boom 20 is braced against the vehicle 22 by diagonal supports 20d, as shown in FIGS. 1 and 2, or may be of the hydraulic or pneumatic telescoping type, as used on television vans.
Video camera 14 and IR scanner 12 thus mounted can be made to pan side-to-side and tilt up and down by remote control means 17 and an operator 28 controlled "joy stick" 17a. Preferably a second video camera 18 is mounted to provide a driver's-eye view of the test area.
A laser device 16 is selectively attached (for example, by cooperative hook-and-pile strips) to video camera 14 and provides a beam to guide the vehicle driver 26, and, as explained later, can also provide an initial point of focus to facilitate the above-mentioned alignment process. As an alternative, a second laser device, 16a, can be similarly attached to the IR scanner 1 31 462~

12 to provide a second point of focus. Thus, for example, one laser may provide a beam to guide the driver 26 and the ot~er to provide a beam for imaging purposes.
Prior to operation, a path o~ travel of system 10 is defined and the IR scanning equipment 12, 40 ls calibrated on a temperature-neutral portion 52 (FIG. 3) of the geological test area. For example, system 10 may traverse a vehicular route, for scanning one or more lanes of the ground or pavement along such route.
The calibration process involves first setting a temperature detection range of preferably ten isothermic units (roughly translatable into degrees Centigrade) and then narrowing the range to five and then preferably two isothermic units. The range defines a curve having a center line. Preferably all surface temperatures within the test geological area should fall within the calibration curve range. Images detected by the IR
scanner 12 will be depicted in various shades of grey on the IR data processor 40 monitor 40a. An electronic colorizer coupled with an analog-to-digital converter 42 converts the various shades of grey to colors.
Preferably, a color spectrum or scale is assigned to the temperature range such that problem areas will be displayed as red or some other designated color on the ultimate thermogram (FIG. 3). This color scale may optionally be printed on the IR videodata frame 36a, for example at space 54. The body temperature of a person 56 in the illustrative FIGS. 3 and 4 is off-scale, out of the curve, and depicted as yellow (FIG. 3). For simpllcity, FIG. 3 is shown with only three colors. In reality, the IR image would be seen having several colors as well as various shades of some colors. In lo 131462~

reality, the image seen in FIG. 6, segment 36a, would also be colored. For simplicity, FIG. 5 is not shown in color.
Ihe beam from laser device 16 indicates a speclfic point on the test area which is used to precisely foc~s the fields of view of both the video camera 14 and the IR scanner 12. This laser point also serves as a point of aim for the system driver 26.
As the driver 26 then guides the vehicle 22 over lQ the geological test area at speeds up to the maximum at which data can be accurately captured, the IR scanner 12, the colocated video camera 14 and the optional driver's-eye video camera 18 each detect and record successive images of their respective fields of view.
Video camera 14 records on either color or black and white videotape. The visual image (illustrated in FIG.
4) so registered is simultaneously transmitted to a video processor 32 (hereinafter referred to as a "quad processor"), i.eO, a computer which acts as a 20 ~Iswitchboard~ or central processing unit for input and output of all system data. The quad processor 32 transmits the video image data simultaneously to at least one ~ideo tape recorder 34, to a color composite monitor 35 and to a color copy processor 38.
Optionally, a video editor unit 34b and an edit-output recorder 34c may be added to the system (FIG. 7). Power for the system 10 components is provided by conventional batteries and a portable generator (not shown).
The video image is visible to the system 10 30 operator 28 in one 36b of four segments 36a-d of the display screen 36 of the color composite monitor 35, or alternatively on the video camera's respective independent monitor 14a, 18a, l9a (FIG. 7). A pictorial 11 1;~1462'-i representation of the monitor 36 is shown in FIG. 6.
Each of the four segments 36a-d may be enlarged to fill the entire screen 36 for better detail visualization.
Likewise, each segment 36a-d can be selectively divided into four subsegments for enlargement or isolation of data.
Simultaneous with the video 1~ recording, the IR
scanner 12 detects geological surface temperature levels and variations in the common field of view. The IR
image data thus detected are transmitted to a real-time IR data processor 40, of the microprocessor type (FIGS.
5 and 7), where successive images of the IR scans~ are viewable on an incorporated display screen 4Oa.
Simultaneously, analog form IR image data are converted by a colorizer/analog-to-digital converter 42 to digital form and provided to the quad processor 32 for subsequent selective transmittal to videotape recorder 34, as suitably controlled by a conventional tuner-timer 44. The videotape recorder 34 may be of either the single or multi-channel variety. The IR image data may be simultaneously transferred to another segment 36a of the display screen 36 of the color composite monitor 35 or alternatively viewed on an independent IR monitor 12b.
Visual image data collected by the driver's-eye-view video camera 18 are collected and processed by the system lO just as that data collected by the front-mounted video camera 1~ are captured, with the exception that visual image data are visible in a different segment 36c of the color composite monitor screen 36. As an alternative, one or more additional video cameras 19 (FIG. 7) can also be mounted for increased data collection. For example, a side-view camera 19 can be mounted for system lO input of data 12 1 31 462~

such as house numbers or bridge or highway markers to supplement other location data. The successive images captured by such a side-view camera 19 could be displayed in the fourth segment 36d of the monitor 35 screen 36.
The fifth wheel 24, (attached by braces 25 to the vehicle 22) provides pulse units per distance units travelled by the mobile system 10. In lieu of the fifth wheel 24, a known pulse-type odometer unit may be employed, so as to provide to converter 46 a predetermined number of pulses per increment of system 10 travel. A microprocessor 46 converts the above ratio into distance units which are transmitted to the quad processor 32 as location data for selective transmittal in digital form to a video recorder 34, to conventional hard copy and to a separate segment 36d of the color composite monitor 35 display screen 360 If preferred, however, the digital location data may also, or alternatively, be superimposed upon visual or infrared image data in any or all of the other screen segments 36a-d. In like manner, the keyboard operator 28 may choose to superimpose other information such as house number, date, weather or vehicle 22 speed data, onto any area (for example, D in FIGS. 3 and 4) of any of the screen segments 36a-d. As a further alternative to the fifth wheel 24, for aerial scans, location data can be geometrically computer generated such as by known LORAN
or satellite location technology, for recordation in the system 10 concomitantly with video and IR data images.
The operator may choose to display all location data only in an otherwise unoccupied screen 36 segment, for example 36d.

13 1 3 1 ~6~4 Each full view of the monitor 35 display screen 36 is referred to as a video data frame and each view of a segment 36a-d of the screen 36 is considered a video data segment. Typically, a floppy disk can store a maximum of only about 40 video data frames. The system preferably yi.elds, for example, a normal video frame rate of thirty video data frames per second. Therefore, in order to reduce the volume of data to be subsequently handled, a sampling method may be used to select and store (capture), for example, only every tenth frame.
As system 10 is operating, if the operator 28 detects a problem area on the composite monitor 35 IR
data display screen segment 36a (as snown, for example, in FIG. 3), the operator 28 may preset system 10 via the keyboard 31 to automatically mark the problem site 50, via automatic spray paint device 43, preferably with at least semi-permanent paint. This function may be activated either by the pulse-counter or the notation of a red-flagged defect site by the colorizer, or even 2Q manually by the system 10 operator 28. This mark will be visible in the video image data frame and on the hard copy thereof, (as shown schematically in FIG. 4).
Optionally, a profilometer 25 may be added to system 10 to provide surface roughness information which may be visualized on an oscilloscope 25a (FIG. 7) as it is transmitted to the quad processor 32 for superpositioning on the successive video data frames.
In addition to the above described mobile field analysis provided by the system 10, a permanent record is also provided for subsequent detailed comparison among the hard copies of simultaneously captured video (FIG. 4), infrared (FIG. 3) and location data 36d frames.

1~ 1 31 ~h2~

Analysis of the co-referenced data frames first requires location o~ problem areas (anomaly sites), preferably indicated by the color red on the thermogram, although other color selections and priorities may be utilized. Then the corresponding video (or visual) data frame is studied for surface evidence of subterranean anomalies. Even if no visual clues are in evidence, thermographically red-flagged anomalies 50 (FIGS. 3, 6) can be quickly located due to system location data being preserved simultaneously with the video and I~ data.
Overall, detection by this method and system 10 results in a very high degree of resolution. This resolution level is possible in part because system 10 location data are automatically incorporated, in part because the IR scanner 12 and video camera 14 fields of view are so precisely in registration with each other and in part because the infrared scanner 12 and processor 40 are carefully calibrated, and possibly recalibrated, to provide an IR data image distinctly illustrating the location as well as the shape of the subsurface anomaly.
Whether a problem site (e.g., 50, FIG. 3) will be cooler or warmer than non-problem areas will depend upon a variety of parameters such as solar radiation, cloud cover, ambient temperatures, wind speed, ground moisture and surface texture. The infrared scanner 12 measures only surface temperatures, which necessarily are affected by the above factors. Additionally, surface temperatures are affected by the presence of voids or other geological anomalies which act as insulators, retardiny the flow of energy into or out of the surrounding ground. To illustrate, during daylight hours, the pavement surface absorbs heat from the sun and transfers it to the earth's mass beneath the 131~62~

pavement. The presence of an anomaly slows heat transfer so that the surface above the anomaly becomes warmer as the heat pools there. At night, the process reverses. The pavement yields heat to the relatively cooler night air; however, an anomaly below the surface slows transfer of heat from the earth to the surface.
Thus at night, the surface temperature above an anomaly is lower than the temperature of other surface sites.
The infrared data image captured by the presently lu claimed system 10 and methodology illustrates size, shape and relative location of an anomaly beneath the surface of the subject geological area. ~
Operation of system 10 involves the following processes and advantages: quad processing of precisely registrated IR scanner and video camera fields of view plus simultaneously incorporated, computer converted and recorded video frame location data permit very fast, accurate, labor efficient detection of subterranean anomalies. Pavement markings and slow image-matching 2û analysis are thus unnecessary. Incorporation of a color composite monitor 35 permits system operation observation and on-site anomaly detection with optional automatic anomaly site marking (43). Individual screen segments 36a-d of the composite monitor 35 can be enlarged to better Vi2W details. Video data frames (such as in FIGS. 3 and 4) can be individually selectively stored on hard copy (as photographs) and a reference data base of defect thermographic signatures can be developed by which to increase recognizability of defects, as well as to permit comparison with subsequent thermograms (IR video data frames) of a particular area in order to detect progressive damage. System 10 permits operator 28 entry of other data, such as date, 16 1 3 1 4 ~ r weather, etc., either audibl~v or by keyboard 31, into any o~ the segments (video, IR, or other) of the video data frame (for example, in space D); any segment or whole frame beiny selectively storable. ~ multiplicity of IR scanners or video cameras may be used simultaneously, as many total as there are video data frame segments (even more than four) on the composite monitor. Thus a very large geological area can be evaluated with only one simultaneous "viewing" by the IR
scanners and their colocated video cameras. System 10 may be mounted on any of several selectively mobile means, such as an automobile, a helicopter or a bucket truck. Location data collected by any of several alternative methods can be superimposed on all (36a -d) or any of the video or IR data frames, as previously described. In this system lO, only the vehicle driver 26 and probably one other human operator 28 are necessary; no ground crews are required. The present system 10 is safe in that it does not require penetration of the geological area surface, either by personnel or mechanical means, and does not require hazardous irradiation. No danger is encountered other than that required in operating mobile system 10 over or near the test area.

17 131~62~

EXAMPLE OF SYSTEM OPERATION: DETECTION OF
-AMAGED SEWER LINES
The following example is provided to illustrate typical operation of the present system.
System 10 is arranged as illustrated in FIGS. 1, 5 and 7. After the driver proceeds to the test location, an alley traversing over a known sewer line, the system is calibrated and the IR scanner(s) and the video cameras are focused as previously described.
Additionally, calibrated visual marking indicia are placed on the pavement in the initial field of view.
This marker is visible in the video data frame of~ that field of view and serves as an additional location reference marker. Appropriate IR scanner and video camera lenses and angles are employed to enable the system data frames to incorporate the entire width of the alley in one "pass", or drive-over. As the driver carefully guides the system vehicle along the alley, the system operator verifies the previously described system operation by watching the color composite monitor, the IR data processor screen and any other monitors selectively added to the system. At the same time, the operator incorporates additional information, such as cross street names, ground surface moisture and precise pavement type.
Assuming that the system has been color-calibrated as previously described, when the operator sees a red area within the IR data segment of the color compos.ite monitor screen, the red is recognized as signalling the presence of a subsurface anomaly, such as a void, which may lead to, or already have caused, a collapsed sewer wall, collapsed surface pavement, or the separation of a lateral sewer line from the main sewer.

1~ 17)1462~

Upon recognizing a problem site, several options are available to the system operator. For example, the operator may immediately compare the IR image wlth the corresponding visual image on the monitor. If an adequate visual reference point exists, he may enter a note to that effect on the visual and/or IR data frames;
e.g., "defect exists four feet directly north of the light pole behind house address 4567 White Street."
Preferably also, a color video copy processor is activated to produce a color print of one or more video frames including the defect area. The system can thus continue along the alley essentially uninterrupted.
However, whether or not adequate visual reference markers are present, the problem site can be physically marked on the pavement, either manually or by the automatic spray paint device previously described.
Verification of accurate marking is possible by viewing the IR and video image data segments.
The above procedure is repeated along the entire test distance of the alley. The operator instructs the system as to which data frames on the video tape recording to select and store in photograph form.
Additionally, selected data frames are later transferred to a floppy disk for subsequent use and storage. The stored IR and video data frames are then permanently available for comparative analysis. On the basis of the analysis, repair crews are able to easily locate the sewer defect, rather than having to physically crawl into the sewer or dig up long stretches of alley while searching for the problem. Thus a possible sewer cave-in is prevented and expensive emergency or overtime measures are avoided.
In view of the foregoing, it will be seen that the 19 ~ 624 several objects of the invention are achieved and other advantages are attained.
Although the foregoing includes a description of the best mode contemplated for carrying out the invention, various modifications are contemplated.
As various modifications could be made in the constructions herein described and illustrated without departing from the scope of the invention, it is intended that all matter contained in the foregoing description or shown in the accompanying drawings shall be interpreted as illustrative rather than limitiny.

Claims (49)

1. A selectively mobile system for infrared thermographic and visual scanning and comparative analysis for evaluating geological areas for subterranean anomalies comprising:
an infrared scanner for scanning a geological area;
a video camera for scanning such a geological area;
mobile carrying means upon which said infrared scanner and said video camera are fixable for movement relative to such geological area while scanning;
location indicator means; and image and location data processing and preservation means;
said infrared scanner and said video camera being alignable to provide overlapping fields of view having a common area of focus;
said location indicator means comprising means for providing location data uniquely representative of locations of such geological area within the common area of focus;
said image and location data processing and preservation means comprising means for continuously capturing infrared and video images and location data within the common area of focus; for superposing the infrared image, video image and location data on single composite video frames, for successively video recording such composite video data frames for further use; and for simultaneously selectively monitoring the infrared and video images and location data for visual verification of such video data frames.
2. A system according to claim 1 wherein the data processing and preservation comprises at least one video recorder; and video processing means for processing the infrared and video images and location data to provide a composite video output of the superposed infrared image, video image and location data to the video recorder for recording.
3. A system according to claim 2 and further comprising means for causing the infrared images to have a color spectrum indicative of preselected temperatures for video recorder capture of such colors.
4. A system according to claim 2 wherein the video processing means provides successive video frames for storage by a video recorder.
5. A system according to claim 4 wherein each video frame includes a plurality of discrete segments;
one of such segments carrying a captured infrared image of such scanned geological area and another of the segments carrying a captured video image of such scanned geological area.
6. A system according to claim 5 wherein each video frame includes a further segment carrying the location data.
7. A system according to claim 6 wherein each video frame includes at least one further segment for carrying additional information relative to said scanning.
8. A system according to claim 7 wherein each video frame includes a total of four such segments.
9. A system according to claim 8 and comprising at least one further video camera for visual scanning while evaluating such geographical area, one of the video frame segments carrying a video image captured by said further video camera.
10. A system as in claim 9 further comprising one of said cameras being so located and focused as to reveal a field of view analagous to the view seen by a driver of said selectively mobile system.
11. A system as in claim 9 wherein one of said cameras is so located and focused as to reveal a field of view differing from that of said aligned video camera and infrared scanner, for additional detection of information relevant to such geological scanning.
12. A system as in claim 7 comprising at least one further infrared scanner, for scanning adjacent fields of view of such geological area; one of the video frame segments carrying an infrared image captured by said further infrared scanner.
13. A system as in claim 2 and further comprising a videotape recorder of the multi-channel type for simultaneous recording on separate channels of information relevant to such geological scanning.
14. A system as in claim 2 and further comprising a video editor by which such video recorded infrared and visual data may be edited; and an edit-output recorder for storage of such edited video recordings.
15. A system as in claim 2 and further comprising videotape recording means for audio recording of information simultaneously with the videotape recording.
16. A system as in claim 2 and further comprising automated marking means; whereby to impose indicia upon selected geological sites during the course of the scan of such sites.
17. A system 25 in claim 1 and further comprising a profilometer for provision of geological area surface roughness information for integration with other data collected by said system.
18. A system as in claim 1 and further comprising a video monitor for viewing composite data frames provided by the video processing means.
19. A system as in claim 1 and further comprising a video monitor for independent viewing of video images provided by the video camera.
20. A systems in claim 1 and further comprising a monitor for independently viewing the infrared images provided by the infrared scanner.
21. A system as in claim 1 and further comprising keyboard means for selective operator provision of information relevant to said scanning for superposition by the data processing and preservation means on the video frame segments.
22. A system as in claim 1 and further comprising color video copy processor means for provision or hard copy or such video data frame segments.
23. A system as in claim 1 and further comprising laser means by which to provide a common point of focus for said aligned infrared scanner and video camera overlapping fields of view and further by which to guide a driver of said selectively mobile system.
24 24. A system as in claim 1, wherein said location indicator means comprises distance input means for provision of distance signals for further processing by said data processing means.
25. A system as in claim 24, wherein said distance input means comprises odometer means responsive to movement of said mobile carrying means for providing pulse-form distance signals and distance processor means for converting such distance signals to digital form.
26. A system as in claim 1, wherein said mobile carrying means comprises a selectively mobile vehicle having mounting means upon which said infrared scanner and said video camera are adjustably affixed.
27. A system as in claim 26 wherein said mounting means comprises telescoping boom means upon which said infrared scanner and said video camera are movably secured for vertical and horizontal positioning.
28. A system as in claim 27 and further comprising remote control means for remotely controlling vertical and horizontal positioning of said video camera and said infrared scanner.
29. A selectively mobile system for infrared thermographic and visual scanning and comparative analysis for evaluating geological areas comprising:
an infrared scanner for scanning a selected area;
a video camera for scanning such area;
mobile carrying means upon which said infrared scanner and said video camera are fixable for movement relative to such area while scanning;
location means; and image and location data processing and preservation means for continuously capturing infrared and video images and location data, for superposing the infrared image, video image and location data on single composite video frames, and for successively video recording such composite video data frames for further use.
30. A system according to claim 29 wherein said data processing and preservation means includes means for simultaneously selectively monitoring the infrared and video images and location data for visual verification of such video data frames.
31. A system according to claim 29 wherein said infrared scanner and said video camera are alignable to provide overlapping fields of view having a common area of focus.
32. A system according to claim 29 wherein the data processing and preservation comprises at least one video recorder; and video processing means for processing the infrared and video images and location data to provide a composite video output of the superposed infrared image, video image and location data to the video recorder for recording.
33. A system according to claim 29 wherein each video frame includes a plurality of discrete segments;
one of such segments carrying a captured infrared image of such scanned geological area and another of the segments carrying a captured video image of such scanned geological area.
34. A system according to claim 29 wherein each video frame includes a further segment carrying the location data.
35. A system according to claim 29 wherein each video frame includes at least one further segment for carrying additional information relative to said scanning.
36. A system according to claim 29 wherein each video frame includes a total of four such segments.
37. A system according to claim 29 and further comprising operator input means for selectively providing information relevant to such scanning for superposition by the data processing and preservation means on the video frame segments.
38. A selectively mobile system for infrared thermographic and visual scanning and comparative analysis for evaluating geological areas for subterranean anomalies comprising at least one infrared scanner, at least one video camera, a location detection means, image and location data processing means, image and location data preservation means and a vehicle for carrying said infrared scanner, video camera, location means and processing and preservation means;
said infrared scanner and said video camera being colocated and affixed by carrying means to said vehicle and alignable to provide overlapping fields of view having a common area of focus of selectively scanned portions of a geological area as said vehicle is moved relative thereto;
said video camera providing video data output representing successive visual images of the selectively scanned area portions;
said infrared scanner providing infrared data output representing variations in temperature of the selectively scanned area portions;

said location detection means being responsive to movement of said vehicle for providing location data representing at least the relative position of said vehicle in said geological area, said location data identifying two selectively scanned area portions;
said image and location data processing means comprising:
(a) means for colorizing the infrared data output to provide colored infrared data wherein colors represent differences between anamolous and nonanamolous regions of the selectively scanned area portions;
(b) means for converting the location data to visually recordable form;
(c) means for permitting operator provision of further visually recordable information data relevant to the selectively scanned area portions;
(d) composite video processing means for superposing the colored infrared data, visual data, visually recordable location data, and information data to provide composite video data wherein video frames each have segments corresponding to such forms of data; and (e) video monitor means for operator viewing of the composite video data;
said image and location data preservation means comprising:
(f) at least one video recorder for sequentially recording video frames of said composite video data; and (g) color videocopy processor means selectively operator actuated for providing hard copy of selected video frames.
39. A method of infrared thermographic and video scanning and comparative analysis for evaluating geological areas for subterranean anomalies, comprising colocating an infrared scanner and a video camera by affixing them on a mobile carrying means;
aligning the infrared scanner and video camera to provide overlapping fields of view having a common area of focus;
capturing successive infrared images of the common area of focus to provide infrared image data representative thereof; while concommitantly capturing successive video images of the common area of focus to provide video image data representative thereof; and while also concommitantly capturing successive location data uniquely representative of geologic locations within the common area of focus;
superposing the infrared image, video image and location data on a composite video data frame; and successively video recording such video data frames for further use.
40. The method of analysis as in claim 39, further comprising simultaneously selectively monitoring the captured infrared and video images and location data for visual verification of such video data frames.
41. The scanning method as in claim 39; and further comprising using at least one additional video camera, being so located and focused as to reveal a field of view differing from that of said aligned video camera and infrared scanner, and superposing the images produced by such additional video camera on successive composite video data frames.
42. The scanning method as in claim 41; wherein said at least one additional video camera is so located and focused as to reveal a field of view analogous to the view seen by an operator of said mobile carrying means.
43. The scanning method as in claim 39 further comprising aligning more than one infrared scanner to have overlapping fields of view and a common area of focus with said video camera, for simultaneous scanning adjacent fields of view of such geological area.
44. The method of analysis in claim 39; and further comprising editing such video recording of such video data frames for further use.
45. The scanning method as in claim 39; and further comprising audibly inserting information onto such videotape recording.
46. The method of analysis as in claim 39 further comprising automatically marking on the surface of such scanned geological areas subterranean anomaly locations as such locations are identified within such captured infrared image data for facilitating later identifi-cation of such anomaly locations.
47. The scanning method as in claim 39; and further comprising:
measuring profilometrically the roughness of a surface being scanned; and transferring such roughness information to said data processing means for recording on said video frames.
48. The scanning method of claim 39, further comprising:
using a laser means to provide a single point of light serving as a common point of focus in each of the overlapping fields of view; and aligning the infrared scanner and said video camera by alignment thereof with said single point of light.
49. The method of analysis of claim 39, and further comprising selectively providing hard copies of successive infrared, video and location data frames, for storage and analysis.
CA000612415A 1989-04-14 1989-09-21 System for geological defect detection utilizing composite video-infrared thermography Expired - Lifetime CA1314624C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US07/339,070 US4910593A (en) 1989-04-14 1989-04-14 System for geological defect detection utilizing composite video-infrared thermography
US07/339,070 1989-04-14

Publications (1)

Publication Number Publication Date
CA1314624C true CA1314624C (en) 1993-03-16

Family

ID=23327356

Family Applications (1)

Application Number Title Priority Date Filing Date
CA000612415A Expired - Lifetime CA1314624C (en) 1989-04-14 1989-09-21 System for geological defect detection utilizing composite video-infrared thermography

Country Status (5)

Country Link
US (1) US4910593A (en)
EP (1) EP0392163B1 (en)
JP (1) JPH02293685A (en)
CA (1) CA1314624C (en)
DE (1) DE69013041T2 (en)

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6621942B1 (en) * 1989-09-29 2003-09-16 Intermec Ip Corp. Data capture apparatus with handwritten data receiving component
FR2655503B1 (en) * 1989-12-01 1992-02-21 Thomson Csf OPTOELECTRONIC SYSTEM FOR AIDING ATTACK AND NAVIGATION MISSIONS.
US5006722A (en) * 1990-03-02 1991-04-09 Intec Corp. Flaw annunciator with a controllable display means for an automatic inspection system
US5111289A (en) * 1990-04-27 1992-05-05 Lucas Gary L Vehicular mounted surveillance and recording system
US5109277A (en) * 1990-06-20 1992-04-28 Quadtek, Inc. System for generating temperature images with corresponding absolute temperature values
JP2845611B2 (en) * 1990-11-06 1999-01-13 ジオ・サーチ株式会社 Pavement structure exploration vehicle
JPH0510825A (en) * 1991-07-05 1993-01-19 Matsushita Electric Ind Co Ltd Disaster detecting device with thermal image detecting means
US5841955A (en) * 1991-12-02 1998-11-24 Goss Graphic Systems, Inc. Control system for a printing press
NL9202019A (en) * 1992-11-19 1994-06-16 Gatso Special Prod Bv Method, system and vehicle for making and analyzing multispectral images.
US6675386B1 (en) * 1996-09-04 2004-01-06 Discovery Communications, Inc. Apparatus for video access and control over computer network, including image correction
US5386117B1 (en) * 1993-06-07 1997-06-10 Computational Systems Inc Infrared thermography system including mobile unit
US5637871A (en) * 1993-06-07 1997-06-10 Computational Systems, Inc. Portable digital infrared thermography system
JP3388034B2 (en) * 1994-08-31 2003-03-17 株式会社東芝 Monitoring method of equipment status using distribution measurement data
US5812705A (en) * 1995-02-28 1998-09-22 Goss Graphic Systems, Inc. Device for automatically aligning a production copy image with a reference copy image in a printing press control system
US5767980A (en) * 1995-06-20 1998-06-16 Goss Graphic Systems, Inc. Video based color sensing device for a printing press control system
US5742335A (en) * 1995-07-19 1998-04-21 Cannon; Michael W. Examination system for architectural structure exteriors
US5805280A (en) * 1995-09-28 1998-09-08 Goss Graphic Systems, Inc. Control system for a printing press
EP0765748A3 (en) * 1995-09-29 1997-08-13 Goss Graphics Systems Inc Device for alignment of images in a control system for a printing press
US5903712A (en) * 1995-10-05 1999-05-11 Goss Graphic Systems, Inc. Ink separation device for printing press ink feed control
US5818951A (en) * 1995-10-13 1998-10-06 Infrared Service Corporation Methods and related apparatus for generating thermographic survey images
US5898459A (en) * 1997-03-26 1999-04-27 Lectrolarm Custom Systems, Inc. Multi-camera programmable pan-and-tilt apparatus
AU2201299A (en) * 1997-12-19 1999-07-12 William Hicks Apparatus and methods for remote inspection of structure facades
DE19800482B4 (en) * 1998-01-09 2008-05-21 Wiesemann & Theis Gmbh gauge
JP2000050238A (en) * 1998-07-27 2000-02-18 Matsushita Electric Ind Co Ltd Monitor camera device
US7197228B1 (en) * 1998-08-28 2007-03-27 Monroe David A Multifunction remote control system for audio and video recording, capture, transmission and playback of full motion and still images
US6067596A (en) * 1998-09-15 2000-05-23 Compaq Computer Corporation Flexible placement of GTL end points using double termination points
US6212286B1 (en) * 1998-09-18 2001-04-03 John Edward Rott Method for non-invasive and safe testing of telecommunication and broadcast towers or other airwave or cable transmitting and receiving devices
FR2783921B1 (en) * 1998-09-29 2001-01-12 Inst Francais Du Petrole THERMOGRAPHY METHOD AND DEVICE FOR ANALYZING THE PROGRESSION OF INJECTED FLUIDS IN A PERMEABLE MEDIUM
DE10219008C1 (en) * 2002-04-27 2003-12-04 Bundesrep Deutschland Visibility range measuring device for automobile driver, uses stepping motors for positioning laser markers at edges of visibility range
FR2842600B1 (en) * 2002-07-17 2005-06-24 Entpr De Const De Lignes ONBOARD SYSTEM AND METHOD FOR INFRARED THERMOGRAPHY INSPECTION, IN PARTICULAR FOR ENTERPRES VAPOR NETWORKS
US7027924B2 (en) * 2002-10-31 2006-04-11 Itt Manufacturing Enterprises, Inc Detecting natural gas pipeline failures
DE10300612A1 (en) * 2003-01-10 2004-07-22 Hella Kg Hueck & Co. Night vision system for motor vehicles
US9587938B2 (en) * 2003-06-17 2017-03-07 Troxler Electronic Laboratories, Inc. Method and apparatus for determining a characteristic of a construction material
US7312454B2 (en) 2003-07-16 2007-12-25 The Boeing Company Non-destructive infrared inspection device
US20060018642A1 (en) * 2004-07-20 2006-01-26 Chaplin David V Mobile laser designated infrared multimedia mapping system
JP4534756B2 (en) * 2004-12-22 2010-09-01 ソニー株式会社 Image processing apparatus, image processing method, imaging apparatus, program, and recording medium
WO2006128087A2 (en) * 2005-05-27 2006-11-30 Entech Engineering, Inc. System of subterranean anomaly detection and repair
US8288726B2 (en) * 2006-12-19 2012-10-16 Weil Gary J Remote sensing of subsurface artifacts by use of visual and thermal imagery
US8233723B2 (en) * 2007-12-06 2012-07-31 Ebay Inc. Image categorization based on comparisons between images
JP5487381B2 (en) * 2009-02-10 2014-05-07 国土交通省国土技術政策総合研究所長 Cover layer abnormality detection method
JP5334020B2 (en) * 2009-02-23 2013-11-06 国際航業株式会社 Cover layer surface imaging device
FI123206B (en) * 2009-11-20 2012-12-31 Roadscanners Oy Procedure for assessing the condition of the coating of a traffic lane
EP2410319A1 (en) * 2010-07-23 2012-01-25 Solarpower GmbH Method and system for detecting defective solar modules
US20130176424A1 (en) * 2010-09-29 2013-07-11 Entech Engineering, Inc. Complete remote sensing bridge investigation system
EP2474808A1 (en) * 2011-01-10 2012-07-11 Leica Geosystems AG Geodesic measuring device with thermographic camera
US10088586B2 (en) 2011-02-25 2018-10-02 University Of Florida Research Foundation, Inc. Detection of sinkholes or anomalies
CN102182137A (en) * 2011-02-25 2011-09-14 广州飒特电力红外技术有限公司 Pavement defect detection system and method
US9921584B2 (en) * 2014-04-03 2018-03-20 General Electric Company Route examination system and method
US10576907B2 (en) 2014-05-13 2020-03-03 Gse Technologies, Llc Remote scanning and detection apparatus and method
US10104344B2 (en) * 2014-05-13 2018-10-16 Gs Engineering Services, Inc. Remote scanning and detection apparatus and method
PL2982951T3 (en) * 2014-08-05 2019-04-30 Voegele Ag J Thermography module for road finishers
EP2990531A1 (en) 2014-08-27 2016-03-02 Joseph Vögele AG System for road finisher with a temperature measuring device, method for determining a cooling behaviour und computer-readable storage medium
ES2734725A1 (en) * 2018-06-06 2019-12-11 Univ Jaen Procedure and equipment for the identification of cavities in a field (Machine-translation by Google Translate, not legally binding)
DE102018114310B4 (en) * 2018-06-14 2021-01-14 Matthias Rimkus Method and device for the outer skin and / or inner skin inspection of infrastructure objects with the aid of a rotary wing drone
JP7303658B2 (en) * 2019-04-24 2023-07-05 株式会社トプコン Method for processing infrared photographic images, apparatus for processing infrared photographic images, and program for processing infrared photographic images
DE102020200981A1 (en) 2020-01-28 2021-07-29 Robert Bosch Gesellschaft mit beschränkter Haftung Prediction of the coefficient of friction for tire-road contact
FR3133696A1 (en) * 2022-03-21 2023-09-22 Ceneau MOBILE DEVICE, SCOOTER AND METHOD FOR DETECTING ANOMALIES IN AN UNDERGROUND WATER NETWORK

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3761713A (en) * 1971-07-13 1973-09-25 Us Interior Method of detecting loose rock
GB1605188A (en) * 1974-04-09 1983-03-09 Emi Ltd Surveillance apparatus
US4560279A (en) * 1978-10-17 1985-12-24 Kouns Charles W Optical method for remote determination of the geological nature of a homogeneous surface
GB8316356D0 (en) * 1983-06-16 1983-07-20 Jordan B J Fibre-optic system
US4578584A (en) * 1984-01-23 1986-03-25 International Business Machines Corporation Thermal wave microscopy using areal infrared detection
FR2564200B1 (en) * 1984-05-11 1986-10-03 Inst Francais Du Petrole PROCESS FOR ACQUIRING IMAGES OF GEOLOGICAL SAMPLES FOR OPTICAL ANALYSIS AND DEVICE FOR IMPLEMENTING SAME
JPS61281915A (en) * 1985-06-07 1986-12-12 Kokusai Kogyo Kk Vehicle device for measuring properties of road surface
US4751571A (en) * 1987-07-29 1988-06-14 General Electric Company Composite visible/thermal-infrared imaging apparatus
DE3726065A1 (en) * 1987-08-06 1988-01-21 Friedhelm Fredrich BOX-TYPE MOTOR VEHICLE having an evaluation device in the driver's cab, which evaluation device allows an operator to assess an object by means of screens and sound transducers, the signals from a video camera being used especially for assessment of the recording angle

Also Published As

Publication number Publication date
DE69013041D1 (en) 1994-11-10
DE69013041T2 (en) 1995-04-06
EP0392163A2 (en) 1990-10-17
JPH02293685A (en) 1990-12-04
EP0392163A3 (en) 1991-01-30
EP0392163B1 (en) 1994-10-05
US4910593A (en) 1990-03-20

Similar Documents

Publication Publication Date Title
CA1314624C (en) System for geological defect detection utilizing composite video-infrared thermography
CN108033015B (en) Unmanned aerial vehicle device and method for monitoring ignition point of coal gangue dump
US5045937A (en) Geographical surveying using multiple cameras to obtain split-screen images with overlaid geographical coordinates
CA1307839C (en) Leak detection and multispectral survey system
EP0534730B1 (en) Method for locating and examining cavities under paved roads
US6028625A (en) Examination system for architectural structure exteriors
US7184072B1 (en) Airborne inventory and inspection system and apparatus
US6501501B1 (en) Construction and civil engineering database generator and display
EP1523738B1 (en) System and method for territory thermal monitoring
US8288726B2 (en) Remote sensing of subsurface artifacts by use of visual and thermal imagery
Idone et al. Performance evaluation of the US national lightning detection network in eastern New York: 2. Location Accuracy
US20130176424A1 (en) Complete remote sensing bridge investigation system
JP6349607B2 (en) Cavity exploration method and risk assessment method
CN115793093B (en) Dam hidden disease diagnosis air-ground equipment
US5192953A (en) Pavement structure examination vehicle
EP1180324B1 (en) Method and apparatus for observing and determining the position of targets in geographical areas
US5298987A (en) Method for investigating ground structure of pavement
US4020344A (en) Mobile infrared apparatus for mapping thermal variations and method employing same
Stockton et al. Advances in applications for aerial infrared thermography
Stockton Advances in applications and methodology for aerial infrared thermography
David et al. Monitoring Bituminous Layers Using Thermal Images
ITO et al. Obtaining digital topographic data using an automatic photogrammetry system with digital imaging in an open pit mine
Stockton How aerial IR can be used as a NDT Tool for Asset Management
CA1078646A (en) Mobile infrared apparatus for mapping thermal variations and method employing same
Bromley THERMAL INFRARED VIDEO IMAGERY OVER THE ROTORUA GEOTHERMAL FIELD

Legal Events

Date Code Title Description
MKEX Expiry