US20100153168A1 - System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device - Google Patents

System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device Download PDF

Info

Publication number
US20100153168A1
US20100153168A1 US12/489,313 US48931309A US2010153168A1 US 20100153168 A1 US20100153168 A1 US 20100153168A1 US 48931309 A US48931309 A US 48931309A US 2010153168 A1 US2010153168 A1 US 2010153168A1
Authority
US
United States
Prior art keywords
inspection
inspector
media
logical
inspected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/489,313
Inventor
Jeffrey York
Marc Siegel
Albert Ho
Christopher Tossing
Adam Ierymenko
Daniar Hussain
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SECURENET SOLUTIONS GROUP LLC
Original Assignee
Jeffrey York
Marc Siegel
Albert Ho
Christopher Tossing
Adam Ierymenko
Daniar Hussain
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jeffrey York, Marc Siegel, Albert Ho, Christopher Tossing, Adam Ierymenko, Daniar Hussain filed Critical Jeffrey York
Priority to US12/489,313 priority Critical patent/US20100153168A1/en
Priority to US12/758,134 priority patent/US20100185549A1/en
Publication of US20100153168A1 publication Critical patent/US20100153168A1/en
Priority to PCT/US2010/039472 priority patent/WO2011005513A1/en
Assigned to KD SECURE LLC reassignment KD SECURE LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HO, ALBERT, MR, TOSSING, CHRISTOPHER, MR, HUSSAIN, DANIAR, MR, IERYMENKO, ADAM, MR, SIEGEL, MARC, MR
Assigned to SECURENET SOLUTIONS GROUP, LLC reassignment SECURENET SOLUTIONS GROUP, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KD SECURE, LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0637Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/103Workflow collaboration or project management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/018Certifying business or products
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P80/00Climate change mitigation technologies for sector-wide applications
    • Y02P80/20Climate change mitigation technologies for sector-wide applications using renewable energy

Definitions

  • the present invention is generally related to inspection systems. More specifically, this invention relates to a system for inspection of industrial equipment assisted by a handheld device, which helps to ensure compliance of the safety and security of industrial equipment fit for business use.
  • the present invention may be used to help prevent accidents that can happen during usage of such industrial equipment, as well as prevent negligent, missed or incomplete inspections of such industrial equipment.
  • Electrocution is generally caused by the crane either hitting a power line or coming close enough to a high-voltage power line to spark an electric arc.
  • Crane assembly/dismantling fatalities usually occur “when a worker underneath the boom was knocking the boom pins out while the boom was held by the pendant line. When the lower supporting pins were removed, the boom fell onto the worker” (Suruda, p. 4).
  • Zachry Construction Company estimates that one day's delay in the construction of an oil refinery or power plant can cost Zachry over $300,000 in liquidated damages arising from guaranteed delivery contracts with the plant owners.
  • a fatality, or any serious accident at a construction site always leads to delays of multiple days or even weeks, disrupting construction work, both for site clean-up, internal inspections, as well as OSHA inspections.
  • Cranes are but one example of industrial equipment that is subject to inspection for compliance with safety or security standards.
  • Other possible industrial equipment includes vehicles such as airplanes, buses, trains, subways, cars, ships, and trucks, public buildings, privately-owned buildings, residential homes, highways, train tracks, airport runways, ship harbors, bridges, underground tunnels, shelters, dams, conventional power plants, nuclear power plants, particle colliders, oil extraction sites, oil refineries, communication towers, data centers, sewage systems, water treatment plants, water wells, reservoirs, and any other equipment or the like.
  • inspections on industrial equipment other than cranes include the inspection of commercial airplanes with FAA (Federal Aviation Administration) standards, the inspection of communication towers with FCC (Federal Communications Commission) standards, the inspection of dams with state dam safety standards such as NJAC (New Jersey Administrative Code) 7:20, the inspection of nuclear power plants with IAEA (International Atomic Energy Agency) standards, and other similar inspections under public safety standards.
  • FAA Federal Aviation Administration
  • FCC Federal Communications Commission
  • NJAC New Jersey Administrative Code
  • IAEA International Atomic Energy Agency
  • Other inspection compliance requirements are associated with renewable energy systems and distributed energy systems, including wind turbines, solar photovoltaic, solar thermal plants, co-generation plants, biomass-fueled power plants, carbon sequestration projects, enhanced oil recovery systems, and the like. Therefore, as recognized by the present inventors, a system, method and apparatus of ensuring that inspections and maintenance procedures are carried out is highly desirable.
  • the present invention is a method and a system for inspections and compliance verification of industrial equipment using a handheld device.
  • One embodiment of the present invention is a method for ensuring compliance of industrial inspection. For the inspector, this involves first segmenting one or more inspected components into one or more logical inspection points. Then the inspector scans one or more unique machine-readable tags at each logical inspection point. Then the inspector takes one or more media samples of the inspected component at each logical inspection point. Then the inspector associates each media sample with the corresponding scan of the unique machine-readable tag. Finally, the inspector declares sub-optimal conditions of the unique machine-readable tags at each logical inspection point, substantiated by corresponding media samples, if condition warrants such declaration. A timestamp is added for each action taken at each logical inspection point, said timestamp representing evidence of a date and a time of physical visitation to said logical inspection point and associated action.
  • Another embodiment of the present invention involves the additional step of either annotating each media sample in such ways that substantiate inspector statements of any inspected components passing inspection, or annotating each media sample in such ways that substantiate inspector statements of problems with inspected components found during inspection.
  • Another embodiment of the present invention involves carrying out the method described, specifically the steps of scanning of one or more unique machine-readable tags and taking of each media sample at each logical inspection point, with a multi-function handheld device.
  • Another embodiment of the present invention involves using unique machine-readable tags that have limited maximum scan range, such that the scanning of the tags requires physical proximity of an inspector to the logical inspection point and implies proper visitation made by the inspector to the logical inspection point.
  • Another embodiment of the present invention involves substantiating inspector statements of problems with inspected components by quoting standards from a standards document.
  • Another embodiment of the present invention involves generating a new work order item for any logical inspection point having a problem found during inspection.
  • Another embodiment of the present invention involves generating a problem reminder that requires an inspector to revisit any problems found during an inspection in future inspections.
  • Another embodiment of the present invention involves associating with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location.
  • GPS global positioning system
  • Another embodiment of the present invention involves associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • the inspector may be identified by scanning his ID tag, photographing his face, capturing his handwritten signature, and the like.
  • Another embodiment of the present invention involves correlating any subset of inspection data segmented as inspection events, and activating one or more actions based on the correlation performed in the correlating step.
  • the present invention also includes a related system by which the method of ensuring compliance of industrial inspection could be carried out.
  • a system could be implemented as a computer system, embodied in a handheld device using separate unique machine-readable tags deployed throughout logical inspection points on a physical inspected component.
  • the system may include integrated or separate hardware components for scanning of unique machine-readable tags and taking of media samples of the inspected component.
  • FIG. 1 is a flowchart of a method for ensuring compliance of industrial inspections, in accordance with one embodiment of the present invention
  • FIG. 2 is an illustration of an illustrative inspection component, the mast section of a tower crane, which is segmented into logical inspection points, in accordance with another embodiment of the present invention
  • FIG. 3 is a flowchart of a method of ensuring compliance of industrial inspections, detailing the flow of usage of the software on a handheld device, in accordance with yet another embodiment of the present invention
  • FIG. 4 is a block diagram of a system, in accordance with yet another embodiment of the present invention.
  • FIG. 5 is an illustration of a multi-functional handheld device, in which some of the software and hardware components of the system reside, in accordance with yet another embodiment of the present invention
  • FIG. 6 is an illustration of inspectors in physical proximity to an inspection component, carrying out an inspection with handheld devices, in accordance with yet another embodiment of the present invention.
  • FIG. 7 is a set of diagrams of illustrative user interfaces in an inspection system installed on different handheld devices, in accordance with multiple embodiments of the present invention.
  • FIG. 8 is a diagram of an illustrative user interface of an inspection system, in accordance with another yet embodiment of the present invention.
  • FIG. 9 is an illustration of an illustrative application of the present invention for ensuring proper inspection of wind turbines and other renewable energy systems, according to yet another embodiment of the present invention.
  • the invention generally pertains to an industrial inspection compliance system with which various methods can be carried out to the effect of assisting in an inspection and providing the means for compliance verification of a proper inspection.
  • an inspection may represent the process of checking a physical component for safety, security or business reasons, doing the same for compliance with industry standards and guidelines, or a maintenance operation on a physical component for those same reasons.
  • These methods can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector. Examples of multi-function handheld devices include the Apple iPhone®, the Psion Teklogix Workabout Pro®, the Motorola MC-75®, and the like, but the present invention is not limited to such devices as shown or described here.
  • One aspect of the invention relates to scanning unique machine-readable tags deployed at logical inspection points defined by the inspector, and assigning a timestamp to the scanning operation. Another aspect of the invention relates to taking media samples of logical inspection points defined by the inspector, and assigning a timestamp to the media sample capturing operation. Another aspect of the invention relates to reporting of sub-optimal conditions of the unique machine-readable tags deployed at logical inspection points if its condition warrants such a declaration. Another aspect of the invention relates to associating a media sample with a corresponding scan of a unique machine-readable tag. Another aspect of the invention relates to annotating a media sample in such ways that substantiate statements of an industrial component passing inspection, or in such ways that substantiate statements of problems found with the industrial component.
  • FIGS. 1-8 These and other aspects of the invention are discussed below with reference to FIGS. 1-8 . However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.
  • FIG. 1 is a flowchart diagram of a method 150 for ensuring compliance of industrial inspections, in accordance with one embodiment of the present invention.
  • This inspection method can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector.
  • This method generally begins at block 100 where an inspector would inspect some industrial component within physical viewable proximity.
  • the component mentioned may include an article or machine, or groups of articles or machines, which are marked to be inspected against prevailing safety or security standards.
  • This embodiment of the invention requires an inspector to be within physical viewable proximity from the inspected component in order to help ensure that the inspector has actually visited the component.
  • This requirement may be enforced by the fact that the inspector will be unable to perform the operations on the handheld device to carry out this method if he is not within physical viewable proximity of the industrial component to be inspected.
  • This method assumes that the physical component has already been logically separated into one or more logical inspection points as shown in FIG. 2 , which will be described in more detail later. This method also assumes that the physical component has already been tagged with unique machine-readable tags at each logical inspection point.
  • industrial inspection method 150 proceeds to block 101 where the inspector selects a logical inspection point to begin inspection. This may be done on the device software by selecting from a list of physical components or from a list of logical inspection points, depending on how the inspector chose to configure the system. Alternatively, this may be done by scanning the unique machine-readable tag deployed at the logical inspection point to be selected, as in block 104 .
  • industrial inspection method 150 proceeds to a decision block 103 , where a decision is made if the unique machine-readable tag is in a “sub-optimal” condition (if it is not readable for whatever reason, it is considered to be in a sub-optimal condition).
  • the industrial inspection method 150 proceeds to block 102 , where the inspector may report the condition that justifies the sub-optimal condition. This reporting may be done in addition to or in lieu of scanning the machine-readable tag.
  • a sub-optimal condition includes the condition of a tag being broken, the condition of a tag being unable to be scanned for any reason, the condition of a tag being absent for any reason, the condition of a tag being misplaced, or any other unacceptable condition or the like.
  • a unique machine-readable tag may be a barcode sticker, a high-frequency (HF) radio-frequency identification (RFID) tag, an ultra-high-frequency (UHF) RFID tag, or any other tag or the like that serves as a unique identifier for a logical inspection point.
  • HF high-frequency
  • RFID radio-frequency identification
  • UHF ultra-high-frequency
  • the scanning of the tag may be done by a corresponding tag reader either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation.
  • a corresponding tag reader either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation.
  • a timestamp is assigned to the scanning operation of block 104 .
  • the timestamp may be expressed as a date and time pair, POSIX time, or any other representation that is semantically consistent between any other timestamp assignment made in the scope of this method.
  • the general purpose of the timestamp assignment is to seal a record of the point in time at which the inspector executed an operation that is a critical component to the proof of inspection. This step is important to the goal of ensuring compliance of the industrial inspection process. Therefore, one of ordinary skill would appreciate that block 104 may not only consist of the action of timestamp assignment, but possibly also the action of timestamp verification, such as the employment and execution of a digitally-signed timestamp, or any other action of the like.
  • a media sample is defined to be a photograph, a sequence of photographs, an ultrasonic image, an infrared image, any other type of mechanically, chemically or electromagnetically-obtained image, a video with an audio component, a video without an audio component, or any other visual or set of visual media or the like.
  • the taking of a media sample may be done by a media input component either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to take and store the media sample.
  • industrial inspection method 150 proceeds to block 110 where a timestamp is assigned to the media sample taking operation of block 108 .
  • the timestamp assignment in block 110 is of the same spirit and scope as the timestamp assignment described in block 106 .
  • industrial inspection method 118 proceeds to block 112 where the media sample taken in block 108 is associated with a scanning of a unique machine-readable tag in block 104 .
  • This association may take the form of a database join table in which ID's of media samples are paired with ID's of unique machine-readable tags, with the ID's having already been established during the operations of scanning the unique machine-readable tag and taking the media sample.
  • an inspector may scan RFID (the unique machine-readable tag) tag number 0039850921847576, the operation of which is recorded by his handheld device software in a database table called “TagScans” that has a primary key called “id” and assigns this record an “id” of 3.
  • the inspector learns from the device software that the RFID he just scanned is referring to a particular joint of the mast section of the tower crane he is inspecting, a logical inspection point he had segmented previously. He then takes a photograph (the media sample) of the vicinity of the RFID tag he just scanned, making sure to capture a good shot of the joint, which is the logical inspection point he intends to inspect. After taking the photograph, the handheld device software first records the photographing operation in a database table called “PhotoCaptures” that has a primary key called “id” and assigns this record an “id” of 8.
  • industrial inspection method 150 proceeds to decision block 113 , where a determination is made by the inspector if the logical inspection point successfully passes the criteria established for the inspection. In the situation in which the logical inspection point passes the inspection, the industrial inspection method 150 proceeds to block 114 where an inspector annotates the media sample taken in block 108 in such ways as to substantiate his statement of the logical inspection point passing inspection.
  • an inspector allows a logical inspection point to pass inspection, he is making a very serious statement about the integrity of the physical component in the face of safety or security standards against which it must hold. Therefore, the step described in block 114 provides the means by which the inspector may add supportive marks, indications, statements, or other data or metadata of the like that serve to justify his statement of the logical inspection point passing inspection.
  • industrial inspection method 150 may possibly proceed to block 116 where an inspector annotates the media sample taken in block 108 in such ways as to substantiate his statement of problems found with the logical inspection point.
  • a useful inspection will need to indicate how the physical component is faulty, what codes in which standards that the fault violates if there exists any applicable code or standard, what should be done to remedy the fault, or any other supportive material or the like. Therefore, the step described in block 116 provides the means by which the inspector may add supportive marks, indications, statements, or other data or metadata or the like that serve to justify his statement of problems found with the logical inspection point.
  • the process of annotating a media sample as described in block 114 and 116 includes any step that helps to substantiate a conclusive statement made by the inspector about a physical inspected component.
  • the conclusive statement generally refers to either a statement of an industrial component passing inspection as in block 114 or a statement of problems found with an industrial component as in block 116 , but may include any other conceivable conclusive statement or the like. For example, if the media sample taken is a photograph of a joint in the mast section of a tower crane and the inspector determines that the joint is not properly welded, the photograph is then annotated by the inspector to visually show the location of the improper welding.
  • the inspector uses the touch screen capabilities of the handheld device and the capabilities of the software to draw a red circle on the digital photograph he took, encircling the segment of the photograph in which the improperly-welded joint is visible.
  • drawing a red circle on a photograph is but one of many possible ways to annotate a media sample.
  • Other methods include highlighting a segment of a photograph with a bright color such as done in the physical analogue of using a highlighter pen, creating and populating a free-form text field with a connected pointer line superimposed on a photograph and pointing to a specific point on the photograph, drawing a thick black border around the form of an object identified in an infrared image, making the same such annotations on a series of video stills all belonging to the same video sequence, superimposing text on a set of video stills to effectively subtitle a video, or any other method of media sample annotation or the like.
  • FIG. 2 is an illustration of an illustrative inspection component, the mast section of a tower crane 200 , which is segmented into logical inspection points, in accordance with another embodiment of the present invention.
  • the diagram serves as an example of a possible industrial component that must be inspected against safety or security standards, such as those of ASME (American Society of Mechanical Engineers).
  • Items 202 , 204 , 206 , 208 , 210 , 212 , 214 and 216 are welded joints on this tower crane mast section, which in this case are the logical inspection points for this physical inspected component.
  • a logical inspection point may include any physical sub-component of any physical inspected component of the article or machine to be inspected, even of the physical article/machine itself, or any non-physical aspect of inspection that can somehow be mapped to a physical component or sub-component of the inspected article/machine.
  • Logical inspection points may be defined by the inspector before or during an inspection, whereby each physical article or machine that is to be inspected has at least one logical inspection point. For example, if the tower crane mast section 200 is to be considered the inspected physical article, the inspector may choose to define each of the eight welded joints 202 , 204 , 206 , 208 , 210 , 212 , 214 and 216 as logical inspection points.
  • each of those items refers directly to a physical weld job that needs to be inspected.
  • Each logical inspection point will have one or more associated unique machine readable tags, such as RFID tag 218 .
  • RFID tag 218 For simplicity of illustration, only one unique machine readable tag 218 is shown, even though each logical inspection point may have one or more unique machine readable tags associated with it.
  • Non-physical logical inspection points for mast section 200 may include requiring that joints 202 , 204 , 206 and 216 have the same horizontal height in order to maintain balance, requiring that those same joints form a near-perfect square in a top-down view, or any other inspection goals or the like.
  • FIG. 3 is a flowchart of a method 300 of ensuring compliance of industrial inspections, detailing the flow of usage of the software on a handheld device, in accordance with yet another embodiment of the present invention.
  • This inspection software can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector.
  • This method generally begins at block 301 , where an inspector would begin inspection of some industrial component within physical viewable proximity.
  • Block 302 designates the fact that the industrial inspection cannot be completed unless the required scanning of each machine readable tag and an associated media sample capture operation are properly performed, or a properly documented reason is provided providing an explanation as to why a particular operation was skipped.
  • industrial inspection method 300 proceeds to block 304 where the main screen of the handheld device software is presented to the inspector.
  • This screen may contain buttons, text links or any other objects that allow the inspector to proceed with any aspect of the inspection.
  • a selection is made by the inspector from the main screen of the handheld device.
  • An inspector may select a component for inspection from a drop-down menu, a list, or the like, in which case industrial inspection method 300 proceeds to block 306 (described below).
  • An inspector may indicate that the inspection is complete, in which case industrial inspection method 300 proceeds to block 318 (described below).
  • an inspector may simply scan a unique machine-readable tag, in which case industrial inspection method 300 proceeds to block 305 (described below).
  • industrial inspection method 300 proceeds to block 306 , the inspector chooses a general component to be inspected from a list of components presented to him by the software.
  • These general components may either be whole physical articles or machines to be inspected, physical sections of the article/machine, or logical inspection points as described before.
  • the list of components is generally prepared by the inspector before the inspection, but the software may allow the inspector to add new components during the inspection if there is a need to do so. Any functions having to do with on-the-spot component configuration, segmentation of physical inspected components into logical inspection points, selection of inspected component, or any other functions or the like, are within scope of block 306 .
  • Block 310 represents a step in the inspection process that forces the inspector to explain why he is unable to scan a tag that is deployed at an inspection point for the purpose of ensuring that he is within physical proximity to the inspected component. Possible reasons may include the condition of a tag being broken, the condition of a tag being unable to be scanned for any reason, the condition of a tag being absent for any reason, the condition of a tag being misplaced, or any other unacceptable condition or the like.
  • a unique machine-readable tag may be a barcode sticker, a high-frequency (HF) radio-frequency identification (RFID) tag, an ultra-high-frequency (UHF) RFID tag, or any other tag or the like that serves as a unique identifier for a logical inspection point.
  • the scanning of the tag may be done by a corresponding tag reader either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation.
  • the software then recognizes the scanned tag's unique identifier and proceeds to retrieve all of its associated data and begins the inspection process for the logical inspection point associated with that particular tag.
  • industrial inspection method 300 checks whether or not the selected component has already been inspected. At this point, the process of selecting an inspection component or a logical inspection point, either by way of manual selection on the handheld device software or by scanning a unique machine-readable tag that the software maps to a particular logical inspection point, is assumed to have already been completed. The next screen presented to the inspector by the software is determined by whether or not the selection has already been inspected.
  • industrial inspection method 300 proceeds to block 312 , where the software guides the inspector to initiate the process of inspecting the selected component.
  • the inspection process itself involves one or more iterations of taking a media sample, as described in relation to block 108 of FIG. 1 , associating the media sample with a corresponding scan of a unique machine-readable tag or of a logical inspection point in the system as described in relation to block 112 of FIG. 1 , and editing the media sample as described above. Editing the media sample includes the actions of cropping the media sample, making annotations on the media sample as described in relation to blocks 114 and 116 of FIG. 1 , or any other action that can be done on a media sample or the like.
  • the software presents the component inspection screen to the inspector. From this screen the inspector may choose to continue inspection of the same component, which may include such actions as typing in notes, speaking into an audio input device if one is available and is able to be interpreted and stored by the software, taking another media sample, or take another inspection action.
  • industrial inspection method 300 may allow the inspector to add a quotation from some standards or specifications document, such as those of ASME (American Society of Mechanical Engineers).
  • the software will present the inspector with an interface for navigating a document, on which he may carry out document navigation and selection actions such as capturing a screenshot of a section of the document, cropping the screenshot, annotating the screenshot, selecting text, selecting a page, or any other action or the like.
  • industrial inspection method 300 may allow the inspector to insert any text selection, screenshot, link, reference of any sort, and the line, into any aspect of the inspection data that is associated with the particular inspected component or logical inspection point chosen in the particular iteration of block 312 .
  • the inspector can navigate the ASME standards document to section B 30.5 and take a screenshot of the text of that particular section. He can then draw a red line underneath the sentences that describe the standard for a joint welding job that this particular joint does not comply with. Then, he may crop the screenshot such as to capture only the sentences he just underlined and then presses a button on the handheld device to insert this cropped screenshot as an attachment to his inspection data for the joint of the tower crane mast section.
  • the inspector can also make a free-form observation of a potential problem identified in the course of the inspection that may not be on the pre-populated checklist. If an inspector makes an observation of a potential problem during an inspection, whether from a pre-populated list or in free-form, the problem is logged by the inspection compliance system so that any future visits to the same site require the problem(s) noted in the previous inspection visit to be re-visited before the next inspection can be satisfactorily completed.
  • Problems must be re-visited on subsequent inspections until they are fixed; re-visiting the problem means visiting the area where the problem was observed (and possibly swiping the machine readable tags), possibly noting any changes (taking new pictures, notes, etc. to describe changes), and optionally fixing the problems and recording pictures, notes, and the like of the fix. Problems will only be automatically populated into subsequent inspections until they are fixed.
  • one embodiment of the present invention also allows the inspector to immediately offer to fix the problem (e.g., repair the welding of a section of the crane mast), and to automatically generate a bill to the customer for fixing the problem.
  • One embodiment of the present invention allows the inspector to automatically generate, using the handheld device, a work items order for billing and accounting purposes, allowing the inspector to carry out the corrective measure immediately onsite without returning to the central office to generate a new work order.
  • the work items order includes a list of the steps taken to fix each problem; a line item for each charge associated with fixing each problem; and a picture taken before and/or after the job is complete. The customer may then immediately review the work items order onsite, sign the inspection report and the work items order, and pay for both the inspection and the charges associated with fixing the problems with the industrial equipment, all before the inspector leaves the site.
  • the data associated with each inspection is stored and versioned in a manner analogous to versioning of source code.
  • a virtual industrial equipment, and all of its subcomponent(s) is versioned for each inspection, in such a way as to ensure that the right information for each version of the industrial equipment and all of its subcomponent(s) is always associated with the correct inspection report.
  • This also adds an additional layer of accountability, as it is known at all times where, when, and by whom each observation and change to the equipment was made over all time.
  • the “shallowest closure component” is the minimum set of versioned data necessary to fully represent the components in question in their latest state, including whichever earlier versions are referenced by the current state.
  • industrial inspection method 300 guides the inspector to a component inspection screen that shows filled-in data fields of the inspection, or may contain buttons, links or other objects that allow the inspector to navigate through his previous inspection.
  • the software may or may not allow the inspector to edit or continue his previous inspection of the selected component.
  • industrial inspection method 300 proceeds back to block 304 , representing the main screen, where the process continues as described above.
  • industrial inspection method 300 proceeds to block 318 , where the software checks that all components marked to be inspected have gone through the required inspection procedure. If a component has not gone through the inspection procedure, the software will check that the inspector has provided an explanation in lieu of the inspection procedure, a declaration of a missing component, or has provided a reason as to why he did not carry out the inspection procedure.
  • industrial inspection method 300 proceeds back to block 304 , representing the main screen, where the inspector is instructed to complete the inspection of the missing component(s) or to provide a justification why the missing component(s) cannot or is not being inspected. In this manner, the inspector is given a chance to inspect missed components or edit already-inspected components.
  • industrial inspection method 300 proceeds to block 307 , where the industrial inspection method 300 allows the inspection to end, since the software has determined that the inspection process is complete because of the fulfillment of all requirements checked by the software in block 318 . If the inspection requirements have not been completely fulfilled as determined in block 318 , the software should preferably not allow the inspector to proceed to block 307 and end the inspection, since this would be inconsistent with ensuring complete compliance with the industrial inspection process.
  • the industrial inspection method 300 includes an additional step of storing all versions of all components that have ever been inspected by the system.
  • the industrial inspection method 300 includes an additional step of associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • the industrial inspection method 300 includes an additional step of substantiating inspector statements of problems with inspected components by quoting standards from a standards document.
  • the industrial inspection method 300 includes an additional step of generating a new work order item for any logical inspection point having a problem found during inspection.
  • the industrial inspection method 300 includes an additional step of generating a problem reminder that requires an inspector to revisit any problem found during an inspection in a future inspection until the problem is fixed.
  • the industrial inspection method 300 includes an additional step of associating with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location.
  • GPS global positioning system
  • the industrial inspection method 300 includes an additional step of associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • FIG. 4 is a block diagram of an exemplary computer system 400 , in accordance with one embodiment of the present invention.
  • the computer system 400 may correspond to a personal computer system, such as a desktops, laptops, tablets or handheld computer.
  • the computer system may also correspond to a computing device, such as a cell phone, PDA, dedicated media player, consumer electronic device, and the like.
  • the exemplary computer system 400 shown in FIG. 4 includes a processor 408 configured to execute instructions and to carry out operations associated with the computer system 400 .
  • the processor 408 may control the reception and manipulation of input and output data between components of the computing system 400 .
  • the processor 408 can be implemented on a single-chip, multiple chips or multiple electrical components.
  • various architectures can be used for the processor 408 , including dedicated or embedded processor, single purpose processor, controller, ASIC, and so forth.
  • the processor 408 together with an operating system operates to execute computer code and produce and use data.
  • Operating systems are generally well known and will not be described in greater detail.
  • the operating system may correspond to OS/2, Apple OS/X, Apple iPhone® OS, Google Android® OS, DOS, UNIX, Linux, Palm® OS, Windows, Windows Mobile®, Windows CE®, and the like.
  • the operating system can also be a special purpose operating system, such as may be used for limited purpose appliance-type computing devices.
  • the operating system, other computer code and data may reside within a memory block 414 that is operatively coupled to the processor 408 .
  • Memory block 414 generally provides a place to store computer code and data that are used by the computer system 400 .
  • the memory block 414 may include Read-Only Memory (ROM), Random-Access Memory (RAM), hard disk drive and the like.
  • ROM Read-Only Memory
  • RAM Random-Access Memory
  • the information could also reside on a removable storage medium and loaded or installed onto the computer system 400 when needed.
  • Removable storage mediums include, for example, CD-ROM, PC-CARD, memory card, floppy disk, magnetic tape, and a network component.
  • the computer system 400 also includes a display device 410 that is operatively coupled to the processor 408 .
  • the display device 410 may be a liquid crystal display (LCD) (e.g., active matrix, passive matrix and the like).
  • the display device 410 may be a monitor such as a monochrome display, color graphics adapter (CGA) display, enhanced graphics adapter (EGA) display, variable-graphics-array (VGA) display, super VGA display, cathode ray tube (CRT), and the like.
  • the display device may also correspond to a plasma display or a display implemented with electronic inks.
  • the display device 410 is generally configured to display a graphical user interface (GUI) that provides an easy to use interface between a user of the computer system and the operating system or application running thereon.
  • GUI graphical user interface
  • the graphical images may include windows, fields, dialog boxes, menus, icons, buttons, cursors, scroll bars, etc. Such images may be arranged in predefined layouts, or may be created dynamically to serve the specific actions being taken by a user.
  • the user can select and activate various graphical images in order to initiate functions and tasks associated therewith.
  • a user may select a button that opens, closes, minimizes, or maximizes a window, or an icon that launches a particular program.
  • the GUI can additionally or alternatively display information, such as non interactive text and graphics, for the user on the display device 410 .
  • the computer system 400 also includes a tag scanning input device 402 that is operatively coupled to the processor 408 .
  • the tag scanning input device 402 is configured to transfer data from the outside world into the computer system 400 .
  • the input device 402 is used to scan unique machine-readable tag 404 .
  • the unique machine-readable tag 404 may be a barcode sticker, a high-frequency (HF) radio-frequency identification (RFID) tag, an ultra-high-frequency (UHF) RFID tag, or any other tag or the like that serves as a unique identifier for a logical inspection point.
  • HF high-frequency
  • RFID radio-frequency identification
  • UHF ultra-high-frequency
  • the scanning of the tag may be done by a corresponding tag scanning input device 402 either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation.
  • a corresponding tag scanning input device 402 either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation.
  • Various other techniques of choosing the type of unique machine-readable tag and the scanning of it are within the skill of one of ordinary skill in the art.
  • the computer system 400 also includes a media sample input device 406 that is operatively coupled to the processor 408 .
  • the media sample input device 406 is configured to transfer data from the outside world into the computer system 400 .
  • the input device 406 is used to capture a media sample and may include cameras of any sort, video camcorders with audio input, video camcorders without audio input, infrared imagers, ultrasonic imagers, or any other type of mechanical, chemical or electromagnetic imager that can obtain visual media. This visual media could be a view of an inspected component 403 .
  • the taking of a media sample may be done by media sample input device 406 either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to take and store the media sample.
  • the computer system 400 also includes capabilities for coupling to one or more I/O devices 420 .
  • the I/O devices 420 may correspond to keyboards, printers, scanners, cameras, speakers, and/or the like.
  • the I/O devices 420 may be integrated with the computer system 400 or they may be separate components (e.g. peripheral devices).
  • the I/O devices 420 may be connected to the computer system 400 through wired connections (e.g. cables/ports).
  • the I/O devices 420 may be connected to the computer system 400 through wireless connections.
  • the data link may correspond to PS/2, USB, IR, RF, Bluetooth or the like.
  • the memory block 414 may include a tag scanning operational program 416 , which may be part of the operating system or a separate application.
  • the tag scanning operational program 416 generally includes a set of instructions that recognizes the occurrence of a tag scan operation on unique machine-readable tag 404 and informs one or more software agents of the presence of unique machine-readable tag 404 and/or what action(s) to take in response to the unique machine-readable tag 404 .
  • the memory block 414 may also include a media sample capturing program 418 , which may be part of the operating system or a separate application.
  • the media sample capturing program 418 generally includes a set of instructions that recognizes the occurrence of a media sample capture operation on the view of inspected component 403 and informs one or more software agents of media obtained and/or what action(s) to take in response to the media obtained.
  • the system 400 may also include a data storage area for storing all versions of all components that have ever been inspected by the system.
  • the system 400 may also a data storage area for associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • the system 400 may also allow the inspector to declare sub-optimal conditions of the unique machine-readable tags at each logical inspection point, substantiated by corresponding media samples, if condition warrants such declaration.
  • the system 400 may also allow the inspector to annotate the media samples in such ways that substantiate inspector statements of problems with inspected components found during inspection.
  • the system 400 may also allow the inspector to substantiate inspector statements of problems with inspected components by quoting standards from a standards document.
  • the system 400 may also allow the inspector to generate a new work order item for any logical inspection point having a problem found during inspection.
  • the system 400 may also allow an inspector to generate a problem reminder that requires the inspector to revisit any problem found during an inspection in a future inspection until the problem is fixed.
  • the system 400 may also allow the inspector to annotating the media samples in such ways that substantiate inspector statements of any inspected components passing inspection.
  • the system 400 may also allow the inspector to associate with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location via an associated GPS device (not shown).
  • GPS global positioning system
  • the system 400 may also allow the inspector to associate with the media sample and the scan of the unique machine-readable tag a unique user-identification of the inspector performing the inspection.
  • FIG. 5 is an illustration 550 of a multi-functional handheld device 500 , in which some of the software and hardware components of the system reside, in accordance with yet another embodiment of the present invention.
  • the handheld device 500 has a built-in display device 506 , which corresponds to the display device 410 described in FIG. 4 .
  • the handheld device 500 also has a keyboard 508 , which corresponds to I/O device 420 described in FIG. 4 .
  • the handheld device 500 also has an RFID scanner 502 , which corresponds to the tag scanning input device 402 described in FIG. 4 .
  • the handheld device 500 has a digital camera 504 , which corresponds to the media sample input device 406 described in FIG. 4 .
  • the handheld device 500 presented is but one of many possible illustrative embodiments of the handheld device of the present invention.
  • One of ordinary skill in the art would appreciate that any other configuration of components that make up the handheld device 500 , as well as any possible extensions by other hardware components, are all within the spirit and scope of the present invention.
  • FIG. 6 is an illustration of inspectors in physical proximity to an inspection component 200 , carrying out an inspection with handheld devices, in accordance with yet another embodiment of the present invention.
  • the inspectors 604 and 605 are standing around article 200 , which in this case is the mast section of a tower crane as shown earlier in FIG. 2 .
  • Inspector 604 is in the process of inspecting the welding of joint 212 of the mast section, while inspector 605 is in the process of inspecting the welding of joint 208 of the mast section. They are both using industrial inspection handheld device 500 , as presented in detail in FIG. 5 .
  • Inspector 604 is more specifically in the process of using industrial inspection handheld device 500 , even more specifically embedded RFID reader 502 , to scan RFID tag 218 via radio frequency communication channel 602 . Since inspector 604 is within proximity of the inspected component, the welding of joint 212 , which also serves as a logical inspection point for this inspection, he is able to successfully scan the RFID tag 218 because it is within the range of radio frequency communication channel 602 .
  • Inspector 605 is more specifically in the process of using industrial inspection handheld device 500 , even more specifically embedded digital camera 504 of FIG. 5 , to take a photograph of a view 606 of welded joint 208 of tower crane mast section 200 .
  • Welded joint 208 in this case plays the role of both the inspected component and the logical inspection point.
  • FIG. 6 The diagram of the inspection system shown in FIG. 6 is but one of many possible illustrative embodiments of the usage of the present invention.
  • One of ordinary skill in the art would appreciate that any other configuration, and representation thereof, of a similar system in use, as well as any possible extensions to the system, are all within the spirit and scope of the present invention.
  • FIG. 7 is a set of diagrams 700 of illustrative user interfaces in an inspection system installed on different handheld devices, in accordance with multiple embodiments of the present invention.
  • User interfaces 702 , 704 and 706 represent three possible embodiments of a user interface deployed on handheld devices for taking a media sample and editing it.
  • User interfaces 702 and 704 are deployed on a Windows Mobile® device while user interface 706 is deployed on an Apple iPhone®.
  • User interface 702 represents one possible UI design in which tabularized pages allow the inspector to jump between sequential stages of the inspection process.
  • User interfaces 704 and 706 both represent a possible UI design in which the inspector is presented with iconographic buttons corresponding to the process steps of taking a media sample and editing it.
  • FIG. 8 is a diagram of an illustrative user interface 800 in an inspection system, in accordance with another embodiment of the present invention. It consists of an image box 802 which is used to display an image along with overlaid objects, and a button group 806 that contains iconographic buttons for each function that the inspector can execute during the process of taking and editing a media sample. For example, if button 804 is pressed, the software activates the handheld device's digital camera and places the captured image in image box 802 . Other such functions that can be found in button group 806 include undo, redo, zoom in, zoom out, delete, annotate with circle, annotate with rectangle, annotate with line, choose color, and any other function of the like.
  • the illustrative user interface 800 is but one of many possible illustrative embodiments of the present invention.
  • One of ordinary skill in the art would appreciate that any other configuration of objects in a user interface, as well as any possible extensions to the set of functions presented in the user interface 800 , are all within the spirit and scope of the present invention.
  • FIG. 9 is an illustration of an inspector carrying out an inspection of wind turbine 902 and wind turbine 904 in accordance with yet another embodiment of the present invention.
  • the inspector 906 is standing next to the tower and foundation sections of wind turbine 904 .
  • the inspector 906 is using industrial inspection handheld device 908 (shown in detail in FIG. 5 ).
  • Inspector 906 is more specifically in the process of using industrial inspection handheld device 908 , even more specifically having an embedded RFID reader, to scan RFID tag 912 on tower section of wind turbine 904 , via radio frequency communication channel 910 . Since inspector 906 is within proximity of the inspected component, he is able to successfully scan the RFID tag 912 because it is within the range of radio frequency communication channel 910 .
  • FIG. 9 is but one of many possible illustrative embodiments of the usage of the present invention.
  • renewable energy systems and distributed energy systems including wind turbines, solar photovoltaic, solar thermal plants, co-generation plants, biomass-fueled power plants, carbon sequestration projects, enhanced oil recovery systems, and the like.
  • Some embodiments of the present invention may contain a correlation engine and an alerting engine for correlating and alerting on patterns of behavior that may indicate potential patterns of improper inspection behavior.
  • the correlation engine correlates any subset of inspection data segmented as inspection events, with other inspection data, as well as data coming from numerous other sources, including data from sensors and from third-party systems, as described in U.S. Pat. No. 7,382,244, filed on Oct. 4, 2007 issued on Jun. 3, 2008, and incorporated by reference in its entirety herein.
  • An alerting engine generates one or more alerts and performs one or more actions based on the correlation performed by the correlation engine.

Abstract

The present invention is a system and method for inspections and compliance verification of industrial equipment using a handheld device. An inspector first segments an inspected component into logical inspection points. The inspector then scans a unique machine-readable tag, such as an RFID tag, with a handheld device at each logical inspection point. The inspector then takes a media sample, such as a digital photograph, of the physical component referred to by each corresponding logical inspection point. Then the inspector associates the media samples with the corresponding scan of the unique machine-readable tag. For each of the actions the inspector carries out on the handheld device, a timestamp is added that represents evidence of a date and a time of physical visitation to the associated logical inspection point. The inspector may then annotate the media samples in such ways that substantiate inspector statements of problems with inspected components found during inspection.

Description

    REFERENCE TO RELATED APPLICATIONS
  • This application claims priority from provisional application Ser. No. 61/122,632, filed on Dec. 15, 2008, and entitled “A system, method and apparatus for inspections and compliance verification of industrial equipment using a handheld device,” the entirety of which is hereby incorporated by reference herein.
  • FIELD OF THE INVENTION
  • The present invention is generally related to inspection systems. More specifically, this invention relates to a system for inspection of industrial equipment assisted by a handheld device, which helps to ensure compliance of the safety and security of industrial equipment fit for business use. The present invention may be used to help prevent accidents that can happen during usage of such industrial equipment, as well as prevent negligent, missed or incomplete inspections of such industrial equipment.
  • BACKGROUND OF THE INVENTION
  • National U.S. statistics show that approximately 20% of accidents on construction sites involve cranes. “For the 11 years 1984-94, 502 deaths occurred in 479 incidents involving cranes in the construction industry” (Suruda, p. 4), which amounts to an average of 44 fatal crane accidents per year, with an average of one human life lost per crane accident. The number of crane-related deaths are on the rise since those statistics were compiled, due to a number of factors, including an increase in the number of construction projects, an increase in the size of the construction projects, and an increase in the economic pressures to complete construction projects on time and under budget, which have resulted in shortcuts many consider to be unsafe.
  • The leading causes of death associated with crane accidents include electrocution (39%), crane assembly/dismantling (12%), boom buckling/collapse (8%), crane upset/overturn (7%), rigging failure (7%), overloading (4%), and being struck by a moving load (4%) (Neitzel, p. 1109). Electrocution is generally caused by the crane either hitting a power line or coming close enough to a high-voltage power line to spark an electric arc. Crane assembly/dismantling fatalities usually occur “when a worker underneath the boom was knocking the boom pins out while the boom was held by the pendant line. When the lower supporting pins were removed, the boom fell onto the worker” (Suruda, p. 4). Of the crane upset/overturn incidents whose cause is known (and not due to overload), most occurred while the crane was moving or because of a failure to extend the outriggers. Rigging failures mostly occurred because the load slipped from the rigging or the rigging broke during the lift. Overloading resulted in fatalities due to boom collapse or crane overturning.
  • A rash of crane accidents is occurring around the country resulting in national and international news. Tight economic conditions and high energy prices have led to large numbers of large scale energy-related construction projects, such as the extension and building of new oil refineries. These construction projects are on extremely tight time and budget schedules because of the economic realities of high energy, and specifically petroleum, prices. The result has been an unprecedented number of deadly, costly, and highly publicized crane accidents.
  • For example, on Jun. 18, 2008, a crane accident at a Texas oil refinery killed four people and injured six others. The crane was not scheduled to be operated that day. On May 30, 2008, a crane accident in New York City killed two workers when the boom and cab snapped off the turntable and fell, apparently because of a bad weld in the rotating plate. Proper inspections were not carried out on the crane, and the New York City Buildings Department Head was fired by the Mayor over this and another preceding incident. On Mar. 25, 2008, a crane accident in Miami killed two workers in the fall of a 20-foot section that was being lifted to extend the height of the crane. The safety personnel who made the safety rules did not follow their own safety rules of evacuating the construction management office in the event of a pick. On Mar. 15, 2008, a second crane accident in New York City killed seven people when a piece of nylon webbing broke, dropping a six-ton metal collar that was being installed. It dislodged the collar below, disconnecting the crane from the building and allowing it to topple over onto a residential building. Proper inspections were not carried out on the crane, the construction site had numerous safety violations, and neighbors, residents, and passer-by's complained and lodged reports of unsafe activity and operation of the crane.
  • Many parties have sought unsuccessfully to prevent crane accidents, including OSHA, the construction industry, and various researchers. Strong heavy construction industry growth, especially in the oil, natural gas, and energy field, as a result of the high price of crude oil and energy, has resulted in the hiring of many workers, a large proportion of whom may be inadequately trained.
  • It is evident that many crane hazards go unnoticed or that efforts to prevent crane accidents are not effectively implemented. Crane hazards on sites should be detected through rigorous inspections of construction sites and eliminated through effective preventive approaches.
  • Traditional approaches that have provided crane safety equipment and proper training have not reduced the number of crane accidents. Traditional crane safety training is not sufficient to enable crane operators to detect and eliminate crane hazards.
  • Motivating crane operators, workers, independent contractors, management, and apparently safety officers themselves to fully follow all safety guidelines at all times is perhaps the greatest challenge.
  • In 2006, Zachry Construction Company had a crane-related fatality. A news article reported that “a crane crew consisting of a crane operator, and six employees, were moving a Kobelco CK2500-II crawler crane across a highway while traffic was shut down on the evening of Oct. 24, 2006. The six employees, three on each track, were using the tracks of the crane as a conveyor, placing rubber mats on the back of tracks of the crane and removing the mats from the front and side of the tracks in order to lay the mats on the highway to protect the highway as the crane advanced. As the crane crossed the closed northbound lanes, from west to east, the crane operator had to swing the crane in order to prevent the boom from contacting a concrete bridge column. The alarms sounded and the crane began its swing. One employee who was working along the southern track was caught by the head between the track and the counterweight.”
  • Texas has led the nation with 26 crane-related fatalities in 2005 and 2006, according to federal statistics. Cranes in Texas operate without any state or local oversight.
  • Human lives are lost unnecessarily every year because recognized and known safety procedures are not followed, overlooked, or even ignored. Construction accidents are not only bad for worker morale, but they bring bad press and hinder worker recruitment. They are also huge financial and logistical liabilities. Even with safety programs in place, historical claims data indicates construction is a potentially highly risky venture financially, especially in large industrial projects. The cost of risk can be quantified—there has been a national average of 82 crane fatalities per year from 1997-2006 (Bureau of Labor Statistics). An average of 1 crane fatality per $8B of construction value (Construction Management Magazine). Direct & indirect accident costs average at 3.8% of construction value, which includes workers' compensation payments, general liability, and litigation expenses (Business Roundtable). In addition, for every dollar of direct cost, there is $2.20 of indirect costs.
  • For example, Zachry Construction Company estimates that one day's delay in the construction of an oil refinery or power plant can cost Zachry over $300,000 in liquidated damages arising from guaranteed delivery contracts with the plant owners. A fatality, or any serious accident at a construction site, always leads to delays of multiple days or even weeks, disrupting construction work, both for site clean-up, internal inspections, as well as OSHA inspections.
  • Some costs may have balance sheet implications, yet are hard to define, especially for large complex projects involving petroleum. The time required to replace mission critical infrastructure damaged in an accident is generally long. The environmental impact can be large as well. For example, the oil spill of the Exxon Valdez oil tanker in Alaska resulted in a judgment of $2.5B. The loss of corporate reputation and goodwill, intangible and often unrecoverable assets, is substantial in the event of a crane accident.
  • Cranes are but one example of industrial equipment that is subject to inspection for compliance with safety or security standards. Other possible industrial equipment includes vehicles such as airplanes, buses, trains, subways, cars, ships, and trucks, public buildings, privately-owned buildings, residential homes, highways, train tracks, airport runways, ship harbors, bridges, underground tunnels, shelters, dams, conventional power plants, nuclear power plants, particle colliders, oil extraction sites, oil refineries, communication towers, data centers, sewage systems, water treatment plants, water wells, reservoirs, and any other equipment or the like.
  • Examples of inspections on industrial equipment other than cranes include the inspection of commercial airplanes with FAA (Federal Aviation Administration) standards, the inspection of communication towers with FCC (Federal Communications Commission) standards, the inspection of dams with state dam safety standards such as NJAC (New Jersey Administrative Code) 7:20, the inspection of nuclear power plants with IAEA (International Atomic Energy Agency) standards, and other similar inspections under public safety standards. Other inspection compliance requirements are associated with renewable energy systems and distributed energy systems, including wind turbines, solar photovoltaic, solar thermal plants, co-generation plants, biomass-fueled power plants, carbon sequestration projects, enhanced oil recovery systems, and the like. Therefore, as recognized by the present inventors, a system, method and apparatus of ensuring that inspections and maintenance procedures are carried out is highly desirable.
  • It is against this background that various embodiments of the present invention were developed.
  • BRIEF SUMMARY OF THE INVENTION
  • The present invention is a method and a system for inspections and compliance verification of industrial equipment using a handheld device.
  • One embodiment of the present invention is a method for ensuring compliance of industrial inspection. For the inspector, this involves first segmenting one or more inspected components into one or more logical inspection points. Then the inspector scans one or more unique machine-readable tags at each logical inspection point. Then the inspector takes one or more media samples of the inspected component at each logical inspection point. Then the inspector associates each media sample with the corresponding scan of the unique machine-readable tag. Finally, the inspector declares sub-optimal conditions of the unique machine-readable tags at each logical inspection point, substantiated by corresponding media samples, if condition warrants such declaration. A timestamp is added for each action taken at each logical inspection point, said timestamp representing evidence of a date and a time of physical visitation to said logical inspection point and associated action.
  • Another embodiment of the present invention involves the additional step of either annotating each media sample in such ways that substantiate inspector statements of any inspected components passing inspection, or annotating each media sample in such ways that substantiate inspector statements of problems with inspected components found during inspection.
  • Another embodiment of the present invention involves carrying out the method described, specifically the steps of scanning of one or more unique machine-readable tags and taking of each media sample at each logical inspection point, with a multi-function handheld device.
  • Another embodiment of the present invention involves using unique machine-readable tags that have limited maximum scan range, such that the scanning of the tags requires physical proximity of an inspector to the logical inspection point and implies proper visitation made by the inspector to the logical inspection point.
  • Another embodiment of the present invention involves substantiating inspector statements of problems with inspected components by quoting standards from a standards document.
  • Another embodiment of the present invention involves generating a new work order item for any logical inspection point having a problem found during inspection.
  • Another embodiment of the present invention involves generating a problem reminder that requires an inspector to revisit any problems found during an inspection in future inspections.
  • Another embodiment of the present invention involves associating with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location.
  • Another embodiment of the present invention involves associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection. The inspector may be identified by scanning his ID tag, photographing his face, capturing his handwritten signature, and the like.
  • Another embodiment of the present invention involves correlating any subset of inspection data segmented as inspection events, and activating one or more actions based on the correlation performed in the correlating step.
  • The present invention also includes a related system by which the method of ensuring compliance of industrial inspection could be carried out. Such a system could be implemented as a computer system, embodied in a handheld device using separate unique machine-readable tags deployed throughout logical inspection points on a physical inspected component. The system may include integrated or separate hardware components for scanning of unique machine-readable tags and taking of media samples of the inspected component.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
  • FIG. 1 is a flowchart of a method for ensuring compliance of industrial inspections, in accordance with one embodiment of the present invention;
  • FIG. 2 is an illustration of an illustrative inspection component, the mast section of a tower crane, which is segmented into logical inspection points, in accordance with another embodiment of the present invention;
  • FIG. 3 is a flowchart of a method of ensuring compliance of industrial inspections, detailing the flow of usage of the software on a handheld device, in accordance with yet another embodiment of the present invention;
  • FIG. 4 is a block diagram of a system, in accordance with yet another embodiment of the present invention;
  • FIG. 5 is an illustration of a multi-functional handheld device, in which some of the software and hardware components of the system reside, in accordance with yet another embodiment of the present invention;
  • FIG. 6 is an illustration of inspectors in physical proximity to an inspection component, carrying out an inspection with handheld devices, in accordance with yet another embodiment of the present invention;
  • FIG. 7 is a set of diagrams of illustrative user interfaces in an inspection system installed on different handheld devices, in accordance with multiple embodiments of the present invention;
  • FIG. 8 is a diagram of an illustrative user interface of an inspection system, in accordance with another yet embodiment of the present invention; and
  • FIG. 9 is an illustration of an illustrative application of the present invention for ensuring proper inspection of wind turbines and other renewable energy systems, according to yet another embodiment of the present invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • The invention generally pertains to an industrial inspection compliance system with which various methods can be carried out to the effect of assisting in an inspection and providing the means for compliance verification of a proper inspection. For the purposes of the text describing this invention, an inspection may represent the process of checking a physical component for safety, security or business reasons, doing the same for compliance with industry standards and guidelines, or a maintenance operation on a physical component for those same reasons. These methods can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector. Examples of multi-function handheld devices include the Apple iPhone®, the Psion Teklogix Workabout Pro®, the Motorola MC-75®, and the like, but the present invention is not limited to such devices as shown or described here. One aspect of the invention relates to scanning unique machine-readable tags deployed at logical inspection points defined by the inspector, and assigning a timestamp to the scanning operation. Another aspect of the invention relates to taking media samples of logical inspection points defined by the inspector, and assigning a timestamp to the media sample capturing operation. Another aspect of the invention relates to reporting of sub-optimal conditions of the unique machine-readable tags deployed at logical inspection points if its condition warrants such a declaration. Another aspect of the invention relates to associating a media sample with a corresponding scan of a unique machine-readable tag. Another aspect of the invention relates to annotating a media sample in such ways that substantiate statements of an industrial component passing inspection, or in such ways that substantiate statements of problems found with the industrial component.
  • These and other aspects of the invention are discussed below with reference to FIGS. 1-8. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.
  • FIG. 1 is a flowchart diagram of a method 150 for ensuring compliance of industrial inspections, in accordance with one embodiment of the present invention. This inspection method can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector. This method generally begins at block 100 where an inspector would inspect some industrial component within physical viewable proximity. The component mentioned may include an article or machine, or groups of articles or machines, which are marked to be inspected against prevailing safety or security standards. This embodiment of the invention requires an inspector to be within physical viewable proximity from the inspected component in order to help ensure that the inspector has actually visited the component. This requirement may be enforced by the fact that the inspector will be unable to perform the operations on the handheld device to carry out this method if he is not within physical viewable proximity of the industrial component to be inspected. This method assumes that the physical component has already been logically separated into one or more logical inspection points as shown in FIG. 2, which will be described in more detail later. This method also assumes that the physical component has already been tagged with unique machine-readable tags at each logical inspection point.
  • Following block 100, industrial inspection method 150 proceeds to block 101 where the inspector selects a logical inspection point to begin inspection. This may be done on the device software by selecting from a list of physical components or from a list of logical inspection points, depending on how the inspector chose to configure the system. Alternatively, this may be done by scanning the unique machine-readable tag deployed at the logical inspection point to be selected, as in block 104.
  • Following block 101, industrial inspection method 150 proceeds to a decision block 103, where a decision is made if the unique machine-readable tag is in a “sub-optimal” condition (if it is not readable for whatever reason, it is considered to be in a sub-optimal condition). In the situation where the unique machine-readable tag deployed at the logical inspection point is found to be in sub-optimal condition, the industrial inspection method 150 proceeds to block 102, where the inspector may report the condition that justifies the sub-optimal condition. This reporting may be done in addition to or in lieu of scanning the machine-readable tag. A sub-optimal condition includes the condition of a tag being broken, the condition of a tag being unable to be scanned for any reason, the condition of a tag being absent for any reason, the condition of a tag being misplaced, or any other unacceptable condition or the like.
  • In the situation where the unique machine-readable tag deployed at the logical inspection point is not in a sub-optimal condition, industrial inspection method 150 proceeds to block 104 where an inspector scans the unique machine-readable tag deployed at the selected logical inspection point. A unique machine-readable tag may be a barcode sticker, a high-frequency (HF) radio-frequency identification (RFID) tag, an ultra-high-frequency (UHF) RFID tag, or any other tag or the like that serves as a unique identifier for a logical inspection point. The scanning of the tag may be done by a corresponding tag reader either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation. Various other techniques of choosing the type of unique machine-readable tag and its scanning are within the skill of one of ordinary skill in the art.
  • Following block 104, industrial inspection method 150 proceeds to block 106, where a timestamp is assigned to the scanning operation of block 104. The timestamp may be expressed as a date and time pair, POSIX time, or any other representation that is semantically consistent between any other timestamp assignment made in the scope of this method. The general purpose of the timestamp assignment is to seal a record of the point in time at which the inspector executed an operation that is a critical component to the proof of inspection. This step is important to the goal of ensuring compliance of the industrial inspection process. Therefore, one of ordinary skill would appreciate that block 104 may not only consist of the action of timestamp assignment, but possibly also the action of timestamp verification, such as the employment and execution of a digitally-signed timestamp, or any other action of the like.
  • Following block 106, industrial inspection method 150 proceeds to block 108 where an inspector takes a media sample of the selected logical inspection point. A media sample is defined to be a photograph, a sequence of photographs, an ultrasonic image, an infrared image, any other type of mechanically, chemically or electromagnetically-obtained image, a video with an audio component, a video without an audio component, or any other visual or set of visual media or the like. The taking of a media sample may be done by a media input component either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to take and store the media sample.
  • Following block 108, industrial inspection method 150 proceeds to block 110 where a timestamp is assigned to the media sample taking operation of block 108. The timestamp assignment in block 110 is of the same spirit and scope as the timestamp assignment described in block 106.
  • Following block 110, industrial inspection method 118 proceeds to block 112 where the media sample taken in block 108 is associated with a scanning of a unique machine-readable tag in block 104. This association may take the form of a database join table in which ID's of media samples are paired with ID's of unique machine-readable tags, with the ID's having already been established during the operations of scanning the unique machine-readable tag and taking the media sample. For example, an inspector may scan RFID (the unique machine-readable tag) tag number 0039850921847576, the operation of which is recorded by his handheld device software in a database table called “TagScans” that has a primary key called “id” and assigns this record an “id” of 3. Then the inspector learns from the device software that the RFID he just scanned is referring to a particular joint of the mast section of the tower crane he is inspecting, a logical inspection point he had segmented previously. He then takes a photograph (the media sample) of the vicinity of the RFID tag he just scanned, making sure to capture a good shot of the joint, which is the logical inspection point he intends to inspect. After taking the photograph, the handheld device software first records the photographing operation in a database table called “PhotoCaptures” that has a primary key called “id” and assigns this record an “id” of 8. Then it associates the two records just created from the RFID scanning and photographing operations by creating a new record in a database join table called “TagScansAndPhotoCaptures” with the following (TagScanId, PhotoCaptureId) pair: (3, 8). The tag scan and media sample are now logically associated, according to one embodiment of the present invention.
  • Following block 112, industrial inspection method 150 proceeds to decision block 113, where a determination is made by the inspector if the logical inspection point successfully passes the criteria established for the inspection. In the situation in which the logical inspection point passes the inspection, the industrial inspection method 150 proceeds to block 114 where an inspector annotates the media sample taken in block 108 in such ways as to substantiate his statement of the logical inspection point passing inspection. When an inspector allows a logical inspection point to pass inspection, he is making a very serious statement about the integrity of the physical component in the face of safety or security standards against which it must hold. Therefore, the step described in block 114 provides the means by which the inspector may add supportive marks, indications, statements, or other data or metadata of the like that serve to justify his statement of the logical inspection point passing inspection.
  • In the situation in which the logical inspection point does not pass the inspection, industrial inspection method 150 may possibly proceed to block 116 where an inspector annotates the media sample taken in block 108 in such ways as to substantiate his statement of problems found with the logical inspection point. A useful inspection will need to indicate how the physical component is faulty, what codes in which standards that the fault violates if there exists any applicable code or standard, what should be done to remedy the fault, or any other supportive material or the like. Therefore, the step described in block 116 provides the means by which the inspector may add supportive marks, indications, statements, or other data or metadata or the like that serve to justify his statement of problems found with the logical inspection point.
  • The process of annotating a media sample as described in block 114 and 116 includes any step that helps to substantiate a conclusive statement made by the inspector about a physical inspected component. The conclusive statement generally refers to either a statement of an industrial component passing inspection as in block 114 or a statement of problems found with an industrial component as in block 116, but may include any other conceivable conclusive statement or the like. For example, if the media sample taken is a photograph of a joint in the mast section of a tower crane and the inspector determines that the joint is not properly welded, the photograph is then annotated by the inspector to visually show the location of the improper welding. In this case, the inspector uses the touch screen capabilities of the handheld device and the capabilities of the software to draw a red circle on the digital photograph he took, encircling the segment of the photograph in which the improperly-welded joint is visible. One of ordinary skill would appreciate that drawing a red circle on a photograph is but one of many possible ways to annotate a media sample. Other methods include highlighting a segment of a photograph with a bright color such as done in the physical analogue of using a highlighter pen, creating and populating a free-form text field with a connected pointer line superimposed on a photograph and pointing to a specific point on the photograph, drawing a thick black border around the form of an object identified in an infrared image, making the same such annotations on a series of video stills all belonging to the same video sequence, superimposing text on a set of video stills to effectively subtitle a video, or any other method of media sample annotation or the like.
  • FIG. 2 is an illustration of an illustrative inspection component, the mast section of a tower crane 200, which is segmented into logical inspection points, in accordance with another embodiment of the present invention. The diagram serves as an example of a possible industrial component that must be inspected against safety or security standards, such as those of ASME (American Society of Mechanical Engineers). Items 202, 204, 206, 208, 210, 212, 214 and 216 are welded joints on this tower crane mast section, which in this case are the logical inspection points for this physical inspected component. A logical inspection point may include any physical sub-component of any physical inspected component of the article or machine to be inspected, even of the physical article/machine itself, or any non-physical aspect of inspection that can somehow be mapped to a physical component or sub-component of the inspected article/machine. Logical inspection points may be defined by the inspector before or during an inspection, whereby each physical article or machine that is to be inspected has at least one logical inspection point. For example, if the tower crane mast section 200 is to be considered the inspected physical article, the inspector may choose to define each of the eight welded joints 202, 204, 206, 208, 210, 212, 214 and 216 as logical inspection points. In this case, each of those items refers directly to a physical weld job that needs to be inspected. Each logical inspection point will have one or more associated unique machine readable tags, such as RFID tag 218. For simplicity of illustration, only one unique machine readable tag 218 is shown, even though each logical inspection point may have one or more unique machine readable tags associated with it. Non-physical logical inspection points for mast section 200 may include requiring that joints 202, 204, 206 and 216 have the same horizontal height in order to maintain balance, requiring that those same joints form a near-perfect square in a top-down view, or any other inspection goals or the like.
  • FIG. 3 is a flowchart of a method 300 of ensuring compliance of industrial inspections, detailing the flow of usage of the software on a handheld device, in accordance with yet another embodiment of the present invention. This inspection software can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector. This method generally begins at block 301, where an inspector would begin inspection of some industrial component within physical viewable proximity. Block 302 designates the fact that the industrial inspection cannot be completed unless the required scanning of each machine readable tag and an associated media sample capture operation are properly performed, or a properly documented reason is provided providing an explanation as to why a particular operation was skipped.
  • Following block 302, industrial inspection method 300 proceeds to block 304 where the main screen of the handheld device software is presented to the inspector. This screen may contain buttons, text links or any other objects that allow the inspector to proceed with any aspect of the inspection.
  • Following block 304, a selection is made by the inspector from the main screen of the handheld device. An inspector may select a component for inspection from a drop-down menu, a list, or the like, in which case industrial inspection method 300 proceeds to block 306 (described below). An inspector may indicate that the inspection is complete, in which case industrial inspection method 300 proceeds to block 318 (described below). Alternatively, an inspector may simply scan a unique machine-readable tag, in which case industrial inspection method 300 proceeds to block 305 (described below).
  • If industrial inspection method 300 proceeds to block 306, the inspector chooses a general component to be inspected from a list of components presented to him by the software. These general components may either be whole physical articles or machines to be inspected, physical sections of the article/machine, or logical inspection points as described before. The list of components is generally prepared by the inspector before the inspection, but the software may allow the inspector to add new components during the inspection if there is a need to do so. Any functions having to do with on-the-spot component configuration, segmentation of physical inspected components into logical inspection points, selection of inspected component, or any other functions or the like, are within scope of block 306.
  • Following block 306, industrial inspection method 300 proceeds to block 310 where the inspector explains the inability to scan a unique machine-readable tag whose identification refers to the component. Since the spirit of this invention pertains to compliance of inspection of industrial equipment, and since the inspector is able to select a component from a list of components in block 306, therefore bypassing the need to be in physical proximity of the inspected component, the inspector should be prompted to provide and record an acceptable reason as to why he cannot scan a tag. Block 310 represents a step in the inspection process that forces the inspector to explain why he is unable to scan a tag that is deployed at an inspection point for the purpose of ensuring that he is within physical proximity to the inspected component. Possible reasons may include the condition of a tag being broken, the condition of a tag being unable to be scanned for any reason, the condition of a tag being absent for any reason, the condition of a tag being misplaced, or any other unacceptable condition or the like.
  • If industrial inspection method 300 proceeds to block 305, the inspector scans a unique machine-readable tag deployed at the selected logical inspection point. A unique machine-readable tag may be a barcode sticker, a high-frequency (HF) radio-frequency identification (RFID) tag, an ultra-high-frequency (UHF) RFID tag, or any other tag or the like that serves as a unique identifier for a logical inspection point. The scanning of the tag may be done by a corresponding tag reader either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation. Various other techniques of choosing the type of unique machine-readable tag and the scanning of it are within the skill of one of ordinary skill in the art. The software then recognizes the scanned tag's unique identifier and proceeds to retrieve all of its associated data and begins the inspection process for the logical inspection point associated with that particular tag.
  • Following either block 305 or block 310, industrial inspection method 300 checks whether or not the selected component has already been inspected. At this point, the process of selecting an inspection component or a logical inspection point, either by way of manual selection on the handheld device software or by scanning a unique machine-readable tag that the software maps to a particular logical inspection point, is assumed to have already been completed. The next screen presented to the inspector by the software is determined by whether or not the selection has already been inspected.
  • If a determination is made that the selected component has not been inspected, industrial inspection method 300 proceeds to block 312, where the software guides the inspector to initiate the process of inspecting the selected component. The inspection process itself involves one or more iterations of taking a media sample, as described in relation to block 108 of FIG. 1, associating the media sample with a corresponding scan of a unique machine-readable tag or of a logical inspection point in the system as described in relation to block 112 of FIG. 1, and editing the media sample as described above. Editing the media sample includes the actions of cropping the media sample, making annotations on the media sample as described in relation to blocks 114 and 116 of FIG. 1, or any other action that can be done on a media sample or the like.
  • In block 312, after the inspector takes the media sample and edits it as described above, the software presents the component inspection screen to the inspector. From this screen the inspector may choose to continue inspection of the same component, which may include such actions as typing in notes, speaking into an audio input device if one is available and is able to be interpreted and stored by the software, taking another media sample, or take another inspection action.
  • In block 312, industrial inspection method 300 may allow the inspector to add a quotation from some standards or specifications document, such as those of ASME (American Society of Mechanical Engineers). The software will present the inspector with an interface for navigating a document, on which he may carry out document navigation and selection actions such as capturing a screenshot of a section of the document, cropping the screenshot, annotating the screenshot, selecting text, selecting a page, or any other action or the like.
  • In block 312, industrial inspection method 300 may allow the inspector to insert any text selection, screenshot, link, reference of any sort, and the line, into any aspect of the inspection data that is associated with the particular inspected component or logical inspection point chosen in the particular iteration of block 312. For example, if the inspector is currently inspecting a welded joint of a tower crane mast section and he finds that the welding job is not done properly, not compliant with the ASME B 30.5 standard, then in carrying out the action of block 312, the inspector can navigate the ASME standards document to section B 30.5 and take a screenshot of the text of that particular section. He can then draw a red line underneath the sentences that describe the standard for a joint welding job that this particular joint does not comply with. Then, he may crop the screenshot such as to capture only the sentences he just underlined and then presses a button on the handheld device to insert this cropped screenshot as an attachment to his inspection data for the joint of the tower crane mast section.
  • In addition to allowing an inspector to select an item from a pre-populated checklist, which requires the inspector to go through each item on the checklist, in one embodiment of the present invention, the inspector can also make a free-form observation of a potential problem identified in the course of the inspection that may not be on the pre-populated checklist. If an inspector makes an observation of a potential problem during an inspection, whether from a pre-populated list or in free-form, the problem is logged by the inspection compliance system so that any future visits to the same site require the problem(s) noted in the previous inspection visit to be re-visited before the next inspection can be satisfactorily completed. Problems must be re-visited on subsequent inspections until they are fixed; re-visiting the problem means visiting the area where the problem was observed (and possibly swiping the machine readable tags), possibly noting any changes (taking new pictures, notes, etc. to describe changes), and optionally fixing the problems and recording pictures, notes, and the like of the fix. Problems will only be automatically populated into subsequent inspections until they are fixed.
  • In addition to allowing the inspector to perform an inspection, one embodiment of the present invention also allows the inspector to immediately offer to fix the problem (e.g., repair the welding of a section of the crane mast), and to automatically generate a bill to the customer for fixing the problem. One embodiment of the present invention allows the inspector to automatically generate, using the handheld device, a work items order for billing and accounting purposes, allowing the inspector to carry out the corrective measure immediately onsite without returning to the central office to generate a new work order. The work items order includes a list of the steps taken to fix each problem; a line item for each charge associated with fixing each problem; and a picture taken before and/or after the job is complete. The customer may then immediately review the work items order onsite, sign the inspection report and the work items order, and pay for both the inspection and the charges associated with fixing the problems with the industrial equipment, all before the inspector leaves the site.
  • Importantly, according to one embodiment of the present invention, the data associated with each inspection is stored and versioned in a manner analogous to versioning of source code. A virtual industrial equipment, and all of its subcomponent(s), is versioned for each inspection, in such a way as to ensure that the right information for each version of the industrial equipment and all of its subcomponent(s) is always associated with the correct inspection report. This also adds an additional layer of accountability, as it is known at all times where, when, and by whom each observation and change to the equipment was made over all time. In order to reduce space consumption on the hand-held device, only the current version of the item(s) being inspected are stored in the handheld device, in addition to any prior versions of the item(s) that are referenced by the current version; that is, only the “shallowest closure component” of the entire version tree is stored locally on the handheld device. That is, the “shallowest closure component” is the minimum set of versioned data necessary to fully represent the components in question in their latest state, including whichever earlier versions are referenced by the current state.
  • Returning to FIG. 3, if a determination is made that the selected component has already been inspected, industrial inspection method 300 guides the inspector to a component inspection screen that shows filled-in data fields of the inspection, or may contain buttons, links or other objects that allow the inspector to navigate through his previous inspection. At this point, the software may or may not allow the inspector to edit or continue his previous inspection of the selected component.
  • Following block 312, industrial inspection method 300, proceeds back to block 304, representing the main screen, where the process continues as described above.
  • If the inspector indicates that he has completed the inspection, industrial inspection method 300 proceeds to block 318, where the software checks that all components marked to be inspected have gone through the required inspection procedure. If a component has not gone through the inspection procedure, the software will check that the inspector has provided an explanation in lieu of the inspection procedure, a declaration of a missing component, or has provided a reason as to why he did not carry out the inspection procedure.
  • Following block 318, if a determination is made that the inspector has not fulfilled the requirements checked in block 318, industrial inspection method 300 proceeds back to block 304, representing the main screen, where the inspector is instructed to complete the inspection of the missing component(s) or to provide a justification why the missing component(s) cannot or is not being inspected. In this manner, the inspector is given a chance to inspect missed components or edit already-inspected components.
  • Following block 318, industrial inspection method 300 proceeds to block 307, where the industrial inspection method 300 allows the inspection to end, since the software has determined that the inspection process is complete because of the fulfillment of all requirements checked by the software in block 318. If the inspection requirements have not been completely fulfilled as determined in block 318, the software should preferably not allow the inspector to proceed to block 307 and end the inspection, since this would be inconsistent with ensuring complete compliance with the industrial inspection process.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of storing all versions of all components that have ever been inspected by the system.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of substantiating inspector statements of problems with inspected components by quoting standards from a standards document.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of generating a new work order item for any logical inspection point having a problem found during inspection.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of generating a problem reminder that requires an inspector to revisit any problem found during an inspection in a future inspection until the problem is fixed.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of associating with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location.
  • In one embodiment of the present invention, not shown in FIG. 3, the industrial inspection method 300 includes an additional step of associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • FIG. 4 is a block diagram of an exemplary computer system 400, in accordance with one embodiment of the present invention. The computer system 400 may correspond to a personal computer system, such as a desktops, laptops, tablets or handheld computer. The computer system may also correspond to a computing device, such as a cell phone, PDA, dedicated media player, consumer electronic device, and the like.
  • The exemplary computer system 400 shown in FIG. 4 includes a processor 408 configured to execute instructions and to carry out operations associated with the computer system 400. For example, using instructions retrieved from memory 414, the processor 408 may control the reception and manipulation of input and output data between components of the computing system 400. The processor 408 can be implemented on a single-chip, multiple chips or multiple electrical components. For example, various architectures can be used for the processor 408, including dedicated or embedded processor, single purpose processor, controller, ASIC, and so forth.
  • In most cases, the processor 408 together with an operating system operates to execute computer code and produce and use data. Operating systems are generally well known and will not be described in greater detail. By way of example, the operating system may correspond to OS/2, Apple OS/X, Apple iPhone® OS, Google Android® OS, DOS, UNIX, Linux, Palm® OS, Windows, Windows Mobile®, Windows CE®, and the like. The operating system can also be a special purpose operating system, such as may be used for limited purpose appliance-type computing devices. The operating system, other computer code and data may reside within a memory block 414 that is operatively coupled to the processor 408. Memory block 414 generally provides a place to store computer code and data that are used by the computer system 400. By way of example, the memory block 414 may include Read-Only Memory (ROM), Random-Access Memory (RAM), hard disk drive and the like. The information could also reside on a removable storage medium and loaded or installed onto the computer system 400 when needed. Removable storage mediums include, for example, CD-ROM, PC-CARD, memory card, floppy disk, magnetic tape, and a network component.
  • The computer system 400 also includes a display device 410 that is operatively coupled to the processor 408. The display device 410 may be a liquid crystal display (LCD) (e.g., active matrix, passive matrix and the like). Alternatively, the display device 410 may be a monitor such as a monochrome display, color graphics adapter (CGA) display, enhanced graphics adapter (EGA) display, variable-graphics-array (VGA) display, super VGA display, cathode ray tube (CRT), and the like. The display device may also correspond to a plasma display or a display implemented with electronic inks.
  • The display device 410 is generally configured to display a graphical user interface (GUI) that provides an easy to use interface between a user of the computer system and the operating system or application running thereon. Generally speaking, the GUI represents programs, files and operational options with graphical images. The graphical images may include windows, fields, dialog boxes, menus, icons, buttons, cursors, scroll bars, etc. Such images may be arranged in predefined layouts, or may be created dynamically to serve the specific actions being taken by a user. During operation, the user can select and activate various graphical images in order to initiate functions and tasks associated therewith. By way of example, a user may select a button that opens, closes, minimizes, or maximizes a window, or an icon that launches a particular program. The GUI can additionally or alternatively display information, such as non interactive text and graphics, for the user on the display device 410.
  • The computer system 400 also includes a tag scanning input device 402 that is operatively coupled to the processor 408. The tag scanning input device 402 is configured to transfer data from the outside world into the computer system 400. The input device 402 is used to scan unique machine-readable tag 404. The unique machine-readable tag 404 may be a barcode sticker, a high-frequency (HF) radio-frequency identification (RFID) tag, an ultra-high-frequency (UHF) RFID tag, or any other tag or the like that serves as a unique identifier for a logical inspection point. The scanning of the tag may be done by a corresponding tag scanning input device 402 either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to read the corresponding tag, whether by way of visual identification, radio frequency identification, or the like, and store a record of the scanning operation. Various other techniques of choosing the type of unique machine-readable tag and the scanning of it are within the skill of one of ordinary skill in the art.
  • The computer system 400 also includes a media sample input device 406 that is operatively coupled to the processor 408. The media sample input device 406 is configured to transfer data from the outside world into the computer system 400. The input device 406 is used to capture a media sample and may include cameras of any sort, video camcorders with audio input, video camcorders without audio input, infrared imagers, ultrasonic imagers, or any other type of mechanical, chemical or electromagnetic imager that can obtain visual media. This visual media could be a view of an inspected component 403. The taking of a media sample may be done by media sample input device 406 either embedded in the inspector's handheld device, or embodied in a separate dedicated device, implemented in whichever way is necessary to take and store the media sample.
  • The computer system 400 also includes capabilities for coupling to one or more I/O devices 420. By way of example, the I/O devices 420 may correspond to keyboards, printers, scanners, cameras, speakers, and/or the like. The I/O devices 420 may be integrated with the computer system 400 or they may be separate components (e.g. peripheral devices). In some cases, the I/O devices 420 may be connected to the computer system 400 through wired connections (e.g. cables/ports). In other cases, the I/O devices 420 may be connected to the computer system 400 through wireless connections. By way of example, the data link may correspond to PS/2, USB, IR, RF, Bluetooth or the like.
  • The memory block 414 may include a tag scanning operational program 416, which may be part of the operating system or a separate application. The tag scanning operational program 416 generally includes a set of instructions that recognizes the occurrence of a tag scan operation on unique machine-readable tag 404 and informs one or more software agents of the presence of unique machine-readable tag 404 and/or what action(s) to take in response to the unique machine-readable tag 404.
  • The memory block 414 may also include a media sample capturing program 418, which may be part of the operating system or a separate application. The media sample capturing program 418 generally includes a set of instructions that recognizes the occurrence of a media sample capture operation on the view of inspected component 403 and informs one or more software agents of media obtained and/or what action(s) to take in response to the media obtained.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also include a data storage area for storing all versions of all components that have ever been inspected by the system.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also a data storage area for associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to declare sub-optimal conditions of the unique machine-readable tags at each logical inspection point, substantiated by corresponding media samples, if condition warrants such declaration.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to annotate the media samples in such ways that substantiate inspector statements of problems with inspected components found during inspection.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to substantiate inspector statements of problems with inspected components by quoting standards from a standards document.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to generate a new work order item for any logical inspection point having a problem found during inspection.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow an inspector to generate a problem reminder that requires the inspector to revisit any problem found during an inspection in a future inspection until the problem is fixed.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to annotating the media samples in such ways that substantiate inspector statements of any inspected components passing inspection.
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to associate with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location via an associated GPS device (not shown).
  • Not shown in FIG. 4, in one embodiment, the system 400 may also allow the inspector to associate with the media sample and the scan of the unique machine-readable tag a unique user-identification of the inspector performing the inspection.
  • FIG. 5 is an illustration 550 of a multi-functional handheld device 500, in which some of the software and hardware components of the system reside, in accordance with yet another embodiment of the present invention. The handheld device 500 has a built-in display device 506, which corresponds to the display device 410 described in FIG. 4. The handheld device 500 also has a keyboard 508, which corresponds to I/O device 420 described in FIG. 4. The handheld device 500 also has an RFID scanner 502, which corresponds to the tag scanning input device 402 described in FIG. 4. Lastly, the handheld device 500 has a digital camera 504, which corresponds to the media sample input device 406 described in FIG. 4. The handheld device 500 presented is but one of many possible illustrative embodiments of the handheld device of the present invention. One of ordinary skill in the art would appreciate that any other configuration of components that make up the handheld device 500, as well as any possible extensions by other hardware components, are all within the spirit and scope of the present invention.
  • FIG. 6 is an illustration of inspectors in physical proximity to an inspection component 200, carrying out an inspection with handheld devices, in accordance with yet another embodiment of the present invention. The inspectors 604 and 605 are standing around article 200, which in this case is the mast section of a tower crane as shown earlier in FIG. 2. Inspector 604 is in the process of inspecting the welding of joint 212 of the mast section, while inspector 605 is in the process of inspecting the welding of joint 208 of the mast section. They are both using industrial inspection handheld device 500, as presented in detail in FIG. 5.
  • Inspector 604 is more specifically in the process of using industrial inspection handheld device 500, even more specifically embedded RFID reader 502, to scan RFID tag 218 via radio frequency communication channel 602. Since inspector 604 is within proximity of the inspected component, the welding of joint 212, which also serves as a logical inspection point for this inspection, he is able to successfully scan the RFID tag 218 because it is within the range of radio frequency communication channel 602.
  • Inspector 605 is more specifically in the process of using industrial inspection handheld device 500, even more specifically embedded digital camera 504 of FIG. 5, to take a photograph of a view 606 of welded joint 208 of tower crane mast section 200. Welded joint 208 in this case plays the role of both the inspected component and the logical inspection point.
  • The diagram of the inspection system shown in FIG. 6 is but one of many possible illustrative embodiments of the usage of the present invention. One of ordinary skill in the art would appreciate that any other configuration, and representation thereof, of a similar system in use, as well as any possible extensions to the system, are all within the spirit and scope of the present invention.
  • FIG. 7 is a set of diagrams 700 of illustrative user interfaces in an inspection system installed on different handheld devices, in accordance with multiple embodiments of the present invention. User interfaces 702, 704 and 706 represent three possible embodiments of a user interface deployed on handheld devices for taking a media sample and editing it. User interfaces 702 and 704 are deployed on a Windows Mobile® device while user interface 706 is deployed on an Apple iPhone®. User interface 702 represents one possible UI design in which tabularized pages allow the inspector to jump between sequential stages of the inspection process. User interfaces 704 and 706 both represent a possible UI design in which the inspector is presented with iconographic buttons corresponding to the process steps of taking a media sample and editing it. The diagrams presented in FIG. 7 are but some of many possible illustrative embodiments of the present invention. One of ordinary skill in the art would appreciate that any other configuration of objects in a user interface, on any other handheld device, as well as any possible extensions to the set of functions presented in the user interfaces of FIG. 7, are all within the spirit and scope of the present invention.
  • FIG. 8 is a diagram of an illustrative user interface 800 in an inspection system, in accordance with another embodiment of the present invention. It consists of an image box 802 which is used to display an image along with overlaid objects, and a button group 806 that contains iconographic buttons for each function that the inspector can execute during the process of taking and editing a media sample. For example, if button 804 is pressed, the software activates the handheld device's digital camera and places the captured image in image box 802. Other such functions that can be found in button group 806 include undo, redo, zoom in, zoom out, delete, annotate with circle, annotate with rectangle, annotate with line, choose color, and any other function of the like. The illustrative user interface 800 is but one of many possible illustrative embodiments of the present invention. One of ordinary skill in the art would appreciate that any other configuration of objects in a user interface, as well as any possible extensions to the set of functions presented in the user interface 800, are all within the spirit and scope of the present invention.
  • FIG. 9 is an illustration of an inspector carrying out an inspection of wind turbine 902 and wind turbine 904 in accordance with yet another embodiment of the present invention. The inspector 906 is standing next to the tower and foundation sections of wind turbine 904. The inspector 906 is using industrial inspection handheld device 908 (shown in detail in FIG. 5). Inspector 906 is more specifically in the process of using industrial inspection handheld device 908, even more specifically having an embedded RFID reader, to scan RFID tag 912 on tower section of wind turbine 904, via radio frequency communication channel 910. Since inspector 906 is within proximity of the inspected component, he is able to successfully scan the RFID tag 912 because it is within the range of radio frequency communication channel 910.
  • The illustration shown in FIG. 9 is but one of many possible illustrative embodiments of the usage of the present invention. One of ordinary skill in the art would appreciate that many possible uses of the present invention are all within the spirit and scope of the present invention, including, but not limited to, renewable energy systems and distributed energy systems, including wind turbines, solar photovoltaic, solar thermal plants, co-generation plants, biomass-fueled power plants, carbon sequestration projects, enhanced oil recovery systems, and the like.
  • Some embodiments of the present invention may contain a correlation engine and an alerting engine for correlating and alerting on patterns of behavior that may indicate potential patterns of improper inspection behavior. The correlation engine correlates any subset of inspection data segmented as inspection events, with other inspection data, as well as data coming from numerous other sources, including data from sensors and from third-party systems, as described in U.S. Pat. No. 7,382,244, filed on Oct. 4, 2007 issued on Jun. 3, 2008, and incorporated by reference in its entirety herein. An alerting engine generates one or more alerts and performs one or more actions based on the correlation performed by the correlation engine.
  • While the methods disclosed herein have been described and shown with reference to particular operations performed in a particular order, it will be understood that these operations may be combined, sub-divided, or re-ordered to form equivalent methods without departing from the teachings of the present invention. Accordingly, unless specifically indicated herein, the order and grouping of the operations is not a limitation of the present invention.
  • While the invention has been particularly shown and described with reference to embodiments thereof, it will be understood by those skilled in the art that various other changes in the form and details may be made without departing from the spirit and scope of the invention.

Claims (32)

1. A method for ensuring compliance of industrial inspection, comprising the steps of:
segmenting one or more inspected components into one or more logical inspection points;
scanning one or more unique machine-readable tags at each logical inspection point;
taking one or more media samples of the inspected component at each logical inspection point; and
associating the media samples with the corresponding scan of the unique machine-readable tag,
wherein a timestamp is added for each action taken at each logical inspection point, said timestamp representing evidence of a date and a time of physical visitation to said logical inspection point and associated action.
2. The method as recited in claim 1, further comprising:
declaring sub-optimal conditions of the unique machine-readable tags at each logical inspection point, substantiated by corresponding media samples, if condition warrants such declaration.
3. The method as recited in claim 1, further comprising:
annotating the media samples in such ways that substantiate inspector statements of problems with inspected components found during inspection.
4. The method as recited in claim 3, further comprising:
substantiating inspector statements of problems with inspected components by quoting standards from a standards document.
5. The method of claim 3, further comprising:
generating a new work order item for any logical inspection point having a problem found during inspection.
6. The method as recited in claim 3, further comprising:
generating a problem reminder that requires an inspector to revisit any problem found during an inspection in a future inspection until the problem is fixed.
7. The method as recited in claim 1, further comprising:
annotating the media samples in such ways that substantiate inspector statements of any inspected components passing inspection.
8. The method as recited in claim 1, wherein the scanning of one or more unique machine-readable tags and the taking of the media samples at each logical inspection point is done by a handheld device.
9. The method as recited in claim 1, wherein the unique machine-readable tags have limited maximum scan range, such that the scanning of the tags requires physical proximity of an inspector to the logical inspection point and implies proper visitation made by the inspector to the logical inspection point.
10. The method as recited in claim 1, further comprising:
associating with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location.
11. The method as recited in claim 1, further comprising:
associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
12. An industrial inspection compliance system, comprising:
one or more physical components marked to be inspected;
one or more logical inspection points segmented from the physical components, having at least one unique machine-readable tag at each logical inspection point;
one or more scanning devices which can read the unique machine-readable tags at each logical inspection point; and
one or more media input devices which can capture media samples of inspected physical components at each logical inspection point.
13. The system as described in claim 12, wherein the scanning device and the media input device are parts of the same physical device.
14. The system as described in claim 12, wherein the scanning device and the media input device are connected via one or more electrical interconnects.
15. The system as described in claim 12, wherein the scanning device and the media input device are connected via one or more wired or wireless networks.
16. The system as described in claim 12, wherein the scanning device and the media input device are logically connected via one or more remote databases which are accessible to and shared by both devices.
17. The system as described in claim 12, further comprising a data storage area for storing information representing segmentation of physical components as logical inspection points.
18. The system as described in claim 12, further comprising a data storage area for storing information representing each scan obtained by the scanning device, wherein each record comprises a timestamp of each scan, and a unique identifier of the scanned machine-readable tag.
19. The system as described in claim 12, further comprising a data storage area for storing information representing the media samples obtained by the media input device, wherein each record comprises a timestamp of the taking of the corresponding media sample, and the media sample itself.
20. The system as described in claim 18, wherein each record further comprises associations with any media samples obtained by the media input device.
21. The system as described in claim 19, wherein each record further comprises associations with any scans obtained by the scanning device.
22. The system as described in claim 12, further comprising a data storage area for storing all versions of all components that have ever been inspected by the system.
23. The system as described in claim 12, further comprising a data storage area for associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
24. The system as recited in claim 12, further comprising:
means for declaring sub-optimal conditions of the unique machine-readable tags at each logical inspection point, substantiated by corresponding media samples, if condition warrants such declaration.
25. The system as recited in claim 12, further comprising:
means for annotating the media samples in such ways that substantiate inspector statements of problems with inspected components found during inspection.
26. The system as recited in claim 12, further comprising:
means for substantiating inspector statements of problems with inspected components by quoting standards from a standards document.
27. The system of claim 12, further comprising:
means for generating a new work order item for any logical inspection point having a problem found during inspection.
28. The system as recited in claim 12, further comprising:
means for generating a problem reminder that requires an inspector to revisit any problem found during an inspection in a future inspection until the problem is fixed.
29. The system as recited in claim 12, further comprising:
means for annotating the media samples in such ways that substantiate inspector statements of any inspected components passing inspection.
30. The system as recited in claim 12, further comprising:
means for associating with the media sample and the scan of the unique machine-readable tag a unique global positioning system (GPS) location.
31. The system as recited in claim 12, further comprising:
means for associating with the media sample and the scan of the unique machine-readable tag a unique user-identification of an inspector performing the inspection.
32. An industrial inspection compliance system, comprising:
one or more physical components marked to be inspected;
one or more logical inspection points segmented from the physical components, having one or more unique machine-readable tags at each logical inspection point;
one or more scanning devices which can read the unique machine-readable tags at each logical inspection point;
one or more media input devices which can capture media samples of inspected physical components at each logical inspection point;
a data storage area for storing information representing segmentation of physical components as logical inspection points;
a data storage area for storing information representing each scan obtained by the scanning device, wherein each record comprises a timestamp of each scan, a unique identifier of the scanned machine-readable tag, and associations with any scans obtained by the scanning device; and
a data storage area for storing information representing the media samples obtained by the media input device, wherein each record comprises a timestamp of the taking of the corresponding media sample, the media sample itself, and associations with any media samples obtained by the media input device.
US12/489,313 2008-12-15 2009-06-22 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device Abandoned US20100153168A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US12/489,313 US20100153168A1 (en) 2008-12-15 2009-06-22 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
US12/758,134 US20100185549A1 (en) 2008-12-15 2010-04-12 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
PCT/US2010/039472 WO2011005513A1 (en) 2009-06-22 2010-06-22 An inspection compliance system using a handheld device, and related methods for facilitating inspections and maintenance operations

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12263208P 2008-12-15 2008-12-15
US12/489,313 US20100153168A1 (en) 2008-12-15 2009-06-22 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/758,134 Continuation US20100185549A1 (en) 2008-12-15 2010-04-12 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device

Publications (1)

Publication Number Publication Date
US20100153168A1 true US20100153168A1 (en) 2010-06-17

Family

ID=42239966

Family Applications (6)

Application Number Title Priority Date Filing Date
US12/489,313 Abandoned US20100153168A1 (en) 2008-12-15 2009-06-22 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
US12/507,039 Abandoned US20100149211A1 (en) 2008-12-15 2009-07-21 System and method for cropping and annotating images on a touch sensitive display device
US12/507,071 Expired - Fee Related US8032830B2 (en) 2008-12-15 2009-07-22 System and method for generating quotations from a reference document on a touch sensitive display device
US12/758,134 Abandoned US20100185549A1 (en) 2008-12-15 2010-04-12 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
US12/767,077 Abandoned US20100194781A1 (en) 2008-12-15 2010-04-26 System and method for cropping and annotating images on a touch sensitive display device
US12/832,903 Expired - Fee Related US7971140B2 (en) 2008-12-15 2010-07-08 System and method for generating quotations from a reference document on a touch sensitive display device

Family Applications After (5)

Application Number Title Priority Date Filing Date
US12/507,039 Abandoned US20100149211A1 (en) 2008-12-15 2009-07-21 System and method for cropping and annotating images on a touch sensitive display device
US12/507,071 Expired - Fee Related US8032830B2 (en) 2008-12-15 2009-07-22 System and method for generating quotations from a reference document on a touch sensitive display device
US12/758,134 Abandoned US20100185549A1 (en) 2008-12-15 2010-04-12 System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
US12/767,077 Abandoned US20100194781A1 (en) 2008-12-15 2010-04-26 System and method for cropping and annotating images on a touch sensitive display device
US12/832,903 Expired - Fee Related US7971140B2 (en) 2008-12-15 2010-07-08 System and method for generating quotations from a reference document on a touch sensitive display device

Country Status (1)

Country Link
US (6) US20100153168A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090048949A1 (en) * 2007-08-16 2009-02-19 Facility Audit Solutions, Llc System and method for managing photographs from site audits of facilities
WO2012012303A1 (en) * 2010-07-23 2012-01-26 Jkads Llc Method for inspecting a physical asset
US20130009785A1 (en) * 2011-07-07 2013-01-10 Finn Clayton L Visual and Audio Warning System Including Test Ledger for Automated Door
US20130144416A1 (en) * 2011-06-06 2013-06-06 Paramit Corporation Verification methods and systems for use in computer directed assembly and manufacture
US20140344077A1 (en) * 2013-03-15 2014-11-20 Contact Marketing Services, Inc. Used industrial equipment sales application suites, systems, and related apparatus and methods
CN104729714A (en) * 2013-12-18 2015-06-24 上海宝钢工业技术服务有限公司 Spot inspection instrument device based on Android phone platform
US20160314546A1 (en) * 2015-04-27 2016-10-27 First Advantage Corporation Device and method for performing validation and authentication of a physical structure or physical object
US20170104823A1 (en) * 2015-10-10 2017-04-13 David Sean Capps Fire service and equipment inspection test and maintenance system
US9652460B1 (en) 2013-05-10 2017-05-16 FotoIN Mobile Corporation Mobile media information capture and management methods and systems
CN108140150A (en) * 2015-10-30 2018-06-08 西门子股份公司 For safeguarding the system and method for industrial plants
US20190295139A1 (en) * 2013-01-22 2019-09-26 General Electric Company Systems and methods for a non-destructive testing ecosystem
US20190378351A1 (en) * 2018-06-11 2019-12-12 International Business Machines Corporation Cognitive learning for vehicle sensor monitoring and problem detection
US20220188955A1 (en) * 2015-10-10 2022-06-16 David Sean Capps Fire Service and Equipment Inspection Test and Maintenance System and Method

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8106856B2 (en) 2006-09-06 2012-01-31 Apple Inc. Portable electronic device for photo management
US8013738B2 (en) 2007-10-04 2011-09-06 Kd Secure, Llc Hierarchical storage manager (HSM) for intelligent storage of large volumes of data
US7382244B1 (en) 2007-10-04 2008-06-03 Kd Secure Video surveillance, storage, and alerting system having network management, hierarchical data storage, video tip processing, and vehicle plate analysis
US8957865B2 (en) * 2009-01-05 2015-02-17 Apple Inc. Device, method, and graphical user interface for manipulating a user interface object
TWI497357B (en) * 2009-04-23 2015-08-21 Waltop Int Corp Multi-touch pad control method
JP5607726B2 (en) * 2009-08-21 2014-10-15 トムソン ライセンシング Method, apparatus, and program for adjusting parameters on user interface screen
EP2480957B1 (en) 2009-09-22 2017-08-09 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
US8780069B2 (en) 2009-09-25 2014-07-15 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
US8799775B2 (en) * 2009-09-25 2014-08-05 Apple Inc. Device, method, and graphical user interface for displaying emphasis animations for an electronic document in a presentation mode
JP5656585B2 (en) * 2010-02-17 2015-01-21 キヤノン株式会社 Document creation support apparatus, document creation support method, and program
US7793850B1 (en) * 2010-03-14 2010-09-14 Kd Secure Llc System and method used for configuration of an inspection compliance tool with machine readable tags and their associations to inspected components
JP5459031B2 (en) * 2010-04-13 2014-04-02 ソニー株式会社 Information processing apparatus, information processing method, and program
WO2011152166A1 (en) * 2010-05-31 2011-12-08 株式会社Pfu Overhead scanner apparatus, image processing method, and program
US9139240B1 (en) * 2010-08-13 2015-09-22 Kodiak Innovations, LLC Apparatus for decreasing aerodynamic drag, improving stability, and reducing road spray of a transport vehicle
JP5685928B2 (en) * 2010-12-24 2015-03-18 ソニー株式会社 Information processing apparatus, image data optimization method, and program
US20120185787A1 (en) * 2011-01-13 2012-07-19 Microsoft Corporation User interface interaction behavior based on insertion point
US20120210200A1 (en) * 2011-02-10 2012-08-16 Kelly Berger System, method, and touch screen graphical user interface for managing photos and creating photo books
US9182882B2 (en) 2011-04-12 2015-11-10 Autodesk, Inc. Dynamic creation and modeling of solid models
US8947429B2 (en) 2011-04-12 2015-02-03 Autodesk, Inc. Gestures and tools for creating and editing solid models
US8902222B2 (en) 2012-01-16 2014-12-02 Autodesk, Inc. Three dimensional contriver tool for modeling with multi-touch devices
US8860726B2 (en) 2011-04-12 2014-10-14 Autodesk, Inc. Transform manipulator control
US8860675B2 (en) 2011-07-12 2014-10-14 Autodesk, Inc. Drawing aid system for multi-touch devices
KR101859100B1 (en) * 2011-07-19 2018-05-17 엘지전자 주식회사 Mobile device and control method for the same
US20130021138A1 (en) * 2011-07-20 2013-01-24 GM Global Technology Operations LLC Method of evaluating structural integrity of a vehicle component with radio frequency identification tags and system for same
US20130063369A1 (en) * 2011-09-14 2013-03-14 Verizon Patent And Licensing Inc. Method and apparatus for media rendering services using gesture and/or voice control
US20130086933A1 (en) * 2011-10-07 2013-04-11 Colleen M. Holtkamp Controller for a medical products storage system
WO2013109245A1 (en) * 2012-01-16 2013-07-25 Autodesk, Inc. Dynamic creation and modeling of solid models
WO2013109244A1 (en) * 2012-01-16 2013-07-25 Autodesk, Inc. Three dimensional contriver tool for modeling with multi-touch devices
WO2013109246A1 (en) * 2012-01-16 2013-07-25 Autodesk, Inc. Gestures and tools for creating and editing solid models
TWI475473B (en) * 2012-02-17 2015-03-01 Mitac Int Corp Method for generating split screen according to a touch gesture
US20130227457A1 (en) * 2012-02-24 2013-08-29 Samsung Electronics Co. Ltd. Method and device for generating captured image for display windows
KR102304700B1 (en) * 2012-02-24 2021-09-28 삼성전자주식회사 Method and device for generating capture image for display windows
US9299019B2 (en) * 2012-03-14 2016-03-29 Trimble Navigation Limited Systems for data collection
CN102662525A (en) * 2012-04-27 2012-09-12 上海量明科技发展有限公司 Method and terminal for carrying out screenshot operation through touch screen
CA2793763C (en) * 2012-05-24 2015-12-29 Research In Motion Limited Presentation of image on display screen with combination crop and rotation and with auto-resizing of crop field
US20140172684A1 (en) * 2012-12-14 2014-06-19 Scott Gerard Wolfe, Jr. System and Method to Utilize Presumptions, Database Information, and/or User Defaults to Calculate Construction Lien, Notice, Bond Claim, and Other Construction Document Deadlines and Requirements
US20220335385A1 (en) * 2012-06-07 2022-10-20 Procore Technologies, Inc. System and method for systematic presentation and ordering of documents based on triggers
US20170024695A1 (en) * 2013-12-24 2017-01-26 Scott Gerard Wolfe, Jr. System and method for systematic presentation and ordering of documents based on triggers
US20170186105A1 (en) * 2012-08-30 2017-06-29 Smith and Turner Development LLC Method to inspect equipment
US9705835B2 (en) * 2012-11-02 2017-07-11 Pandexio, Inc. Collaboration management systems
US20140281895A1 (en) * 2013-03-15 2014-09-18 Kah Seng Tay Techniques for embedding quotes of content
WO2014153409A2 (en) 2013-03-20 2014-09-25 Lifetime Brands, Inc. Method and apparatus for mobile quality management inspections
US20140330731A1 (en) * 2013-05-06 2014-11-06 RDH Environmental Services, LLC System and method for managing backflow prevention assembly test data
US10417763B2 (en) 2014-07-25 2019-09-17 Samsung Electronics Co., Ltd. Image processing apparatus, image processing method, x-ray imaging apparatus and control method thereof
US10672089B2 (en) * 2014-08-19 2020-06-02 Bert L. Howe & Associates, Inc. Inspection system and related methods
US10671275B2 (en) 2014-09-04 2020-06-02 Apple Inc. User interfaces for improving single-handed operation of devices
US9329762B1 (en) * 2015-06-02 2016-05-03 Interactive Memories, Inc. Methods and systems for reversing editing operations in media-rich projects
CN106325663B (en) * 2015-06-27 2019-09-17 南昌欧菲光科技有限公司 Mobile terminal and its screenshotss method
CN105151436B (en) * 2015-09-03 2017-03-22 温州智信机电科技有限公司 Spark plug sheath sleeving machine with function of material detection, and reliable working
EP3365272A4 (en) * 2015-10-19 2019-06-26 University of North Texas Dynamic reverse gas stack model for portable chemical detection devices to locate threat and point-of-source from effluent streams
GB201611152D0 (en) * 2016-06-27 2016-08-10 Moletest Ltd Image processing
US11095502B2 (en) * 2017-11-03 2021-08-17 Otis Elevator Company Adhoc protocol for commissioning connected devices in the field
CN108205412B (en) * 2017-11-09 2019-10-11 中兴通讯股份有限公司 A kind of method and apparatus for realizing screenshotss
WO2020027813A1 (en) * 2018-07-31 2020-02-06 Hewlett-Packard Development Company, L.P. Cropping portions of images
DK201970535A1 (en) 2019-05-06 2020-12-21 Apple Inc Media browsing user interface with intelligently selected representative media items
DK202070616A1 (en) 2020-02-14 2022-01-14 Apple Inc User interfaces for workout content
US11294556B1 (en) * 2021-01-05 2022-04-05 Adobe Inc. Editing digital images using multi-panel graphical user interfaces

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040143419A1 (en) * 2001-07-11 2004-07-22 Stark Randal Raymond Systems and methods for managing inspections
US6859757B2 (en) * 2002-07-31 2005-02-22 Sap Aktiengesellschaft Complex article tagging with maintenance related information
US20050065842A1 (en) * 2003-07-28 2005-03-24 Richard Summers System and method for coordinating product inspection, repair and product maintenance
US20080275714A1 (en) * 2007-05-01 2008-11-06 David Frederick Martinez Computerized requirement management system
US7860268B2 (en) * 2006-12-13 2010-12-28 Graphic Security Systems Corporation Object authentication using encoded images digitally stored on the object

Family Cites Families (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69104770T2 (en) * 1990-01-11 1995-03-16 Toshiba Kawasaki Kk DEVICE TO SUPPORT INSTALLATION INSPECTION.
US6262732B1 (en) * 1993-10-25 2001-07-17 Scansoft, Inc. Method and apparatus for managing and navigating within stacks of document pages
US7028044B2 (en) * 1994-12-22 2006-04-11 University Of Utah Research Foundation Highlighting quoted passages in a hypertext system
US5732230A (en) * 1995-05-19 1998-03-24 Richo Company Ltd. Computer user interface for manipulating image fragments using drag, drop and merge operations
US6665490B2 (en) * 1998-04-01 2003-12-16 Xerox Corporation Obtaining and using data associating annotating activities with portions of recordings
US6283759B1 (en) * 1998-11-13 2001-09-04 R. J. Price System for demonstrating compliance with standards
US6304271B1 (en) * 1999-02-05 2001-10-16 Sony Corporation Apparatus and method for cropping an image in a zooming graphical user interface
US20020023109A1 (en) * 1999-12-30 2002-02-21 Lederer Donald A. System and method for ensuring compliance with regulations
US20010047283A1 (en) * 2000-02-01 2001-11-29 Melick Bruce D. Electronic system for identification, recording, storing, and retrieving material handling equipment records and certifications
US20020025085A1 (en) * 2000-04-19 2002-02-28 Ipads.Com, Inc. Computer-controlled system and method for generating a customized imprinted item
US7038714B1 (en) * 2000-05-16 2006-05-02 Eastman Kodak Company Printing system and method having a digital printer that uses a digital camera image display
US7181304B2 (en) * 2000-09-07 2007-02-20 Praeses Corporation System and method for an online jurisdiction manager
US8198986B2 (en) * 2001-11-13 2012-06-12 Ron Craik System and method for storing and retrieving equipment inspection and maintenance data
US7231135B2 (en) * 2001-05-18 2007-06-12 Pentax Of American, Inc. Computer-based video recording and management system for medical diagnostic equipment
US9760235B2 (en) * 2001-06-12 2017-09-12 Callahan Cellular L.L.C. Lens-defined adjustment of displays
US7084886B2 (en) * 2002-07-16 2006-08-01 Idelix Software Inc. Using detail-in-context lenses for accurate digital image cropping and measurement
US6587768B2 (en) * 2001-08-08 2003-07-01 Meritor Heavy Vehicle Technology, Llc Vehicle inspection and maintenance system
US6671646B2 (en) * 2001-09-11 2003-12-30 Zonar Compliance Systems, Llc System and process to ensure performance of mandated safety and maintenance inspections
US7557696B2 (en) * 2001-09-11 2009-07-07 Zonar Systems, Inc. System and process to record inspection compliance data
US8400296B2 (en) * 2001-09-11 2013-03-19 Zonar Systems, Inc. Method and apparatus to automate data collection during a mandatory inspection
US20030069716A1 (en) * 2001-10-09 2003-04-10 Martinez David Frederick System & method for performing field inspection
US20030131011A1 (en) * 2002-01-04 2003-07-10 Argent Regulatory Services, L.L.C. Online regulatory compliance system and method for facilitating compliance
US20050228688A1 (en) * 2002-02-14 2005-10-13 Beyond Compliance Inc. A compliance management system
CA2394268A1 (en) * 2002-02-14 2003-08-14 Beyond Compliance Inc. A compliance management system
WO2003096161A2 (en) * 2002-05-10 2003-11-20 Confoti, Inc. Apparatus for interactive specification of manufactured products
US20030229858A1 (en) * 2002-06-06 2003-12-11 International Business Machines Corporation Method and apparatus for providing source information from an object originating from a first document and inserted into a second document
US8120624B2 (en) * 2002-07-16 2012-02-21 Noregin Assets N.V. L.L.C. Detail-in-context lenses for digital image cropping, measurement and online maps
US20040177326A1 (en) * 2002-10-21 2004-09-09 Bibko Peter N. Internet/intranet software system to audit and manage compliance
AU2003279994A1 (en) * 2002-10-21 2004-05-13 John P. Sinisi System and method for mobile data collection
US7356393B1 (en) * 2002-11-18 2008-04-08 Turfcentric, Inc. Integrated system for routine maintenance of mechanized equipment
US20050111699A1 (en) * 2003-11-24 2005-05-26 Emil Gran Suite of parking regulation control systems
US7536278B2 (en) * 2004-05-27 2009-05-19 International Electronic Machines Corporation Inspection method, system, and program product
US7454050B2 (en) * 2004-06-18 2008-11-18 Csi Technology, Inc. Method of automating a thermographic inspection process
US7743348B2 (en) * 2004-06-30 2010-06-22 Microsoft Corporation Using physical objects to adjust attributes of an interactive display application
US8826328B2 (en) * 2004-11-12 2014-09-02 Opentv, Inc. Communicating primary content streams and secondary content streams including targeted advertising to a remote unit
US20060132291A1 (en) * 2004-11-17 2006-06-22 Dourney Charles Jr Automated vehicle check-in inspection method and system with digital image archiving
US20060132836A1 (en) * 2004-12-21 2006-06-22 Coyne Christopher R Method and apparatus for re-sizing image data
US7834876B2 (en) * 2004-12-28 2010-11-16 The Mathworks, Inc. Providing graphic generating capabilities for a model based development process
US20060218492A1 (en) * 2005-03-22 2006-09-28 Andrade Jose O Copy and paste with citation attributes
US7869944B2 (en) * 2005-04-18 2011-01-11 Roof Express, Llc Systems and methods for recording and reporting data collected from a remote location
US20060235741A1 (en) * 2005-04-18 2006-10-19 Dataforensics, Llc Systems and methods for monitoring and reporting
US7324905B2 (en) * 2005-05-11 2008-01-29 Robert James Droubie Apparatus, system and method for automating an interactive inspection process
US7357571B2 (en) * 2005-07-01 2008-04-15 Predictive Service, Llc Infrared inspection and reporting process
US20070027704A1 (en) * 2005-07-28 2007-02-01 Simplikate Systems, L.L.C. System and method for community association violation tracking and processing
US20070050177A1 (en) * 2005-08-25 2007-03-01 Kirkland James R Jr Methods and Systems for Accessing Code Information
US7851758B1 (en) * 2005-09-29 2010-12-14 Flir Systems, Inc. Portable multi-function inspection systems and methods
US20070097089A1 (en) * 2005-10-31 2007-05-03 Battles Amy E Imaging device control using touch pad
US8368749B2 (en) * 2006-03-27 2013-02-05 Ge Inspection Technologies Lp Article inspection apparatus
WO2008054847A2 (en) * 2006-04-03 2008-05-08 3M Innovative Properties Company Vehicle inspection using radio frequency identification (rfid)
JP4781883B2 (en) * 2006-04-04 2011-09-28 株式会社日立製作所 Information management method and information management system
US20100171826A1 (en) * 2006-04-12 2010-07-08 Store Eyes, Inc. Method for measuring retail display and compliance
US8230362B2 (en) * 2006-05-31 2012-07-24 Manheim Investments, Inc. Computer-assisted and/or enabled systems, methods, techniques, services and user interfaces for conducting motor vehicle and other inspections
US20070288859A1 (en) * 2006-06-07 2007-12-13 Siemens Communications, Inc. Method and apparatus for selective forwarding of e-mail and document content
US20080021717A1 (en) * 2006-06-08 2008-01-24 Db Industries, Inc. Method of Facilitating Controlled Flow of Information for Safety Equipment Items and Database Related Thereto
US20080021905A1 (en) * 2006-06-08 2008-01-24 Db Industries, Inc. Direct Data Input for Database for Safety Equipment Items and Method
US20080021718A1 (en) * 2006-06-08 2008-01-24 Db Industries, Inc. Centralized Database of Information Related to Inspection of Safety Equipment Items Inspection and Method
US20080052377A1 (en) * 2006-07-11 2008-02-28 Robert Light Web-Based User-Dependent Customer Service Interaction with Co-Browsing
US8106856B2 (en) * 2006-09-06 2012-01-31 Apple Inc. Portable electronic device for photo management
US8564544B2 (en) * 2006-09-06 2013-10-22 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
GB2443010B (en) * 2006-10-10 2009-09-02 Promethean Technologies Group Interactive display system
US8396280B2 (en) * 2006-11-29 2013-03-12 Honeywell International Inc. Apparatus and method for inspecting assets in a processing or other environment
US7865872B2 (en) * 2006-12-01 2011-01-04 Murex S.A.S. Producer graph oriented programming framework with undo, redo, and abort execution support
US11126966B2 (en) * 2007-01-23 2021-09-21 Tegris, Inc. Systems and methods for a web based inspection compliance registry and communication tool
KR101420419B1 (en) * 2007-04-20 2014-07-30 엘지전자 주식회사 Electronic Device And Method Of Editing Data Using the Same And Mobile Communication Terminal
JP4904223B2 (en) * 2007-08-23 2012-03-28 キヤノン株式会社 Image processing apparatus and image processing method
JP2009104268A (en) * 2007-10-22 2009-05-14 Hitachi Displays Ltd Coordinate detection device and operation method using touch panel
US8224020B2 (en) * 2007-11-29 2012-07-17 Kabushiki Kaisha Toshiba Appearance inspection apparatus, appearance inspection system, and appearance inspection appearance
US8571747B2 (en) * 2007-12-06 2013-10-29 The Boeing Company System and method for managing aircraft maintenance
TW200935278A (en) * 2008-02-04 2009-08-16 E Lead Electronic Co Ltd A cursor control system and method thereof
WO2009117419A2 (en) * 2008-03-17 2009-09-24 Worcester Polytechnic Institute Virtual interactive system for ultrasound training
US20090271243A1 (en) * 2008-04-25 2009-10-29 Btsafety Llc. System and method of providing product quality and safety
US8526767B2 (en) * 2008-05-01 2013-09-03 Atmel Corporation Gesture recognition
US8866698B2 (en) * 2008-10-01 2014-10-21 Pleiades Publishing Ltd. Multi-display handheld device and supporting system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040143419A1 (en) * 2001-07-11 2004-07-22 Stark Randal Raymond Systems and methods for managing inspections
US6859757B2 (en) * 2002-07-31 2005-02-22 Sap Aktiengesellschaft Complex article tagging with maintenance related information
US20050065842A1 (en) * 2003-07-28 2005-03-24 Richard Summers System and method for coordinating product inspection, repair and product maintenance
US7860268B2 (en) * 2006-12-13 2010-12-28 Graphic Security Systems Corporation Object authentication using encoded images digitally stored on the object
US20080275714A1 (en) * 2007-05-01 2008-11-06 David Frederick Martinez Computerized requirement management system

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090048949A1 (en) * 2007-08-16 2009-02-19 Facility Audit Solutions, Llc System and method for managing photographs from site audits of facilities
WO2012012303A1 (en) * 2010-07-23 2012-01-26 Jkads Llc Method for inspecting a physical asset
US9064290B2 (en) 2010-07-23 2015-06-23 Jkads Llc Method for inspecting a physical asset
US20130144416A1 (en) * 2011-06-06 2013-06-06 Paramit Corporation Verification methods and systems for use in computer directed assembly and manufacture
US9329594B2 (en) * 2011-06-06 2016-05-03 Paramit Corporation Verification methods and systems for use in computer directed assembly and manufacture
US20130009785A1 (en) * 2011-07-07 2013-01-10 Finn Clayton L Visual and Audio Warning System Including Test Ledger for Automated Door
US11869052B2 (en) * 2013-01-22 2024-01-09 Baker Hughes Holdings Llc Systems and methods for a non-destructive testing ecosystem
US20190295139A1 (en) * 2013-01-22 2019-09-26 General Electric Company Systems and methods for a non-destructive testing ecosystem
US20140344077A1 (en) * 2013-03-15 2014-11-20 Contact Marketing Services, Inc. Used industrial equipment sales application suites, systems, and related apparatus and methods
US9652460B1 (en) 2013-05-10 2017-05-16 FotoIN Mobile Corporation Mobile media information capture and management methods and systems
CN104729714A (en) * 2013-12-18 2015-06-24 上海宝钢工业技术服务有限公司 Spot inspection instrument device based on Android phone platform
US20160314546A1 (en) * 2015-04-27 2016-10-27 First Advantage Corporation Device and method for performing validation and authentication of a physical structure or physical object
US11562448B2 (en) * 2015-04-27 2023-01-24 First Advantage Corporation Device and method for performing validation and authentication of a physical structure or physical object
US20170104823A1 (en) * 2015-10-10 2017-04-13 David Sean Capps Fire service and equipment inspection test and maintenance system
US20220188955A1 (en) * 2015-10-10 2022-06-16 David Sean Capps Fire Service and Equipment Inspection Test and Maintenance System and Method
US11805170B2 (en) * 2015-10-10 2023-10-31 David Sean Capps Fire service and equipment inspection test and maintenance system
CN108140150A (en) * 2015-10-30 2018-06-08 西门子股份公司 For safeguarding the system and method for industrial plants
US20180307212A1 (en) * 2015-10-30 2018-10-25 Siemens Aktiengesellschaft System and method for the maintenance of an industrial plant
US20190378351A1 (en) * 2018-06-11 2019-12-12 International Business Machines Corporation Cognitive learning for vehicle sensor monitoring and problem detection
US10977874B2 (en) * 2018-06-11 2021-04-13 International Business Machines Corporation Cognitive learning for vehicle sensor monitoring and problem detection

Also Published As

Publication number Publication date
US8032830B2 (en) 2011-10-04
US7971140B2 (en) 2011-06-28
US20100269029A1 (en) 2010-10-21
US20100153833A1 (en) 2010-06-17
US20100149211A1 (en) 2010-06-17
US20100185549A1 (en) 2010-07-22
US20100194781A1 (en) 2010-08-05

Similar Documents

Publication Publication Date Title
US20100153168A1 (en) System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
US20110173127A1 (en) System and method used for configuration of an inspection compliance tool with machine readable tags and their associations to inspected components
US7793850B1 (en) System and method used for configuration of an inspection compliance tool with machine readable tags and their associations to inspected components
US8046253B2 (en) Method of risk management across a mission support network
JP2023053244A (en) Systems and portable devices for providing and receiving information for risk management in field
KR101422352B1 (en) System and method for manageing defect of construction site
AU2014224139A1 (en) Methods and apparatus for assessing locate request tickets
US8527550B1 (en) Bridge inspection diagnostic system
CN102968678A (en) Fixed asset project management system based on geographic information system
US10963826B2 (en) Work planning system, work planning method, decision-making support system, computer program, and storage medium
CN109110646A (en) Implementation method, system and the storage medium of a kind of pair of safety of tower crane inspection management
JP2013122699A (en) Apparatus and method for supporting emergency response instruction formulation
KR101584485B1 (en) Elevator safety system using mobile device
Chi et al. Scaffolding progress monitoring of LNG plant maintenance project using BIM and image processing technologies
JP2009182870A (en) Form entry record management system and form entry record monitoring program
WO2010019462A2 (en) Method and apparatus for critical infrastructure protection
Templeton et al. A project lifetime approach to the management of induced seismicity risk at geologic carbon storage sites
Harris et al. RISKGATE-a case study in application to fires on mobile plant
Wessels et al. Managing geotechnical risk in multi-pit operations
Miao et al. Coal mine electrical safety management and accident prevention based on neural network and signal processing
Ali et al. An investigation of difficulties in information management for delay and disruption claims
CN116228147A (en) Implementation method and system for on-site dangerous large project inspection management of building construction enterprises
CN112257138B (en) Remote safety inquiry method, system, intelligent terminal and storage medium
US20220058565A1 (en) Compliance inspection
US20120297331A1 (en) Systems and methods for intelligent decision support

Legal Events

Date Code Title Description
AS Assignment

Owner name: KD SECURE LLC, FLORIDA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HO, ALBERT, MR;SIEGEL, MARC, MR;TOSSING, CHRISTOPHER, MR;AND OTHERS;SIGNING DATES FROM 20110111 TO 20110119;REEL/FRAME:025869/0811

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: SECURENET SOLUTIONS GROUP, LLC, FLORIDA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KD SECURE, LLC;REEL/FRAME:043815/0074

Effective date: 20171009