WO2009099530A3 - System and method for assembly inspection - Google Patents

System and method for assembly inspection Download PDF

Info

Publication number
WO2009099530A3
WO2009099530A3 PCT/US2009/000511 US2009000511W WO2009099530A3 WO 2009099530 A3 WO2009099530 A3 WO 2009099530A3 US 2009000511 W US2009000511 W US 2009000511W WO 2009099530 A3 WO2009099530 A3 WO 2009099530A3
Authority
WO
WIPO (PCT)
Prior art keywords
corresponding standard
component
objects
assembly inspection
digital image
Prior art date
Application number
PCT/US2009/000511
Other languages
French (fr)
Other versions
WO2009099530A2 (en
Inventor
Burton R. Clarke
John E. Norlin
Original Assignee
Caterpillar Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Caterpillar Inc. filed Critical Caterpillar Inc.
Priority to CN2009801067843A priority Critical patent/CN101960484A/en
Publication of WO2009099530A2 publication Critical patent/WO2009099530A2/en
Publication of WO2009099530A3 publication Critical patent/WO2009099530A3/en

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/41875—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by quality surveillance of production
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/37—Measurements
    • G05B2219/37205—Compare measured, vision data with computer model, cad data
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

A method for assembly inspection is disclosed. The system may include obtaining a digital image of an assembled product (101), extracting images of one or more objects from the digital image of the assembled product, and recognizing each of the one or more objects as a component based on its extracted image and a library of standard components. The method may further include identifying one or more features of each recognized component, comparing each of the one or more identified features with a corresponding standard feature of the corresponding standard component, and determining an assembly fault if at least one of the one or more identified features does not match the corresponding standard feature.
PCT/US2009/000511 2008-01-31 2009-01-27 System and method for assembly inspection WO2009099530A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009801067843A CN101960484A (en) 2008-01-31 2009-01-27 System and method for assembly inspection

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/010,956 US8131055B2 (en) 2008-01-31 2008-01-31 System and method for assembly inspection
US12/010,956 2008-01-31

Publications (2)

Publication Number Publication Date
WO2009099530A2 WO2009099530A2 (en) 2009-08-13
WO2009099530A3 true WO2009099530A3 (en) 2009-10-01

Family

ID=40932507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/000511 WO2009099530A2 (en) 2008-01-31 2009-01-27 System and method for assembly inspection

Country Status (3)

Country Link
US (1) US8131055B2 (en)
CN (1) CN101960484A (en)
WO (1) WO2009099530A2 (en)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7693648B2 (en) * 2007-11-27 2010-04-06 Caterpillar Inc. System and method for detecting misassembly of an exhaust aftertreatment system of a machine
TW201005659A (en) * 2008-07-25 2010-02-01 Kye Systems Corp Digital photo frame with automatic image recognition, display system and method thereof
US20100194749A1 (en) * 2009-01-30 2010-08-05 Gerald Bernard Nightingale Systems and methods for non-destructive examination of an engine
JP5926881B2 (en) * 2010-03-30 2016-05-25 富士機械製造株式会社 Image processing component data creation method and image processing component data creation device
US20120131393A1 (en) * 2010-11-19 2012-05-24 International Business Machines Corporation Detecting System Component Failures In A Computing System
CN103034873A (en) * 2011-09-30 2013-04-10 北京千橡网景科技发展有限公司 Method and equipment used for providing assembling process of assembly
JP5777507B2 (en) * 2011-12-27 2015-09-09 キヤノン株式会社 Information processing apparatus, information processing method, and program thereof
US9853448B2 (en) * 2012-01-17 2017-12-26 General Electric Company Systems and methods for coordinating electrical network optimization
US9103251B2 (en) * 2012-01-25 2015-08-11 Cummins Inc. Devices and methods for compliant aftertreatment component assembly
US8855404B2 (en) 2012-08-27 2014-10-07 The Boeing Company Methods and systems for inspecting a workpiece
CN102982195A (en) * 2012-10-29 2013-03-20 曙光云计算技术有限公司 Implement method for equipment assembling and implement device for equipment assembling
CN103582310B (en) * 2013-09-18 2015-03-25 江苏腾世机电有限公司 Surface-mounting control method and system for surface-mounted element of surface-mounting machine
US9633050B2 (en) 2014-02-21 2017-04-25 Wipro Limited Methods for assessing image change and devices thereof
JP6306903B2 (en) * 2014-03-06 2018-04-04 キヤノン株式会社 Information processing apparatus, information processing apparatus control method, and program
JP6399437B2 (en) * 2014-06-04 2018-10-03 パナソニックＩｐマネジメント株式会社 Control device and work management system using the same
GB2528963B (en) 2014-08-07 2018-07-25 Artform Int Ltd Product display shelf, system and method
TWI505120B (en) * 2014-12-10 2015-10-21 Inventec Corp 3d model component comparing system and method thereof
JP6347215B2 (en) * 2015-01-16 2018-06-27 スズキ株式会社 Shape inspection apparatus, shape inspection method and program
US9646371B2 (en) * 2015-03-09 2017-05-09 Dresser, Inc. Utilizing an image of a valve assembly to identify the valve assembly found on a process line
EP3405074A1 (en) 2016-01-18 2018-11-28 DCI Marketing, Inc. dba DCI - Artform Sensors, devices, adapters and mating structures for merchandisers and related methods
WO2017164968A1 (en) 2016-03-23 2017-09-28 Dci Marketing, Inc. Dba Dci - Artform Low product indicator for self facing merchandiser and related methods
JP6724484B2 (en) * 2016-03-31 2020-07-15 日本電気株式会社 Inspection processing device, inspection system, product master registration device, inspection processing method and program
CN105911949A (en) * 2016-04-19 2016-08-31 高桥金属制品（苏州）有限公司 Welding recognition device for automobile parts
CA3040176C (en) 2016-10-18 2023-07-11 Retail Space Solutions Llc Illuminated merchandiser, retrofit kit and related methods
CN106919983B (en) * 2017-02-20 2021-07-27 北京小米移动软件有限公司 Workpiece information processing method, device and system
CN109901977A (en) * 2017-12-08 2019-06-18 同方威视技术股份有限公司 Image inspection analogy method, device, equipment and computer readable storage medium
US11084225B2 (en) 2018-04-02 2021-08-10 Nanotronics Imaging, Inc. Systems, methods, and media for artificial intelligence process control in additive manufacturing
US10733723B2 (en) * 2018-05-22 2020-08-04 Midea Group Co., Ltd. Methods and system for improved quality inspection
US10481579B1 (en) * 2019-02-28 2019-11-19 Nanotronics Imaging, Inc. Dynamic training for assembly lines
WO2020176908A1 (en) 2019-02-28 2020-09-03 Nanotronics Imaging, Inc. Assembly error correction for assembly lines
US11209795B2 (en) 2019-02-28 2021-12-28 Nanotronics Imaging, Inc. Assembly error correction for assembly lines
KR20220005434A (en) * 2019-04-19 2022-01-13 나노트로닉스 이미징, 인코포레이티드 Correct assembly errors for assembly lines
US20210034504A1 (en) * 2019-08-02 2021-02-04 Pratt & Whitney Canada Corp. Validation of inspection software
KR20220054673A (en) 2019-09-10 2022-05-03 나노트로닉스 이미징, 인코포레이티드 Systems, methods and media for manufacturing processes
CN111753791A (en) * 2020-06-30 2020-10-09 联想(北京)有限公司 Detection method and detection equipment
US20230297092A1 (en) * 2020-08-05 2023-09-21 Kitov Systems Ltd Design encoding of intercomponent inspection requirements
KR20220133712A (en) * 2021-03-25 2022-10-05 현대자동차주식회사 System for managing quality of a vehicle and method thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050147287A1 (en) * 2003-11-20 2005-07-07 Kaoru Sakai Method and apparatus for inspecting pattern defects
US20070177787A1 (en) * 2006-01-20 2007-08-02 Shunji Maeda Fault inspection method

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3889053A (en) * 1973-10-30 1975-06-10 Westinghouse Electric Corp Contactless test system
US4056716A (en) * 1976-06-30 1977-11-01 International Business Machines Corporation Defect inspection of objects such as electronic circuits
IT1129509B (en) * 1980-01-14 1986-06-04 Tasco Spa PROCEDURE AND EQUIPMENT FOR THE REAL-TIME FINDING OF DEFECTS IN INDUSTRIAL OBJECTS
US4486775A (en) * 1980-10-17 1984-12-04 Micro Consultants Limited Object recognition
US4978224A (en) * 1987-07-14 1990-12-18 Sharp Kabushiki Kaisha Method of and apparatus for inspecting mounting of chip components
DE69208413T2 (en) * 1991-08-22 1996-11-14 Kla Instr Corp Device for automatic testing of photomask
IL114838A0 (en) * 1995-08-04 1996-11-14 Spiegel Ehud Apparatus and method for object tracking
US5796868A (en) * 1995-12-28 1998-08-18 Cognex Corporation Object edge point filtering system for machine vision
US5815198A (en) * 1996-05-31 1998-09-29 Vachtsevanos; George J. Method and apparatus for analyzing an image to detect and identify defects
US6658145B1 (en) * 1997-12-31 2003-12-02 Cognex Corporation Fast high-accuracy multi-dimensional pattern inspection
US6650779B2 (en) * 1999-03-26 2003-11-18 Georgia Tech Research Corp. Method and apparatus for analyzing an image to detect and identify patterns
US7167583B1 (en) * 2000-06-28 2007-01-23 Landrex Technologies Co., Ltd. Image processing system for use with inspection systems
DE10057928C1 (en) * 2000-11-22 2002-02-21 Inb Vision Ag Surface fault detection method uses evaluation of matrix camera image of object surface via neural network
US7006669B1 (en) * 2000-12-31 2006-02-28 Cognex Corporation Machine vision method and apparatus for thresholding images of non-uniform materials
US7024032B2 (en) * 2002-10-31 2006-04-04 Perceptron, Inc. Method for assessing fit and alignment of a manufactured part
US7272254B2 (en) * 2003-07-09 2007-09-18 General Electric Company System and method for analyzing and identifying flaws in a manufactured part
KR20060030902A (en) * 2003-07-11 2006-04-11 올림푸스 가부시키가이샤 Information presentation device and information presentation system using the same
US7190834B2 (en) * 2003-07-22 2007-03-13 Cognex Technology And Investment Corporation Methods for finding and characterizing a deformed pattern in an image
US20050018216A1 (en) * 2003-07-22 2005-01-27 International Business Machines Corporation Apparatus and method to advertise to the consumer based off a digital image
US7315644B2 (en) * 2003-07-31 2008-01-01 The Boeing Company Investigation of destroyed assemblies and identification of components thereof
DE102004007829B4 (en) * 2004-02-18 2007-04-05 Isra Vision Systems Ag Method for determining areas to be inspected
US7366321B2 (en) * 2004-06-18 2008-04-29 Agilent Technologies, Inc. System and method for performing automated optical inspection of objects
US7327869B2 (en) * 2004-06-21 2008-02-05 The Boeing Company Computer aided quality assurance software system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050147287A1 (en) * 2003-11-20 2005-07-07 Kaoru Sakai Method and apparatus for inspecting pattern defects
US20070177787A1 (en) * 2006-01-20 2007-08-02 Shunji Maeda Fault inspection method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"DaimlerChrysler Research and Technology", vol. 2781, 6 September 2003, SPRINGER, BERLIN, article "A visual quality inspection system based on a hierarchical 3d pose estimation algorithm", pages: 179 - 186 *

Also Published As

Publication number Publication date
CN101960484A (en) 2011-01-26
US20090198464A1 (en) 2009-08-06
WO2009099530A2 (en) 2009-08-13
US8131055B2 (en) 2012-03-06

Similar Documents

Publication Publication Date Title
WO2009099530A3 (en) System and method for assembly inspection
WO2007015200A3 (en) Apparatus for monitoring a person having an interest to an object, and method thereof
WO2009111498A3 (en) Object matching for tracking, indexing, and search
WO2009044148A8 (en) Apparatus and method of image analysis
EP2763077A3 (en) Method and apparatus for sensor aided extraction of spatio-temporal features
EP4113994A3 (en) Mv/mode prediction, roi-based transmit, metadata capture, and format detection for 360 video
WO2006113580A3 (en) Linear correspondence assessment
WO2008091785A3 (en) System and method for determining data entropy to identify malware
WO2008143167A1 (en) Image difference detection method and apparatus, scene change detection method and apparatus, as well as image difference value detection method and apparatus
WO2009037558A3 (en) Method and system for capturing an image from video
WO2011044058A3 (en) Detecting near duplicate images
SG170770A1 (en) Testing surveillance camera installations
WO2006105473A3 (en) Automatic detection of red lesions in digital color fundus photographs
WO2008063482A3 (en) Improved method and system for learning object recognition in images
EP1986153A3 (en) Method and system for determining objects poses from range images
WO2005098603A3 (en) Establishing an interactive environment for rendered documents
WO2006096728A3 (en) System and method for ranging
ATE548706T1 (en) VIDEO SCENE BACKGROUND PRESERVATION USING CHANGE DETECTION AND CLASSIFICATION
EP2372309A3 (en) Vehicle position detection system
WO2008011142A3 (en) Method and apparatus for providing search capability and targeted advertising for audio, image, and video content over the internet
WO2010016992A3 (en) System and method for analysis of spatio-temporal data
ATE426297T1 (en) FINGERPRINT EXTRACTION
WO2008056261A9 (en) Pedestrian detection device and pedestrian detection method
WO2007135659A3 (en) Clustering - based image registration
WO2007100701A3 (en) System and method for performing wavelet-based texture feature extraction and classification

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980106784.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09709337

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09709337

Country of ref document: EP

Kind code of ref document: A2