WO2003015004A2 - Pattern-recognition artificial neural with expert system - Google Patents

Pattern-recognition artificial neural with expert system Download PDF

Info

Publication number
WO2003015004A2
WO2003015004A2 PCT/US2002/018279 US0218279W WO03015004A2 WO 2003015004 A2 WO2003015004 A2 WO 2003015004A2 US 0218279 W US0218279 W US 0218279W WO 03015004 A2 WO03015004 A2 WO 03015004A2
Authority
WO
WIPO (PCT)
Prior art keywords
ann
production
yield
production yield
expert
Prior art date
Application number
PCT/US2002/018279
Other languages
French (fr)
Other versions
WO2003015004A3 (en
Inventor
Brian Gventer
Original Assignee
Nokia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation filed Critical Nokia Corporation
Priority to AU2002310372A priority Critical patent/AU2002310372A1/en
Priority to EP02737443A priority patent/EP1415260A2/en
Priority to MXPA04001083A priority patent/MXPA04001083A/en
Priority to BR0211714-2A priority patent/BR0211714A/en
Publication of WO2003015004A2 publication Critical patent/WO2003015004A2/en
Publication of WO2003015004A3 publication Critical patent/WO2003015004A3/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0218Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
    • G05B23/0224Process history based detection method, e.g. whereby history implies the availability of large amounts of data
    • G05B23/024Quantitative history assessment, e.g. mathematical relationships between available data; Functions therefor; Principal component analysis [PCA]; Partial least square [PLS]; Statistical classifiers, e.g. Bayesian networks, linear regression or correlation analysis; Neural networks
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/0265Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
    • G05B13/027Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion using neural networks only
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/41875Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by quality surveillance of production
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0259Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterized by the response to fault detection
    • G05B23/0267Fault communication, e.g. human machine interface [HMI]
    • G05B23/027Alarm generation, e.g. communication protocol; Forms of alarm
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0259Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterized by the response to fault detection
    • G05B23/0275Fault isolation and identification, e.g. classify fault; estimate cause or root of failure
    • G05B23/0281Quantitative, e.g. mathematical distance; Clustering; Neural networks; Statistical analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/042Knowledge-based neural networks; Logical representations of neural networks
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/31From computer integrated manufacturing till monitoring
    • G05B2219/31354Hybrid expert, knowledge based system combined with ann
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/32Operator till task planning
    • G05B2219/32193Ann, neural base quality management
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present invention relates generally to testing of electronic devices. More particularly, the present invention relates to a cellular Radio Frequency (RF) mobile station production/testing and statistical monitoring process using an Artificial Neural Network (ANN).
  • RF Radio Frequency
  • ANN Artificial Neural Network
  • Prior art production methodology relied on centralized testers doing long arduous test plans and catching process problems long after they occurred. The testers were then considered suspect until proven innocent at which point the actual proximate cause could be investigated and corrected. Often after significant numbers of unsound and unreliable product were built, and subsequently a massive rework effort ensued. This results in wasted product, money, and resources.
  • a classic example of the problem is power level two upperband tuning failures across eight testers in Final/UI (Final Assembly Test Stage) of mobile stations.
  • the failure is induced by a particular tester at Flash SWA (SMD Test Stage) incorrectly tuning power levels due to faulty calibration.
  • Flash SWA SWA
  • a sharp engineer standing there and concentrating as the event unfolds may realize that the failures are all from a single source.
  • this realization occurs after hundreds of phones are incorrectly built, and yields are severely degraded.
  • a problem may last until Monday morning.
  • Deep understanding of the vast amount of data is done through exhaustive SPC statistical analysis.
  • the linear regression techniques usually require very thorough calculations by a black-belt level statistician seeking specific information and rarely turns up unknown or hidden inter-related data points or inter- dependancies.
  • the deep data mining by humans ordinarily is days or weeks after an event.
  • ACM automatically controlled machinery
  • a technology that has developed hand-in-hand with robotics and automatic control is artificial intelligence.
  • Artificial Intelligence technology refers to the use of digital circuits to mimic the cognitive and symbolic skills of humans. When the principles of artificial intelligent are applied to automated machinery their usefulness is increased to an even greater degree. Al allows automatic machines to be programmed to perform complex tasks, to react to external inputs and even to perform rudimentary decision making.
  • Artificial intelligence (Al) systems can integrate data accumulation, recognition and storage functions with higher order analysis and decision protocols. Al systems such as expert systems and neural networks find wide application in qualitative analysis. Expert systems typically generate an individual data structure which is analyzed according to a knowledge base working in conjunction with a resident database.
  • Neural networks are a type of data processing system whose architecture is inspired by the structure of the neural systems of living beings. Unlike the serial connections of the digital computers used for Al systems, neural networks are highly interconnected with variable weights assigned to each of the interconnections. Their architecture allows neural networks to actually learn and to generalize from their knowledge. Therefore, neural networks are taught or trained rather than programmed. Some neural networks are even capable of independent or autonomous learning, or learning by trial and error.
  • neural network controllers controlling for example a robot
  • Some neural networks may be self-organizing (or un-supervised), that is., they learn from these new situations and add it to the data learned from their training sets by adjusting the weights assigned to the interconnections between their processing elements.
  • Two types of neural networks capable of self organizing are back- propagation networks and adaptive resonance networks.
  • ⁇ i is the threshold for neuron i to fire.
  • Hebb Another seminal idea in neural or brain models also published in the 1940s was Hebb's proposal for neural learning, D.O. Hebb, "The Organization of Behavior'” Wiley, N.Y. (1949). Hebb states that if one neuron repeatedly fires another, some change takes place in the connecting synapse to increase the efficiency of such firing, that is, the synaptic strength or weight is increased.
  • Figure 1 is illustrative of a simple artificial neural network (ANN).
  • Signals Xi to X n are inputs of an artificial neuron and Y is an output signal.
  • the values of the input signals ⁇ to X n may be constantly changing (analogous) or binary quantities, and the output signal Y may usually be given both positive and negative values.
  • ⁇ N ⁇ to W n are weighting coefficients, i.e. synaptic strengths or weights, which may also be either positive or negative. In some cases, only positive signal values and/or weighting coefficients are used.
  • Synapses 11, to 11 n of the neuron weight the corresponding input signal by weighting coefficients W T to W n .
  • a summing circuit 12 calculates a weighted sum U.
  • the sum U is supplied to a thresholding function circuit 13, whose output signal is V.
  • the threshold function may vary, but usually a sigmoid or a piecewise linear function is used, whereby the output signal is given continuous values.
  • the output signal V of the thresholding function circuit 13 is simultaneously the output signal Y of the whole neuron.
  • the network is trained, i.e. suitable values are found for the weighting coefficients ⁇ N to W n .
  • Different algorithms have been developed for the purpose.
  • a neural network that is capable of storing repeatedly supplied information by combining different signals, for example, a certain input and a certain situation is called an associative neural network.
  • Associative neurons different versions of what is known as the Hebb rule are often used. According to the Hebb rule, the weighting coefficient is increased always when the input corresponding to the weighting coefficient is active and the output of the neuron should be active.
  • the changing of the weighting coefficients according to the algorithms is called the training of the neural network.
  • monitoring consists of technicians and supervisors standing in front of a monitor flipping through displays. If experienced, they can identify trends as they became statistically significant. Often that effort is investigative, only drawing attention after the problem becomes significant. Even experienced monitors may have problems monitoring multiple testers with their exponentially increasing complexity as stated above. Other methods for monitoring included exhaustive Statistical Process Control (SPC) tools which required highly trained and competent engineers targeting specific points of data not close to realtime.
  • SPC Statistical Process Control
  • Embodiments of the present invention accordingly, advantageously provide a production/testing and statistical monitoring process.
  • ANN Artificial Neural Net
  • ES Expert System
  • the ANN recognizes and classifies production yield patterns occurring at individual tester, complete test stage, and production line test aggregation and executes a proscribed range of responses.
  • the ANN will automate human statistical analysis and line monitoring functions, identify emerging yield trends, identify proximate cause of a yield-degrading event, classify event severity, and provide conclusional accuracy.
  • the ES based on recognized or inferred conditions provided by the ANN, consults it's knowledge base and applies cognitive heuristics to execute responses in the manner described by the human expert it is modeled after. These responses may include a summary report electronically to the correct individuals, a voice/pager message to the individuals responsible to react to an event, a visual or audible alarm at the event site, and/or direct adjustment of the production process.
  • Figure 1 is illustrative of a simple artificial neural network.
  • Figure 2 is illustrative of an optical inspection system.
  • Figure 3 is an illustration of the production test flow using ANN to monitor test plan results in real-time.
  • Figure 4 is a first time pass report that shows 10 testers on an tester line testing an user interface.
  • Figure 5 is a list showing failures versus ATEs.
  • Figure 6 is a bar graph showing production data.
  • a novel apparatus and method for the production and testing of an electronic device is provided.
  • the invention verifies processes at the point of operation and identifies problems early to save production yield, time, and other resources.
  • DUT may be monitored at the various points of assembly by vision systems which confirm/deny presence and placement of components. Failures due to process instability may fixed onsite along with the affected process. Failures due to imperfect materials/components may routed to quality control.
  • a visual inspection input into the ANN system may include an optical inspection system Figure 2.
  • Figure 2 is an example of the preferred embodiment of the invention used in the environment of a DUT as described.
  • Figure 2 is an example only.
  • Optical inspection system comprises an optical image capture device 260, IR fiducial sensor 230, IR fiducial emitter 220.
  • Optical image capture device 260 may be camera, Charge Coupled Device (CCD) or the like.
  • Optical image capture device 2600 may be moveable to allow for inspection control.
  • Optical image capture device 260 may also be fixed and images DUT as it travels below said optical image capture device 610.
  • the optical image capture device is activated when DUT on fixture passes pass a trigger line 240. There may also be ready line 250 wherein DUT and fixture pauses until the inspection area is ready to receive a new electronic device which is to be tested.
  • the CCD sensor collects samples representing successive video images. These samples are digitalized and transmitted to an artificial network for processing.
  • United States Patent Number 5,376,963 issued to Anthony Zortea describes a neural network video processor.
  • the DUT is certified a functionally sound and reliable RF handset, issued an electronic serial number (ESN) and powers down, all physical interfaces to the fixture adapter disengage.
  • ESN electronic serial number
  • the handset routes to an offloading and packaging cell where it is extracted from the fixture adapter, laser "branded", packaged and shipped.
  • Yield and process statistics are monitored near real-time by an Artificial Intelligence (Al) package, which incorporates the associative knowledge of Artificial Neural Nets (ANN) with the cognitive rule-based behavior of an Expert System (ES).
  • Al Artificial Intelligence
  • ANN Artificial Neural Nets
  • ES Expert System
  • the Al identifies patterns or trends and reacts according to established rule-sets governing process situations. Reactions range from notification of human authorities to alarms and even process alteration.
  • FIG 3 is an illustration of the production test flow using Artificial Neural Net (ANN) 350 to monitor test plan results in real-time.
  • ANN 350 measures individual stage trends during various stages 310 and 320.
  • flash software test and tuning alignment in completed.
  • stage 320 final user interface test and alignment verification is performed.
  • the ANN weighs trends 340 at each stage and correlations between said stages.
  • the training of the ANN has established a specific threshold.
  • ANN detects a pattern 360 when conclusional accuracy is above this specified threshold.
  • Expert system 370 consults knowledge base for rules 380 governing response to ANN recognized pattern and executes applicable responses.
  • the rules are example of cognitive heuristics which may be based on programming of knowledge base from human expert or may be extracted from case-based experiences programmed into the system or experienced by the ANN/ES system.
  • ANN Artificial Neural Network
  • ANN may identify and classify the same trend, recognize the pattern at preferably 3-5 failures, (approx. 24 mobile stations), hand off to the ES which pages a technician, provides event statistics to support the conclusion, and takes the suspect tester off-line.
  • the ANN can also recognize that a seemingly unrelated test value is erratic or different from values in passing DUTs, thereby interpolating an inter-dependancy or trend indicator previously unrecognized. Thus, rework is reduced drastically and more consistent monitoring is achieved.
  • Figures 4, 5 and 6 show real-time tools available on the production floor at the time of the creation of the present invention.
  • a human has to discern patterns from data, and then, once recognizing a pattern either know the correct response and enact it, or be able to find the right agents who can enact a solution.
  • the ANN is able to provide for the pattern recognition without a human.
  • Expert system 370 is response to the pattern recognition 360 function in accordance with the present invention provides the event response. For any known case or failure mode there are proscribed actions that would be taken if everyone involved recognized they were required to do something. As an example, an human expert may be notified will shut down an erratic machine, send a page to the technician and line supervisor, and generate a report to all concerned.
  • Figure 4 is a first time pass report that shows 10 testers on an tester line testing an user interface.
  • the line used in this example produces a mature DCT3 product. You can see based on the testers FP (first time pass) yield percentage that they range from 92.86% on tester 2 to 96.06% on tester 4, respectively.
  • FP first time pass
  • a human must try to discern what is the variance between all the different testers and why one is nearly 4% less productive (goal across NMP is 97% at this stage). Time ranges (across the top) from 0400 to 1500 with no production after 1400. This means that the line has for some reason stopped for over an hour in the example.
  • Total fails are shown by hour for each tester from left to right and total FP (first time pass) and FF (first time failure) by tester in column to the right of this shot.
  • Tester number two has only produced 117 phones with 9 failures over this time span, while tester number 4 has produced 317 phones with 13 failures.
  • tester number 2 has performed poorly for the entire period and is clearly a point of weakness, but clearly the whole stage is substandard and there are surely many issues.
  • a human must frequently study the monitor, try to discern patterns after they have begun to emerge, and correctly respond - a skill which varies widely from person to person, and from different hours of the day.
  • An inexperienced person at 0230 on Saturday morning may miss a problem, and that problem may remain untreated until 0600 on Monday morning after thousands of aberrant handsets have been manufactured.
  • Figure 5 is a list showing failures versus ATEs, tester failure percentages by test step ID in column. One may see test step ID failure percentages by tester in row.
  • Test Step ID 230 RXD MAHO BER - mobile assisted hand-off/bit error rate
  • EXCEPT tester number 7 a relatively average (for this sample) performing tester, has zero% failures. Is this tester allowing bad phones to actually pass? - Assume this case is a tester that is missing failures; an Expert System might page the test technician, and send a report of all phones passed over a given time frame so that samples may be gathered and retested. It also might pause the tester until it is verified.
  • tester number 2 is the only one that has failed any phones for Test Step ID 221 (TXD Phase Error). More than likely this is a true failure given its low percentage, and also low actual number - 1 out of 117. An expert might simply note this number and add it to an overall shift report. Unless the data correlations show the ANN that this is related to some other failure mode, it would simply continue to monitor.
  • Figure 6 is a bar graph which appears to the untrained as an indicator of good production because green means good. Actually it can be set to turn red on any threshold, and were this stage set to the stated 97% yield only 0400 and 1200 would be green.
  • Case-based reasoning methods and systems involve storing knowledge as a repository of successful cases of solved problems called a case base.
  • a case base When the system is presented with a problem, it searches the case base for similar cases. Once the similar cases are retrieved, various problem-solving strategies may be adapted to the case at hand. If the adapted strategy successfully solves the problem, then the newly solved problem may be added to the case base with the adapted solution.
  • a router profile may be incorrectly set causing the router to separate PCB radio modules out of the PCB panel. Specifically, the router may be cutting just microns too close to the antenna ground plane.
  • a disadvantage is even self-learning ANN models will need periodic review/updates to ensure optimum accuracy.
  • Expert Systems are only as accurate as the knowledge base and need periodic updating as well.
  • Expert systems are dependent upon the ability of a knowledge engineer to extract accurate, precise heuristics from a bona-fide human expert or past case-based solutions.
  • ATE - Automated Test Equipment A chassis populated with instruments, controlled by a computer, which controls various measurements and tests on a DUT, and records results.
  • ANN - Artificial Neural Network a computer model composed of a large number of interconnected, interacting, processing elements organized into layers. Mimics behavior of human nervous system at the neuronic level. ANN reasoning is associative in nature.
  • DUT - Device Under Test May be any electrical device which is undergoing production and/or testing. In the preferred embodiment, the production of a PCB, radio module, or mobile station depending on the point of assembly.
  • ES - Expert System A problem solving and decision making system based on knowledge of its task and logical rules and procedures for using the knowledge. Knowledge and logic are codified from the experience of human specialists in the field or from solutions of problems which have occurred in the past. ES reasoning is cognitive and rule-based in nature.

Abstract

Artificial Neural Net (ANN) (350) coupled with an Expert System (ES) (320) which monitors production test plans (310, 320) in real-time is provided. The ANN (350) recognizes and classifies production yield patterns (360) occurring at individual tester, complete test stage, and production line test aggregation and executes a proscribed range of responses. The ANN (350) will automate human statistical analysis and line monitoring functions, identify emerging yield trends, identify proximate cause of a yield-degrading event, classify event severity, and provide conclusional accuracy. The ES (320), based on recognized or inferred conditions provided by the ANN (350), consults its knowledge base and applies cognitive heuristics to execute responses (380) in the manner described by the human expert it is modeled after. These responses may include a summary report electronically to the correct individuals, a voice/pager message to the individuals responsible to react to an event, a visual or audible alarm at the event site, and/or direct adjustment of the production process.

Description

PRODUCTION PATTERN-RECOGNITION ARTIFICIAL NEURAL NET (ANN) WITH EVENT-RESPONSE EXPERT SYSTEM (ES)--YIELDSHIELD™
BACKGROUND OF THE INVENTION
[0001] The present invention relates generally to testing of electronic devices. More particularly, the present invention relates to a cellular Radio Frequency (RF) mobile station production/testing and statistical monitoring process using an Artificial Neural Network (ANN).
[0002] Prior art production methodology relied on centralized testers doing long arduous test plans and catching process problems long after they occurred. The testers were then considered suspect until proven innocent at which point the actual proximate cause could be investigated and corrected. Often after significant numbers of unsound and unreliable product were built, and subsequently a massive rework effort ensued. This results in wasted product, money, and resources.
[0003] An experienced human monitoring the process with undivided attention is still unable to effectively monitor and identify a yield threatening trend. The intricacy and range of data managed by a single tester in production is currently difficult for less than experienced engineers. The ability for many individuals to further understand and correlate the measurement values and hidden inter-relationships is exponentially complex when stages of 10 testers are aggregated, compounded yet again by correlating inter-relationships between test stages.
[0004] A classic example of the problem is power level two upperband tuning failures across eight testers in Final/UI (Final Assembly Test Stage) of mobile stations. In this example, the failure is induced by a particular tester at Flash SWA (SMD Test Stage) incorrectly tuning power levels due to faulty calibration. Currently, a sharp engineer standing there and concentrating as the event unfolds, may realize that the failures are all from a single source. Typically on a fully alert day shift, this realization occurs after hundreds of phones are incorrectly built, and yields are severely degraded. In a night shift weekend scenario a problem may last until Monday morning. [0005] Deep understanding of the vast amount of data is done through exhaustive SPC statistical analysis. The linear regression techniques usually require very thorough calculations by a black-belt level statistician seeking specific information and rarely turns up unknown or hidden inter-related data points or inter- dependancies. The deep data mining by humans ordinarily is days or weeks after an event.
[0006] One possible solution is the use of automatically controlled machinery (ACM) which are playing an increasingly important role in our industry, our economy and our society. (ACM) can be used to replace human labor in tasks that are dull and repetitive or they can be used to perform tasks requiring extreme precision, speed or strength which is beyond human capabilities.
[0007] A technology that has developed hand-in-hand with robotics and automatic control is artificial intelligence. Artificial Intelligence technology (Al) refers to the use of digital circuits to mimic the cognitive and symbolic skills of humans. When the principles of artificial intelligent are applied to automated machinery their usefulness is increased to an even greater degree. Al allows automatic machines to be programmed to perform complex tasks, to react to external inputs and even to perform rudimentary decision making. Artificial intelligence (Al) systems can integrate data accumulation, recognition and storage functions with higher order analysis and decision protocols. Al systems such as expert systems and neural networks find wide application in qualitative analysis. Expert systems typically generate an individual data structure which is analyzed according to a knowledge base working in conjunction with a resident database.
[0008] Neural networks are a type of data processing system whose architecture is inspired by the structure of the neural systems of living beings. Unlike the serial connections of the digital computers used for Al systems, neural networks are highly interconnected with variable weights assigned to each of the interconnections. Their architecture allows neural networks to actually learn and to generalize from their knowledge. Therefore, neural networks are taught or trained rather than programmed. Some neural networks are even capable of independent or autonomous learning, or learning by trial and error.
[0009] The ability of neural networks to learn and to generalize from their knowledge makes them highly useful as automated controllers for robots also known as neural network controllers. Neural network controllers controlling for example a robot, may be taught by taking it through a series of training sets, which present data typical of what the robot will see in operation. From these training sets, the robot can "generalize" to react properly to new situations encountered in actual operation, even if they do not exactly match the training sets from which they were taught. Some neural networks may be self-organizing (or un-supervised), that is., they learn from these new situations and add it to the data learned from their training sets by adjusting the weights assigned to the interconnections between their processing elements. Two types of neural networks capable of self organizing are back- propagation networks and adaptive resonance networks.
[0010] The roots of the work on neural networks can be found in a 1943 paper by W.S. McCulloch and W.H. Pitts, "A logical calculus of ideas immanent in nervous activity," Bulletin of Mathematical Biophysics, 4, 115 (1943). McCulloch and Pitts modeled the brain as a collection of neurons with one of two states, Sj=0 (not firing) or Sj=1 (firing at maximum rate). If there is a connection from neuron i to neuron j, the strength or weight of this connection is defined as w, . Each neuron adjusts its state asynchronously according to the threshold rule:
Figure imgf000004_0001
where θi is the threshold for neuron i to fire.
[0011] Another seminal idea in neural or brain models also published in the 1940s was Hebb's proposal for neural learning, D.O. Hebb, "The Organization of Behavior'" Wiley, N.Y. (1949). Hebb states that if one neuron repeatedly fires another, some change takes place in the connecting synapse to increase the efficiency of such firing, that is, the synaptic strength or weight is increased.
[0012] Figure 1 is illustrative of a simple artificial neural network (ANN). Signals Xi to Xn are inputs of an artificial neuron and Y is an output signal. The values of the input signals \ to Xn may be constantly changing (analogous) or binary quantities, and the output signal Y may usually be given both positive and negative values. \N^ to Wn are weighting coefficients, i.e. synaptic strengths or weights, which may also be either positive or negative. In some cases, only positive signal values and/or weighting coefficients are used. Synapses 11, to 11n of the neuron weight the corresponding input signal by weighting coefficients WT to Wn. A summing circuit 12 calculates a weighted sum U. The sum U is supplied to a thresholding function circuit 13, whose output signal is V. The threshold function may vary, but usually a sigmoid or a piecewise linear function is used, whereby the output signal is given continuous values. In a conventional neuron, the output signal V of the thresholding function circuit 13 is simultaneously the output signal Y of the whole neuron.
[0013] When neurons of this kind are used in ANNs, the network is trained, i.e. suitable values are found for the weighting coefficients \N to Wn. Different algorithms have been developed for the purpose. A neural network that is capable of storing repeatedly supplied information by combining different signals, for example, a certain input and a certain situation is called an associative neural network. In associative neurons, different versions of what is known as the Hebb rule are often used. According to the Hebb rule, the weighting coefficient is increased always when the input corresponding to the weighting coefficient is active and the output of the neuron should be active. The changing of the weighting coefficients according to the algorithms is called the training of the neural network.
[0014] While reference will be made to specific types of neural networks in the specification, it is not the intention of this specification to teach the design or architecture of neural networks, but to advance the application of neural network technology to automatic control technology. It should also be understood by the reader that the specific types of neural networks referred to are given by way of example and that other types of neural networks may also be used with the disclosed control method. A background in ANN may be found in "Artificial Neural Networks" by Robert J. Schalkoff, published by McGraw-Hill Companies ISBN 0-07-057118-X herein incorporated by reference (http://www.mhcollege.com).
[0015] An example of in the patent art which provides a background in ANN for the reader is United States Patent Number 5,214,745 issued to John Sutherland on May 25, 1993 and is herein incorporated by reference.
[0016] United States Patent Number 5,355,435 issued to DeYong et al. provides the reader with the design considerations of a neural processing element (PE) and is herein incorporated by reference. DeYong et al. considers the implementation methodologies used in Very Large Scale Integration (VLSI) neural networks. DeYong et al. considers implementation details such as analog vs. digital, biological vs. non-biological, time-dependent vs. time-independent, continous/asynchronous vs. discrete/synchronous, triggerable vs. non-triggerable, and linear vs. non-linear.
[0017] Since neurons work on a spike or pulse based triggers a spike-based implementation for analog-to-digital conversion is very well suited to ANN circuit designs. An example of an analog-to-digital converter is provided by United States Patent Number 6,262,678 issued to Rahul Sarpeshkar on July 17, 2001.
[0018] An example of neural networks which have been used in optical character recognition applications is given by United States Patent Number 5,251 ,268 issued to Colley et al. on October 5, 1993 and incorporated herein by reference.
[0019] Prior to the present invention, production and testing is monitored by an experienced human. A human supervising the process with undivided attention is still unable to effectively monitor and identify a yield-threatening trend. The intricacy and range of data managed by a single tester in production is currently difficult for less than experienced engineers. The ability for many individuals to further understand and correlate the measurement values and hidden inter-relationships is exponentially complex when stages of 10 testers are aggregated, compounded yet again by correlating inter-relationships between test stages.
[0020] Earlier production methodology relied on centralized testers doing long arduous test plans, and catching process problems long after they occurred. The testers were then considered suspect until proven innocent at which point the actual proximate cause could be investigated and corrected. Often after significant numbers of unsound and unreliable product was built, and subsequently a massive rework effort ensued. Testers are often relied upon to "test" quality into the system. There is a need to verify processes at the point of operation, and identify problems early.
[0021] Prior to the present invention, monitoring consists of technicians and supervisors standing in front of a monitor flipping through displays. If experienced, they can identify trends as they became statistically significant. Often that effort is investigative, only drawing attention after the problem becomes significant. Even experienced monitors may have problems monitoring multiple testers with their exponentially increasing complexity as stated above. Other methods for monitoring included exhaustive Statistical Process Control (SPC) tools which required highly trained and competent engineers targeting specific points of data not close to realtime.
[0022] It is in light of this background information related to the production and testing of mobile stations that the significant improvement of the present invention has evolved.
SUMMARY OF THE INVENTION
[0023] Embodiments of the present invention, accordingly, advantageously provide a production/testing and statistical monitoring process.
[0024] Artificial Neural Net (ANN) coupled with an Expert System (ES) which monitors production test plans in real-time is provided. The ANN recognizes and classifies production yield patterns occurring at individual tester, complete test stage, and production line test aggregation and executes a proscribed range of responses. The ANN will automate human statistical analysis and line monitoring functions, identify emerging yield trends, identify proximate cause of a yield-degrading event, classify event severity, and provide conclusional accuracy. The ES, based on recognized or inferred conditions provided by the ANN, consults it's knowledge base and applies cognitive heuristics to execute responses in the manner described by the human expert it is modeled after. These responses may include a summary report electronically to the correct individuals, a voice/pager message to the individuals responsible to react to an event, a visual or audible alarm at the event site, and/or direct adjustment of the production process.
[0025] A more complete appreciation of the present invention and the scope thereof can be obtained from the accompanying drawing which are briefly summarized below, the following detailed description of the presently-preferred embodiment of the invention, and the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 is illustrative of a simple artificial neural network.
[0027] Figure 2 is illustrative of an optical inspection system.
[0028] Figure 3 is an illustration of the production test flow using ANN to monitor test plan results in real-time.
[0029] Figure 4 is a first time pass report that shows 10 testers on an tester line testing an user interface.
[0030] Figure 5 is a list showing failures versus ATEs.
[0031] Figure 6 is a bar graph showing production data.
DETAILED DESCRIPTION
[0032] A novel apparatus and method for the production and testing of an electronic device is provided. The invention verifies processes at the point of operation and identifies problems early to save production yield, time, and other resources.
[0033] Assembly and installation process verification for a Device Under Test
(DUT) may be monitored at the various points of assembly by vision systems which confirm/deny presence and placement of components. Failures due to process instability may fixed onsite along with the affected process. Failures due to imperfect materials/components may routed to quality control.
[0034] A visual inspection input into the ANN system may include an optical inspection system Figure 2. Figure 2 is an example of the preferred embodiment of the invention used in the environment of a DUT as described. Figure 2 is an example only. Optical inspection system comprises an optical image capture device 260, IR fiducial sensor 230, IR fiducial emitter 220. Optical image capture device 260 may be camera, Charge Coupled Device (CCD) or the like. Optical image capture device 2600 may be moveable to allow for inspection control. Optical image capture device 260 may also be fixed and images DUT as it travels below said optical image capture device 610. The optical image capture device is activated when DUT on fixture passes pass a trigger line 240. There may also be ready line 250 wherein DUT and fixture pauses until the inspection area is ready to receive a new electronic device which is to be tested.
[0035] The CCD sensor collects samples representing successive video images. These samples are digitalized and transmitted to an artificial network for processing. United States Patent Number 5,376,963 issued to Anthony Zortea describes a neural network video processor.
[0036] Certain aspects of RF/Baseband tuning, alignment, and measuring still require an unbroken calibrated galvanic connection with the DUT. These actions will occur concentrated in an RF shielded cell where a robotic arm/socket assembly will interface the moving fixture/fixture adapter, move with it for the duration of measurements, and extract when complete.
[0037] Once all standards are met, the DUT is certified a functionally sound and reliable RF handset, issued an electronic serial number (ESN) and powers down, all physical interfaces to the fixture adapter disengage. The handset routes to an offloading and packaging cell where it is extracted from the fixture adapter, laser "branded", packaged and shipped.
[0038] Artificial Intelligence decision support systems monitor yields and production trends. This automates the monitoring process at near real-time. For example, updates may occur once every 5 minutes.
[0039] Yield and process statistics are monitored near real-time by an Artificial Intelligence (Al) package, which incorporates the associative knowledge of Artificial Neural Nets (ANN) with the cognitive rule-based behavior of an Expert System (ES). The Al identifies patterns or trends and reacts according to established rule-sets governing process situations. Reactions range from notification of human authorities to alarms and even process alteration.
[0040] Figure 3 is an illustration of the production test flow using Artificial Neural Net (ANN) 350 to monitor test plan results in real-time. ANN 350 measures individual stage trends during various stages 310 and 320. At stage 310, flash software test and tuning alignment in completed. At stage 320 final user interface test and alignment verification is performed. The ANN weighs trends 340 at each stage and correlations between said stages. The training of the ANN has established a specific threshold. ANN detects a pattern 360 when conclusional accuracy is above this specified threshold. Expert system 370 consults knowledge base for rules 380 governing response to ANN recognized pattern and executes applicable responses. The rules are example of cognitive heuristics which may be based on programming of knowledge base from human expert or may be extracted from case-based experiences programmed into the system or experienced by the ANN/ES system.
[0041] Artificial Neural Network (ANN) may identify and classify the same trend, recognize the pattern at preferably 3-5 failures, (approx. 24 mobile stations), hand off to the ES which pages a technician, provides event statistics to support the conclusion, and takes the suspect tester off-line. The ANN can also recognize that a seemingly unrelated test value is erratic or different from values in passing DUTs, thereby interpolating an inter-dependancy or trend indicator previously unrecognized. Thus, rework is reduced drastically and more consistent monitoring is achieved.
[0042] Figures 4, 5 and 6 show real-time tools available on the production floor at the time of the creation of the present invention. A human has to discern patterns from data, and then, once recognizing a pattern either know the correct response and enact it, or be able to find the right agents who can enact a solution. The ANN is able to provide for the pattern recognition without a human.
[0043] Expert system 370 is response to the pattern recognition 360 function in accordance with the present invention provides the event response. For any known case or failure mode there are proscribed actions that would be taken if everyone involved recognized they were required to do something. As an example, an human expert may be notified will shut down an erratic machine, send a page to the technician and line supervisor, and generate a report to all concerned.
[0044] For example, Figure 4 is a first time pass report that shows 10 testers on an tester line testing an user interface. The line used in this example produces a mature DCT3 product. You can see based on the testers FP (first time pass) yield percentage that they range from 92.86% on tester 2 to 96.06% on tester 4, respectively. [0045] At this point in the example, a human must try to discern what is the variance between all the different testers and why one is nearly 4% less productive (goal across NMP is 97% at this stage). Time ranges (across the top) from 0400 to 1500 with no production after 1400. This means that the line has for some reason stopped for over an hour in the example.
[0046] Total fails are shown by hour for each tester from left to right and total FP (first time pass) and FF (first time failure) by tester in column to the right of this shot. Tester number two has only produced 117 phones with 9 failures over this time span, while tester number 4 has produced 317 phones with 13 failures. Overall, tester number 2 has performed poorly for the entire period and is clearly a point of weakness, but clearly the whole stage is substandard and there are surely many issues.
[0047] At this point, human experience, skill, intuition, judgment, luck all come into play. There are easily hundreds of variables and indicators for thousands of possible problem combinations. As an example, there are about 110 test steps in this test plan. Some are simple yes or no tests and some are value ranges. False failures may occur in a single tester due to the tester itself, calibration between the fixture and the ATE rack, some failure in a particular instrument in the ATE rack. False failures can occur across the board due to equipment incompatibility, test plan code errors, calibration errors, network communications etc. There are also true failures indicating a process error (which is of course, the point, to testing).
[0048] A human must frequently study the monitor, try to discern patterns after they have begun to emerge, and correctly respond - a skill which varies widely from person to person, and from different hours of the day. An inexperienced person at 0230 on Saturday morning may miss a problem, and that problem may remain untreated until 0600 on Monday morning after thousands of aberrant handsets have been manufactured.
[0049] Figure 5 is a list showing failures versus ATEs, tester failure percentages by test step ID in column. One may see test step ID failure percentages by tester in row. Note Test Step ID 230 (RXD MAHO BER - mobile assisted hand-off/bit error rate) has a consistent across the board (left to right) failure rate and percentages are consistent with quantities produced... EXCEPT tester number 7, a relatively average (for this sample) performing tester, has zero% failures. Is this tester allowing bad phones to actually pass? - Assume this case is a tester that is missing failures; an Expert System might page the test technician, and send a report of all phones passed over a given time frame so that samples may be gathered and retested. It also might pause the tester until it is verified.
[0050] Alternately, tester number 2 is the only one that has failed any phones for Test Step ID 221 (TXD Phase Error). More than likely this is a true failure given its low percentage, and also low actual number - 1 out of 117. An expert might simply note this number and add it to an overall shift report. Unless the data correlations show the ANN that this is related to some other failure mode, it would simply continue to monitor.
[0051] Also, notice Test Step ID number 215 - TXA Power Level 2 nearly across the board but low level.
[0052] Is this a calibration issue, a tuning error from a previous test stage (Flash and Software Alignment where the transmitter and receiver are tuned) or a component issue? If a component issue is it due to oven profiles, solder or underfill, errors, part placement, or just a bad lot of components? This would prompt an expert to request ANN correlation between those phones which failed and the testers from which they came. At the same time, a query of oven profiles and component reel changeovers would be examined to see if a likely SMD error occurred. If all the phones failing were from flash across the board, the expert would then direct calibration of all testers at Flash. If the bad phones come from a specific tester it would be shut down until verified. If it were instead found that an oven profile was erratic, that system could be corrected before hundreds of other failures might be induced. Again sending notifications and reports to all humans who need them.
[0053] Figure 6 is a bar graph which appears to the untrained as an indicator of good production because green means good. Actually it can be set to turn red on any threshold, and were this stage set to the stated 97% yield only 0400 and 1200 would be green.
Case-Based Reasoning Methods
[0054] Case-based reasoning methods and systems involve storing knowledge as a repository of successful cases of solved problems called a case base. When the system is presented with a problem, it searches the case base for similar cases. Once the similar cases are retrieved, various problem-solving strategies may be adapted to the case at hand. If the adapted strategy successfully solves the problem, then the newly solved problem may be added to the case base with the adapted solution.
[0055] The following is an example of a case based solution. A router profile may be incorrectly set causing the router to separate PCB radio modules out of the PCB panel. Specifically, the router may be cutting just microns too close to the antenna ground plane. The problem manifested itself at Final User Interface as a percentage of SINAD failures, and another percentage of antenna check failures, certain testers preferring to fail for SINAD, others for Antenna check. What appears as two separate problems may actually be the same problem. Technical and supervisory personhours may be spent scrutinizing the antenna assembly process to no avail, while simultaneously trying to find a power line noise factor cause for the SINAD failures, before someone notices on retest that certain phones always failed for antenna check on certain testers, and always failed for SINAD on certain others, and that the failures were actually related. The failure condition may be recognized differently on some radio test sets than others (due to inherent differences in instruments - newer test sets are able to handle the antenna weakness), though all may recognize the failure as either one thing or the other, and always the same thing. At this point, basic knowledge of the phone may be used to find how SINAD and antenna check are related. Upon visual inspection, it may be observed that the routing was cutting into the antenna ground plane. If an ANN is used to report the correlation, and the Expert System directs retests from diagnostics to go from one failure-type ATE to the other as a confirmation, hours of troubleshooting and hundreds of scrap phones can be saved. Also, because this may be assumed to be two discrete simple problems, only low-level production supervisors and technicians may be involved until the latter stages of trouble-shooting. Thus resulting in wasted production or down-time. An Expert might have sent notification to engineering staff that a serious complex problem existed, of a nature technicians simply were not experienced enough to solve.
[0056] In another example of a case-based problem from which an ANN may extract Expert System rules, a specific tester at Final User Interface may be failing display pattern tests - perhaps 10% of the time. Easily recognized by an ANN since none of the other testers are failing, it reports the pattern to the Expert System. Because the late-night staff is inexperienced, the simple but confusing vision calibration method escapes the technician. Often in the past these low-level problems are "walked-away from" hoping someone else will come along and fix it later. In the meantime 3-5 phones an hour are steadily failing, to be retested and passed in another tester after the diagnostic technician finds no fault. The Expert System would not only stop the tester, but also identify the procedure for vision calibration, the equipment required, and the directory of the necessary files. It would even be capable of walking the technician through the procedure step by step if so required, replacing the need for manuals, intensive training, years of experience and human experts. In minutes the vision is "re-taught" and the tester back online.
[0057] A disadvantage is even self-learning ANN models will need periodic review/updates to ensure optimum accuracy. Expert Systems are only as accurate as the knowledge base and need periodic updating as well. Expert systems are dependent upon the ability of a knowledge engineer to extract accurate, precise heuristics from a bona-fide human expert or past case-based solutions.
Abbreviations
[0058] A] - Artificial Intelligence.
[0059] ATE - Automated Test Equipment. A chassis populated with instruments, controlled by a computer, which controls various measurements and tests on a DUT, and records results.
[0060] ANN - Artificial Neural Network: a computer model composed of a large number of interconnected, interacting, processing elements organized into layers. Mimics behavior of human nervous system at the neuronic level. ANN reasoning is associative in nature.
[0061] DUT - Device Under Test: May be any electrical device which is undergoing production and/or testing. In the preferred embodiment, the production of a PCB, radio module, or mobile station depending on the point of assembly.
[0062] ES - Expert System: A problem solving and decision making system based on knowledge of its task and logical rules and procedures for using the knowledge. Knowledge and logic are codified from the experience of human specialists in the field or from solutions of problems which have occurred in the past. ES reasoning is cognitive and rule-based in nature.
[0063] ESN - Electronic Serial Number.
[0064] These and other features, aspects, and advantages of embodiments of the present invention will become apparent with reference to the following description in conjunction with the accompanying drawings. It is to be understood, however, that the drawings are designed solely for the purposes of illustration and not as a definition of the limits of the invention, for which reference should be made to the appended claims.

Claims

What is claimed is:
[0065] 1. A system for monitoring a manufacturing production line, said system comprising:
an artificial neural network (ANN) for recognizing and classifying production yield patterns; and an expert system (ES) coupled to said artificial neural network to provide a knowledge base and apply cognitive heuristics to execute responses based on production yield patterns information received from said artificial neural network.
[0066] 2. The system of claim 1 wherein said ANN identifies a plurality of yield trends and assigns a weight to at least one of said production yield trends; and wherein said ANN outputs notification for identifying each of said at least one weighted production yield trend having an assigned weight beyond a predetermined yield-degrading threshold value.
[0067] 3. The system of claim 1 , further comprising instructions for training said ANN to assign said weight to each of said production yield trends based on historical case studies.
[0068] 4. The system of claim 1 , further comprising instructions for training said ANN to assign said weight to each of said production yield trends based on a base of knowledge.
[0069] 5. The system of claim 1 , further comprising instructions to send a report to predetermined individuals.
[0070] 6. The system of claim 1 , further comprising instructions to provide an alarm signal.
[0071] 7. The system of claim 1 , further comprising instructions to send a pager message to predetermined individuals. [0072] 8. The system of claim 1 , further comprising instructions to adjust the production process in accordance with the knowledge base of the system.
[0073] 9. A method for system for monitoring a manufacturing production line using an artificial neural network (ANN) coupled to an expert system, said method comprising the steps of:
recognizing a plurality of production yield patterns; classifying at least one of said production yield patterns into at least one production yield trend; weighting said at least one production yield trend; providing notification to expert system (ES) when at least one of said weighted trends passes a predetermined yield-degrading threshold value; and executing responses from said expert system (ES) in accordance with said expert systems knowledge base.
PCT/US2002/018279 2001-08-06 2002-06-10 Pattern-recognition artificial neural with expert system WO2003015004A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
AU2002310372A AU2002310372A1 (en) 2001-08-06 2002-06-10 Pattern-recognition artificial neural with expert system
EP02737443A EP1415260A2 (en) 2001-08-06 2002-06-10 Production pattern-recognition artificial neural net (ann) with event-response expert system (es)-yieldshield tm
MXPA04001083A MXPA04001083A (en) 2001-08-06 2002-06-10 Production pattern-recognition artificial neural net (ann) with event-response expert system (es)-yieldshieldtm.
BR0211714-2A BR0211714A (en) 2001-08-06 2002-06-10 System and method for monitoring manufacturing production line

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/923,215 US20030028353A1 (en) 2001-08-06 2001-08-06 Production pattern-recognition artificial neural net (ANN) with event-response expert system (ES)--yieldshieldTM
US09/923,215 2001-08-06

Publications (2)

Publication Number Publication Date
WO2003015004A2 true WO2003015004A2 (en) 2003-02-20
WO2003015004A3 WO2003015004A3 (en) 2003-08-28

Family

ID=25448323

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/018279 WO2003015004A2 (en) 2001-08-06 2002-06-10 Pattern-recognition artificial neural with expert system

Country Status (6)

Country Link
US (1) US20030028353A1 (en)
EP (1) EP1415260A2 (en)
AU (1) AU2002310372A1 (en)
BR (1) BR0211714A (en)
MX (1) MXPA04001083A (en)
WO (1) WO2003015004A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2881899A2 (en) 2013-12-09 2015-06-10 Deutsche Telekom AG System and method for automated aggregation of descriptions of individual object variants
US10761974B2 (en) 2017-11-10 2020-09-01 International Business Machines Corporation Cognitive manufacturing systems test repair action

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7272750B2 (en) * 2003-06-30 2007-09-18 Texas Instruments Incorporated Expert system for intelligent testing
US7181360B1 (en) * 2004-01-30 2007-02-20 Spirent Communications Methods and systems for generating test plans for communication devices
DE102005006575A1 (en) * 2005-02-11 2006-09-07 Battenberg, Günther System for recording and evaluating user-dependent processes and / or components in automatic production and test processes
US20080154822A1 (en) * 2006-10-30 2008-06-26 Techguard Security Llc Systems and methods for creating an artificial neural network
WO2015017796A2 (en) * 2013-08-02 2015-02-05 Digimarc Corporation Learning systems and methods
CN104238505A (en) * 2014-08-28 2014-12-24 华南理工大学 Quality control expert system and method for FPC manufacturing process
US10114395B2 (en) * 2015-11-05 2018-10-30 Electronic Systems Protection, Inc. Expert system analysis for power monitoring devices
JP6893211B2 (en) * 2016-07-25 2021-06-23 株式会社Fuji Board production control device and board production control method
US10247032B2 (en) 2017-03-28 2019-04-02 Honeywell International Inc. Gas turbine engine and test cell real-time diagnostic fault detection and corrective action system and method
US11714397B2 (en) * 2019-02-05 2023-08-01 Samsung Display Co., Ltd. System and method for generating machine learning model with trace data
DE102019104822A1 (en) * 2019-02-26 2020-08-27 Wago Verwaltungsgesellschaft Mbh Method and device for monitoring an industrial process step
CN110265165B (en) * 2019-06-18 2021-07-20 中广核核电运营有限公司 Nuclear power container temperature adjusting method and device, computer equipment and storage medium
US11449797B1 (en) * 2019-09-23 2022-09-20 Amazon Technologies, Inc. Secure machine learning workflow automation using isolated resources
US11269901B2 (en) 2020-01-16 2022-03-08 International Business Machines Corporation Cognitive test advisor facility for identifying test repair actions

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4802094A (en) * 1985-07-10 1989-01-31 Hitachi, Ltd. Process monitoring apparatus for process management in production and assembly lines
US4958292A (en) * 1987-04-22 1990-09-18 Toyota Jidosha Kabushiki Kaisha Production control system for mixed production line
US5237508A (en) * 1989-08-10 1993-08-17 Fujitsu Limited Production control system

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4642782A (en) * 1984-07-31 1987-02-10 Westinghouse Electric Corp. Rule based diagnostic system with dynamic alteration capability
US4660166A (en) * 1985-01-22 1987-04-21 Bell Telephone Laboratories, Incorporated Electronic network for collective decision based on large number of connections between signals
US4874963A (en) * 1988-02-11 1989-10-17 Bell Communications Research, Inc. Neuromorphic learning networks
US4876731A (en) * 1988-02-19 1989-10-24 Nynex Corporation Neural network model in pattern recognition using probabilistic contextual information
US4878843A (en) * 1988-06-08 1989-11-07 Kuch Nina J Process and apparatus for conveying information through motion sequences
US5214745A (en) * 1988-08-25 1993-05-25 Sutherland John G Artificial neural device utilizing phase orientation in the complex number domain to encode and decode stimulus response patterns
US5390261A (en) * 1991-05-13 1995-02-14 Huang; Yee-Wei Method and apparatus for pattern classification using distributed adaptive fuzzy windows
US5467428A (en) * 1991-06-06 1995-11-14 Ulug; Mehmet E. Artificial neural network method and architecture adaptive signal filtering
US5251268A (en) * 1991-08-09 1993-10-05 Electric Power Research Institute, Inc. Integrated method and apparatus for character and symbol recognition
US5253329A (en) * 1991-12-26 1993-10-12 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Neural network for processing both spatial and temporal data with time based back-propagation
US5355435A (en) * 1992-05-18 1994-10-11 New Mexico State University Technology Transfer Corp. Asynchronous temporal neural processing element
AU658066B2 (en) * 1992-09-10 1995-03-30 Deere & Company Neural network based control system
US5376963A (en) * 1993-03-31 1994-12-27 Panasonic Technologies, Inc. Neural network video image processor
US5448684A (en) * 1993-11-12 1995-09-05 Motorola, Inc. Neural network, neuron, and method for recognizing a missing input valve
US5566092A (en) * 1993-12-30 1996-10-15 Caterpillar Inc. Machine fault diagnostics system and method
US5528516A (en) * 1994-05-25 1996-06-18 System Management Arts, Inc. Apparatus and method for event correlation and problem reporting
US5835902A (en) * 1994-11-02 1998-11-10 Jannarone; Robert J. Concurrent learning and performance information processing system
EP0823090B1 (en) * 1995-04-27 2005-01-26 Northrop Grumman Corporation Adaptive filtering neural network classifier
US5748847A (en) * 1995-12-21 1998-05-05 Maryland Technology Corporation Nonadaptively trained adaptive neural systems
US5727950A (en) * 1996-05-22 1998-03-17 Netsage Corporation Agent based instruction system and method
US5892808A (en) * 1996-06-28 1999-04-06 Techne Systems, Inc. Method and apparatus for feature detection in a workpiece
US6216119B1 (en) * 1997-11-19 2001-04-10 Netuitive, Inc. Multi-kernel neural network concurrent learning, monitoring, and forecasting system
US6266668B1 (en) * 1998-08-04 2001-07-24 Dryken Technologies, Inc. System and method for dynamic data-mining and on-line communication of customized information
US6269354B1 (en) * 1998-11-30 2001-07-31 David W. Arathorn General purpose recognition e-circuits capable of translation-tolerant recognition, scene segmentation and attention shift, and their application to machine vision
US6262678B1 (en) * 1999-09-29 2001-07-17 Lucent Technologies Inc. Current-mode spike-based analog-to-digital conversion
US6563301B2 (en) * 2001-04-30 2003-05-13 Nokia Mobile Phones Ltd. Advanced production test method and apparatus for testing electronic devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4802094A (en) * 1985-07-10 1989-01-31 Hitachi, Ltd. Process monitoring apparatus for process management in production and assembly lines
US4958292A (en) * 1987-04-22 1990-09-18 Toyota Jidosha Kabushiki Kaisha Production control system for mixed production line
US5237508A (en) * 1989-08-10 1993-08-17 Fujitsu Limited Production control system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2881899A2 (en) 2013-12-09 2015-06-10 Deutsche Telekom AG System and method for automated aggregation of descriptions of individual object variants
US10761974B2 (en) 2017-11-10 2020-09-01 International Business Machines Corporation Cognitive manufacturing systems test repair action

Also Published As

Publication number Publication date
WO2003015004A3 (en) 2003-08-28
US20030028353A1 (en) 2003-02-06
EP1415260A2 (en) 2004-05-06
AU2002310372A1 (en) 2003-02-24
BR0211714A (en) 2004-09-21
MXPA04001083A (en) 2004-07-08

Similar Documents

Publication Publication Date Title
US20030028353A1 (en) Production pattern-recognition artificial neural net (ANN) with event-response expert system (ES)--yieldshieldTM
CN100465842C (en) Data analysis system and method
US10782664B2 (en) Production system that sets determination value of variable relating to abnormality of product
CN109001649B (en) Intelligent power supply diagnosis system and protection method
US6563301B2 (en) Advanced production test method and apparatus for testing electronic devices
Dowdeswell et al. Finding faults: A scoping study of fault diagnostics for Industrial Cyber–Physical Systems
CN114118673A (en) Workshop intelligent fault diagnosis early warning method based on digital twin technology
WO2019226846A1 (en) Competency gap identification of an operators response to various process control and maintenance conditions
Villalonga et al. Local decision making based on distributed digital twin framework
CN110290203A (en) Artificial intelligence cloud computing carries out Noninvasive production defect recognition and information communication to manufactured goods
CN109523030B (en) Telemetering parameter abnormity monitoring system based on machine learning
US11676055B2 (en) System for detecting data drift in machine-learning process monitoring
Chen et al. Exploring equipment electrocardiogram mechanism for performance degradation monitoring in smart manufacturing
US11580842B1 (en) Real-time alert management using machine learning
US11334061B2 (en) Method to detect skill gap of operators making frequent inadvertent changes to the process variables
EP3839530A1 (en) Methods and systems for assessing printed circuit boards
da Silva Adaptation oriented test data generation for adaptive systems
Ku et al. An intelligent FMEA system implemented with a hierarchy of back-propagation neural networks
Davies et al. The utilization of artificial intelligence to achieve availability improvement in automated manufacture
Osyk et al. A neural network model for fault detection in conjunction with a programmable logic controller
Amigoni et al. Artificial intelligence in science of measurements and the evolution of the measurements instruments: A perspective conception
Provan et al. Model-based fault tolerant control reconfiguration for discrete event systems
CN113396444A (en) Method and device for automatically identifying product defects of products and/or for automatically identifying causes of product defects
Villalonga Jaén et al. Local Decision Making based on Distributed Digital Twin Framework
TW202336685A (en) Inspection system and management method of artificial intelligence model data capable of more easily applying an appropriate AI model to a production line

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ OM PH PL PT RU SD SE SG SI SK SL TJ TM TN TR TZ UA UG US UZ VN YU ZA ZM

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZM ZW AM AZ BY KG KZ RU TJ TM AT BE CH CY DE DK FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2002737443

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: PA/a/2004/001083

Country of ref document: MX

WWP Wipo information: published in national office

Ref document number: 2002737443

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 2002737443

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP