WO2005083567A2 - Method of testing the development status of a developed system - Google Patents

Method of testing the development status of a developed system Download PDF

Info

Publication number
WO2005083567A2
WO2005083567A2 PCT/EP2005/001558 EP2005001558W WO2005083567A2 WO 2005083567 A2 WO2005083567 A2 WO 2005083567A2 EP 2005001558 W EP2005001558 W EP 2005001558W WO 2005083567 A2 WO2005083567 A2 WO 2005083567A2
Authority
WO
WIPO (PCT)
Prior art keywords
quality
testing
degree
severity
specific problem
Prior art date
Application number
PCT/EP2005/001558
Other languages
French (fr)
Other versions
WO2005083567A3 (en
Inventor
Michael Schneider
Rolf Schwedhelm
Original Assignee
Eastman Kodak Company
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastman Kodak Company filed Critical Eastman Kodak Company
Publication of WO2005083567A2 publication Critical patent/WO2005083567A2/en
Publication of WO2005083567A3 publication Critical patent/WO2005083567A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/008Reliability or availability analysis

Definitions

  • the present invention relates to a method of testing the development status, in particular, the degree of quality and/or reliability, preferably the launch readiness, of a developed system, specifically a machine.
  • An object of the invention is to provide a method which permits the differentiated testing of a system, in particular, by selecting points of special emphasis applicable to continued developments or to improvements of the system.
  • this object is achieved in that problems (Pj), which potentially occur during the operation of the system and which are to be used for testing, are detected and/or defined, in that at least one quality criterion (K n ) is used as the default for analyzing the problems, and in that the degree of severity (Si) of a specific problem (Pj) is expressed in terms of the ratio of the extent of the occurrence of at least one quality criterion (K n ) regarding this defined problem (Pj) with respect to the maximum possible or expected extent (Max K n ) of this specific problem (Pi).
  • this way of weighting makes sense only when a plurality of quality criteria, as are preferably provided, are selected in such a manner that, in order to determine the degree of severity (Sj), several stated ratios (K n )/Max K n ) or (g n Kn)/(Max K n ) for different quality criteria among a number (n) of quality criteria Ki through K ⁇ are multiplied with each other.
  • quality criteria the downtime of the system when a specific problem occurs, and/or the frequency of the occurrence of a specific problem, and/or the number of systems in which a specific problem occurs.
  • the method of the present invention is designed and suitable for testing a digital printing machine.
  • the degree of severity (Sj) is defined in terms of the following formula: g ⁇ * K ⁇ * - * g n * K tract S, MaxK x • ... • MaxK n
  • quality criteria Ki through K n there is a quantity of 1 through n quality criteria Ki through K n , from among which a few or every criteria are selected for the aforementioned formula as the criteria that are significant regarding the analysis of the system, and that these quality criteria are weighted with their respectively assigned weighting factors gi through g n .
  • Each weighting factor has a real value of from 0 to 1.
  • the respective maximum (bad) value for the quality criterion Max K n is used to qualify or standardize the value Sj.
  • the quality value would be equal to zero, assuming that all weighting factors are equal to one, and assuming that all quality criteria have satisfied the "maximum bad' status, i.e., each problem Pj, taking into consideration each quality criterion, exhibits maximum critical status.
  • the degree of severity Sj and the quality value Qj must be determined for each and every problem.
  • Fig. 1 data and a quality graph depicting the degree of severity S, taking into consideration two quality criteria;
  • Fig. 2 a quantity graph depicting the degree of severity S, as in Fig. 1 , and the graph of the respectively assigned quality value Q.
  • Fig. 1 problems 1 through 28, i.e., Pj of Pi through P 28 , are plotted on the abscissa.
  • problems 1 through 28 i.e., Pj of Pi through P 28
  • the following may be potential problems: no fusion roller temperature control, machine stop, wrong printing sheet length, paper jam, error message from a registration sensor, hood not closed, no printing material, and so on.
  • the right ordinate of Fig. 1 indicates how many times the respective problem has occurred, for example, in field testing.
  • These frequency values are connected with each other by a solid line that forms a graph. Consequently, this frequency represents a first quality criterion, i.e., Ki, in testing.
  • the downtimes resulting from the respective problem are depicted.
  • these downtimes represent the second significant quality criterion K 2 .
  • this kind of field testing may be performed with a plurality of systems, i.e., for example, the same type of printing machines, so that the number of tested machines displaying a given problem can be used as a third quality criterion K 3 .
  • the index n of quality criteria would run from 1 through 3.
  • Fig. 1 which was created for only one machine, it is assumed that the last factor in the numerator and in denominator, respectively, is equal to 1.
  • the two remaining quality criteria K-i and K 2 are used for each problem Pj to determine the respective degree of severity Sj in accordance with the above formula.
  • these degrees of severity Sj are plotted (qualitatively) and connected by a dashed line to form a graph. To achieve this, the problems have already been sorted as to degree of severity in Fig. 1 in such a manner that the most severe problems are located on the extreme left.
  • Fig. 2 shows the graph depicting the degree of severity, again quantitatively, in correspondence with the dimensions of the left ordinate in Fig. 2.
  • the corresponding graph of quality values Qj has been defined and plotted in Fig. 2.
  • this number can be used as a criterion to release the analyzed system for launching.
  • these numbers may be used for prioritizing development tasks. If the degree of severity or the quality value is based on field-testing data, these numbers may be used to communicate an improvement to the customer (e.g., in the course of product iteration or after providing update kits).

Abstract

The present invention relates to a method of testing the development status, in particular, the degree of quality and/or reliability, preferably the launch readiness, of a developed system, specifically a machine. An object of the invention is to provide a method which permits the differentiated testing of a system. This object is achieved in that problems (Pi), which potentially occur during the operation of the system and which are to be used for testing, are detected and/or defined, that at least one quality criterion (Kn) is used as the default for analyzing the problems, and that the degree of severity (Si) of a specific problem (Pi) is expressed in terms of the ratio of the extent of the occurrence of at least one quality criterion (Kn) regarding this defined problem (Pi) relative to the maximum possible or expected extent (Max Kn) of this specific problem (Pi).

Description

Method of Testing the Development Status of a Developed System
The present invention relates to a method of testing the development status, in particular, the degree of quality and/or reliability, preferably the launch readiness, of a developed system, specifically a machine.
In principle, a method of the aforementioned type has been known from US-A-6 038 517. However, in this method, an error-free running time is used as the general testing criterion.
An object of the invention is to provide a method which permits the differentiated testing of a system, in particular, by selecting points of special emphasis applicable to continued developments or to improvements of the system.
In accordance with the present invention, this object is achieved in that problems (Pj), which potentially occur during the operation of the system and which are to be used for testing, are detected and/or defined, in that at least one quality criterion (Kn) is used as the default for analyzing the problems, and in that the degree of severity (Si) of a specific problem (Pj) is expressed in terms of the ratio of the extent of the occurrence of at least one quality criterion (Kn) regarding this defined problem (Pj) with respect to the maximum possible or expected extent (Max Kn) of this specific problem (Pi).
In so doing, different quality criteria may be viewed as being of different importance or significance in the process of testing the system. Therefore, one development of the invention provides that the aforementioned ratio (Kn) / (Max Kn) assigned to a specific problem (Pj) for determining the degree of severity (Sj) is multiplied with a weighting factor (gn), where 0 < gn < 1, that is assigned to this quality criterion (Kπ). If the weighting factor gn = 0, the respectively weighted quality criterion, of course, becomes unnecessary as such. Hence, this way of weighting makes sense only when a plurality of quality criteria, as are preferably provided, are selected in such a manner that, in order to determine the degree of severity (Sj), several stated ratios (Kn)/Max Kn) or (gn Kn)/(Max Kn) for different quality criteria among a number (n) of quality criteria Ki through Kπ are multiplied with each other.
For example, in particular the following may be considered as quality criteria: the downtime of the system when a specific problem occurs, and/or the frequency of the occurrence of a specific problem, and/or the number of systems in which a specific problem occurs.
Preferably, the method of the present invention is designed and suitable for testing a digital printing machine.
Consequently, in accordance with the present invention, the degree of severity (Sj) is defined in terms of the following formula: gι * Kι * - * gn * K„ S, MaxKx • ... • MaxKn
Considering this, there is a quantity of 1 through n quality criteria Ki through Kn, from among which a few or every criteria are selected for the aforementioned formula as the criteria that are significant regarding the analysis of the system, and that these quality criteria are weighted with their respectively assigned weighting factors gi through gn. Each weighting factor has a real value of from 0 to 1. The respective maximum (bad) value for the quality criterion Max Kn is used to qualify or standardize the value Sj. A corresponding quality value can be defined in terms of Qj = 1 - Sj. Consequently, the quality value would be equal to zero, assuming that all weighting factors are equal to one, and assuming that all quality criteria have satisfied the "maximum bad' status, i.e., each problem Pj, taking into consideration each quality criterion, exhibits maximum critical status. In light of the quality criterion Kn, the degree of severity Sj and the quality value Qj must be determined for each and every problem. Thus, the degree of severity S and the quality value Q are quasi-functions of Pj and have the respective function values S (Pj) = Sj and Q (Pj) = Qj, where the index quantity I = { i | i e N }, with N, in this case, representing the finite quantity of natural numbers which are the numbers of consecutively numbered problems Pj.
Examples of inventive tests, which may result in additional inventive features, which, however, do not restrict the scope of this invention, are shown by the drawings.
They show in
Fig. 1 data and a quality graph depicting the degree of severity S, taking into consideration two quality criteria; and,
Fig. 2 a quantity graph depicting the degree of severity S, as in Fig. 1 , and the graph of the respectively assigned quality value Q.
In Fig. 1 , problems 1 through 28, i.e., Pj of Pi through P28, are plotted on the abscissa. For example, considering an electrophotographically operating digital printing machine that is being analyzed, the following may be potential problems: no fusion roller temperature control, machine stop, wrong printing sheet length, paper jam, error message from a registration sensor, hood not closed, no printing material, and so on. Considering each of these problems, the right ordinate of Fig. 1 indicates how many times the respective problem has occurred, for example, in field testing. These frequency values are connected with each other by a solid line that forms a graph. Consequently, this frequency represents a first quality criterion, i.e., Ki, in testing. Using bars corresponding to the dimensions of the left ordinate of Fig. 1 , the downtimes resulting from the respective problem are depicted. In the course of testing, these downtimes represent the second significant quality criterion K2. Of course, this kind of field testing may be performed with a plurality of systems, i.e., for example, the same type of printing machines, so that the number of tested machines displaying a given problem can be used as a third quality criterion K3. Hence, the index n of quality criteria would run from 1 through 3.
In accordance with the aforementioned formula, the degree of severity Sj for each problem Pj would be determined mathematically as follows:
_ Downtime _ because _ Pt • Frequency _of _Pt • Machines _ with _ Pt Max(Downtime _ because _ Pl ) • Max(Frequency _of_Pl) » Number _ all _ Machines
In Fig. 1 , which was created for only one machine, it is assumed that the last factor in the numerator and in denominator, respectively, is equal to 1. In this case, the two remaining quality criteria K-i and K2 are used for each problem Pj to determine the respective degree of severity Sj in accordance with the above formula. In Fig. 1 , these degrees of severity Sj are plotted (qualitatively) and connected by a dashed line to form a graph. To achieve this, the problems have already been sorted as to degree of severity in Fig. 1 in such a manner that the most severe problems are located on the extreme left.
Fig. 2 shows the graph depicting the degree of severity, again quantitatively, in correspondence with the dimensions of the left ordinate in Fig. 2. In addition, the corresponding graph of quality values Qj has been defined and plotted in Fig. 2.
Testing in accordance with the invention may be performed in view of the following objectives, for example:
1. If the degree of severity is below a default limit or if the quality value is above a default limit, this number can be used as a criterion to release the analyzed system for launching.
2. If the degree of severity or the quality value is based on field-testing data, these numbers may be used for prioritizing development tasks. If the degree of severity or the quality value is based on field-testing data, these numbers may be used to communicate an improvement to the customer (e.g., in the course of product iteration or after providing update kits).

Claims

Patent Claims
1. Method of testing the development status, in particular, the degree of quality and/or reliability, preferably the launch readiness, of a developed system, specifically a machine, characterized in that problems (Pj), which potentially occur during the operation of the system and which are to be used for testing, are detected and/or defined, at least one quality criterion (Kn) is used as the default for analyzing the problems, and the degree of severity (Sj) of a specific problem (Pj) is expressed in terms of the ratio of the extent of the occurrence of at least one quality criterion (Kn) regarding this defined problem (Pj) with respect to the maximum possible or expected extent (Max Kn) of this specific problem (Pj).
2. Method as in Claim 1 , characterized in that said ratio (Kn ) / (Max Kn) for a specific problem (Pj) is multiplied with a weighting factor gn, where 0 < gn < 1 , that is assigned to this quality criterion (Kn), in order to determine the degree of severity (Sj).
3. Method as in Claim 1 or 2, characterized in that, in order to determine the degree of severity (Sj), several stated ratios (Kn)/Max Kn) or (gn Kn)/(Max Kn) for different quality criteria from among a number (n) of quality criteria (Ki through Kn) are multiplied with each other.
4. Method as in one of the previous Claims, characterized in that one of the quality criteria used is the downtime of the system when a specific problem occurs.
5. Method as in one of the previous Claims, characterized in that one of the quality criteria used is the frequency of the occurrence of a specific problem.
6. Method as in one of the previous Claims, characterized in that one of the quality criteria used is the number of systems in which a specific problem occurs.
7. Method as in one of the previous Claims, characterized in that the system is a digital printing machine.
PCT/EP2005/001558 2004-02-26 2005-02-16 Method of testing the development status of a developed system WO2005083567A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE200410009227 DE102004009227A1 (en) 2004-02-26 2004-02-26 Method for testing a state of development of a developed system
DE102004009227.3 2004-02-26

Publications (2)

Publication Number Publication Date
WO2005083567A2 true WO2005083567A2 (en) 2005-09-09
WO2005083567A3 WO2005083567A3 (en) 2006-10-12

Family

ID=34894862

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2005/001558 WO2005083567A2 (en) 2004-02-26 2005-02-16 Method of testing the development status of a developed system

Country Status (2)

Country Link
DE (1) DE102004009227A1 (en)
WO (1) WO2005083567A2 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6038517A (en) * 1997-01-03 2000-03-14 Ncr Corporation Computer system and method for dynamically assessing the market readiness of a product under development

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5283416A (en) * 1992-06-26 1994-02-01 Trw Inc. Laser process monitoring and evaluation
EP0881783A1 (en) * 1997-05-26 1998-12-02 Siemens Schweiz AG Method for selecting an optimal transmission channel

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6038517A (en) * 1997-01-03 2000-03-14 Ncr Corporation Computer system and method for dynamically assessing the market readiness of a product under development

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BORIS BEIZER: "Software System Testing and Quality Assurance" 1984, VAN NOSTRAND REINHOLD, NEW YORK, N.Y. 10003 , ISBN 0-442-21306-9 , XP002388745 Chapter 2: "Bugs in perspective" page 16 - page 36 *
SHELTON C P ET AL: "Robustness testing of the Microsoft Win32 API" DEPENDABLE SYSTEMS AND NETWORKS, 2000. DSN 2000. PROCEEDINGS INTERNATIONAL CONFERENCE ON NEW YORK, NY, USA 25-28 JUNE 2000, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 25 June 2000 (2000-06-25), pages 261-270, XP010504338 ISBN: 0-7695-0707-7 *

Also Published As

Publication number Publication date
DE102004009227A1 (en) 2005-09-29
WO2005083567A3 (en) 2006-10-12

Similar Documents

Publication Publication Date Title
JP5370832B2 (en) State determination device and failure prediction system using the same
JP4710720B2 (en) Failure prevention diagnosis support system and failure prevention diagnosis support method
US8190037B2 (en) Fault prediction method, fault prediction system, and image forming apparatus
EP0259144A2 (en) Reproduction machine with diagnostic system
US20080059120A1 (en) Using fault history to predict replacement parts
Lin et al. Analysis of test suite reduction with enhanced tie-breaking techniques
EP1085416A2 (en) Diagnostic system
US10776706B2 (en) Cost-driven system and method for predictive equipment failure detection
JP5045191B2 (en) Failure prediction diagnosis device, failure prediction diagnosis system using the same, and failure prediction diagnosis program
CN110023862A (en) Diagnostic device, diagnostic method and program
JP7076440B2 (en) How to monitor gas analyzer components
JP2009003561A (en) Fault prediction diagnostic system and fault prediction diagnostic system using the same
CN107798047A (en) Repeat work order detection method, device, server and medium
KR20190021560A (en) Failure prediction system using big data and failure prediction method
US20160110653A1 (en) Method and apparatus for predicting a service call for digital printing equipment from a customer
JP2008256981A (en) Fault diagnostic system
EP1726998A2 (en) Contextual Fault Handling Method and Apparatus in a Printing System
US5521844A (en) Printing press monitoring and advising system
CN108427542A (en) Design support system and design support method
CN111061581B (en) Fault detection method, device and equipment
WO2005083567A2 (en) Method of testing the development status of a developed system
Narasimhan et al. Fault isolation in hybrid systems combining model based diagnosis and signal processing
Ramler et al. Requirements for integrating defect prediction and risk-based testing
CN107924185B (en) Method and system for maintaining field devices in a plant using automation technology
CN116391159A (en) Quality control of products for mass production

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase