US 6883120 B1 Abstract A method and system for computer assisted automatic error detection and diagnosis of file servers. Software modules periodically and continuously review monitoring statistics gathered by the file server regarding its operation. The monitoring statistics are processed by a pattern matching system and a rule-based inference system. Software modules augment known network protocols, by manipulating parameters of lower-level protocols using different higher-level protocols. Using the higher-level protocols, software modules determine if the selected parameters for the lower-level protocols are correct. Software modules track hardware and software configuration changes to the file server, and relate changes in known monitoring statistics to timing of those hardware and software configuration changes. Claims 1. A method, including steps of repeatedly reviewing monitoring statistics regarding operation of a file server, said steps of reviewing being performed at least as often as a selected time period; and processing said monitoring statistics using a diagnostic software module on said file server, in response to said steps of repeatedly reviewing; wherein said diagnostic software module diagnoses a behavior of said file server to determine a specific problem or problems by comparing said monitoring statistics to rules or patterns representing abnormal states of operation for said file server; and wherein said monitoring statistics include information gathered by at least first and second software modules, said first and second software modules being disposed at differing protocol levels within an operating system of said file server. 2. A method as in 3. A method as in 4. A method as in 5. A method as in 6. A method as in 7. A method as in selecting parameters for said differing protocol levels; using said diagnostic software module to determine a measure of efficiency for said file server using a higher one of said differing protocol levels; and selecting new parameters for a lower one of said differing protocol levels in response to said measure of efficiency. 8. A method, including steps of tracking configuration changes to a file server; maintaining monitoring statistics for said file server: identifying a relationship between changes in said monitoring statistics for said file server and timing of said configuration changes; identifying possible errors or other faults for said server associated with relating said changes in said monitoring statistics to timing of said configuration changes; determining, in response to said relationship between said changes in monitoring statistics and said timing of configuration changes, which of said possible errors or other faults is most likely; and identifying, in response to which of said possible errors or other faults is most likely, one or more of said configuration changes. 9. A method as in 10. A method as in 11. A file server comprising: an interface to a network; mass storage accessible through said interface; a processor that controls access to said mass storage; and a memory that stores information including instructions executable by said processor, said instructions including steps of (a) repeatedly reviewing monitoring statistics regarding operation of said file server, said steps of reviewing being performed at least as often as a selected time period, and (b) processing said monitoring statistics using a diagnostic software module on said file server, in response to said steps of repeatedly reviewing; wherein said diagnostic software module diagnoses a behavior of said file server to determine a specific problem or problems by comparing said monitoring statistics to rules or patterns representing abnormal states of operation for said file server; and wherein said monitoring statistics include information gathered by at least first and second software modules, said first and second software modules being disposed at differing protocol levels within an operating system of said file server. 12. A file server as in 13. A file server as in 14. A file server as in 15. A file server as in 16. A file server as in 17. A file server as in 18. A file server comprising: an interface to a network; mass storage accessible through said interface; a processor that controls access to said mass storage; and a memory that stores information including instructions executable by said processor, said instructions including steps of (a) tracking configuration changes to said file server, (b) maintaining monitoring statistics for said file server, (c) identifying a relationship between changes in said monitoring statistics for said file server and timing of said configuration changes, (d) identifying possible errors or other faults for said server associated with said changes in said monitoring statistics, (e) determining, in response to said relationship between said changes in monitoring statistics and said timing of configuration changes, which of said possible errors or other faults is most likely, and (f) identifying, in response to which of said possible errors or other faults is most likely, one or more of said configuration changes. 19. A file server as in 20. A file server as in 21. A memory storing information including instructions, the instructions executable by a processor to control a file server, the instructions including steps of repeatedly reviewing monitoring statistics regarding operation of said file server, said steps of reviewing being performed at least as often as a selected time period; and processing said monitoring statistics using a diagnostic software module on said file server, in response to said steps of repeatedly reviewing; wherein said diagnostic software module diagnoses a behavior of said file server to determine a specific problem or problems by comparing said monitoring statistics to rules or patterns representing abnormal states of operation for said file server; and wherein said monitoring statistics include information gathered by at least first and second software modules, said first and second software modules being disposed at differing protocol levels within an operating system of said file server. 22. A memory as in 23. A memory as in 24. A memory as in 25. A memory as in 26. A memory as in 27. A memory as in selecting parameters for said differing protocol levels; using said diagnostic software module to determine a measure of efficiency for said file server using a higher one of said differing protocol levels; and selecting new parameters for a lower one of said differing protocol levels in response to said measure of efficiency. 28. A memory storing information including instructions, the instructions executable by a processor to control a file server, the instructions including steps of tracking configuration changes to a file server; maintaining monitoring statistics for said file server; identifying a relationship between changes in said monitoring statistics for said file server and timing of said configuration changes; identifying possible errors or other faults for said server associated with said changes in said monitoring statistics; determining in response to said relationship between said changes in monitoring statistics and said timing of configuration changes, which of said possible errors or other faults is most likely; and identifying, in response to which of said possible errors or other faults is most likely, one or more of said configuration changes. 29. A memory as in 30. A memory as in Description 1. Field of the Invention This invention relates to computer assisted automatic error detection and diagnosis of file servers, such as for a networked file server. 2. Related Art Network file servers are subject to errors and other failures (such as less-than-expected levels of performance), including those arising from hardware failure, software error, erroneous configuration, or mismatch between configuration and usage. Many of these errors and other failures are similar to those that are common for general-purpose computer systems, and these would therefore be subject to similar forms of error detection and diagnosis by a user of the system. However, many network file servers are designed for minimal user intervention, and are specifically intended to have extremely simple user interfaces. One such group of easy-to-use network file servers are called “Network Appliance”™ file servers, for which the model of use is that the device is as easy to use as a common toaster. One problem with known systems is that relative ease of use is often coupled with relatively unsophisticated users. Error detection and diagnosis by relatively unsophisticated users is subject to the drawback that relatively unsophisticated users are relatively unsophisticated in the use of error detection and diagnosis techniques. Thus, forms of error detection and diagnosis that are acceptable for general-purpose computer systems are not nearly as suitable for network file servers where one of the most important purposes is to be easy-to-use. Accordingly, it would be advantageous to provide a technique for computer assisted automatic error detection and diagnosis of file servers that is not subject to drawbacks of the known art. The invention provides a method and system for computer assisted automatic error detection and diagnosis of file servers. In a preferred embodiment, the file server includes diagnostic software modules for (1) periodic and continuous interpretation of monitoring statistics, (2) augmentation of known network protocols, (3) cross-layer analysis of monitoring statistics, and (4) tracking of hardware and software configuration changes. In a first aspect of the invention, the diagnostic software modules periodically and continuously review monitoring statistics gathered by the file server regarding its operation. These monitoring statistics can include a wide variety of values gathered by software modules at disparate levels within the operating system of the file server. The collection of monitoring statistics is processed by a pattern matching system and a rule-based inference system. In a preferred embodiment, the pattern matching system and rule-based inference system are responsive to a use profile for the file server, such as whether the file server is being used for an ISP, a development environment, a mail server, or otherwise. In a second aspect of the invention, the diagnostic software modules are capable of augmenting known network protocols, by manipulating parameters of lower-level protocols using different higher-level protocols. The diagnostic software modules can manipulate known parameters of the lower-level protocols in rapid succession, so as to try a large number of combinations of protocol parameters. Using the higher-level protocols, the diagnostic software modules can determine if the selected parameters for the lower-level protocols are correct. In a third aspect of the invention, the diagnostic software modules are capable of imposing sequential and combined constraints on diagnosis of possible errors, with reference to known logical coupling between monitoring statistics gathered at multiple logical levels of software modules within the file server. In a preferred embodiment, constraints from multiple logical levels are chained together so as to limit the number of possible errors deduced as possible from the various monitoring statistics to a relatively small number. In a fourth aspect of the invention, the diagnostic software modules are capable of tracking hardware and software configuration changes to the file server, and relating changes in known monitoring statistics to timing of those hardware and software configuration changes. In a preferred embodiment, the diagnostic software modules are capable of determining the configuration change most likely to be responsible for a computer assisted diagnosed error, and of suggesting activities to reverse the hardware and software configuration changes so as to place the file server in an operating state. The invention provides an enabling technology for a wide variety of applications for computer assisted automatic error detection and diagnosis of file servers, so as to obtain substantial advantages and capabilities that are novel and non-obvious in view of the known art. Examples described below primarily relate to networked file servers, but the invention is broadly applicable to many different types of automated software systems. In the following description, a preferred embodiment of the invention is described with regard to preferred process steps and data structures. Embodiments of the invention can be implemented using general-purpose processors or special purpose processors operating under program control, or other circuits, adapted to particular process steps and data structures described herein. Implementation of the process steps and data structures described herein would not require undue experimentation or further invention. Lexicography The following terms refer or relate to aspects of the invention as described below. The descriptions of general meanings of these terms are not intended to be limiting, only illustrative.
As noted above, these descriptions of general meanings of these terms are not intended to be limiting, only illustrative. Other and further applications of the invention, including extensions of these terms and concepts, would be clear to those of ordinary skill in the art after perusing this application. These other and further applications are part of the scope and spirit of the invention, and would be clear to those of ordinary skill in the art, without further invention or undue experimentation. System Elements A system 100 includes a file server (or other device) 110, a communication network 120, a network interface 130, and a database 140. The file server (or other device) 110 includes a computer having a processor, program and data memory, mass storage, a presentation element, and an input element, and coupled to the communication network 120. As used herein, the term “computer” is intended in its broadest sense, and includes any device having a programmable processor or otherwise falling within the generalized Turing machine paradigm. The mass storage can include any device for storing relatively large amounts of information, such as magnetic disks or tapes, optical devices, magneto-optical devices, or other types of mass storage. The file server 110 includes operating system software 111, including an appliance operating system 112 for controlling the file server 110 and performing its file server operations, and a diagnostic software module 113 for performing computer assisted automatic error detection and diagnosis. The diagnostic software module 113 includes software modules for error detection and diagnosis (further described with regard to The communication network 120 includes any technique for sending information between the file server 110 and at least one point outside the file server 110. In a preferred embodiment, the communication network 120 includes a computer network, such as an Internet, intranet, extranet, or a virtual private network. In alternative embodiments, the communication network 120 can include a direct communication line, a switched network such as a telephone network, or some combination thereof. The network interface 130 includes a communication link between the file server 10 and the communication network 120. The database 140 includes memory or mass storage in which monitoring statistics and other information about the file server 110 can be recorded and retrieved therefrom. Method of Operation (Interpretation of Monitoring Statistics) A method 200 includes a set of flow points and a set of steps. The system 100 performs the method 200. Although the method 200 is described serially, the steps of the method 200 can be performed by separate elements in conjunction or in parallel, whether asynchronously, in a pipelined manner, or otherwise. There is no particular requirement that the method 200 be performed in the same order in which this description lists the steps, except where so indicated. At a flow point 210, the diagnostic software module 113 is ready to passively monitor operating system statistics. At a step 211, the diagnostic software module 113 receives operating system statistics from the database 140 and compares those operating system statistics against a set of predefined rules regarding statistical aberrations. If the operating system statistics fall within the predefined rules, thus indicating an abnormal system state, the diagnostic software module 113 flags that abnormal system state, enters a reporting record in the database 140, and reports the detected abnormal system state and its associated operating system statistics to an operator (not shown). In a preferred embodiment, the predefined rules regarding statistical aberrations include both (a) pattern matching, in which the diagnostic software module 113 compares the monitoring statistics against selected patterns known to be related to an errors or other faults, and (b) rule-based inference, in which the diagnostic software module 113 draws factual conclusions from monitoring statistics and other known facts, so as to determine the presence or absence of errors or other faults. In a preferred embodiment, the predefined rules regarding statistical aberrations are responsive to a usage pattern for the file server, as recorded in the database 140 or otherwise. For example, the file server can be primarily used as for an ISP, a development environment, a mail server, or otherwise. The usage pattern for the file server could reflect such information, preferably including an expected number of distinct users, an expected number of distinct files, an expected size for typical files, and an expected duration of existence for distinct files or file-usage sessions. At a step 212, the diagnostic software module 113 determines, using the predefined rules, whether the abnormal system state corresponds to a specific known problem, or is associated with more than one known problem. If the abnormal system state corresponds to a specific known problem, the diagnostic software module 113 so indicates and reports the specific known problem to the operator. At a step 213, if the abnormal system state was determined in the previous step to correspond to a set of more than one known problem, the diagnostic software module 113 determines if there is a predefined technique for analyzing the abnormal system state. If there is such a predefined technique, the diagnostic software module 113 proceeds with the next step. At a step 214, the diagnostic software module 113 performs the predefined technique for analyzing the abnormal system state found in the previous step. After this step, the method 200 has performed one round of passively monitoring operating system statistics, and is ready to perform another such round so as to continuously monitor operating system statistics. The method 200 is performed one or more times starting from the flow point 210 and continuing therefrom. In a preferred embodiment, the diagnostic software module 113 repeatedly performs the method 200, starting from the flow point 210 and continuing therefrom, so as to review monitoring statistics gathered by the file server periodically and continuously. Method of Operation (Augmentation of Network Protocols) A method 300 includes a set of flow points and a set of steps. The system 100 performs the method 300. Although the method 300 is described serially, the steps of the method 300 can be performed by separate elements in conjunction or in parallel, whether asynchronously, in a pipelined manner, or otherwise. There is no particular requirement that the method 300 be performed in the same order in which this description lists the steps, except where so indicated. At a flow point 310, the diagnostic software module 113 is ready to determine the presence or absence of errors or other faults, using protocol augmentation of known network protocols. At a step 311, the diagnostic software module 113 selects parameters for known network protocols, so as to communicate with a device at a point outside the file server 110. In selecting these parameters, the diagnostic software module 113 attempts to choose parameters that match with the device outside the file server 110, so as to achieve relatively efficient communication. At a step 312, the diagnostic software module 113 uses the lower-level protocol to set its parameters to the parameters selected in the previous step. At a step 313, the diagnostic software module 113 communicates with the device outside the file server 110 using a higher-level protocol, and uses the higher-level protocol to measure the relative efficiency of communication therewith. At a step 314, the diagnostic software module 113 selects a new set of parameters for the lower-level protocol, in response to the measure of relative efficiency determined using the higher-level protocol in the previous step. The diagnostic software module 113 performs the step 312, the step 313, and the step 314, repeatedly and rapidly, so as to try a large number of combinations of protocol parameters. The diagnostic software module 113 thus determines which selected parameters are optimal. At a step 315, the diagnostic software module 113 uses the lower-level protocol to set its parameters to the parameters determined to be optimal. After this step, the method 300 has set the optimal parameters for the lower-level protocol. The method 300 can be performed one or more times starting from the flow point 310 and continuing therefrom. Method of Operation (Cross-Layer Analysis) A method 400 includes a set of flow points and a set of steps. The system 100 performs the method 400. Although the method 400 is described serially, the steps of the method 400 can be performed by separate elements in conjunction or in parallel, whether asynchronously, in a pipelined manner, or otherwise. There is no particular requirement that the method 400 be performed in the same order in which this description lists the steps, except where so indicated. At a flow point 410, the diagnostic software module 113 is ready to perform cross-layer analysis of monitoring statistics. At a step 411, the diagnostic software module 113 identifies a diagnostic constraint applicable to the set of current monitoring statistics. At a step 412, the diagnostic software module 113 performs pattern matching and rule-based inference to attempt to identify a known error or other fault, similar to the method 200. The diagnostic software module 1113 performs the step 411 and the step 412 repeatedly and rapidly, so as to apply a large number of combinations of diagnostic constraints. The diagnostic software module 113 thus determines a set of errors or other faults are not compatible with the set of current monitoring statistics. In a preferred embodiment, the diagnostic software module 113 continues to apply combinations of diagnostic constraints until the set of errors or other faults is reduced to only a few possibilities. After this step, the method 400 has used cross-layer analysis of monitoring statistics to restrict the set of possible errors or other faults. The method 400 can be performed one or more times starting from the flow point 410 and continuing therefrom. Method of Operation (Tracking Configuration Changes) A method 500 includes a set of flow points and a set of steps. The system 100 performs the method 500. Although the method 500 is described serially, the steps of the method 500 can be performed by separate elements in conjunction or in parallel, whether asynchronously, in a pipelined manner, or otherwise. There is no particular requirement that the method 500 be performed in the same order in which this description lists the steps, except where so indicated. At a flow point 510, the diagnostic software module 113 is ready to perform tracking of hardware and software configuration changes. At a step 511, the diagnostic software module 113 identifies a past hardware or software configuration for the file server, recorded in the database 140 or otherwise, and a present hardware or software configuration for the file server, recorded in the database 140 or otherwise. At a step 512, the diagnostic software module 113 identifies a set of differences between the past configuration and the present configuration. The diagnostic software module relates changes in known monitoring statistics to timing of those configuration changes. At a step 513, the diagnostic software module 113 identifies a set of possible errors or other faults associated with the set of differences identified in the previous step. At a step 514, the diagnostic software module 113 applies diagnostic constraints from the set of current monitoring statistics to the set of possible errors or other faults, so as to determine which errors or other faults are most likely. At a step 515, the diagnostic software module 113 uses the determination, in the previous step, of which errors or other faults are most likely, to suggest activities to reverse the hardware or software configuration changes so as to place the file server in an operating state. After this step, the method 500 has used tracking of hardware and software configuration changes to restrict the set of possible errors or other faults. The method 500 can be performed one or more times starting from the flow point 510 and continuing therefrom. Generality of the Invention The invention has general applicability to various fields of use, not necessarily related to the services described above. For example, these fields of use can include other “appliance”-type devices other than file servers. Other and further applications of the invention in its most general form, will be clear to those skilled in the art after perusal of this application, and are within the scope and spirit of the invention. Technical Appendix The technical appendix enclosed with this application is hereby incorporated by reference as if fully set forth herein, and forms a part of the disclosure of the invention and its preferred embodiments. Alternative Embodiments Although preferred embodiments are disclosed herein, many variations are possible which remain within the concept, scope, and spirit of the invention, and these variations would become clear to those skilled in the art after perusal of this application. Patent Citations
Non-Patent Citations
Referenced by
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||