US20070299665A1 - Automatic Decision Support - Google Patents
Automatic Decision Support Download PDFInfo
- Publication number
- US20070299665A1 US20070299665A1 US11/766,780 US76678007A US2007299665A1 US 20070299665 A1 US20070299665 A1 US 20070299665A1 US 76678007 A US76678007 A US 76678007A US 2007299665 A1 US2007299665 A1 US 2007299665A1
- Authority
- US
- United States
- Prior art keywords
- document
- decision support
- codings
- output
- produce
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/20—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for electronic clinical trials or questionnaires
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
Definitions
- transcripts are produced of diagnoses, prognoses, prescriptions, and other information dictated by doctors and other medical professionals.
- transcripts can be time-consuming. For example, the speed with which a human transcriptionist can produce a transcript is limited by the transcriptionist's typing speed and ability to understand the speech being transcribed.
- software-based automatic speech recognizers are often used to supplement or replace the role of the human transcriptionist in producing an initial transcript, even a transcript produced by a combination of human transcriptionist and automatic speech recognizer will contain errors. Any transcript that is produced, therefore, must be considered to be a draft, to which some form of error correction is to be applied.
- Producing a transcript is time-consuming for these and other reasons. For example, it may be desirable or necessary for certain kinds of transcripts (such as medical reports) to be stored and/or displayed in a particular format. Providing a transcript in an appropriate format typically requires some combination of human editing and automatic processing, which introduces an additional delay into the production of the final transcript.
- Speech is transcribed to produce a transcript. At least some of the text in the transcript is encoded as data. These codings may be verified for accuracy and corrected if inaccurate.
- the resulting transcript is provided to a decision support system to perform functions such as checking for drug-drug, drug-allergy, and drug-procedure interactions, and checking against clinical performance measures (such as recommended treatments). Alerts and other information output by the decision support system are associated with the transcript.
- the transcript and associated decision support output are provided to a physician to assist the physician in reviewing the transcript and in taking any appropriate action in response to the transcript.
- one embodiment of the present invention is a computer-implemented method comprising: (A) applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; (B) providing the first document to an automatic decision support system; (C) receiving, from the automatic decision support system, decision support output derived from the first document; and (D) transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is an apparatus comprising: speech recognition means for applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; document provision means for providing the first document to an automatic decision support system; output receiving means for receiving, from the automatic decision support system, decision support output derived from the first document; and document transmission means for transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is a computer-implemented method comprising: (A) applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; (B) applying a decision support method to the first document to produce decision support output; (C) storing a record associating the decision support output with the first document; and (D) transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is an apparatus comprising: speech recognition means for applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; decision support means for applying a decision support method to the first document to produce decision support output; record storage means for storing a record associating the decision support output with the first document; and document transmission means for transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is a computer-implemented method comprising: (A) receiving, from a remote location, a spoken audio stream; (B) applying an automatic speech recognizer to the spoken audio stream to produce a first document including first codings associated with text in the first document; (C) providing the first document to an automatic decision support system; (D) receiving, from the automatic decision support system, decision support output derived from the first document; and (E) transmitting, to a recipient, at the remote location, a second document, derived from the first document and the decision support output.
- Another embodiment of the present invention is an apparatus comprising: means for receiving, from a remote location, a spoken audio stream; means for applying an automatic speech recognizer to the spoken audio stream to produce a first document including first codings associated with text in the first document; means for providing the first document to an automatic decision support system; means for receiving, from the automatic decision support system, decision support output derived from the first document; and means for transmitting, to a recipient, at the remote location, a second document, derived from the first document and the decision support output.
- Another embodiment of the present invention is a computer-implemented method comprising: (A) receiving a first portion of a streamed spoken audio stream from an audio stream transmitter; (B) applying an automatic speech recognizer to the stream spoken audio stream to produce a first partial document including first codings associated with text in the first partial document; (C) providing the first partial document to an automatic decision support system; (D) receiving, from the automatic decision support system, decision support output derived from the first partial document; (E) determining whether the decision support output satisfies a predetermined criterion triggering human review; (F) if the decision support output is determined to satisfy the predetermined criterion, then transmitting to the audio stream transmitter, while receiving a second portion of the streamed spoken audio stream, an indication that the decision support output satisfies the predetermined criterion.
- Another embodiment of the present invention is an apparatus comprising: means for receiving a first portion of a streamed spoken audio stream from an audio stream transmitter; means for applying an automatic speech recognizer to the stream spoken audio stream to produce a first partial document including first codings associated with text in the first partial document; means for providing the first partial document to an automatic decision support system; means for receiving, from the automatic decision support system, decision support output derived from the first partial document; means for determining whether the decision support output satisfies a predetermined criterion triggering human review; and means for transmitting to the audio stream transmitter, while receiving a second portion of the streamed spoken audio stream, an indication that the decision support output satisfies the predetermined criterion if the decision support output is determined to satisfy the predetermined criterion.
- FIG. 1 is a dataflow diagram of a system for applying automatic clinical decision support to a transcript of speech
- FIG. 2 is a flowchart of a method performed by the system of FIG. 1 according to one embodiment of the present invention.
- Embodiments of the invention are directed to techniques for providing a transcript to a clinical decision support system for the purpose of attaching critical alerts and other information to the transcript for review by a physician.
- speech is transcribed to produce a report.
- At least some of the text in the transcript is encoded as data.
- the codings may be verified for accuracy and corrected if inaccurate.
- the resulting transcript is provided to a decision support system to perform functions such as checking for drug-drug, drug-allergy, and drug-procedure interactions, and checking against clinical performance measures (such as recommended treatments).
- Alerts and other information provided by the decision support system are associated with the transcript.
- the transcript and associated decision support output are provided to a physician for review and any other appropriate action in response to the decision support output.
- FIG. 1 a dataflow diagram is shown of a system 100 for applying automatic clinical decision support to a transcript of speech.
- FIG. 2 a flowchart is shown of a method 200 performed by the system 100 of FIG. 1 according to one embodiment of the present invention.
- a transcription system 104 transcribes a spoken audio stream 102 to produce a draft transcript 106 (step 202 ).
- the spoken audio stream 102 may, for example, be dictation by a doctor describing a patient visit.
- the spoken audio stream 102 may take any form. For example, it may be a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format.
- the transcription system 104 may produce the draft transcript 106 using, for example, an automated speech recognizer or a combination of an automated speech recognizer and human transcriptionist.
- the transcription system 104 may, for example, produce the draft transcript 106 using any of the techniques disclosed in the above-referenced patent application entitled “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech.”
- the draft transcript 106 may include text 116 that is either a literal (verbatim) transcript or a non-literal transcript of the spoken audio stream 102 .
- the draft transcript 106 may be a plain text document
- the draft transcript 106 may also, for example, in whole or in part be a structured document, such as an XML document which delineates document sections and other kinds of document structure.
- a structured document such as an XML document which delineates document sections and other kinds of document structure.
- the draft transcript 106 includes one or more codings 108 , each of which encodes a “concept” extracted from the spoken audio stream 102 .
- the term “concept” is used herein as defined in the above-referenced patent application entitled “Automated Extraction of Semantic content and Generation of a Structured Document from Speech.”
- Reference numeral 108 is used herein to refer generally to all of the codings within the draft transcript 106 . Although in FIG. 1 only two codings, designated 108 a and 108 b , are shown, the draft transcript 106 may include any number of codings.
- each of the codings 108 may, for example, encode an allergy, prescription, diagnosis, or prognosis.
- each of the codings 108 includes a code and corresponding data, which are not shown in FIG. 1 for ease of illustration.
- Each of the codings 108 may be linked to text in the transcript 106 .
- coding 108 a may be linked to text 118 a
- coding 108 b may be linked to text 118 b . Further details of embodiments of the codings 108 may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.”
- a coding verifier 120 may verify the codings 108 (step 204 ). Any of a variety of techniques may be used to verify the codings, examples of which may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.” The verification process performed by the coding verifier 120 may include correcting any codings that are found to be incorrect. The coding verifier 120 therefore produces a modified draft transcript 122 , which includes any corrections to the codings 108 or other modifications made by the coding verifier 120 (step 206 ). Note, however, that it is optional to verify the codings 108 .
- the modified draft transcript 122 is provided to a decision support engine 124 , which applies decision support methods 126 to the modified draft transcript 122 to produce decision support output 128 (step 208 ). If the codings 108 were not verified (e.g., if step 204 was not performed), then the original draft transcript 106 , instead of the modified draft transcript 122 , may be provided to the decision support engine 124 in step 208 to produce the decision support output 128 . In other words, the draft transcript 106 may be unverified when decision support is applied to it.
- An example of a decision support method is a method which checks for drug-drug, drug-allergy, and/or drug-procedure interactions.
- the decision support engine 124 may easily perform such a method because concepts such as drugs, allergies, and procedures have already been encoded in the modified draft transcript 122 in a form that is computer-readable. Therefore, the decision support engine 124 may use a database of drug-drug interactions, for example, to determine whether the modified draft transcript 122 describes any such interactions requiring attention of a physician.
- a decision support method is a method which checks concepts encoded in the modified draft transcript 122 against clinical performance measures (such as recommended treatments). For example, the American Heart Association (AHA) recommends that patients who have had a heart attack, unstable angina, or ischemic stroke take aspirin regularly. Therefore, one of the decision support methods 126 may determine whether the draft transcript 106 (or modified draft transcript 122 ) indicates that the dictating physician stated that the patient has experienced a heart attack, unstable angina, or ischemic stroke. If so, the decision support method may further determine whether the draft transcript 106 (or modified draft transcript 122 ) recommends (e.g., in the “recommended treatments” section) that the patient take aspirin.
- AHA American Heart Association
- the decision support method may alert the physician (through the decision support output 128 ) to this fact and suggest that the physician recommend aspirin to the patient.
- the decision support engine 124 may easily perform such a method because concepts such as the patient's medical history and recommended treatments have already been encoded in the transcripts 106 and 122 in a form that is computer-readable.
- the decision support engine 124 produces decision support output 128 .
- An example of such output is a critical alert indicating that the transcript 122 states that the patient has been prescribed two drugs which are contraindicated with each other.
- the decision support engine 124 may be configured to label different components of the output 128 with different priority levels. For example, the decision support engine 124 may label certain components of the output 128 as requiring immediate physician review, while labeling other components of the output 128 as requiring physician review, but not immediately. Alternatively, for example, the decision support engine 124 may filter the results it produces and include in the output 128 only those pieces of information which exceed a certain priority level (e.g., only those pieces of information requiring immediate physician review).
- a decision support output processor 130 may attach the decision support output 128 to the modified draft transcript 122 or otherwise associate the decision support output 128 with the modified draft transcript 122 (step 210 ). For example, in the embodiment shown in FIG. 1 , the decision support output processor 130 stores the decision support output 128 within the modified draft transcript 122 , thereby producing a processed draft transcript 132 containing the contents of both the modified draft transcript 122 and the decision support output 128 .
- decision support output processor 130 may use the decision support output 128 to modify the modified draft transcript 122 .
- the decision support output processor 130 may modify the code(s) for the contraindicated drug(s) in the transcript 122 so that the text corresponding to the drug(s) appears in boldface, in a conspicuous color (e.g., red), or in some other manner that calls attention to the text.
- the decision support output processor 130 may include in the transcript 122 a textual comment describing the drug-drug allergy such that the comment appears in the vicinity of the text when it is rendered.
- the processed draft transcript 132 (and the decision support output 128 , if it is not contained within the processed draft transcript 132 ) may be provided to a physician or other reviewer 138 for review.
- information derived from the processed draft transcript 132 and/or decision support output 128 may be provided to the reviewer 138 for review.
- the reviewer 138 may be the same person as the dictator of the spoken audio stream 102 .
- a renderer 134 may render the processed transcript 132 based on the decision support output 128 to produce a rendering 136 (step 212 ).
- the rendering 136 may display both the text of the transcript 132 and the output 128 .
- the rendering 136 may reflect the output 128 in a variety of ways, such as by using the output 128 to modify the manner in which the text of the transcript 132 is rendered.
- the rendering 136 may be a flat text document or other document which does not include the codings 108 a - b and other data which typically require an EMR and/or decision support system to process.
- the rendering 136 may be a Rich Text Format (RTF) or HTML document suitable for display by a conventional word processor or web browser.
- the renderer 134 may, for example, strip out the codings 108 a - b from the processed draft transcript 132 or otherwise process the draft transcript 132 to produce the rendering 136 in a format suitable for processing (e.g., displaying) without an on-site EMR and/or decision support system.
- the rendering 136 therefore, need not be directly or immediately displayed to the reviewer 138 .
- the renderer 134 may transmit the rendering 136 to the reviewer 138 electronically (e.g., by email, FTP, or HTTP), for subsequent viewing in any manner by the reviewer 138 .
- the reviewer 138 (e.g., physician) reviews the rendering 136 .
- the system 100 may include an approval mechanism (not shown) which enables the reviewer 138 to provide input indicating whether the reviewer 138 approves of the transcript 132 .
- the reviewer 138 is a physician
- the physician may be required to sign off on the transcript 132 , as represented by the rendering 136 .
- the use of the decision support output 128 in the process of producing the rendering 136 facilitates the process of reviewing the transcript 132 .
- the rendering 136 may display a conspicuous indication of such allergy, thereby increasing the likelihood that the physician-reviewer 138 will notice such an allergy and decreasing the time required for the physician-reviewer 138 to do so.
- Embodiments of the present invention have a variety of advantages.
- a physician typically dictates a report.
- the report is transcribed and the transcript is presented to the physician for review and signature.
- the physician must conclude that the report is accurate before signing it. If the physician's facility does not have an onsite EMR system and/or decision support system, then it may not be possible or feasible for decision support to be applied to the report before presenting it to the physician for signature. As a result, the physician must review and sign the report, thereby attesting to its accuracy, without the additional assurance of accuracy that a decision support system may provide.
- the techniques disclosed herein facilitate the process of applying decision support and other quality assurance measures to a draft report before providing the report to the physician for signature, i.e., while the report is still in its unsigned state.
- the techniques disclosed herein may be used both to increase the quality of signed reports and to reduce the amount of time required by physicians to review reports before signing.
- the techniques disclosed herein may be used to bring the benefits of automatic clinical decision support and other automated quality assurance measures to care providers who do not have an on-site Electronic Medical Record (EMR) system which is capable of consuming coded document formats.
- EMR Electronic Medical Record
- Such EMR systems are costly and therefore are not used by small clinics.
- Embodiments of the present invention do not require an on-site EMR system because all processing of encoded documents may be integrated into the transcription workflow and therefore performed by, for example, an outsourced transcription service at a remote location in relation to the clinic or other source organization.
- the dictator of speech 102 may, for example, transmit the spoken audio stream 102 to such a service at a remote location in any manner, such as by electronic transmission.
- the service may then perform method 200 ( FIG. 2 ) at an off-site location in relation to the dictator of speech 102 .
- the service may then transmit the processed draft transcript 132 , decision support output 128 , and/or the rendering 136 to the reviewer 138 in any manner, such as by any form of electronic transmission. If the reviewer 138 does not have an on-site EMR and/or decision support system, however, the service may provide the transcript 132 , decision support output 128 , and/or rendering 136 to the reviewer 138 in a flat text format or other format that does not require the reviewer 138 to have an on-site EMR or decision support system to process.
- the service may provide only the rendering 136 , and not the processed draft transcript 132 or decision support output 128 , to the reviewer 138 . Therefore, embodiments of the present invention may be used to provide the benefits of automatic clinical decision support systems to providers through medical transcription services without requiring deployment of EMR systems on the provider side.
- embodiments of the present invention use a human transcription workflow to enable automatic clinical decision support, disease management, and performance tracking.
- conventional transcription systems typically produce transcripts which are “flat” text documents, and which therefore are not suitable for acting as input to decision support processes.
- embodiments of the present invention produce transcripts including structured data which encode concepts such as allergies and medications, and which therefore may be processed easily by automatic decision support systems. Such embodiments may therefore be integrated with clinical decision support systems and provide the benefits of such systems quickly and easily.
- transcripts may be produced using embodiments of the present invention quickly and with a high degree of accuracy, thereby making such transcripts particularly suitable for use as input to automatic clinical decision support systems.
- the techniques disclosed herein do not require the entire spoken audio stream 102 to be spoken before clinical decision support may be applied to it.
- a physician dictates the spoken audio stream 102 into a handheld recording device, which streams the spoken audio stream 102 to the transcription system 104 while the physician is speaking the spoken audio stream 102 .
- the transcription system 104 may begin transcribing the beginning of the spoken audio stream 104 while the physician dictates subsequent portions of the spoken audio stream 102 , which continue to be streamed to the transcription system 104 .
- the draft transcript 104 As the draft transcript 104 is being produced, it may be processed by the remainder of the system 100 as described above with respect to FIGS. 1 and 2 .
- the decision support output 128 (e.g., in the form of the processed draft transcript 132 and/or the rendering 136 ) may be provided to the physician-reviewer 138 while the physician is still dictating the remainder of the spoken audio stream, i.e., before the entire spoken audio stream 102 has been transmitted to the transcription system 104 and before the entire draft transcript 106 has been produced.
- decision support output 128 may be provided to the dictating physician before the physician has finished dictating, thereby presenting the physician with an opportunity to correct any errors during a single dictation session and while the correct content of the session is still fresh in the physician's mind.
- the spoken audio stream 102 may be any audio stream, such as a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format.
- DSR distributed speech recognition
- a client performs preprocessing on an audio stream to produce a processed audio stream that is transmitted to a server, which performs speech recognition on the processed audio stream.
- the audio stream may, for example, be a processed audio stream produced by a DSR client.
- the invention is not limited to any of the described domains (such as the medical and legal fields), but generally applies to any kind of documents in any domain.
- the reviewer 138 may be described herein as a physician, this is not a limitation of the present invention. Rather, the reviewer 138 may be any person.
- documents used in conjunction with embodiments of the present invention may be represented in any machine-readable form. Such forms include plain text documents and structured documents represented in markup languages such as XML. Such documents may be stored in any computer-readable medium and transmitted using any kind of communications channel and protocol.
- the techniques disclosed herein may be applied to other forms of automated decision support based on transcripts containing structured text with encoded data.
- the techniques disclosed herein may be used to verify document completeness, such as whether the dictator of the transcript 106 mistakenly omitted a required section of the transcript 106 .
- the decision support engine 124 may include any mechanism, such as a software- or hardware-based mechanism, for applying automatic decision support to the modified draft transcript 122 . Although the decision support engine 124 may be described herein as applying automated methods, this does not preclude some degree of human interaction with the decision support engine 124 to perform its functions.
- the decision support engine 124 may receive inputs in addition to the modified draft transcript 122 to assist in providing decision support.
- a transcription service may produce multiple transcripts over time describing a single patient.
- the transcription service may build an archive of data about the patient, derived from data in the transcripts.
- the transcription service may identify that the new spoken audio stream refers to a patient for whom a data archive already exists.
- the transcription service may then provide not only the current draft transcript, but also some or all of the patient's data archive, to the decision support engine 124 .
- the decision support engine 124 may benefit from such additional data about the patient, such as medications previously prescribed to the patient, to detect drug-drug allergies or other problems which could not be detected from the current transcript in isolation.
- the techniques described above may be implemented, for example, in hardware, software, firmware, or any combination thereof.
- the techniques described above may be implemented in one or more computer programs executing on a programmable computer including a processor, a storage medium readable by the processor (including, for example, volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
- Program code may be applied to input entered using the input device to perform the functions described and to generate output.
- the output may be provided to one or more output devices.
- Each computer program within the scope of the claims below may be implemented in any programming language, such as assembly language, machine language, a high-level procedural programming language, or an object-oriented programming language.
- the programming language may, for example, be a compiled or interpreted programming language.
- Each such computer program may be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a computer processor.
- Method steps of the invention may be performed by a computer processor executing a program tangibly embodied on a computer-readable medium to perform functions of the invention by operating on input and generating output.
- Suitable processors include, by way of example, both general and special purpose microprocessors.
- the processor receives instructions and data from a read-only memory and/or a random access memory.
- Storage devices suitable for tangibly embodying computer program instructions include, for example, all forms of non-volatile memory, such as semiconductor memory devices, including EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROMs. Any of the foregoing may be supplemented by, or incorporated in, specially-designed ASICs (application-specific integrated circuits) or FPGAs (Field-Programmable Gate Arrays).
- a computer can generally also receive programs and data from a storage medium such as an internal disk (not shown) or a removable disk.
Abstract
Description
- This application claims the benefit of U.S. Prov. Pat. App. Ser. No. 60/815,689, filed on Jun. 22, 2006, entitled, “Verification of Extracted Facts”; U.S. Prov. Pat. App. Ser. No. 60/815,688, filed on Jun. 22, 2006, entitled, “Automatic Clinical Decision Support”; and U.S. Prov. Pat. App. Ser. No. 60/815/687, filed on Jun. 22, 2006, entitled, “Data Extraction Using Service Levels,” all of which are hereby incorporated by reference herein.
- This application is related to copending and commonly-owned U.S. patent application Ser. No. 10/923,517, filed on Aug. 20, 2004, entitled “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech,” which is hereby incorporated by reference herein.
- It is desirable in many contexts to generate a structured textual document based on human speech. In the legal profession, for example, transcriptionists transcribe testimony given in court proceedings and in depositions to produce a written transcript of the testimony. Similarly, in the medical profession, transcripts are produced of diagnoses, prognoses, prescriptions, and other information dictated by doctors and other medical professionals.
- Producing such transcripts can be time-consuming. For example, the speed with which a human transcriptionist can produce a transcript is limited by the transcriptionist's typing speed and ability to understand the speech being transcribed. Although software-based automatic speech recognizers are often used to supplement or replace the role of the human transcriptionist in producing an initial transcript, even a transcript produced by a combination of human transcriptionist and automatic speech recognizer will contain errors. Any transcript that is produced, therefore, must be considered to be a draft, to which some form of error correction is to be applied.
- Producing a transcript is time-consuming for these and other reasons. For example, it may be desirable or necessary for certain kinds of transcripts (such as medical reports) to be stored and/or displayed in a particular format. Providing a transcript in an appropriate format typically requires some combination of human editing and automatic processing, which introduces an additional delay into the production of the final transcript.
- Consumers of reports, such as doctors and radiologists in the medical context, often stand to benefit from receiving reports quickly. If a diagnosis depends on the availability of a certain report, for example, then the diagnosis cannot be provided until the required report is ready. For these and other reasons it is desirable to increase the speed with which transcripts and other kinds of reports derived from speech may be produced, without sacrificing accuracy.
- Furthermore, even when a report is provided quickly to its consumer, the consumer typically must read and interpret the report in order to decide on which action, if any, to take in response to the report. Performing such interpretation and making such decisions may be time-consuming and require significant training and skill. In the medical context, for example, it would be desirable to facilitate the process of acting on reports, particularly in time-critical situations.
- Speech is transcribed to produce a transcript. At least some of the text in the transcript is encoded as data. These codings may be verified for accuracy and corrected if inaccurate. The resulting transcript is provided to a decision support system to perform functions such as checking for drug-drug, drug-allergy, and drug-procedure interactions, and checking against clinical performance measures (such as recommended treatments). Alerts and other information output by the decision support system are associated with the transcript. The transcript and associated decision support output are provided to a physician to assist the physician in reviewing the transcript and in taking any appropriate action in response to the transcript.
- For example, one embodiment of the present invention is a computer-implemented method comprising: (A) applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; (B) providing the first document to an automatic decision support system; (C) receiving, from the automatic decision support system, decision support output derived from the first document; and (D) transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is an apparatus comprising: speech recognition means for applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; document provision means for providing the first document to an automatic decision support system; output receiving means for receiving, from the automatic decision support system, decision support output derived from the first document; and document transmission means for transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is a computer-implemented method comprising: (A) applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; (B) applying a decision support method to the first document to produce decision support output; (C) storing a record associating the decision support output with the first document; and (D) transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is an apparatus comprising: speech recognition means for applying an automatic speech recognizer to a spoken audio stream to produce a first document including first codings associated with text in the first document; decision support means for applying a decision support method to the first document to produce decision support output; record storage means for storing a record associating the decision support output with the first document; and document transmission means for transmitting to a recipient a second document, derived from the first document and the decision support output, wherein the second document does not include the first codings.
- Another embodiment of the present invention is a computer-implemented method comprising: (A) receiving, from a remote location, a spoken audio stream; (B) applying an automatic speech recognizer to the spoken audio stream to produce a first document including first codings associated with text in the first document; (C) providing the first document to an automatic decision support system; (D) receiving, from the automatic decision support system, decision support output derived from the first document; and (E) transmitting, to a recipient, at the remote location, a second document, derived from the first document and the decision support output.
- Another embodiment of the present invention is an apparatus comprising: means for receiving, from a remote location, a spoken audio stream; means for applying an automatic speech recognizer to the spoken audio stream to produce a first document including first codings associated with text in the first document; means for providing the first document to an automatic decision support system; means for receiving, from the automatic decision support system, decision support output derived from the first document; and means for transmitting, to a recipient, at the remote location, a second document, derived from the first document and the decision support output.
- Another embodiment of the present invention is a computer-implemented method comprising: (A) receiving a first portion of a streamed spoken audio stream from an audio stream transmitter; (B) applying an automatic speech recognizer to the stream spoken audio stream to produce a first partial document including first codings associated with text in the first partial document; (C) providing the first partial document to an automatic decision support system; (D) receiving, from the automatic decision support system, decision support output derived from the first partial document; (E) determining whether the decision support output satisfies a predetermined criterion triggering human review; (F) if the decision support output is determined to satisfy the predetermined criterion, then transmitting to the audio stream transmitter, while receiving a second portion of the streamed spoken audio stream, an indication that the decision support output satisfies the predetermined criterion.
- Another embodiment of the present invention is an apparatus comprising: means for receiving a first portion of a streamed spoken audio stream from an audio stream transmitter; means for applying an automatic speech recognizer to the stream spoken audio stream to produce a first partial document including first codings associated with text in the first partial document; means for providing the first partial document to an automatic decision support system; means for receiving, from the automatic decision support system, decision support output derived from the first partial document; means for determining whether the decision support output satisfies a predetermined criterion triggering human review; and means for transmitting to the audio stream transmitter, while receiving a second portion of the streamed spoken audio stream, an indication that the decision support output satisfies the predetermined criterion if the decision support output is determined to satisfy the predetermined criterion.
- Other features and advantages of various aspects and embodiments of the present invention will become apparent from the following description and from the claims.
-
FIG. 1 is a dataflow diagram of a system for applying automatic clinical decision support to a transcript of speech; and -
FIG. 2 is a flowchart of a method performed by the system ofFIG. 1 according to one embodiment of the present invention. - Embodiments of the invention are directed to techniques for providing a transcript to a clinical decision support system for the purpose of attaching critical alerts and other information to the transcript for review by a physician. In general, speech is transcribed to produce a report. At least some of the text in the transcript is encoded as data. The codings may be verified for accuracy and corrected if inaccurate. The resulting transcript is provided to a decision support system to perform functions such as checking for drug-drug, drug-allergy, and drug-procedure interactions, and checking against clinical performance measures (such as recommended treatments). Alerts and other information provided by the decision support system are associated with the transcript. The transcript and associated decision support output are provided to a physician for review and any other appropriate action in response to the decision support output.
- More specifically, referring to
FIG. 1 , a dataflow diagram is shown of asystem 100 for applying automatic clinical decision support to a transcript of speech. Referring toFIG. 2 , a flowchart is shown of amethod 200 performed by thesystem 100 ofFIG. 1 according to one embodiment of the present invention. - A
transcription system 104 transcribes a spokenaudio stream 102 to produce a draft transcript 106 (step 202). The spokenaudio stream 102 may, for example, be dictation by a doctor describing a patient visit. The spokenaudio stream 102 may take any form. For example, it may be a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format. - The
transcription system 104 may produce thedraft transcript 106 using, for example, an automated speech recognizer or a combination of an automated speech recognizer and human transcriptionist. Thetranscription system 104 may, for example, produce thedraft transcript 106 using any of the techniques disclosed in the above-referenced patent application entitled “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech.” As described therein, thedraft transcript 106 may includetext 116 that is either a literal (verbatim) transcript or a non-literal transcript of the spokenaudio stream 102. As further described therein, although thedraft transcript 106 may be a plain text document, thedraft transcript 106 may also, for example, in whole or in part be a structured document, such as an XML document which delineates document sections and other kinds of document structure. Various standards exist for encoding structured documents, and for annotating parts of the structured text with discrete facts (data) that are in some way related to the structured text. Examples of existing techniques for encoding medical documents include the HL7 CDA v2 XML standard (ANSI-approved since May 2005), SNOMED CT, LOINC, CPT, ICD-9 and ICD-10, and UMLS. - As shown in
FIG. 1 , thedraft transcript 106 includes one or more codings 108, each of which encodes a “concept” extracted from the spokenaudio stream 102. The term “concept” is used herein as defined in the above-referenced patent application entitled “Automated Extraction of Semantic content and Generation of a Structured Document from Speech.” Reference numeral 108 is used herein to refer generally to all of the codings within thedraft transcript 106. Although inFIG. 1 only two codings, designated 108 a and 108 b, are shown, thedraft transcript 106 may include any number of codings. - In the context of a medical report, each of the codings 108 may, for example, encode an allergy, prescription, diagnosis, or prognosis. In general, each of the codings 108 includes a code and corresponding data, which are not shown in
FIG. 1 for ease of illustration. Each of the codings 108 may be linked to text in thetranscript 106. For example, coding 108 a may be linked to text 118 a andcoding 108 b may be linked totext 118 b. Further details of embodiments of the codings 108 may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.” - A
coding verifier 120 may verify the codings 108 (step 204). Any of a variety of techniques may be used to verify the codings, examples of which may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.” The verification process performed by thecoding verifier 120 may include correcting any codings that are found to be incorrect. Thecoding verifier 120 therefore produces a modifieddraft transcript 122, which includes any corrections to the codings 108 or other modifications made by the coding verifier 120 (step 206). Note, however, that it is optional to verify the codings 108. - The modified
draft transcript 122 is provided to adecision support engine 124, which appliesdecision support methods 126 to the modifieddraft transcript 122 to produce decision support output 128 (step 208). If the codings 108 were not verified (e.g., ifstep 204 was not performed), then theoriginal draft transcript 106, instead of the modifieddraft transcript 122, may be provided to thedecision support engine 124 instep 208 to produce thedecision support output 128. In other words, thedraft transcript 106 may be unverified when decision support is applied to it. - An example of a decision support method is a method which checks for drug-drug, drug-allergy, and/or drug-procedure interactions. The
decision support engine 124 may easily perform such a method because concepts such as drugs, allergies, and procedures have already been encoded in the modifieddraft transcript 122 in a form that is computer-readable. Therefore, thedecision support engine 124 may use a database of drug-drug interactions, for example, to determine whether the modifieddraft transcript 122 describes any such interactions requiring attention of a physician. - Another example of a decision support method is a method which checks concepts encoded in the modified
draft transcript 122 against clinical performance measures (such as recommended treatments). For example, the American Heart Association (AHA) recommends that patients who have had a heart attack, unstable angina, or ischemic stroke take aspirin regularly. Therefore, one of thedecision support methods 126 may determine whether the draft transcript 106 (or modified draft transcript 122) indicates that the dictating physician stated that the patient has experienced a heart attack, unstable angina, or ischemic stroke. If so, the decision support method may further determine whether the draft transcript 106 (or modified draft transcript 122) recommends (e.g., in the “recommended treatments” section) that the patient take aspirin. If the decision support method determines that the patient has had one of the three indicated conditions and that the doctor did not recommend aspirin for the patient, then the decision support method may alert the physician (through the decision support output 128) to this fact and suggest that the physician recommend aspirin to the patient. Again, thedecision support engine 124 may easily perform such a method because concepts such as the patient's medical history and recommended treatments have already been encoded in thetranscripts - As stated above, the
decision support engine 124 producesdecision support output 128. An example of such output is a critical alert indicating that thetranscript 122 states that the patient has been prescribed two drugs which are contraindicated with each other. Thedecision support engine 124 may be configured to label different components of theoutput 128 with different priority levels. For example, thedecision support engine 124 may label certain components of theoutput 128 as requiring immediate physician review, while labeling other components of theoutput 128 as requiring physician review, but not immediately. Alternatively, for example, thedecision support engine 124 may filter the results it produces and include in theoutput 128 only those pieces of information which exceed a certain priority level (e.g., only those pieces of information requiring immediate physician review). - A decision
support output processor 130 may attach thedecision support output 128 to the modifieddraft transcript 122 or otherwise associate thedecision support output 128 with the modified draft transcript 122 (step 210). For example, in the embodiment shown inFIG. 1 , the decisionsupport output processor 130 stores thedecision support output 128 within the modifieddraft transcript 122, thereby producing a processed draft transcript 132 containing the contents of both the modifieddraft transcript 122 and thedecision support output 128. - As another example, decision
support output processor 130 may use thedecision support output 128 to modify the modifieddraft transcript 122. For example, if thedecision support output 128 indicates a drug-drug allergy, the decisionsupport output processor 130 may modify the code(s) for the contraindicated drug(s) in thetranscript 122 so that the text corresponding to the drug(s) appears in boldface, in a conspicuous color (e.g., red), or in some other manner that calls attention to the text. As another example, the decisionsupport output processor 130 may include in the transcript 122 a textual comment describing the drug-drug allergy such that the comment appears in the vicinity of the text when it is rendered. - The processed draft transcript 132 (and the
decision support output 128, if it is not contained within the processed draft transcript 132) may be provided to a physician orother reviewer 138 for review. Alternatively, for example, information derived from the processed draft transcript 132 and/ordecision support output 128 may be provided to thereviewer 138 for review. Thereviewer 138 may be the same person as the dictator of the spokenaudio stream 102. - For example, a
renderer 134 may render the processed transcript 132 based on thedecision support output 128 to produce a rendering 136 (step 212). Therendering 136 may display both the text of the transcript 132 and theoutput 128. As described above, therendering 136 may reflect theoutput 128 in a variety of ways, such as by using theoutput 128 to modify the manner in which the text of the transcript 132 is rendered. - For example, the
rendering 136 may be a flat text document or other document which does not include the codings 108 a-b and other data which typically require an EMR and/or decision support system to process. For example, therendering 136 may be a Rich Text Format (RTF) or HTML document suitable for display by a conventional word processor or web browser. Therenderer 134 may, for example, strip out the codings 108 a-b from the processed draft transcript 132 or otherwise process the draft transcript 132 to produce therendering 136 in a format suitable for processing (e.g., displaying) without an on-site EMR and/or decision support system. Therendering 136, therefore, need not be directly or immediately displayed to thereviewer 138. For example, therenderer 134 may transmit therendering 136 to thereviewer 138 electronically (e.g., by email, FTP, or HTTP), for subsequent viewing in any manner by thereviewer 138. - The reviewer 138 (e.g., physician) reviews the
rendering 136. Thesystem 100 may include an approval mechanism (not shown) which enables thereviewer 138 to provide input indicating whether thereviewer 138 approves of the transcript 132. In the medical context, for example, if thereviewer 138 is a physician, the physician may be required to sign off on the transcript 132, as represented by therendering 136. The use of thedecision support output 128 in the process of producing therendering 136 facilitates the process of reviewing the transcript 132. For example, if theoutput 128 indicates that thetranscript 122 describes a particular drug-drug allergy, then therendering 136 may display a conspicuous indication of such allergy, thereby increasing the likelihood that the physician-reviewer 138 will notice such an allergy and decreasing the time required for the physician-reviewer 138 to do so. - Embodiments of the present invention have a variety of advantages. For example, in conventional systems, a physician typically dictates a report. The report is transcribed and the transcript is presented to the physician for review and signature. The physician must conclude that the report is accurate before signing it. If the physician's facility does not have an onsite EMR system and/or decision support system, then it may not be possible or feasible for decision support to be applied to the report before presenting it to the physician for signature. As a result, the physician must review and sign the report, thereby attesting to its accuracy, without the additional assurance of accuracy that a decision support system may provide.
- In contrast, the techniques disclosed herein facilitate the process of applying decision support and other quality assurance measures to a draft report before providing the report to the physician for signature, i.e., while the report is still in its unsigned state. As a result, the techniques disclosed herein may be used both to increase the quality of signed reports and to reduce the amount of time required by physicians to review reports before signing.
- In particular, the techniques disclosed herein may be used to bring the benefits of automatic clinical decision support and other automated quality assurance measures to care providers who do not have an on-site Electronic Medical Record (EMR) system which is capable of consuming coded document formats. Such EMR systems are costly and therefore are not used by small clinics. Embodiments of the present invention do not require an on-site EMR system because all processing of encoded documents may be integrated into the transcription workflow and therefore performed by, for example, an outsourced transcription service at a remote location in relation to the clinic or other source organization. The dictator of
speech 102 may, for example, transmit the spokenaudio stream 102 to such a service at a remote location in any manner, such as by electronic transmission. - The service may then perform method 200 (
FIG. 2 ) at an off-site location in relation to the dictator ofspeech 102. The service may then transmit the processed draft transcript 132,decision support output 128, and/or therendering 136 to thereviewer 138 in any manner, such as by any form of electronic transmission. If thereviewer 138 does not have an on-site EMR and/or decision support system, however, the service may provide the transcript 132,decision support output 128, and/orrendering 136 to thereviewer 138 in a flat text format or other format that does not require thereviewer 138 to have an on-site EMR or decision support system to process. For example, the service may provide only therendering 136, and not the processed draft transcript 132 ordecision support output 128, to thereviewer 138. Therefore, embodiments of the present invention may be used to provide the benefits of automatic clinical decision support systems to providers through medical transcription services without requiring deployment of EMR systems on the provider side. - More generally, embodiments of the present invention use a human transcription workflow to enable automatic clinical decision support, disease management, and performance tracking. As described above, conventional transcription systems typically produce transcripts which are “flat” text documents, and which therefore are not suitable for acting as input to decision support processes. In contrast, embodiments of the present invention produce transcripts including structured data which encode concepts such as allergies and medications, and which therefore may be processed easily by automatic decision support systems. Such embodiments may therefore be integrated with clinical decision support systems and provide the benefits of such systems quickly and easily.
- It is difficult or impossible to use flat text transcripts in this way because a decision support system would need first to interpret such text to apply decision support methods to it. Any attempt to use human intervention and/or natural language processing to perform such interpretation will suffer from the slow turnaround times and relatively high error rates associated with such techniques. In contrast, and as described in more detail in the above-referenced patent applications, transcripts may be produced using embodiments of the present invention quickly and with a high degree of accuracy, thereby making such transcripts particularly suitable for use as input to automatic clinical decision support systems.
- Even in cases in which the
system 100 ofFIG. 1 is implemented in conjunction with an outsourced transcription service, the techniques disclosed herein do not require the entire spokenaudio stream 102 to be spoken before clinical decision support may be applied to it. For example, consider a case in which a physician dictates the spokenaudio stream 102 into a handheld recording device, which streams the spokenaudio stream 102 to thetranscription system 104 while the physician is speaking the spokenaudio stream 102. Thetranscription system 104 may begin transcribing the beginning of the spokenaudio stream 104 while the physician dictates subsequent portions of the spokenaudio stream 102, which continue to be streamed to thetranscription system 104. As thedraft transcript 104 is being produced, it may be processed by the remainder of thesystem 100 as described above with respect toFIGS. 1 and 2 . - As a result, if the
decision support system 124 identifies a problem (such as a drug-drug allergy) requiring physician review, the decision support output 128 (e.g., in the form of the processed draft transcript 132 and/or the rendering 136) may be provided to the physician-reviewer 138 while the physician is still dictating the remainder of the spoken audio stream, i.e., before the entire spokenaudio stream 102 has been transmitted to thetranscription system 104 and before theentire draft transcript 106 has been produced. One benefit of such real-time application of decision support to the spokenaudio stream 102 is that thedecision support output 128 may be provided to the dictating physician before the physician has finished dictating, thereby presenting the physician with an opportunity to correct any errors during a single dictation session and while the correct content of the session is still fresh in the physician's mind. - It is to be understood that although the invention has been described above in terms of particular embodiments, the foregoing embodiments are provided as illustrative only, and do not limit or define the scope of the invention. Various other embodiments, including but not limited to the following, are also within the scope of the claims. For example, elements and components described herein may be further divided into additional components or joined together to form fewer components for performing the same functions.
- Although certain examples provided herein involve documents generated by a speech recognizer, this is not a requirement of the present invention. Rather, the techniques disclosed herein may be applied to any kind of document, regardless of how it was generated. Such techniques may, for example, be used in conjunction with documents typed using conventional text editors.
- The spoken
audio stream 102 may be any audio stream, such as a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format. In distributed speech recognition (DSR), a client performs preprocessing on an audio stream to produce a processed audio stream that is transmitted to a server, which performs speech recognition on the processed audio stream. The audio stream may, for example, be a processed audio stream produced by a DSR client. - The invention is not limited to any of the described domains (such as the medical and legal fields), but generally applies to any kind of documents in any domain. For example, although the
reviewer 138 may be described herein as a physician, this is not a limitation of the present invention. Rather, thereviewer 138 may be any person. Furthermore, documents used in conjunction with embodiments of the present invention may be represented in any machine-readable form. Such forms include plain text documents and structured documents represented in markup languages such as XML. Such documents may be stored in any computer-readable medium and transmitted using any kind of communications channel and protocol. - Furthermore, although particular examples are described herein in conjunction with clinical decision support, this is not a limitation of the present invention. Rather, the techniques disclosed herein may be applied to other forms of automated decision support based on transcripts containing structured text with encoded data. For example, the techniques disclosed herein may be used to verify document completeness, such as whether the dictator of the
transcript 106 mistakenly omitted a required section of thetranscript 106. - The
decision support engine 124 may include any mechanism, such as a software- or hardware-based mechanism, for applying automatic decision support to the modifieddraft transcript 122. Although thedecision support engine 124 may be described herein as applying automated methods, this does not preclude some degree of human interaction with thedecision support engine 124 to perform its functions. - Furthermore, the
decision support engine 124 may receive inputs in addition to the modifieddraft transcript 122 to assist in providing decision support. For example, a transcription service may produce multiple transcripts over time describing a single patient. In the course of producing such transcripts, the transcription service may build an archive of data about the patient, derived from data in the transcripts. Then, when the transcription service receives a new spoken audio stream for transcription, the transcription service may identify that the new spoken audio stream refers to a patient for whom a data archive already exists. The transcription service may then provide not only the current draft transcript, but also some or all of the patient's data archive, to thedecision support engine 124. Thedecision support engine 124 may benefit from such additional data about the patient, such as medications previously prescribed to the patient, to detect drug-drug allergies or other problems which could not be detected from the current transcript in isolation. - The techniques described above may be implemented, for example, in hardware, software, firmware, or any combination thereof. The techniques described above may be implemented in one or more computer programs executing on a programmable computer including a processor, a storage medium readable by the processor (including, for example, volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Program code may be applied to input entered using the input device to perform the functions described and to generate output. The output may be provided to one or more output devices.
- Each computer program within the scope of the claims below may be implemented in any programming language, such as assembly language, machine language, a high-level procedural programming language, or an object-oriented programming language. The programming language may, for example, be a compiled or interpreted programming language.
- Each such computer program may be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a computer processor. Method steps of the invention may be performed by a computer processor executing a program tangibly embodied on a computer-readable medium to perform functions of the invention by operating on input and generating output. Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, the processor receives instructions and data from a read-only memory and/or a random access memory. Storage devices suitable for tangibly embodying computer program instructions include, for example, all forms of non-volatile memory, such as semiconductor memory devices, including EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROMs. Any of the foregoing may be supplemented by, or incorporated in, specially-designed ASICs (application-specific integrated circuits) or FPGAs (Field-Programmable Gate Arrays). A computer can generally also receive programs and data from a storage medium such as an internal disk (not shown) or a removable disk. These elements will also be found in a conventional desktop or workstation computer as well as other computers suitable for executing computer programs implementing the methods described herein, which may be used in conjunction with any digital print engine or marking engine, display monitor, or other raster output device capable of producing color or gray scale pixels on paper, film, display screen, or other output medium.
Claims (26)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/766,780 US20070299665A1 (en) | 2006-06-22 | 2007-06-21 | Automatic Decision Support |
US13/888,290 US9892734B2 (en) | 2006-06-22 | 2013-05-06 | Automatic decision support |
US15/892,876 US10339937B2 (en) | 2006-06-22 | 2018-02-09 | Automatic decision support |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US81568806P | 2006-06-22 | 2006-06-22 | |
US81568706P | 2006-06-22 | 2006-06-22 | |
US81568906P | 2006-06-22 | 2006-06-22 | |
US11/766,780 US20070299665A1 (en) | 2006-06-22 | 2007-06-21 | Automatic Decision Support |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/888,290 Continuation US9892734B2 (en) | 2006-06-22 | 2013-05-06 | Automatic decision support |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070299665A1 true US20070299665A1 (en) | 2007-12-27 |
Family
ID=38834406
Family Applications (10)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/766,780 Abandoned US20070299665A1 (en) | 2006-06-22 | 2007-06-21 | Automatic Decision Support |
US11/766,784 Active 2030-12-26 US8560314B2 (en) | 2006-06-22 | 2007-06-21 | Applying service levels to transcripts |
US11/766,767 Active US7716040B2 (en) | 2006-06-22 | 2007-06-21 | Verification of extracted data |
US12/771,193 Active US8321199B2 (en) | 2006-06-22 | 2010-04-30 | Verification of extracted data |
US13/563,949 Active US8521514B2 (en) | 2006-06-22 | 2012-08-01 | Verification of extracted data |
US13/888,290 Expired - Fee Related US9892734B2 (en) | 2006-06-22 | 2013-05-06 | Automatic decision support |
US13/975,833 Active US8768694B2 (en) | 2006-06-22 | 2013-08-26 | Verification of extracted data |
US14/052,005 Abandoned US20140039880A1 (en) | 2006-06-22 | 2013-10-11 | Applying Service Levels to Transcripts |
US14/317,323 Abandoned US20140316772A1 (en) | 2006-06-22 | 2014-06-27 | Verification of Extracted Data |
US15/892,876 Active US10339937B2 (en) | 2006-06-22 | 2018-02-09 | Automatic decision support |
Family Applications After (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/766,784 Active 2030-12-26 US8560314B2 (en) | 2006-06-22 | 2007-06-21 | Applying service levels to transcripts |
US11/766,767 Active US7716040B2 (en) | 2006-06-22 | 2007-06-21 | Verification of extracted data |
US12/771,193 Active US8321199B2 (en) | 2006-06-22 | 2010-04-30 | Verification of extracted data |
US13/563,949 Active US8521514B2 (en) | 2006-06-22 | 2012-08-01 | Verification of extracted data |
US13/888,290 Expired - Fee Related US9892734B2 (en) | 2006-06-22 | 2013-05-06 | Automatic decision support |
US13/975,833 Active US8768694B2 (en) | 2006-06-22 | 2013-08-26 | Verification of extracted data |
US14/052,005 Abandoned US20140039880A1 (en) | 2006-06-22 | 2013-10-11 | Applying Service Levels to Transcripts |
US14/317,323 Abandoned US20140316772A1 (en) | 2006-06-22 | 2014-06-27 | Verification of Extracted Data |
US15/892,876 Active US10339937B2 (en) | 2006-06-22 | 2018-02-09 | Automatic decision support |
Country Status (5)
Country | Link |
---|---|
US (10) | US20070299665A1 (en) |
EP (3) | EP2030196B1 (en) |
JP (4) | JP5167256B2 (en) |
CA (3) | CA2652444C (en) |
WO (3) | WO2007150005A2 (en) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060041427A1 (en) * | 2004-08-20 | 2006-02-23 | Girija Yegnanarayanan | Document transcription system training |
US20060190263A1 (en) * | 2005-02-23 | 2006-08-24 | Michael Finke | Audio signal de-identification |
US20080177623A1 (en) * | 2007-01-24 | 2008-07-24 | Juergen Fritsch | Monitoring User Interactions With A Document Editing System |
US20100318347A1 (en) * | 2005-07-22 | 2010-12-16 | Kjell Schubert | Content-Based Audio Playback Emphasis |
US8321199B2 (en) | 2006-06-22 | 2012-11-27 | Multimodal Technologies, Llc | Verification of extracted data |
WO2012177662A1 (en) | 2011-06-19 | 2012-12-27 | Mmodal Ip Llc | Document extension in dictation-based document generation workflow |
US8504372B2 (en) | 2008-08-29 | 2013-08-06 | Mmodal Ip Llc | Distributed speech recognition using one way communication |
US8666742B2 (en) | 2005-11-08 | 2014-03-04 | Mmodal Ip Llc | Automatic detection and application of editing patterns in draft documents |
US8959102B2 (en) | 2010-10-08 | 2015-02-17 | Mmodal Ip Llc | Structured searching of dynamic structured document corpuses |
US20150279354A1 (en) * | 2010-05-19 | 2015-10-01 | Google Inc. | Personalization and Latency Reduction for Voice-Activated Commands |
US9761226B2 (en) | 2008-10-27 | 2017-09-12 | Mmodal Ip Llc | Synchronized transcription rules handling |
US9865025B2 (en) | 2011-11-28 | 2018-01-09 | Peter Ragusa | Electronic health record system and method for patient encounter transcription and documentation |
US20180204645A1 (en) * | 2017-01-17 | 2018-07-19 | Mmodal Ip Llc | Methods and systems for manifestation and transmission of follow-up notifications |
US10032127B2 (en) | 2011-02-18 | 2018-07-24 | Nuance Communications, Inc. | Methods and apparatus for determining a clinician's intent to order an item |
US20190258704A1 (en) * | 2018-02-20 | 2019-08-22 | Dropbox, Inc. | Automated outline generation of captured meeting audio in a collaborative document context |
US10657954B2 (en) | 2018-02-20 | 2020-05-19 | Dropbox, Inc. | Meeting audio capture and transcription in a collaborative document context |
US10950329B2 (en) | 2015-03-13 | 2021-03-16 | Mmodal Ip Llc | Hybrid human and computer-assisted coding workflow |
US11037665B2 (en) | 2018-01-11 | 2021-06-15 | International Business Machines Corporation | Generating medication orders from a clinical encounter |
US11282596B2 (en) | 2017-11-22 | 2022-03-22 | 3M Innovative Properties Company | Automated code feedback system |
US11488602B2 (en) | 2018-02-20 | 2022-11-01 | Dropbox, Inc. | Meeting transcription using custom lexicons based on document history |
US11689379B2 (en) | 2019-06-24 | 2023-06-27 | Dropbox, Inc. | Generating customized meeting insights based on user interactions and meeting media |
Families Citing this family (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004049192A2 (en) | 2002-11-28 | 2004-06-10 | Koninklijke Philips Electronics N.V. | Method to assign word class information |
US9710819B2 (en) * | 2003-05-05 | 2017-07-18 | Interactions Llc | Real-time transcription system utilizing divided audio chunks |
US20130304453A9 (en) * | 2004-08-20 | 2013-11-14 | Juergen Fritsch | Automated Extraction of Semantic Content and Generation of a Structured Document from Speech |
US7584103B2 (en) * | 2004-08-20 | 2009-09-01 | Multimodal Technologies, Inc. | Automated extraction of semantic content and generation of a structured document from speech |
US8348839B2 (en) | 2007-04-10 | 2013-01-08 | General Electric Company | Systems and methods for active listening/observing and event detection |
US20100145720A1 (en) * | 2008-12-05 | 2010-06-10 | Bruce Reiner | Method of extracting real-time structured data and performing data analysis and decision support in medical reporting |
EP2534591A4 (en) | 2010-02-10 | 2013-07-17 | Mmodal Ip Llc | Providing computable guidance to relevant evidence in question-answering systems |
US20110282687A1 (en) * | 2010-02-26 | 2011-11-17 | Detlef Koll | Clinical Data Reconciliation as Part of a Report Generation Solution |
US9613325B2 (en) * | 2010-06-30 | 2017-04-04 | Zeus Data Solutions | Diagnosis-driven electronic charting |
US8630842B2 (en) * | 2010-06-30 | 2014-01-14 | Zeus Data Solutions | Computerized selection for healthcare services |
US20220398270A1 (en) * | 2010-09-01 | 2022-12-15 | Apixio, Inc. | Systems and methods for customized annotation of medical information |
US8463673B2 (en) | 2010-09-23 | 2013-06-11 | Mmodal Ip Llc | User feedback in semi-automatic question answering systems |
US8924394B2 (en) | 2011-02-18 | 2014-12-30 | Mmodal Ip Llc | Computer-assisted abstraction for reporting of quality measures |
US10460288B2 (en) | 2011-02-18 | 2019-10-29 | Nuance Communications, Inc. | Methods and apparatus for identifying unspecified diagnoses in clinical documentation |
US8768723B2 (en) | 2011-02-18 | 2014-07-01 | Nuance Communications, Inc. | Methods and apparatus for formatting text for clinical fact extraction |
US9904768B2 (en) | 2011-02-18 | 2018-02-27 | Nuance Communications, Inc. | Methods and apparatus for presenting alternative hypotheses for medical facts |
US9286035B2 (en) | 2011-06-30 | 2016-03-15 | Infosys Limited | Code remediation |
US9021565B2 (en) * | 2011-10-13 | 2015-04-28 | At&T Intellectual Property I, L.P. | Authentication techniques utilizing a computing device |
US9569594B2 (en) | 2012-03-08 | 2017-02-14 | Nuance Communications, Inc. | Methods and apparatus for generating clinical reports |
US9679077B2 (en) * | 2012-06-29 | 2017-06-13 | Mmodal Ip Llc | Automated clinical evidence sheet workflow |
CA2881564A1 (en) | 2012-08-13 | 2014-02-20 | Mmodal Ip Llc | Maintaining a discrete data representation that corresponds to information contained in free-form text |
US9710431B2 (en) * | 2012-08-18 | 2017-07-18 | Health Fidelity, Inc. | Systems and methods for processing patient information |
US11024406B2 (en) | 2013-03-12 | 2021-06-01 | Nuance Communications, Inc. | Systems and methods for identifying errors and/or critical results in medical reports |
CN103198220A (en) * | 2013-04-08 | 2013-07-10 | 浙江大学医学院附属第二医院 | Computer-aided antibacterial agent clinical application mid-diagnosis decision making system |
US9154617B2 (en) * | 2013-04-19 | 2015-10-06 | International Business Machines Corporation | Recording and playing back portions of a telephone call |
US11183300B2 (en) * | 2013-06-05 | 2021-11-23 | Nuance Communications, Inc. | Methods and apparatus for providing guidance to medical professionals |
US10496743B2 (en) | 2013-06-26 | 2019-12-03 | Nuance Communications, Inc. | Methods and apparatus for extracting facts from a medical text |
US20150121456A1 (en) * | 2013-10-25 | 2015-04-30 | International Business Machines Corporation | Exploiting trust level lifecycle events for master data to publish security events updating identity management |
US10324966B2 (en) | 2014-03-21 | 2019-06-18 | Mmodal Ip Llc | Search by example |
US10373711B2 (en) | 2014-06-04 | 2019-08-06 | Nuance Communications, Inc. | Medical coding system with CDI clarification request notification |
US11152084B2 (en) * | 2016-01-13 | 2021-10-19 | Nuance Communications, Inc. | Medical report coding with acronym/abbreviation disambiguation |
US10043135B2 (en) * | 2016-03-08 | 2018-08-07 | InferLink Corporation | Textual information extraction, parsing, and inferential analysis |
EP3223179A1 (en) * | 2016-03-24 | 2017-09-27 | Fujitsu Limited | A healthcare risk extraction system and method |
US10860685B2 (en) * | 2016-11-28 | 2020-12-08 | Google Llc | Generating structured text content using speech recognition models |
US11158411B2 (en) | 2017-02-18 | 2021-10-26 | 3M Innovative Properties Company | Computer-automated scribe tools |
US20180315428A1 (en) * | 2017-04-27 | 2018-11-01 | 3Play Media, Inc. | Efficient transcription systems and methods |
EP3648032A1 (en) * | 2017-06-29 | 2020-05-06 | Bizocean Co., Ltd. | Information inputting method, information inputting device, and information inputting system |
US11055481B2 (en) | 2017-06-29 | 2021-07-06 | Spalo Co., Ltd. | Information input method, information input apparatus, and information input system |
US11133091B2 (en) | 2017-07-21 | 2021-09-28 | Nuance Communications, Inc. | Automated analysis system and method |
US11024424B2 (en) * | 2017-10-27 | 2021-06-01 | Nuance Communications, Inc. | Computer assisted coding systems and methods |
US11782967B2 (en) | 2017-11-13 | 2023-10-10 | International Business Machines Corporation | Determining user interactions with natural language processor (NPL) items in documents to determine priorities to present NPL items in documents to review |
US11222056B2 (en) * | 2017-11-13 | 2022-01-11 | International Business Machines Corporation | Gathering information on user interactions with natural language processor (NLP) items to order presentation of NLP items in documents |
US10387576B2 (en) * | 2017-11-30 | 2019-08-20 | International Business Machines Corporation | Document preparation with argumentation support from a deep question answering system |
WO2019169242A1 (en) * | 2018-03-02 | 2019-09-06 | Mmodal Ip Llc | Automated diagnostic support system for clinical documentation workflows |
US11461801B2 (en) * | 2018-03-02 | 2022-10-04 | Adobe Inc. | Detecting and resolving semantic misalignments between digital messages and external digital content |
US11670291B1 (en) * | 2019-02-22 | 2023-06-06 | Suki AI, Inc. | Systems, methods, and storage media for providing an interface for textual editing through speech |
US11341204B2 (en) | 2019-05-22 | 2022-05-24 | Adobe Inc. | Identifying and presenting misalignments between digital messages and external digital content |
US20210241773A1 (en) * | 2020-02-04 | 2021-08-05 | Frank Appiah | Voice recording & label making system |
US11830586B2 (en) | 2020-12-08 | 2023-11-28 | Kyndryl, Inc. | Enhancement of patient outcome forecasting |
US20220383874A1 (en) | 2021-05-28 | 2022-12-01 | 3M Innovative Properties Company | Documentation system based on dynamic semantic templates |
US20230317225A1 (en) * | 2022-03-29 | 2023-10-05 | ScribeAmerica, LLC | Platform and interfaces for clinical services |
CN115082045B (en) * | 2022-08-22 | 2023-01-03 | 深圳译码阁科技有限公司 | Data proofreading method and device, computer equipment and storage medium |
Citations (91)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5384892A (en) * | 1992-12-31 | 1995-01-24 | Apple Computer, Inc. | Dynamic language model for speech recognition |
US5434962A (en) * | 1990-09-07 | 1995-07-18 | Fuji Xerox Co., Ltd. | Method and system for automatically generating logical structures of electronic documents |
US5526407A (en) * | 1991-09-30 | 1996-06-11 | Riverrun Technology | Method and apparatus for managing information |
US5594638A (en) * | 1993-12-29 | 1997-01-14 | First Opinion Corporation | Computerized medical diagnostic system including re-enter function and sensitivity factors |
US5669007A (en) * | 1994-06-16 | 1997-09-16 | International Business Machines Corporation | Method and system for analyzing the logical structure of a document |
US5701469A (en) * | 1995-06-07 | 1997-12-23 | Microsoft Corporation | Method and system for generating accurate search results using a content-index |
US5797123A (en) * | 1996-10-01 | 1998-08-18 | Lucent Technologies Inc. | Method of key-phase detection and verification for flexible speech understanding |
US5809476A (en) * | 1994-03-23 | 1998-09-15 | Ryan; John Kevin | System for converting medical information into representative abbreviated codes with correction capability |
US5823948A (en) * | 1996-07-08 | 1998-10-20 | Rlis, Inc. | Medical records, documentation, tracking and order entry system |
US5835893A (en) * | 1996-02-15 | 1998-11-10 | Atr Interpreting Telecommunications Research Labs | Class-based word clustering for speech recognition using a three-level balanced hierarchical similarity |
US5839106A (en) * | 1996-12-17 | 1998-11-17 | Apple Computer, Inc. | Large-vocabulary speech recognition using an integrated syntactic and semantic statistical language model |
US5870706A (en) * | 1996-04-10 | 1999-02-09 | Lucent Technologies, Inc. | Method and apparatus for an improved language recognition system |
US5926784A (en) * | 1997-07-17 | 1999-07-20 | Microsoft Corporation | Method and system for natural language parsing using podding |
US5970449A (en) * | 1997-04-03 | 1999-10-19 | Microsoft Corporation | Text normalization using a context-free grammar |
US5983187A (en) * | 1995-12-15 | 1999-11-09 | Hewlett-Packard Company | Speech data storage organizing system using form field indicators |
US5995936A (en) * | 1997-02-04 | 1999-11-30 | Brais; Louis | Report generation system and method for capturing prose, audio, and video by voice command and automatically linking sound and image to formatted text locations |
US6041292A (en) * | 1996-01-16 | 2000-03-21 | Jochim; Carol | Real time stenographic system utilizing vowel omission principle |
US6055494A (en) * | 1996-10-28 | 2000-04-25 | The Trustees Of Columbia University In The City Of New York | System and method for medical language extraction and encoding |
US6061675A (en) * | 1995-05-31 | 2000-05-09 | Oracle Corporation | Methods and apparatus for classifying terminology utilizing a knowledge catalog |
US6112168A (en) * | 1997-10-20 | 2000-08-29 | Microsoft Corporation | Automatically recognizing the discourse structure of a body of text |
US6122614A (en) * | 1998-11-20 | 2000-09-19 | Custom Speech Usa, Inc. | System and method for automating transcription services |
US6122613A (en) * | 1997-01-30 | 2000-09-19 | Dragon Systems, Inc. | Speech recognition using multiple recognizers (selectively) applied to the same input sample |
US6154722A (en) * | 1997-12-18 | 2000-11-28 | Apple Computer, Inc. | Method and apparatus for a speech recognition system language model that integrates a finite state grammar probability and an N-gram probability |
US6182039B1 (en) * | 1998-03-24 | 2001-01-30 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus using probabilistic language model based on confusable sets for speech recognition |
US6243669B1 (en) * | 1999-01-29 | 2001-06-05 | Sony Corporation | Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation |
US6249765B1 (en) * | 1998-12-22 | 2001-06-19 | Xerox Corporation | System and method for extracting data from audio messages |
US6278968B1 (en) * | 1999-01-29 | 2001-08-21 | Sony Corporation | Method and apparatus for adaptive speech recognition hypothesis construction and selection in a spoken language translation system |
US6292771B1 (en) * | 1997-09-30 | 2001-09-18 | Ihc Health Services, Inc. | Probabilistic method for natural language processing and for encoding free-text data into a medical database by utilizing a Bayesian network to perform spell checking of words |
US6304870B1 (en) * | 1997-12-02 | 2001-10-16 | The Board Of Regents Of The University Of Washington, Office Of Technology Transfer | Method and apparatus of automatically generating a procedure for extracting information from textual information sources |
US6345249B1 (en) * | 1999-07-07 | 2002-02-05 | International Business Machines Corp. | Automatic analysis of a speech dictated document |
US6405165B1 (en) * | 1998-03-05 | 2002-06-11 | Siemens Aktiengesellschaft | Medical workstation for treating a patient with a voice recording arrangement for preparing a physician's report during treatment |
US20020087315A1 (en) * | 2000-12-29 | 2002-07-04 | Lee Victor Wai Leung | Computer-implemented multi-scanning language method and system |
US20020087311A1 (en) * | 2000-12-29 | 2002-07-04 | Leung Lee Victor Wai | Computer-implemented dynamic language model generation method and system |
US20020099717A1 (en) * | 2001-01-24 | 2002-07-25 | Gordon Bennett | Method for report generation in an on-line transcription system |
US6434547B1 (en) * | 1999-10-28 | 2002-08-13 | Qenm.Com | Data capture and verification system |
US6435849B1 (en) * | 2000-09-15 | 2002-08-20 | Paul L. Guilmette | Fluid pump |
US20020123891A1 (en) * | 2001-03-01 | 2002-09-05 | International Business Machines Corporation | Hierarchical language models |
US6490561B1 (en) * | 1997-06-25 | 2002-12-03 | Dennis L. Wilson | Continuous speech voice transcription |
US6526380B1 (en) * | 1999-03-26 | 2003-02-25 | Koninklijke Philips Electronics N.V. | Speech recognition system having parallel large vocabulary recognition engines |
US20030065503A1 (en) * | 2001-09-28 | 2003-04-03 | Philips Electronics North America Corp. | Multi-lingual transcription system |
US20030069760A1 (en) * | 2001-10-04 | 2003-04-10 | Arthur Gelber | System and method for processing and pre-adjudicating patient benefit claims |
US20030093272A1 (en) * | 1999-12-02 | 2003-05-15 | Frederic Soufflet | Speech operated automatic inquiry system |
US20030101054A1 (en) * | 2001-11-27 | 2003-05-29 | Ncc, Llc | Integrated system and method for electronic speech recognition and transcription |
US20030144885A1 (en) * | 2002-01-29 | 2003-07-31 | Exscribe, Inc. | Medical examination and transcription method, and associated apparatus |
US6609087B1 (en) * | 1999-04-28 | 2003-08-19 | Genuity Inc. | Fact recognition system |
US20030167266A1 (en) * | 2001-01-08 | 2003-09-04 | Alexander Saldanha | Creation of structured data from plain text |
US20030181790A1 (en) * | 2000-05-18 | 2003-09-25 | Daniel David | Methods and apparatus for facilitated, hierarchical medical diagnosis and symptom coding and definition |
US20030191627A1 (en) * | 1998-05-28 | 2003-10-09 | Lawrence Au | Topological methods to organize semantic network data flows for conversational applications |
US6662168B1 (en) * | 2000-05-19 | 2003-12-09 | International Business Machines Corporation | Coding system for high data volume |
US6684188B1 (en) * | 1996-02-02 | 2004-01-27 | Geoffrey C Mitchell | Method for production of medical records and other technical documents |
US20040019482A1 (en) * | 2002-04-19 | 2004-01-29 | Holub John M. | Speech to text system using controlled vocabulary indices |
US20040030688A1 (en) * | 2000-05-31 | 2004-02-12 | International Business Machines Corporation | Information search using knowledge agents |
US20040030704A1 (en) * | 2000-11-07 | 2004-02-12 | Stefanchik Michael F. | System for the creation of database and structured information from verbal input |
US20040030556A1 (en) * | 1999-11-12 | 2004-02-12 | Bennett Ian M. | Speech based learning/training system using semantic decoding |
US20040064317A1 (en) * | 2002-09-26 | 2004-04-01 | Konstantin Othmer | System and method for online transcription services |
US20040078215A1 (en) * | 2000-11-22 | 2004-04-22 | Recare, Inc. | Systems and methods for documenting medical findings of a physical examination |
US20040102957A1 (en) * | 2002-11-22 | 2004-05-27 | Levin Robert E. | System and method for speech translation using remote devices |
US20040117189A1 (en) * | 1999-11-12 | 2004-06-17 | Bennett Ian M. | Query engine for processing voice based queries including semantic decoding |
US20040148170A1 (en) * | 2003-01-23 | 2004-07-29 | Alejandro Acero | Statistical classifiers for spoken language understanding and command/control scenarios |
US6785651B1 (en) * | 2000-09-14 | 2004-08-31 | Microsoft Corporation | Method and apparatus for performing plan-based dialog |
US20050065774A1 (en) * | 2003-09-20 | 2005-03-24 | International Business Machines Corporation | Method of self enhancement of search results through analysis of system logs |
US20050086056A1 (en) * | 2003-09-25 | 2005-04-21 | Fuji Photo Film Co., Ltd. | Voice recognition system and program |
US20050091059A1 (en) * | 2003-08-29 | 2005-04-28 | Microsoft Corporation | Assisted multi-modal dialogue |
US6915254B1 (en) * | 1998-07-30 | 2005-07-05 | A-Life Medical, Inc. | Automatically assigning medical codes using natural language processing |
US20050154690A1 (en) * | 2002-02-04 | 2005-07-14 | Celestar Lexico-Sciences, Inc | Document knowledge management apparatus and method |
US20050234891A1 (en) * | 2004-03-15 | 2005-10-20 | Yahoo! Inc. | Search systems and methods with integration of user annotations |
US20050240439A1 (en) * | 2004-04-15 | 2005-10-27 | Artificial Medical Intelligence, Inc, | System and method for automatic assignment of medical codes to unformatted data |
US20060007188A1 (en) * | 2004-07-09 | 2006-01-12 | Gesturerad, Inc. | Gesture-based reporting method and system |
US20060041428A1 (en) * | 2004-08-20 | 2006-02-23 | Juergen Fritsch | Automated extraction of semantic content and generation of a structured document from speech |
US20060074656A1 (en) * | 2004-08-20 | 2006-04-06 | Lambert Mathias | Discriminative training of document transcription system |
US7028038B1 (en) * | 2002-07-03 | 2006-04-11 | Mayo Foundation For Medical Education And Research | Method for generating training data for medical text abbreviation and acronym normalization |
US7031908B1 (en) * | 2000-06-01 | 2006-04-18 | Microsoft Corporation | Creating a language model for a language processing system |
US20060190263A1 (en) * | 2005-02-23 | 2006-08-24 | Michael Finke | Audio signal de-identification |
US7197460B1 (en) * | 2002-04-23 | 2007-03-27 | At&T Corp. | System for handling frequently asked questions in a natural language dialog service |
US7216073B2 (en) * | 2001-03-13 | 2007-05-08 | Intelligate, Ltd. | Dynamic natural language understanding |
US20070179777A1 (en) * | 2005-12-22 | 2007-08-02 | Rakesh Gupta | Automatic Grammar Generation Using Distributedly Collected Knowledge |
US20070226211A1 (en) * | 2006-03-27 | 2007-09-27 | Heinze Daniel T | Auditing the Coding and Abstracting of Documents |
US20070288212A1 (en) * | 2002-08-19 | 2007-12-13 | General Electric Company | System And Method For Optimizing Simulation Of A Discrete Event Process Using Business System Data |
US20080059232A1 (en) * | 1997-03-13 | 2008-03-06 | Clinical Decision Support, Llc | Disease management system and method including question version |
US20080168343A1 (en) * | 2007-01-05 | 2008-07-10 | Doganata Yurdaer N | System and Method of Automatically Mapping a Given Annotator to an Aggregate of Given Annotators |
US20090055168A1 (en) * | 2007-08-23 | 2009-02-26 | Google Inc. | Word Detection |
US7519529B1 (en) * | 2001-06-29 | 2009-04-14 | Microsoft Corporation | System and methods for inferring informational goals and preferred level of detail of results in response to questions posed to an automated information-retrieval or question-answering service |
US7555425B2 (en) * | 2001-10-18 | 2009-06-30 | Oon Yeong K | System and method of improved recording of medical transactions |
US20090228126A1 (en) * | 2001-03-09 | 2009-09-10 | Steven Spielberg | Method and apparatus for annotating a line-based document |
US20090228299A1 (en) * | 2005-11-09 | 2009-09-10 | The Regents Of The University Of California | Methods and apparatus for context-sensitive telemedicine |
US7610192B1 (en) * | 2006-03-22 | 2009-10-27 | Patrick William Jamieson | Process and system for high precision coding of free text documents against a standard lexicon |
US20100076761A1 (en) * | 2008-09-25 | 2010-03-25 | Fritsch Juergen | Decoding-Time Prediction of Non-Verbalized Tokens |
US7716040B2 (en) * | 2006-06-22 | 2010-05-11 | Multimodal Technologies, Inc. | Verification of extracted data |
US20100185685A1 (en) * | 2009-01-13 | 2010-07-22 | Chew Peter A | Technique for Information Retrieval Using Enhanced Latent Semantic Analysis |
US20100299135A1 (en) * | 2004-08-20 | 2010-11-25 | Juergen Fritsch | Automated Extraction of Semantic Content and Generation of a Structured Document from Speech |
US7869998B1 (en) * | 2002-04-23 | 2011-01-11 | At&T Intellectual Property Ii, L.P. | Voice-enabled dialog system |
Family Cites Families (126)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS62221775A (en) | 1986-03-20 | 1987-09-29 | Fujitsu Ltd | Natural language processing system |
US5329609A (en) | 1990-07-31 | 1994-07-12 | Fujitsu Limited | Recognition apparatus with function of displaying plural recognition candidates |
JPH0769921B2 (en) | 1990-11-09 | 1995-07-31 | 株式会社日立製作所 | Document logical structure generation method |
JPH06168267A (en) | 1992-11-30 | 1994-06-14 | Itec:Kk | Structural document preparing method and structural document preparation supporting device |
CA2151371A1 (en) | 1992-12-31 | 1994-07-21 | Yen-Lu Chow | Recursive finite state grammar |
US7631343B1 (en) * | 1993-03-24 | 2009-12-08 | Endgate LLC | Down-line transcription system using automatic tracking and revenue collection |
US6206829B1 (en) * | 1996-07-12 | 2001-03-27 | First Opinion Corporation | Computerized medical diagnostic and treatment advice system including network access |
JPH07325597A (en) * | 1994-05-31 | 1995-12-12 | Fuji Xerox Co Ltd | Information input method and device for executing its method |
US5664109A (en) | 1995-06-07 | 1997-09-02 | E-Systems, Inc. | Method for extracting pre-defined data items from medical service records generated by health care providers |
JPH09106428A (en) * | 1995-10-11 | 1997-04-22 | Kitsusei Comtec Kk | Finding preparing device |
EP0912957B1 (en) * | 1996-07-12 | 2004-12-08 | First Opinion Corporation | Computerized medical diagnostic and treatment advice system including network access |
US6182029B1 (en) * | 1996-10-28 | 2001-01-30 | The Trustees Of Columbia University In The City Of New York | System and method for language extraction and encoding utilizing the parsing of text data in accordance with domain parameters |
US6126596A (en) | 1997-06-02 | 2000-10-03 | Freedman; Joshua | Apparatus and method for evaluating a client's condition and the concordance of a clinician's treatment with treatment guidelines |
EP0903727A1 (en) | 1997-09-17 | 1999-03-24 | Istituto Trentino Di Cultura | A system and method for automatic speech recognition |
US6006183A (en) * | 1997-12-16 | 1999-12-21 | International Business Machines Corp. | Speech recognition confidence level display |
US6782510B1 (en) * | 1998-01-27 | 2004-08-24 | John N. Gross | Word checking tool for controlling the language content in documents using dictionaries with modifyable status fields |
US7043426B2 (en) * | 1998-04-01 | 2006-05-09 | Cyberpulse, L.L.C. | Structured speech recognition |
US6304848B1 (en) * | 1998-08-13 | 2001-10-16 | Medical Manager Corp. | Medical record forming and storing apparatus and medical record and method related to same |
US6064965A (en) * | 1998-09-02 | 2000-05-16 | International Business Machines Corporation | Combined audio playback in speech recognition proofreader |
US6064961A (en) * | 1998-09-02 | 2000-05-16 | International Business Machines Corporation | Display for proofreading text |
WO2000054180A1 (en) | 1999-03-05 | 2000-09-14 | Cai Co., Ltd. | System and method for creating formatted document on the basis of conversational speech recognition |
JP2000259175A (en) | 1999-03-08 | 2000-09-22 | Mitsubishi Electric Corp | Voice recognition device |
US6611802B2 (en) * | 1999-06-11 | 2003-08-26 | International Business Machines Corporation | Method and system for proofreading and correcting dictated text |
US7475019B2 (en) * | 1999-11-18 | 2009-01-06 | Visicu, Inc. | System and method for physician note creation and management |
US6865258B1 (en) * | 1999-08-13 | 2005-03-08 | Intervoice Limited Partnership | Method and system for enhanced transcription |
US20030195774A1 (en) | 1999-08-30 | 2003-10-16 | Abbo Fred E. | Medical practice management system |
US6963837B1 (en) * | 1999-10-06 | 2005-11-08 | Multimodal Technologies, Inc. | Attribute-based word modeling |
US6535849B1 (en) | 2000-01-18 | 2003-03-18 | Scansoft, Inc. | Method and system for generating semi-literal transcripts for speech recognition systems |
NZ520461A (en) * | 2000-02-14 | 2005-03-24 | First Opinion Corp | Automated diagnostic system and method |
JP3896760B2 (en) * | 2000-03-28 | 2007-03-22 | 富士ゼロックス株式会社 | Dialog record editing apparatus, method, and storage medium |
US6738784B1 (en) * | 2000-04-06 | 2004-05-18 | Dictaphone Corporation | Document and information processing system |
US6912498B2 (en) * | 2000-05-02 | 2005-06-28 | Scansoft, Inc. | Error correction in speech recognition by correcting text around selected area |
US7447988B2 (en) | 2000-05-10 | 2008-11-04 | Ross Gary E | Augmentation system for documentation |
GB0011798D0 (en) * | 2000-05-16 | 2000-07-05 | Canon Kk | Database annotation and retrieval |
AU2001268293A1 (en) * | 2000-06-12 | 2001-12-24 | L And H Holdings Usa, Inc. | Using utterance-level confidence estimates |
US7490092B2 (en) * | 2000-07-06 | 2009-02-10 | Streamsage, Inc. | Method and system for indexing and searching timed media information based upon relevance intervals |
WO2002009492A1 (en) * | 2000-07-31 | 2002-02-07 | Reallegal.Com | Transcript management software and methods therefor |
JP4108948B2 (en) | 2000-09-25 | 2008-06-25 | 富士通株式会社 | Apparatus and method for viewing a plurality of documents |
US6937983B2 (en) * | 2000-12-20 | 2005-08-30 | International Business Machines Corporation | Method and system for semantic speech recognition |
US20020077833A1 (en) * | 2000-12-20 | 2002-06-20 | Arons Barry M. | Transcription and reporting system |
US20020156817A1 (en) * | 2001-02-22 | 2002-10-24 | Volantia, Inc. | System and method for extracting information |
US7346521B2 (en) * | 2001-03-05 | 2008-03-18 | Ims Health Incorporated | System and methods for generating physician profiles concerning prescription therapy practices |
JP2002272990A (en) | 2001-03-21 | 2002-09-24 | Heiwa Corp | Pattern display method for game machine |
US6834264B2 (en) * | 2001-03-29 | 2004-12-21 | Provox Technologies Corporation | Method and apparatus for voice dictation and document production |
US20020147616A1 (en) | 2001-04-05 | 2002-10-10 | Mdeverywhere, Inc. | Method and apparatus for introducing medical necessity policy into the clinical decision making process at the point of care |
US7188064B2 (en) * | 2001-04-13 | 2007-03-06 | University Of Texas System Board Of Regents | System and method for automatic semantic coding of free response data using Hidden Markov Model methodology |
US6973428B2 (en) * | 2001-05-24 | 2005-12-06 | International Business Machines Corporation | System and method for searching, analyzing and displaying text transcripts of speech after imperfect speech recognition |
JP2003022091A (en) | 2001-07-10 | 2003-01-24 | Nippon Hoso Kyokai <Nhk> | Method, device, and program for voice recognition |
DE10138408A1 (en) * | 2001-08-04 | 2003-02-20 | Philips Corp Intellectual Pty | Method for assisting the proofreading of a speech-recognized text with a reproduction speed curve adapted to the recognition reliability |
JP2003058559A (en) | 2001-08-17 | 2003-02-28 | Hitachi Ltd | Document classification method, retrieval method, classification system, and retrieval system |
US7529685B2 (en) * | 2001-08-28 | 2009-05-05 | Md Datacor, Inc. | System, method, and apparatus for storing, retrieving, and integrating clinical, diagnostic, genomic, and therapeutic data |
WO2003030069A1 (en) * | 2001-10-03 | 2003-04-10 | Mdoffices.Com, Inc. | Health care management method and system |
JP4434536B2 (en) * | 2001-10-10 | 2010-03-17 | 株式会社東芝 | Electronic medical record system |
US6708148B2 (en) * | 2001-10-12 | 2004-03-16 | Koninklijke Philips Electronics N.V. | Correction device to mark parts of a recognized text |
US20030083903A1 (en) | 2001-10-30 | 2003-05-01 | Myers Gene E. | Method and apparatus for contemporaneous billing and documenting with rendered services |
DE60211197T2 (en) * | 2001-10-31 | 2007-05-03 | Koninklijke Philips Electronics N.V. | METHOD AND DEVICE FOR THE CONVERSION OF SPANISHED TEXTS AND CORRECTION OF THE KNOWN TEXTS |
US20030105638A1 (en) * | 2001-11-27 | 2003-06-05 | Taira Rick K. | Method and system for creating computer-understandable structured medical data from natural language reports |
JP2003202895A (en) | 2002-01-10 | 2003-07-18 | Sony Corp | Interaction device and interaction control method, storage medium, and computer program |
US20030154085A1 (en) * | 2002-02-08 | 2003-08-14 | Onevoice Medical Corporation | Interactive knowledge base system |
US20030163348A1 (en) * | 2002-02-27 | 2003-08-28 | Stead William W. | Method and system for clinical action support |
US7716072B1 (en) * | 2002-04-19 | 2010-05-11 | Greenway Medical Technologies, Inc. | Integrated medical software system |
US20110301982A1 (en) * | 2002-04-19 | 2011-12-08 | Green Jr W T | Integrated medical software system with clinical decision support |
US8738396B2 (en) * | 2002-04-19 | 2014-05-27 | Greenway Medical Technologies, Inc. | Integrated medical software system with embedded transcription functionality |
US7292975B2 (en) * | 2002-05-01 | 2007-11-06 | Nuance Communications, Inc. | Systems and methods for evaluating speaker suitability for automatic speech recognition aided transcription |
US7548847B2 (en) * | 2002-05-10 | 2009-06-16 | Microsoft Corporation | System for automatically annotating training data for a natural language understanding system |
US20040073458A1 (en) | 2002-07-31 | 2004-04-15 | Aviacode Inc. | Method and system for processing medical records |
US20060041836A1 (en) * | 2002-09-12 | 2006-02-23 | Gordon T J | Information documenting system with improved speed, completeness, retriveability and granularity |
US8606594B2 (en) | 2002-10-29 | 2013-12-10 | Practice Velocity, LLC | Method and system for automated medical records processing |
WO2004051432A2 (en) | 2002-12-03 | 2004-06-17 | Siemens Medical Solutions Usa, Inc. | Systems and methods for automated extraction and processing of billing information in patient records |
US7444285B2 (en) * | 2002-12-06 | 2008-10-28 | 3M Innovative Properties Company | Method and system for sequential insertion of speech recognition results to facilitate deferred transcription services |
US7774694B2 (en) * | 2002-12-06 | 2010-08-10 | 3M Innovation Properties Company | Method and system for server-based sequential insertion processing of speech recognition results |
JP4415546B2 (en) | 2003-01-06 | 2010-02-17 | 三菱電機株式会社 | Spoken dialogue processing apparatus and program thereof |
JP4249534B2 (en) | 2003-01-15 | 2009-04-02 | 株式会社京三製作所 | Data processing apparatus, data verification method, and data verification program |
US7958443B2 (en) * | 2003-02-28 | 2011-06-07 | Dictaphone Corporation | System and method for structuring speech recognized text into a pre-selected document format |
WO2004088635A1 (en) * | 2003-03-31 | 2004-10-14 | Koninklijke Philips Electronics N.V. | System for correction of speech recognition results with confidence level indication |
US20040243545A1 (en) * | 2003-05-29 | 2004-12-02 | Dictaphone Corporation | Systems and methods utilizing natural language medical records |
US8095544B2 (en) * | 2003-05-30 | 2012-01-10 | Dictaphone Corporation | Method, system, and apparatus for validation |
US20070174041A1 (en) * | 2003-05-01 | 2007-07-26 | Ryan Yeske | Method and system for concept generation and management |
US7383172B1 (en) * | 2003-08-15 | 2008-06-03 | Patrick William Jamieson | Process and system for semantically recognizing, correcting, and suggesting domain specific speech |
US20050120300A1 (en) * | 2003-09-25 | 2005-06-02 | Dictaphone Corporation | Method, system, and apparatus for assembly, transport and display of clinical data |
US7860717B2 (en) * | 2003-09-25 | 2010-12-28 | Dictaphone Corporation | System and method for customizing speech recognition input and output |
JP4495431B2 (en) * | 2003-09-26 | 2010-07-07 | 株式会社湯山製作所 | ICD code assigning apparatus and method |
US20050144184A1 (en) * | 2003-10-01 | 2005-06-30 | Dictaphone Corporation | System and method for document section segmentation |
US7996223B2 (en) * | 2003-10-01 | 2011-08-09 | Dictaphone Corporation | System and method for post processing speech recognition output |
US20050102140A1 (en) * | 2003-11-12 | 2005-05-12 | Joel Davne | Method and system for real-time transcription and correction using an electronic communication environment |
JP2005149083A (en) | 2003-11-14 | 2005-06-09 | Hitachi Medical Corp | Electronic medical record input support apparatus |
US20050137910A1 (en) | 2003-12-19 | 2005-06-23 | Rao R. B. | Systems and methods for automated extraction and processing of billing information in patient records |
US7542971B2 (en) * | 2004-02-02 | 2009-06-02 | Fuji Xerox Co., Ltd. | Systems and methods for collaborative note-taking |
JP2005267358A (en) * | 2004-03-19 | 2005-09-29 | Hitachi Medical Corp | Electronic medical charge formation/management system for local health care, and operation method thereof |
JP2005284834A (en) * | 2004-03-30 | 2005-10-13 | Toshiba Corp | Document input system, document input program, recording medium with document input program recorded, and document input method |
US7379946B2 (en) * | 2004-03-31 | 2008-05-27 | Dictaphone Corporation | Categorization of information using natural language processing and predefined templates |
US20050273365A1 (en) * | 2004-06-04 | 2005-12-08 | Agfa Corporation | Generalized approach to structured medical reporting |
US20050288930A1 (en) * | 2004-06-09 | 2005-12-29 | Vaastek, Inc. | Computer voice recognition apparatus and method |
JP4653976B2 (en) | 2004-07-09 | 2011-03-16 | Hoya株式会社 | camera |
US20060020886A1 (en) * | 2004-07-15 | 2006-01-26 | Agrawal Subodh K | System and method for the structured capture of information and the generation of semantically rich reports |
US20060020466A1 (en) * | 2004-07-26 | 2006-01-26 | Cousineau Leo E | Ontology based medical patient evaluation method for data capture and knowledge representation |
US20060020492A1 (en) * | 2004-07-26 | 2006-01-26 | Cousineau Leo E | Ontology based medical system for automatically generating healthcare billing codes from a patient encounter |
GB2432704B (en) * | 2004-07-30 | 2009-12-09 | Dictaphone Corp | A system and method for report level confidence |
KR20060016933A (en) | 2004-08-19 | 2006-02-23 | 함정우 | Apparatus and method for classification document |
US7844464B2 (en) * | 2005-07-22 | 2010-11-30 | Multimodal Technologies, Inc. | Content-based audio playback emphasis |
US7650628B2 (en) * | 2004-10-21 | 2010-01-19 | Escription, Inc. | Transcription data security |
US8756234B1 (en) * | 2004-11-16 | 2014-06-17 | The General Hospital Corporation | Information theory entropy reduction program |
US20060129435A1 (en) * | 2004-12-15 | 2006-06-15 | Critical Connection Inc. | System and method for providing community health data services |
US20060161460A1 (en) | 2004-12-15 | 2006-07-20 | Critical Connection Inc. | System and method for a graphical user interface for healthcare data |
JP2006302057A (en) * | 2005-04-22 | 2006-11-02 | Gifu Univ | Medical audio information processing apparatus and medical audio information processing program |
US7849048B2 (en) | 2005-07-05 | 2010-12-07 | Clarabridge, Inc. | System and method of making unstructured data available to structured data analysis tools |
CA2630962A1 (en) * | 2005-07-27 | 2007-02-01 | Medecision, Inc. | System and method for health care data integration and management |
US20070043761A1 (en) | 2005-08-22 | 2007-02-22 | The Personal Bee, Inc. | Semantic discovery engine |
US7640158B2 (en) * | 2005-11-08 | 2009-12-29 | Multimodal Technologies, Inc. | Automatic detection and application of editing patterns in draft documents |
US8233751B2 (en) * | 2006-04-10 | 2012-07-31 | Patel Nilesh V | Method and system for simplified recordkeeping including transcription and voting based verification |
US8121838B2 (en) * | 2006-04-11 | 2012-02-21 | Nuance Communications, Inc. | Method and system for automatic transcription prioritization |
WO2007120904A2 (en) * | 2006-04-14 | 2007-10-25 | Fuzzmed, Inc. | System, method, and device for personal medical care, intelligent analysis, and diagnosis |
US20070282640A1 (en) * | 2006-05-26 | 2007-12-06 | Allmed Resources Llc | Healthcare information accessibility and processing system |
US7844470B2 (en) * | 2006-07-25 | 2010-11-30 | Siemens Medical Solutions Usa, Inc. | Treatment order processing system suitable for pharmacy and other use |
WO2008064358A2 (en) * | 2006-11-22 | 2008-05-29 | Multimodal Technologies, Inc. | Recognition of speech in editable audio streams |
US20080228769A1 (en) | 2007-03-15 | 2008-09-18 | Siemens Medical Solutions Usa, Inc. | Medical Entity Extraction From Patient Data |
US7383183B1 (en) | 2007-09-25 | 2008-06-03 | Medquist Inc. | Methods and systems for protecting private information during transcription |
AU2008312423B2 (en) | 2007-10-17 | 2013-12-19 | Vcvc Iii Llc | NLP-based content recommender |
US20090192822A1 (en) | 2007-11-05 | 2009-07-30 | Medquist Inc. | Methods and computer program products for natural language processing framework to assist in the evaluation of medical care |
US7933777B2 (en) * | 2008-08-29 | 2011-04-26 | Multimodal Technologies, Inc. | Hybrid speech recognition |
WO2010117424A2 (en) | 2009-03-31 | 2010-10-14 | Medquist Ip, Llc | Computer-assisted abstraction of data and document coding |
WO2010132790A1 (en) | 2009-05-14 | 2010-11-18 | Collexis Holdings, Inc. | Methods and systems for knowledge discovery |
US20110173153A1 (en) | 2010-01-08 | 2011-07-14 | Vertafore, Inc. | Method and apparatus to import unstructured content into a content management system |
US8959102B2 (en) | 2010-10-08 | 2015-02-17 | Mmodal Ip Llc | Structured searching of dynamic structured document corpuses |
US8924394B2 (en) | 2011-02-18 | 2014-12-30 | Mmodal Ip Llc | Computer-assisted abstraction for reporting of quality measures |
US9471878B2 (en) | 2014-07-11 | 2016-10-18 | International Business Machines Corporation | Dynamic mathematical validation using data mining |
-
2007
- 2007-06-21 WO PCT/US2007/071837 patent/WO2007150005A2/en active Application Filing
- 2007-06-21 US US11/766,780 patent/US20070299665A1/en not_active Abandoned
- 2007-06-21 EP EP07784506.3A patent/EP2030196B1/en active Active
- 2007-06-21 US US11/766,784 patent/US8560314B2/en active Active
- 2007-06-21 WO PCT/US2007/071838 patent/WO2007150006A2/en active Application Filing
- 2007-06-21 CA CA2652444A patent/CA2652444C/en not_active Expired - Fee Related
- 2007-06-21 WO PCT/US2007/071836 patent/WO2007150004A2/en active Application Filing
- 2007-06-21 US US11/766,767 patent/US7716040B2/en active Active
- 2007-06-21 EP EP07784508.9A patent/EP2030198B1/en active Active
- 2007-06-21 JP JP2009516737A patent/JP5167256B2/en active Active
- 2007-06-21 CA CA2650816A patent/CA2650816C/en active Active
- 2007-06-21 JP JP2009516738A patent/JP5385134B2/en not_active Expired - Fee Related
- 2007-06-21 EP EP07784507A patent/EP2030197A4/en not_active Ceased
- 2007-06-21 CA CA2652441A patent/CA2652441C/en active Active
- 2007-06-21 JP JP2009516739A patent/JP2009541800A/en active Pending
-
2010
- 2010-04-30 US US12/771,193 patent/US8321199B2/en active Active
-
2012
- 2012-08-01 US US13/563,949 patent/US8521514B2/en active Active
-
2013
- 2013-05-06 US US13/888,290 patent/US9892734B2/en not_active Expired - Fee Related
- 2013-08-26 US US13/975,833 patent/US8768694B2/en active Active
- 2013-10-11 US US14/052,005 patent/US20140039880A1/en not_active Abandoned
-
2014
- 2014-06-24 JP JP2014128942A patent/JP5964358B2/en not_active Expired - Fee Related
- 2014-06-27 US US14/317,323 patent/US20140316772A1/en not_active Abandoned
-
2018
- 2018-02-09 US US15/892,876 patent/US10339937B2/en active Active
Patent Citations (99)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5434962A (en) * | 1990-09-07 | 1995-07-18 | Fuji Xerox Co., Ltd. | Method and system for automatically generating logical structures of electronic documents |
US5526407A (en) * | 1991-09-30 | 1996-06-11 | Riverrun Technology | Method and apparatus for managing information |
US5384892A (en) * | 1992-12-31 | 1995-01-24 | Apple Computer, Inc. | Dynamic language model for speech recognition |
US5594638A (en) * | 1993-12-29 | 1997-01-14 | First Opinion Corporation | Computerized medical diagnostic system including re-enter function and sensitivity factors |
US5809476A (en) * | 1994-03-23 | 1998-09-15 | Ryan; John Kevin | System for converting medical information into representative abbreviated codes with correction capability |
US5669007A (en) * | 1994-06-16 | 1997-09-16 | International Business Machines Corporation | Method and system for analyzing the logical structure of a document |
US6061675A (en) * | 1995-05-31 | 2000-05-09 | Oracle Corporation | Methods and apparatus for classifying terminology utilizing a knowledge catalog |
US5701469A (en) * | 1995-06-07 | 1997-12-23 | Microsoft Corporation | Method and system for generating accurate search results using a content-index |
US5983187A (en) * | 1995-12-15 | 1999-11-09 | Hewlett-Packard Company | Speech data storage organizing system using form field indicators |
US6041292A (en) * | 1996-01-16 | 2000-03-21 | Jochim; Carol | Real time stenographic system utilizing vowel omission principle |
US6684188B1 (en) * | 1996-02-02 | 2004-01-27 | Geoffrey C Mitchell | Method for production of medical records and other technical documents |
US5835893A (en) * | 1996-02-15 | 1998-11-10 | Atr Interpreting Telecommunications Research Labs | Class-based word clustering for speech recognition using a three-level balanced hierarchical similarity |
US5870706A (en) * | 1996-04-10 | 1999-02-09 | Lucent Technologies, Inc. | Method and apparatus for an improved language recognition system |
US5823948A (en) * | 1996-07-08 | 1998-10-20 | Rlis, Inc. | Medical records, documentation, tracking and order entry system |
US5797123A (en) * | 1996-10-01 | 1998-08-18 | Lucent Technologies Inc. | Method of key-phase detection and verification for flexible speech understanding |
US6055494A (en) * | 1996-10-28 | 2000-04-25 | The Trustees Of Columbia University In The City Of New York | System and method for medical language extraction and encoding |
US5839106A (en) * | 1996-12-17 | 1998-11-17 | Apple Computer, Inc. | Large-vocabulary speech recognition using an integrated syntactic and semantic statistical language model |
US6122613A (en) * | 1997-01-30 | 2000-09-19 | Dragon Systems, Inc. | Speech recognition using multiple recognizers (selectively) applied to the same input sample |
US5995936A (en) * | 1997-02-04 | 1999-11-30 | Brais; Louis | Report generation system and method for capturing prose, audio, and video by voice command and automatically linking sound and image to formatted text locations |
US20080059232A1 (en) * | 1997-03-13 | 2008-03-06 | Clinical Decision Support, Llc | Disease management system and method including question version |
US5970449A (en) * | 1997-04-03 | 1999-10-19 | Microsoft Corporation | Text normalization using a context-free grammar |
US6490561B1 (en) * | 1997-06-25 | 2002-12-03 | Dennis L. Wilson | Continuous speech voice transcription |
US5926784A (en) * | 1997-07-17 | 1999-07-20 | Microsoft Corporation | Method and system for natural language parsing using podding |
US20020128816A1 (en) * | 1997-09-30 | 2002-09-12 | Haug Peter J. | Probabilistic system for natural language processing |
US6556964B2 (en) * | 1997-09-30 | 2003-04-29 | Ihc Health Services | Probabilistic system for natural language processing |
US6292771B1 (en) * | 1997-09-30 | 2001-09-18 | Ihc Health Services, Inc. | Probabilistic method for natural language processing and for encoding free-text data into a medical database by utilizing a Bayesian network to perform spell checking of words |
US6112168A (en) * | 1997-10-20 | 2000-08-29 | Microsoft Corporation | Automatically recognizing the discourse structure of a body of text |
US6304870B1 (en) * | 1997-12-02 | 2001-10-16 | The Board Of Regents Of The University Of Washington, Office Of Technology Transfer | Method and apparatus of automatically generating a procedure for extracting information from textual information sources |
US6154722A (en) * | 1997-12-18 | 2000-11-28 | Apple Computer, Inc. | Method and apparatus for a speech recognition system language model that integrates a finite state grammar probability and an N-gram probability |
US6405165B1 (en) * | 1998-03-05 | 2002-06-11 | Siemens Aktiengesellschaft | Medical workstation for treating a patient with a voice recording arrangement for preparing a physician's report during treatment |
US6182039B1 (en) * | 1998-03-24 | 2001-01-30 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus using probabilistic language model based on confusable sets for speech recognition |
US20030191627A1 (en) * | 1998-05-28 | 2003-10-09 | Lawrence Au | Topological methods to organize semantic network data flows for conversational applications |
US6915254B1 (en) * | 1998-07-30 | 2005-07-05 | A-Life Medical, Inc. | Automatically assigning medical codes using natural language processing |
US6122614A (en) * | 1998-11-20 | 2000-09-19 | Custom Speech Usa, Inc. | System and method for automating transcription services |
US6249765B1 (en) * | 1998-12-22 | 2001-06-19 | Xerox Corporation | System and method for extracting data from audio messages |
US6278968B1 (en) * | 1999-01-29 | 2001-08-21 | Sony Corporation | Method and apparatus for adaptive speech recognition hypothesis construction and selection in a spoken language translation system |
US6243669B1 (en) * | 1999-01-29 | 2001-06-05 | Sony Corporation | Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation |
US6526380B1 (en) * | 1999-03-26 | 2003-02-25 | Koninklijke Philips Electronics N.V. | Speech recognition system having parallel large vocabulary recognition engines |
US6609087B1 (en) * | 1999-04-28 | 2003-08-19 | Genuity Inc. | Fact recognition system |
US6345249B1 (en) * | 1999-07-07 | 2002-02-05 | International Business Machines Corp. | Automatic analysis of a speech dictated document |
US6434547B1 (en) * | 1999-10-28 | 2002-08-13 | Qenm.Com | Data capture and verification system |
US20050086059A1 (en) * | 1999-11-12 | 2005-04-21 | Bennett Ian M. | Partial speech processing device & method for use in distributed systems |
US7555431B2 (en) * | 1999-11-12 | 2009-06-30 | Phoenix Solutions, Inc. | Method for processing speech using dynamic grammars |
US20040117189A1 (en) * | 1999-11-12 | 2004-06-17 | Bennett Ian M. | Query engine for processing voice based queries including semantic decoding |
US20040030556A1 (en) * | 1999-11-12 | 2004-02-12 | Bennett Ian M. | Speech based learning/training system using semantic decoding |
US7624007B2 (en) * | 1999-11-12 | 2009-11-24 | Phoenix Solutions, Inc. | System and method for natural language processing of sentence based queries |
US20030093272A1 (en) * | 1999-12-02 | 2003-05-15 | Frederic Soufflet | Speech operated automatic inquiry system |
US20030181790A1 (en) * | 2000-05-18 | 2003-09-25 | Daniel David | Methods and apparatus for facilitated, hierarchical medical diagnosis and symptom coding and definition |
US6662168B1 (en) * | 2000-05-19 | 2003-12-09 | International Business Machines Corporation | Coding system for high data volume |
US20040030688A1 (en) * | 2000-05-31 | 2004-02-12 | International Business Machines Corporation | Information search using knowledge agents |
US7031908B1 (en) * | 2000-06-01 | 2006-04-18 | Microsoft Corporation | Creating a language model for a language processing system |
US6785651B1 (en) * | 2000-09-14 | 2004-08-31 | Microsoft Corporation | Method and apparatus for performing plan-based dialog |
US6435849B1 (en) * | 2000-09-15 | 2002-08-20 | Paul L. Guilmette | Fluid pump |
US20040030704A1 (en) * | 2000-11-07 | 2004-02-12 | Stefanchik Michael F. | System for the creation of database and structured information from verbal input |
US20040078215A1 (en) * | 2000-11-22 | 2004-04-22 | Recare, Inc. | Systems and methods for documenting medical findings of a physical examination |
US20020087311A1 (en) * | 2000-12-29 | 2002-07-04 | Leung Lee Victor Wai | Computer-implemented dynamic language model generation method and system |
US20020087315A1 (en) * | 2000-12-29 | 2002-07-04 | Lee Victor Wai Leung | Computer-implemented multi-scanning language method and system |
US20030167266A1 (en) * | 2001-01-08 | 2003-09-04 | Alexander Saldanha | Creation of structured data from plain text |
US20020099717A1 (en) * | 2001-01-24 | 2002-07-25 | Gordon Bennett | Method for report generation in an on-line transcription system |
US20020123891A1 (en) * | 2001-03-01 | 2002-09-05 | International Business Machines Corporation | Hierarchical language models |
US6754626B2 (en) * | 2001-03-01 | 2004-06-22 | International Business Machines Corporation | Creating a hierarchical tree of language models for a dialog system based on prompt and dialog context |
US20090228126A1 (en) * | 2001-03-09 | 2009-09-10 | Steven Spielberg | Method and apparatus for annotating a line-based document |
US7216073B2 (en) * | 2001-03-13 | 2007-05-08 | Intelligate, Ltd. | Dynamic natural language understanding |
US7519529B1 (en) * | 2001-06-29 | 2009-04-14 | Microsoft Corporation | System and methods for inferring informational goals and preferred level of detail of results in response to questions posed to an automated information-retrieval or question-answering service |
US20030065503A1 (en) * | 2001-09-28 | 2003-04-03 | Philips Electronics North America Corp. | Multi-lingual transcription system |
US20030069760A1 (en) * | 2001-10-04 | 2003-04-10 | Arthur Gelber | System and method for processing and pre-adjudicating patient benefit claims |
US7555425B2 (en) * | 2001-10-18 | 2009-06-30 | Oon Yeong K | System and method of improved recording of medical transactions |
US20030101054A1 (en) * | 2001-11-27 | 2003-05-29 | Ncc, Llc | Integrated system and method for electronic speech recognition and transcription |
US20030144885A1 (en) * | 2002-01-29 | 2003-07-31 | Exscribe, Inc. | Medical examination and transcription method, and associated apparatus |
US20050154690A1 (en) * | 2002-02-04 | 2005-07-14 | Celestar Lexico-Sciences, Inc | Document knowledge management apparatus and method |
US20040019482A1 (en) * | 2002-04-19 | 2004-01-29 | Holub John M. | Speech to text system using controlled vocabulary indices |
US7869998B1 (en) * | 2002-04-23 | 2011-01-11 | At&T Intellectual Property Ii, L.P. | Voice-enabled dialog system |
US7197460B1 (en) * | 2002-04-23 | 2007-03-27 | At&T Corp. | System for handling frequently asked questions in a natural language dialog service |
US7028038B1 (en) * | 2002-07-03 | 2006-04-11 | Mayo Foundation For Medical Education And Research | Method for generating training data for medical text abbreviation and acronym normalization |
US20070288212A1 (en) * | 2002-08-19 | 2007-12-13 | General Electric Company | System And Method For Optimizing Simulation Of A Discrete Event Process Using Business System Data |
US20040064317A1 (en) * | 2002-09-26 | 2004-04-01 | Konstantin Othmer | System and method for online transcription services |
US20040102957A1 (en) * | 2002-11-22 | 2004-05-27 | Levin Robert E. | System and method for speech translation using remote devices |
US20040148170A1 (en) * | 2003-01-23 | 2004-07-29 | Alejandro Acero | Statistical classifiers for spoken language understanding and command/control scenarios |
US20050091059A1 (en) * | 2003-08-29 | 2005-04-28 | Microsoft Corporation | Assisted multi-modal dialogue |
US20050065774A1 (en) * | 2003-09-20 | 2005-03-24 | International Business Machines Corporation | Method of self enhancement of search results through analysis of system logs |
US20050086056A1 (en) * | 2003-09-25 | 2005-04-21 | Fuji Photo Film Co., Ltd. | Voice recognition system and program |
US20050234891A1 (en) * | 2004-03-15 | 2005-10-20 | Yahoo! Inc. | Search systems and methods with integration of user annotations |
US20050240439A1 (en) * | 2004-04-15 | 2005-10-27 | Artificial Medical Intelligence, Inc, | System and method for automatic assignment of medical codes to unformatted data |
US20060007188A1 (en) * | 2004-07-09 | 2006-01-12 | Gesturerad, Inc. | Gesture-based reporting method and system |
US20060041428A1 (en) * | 2004-08-20 | 2006-02-23 | Juergen Fritsch | Automated extraction of semantic content and generation of a structured document from speech |
US20090048833A1 (en) * | 2004-08-20 | 2009-02-19 | Juergen Fritsch | Automated Extraction of Semantic Content and Generation of a Structured Document from Speech |
US20060074656A1 (en) * | 2004-08-20 | 2006-04-06 | Lambert Mathias | Discriminative training of document transcription system |
US20100299135A1 (en) * | 2004-08-20 | 2010-11-25 | Juergen Fritsch | Automated Extraction of Semantic Content and Generation of a Structured Document from Speech |
US7584103B2 (en) * | 2004-08-20 | 2009-09-01 | Multimodal Technologies, Inc. | Automated extraction of semantic content and generation of a structured document from speech |
US20060190263A1 (en) * | 2005-02-23 | 2006-08-24 | Michael Finke | Audio signal de-identification |
US20090228299A1 (en) * | 2005-11-09 | 2009-09-10 | The Regents Of The University Of California | Methods and apparatus for context-sensitive telemedicine |
US20070179777A1 (en) * | 2005-12-22 | 2007-08-02 | Rakesh Gupta | Automatic Grammar Generation Using Distributedly Collected Knowledge |
US7610192B1 (en) * | 2006-03-22 | 2009-10-27 | Patrick William Jamieson | Process and system for high precision coding of free text documents against a standard lexicon |
US20070226211A1 (en) * | 2006-03-27 | 2007-09-27 | Heinze Daniel T | Auditing the Coding and Abstracting of Documents |
US7716040B2 (en) * | 2006-06-22 | 2010-05-11 | Multimodal Technologies, Inc. | Verification of extracted data |
US20080168343A1 (en) * | 2007-01-05 | 2008-07-10 | Doganata Yurdaer N | System and Method of Automatically Mapping a Given Annotator to an Aggregate of Given Annotators |
US20090055168A1 (en) * | 2007-08-23 | 2009-02-26 | Google Inc. | Word Detection |
US20100076761A1 (en) * | 2008-09-25 | 2010-03-25 | Fritsch Juergen | Decoding-Time Prediction of Non-Verbalized Tokens |
US20100185685A1 (en) * | 2009-01-13 | 2010-07-22 | Chew Peter A | Technique for Information Retrieval Using Enhanced Latent Semantic Analysis |
Cited By (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8335688B2 (en) | 2004-08-20 | 2012-12-18 | Multimodal Technologies, Llc | Document transcription system training |
US20060041427A1 (en) * | 2004-08-20 | 2006-02-23 | Girija Yegnanarayanan | Document transcription system training |
US20060190263A1 (en) * | 2005-02-23 | 2006-08-24 | Michael Finke | Audio signal de-identification |
US7502741B2 (en) * | 2005-02-23 | 2009-03-10 | Multimodal Technologies, Inc. | Audio signal de-identification |
US8768706B2 (en) | 2005-07-22 | 2014-07-01 | Multimodal Technologies, Llc | Content-based audio playback emphasis |
US20100318347A1 (en) * | 2005-07-22 | 2010-12-16 | Kjell Schubert | Content-Based Audio Playback Emphasis |
US8666742B2 (en) | 2005-11-08 | 2014-03-04 | Mmodal Ip Llc | Automatic detection and application of editing patterns in draft documents |
US8321199B2 (en) | 2006-06-22 | 2012-11-27 | Multimodal Technologies, Llc | Verification of extracted data |
US8560314B2 (en) | 2006-06-22 | 2013-10-15 | Multimodal Technologies, Llc | Applying service levels to transcripts |
US20080177623A1 (en) * | 2007-01-24 | 2008-07-24 | Juergen Fritsch | Monitoring User Interactions With A Document Editing System |
US8504372B2 (en) | 2008-08-29 | 2013-08-06 | Mmodal Ip Llc | Distributed speech recognition using one way communication |
US9761226B2 (en) | 2008-10-27 | 2017-09-12 | Mmodal Ip Llc | Synchronized transcription rules handling |
US20150279354A1 (en) * | 2010-05-19 | 2015-10-01 | Google Inc. | Personalization and Latency Reduction for Voice-Activated Commands |
US8959102B2 (en) | 2010-10-08 | 2015-02-17 | Mmodal Ip Llc | Structured searching of dynamic structured document corpuses |
US10956860B2 (en) | 2011-02-18 | 2021-03-23 | Nuance Communications, Inc. | Methods and apparatus for determining a clinician's intent to order an item |
US10032127B2 (en) | 2011-02-18 | 2018-07-24 | Nuance Communications, Inc. | Methods and apparatus for determining a clinician's intent to order an item |
US9275643B2 (en) | 2011-06-19 | 2016-03-01 | Mmodal Ip Llc | Document extension in dictation-based document generation workflow |
EP2721606A4 (en) * | 2011-06-19 | 2015-04-01 | Mmodal Ip Llc | Document extension in dictation-based document generation workflow |
EP2721606A1 (en) * | 2011-06-19 | 2014-04-23 | MModal IP LLC | Document extension in dictation-based document generation workflow |
WO2012177662A1 (en) | 2011-06-19 | 2012-12-27 | Mmodal Ip Llc | Document extension in dictation-based document generation workflow |
US9865025B2 (en) | 2011-11-28 | 2018-01-09 | Peter Ragusa | Electronic health record system and method for patient encounter transcription and documentation |
US10950329B2 (en) | 2015-03-13 | 2021-03-16 | Mmodal Ip Llc | Hybrid human and computer-assisted coding workflow |
US20210296010A1 (en) * | 2017-01-17 | 2021-09-23 | 3M Innovative Properties Company | Methods and Systems for Manifestation and Transmission of Follow-Up Notifications |
US11043306B2 (en) * | 2017-01-17 | 2021-06-22 | 3M Innovative Properties Company | Methods and systems for manifestation and transmission of follow-up notifications |
US20180204645A1 (en) * | 2017-01-17 | 2018-07-19 | Mmodal Ip Llc | Methods and systems for manifestation and transmission of follow-up notifications |
US11699531B2 (en) * | 2017-01-17 | 2023-07-11 | 3M Innovative Properties Company | Methods and systems for manifestation and transmission of follow-up notifications |
US11282596B2 (en) | 2017-11-22 | 2022-03-22 | 3M Innovative Properties Company | Automated code feedback system |
US11037665B2 (en) | 2018-01-11 | 2021-06-15 | International Business Machines Corporation | Generating medication orders from a clinical encounter |
US10657954B2 (en) | 2018-02-20 | 2020-05-19 | Dropbox, Inc. | Meeting audio capture and transcription in a collaborative document context |
US10943060B2 (en) | 2018-02-20 | 2021-03-09 | Dropbox, Inc. | Automated outline generation of captured meeting audio in a collaborative document context |
US10467335B2 (en) * | 2018-02-20 | 2019-11-05 | Dropbox, Inc. | Automated outline generation of captured meeting audio in a collaborative document context |
US20190258704A1 (en) * | 2018-02-20 | 2019-08-22 | Dropbox, Inc. | Automated outline generation of captured meeting audio in a collaborative document context |
US11275891B2 (en) | 2018-02-20 | 2022-03-15 | Dropbox, Inc. | Automated outline generation of captured meeting audio in a collaborative document context |
US11488602B2 (en) | 2018-02-20 | 2022-11-01 | Dropbox, Inc. | Meeting transcription using custom lexicons based on document history |
US11689379B2 (en) | 2019-06-24 | 2023-06-27 | Dropbox, Inc. | Generating customized meeting insights based on user interactions and meeting media |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10339937B2 (en) | Automatic decision support | |
US11922373B2 (en) | Clinical data reconciliation as part of a report generation solution | |
JP6078057B2 (en) | Document expansion in dictation-based document generation workflow | |
US7831423B2 (en) | Replacing text representing a concept with an alternate written form of the concept | |
US11282596B2 (en) | Automated code feedback system | |
US20090287487A1 (en) | Systems and Methods for a Visual Indicator to Track Medical Report Dictation Progress |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MULTIMODAL TECHNOLOGIES, INC., PENNSYLVANIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOLL, DETLEF;FINKE, MICHAEL;REEL/FRAME:019470/0489 Effective date: 20070621 |
|
AS | Assignment |
Owner name: MULTIMODAL TECHNOLOGIES, LLC, PENNSYLVANIA Free format text: CHANGE OF NAME;ASSIGNOR:MULTIMODAL TECHNOLOGIES, INC.;REEL/FRAME:027061/0492 Effective date: 20110818 |
|
AS | Assignment |
Owner name: ROYAL BANK OF CANADA, AS ADMINISTRATIVE AGENT, ONT Free format text: SECURITY AGREEMENT;ASSIGNORS:MMODAL IP LLC;MULTIMODAL TECHNOLOGIES, LLC;POIESIS INFOMATICS INC.;REEL/FRAME:028824/0459 Effective date: 20120817 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION |
|
AS | Assignment |
Owner name: MULTIMODAL TECHNOLOGIES, LLC, PENNSYLVANIA Free format text: RELEASE OF SECURITY INTEREST;ASSIGNOR:ROYAL BANK OF CANADA, AS ADMINISTRATIVE AGENT;REEL/FRAME:033459/0987 Effective date: 20140731 |
|
AS | Assignment |
Owner name: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT, NEW YORK Free format text: SECURITY AGREEMENT;ASSIGNOR:MMODAL IP LLC;REEL/FRAME:034047/0527 Effective date: 20140731 Owner name: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT, Free format text: SECURITY AGREEMENT;ASSIGNOR:MMODAL IP LLC;REEL/FRAME:034047/0527 Effective date: 20140731 |
|
AS | Assignment |
Owner name: MEDQUIST OF DELAWARE, INC., TENNESSEE Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712 Effective date: 20190201 Owner name: MMODAL MQ INC., TENNESSEE Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712 Effective date: 20190201 Owner name: MMODAL IP LLC, TENNESSEE Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712 Effective date: 20190201 Owner name: MEDQUIST CM LLC, TENNESSEE Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712 Effective date: 20190201 Owner name: MULTIMODAL TECHNOLOGIES, LLC, TENNESSEE Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712 Effective date: 20190201 |