US20140039880A1 - Applying Service Levels to Transcripts - Google Patents

Applying Service Levels to Transcripts Download PDF

Info

Publication number
US20140039880A1
US20140039880A1 US14/052,005 US201314052005A US2014039880A1 US 20140039880 A1 US20140039880 A1 US 20140039880A1 US 201314052005 A US201314052005 A US 201314052005A US 2014039880 A1 US2014039880 A1 US 2014039880A1
Authority
US
United States
Prior art keywords
transcript
portions
priority
verification
draft
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/052,005
Inventor
Detlef Koll
Michael Finke
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MModal IP LLC
Original Assignee
MULTIMODAL TECHNOLOGIES LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=38834406&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20140039880(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Priority to US14/052,005 priority Critical patent/US20140039880A1/en
Assigned to MULTIMODAL TECHNOLOGIES, LLC reassignment MULTIMODAL TECHNOLOGIES, LLC CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: MULTIMODAL TECHNOLOGIES, INC.
Assigned to MULTIMODAL TECHNOLOGIES, INC. reassignment MULTIMODAL TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FINKE, MICHAEL, KOLL, DETLEF
Application filed by MULTIMODAL TECHNOLOGIES LLC filed Critical MULTIMODAL TECHNOLOGIES LLC
Assigned to MMODAL IP LLC reassignment MMODAL IP LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MULTIMODAL TECHNOLOGIES, LLC
Publication of US20140039880A1 publication Critical patent/US20140039880A1/en
Assigned to WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT reassignment WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT SECURITY AGREEMENT Assignors: MMODAL IP LLC
Assigned to CORTLAND CAPITAL MARKET SERVICES LLC reassignment CORTLAND CAPITAL MARKET SERVICES LLC PATENT SECURITY AGREEMENT Assignors: MMODAL IP LLC
Assigned to MMODAL IP LLC reassignment MMODAL IP LLC CHANGE OF ADDRESS Assignors: MMODAL IP LLC
Assigned to MMODAL IP LLC reassignment MMODAL IP LLC RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: CORTLAND CAPITAL MARKET SERVICES LLC, AS ADMINISTRATIVE AGENT
Assigned to MEDQUIST CM LLC, MEDQUIST OF DELAWARE, INC., MULTIMODAL TECHNOLOGIES, LLC, MMODAL IP LLC, MMODAL MQ INC. reassignment MEDQUIST CM LLC TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Assignors: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G06F17/2785
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/103Formatting, i.e. changing of presentation of documents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/02Feature extraction for speech recognition; Selection of recognition unit
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/20ICT specially adapted for the handling or processing of patient-related medical or healthcare data for electronic clinical trials or questionnaires
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records

Definitions

  • transcripts are produced of diagnoses, prognoses, prescriptions, and other information dictated by doctors and other medical professionals.
  • transcripts can be time-consuming. For example, the speed with which a human transcriptionist can produce a transcript is limited by the transcriptionist's typing speed and ability to understand the speech being transcribed.
  • software-based automatic speech recognizers are often used to supplement or replace the role of the human transcriptionist in producing an initial transcript, even a transcript produced by a combination of human transcriptionist and automatic speech recognizer will contain errors. Any transcript that is produced, therefore, must be considered to be a draft, to which some form of error correction is to be applied.
  • Producing a transcript is time-consuming for these and other reasons. For example, it may be desirable or necessary for certain kinds of transcripts (such as medical reports) to be stored and/or displayed in a particular format. Providing a transcript in an appropriate format typically requires some combination of human editing and automatic processing, which introduces an additional delay into the production of the final transcript.
  • Speech is transcribed to produce a draft transcript of the speech.
  • Portions of the transcript having a high priority are identified. For example, particular sections of the transcript may be identified as high-priority sections. As another example, portions of the transcript requiring human verification may be identified as high-priority sections. High-priority portions of the transcript are verified at a first time, without verifying other portions of the transcript. Such other portions may or may not be verified at a later time. Limiting verification, either initially or entirely, to high-priority portions of the transcript limits the time required to perform such verification, thereby making it feasible to verify the most important portions of the transcript at an early stage without introducing an undue delay into the transcription process. Verifying the other portions of the transcript later ensures that early verification of the high-priority portions does not sacrifice overall verification accuracy.
  • one embodiment of the present invention is a computer-implemented method comprising: (A) identifying a first semantic meaning of a first portion of a first transcript of speech; (B) assigning a first service level to the first portion of the transcript based on the first semantic meaning; (C) identifying a second semantic meaning of a second portion of the first transcript; (D) assigning a second service level to the second portion of the transcript based on the second semantic meaning; and (E) verifying the transcript in accordance with the first and second service levels.
  • Another embodiment of the present invention is an apparatus comprising: first meaning identification means for identifying a first semantic meaning of a first portion of a first transcript of speech; first service level assignment means for assigning a first service level to the first portion of the transcript based on the first semantic meaning; second meaning identification means for identifying a second semantic meaning of a second portion of the first transcript; second service level assignment means for assigning a second service level to the second portion of the transcript based on the second semantic meaning; and verification means for verifying the transcript in accordance with the first and second service levels.
  • Another embodiment of the present invention is a computer-implemented method comprising: (A) identifying a first semantic meaning of a first transcript of first speech; (B) assigning a first service level to the first transcript based on the first semantic meaning; (C) identifying a second semantic meaning of a second transcript of second speech; (D) assigning a second service level to the second transcript based on the second semantic meaning; and (E) verifying the first and second transcripts in accordance with the first and second service levels, respectively.
  • Another embodiment of the present invention is an apparatus comprising: means for identifying a first semantic meaning of a first transcript of first speech; means for assigning a first service level to the first transcript based on the first semantic meaning; means for identifying a second semantic meaning of a second transcript of second speech; means for assigning a second service level to the second transcript based on the second semantic meaning; and means for verifying the first and second transcripts in accordance with the first and second service levels, respectively.
  • FIG. 1 is a dataflow diagram of a system for verifying a transcript of speech according to one embodiment of the present invention.
  • FIG. 2 is a flowchart of a method performed by the system of FIG. 1 according to one embodiment of the present invention.
  • Embodiments of the invention are directed to verifying a transcript of speech using multiple service levels.
  • Service levels may, for example, correspond to required turnaround times for verification.
  • a “high priority” service level may, for example, correspond to a relatively short turnaround time, while a “low priority” service level may correspond to another service level.
  • the high priority service level may indicate that human verification of the corresponding text is required, while the low priority service level may indicate that human verification is not required.
  • the “impressions” section of a medical transcript may be identified as a high-priority section of the report, while other sections may be identified as low-priority sections. Verification of each portion of the document is performed according to that portion's service level. For example, high-priority sections (such as the “impressions” section) may be verified immediately, while low-priority sections may be verified at a later time. As another example, high-priority sections may be verified by a human, while low-priority sections may be verified by software or not at all.
  • FIG. 1 a dataflow diagram is shown of a system 100 for selectively verifying portions of a draft transcript 106 according to one embodiment of the present invention.
  • FIG. 2 a flowchart is shown of a method 200 performed by the system 100 of FIG. 1 according to one embodiment of the present invention.
  • a transcription system 104 transcribes a spoken audio stream 102 to produce a draft transcript 106 (step 202 ).
  • the spoken audio stream 102 may, for example, be dictation by a doctor describing a patient visit.
  • the spoken audio stream 102 may take any form. For example, it may be a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format.
  • the transcription system 104 may produce the draft transcript 106 using, for example, an automated speech recognizer or a combination of an automated speech recognizer and human transcriptionist.
  • the transcription system 104 may, for example, produce the draft transcript 106 using any of the techniques disclosed in the above-referenced patent application entitled “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech.”
  • the draft transcript 106 may include text 116 that is either a literal (verbatim) transcript or a non-literal transcript of the spoken audio stream 102 .
  • the draft transcript 106 may be a plain text document
  • the draft transcript 106 may also, for example, in whole or in part be a structured document, such as an XML document which delineates document sections and other kinds of document structure.
  • a structured document such as an XML document which delineates document sections and other kinds of document structure.
  • the draft transcript 106 includes one or more codings 108 , each of which encodes a “concept” extracted from the spoken audio stream 102 .
  • the term “concept” is used herein as defined in the above-referenced patent application entitled “Automated Extraction of Semantic content and Generation of a Structured Document from Speech.”
  • Reference numeral 108 is used herein to refer generally to all of the codings within the draft transcript 106 . Although in FIG. 1 only two codings, designated 108 a and 108 b , are shown, the draft transcript 106 may include any number of codings.
  • each of the codings 108 may, for example, encode an allergy, prescription, diagnosis, or prognosis.
  • each of the codings 108 includes a code and corresponding data, which are not shown in FIG. 1 for ease of illustration.
  • Each of the codings 108 may be linked to text in the transcript 106 .
  • coding 108 a may be linked to text 118 a
  • coding 108 b may be linked to text 118 b .
  • linked text 118 a is in a first section of the draft transcript 106 (such as an “impressions” section)
  • linked text 118 b is in a second section of the draft transcript 106 (such as a “patient history” section).
  • Further details of embodiments of the codings 108 may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.”
  • a priority identifier 120 identifies verification priorities of one or more portions of the draft transcript 106 to produce portion priorities 122 (step 204 ).
  • a “portion” of the draft transcript 106 may, for example, be a single coding (such as the coding 108 a or coding 108 b ), sentence, paragraph, or section.
  • the priority identifier 120 identifies the priority of a portion of the draft transcript 106 by identifying a semantic meaning of the portion, and identifying the priority of the portion based on the identified semantic meaning.
  • the priority identifier 120 may be configured to assign a high priority to any “impressions” sections in the draft transcript 106 and a low priority to all other sections in the draft transcript 106 .
  • certain portions of the draft transcript 106 may require human (rather than software-based or other automated) verification. Typically, all portions of the draft transcript 106 require human verification. Some portions, however, such as certain codings representing data which are used solely for automatic computer processing, may not be rendered to the reviewer (e.g., physician) for review and not require human verification.
  • the priority identifier 120 may be configured to assign a high priority to any portions of the draft transcript 106 which require human verification, and to assign a low priority to all other portions of the draft transcript 106 .
  • the priority identifier 120 may identify portions of the draft transcript 106 requiring human verification in any of a variety of ways. For example, the priority identifier 120 may be configured to identify certain codings, or certain types of codings, as requiring human verification, in which case the priority identifier 120 may assign a high priority to such codings.
  • the portions of the draft transcript 106 are verified according to service levels associated with their priorities (step 205 ). For example, a “high-priority” service level may be applied to portions of the transcript 106 having a high priority. Similarly, a “low-priority” service level may be applied to portions of the transcript 106 having a low priority. Since the priorities 122 of the document portions are identified based on the semantic meanings of the portions, the service levels that are applied to the portions are based on the semantic meanings of the portions.
  • an initial transcript verifier 124 verifies, at a first time, only those portions of the draft transcript 106 which the priority identifier 120 has identified as having a high verification priority (step 206 ).
  • the portion priorities 122 may, for example, include links to the corresponding portions of the draft transcript 106 .
  • the initial transcript verifier 124 may use such links to identify which portions of the draft transcript 106 have high verification priorities and to verify only those portions of the draft transcript 106 .
  • the initial transcript verifier 124 produces initial transcript verification status identifiers 128 which indicate the verification status of each of the high-priority portions of the draft transcript 106 .
  • a verification status may, for example, indicate whether the corresponding portion of the draft transcript 106 is correct or incorrect.
  • the high-priority portions of the draft transcript 106 may be presented to a human reviewer, who may be the same person who dictated the spoken audio stream.
  • the speaker of the spoken audio stream 102 may still be dictating the remainder of the spoken audio stream 102 while portions of the draft transcript 106 representing previous parts of the spoken audio stream 102 are presented to the reviewer for verification.
  • the verification process performed by the initial transcript verifier 124 may include correcting any portions of the draft transcript 106 that are found to be incorrect.
  • the reviewer may provide input to correct one or more portions of the draft transcript 106 presented for review.
  • the initial transcript verifier 124 may therefore produce a modified draft transcript 126 , which includes any corrections to the codings 108 or other modifications made by the initial transcript verifier 124 (step 208 ).
  • initial transcript verification status identifiers 128 and the modified draft transcript 126 may be combined. For example, portions of the modified draft transcript 126 may be tagged with their own verification statuses.
  • the delay 130 may occur, for example, while the modified draft transcript 126 is provided to a nurse or physician for use in providing medical care.
  • a subsequent transcript verifier 132 verifies portions of the modified draft transcript 126 other than those which were verified by the initial transcript verifier 124 , thereby producing a final transcript 134 (step 212 ).
  • the subsequent transcript verifier 132 may verify all of the portions which were not verified by the initial transcript verifier 124 .
  • the subsequent transcript verifier 132 may use the same verification techniques as the initial transcript verifier 124 . Note that although the initial transcript verifier 124 and subsequent transcript verifier 132 are illustrated as two distinct components in FIG. 1 , they may be integrated into a single component (e.g., a single software program).
  • the techniques just described may be viewed as implementing two tiers of “service level,” in which each tier corresponds to a different turnaround time requirement.
  • the first (high-priority) tier of service level corresponds to a relatively short turnaround time
  • the second (low-priority) tier of service level corresponds to a relatively long turnaround time.
  • the priorities 122 assigned to portions of the draft transcript 106 may, however, be used to implement service levels corresponding to characteristics other than turnaround times.
  • a first tier of service level may require the corresponding portion of the draft transcript 106 to be verified by a human, while a second tier of service level may not require human verification.
  • the second tier may require software verification or not require any verification.
  • the method of FIG. 2 would include only steps 202 - 208 . More specifically, step 202 would include transcribing the spoken audio stream to produce the draft transcript 106 , as described above. Step 204 would include identifying priorities 122 of portions of the draft transcript 106 . In this example, a high priority would indicate that human verification is required, while a low priority would indicate that human verification is not required.
  • Step 206 would include verifying only those portions of the draft transcript 106 having high priorities (i.e., only those portions of the draft transcript 106 requiring human verification). Such verification may, for example, be performed by providing the draft transcript 106 to a human reviewer (such as the dictating physician) for review.
  • a human reviewer such as the dictating physician
  • the method 200 would then terminate, without verifying the low-priority portions of the draft transcript 106 because such portions have been identified as not requiring human verification.
  • a high service level would require verification by the dictating physician
  • a medium service level would require verification by a data entry clerk
  • a low service level would not require any human verification.
  • Embodiments of the present invention have a variety of advantages.
  • transcripts of physician-dictated reports typically are not provided to nurses and others for use in patient care soon after a draft of the transcript has been produced because it has not been possible to verify the accuracy of the transcript quickly enough.
  • draft transcripts typically are withheld until they have been verified, which can introduce a significant delay before such transcripts may be used.
  • One benefit of the techniques disclosed herein is that they make it possible to provide transcripts to consumers of such transcripts both quickly and with increased accuracy by limiting the amount of the transcript that is verified, at least at the outset.
  • the techniques illustrated in FIGS. 1 and 2 increase the accuracy of those portions of the draft transcript 106 for which accuracy is most critical, without introducing the significant delay that would otherwise be incurred by verifying the entire transcript.
  • the techniques disclosed herein do not create significant additional work for the physician or other dictator/reviewer of the transcript, and may thereby reduce the total amount of time they need to devote to performing their tasks. If, for example, the initial transcript verifier 124 presents high-priority portions of the draft transcript 106 to a physician for review immediately after the physician dictates such portions, or even while the physician is dictating such portions, the physician may verify and correct any errors in such portions more efficiently than if those portions of the transcript were provided to the physician for review an hour, day, or week later because of the switching costs involved. Furthermore, overall accuracy may be increased because the dictator/reviewer of the draft transcript 106 may have a clearer memory of the intended content of the draft transcript 106 is presented to him or her immediately after dictating it, rather than at a later time.
  • the “impressions” section of a radiology report needs to be made available immediately for emergency room radiology studies, while the rest of the document may be completed at a later time.
  • the “impressions” section of the draft transcript 106 may be provided to the dictating physician immediately for self-correction, while leaving the remainder of the document to be corrected at a later time by professional transcriptionists.
  • the medication and allergy sections of a progress note may be interpreted and populated immediately in an electronic medical records (EMR) system to be available for order entry (i.e., prescription medications) and decision support at point of care.
  • EMR electronic medical records
  • Other data elements e.g., history of present illness may be verified at a later time.
  • the modified draft transcript 126 may be provided to an automated clinical decision support system, as described in the above-referenced patent application, to provide clinical decision support quickly.
  • Such techniques may, for example, be used to provide a quick indication of whether the draft transcript 126 indicates a dangerous drug-drug allergy which requires attention by the dictating physician or other care provider.
  • the techniques disclosed herein facilitate the provision of such rapid clinical decision support by enabling verification of high-priority portions of the draft transcript 106 to be performed soon after the draft transcript 106 is produced. If verification of such high-priority portions had to wait until all portions of the draft transcript 106 were verified, then application of automated clinical decision support to the high-priority portions would have to wait as well.
  • portions of the draft transcript 106 which are necessary to provide as input a clinical decision support system may be assigned a high priority.
  • the initial transcript verifier 124 will verify those portions of the draft transcript 106 which are necessary to provide as input to the clinical decision support system. This ensures that any desired clinical decision support can be applied to the modified draft transcript 126 produced by the initial transcript verifier 124 , without incurring additional delay.
  • the spoken audio stream 102 may be any audio stream, such as a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format.
  • DSR distributed speech recognition
  • a client performs preprocessing on an audio stream to produce a processed audio stream that is transmitted to a server, which performs speech recognition on the processed audio stream.
  • the audio stream may, for example, be a processed audio stream produced by a DSR client.
  • the invention is not limited to any of the described domains (such as the medical and legal fields), but generally applies to any kind of documents in any domain.
  • the reviewer 138 may be described herein as a physician, this is not a limitation of the present invention. Rather, the reviewer 138 may be any person.
  • documents used in conjunction with embodiments of the present invention may be represented in any machine-readable form. Such forms include plain text documents and structured documents represented in markup languages such as XML. Such documents may be stored in any computer-readable medium and transmitted using any kind of communications channel and protocol.
  • priorities may be applied to any number of priorities defined and/or labeled in any manner. For example, there may be high, medium, and low priorities. As another examples, priorities may specify maximum turnaround times, such as one minute, one hour, and one day.
  • the high priority service level is described as providing “immediate” verification, this is not a requirement of the present invention. Rather, service levels may be defined and applied in any manner. For example, even when service levels define turnaround requirements, the highest-priority service level need not require immediate turnaround, but rather may require or allow any amount of delay.
  • a first (e.g., high-priority) service level may be applied to a first entire document and a second (e.g., low-priority) service level may be applied to a second entire document.
  • the first and second documents may then be verified in accordance with their respective service levels.
  • the transcription system 104 may transcribe a first spoken audio stream to produce a first draft transcript and apply automatic decision support to the first draft transcript using the techniques disclosed in the above-referenced patent application entitled, “Automatic Decision Support.”
  • a first service level may be associated with the first draft transcript based on the results of the automatic decision support. For example, if automatic decision support determines that the draft transcript does not include any critical errors, then a low-priority service level may be associated with the first draft transcript.
  • the transcription system 104 may also transcribe a second spoken audio stream to produce a second draft transcript and apply automatic decision support to the second draft transcript using the above-described techniques.
  • a second service level may be associated with the second draft transcript based on the results of the automatic decision support. For example, if automatic decision support determines that the second draft transcript contains a critical error (such as by describing a prescription that would result in a drug-drug allergy), then a high-priority service level may be associated with the second draft transcript.
  • the first and second draft transcripts may then be verified in accordance with their respective service levels.
  • the second draft transcript may be presented for verification before the first draft transcript, even though the first draft transcript was transcribed before the second draft transcript, because the second draft transcript is associated with a higher service level than the first draft transcript.
  • a phone call might be made immediately to the dictating physician of the second draft transcript to alert him or her to the identified error.
  • the second draft transcript might be placed at the top of the queue of documents to which full verification is to be applied. In either case, the (low-priority) first draft transcript may be verified at a later time.
  • verification statuses 130 may include statuses such as “correct” and “incorrect,” the invention is not so limited. Rather, the verification statuses 130 may take any of a variety of forms. Further examples of the verification statuses and techniques for producing them may be found in the above-referenced patent application entitled, “Verification of Extracted Data.”
  • service levels not disclosed herein may be used in conjunction with the techniques disclosed herein.
  • service levels may be combined with each other in various ways. For example, a “high-priority” service level may be applied to any portions of the draft transcript 106 which:
  • the verification performed by the initial transcript verifier 124 and the subsequent transcript verifier 132 may be performed in whole or in part by a human, such as the dictator of the draft transcript 106 .
  • the high-priority portions of the draft transcript 106 may be called out to the reviewer, such as by highlighting them or displaying them in a different color within a display of the draft transcript 106 .
  • Such a display may, for example, be displayed to the reviewer while the reviewer is dictating the contents of the transcript 106 .
  • the techniques described above may be implemented, for example, in hardware, software, firmware, or any combination thereof.
  • the techniques described above may be implemented in one or more computer programs executing on a programmable computer including a processor, a storage medium readable by the processor (including, for example, volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
  • Program code may be applied to input entered using the input device to perform the functions described and to generate output.
  • the output may be provided to one or more output devices.
  • Each computer program within the scope of the claims below may be implemented in any programming language, such as assembly language, machine language, a high-level procedural programming language, or an object-oriented programming language.
  • the programming language may, for example, be a compiled or interpreted programming language.
  • Each such computer program may be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a computer processor.
  • Method steps of the invention may be performed by a computer processor executing a program tangibly embodied on a computer-readable medium to perform functions of the invention by operating on input and generating output.
  • Suitable processors include, by way of example, both general and special purpose microprocessors.
  • the processor receives instructions and data from a read-only memory and/or a random access memory.
  • Storage devices suitable for tangibly embodying computer program instructions include, for example, all forms of non-volatile memory, such as semiconductor memory devices, including EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROMs. Any of the foregoing may be supplemented by, or incorporated in, specially-designed ASICs (application-specific integrated circuits) or FPGAs (Field-Programmable Gate Arrays).
  • a computer can generally also receive programs and data from a storage medium such as an internal disk (not shown) or a removable disk.

Abstract

Speech is transcribed to produce a draft transcript of the speech. Portions of the transcript having a high priority are identified. For example, particular sections of the transcript may be identified as high-priority sections. As another example, portions of the transcript requiring human verification may be identified as high-priority sections. High-priority portions of the transcript are verified at a first time, without verifying other portions of the transcript. Such other portions may or may not be verified at a later time. Limiting verification, either initially or entirely, to high-priority portions of the transcript limits the time required to perform such verification, thereby making it feasible to verify the most important portions of the transcript at an early stage without introducing an undue delay into the transcription process. Verifying the other portions of the transcript later ensures that early verification of the high-priority portions does not sacrifice overall verification accuracy.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is related to U.S. patent application Ser. No. 10/923,517, filed on Aug. 20, 2004, entitled “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech,” now U.S. Pat. No. 7,584,103, which is hereby incorporated by reference herein.
  • BACKGROUND
  • It is desirable in many contexts to generate a structured textual document based on human speech. In the legal profession, for example, transcriptionists transcribe testimony given in court proceedings and in depositions to produce a written transcript of the testimony. Similarly, in the medical profession, transcripts are produced of diagnoses, prognoses, prescriptions, and other information dictated by doctors and other medical professionals.
  • Producing such transcripts can be time-consuming. For example, the speed with which a human transcriptionist can produce a transcript is limited by the transcriptionist's typing speed and ability to understand the speech being transcribed. Although software-based automatic speech recognizers are often used to supplement or replace the role of the human transcriptionist in producing an initial transcript, even a transcript produced by a combination of human transcriptionist and automatic speech recognizer will contain errors. Any transcript that is produced, therefore, must be considered to be a draft, to which some form of error correction is to be applied.
  • Producing a transcript is time-consuming for these and other reasons. For example, it may be desirable or necessary for certain kinds of transcripts (such as medical reports) to be stored and/or displayed in a particular format. Providing a transcript in an appropriate format typically requires some combination of human editing and automatic processing, which introduces an additional delay into the production of the final transcript.
  • Consumers of reports, such as doctors, nurses, and radiologists in the medical context, often stand to benefit from receiving reports quickly. If a diagnosis depends on the availability of a certain report, for example, then the diagnosis cannot be provided until the required report is ready. Similarly, if a doctor dictates a report of an operation into a handheld dictation device while still in the operating room, it may be desirable for a nurse to receive a transcript or other report of the dictation as soon as possible after the patient leaves the operating room. For these and other reasons it is desirable to increase the speed with which transcripts and other kinds of reports derived from speech may be produced, without sacrificing accuracy.
  • SUMMARY
  • Speech is transcribed to produce a draft transcript of the speech. Portions of the transcript having a high priority are identified. For example, particular sections of the transcript may be identified as high-priority sections. As another example, portions of the transcript requiring human verification may be identified as high-priority sections. High-priority portions of the transcript are verified at a first time, without verifying other portions of the transcript. Such other portions may or may not be verified at a later time. Limiting verification, either initially or entirely, to high-priority portions of the transcript limits the time required to perform such verification, thereby making it feasible to verify the most important portions of the transcript at an early stage without introducing an undue delay into the transcription process. Verifying the other portions of the transcript later ensures that early verification of the high-priority portions does not sacrifice overall verification accuracy.
  • For example, one embodiment of the present invention is a computer-implemented method comprising: (A) identifying a first semantic meaning of a first portion of a first transcript of speech; (B) assigning a first service level to the first portion of the transcript based on the first semantic meaning; (C) identifying a second semantic meaning of a second portion of the first transcript; (D) assigning a second service level to the second portion of the transcript based on the second semantic meaning; and (E) verifying the transcript in accordance with the first and second service levels.
  • Another embodiment of the present invention is an apparatus comprising: first meaning identification means for identifying a first semantic meaning of a first portion of a first transcript of speech; first service level assignment means for assigning a first service level to the first portion of the transcript based on the first semantic meaning; second meaning identification means for identifying a second semantic meaning of a second portion of the first transcript; second service level assignment means for assigning a second service level to the second portion of the transcript based on the second semantic meaning; and verification means for verifying the transcript in accordance with the first and second service levels.
  • Another embodiment of the present invention is a computer-implemented method comprising: (A) identifying a first semantic meaning of a first transcript of first speech; (B) assigning a first service level to the first transcript based on the first semantic meaning; (C) identifying a second semantic meaning of a second transcript of second speech; (D) assigning a second service level to the second transcript based on the second semantic meaning; and (E) verifying the first and second transcripts in accordance with the first and second service levels, respectively.
  • Another embodiment of the present invention is an apparatus comprising: means for identifying a first semantic meaning of a first transcript of first speech; means for assigning a first service level to the first transcript based on the first semantic meaning; means for identifying a second semantic meaning of a second transcript of second speech; means for assigning a second service level to the second transcript based on the second semantic meaning; and means for verifying the first and second transcripts in accordance with the first and second service levels, respectively.
  • Other features and advantages of various aspects and embodiments of the present invention will become apparent from the following description and from the claims.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a dataflow diagram of a system for verifying a transcript of speech according to one embodiment of the present invention; and
  • FIG. 2 is a flowchart of a method performed by the system of FIG. 1 according to one embodiment of the present invention.
  • DETAILED DESCRIPTION
  • Embodiments of the invention are directed to verifying a transcript of speech using multiple service levels. Service levels may, for example, correspond to required turnaround times for verification. A “high priority” service level may, for example, correspond to a relatively short turnaround time, while a “low priority” service level may correspond to another service level. As another example, the high priority service level may indicate that human verification of the corresponding text is required, while the low priority service level may indicate that human verification is not required.
  • The priorities of different portions of a transcript are identified. For example, the “impressions” section of a medical transcript may be identified as a high-priority section of the report, while other sections may be identified as low-priority sections. Verification of each portion of the document is performed according to that portion's service level. For example, high-priority sections (such as the “impressions” section) may be verified immediately, while low-priority sections may be verified at a later time. As another example, high-priority sections may be verified by a human, while low-priority sections may be verified by software or not at all.
  • More specifically, referring to FIG. 1, a dataflow diagram is shown of a system 100 for selectively verifying portions of a draft transcript 106 according to one embodiment of the present invention. Referring to FIG. 2, a flowchart is shown of a method 200 performed by the system 100 of FIG. 1 according to one embodiment of the present invention.
  • A transcription system 104 transcribes a spoken audio stream 102 to produce a draft transcript 106 (step 202). The spoken audio stream 102 may, for example, be dictation by a doctor describing a patient visit. The spoken audio stream 102 may take any form. For example, it may be a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format.
  • The transcription system 104 may produce the draft transcript 106 using, for example, an automated speech recognizer or a combination of an automated speech recognizer and human transcriptionist. The transcription system 104 may, for example, produce the draft transcript 106 using any of the techniques disclosed in the above-referenced patent application entitled “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech.” As described therein, the draft transcript 106 may include text 116 that is either a literal (verbatim) transcript or a non-literal transcript of the spoken audio stream 102. As further described therein, although the draft transcript 106 may be a plain text document, the draft transcript 106 may also, for example, in whole or in part be a structured document, such as an XML document which delineates document sections and other kinds of document structure. Various standards exist for encoding structured documents, and for annotating parts of the structured text with discrete facts (data) that are in some way related to the structured text. Examples of existing techniques for encoding medical documents include the HL7 CDA v2 XML standard (ANSI-approved since May 2005), SNOMED CT, LOINC, CPT, ICD-9 and ICD-10, and UMLS.
  • As shown in FIG. 1, the draft transcript 106 includes one or more codings 108, each of which encodes a “concept” extracted from the spoken audio stream 102. The term “concept” is used herein as defined in the above-referenced patent application entitled “Automated Extraction of Semantic content and Generation of a Structured Document from Speech.” Reference numeral 108 is used herein to refer generally to all of the codings within the draft transcript 106. Although in FIG. 1 only two codings, designated 108 a and 108 b, are shown, the draft transcript 106 may include any number of codings.
  • In the context of a medical report, each of the codings 108 may, for example, encode an allergy, prescription, diagnosis, or prognosis. In general, each of the codings 108 includes a code and corresponding data, which are not shown in FIG. 1 for ease of illustration. Each of the codings 108 may be linked to text in the transcript 106. For example, coding 108 a may be linked to text 118 a and coding 108 b may be linked to text 118 b. Assume for purposes of example that linked text 118 a is in a first section of the draft transcript 106 (such as an “impressions” section), and that linked text 118 b is in a second section of the draft transcript 106 (such as a “patient history” section). Further details of embodiments of the codings 108 may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.”
  • A priority identifier 120 identifies verification priorities of one or more portions of the draft transcript 106 to produce portion priorities 122 (step 204). A “portion” of the draft transcript 106 may, for example, be a single coding (such as the coding 108 a or coding 108 b), sentence, paragraph, or section.
  • In general, the priority identifier 120 identifies the priority of a portion of the draft transcript 106 by identifying a semantic meaning of the portion, and identifying the priority of the portion based on the identified semantic meaning. For example, the priority identifier 120 may be configured to assign a high priority to any “impressions” sections in the draft transcript 106 and a low priority to all other sections in the draft transcript 106.
  • As another example, certain portions of the draft transcript 106 may require human (rather than software-based or other automated) verification. Typically, all portions of the draft transcript 106 require human verification. Some portions, however, such as certain codings representing data which are used solely for automatic computer processing, may not be rendered to the reviewer (e.g., physician) for review and not require human verification. The priority identifier 120 may be configured to assign a high priority to any portions of the draft transcript 106 which require human verification, and to assign a low priority to all other portions of the draft transcript 106. The priority identifier 120 may identify portions of the draft transcript 106 requiring human verification in any of a variety of ways. For example, the priority identifier 120 may be configured to identify certain codings, or certain types of codings, as requiring human verification, in which case the priority identifier 120 may assign a high priority to such codings.
  • In general, the portions of the draft transcript 106 are verified according to service levels associated with their priorities (step 205). For example, a “high-priority” service level may be applied to portions of the transcript 106 having a high priority. Similarly, a “low-priority” service level may be applied to portions of the transcript 106 having a low priority. Since the priorities 122 of the document portions are identified based on the semantic meanings of the portions, the service levels that are applied to the portions are based on the semantic meanings of the portions.
  • One example of applying such service levels is illustrated by steps 206-212 in FIG. 2. More specifically, an initial transcript verifier 124 verifies, at a first time, only those portions of the draft transcript 106 which the priority identifier 120 has identified as having a high verification priority (step 206). The portion priorities 122 may, for example, include links to the corresponding portions of the draft transcript 106. The initial transcript verifier 124 may use such links to identify which portions of the draft transcript 106 have high verification priorities and to verify only those portions of the draft transcript 106. The initial transcript verifier 124 produces initial transcript verification status identifiers 128 which indicate the verification status of each of the high-priority portions of the draft transcript 106. A verification status may, for example, indicate whether the corresponding portion of the draft transcript 106 is correct or incorrect.
  • Any of a variety of techniques may be used to verify the high-priority portions of the draft transcript 106, examples of which may be found in the above-referenced patent application entitled, “Verification of Data Extracted from Speech.” For example, the high-priority portions of the draft transcript 106 may be presented to a human reviewer, who may be the same person who dictated the spoken audio stream. In fact, the speaker of the spoken audio stream 102 may still be dictating the remainder of the spoken audio stream 102 while portions of the draft transcript 106 representing previous parts of the spoken audio stream 102 are presented to the reviewer for verification.
  • The verification process performed by the initial transcript verifier 124 may include correcting any portions of the draft transcript 106 that are found to be incorrect. For example, the reviewer may provide input to correct one or more portions of the draft transcript 106 presented for review. The initial transcript verifier 124 may therefore produce a modified draft transcript 126, which includes any corrections to the codings 108 or other modifications made by the initial transcript verifier 124 (step 208).
  • Note that the initial transcript verification status identifiers 128 and the modified draft transcript 126 may be combined. For example, portions of the modified draft transcript 126 may be tagged with their own verification statuses.
  • There is some delay 130 after the initial verification (step 210). The delay 130 may occur, for example, while the modified draft transcript 126 is provided to a nurse or physician for use in providing medical care.
  • After the delay 130, a subsequent transcript verifier 132 verifies portions of the modified draft transcript 126 other than those which were verified by the initial transcript verifier 124, thereby producing a final transcript 134 (step 212). For example, the subsequent transcript verifier 132 may verify all of the portions which were not verified by the initial transcript verifier 124. The subsequent transcript verifier 132 may use the same verification techniques as the initial transcript verifier 124. Note that although the initial transcript verifier 124 and subsequent transcript verifier 132 are illustrated as two distinct components in FIG. 1, they may be integrated into a single component (e.g., a single software program).
  • The techniques just described may be viewed as implementing two tiers of “service level,” in which each tier corresponds to a different turnaround time requirement. The first (high-priority) tier of service level corresponds to a relatively short turnaround time, and the second (low-priority) tier of service level corresponds to a relatively long turnaround time. The priorities 122 assigned to portions of the draft transcript 106 may, however, be used to implement service levels corresponding to characteristics other than turnaround times.
  • For example, a first tier of service level may require the corresponding portion of the draft transcript 106 to be verified by a human, while a second tier of service level may not require human verification. For example, the second tier may require software verification or not require any verification. In this example, the method of FIG. 2 would include only steps 202-208. More specifically, step 202 would include transcribing the spoken audio stream to produce the draft transcript 106, as described above. Step 204 would include identifying priorities 122 of portions of the draft transcript 106. In this example, a high priority would indicate that human verification is required, while a low priority would indicate that human verification is not required.
  • Step 206 would include verifying only those portions of the draft transcript 106 having high priorities (i.e., only those portions of the draft transcript 106 requiring human verification). Such verification may, for example, be performed by providing the draft transcript 106 to a human reviewer (such as the dictating physician) for review.
  • The method 200 would then terminate, without verifying the low-priority portions of the draft transcript 106 because such portions have been identified as not requiring human verification. In yet another embodiment, a high service level would require verification by the dictating physician, a medium service level would require verification by a data entry clerk, and a low service level would not require any human verification.
  • Embodiments of the present invention have a variety of advantages. For example, transcripts of physician-dictated reports typically are not provided to nurses and others for use in patient care soon after a draft of the transcript has been produced because it has not been possible to verify the accuracy of the transcript quickly enough. As a result, draft transcripts typically are withheld until they have been verified, which can introduce a significant delay before such transcripts may be used.
  • One benefit of the techniques disclosed herein is that they make it possible to provide transcripts to consumers of such transcripts both quickly and with increased accuracy by limiting the amount of the transcript that is verified, at least at the outset. In particular, by limiting the verification, either initially or entirely, to high-priority portions of the draft transcript 106, the techniques illustrated in FIGS. 1 and 2 increase the accuracy of those portions of the draft transcript 106 for which accuracy is most critical, without introducing the significant delay that would otherwise be incurred by verifying the entire transcript.
  • Furthermore, the techniques disclosed herein do not create significant additional work for the physician or other dictator/reviewer of the transcript, and may thereby reduce the total amount of time they need to devote to performing their tasks. If, for example, the initial transcript verifier 124 presents high-priority portions of the draft transcript 106 to a physician for review immediately after the physician dictates such portions, or even while the physician is dictating such portions, the physician may verify and correct any errors in such portions more efficiently than if those portions of the transcript were provided to the physician for review an hour, day, or week later because of the switching costs involved. Furthermore, overall accuracy may be increased because the dictator/reviewer of the draft transcript 106 may have a clearer memory of the intended content of the draft transcript 106 is presented to him or her immediately after dictating it, rather than at a later time.
  • These techniques are particularly useful in contexts in which a transcript needs to be made available immediately to someone other than the dictator of the transcript. For example, the “impressions” section of a radiology report needs to be made available immediately for emergency room radiology studies, while the rest of the document may be completed at a later time. In order to guarantee immediate turnaround, the “impressions” section of the draft transcript 106 may be provided to the dictating physician immediately for self-correction, while leaving the remainder of the document to be corrected at a later time by professional transcriptionists.
  • As another example, the medication and allergy sections of a progress note may be interpreted and populated immediately in an electronic medical records (EMR) system to be available for order entry (i.e., prescription medications) and decision support at point of care. Other data elements (e.g., history of present illness) may be verified at a later time.
  • Another benefit of techniques disclosed herein is that they may be combined with the techniques disclosed in the above-referenced patent application entitled “Automatic Decision Support” for applying automated clinical decision support to transcripts. For example, the modified draft transcript 126 may be provided to an automated clinical decision support system, as described in the above-referenced patent application, to provide clinical decision support quickly. Such techniques may, for example, be used to provide a quick indication of whether the draft transcript 126 indicates a dangerous drug-drug allergy which requires attention by the dictating physician or other care provider. The techniques disclosed herein facilitate the provision of such rapid clinical decision support by enabling verification of high-priority portions of the draft transcript 106 to be performed soon after the draft transcript 106 is produced. If verification of such high-priority portions had to wait until all portions of the draft transcript 106 were verified, then application of automated clinical decision support to the high-priority portions would have to wait as well.
  • In this regard, portions of the draft transcript 106 which are necessary to provide as input a clinical decision support system may be assigned a high priority. As a result, the initial transcript verifier 124 will verify those portions of the draft transcript 106 which are necessary to provide as input to the clinical decision support system. This ensures that any desired clinical decision support can be applied to the modified draft transcript 126 produced by the initial transcript verifier 124, without incurring additional delay.
  • It is to be understood that although the invention has been described above in terms of particular embodiments, the foregoing embodiments are provided as illustrative only, and do not limit or define the scope of the invention. Various other embodiments, including but not limited to the following, are also within the scope of the claims. For example, elements and components described herein may be further divided into additional components or joined together to form fewer components for performing the same functions.
  • Although certain examples provided herein involve documents generated by a speech recognizer, this is not a requirement of the present invention. Rather, the techniques disclosed herein may be applied to any kind of document, regardless of how it was generated. Such techniques may, for example, be used in conjunction with documents typed using conventional text editors.
  • The spoken audio stream 102 may be any audio stream, such as a live audio stream received directly or indirectly (such as over a telephone or IP connection), or an audio stream recorded on any medium and in any format. In distributed speech recognition (DSR), a client performs preprocessing on an audio stream to produce a processed audio stream that is transmitted to a server, which performs speech recognition on the processed audio stream. The audio stream may, for example, be a processed audio stream produced by a DSR client.
  • The invention is not limited to any of the described domains (such as the medical and legal fields), but generally applies to any kind of documents in any domain. For example, although the reviewer 138 may be described herein as a physician, this is not a limitation of the present invention. Rather, the reviewer 138 may be any person. Furthermore, documents used in conjunction with embodiments of the present invention may be represented in any machine-readable form. Such forms include plain text documents and structured documents represented in markup languages such as XML. Such documents may be stored in any computer-readable medium and transmitted using any kind of communications channel and protocol.
  • Although certain examples described herein include only two priorities—high and low—these are merely examples of priorities and do not constitute limitations of the present invention. Rather, the techniques disclosed herein may be applied to any number of priorities defined and/or labeled in any manner. For example, there may be high, medium, and low priorities. As another examples, priorities may specify maximum turnaround times, such as one minute, one hour, and one day.
  • Furthermore, although in certain examples herein the high priority service level is described as providing “immediate” verification, this is not a requirement of the present invention. Rather, service levels may be defined and applied in any manner. For example, even when service levels define turnaround requirements, the highest-priority service level need not require immediate turnaround, but rather may require or allow any amount of delay.
  • Although certain examples disclosed herein apply different service levels to different portions of a single transcript, the same or similar techniques may be used to apply different service levels to different documents. In other words, a first (e.g., high-priority) service level may be applied to a first entire document and a second (e.g., low-priority) service level may be applied to a second entire document. The first and second documents may then be verified in accordance with their respective service levels.
  • For example, the transcription system 104 may transcribe a first spoken audio stream to produce a first draft transcript and apply automatic decision support to the first draft transcript using the techniques disclosed in the above-referenced patent application entitled, “Automatic Decision Support.” A first service level may be associated with the first draft transcript based on the results of the automatic decision support. For example, if automatic decision support determines that the draft transcript does not include any critical errors, then a low-priority service level may be associated with the first draft transcript.
  • The transcription system 104 may also transcribe a second spoken audio stream to produce a second draft transcript and apply automatic decision support to the second draft transcript using the above-described techniques. A second service level may be associated with the second draft transcript based on the results of the automatic decision support. For example, if automatic decision support determines that the second draft transcript contains a critical error (such as by describing a prescription that would result in a drug-drug allergy), then a high-priority service level may be associated with the second draft transcript.
  • The first and second draft transcripts may then be verified in accordance with their respective service levels. For example, the second draft transcript may be presented for verification before the first draft transcript, even though the first draft transcript was transcribed before the second draft transcript, because the second draft transcript is associated with a higher service level than the first draft transcript. As one example of processing the two draft transcripts in accordance with their respective service levels, a phone call might be made immediately to the dictating physician of the second draft transcript to alert him or her to the identified error. As another example, the second draft transcript might be placed at the top of the queue of documents to which full verification is to be applied. In either case, the (low-priority) first draft transcript may be verified at a later time. Such application of different service levels to different documents shares benefits of the techniques disclosed herein for applying different service levels to different portions of a single document.
  • Although the verification statuses 130 may include statuses such as “correct” and “incorrect,” the invention is not so limited. Rather, the verification statuses 130 may take any of a variety of forms. Further examples of the verification statuses and techniques for producing them may be found in the above-referenced patent application entitled, “Verification of Extracted Data.”
  • Although certain individual types of service levels are described herein, such service levels are merely examples and do not constitute limitations of the present invention. For example, the above-referenced patent application entitled, “Automatic Decision Support,” discloses techniques for performing real-time automatic decision support, in which decision support is applied to a transcript-in-progress while the physician (or other speaker) is still dictating the report. If the decision support system identifies a critical error or other problem requiring the immediate attention of the speaker-reviewer, the system notifies the speaker-reviewer of the problem while the report is still being dictated. Such immediate, real-time presentation of a partial transcript for review may be viewed as a service level, in comparison, for example, to service levels in which lower-priority errors are not deferred until dictation of the report is complete.
  • Furthermore, service levels not disclosed herein may be used in conjunction with the techniques disclosed herein. Furthermore, service levels may be combined with each other in various ways. For example, a “high-priority” service level may be applied to any portions of the draft transcript 106 which:
  • (1) are within predetermined sections of the transcript 106; or
    (2) which require human verification.
  • The verification performed by the initial transcript verifier 124 and the subsequent transcript verifier 132 may be performed in whole or in part by a human, such as the dictator of the draft transcript 106. To facilitate such verification, the high-priority portions of the draft transcript 106 may be called out to the reviewer, such as by highlighting them or displaying them in a different color within a display of the draft transcript 106. Such a display may, for example, be displayed to the reviewer while the reviewer is dictating the contents of the transcript 106.
  • The techniques described above may be implemented, for example, in hardware, software, firmware, or any combination thereof. The techniques described above may be implemented in one or more computer programs executing on a programmable computer including a processor, a storage medium readable by the processor (including, for example, volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Program code may be applied to input entered using the input device to perform the functions described and to generate output. The output may be provided to one or more output devices.
  • Each computer program within the scope of the claims below may be implemented in any programming language, such as assembly language, machine language, a high-level procedural programming language, or an object-oriented programming language. The programming language may, for example, be a compiled or interpreted programming language.
  • Each such computer program may be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a computer processor. Method steps of the invention may be performed by a computer processor executing a program tangibly embodied on a computer-readable medium to perform functions of the invention by operating on input and generating output. Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, the processor receives instructions and data from a read-only memory and/or a random access memory. Storage devices suitable for tangibly embodying computer program instructions include, for example, all forms of non-volatile memory, such as semiconductor memory devices, including EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROMs. Any of the foregoing may be supplemented by, or incorporated in, specially-designed ASICs (application-specific integrated circuits) or FPGAs (Field-Programmable Gate Arrays). A computer can generally also receive programs and data from a storage medium such as an internal disk (not shown) or a removable disk. These elements will also be found in a conventional desktop or workstation computer as well as other computers suitable for executing computer programs implementing the methods described herein, which may be used in conjunction with any digital print engine or marking engine, display monitor, or other raster output device capable of producing color or gray scale pixels on paper, film, display screen, or other output medium.

Claims (1)

What is claimed is:
1. A computer-implemented method comprising:
(A) identifying a first semantic meaning of a first portion of a first transcript of speech;
(B) assigning a first service level to the first portion of the transcript based on the first semantic meaning;
(C) identifying a second semantic meaning of a second portion of the first transcript;
(D) assigning a second service level to the second portion of the transcript based on the second semantic meaning; and
(E) at a processor, verifying the transcript in accordance with the first and second service levels.
US14/052,005 2006-06-22 2013-10-11 Applying Service Levels to Transcripts Abandoned US20140039880A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/052,005 US20140039880A1 (en) 2006-06-22 2013-10-11 Applying Service Levels to Transcripts

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US81568706P 2006-06-22 2006-06-22
US81568806P 2006-06-22 2006-06-22
US81568906P 2006-06-22 2006-06-22
US11/766,784 US8560314B2 (en) 2006-06-22 2007-06-21 Applying service levels to transcripts
US14/052,005 US20140039880A1 (en) 2006-06-22 2013-10-11 Applying Service Levels to Transcripts

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/766,784 Continuation US8560314B2 (en) 2006-06-22 2007-06-21 Applying service levels to transcripts

Publications (1)

Publication Number Publication Date
US20140039880A1 true US20140039880A1 (en) 2014-02-06

Family

ID=38834406

Family Applications (10)

Application Number Title Priority Date Filing Date
US11/766,784 Active 2030-12-26 US8560314B2 (en) 2006-06-22 2007-06-21 Applying service levels to transcripts
US11/766,780 Abandoned US20070299665A1 (en) 2006-06-22 2007-06-21 Automatic Decision Support
US11/766,767 Active US7716040B2 (en) 2006-06-22 2007-06-21 Verification of extracted data
US12/771,193 Active US8321199B2 (en) 2006-06-22 2010-04-30 Verification of extracted data
US13/563,949 Active US8521514B2 (en) 2006-06-22 2012-08-01 Verification of extracted data
US13/888,290 Expired - Fee Related US9892734B2 (en) 2006-06-22 2013-05-06 Automatic decision support
US13/975,833 Active US8768694B2 (en) 2006-06-22 2013-08-26 Verification of extracted data
US14/052,005 Abandoned US20140039880A1 (en) 2006-06-22 2013-10-11 Applying Service Levels to Transcripts
US14/317,323 Abandoned US20140316772A1 (en) 2006-06-22 2014-06-27 Verification of Extracted Data
US15/892,876 Active US10339937B2 (en) 2006-06-22 2018-02-09 Automatic decision support

Family Applications Before (7)

Application Number Title Priority Date Filing Date
US11/766,784 Active 2030-12-26 US8560314B2 (en) 2006-06-22 2007-06-21 Applying service levels to transcripts
US11/766,780 Abandoned US20070299665A1 (en) 2006-06-22 2007-06-21 Automatic Decision Support
US11/766,767 Active US7716040B2 (en) 2006-06-22 2007-06-21 Verification of extracted data
US12/771,193 Active US8321199B2 (en) 2006-06-22 2010-04-30 Verification of extracted data
US13/563,949 Active US8521514B2 (en) 2006-06-22 2012-08-01 Verification of extracted data
US13/888,290 Expired - Fee Related US9892734B2 (en) 2006-06-22 2013-05-06 Automatic decision support
US13/975,833 Active US8768694B2 (en) 2006-06-22 2013-08-26 Verification of extracted data

Family Applications After (2)

Application Number Title Priority Date Filing Date
US14/317,323 Abandoned US20140316772A1 (en) 2006-06-22 2014-06-27 Verification of Extracted Data
US15/892,876 Active US10339937B2 (en) 2006-06-22 2018-02-09 Automatic decision support

Country Status (5)

Country Link
US (10) US8560314B2 (en)
EP (3) EP2030196B1 (en)
JP (4) JP5167256B2 (en)
CA (3) CA2652441C (en)
WO (3) WO2007150004A2 (en)

Families Citing this family (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100517300C (en) 2002-11-28 2009-07-22 皇家飞利浦电子股份有限公司 Method to assign word class information
US9710819B2 (en) * 2003-05-05 2017-07-18 Interactions Llc Real-time transcription system utilizing divided audio chunks
US8335688B2 (en) * 2004-08-20 2012-12-18 Multimodal Technologies, Llc Document transcription system training
US20130304453A9 (en) * 2004-08-20 2013-11-14 Juergen Fritsch Automated Extraction of Semantic Content and Generation of a Structured Document from Speech
US7844464B2 (en) * 2005-07-22 2010-11-30 Multimodal Technologies, Inc. Content-based audio playback emphasis
US7584103B2 (en) * 2004-08-20 2009-09-01 Multimodal Technologies, Inc. Automated extraction of semantic content and generation of a structured document from speech
US7502741B2 (en) * 2005-02-23 2009-03-10 Multimodal Technologies, Inc. Audio signal de-identification
US7640158B2 (en) 2005-11-08 2009-12-29 Multimodal Technologies, Inc. Automatic detection and application of editing patterns in draft documents
JP5167256B2 (en) 2006-06-22 2013-03-21 マルチモーダル・テクノロジーズ・エルエルシー Computer mounting method
US20080177623A1 (en) * 2007-01-24 2008-07-24 Juergen Fritsch Monitoring User Interactions With A Document Editing System
US8348839B2 (en) * 2007-04-10 2013-01-08 General Electric Company Systems and methods for active listening/observing and event detection
US8019608B2 (en) 2008-08-29 2011-09-13 Multimodal Technologies, Inc. Distributed speech recognition using one way communication
US20100125450A1 (en) 2008-10-27 2010-05-20 Spheris Inc. Synchronized transcription rules handling
US20100145720A1 (en) * 2008-12-05 2010-06-10 Bruce Reiner Method of extracting real-time structured data and performing data analysis and decision support in medical reporting
WO2011100474A2 (en) 2010-02-10 2011-08-18 Multimodal Technologies, Inc. Providing computable guidance to relevant evidence in question-answering systems
EP2539865A4 (en) 2010-02-26 2014-12-17 Mmodal Ip Llc Clinical data reconciliation as part of a report generation solution
US20150279354A1 (en) * 2010-05-19 2015-10-01 Google Inc. Personalization and Latency Reduction for Voice-Activated Commands
US9613325B2 (en) * 2010-06-30 2017-04-04 Zeus Data Solutions Diagnosis-driven electronic charting
US8630842B2 (en) * 2010-06-30 2014-01-14 Zeus Data Solutions Computerized selection for healthcare services
US20220398270A1 (en) * 2010-09-01 2022-12-15 Apixio, Inc. Systems and methods for customized annotation of medical information
US8463673B2 (en) 2010-09-23 2013-06-11 Mmodal Ip Llc User feedback in semi-automatic question answering systems
US8959102B2 (en) 2010-10-08 2015-02-17 Mmodal Ip Llc Structured searching of dynamic structured document corpuses
US8924394B2 (en) 2011-02-18 2014-12-30 Mmodal Ip Llc Computer-assisted abstraction for reporting of quality measures
US10032127B2 (en) 2011-02-18 2018-07-24 Nuance Communications, Inc. Methods and apparatus for determining a clinician's intent to order an item
US10460288B2 (en) 2011-02-18 2019-10-29 Nuance Communications, Inc. Methods and apparatus for identifying unspecified diagnoses in clinical documentation
US8768723B2 (en) 2011-02-18 2014-07-01 Nuance Communications, Inc. Methods and apparatus for formatting text for clinical fact extraction
US9904768B2 (en) 2011-02-18 2018-02-27 Nuance Communications, Inc. Methods and apparatus for presenting alternative hypotheses for medical facts
US8781829B2 (en) * 2011-06-19 2014-07-15 Mmodal Ip Llc Document extension in dictation-based document generation workflow
US9286035B2 (en) 2011-06-30 2016-03-15 Infosys Limited Code remediation
US9021565B2 (en) 2011-10-13 2015-04-28 At&T Intellectual Property I, L.P. Authentication techniques utilizing a computing device
WO2013082087A1 (en) 2011-11-28 2013-06-06 Voicehit Electronic health record system and method for patient encounter transcription and documentation
US9569594B2 (en) 2012-03-08 2017-02-14 Nuance Communications, Inc. Methods and apparatus for generating clinical reports
US9679077B2 (en) * 2012-06-29 2017-06-13 Mmodal Ip Llc Automated clinical evidence sheet workflow
JP6388864B2 (en) 2012-08-13 2018-09-12 エムモーダル アイピー エルエルシー Maintaining discrete data representations corresponding to information contained in free-form text
US9710431B2 (en) * 2012-08-18 2017-07-18 Health Fidelity, Inc. Systems and methods for processing patient information
US11024406B2 (en) 2013-03-12 2021-06-01 Nuance Communications, Inc. Systems and methods for identifying errors and/or critical results in medical reports
CN103198220A (en) * 2013-04-08 2013-07-10 浙江大学医学院附属第二医院 Computer-aided antibacterial agent clinical application mid-diagnosis decision making system
US9154617B2 (en) * 2013-04-19 2015-10-06 International Business Machines Corporation Recording and playing back portions of a telephone call
US11183300B2 (en) * 2013-06-05 2021-11-23 Nuance Communications, Inc. Methods and apparatus for providing guidance to medical professionals
US10496743B2 (en) 2013-06-26 2019-12-03 Nuance Communications, Inc. Methods and apparatus for extracting facts from a medical text
US20150121456A1 (en) * 2013-10-25 2015-04-30 International Business Machines Corporation Exploiting trust level lifecycle events for master data to publish security events updating identity management
US10324966B2 (en) 2014-03-21 2019-06-18 Mmodal Ip Llc Search by example
US10373711B2 (en) 2014-06-04 2019-08-06 Nuance Communications, Inc. Medical coding system with CDI clarification request notification
US10950329B2 (en) 2015-03-13 2021-03-16 Mmodal Ip Llc Hybrid human and computer-assisted coding workflow
US11152084B2 (en) * 2016-01-13 2021-10-19 Nuance Communications, Inc. Medical report coding with acronym/abbreviation disambiguation
US10043135B2 (en) * 2016-03-08 2018-08-07 InferLink Corporation Textual information extraction, parsing, and inferential analysis
EP3223179A1 (en) * 2016-03-24 2017-09-27 Fujitsu Limited A healthcare risk extraction system and method
US10860685B2 (en) * 2016-11-28 2020-12-08 Google Llc Generating structured text content using speech recognition models
CA3050101A1 (en) 2017-01-17 2018-07-26 Mmodal Ip Llc Methods and systems for manifestation and transmission of follow-up notifications
WO2018152352A1 (en) 2017-02-18 2018-08-23 Mmodal Ip Llc Computer-automated scribe tools
US20180315428A1 (en) * 2017-04-27 2018-11-01 3Play Media, Inc. Efficient transcription systems and methods
US11055481B2 (en) 2017-06-29 2021-07-06 Spalo Co., Ltd. Information input method, information input apparatus, and information input system
EP3648032A1 (en) * 2017-06-29 2020-05-06 Bizocean Co., Ltd. Information inputting method, information inputting device, and information inputting system
US11133091B2 (en) 2017-07-21 2021-09-28 Nuance Communications, Inc. Automated analysis system and method
US11024424B2 (en) * 2017-10-27 2021-06-01 Nuance Communications, Inc. Computer assisted coding systems and methods
US11222056B2 (en) * 2017-11-13 2022-01-11 International Business Machines Corporation Gathering information on user interactions with natural language processor (NLP) items to order presentation of NLP items in documents
US11782967B2 (en) 2017-11-13 2023-10-10 International Business Machines Corporation Determining user interactions with natural language processor (NPL) items in documents to determine priorities to present NPL items in documents to review
US11282596B2 (en) 2017-11-22 2022-03-22 3M Innovative Properties Company Automated code feedback system
US10387576B2 (en) * 2017-11-30 2019-08-20 International Business Machines Corporation Document preparation with argumentation support from a deep question answering system
US11037665B2 (en) 2018-01-11 2021-06-15 International Business Machines Corporation Generating medication orders from a clinical encounter
US11488602B2 (en) 2018-02-20 2022-11-01 Dropbox, Inc. Meeting transcription using custom lexicons based on document history
US10467335B2 (en) * 2018-02-20 2019-11-05 Dropbox, Inc. Automated outline generation of captured meeting audio in a collaborative document context
US10657954B2 (en) 2018-02-20 2020-05-19 Dropbox, Inc. Meeting audio capture and transcription in a collaborative document context
US20190272921A1 (en) * 2018-03-02 2019-09-05 Mmodal Ip Llc Automated Diagnostic Support System for Clinical Documentation Workflows
US11461801B2 (en) * 2018-03-02 2022-10-04 Adobe Inc. Detecting and resolving semantic misalignments between digital messages and external digital content
US11670291B1 (en) * 2019-02-22 2023-06-06 Suki AI, Inc. Systems, methods, and storage media for providing an interface for textual editing through speech
US11341204B2 (en) 2019-05-22 2022-05-24 Adobe Inc. Identifying and presenting misalignments between digital messages and external digital content
US11689379B2 (en) 2019-06-24 2023-06-27 Dropbox, Inc. Generating customized meeting insights based on user interactions and meeting media
US20210241773A1 (en) * 2020-02-04 2021-08-05 Frank Appiah Voice recording & label making system
US11830586B2 (en) 2020-12-08 2023-11-28 Kyndryl, Inc. Enhancement of patient outcome forecasting
US20220383874A1 (en) 2021-05-28 2022-12-01 3M Innovative Properties Company Documentation system based on dynamic semantic templates
US20230317225A1 (en) * 2022-03-29 2023-10-05 ScribeAmerica, LLC Platform and interfaces for clinical services
CN115082045B (en) * 2022-08-22 2023-01-03 深圳译码阁科技有限公司 Data proofreading method and device, computer equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020124018A1 (en) * 2000-07-31 2002-09-05 Fifield Davin J. Transcript management software and methods therefor
US20030110030A1 (en) * 2001-10-12 2003-06-12 Koninklijke Philips Electronics N.V. Correction device to mark parts of a recognized text
US20030191627A1 (en) * 1998-05-28 2003-10-09 Lawrence Au Topological methods to organize semantic network data flows for conversational applications
US20070043761A1 (en) * 2005-08-22 2007-02-22 The Personal Bee, Inc. Semantic discovery engine
US20070239445A1 (en) * 2006-04-11 2007-10-11 International Business Machines Corporation Method and system for automatic transcription prioritization
US7908145B2 (en) * 1993-03-24 2011-03-15 Engate Llc Down-line transcription system using automatic tracking and revenue collection

Family Cites Families (211)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS62221775A (en) 1986-03-20 1987-09-29 Fujitsu Ltd Natural language processing system
US5329609A (en) 1990-07-31 1994-07-12 Fujitsu Limited Recognition apparatus with function of displaying plural recognition candidates
US5434962A (en) 1990-09-07 1995-07-18 Fuji Xerox Co., Ltd. Method and system for automatically generating logical structures of electronic documents
JPH0769921B2 (en) 1990-11-09 1995-07-31 株式会社日立製作所 Document logical structure generation method
AU2868092A (en) * 1991-09-30 1993-05-03 Riverrun Technology Method and apparatus for managing information
JPH06168267A (en) 1992-11-30 1994-06-14 Itec:Kk Structural document preparing method and structural document preparation supporting device
DE4397100C2 (en) 1992-12-31 2003-02-27 Apple Computer Method for recognizing speech signals and speech recognition system with recursive grammar with a finite number of states
US5384892A (en) 1992-12-31 1995-01-24 Apple Computer, Inc. Dynamic language model for speech recognition
US6206829B1 (en) * 1996-07-12 2001-03-27 First Opinion Corporation Computerized medical diagnostic and treatment advice system including network access
US5594638A (en) 1993-12-29 1997-01-14 First Opinion Corporation Computerized medical diagnostic system including re-enter function and sensitivity factors
NZ248751A (en) * 1994-03-23 1997-11-24 Ryan John Kevin Text analysis and coding
JPH07325597A (en) * 1994-05-31 1995-12-12 Fuji Xerox Co Ltd Information input method and device for executing its method
JP2618832B2 (en) * 1994-06-16 1997-06-11 日本アイ・ビー・エム株式会社 Method and system for analyzing logical structure of document
US6061675A (en) 1995-05-31 2000-05-09 Oracle Corporation Methods and apparatus for classifying terminology utilizing a knowledge catalog
US5701469A (en) * 1995-06-07 1997-12-23 Microsoft Corporation Method and system for generating accurate search results using a content-index
US5664109A (en) 1995-06-07 1997-09-02 E-Systems, Inc. Method for extracting pre-defined data items from medical service records generated by health care providers
JPH09106428A (en) * 1995-10-11 1997-04-22 Kitsusei Comtec Kk Finding preparing device
GB9525719D0 (en) * 1995-12-15 1996-02-14 Hewlett Packard Co Speech system
US6041292A (en) 1996-01-16 2000-03-21 Jochim; Carol Real time stenographic system utilizing vowel omission principle
US6684188B1 (en) * 1996-02-02 2004-01-27 Geoffrey C Mitchell Method for production of medical records and other technical documents
US5835893A (en) * 1996-02-15 1998-11-10 Atr Interpreting Telecommunications Research Labs Class-based word clustering for speech recognition using a three-level balanced hierarchical similarity
US5870706A (en) 1996-04-10 1999-02-09 Lucent Technologies, Inc. Method and apparatus for an improved language recognition system
US5823948A (en) 1996-07-08 1998-10-20 Rlis, Inc. Medical records, documentation, tracking and order entry system
AU728675C (en) * 1996-07-12 2001-11-08 First Opinion Corporation Computerized medical diagnostic and treatment advice system including list based processing
US5797123A (en) * 1996-10-01 1998-08-18 Lucent Technologies Inc. Method of key-phase detection and verification for flexible speech understanding
US6182029B1 (en) 1996-10-28 2001-01-30 The Trustees Of Columbia University In The City Of New York System and method for language extraction and encoding utilizing the parsing of text data in accordance with domain parameters
US6055494A (en) * 1996-10-28 2000-04-25 The Trustees Of Columbia University In The City Of New York System and method for medical language extraction and encoding
US5839106A (en) * 1996-12-17 1998-11-17 Apple Computer, Inc. Large-vocabulary speech recognition using an integrated syntactic and semantic statistical language model
US6122613A (en) * 1997-01-30 2000-09-19 Dragon Systems, Inc. Speech recognition using multiple recognizers (selectively) applied to the same input sample
US5995936A (en) 1997-02-04 1999-11-30 Brais; Louis Report generation system and method for capturing prose, audio, and video by voice command and automatically linking sound and image to formatted text locations
CN1252877A (en) * 1997-03-13 2000-05-10 第一咨询公司 Disease management system
US5970449A (en) 1997-04-03 1999-10-19 Microsoft Corporation Text normalization using a context-free grammar
US6126596A (en) 1997-06-02 2000-10-03 Freedman; Joshua Apparatus and method for evaluating a client's condition and the concordance of a clinician's treatment with treatment guidelines
US6490561B1 (en) * 1997-06-25 2002-12-03 Dennis L. Wilson Continuous speech voice transcription
US5926784A (en) * 1997-07-17 1999-07-20 Microsoft Corporation Method and system for natural language parsing using podding
EP0903727A1 (en) 1997-09-17 1999-03-24 Istituto Trentino Di Cultura A system and method for automatic speech recognition
AU9513198A (en) 1997-09-30 1999-04-23 Ihc Health Services, Inc. Aprobabilistic system for natural language processing
US6112168A (en) 1997-10-20 2000-08-29 Microsoft Corporation Automatically recognizing the discourse structure of a body of text
US6304870B1 (en) 1997-12-02 2001-10-16 The Board Of Regents Of The University Of Washington, Office Of Technology Transfer Method and apparatus of automatically generating a procedure for extracting information from textual information sources
US6006183A (en) * 1997-12-16 1999-12-21 International Business Machines Corp. Speech recognition confidence level display
US6154722A (en) * 1997-12-18 2000-11-28 Apple Computer, Inc. Method and apparatus for a speech recognition system language model that integrates a finite state grammar probability and an N-gram probability
US6782510B1 (en) * 1998-01-27 2004-08-24 John N. Gross Word checking tool for controlling the language content in documents using dictionaries with modifyable status fields
DE19809563A1 (en) 1998-03-05 1999-09-09 Siemens Ag Medical work station for treating patient
US6182039B1 (en) 1998-03-24 2001-01-30 Matsushita Electric Industrial Co., Ltd. Method and apparatus using probabilistic language model based on confusable sets for speech recognition
US7043426B2 (en) 1998-04-01 2006-05-09 Cyberpulse, L.L.C. Structured speech recognition
US6915254B1 (en) * 1998-07-30 2005-07-05 A-Life Medical, Inc. Automatically assigning medical codes using natural language processing
US6304848B1 (en) 1998-08-13 2001-10-16 Medical Manager Corp. Medical record forming and storing apparatus and medical record and method related to same
US6064961A (en) * 1998-09-02 2000-05-16 International Business Machines Corporation Display for proofreading text
US6064965A (en) * 1998-09-02 2000-05-16 International Business Machines Corporation Combined audio playback in speech recognition proofreader
US6122614A (en) * 1998-11-20 2000-09-19 Custom Speech Usa, Inc. System and method for automating transcription services
US6249765B1 (en) 1998-12-22 2001-06-19 Xerox Corporation System and method for extracting data from audio messages
US6243669B1 (en) 1999-01-29 2001-06-05 Sony Corporation Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation
US6278968B1 (en) 1999-01-29 2001-08-21 Sony Corporation Method and apparatus for adaptive speech recognition hypothesis construction and selection in a spoken language translation system
WO2000054180A1 (en) 1999-03-05 2000-09-14 Cai Co., Ltd. System and method for creating formatted document on the basis of conversational speech recognition
JP2000259175A (en) 1999-03-08 2000-09-22 Mitsubishi Electric Corp Voice recognition device
US6526380B1 (en) * 1999-03-26 2003-02-25 Koninklijke Philips Electronics N.V. Speech recognition system having parallel large vocabulary recognition engines
US6609087B1 (en) * 1999-04-28 2003-08-19 Genuity Inc. Fact recognition system
US6611802B2 (en) * 1999-06-11 2003-08-26 International Business Machines Corporation Method and system for proofreading and correcting dictated text
US7475019B2 (en) * 1999-11-18 2009-01-06 Visicu, Inc. System and method for physician note creation and management
US6345249B1 (en) * 1999-07-07 2002-02-05 International Business Machines Corp. Automatic analysis of a speech dictated document
US6865258B1 (en) 1999-08-13 2005-03-08 Intervoice Limited Partnership Method and system for enhanced transcription
US20030195774A1 (en) 1999-08-30 2003-10-16 Abbo Fred E. Medical practice management system
US6963837B1 (en) 1999-10-06 2005-11-08 Multimodal Technologies, Inc. Attribute-based word modeling
US6434547B1 (en) 1999-10-28 2002-08-13 Qenm.Com Data capture and verification system
US7392185B2 (en) * 1999-11-12 2008-06-24 Phoenix Solutions, Inc. Speech based learning/training system using semantic decoding
US7725307B2 (en) * 1999-11-12 2010-05-25 Phoenix Solutions, Inc. Query engine for processing voice based queries including semantic decoding
DE60023736T2 (en) 1999-12-02 2006-08-10 Thomson Licensing METHOD AND DEVICE FOR VOICE RECOGNITION WITH VARIOUS LANGUAGE MODELS
US6535849B1 (en) 2000-01-18 2003-03-18 Scansoft, Inc. Method and system for generating semi-literal transcripts for speech recognition systems
UA73967C2 (en) * 2000-02-14 2005-10-17 First Opinion Corp Structure-based automatic processing for diagnostics (variants)
JP3896760B2 (en) * 2000-03-28 2007-03-22 富士ゼロックス株式会社 Dialog record editing apparatus, method, and storage medium
US6738784B1 (en) 2000-04-06 2004-05-18 Dictaphone Corporation Document and information processing system
AU2001259446A1 (en) * 2000-05-02 2001-11-12 Dragon Systems, Inc. Error correction in speech recognition
US7447988B2 (en) 2000-05-10 2008-11-04 Ross Gary E Augmentation system for documentation
GB0011798D0 (en) 2000-05-16 2000-07-05 Canon Kk Database annotation and retrieval
ES2467154T3 (en) * 2000-05-18 2014-06-12 Commwell, Inc. Method for remote medical monitoring that incorporates video processing
US6662168B1 (en) 2000-05-19 2003-12-09 International Business Machines Corporation Coding system for high data volume
US6636848B1 (en) 2000-05-31 2003-10-21 International Business Machines Corporation Information search using knowledge agents
US7031908B1 (en) 2000-06-01 2006-04-18 Microsoft Corporation Creating a language model for a language processing system
WO2001097213A1 (en) * 2000-06-12 2001-12-20 L & H Holdings Usa, Inc. Speech recognition using utterance-level confidence estimates
US7490092B2 (en) 2000-07-06 2009-02-10 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US6785651B1 (en) 2000-09-14 2004-08-31 Microsoft Corporation Method and apparatus for performing plan-based dialog
US6435849B1 (en) * 2000-09-15 2002-08-20 Paul L. Guilmette Fluid pump
JP4108948B2 (en) 2000-09-25 2008-06-25 富士通株式会社 Apparatus and method for viewing a plurality of documents
CA2466273A1 (en) 2000-11-07 2003-06-13 Ascriptus, Inc. System for the creation of database and structured information from verbal input
JP2004514981A (en) 2000-11-22 2004-05-20 リケア・インコーポレイテッド System and method for recording medical findings of a medical test
US20020077833A1 (en) * 2000-12-20 2002-06-20 Arons Barry M. Transcription and reporting system
US6937983B2 (en) * 2000-12-20 2005-08-30 International Business Machines Corporation Method and system for semantic speech recognition
US20020087311A1 (en) 2000-12-29 2002-07-04 Leung Lee Victor Wai Computer-implemented dynamic language model generation method and system
US20020087315A1 (en) 2000-12-29 2002-07-04 Lee Victor Wai Leung Computer-implemented multi-scanning language method and system
US6714939B2 (en) 2001-01-08 2004-03-30 Softface, Inc. Creation of structured data from plain text
US20020099717A1 (en) 2001-01-24 2002-07-25 Gordon Bennett Method for report generation in an on-line transcription system
WO2002082318A2 (en) 2001-02-22 2002-10-17 Volantia Holdings Limited System and method for extracting information
US6754626B2 (en) * 2001-03-01 2004-06-22 International Business Machines Corporation Creating a hierarchical tree of language models for a dialog system based on prompt and dialog context
US7346521B2 (en) * 2001-03-05 2008-03-18 Ims Health Incorporated System and methods for generating physician profiles concerning prescription therapy practices
US7366979B2 (en) 2001-03-09 2008-04-29 Copernicus Investments, Llc Method and apparatus for annotating a document
EP1490790A2 (en) 2001-03-13 2004-12-29 Intelligate Ltd. Dynamic natural language understanding
JP2002272990A (en) 2001-03-21 2002-09-24 Heiwa Corp Pattern display method for game machine
US6834264B2 (en) 2001-03-29 2004-12-21 Provox Technologies Corporation Method and apparatus for voice dictation and document production
US20020147616A1 (en) 2001-04-05 2002-10-10 Mdeverywhere, Inc. Method and apparatus for introducing medical necessity policy into the clinical decision making process at the point of care
US7188064B2 (en) 2001-04-13 2007-03-06 University Of Texas System Board Of Regents System and method for automatic semantic coding of free response data using Hidden Markov Model methodology
US6973428B2 (en) 2001-05-24 2005-12-06 International Business Machines Corporation System and method for searching, analyzing and displaying text transcripts of speech after imperfect speech recognition
US7519529B1 (en) 2001-06-29 2009-04-14 Microsoft Corporation System and methods for inferring informational goals and preferred level of detail of results in response to questions posed to an automated information-retrieval or question-answering service
JP2003022091A (en) 2001-07-10 2003-01-24 Nippon Hoso Kyokai <Nhk> Method, device, and program for voice recognition
DE10138408A1 (en) 2001-08-04 2003-02-20 Philips Corp Intellectual Pty Method for assisting the proofreading of a speech-recognized text with a reproduction speed curve adapted to the recognition reliability
JP2003058559A (en) 2001-08-17 2003-02-28 Hitachi Ltd Document classification method, retrieval method, classification system, and retrieval system
US7529685B2 (en) * 2001-08-28 2009-05-05 Md Datacor, Inc. System, method, and apparatus for storing, retrieving, and integrating clinical, diagnostic, genomic, and therapeutic data
US20030065503A1 (en) * 2001-09-28 2003-04-03 Philips Electronics North America Corp. Multi-lingual transcription system
EP1442407A1 (en) * 2001-10-03 2004-08-04 Mdoffices.Com, Inc. Health care management method and system
US20030069760A1 (en) * 2001-10-04 2003-04-10 Arthur Gelber System and method for processing and pre-adjudicating patient benefit claims
JP4434536B2 (en) * 2001-10-10 2010-03-17 株式会社東芝 Electronic medical record system
US7555425B2 (en) * 2001-10-18 2009-06-30 Oon Yeong K System and method of improved recording of medical transactions
US20030083903A1 (en) 2001-10-30 2003-05-01 Myers Gene E. Method and apparatus for contemporaneous billing and documenting with rendered services
DE60211197T2 (en) 2001-10-31 2007-05-03 Koninklijke Philips Electronics N.V. METHOD AND DEVICE FOR THE CONVERSION OF SPANISHED TEXTS AND CORRECTION OF THE KNOWN TEXTS
US20030105638A1 (en) 2001-11-27 2003-06-05 Taira Rick K. Method and system for creating computer-understandable structured medical data from natural language reports
US20030101054A1 (en) 2001-11-27 2003-05-29 Ncc, Llc Integrated system and method for electronic speech recognition and transcription
JP2003202895A (en) * 2002-01-10 2003-07-18 Sony Corp Interaction device and interaction control method, storage medium, and computer program
US20030144885A1 (en) * 2002-01-29 2003-07-31 Exscribe, Inc. Medical examination and transcription method, and associated apparatus
US20050154690A1 (en) 2002-02-04 2005-07-14 Celestar Lexico-Sciences, Inc Document knowledge management apparatus and method
US20030154085A1 (en) * 2002-02-08 2003-08-14 Onevoice Medical Corporation Interactive knowledge base system
US20030163348A1 (en) * 2002-02-27 2003-08-28 Stead William W. Method and system for clinical action support
US20110301982A1 (en) 2002-04-19 2011-12-08 Green Jr W T Integrated medical software system with clinical decision support
US8738396B2 (en) * 2002-04-19 2014-05-27 Greenway Medical Technologies, Inc. Integrated medical software system with embedded transcription functionality
US7716072B1 (en) * 2002-04-19 2010-05-11 Greenway Medical Technologies, Inc. Integrated medical software system
US7257531B2 (en) * 2002-04-19 2007-08-14 Medcom Information Systems, Inc. Speech to text system using controlled vocabulary indices
US7869998B1 (en) * 2002-04-23 2011-01-11 At&T Intellectual Property Ii, L.P. Voice-enabled dialog system
US7197460B1 (en) 2002-04-23 2007-03-27 At&T Corp. System for handling frequently asked questions in a natural language dialog service
US7292975B2 (en) 2002-05-01 2007-11-06 Nuance Communications, Inc. Systems and methods for evaluating speaker suitability for automatic speech recognition aided transcription
US7548847B2 (en) * 2002-05-10 2009-06-16 Microsoft Corporation System for automatically annotating training data for a natural language understanding system
US7028038B1 (en) * 2002-07-03 2006-04-11 Mayo Foundation For Medical Education And Research Method for generating training data for medical text abbreviation and acronym normalization
US20040073458A1 (en) 2002-07-31 2004-04-15 Aviacode Inc. Method and system for processing medical records
US20040230404A1 (en) 2002-08-19 2004-11-18 Messmer Richard Paul System and method for optimizing simulation of a discrete event process using business system data
US20060041836A1 (en) 2002-09-12 2006-02-23 Gordon T J Information documenting system with improved speed, completeness, retriveability and granularity
US7016844B2 (en) * 2002-09-26 2006-03-21 Core Mobility, Inc. System and method for online transcription services
US8606594B2 (en) 2002-10-29 2013-12-10 Practice Velocity, LLC Method and system for automated medical records processing
US6996520B2 (en) * 2002-11-22 2006-02-07 Transclick, Inc. Language translation system and method using specialized dictionaries
EP1573624A4 (en) 2002-12-03 2008-01-02 Siemens Medical Solutions Systems and methods for automated extraction and processing of billing information in patient records
US7774694B2 (en) 2002-12-06 2010-08-10 3M Innovation Properties Company Method and system for server-based sequential insertion processing of speech recognition results
US7444285B2 (en) 2002-12-06 2008-10-28 3M Innovative Properties Company Method and system for sequential insertion of speech recognition results to facilitate deferred transcription services
JP4415546B2 (en) 2003-01-06 2010-02-17 三菱電機株式会社 Spoken dialogue processing apparatus and program thereof
JP4249534B2 (en) * 2003-01-15 2009-04-02 株式会社京三製作所 Data processing apparatus, data verification method, and data verification program
US20040148170A1 (en) 2003-01-23 2004-07-29 Alejandro Acero Statistical classifiers for spoken language understanding and command/control scenarios
US7958443B2 (en) 2003-02-28 2011-06-07 Dictaphone Corporation System and method for structuring speech recognized text into a pre-selected document format
WO2004088635A1 (en) 2003-03-31 2004-10-14 Koninklijke Philips Electronics N.V. System for correction of speech recognition results with confidence level indication
US20040243545A1 (en) 2003-05-29 2004-12-02 Dictaphone Corporation Systems and methods utilizing natural language medical records
US8095544B2 (en) 2003-05-30 2012-01-10 Dictaphone Corporation Method, system, and apparatus for validation
WO2004097664A2 (en) * 2003-05-01 2004-11-11 Axonwave Software Inc. A method and system for concept generation and management
US7383172B1 (en) * 2003-08-15 2008-06-03 Patrick William Jamieson Process and system for semantically recognizing, correcting, and suggesting domain specific speech
US8311835B2 (en) 2003-08-29 2012-11-13 Microsoft Corporation Assisted multi-modal dialogue
US20050065774A1 (en) * 2003-09-20 2005-03-24 International Business Machines Corporation Method of self enhancement of search results through analysis of system logs
JP2005122128A (en) * 2003-09-25 2005-05-12 Fuji Photo Film Co Ltd Speech recognition system and program
US7860717B2 (en) 2003-09-25 2010-12-28 Dictaphone Corporation System and method for customizing speech recognition input and output
US20050120300A1 (en) 2003-09-25 2005-06-02 Dictaphone Corporation Method, system, and apparatus for assembly, transport and display of clinical data
JP4495431B2 (en) * 2003-09-26 2010-07-07 株式会社湯山製作所 ICD code assigning apparatus and method
US20050144184A1 (en) 2003-10-01 2005-06-30 Dictaphone Corporation System and method for document section segmentation
US7996223B2 (en) 2003-10-01 2011-08-09 Dictaphone Corporation System and method for post processing speech recognition output
US20050102140A1 (en) * 2003-11-12 2005-05-12 Joel Davne Method and system for real-time transcription and correction using an electronic communication environment
JP2005149083A (en) 2003-11-14 2005-06-09 Hitachi Medical Corp Electronic medical record input support apparatus
US20050137910A1 (en) 2003-12-19 2005-06-23 Rao R. B. Systems and methods for automated extraction and processing of billing information in patient records
US7542971B2 (en) * 2004-02-02 2009-06-02 Fuji Xerox Co., Ltd. Systems and methods for collaborative note-taking
KR101222294B1 (en) 2004-03-15 2013-01-15 야후! 인크. Search systems and methods with integration of user annotations
JP2005267358A (en) * 2004-03-19 2005-09-29 Hitachi Medical Corp Electronic medical charge formation/management system for local health care, and operation method thereof
JP2005284834A (en) * 2004-03-30 2005-10-13 Toshiba Corp Document input system, document input program, recording medium with document input program recorded, and document input method
US7379946B2 (en) 2004-03-31 2008-05-27 Dictaphone Corporation Categorization of information using natural language processing and predefined templates
US20050240439A1 (en) * 2004-04-15 2005-10-27 Artificial Medical Intelligence, Inc, System and method for automatic assignment of medical codes to unformatted data
US20050273365A1 (en) 2004-06-04 2005-12-08 Agfa Corporation Generalized approach to structured medical reporting
US20050288930A1 (en) 2004-06-09 2005-12-29 Vaastek, Inc. Computer voice recognition apparatus and method
JP2008506188A (en) 2004-07-09 2008-02-28 ジェスチャーラド インコーポレイテッド Gesture-based reporting method and system
JP4653976B2 (en) 2004-07-09 2011-03-16 Hoya株式会社 camera
US20060020886A1 (en) 2004-07-15 2006-01-26 Agrawal Subodh K System and method for the structured capture of information and the generation of semantically rich reports
US20060020492A1 (en) * 2004-07-26 2006-01-26 Cousineau Leo E Ontology based medical system for automatically generating healthcare billing codes from a patient encounter
US20060020466A1 (en) 2004-07-26 2006-01-26 Cousineau Leo E Ontology based medical patient evaluation method for data capture and knowledge representation
CA2575373C (en) 2004-07-30 2015-09-08 Dictaphone Corporation A system and method for report level confidence
KR20060016933A (en) 2004-08-19 2006-02-23 함정우 Apparatus and method for classification document
US8412521B2 (en) * 2004-08-20 2013-04-02 Multimodal Technologies, Llc Discriminative training of document transcription system
US7844464B2 (en) 2005-07-22 2010-11-30 Multimodal Technologies, Inc. Content-based audio playback emphasis
US20130304453A9 (en) 2004-08-20 2013-11-14 Juergen Fritsch Automated Extraction of Semantic Content and Generation of a Structured Document from Speech
US7584103B2 (en) * 2004-08-20 2009-09-01 Multimodal Technologies, Inc. Automated extraction of semantic content and generation of a structured document from speech
US7650628B2 (en) 2004-10-21 2010-01-19 Escription, Inc. Transcription data security
US8756234B1 (en) * 2004-11-16 2014-06-17 The General Hospital Corporation Information theory entropy reduction program
US20060129435A1 (en) 2004-12-15 2006-06-15 Critical Connection Inc. System and method for providing community health data services
US20060161460A1 (en) 2004-12-15 2006-07-20 Critical Connection Inc. System and method for a graphical user interface for healthcare data
US7502741B2 (en) 2005-02-23 2009-03-10 Multimodal Technologies, Inc. Audio signal de-identification
JP2006302057A (en) * 2005-04-22 2006-11-02 Gifu Univ Medical audio information processing apparatus and medical audio information processing program
US7849048B2 (en) 2005-07-05 2010-12-07 Clarabridge, Inc. System and method of making unstructured data available to structured data analysis tools
US20070055552A1 (en) * 2005-07-27 2007-03-08 St Clair David System and method for health care data integration and management
US7640158B2 (en) 2005-11-08 2009-12-29 Multimodal Technologies, Inc. Automatic detection and application of editing patterns in draft documents
WO2007056601A2 (en) * 2005-11-09 2007-05-18 The Regents Of The University Of California Methods and apparatus for context-sensitive telemedicine
US7957968B2 (en) * 2005-12-22 2011-06-07 Honda Motor Co., Ltd. Automatic grammar generation using distributedly collected knowledge
US7610192B1 (en) 2006-03-22 2009-10-27 Patrick William Jamieson Process and system for high precision coding of free text documents against a standard lexicon
US8731954B2 (en) 2006-03-27 2014-05-20 A-Life Medical, Llc Auditing the coding and abstracting of documents
US8233751B2 (en) * 2006-04-10 2012-07-31 Patel Nilesh V Method and system for simplified recordkeeping including transcription and voting based verification
US10410308B2 (en) * 2006-04-14 2019-09-10 Fuzzmed, Inc. System, method, and device for personal medical care, intelligent analysis, and diagnosis
US20070282640A1 (en) * 2006-05-26 2007-12-06 Allmed Resources Llc Healthcare information accessibility and processing system
JP5167256B2 (en) 2006-06-22 2013-03-21 マルチモーダル・テクノロジーズ・エルエルシー Computer mounting method
US7844470B2 (en) * 2006-07-25 2010-11-30 Siemens Medical Solutions Usa, Inc. Treatment order processing system suitable for pharmacy and other use
JP4875752B2 (en) 2006-11-22 2012-02-15 マルチモーダル・テクノロジーズ・インク Speech recognition in editable audio streams
US8356245B2 (en) 2007-01-05 2013-01-15 International Business Machines Corporation System and method of automatically mapping a given annotator to an aggregate of given annotators
US20080228769A1 (en) 2007-03-15 2008-09-18 Siemens Medical Solutions Usa, Inc. Medical Entity Extraction From Patient Data
US7917355B2 (en) 2007-08-23 2011-03-29 Google Inc. Word detection
US7383183B1 (en) 2007-09-25 2008-06-03 Medquist Inc. Methods and systems for protecting private information during transcription
WO2009052308A1 (en) 2007-10-17 2009-04-23 Roseman Neil S Nlp-based content recommender
US20090192822A1 (en) 2007-11-05 2009-07-30 Medquist Inc. Methods and computer program products for natural language processing framework to assist in the evaluation of medical care
US7933777B2 (en) 2008-08-29 2011-04-26 Multimodal Technologies, Inc. Hybrid speech recognition
CA2680304C (en) 2008-09-25 2017-08-22 Multimodal Technologies, Inc. Decoding-time prediction of non-verbalized tokens
US8290961B2 (en) 2009-01-13 2012-10-16 Sandia Corporation Technique for information retrieval using enhanced latent semantic analysis generating rank approximation matrix by factorizing the weighted morpheme-by-document matrix
WO2010117424A2 (en) 2009-03-31 2010-10-14 Medquist Ip, Llc Computer-assisted abstraction of data and document coding
US20120158400A1 (en) 2009-05-14 2012-06-21 Martin Schmidt Methods and systems for knowledge discovery
US20110173153A1 (en) 2010-01-08 2011-07-14 Vertafore, Inc. Method and apparatus to import unstructured content into a content management system
US8959102B2 (en) 2010-10-08 2015-02-17 Mmodal Ip Llc Structured searching of dynamic structured document corpuses
US8924394B2 (en) 2011-02-18 2014-12-30 Mmodal Ip Llc Computer-assisted abstraction for reporting of quality measures
US9471878B2 (en) 2014-07-11 2016-10-18 International Business Machines Corporation Dynamic mathematical validation using data mining

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7908145B2 (en) * 1993-03-24 2011-03-15 Engate Llc Down-line transcription system using automatic tracking and revenue collection
US20030191627A1 (en) * 1998-05-28 2003-10-09 Lawrence Au Topological methods to organize semantic network data flows for conversational applications
US20020124018A1 (en) * 2000-07-31 2002-09-05 Fifield Davin J. Transcript management software and methods therefor
US20030110030A1 (en) * 2001-10-12 2003-06-12 Koninklijke Philips Electronics N.V. Correction device to mark parts of a recognized text
US20070043761A1 (en) * 2005-08-22 2007-02-22 The Personal Bee, Inc. Semantic discovery engine
US20070239445A1 (en) * 2006-04-11 2007-10-11 International Business Machines Corporation Method and system for automatic transcription prioritization

Also Published As

Publication number Publication date
WO2007150004A2 (en) 2007-12-27
US7716040B2 (en) 2010-05-11
US10339937B2 (en) 2019-07-02
WO2007150005A3 (en) 2008-10-09
CA2652444A1 (en) 2007-12-27
JP2009541865A (en) 2009-11-26
US20070299652A1 (en) 2007-12-27
CA2650816A1 (en) 2007-12-27
CA2652441A1 (en) 2007-12-27
US8560314B2 (en) 2013-10-15
US8321199B2 (en) 2012-11-27
US20140149114A1 (en) 2014-05-29
JP2009541800A (en) 2009-11-26
WO2007150006A3 (en) 2008-10-09
US20100211869A1 (en) 2010-08-19
JP2010512561A (en) 2010-04-22
EP2030196A4 (en) 2017-05-17
US20070299651A1 (en) 2007-12-27
US8768694B2 (en) 2014-07-01
US8521514B2 (en) 2013-08-27
EP2030197A2 (en) 2009-03-04
EP2030198A4 (en) 2012-04-25
EP2030198A2 (en) 2009-03-04
CA2650816C (en) 2015-10-27
WO2007150005A2 (en) 2007-12-27
EP2030196B1 (en) 2018-09-05
US20140316772A1 (en) 2014-10-23
US20120296639A1 (en) 2012-11-22
US20070299665A1 (en) 2007-12-27
EP2030196A2 (en) 2009-03-04
CA2652441C (en) 2014-09-23
WO2007150004A3 (en) 2008-11-06
JP2014197223A (en) 2014-10-16
JP5964358B2 (en) 2016-08-03
US20130346074A1 (en) 2013-12-26
CA2652444C (en) 2020-04-28
WO2007150006A2 (en) 2007-12-27
EP2030197A4 (en) 2012-04-04
US9892734B2 (en) 2018-02-13
EP2030198B1 (en) 2018-08-29
JP5385134B2 (en) 2014-01-08
JP5167256B2 (en) 2013-03-21
US20180166081A1 (en) 2018-06-14

Similar Documents

Publication Publication Date Title
US8560314B2 (en) Applying service levels to transcripts
US11922373B2 (en) Clinical data reconciliation as part of a report generation solution
JP6078057B2 (en) Document expansion in dictation-based document generation workflow
US20180040087A1 (en) Automated Billing Code Generation
JP2009541800A5 (en)
Kang et al. Experience with voice recognition in surgical pathology at a large academic multi-institutional center
US20090132254A1 (en) Diagnostic report based on quality of user&#39;s report dictation

Legal Events

Date Code Title Description
AS Assignment

Owner name: MULTIMODAL TECHNOLOGIES, LLC, PENNSYLVANIA

Free format text: CHANGE OF NAME;ASSIGNOR:MULTIMODAL TECHNOLOGIES, INC.;REEL/FRAME:031392/0462

Effective date: 20110818

Owner name: MULTIMODAL TECHNOLOGIES, INC., PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOLL, DETLEF;FINKE, MICHAEL;REEL/FRAME:031390/0949

Effective date: 20070621

AS Assignment

Owner name: MMODAL IP LLC, TENNESSEE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MULTIMODAL TECHNOLOGIES, LLC;REEL/FRAME:031581/0097

Effective date: 20131107

AS Assignment

Owner name: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT, NEW YORK

Free format text: SECURITY AGREEMENT;ASSIGNOR:MMODAL IP LLC;REEL/FRAME:034047/0527

Effective date: 20140731

Owner name: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT,

Free format text: SECURITY AGREEMENT;ASSIGNOR:MMODAL IP LLC;REEL/FRAME:034047/0527

Effective date: 20140731

AS Assignment

Owner name: CORTLAND CAPITAL MARKET SERVICES LLC, ILLINOIS

Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:MMODAL IP LLC;REEL/FRAME:033958/0729

Effective date: 20140731

AS Assignment

Owner name: MMODAL IP LLC, TENNESSEE

Free format text: CHANGE OF ADDRESS;ASSIGNOR:MMODAL IP LLC;REEL/FRAME:042271/0858

Effective date: 20140805

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: MMODAL IP LLC, TENNESSEE

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CORTLAND CAPITAL MARKET SERVICES LLC, AS ADMINISTRATIVE AGENT;REEL/FRAME:048211/0799

Effective date: 20190201

AS Assignment

Owner name: MEDQUIST OF DELAWARE, INC., TENNESSEE

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712

Effective date: 20190201

Owner name: MEDQUIST CM LLC, TENNESSEE

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712

Effective date: 20190201

Owner name: MULTIMODAL TECHNOLOGIES, LLC, TENNESSEE

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712

Effective date: 20190201

Owner name: MMODAL MQ INC., TENNESSEE

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712

Effective date: 20190201

Owner name: MMODAL IP LLC, TENNESSEE

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT;REEL/FRAME:048411/0712

Effective date: 20190201