WO2013186794A2 - A voice controlled operation theater automation system - Google Patents

A voice controlled operation theater automation system Download PDF

Info

Publication number
WO2013186794A2
WO2013186794A2 PCT/IN2013/000369 IN2013000369W WO2013186794A2 WO 2013186794 A2 WO2013186794 A2 WO 2013186794A2 IN 2013000369 W IN2013000369 W IN 2013000369W WO 2013186794 A2 WO2013186794 A2 WO 2013186794A2
Authority
WO
WIPO (PCT)
Prior art keywords
voice
equipment
controlled operation
range
function
Prior art date
Application number
PCT/IN2013/000369
Other languages
French (fr)
Other versions
WO2013186794A3 (en
Inventor
Suresh DESHPANDE
Original Assignee
Suresh DESHPANDE
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suresh DESHPANDE filed Critical Suresh DESHPANDE
Publication of WO2013186794A2 publication Critical patent/WO2013186794A2/en
Publication of WO2013186794A3 publication Critical patent/WO2013186794A3/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50Supports for surgical instruments, e.g. articulated arms
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00017Electrical control of surgical instruments
    • A61B2017/00203Electrical control of surgical instruments with speech control or speech recognition

Definitions

  • This invention relates to the field of automation systems, electronics and computer engineering.
  • this invention relates to a system and method for controlling an operation theater environment, and associated equipment, thereof.
  • this invention relates to a voice controlled operation theater automation system.
  • this invention also relates to a control system, preferably, an open access control system adapted to control a plurality of equipment.
  • An operating theater is a sterile are or room in which surgical procedures or operating procedures of surgeries or operations are carried out. This is a facility, typically, located within a hospital. An operating theater is also known as an operating room.
  • Operating rooms are spacious, easy to clean, and well-lit, typically with overhead surgical lights, and may have viewing screens and monitors. Operating rooms are generally windowless and feature controlled temperature and humidity. Special air handlers filter the air and maintain a slightly elevated pressure. Electricity support has backup systems in case of a black-out. Rooms are supplied with wall suction, oxygen, and possibly other, anesthetic gases. Key equipment consists of an operating table and an anesthesia cart. In addition, there are tables to set up instruments. There is storage space for common surgical supplies. There are containers for disposables. Outside the operating room is a dedicated scrubbing area that is used by surgeons, anesthetists, ODPs (operating department practitioners), and nurses prior to surgery.
  • An operating room will have a map to enable the terminal cleaner to realign the operating table and equipment to the desired layout during cleaning.
  • operating rooms are part of the operating suite that forms a distinct section within a health-care facility. Besides the operating rooms and their wash rooms, it contains rooms for personnel to change, wash, and rest, preparation and recovery rooms(s), storage and cleaning facilities, offices, dedicated corridors, and possibly other supportive units. In larger facilities, the operating suite is climate- and air- controlled, and separated from other departments so that only authorized personnel have access.
  • Operating room equipment typically, comprises:
  • - anesthesia machine typically, at the head of the operating table - this machine has tubes that connect to the patient to assist him or her in breathing during surgery, and built-in monitors that help control the mixture of gases in the breathing circuit;
  • - anesthesia cart next to the anesthesia machine - it contains the medications, equipment, and other supplies that the anesthesiologist may need;
  • - electrocautery machine uses high frequency electrical signals to cauterize or seal off blood vessels and may also be used to cut through tissue with a minimal amount of bleeding;
  • Assistants are required by the surgeon in an operating theater in order to control or move the plurality if equipment in the operating theater as per the surgeon's command and as per the surgical procedure.
  • more than one assistant is required.
  • surgeon / doctor or anesthetic has to control some of equipment while executing an operation such as operating a Fosterry machine. This requires the surgeon / doctor has to be dependent on assistant(s) and his / her skills. All equipments are placed near operation table and wiring is pulled from wall nearby. This creates a wire matrix all over the room and in a practical scenario, these wires are hazardous in the sense that personnel or assistant moving around the operating theater need to carefully avoid these wires.
  • an operating theater is an operating room in an operating theatre is any room wherein a surgical procedure or an operating procedure or a surgery or an operation is performed.
  • An object of the invention is to reduce wired control in an operating theater. Another object of the invention is to make an operation theater clutter free. Yet another object of the invention is to provide accurate and responsive control.
  • Still another object of the invention is to provide person-independent control.
  • An additional object of the invention is to provide voice dependant control.
  • Yet an additional object of the invention is to provide secure control.
  • Still an additional object of the invention is to allow a surgeon to concentrate on procedure rather than look over assistants.
  • Another additional object of the invention is to obviate assistance.
  • a voice controlled operation theater automation system comprising:
  • equipment defining means adapted to define each equipment adapted to be used within a defined environment
  • function defining means adapted to define function related to each of said defined equipment
  • range defining means adapted to define range of operation of each defined function of each defined equipment
  • voice based system adapted to control each defined equipment in terms of its defined functions and in terms of defined range of defined function
  • security features' enabling means adapted to enable pre-defined security features in relation to voice based operation for said defined range of said defined function of said defined equipment; voice input means adapted to allow input of voice command(s);
  • controller adapted to receive voice command(s) and further adapted to provide control signals corresponding to said voice command in relation to each defined range related to each defined function of each defined equipment;
  • an output card adapted to interface with each defined equipment and said controller and further adapted to actuate each of said corresponding defined equipment in terms of its function and / or range after receiving control signals from a user processed via said controller; thereby providing plug and play modularity for use, of each of said defined equipment, using said system.
  • said output card further comprises ports which interface with a plurality of physical actuating elements adapted to actuate corresponding defined equipment.
  • said security features' enabling means further comprises a first security feature adapted to provide a pause function using a pause command and to provide a start function using a start command characterised in that said first security feature disables additional voice commands after a pause command until a start command is received.
  • said security features' enabling means further comprises a second security feature adapted to provide an auto-pause function for a pre-defined time limit which is effected after the last command and elapsing of the pre-defined time limit.
  • said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions.
  • said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by using a mike worn by a user within said defined range.
  • said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by fine tuning input parameters of said controller to read voice commands within said defined range.
  • said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel.
  • said security features' enabling means further comprises a fourth security feature adapted to provide interruption of commands, for a pre-defined time period, in relation to an operating table, specifically in relation to locking of operating table.
  • said security features' enabling means further comprises a fifth security feature is the introduction of a pre-defined time period, after each voice command, wherein system pauses before receiving additional voice commands.
  • said security features' enabling means further comprises a sixth security feature adapted to provide a pre-defined range of acceptance of command in relation to a voice input mechanism.
  • said security features' enabling means further comprises a seventh security feature adapted to provide total stop mode for each of the defined equipment, such that in said total stop mode, control switches over from voice to other pre-defined options selected from a group of options consisting of manual control option, soft control option, and the like options.
  • said equipment is selected from a group of equipment consisting of Table (Bed) with six degrees of freedom, Lights, Suction Machine, Cautary Machine , Drill Machine, Door.
  • said equipment comprises a laparoscopic probe and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity
  • said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to drive each of said discrete
  • said function defining means is adapted to define functions selected from a group of functions consisting of movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and their combinations.
  • said range defining means is adapted to define ranges in terms of linear displacement, angular displacement, intensity, speed, and their combinations.
  • said voice based system comprises word input means adapted to allow a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like.
  • said voice based system comprises training means adapted to include a training routine for training the system for understanding each defined equipment, each defined function, each defined range, in a spoken format based on voice related parameters.
  • said voice based system comprises voice based security feature extrication means adapted to be enabled during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment.
  • said voice based system comprises words' recognition means adapted to allow the system to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range.
  • said controller is further adapted to:
  • said controller is further adapted to read and decipher each voice command and to provide corresponding control signals to a corresponding actuating element on said output card in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
  • said system comprises a voice input means adapted to interface with said voice based system in order to relay voice based commands from a user.
  • said system comprises foot switches for immediate response.
  • said system comprises a plurality of communication channels adapted to communicably couple said controller to each of the defined equipment in the defined environment.
  • said system is a splash mode operable system in at least one part in order to initiate said system and said user.
  • said system is a main mode operable system in at least one part in order to enable said system to start listening to every command from said user so that the system can process the same and forward to said controller.
  • said system comprises a controller to break a voice command in two parts; equipment identity and function identity.
  • said system comprises a controller to break a voice command in three parts; equipment identity, function identity, and range identity.
  • said system comprises sensor feedback means adapted to comprise a plurality of sensing elements located at each equipment in order to provide feedback to said controller about function and / or range being performed per equipment based on said voice command.
  • said system comprises sensor feedback means adapted to comprise a plurality of sensing elements located at each equipment in order to limit function and / or range in relation to pre-defined limits.
  • said system comprises a visual indication or display means adapted to indicate or display correct receipt of voice command.
  • said system comprises a visual indication or display means adapted to indicate or display the plurality of equipment that can be controlled in the defined environment.
  • a voice controlled operation theater automation method comprising the steps of:
  • said step of interfacing with each defined equipment and said controller and further actuating each of said corresponding defined equipment, using an output card comprises a step of interfacing with ports on said output card, which ports interface with a plurality of physical actuating elements adapted to actuate corresponding defined equipment.
  • said step of enabling pre-defmed security features comprises a first security feature adapted to provide a pause function using a pause command and to provide a start function using a start command characterised in that said first security feature disables additional voice commands after a pause command until a start command is received.
  • said step of enabling pre-defined security features comprises a second security feature adapted to provide an auto-pause function for a pre-defined time limit which is effected after the last command and elapsing of the pre-defined time limit.
  • said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions.
  • said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by using a mike worn by a user within said defined range.
  • said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by fine tuning input parameters of said controller to read voice commands within said defined range.
  • said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel.
  • said step of enabling pre-defined security features comprises a fourth security feature adapted to provide interruption of commands, for a pre-defined time period, in relation to an operating table, specifically in relation to locking of operating table.
  • said step of enabling pre-defined security features comprises a fifth security feature is the introduction of a pre-defined time period, after each voice command, wherein method pauses before receiving additional voice commands.
  • said step of enabling pre-defined security features comprises a sixth security feature adapted to provide a pre-defined range of acceptance of command in relation to a voice input mechanism.
  • said step of enabling pre-defined security features comprises a seventh security feature adapted to provide total stop mode for each of the defined equipment, such that in said total stop mode, control switches over from voice to other pre-defined options selected from a group of options consisting of manual control option, soft control option, and the like options.
  • using said equipment defining means further comprises a step of selecting said equipment from a group of equipment consisting of Table (Bed) with six degrees of freedom, Lights, Suction Machine, Cautary Machine , Drill Machine, Door.
  • Table Bed
  • said step of defining each equipment, using said equipment defining means further comprises a step of selecting a laparoscopic probe and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity
  • said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third
  • said step of defining function, using function definition means comprises a step of defining functions selected from a group of functions consisting of movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and their combinations.
  • said step of defining ranges, using range definition means comprises a step of defining ranges in terms of linear displacement, angular displacement, intensity, speed, and their combinations.
  • said step of controlling each defined equipment, using a voice based system comprises a step of allowing a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like; using word input means.
  • said step of controlling each defined equipment, using a voice based system comprises a step of including a training routine for training the method for understanding each defined equipment, each defined function, each defined range, in a spoken format based on voice related parameters; using training means.
  • said step of controlling each defined equipment, using a voice based system comprises a step of enabling voice based security features during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment; using voice based security feature extrication means.
  • said step of controlling each defined equipment, using a voice based system comprises a step of allowing said method to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range; using words' recognition means.
  • said step of controlling each defined equipment, using a voice based system comprises further steps of:
  • said step of controlling each defined equipment, using a voice based system comprises further steps of reading and deciphering each voice command and providing corresponding control signals to a corresponding actuating element on said output card in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
  • said method comprises a step of interfacing voice input means with said voice based system in order to relay voice based commands from a user.
  • said method comprises use of foot switches for immediate response.
  • said method comprises a step of communicably coupling said controller to each of the defined equipment in the defined environment using a plurality of communication channels.
  • said method is a splash mode operable method in at least one part in order to initiate said method and said user.
  • said method is a main mode operable method in at least one part in order to enable said method to start listening to every command from said user so that the method can process the same and forward to said controller.
  • said method comprises a step of breaking a voice command in two parts; equipment identity, and function identity - using said controller.
  • said method comprises a step of breaking a voice command in three parts; equipment identity, function identity, and range identity - using said controller.
  • said method comprises a step of providing feedback to said controller about function and / or range being performed per equipment based on said voice command using sensor feedback means which further comprises plurality of sensing elements located at each equipment.
  • said method comprises a step of limiting function and / or range in relation to pre-defined limits using sensor feedback means which further comprises plurality of sensing elements located at each equipment.
  • said method comprises a step of indicating of displaying correct receipt of voice command using visual indication or display means.
  • said method comprises a step of indicating or displaying the plurality of equipment that can be controlled in the defined environment using visual indication or display means.
  • Figure 1 illustrates a schematic operation theater that is to be controlled using the system and method of this invention
  • FIG. 2 illustrates a schematic block diagram of the system of this invention.
  • Figure 3 illustrates a schematic block diagram of the interface structure between voice input mechanism, voice output mechanism, controller, output card, and actuating elements.
  • An operation theater typically, comprises a plurality of equipment. These equipment need to be controlled by the surgeon or assistants, at different points in time during the course of a surgery, including its preparation.
  • Figure 1 illustrates a schematic operation theater that is to be controlled using the system and method of this invention.
  • Figure 2 illustrates a schematic block diagram of the system of this invention.
  • Figure 3 illustrates a schematic block diagram of the interface structure between voice input mechanism, voice output mechanism, controller, output card, and actuating elements.
  • a defining means adapted to define each equipment adapted to be used within a defined environment such as an operating room.
  • an Operation Theater comprises equipment listed below:
  • Controls are, typically, defined in two parts:
  • An operation theater may further comprise a laparoscopic probe (E5) and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity
  • said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to
  • Speed can be dynamic or static; continuous or discrete.
  • speed options may include the following:
  • Each entity is open/ON or Closed/OFF.
  • each item within the operating room environment is defined by a unique identity.
  • a function defining means adapted to define function related to each of said defined equipment.
  • the functions may be movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and the like.
  • a range defining means adapted to refine range of operation of each defined function of each defined equipment.
  • the range typically, may in terms of linear displacement, angular displacement, intensity, speed, and the like.
  • a voice based system VBS
  • the voice based system comprises word input means (WIM) adapted to allow a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like.
  • the voice based system may further comprises training means (TM) adapted to include a training routine for training the system for understanding each defined equipment, each defined function, each defined range, and the like in the spoken format based on voice related parameters.
  • the voice based system yet further comprises voice based security feature extrication means (SFEM) adapted to be enabled during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment.
  • the voice recognition system comprises words' recognition means (WRM) adapted to allow the system to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range.
  • an output card adapted to interface with each defined equipment.
  • One output card suffices for controlling a plurality of equipment, irrespective of the make of the equipment to be controlled.
  • the voice based system does away with a voice card and introduces an output card (OC) designed to be modular in nature, in that, the output card is designed to work with a plurality of actuating elements.
  • This output card actually operates or actuates each equipment in terms of its function and / or range after receiving command signals from a controller.
  • the output card interfaces with a controller (CM) which receives soft commands detected upon being spoken by a user.
  • the output card further comprises ports which interface with a plurality of physical actuating elements (AE).
  • This card operates electro-mechanical switches like relays or semiconductor components like Triac, FET according to equipment chosen and task to be performed.
  • the output card is divided in two sections; one is Operation table outputs and second is equipment on/off section.
  • Equipment on/off section is a section that just controls on/off state of equipments of attached to it. These equipment may not be in close loop with controller. That means these equipments may not sent any sensor feedback to processor.
  • the operation Table section controls the speed of the motors, which gives movements to the table according to the signal received this section generates power for the speed selected. These movements are monitored by a close loop system.
  • voice recognition system is a relatively easier way for any doctor / surgeon to just give commands verbally and control various equipment function, thereby relegating the need of assistants.
  • Voice controlled system helps any doctor / surgeon to concentrate on the operation or procedure at task without worrying about assistant skill.
  • a speech / voice recognition system is adapted to translate voice command spoken by user to known commands used by a controller to control equipment. There is a continuous monitoring means adapted to monitor each spoken word in order to pick up recognised words or recognised combination of words in order to actuate controller, accordingly.
  • the speech / voice recognition system is adapted to detect syntax and semantic in order to actuate controller, accordingly.
  • CM controller
  • the controller (CM) is further adapted to read and decipher each voice command and to provide corresponding control signals to a corresponding actuating element (AE) on the output card (OC) in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
  • Controller can be controlled in two ways:
  • Graphical user interface is designed in such way that anyone can easily control the system.
  • Each click has been defined by images (e.g. Door, Suction, Table direction) on a visual display. User can click and control entire system.
  • Controller sends command to equipment for their actuation and control.
  • Prior art voice recognition systems require voice training of person who is supposed to use the system. This system aims to be a dynamic tool which can detect any voice and any pronunciation.
  • a voice input means such as a mike is provided.
  • the voice based system comprises a plurality of security features.
  • a first security feature is to provide a pause function using a pause command and start command.
  • a command 'Pause Speech'.
  • controller or voice based system does not look / hunt / search or is not receptive of any kind of command until user pronounces 'Start Speech'.
  • a second security feature is to provide an auto-pause function of a pre-defined time limit. This is effected after the last command and elapsing of the pre-defined time limit.
  • a user / doctor / surgeon forgets to say 'Pause Speech' and starts operative procedure, then it becomes a risky condition, in that, if user pronounces any word similar to a command, then the system can start working, as defined, but may not be intended by the user / doctor / surgeon.
  • the system comprises an added feature of auto pause of 3 minutes. After last command, the system will wait for 3 minutes and get paused automatically.
  • a third security feature is a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions. This third security feature is enabled by using a mike worn by a user within said defined range. Further, this third security feature is enabled by fine tuning input parameters of said controller to read voice commands within said defined range. Still further, this third security feature is enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel. According to a non- limiting exemplary embodiment, if any other person pronounces the same command as a first user, the system detects that the command received is from a warranted or non- warranted user.
  • a fourth security feature is to provide interruption of commands in relation to operating table, specifically in relation to locking of operating table. According to a non-limiting exemplary embodiment, if a table was locked in a final position, a user shall say 'Lock Table' and then system shall listen for other command(s) and not for table, until a pre-defmed time is over.
  • the channel of communication between user / doctor / surgeon and system may be a Bluetooth enabled headphone.
  • a fifth security feature is the introduction of a pre-defined time period wherein system pauses.
  • system gets pause automatically after 20 seconds, so that user can speak some similar words which are familiar to commands, but not be executed by the system.
  • the system is not supposed to detect those other words as commands.
  • User can speak as "Pause Robot” and "Resume Robot” as security reason.
  • For Table movement in all six direction speed level is defined so that if user needs minor change he can go for "Slow” mode and if he / she needs quick and long change he / she can chose "Fast" mode.
  • a sixth security feature is the introduction of a pre-defined range of acceptance of command in relation to a voice input mechanism such as a mike.
  • a 6- inch limitation is imposed on to the voice input mechanism such that commands are received within the pre-defined range (6 inch) of the mike. Commands or voices beyond this range, however loud, are not detected and processed by the system of this invention.
  • a seventh security feature is the introduction of total stop mode for each of the defined equipment.
  • the control switches over from voice to other options which could be one of many options such as manual control, soft control, or the like.
  • foot switches are provided so that if any other sound or problem occurs, user can use foot switch for immediate response.
  • a plurality of communication channels adapted to communicably couple the controller to each of the defined equipment in the defined environment.
  • This block informs the controller about the current communication channel selected like USB, Serial, Parallel or None that is manual mode. It also includes as a signal booster so that any data loss between controller and equipment is compensated.
  • Controller and equipment electronics typically, have modbus protocol for * communication. This protocol is standard for safer communication. Same protocol helps to get feedback from controller or associated equipment.
  • the system of this invention is adapted to be designed using two forms
  • the system welcomes doctor / surgeon and checks communication and basic protocols.
  • the system starts listening to every command from user so that the system can process the same and forward to controller.
  • An operator gives voice commands that are processed by voice based system. After doing speech analysis, the system decodes these voice commands and issues corresponding commands to controller through selected communication channel.
  • controller acts upon these commands and sends back confirmation. While executing this process different safety measures are taken.
  • the controller While processing a command, the controller breaks a command in two parts;
  • equipment identity and function identity may also break the command in three parts; equipment identity, function identity, and range identity.
  • equipment identity the controller provides command signals in order to execute the told function. Then it generates task complete message and sends it back to system.
  • a sensor feedback means adapted to comprises a plurality of sensing elements located at each equipment. This provides feedback to the controller about the process, which has been executed or is being executed. This can be relayed to the user through voice output means (VOM) such as headphones or speakers (as seen in Figure 3 of the accompanying drawings).
  • VOM voice output means
  • operation table output card when a motor is turned on, speed of the motor is constantly measured using a speed sensor and this information is passed on to controller so that it can take any corrective measures, if necessary.
  • position sensors make sure that motors do not move the operation table top beyond its extreme limits. As soon as these maximum or minimum positions are reached, these sensors send data to controller and motor is stopped immediately to avoid overloading of mechanical system. Data being sent from sensor to controller is digital or is in voltage form as the controller is capable of processing both.
  • a visual indication or display means adapted to indicate or display correct receipt of voice command. Further, it may indicate or display the plurality of equipment that can be controlled in the defined environment. This may in terms of equipment identity, function identity, range identity, and the like.
  • system and method of this invention relates to an open access control system such that any make and any number of equipment may be adapted to be controlled by this control system, in an easy and cost-effective manner.
  • System and Method of control may relate to soft-GUI based controls or voice actuated controls. Further, the system and method of this invention much specifically related to providing control in relation to voice command without the use of a voice card.
  • This invention relates to a system and method for controlling a defined environment such as an Operation Theater with help of voice recognition, voice (pre defined words) recognition of any person using any accent.
  • User interface for controlling variety of instruments is available in the theater.
  • User interface with three media; Audio, Mouse (monitor) and Foot Switch are provided to control each entity.
  • Operation theater includes all kind of instruments (e.g. Suction Machine, Cautary Machine, Lights, etc) and Operation Table
  • Controller designed to interface only with predefined equipment. Further, it is to be noted that all the voice activated functions can be simulated on to a dashboard for soft activation and control.
  • the technical advancement of this invention lies in providing a voice controlled operation theater automation system for controlling defined equipment in the operation theater without the use of voice card.
  • the system of this invention is enabled by using an output card which has been designed to work in conjunction with the plurality of defined equipment as well as with a software system which processes the voice command to correctly recognise the commands and to correctly control the requisite equipment.
  • This provides for plug and play modularity, thereby enabling any brand of equipment to be used with voice controlled operation theater automation system of this invention.
  • Multiple actuating elements can be coupled to the designed output card.
  • the system and method is intuitive and filters background noise due to the frequency defined.
  • the system provides voice control of equipment, in a real-time manner.
  • the various security features have been iteratively developed to incorporated for ease of use, for intuition of use, and for industrial applicability of use.

Abstract

This invention relates to a voice controlled operation theater automation system comprising: equipment defining means; function defining means; range defining means; voice based system adapted to control each defined equipment in terms of its defined functions and in terms of defined range of defined function; security features' enabling means adapted to enable predefined security features in relation to voice based operation for said defined range of said defined function of said defined equipment; voice input means adapted to allow input of voice command(s); controller adapted to receive voice command(s) and further adapted to provide control signals corresponding to said voice command in relation to each defined range related to each defined function of each defined equipment; and an output card adapted to actuate each of said corresponding defined equipment in terms of its function and / or range after receiving control signals from a user processed via said controller; thereby providing plug and play modularity for use, of each of said defined equipment, using said system.

Description

A VOICE CONTROLLED OPERATION THEATER AUTOMATION SYSTEM
Field of the Invention:
This invention relates to the field of automation systems, electronics and computer engineering.
Particularly, this invention relates to a system and method for controlling an operation theater environment, and associated equipment, thereof.
Specifically, this invention relates to a voice controlled operation theater automation system.
Specifically, this invention also relates to a control system, preferably, an open access control system adapted to control a plurality of equipment.
Background of the Invention:
An operating theater is a sterile are or room in which surgical procedures or operating procedures of surgeries or operations are carried out. This is a facility, typically, located within a hospital. An operating theater is also known as an operating room.
Operating rooms are spacious, easy to clean, and well-lit, typically with overhead surgical lights, and may have viewing screens and monitors. Operating rooms are generally windowless and feature controlled temperature and humidity. Special air handlers filter the air and maintain a slightly elevated pressure. Electricity support has backup systems in case of a black-out. Rooms are supplied with wall suction, oxygen, and possibly other, anesthetic gases. Key equipment consists of an operating table and an anesthesia cart. In addition, there are tables to set up instruments. There is storage space for common surgical supplies. There are containers for disposables. Outside the operating room is a dedicated scrubbing area that is used by surgeons, anesthetists, ODPs (operating department practitioners), and nurses prior to surgery.
An operating room will have a map to enable the terminal cleaner to realign the operating table and equipment to the desired layout during cleaning.
Several operating rooms are part of the operating suite that forms a distinct section within a health-care facility. Besides the operating rooms and their wash rooms, it contains rooms for personnel to change, wash, and rest, preparation and recovery rooms(s), storage and cleaning facilities, offices, dedicated corridors, and possibly other supportive units. In larger facilities, the operating suite is climate- and air- controlled, and separated from other departments so that only authorized personnel have access.
Operating room equipment, typically, comprises:
- operating table in the center of the room can be raised, lowered, and tilted in any direction;
- operating room lights over the table to provide bright light, without shadows, during surgery'
- anesthesia machine, typically, at the head of the operating table - this machine has tubes that connect to the patient to assist him or her in breathing during surgery, and built-in monitors that help control the mixture of gases in the breathing circuit; - anesthesia cart next to the anesthesia machine - it contains the medications, equipment, and other supplies that the anesthesiologist may need;
- sterile instruments to be used during surgery that are arranged on a table;
- electronic monitor (which records the heart rate and respiratory rate by adhesive patches) are placed on patient's chest;
- pulse oximeter machine attaches to the patient's finger with an elastic band aid - it measures the amount of oxygen contained in the blood;
- automated blood pressure measuring machine that automatically inflates the blood pressure cuff on patient's arm;
- electrocautery machine uses high frequency electrical signals to cauterize or seal off blood vessels and may also be used to cut through tissue with a minimal amount of bleeding;
- drips, advantageously placed;
- Heart-lung machine; and
- other specialized equipment.
Present day operation theaters are analogous to firefighting rooms where mistakes can create catastrophic problems.
Assistants are required by the surgeon in an operating theater in order to control or move the plurality if equipment in the operating theater as per the surgeon's command and as per the surgical procedure. Sometimes, more than one assistant is required. Sometimes, surgeon / doctor or anesthetic has to control some of equipment while executing an operation such as operating a cautary machine. This requires the surgeon / doctor has to be dependent on assistant(s) and his / her skills. All equipments are placed near operation table and wiring is pulled from wall nearby. This creates a wire matrix all over the room and in a practical scenario, these wires are hazardous in the sense that personnel or assistant moving around the operating theater need to carefully avoid these wires.
Precision and timing are the cornerstones of effective surgery; not only of the surgeon but also of the paraphernalia such as supporting paramedics and assistants
Needless to say, a surgeon / doctor faces some problem while operation. Doctor needs to concentrate on the procedure as well as to risk some caution with assistants in the environment. Immediate response is also one of the cornerstones of any procedure.
Many theaters, now, are designed in such a way so as to avoid wire matrix of instruments. But in different kinds of operations, different instruments are required which are dynamically placed or located according to the requirement. This provides for a tedious job for arrangement to create a universal controlling system.
For the purposes of this invention, an operating theater is an operating room in an operating theatre is any room wherein a surgical procedure or an operating procedure or a surgery or an operation is performed.
Objects of the Invention:
An object of the invention is to reduce wired control in an operating theater. Another object of the invention is to make an operation theater clutter free. Yet another object of the invention is to provide accurate and responsive control.
Still another object of the invention is to provide person-independent control.
An additional object of the invention is to provide voice dependant control.
Yet an additional object of the invention is to provide secure control.
Still an additional object of the invention is to allow a surgeon to concentrate on procedure rather than look over assistants.
Another additional object of the invention is to obviate assistance.
Summary of the Invention:
According to this invention, there is provided a voice controlled operation theater automation system comprising:
equipment defining means adapted to define each equipment adapted to be used within a defined environment;
function defining means adapted to define function related to each of said defined equipment;
range defining means adapted to define range of operation of each defined function of each defined equipment;
voice based system adapted to control each defined equipment in terms of its defined functions and in terms of defined range of defined function;
security features' enabling means adapted to enable pre-defined security features in relation to voice based operation for said defined range of said defined function of said defined equipment; voice input means adapted to allow input of voice command(s);
controller adapted to receive voice command(s) and further adapted to provide control signals corresponding to said voice command in relation to each defined range related to each defined function of each defined equipment; and
an output card adapted to interface with each defined equipment and said controller and further adapted to actuate each of said corresponding defined equipment in terms of its function and / or range after receiving control signals from a user processed via said controller; thereby providing plug and play modularity for use, of each of said defined equipment, using said system.
Typically, said output card further comprises ports which interface with a plurality of physical actuating elements adapted to actuate corresponding defined equipment.
Typically, said security features' enabling means further comprises a first security feature adapted to provide a pause function using a pause command and to provide a start function using a start command characterised in that said first security feature disables additional voice commands after a pause command until a start command is received.
Typically, said security features' enabling means further comprises a second security feature adapted to provide an auto-pause function for a pre-defined time limit which is effected after the last command and elapsing of the pre-defined time limit. Typically, said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions.
Typically, said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by using a mike worn by a user within said defined range.
Typically, said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by fine tuning input parameters of said controller to read voice commands within said defined range.
Typically, said security features' enabling means further comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel.
Typically, said security features' enabling means further comprises a fourth security feature adapted to provide interruption of commands, for a pre-defined time period, in relation to an operating table, specifically in relation to locking of operating table. Typically, said security features' enabling means further comprises a fifth security feature is the introduction of a pre-defined time period, after each voice command, wherein system pauses before receiving additional voice commands.
Typically, said security features' enabling means further comprises a sixth security feature adapted to provide a pre-defined range of acceptance of command in relation to a voice input mechanism.
Typically, said security features' enabling means further comprises a seventh security feature adapted to provide total stop mode for each of the defined equipment, such that in said total stop mode, control switches over from voice to other pre-defined options selected from a group of options consisting of manual control option, soft control option, and the like options.
Preferably, said equipment is selected from a group of equipment consisting of Table (Bed) with six degrees of freedom, Lights, Suction Machine, Cautary Machine , Drill Machine, Door.
Additionally, said equipment comprises a laparoscopic probe and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to drive each of said discrete drive mechanism means to position the tip of said probe in its operative configuration within a body cavity, said range of motion of this laparoscopic probe being selected from a group of motions consisting of up motion, down motion, right motion, left motion, in motion, out motion, and its combinations.
Typically, said function defining means is adapted to define functions selected from a group of functions consisting of movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and their combinations.
Typically, said range defining means is adapted to define ranges in terms of linear displacement, angular displacement, intensity, speed, and their combinations.
Typically, said voice based system comprises word input means adapted to allow a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like.
Additionally, said voice based system comprises training means adapted to include a training routine for training the system for understanding each defined equipment, each defined function, each defined range, in a spoken format based on voice related parameters. Typically, said voice based system comprises voice based security feature extrication means adapted to be enabled during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment.
Typically, said voice based system comprises words' recognition means adapted to allow the system to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range.
Typically, said controller is further adapted to:
- read each defined identity of equipment within a defined environment;
- read each defined function related to each defined identity of each defined equipment;
- read each defined range related to each defined function of each defined identity;
- provide control signals in relation to each defined equipment;
- provide control signals in relation to each defined function related to each defined equipment; and
- provide control signals in relation to each defined range related to each defined function of each defined equipment.
Typically, said controller is further adapted to read and decipher each voice command and to provide corresponding control signals to a corresponding actuating element on said output card in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
Typically, said system comprises a voice input means adapted to interface with said voice based system in order to relay voice based commands from a user.
Preferably, said system comprises foot switches for immediate response.
Typically, said system comprises a plurality of communication channels adapted to communicably couple said controller to each of the defined equipment in the defined environment.
Typically, said system is a splash mode operable system in at least one part in order to initiate said system and said user.
Typically, said system is a main mode operable system in at least one part in order to enable said system to start listening to every command from said user so that the system can process the same and forward to said controller.
Preferably, said system comprises a controller to break a voice command in two parts; equipment identity and function identity.
Alternatively, said system comprises a controller to break a voice command in three parts; equipment identity, function identity, and range identity.
Additionally, said system comprises sensor feedback means adapted to comprise a plurality of sensing elements located at each equipment in order to provide feedback to said controller about function and / or range being performed per equipment based on said voice command.
Additionally, said system comprises sensor feedback means adapted to comprise a plurality of sensing elements located at each equipment in order to limit function and / or range in relation to pre-defined limits.
Additionally, said system comprises a visual indication or display means adapted to indicate or display correct receipt of voice command.
Additionally, said system comprises a visual indication or display means adapted to indicate or display the plurality of equipment that can be controlled in the defined environment.
According to this invention, there is provided a voice controlled operation theater automation method comprising the steps of:
defining each equipment, using equipment defining means, adapted to be used within a defined environment;
defining function, using function definition means, related to each of said defined equipment;
defining range of operation, using range defining means, of each defined function of each defined equipment;
controlling each defined equipment, using a voice based system, in terms of its defined functions and in terms of defined range of defined function;
enabling pre-defined security features, using security features' enabling means, in relation to voice based operation for said defined range of said defined function of said defined equipment; allowing input of input of voice command(s), using voice input means;
receiving voice command(s) and further providing control signals, using a controller, corresponding to said voice command in relation to each defined range related to each defined function of each defined equipment; and
interfacing with each defined equipment and said controller and further actuating each of said corresponding defined equipment, using a an output card, in terms of its function and / or range after receiving control signals from a user processed via said controller; thereby providing plug and play modularity for use, of each of said defined equipment, using said method.
Typically, said step of interfacing with each defined equipment and said controller and further actuating each of said corresponding defined equipment, using an output card comprises a step of interfacing with ports on said output card, which ports interface with a plurality of physical actuating elements adapted to actuate corresponding defined equipment.
Typically, said step of enabling pre-defmed security features comprises a first security feature adapted to provide a pause function using a pause command and to provide a start function using a start command characterised in that said first security feature disables additional voice commands after a pause command until a start command is received.
Typically, said step of enabling pre-defined security features comprises a second security feature adapted to provide an auto-pause function for a pre-defined time limit which is effected after the last command and elapsing of the pre-defined time limit. Typically, said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions.
Typically, said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by using a mike worn by a user within said defined range.
Typically, said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by fine tuning input parameters of said controller to read voice commands within said defined range.
Typically, said step of enabling pre-defined security features comprises a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel.
Typically, said step of enabling pre-defined security features comprises a fourth security feature adapted to provide interruption of commands, for a pre-defined time period, in relation to an operating table, specifically in relation to locking of operating table.
Typically, said step of enabling pre-defined security features comprises a fifth security feature is the introduction of a pre-defined time period, after each voice command, wherein method pauses before receiving additional voice commands.
Typically, said step of enabling pre-defined security features comprises a sixth security feature adapted to provide a pre-defined range of acceptance of command in relation to a voice input mechanism.
Typically, said step of enabling pre-defined security features comprises a seventh security feature adapted to provide total stop mode for each of the defined equipment, such that in said total stop mode, control switches over from voice to other pre-defined options selected from a group of options consisting of manual control option, soft control option, and the like options.
Preferably, using said equipment defining means, further comprises a step of selecting said equipment from a group of equipment consisting of Table (Bed) with six degrees of freedom, Lights, Suction Machine, Cautary Machine , Drill Machine, Door.
Additionally, said step of defining each equipment, using said equipment defining means, further comprises a step of selecting a laparoscopic probe and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to drive each of said discrete drive mechanism means to position the tip of said probe in its operative configuration within a body cavity, said range of motion of this laparoscopic probe being selected from a group of motions consisting of up motion, down motion, right motion, left motion, in motion, out motion, and its combinations.
Typically, said step of defining function, using function definition means, comprises a step of defining functions selected from a group of functions consisting of movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and their combinations.
Typically, said step of defining ranges, using range definition means, comprises a step of defining ranges in terms of linear displacement, angular displacement, intensity, speed, and their combinations.
Typically, said step of controlling each defined equipment, using a voice based system comprises a step of allowing a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like; using word input means.
Additionally, said step of controlling each defined equipment, using a voice based system comprises a step of including a training routine for training the method for understanding each defined equipment, each defined function, each defined range, in a spoken format based on voice related parameters; using training means.
Typically, said step of controlling each defined equipment, using a voice based system comprises a step of enabling voice based security features during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment; using voice based security feature extrication means.
Typically, said step of controlling each defined equipment, using a voice based system comprises a step of allowing said method to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range; using words' recognition means.
Typically, said step of controlling each defined equipment, using a voice based system comprises further steps of:
- reading each defined identity of equipment within a defined environment;
- reading each defined function related to each defined identity of each defined equipment; - reading each defined range related to each defined function of each defined identity;
- providing control signals in relation to each defined equipment;
- providing control signals in relation to each defined function related to each defined equipment; and
- providing control signals in relation to each defined range related to each defined function of each defined equipment.
Typically, said step of controlling each defined equipment, using a voice based system comprises further steps of reading and deciphering each voice command and providing corresponding control signals to a corresponding actuating element on said output card in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
Typically, said method comprises a step of interfacing voice input means with said voice based system in order to relay voice based commands from a user.
Preferably, said method comprises use of foot switches for immediate response.
Typically, said method comprises a step of communicably coupling said controller to each of the defined equipment in the defined environment using a plurality of communication channels.
Typically, said method is a splash mode operable method in at least one part in order to initiate said method and said user. Typically, said method is a main mode operable method in at least one part in order to enable said method to start listening to every command from said user so that the method can process the same and forward to said controller.
Preferably, said method comprises a step of breaking a voice command in two parts; equipment identity, and function identity - using said controller.
Alternatively, said method comprises a step of breaking a voice command in three parts; equipment identity, function identity, and range identity - using said controller.
Additionally, said method comprises a step of providing feedback to said controller about function and / or range being performed per equipment based on said voice command using sensor feedback means which further comprises plurality of sensing elements located at each equipment.
Additionally, said method comprises a step of limiting function and / or range in relation to pre-defined limits using sensor feedback means which further comprises plurality of sensing elements located at each equipment.
Additionally, said method comprises a step of indicating of displaying correct receipt of voice command using visual indication or display means.
Additionally, said method comprises a step of indicating or displaying the plurality of equipment that can be controlled in the defined environment using visual indication or display means. Brief Description of the Accompanying Drawings:
The invention will now be described in relation to the accompanying drawings, in which:
Figure 1 illustrates a schematic operation theater that is to be controlled using the system and method of this invention;
Figure 2 illustrates a schematic block diagram of the system of this invention; and
Figure 3 illustrates a schematic block diagram of the interface structure between voice input mechanism, voice output mechanism, controller, output card, and actuating elements.
Detailed Description of the Accompanying Drawings:
According to this invention, there is provided a voice controlled operation theater automation system. An operation theater, typically, comprises a plurality of equipment. These equipment need to be controlled by the surgeon or assistants, at different points in time during the course of a surgery, including its preparation.
In developing countries or in least developed countries, it is difficult to procure or hire assistants trained in the field of surgery, which assistants are of assistance to a doctor or a surgeon in an operating room environment. Hence, there is a need for such a system.
Figure 1 illustrates a schematic operation theater that is to be controlled using the system and method of this invention. Figure 2 illustrates a schematic block diagram of the system of this invention.
Figure 3 illustrates a schematic block diagram of the interface structure between voice input mechanism, voice output mechanism, controller, output card, and actuating elements.
In accordance with an embodiment of this invention, there is provided a defining means (DM) adapted to define each equipment adapted to be used within a defined environment such as an operating room.
Typically, an Operation Theater comprises equipment listed below:
- Table (Bed) (T) with six degrees of freedom
- Lights (LI , L2)
- Suction Machine (El)
- Cautary Machine (E2)
- Drill Machine (E3)
- Door Open/close (E4)
Controls are, typically, defined in two parts:
- Movement
- ON / OFF
An operation theater may further comprise a laparoscopic probe (E5) and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to drive each of said discrete drive mechanism means to position the tip of said probe in its operative configuration within a body cavity. The range of motion of this laparoscopic probe is as follows:
Up
Down
Right
Left
In
Out
For the control relating to movement,
Table (Bed) has movement with Speed Timing. The movements (depicted by dotted arrows) relate to the following:
Table Up (reference numeral 1 )
Table Down (reference numeral 2)
Head UP (reference numeral 3)
Head Down (reference numeral 4)
Tilt Right (reference numeral 5)
Tilt Left (reference numeral 6)
These are 6 movements added to table. Movement is controlled with Speed. Speed can be dynamic or static; continuous or discrete. Typically, speed options may include the following:
Slow (reference numeral 7) Normal (reference numeral 8)
Fast (reference numeral 9)
For the control relating to ON/OFF,
Other accessories in the Operation Table are Switch On and Switch Off the following:
Light One
Light Two
Suction
Cautary
Drill
Door
Each entity is open/ON or Closed/OFF.
Typically, each item within the operating room environment is defined by a unique identity.
In accordance with another embodiment of this invention, there is provided a function defining means (FDM) adapted to define function related to each of said defined equipment. The functions may be movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and the like.
In accordance with yet another embodiment of this invention, there is provided a range defining means (RDM) adapted to refine range of operation of each defined function of each defined equipment. The range, typically, may in terms of linear displacement, angular displacement, intensity, speed, and the like. In accordance with still another embodiment of this invention, there is provided a voice based system (VBS) adapted to control each defined equipment in terms of its defined functions and in terms of defined range of defined function. The voice based system comprises word input means (WIM) adapted to allow a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like. The voice based system may further comprises training means (TM) adapted to include a training routine for training the system for understanding each defined equipment, each defined function, each defined range, and the like in the spoken format based on voice related parameters. The voice based system yet further comprises voice based security feature extrication means (SFEM) adapted to be enabled during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment. The voice recognition system comprises words' recognition means (WRM) adapted to allow the system to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range.
In accordance with an additional embodiment of this invention, there is provided an output card (OC), adapted to interface with each defined equipment. One output card suffices for controlling a plurality of equipment, irrespective of the make of the equipment to be controlled. The voice based system does away with a voice card and introduces an output card (OC) designed to be modular in nature, in that, the output card is designed to work with a plurality of actuating elements. This output card actually operates or actuates each equipment in terms of its function and / or range after receiving command signals from a controller. The output card interfaces with a controller (CM) which receives soft commands detected upon being spoken by a user. The output card further comprises ports which interface with a plurality of physical actuating elements (AE). This card operates electro-mechanical switches like relays or semiconductor components like Triac, FET according to equipment chosen and task to be performed. Preferably, the output card is divided in two sections; one is Operation table outputs and second is equipment on/off section. Equipment on/off section is a section that just controls on/off state of equipments of attached to it. These equipment may not be in close loop with controller. That means these equipments may not sent any sensor feedback to processor. When the operation Table section controls the speed of the motors, which gives movements to the table according to the signal received this section generates power for the speed selected. These movements are monitored by a close loop system.
In an operating theater or room, voice recognition system is a relatively easier way for any doctor / surgeon to just give commands verbally and control various equipment function, thereby relegating the need of assistants. Voice controlled system helps any doctor / surgeon to concentrate on the operation or procedure at task without worrying about assistant skill.
A speech / voice recognition system is adapted to translate voice command spoken by user to known commands used by a controller to control equipment. There is a continuous monitoring means adapted to monitor each spoken word in order to pick up recognised words or recognised combination of words in order to actuate controller, accordingly. The speech / voice recognition system is adapted to detect syntax and semantic in order to actuate controller, accordingly.
In accordance with an additional embodiment of this invention, there is provided a controller (CM) adapted to receive voice commands from a user and further to:
- read each defined identity of equipment within a defined environment;
- read each defined function related to each defined identity of each defined equipment;
- read each defined range related to each defined function of each defined identity;
- provide control signals in relation to each defined equipment;
- provide control signals in relation to each defined function related to each defined equipment;
- provide control signals in relation to each defined range related to each defined function of each defined equipment.
The controller (CM) is further adapted to read and decipher each voice command and to provide corresponding control signals to a corresponding actuating element (AE) on the output card (OC) in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
Controller can be controlled in two ways:
1) By clicking on button.
2) By Voice.
Graphical user interface is designed in such way that anyone can easily control the system. Each click has been defined by images (e.g. Door, Suction, Table direction) on a visual display. User can click and control entire system.
Controller sends command to equipment for their actuation and control. Prior art voice recognition systems require voice training of person who is supposed to use the system. This system aims to be a dynamic tool which can detect any voice and any pronunciation.
For voice control, a voice input means (VIM) such as a mike is provided.
The voice based system comprises a plurality of security features.
A first security feature is to provide a pause function using a pause command and start command. According to a non-limiting exemplary embodiment, a command, 'Pause Speech', is provided. When pause speech command is pronounced by user then controller or voice based system does not look / hunt / search or is not receptive of any kind of command until user pronounces 'Start Speech'.
A second security feature is to provide an auto-pause function of a pre-defined time limit. This is effected after the last command and elapsing of the pre-defined time limit. According to a non-limiting exemplary embodiment, if a user / doctor / surgeon forgets to say 'Pause Speech' and starts operative procedure, then it becomes a risky condition, in that, if user pronounces any word similar to a command, then the system can start working, as defined, but may not be intended by the user / doctor / surgeon. Hence, the system comprises an added feature of auto pause of 3 minutes. After last command, the system will wait for 3 minutes and get paused automatically.
A third security feature is a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions. This third security feature is enabled by using a mike worn by a user within said defined range. Further, this third security feature is enabled by fine tuning input parameters of said controller to read voice commands within said defined range. Still further, this third security feature is enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel. According to a non- limiting exemplary embodiment, if any other person pronounces the same command as a first user, the system detects that the command received is from a warranted or non- warranted user.
A fourth security feature is to provide interruption of commands in relation to operating table, specifically in relation to locking of operating table. According to a non-limiting exemplary embodiment, if a table was locked in a final position, a user shall say 'Lock Table' and then system shall listen for other command(s) and not for table, until a pre-defmed time is over.
The channel of communication between user / doctor / surgeon and system may be a Bluetooth enabled headphone.
A fifth security feature is the introduction of a pre-defined time period wherein system pauses. According to a non-limiting exemplary embodiment, system gets pause automatically after 20 seconds, so that user can speak some similar words which are familiar to commands, but not be executed by the system. The system is not supposed to detect those other words as commands. User can speak as "Pause Robot" and "Resume Robot" as security reason. For Table movement in all six direction speed level is defined so that if user needs minor change he can go for "Slow" mode and if he / she needs quick and long change he / she can chose "Fast" mode.
A sixth security feature is the introduction of a pre-defined range of acceptance of command in relation to a voice input mechanism such as a mike. Preferably, a 6- inch limitation is imposed on to the voice input mechanism such that commands are received within the pre-defined range (6 inch) of the mike. Commands or voices beyond this range, however loud, are not detected and processed by the system of this invention.
A seventh security feature is the introduction of total stop mode for each of the defined equipment. In this total stop mode, the control switches over from voice to other options which could be one of many options such as manual control, soft control, or the like.
For security reasons, foot switches are provided so that if any other sound or problem occurs, user can use foot switch for immediate response.
Once table is set properly user need not move again and again. But he / she needs to control other instruments as well so for safety reason "Lock Table" command locks table and moved no more. Till User speaks "Unlock Table"
In accordance with yet an additional embodiment of this invention, there are provided a plurality of communication channels (CC) adapted to communicably couple the controller to each of the defined equipment in the defined environment. This block informs the controller about the current communication channel selected like USB, Serial, Parallel or None that is manual mode. It also includes as a signal booster so that any data loss between controller and equipment is compensated.
Controller and equipment electronics, typically, have modbus protocol for * communication. This protocol is standard for safer communication. Same protocol helps to get feedback from controller or associated equipment.
The system of this invention, is adapted to be designed using two forms
• Splash
• Main form
In splash form, the system welcomes doctor / surgeon and checks communication and basic protocols.
In main form, the system starts listening to every command from user so that the system can process the same and forward to controller.
An operator gives voice commands that are processed by voice based system. After doing speech analysis, the system decodes these voice commands and issues corresponding commands to controller through selected communication channel.
Then controller acts upon these commands and sends back confirmation. While executing this process different safety measures are taken.
While processing a command, the controller breaks a command in two parts;
equipment identity and function identity. It may also break the command in three parts; equipment identity, function identity, and range identity. According to equipment identity, the controller provides command signals in order to execute the told function. Then it generates task complete message and sends it back to system.
In accordance with yet an additional embodiment of this invention, there is provided a sensor feedback means (SFM) adapted to comprises a plurality of sensing elements located at each equipment. This provides feedback to the controller about the process, which has been executed or is being executed. This can be relayed to the user through voice output means (VOM) such as headphones or speakers (as seen in Figure 3 of the accompanying drawings). E.g. if, operation table output card when a motor is turned on, speed of the motor is constantly measured using a speed sensor and this information is passed on to controller so that it can take any corrective measures, if necessary. At the same time, position sensors make sure that motors do not move the operation table top beyond its extreme limits. As soon as these maximum or minimum positions are reached, these sensors send data to controller and motor is stopped immediately to avoid overloading of mechanical system. Data being sent from sensor to controller is digital or is in voltage form as the controller is capable of processing both.
In accordance with still an additional embodiment of this invention, there is provided a visual indication or display means (VM) adapted to indicate or display correct receipt of voice command. Further, it may indicate or display the plurality of equipment that can be controlled in the defined environment. This may in terms of equipment identity, function identity, range identity, and the like.
Specifically, the system and method of this invention relates to an open access control system such that any make and any number of equipment may be adapted to be controlled by this control system, in an easy and cost-effective manner. System and Method of control may relate to soft-GUI based controls or voice actuated controls. Further, the system and method of this invention much specifically related to providing control in relation to voice command without the use of a voice card.
This invention relates to a system and method for controlling a defined environment such as an Operation Theater with help of voice recognition, voice (pre defined words) recognition of any person using any accent. User interface for controlling variety of instruments is available in the theater. User interface with three media; Audio, Mouse (monitor) and Foot Switch are provided to control each entity. Operation theater includes all kind of instruments (e.g. Suction Machine, Cautary Machine, Lights, etc) and Operation Table
The following are the highlights of the system and method of this invention:
1. A system and method for controlling operation table through controller and electronically interfaced system - actuated by voice control.
2. Voice recognition using Wireless technology.
3. Voice recognition system used by controller for controlling whole system.
4. Voice recognition without any audio card.
5. Voice recognition without any training needed for each user.
6. No Ascent dependency for command detection.
7. Security used regarding false command and self stopping system.
8. Electronics interface with predefined protocol for safer and authentic communication.
9. User friendly display using images to control without audio or foot switch.
10. Controller designed to interface only with predefined equipment. Further, it is to be noted that all the voice activated functions can be simulated on to a dashboard for soft activation and control.
The technical advancement of this invention lies in providing a voice controlled operation theater automation system for controlling defined equipment in the operation theater without the use of voice card. The system of this invention is enabled by using an output card which has been designed to work in conjunction with the plurality of defined equipment as well as with a software system which processes the voice command to correctly recognise the commands and to correctly control the requisite equipment. This provides for plug and play modularity, thereby enabling any brand of equipment to be used with voice controlled operation theater automation system of this invention. Multiple actuating elements can be coupled to the designed output card. The system and method is intuitive and filters background noise due to the frequency defined. The system provides voice control of equipment, in a real-time manner. The various security features have been iteratively developed to incorporated for ease of use, for intuition of use, and for industrial applicability of use.
While this detailed description has disclosed certain specific embodiments of the present invention for illustrative purposes, various modifications will be apparent to those skilled in the art which do not constitute departures from the spirit and scope of the invention as defined in the following claims, and it is to be distinctly understood that the foregoing descriptive matter is to be interpreted merely as illustrative of the invention and not as a limitation.
BLANK SHEET

Claims

Claims,
1. A voice controlled operation theater automation system comprising:
- equipment defining means adapted to define each equipment adapted to be used within a defined environment;
- function defining means adapted to define function related to each of said defined equipment;
- range defining means adapted to define range of operation of each defined function of each defined equipment;
- voice based system adapted to control each defined equipment in terms of its defined functions and in terms of defined range of defined function;
- security features' enabling means adapted to enable pre-defined security features in relation to voice based operation for said defined range of said defined function of said defined equipment;
- voice input means adapted to allow input of voice command(s);
- controller adapted to receive voice command(s) and further adapted to provide control signals corresponding to said voice command in relation to each defined range related to each defined function of each defined equipment; and
- an output card adapted to interface with each defined equipment and said controller and further adapted to actuate each of said corresponding defined equipment in terms of its function and / or range after receiving control signals from a user processed via said controller; thereby providing plug and play modularity for use, of each of said defined equipment, using said system.
2. A voice controlled operation theater automation system as claimed in claim 1 wherein, said output card further comprises ports which interface with a plurality of physical actuating elements adapted to actuate corresponding defined equipment.
3. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a first security feature adapted to provide a pause function using a pause command and to provide a start function using a start command characterised in that said first security feature disables additional voice commands after a pause command until a start command is received.
4. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a second security feature adapted to provide an auto-pause function for a pre-defined time limit which is effected after the last command and elapsing of the pre-defined time limit.
5. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions.
6. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by using a mike worn by a user within said defined range.
7. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by fine tuning input parameters of said controller to read voice commands within said defined range.
8. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel.
9. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a fourth security feature adapted to provide interruption of commands, for a pre-defined time period, in relation to an operating table, specifically in relation to locking of operating table.
10. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a fifth security feature is the introduction of a pre-defined time period, after each voice command, wherein system pauses before receiving additional voice commands.
11. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a sixth security feature adapted to provide a pre-defined range of acceptance of command in relation to a voice input mechanism.
12. A voice controlled operation theater automation system comprising said security features' enabling means as claimed in claim 1 wherein, said security features' enabling means further comprising a seventh security feature adapted to provide total stop mode for each of the defined equipment, such that in said total stop mode, control switches over from voice to other pre-defined options selected from a group of options consisting of manual control option, soft control option, and the like options.
13. A voice controlled operation theater automation system as claimed in claim 1 wherein, said equipment being selected from a group of equipment consisting of Table (Bed) with six degrees of freedom, Lights, Suction Machine, Cautary Machine , Drill Machine, Door.
14. A voice controlled operation theater automation system as claimed in claim 1 wherein, said equipment comprising a laparoscopic . probe and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to drive each of said discrete drive mechanism means to position the tip of said probe in its operative configuration within a body cavity, said range of motion of this laparoscopic probe being selected from a group of motions consisting of up motion, down motion, right motion, left motion, in motion, out motion, and its combinations.
15. A voice controlled operation theater automation system comprising said function defining means as claimed in claim 1 wherein, said function defining means adapted to define functions selected from a group of functions consisting of movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and their combinations.
16. A voice controlled operation theater automation system comprising said range defining means as claimed in claim 1 wherein, said range defining means adapted to define ranges in terms of linear displacement, angular displacement, intensity, speed, and their combinations.
17. A voice controlled operation theater automation system as claimed in claim 1 wherein, said voice based system comprising word input means adapted to allow a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like.
18. A voice controlled operation theater automation system as claimed in claim 1 wherein, said voice based system comprising training means adapted to include a training routine for training the system for understanding each defined equipment, each defined function, each defined range, in a spoken format based on voice related parameters.
19. A voice controlled operation theater automation system as claimed in claim 1 wherein, said voice based system comprising voice based security feature extrication means adapted to be enabled during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment.
20. A voice controlled operation theater automation system as claimed in claim 1 wherein, said voice based system comprising words' recognition means adapted to allow the system to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range.
21. A voice controlled operation theater automation system comprising said controller as claimed in claim 1 wherein, said controller being further adapted to:
- read each defined identity of equipment within a defined environment;
- read each defined function related to each defined identity of each defined equipment;
- read each defined range related to each defined function of each defined identity;
- provide control signals in relation to each defined equipment;
- provide control signals in relation to each defined function related to each defined equipment; and
- provide control signals in relation to each defined range related to each defined function of each defined equipment.
22. A voice controlled operation theater automation system comprising said controller as claimed in claim 1 wherein, said controller being further adapted to read and decipher each voice command and to provide corresponding control signals to a corresponding actuating element on said output card in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
23. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising a voice input means adapted to interface with said voice based system in order to relay voice based commands from a user.
24. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising foot switches for immediate response.
25. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising a plurality of communication channels adapted to communicably couple said controller to each of the defined equipment in the defined environment.
26. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system being a splash mode operable system in at least one part in order to initiate said system and said user.
27. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system being a main mode operable system in at least one part in order to enable said system to start listening to every command from said user so that the system can process the same and forward to said controller.
28. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising controller to breaks a voice command in two parts; equipment identity and function identity.
29. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising controller to breaks a voice command in three parts; equipment identity, function identity, and range identity.
30. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising sensor feedback means adapted to comprise a plurality of sensing elements located at each equipment in order to provide feedback to said controller about function and / or range being performed per equipment based on said voice command.
31.A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising sensor feedback means adapted to comprise a plurality of sensing elements located at each equipment in order to limit function and / or range in relation to pre-defined limits.
32. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising a visual indication or display means adapted to indicate or display correct receipt of voice command.
33. A voice controlled operation theater automation system as claimed in claim 1 wherein, said system comprising a visual indication or display means adapted to indicate or display the plurality of equipment that can be controlled in the defined environment.
34. A voice controlled operation theater automation method comprising the steps of:
- defining each equipment, using equipment defining means, adapted to be used within a defined environment;
- defining function, using function definition means, related to each of said defined equipment;
- defining range of operation, using range defining means, of each defined function of each defined equipment;
- controlling each defined equipment, using a voice based system, in terms of its defined functions and in terms of defined range of defined function; - enabling pre-defined security features, using security features' enabling means, in relation to voice based operation for said defined range of said defined function of said defined equipment;
- allowing input of input of voice command(s), using voice input means;
- receiving voice command(s) and further providing control signals, using a controller, corresponding to said voice command in relation to each defined range related to each defined function of each defined equipment; and
- interfacing with each defined equipment and said controller and further actuating each of said corresponding defined equipment, using a an output card, in terms of its function and / or range after receiving control signals from a user processed via said controller; thereby providing plug and play modularity for use, of each of said defined equipment, using said method.
35. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of interfacing with each defined equipment and said controller and further actuating each of said corresponding defined equipment, using an output card comprises a step of interfacing with ports on said output card, which ports interface with a plurality of physical actuating elements adapted to actuate corresponding defined equipment.
36. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a first security feature adapted to provide a pause function using a pause command and to provide a start function using a start command characterised in that said first security feature disables additional voice commands after a pause command until a start command is received.
37. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a second security feature adapted to provide an auto-pause function for a pre-defined time limit which is effected after the last command and elapsing of the pre-defined time limit.
38. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defmed security features comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions.
39. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by using a mike worn by a user within said defined range.
40. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by fine tuning input parameters of said controller to read voice commands within said defined range.
41. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a third security feature adapted to be a detection feature which detects only one voice at a time or within a defined time range or within a range defined by pre-defined functions, said third security feature being enabled by defining input parameters in relation to a given set of frequencies, in relation to given set of amplitudes, and in relation to a given set of directions of sound wave travel.
42. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a fourth security feature adapted to provide interruption of commands, for a pre-defined time period, in relation to an operating table, specifically in relation to locking of operating table.
43. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a fifth security feature is the introduction of a pre-defined time period, after each voice command, wherein method pauses before receiving additional voice commands.
44. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a sixth security feature adapted to provide a pre-defined range of acceptance of command in relation to a voice input mechanism.
45. A voice controlled operation theater automation method comprising said step of enabling pre-defined security features as claimed in claim 34 wherein, said step of enabling pre-defined security features comprising a seventh security feature adapted to provide total stop mode for each of the defined equipment, such that in said total stop mode, control switches over from voice to other pre-defined options selected from a group of options consisting of manual control option, soft control option, and the like options.
46. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of defining each equipment, using said equipment defining means, further comprising a step of selecting said equipment from a group of equipment consisting of Table (Bed) with six degrees of freedom, Lights, Suction Machine, Cautary Machine , Drill Machine, Door.
47. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of defining each equipment, using said equipment defining means, further comprising a step of selecting a laparoscopic probe and control mechanism for holding the laparoscopic probe and precisely positioning the tip of said probe in its operative configuration within a body cavity said control equipment comprising: (i) a housing adapted to be arcuately movable about a vertical axis in a first plane in its operative configuration; (ii) a post extending from said housing, angularly displaceable in a second plane being perpendicular to said first plane; (iii) an arm fitted in proximity to the apex of the operative top end of said post, said arm being angularly displaceable in a third plane being mutually perpendicular to said first and second planes and defining a free end; (iv) a clamp adapted to be fitted to said free end and adapted to hold the probe of a laparoscope in position; (v) discrete drive mechanisms adapted to displace said housing, post and arm in respective first, second and third planes; and (vi)control means adapted to drive each of said discrete drive mechanism means to position the tip of said probe in its operative configuration within a body cavity, said range of motion of this laparoscopic probe being selected from a group of motions consisting of up motion, down motion, right motion, left motion, in motion, out motion, and its combinations.
48. A voice controlled operation theater automation method, as claimed in claim 34 wherein, said step of defining function, using function definition means, comprising a step of defining functions selected from a group of functions consisting of movement functions, switch On and Switch Off functions, linear displacement functions, angular displacement functions, intensity functions, speed functions, and their combinations.
49. A voice controlled operation theater automation method, as claimed in claim 34 wherein, said step of defining ranges, using range definition means, comprising a step of defining ranges in terms of linear displacement, angular displacement, intensity, speed, and their combinations.
50. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of controlling each defined equipment, using a voice based system comprising a step of allowing a user to input words in relation to each equipment, in relation to each function of each equipment, in relation to each range for each function of each equipment and the like; using word input means.
51. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of controlling each defined equipment, using a voice based system comprising a step of including a training routine for training the method for understanding each defined equipment, each defined function, each defined range, in a spoken format based on voice related parameters; using training means.
52. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of controlling each defined equipment, using a voice based system comprising a step of enabling voice based security features during initialisation such that a user's voice parameters are recorded and such that these parameters are used as a safety mechanism to ensure that only authorised personnel can provide voice commands in the defined environment and to ensure that only the voice of authorised personnel are used for actuation of equipment within the defined environment; using voice based security feature extrication means.
53. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of controlling each defined equipment, using a voice based system comprising a step of allowing said method to pick up words or combination of words, as defined, in order to provide corresponding signals to each of said equipment in relation to their function and range; using words' recognition means.
54. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of controlling each defined equipment, using a voice based system comprising further steps of:
- reading each defined identity of equipment within a defined environment;
- reading each defined function related to each defined identity of each defined equipment;
- reading each defined range related to each defined function of each defined identity;
- providing control signals in relation to each defined equipment;
- providing control signals in relation to each defined function related to each defined equipment; and
- providing control signals in relation to each defined range related to each defined function of each defined equipment.
55. A voice controlled operation theater automation method as claimed in claim 34 wherein, said step of controlling each defined equipment, using a voice based system comprising further steps of reading and deciphering each voice command and providing corresponding control signals to a corresponding actuating element on said output card in order to actuate corresponding action on the corresponding equipment for which the voice command is intended.
56. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of interfacing voice input means with said voice based system in order to relay voice based commands from a user.
57. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising use of foot switches for immediate response.
58. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of communicably coupling said controller to each of the defined equipment in the defined environment using a plurality of communication channels.
59. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method being a splash mode operable method in at least one part in order to initiate said method and said user.
60. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method being a main mode operable method in at least one part in order to enable said method to start listening to every command from said user so that the method can process the same and forward to said controller.
61. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of breaking a voice command in two parts; equipment identity, and function identity - using said controller.
62. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of breaking a voice command in three parts; equipment identity, function identity, and range identity - using said controller.
63. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of providing feedback to said controller about function and / or range being performed per equipment based on said voice command using sensor feedback means which further comprises plurality of sensing elements located at each equipment.
64. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of limiting function and / or range in relation to pre-defined limits using sensor feedback means which further comprises plurality of sensing elements located at each equipment.
65. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of indicating of displaying correct receipt of voice command using visual indication or display means.
66. A voice controlled operation theater automation method as claimed in claim 34 wherein, said method comprising a step of indicating or displaying the plurality of equipment that can be controlled in the defined environment using visual indication or display means.
PCT/IN2013/000369 2012-06-15 2013-06-14 A voice controlled operation theater automation system WO2013186794A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN1729/MUM/2012 2012-06-15
IN1729MU2012 2012-06-15

Publications (2)

Publication Number Publication Date
WO2013186794A2 true WO2013186794A2 (en) 2013-12-19
WO2013186794A3 WO2013186794A3 (en) 2014-02-27

Family

ID=49758825

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2013/000369 WO2013186794A2 (en) 2012-06-15 2013-06-14 A voice controlled operation theater automation system

Country Status (1)

Country Link
WO (1) WO2013186794A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102014204251A1 (en) * 2014-03-07 2015-09-10 Siemens Aktiengesellschaft Method for an interaction between an assistance device and a medical device and / or an operator and / or a patient, assistance device, assistance system, unit and system
CN113129892A (en) * 2021-05-25 2021-07-16 深圳市罗湖区人民医院 Counting method and system for surgical articles
EP4005462A1 (en) 2020-11-25 2022-06-01 KHS GmbH Operation assistance system and method for the generation of control signals for voice control of a motor-controlled mobile robot kinematics of such an operation assistance system
US11382703B2 (en) 2017-01-30 2022-07-12 Aktormed Gmbh Surgical assistance system and method for generating control signals for voice control of a surgical assistance system robot kinematics that can be moved in a motor-controlled manner

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010040496A1 (en) * 1996-06-24 2001-11-15 Yulun Wang General purpose distributed operating room control system
US6591239B1 (en) * 1999-12-09 2003-07-08 Steris Inc. Voice controlled surgical suite
US6642836B1 (en) * 1996-08-06 2003-11-04 Computer Motion, Inc. General purpose distributed operating room control system
US20040124964A1 (en) * 1996-08-06 2004-07-01 Computer Motion, Inc. General purpose distributed operating room control system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010040496A1 (en) * 1996-06-24 2001-11-15 Yulun Wang General purpose distributed operating room control system
US6642836B1 (en) * 1996-08-06 2003-11-04 Computer Motion, Inc. General purpose distributed operating room control system
US20040124964A1 (en) * 1996-08-06 2004-07-01 Computer Motion, Inc. General purpose distributed operating room control system
US6591239B1 (en) * 1999-12-09 2003-07-08 Steris Inc. Voice controlled surgical suite

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102014204251A1 (en) * 2014-03-07 2015-09-10 Siemens Aktiengesellschaft Method for an interaction between an assistance device and a medical device and / or an operator and / or a patient, assistance device, assistance system, unit and system
US9927966B2 (en) 2014-03-07 2018-03-27 Siemens Aktiengesellschaft Method for enabling an interaction between an assistance device and a medical apparatus and/or an operator and/or a patient, assistance device, assistance system, unit, and system
US11382703B2 (en) 2017-01-30 2022-07-12 Aktormed Gmbh Surgical assistance system and method for generating control signals for voice control of a surgical assistance system robot kinematics that can be moved in a motor-controlled manner
EP4005462A1 (en) 2020-11-25 2022-06-01 KHS GmbH Operation assistance system and method for the generation of control signals for voice control of a motor-controlled mobile robot kinematics of such an operation assistance system
DE102020131232B4 (en) 2020-11-25 2023-07-06 Aktormed Gmbh Operation assistance system and method for generating control signals for voice control of a motor-controlled moveable robot kinematics of such an operation assistance system
CN113129892A (en) * 2021-05-25 2021-07-16 深圳市罗湖区人民医院 Counting method and system for surgical articles

Also Published As

Publication number Publication date
WO2013186794A3 (en) 2014-02-27

Similar Documents

Publication Publication Date Title
US11490976B2 (en) Surgical system with voice control
US10420625B2 (en) Vibration detection module, vibration detection method, and surgical system
CN104688347B (en) Surgical operation robot system and its control method
US10182873B2 (en) Structural adjustment systems and methods for a teleoperational medical system
JP5927366B1 (en) Medical system
US11596485B2 (en) Method of remotely supporting surgery assistant robot and remote support system
US20210205027A1 (en) Context-awareness systems and methods for a computer-assisted surgical system
WO2013186794A2 (en) A voice controlled operation theater automation system
US9131989B2 (en) Operating room environment
CN110913792A (en) System and method for state-based speech recognition in a remote operating system
CN114401691A (en) Hand-held user interface device for surgical robot
US11880513B2 (en) System and method for motion mode management
JP5945644B1 (en) Medical system
JP2007323607A (en) Medical treatment control device
US20220096197A1 (en) Augmented reality headset for a surgical robot
JP2001029360A (en) Medical treatment control system
JP2000185022A (en) Mri device
JP2007075519A (en) Operating room controlling system
EP4344668A1 (en) Remote surgery support system
US20230278222A1 (en) Robotic system for remote operation of equipment in infectious environments
US20240099558A1 (en) Remote surgery support system and mentor-side operating device
WO2023171263A1 (en) Control device and medical robot

Legal Events

Date Code Title Description
122 Ep: pct application non-entry in european phase

Ref document number: 13804245

Country of ref document: EP

Kind code of ref document: A2