US20140058564A1 - Visual force feedback in a minimally invasive surgical procedure - Google Patents
Visual force feedback in a minimally invasive surgical procedure Download PDFInfo
- Publication number
- US20140058564A1 US20140058564A1 US14/066,823 US201314066823A US2014058564A1 US 20140058564 A1 US20140058564 A1 US 20140058564A1 US 201314066823 A US201314066823 A US 201314066823A US 2014058564 A1 US2014058564 A1 US 2014058564A1
- Authority
- US
- United States
- Prior art keywords
- force
- end effector
- information
- image
- deformation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1628—Programme controls characterised by the control loop
- B25J9/1633—Programme controls characterised by the control loop compliant, force, torque control, e.g. combined with position control
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
-
- A61B19/2203—
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/35—Surgical robots for telesurgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/37—Master-slave robots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
- A61B34/76—Manipulators having means for providing feel, e.g. force or tactile feedback
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/064—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
- A61B2090/065—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension for measuring contact or contact pressure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S901/00—Robots
- Y10S901/46—Sensing device
- Y10S901/47—Optical
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Robotics (AREA)
- Medical Informatics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Mechanical Engineering (AREA)
- Manipulator (AREA)
Abstract
Methods of and a system for providing a visual representation of force information in a robotic surgical system. A real position of a surgical end effector is determined. A projected position of the surgical end effector if no force were applied against the end effector is also determined. Images representing the real and projected positions are output superimposed on a display. The offset between the two images provides a visual indication of a force applied to the end effector or to the kinematic chain that supports the end effector. In addition, tissue deformation information is determined and displayed.
Description
- This non-provisional application claims the benefit under 35 U.S.C. §119(e) of provisional U.S. Pat. App. No. 61/204,085 (filed Dec. 31, 2008), which is incorporated herein by reference.
- This application is related to non-provisional U.S. patent application Ser. No. ______ [Attorney Docket No. ISRG 01450/US, entitled “Obtaining Force Information in a Minimally Invasive Surgical Procedure”](concurrently filed) and to provisional U.S. Pat App. No. 61/204,083 (filed Dec. 31, 2008), both of which are incorporated herein by reference.
- Minimally invasive surgical (MIS) procedures have become more common using robotic (e.g., telerobotic) surgical systems. One example of such a system is the minimally invasive robotic surgery system described in commonly owned U.S. Pat. No. 7,155,315 (filed Dec. 12, 2005), entitled “Camera Referenced Control in a Minimally Invasive Surgical Apparatus.”
- A common form of minimally invasive surgery is endoscopy. Endoscopic surgical instruments in minimally invasive medical techniques generally include an endoscope for viewing the surgical field and working tools defining end effectors. The working tools are similar to those used in conventional (open) surgery, except that the working end or end effector of each tool is separated from its handle by an approximately 12-inch long extension tube. Typical surgical end effectors include clamps, graspers, scissors, staplers, or needle holders, as examples.
- To manipulate end effectors, a human operator, typically a surgeon, manipulates or otherwise commands a locally provided master manipulator. Commands to the master manipulator are translated as appropriate and sent to a slave manipulator that could be remotely deployed. The slave manipulator then moves the end effector according to the user's commands.
- In order to duplicate the “feel” of actual surgery, force feedback may be included in minimally invasive robotic surgical systems. To provide such feedback, conventional systems have the remote slave manipulator feed back force information to the master manipulator, and that force information is utilized to provide haptic feedback to the surgeon so that the surgeon feels as if he or she is manipulating the end effectors directly by hand.
- The following presents a simplified summary of some embodiments of the invention in order to provide a basic understanding of the invention. This summary is not an extensive overview of the invention. It is not intended to identify key/critical elements of the invention or to delineate the scope of the invention. Its sole purpose is to present some embodiments of the invention in a simplified form as a prelude to the more detailed description that is presented later.
- In accordance with an aspect of the invention, a method of providing visual representation of force information for a robotic surgical system is provided. The method includes determining a force applied against a surgical end effector, displaying an image that shows an actual position of the end effector under the applied force, and superimposing another image over the image that shows the actual position. The second image represents a projected position of the end effector if no force were applied, and the offset between the two images provides a visual indication of the force applied to the end effector. The applied force may be, e.g., a reactive force from tissue as the end effector is pressed against that tissue.
- In accordance with another aspect of the invention, a system for providing a visual force representation of force information for a robotic surgical system is provided. An image input captures an image of an end effector while force is applied to the end effector, and a display is used to output the captured image. An electronic data processor generates another image that represents a projected position of the end effector if no force were applied, and the processor superimposes the generated image over the first image, so that the offset between the two images provides a visual indication of the force applied to the end effector.
- In accordance with another aspect of the invention, a method of providing a visual representation of tissue deformation in a robotic surgical system is provided. Force is applied against the tissue, and the resulting tissue deformation is determined. Information about the tissue deformation is displayed.
-
FIG. 1 shows a top view of an operating room which includes a minimally invasive telesurgical system in accordance with an embodiment; -
FIG. 2 is front view of a patient cart for the minimally invasive telesurgical system ofFIG. 1 ; -
FIG. 3 is a block diagram representing components of the minimally invasive telesurgical system ofFIG. 1 ; -
FIG. 4 is a block diagram representing components for a computer for use in the minimally invasive telesurgical system ofFIG. 1 in accordance with an embodiment; -
FIG. 5 is a flowchart representing steps for calculating force on an end effector in accordance with an embodiment; -
FIG. 6 is a diagrammatic representation of movement of an end effector between positions A and B with force F resisting the movement; -
FIG. 7 is a flowchart representing steps for displaying force in accordance with an embodiment; -
FIG. 8 is a side perspective view of an end effector and synthetic representation of an end effector showing force in accordance with an embodiment; -
FIG. 9 is a flowchart representing steps for displaying a synthetic model in accordance with an embodiment; -
FIG. 10 is a side perspective view of a master controller in accordance with an embodiment; -
FIG. 11 is a flow chart representing steps for filtering forces to limit force measurements primarily to tip forces in accordance with an embodiment; and -
FIG. 12 is a flow chart representing steps for displaying deformation of a tissue using variations in color in accordance with an embodiment. - In the following description, various embodiments of the present invention will be described. For purposes of explanation, specific configurations and details are set forth in order to provide a thorough understanding of the embodiments. However, it will also be apparent to one skilled in the art that the present invention may be practiced without the specific details. Furthermore, well-known features may be omitted or simplified in order not to obscure the embodiment being described.
- Referring now to the drawings, in which like reference numerals represent like parts throughout several views,
FIG. 1 shows a minimally invasivetelesurgical system 20 having an operator station orsurgeon console 30 in accordance with an embodiment. Thesurgeon console 30 includes aviewer 32 where an image of a surgical site is displayed to a surgeon S. As is known, a support (not shown) is provided on which the surgeon S can rest his or her forearm while gripping two master controls 700 (FIG. 10 ), one in each hand. More controls may be provided if more end effectors are available, but typically a surgeon manipulates only two controls at a time and, if multiple end effectors are used, the surgeon releases one end effector with amaster control 700 and grasps another with same master control. When using thesurgeon console 30, the surgeon S typically sits in a chair in front of the surgeon console, positions his or her eyes in front of theviewer 32, and grips themaster controls 700, one in each hand, while resting his or her forearms on the support. - A
patient side cart 40 of thetelesurgical system 20 is positioned adjacent to a patient P. In use, thepatient side cart 40 is positioned dose to the patient P requiring surgery. Thepatient side cart 40 typically is stationary during a surgical procedure, and it includes wheels or castors to render it mobile. Thesurgeon console 30 is typically positioned remote from thepatient side cart 40 and may be separated from the patient side cart by a great distance, even miles away, but will typically be used within the same operating room as the patient cart. - The
patient side cart 40, shown in more detail inFIG. 2 , typically includes two or more robotic arm assemblies. Each arm assembly typically includes unpowered, lockable “set up” joints and powered “manipulator” joints. In the embodiment shown inFIG. 2 , thepatient side cart 40 includes fourrobotic arm assemblies robotic arm assembly surgeon console 30. Thus, movement of therobotic arm assemblies - One of the robotic arm assemblies, indicated by the
reference numeral 42, is arranged to hold animage capturing device 50, e.g., an endoscope, or the like. The endoscope orimage capturing device 50 includes aviewing end 56 at a remote end of anelongate shaft 54. Theelongate shaft 54 permits theviewing end 56 to be inserted through a surgery entry port of the patient P. Theimage capturing device 50 is operatively connected to theviewer 32 of thesurgeon console 30 to display an image captured at itsviewing end 56. - Each of the other
robotic arm assemblies tool tools robotic arm assemblies end effectors tools end effectors 66. 68, 70 to be inserted through surgical entry ports of the patient P. Movement of theend effectors tools surgeon console 30. The instruments are typically removably attached to the manipulator arms, and a mechanical interface between the instrument and the arm transmits actuating forces to the instrument. - The
telesurgical system 20 includes avision cart 80. In an embodiment, thevision cart 80 includes most of the “core” computer equipment or other controls for operating thetelesurgical system 20. As an example, signals sent by the master controllers of thesurgeon console 30 may be sent to thevision cart 80, which in turn may interpret the signals and generate commands for theend effectors robotic arm assemblies image capturing device 50 to the viewer 34 may be processed by, or simply transferred by, thevision cart 80. In other embodiments, “core” computer equipment for the telesurgical system may be distributed in the surgeon console and patient side cart. -
FIG. 3 is a diagrammatic representation of thetelesurgical system 20. As can be seen, the system includes thesurgeon console 30, thepatient side cart 40, and thevision cart 80. In addition, in accordance with an embodiment, anadditional computer 82 anddisplay 84 are provided. These components may be incorporated in one or more of thesurgeon console 30, thepatient side cart 40, and/or thevision cart 80. For example, the features of thecomputer 82 may be incorporated into thevision cart 80. In addition, the features of thedisplay 84 may be incorporated into thesurgeon console 30, for example, in theviewer 32, or may be provided by a completely separate display or the surgeon console or on another location. In addition, in accordance with an embodiment, thecomputer 82 may generate information that may be utilized without a display, such as thedisplay 84. - Although described as a “computer,” the
computer 82 may be a component of a computer system or any other software or hardware that is capable of performing the functions herein. Moreover, as described above, functions and features of thecomputer 82 may be distributed over several devices or software components. Thus, thecomputer 82 shown in the drawings is for the convenience of discussion, and it may be replaced by a controller, or its functions may be provided by one or more components. -
FIG. 4 shows components of thecomputer 82 in accordance with an embodiment. In the embodiment shown in the drawing, thecomputer 82 includes atool tracking component 90, akinematic component 92, and aforce component 94. Briefly described, thetool tracking component 90 andkinematic component 92 provide information to theforce component 94. Theforce component 94 combines or otherwise utilizes this information and outputs aforce output 96. - A positional component is included in or is otherwise associated with the
computer 82. The positional component provides information about a position of an end effector, such as one of theend effectors tool tracking component 90 is the positional component, and it provides information about a position of an end effector, such as theend effectors image capturing device 50 to provide information about the position of an end effector, but other information may be used instead of, or in addition to, this visual information, including sensor information, kinematic information, any combination of these, or additional information that may provide the position and/or orientation of theend effectors tool tracking component 90 are disclosed in U.S. Pat. App. Pub. No. US 2006/0258938, entitled, “Methods and System for Performing 3-D Tool Tracking by Fusion of Sensor and/or Camera Derived Data During Minimally Invasive Robotic Surgery”; U.S. Pat. No. 5,950,629 (filed Apr. 28, 1994), entitled “System for Assisting a Surgeon During Surgery”; U.S. Pat. No. 6,468,265 (filed Nov. 9, 1999), entitled “Performing Cardiac Surgery Without Cardioplegia”; and U.S. Pat. App. Pub. No. US 2008/0004603 A1 (filed Jun. 29, 2006), entitled “Tool Position and Identification Indicator Displayed in a Boundary Area of a Computer Display Screen.” In accordance with an embodiment, thetool tracking component 90 utilizes the systems and methods described in commonly owned U.S. Pat. App. No. 61/203,975 (filed Dec. 31, 2008), which is incorporated herein by reference. In general, the positional component maintains information about the actual position and orientation of end effectors. This information is updated depending upon when the information is available, and may be, for example, asynchronous information. - To manipulate the
tools robotic arm assemblies FIG. 4 ). Since the construction and operation of such robotic manipulators are well known, their details need not be repeated here. For example, general details on robotic manipulators of this type can be found in John J. Craig, Introduction to Robotics Mechanics and Control, 2nd edition, Addison-Wesley Publishing Company, Inc., 1989. - The
kinematic component 92 is generally any device that estimates a position, herein a “kinematic position,” of an end effector utilizing information available through thetelesurgical system 20. In an embodiment, thekinematic component 92 utilizes kinematic position information from joint states of a linkage to the end effector. As an example, thekinematic component 92 may utilize the master/slave architecture for thetelesurgical system 20 to calculate intended Cartesian positions of theend effectors encoders 102,FIG. 4 ) for the joints in the linkage for each of thetools - As is known, during movement of a linkage, a master controller provides instructions, for example via the
vision cart 80, to the slave manipulators to cause corresponding movement of the robot. The instructions provide a position (herein “command position”) in which the master manipulators direct the slave manipulators. This command, position is the position at which the tool or end effector is ideally located as instructed by the master manipulator, and it would be the actual position if there were no errors in the joints and no flexing in the components of the linkage. - In reality, however, an end effector or tool may be in a different location than the command position, either initially or after a sequence of moves by the slave manipulator. In some telesurgical systems, detected joint positions, provided by the
encoders 102, may provide information about an estimated position of end effector (herein an “encoder-detected position” of the end effector). The difference between the command position and the encoder-detected position may be used to generate a joint position or kinematic error, and torque commands may be provided for correcting the position of the end effector from the encoder-detected position to the command position, in the form of a correction. - If a joint correction is made for joint position error as described above, then the new corrected position of the end effector is referred to herein as the “corrected position.” This corrected position is not necessarily aligned with the command position, because there may be errors in the stiffness of the joints or the readings of the encoders. In addition, even if the joints were aligned perfectly, there may be some flexion in the components of the linkage, causing the actual position of end effector to not completely align with the control position.
-
FIG. 5 is a flowchart representing steps for calculating force on an end effector in accordance with an embodiment. In accordance with this embodiment, a comparison is made between a kinematic position of the end effector versus an actual position of the end effector, and such comparison represents force on the end effector. In such an embodiment, the kinematic position may be the corrected position, if used, or the encoder-detected position. Since forces applied to the tool, such as a static force experienced when the tool is pressing against an obstruction, can cause the parts of a linkage or tool to flex without a detectible change in joint states, the actual position of the end effector may not match the kinematic position of the end effector, even if the kinematic position is the corrected position and the corrected position is accurate with respect to the command position. In accordance with the embodiment shown inFIG. 5 , this difference in position may be used to indicate force. - At
step 500, the end effector begins at position A. Although described as “positions” herein, a change in position may be a change in time in which there is no movement of the end effector. However, for ease of description, “position” is used herein to mean a change of time and/or position. Atstep 502, the actual position of the end effector is stored. This actual position is obtained by, for example, thetool tracking component 90. Atstep 504, the kinematic information for the end effector is stored. This information may be obtained, for example, via thekinematic component 92. - In accordance with an embodiment, an offset may be stored at
step 506. This offset provides information regarding the difference between the kinematic information stored instep 504 and the actual position information stored instep 502. Utilizing the offset, the kinematic information and the actual position information may be registered to the same position. - At
step 508, the end effector moves to position B. Instep 510, the change in actual position of the end effector is calculated between the actual position of the tool at position B versus the actual position of the tool in position A. Atstep 512, the change in position is calculated using kinematic information obtained via thekinematic component 92. If desired, although not required, another offset may be determined at position B. Atstep 514, the force on the tool is represented by the difference between the change in actual positions between A and B and the change in kinematic positions between A and B. The difference between the change in actual position and the change in kinematic position is utilized to represent direction and amount of force applied to the end effector, for example, supplied by contact of the end effector with body parts. - The amount of force deflection is a function of the flexibility of the tool and/or linkage, and the distance from where a force is applied to the end effector to the exit of the cannula (body port entry). This information may be utilized to generate real force metrics using known formulas. However, a user may also be interested in a change in force, and relative differences may be informative as to the amount of force being applied.
- As an example,
FIG. 6 is a diagrammatic representation of movement of an end effector from position A to position B with force F resisting the movement. At position A, an image of anend effector 110 has an actual position shown by the solid outer line for the end effector. Kinematic information (in this example, the corrected position) for the end effector is represented by the dottedline 112. In the diagram shown in the drawing, the kinematic position information matches the actual position information. In reality, however, as described above, the kinematic position information may vary to some degree, and may not match unless the offset provided instep 506 is utilized. For this example, it is assumed that the offset is used or that the kinematic information matches the actual information exactly at position A. Thus, the dottedline 112, representing the kinematic position information provided by thekinematic component 92, matches the position of theimage 110 of the end effector, representing actual position information provided by thetool tracking component 90. In addition, in an embodiment, the actual position may be represented by a video of the tool. - At position B, the actual position of the end effector, represented by the
image 113, is shown as being moved from position A. This actual position, as described above, is calculated by the tool tracking component 90 (e.g., at a frame rate less than or equal to approximately thirty frames per second). The kinematic position information, estimates (e.g., at an update cycle time of approximately 1333 Hz), however, that the tool, in movement from position A to position B, is now at the dottedline 114 shown with position B. The dottedline 114 represents a position where the end effector would be if moved without force being applied to theend effector 110. Absent force being applied to the end effector, this estimate is typically accurate. Although, as described above, kinematic position information is typically not accurate for determining a position of an end effector in space at a start of a process, the kinematic position information typically is accurate in determining a change in position of an end effector if there is no force. - The position shown by the dotted
line 114 assumes that the beginning point of movement for the end effector, with respect to thekinematic component 92, is theline 112. If the kinematic position information did not match the actual position information at position A, then the offset provided instep 506 may be utilized at position B to project the relative position of the dottedline 114 assuming a start atline 112. - The dotted
line 114 is in a different location than the actual position of the end effector due to the difference between the kinematic position information and the actual position information. The difference between the two is due to force applied to the end effector in the movement from position A to position B. For example, in the example shown inFIG. 6 , a force F is applied to the end effector during movement. This force prevents the end effector from moving fully as estimated by thekinematic component 92, shown by the dottedline 114. Instead, the combination of the movement of the linkage for theend effector 110 and the force F results in the end effector being positioned as shown by theimage 113 inFIG. 6B . - The
force output 96 provided by the change in kinematic position information versus actual position information may be useful for a variety of different applications. For example, theforce output 96 may be forwarded to thevision cart 80, which in turn may generate instructions for thesurgeon console 30 to create tactile feedback to the surgeon S so that the surgeon is provided positive feedback of the existence of force. In addition, in accordance with an embodiment and as is described above with reference toFIG. 6 , theforce output 96 may be utilized to generate an image representing force applied to the end effector. For example, by displaying the diagram at the B portion ofFIG. 6 , a representation of force applied on the end effector is provided. That is, providing the visual image of where the end effector would be absent force (i.e., the dotted line 114), and simultaneously displaying theimage 113 of the actual location of the end effector, a viewer is provided a visual representation of the force applied to the end effector and the force's effect on the end effector. - In an embodiment, the
force output 96 may be combined with other information, such as the length the tool is inserted into the body and tool properties (e.g., via finite element analysis) to calculate the actual force that is applied on the tool. As can be understood, the amount of deflection of a tool is directly related to how much of the tool is available for flexion. The insertion length of the tool beyond cannula (body wall entry port) to the tip of the tool is readily available from a robotic system. This length, together with a measured deflection can be used to derive another quantity which is invariant to insertion length. This quantity is one step closer to the real force, and therefore can be more intuitive to use. The other factors (such as instrument properties) do not typically change at different instances so surgeons can adapt to them. This new quantity can be displayed by modulating the amount of deflection (for example, if the insertion length is small, increase the amount of actual deflection). The exact modulation can follow some finite element analysis. In general, however, theforce output 96 is useful in that it provides relative force that may be useful as feedback to a surgeon S. - In an embodiment, the timing of the position A may be selected by the
computer 82. As an example, the position A may be initiated by an event, such as closing of grippers or scissors. Alternatively, the position A may be selected by a user, such as the surgeon S. For example, the process above may be initiated by a surgeon, for example by the surgeon touching a foot pedal or double-clicking the master grips of the master controller when at position A so as to start the process. The surgeon's initiation sets position A. After force measurement or reaching position B, a normal mode can be returned by another touch or double-click. In an alternative embodiment, the process may be automated so that it occurs regularly. If desired, the position A may be some combination of an event, information that is available to theimage capturing device 50, taken at regular intervals, or any combination of these. The amount of time elapsed before establishing position B may also be determined by time, information available, or may be requested by the surgeon S. - As an example, a surgeon may grasp an organ or other part of the patient's body with a grasper. Position A may be initiated by the surgeon just prior to or as grasping the organ. The grasper may then register the position B reading, or the surgeon may pull against the organ, and position B may be registered after some pulling. Position B may be selected after a particular amount of time, or it may be selected by the surgeon as desired. In addition, if desired, force output provided by the embodiments described herein may be output as a result of a particular force being applied to the organ. This force output may initiate a warning or other indicator to the surgeon, for example.
- As described above, the force information derived from the method of
FIG. 5 often is directed to the flexion of a tool or the linkage. An advantage of the method is that the force information is typically not impacted by the body wall forces, whereas many joint sensors are. In addition, unlike tip force sensors, the method inFIG. 5 may sense forces along an instrument shaft (typically a Z-axis), assuming the shaft is not parallel to the viewing angle. - The display provided herein, for example, as shown in
FIG. 6B , may be useful in displaying visual information about force, regardless of the force input. That is, the display may be used to display force sensed or otherwise provided from sources other than thecomputer 82. Alternatively, the force information described above may be combined with additional force sensing or other force information to provide more accurate information about force. - As an example of a different source of force information, active force sensors may be utilized to determine the force on an end effector. This force may be displayed on the
display 84 without the need for kinematic information. Such sensors may be, for example, located at the tip of a tool (i.e., at the end effector). The force information, as another example, may be derived from strain gauge measurements on linkages in the slave manipulator manipulating the tool that is being monitored, or it may be derived from encoders associated with joints in the slave manipulator manipulating the tool that is being monitored. Such systems for providing force information are disclosed, for example, in U.S. Pat. App. Pub. No. US 2008/0065111 A1 (filed Sep. 29, 2007), entitled “Force Sensing for Surgical Instruments.” - As another example, force may be calculated using the kinematic error information described above. In one example, the change between the encoder-detected position and the corrected position may be assumed to represent force. Since forces applied to the tool, such as a static force experienced when the tool is pressing against an obstruction, can create a joint position error, an assumption can be made that the difference between the two positions is a result of force on the tool. Typical processing to generate the force information may include filtering and/or gain adjustments. As another example, the force may be extracted from the torque information generated to correct joint errors. Such systems for providing force information are disclosed in U.S. Pat. App. Pub. No. US 2005/0200324 A1 (filed Mar. 30, 2005), entitled “Non-Force Reflecting Method for Providing Tool Force Information to a User of a Telesurgical System.”
- If alternative force information is used as described above, in an embodiment, the actual force on the tool may be extracted by mathematically removing other forces, such as body wall forces and the like. This information may be calculated, for example, by using such information as the length the tool is inserted into the body and tool properties (e.g., via finite element analysis) to extract the actual force that is applied on the tool.
-
FIG. 7 is a flowchart representing steps for displaying force in accordance with an embodiment. Atstep 700, an end effector begins at position A. Atstep 702, the position of A is stored. Atstep 704, the end effector is moved to position B. Atstep 706, the force applied to the end effector in the movement between position A and B is determined, for example by one of the methods described above or by other methods. Atstep 708, an image representing the actual position of the end effector at position B is displayed. This image may be a video view of the actual end effector or another suitable image, such as a synthetic representation of the end effector. Atstep 710, an image representing the end effector without force being applied is displayed. This displayed image may be the dottedline 114 shown inFIG. 6B or any other appropriate image. As an example, the display instep 710 may display force in a particular direction. Force information may be provided on or near the end effector, or may be positioned in a different location, such as in another window. In any event, a user may be provided a visual or other (e.g., audible) indication of force that is applied to the end effector. - The features described herein may be provided in stereoscopic vision so that a user may visualize force in apparent three-dimensional form. As can be understood, in a stereoscopic view, force that is transverse to a direction of view is more visual in such a representation, and force that is parallel to a direction of view may not be displayed, and feedback for forces in these directions may be provided by other mechanisms, such as haptic or a different type of screen display.
- In addition, in accordance with an embodiment, the force information provided above may be provided with other force information, such as sensed force information, to provide a more detailed analysis of force being applied to an end effector.
- In accordance with an embodiment, instead of the dotted
line 114, a synthetic image of an end effector may be displayed as a representation of the actual end effector without load. To this end, modeling data 150 (FIG. 3 ) may be provided that is associated with thepatient side cart 40 and/or thecomputer 82. Themodeling data 150 may be, for example, a two-dimensional or three-dimensional image of the end effector. In an embodiment, such an end effector is a three-dimensional model of the end effector and thus may represent an actual solid model of the end effector. Themodeling data 150 may be, for example, CAD data or other three-dimensional solid model data representing an end effector, such as theend effector 152 shown inFIG. 8 . In an embodiment, the three-dimensional model is manipulatable at each joint so that movements of theend effector 152 may be mimicked by a synthetic model 154 (shown in phantom line inFIG. 8 ) of the end effector. As shown inFIG. 8 , thesynthetic model 154 may be the same size as the image of theactual end effector 152, but it may be larger or smaller. - Although shown in dashed lines in the drawings, the
synthetic model 154 may be represented in a number of different ways. As an example, thesynthetic model 154 may be a transparent image of theend effector 152 or a wire diagram image of the end effector. Thesynthetic model 154 may alternatively be an image that is not transparent, but such a model may make viewing of theactual end effector 152 difficult. -
FIG. 9 is a flowchart representing steps for displaying thesynthetic model 154 in accordance with an embodiment. Instep 900, theend effector 152 begins at position A. In the embodiment shown inFIG. 9 , the synthetic model is displayed in accordance with the actual position information (i.e., is displayed at the actual position of the end effector 152) atstep 902. Thus, the synthetic model is superimposed over the image of theend effector 152, which may be a video image of the end effecter. For example, as shown inFIG. 8 , thesynthetic model 154 is translucent or transparent and may be displayed over the video image of theactual end effector 152. As another option, thesynthetic model 154 may start at a location other than the actual position of theend effector 152. - At
step 904, the end effector moves to position B. Atstep 906, kinematic position information is received for theend effector 152. An adjustment for offset is taken atstep 908, and then thesynthetic model 154 is displayed instep 910. - In accordance with the method in
FIG. 9 , thesynthetic model 154 may continue to be updated so that force information is represented by thesynthetic model 154 and its position relative to theend effector 152. In the display shown, theend effector 152 is a video image of the end effector. As such, steps 906-910 may be updated in real time, for both the video image and thesynthetic model 154, so that thesynthetic model 154 and its position are updated as theend effector 152 is moved. In such continual real time display of thesynthetic model 154,step 902 may be substituted with the display of the model at the last location instead of the actual position. In addition, as described above, the offset and the original position A may be determined in accordance with an event or timing or in another manner. - In accordance with an embodiment, the methods described herein may be altered so as to control the display of forces as the surgeon desires. For example, when a movement is made between two positions, there may be a number of other forces involved other than force on the tip of the tool, such as body cavity contact or gravity, that the surgeon does not want to affect his or her measurement. This problem may be even more pronounced when the distance over which the end effector is moved between positions A and B is increased.
- In general, the forces that the surgeon desires to measure during a movement of an end effector between two positions are the forces at the tip of the tool, i.e., at the end effector. In an embodiment, the force measurements are taken so that they filter out, to the extent possible, forces other than those applied at the end effector. One method for eliminating other forces, such as body wall forces and gravity, is by assuming that total movement between the two positions, which indicates total forces on the tool between the two positions, is a combination of two sets of forces: those applied at the tip of the tool and other forces. In general, body forces, gravity, and other forces that are remote of the tip may be detected by the
encoders 102. As described above, as pan of the setup process and movements for a patient side cart and the corresponding robotic manipulator arm, the arm is instructed to move and theencoders 102 determine whether the encoder-detected position is consistent with the command position. If not, then the manipulator is instructed to move to the corrected position. As discussed above, this movement to the corrected position may be used to calculate force exerted during the movement. This joint correction will address joint error, but typically it does not address flexing of the components of the linkage. Assuming that flexing of the tool at the tip is the primary form of force absorption at the tip, then, in accordance with an embodiment, any force not sensed through the joint correction process may be assumed to be force applied at the tip. Thus, in accordance with an embodiment, the forces exerted at the tip are determined by subtracting the calculated joint forces from the total forces. -
FIG. 11 is a flow chart representing steps for filtering forces primarily to tip forces in accordance with an embodiment. Beginning atstep 1100, and end effector is at position A. Atstep 1102, the kinematic correction for the linkage is updated. Atstep 1104, the actual position of the end effector is sensed, for example using thetool tracking component 90. Atstep 1106, the kinematic position is calculated for position A. Atstep 1108, a kinematic force calculation is made at position A using the kinematic information, as described above. Atstep 110, the tool is moved to Position B. Atstep 1112, the actual position of the tool is sensed, for example using thetool tracking component 90. Atstep 1114, the kinematic position is calculated for position B. Atstep 1116, a force calculation is made of the movement from A to B using a kinematic position of the end effector verses an actual position of the end effector, for example as described above with reference toFIG. 5 . Atstep 1118, the force on the end effector is calculated by subtracting the force instep 1112 from the total force fromstep 1116. - In the force calculation of
step 1118, the force on the tool tip is calculated based upon a difference between the total force and kinematic joint forces. As described above, the kinematic joint forces are assumed to represent the forces other than tip forces. If desired, all three forces (total, kinematic, or tip) or any subset of these three may be generated as theforce output 96, and/or may be displayed to a user, for example on thedisplay 84 or theviewer 32, as indicated by the dotted line inFIG. 4 . In this calculation, it is assumed that other, outside forces are held constant between positions A and B, and the motion between these two positions is due to the application of force. - Methods described herein are advantageous in that they provide instantaneous visual feedback to a surgeon of force on a tool. A surgeon utilizing the features may grow accustomed to the intuitive feedback, and may recognize the amount of force being used by comparing the current displacement to a history of procedures. For example, a surgeon performing a sewing procedure who sees a deflection of X may recognize that he or she is applying roughly the same force when a deflection of X occurs in a different procedure.
- If desired, the amount of deflection may be altered for stiff tools so that a visual representation of the deflection is exaggerated on the display. In addition, if desired, force may be displayed by showing force information in a different manner. For example, an arrow indicating a direction of force may be used, or a synthetic representation may be displayed in another direction or position.
- In another aspect of the invention, the tip force information may be used to derive the deformation, or elasticity, of tissue that is clinically relevant. For, e.g., tumors on or below the tissue surface, surgeons can directly sense the difference in elasticity between normal and cancerous tissues by applying pressure to the two different types of tissue and using intuitive visualization of instrument tip flexing (described above) to determine deformation characteristics of particular locations on the tissue. For a given amount of movement by an end effector into contact with the tissue, the amount that the end effector actually moves when in contact with the tissue, instead the end effector flexing, is directly related to the deformation of the tissue. Thus, force information, as determined above, may be used to determine deformation of a tissue. Moreover, other force information, such as provided by sensors, may be used to determine tissue deformation. For example, the amount a tissue pushes back against an end effector will be reflected in the force sensed by active sensors—the more force sensed, the less the tissue is deforming. In addition, the force information, such as may be extracted about the instrument tip, may be combined with, e.g., ultrasound imaging to provide elasticity imaging of tissues and organs underneath the tissue with absolute elasticity measurements.
- In an embodiment, the display of tissue may be altered to show tissue deformation. This deformation may be calculated, for example, based upon force input from any number of sources, including, but not limited to, the sources listed herein. Based upon the amount of force that is sensed, the deformation display may be altered accordingly. For example, in an embodiment, the tissue at an impact point, for example where grasped or where an end effector applies pressure, may be altered in color, for example shaded variations in color based upon the amount of force applied to the tissue. The tissue's point of impact can be determined from the location of touching tool tip that is tracked by tool tracking. The surrounding tissue surface locations (left and right) for overlaying deformation color can be obtained by sparse tissue matching and/or regular dense stereo matching constrained in the selected region of interest. The color and/or intensity of the color may be altered based upon the sensed tip force or tissue elasticity using existing mechanical models. This information may be helpful, for example, in providing visual feedback to a surgeon of force applied to particular tissue.
- For example, in
FIG. 12 , a method is shown for displaying deformation of a tissue using variations in color in accordance with an embodiment. Beginning atstep 1200, deformation is measured for a tissue, for example using the methods described above. Atstep 1202, a determination is made whether a minimum deformation threshold is met. This determination represents a minimum amount of deformation in which to display an indication of deformation for the tissue. If the threshold is not met, then the process continually loops back to 1200. If this threshold is met, then the process proceeds to step 1204, where a determination is made whether a first deformation threshold has been met, and if so, a first color is displayed atstep 1206. In the embodiment shown in the drawings, for simplicity, this first deformation represents a maximum deformation permitted for the tissue, and thus the color may indicate such a high deformation, for example using the color red. If this first deformation is not met, then step 1204 branches to step 1208, where a determination is made whether a second deformation threshold has been met, the second deformation being less than the first deformation. If so, then a second color is displayed at 1210. Additional determinations are made, and colors applied as needed, insteps 1210 to 1218, where the amount of deformation needed to meet a threshold continues to decline to the minimum or until the necessary color is displayed. If a fourth threshold is not met, then step 1216 branches to step 1220, where a fifth color is displayed. This color represents a minimum deformation displayed by the system. The process shown inFIG. 12 may continue to loop back, so that changes in deformation are reflected by different color variations. - In the embodiment shown in the drawings, the number of different colors displayed is five, although any number may be used. In addition, if desired, a color may be altered, such as lightened or darkened, based upon an increase or decrease in deformation.
- Using the process of
FIG. 12 , a surgeon is provided visual feedback of deformation of tissue. The amount of deformation may reflect a type of tissue and/or the condition of the tissue. Although described herein as being displayed as a color or color variation displayed on the tissue, deformation information may be provided in another manner or in another location. - In accordance with another embodiment, a tissue may be varied in color based upon how far the tissue is from an impact point. That is, the tissue may be one color at the impact point and different colors as the tissue is spaced from the impact point. The variations in color represent different amounts of deformation at the different locations. To determine a color for a particular region, other techniques, such as robust image matching or stereo matching, such as is disclosed in U.S. Pat. App. No. 61/204,082 (filed Dec. 31, 2008), may be incorporated to determine deformation at particular locations, including the impact point and locations spaced from the impact point.
- Other variations are within the spirit of the present invention. Thus, while the invention is susceptible to various modifications and alternative constructions, a certain illustrated embodiment thereof is shown in the drawings and has been described above in detail. It should be understood, however, that there is no intention to limit the invention to the specific form or forms disclosed, but on the contrary, the intention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention, as defined in the appended claims.
- All references, including publications, patent applications, and patents, cited herein are hereby incorporated by reference to the same extent as if each reference were individually and specifically indicated to be incorporated by reference and were set forth in its entirety herein.
- The use of the terms “a” and “an” and “the” and similar referents in the context of describing the invention (especially in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. The terms “comprising,” “having,” “including,” and “containing” are to be construed as open-ended terms (i.e., meaning “including, but not limited to.”) unless otherwise noted. The term “connected” is to be construed as partly or wholly contained within, attached to, or joined together, even if there is something intervening. Recitation of ranges of values herein are merely intended to serve as a shorthand method of referring individually to each separate value falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. All methods described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The use of any and all examples, or exemplary language (e.g., “such as”) provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed. No language in the specification should be construed as indicating any non-claimed element as essential to the practice of the invention.
- Preferred embodiments of this invention are described herein, including the best mode known to the inventors for carrying out the invention. Variations of those preferred embodiments may become apparent to those of ordinary skill in the art upon reading the foregoing description. The inventors expect skilled artisans to employ such variations as appropriate, and the inventors intend for the invention to be practiced otherwise than as specifically described herein. Accordingly, this invention includes all modifications and equivalents of the subject matter recited in the claims appended hereto as permitted by applicable law. Moreover, any combination of the above-described elements in all possible variations thereof is encompassed by the invention unless otherwise indicated herein or otherwise clearly contradicted by context.
Claims (26)
1. A method of providing a visual representation of force information in a robotic surgical system, the method comprising:
determining a force applied against a surgical end effector;
displaying a first image showing an actual position of the end effector under the applied force; and
superimposing on the first image a second image representing a projected position of the end effector offset from the first position, wherein the offset is a visual indication of the force.
2. The method of claim 1 , wherein said at least some force comprises force applied to the end effector as a result of movement of the end effector between a first position and a second position, wherein another force is applied to a linkage supporting the end effector, and wherein the offset between the projected position and the actual position disregards at least some of the other force.
3. The method of claim 1 , wherein the second image represents kinematic position information derived from joint states of a linkage supporting the end effector.
4. The method of claim 1 , wherein the first image comprises a visual image of the end effector.
5. The method of claim 1 , wherein displaying comprises displaying on a viewer of a surgeon console of the robotic surgical system.
6. The method of claim 1 , wherein the second image comprises a synthetic representation of the tool showing a position of the tool, an orientation of the tool, or both.
7. The method of claim 6 , wherein the synthetic representation comprises a model of the tool.
8. The method of claim 7 , wherein the model comprises a three-dimensional model of the tool.
9. The method of claim 1 , wherein the force is derived from force information derived from active force sensors.
10. The method of claim 9 , wherein the active force sensors comprise force sensors located at the end effector.
11. The method of claim 10 , wherein the end effector is supported by a linkage having joints, and wherein the active force sensors comprise sensors located at the joints.
12. The method of claim 1 , wherein the end effector is supported by a linkage having joints, and further comprising:
determining joint errors from positions of the joints with respect to a commanded position of the joints;
correcting the joints toward the command position; and
wherein the force is derived from information derived from the correcting of the joints.
13. A system of providing a visual representation of force information in a robotic system, the system comprising:
an image input for capturing an image of an end effector while a force is applied to the end effector;
a display coupled to the image input so as to present an actual position of the end effector under the applied force; and
a processor coupled to the display, the processor generating a second image representing a projected position of the end effector offset from the first position so as to visually indicate the force, the processor transmitting the second image to the display so that the second image is superimposed with the first image.
14. A method of providing a visual representation of tissue deformation in a robotic surgical system, the method comprising:
applying a force against a tissue;
determining deformation of the tissue, the deformation being due to application of the force; and
displaying information about the deformation.
15. The method of claim 14 , wherein determining the deformation comprises utilizing the force to derive the deformation.
16. The method of claim 15 , wherein the force is derived from force information derived from active force sensors.
17. The method of claim 16 , wherein the active force sensors comprise force sensors located at the end effector.
18. The method of claim 16 , wherein the end effector is supported by a linkage having joints, and wherein the active force sensors comprise sensors located at the joints.
19. The method of claim 15 , wherein the end effector is supported by a linkage having joints, and further comprising:
determining joint errors from positions of the joints with respect to a commanded position of the joints;
correcting the joints toward the command position; and
wherein the force is derived from information derived from the correcting of the joints.
20. The method of claim 15 , wherein the force is derived from force information, the force information being provided by:
storing first kinematic position information and first actual position information for a first position of an end effector;
moving the end effector via the robotic surgical system from the first position to a second position;
storing second kinematic position information and second actual position information; and
providing force information regarding force applied to the end effector at the second position utilizing the first actual position information, the second actual position information, the first kinematic position information, and the second kinematic position information.
21. The method of claim 14 , wherein displaying information about the deformation comprises displaying the tissue simultaneous with the information about the deformation.
22. The method of claim 21 , wherein the information about the deformation is superimposed over the tissue.
23. The method of claim 22 , wherein the information about the deformation comprises superimposing a color over the tissue.
24. The method of claim 23 , wherein the color changes based upon the amount of force applied to the tissue.
25. The method of claim 23 , wherein the color is varied based upon how far the tissue is from contact with the end effector.
26. The method of claim 14 , wherein the deformation information is combined with ultrasound imaging to provide elasticity imaging of tissues.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/066,823 US20140058564A1 (en) | 2008-12-31 | 2013-10-30 | Visual force feedback in a minimally invasive surgical procedure |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US20408508P | 2008-12-31 | 2008-12-31 | |
US12/428,142 US8594841B2 (en) | 2008-12-31 | 2009-04-22 | Visual force feedback in a minimally invasive surgical procedure |
US14/066,823 US20140058564A1 (en) | 2008-12-31 | 2013-10-30 | Visual force feedback in a minimally invasive surgical procedure |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/428,142 Continuation US8594841B2 (en) | 2008-12-31 | 2009-04-22 | Visual force feedback in a minimally invasive surgical procedure |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140058564A1 true US20140058564A1 (en) | 2014-02-27 |
Family
ID=42286458
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/428,142 Active 2031-01-26 US8594841B2 (en) | 2008-12-31 | 2009-04-22 | Visual force feedback in a minimally invasive surgical procedure |
US14/066,823 Abandoned US20140058564A1 (en) | 2008-12-31 | 2013-10-30 | Visual force feedback in a minimally invasive surgical procedure |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/428,142 Active 2031-01-26 US8594841B2 (en) | 2008-12-31 | 2009-04-22 | Visual force feedback in a minimally invasive surgical procedure |
Country Status (2)
Country | Link |
---|---|
US (2) | US8594841B2 (en) |
WO (1) | WO2010078011A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017083453A1 (en) * | 2015-11-12 | 2017-05-18 | Covidien Lp | Robotic surgical systems and methods for monitoring applied forces |
US20180325607A1 (en) * | 2016-01-14 | 2018-11-15 | Olympus Corporation | Medical manipulator system |
US11498216B2 (en) * | 2017-09-22 | 2022-11-15 | Mitsubishi Electric Corporation | Remote control manipulator system and control device |
US11564768B2 (en) | 2017-03-31 | 2023-01-31 | Koninklijke Philips N.V. | Force sensed surface scanning systems, devices, controllers and method |
US11583358B2 (en) | 2017-09-06 | 2023-02-21 | Covidien Lp | Boundary scaling of surgical robots |
US11628022B2 (en) | 2017-09-05 | 2023-04-18 | Covidien Lp | Collision handling algorithms for robotic surgical systems |
Families Citing this family (224)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8944070B2 (en) | 1999-04-07 | 2015-02-03 | Intuitive Surgical Operations, Inc. | Non-force reflecting method for providing tool force information to a user of a telesurgical system |
US9789608B2 (en) | 2006-06-29 | 2017-10-17 | Intuitive Surgical Operations, Inc. | Synthetic representation of a surgical robot |
US9492240B2 (en) | 2009-06-16 | 2016-11-15 | Intuitive Surgical Operations, Inc. | Virtual measurement tool for minimally invasive surgery |
US8971597B2 (en) * | 2005-05-16 | 2015-03-03 | Intuitive Surgical Operations, Inc. | Efficient vision and kinematic data fusion for robotic surgical instruments and other applications |
US8219178B2 (en) | 2007-02-16 | 2012-07-10 | Catholic Healthcare West | Method and system for performing invasive medical procedures using a surgical robot |
US10653497B2 (en) | 2006-02-16 | 2020-05-19 | Globus Medical, Inc. | Surgical tool systems and methods |
US10357184B2 (en) | 2012-06-21 | 2019-07-23 | Globus Medical, Inc. | Surgical tool systems and method |
US10893912B2 (en) | 2006-02-16 | 2021-01-19 | Globus Medical Inc. | Surgical tool systems and methods |
US10258425B2 (en) | 2008-06-27 | 2019-04-16 | Intuitive Surgical Operations, Inc. | Medical robotic system providing an auxiliary view of articulatable instruments extending out of a distal end of an entry guide |
US9718190B2 (en) | 2006-06-29 | 2017-08-01 | Intuitive Surgical Operations, Inc. | Tool position and identification indicator displayed in a boundary area of a computer display screen |
US20090192523A1 (en) * | 2006-06-29 | 2009-07-30 | Intuitive Surgical, Inc. | Synthetic representation of a surgical instrument |
US10008017B2 (en) | 2006-06-29 | 2018-06-26 | Intuitive Surgical Operations, Inc. | Rendering tool information as graphic overlays on displayed images of tools |
US8814779B2 (en) | 2006-12-21 | 2014-08-26 | Intuitive Surgical Operations, Inc. | Stereoscopic endoscope |
US8556807B2 (en) * | 2006-12-21 | 2013-10-15 | Intuitive Surgical Operations, Inc. | Hermetically sealed distal sensor endoscope |
US8792688B2 (en) | 2007-03-01 | 2014-07-29 | Titan Medical Inc. | Methods, systems and devices for three dimensional input and control methods and systems based thereon |
US11576736B2 (en) | 2007-03-01 | 2023-02-14 | Titan Medical Inc. | Hand controller for robotic surgery system |
US9138129B2 (en) | 2007-06-13 | 2015-09-22 | Intuitive Surgical Operations, Inc. | Method and system for moving a plurality of articulated instruments in tandem back towards an entry guide |
US9469034B2 (en) | 2007-06-13 | 2016-10-18 | Intuitive Surgical Operations, Inc. | Method and system for switching modes of a robotic system |
US9089256B2 (en) | 2008-06-27 | 2015-07-28 | Intuitive Surgical Operations, Inc. | Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide |
US8620473B2 (en) | 2007-06-13 | 2013-12-31 | Intuitive Surgical Operations, Inc. | Medical robotic system with coupled control modes |
US9084623B2 (en) | 2009-08-15 | 2015-07-21 | Intuitive Surgical Operations, Inc. | Controller assisted reconfiguration of an articulated instrument during movement into and out of an entry guide |
US8864652B2 (en) | 2008-06-27 | 2014-10-21 | Intuitive Surgical Operations, Inc. | Medical robotic system providing computer generated auxiliary views of a camera instrument for controlling the positioning and orienting of its tip |
US8830224B2 (en) | 2008-12-31 | 2014-09-09 | Intuitive Surgical Operations, Inc. | Efficient 3-D telestration for local robotic proctoring |
US8594841B2 (en) * | 2008-12-31 | 2013-11-26 | Intuitive Surgical Operations, Inc. | Visual force feedback in a minimally invasive surgical procedure |
US9155592B2 (en) * | 2009-06-16 | 2015-10-13 | Intuitive Surgical Operations, Inc. | Virtual measurement tool for minimally invasive surgery |
US8918212B2 (en) | 2009-06-24 | 2014-12-23 | Intuitive Surgical Operations, Inc. | Arm with a combined shape and force sensor |
US8918211B2 (en) | 2010-02-12 | 2014-12-23 | Intuitive Surgical Operations, Inc. | Medical robotic system providing sensory feedback indicating a difference between a commanded state and a preferred pose of an articulated instrument |
US9492927B2 (en) | 2009-08-15 | 2016-11-15 | Intuitive Surgical Operations, Inc. | Application of force feedback on an input device to urge its operator to command an articulated instrument to a preferred pose |
KR20120030174A (en) * | 2010-09-17 | 2012-03-28 | 삼성전자주식회사 | Surgery robot system and surgery apparatus and method for providing tactile feedback |
US9342997B2 (en) | 2010-10-29 | 2016-05-17 | The University Of North Carolina At Chapel Hill | Modular staged reality simulator |
US9805625B2 (en) | 2010-10-29 | 2017-10-31 | KindHeart, Inc. | Surgical simulation assembly |
US8532738B2 (en) * | 2010-11-04 | 2013-09-10 | Biosense Webster (Israel), Ltd. | Visualization of catheter-tissue contact by map distortion |
US8606403B2 (en) | 2010-12-14 | 2013-12-10 | Harris Corporation | Haptic interface handle with force-indicating trigger mechanism |
US8951266B2 (en) | 2011-01-07 | 2015-02-10 | Restoration Robotics, Inc. | Methods and systems for modifying a parameter of an automated procedure |
US8918214B2 (en) | 2011-01-19 | 2014-12-23 | Harris Corporation | Telematic interface with directional translation |
US8918215B2 (en) * | 2011-01-19 | 2014-12-23 | Harris Corporation | Telematic interface with control signal scaling based on force sensor feedback |
US8989903B2 (en) | 2011-02-15 | 2015-03-24 | Intuitive Surgical Operations, Inc. | Methods and systems for indicating a clamping prediction |
RU2013143160A (en) * | 2011-02-24 | 2015-03-27 | Конинклейке Филипс Электроникс Н.В. | NON-RIGID TRANSFORMATION OF THE IMAGE OF THE VESSEL USING THE FORM OF AN INJURAL DEVICE |
US11406278B2 (en) | 2011-02-24 | 2022-08-09 | Koninklijke Philips N.V. | Non-rigid-body morphing of vessel image using intravascular device shape |
US9205555B2 (en) | 2011-03-22 | 2015-12-08 | Harris Corporation | Manipulator joint-limit handling algorithm |
WO2012131660A1 (en) | 2011-04-01 | 2012-10-04 | Ecole Polytechnique Federale De Lausanne (Epfl) | Robotic system for spinal and other surgeries |
US8694134B2 (en) | 2011-05-05 | 2014-04-08 | Harris Corporation | Remote control interface |
US8639386B2 (en) | 2011-05-20 | 2014-01-28 | Harris Corporation | Haptic device for manipulator and vehicle control |
US9026250B2 (en) | 2011-08-17 | 2015-05-05 | Harris Corporation | Haptic manipulation system for wheelchairs |
JP5477665B2 (en) * | 2011-09-20 | 2014-04-23 | 株式会社安川電機 | Robot system and method for manufacturing string-like packaged product |
KR20140074961A (en) * | 2011-09-26 | 2014-06-18 | 윤상진 | Intelligent surgery system |
US9770828B2 (en) * | 2011-09-28 | 2017-09-26 | The Johns Hopkins University | Teleoperative-cooperative robotic system |
US8996244B2 (en) | 2011-10-06 | 2015-03-31 | Harris Corporation | Improvised explosive device defeat system |
KR101912716B1 (en) | 2011-11-01 | 2018-10-30 | 삼성전자주식회사 | Robot arm including force sensing apparatus |
KR101967635B1 (en) * | 2012-05-15 | 2019-04-10 | 삼성전자주식회사 | End effector and remote control apparatus |
US11399900B2 (en) | 2012-06-21 | 2022-08-02 | Globus Medical, Inc. | Robotic systems providing co-registration using natural fiducials and related methods |
US11317971B2 (en) | 2012-06-21 | 2022-05-03 | Globus Medical, Inc. | Systems and methods related to robotic guidance in surgery |
US11298196B2 (en) | 2012-06-21 | 2022-04-12 | Globus Medical Inc. | Surgical robotic automation with tracking markers and controlled tool advancement |
US10758315B2 (en) | 2012-06-21 | 2020-09-01 | Globus Medical Inc. | Method and system for improving 2D-3D registration convergence |
US10350013B2 (en) | 2012-06-21 | 2019-07-16 | Globus Medical, Inc. | Surgical tool systems and methods |
US11607149B2 (en) | 2012-06-21 | 2023-03-21 | Globus Medical Inc. | Surgical tool systems and method |
US11045267B2 (en) | 2012-06-21 | 2021-06-29 | Globus Medical, Inc. | Surgical robotic automation with tracking markers |
US11116576B2 (en) | 2012-06-21 | 2021-09-14 | Globus Medical Inc. | Dynamic reference arrays and methods of use |
US11793570B2 (en) | 2012-06-21 | 2023-10-24 | Globus Medical Inc. | Surgical robotic automation with tracking markers |
US11864839B2 (en) | 2012-06-21 | 2024-01-09 | Globus Medical Inc. | Methods of adjusting a virtual implant and related surgical navigation systems |
US11857149B2 (en) | 2012-06-21 | 2024-01-02 | Globus Medical, Inc. | Surgical robotic systems with target trajectory deviation monitoring and related methods |
US10231791B2 (en) | 2012-06-21 | 2019-03-19 | Globus Medical, Inc. | Infrared signal based position recognition system for use with a robot-assisted surgery |
US11857266B2 (en) | 2012-06-21 | 2024-01-02 | Globus Medical, Inc. | System for a surveillance marker in robotic-assisted surgery |
US11864745B2 (en) | 2012-06-21 | 2024-01-09 | Globus Medical, Inc. | Surgical robotic system with retractor |
US10136954B2 (en) | 2012-06-21 | 2018-11-27 | Globus Medical, Inc. | Surgical tool systems and method |
WO2013192598A1 (en) | 2012-06-21 | 2013-12-27 | Excelsius Surgical, L.L.C. | Surgical robot platform |
US11395706B2 (en) | 2012-06-21 | 2022-07-26 | Globus Medical Inc. | Surgical robot platform |
US11253327B2 (en) | 2012-06-21 | 2022-02-22 | Globus Medical, Inc. | Systems and methods for automatically changing an end-effector on a surgical robot |
US10624710B2 (en) | 2012-06-21 | 2020-04-21 | Globus Medical, Inc. | System and method for measuring depth of instrumentation |
US9148443B2 (en) * | 2012-07-06 | 2015-09-29 | University of Washington through its Center for Commericalization | Enhanced security and safety in telerobotic systems |
US10292863B2 (en) * | 2012-11-02 | 2019-05-21 | Optimedica Corporation | Interface force feedback in a laser eye surgery system |
US8954195B2 (en) | 2012-11-09 | 2015-02-10 | Harris Corporation | Hybrid gesture control haptic system |
US8965620B2 (en) | 2013-02-07 | 2015-02-24 | Harris Corporation | Systems and methods for controlling movement of unmanned vehicles |
US10507066B2 (en) | 2013-02-15 | 2019-12-17 | Intuitive Surgical Operations, Inc. | Providing information of tools by filtering image areas adjacent to or on displayed images of the tools |
WO2014151952A1 (en) | 2013-03-14 | 2014-09-25 | Sri International | Compact robotic wrist |
WO2014151642A1 (en) * | 2013-03-15 | 2014-09-25 | Intuitive Surgical Operations, Inc. | Surgical patient side cart with steering interface |
US9101348B2 (en) | 2013-03-15 | 2015-08-11 | Intuitive Surgical Operations, Inc. | Surgical patient side cart with drive system and method of moving a patient side cart |
JP6396987B2 (en) | 2013-03-15 | 2018-09-26 | エスアールアイ インターナショナルSRI International | Super elaborate surgical system |
JP6410023B2 (en) * | 2013-09-06 | 2018-10-24 | パナソニックIpマネジメント株式会社 | Master-slave robot control device and control method, robot, master-slave robot control program, and integrated electronic circuit for master-slave robot control |
US11020182B1 (en) * | 2013-09-30 | 2021-06-01 | Michael Feloney | Tactile feedback for surgical robots |
US9283048B2 (en) | 2013-10-04 | 2016-03-15 | KB Medical SA | Apparatus and systems for precise guidance of surgical tools |
EP3578119B1 (en) | 2013-12-11 | 2021-03-17 | Covidien LP | Wrist and jaw assemblies for robotic surgical systems |
US9128507B2 (en) | 2013-12-30 | 2015-09-08 | Harris Corporation | Compact haptic interface |
WO2015107099A1 (en) | 2014-01-15 | 2015-07-23 | KB Medical SA | Notched apparatus for guidance of an insertable instrument along an axis during spinal surgery |
EP3104803B1 (en) | 2014-02-11 | 2021-09-15 | KB Medical SA | Sterile handle for controlling a robotic surgical system from a sterile field |
JP6559691B2 (en) * | 2014-02-20 | 2019-08-14 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | Limited movement of the surgical mounting platform controlled by manual movement of the robot arm |
JP6270537B2 (en) * | 2014-02-27 | 2018-01-31 | オリンパス株式会社 | Medical system |
USD768295S1 (en) * | 2014-03-17 | 2016-10-04 | Intuitive Surgical Operations, Inc. | Surgical instrument end portion |
USD760387S1 (en) * | 2014-03-17 | 2016-06-28 | Intuitive Surgical Operations, Inc. | Surgical instrument end portion |
USD767130S1 (en) * | 2014-03-17 | 2016-09-20 | Intuitive Surgical Operations, Inc. | Surgical instrument end portion |
USD767129S1 (en) * | 2014-03-17 | 2016-09-20 | Intuitive Surgical Operations, Inc. | Surgical instrument end portion |
EP3125808B1 (en) | 2014-03-28 | 2023-01-04 | Intuitive Surgical Operations, Inc. | Quantitative three-dimensional visualization of instruments in a field of view |
JP6609616B2 (en) | 2014-03-28 | 2019-11-20 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | Quantitative 3D imaging of surgical scenes from a multiport perspective |
WO2015149040A1 (en) | 2014-03-28 | 2015-10-01 | Dorin Panescu | Quantitative three-dimensional imaging of surgical scenes |
EP3125809B1 (en) | 2014-03-28 | 2020-09-09 | Intuitive Surgical Operations, Inc. | Surgical system with haptic feedback based upon quantitative three-dimensional imaging |
WO2015149043A1 (en) | 2014-03-28 | 2015-10-01 | Dorin Panescu | Quantitative three-dimensional imaging and printing of surgical implants |
CN106659537B (en) | 2014-04-24 | 2019-06-11 | Kb医疗公司 | The surgical instrument holder used in conjunction with robotic surgical system |
US20170215970A1 (en) | 2014-05-01 | 2017-08-03 | St. Jude Medical, Cardiology Division, Inc. | Depicting force |
USD761313S1 (en) | 2014-05-01 | 2016-07-12 | St. Jude Medical, Cardiology Division, Inc. | Display screen with a transitional graphical user interface |
USD761808S1 (en) | 2014-05-01 | 2016-07-19 | St. Jude Medical, Cardiology Division, Inc. | Display screen with transitional graphical user interface |
CN107072673A (en) | 2014-07-14 | 2017-08-18 | Kb医疗公司 | Anti-skidding operating theater instruments for preparing hole in bone tissue |
USD779678S1 (en) | 2014-07-24 | 2017-02-21 | KindHeart, Inc. | Surgical tray |
CN106659538B (en) | 2014-08-13 | 2019-05-10 | 柯惠Lp公司 | The clamping with mechanical dominance of robot control |
DE102014016843A1 (en) | 2014-11-13 | 2016-05-19 | Kuka Roboter Gmbh | System with a medical instrument and a receiving means |
US9375853B1 (en) * | 2014-12-03 | 2016-06-28 | Google Inc. | Methods and systems to provide feedback based on a motion per path metric indicative of an effect of motion associated with components of a robotic device |
US10013808B2 (en) | 2015-02-03 | 2018-07-03 | Globus Medical, Inc. | Surgeon head-mounted display apparatuses |
US10555782B2 (en) | 2015-02-18 | 2020-02-11 | Globus Medical, Inc. | Systems and methods for performing minimally invasive spinal surgery with a robotic surgical system using a percutaneous technique |
CA2975907C (en) | 2015-02-19 | 2023-10-10 | Covidien Lp | Repositioning method of input device for robotic surgical system |
AU2016229897B2 (en) | 2015-03-10 | 2020-07-16 | Covidien Lp | Measuring health of a connector member of a robotic surgical system |
US20160314711A1 (en) * | 2015-04-27 | 2016-10-27 | KindHeart, Inc. | Telerobotic surgery system for remote surgeon training using robotic surgery station and remote surgeon station with display of actual animal tissue images and associated methods |
CN107666866A (en) | 2015-06-03 | 2018-02-06 | 柯惠Lp公司 | Bias apparatus driver element |
CN112294439A (en) | 2015-06-16 | 2021-02-02 | 柯惠Lp公司 | Robotic surgical system torque sensing |
CN107820412B (en) | 2015-06-23 | 2021-01-15 | 柯惠Lp公司 | Robotic surgical assembly |
US9889564B2 (en) * | 2015-07-08 | 2018-02-13 | Empire Technology Development Llc | Stable grasp point selection for robotic grippers with machine vision and ultrasound beam forming |
WO2017015599A1 (en) | 2015-07-23 | 2017-01-26 | Sri International | Robotic arm and robotic surgical system |
US10646298B2 (en) | 2015-07-31 | 2020-05-12 | Globus Medical, Inc. | Robot arm and methods of use |
US10058394B2 (en) | 2015-07-31 | 2018-08-28 | Globus Medical, Inc. | Robot arm and methods of use |
US10080615B2 (en) | 2015-08-12 | 2018-09-25 | Globus Medical, Inc. | Devices and methods for temporary mounting of parts to bone |
EP3344179B1 (en) | 2015-08-31 | 2021-06-30 | KB Medical SA | Robotic surgical systems |
US10034716B2 (en) | 2015-09-14 | 2018-07-31 | Globus Medical, Inc. | Surgical robotic systems and methods thereof |
WO2017048922A1 (en) | 2015-09-16 | 2017-03-23 | KindHeart, Inc. | Surgical simulation system and associated methods |
WO2017053363A1 (en) | 2015-09-25 | 2017-03-30 | Covidien Lp | Robotic surgical assemblies and instrument drive connectors thereof |
US9771092B2 (en) | 2015-10-13 | 2017-09-26 | Globus Medical, Inc. | Stabilizer wheel assembly and methods of use |
CN108135670B (en) | 2015-10-23 | 2021-02-26 | 柯惠Lp公司 | Surgical system for detecting gradual changes in perfusion |
EP3376988B1 (en) | 2015-11-19 | 2023-08-23 | Covidien LP | Optical force sensor for robotic surgical system |
US9872738B2 (en) * | 2016-01-06 | 2018-01-23 | Ethicon Endo-Surgery, Llc | Methods, systems, and devices for control of surgical tools in a robotic surgical system |
KR102518492B1 (en) | 2016-01-19 | 2023-04-05 | 타이탄 메디칼 아이엔씨. | Graphical user interface for a robotic surgical system |
US11058378B2 (en) | 2016-02-03 | 2021-07-13 | Globus Medical, Inc. | Portable medical imaging system |
US10842453B2 (en) | 2016-02-03 | 2020-11-24 | Globus Medical, Inc. | Portable medical imaging system |
US10448910B2 (en) | 2016-02-03 | 2019-10-22 | Globus Medical, Inc. | Portable medical imaging system |
US11883217B2 (en) | 2016-02-03 | 2024-01-30 | Globus Medical, Inc. | Portable medical imaging system and method |
US10117632B2 (en) | 2016-02-03 | 2018-11-06 | Globus Medical, Inc. | Portable medical imaging system with beam scanning collimator |
US10866119B2 (en) | 2016-03-14 | 2020-12-15 | Globus Medical, Inc. | Metal detector for detecting insertion of a surgical device into a hollow tube |
US11576562B2 (en) | 2016-04-07 | 2023-02-14 | Titan Medical Inc. | Camera positioning method and apparatus for capturing images during a medical procedure |
WO2017205310A1 (en) | 2016-05-26 | 2017-11-30 | Covidien Lp | Robotic surgical assemblies |
CN109152614B (en) | 2016-05-26 | 2021-09-10 | 柯惠Lp公司 | Instrument drive unit |
CN109195543A (en) | 2016-06-03 | 2019-01-11 | 柯惠Lp公司 | Passive axle system for robotic surgical system |
WO2017210497A1 (en) | 2016-06-03 | 2017-12-07 | Covidien Lp | Systems, methods, and computer-readable program products for controlling a robotically delivered manipulator |
CN109152612A (en) | 2016-06-03 | 2019-01-04 | 柯惠Lp公司 | Robotic surgical system with embedded imaging instrument |
EP3463150B1 (en) | 2016-06-03 | 2023-09-27 | Covidien LP | Control arm for robotic surgical systems |
USD864386S1 (en) | 2016-07-14 | 2019-10-22 | Intuitive Surgical Operations, Inc. | Surgical instrument actuator end portion |
USD865163S1 (en) | 2016-07-14 | 2019-10-29 | Intuitive Surgical Operations, Inc. | Surgical instrument actuator end portion |
USD865164S1 (en) | 2016-07-14 | 2019-10-29 | Intuitive Surgical Operations, Inc. | Surgical instrument actuator end portion |
US10537399B2 (en) * | 2016-08-16 | 2020-01-21 | Ethicon Llc | Surgical tool positioning based on sensed parameters |
US10398517B2 (en) | 2016-08-16 | 2019-09-03 | Ethicon Llc | Surgical tool positioning based on sensed parameters |
GB2554363B (en) * | 2016-09-21 | 2021-12-08 | Cmr Surgical Ltd | User interface device |
US11558677B2 (en) * | 2016-11-10 | 2023-01-17 | Telefonaktiebolaget Lm Ericsson (Publ) | Resource segmentation to improve delivery performance |
EP3518854A4 (en) | 2016-11-28 | 2020-09-02 | Verb Surgical Inc. | Robotic surgical system to reduce unwanted vibration |
JP6577936B2 (en) | 2016-12-27 | 2019-09-18 | 川崎重工業株式会社 | Hydraulic forceps system |
EP3360502A3 (en) | 2017-01-18 | 2018-10-31 | KB Medical SA | Robotic navigation of robotic surgical systems |
US11690691B2 (en) | 2017-02-15 | 2023-07-04 | Covidien Lp | System and apparatus for crush prevention for medical robot applications |
US11071594B2 (en) | 2017-03-16 | 2021-07-27 | KB Medical SA | Robotic navigation of robotic surgical systems |
US10792119B2 (en) | 2017-05-22 | 2020-10-06 | Ethicon Llc | Robotic arm cart and uses therefor |
EP3629979A4 (en) | 2017-05-24 | 2021-02-17 | Covidien LP | Presence detection for electrosurgical tools in a robotic system |
CN110662507A (en) | 2017-05-25 | 2020-01-07 | 柯惠Lp公司 | Robotic surgical system with automatic guidance |
US11510747B2 (en) | 2017-05-25 | 2022-11-29 | Covidien Lp | Robotic surgical systems and drapes for covering components of robotic surgical systems |
WO2018217444A2 (en) | 2017-05-25 | 2018-11-29 | Covidien Lp | Systems and methods for detection of objects within a field of view of an image capture device |
US10856948B2 (en) | 2017-05-31 | 2020-12-08 | Verb Surgical Inc. | Cart for robotic arms and method and apparatus for registering cart to surgical table |
US10485623B2 (en) | 2017-06-01 | 2019-11-26 | Verb Surgical Inc. | Robotic arm cart with fine position adjustment features and uses therefor |
US10913145B2 (en) | 2017-06-20 | 2021-02-09 | Verb Surgical Inc. | Cart for robotic arms and method and apparatus for cartridge or magazine loading of arms |
US11135015B2 (en) | 2017-07-21 | 2021-10-05 | Globus Medical, Inc. | Robot surgical platform |
US10898252B2 (en) | 2017-11-09 | 2021-01-26 | Globus Medical, Inc. | Surgical robotic systems for bending surgical rods, and related methods and devices |
US11794338B2 (en) | 2017-11-09 | 2023-10-24 | Globus Medical Inc. | Robotic rod benders and related mechanical and motor housings |
US11382666B2 (en) | 2017-11-09 | 2022-07-12 | Globus Medical Inc. | Methods providing bend plans for surgical rods and related controllers and computer program products |
US11134862B2 (en) | 2017-11-10 | 2021-10-05 | Globus Medical, Inc. | Methods of selecting surgical implants and related devices |
AU2019205201B2 (en) | 2018-01-04 | 2020-11-05 | Covidien Lp | Systems and assemblies for mounting a surgical accessory to robotic surgical systems, and providing access therethrough |
US20190254753A1 (en) | 2018-02-19 | 2019-08-22 | Globus Medical, Inc. | Augmented reality navigation systems for use with robotic surgical systems and methods of their use |
US11189379B2 (en) | 2018-03-06 | 2021-11-30 | Digital Surgery Limited | Methods and systems for using multiple data structures to process surgical data |
US11628024B2 (en) | 2018-03-08 | 2023-04-18 | Covidien Lp | Surgical robotic systems |
US10573023B2 (en) | 2018-04-09 | 2020-02-25 | Globus Medical, Inc. | Predictive visualization of medical imaging scanner component movement |
USD884892S1 (en) | 2018-04-20 | 2020-05-19 | Intuitive Surgical Operations, Inc. | Surgical instrument backend housing |
WO2019204012A1 (en) | 2018-04-20 | 2019-10-24 | Covidien Lp | Compensation for observer movement in robotic surgical systems having stereoscopic displays |
WO2020002078A1 (en) * | 2018-06-26 | 2020-01-02 | Koninklijke Philips N.V. | Optimal imaging point of view based on intervention instrument loading |
WO2020009830A1 (en) | 2018-07-03 | 2020-01-09 | Covidien Lp | Systems, methods, and computer-readable media for detecting image degradation during surgical procedures |
US11109746B2 (en) | 2018-10-10 | 2021-09-07 | Titan Medical Inc. | Instrument insertion system, method, and apparatus for performing medical procedures |
US11337742B2 (en) | 2018-11-05 | 2022-05-24 | Globus Medical Inc | Compliant orthopedic driver |
US11278360B2 (en) | 2018-11-16 | 2022-03-22 | Globus Medical, Inc. | End-effectors for surgical robotic systems having sealed optical components |
US11602402B2 (en) | 2018-12-04 | 2023-03-14 | Globus Medical, Inc. | Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems |
US11744655B2 (en) | 2018-12-04 | 2023-09-05 | Globus Medical, Inc. | Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems |
US11586106B2 (en) | 2018-12-28 | 2023-02-21 | Titan Medical Inc. | Imaging apparatus having configurable stereoscopic perspective |
US11717355B2 (en) | 2019-01-29 | 2023-08-08 | Covidien Lp | Drive mechanisms for surgical instruments such as for use in robotic surgical systems |
US11576733B2 (en) | 2019-02-06 | 2023-02-14 | Covidien Lp | Robotic surgical assemblies including electrosurgical instruments having articulatable wrist assemblies |
US11484372B2 (en) | 2019-02-15 | 2022-11-01 | Covidien Lp | Articulation mechanisms for surgical instruments such as for use in robotic surgical systems |
JP6867654B2 (en) * | 2019-03-15 | 2021-05-12 | リバーフィールド株式会社 | Force display device and force display method for medical robot systems |
US11918313B2 (en) | 2019-03-15 | 2024-03-05 | Globus Medical Inc. | Active end effectors for surgical robots |
US11317978B2 (en) | 2019-03-22 | 2022-05-03 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US11419616B2 (en) | 2019-03-22 | 2022-08-23 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US20200297357A1 (en) | 2019-03-22 | 2020-09-24 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US11382549B2 (en) | 2019-03-22 | 2022-07-12 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, and related methods and devices |
US11571265B2 (en) | 2019-03-22 | 2023-02-07 | Globus Medical Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US11806084B2 (en) | 2019-03-22 | 2023-11-07 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, and related methods and devices |
US11045179B2 (en) | 2019-05-20 | 2021-06-29 | Global Medical Inc | Robot-mounted retractor system |
US11628023B2 (en) | 2019-07-10 | 2023-04-18 | Globus Medical, Inc. | Robotic navigational system for interbody implants |
US11571171B2 (en) | 2019-09-24 | 2023-02-07 | Globus Medical, Inc. | Compound curve cable chain |
US11864857B2 (en) | 2019-09-27 | 2024-01-09 | Globus Medical, Inc. | Surgical robot with passive end effector |
US11426178B2 (en) | 2019-09-27 | 2022-08-30 | Globus Medical Inc. | Systems and methods for navigating a pin guide driver |
US11890066B2 (en) | 2019-09-30 | 2024-02-06 | Globus Medical, Inc | Surgical robot with passive end effector |
US11510684B2 (en) | 2019-10-14 | 2022-11-29 | Globus Medical, Inc. | Rotary motion passive end effector for surgical robots in orthopedic surgeries |
USD940736S1 (en) | 2019-11-20 | 2022-01-11 | Titan Medical Inc. | Display screen or portion thereof with a graphical user interface |
KR102313620B1 (en) * | 2019-12-05 | 2021-10-19 | 주식회사 큐엔티 | Method and apparatus for outputting abnormal condition of robot |
WO2021152784A1 (en) * | 2020-01-30 | 2021-08-05 | 株式会社インキュビット | Surgery assistance system |
US11382699B2 (en) | 2020-02-10 | 2022-07-12 | Globus Medical Inc. | Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery |
US11207150B2 (en) | 2020-02-19 | 2021-12-28 | Globus Medical, Inc. | Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment |
CN113752256B (en) * | 2020-04-03 | 2023-04-07 | 牧今科技 | Robot system with route planning stabilizing mechanism |
US11253216B2 (en) | 2020-04-28 | 2022-02-22 | Globus Medical Inc. | Fixtures for fluoroscopic imaging systems and related navigation systems and methods |
US11382700B2 (en) | 2020-05-08 | 2022-07-12 | Globus Medical Inc. | Extended reality headset tool tracking and control |
US11153555B1 (en) | 2020-05-08 | 2021-10-19 | Globus Medical Inc. | Extended reality headset camera system for computer assisted navigation in surgery |
US11510750B2 (en) | 2020-05-08 | 2022-11-29 | Globus Medical, Inc. | Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications |
US11317973B2 (en) | 2020-06-09 | 2022-05-03 | Globus Medical, Inc. | Camera tracking bar for computer assisted navigation during surgery |
US11382713B2 (en) | 2020-06-16 | 2022-07-12 | Globus Medical, Inc. | Navigated surgical system with eye to XR headset display calibration |
USD963851S1 (en) | 2020-07-10 | 2022-09-13 | Covidien Lp | Port apparatus |
US11877807B2 (en) | 2020-07-10 | 2024-01-23 | Globus Medical, Inc | Instruments for navigated orthopedic surgeries |
US11793588B2 (en) | 2020-07-23 | 2023-10-24 | Globus Medical, Inc. | Sterile draping of robotic arms |
US11737831B2 (en) | 2020-09-02 | 2023-08-29 | Globus Medical Inc. | Surgical object tracking template generation for computer assisted navigation during surgical procedure |
US11523785B2 (en) | 2020-09-24 | 2022-12-13 | Globus Medical, Inc. | Increased cone beam computed tomography volume length without requiring stitching or longitudinal C-arm movement |
US11911112B2 (en) | 2020-10-27 | 2024-02-27 | Globus Medical, Inc. | Robotic navigational system |
US11941814B2 (en) | 2020-11-04 | 2024-03-26 | Globus Medical Inc. | Auto segmentation using 2-D images taken during 3-D imaging spin |
US11717350B2 (en) | 2020-11-24 | 2023-08-08 | Globus Medical Inc. | Methods for robotic assistance and navigation in spinal surgery and related systems |
JP2022088805A (en) | 2020-12-03 | 2022-06-15 | 株式会社メディカロイド | Robot surgery system and display method |
US11948226B2 (en) | 2021-05-28 | 2024-04-02 | Covidien Lp | Systems and methods for clinical workspace simulation |
US11857273B2 (en) | 2021-07-06 | 2024-01-02 | Globus Medical, Inc. | Ultrasonic robotic surgical navigation |
US11439444B1 (en) | 2021-07-22 | 2022-09-13 | Globus Medical, Inc. | Screw tower and rod reduction tool |
WO2023101968A1 (en) | 2021-11-30 | 2023-06-08 | Endoquest Robotics, Inc. | Steerable overtube assemblies for robotic surgical systems |
US11918304B2 (en) | 2021-12-20 | 2024-03-05 | Globus Medical, Inc | Flat panel registration fixture and method of using same |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090088897A1 (en) * | 2007-09-30 | 2009-04-02 | Intuitive Surgical, Inc. | Methods and systems for robotic instrument tool tracking |
US20090192524A1 (en) * | 2006-06-29 | 2009-07-30 | Intuitive Surgical, Inc. | Synthetic representation of a surgical robot |
US20090192523A1 (en) * | 2006-06-29 | 2009-07-30 | Intuitive Surgical, Inc. | Synthetic representation of a surgical instrument |
US20100168763A1 (en) * | 2008-12-31 | 2010-07-01 | Intuitive Surgical, Inc. | Configuration marker design and detection for instrument tracking |
US20100168562A1 (en) * | 2008-12-31 | 2010-07-01 | Intuitive Surgical, Inc. | Fiducial marker design and detection for locating surgical instrument in images |
US20100331855A1 (en) * | 2005-05-16 | 2010-12-30 | Intuitive Surgical, Inc. | Efficient Vision and Kinematic Data Fusion For Robotic Surgical Instruments and Other Applications |
US20110224689A1 (en) * | 2005-12-30 | 2011-09-15 | Intuitive Surgical Operations, Inc. | Robotic surgery system including position sensors using fiber bragg gratings |
US8594841B2 (en) * | 2008-12-31 | 2013-11-26 | Intuitive Surgical Operations, Inc. | Visual force feedback in a minimally invasive surgical procedure |
US8600551B2 (en) * | 1998-11-20 | 2013-12-03 | Intuitive Surgical Operations, Inc. | Medical robotic system with operatively couplable simulator unit for surgeon training |
Family Cites Families (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US755315A (en) * | 1903-11-11 | 1904-03-22 | John O Qualley | Belt-adjuster for harvesters. |
US4362977A (en) * | 1980-06-30 | 1982-12-07 | International Business Machines Corporation | Method and apparatus for calibrating a robot to compensate for inaccuracy of the robot |
US5086401A (en) * | 1990-05-11 | 1992-02-04 | International Business Machines Corporation | Image-directed robotic system for precise robotic surgery including redundant consistency checking |
US5193963A (en) * | 1990-10-31 | 1993-03-16 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Force reflecting hand controller |
US5279309A (en) | 1991-06-13 | 1994-01-18 | International Business Machines Corporation | Signaling device and method for monitoring positions in a surgical operation |
US5239246A (en) * | 1992-07-08 | 1993-08-24 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Force reflection with compliance control |
US5762458A (en) * | 1996-02-20 | 1998-06-09 | Computer Motion, Inc. | Method and apparatus for performing minimally invasive cardiac procedures |
US5451924A (en) * | 1993-01-14 | 1995-09-19 | Massachusetts Institute Of Technology | Apparatus for providing sensory substitution of force feedback |
US6028593A (en) * | 1995-12-01 | 2000-02-22 | Immersion Corporation | Method and apparatus for providing simulated physical interactions within computer generated environments |
AU4362597A (en) * | 1996-05-28 | 1998-01-05 | Robin Medical Technologies, Ltd. | Method and apparatus for cardiologic echo-doppler image enchancement by gated adaptive filtering in time domain |
US6125385A (en) * | 1996-08-01 | 2000-09-26 | Immersion Corporation | Force feedback implementation in web pages |
DE69737528T2 (en) * | 1997-12-17 | 2007-07-12 | Moog Fcs B.V. | Remote control system for remote manipulation and remote control arrangement using this |
US6233504B1 (en) * | 1998-04-16 | 2001-05-15 | California Institute Of Technology | Tool actuation and force feedback on robot-assisted microsurgery system |
US6659939B2 (en) * | 1998-11-20 | 2003-12-09 | Intuitive Surgical, Inc. | Cooperative minimally invasive telesurgical system |
US6468265B1 (en) | 1998-11-20 | 2002-10-22 | Intuitive Surgical, Inc. | Performing cardiac surgery without cardioplegia |
US6459926B1 (en) * | 1998-11-20 | 2002-10-01 | Intuitive Surgical, Inc. | Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery |
US6493608B1 (en) * | 1999-04-07 | 2002-12-10 | Intuitive Surgical, Inc. | Aspects of a control system of a minimally invasive surgical apparatus |
US6522906B1 (en) | 1998-12-08 | 2003-02-18 | Intuitive Surgical, Inc. | Devices and methods for presenting and regulating auxiliary information on an image display of a telesurgical system to assist an operator in performing a surgical procedure |
US8944070B2 (en) * | 1999-04-07 | 2015-02-03 | Intuitive Surgical Operations, Inc. | Non-force reflecting method for providing tool force information to a user of a telesurgical system |
US6424885B1 (en) * | 1999-04-07 | 2002-07-23 | Intuitive Surgical, Inc. | Camera referenced control in a minimally invasive surgical apparatus |
US6594552B1 (en) * | 1999-04-07 | 2003-07-15 | Intuitive Surgical, Inc. | Grip strength with tactile feedback for robotic surgery |
US20030040758A1 (en) * | 2001-08-21 | 2003-02-27 | Yulun Wang | Robotically controlled surgical instrument, visual force-feedback |
US8010180B2 (en) * | 2002-03-06 | 2011-08-30 | Mako Surgical Corp. | Haptic guidance system and method |
US7831292B2 (en) * | 2002-03-06 | 2010-11-09 | Mako Surgical Corp. | Guidance system and method for surgical procedures with improved feedback |
AU2003257309A1 (en) * | 2002-08-13 | 2004-02-25 | Microbotics Corporation | Microsurgical robot system |
US7443115B2 (en) * | 2002-10-29 | 2008-10-28 | Matsushita Electric Industrial Co., Ltd. | Apparatus and method for robot handling control |
US7227984B2 (en) * | 2003-03-03 | 2007-06-05 | Kla-Tencor Technologies Corporation | Method and apparatus for identifying defects in a substrate surface by using dithering to reconstruct under-sampled images |
US7974681B2 (en) * | 2004-03-05 | 2011-07-05 | Hansen Medical, Inc. | Robotic catheter system |
US8375808B2 (en) | 2005-12-30 | 2013-02-19 | Intuitive Surgical Operations, Inc. | Force sensing for surgical instruments |
US10555775B2 (en) * | 2005-05-16 | 2020-02-11 | Intuitive Surgical Operations, Inc. | Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery |
EP1887961B1 (en) * | 2005-06-06 | 2012-01-11 | Intuitive Surgical Operations, Inc. | Laparoscopic ultrasound robotic surgical system |
US8016757B2 (en) * | 2005-09-30 | 2011-09-13 | University Of Washington | Non-invasive temperature estimation technique for HIFU therapy monitoring using backscattered ultrasound |
US20100168919A1 (en) * | 2006-03-24 | 2010-07-01 | Matsushita Electric Industrial Co, Ltd. | Control method and control system for manipulator |
US9718190B2 (en) | 2006-06-29 | 2017-08-01 | Intuitive Surgical Operations, Inc. | Tool position and identification indicator displayed in a boundary area of a computer display screen |
EP1915963A1 (en) | 2006-10-25 | 2008-04-30 | The European Atomic Energy Community (EURATOM), represented by the European Commission | Force estimation for a minimally invasive robotic surgery system |
US8374723B2 (en) * | 2008-12-31 | 2013-02-12 | Intuitive Surgical Operations, Inc. | Obtaining force information in a minimally invasive surgical procedure |
-
2009
- 2009-04-22 US US12/428,142 patent/US8594841B2/en active Active
- 2009-12-17 WO PCT/US2009/068406 patent/WO2010078011A1/en active Application Filing
-
2013
- 2013-10-30 US US14/066,823 patent/US20140058564A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8600551B2 (en) * | 1998-11-20 | 2013-12-03 | Intuitive Surgical Operations, Inc. | Medical robotic system with operatively couplable simulator unit for surgeon training |
US20100331855A1 (en) * | 2005-05-16 | 2010-12-30 | Intuitive Surgical, Inc. | Efficient Vision and Kinematic Data Fusion For Robotic Surgical Instruments and Other Applications |
US20110224689A1 (en) * | 2005-12-30 | 2011-09-15 | Intuitive Surgical Operations, Inc. | Robotic surgery system including position sensors using fiber bragg gratings |
US20110224685A1 (en) * | 2005-12-30 | 2011-09-15 | Intuitive Surgical Operations, Inc. | Robotic surgery system including position sensors using fiber bragg gratings |
US20090192524A1 (en) * | 2006-06-29 | 2009-07-30 | Intuitive Surgical, Inc. | Synthetic representation of a surgical robot |
US20090192523A1 (en) * | 2006-06-29 | 2009-07-30 | Intuitive Surgical, Inc. | Synthetic representation of a surgical instrument |
US20090088897A1 (en) * | 2007-09-30 | 2009-04-02 | Intuitive Surgical, Inc. | Methods and systems for robotic instrument tool tracking |
US20100168763A1 (en) * | 2008-12-31 | 2010-07-01 | Intuitive Surgical, Inc. | Configuration marker design and detection for instrument tracking |
US20100168562A1 (en) * | 2008-12-31 | 2010-07-01 | Intuitive Surgical, Inc. | Fiducial marker design and detection for locating surgical instrument in images |
US8594841B2 (en) * | 2008-12-31 | 2013-11-26 | Intuitive Surgical Operations, Inc. | Visual force feedback in a minimally invasive surgical procedure |
Non-Patent Citations (1)
Title |
---|
Mack, Minimally Invasive and Robotic Surgery, 2001, Internet, pg. 568-572 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017083453A1 (en) * | 2015-11-12 | 2017-05-18 | Covidien Lp | Robotic surgical systems and methods for monitoring applied forces |
US10874475B2 (en) | 2015-11-12 | 2020-12-29 | Covidien Lp | Robotic surgical systems and methods for monitoring applied forces |
US11628034B2 (en) | 2015-11-12 | 2023-04-18 | Covidien Lp | Robotic surgical systems and methods for monitoring applied forces |
US20180325607A1 (en) * | 2016-01-14 | 2018-11-15 | Olympus Corporation | Medical manipulator system |
US10959787B2 (en) * | 2016-01-14 | 2021-03-30 | Olympus Corporation | Medical manipulator system |
US11564768B2 (en) | 2017-03-31 | 2023-01-31 | Koninklijke Philips N.V. | Force sensed surface scanning systems, devices, controllers and method |
US11857379B2 (en) | 2017-03-31 | 2024-01-02 | Koninklijke Philips N.V. | Force sensed surface scanning systems, devices, controllers and methods |
US11628022B2 (en) | 2017-09-05 | 2023-04-18 | Covidien Lp | Collision handling algorithms for robotic surgical systems |
US11583358B2 (en) | 2017-09-06 | 2023-02-21 | Covidien Lp | Boundary scaling of surgical robots |
US11498216B2 (en) * | 2017-09-22 | 2022-11-15 | Mitsubishi Electric Corporation | Remote control manipulator system and control device |
Also Published As
Publication number | Publication date |
---|---|
US8594841B2 (en) | 2013-11-26 |
US20100169815A1 (en) | 2010-07-01 |
WO2010078011A1 (en) | 2010-07-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8706301B2 (en) | Obtaining force information in a minimally invasive surgical procedure | |
US8594841B2 (en) | Visual force feedback in a minimally invasive surgical procedure | |
US9801690B2 (en) | Synthetic representation of a surgical instrument | |
US11638999B2 (en) | Synthetic representation of a surgical robot | |
CN103211563B (en) | The method and system that data realize 3-D tool trackings is exported by combination sensor during mechanical micro-wound surgical operation and/or camera | |
JP2012529970A (en) | Virtual measurement tool for minimally invasive surgery | |
JP2012529971A (en) | Virtual measurement tool for minimally invasive surgery | |
EP2231051A1 (en) | Medical robotic system with functionality to determine and display a distance indicated by movement of a tool robotically manipulated by an operator | |
US20230249354A1 (en) | Synthetic representation of a surgical robot |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |