US20100010504A1 - Systems, devices, and methods for surgery on a hollow anatomically suspended organ - Google Patents

Systems, devices, and methods for surgery on a hollow anatomically suspended organ Download PDF

Info

Publication number
US20100010504A1
US20100010504A1 US12/441,566 US44156607A US2010010504A1 US 20100010504 A1 US20100010504 A1 US 20100010504A1 US 44156607 A US44156607 A US 44156607A US 2010010504 A1 US2010010504 A1 US 2010010504A1
Authority
US
United States
Prior art keywords
robot
robotic
cannula
eye
serial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/441,566
Inventor
Nabil Simaan
Wei Wei
Roger Goldman
Howard Fine
Stanley Chang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Columbia University of New York
Original Assignee
Columbia University of New York
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Columbia University of New York filed Critical Columbia University of New York
Priority to US12/441,566 priority Critical patent/US20100010504A1/en
Assigned to THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK reassignment THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FINE, HOWARD, GOLDMAN, ROGER, SIMAAN, NABIL, WEI, WEI, CHANG, STANLEY
Publication of US20100010504A1 publication Critical patent/US20100010504A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/10Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis
    • A61B90/14Fixators for body parts, e.g. skull clamps; Constructional details of fixators, e.g. pins
    • A61B90/16Bite blocks
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/13Ophthalmic microscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B34/35Surgical robots for telesurgery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B34/37Master-slave robots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • A61B34/71Manipulators operated by drive cable mechanisms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • A61B34/75Manipulators having means for prevention or compensation of hand tremors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • A61B34/76Manipulators having means for providing feel, e.g. force or tactile feedback
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00831Material properties
    • A61B2017/00867Material properties shape memory effect
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3403Needle locating or guiding means
    • A61B2017/3405Needle locating or guiding means using mechanical guide means
    • A61B2017/3407Needle locating or guiding means using mechanical guide means including a base for support on the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B2034/304Surgical robots including a freely orientable platform, e.g. so called 'Stewart platforms'
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06Measuring instruments not otherwise provided for
    • A61B2090/064Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/30Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
    • A61B2090/306Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure using optical fibres
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20Surgical microscopes characterised by non-optical aspects
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/007Methods or devices for eye surgery

Definitions

  • ophthalmic microsurgery Minimally invasive surgery on hollow anatomical suspended organs (e.g., ophthalmic microsurgery) presents medical professionals with unique challenges. Focusing on ophthalmic microsurgery, these challenges stem from the fact that the eye is a hollow and movable organ requiring very accurate and delicate surgical tasks to be performed inside it.
  • medical professionals use a microscope to visualize the retina by looking through the dilated iris.
  • the tools currently used by medical professionals lack intraocular dexterity and are constrained to minimal degrees of freedom. Hence, it can be very difficult to perform complex ophthalmic surgery. Further, medical professionals can also be required to rotate the eye under the microscope in order to allow access to and visualization of the peripheral regions of the eye while manipulating multiple tools with very high precision.
  • microsurgery includes lack of intraocular dexterity of the tools, limited force feedback, and lack of depth perception when visualizing using the microscope.
  • Microsurgery also demands a level of accuracy and bimanual dexterity not common to other surgical fields (e.g. positioning accuracy of 5-10 microns can be required). These difficult and precise bimanual tasks demonstrate the potential benefits and need for robotic assistance.
  • a tele-robotic microsurgical system for eye surgery has: a tele-robotic master and a slave hybrid-robot; wherein the tele-robotic master has at least two master slave interfaces controlled by a medical professional; wherein the slave hybrid-robot has at least two robotic arms attached to a frame which is releasably attachable to a patient's head; and wherein the at least two robotic arms each have a parallel robot and a serial robot.
  • a tele-robotic microsurgical system for eye surgery has: a frame, a first robotic arm, a second robotic arm, and a tele-robotic master; wherein the frame is releasably attached to a patient's head; wherein the first robotic arm and second robotic arm each have a parallel robot and a serial robot; the tele-robotic master having a master slave interface controlled by a medical professional and the serial robot having a tube and a cannula.
  • a tele-robotic microsurgical system for surgery on a hollow anatomically suspended organ has: a tele-robotic master and a slave hybrid-robot; wherein the tele-robotic master has at least one master slave interface controlled by a medical professional; wherein the slave hybrid-robot has at least one robotic arm attached to a frame releasably attachable to a patient; and wherein the at least one robotic arm has a parallel robot and a serial robot.
  • a slave-hybrid robot for surgery on a hollow anatomically suspended organ has: a frame releasably attachable to a patient and at least one robotic arm releasably attached to the frame; wherein the at least one robotic arm has a parallel robot and a serial robot; wherein the serial robot has a tube for delivering a pre-bent NiTi cannula; wherein at least one of the tube and the pre-bent NiTi cannula is capable of rotating about its longitudinal axis; and wherein the pre-bent NiTi cannula is capable of bending when extended from the tube.
  • FIG. 1A illustratively displays a method for using a tele-robotic microsurgery system in accordance with some embodiments of the disclosed subject matter
  • FIG. 1B illustratively displays the general surgical setup for tele-robotic microsurgery on the eye in accordance with some embodiments of the disclosed subject matter;
  • FIG. 2 illustratively displays a slave hybrid-robot positioned over a patient's head in accordance with some embodiments of the disclosed subject matter
  • FIG. 3 illustratively displays a tele-robotic microsurgical system for eye surgery including a tele-robotic master and a slave hybrid-robot in accordance with some embodiments of the disclosed subject matter;
  • FIG. 4A illustratively displays a slave hybrid-robot illustrating a serial robot and a parallel robot in accordance with some embodiments of the disclosed subject matter
  • FIGS. 4B-4C illustratively display a serial connector included in a serial robot in accordance with some embodiments of the disclosed subject matter
  • FIG. 5 illustratively displays a serial articulator included in a serial robot in accordance with some embodiments of the disclosed subject matter
  • FIGS. 6A-6B illustratively display a tube for delivering a cannula in accordance with some embodiments of the disclosed subject matter
  • FIG. 7 illustratively displays a slave hybrid-robot illustrating the legs of a parallel robot in accordance with some embodiments of the disclosed subject matter
  • FIGS. 8-9 illustratively display an eye and an i th slave hybrid-robot in accordance with some embodiments of the disclosed subject matter.
  • FIGS. 10A-10B illustratively display an organ and an i th slave hybrid-robot in accordance with some embodiments of the disclosed subject matter.
  • systems, devices, and methods for surgery on a hollow anatomically suspended organ are disclosed.
  • a tele-robotic microsurgical system can have a slave hybrid robot having at least two robotic arms (each robotic arm having a serial robot attached to a parallel robot) and a tele-robotic master having at least two user controlled master slave interfaces (e.g., joysticks).
  • the serial robot for each robotic arm can have a tube housing a pre-bent NiTi cannula that is substantially straight when in the tube.
  • the user can control movement of the at least two robotic arms by controlling the parallel robot and serial robot for each robotic arm. That is, the user can control the combined motion of the serial robot and parallel robot for each arm by the master slave interfaces.
  • a general surgical setup for eye surgery 100 includes a surgical bed 110 , a surgical microscope 120 , a slave hybrid-robot 125 , and a tele-robotic master (not shown).
  • the patient lies on surgical bed 110 , with his head 115 positioned as shown.
  • a patient located on surgical bed 110 has a frame 130 releasably attached to their head, and a slave hybrid-robot releasably attached to frame 130 .
  • a medical professional can look into the patient's eye through surgical microscope 120 and can control drug delivery, aspiration, light delivery, and delivery of at least one of microgrippers, picks, and micro knives by the tele-robotic master which is in communication with slave hybrid-robot 125 .
  • the slave-hybrid robot can be positioned over the organ (e.g., attached to a frame connected to the head of a patient).
  • the slave-hybrid robot having a first robotic arm (having a first parallel robot and first serial robot) and a second robotic arm (having a second parallel robot and a second serial robot) can have both arms in a position minimizing the amount of movement needed to enter the organ.
  • organ entry 102 in FIG.
  • the user can insert a first tube, housing a first pre-bent NiTi cannula, into a patient's organ by moving the first parallel robot.
  • a second user controlled master slave interface to control the second robotic arm the user can insert a second tube into the patient's organ by moving the second parallel robot.
  • Organ manipulation ( 105 in FIG. 1A ) and operations inside the organ ( 104 in FIG. 1A ) can occur in series (e.g., operations inside the organ then organ manipulation, organ manipulation then operations inside the organ, etc.) or in parallel (e.g., operations inside the organ and organ manipulation at substantially the same time).
  • performing operations inside the organ ( 104 in FIG. 1A ) and organ manipulation ( 105 in FIG. 1A ) in series is described below.
  • the user can control the first serial robot extending the first pre-bent NiTi cannula out of the first tube, the first pre-bent NiTi cannula bending as it exits the first tube. This bending represents one degree of freedom for the serial robot as described below.
  • the user can use the first serial robot to rotate at least one of the first pre-bent NiTi cannula and the first tube about their longitudinal axis (hence positioning the NiTi cannula inside the organ). This rotation about the longitudinal axis represents a second degree of freedom for the serial robot.
  • the user can use the second serial robot to move a second pre-bent NiTi cannula out of the second tube. The second pre-bent NiTi cannula bends as it exits the second tube.
  • the user can rotate at least one of the second pre-bent NiTi cannula and the second tube about their longitudinal axis.
  • delivering a second pre-bent NiTi cannula out of the tube is not necessary.
  • the second tube can be used for delivering a light into the organ.
  • the pre-bent NiTi cannula can be delivered outside of the tube to provide a controlled delivery of light through an embedded optical fiber.
  • the pre-bent NiTi cannula can be delivered outside of the tube to provide a controlled delivery of an optical fiber bundle for controllable intra-ocular visualization for applications such as visualizing the distance between tools and the retina by providing a side view to the surgeon.
  • the user can utilize at least one of the first and second NiTi cannula and first and second tubes for drug delivery, aspiration, light delivery, and delivery of at least one of microgrippers, picks, and micro knives into the organ.
  • the user can manipulate and position the organ ( 105 in FIG. 1A ), with both tubes in the patient's organ,. For example, using both the first and second user controlled master slave interfaces, the user can move both parallel robots together (hence moving the tubes in the organ) and manipulate the organ. Further, after manipulating the organ the user can perform additional operations within the organ ( 104 in FIG. 1A ).
  • the user For exiting the organ ( 106 in FIG. 1A ), that is, to remove the surgical instruments from the organ, the user uses the first, user controlled master slave interface to control the first robotic arm.
  • the user retracts the first pre-bent NiTi cannula into the first tube using the first serial robot.
  • the user can similarly retract the second pre-bent NiTi cannula into the second tube using the serial robot.
  • the user can move both the first and second parallel robots to retract both the first and second tubes from the organ.
  • the serial robots can be removed from the eye by releasing a fast clamping mechanisms connecting them to the parallel robots and subsequently removing the frame with the two parallel robots.
  • the disclosed subject matter can be used for surgery on any hollow anatomically suspended organs in the body.
  • the disclosed subject matter can be used on the eye, heart, liver, kidneys, bladder, or any other substantially hollow anatomically suspended organ deemed suitable.
  • the following description focuses on tele-robotic microsurgery on the eye.
  • a slave hybrid-robot 125 positioned over a patient's head is displayed.
  • the slave hybrid-robot 125 can be attached to a frame 210 which in turn is attached to a patient's head 215 .
  • slave hybrid-robot 125 includes a first robotic arm 220 and a second robotic arm 225 that can be attached to frame 210 and can further include a microscope/viewcone 230 .
  • first robotic arm 220 and second robotic arm 225 can include a parallel robot 235 (e.g., a Stewart platform, Stewart/Gough platform, delta robot, etc.) and a serial robot 240 (e.g., a robot consisting of a number of rigid links connected with joints).
  • a parallel robot 235 e.g., a Stewart platform, Stewart/Gough platform, delta robot, etc.
  • serial robot 240 e.g., a robot consisting of a number of rigid links connected with joints.
  • the serial robot can be releasably attached to the parallel robot.
  • the parallel robot can be permanently attached to the frame and the serial robot can be releasably attached to the parallel robot.
  • the serial robot can be releasably attached to the parallel robot by, for example, lockable adjustable jaws.
  • the slave hybrid-robot includes at least two robot arms releasably attached to the frame.
  • the robot arms can be attached to the frame by an adjustable lockable link, a friction fit, a clamp fit, a screw fit, or any other mechanical method and apparatus deemed suitable.
  • the robotic arms can be permanently attached to the frame.
  • the robotic arms can be attached by welding, adhesive, or any other mechanism deemed suitable.
  • first robotic arm 220 and second robotic arm 225 can be adjusted into location at initial setup of the system (e.g., at the beginning of surgery). This can be done, for example, to align the robotic arms with the eye. Further, first robotic arm 220 and second robotic arm 225 can have a serial robot and a parallel robot where only one of the serial robot or parallel robot can be adjusted into location at initial setup of the system.
  • frame 210 can be attached to the patient's head by a bite plate 245 (e.g., an item placed in the patient's mouth which the patient bites down on) and a surgical strap 250 .
  • Frame 210 can be designed to produce the least amount of trauma to a patient when attached.
  • frame 210 can be attached to a patient's head by a coronal strap (e.g., a strap placed around the patient's head) and a locking bite plate (e.g., a bite plate which can be locked onto the patient's mouth where the bite plate locks on the upper teeth ).
  • Any mechanism for attaching the frame to the patient's head can be used.
  • the frame can be attached to the patient's head by a bite plate, surgical strap, or tension screw. Further, frame 210 can be screwed directly into the patient's skull.
  • bite plate 245 can include air and suction access (not shown).
  • first robotic arm 220 and second robotic arm 225 can be released from the frame and the patient can receive air and suction through tubes (not shown) in the bite plate access.
  • Frame 210 can be made using a substantially monolithic material constructed in a substantially circular shape with a hollow center. Further, the shape of frame 210 can be designed to fit the curvature of the patient's face. For example, the frame 210 can be substantially round, oval, or any other shape deemed suitable.
  • the frame material can be selected to be fully autoclaved.
  • the frame material can include a metal, a plastic, a blend, or any other material deemed suitable for an autoclave. Further still, frame 210 can include a material that is not selected to be fully autoclaved. That is, the frame can be for one time use.
  • first robotic arm 220 and second robotic arm 225 include hybrid-robots. It will be understood that a hybrid-robot refers to any combination of more than one robot combined for use on each of the robotic arms.
  • first robotic arm 220 and second robotic arm 225 include a six degree of freedom parallel robot (e.g., a Stewart platform, Stewart/Gough platform, delta robot, etc.) attached to a two degree of freedom serial robot (e.g., an intra-ocular dexterity robot) which when combined produce 16 degrees of freedom in the system.
  • the hybrid-robots can include a parallel robot with any number of degrees of freedom.
  • the two degree of freedom serial robot e.g., intra-ocular dexterity robot
  • the parallel robot can provide global high precision positioning of the eye and any surgical tool inside the eye.
  • the hybrid-robots can include any combination of robots including a serial robot, parallel robot, snake robot, mechanatronic robot, or any other robot deemed suitable.
  • First robotic arm 220 and second robotic arm 225 can be substantially identical.
  • both first robotic arm 220 and second robotic arm 225 can include a parallel robot and a serial robot.
  • first robotic arm 220 and second robotic arm 225 can be substantially different.
  • first robotic arm 220 can include a first parallel robot attached to a second serial robot while second robotic arm 225 can include a first parallel robot attached to a second parallel robot.
  • slave hybrid-robot 125 includes only two robotic arms. Using two robotic arms increases the bimanual dexterity of the user. For example, the two robotic arms can be controlled by a medical professional using two user controlled master slave interfaces (e.g., one controller in contact with each hand). Further, more than two robotic arms can be used in slave hybrid-robot 125 . For example, four robotic arms can be used in slave hybrid-robot 125 . Any suitable number of robotic arms can be used in slave hybrid-robot 125 .
  • first robotic arm 220 and second robotic arm 225 can be designed to be placed in an autoclave. Further, first robotic arm 220 and second robotic arm 225 can be designed for one time use. For example, first robotic arm 220 and second robotic arm 225 can be designed as throw away one time use products. Still further, parts of the robotic arms can be designed for one time use while other parts can be designed to be used in future operations. For example, first robotic arm 220 and second robotic arm 225 can include a disposable cannula, which can be used one time, and a reusable parallel robot.
  • the slave hybrid-robot can be designed to use less than 24 Volts and 0.8 Amps for each electrical component. Using less than 24 Volts and 0.8 Amps can minimize safety concerns for the patient. Further, in some embodiments, both the parallel robot and serial robot allow sterile draping and the frame supporting the parallel and serial robot can be designed to be autoclaved.
  • a tele-robotic microsurgical system for eye surgery 300 includes a tele-robotic master 305 and a slave hybrid-robot 325 .
  • tele-robotic robotic master 305 includes a controller 310 and a user controlled master slave interface 315 (e.g., two force feedback joysticks).
  • controller 310 includes at least one of a dexterity optimizer, a force feedback system, and a tremor filtering system.
  • the force feedback system can include a display 320 for indicating to a medical professional 325 the amount of force exerted by the robotic arms (e.g., the force on the cannula in the eye). Further, the force feedback system can include providing resistance on user controlled master slave interface 315 as the medical professional increases force on the robotic arms. Further still, at least one of the robotic arms can include a force sensor and torque sensor to measure the amount of force or torque on the arms during surgery. For example, at least one of the robotic arms can include a 6-axis force sensor for force feedback. These sensors can be used to provide force feedback to the medical professional. Forces on the robotic arms can be measured to prevent injuring patients.
  • a tremor reducing system can be included in robotic master 305 .
  • tremor reduction can be accomplished by filtering the tremor of the surgeon on the tele-robotic master side before delivering motion commands.
  • the motions of a master slave interface e.g., joystick
  • the controller can be filtered and delivered by the controller as set points for a PID (proportional, integral, and differential) controller of the slave hybrid-robot.
  • PID proportional, integral, and differential
  • the two tilting angles of the master joystick can be correlated to axial translations in the x-and y directions.
  • the direction of the master slave interface (e.g., joystick) can be correlated to the direction of movement of the slave in the x-y plane while the magnitudes of tilting of the master slave interface (e.g., joystick) can be correlated to the magnitude of the movement velocity of the robotic slave in x-y plane.
  • the user can control the slave hybrid robot by directly applying forces to a tube (described below) included in the serial robot.
  • the serial robot can be connected to the parallel robot through a six-axis force and moment sensor that reads forces that the user applies and can deliver signals to the controller 310 that translates these commands to motion commands while filtering the tremor of the hand of the surgeon.
  • Any suitable method for tremor reducing can be included in tele-robotic master 305 .
  • any suitable cooperative manipulation method for tremor reducing can be used.
  • a dexterity optimizer can include any mechanism for increasing the dexterity of the user.
  • the dexterity optimizer can utilize a preplanned path for entry into the eye.
  • the dexterity optimizer takes over the delivery of the tube into the eye by using the preplanned path.
  • the tele-robotic master and slave hybrid-robot can communicate over a high-speed dedicated Ethernet connection. Any communications mechanism between the tele-robotic master and slave hybrid-robot deemed suitable can be used. Further, the medical professional and the tele-robotic master can be in a substantially different location than the slave hybrid-robot and patient.
  • the slave hybrid-robot can include a serial robot 405 and a parallel robot 410 .
  • serial robot 405 can include a serial connector 406 for connecting a platform 415 (e.g., the parallel robot's platform) and a serial articulator 407 . Any mechanical connection can be used for connecting the parallel robot's platform and serial articulator 407 .
  • Platform 415 can be connected to legs 420 which are attached to base 425 .
  • serial robot 405 including serial connector 406 is illustratively displayed.
  • the serial connector can be enlarged for a clearer view of the serial connector.
  • FIG. 4C an exploded view of serial connector 406 is displayed for a clearer view of a possible construction for serial connector 406 .
  • Any suitable construction for serial connector 406 can be used.
  • serial connector 406 can connect serial articulator 407 ( FIG. 4A ) with parallel robot 410 ( FIG. 4A ).
  • platform 415 e.g., the parallel robot moving platform
  • hollow arms 430 can support a first electrical motor 435 and a second electric motor 437 .
  • First electric motor 435 and second electric motor 437 can actuate a first capstan 440 and a second capstan 443 via a first wire drive that actuate anti-backlash bevel gear 445 and a second wire drive actuate anti-backlash bevel gear 447 that can differentially actuate a third bevel gear 465 about its axis and tilt a supporting bracket 455 .
  • Differentially driving first electric motor 435 and second electric motor 437 , the tilting of bracket 455 and the rotation of a fast clamp 460 about the axis of the cannula can be controlled.
  • fast clamp 460 included in serial connector 406 , can be used to clamp instruments that are inserted through the fast clamp 460 .
  • Any suitable construction for fast clamp 460 can be used.
  • fast clamp 460 can include a collet housing 450 , connecting screws 470 , and a flexible collet 475 . Connecting screws 470 can connect collet housing 450 to third bevel gear 450 .
  • Collet housing 450 can have a tapered bore such that when flexible collet 475 is screwed into a matching thread in the collet housing 450 a flexible tip (included in flexible collet 475 ) can be axially driven along the axis of the tapered bore, hence reducing the diameter of the flexible collet 475 . This can be done, for example, to clamp instruments that are inserted through the fast clamp 460 . Any other suitable mechanism for clamping instruments can be used.
  • the serial robot includes a serial articulator 407 for delivering at least one of a tube 505 and a cannula 520 into the eye.
  • serial robot articulator 407 includes a servo motor 510 and high precision ball screw 515 for controlling delivery of at least one of tube 505 and cannula 520 .
  • Servo motor 510 coupled to high-precision ball screw 515 , can add a degree of freedom to the system that can be used for controlling the position of cannula 520 with respect to tube 505 .
  • servo motor 510 can be coupled to a hollow lead screw (not shown) that when rotated drives a nut (not shown) axially.
  • cannula 520 can be connected to the nut and move up/down as servo motor 510 rotates the lead screw (not shown). Any suitable mechanism for controlling the delivery of tube 505 and cannula 520 can be used. Further, in some embodiments, tube 505 houses cannula 520 .
  • cannula 520 can be delivered through tube 505 into the eye.
  • FIG. 6A illustratively displays a cannula 520 in a straightened position while housed in tube 505 .
  • FIG. 6B illustratively displays cannula 520 in a bent position as cannula 520 has exited tube 505 (hence the cannula has assumed its pre-bent shape).
  • the pre-bent shape of cannula 520 can be created by using any shape memory alloy (e.g., NiTi) and setting the shape so that the cannula assumes the bent position at a given temperature (e.g., body temperature, room temperature, etc.).
  • Tube 505 can include a proximal end 610 and a distal end 615 . Further, cannula 520 can exit distal end 615 of tube 505 . In some embodiments, cannula 520 can include a pre-bent NiTi cannula which bends when exiting tube 505 . Tube 505 and cannula 520 can be constructed of different suitable materials, such as a plastic (e.g, Teflon, Nylon, etc), metal (e.g, Stainless Steal, NiTi, etc), or any other suitable material. Further, in some embodiments, at least one of tube 505 and cannula 520 can rotate about longitudinal axis 620 .
  • a plastic e.g, Teflon, Nylon, etc
  • metal e.g, Stainless Steal, NiTi, etc
  • at least one of tube 505 and cannula 520 can rotate about longitudinal axis 620 .
  • cannula 520 or tube 505 can be used for at least one of drug delivery, aspiration, light delivery, and for delivering at least one of microgrippers, picks, and micro knives.
  • a medical professional can extend cannula 520 out of tube 505 into the orbit of the eye. While in the orbit, the medical professional can deliver a micro knife through cannula 520 to remove tissue on the retina.
  • cannula 520 can include a backlash-free super-elastic NiTi cannula to provide high precision dexterous manipulation.
  • Using a backlash-free super-elastic NiTi cannula increases the control of delivery into the orbit of the eye by eliminating unwanted movement of the cannula (e.g., backlash). Further, the bending of cannula 520 when exiting tube 505 can increase positioning capabilities for eye surgery.
  • the slave hybrid-robot can be designed to manipulate the eye.
  • at least one of tube 505 and cannula 520 apply force to the eye thereby moving the position of the eye.
  • force can be applied by cannula 520 inside the eye for manipulating the eye.
  • Force on the eye by at least one of tube 505 and cannula 520 can be generated by moving the parallel robot controlling the position of at least one of the tube and cannula.
  • the parallel robot can include a plurality of independently actuated legs 705 . As the lengths of the independently actuated legs are changed the position and orientation of the platform 415 changes.
  • Legs 705 can include a universal joint 710 , a high precision ball screw 715 , anti-backlash gear pair 720 , and a ball joint 725 .
  • the parallel robot can include any number of legs 705 . For example, the parallel robot can include three to six legs.
  • a unified kinematic model accounts for the relationship between joint speeds (e.g., the speed at which moving parts of the parallel and serial robots translate and rotate) of the two robotic arms of the slave hybrid-robot, and twist of the eye and the surgical tools inside the eye.
  • joint speeds e.g., the speed at which moving parts of the parallel and serial robots translate and rotate
  • twist relates to the six dimensional vector of linear velocity and angular velocity where the linear velocity precedes the angular velocity.
  • the twist can be required to represent the motion of an end effector, described below ( 920 in FIG. 9 ). Further, this definition can be different from the standard nomenclature where the angular velocity precedes the linear velocity (in its vector presentation).
  • the eye system can be enlarged, FIG. 9 , for a clearer view of the end effector (e.g., the device at the end of a robotic arm designed to interact with the environment of the eye, such as the pre-bent cannula or items delivered through the pre-bent cannula) and the eye coordinate frames.
  • the coordinate system can be defined to assist in the derivation of the system kinematics.
  • the coordinate systems described below are defined to assist in the derivation of the system kinematics.
  • the world coordinate system ⁇ W ⁇ (having coordinates ⁇ circumflex over (x) ⁇ W , ⁇ W , ⁇ circumflex over (z) ⁇ W ) can be centered at an arbitrarily predetermined point in the patient's forehead with the patient in a supine position.
  • the ⁇ circumflex over (z) ⁇ W axis points vertically and ⁇ W axis points superiorly (e.g., pointing in the direction of the patients head as viewed from the center of the body along a line parallel to the line formed by the bregma and center point of the foramen magnum of the skull).
  • a parallel robot base coordinate system ⁇ B i ⁇ of the i th hybrid robot (having coordinates ⁇ circumflex over (x) ⁇ B i , ⁇ B i , ⁇ circumflex over (z) ⁇ B i ) can be located at point b i (i.e., the center of the platform base) such that the ⁇ circumflex over (z) ⁇ B i axis lies perpendicular to the platform base of the parallel robot base and the ⁇ circumflex over (x) ⁇ B i axis lies parallel to ⁇ circumflex over (z) ⁇ W .
  • the moving platform coordinate system of the i th hybrid robot ⁇ P i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ P i , ⁇ P i , ⁇ circumflex over (z) ⁇ P i ) lies in center of the moving platform, at point p i , such that the axes lie parallel to ⁇ B i ⁇ when the parallel platform lies in a home configuration.
  • a parallel extension arm coordinate system of the i th hybrid ⁇ Q i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ Q i , ⁇ Q i , ⁇ circumflex over (z) ⁇ Q i ) can be attached to the distal end of the arm at point q i , with ⁇ circumflex over (z) ⁇ Q i lying along the direction of the insertion needle of the robot, in vector direction q ⁇ right arrow over ( i n) ⁇ i , and ⁇ circumflex over (x) ⁇ Q i being fixed during setup of eye surgery (e.g., a vitrectomy procedure).
  • eye surgery e.g., a vitrectomy procedure
  • the serial robot base coordinate system of the i th hybrid robot ⁇ N i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ N i ⁇ N i ⁇ circumflex over (z) ⁇ N i ) lies at point n i with the ⁇ circumflex over (z) ⁇ N i , axis also pointing along the insertion needle length of vector q ⁇ right arrow over ( i n) ⁇ i and the ⁇ N i axis rotated from ⁇ Q i an angle q s i 1 about ⁇ circumflex over (z) ⁇ N i .
  • the end effector coordinator system ⁇ G i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ G i , ⁇ G i , ⁇ circumflex over (z) ⁇ G i ) lies at point g i with the ⁇ circumflex over (z) ⁇ G i axis pointing in the direction of the end effector gripper 920 and the ⁇ G i can be parallel to the ⁇ N i axis.
  • the eye coordinate system ⁇ E ⁇ (having coordinates ⁇ circumflex over (x) ⁇ E , ⁇ E , ⁇ circumflex over (z) ⁇ E ) sits at the center point e of the eye with axes parallel to ⁇ W ⁇ when the eye is unactuated by the robot.
  • the kinematic modeling of the system includes the kinematic constraints due to the incision points in the eye and the limited degrees of freedom of the eye.
  • the kinematics of a two-armed robot with the eye are described, while describing the relative kinematics of a serial robot end effector with respect to a target point on the retina.
  • the Jacobian of the parallel robot platform relating the twist of the moving platform frame ⁇ P i ⁇ to the joint speeds ⁇ dot over (q) ⁇ P i can be given by:
  • a i W( ⁇ right arrow over (p i q i ) ⁇ ) can be the twist transformation matrix.
  • the kinematic relationship of the frame ⁇ N i ⁇ can be similarly related to ⁇ Q i ⁇ by combining the linear and angular velocities.
  • the linear and angular velocities are:
  • Equations 5 and 6 expressed in matrix form yield:
  • Equations 8 and 9 expressed in matrix form yield:
  • the serial joints of the hybrid system can be parameterized as follows:
  • J s i [ [ ( - n i ⁇ g i ⁇ ) ⁇ ] ⁇ z ⁇ Q i r ⁇ ⁇ z ⁇ G i z ⁇ Q i y ⁇ N i ]
  • J h i ⁇ C i B i A i J P i ⁇ 1 , J s i ⁇ .
  • the eye can be modeled as a rigid body constrained to spherical motion by the geometry of the orbit and musculature.
  • the angular velocity of the eye can be parameterized by:
  • ⁇ dot over (x) ⁇ e [ ⁇ dot over ( ⁇ ) ⁇ , ⁇ dot over ( ⁇ ) ⁇ , ⁇ dot over ( ⁇ ) ⁇ ] t (4)
  • the kinematics of the end effector with respect to the eye can also be modeled.
  • the formulations can be combined to define the kinematic structure of the eye and i th hybrid robot.
  • This relationship can allow expression of the robot joint parameters based on the desired velocity of the end effector with respect to the eye and the desired angular velocity of the eye.
  • an arbitrary goal point on the retinal surface t i can be chosen.
  • the angular velocity of the eye imparts a velocity at point t i
  • the angular velocity of the end effector frame of the robot with respect to the eye frame can be written as:
  • the mechanical structure of the hybrid robot in the eye allows only five degrees of freedom as independent rotation about the ⁇ circumflex over (z) ⁇ G i axis can be unachievable.
  • This rotation can be easily represented by the third w-v-w Euler angle ⁇ i .
  • the first angle ⁇ i represents the rotation between the projection of the ⁇ circumflex over (z) ⁇ G i axis on the ⁇ circumflex over (x) ⁇ W ⁇ W plane and ⁇ circumflex over (x) ⁇ W
  • the second angle ⁇ i represents rotation between ⁇ circumflex over (z) ⁇ W and ⁇ circumflex over (z) ⁇ G i .
  • the system can utilize path planning and path control.
  • path planning and path control can be used to ease the surgery by having the tele-robotic master controller automatically perform some of the movements for the slave hybrid-robot.
  • the twist of the system can therefore be parameterized with w-v-w Euler angles and the third Euler angle eliminated by a degenerate matrix K i defined as follows:
  • the robotic system can be constrained such that the hybrid robots move in concert (e.g., move substantially together) to control the eye without injuring the structure by tearing the insertion points.
  • This motion can be achieved by allowing each insertion arm to move at the insertion point only with the velocity equal to the eye surface at that point, plus any velocity along the insertion needle. This combined motion constrains the insertion needle to the insertion point without damage to the structure.
  • point m i can be defined at the insertion point on the scleral surface of the eye and m′ i can be defined as point on the insertion needle instantaneously coincident with m i .
  • the velocity of m i must be equal to the velocity of point m i in the plane perpendicular to the needle axis:
  • v m′ i [I 3 ⁇ 3 , 0 3 ⁇ 3 ] ⁇ dot over (x) ⁇ Q i +E i [0 3 ⁇ 3 , I 3 ⁇ 3 ] ⁇ dot over (x) ⁇ Q i (27)
  • An expression for the velocity of the insertion point m i can be related to the desired eye velocity, similar to the derivation of velocity of point t i , yielding:
  • M i ⁇ ( ⁇ right arrow over (em i ) ⁇ ) ⁇ .
  • FIG. 10A-10B an organ and the i th hybrid robotic arm is displayed.
  • the organ is enlarged ( FIG. 10A ) for a clearer view of the end effector and the organ coordinate frames.
  • FIG. 10B illustratively displays an enlarged view of the end effector.
  • the following coordinate systems are defined to assist in the derivation of the system kinematics.
  • the world coordinate system ⁇ W ⁇ (having coordinates ⁇ circumflex over (x) ⁇ W , ⁇ W , ⁇ circumflex over (z) ⁇ W ) can be centered at an arbitrarily predetermined point in the patient's forehead with the patient in a supine position.
  • the ⁇ circumflex over (z) ⁇ W axis points vertically and ⁇ W axis points superiorly.
  • the parallel robot base coordinate system ⁇ B i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ B i , ⁇ B i , ⁇ circumflex over (z) ⁇ B i ) of the i th hybrid robot can be located at point b i (i.e., the center of the base platform) such that the ⁇ circumflex over (z) ⁇ B i axis lies perpendicular to the base of the parallel robot platform and the ⁇ circumflex over (x) ⁇ B i axis lies parallel to ⁇ circumflex over (z) ⁇ W .
  • the moving platform coordinate system of the i th hybrid robot ⁇ P i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ P i , ⁇ P i , ⁇ circumflex over (z) ⁇ P i ) lies in center of the moving platform, at point p i such that the axes lie parallel to ⁇ B i ⁇ when the parallel robot platform lies in the home configuration (e.g., the initial setup position).
  • the parallel robot extension arm coordinate system of the i th hybrid ⁇ Q i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ Q i , ⁇ Q i , ⁇ circumflex over (z) ⁇ Q i ) can be attached to the distal end of the arm at point q i , with ⁇ circumflex over (z) ⁇ Q i lying along the direction of the insertion needle of the robot ⁇ right arrow over (q i n i ) ⁇ , and ⁇ circumflex over (x) ⁇ Q i fixed during setup procedure.
  • the serial robot (e.g., intra-ocular dexterity robot) base coordinate system of the i th hybrid robot ⁇ N i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ N i ⁇ N i ⁇ circumflex over (z) ⁇ N i ) lies at point n i with the ⁇ circumflex over (z) ⁇ N i axis also pointing along the insertion needle length ⁇ right arrow over (q i n i ) ⁇ and the ⁇ N i axis rotated from ⁇ Q i an angle q s i 1 about ⁇ circumflex over (z) ⁇ N i .
  • the serial robot e.g., intra-ocular dexterity robot
  • the end effector coordinate system ⁇ G i ⁇ (having coordinates ⁇ circumflex over (x) ⁇ G i , ⁇ G i , ⁇ circumflex over (z) ⁇ G i ) lies at point g i with the ⁇ circumflex over (z) ⁇ G i , axis pointing in the direction of the end effector gripper and the ⁇ G i axis parallel to the ⁇ N i axis.
  • the organ coordinate system ⁇ O ⁇ (having coordinates ⁇ circumflex over (x) ⁇ O , ⁇ O , ⁇ circumflex over (z) ⁇ O ) sits at the rotating center o of the organ with axes parallel to ⁇ W ⁇ when the organ can be not actuated by the robot.
  • the kinematic modeling of the system can include the kinematic constraints of the incision points on the hollow organ.
  • the kinematics of the triple-armed robot with the organ and describes the relative kinematics of the serial robot (e.g., intra-ocular dexterity robot) end effector with respect to a target point on the organ.
  • the serial robot e.g., intra-ocular dexterity robot
  • Equation 33 The Jacobian of the parallel robot platform relating the twist of the moving platform frame ⁇ dot over (x) ⁇ p i to the joint parameters, ⁇ dot over (q) ⁇ p i is shown in equation 33. Further, the overall hybrid Jacobian matrix for one robotic arm is obtained as equation 34.
  • modeling can be accomplished by considering the elasticity and surrounding anatomy of the organ. Further, in some embodiments, the below analysis does not include the organ elasticity. Further still, a six dimension twist vector can be used to describe the motion of the organ using the following parameterization:
  • x,y,z, ⁇ , ⁇ , ⁇ can be linear positions and Roll-Pitch-Yaw angles of the organ, and ⁇ dot over (x) ⁇ ol and ⁇ dot over (x) ⁇ on correspond to the linear and angular velocities of the organ respectively.
  • the Kinematics of the serial robot (e.g., intra-ocular dexterity robot) end effector with respect to the organ can be modeled. Further, in some embodiments, the model can express the desired velocity of the end effector with respect to the organ and the desired velocity of the organ itself, an arbitrary target point t i on the inner surface of the organ can be chosen.
  • the linear and angular velocities of the end effector frame with respect to the target point can be written as:
  • v g i /t i [I 3 ⁇ 3 ,0 3 ⁇ 3 ]J h i ⁇ dot over (q) ⁇ h i ⁇ dot over (x) ⁇ ol ⁇ T i ⁇ dot over (x) ⁇ on (36)
  • T i ⁇ ( ⁇ right arrow over (ot i ) ⁇ ) ⁇
  • H i [ I 3 ⁇ 3 T i 0 3 ⁇ 3 I 3 ⁇ 3 ]
  • the mechanical structure of the hybrid robot in the organ cavity can allow only five degrees of freedom as independent rotation of the serial robot (e.g., intra-ocular dexterity robot) end effector about the ⁇ circumflex over (z) ⁇ G i axis can be unachievable due to the two degrees of freedom of the serial robot (e.g., intra-ocular dexterity robot).
  • This rotation can be represented by the third w-v-w Euler angle ⁇ i .
  • the twist of the system can be parameterized using w-v-w Euler angles while eliminating the third Euler angle through the use of a degenerate matrix K i as defined below. Inserting the aforementioned parameterization into the end effector twist, equation 38 , yields a relation between the achievable independent velocities and the joint parameters of the hybrid system, equation 40.
  • the robotic system can be constrained such that the hybrid arms move synchronously to control the organ without tearing the insertion point.
  • the robotic system can be constrained such that the multitude, n a , of hybrid robotic arms moves synchronously to control the organ without tearing the insertion points.
  • n a n a .
  • an equality constraint must be imposed between the projections of the linear velocities of m i and m′ i on a plane perpendicular to the longitudinal axis of the i th serial robot (e.g., intra-ocular dexterity robot) cannula.
  • Equation 41 and equation 42 can constitute 2n a scalar equations that provide the conditions for the organ to be constrained by n a robotic arms inserted into it through incision points.
  • equation 41 and equation 42 should have the same rank as the dimension of the organ twist, ⁇ dot over (x) ⁇ o as constrained by its surrounding anatomy.
  • the rank should be six and therefore a minimum of three robotic arms can be necessary to effectively stabilize the organ.
  • the required rank can be three and hence the minimum number of arms can be two (e.g., for a dual-arm ophthalmic surgical system).
  • a differential kinematic relationship can be modeled. Further, multi-arm manipulation can be modeled wherein the relative position between the robotic arms and the organ can be always changing. Further, by separating input joint rates ⁇ dot over (q) ⁇ h output organ motion rates ⁇ dot over (x) ⁇ o and relative motion rates equation 43, the kinematic relationship can be modeled.
  • the robot kinetostatic performance can be evaluated by examining the characteristics of the robot Jacobian matrix. Further, normalization of the Jacobian can be necessary when calculating the singular values of the Jacobian. These singular values can depend on the units of the individual cells of the Jacobian. Inhomogeneity of the units of the Jacobian can stem from the inhomogeneity of the units of its end effector twist and inhomogeneity of the units in joint space (e.g., in cases where not all the joints are of the same type, such as linear or angular). Normalizing the Jacobian matrix requires scaling matrices corresponding to ranges of joint and task-space variables by multiplying the Jacobian for normalization.
  • the performance can be evaluated.
  • the Jacobian scaling matrix can be found by using a physically meaningful transformation of the end effector twist that would homogenize the units of the transformed twist. The designer can be required to determine the scaling/normalization factors of the Jacobian prior to the calculation of the condition index of the Jacobian. The methodology used relies on the use of individual characteristic lengths for the serial and the parallel portions of each robotic arm.
  • Equations 44-46 specify the units of the individual vectors and submatrices of equation 43.
  • the brackets can be used to designate units of a vector or a matrix, where [m] and [s] denote meters and seconds respectively.
  • the Jacobian matrices J l and J o do not possess uniform units and using a single characteristic length to normalize both of them can be not possible because the robotic arms can include both serial and parallel portions. Also, evaluating the performance of the robotic system for different applications can include simultaneously normalizing J l and J o rendering the units of all their elements to be unity.
  • the matrix can be homogenized using the radius of the organ at the target point as the characteristic length. It can be this radius, as measured with respect to the instantaneous center of rotation that imparts a linear velocity to point t i , as a result of the angular velocity of the organ.
  • the top right nine components of J O given by K i H i i 1,2,3 of equation 43, bear the unit of [m]. Hence, dividing them by the radius of the organ at the target point, L r can render their units to be unity.
  • the Jacobian matrix J l can describe the geometry of both the parallel robot and the serial robot. Further this can be done by using both L p , the length of the connection link of the parallel robot, ⁇ right arrow over (p i q i ) ⁇ , and L s , the bending radius of the inner bending tube of the serial robot, as characteristic lengths. In some instances, L p is multiplied by those components in K i J h i bearing the unit of [1/m]. Further, the components in K i J h i that bear the unit of [m] can be divided by L s . This can result in a normalized input Jacobian J l that can be dimensionless. Further still, the radius of the moving platform can be used for normalization.
  • L p can be the scaling factor of the linear velocity at point q i stemming from a unit angular velocity of the moving platform.
  • the circular bending cannula of the serial robot can be modeled as a virtual rotary joint, and the bending radius L s can be used to normalize the components of K i J h i that are related to the serial robot.
  • the eye can be modeled as a constrained organ allowing only rotational motions about its center. This can be used to produce a simplify model of the twist of the organ as a three dimensional vector as indicated in equation 47.
  • the overall Jacobian equation for the whole system with the eye simplifies to equation 52.
  • x . e [ ⁇ . , ⁇ . , ⁇ . ] t ( 47 )
  • v g i / t i [ I 3 ⁇ 3 , 0 3 ⁇ 3 ] ⁇ J h i ⁇ q . h i - T i ⁇ x . e ( 48 )
  • ⁇ g i / e [ 0 3 ⁇ 3 , I 3 ⁇ 3 ] ⁇ J h i ⁇ q . h i - x . e ( 49 )
  • x . g i / t i J h i ⁇ q . h i - D i ⁇ x .
  • At least four modes of operation can be performed by a robotic system for surgery: intra-organ manipulation and stabilization of the organ; organ manipulation with constrained intra-organ motions (e.g., manipulation of the eye while maintaining the relative position of devices in the eye with respect to a target point inside the eye); organ manipulation with unconstrained intra-organ motion (e.g., eye manipulation regardless of the relative motions between devices in the eye and the eye); and simultaneous organ manipulation and intra-organ operation.
  • organ manipulation with constrained intra-organ motions e.g., manipulation of the eye while maintaining the relative position of devices in the eye with respect to a target point inside the eye
  • organ manipulation with unconstrained intra-organ motion e.g., eye manipulation regardless of the relative motions between devices in the eye and the eye
  • simultaneous organ manipulation and intra-organ operation e.g., simultaneous organ manipulation and intra-organ operation.
  • each of the aforementioned four modes can be used to provide a dexterity evaluation.
  • intra-organ operation with organ stabilization can be used to examine the intraocular dexterity, a measure of how well this system can perform a specified surgical task inside the eye with one of its two arms.
  • organ manipulation with constrained intra-organ motions can be used to evaluate orbital dexterity, a measure of how well the two arms can grossly manipulate the rotational position of eye, while respecting the kinematic constraints at the incision points and maintaining zero velocity of the grippers with respect to the retina.
  • organ manipulation with unconstrained intra-organ motion can be used to evaluate the orbital dexterity without constraints of zero velocity of the grippers with respect to the retina.
  • simultaneous organ manipulation and intra-organ operation can be used to measure of intra-ocular and orbital dexterity while simultaneously rotating the eye and executing an intra-ocular surgical task.
  • x . ⁇ g / t [ x . ⁇ g 1 / t 1 t , x . ⁇ g 2 / t 2 t ] t .
  • Equation 54 represents the mathematical model of intra-ocular manipulation while constraining the eye.
  • equation 53 can simplify to equation 55. Physically this signifies that by specifying the relative velocities of the serial robot end effector with respect to the eye to be zero, equation 55 represents the mathematical model of orbital manipulation.
  • the robotic arms can use standard ophthalmic instruments with no distal dexterity (e.g., a straight cannula capable of rotating about its own longitudinal axis). This yields a seven degree of freedom robotic arm.
  • the Jacobian matrix for a seven degree of freedom robotic arm can be
  • J 7 i [ B i ⁇ A i ⁇ J P i - 1 , 0 3 ⁇ 1 z ⁇ Q i ]
  • Equation 56 and equation 58 can give the normalized sub-Jacobians for translational motions of seven degree of freedom and eight degree of freedom robots, while equation 57 and equation 59 can give the normalized sub-Jacobians for rotational motions of seven degree of freedom and eight degree of freedom robots.
  • Organ manipulation with constrained intra-organ motions can be used to evaluated the orbital dexterity when simultaneously using both arms to rotate the eyeball.
  • the evaluation can be designed to address the medical professionals' need to rotate the eye under the microscope in order to obtain a view of peripheral areas of the retina.
  • the two arms can be predetermined to approach a target point on the retina.
  • the relative position and orientation of the robot end effector with respect to a target point remains constant.
  • the target point on the retina can be selected to be [5 ⁇ /6, 0] t , defined in the eye and attached coordinate system ⁇ E ⁇ .
  • Frame ⁇ E ⁇ can be defined similarly as the organ coordinate system ⁇ O ⁇ and can represent the relative rotation of the eye with respect to ⁇ W ⁇ . This can cause the target point to rotate together with the eye during a manipulation.
  • a desired rotation velocity of the eye of 10°/sec about the y-axis can be specified and the input joint actuation velocities can be calculated through the inverse of the Jacobian matrix.
  • two serial robots e.g., intra-ocular dexterity robots
  • the eyeball form a rigid body allowing no relative motion in between.
  • the rates of the serial robot joints can be expected to be zero.
  • both arms coordinate to manipulate the eyeball. Further, one arm also operates inside the eye along a specified path. The overall dexterity of the robot utilizing this combined motion can be evaluated. It will be understood that assuming the eye can be rotated about the y-axis by 10°, one arm of the robotic system can scan the retina independently, meaning that there can be a specified relative motion between this arm and the eye.
  • the arm inserted through port [ ⁇ /3, ⁇ ] t retains fixed in position and orientation with respect to the eye
  • a i W( ⁇ right arrow over (p i q i ) ⁇ ) can be the twist transformation matrix.
  • J s i [ [ ( - n i ⁇ g i ⁇ ) ⁇ ] ⁇ z ⁇ Q i r ⁇ z ⁇ G i z ⁇ Q i y ⁇ N i ]
  • the 5 ⁇ 1 Euler angle parameterization of the desired i th end effector velocity can be related to the general twist of the i th robot end effector, by the degenerate matrix K i .
  • the matrix can be derived using a relationship relating the Cartesian angular velocities to the Euler angle velocities:
  • R i [ 0 - sin ⁇ ( ⁇ i ) cos ⁇ ( ⁇ i ) ⁇ sin ⁇ ( ⁇ i ) 0 cos ⁇ ( ⁇ i ) sin ⁇ ( ⁇ i ) ⁇ sin ⁇ ( ⁇ i ) 1 0 cos ⁇ ( ⁇ i ) ]
  • the general twist of a system, ⁇ dot over (x) ⁇ can be related to the 6 ⁇ 1 Euler angle twist, [ ⁇ dot over (x) ⁇ , ⁇ dot over (y) ⁇ , ⁇ , ⁇ dot over ( ⁇ ) ⁇ , ⁇ dot over ( ⁇ ) ⁇ , ⁇ dot over ( ⁇ ) ⁇ ] t , as follows:
  • the 5 ⁇ 1 Euler parameterization used in the aforementioned path planning equation can be derived by applying a 5 ⁇ 6 degenerate matrix to the 6 ⁇ 1 Euler angle twist, as follows:
  • K i [I 5 ⁇ 5 ,0 5 ⁇ 1 ]S i .
  • each insertion arm moves at the insertion point only with the velocity equal to the velocity of the organ surface at that point plus any velocity along the insertion needle can be derived as follows.
  • point m i can be defined at the insertion point on the surface of the organ and m′ i can be defined as point on the insertion needle instantaneously coincident with m i .
  • the velocity of m′ i must be equal to the velocity of point m i in the plane perpendicular to the needle axis:
  • constraints can be expressed in terms of the joint angles and organ velocity by relating the velocities of point m i and m′ i to the robot and organ coordinate systems.
  • the velocity of point m′ i can be related to the velocity of frame ⁇ Q i ⁇ as
  • An expression for the velocity of the insertion point m can be related to the desired organ velocity, yielding:
  • M i [( ⁇ right arrow over (m i ) ⁇ ) ⁇ ].

Abstract

Systems, devices, and methods for surgery on a hollow anatomically suspended organ are described herein. In some embodiments a tele-robotic microsurgical system for eye surgery include: a tele-robotic master and a slave hybrid-robot; wherein the tele-robotic master has at least two master slave interfaces controlled by a medical professional; wherein the slave hybrid-robot has at least two robotic arms attached to a frame releasably attached to a patient's head; wherein the at least two robotic arms each have a parallel robot and a serial robot; and wherein the serial robot includes a tube housing a cannula.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of U.S. Provisional Patent Applications No. 60/845,688, filed on Sep. 19, 2006 and 60/920,848, filed on Mar. 30, 2007, which are hereby incorporated by reference herein in their entireties.
  • TECHNOLOGY AREA
  • Systems, devices, and methods for surgery on a hollow anatomically suspended organ are provided.
  • BACKGROUND
  • Minimally invasive surgery on hollow anatomical suspended organs (e.g., ophthalmic microsurgery) presents medical professionals with unique challenges. Focusing on ophthalmic microsurgery, these challenges stem from the fact that the eye is a hollow and movable organ requiring very accurate and delicate surgical tasks to be performed inside it. During ophthalmic surgery, medical professionals use a microscope to visualize the retina by looking through the dilated iris. The tools currently used by medical professionals lack intraocular dexterity and are constrained to minimal degrees of freedom. Hence, it can be very difficult to perform complex ophthalmic surgery. Further, medical professionals can also be required to rotate the eye under the microscope in order to allow access to and visualization of the peripheral regions of the eye while manipulating multiple tools with very high precision.
  • The challenges of microsurgery include lack of intraocular dexterity of the tools, limited force feedback, and lack of depth perception when visualizing using the microscope. Microsurgery also demands a level of accuracy and bimanual dexterity not common to other surgical fields (e.g. positioning accuracy of 5-10 microns can be required). These difficult and precise bimanual tasks demonstrate the potential benefits and need for robotic assistance.
  • SUMMARY
  • In some embodiments, a tele-robotic microsurgical system for eye surgery has: a tele-robotic master and a slave hybrid-robot; wherein the tele-robotic master has at least two master slave interfaces controlled by a medical professional; wherein the slave hybrid-robot has at least two robotic arms attached to a frame which is releasably attachable to a patient's head; and wherein the at least two robotic arms each have a parallel robot and a serial robot.
  • In some embodiments, a tele-robotic microsurgical system for eye surgery, has: a frame, a first robotic arm, a second robotic arm, and a tele-robotic master; wherein the frame is releasably attached to a patient's head; wherein the first robotic arm and second robotic arm each have a parallel robot and a serial robot; the tele-robotic master having a master slave interface controlled by a medical professional and the serial robot having a tube and a cannula.
  • In some embodiments, a tele-robotic microsurgical system for surgery on a hollow anatomically suspended organ, has: a tele-robotic master and a slave hybrid-robot; wherein the tele-robotic master has at least one master slave interface controlled by a medical professional; wherein the slave hybrid-robot has at least one robotic arm attached to a frame releasably attachable to a patient; and wherein the at least one robotic arm has a parallel robot and a serial robot.
  • In some embodiments, a slave-hybrid robot for surgery on a hollow anatomically suspended organ, has: a frame releasably attachable to a patient and at least one robotic arm releasably attached to the frame; wherein the at least one robotic arm has a parallel robot and a serial robot; wherein the serial robot has a tube for delivering a pre-bent NiTi cannula; wherein at least one of the tube and the pre-bent NiTi cannula is capable of rotating about its longitudinal axis; and wherein the pre-bent NiTi cannula is capable of bending when extended from the tube.
  • DESCRIPTION OF DRAWINGS
  • The above and other objects and advantages of the disclosed subject matter will be apparent upon consideration of the following detailed description, taken in conjunction with accompanying drawings, in which like reference characters refer to like parts throughout, and in which:
  • FIG. 1A illustratively displays a method for using a tele-robotic microsurgery system in accordance with some embodiments of the disclosed subject matter;
  • FIG. 1B illustratively displays the general surgical setup for tele-robotic microsurgery on the eye in accordance with some embodiments of the disclosed subject matter;
  • FIG. 2 illustratively displays a slave hybrid-robot positioned over a patient's head in accordance with some embodiments of the disclosed subject matter;
  • FIG. 3 illustratively displays a tele-robotic microsurgical system for eye surgery including a tele-robotic master and a slave hybrid-robot in accordance with some embodiments of the disclosed subject matter;
  • FIG. 4A illustratively displays a slave hybrid-robot illustrating a serial robot and a parallel robot in accordance with some embodiments of the disclosed subject matter;
  • FIGS. 4B-4C illustratively display a serial connector included in a serial robot in accordance with some embodiments of the disclosed subject matter;
  • FIG. 5 illustratively displays a serial articulator included in a serial robot in accordance with some embodiments of the disclosed subject matter;
  • FIGS. 6A-6B illustratively display a tube for delivering a cannula in accordance with some embodiments of the disclosed subject matter;
  • FIG. 7 illustratively displays a slave hybrid-robot illustrating the legs of a parallel robot in accordance with some embodiments of the disclosed subject matter;
  • FIGS. 8-9 illustratively display an eye and an ith slave hybrid-robot in accordance with some embodiments of the disclosed subject matter; and
  • FIGS. 10A-10B illustratively display an organ and an ith slave hybrid-robot in accordance with some embodiments of the disclosed subject matter.
  • DETAILED DESCRIPTION
  • In accordance with the disclosed subject matter, systems, devices, and methods for surgery on a hollow anatomically suspended organ are disclosed.
  • In some embodiments, a tele-robotic microsurgical system can have a slave hybrid robot having at least two robotic arms (each robotic arm having a serial robot attached to a parallel robot) and a tele-robotic master having at least two user controlled master slave interfaces (e.g., joysticks). Further, the serial robot for each robotic arm can have a tube housing a pre-bent NiTi cannula that is substantially straight when in the tube. Using each of the user controlled master slave interfaces, the user can control movement of the at least two robotic arms by controlling the parallel robot and serial robot for each robotic arm. That is, the user can control the combined motion of the serial robot and parallel robot for each arm by the master slave interfaces.
  • Referring to FIG. 1B, the general surgical setup for tele-robotic microsurgery on the eye is displayed. In some embodiments, a general surgical setup for eye surgery 100 includes a surgical bed 110, a surgical microscope 120, a slave hybrid-robot 125, and a tele-robotic master (not shown). The patient lies on surgical bed 110, with his head 115 positioned as shown. During eye surgery a patient located on surgical bed 110, has a frame 130 releasably attached to their head, and a slave hybrid-robot releasably attached to frame 130. Further, a medical professional can look into the patient's eye through surgical microscope 120 and can control drug delivery, aspiration, light delivery, and delivery of at least one of microgrippers, picks, and micro knives by the tele-robotic master which is in communication with slave hybrid-robot 125.
  • Referring to FIG. 1A a method for using a tele-robotic microsurgical system is illustratively displayed. For initial setup (101 in FIG. 1A), the slave-hybrid robot can be positioned over the organ (e.g., attached to a frame connected to the head of a patient). For example, a slave-hybrid robot having a first robotic arm (having a first parallel robot and first serial robot) and a second robotic arm (having a second parallel robot and a second serial robot) can have both arms in a position minimizing the amount of movement needed to enter the organ. For organ entry (102 in FIG. 1A), using a first user controlled master slave interface to control the first robotic arm, the user can insert a first tube, housing a first pre-bent NiTi cannula, into a patient's organ by moving the first parallel robot. Similarly, using a second user controlled master slave interface to control the second robotic arm, the user can insert a second tube into the patient's organ by moving the second parallel robot.
  • Inside the organ the user can perform surgical tasks (103 in FIG. 1A), such as organ manipulation (105 in FIG. 1A) and operations inside the organ (104 in FIG. 1A). Organ manipulation (105 in FIG. 1A) and operations inside the organ (104 in FIG. 1A) can occur in series (e.g., operations inside the organ then organ manipulation, organ manipulation then operations inside the organ, etc.) or in parallel (e.g., operations inside the organ and organ manipulation at substantially the same time).
  • For example, performing operations inside the organ (104 in FIG. 1A) and organ manipulation (105 in FIG. 1A) in series is described below. For performing operations inside the organ (104 in FIG. 1A), using the first user controlled master slave interface to control the first robotic arm, the user can control the first serial robot extending the first pre-bent NiTi cannula out of the first tube, the first pre-bent NiTi cannula bending as it exits the first tube. This bending represents one degree of freedom for the serial robot as described below. Further, using the first user controlled master slave interface to control the first robotic arm, the user can use the first serial robot to rotate at least one of the first pre-bent NiTi cannula and the first tube about their longitudinal axis (hence positioning the NiTi cannula inside the organ). This rotation about the longitudinal axis represents a second degree of freedom for the serial robot. Similarly, using the second user controlled master slave interface to control the second robotic arm, the user can use the second serial robot to move a second pre-bent NiTi cannula out of the second tube. The second pre-bent NiTi cannula bends as it exits the second tube. Again, similarly, the user can rotate at least one of the second pre-bent NiTi cannula and the second tube about their longitudinal axis. In some instances, delivering a second pre-bent NiTi cannula out of the tube is not necessary. For example, the second tube can be used for delivering a light into the organ. Further, for example, the pre-bent NiTi cannula can be delivered outside of the tube to provide a controlled delivery of light through an embedded optical fiber. Further still, for example, the pre-bent NiTi cannula can be delivered outside of the tube to provide a controlled delivery of an optical fiber bundle for controllable intra-ocular visualization for applications such as visualizing the distance between tools and the retina by providing a side view to the surgeon.
  • Further, for performing operations within the organ (104 in FIG. 1A), the user can utilize at least one of the first and second NiTi cannula and first and second tubes for drug delivery, aspiration, light delivery, and delivery of at least one of microgrippers, picks, and micro knives into the organ. The user can manipulate and position the organ (105 in FIG. 1A), with both tubes in the patient's organ,. For example, using both the first and second user controlled master slave interfaces, the user can move both parallel robots together (hence moving the tubes in the organ) and manipulate the organ. Further, after manipulating the organ the user can perform additional operations within the organ (104 in FIG. 1A).
  • For exiting the organ (106 in FIG. 1A), that is, to remove the surgical instruments from the organ, the user uses the first, user controlled master slave interface to control the first robotic arm. The user retracts the first pre-bent NiTi cannula into the first tube using the first serial robot. For instances where a second pre-bent NiTi cannula has been delivered, the user can similarly retract the second pre-bent NiTi cannula into the second tube using the serial robot. Using both the first and second user controlled master slave interfaces to control respectively the first and second robotic arms, the user can move both the first and second parallel robots to retract both the first and second tubes from the organ. In cases of emergency the serial robots can be removed from the eye by releasing a fast clamping mechanisms connecting them to the parallel robots and subsequently removing the frame with the two parallel robots.
  • It will be apparent that the disclosed subject matter can be used for surgery on any hollow anatomically suspended organs in the body. For example, the disclosed subject matter can be used on the eye, heart, liver, kidneys, bladder, or any other substantially hollow anatomically suspended organ deemed suitable. For ease in understanding the subject matter presented herein, the following description focuses on tele-robotic microsurgery on the eye.
  • Referring to FIG. 2, a slave hybrid-robot 125 positioned over a patient's head is displayed. In some embodiments, the slave hybrid-robot 125 can be attached to a frame 210 which in turn is attached to a patient's head 215. Further, slave hybrid-robot 125 includes a first robotic arm 220 and a second robotic arm 225 that can be attached to frame 210 and can further include a microscope/viewcone 230. Still further, in some embodiments, first robotic arm 220 and second robotic arm 225 can include a parallel robot 235 (e.g., a Stewart platform, Stewart/Gough platform, delta robot, etc.) and a serial robot 240 (e.g., a robot consisting of a number of rigid links connected with joints). Some parts of the first and second robotic arms can be permanently attached to the frame while other parts can be releasably attached to the frame. Further, the serial robot can be releasably attached to the parallel robot. For example, for a robotic arm including a parallel and a serial robot, the parallel robot can be permanently attached to the frame and the serial robot can be releasably attached to the parallel robot. In some embodiments, the serial robot can be releasably attached to the parallel robot by, for example, lockable adjustable jaws.
  • In some embodiments, the slave hybrid-robot includes at least two robot arms releasably attached to the frame. For example, the robot arms can be attached to the frame by an adjustable lockable link, a friction fit, a clamp fit, a screw fit, or any other mechanical method and apparatus deemed suitable. Further, the robotic arms can be permanently attached to the frame. For example, the robotic arms can be attached by welding, adhesive, or any other mechanism deemed suitable.
  • In some embodiments, first robotic arm 220 and second robotic arm 225 can be adjusted into location at initial setup of the system (e.g., at the beginning of surgery). This can be done, for example, to align the robotic arms with the eye. Further, first robotic arm 220 and second robotic arm 225 can have a serial robot and a parallel robot where only one of the serial robot or parallel robot can be adjusted into location at initial setup of the system.
  • In some embodiments, frame 210 can be attached to the patient's head by a bite plate 245 (e.g., an item placed in the patient's mouth which the patient bites down on) and a surgical strap 250. Frame 210 can be designed to produce the least amount of trauma to a patient when attached. For example, frame 210 can be attached to a patient's head by a coronal strap (e.g., a strap placed around the patient's head) and a locking bite plate (e.g., a bite plate which can be locked onto the patient's mouth where the bite plate locks on the upper teeth ). Any mechanism for attaching the frame to the patient's head can be used. For example, the frame can be attached to the patient's head by a bite plate, surgical strap, or tension screw. Further, frame 210 can be screwed directly into the patient's skull.
  • Further, bite plate 245 can include air and suction access (not shown). For example, in an emergency, first robotic arm 220 and second robotic arm 225 can be released from the frame and the patient can receive air and suction through tubes (not shown) in the bite plate access.
  • Frame 210 can be made using a substantially monolithic material constructed in a substantially circular shape with a hollow center. Further, the shape of frame 210 can be designed to fit the curvature of the patient's face. For example, the frame 210 can be substantially round, oval, or any other shape deemed suitable. The frame material can be selected to be fully autoclaved. For example, the frame material can include a metal, a plastic, a blend, or any other material deemed suitable for an autoclave. Further still, frame 210 can include a material that is not selected to be fully autoclaved. That is, the frame can be for one time use.
  • In some embodiments, first robotic arm 220 and second robotic arm 225 include hybrid-robots. It will be understood that a hybrid-robot refers to any combination of more than one robot combined for use on each of the robotic arms. For example, in some embodiments, first robotic arm 220 and second robotic arm 225 include a six degree of freedom parallel robot (e.g., a Stewart platform, Stewart/Gough platform, delta robot, etc.) attached to a two degree of freedom serial robot (e.g., an intra-ocular dexterity robot) which when combined produce 16 degrees of freedom in the system. The hybrid-robots can include a parallel robot with any number of degrees of freedom. Further, the two degree of freedom serial robot (e.g., intra-ocular dexterity robot) can provide intra-ocular dexterity while the parallel robot can provide global high precision positioning of the eye and any surgical tool inside the eye. Still further, the hybrid-robots can include any combination of robots including a serial robot, parallel robot, snake robot, mechanatronic robot, or any other robot deemed suitable.
  • First robotic arm 220 and second robotic arm 225 can be substantially identical. For example, both first robotic arm 220 and second robotic arm 225 can include a parallel robot and a serial robot. Further, first robotic arm 220 and second robotic arm 225 can be substantially different. For example, first robotic arm 220 can include a first parallel robot attached to a second serial robot while second robotic arm 225 can include a first parallel robot attached to a second parallel robot.
  • In some embodiments, slave hybrid-robot 125 includes only two robotic arms. Using two robotic arms increases the bimanual dexterity of the user. For example, the two robotic arms can be controlled by a medical professional using two user controlled master slave interfaces (e.g., one controller in contact with each hand). Further, more than two robotic arms can be used in slave hybrid-robot 125. For example, four robotic arms can be used in slave hybrid-robot 125. Any suitable number of robotic arms can be used in slave hybrid-robot 125.
  • The robotic arms can be constructed to be reused in future operations. For example, first robotic arm 220 and second robotic arm 225 can be designed to be placed in an autoclave. Further, first robotic arm 220 and second robotic arm 225 can be designed for one time use. For example, first robotic arm 220 and second robotic arm 225 can be designed as throw away one time use products. Still further, parts of the robotic arms can be designed for one time use while other parts can be designed to be used in future operations. For example, first robotic arm 220 and second robotic arm 225 can include a disposable cannula, which can be used one time, and a reusable parallel robot.
  • In some embodiments, the slave hybrid-robot can be designed to use less than 24 Volts and 0.8 Amps for each electrical component. Using less than 24 Volts and 0.8 Amps can minimize safety concerns for the patient. Further, in some embodiments, both the parallel robot and serial robot allow sterile draping and the frame supporting the parallel and serial robot can be designed to be autoclaved.
  • Referring to FIG. 3, in some embodiments, a tele-robotic microsurgical system for eye surgery 300 includes a tele-robotic master 305 and a slave hybrid-robot 325. In some embodiments, tele-robotic robotic master 305 includes a controller 310 and a user controlled master slave interface 315 (e.g., two force feedback joysticks). In some embodiments, controller 310 includes at least one of a dexterity optimizer, a force feedback system, and a tremor filtering system.
  • The force feedback system can include a display 320 for indicating to a medical professional 325 the amount of force exerted by the robotic arms (e.g., the force on the cannula in the eye). Further, the force feedback system can include providing resistance on user controlled master slave interface 315 as the medical professional increases force on the robotic arms. Further still, at least one of the robotic arms can include a force sensor and torque sensor to measure the amount of force or torque on the arms during surgery. For example, at least one of the robotic arms can include a 6-axis force sensor for force feedback. These sensors can be used to provide force feedback to the medical professional. Forces on the robotic arms can be measured to prevent injuring patients.
  • A tremor reducing system can be included in robotic master 305. For example, tremor reduction can be accomplished by filtering the tremor of the surgeon on the tele-robotic master side before delivering motion commands. For example, the motions of a master slave interface (e.g., joystick) can be filtered and delivered by the controller as set points for a PID (proportional, integral, and differential) controller of the slave hybrid-robot. In this example the two tilting angles of the master joystick can be correlated to axial translations in the x-and y directions. The direction of the master slave interface (e.g., joystick) can be correlated to the direction of movement of the slave in the x-y plane while the magnitudes of tilting of the master slave interface (e.g., joystick) can be correlated to the magnitude of the movement velocity of the robotic slave in x-y plane. In another embodiment the user can control the slave hybrid robot by directly applying forces to a tube (described below) included in the serial robot. Further, the serial robot can be connected to the parallel robot through a six-axis force and moment sensor that reads forces that the user applies and can deliver signals to the controller 310 that translates these commands to motion commands while filtering the tremor of the hand of the surgeon. Any suitable method for tremor reducing can be included in tele-robotic master 305. For example, any suitable cooperative manipulation method for tremor reducing can be used.
  • In some embodiments, a dexterity optimizer can include any mechanism for increasing the dexterity of the user. For example, the dexterity optimizer can utilize a preplanned path for entry into the eye. In some embodiments, the dexterity optimizer takes over the delivery of the tube into the eye by using the preplanned path.
  • The tele-robotic master and slave hybrid-robot can communicate over a high-speed dedicated Ethernet connection. Any communications mechanism between the tele-robotic master and slave hybrid-robot deemed suitable can be used. Further, the medical professional and the tele-robotic master can be in a substantially different location than the slave hybrid-robot and patient.
  • Referring to FIG. 4A, in some embodiments, the slave hybrid-robot can include a serial robot 405 and a parallel robot 410. Further, in some embodiments, serial robot 405 can include a serial connector 406 for connecting a platform 415 (e.g., the parallel robot's platform) and a serial articulator 407. Any mechanical connection can be used for connecting the parallel robot's platform and serial articulator 407. Platform 415 can be connected to legs 420 which are attached to base 425.
  • Referring to FIG. 4B, a serial robot 405 including serial connector 406 is illustratively displayed. The serial connector can be enlarged for a clearer view of the serial connector. Referring to FIG. 4C, an exploded view of serial connector 406 is displayed for a clearer view of a possible construction for serial connector 406. Any suitable construction for serial connector 406 can be used. For example, serial connector 406 can connect serial articulator 407 (FIG. 4A) with parallel robot 410 (FIG. 4A). Referring to FIG. 4C, platform 415 (e.g., the parallel robot moving platform) can support hollow arms 430 that can support a first electrical motor 435 and a second electric motor 437. First electric motor 435 and second electric motor 437 can actuate a first capstan 440 and a second capstan 443 via a first wire drive that actuate anti-backlash bevel gear 445 and a second wire drive actuate anti-backlash bevel gear 447 that can differentially actuate a third bevel gear 465 about its axis and tilt a supporting bracket 455. Differentially driving first electric motor 435 and second electric motor 437, the tilting of bracket 455 and the rotation of a fast clamp 460 about the axis of the cannula can be controlled.
  • Further referring to FIG. 4C, an exploded view of the fast clamp 460 is displayed for a clearer view of a possible construction for fast clamp 460. Fast clamp 460, included in serial connector 406, can be used to clamp instruments that are inserted through the fast clamp 460. Any suitable construction for fast clamp 460 can be used. For example, fast clamp 460 can include a collet housing 450, connecting screws 470, and a flexible collet 475. Connecting screws 470 can connect collet housing 450 to third bevel gear 450. Collet housing 450 can have a tapered bore such that when flexible collet 475 is screwed into a matching thread in the collet housing 450 a flexible tip (included in flexible collet 475) can be axially driven along the axis of the tapered bore, hence reducing the diameter of the flexible collet 475. This can be done, for example, to clamp instruments that are inserted through the fast clamp 460. Any other suitable mechanism for clamping instruments can be used.
  • Referring to FIG. 5, in some embodiments, the serial robot includes a serial articulator 407 for delivering at least one of a tube 505 and a cannula 520 into the eye. In some embodiments, for example, serial robot articulator 407 includes a servo motor 510 and high precision ball screw 515 for controlling delivery of at least one of tube 505 and cannula 520. Servo motor 510, coupled to high-precision ball screw 515, can add a degree of freedom to the system that can be used for controlling the position of cannula 520 with respect to tube 505. For example, servo motor 510 can be coupled to a hollow lead screw (not shown) that when rotated drives a nut (not shown) axially. Further, for example, cannula 520 can be connected to the nut and move up/down as servo motor 510 rotates the lead screw (not shown). Any suitable mechanism for controlling the delivery of tube 505 and cannula 520 can be used. Further, in some embodiments, tube 505 houses cannula 520.
  • Referring to FIGS. 6A-6B, in some embodiments, cannula 520 can be delivered through tube 505 into the eye. FIG. 6A illustratively displays a cannula 520 in a straightened position while housed in tube 505. FIG. 6B illustratively displays cannula 520 in a bent position as cannula 520 has exited tube 505 (hence the cannula has assumed its pre-bent shape). The pre-bent shape of cannula 520 can be created by using any shape memory alloy (e.g., NiTi) and setting the shape so that the cannula assumes the bent position at a given temperature (e.g., body temperature, room temperature, etc.). Further, although cannula 520 is described as having a specific pre-bent shape, any shape deemed suitable can be used (e.g., s-shaped, curved, etc.). Tube 505 can include a proximal end 610 and a distal end 615. Further, cannula 520 can exit distal end 615 of tube 505. In some embodiments, cannula 520 can include a pre-bent NiTi cannula which bends when exiting tube 505. Tube 505 and cannula 520 can be constructed of different suitable materials, such as a plastic (e.g, Teflon, Nylon, etc), metal (e.g, Stainless Steal, NiTi, etc), or any other suitable material. Further, in some embodiments, at least one of tube 505 and cannula 520 can rotate about longitudinal axis 620.
  • In some embodiments, cannula 520 or tube 505 can be used for at least one of drug delivery, aspiration, light delivery, and for delivering at least one of microgrippers, picks, and micro knives. For example, during tele-robotic microsurgery on the eye, a medical professional can extend cannula 520 out of tube 505 into the orbit of the eye. While in the orbit, the medical professional can deliver a micro knife through cannula 520 to remove tissue on the retina.
  • Further, in some embodiments, cannula 520 can include a backlash-free super-elastic NiTi cannula to provide high precision dexterous manipulation. Using a backlash-free super-elastic NiTi cannula increases the control of delivery into the orbit of the eye by eliminating unwanted movement of the cannula (e.g., backlash). Further, the bending of cannula 520 when exiting tube 505 can increase positioning capabilities for eye surgery.
  • In some embodiments, the slave hybrid-robot can be designed to manipulate the eye. For example, in some embodiments, at least one of tube 505 and cannula 520 apply force to the eye thereby moving the position of the eye. In some embodiments, force can be applied by cannula 520 inside the eye for manipulating the eye. Force on the eye by at least one of tube 505 and cannula 520 can be generated by moving the parallel robot controlling the position of at least one of the tube and cannula.
  • Referring to FIG. 7, the parallel robot can include a plurality of independently actuated legs 705. As the lengths of the independently actuated legs are changed the position and orientation of the platform 415 changes. Legs 705 can include a universal joint 710, a high precision ball screw 715, anti-backlash gear pair 720, and a ball joint 725. The parallel robot can include any number of legs 705. For example, the parallel robot can include three to six legs.
  • In some embodiments, a unified kinematic model accounts for the relationship between joint speeds (e.g., the speed at which moving parts of the parallel and serial robots translate and rotate) of the two robotic arms of the slave hybrid-robot, and twist of the eye and the surgical tools inside the eye. It will be understood that the twist relates to the six dimensional vector of linear velocity and angular velocity where the linear velocity precedes the angular velocity. The twist can be required to represent the motion of an end effector, described below (920 in FIG. 9). Further, this definition can be different from the standard nomenclature where the angular velocity precedes the linear velocity (in its vector presentation).
  • Referring to FIG. 8, the eye and an ith hybrid robot is displayed. The eye system can be enlarged, FIG. 9, for a clearer view of the end effector (e.g., the device at the end of a robotic arm designed to interact with the environment of the eye, such as the pre-bent cannula or items delivered through the pre-bent cannula) and the eye coordinate frames. The coordinate system can be defined to assist in the derivation of the system kinematics. For example, the coordinate systems described below are defined to assist in the derivation of the system kinematics. The world coordinate system {W} (having coordinates {circumflex over (x)}W, ŷW, {circumflex over (z)}W) can be centered at an arbitrarily predetermined point in the patient's forehead with the patient in a supine position. The {circumflex over (z)}W axis points vertically and ŷW axis points superiorly (e.g., pointing in the direction of the patients head as viewed from the center of the body along a line parallel to the line formed by the bregma and center point of the foramen magnum of the skull). A parallel robot base coordinate system {Bi} of the ith hybrid robot (having coordinates {circumflex over (x)}B i , ŷB i , {circumflex over (z)}B i ) can be located at point bi (i.e., the center of the platform base) such that the {circumflex over (z)}B i axis lies perpendicular to the platform base of the parallel robot base and the {circumflex over (x)}B i axis lies parallel to {circumflex over (z)}W. The moving platform coordinate system of the ith hybrid robot {Pi} (having coordinates {circumflex over (x)}P i , ŷP i , {circumflex over (z)}P i ) lies in center of the moving platform, at point pi, such that the axes lie parallel to {Bi} when the parallel platform lies in a home configuration. A parallel extension arm coordinate system of the ith hybrid {Qi} (having coordinates {circumflex over (x)}Q i , ŷQ i , {circumflex over (z)}Q i ) can be attached to the distal end of the arm at point qi, with {circumflex over (z)}Q i lying along the direction of the insertion needle of the robot, in vector direction q{right arrow over (in)}i, and {circumflex over (x)}Q i being fixed during setup of eye surgery (e.g., a vitrectomy procedure). The serial robot base coordinate system of the ith hybrid robot {Ni} (having coordinates {circumflex over (x)}N i ŷN i {circumflex over (z)}N i ) lies at point ni with the {circumflex over (z)}N i , axis also pointing along the insertion needle length of vector q{right arrow over (in)}i and the ŷN i axis rotated from ŷQ i an angle qs i 1 about {circumflex over (z)}N i . The end effector coordinator system {Gi} (having coordinates {circumflex over (x)}G i , ŷG i , {circumflex over (z)}G i ) lies at point gi with the {circumflex over (z)}G i axis pointing in the direction of the end effector gripper 920 and the ŷG i can be parallel to the ŷN i axis. The eye coordinate system {E} (having coordinates {circumflex over (x)}E, ŷE, {circumflex over (z)}E) sits at the center point e of the eye with axes parallel to {W} when the eye is unactuated by the robot.
  • The notations used are defined below.
      • i=1,2 refers to an index referring to one of the two arms.
      • {A} refers to an arbitrary right handed coordinate frame with {{circumflex over (x)}A, ŷA, {circumflex over (z)}A} as it is associated unit vectors and point a as the location of its origin.
      • vC A/B, ωC A/B refers to the relative linear and angular velocities of frame {A} with respect to frame {B}, expressed in frame {C}. Unless specifically stated, all vectors are expressed in {W}.
      • vA, ωA refers to the absolute linear and angular velocities of frame {A}.
      • ARB refers to the rotation matrix of the moving frame {B} with respect to the frame {A}.
      • Rot({circumflex over (x)}A, α) refers to the rotation matrix about unit vector {circumflex over (x)}A by an angle α.
      • [b×] refers to the skew symmetric cross product (i.e., a square matrix A such that it is equal to the negative of its transposed matrix, A=−At, where superscript t refers to the transpose operator) matrix of b.
      • {dot over (q)}P i =[{dot over (q)}P i 1, {dot over (q)}P i 2, {dot over (q)}P i 3, {dot over (q)}P i 4, {dot over (q)}P i 5, {dot over (q)}P i 6]t refers to the joint speeds of the ith parallel robot platform.
      • {dot over (q)}s i =[{dot over (q)}s i 1, {dot over (q)}s i 2] t refers to the joint speeds of the serial robot. The first component can be the rotation speed about the axis of the serial robot tube and the second component can be the bending angular rate of the pre-bent cannula.
      • {dot over (x)}A=[{dot over (x)}A, {dot over (y)}A, żA, ωAx, ωAy, ωAz]t refers to the twist of a general coordinate system {A}. For example, referring to FIG. 9A, {Qi} represents the coordinate system defined by its three coordinate axes {{circumflex over (x)}Q i , ŷQ i , {circumflex over (z)}Q i }
      • {dot over (x)}P i =[{dot over (x)}P i , {dot over (y)}P i , żP i , ωP i x, ωP i y, ωP i z]t refers to the twist of the moving platform of the ith parallel robot where i=1,2.
      • {dot over (x)}n i refers to the twist of the ith insertion needle end/base of the snake (e.g., the length of the NiTi cannula).
      • {dot over (x)}e represents only the angular velocity of the eye (a 3×1 column vector). This is an exception to other notation because it is assumed that the translations of the center of motion of the eye are negligible due to anatomical constraints
      • A{right arrow over (ab)} refers to the vector from point a to b expressed in frame {A}.
      • r refers to the bending radius of the pre-curved cannula.
  • w ( a ) = [ I 3 × 3 [ - ( a ) × ] 0 3 × 3 I 3 × 3 ]
      • refers to the twist transformation operator. This operator can be defined as a unction of the translation of the origin of the coordinate system indicated by vector {right arrow over (a)}. W can be a 6×6 upper triangular matrix with the diagonal elements being a 3×3 unity matrix
  • [ 100 010 001 ]
      • and the upper right 3×3 block being a cross product matrix and the lower left 3×3 block being all zeros.
  • In some embodiments, the kinematic modeling of the system includes the kinematic constraints due to the incision points in the eye and the limited degrees of freedom of the eye. Below, the kinematics of a two-armed robot with the eye are described, while describing the relative kinematics of a serial robot end effector with respect to a target point on the retina.
  • The Jacobian of the parallel robot platform, relating the twist of the moving platform frame {Pi} to the joint speeds {dot over (q)}P i can be given by:

  • JP i {dot over (x)}P i ={dot over (q)}P i   (1)
  • Developing the next step in the kinematic chain of the ith hybrid robot, to {Qi}, the linear and angular velocities can be expressed with respect to the respective velocities of the moving platform:

  • v Q i =v P i P i ×({right arrow over (p i q i)})   (2)

  • ωQ i P i   (3)
  • Writing equations (2) and (3) in matrix form results in the twist of the distal end of the adjustable lockable link:

  • {dot over (x)}Q i =Ai{dot over (x)}P i   (4)
  • where Ai=W({right arrow over (piqi)}) can be the twist transformation matrix.
  • The kinematic relationship of the frame {Ni} can be similarly related to {Qi} by combining the linear and angular velocities. The linear and angular velocities are:

  • v N i =v Q i Q i ×({right arrow over (q i n i)})   (5)

  • ωN i Q i +{dot over (q)} s i 1 {circumflex over (z)} Q i   (6)
  • Equations 5 and 6 expressed in matrix form yield:
  • x . N i = B i x . Q i + [ 0 z ^ Q i ] q . s i 1 ( 7 )
  • where Bi=W({right arrow over (qini)}).
  • Continuing to the final serial frame in the hybrid robot, {Gi}, the linear and angular velocities can be written as

  • v G i =v N i +{dot over (q)}s i 2 r{circumflex over (z)}G i N i×({right arrow over (n i g i)})   (8)

  • ωG i N i +{dot over (q)} s i 2 ŷ N i   (9)
  • Equations 8 and 9 expressed in matrix form yield:
  • x . G i = C i x . N i + [ r z ^ G i y ^ N i ] q . s i 2 ( 10 )
  • where Ci=W({right arrow over (nigi)}).
  • To express the kinematics of the frame of the robot end effector, {Gi}, as a function of the joint parameters of the ith hybrid robotic system, the serial relationships developed above can be combined. Beginning with the relationship between the twist of frame {Gi} and {Ni} and inserting the relationship between {Ni} and {Qi} yields:
  • x . G i = C i B i x . Q i + C i [ 0 z ^ Q i ] q . s i 1 + [ r z ^ G i y ^ N i ] q . s i 2 ( 11 )
  • Further, by reintroducing the matrix Ci to the {dot over (q)}s,1 term, the serial joints of the hybrid system can be parameterized as follows:

  • {dot over (x)} G i =C i B i {dot over (x)} Q i +J s x {dot over (q)} s i   (12)
  • where
  • J s i = [ [ ( - n i g i ) × ] z ^ Q i r z ^ G i z ^ Q i y ^ N i ]
  • represents the Jacobian of the serial robot including the speeds of rotation about the axis of the serial robot cannula and the bending of the pre-curved cannula.
  • Inserting the relationship between {Qi} and {Pi} and the inverse of the Stewart Jacobian equation (1), and condensing terms yields the final Jacobian for the ith hybrid robot yields:

  • {dot over (x)}G i =J h i {dot over (q)}h i   (13)
  • where Jh i =└CiBiAiJP i −1, Js i ┘.
  • The eye can be modeled as a rigid body constrained to spherical motion by the geometry of the orbit and musculature. Roll-Pitch-Yaw angles (α,β,γ) can be chosen to describe the orientation of the eye such that the rotation matrix wRe specifies the eye frame {E} with respect to {W} as WRe=RzRyRx where Rx=Rot({circumflex over (x)}W,α), Ry=Rot(ŷW,β), and Rz=Rot({circumflex over (z)}W,γ).
  • The angular velocity of the eye can be parameterized by:

  • {dot over (x)}e=[{dot over (α)},{dot over (β)},{dot over (γ)}]t   (4)
  • The kinematics of the end effector with respect to the eye can also be modeled. For example, with the kinematics of the eye and the ith hybrid robotic system characterized separately, the formulations can be combined to define the kinematic structure of the eye and ith hybrid robot. This relationship can allow expression of the robot joint parameters based on the desired velocity of the end effector with respect to the eye and the desired angular velocity of the eye. To achieve this relationship, an arbitrary goal point on the retinal surface ti can be chosen. The angular velocity of the eye imparts a velocity at point ti

  • vt i =Ti{dot over (x)}e   (15)
  • where end effector Ti=└(−{right arrow over (et)}i)×┘
  • The linear velocity of the end effector frame of the robot with respect to the goal point ti can be written as:

  • v g i /t i =v g i −v t i   (16)
  • Inserting equations (13) and equations (15) into equation (16) yields a linear velocity of the end effector as a function of the robot joint speeds and the desired eye velocity

  • v g t /t i =[I 3×3,03×3 ]J h i {dot over (q)} h i −T i {dot over (x)} e   (17)
  • Similarly, the angular velocity of the end effector frame of the robot with respect to the eye frame can be written as:

  • ωg t /eg i −ωe   (18)
  • or, by inserting equation (13) and equation (15) into equation (18) yielding

  • ωg i /e=[03×3 ,I 3×3 ]J h i {dot over (q)} h i −{dot over (x)} e   (19)
  • further combining the linear equation (17) and angular equation (19) velocities yields the twist of the end effector with respect to point ti:

  • {dot over (x)} g i /t i =J h i {dot over (q)} h i −D i {dot over (x)} e   (20)
  • where Di=[Ti t,I3×3]t.
  • In some embodiments, the mechanical structure of the hybrid robot in the eye (e.g., vitreous cavity) allows only five degrees of freedom as independent rotation about the {circumflex over (z)}G i axis can be unachievable. This rotation can be easily represented by the third w-v-w Euler angle φi. It should be noted that the first angle φi represents the rotation between the projection of the {circumflex over (z)}G i axis on the {circumflex over (x)}WŷW plane and {circumflex over (x)}W and the second angle θi represents rotation between {circumflex over (z)}W and {circumflex over (z)}G i .
  • The system can utilize path planning and path control. For example, path planning and path control can be used to ease the surgery by having the tele-robotic master controller automatically perform some of the movements for the slave hybrid-robot. For the purposes of path planning and control, the twist of the system can therefore be parameterized with w-v-w Euler angles and the third Euler angle eliminated by a degenerate matrix Ki defined as follows:

  • {dot over ({tilde over (x)} g i /t i =K i {dot over (x)} g i /t i   (21)
  • Inserting this new parameterization into the end effector twist yields a relation between the achievable independent velocities and the joint parameters of the hybrid system.

  • Figure US20100010504A1-20100114-P00001
    +K i D i {dot over (x)} e =K i J h i {dot over (q)} h i   (22)
  • The robotic system can be constrained such that the hybrid robots move in concert (e.g., move substantially together) to control the eye without injuring the structure by tearing the insertion points. This motion can be achieved by allowing each insertion arm to move at the insertion point only with the velocity equal to the eye surface at that point, plus any velocity along the insertion needle. This combined motion constrains the insertion needle to the insertion point without damage to the structure.
  • To assist in the development of the aforementioned constraint, point mi can be defined at the insertion point on the scleral surface of the eye and m′i can be defined as point on the insertion needle instantaneously coincident with mi. To meet the above constraint, the velocity of mi must be equal to the velocity of point mi in the plane perpendicular to the needle axis:

  • vm′ i =vm i   (23)
  • Taking a dot product in the directions, {circumflex over (x)}Q i and ŷQ i yields two independent constraint equations:

  • {circumflex over (x)}Q i tvm′ i ={circumflex over (x)}Q i tvm i   (24)

  • ŷQ i tvm′ i Q i tvm i   (25)
  • These constraints can be expressed in terms of the joint angles by relating the velocities of point mi and m′i to the robot coordinate systems. The velocity of point m; can be related to the velocity of frame {Qi} as follows:

  • v m′ i =v Q i Q i ×{right arrow over (q i m)}i   (26)
  • By substituting the twist of frame {Qi}, the above equation becomes:

  • v m′ i =[I 3×3, 03×3 ]{dot over (x)} Q i +E i[03×3 , I 3×3 ]{dot over (x)} Q i   (27)
  • where Ei=[{right arrow over (qimi)}×].
  • Inserting equations (4) and (1) and writing in terms of the hybrid joint parameters {dot over (q)}h i yields:

  • vm′ i =Fi{dot over (q)}h i   (28)
  • where Fi=([I3×3,03×3]−Ei[03×3,I3×3])AiJP i −1[I6×6,06×2].
  • An expression for the velocity of the insertion point mi can be related to the desired eye velocity, similar to the derivation of velocity of point ti, yielding:

  • vm i =Mi{dot over (x)}e   (29)
  • where Mi=└(−{right arrow over (emi)})×┘.
  • Substituting equation (28) and equation (29) into equation (24) and equation (25) yields the final constraint equations given for the rigid body motion of the eye-robot system:

  • {circumflex over (x)}Q i tFi{dot over (q)}h i ={circumflex over (x)}Q i tMi{circumflex over (x)}e   (30)

  • ŷQ i tFi{dot over (q)}h i Q i tMi{dot over (x)}e   (31)
  • Combining these constraints with the twist of the hybrid systems for indices 1 and 2, yields the desired expression of the overall eye-robotic system relating the hybrid robotic joint parameters to the desired end effector twists and the desired eye velocity.
  • [ K 1 J h 1 0 5 × 8 0 5 × 8 K 2 J h 2 G 1 F 1 0 2 × 8 0 2 × 8 G 2 F 2 ] [ q . h 1 q . h 2 ] = [ I 5 × 5 0 5 × 5 K 1 D 1 0 5 × 5 I 5 × 5 K 2 D 2 0 2 × 5 0 2 × 5 G 1 M 1 0 2 × 5 0 2 × 5 G 2 M 2 ] [ x . g 1 / t 1 x . g 2 / t 2 x . e ] ( 32 )
  • where Gi=[{circumflex over (x)}O 1 O 1 ]
  • Referring to FIG. 10A-10B, an organ and the ith hybrid robotic arm is displayed. The organ is enlarged (FIG. 10A) for a clearer view of the end effector and the organ coordinate frames. FIG. 10B illustratively displays an enlarged view of the end effector. The following coordinate systems are defined to assist in the derivation of the system kinematics. The world coordinate system {W} (having coordinates {circumflex over (x)}W, ŷW, {circumflex over (z)}W) can be centered at an arbitrarily predetermined point in the patient's forehead with the patient in a supine position. The {circumflex over (z)}W axis points vertically and ŷW axis points superiorly. The parallel robot base coordinate system {Bi} (having coordinates {circumflex over (x)}B i , ŷB i , {circumflex over (z)}B i ) of the ith hybrid robot can be located at point bi (i.e., the center of the base platform) such that the {circumflex over (z)}B i axis lies perpendicular to the base of the parallel robot platform and the {circumflex over (x)}B i axis lies parallel to {circumflex over (z)}W. The moving platform coordinate system of the ith hybrid robot {Pi} (having coordinates {circumflex over (x)}P i , ŷP i , {circumflex over (z)}P i ) lies in center of the moving platform, at point pi such that the axes lie parallel to {Bi} when the parallel robot platform lies in the home configuration (e.g., the initial setup position). The parallel robot extension arm coordinate system of the ith hybrid {Qi} (having coordinates {circumflex over (x)}Q i , ŷQ i , {circumflex over (z)}Q i ) can be attached to the distal end of the arm at point qi, with {circumflex over (z)}Q i lying along the direction of the insertion needle of the robot {right arrow over (qini)}, and {circumflex over (x)}Q i fixed during setup procedure. The serial robot (e.g., intra-ocular dexterity robot) base coordinate system of the ith hybrid robot {Ni} (having coordinates {circumflex over (x)}N i ŷN i {circumflex over (z)}N i ) lies at point ni with the {circumflex over (z)}N i axis also pointing along the insertion needle length {right arrow over (qini)} and the ŷN i axis rotated from ŷQ i an angle qs i 1 about {circumflex over (z)}N i . The end effector coordinate system {Gi} (having coordinates {circumflex over (x)}G i , ŷG i , {circumflex over (z)}G i ) lies at point gi with the {circumflex over (z)}G i, axis pointing in the direction of the end effector gripper and the ŷG i axis parallel to the ŷN i axis. The organ coordinate system {O} (having coordinates {circumflex over (x)}O, ŷO, {circumflex over (z)}O) sits at the rotating center o of the organ with axes parallel to {W} when the organ can be not actuated by the robot.
  • The additional notations used are defined below:
      • i refers to the index identifying each robotic arm. Further, for unconstrained organs i=1,2,3 while for the eye i=1,2.
      • {A} refers to a right handed coordinate frame with {{circumflex over (x)}AA,{circumflex over (z)}A} as its associated unit vectors and point a as the location of its origin.
      • vC A/B, ωC A/B refers to the relative linear and angular velocities of frame {A} with respect to {B}, expressed in {C}. It will be understood that, unless specifically stated, all vectors displayed below can be expressed in {W}.
      • vAA refers to absolute linear and angular velocities of frame {A}.
      • ARB refers to the rotation matrix of the moving frame {B} with respect to {A}.
      • Rot({circumflex over (x)}A, α) refers to the rotation matrix about unit vector {circumflex over (x)}A by angle α.
      • [b×] refers to the skew symmetric cross product matrix of vector b.
      • {dot over (q)}P i =[{dot over (q)}P i 1,{dot over (q)}P i 2,{dot over (q)}P i 3,{dot over (q)}P i 4,{dot over (q)}P i 5,{dot over (q)}P i 6]t refers to the active joint speeds of the ith parallel robot platform.
      • {dot over (q)}s i =[{dot over (q)}s i 1,{dot over (q)}s i 2]t refers to the joint speeds of the ith serial robot (e.g., intra-ocular dexterity robot). The first component can be the rotation speed about the axis of the serial robot (e.g., intra-ocular dexterity robot) tube, and the second component can be the bending angular rate of the pre-shaped cannula.
      • {dot over (x)}A, {dot over (x)}P i , {dot over (x)}o refers to the twists of frame {A}, of the ith parallel robot moving platform, and of the organ.
      • A{right arrow over (ab)} refers to the vector from point a to b expressed in frame {A}.
      • Ls refers to the bending radius of the pre-bent cannula of the serial robot (e.g., intra-ocular dexterity robot).
  • w ( a ) = [ I 3 × 3 [ - ( a ) × ] 0 3 × 3 I 3 × 3 ]
      • refers to the twist transformation operator. This operator can be defined as a function of the translation of the origin of the coordinate system indicated by vector {dot over (a)}. W can be a 6×6 upper triangular matrix with the
  • [ 100 010 001 ]
      • diagonal elements being a 3×3 unity matrix and the upper right 3×3 block being a cross product matrix and the lower left 3×3 block being all zeros.
  • In some embodiments, the kinematic modeling of the system can include the kinematic constraints of the incision points on the hollow organ. Below, the kinematics of the triple-armed robot with the organ and describes the relative kinematics of the serial robot (e.g., intra-ocular dexterity robot) end effector with respect to a target point on the organ.
  • The Jacobian of the parallel robot platform relating the twist of the moving platform frame {dot over (x)}p i to the joint parameters, {dot over (q)}p i is shown in equation 33. Further, the overall hybrid Jacobian matrix for one robotic arm is obtained as equation 34.

  • JP i {dot over (x)} P i ={dot over (q)}P i   (33)

  • {dot over (x)}G i =Jh i {dot over (q)}h i   (34)
  • In some embodiments, modeling can be accomplished by considering the elasticity and surrounding anatomy of the organ. Further, in some embodiments, the below analysis does not include the organ elasticity. Further still, a six dimension twist vector can be used to describe the motion of the organ using the following parameterization:

  • {dot over (x)}o=[{dot over (x)}ol t,{dot over (x)}on t]t=[{dot over (x)},{dot over (y)},ż, {dot over (α)},{dot over (β)},{dot over (γ)}]t   (35)
  • where x,y,z,α,β,γ can be linear positions and Roll-Pitch-Yaw angles of the organ, and {dot over (x)}ol and {dot over (x)}on correspond to the linear and angular velocities of the organ respectively.
  • In some embodiments, the Kinematics of the serial robot (e.g., intra-ocular dexterity robot) end effector with respect to the organ can be modeled. Further, in some embodiments, the model can express the desired velocity of the end effector with respect to the organ and the desired velocity of the organ itself, an arbitrary target point ti on the inner surface of the organ can be chosen. The linear and angular velocities of the end effector frame with respect to the target point can be written as:

  • v g i /t i =[I 3×3,03×3 ]J h i {dot over (q)} h i −{dot over (x)} ol −T i {dot over (x)} on   (36)

  • ωg i /o=[03×3 ,I 3×3 ]J h i {dot over (q)} h i −{dot over (x)} on   (37)
  • Further, combining equation 36 and equation 37 yields the twist of the end effector with respect to point ti:

  • {dot over (x)} g i /t i =J h i {dot over (q)} h i −H i {dot over (x)} o   (38)
  • where Ti=└(−{right arrow over (oti)})×┘ and
  • H i = [ I 3 × 3 T i 0 3 × 3 I 3 × 3 ]
  • The mechanical structure of the hybrid robot in the organ cavity can allow only five degrees of freedom as independent rotation of the serial robot (e.g., intra-ocular dexterity robot) end effector about the {circumflex over (z)}G i axis can be unachievable due to the two degrees of freedom of the serial robot (e.g., intra-ocular dexterity robot). This rotation can be represented by the third w-v-w Euler angle φi. In some embodiments, for the purposes of path planning and control, the twist of the system can be parameterized using w-v-w Euler angles while eliminating the third Euler angle through the use of a degenerate matrix Ki as defined below. Inserting the aforementioned parameterization into the end effector twist, equation 38, yields a relation between the achievable independent velocities and the joint parameters of the hybrid system, equation 40.

  • Figure US20100010504A1-20100114-P00002
    =K i {dot over (x)} g i /t i   (39)

  • Figure US20100010504A1-20100114-P00002
    +K i H i {dot over (x)} o =K i J h i {dot over (q)} h i   (40)
  • In some embodiments, the robotic system can be constrained such that the hybrid arms move synchronously to control the organ without tearing the insertion point. For example, the robotic system can be constrained such that the multitude, na, of hybrid robotic arms moves synchronously to control the organ without tearing the insertion points. The ith incision point on the organ be designated by point mi, i=1,2,3 . . . na. The corresponding point, which can be on the serial robot (e.g., intra-ocular dexterity robot) cannula of the ith robotic arm and instantaneously coincident with mi, be designated by m′i, i=1,2,3 . . . na. In some embodiments, to prevent damage to the anatomy, an equality constraint must be imposed between the projections of the linear velocities of mi and m′i on a plane perpendicular to the longitudinal axis of the ith serial robot (e.g., intra-ocular dexterity robot) cannula. These conditions can be given in equation 41 and equation 42 as derived in detail below.

  • {circumflex over (x)} Q i t F i {dot over (q)} h i ={circumflex over (x)} Q i t({dot over (x)} ol +M i {dot over (x)} on), i=1, 2, 3 . . . n a   (41)

  • ŷ Q i t F i {dot over (q)} h i Q i t({dot over (x)} ol +M i {dot over (x)} on), i=1, 2, 3 . . . n a   (42)
  • Equation 41 and equation 42 can constitute 2na scalar equations that provide the conditions for the organ to be constrained by na robotic arms inserted into it through incision points. For the organ to be fully constrained by the robotic arms, equation 41 and equation 42 should have the same rank as the dimension of the organ twist, {dot over (x)}o as constrained by its surrounding anatomy. Further, if the organ is a free-floating organ, then the rank should be six and therefore a minimum of three robotic arms can be necessary to effectively stabilize the organ. Further still, if the organ is constrained from translation (e.g., as for the eye), the required rank can be three and hence the minimum number of arms can be two (e.g., for a dual-arm ophthalmic surgical system).
  • Combining the constraint equations as derived below with the twist of the hybrid robotic arms
    Figure US20100010504A1-20100114-P00002
    for i=1, 2, 3, yields the desired expression of the overall organ-robotic system relating the joint parameters of each hybrid robotic arm to the desired end effector twists and to the organ twist.
  • [ K 1 J h 1 0 5 × 8 0 5 × 8 0 5 × 8 K 2 J h 2 0 5 × 8 0 5 × 8 0 5 × 8 K 3 J h 3 G 1 F 1 0 2 × 8 0 2 × 8 0 2 × 8 G 2 F 2 0 2 × 8 0 2 × 8 0 2 × 8 G 3 F 3 J I ] [ q . h 1 q . h 2 q . h 3 ] = [ I 5 × 5 0 5 × 5 0 5 × 5 K 1 H 1 0 5 × 5 I 5 × 5 0 5 × 5 K 2 H 2 0 5 × 5 0 5 × 5 1 5 × 5 K 3 H 3 0 2 × 5 0 2 × 5 0 2 × 5 G 1 P 1 0 2 × 5 0 2 × 5 0 2 × 5 G 2 P 2 0 2 × 5 0 2 × 5 0 2 × 5 G 3 P 3 J O ] [ x . ~ g 1 / t 1 x . ~ g 2 / t 2 x . ~ g 3 / t 3 x . o ] ( 43 )
  • Considering the contact between fingers (e.g., graspers delivered into an organ) and the payload (e.g., the organ) a differential kinematic relationship can be modeled. Further, multi-arm manipulation can be modeled wherein the relative position between the robotic arms and the organ can be always changing. Further, by separating input joint rates {dot over (q)}h output organ motion rates {dot over (x)}o and relative motion rates
    Figure US20100010504A1-20100114-P00003
    equation 43, the kinematic relationship can be modeled.
  • The robot kinetostatic performance can be evaluated by examining the characteristics of the robot Jacobian matrix. Further, normalization of the Jacobian can be necessary when calculating the singular values of the Jacobian. These singular values can depend on the units of the individual cells of the Jacobian. Inhomogeneity of the units of the Jacobian can stem from the inhomogeneity of the units of its end effector twist and inhomogeneity of the units in joint space (e.g., in cases where not all the joints are of the same type, such as linear or angular). Normalizing the Jacobian matrix requires scaling matrices corresponding to ranges of joint and task-space variables by multiplying the Jacobian for normalization. Further, using the characteristic length to normalize the portion of the Jacobian bearing the unit of length and using a kinematic conditioning index defined as the ratio of the smallest and largest singular value of a normalized Jacobian the performance can be evaluated. Further still, the Jacobian scaling matrix can be found by using a physically meaningful transformation of the end effector twist that would homogenize the units of the transformed twist. The designer can be required to determine the scaling/normalization factors of the Jacobian prior to the calculation of the condition index of the Jacobian. The methodology used relies on the use of individual characteristic lengths for the serial and the parallel portions of each robotic arm.
  • Equations 44-46 specify the units of the individual vectors and submatrices of equation 43. The brackets can be used to designate units of a vector or a matrix, where [m] and [s] denote meters and seconds respectively. The Jacobian matrices Jl and Jo do not possess uniform units and using a single characteristic length to normalize both of them can be not possible because the robotic arms can include both serial and parallel portions. Also, evaluating the performance of the robotic system for different applications can include simultaneously normalizing Jl and Jo rendering the units of all their elements to be unity. Further, this can be achieved through an inspection of the units of these matrices and the physical meaning of each submatrix in equation 43 while relating each matrix block to the kinematics of the parallel robot, or the serial robot (e.g., intra-ocular dexterity robot), or the organ.
  • [ x . ~ g i / t i ] = [ [ m / s ] 1 × 3 , [ 1 / s ] 1 × 2 ] t , [ x . o ] = [ [ m / s ] 1 × 3 [ 1 / s ] 1 × 3 ] t q . h i = [ [ m / s ] 1 × 6 , [ 1 / s ] 1 × 2 ] t ( 44 ) [ G i P i ] = [ [ 1 ] 2 × 3 [ m ] 2 × 3 ] , [ G i F i ] = [ [ 1 ] 2 × 6 [ 0 ] 2 × 2 ] ( 45 ) [ K i H i ] = [ [ 1 ] 3 × 3 [ m ] 3 × 3 [ 0 ] 2 × 3 [ 1 ] 2 × 3 ] , [ K i J h i ] = [ [ 1 ] 3 × 6 [ m ] 3 × 2 [ 1 / m ] 2 × 6 [ 1 ] 2 × 2 ] ( 46 )
  • When the Jacobian matrix JO characterizes the velocities of the rotating organ and the end effector, the matrix can be homogenized using the radius of the organ at the target point as the characteristic length. It can be this radius, as measured with respect to the instantaneous center of rotation that imparts a linear velocity to point ti, as a result of the angular velocity of the organ. The top right nine components of JO given by KiHi i=1,2,3 of equation 43, bear the unit of [m]. Hence, dividing them by the radius of the organ at the target point, Lr can render their units to be unity. The same treatment can be also carried out to the rightmost six components of each matrix block GiPi i=1,2,3, where we divide them by Lr as well.
  • The Jacobian matrix Jl can describe the geometry of both the parallel robot and the serial robot. Further this can be done by using both Lp, the length of the connection link of the parallel robot, {right arrow over (piqi)}, and Ls, the bending radius of the inner bending tube of the serial robot, as characteristic lengths. In some instances, Lp is multiplied by those components in KiJh i bearing the unit of [1/m]. Further, the components in KiJh i that bear the unit of [m] can be divided by Ls. This can result in a normalized input Jacobian Jl that can be dimensionless. Further still, the radius of the moving platform can be used for normalization. Lp can be the scaling factor of the linear velocity at point qi stemming from a unit angular velocity of the moving platform. Similarly, the circular bending cannula of the serial robot can be modeled as a virtual rotary joint, and the bending radius Ls can be used to normalize the components of KiJh i that are related to the serial robot.
  • In some embodiments, the eye can be modeled as a constrained organ allowing only rotational motions about its center. This can be used to produce a simplify model of the twist of the organ as a three dimensional vector as indicated in equation 47. The relative linear and angular velocities of the robot arm end effector with respect to a target point t; on the retina are given by equation 48 and equation 49, which can be combined to yield the relative twist between the end effector of each arm, and the target point, equation 50, where Di=[Ti t,I3×3]t while the five dimensional constrained twist of the serial robot end effector in equation 40 simplifies to equation 51. Further, the overall Jacobian equation for the whole system with the eye simplifies to equation 52.
  • x . e = [ α . , β . , γ . ] t ( 47 ) v g i / t i = [ I 3 × 3 , 0 3 × 3 ] J h i q . h i - T i x . e ( 48 ) ω g i / e = [ 0 3 × 3 , I 3 × 3 ] J h i q . h i - x . e ( 49 ) x . g i / t i = J h i q . h i - D i x . e ( 50 ) x . ~ g i / t i + K i D i x . e = K i J h i q . h i ( 51 ) [ K 1 J h 1 0 5 × 8 0 5 × 8 K 2 J h 2 G 1 F 1 0 2 × 8 0 2 × 8 G 2 F 2 ] M [ q . h 1 q . h 2 ] = [ I 5 × 5 0 5 × 5 0 5 × 5 I 5 × 5 0 2 × 5 0 2 × 5 0 2 × 5 0 2 × 5 N 1 K 1 D 1 K 2 D 2 G 1 M 1 G 2 M 2 N 2 ] N [ x . ~ g 1 / t 1 x . ~ g 2 / t 2 x . e ] ( 52 )
  • In some embodiments, at least four modes of operation can be performed by a robotic system for surgery: intra-organ manipulation and stabilization of the organ; organ manipulation with constrained intra-organ motions (e.g., manipulation of the eye while maintaining the relative position of devices in the eye with respect to a target point inside the eye); organ manipulation with unconstrained intra-organ motion (e.g., eye manipulation regardless of the relative motions between devices in the eye and the eye); and simultaneous organ manipulation and intra-organ operation.
  • Further, each of the aforementioned four modes can be used to provide a dexterity evaluation. For example, intra-organ operation with organ stabilization can be used to examine the intraocular dexterity, a measure of how well this system can perform a specified surgical task inside the eye with one of its two arms. Further, for example, organ manipulation with constrained intra-organ motions can be used to evaluate orbital dexterity, a measure of how well the two arms can grossly manipulate the rotational position of eye, while respecting the kinematic constraints at the incision points and maintaining zero velocity of the grippers with respect to the retina. Still further, for example, organ manipulation with unconstrained intra-organ motion, can be used to evaluate the orbital dexterity without constraints of zero velocity of the grippers with respect to the retina. Still further, for example, simultaneous organ manipulation and intra-organ operation can be used to measure of intra-ocular and orbital dexterity while simultaneously rotating the eye and executing an intra-ocular surgical task.
  • It will be understood that for the analysis below both robotic arms are put to the side of the eyeball. Two incision points can be specified by angles [π/3,π/3]t and [π/3,π]t. The aforementioned four modes of surgical tasks can all be based on this setup.
  • Rewriting equation 52 using matrices M and N, equation 53 can be obtained where {dot over (q)}h=[{dot over (q)}h i t,{dot over (q)}h 2 t]t and
  • x . ~ g / t = [ x . ~ g 1 / t 1 t , x . ~ g 2 / t 2 t ] t .
  • Specifying {dot over (x)}e=0 equation 53 simplifies to equation 54 and its physical meaning can be that the angular velocity of the eye is zero. Equation 54 represents the mathematical model of intra-ocular manipulation while constraining the eye.
  • Similarly, specifying
    Figure US20100010504A1-20100114-P00004
    =0 equation 53 can simplify to equation 55. Physically this signifies that by specifying the relative velocities of the serial robot end effector with respect to the eye to be zero, equation 55 represents the mathematical model of orbital manipulation.
  • M q . h = N 1 x . ~ g / t + N 2 x . e ( 53 ) M q . h = N 1 x . ~ g / t ( 54 ) M q . h = N 2 x . e ( 55 )
  • For intra-organ operation with organ stabilization, two modular configurations can be taken into account. In the first configuration the robotic arms can use standard ophthalmic instruments with no distal dexterity (e.g., a straight cannula capable of rotating about its own longitudinal axis). This yields a seven degree of freedom robotic arm. The Jacobian matrix for a seven degree of freedom robotic arm can be
  • J 7 i = [ B i A i J P i - 1 , 0 3 × 1 z ^ Q i ]
  • as in equation 56 and equation 57. In the second configuration the robotic arms employ the serial robot, therefore a kinematic model can be represented by equation 34. An intra-ocular dexterity evaluation can be used to compare the performance of the system in both these configurations (e.g., with or without the serial robot).
  • The method of using multiple characteristic lengths to normalize the overall Jacobian can be used for the purpose of performance evaluation. For intra-organ operation with organ stabilization, evaluating translational and rotational dexterity separately can be accomplished by investigating the upper and lower three rows of J7 i and Jh i . Equation 56 and equation 58 can give the normalized sub-Jacobians for translational motions of seven degree of freedom and eight degree of freedom robots, while equation 57 and equation 59 can give the normalized sub-Jacobians for rotational motions of seven degree of freedom and eight degree of freedom robots.
  • J 7 DoF_t = [ I 3 × 3 , 0 3 × 3 ] [ B i A i J P i - 1 , 0 3 × 1 z ^ Q i ] [ I 6 × 6 0 6 × 1 0 1 × 6 1 / L s ] ( 56 ) J 7 DoF_r = [ 0 3 × 3 , I 3 × 3 ] [ B i A i J P i - 1 , 0 3 × 1 z ^ Q i ] [ L P I 6 × 6 0 6 × 1 0 1 × 6 1 ] ( 57 ) J 8 DoF_t = [ I 3 × 3 , 0 3 × 3 ] J h i [ I 6 × 6 0 6 × 2 0 2 × 6 I 2 × 2 / L s ] ( 58 ) J 8 DoF_r = [ 0 3 × 3 , I 3 × 3 ] J h i [ L P I 6 × 6 0 6 × 2 0 2 × 6 1 2 × 2 ] ( 59 )
  • Organ manipulation with constrained intra-organ motions can be used to evaluated the orbital dexterity when simultaneously using both arms to rotate the eyeball. The evaluation can be designed to address the medical professionals' need to rotate the eye under the microscope in order to obtain a view of peripheral areas of the retina.
  • The two arms can be predetermined to approach a target point on the retina. The relative position and orientation of the robot end effector with respect to a target point remains constant. The target point on the retina can be selected to be [5π/6, 0]t, defined in the eye and attached coordinate system {E}. Frame {E} can be defined similarly as the organ coordinate system {O} and can represent the relative rotation of the eye with respect to {W}. This can cause the target point to rotate together with the eye during a manipulation.
  • To verify the accuracy of the derivation, a desired rotation velocity of the eye of 10°/sec about the y-axis can be specified and the input joint actuation velocities can be calculated through the inverse of the Jacobian matrix. For rotating the eye by fixing the end effector to a target point two serial robots (e.g., intra-ocular dexterity robots) and the eyeball form a rigid body allowing no relative motion in between. The rates of the serial robot joints can be expected to be zero.
  • For organ manipulation with unconstrained intra-organ motion, there can be no constraint applied on
    Figure US20100010504A1-20100114-P00004
    . Accordingly, it can not be necessary to put limits on the velocities of point gi with respect to a selected target point ti. Further, inserting equation 51 into equation 53 yields:
  • M q . h = N 1 O 1 q . h + N 1 O 2 x . e + N 2 x . e where O 1 = [ K 1 J h 1 0 5 × 8 0 5 × 8 K 2 J h 2 ] and O 2 = [ - K 1 D 1 - K 2 D 2 ] . ( 60 ) ( M - N 1 O 1 ) q . h = ( N 1 O 2 + N 2 ) x . e ( 61 )
  • For simultaneous organ manipulation and intra-organ operation, both arms coordinate to manipulate the eyeball. Further, one arm also operates inside the eye along a specified path. The overall dexterity of the robot utilizing this combined motion can be evaluated. It will be understood that assuming the eye can be rotated about the y-axis by 10°, one arm of the robotic system can scan the retina independently, meaning that there can be a specified relative motion between this arm and the eye. Assuming that the arm inserted through port [π/3, π]t retains fixed in position and orientation with respect to the eye, the arm inserted through port [π/3, π/3]t can coordinate with the previous arm to rotate the eye 10° about the y-axis, but it also scans the retina along the latitude circle θ=5π/6 by 60°.
  • Transforming the linear and angular velocities from the parallel robot platform center to frame {Qi}, results in:

  • v Q i =v P i P i ×({right arrow over (p i q i)})   (62)

  • ωQ i P i   (63)
  • Further, writing equation 62 and equation 63 in matrix form results in the twist of the distal end qi of the connection link:

  • {dot over (x)}Q i =Ai{dot over (x)}P i   (64)
  • where Ai=W({right arrow over (piqi)}) can be the twist transformation matrix.
  • Further, having
  • B i = W ( q i n . i )
  • and Ci=W({right arrow over (nigi)}) the twist of point gi contributed by the parallel robot platform can be calculated. By incorporating the two serial degrees of freedom of the serial robot, the twist of point gi can be obtained:
  • x . G i = C i B i x . Q i + C i [ 0 z ^ Q i ] q . s i 1 + [ r z ^ G i y ^ N i ] q . s i 2 ( 65 )
  • Yielding the Jacobian Js i of the serial robot as:

  • {dot over (x)} G i =C i B i {dot over (x)} Q i +J s i {dot over (q)} s i   (66)
  • where
  • J s i = [ [ ( - n i g i ) × ] z ^ Q i r z ^ G i z ^ Q i y ^ N i ]
  • can include the speeds of rotation about the axis of the serial robot tube and the bending of the pre-curved NiTi cannula. The hybrid Jacobian matrix relating the twist of point gi and all eight inputs of one arm can be obtained as in equation 34 where Jh i =[CiBiAiJP i −1, Js i ] and {dot over (q)}h i =[P i t, {dot over (q)}s i t]t.
  • Further, the 5×1 Euler angle parameterization of the desired ith end effector velocity,
    Figure US20100010504A1-20100114-P00005
    , can be related to the general twist of the ith robot end effector,
    Figure US20100010504A1-20100114-P00006
    by the degenerate matrix Ki. The matrix can be derived using a relationship relating the Cartesian angular velocities to the Euler angle velocities:

  • xyz]t=Ri[{dot over (φ)},{dot over (θ)},{dot over (φ)}]t   (67)
  • where
  • R i = [ 0 - sin ( φ i ) cos ( φ i ) sin ( θ i ) 0 cos ( φ i ) sin ( φ i ) sin ( θ i ) 1 0 cos ( θ i ) ]
  • With the above relationship, the general twist of a system, {dot over (x)}, can be related to the 6×1 Euler angle twist, [{dot over (x)},{dot over (y)},ż,{dot over (φ)},{dot over (θ)},{dot over (φ)}]t, as follows:
  • [ x . , y . , z . , φ . , θ . , φ . ] t = S i x . where S i = [ I 0 0 R i - 1 ] . ( 68 )
  • The 5×1 Euler parameterization used in the aforementioned path planning equation can be derived by applying a 5×6 degenerate matrix to the 6×1 Euler angle twist, as follows:

  • Figure US20100010504A1-20100114-P00007
    =[I5×5,05×1][{dot over (x)},{dot over (y)},ż,{dot over (φ)},{dot over (θ)},{dot over (φ)}]  (69)
  • Substituting the relationship between the generalized and the 6×1 Euler angle twist above yields the Matrix Ki as follows:

  • Figure US20100010504A1-20100114-P00007
    =Ki{dot over (x)}  (70)
  • where Ki=[I5×5,05×1]Si.
  • As specified above, the constraint that each insertion arm moves at the insertion point only with the velocity equal to the velocity of the organ surface at that point plus any velocity along the insertion needle can be derived as follows. To assist in the development of this constraint, point mi can be defined at the insertion point on the surface of the organ and m′i can be defined as point on the insertion needle instantaneously coincident with mi. The velocity of m′i must be equal to the velocity of point mi in the plane perpendicular to the needle axis:

  • vm′ i =vm i   (71)
  • Taking a dot product in the directions {circumflex over (x)}Q i and ŷQ i yields two independent constraint equations:

  • {circumflex over (x)}Q i tvm′ i ={circumflex over (x)}Q i tvm i   (72)

  • ŷQ i tvm′ i Q i tvm i   (73)
  • These constraints can be expressed in terms of the joint angles and organ velocity by relating the velocities of point mi and m′i to the robot and organ coordinate systems. The velocity of point m′i can be related to the velocity of frame {Qi} as

  • v′ m i =v Q i Q i ×{right arrow over (q i m i)}  (74)
  • By substituting the twist of frame {Qi}, equation 74 becomes

  • v′ m i =[I 3×3,03×3 ]{dot over (x)} Q i +E i[03×3 ,I 3×3 ]{dot over (x)} Q i   (75)
  • where Ei=[(−{right arrow over (qimi)})×].
  • Further, inserting equation 64 and equation 33 and writing in terms of the hybrid joint parameters {dot over (q)}h i yields:

  • vm′ i =Fi{dot over (q)}h i   (76)
  • where Fi=(I3×3,03×3+Ei[03×3,I3×3])AiJP i −1[I6×6,06×2].
  • An expression for the velocity of the insertion point m; can be related to the desired organ velocity, yielding:

  • v m i ={dot over (x)} ol +M i {dot over (x)} oa   (77)
  • where Mi=[(−{right arrow over (mi)})×].
  • Further, substituting equation 76 and equation 77 into equation 72 and equation 73 yields the constraint equations given the rigid body motion of the organ-robot system:

  • {circumflex over (x)} Q i t F i {dot over (q)} h i ={circumflex over (x)} Q i t({dot over (x)} ol +M i {dot over (x)} oa)   (78)

  • ŷ Q i t F i {dot over (q)} h i Q i t({dot over (x)} ol +M i {dot over (x)} oa)   (79)
  • Vectors {circumflex over (x)}Q i and ŷQ i can be put in matrix form as Gi=[{circumflex over (Q)} i Q i ]t, and matrix Pi can be used to denote Pi=[I3×3,Mi].
  • Other embodiments, extensions, and modifications of the ideas presented above are comprehended and should be within the reach of one versed in the art upon reviewing the present disclosure. Accordingly, the scope of the disclosed subject matter in its various aspects should not be limited by the examples presented above. The individual aspects of the disclosed subject matter, and the entirety of the disclosed subject matter should be regarded so as to allow for such design modifications and future developments within the scope of the present disclosure. The disclosed subject matter can be limited only by the claims that follow.

Claims (24)

1. A tele-robotic microsurgical system for eye surgery, comprising:
a tele-robotic master and a slave hybrid-robot;
the tele-robotic master having at least two user controlled master slave interfaces;
the slave hybrid-robot having at least two robotic arms attached to a frame releasably attachable to a patient's head; and
wherein the at least two robotic arms each have a serial robot connected to a parallel robot.
2. The system of claim 1, wherein the parallel robot has six degrees of freedom and the serial robot has two degrees of freedom.
3. The system of claim 2, wherein the serial robot comprises one rotational degree of freedom about its longitudinal axis and one degree of freedom bending an end-effector.
4. The system of claim 3, wherein the end-effector comprises a cannula and a tube.
5. The system of claim 4, wherein the cannula is a NiTi cannula that bends in one degree of freedom as it is moves outside of the tube.
6. The system of claim 4, wherein the cannula is a backlash-free superelastic NiTi cannula for providing manipulation inside an eye.
7. The system of claim 5, wherein the NiTi cannula has a structural design for at least one of drug delivery, aspiration, light delivery, and delivery of at least one of micro-grippers, picks, and micro knives.
8. The system of claim 1, wherein the serial robot manipulates and stabilizes the eye while each of the robotic arms moves substantially together.
9. The system of claim 1, wherein the slave hybrid-robot has a structural configuration having at least one of tool replacement, controllable visualization inside the eye, controllable light source, drug delivery, and aspiration.
10. The system of claim 1, wherein the tele-robotic microsurgical system comprises a structure for at least one of intraocular dexeterity, dual arm dexterious manipulations inside the eye, force feedback, controllable lighting, aspiration and drug delivery, and stabilization and manipulation of the eye.
11. The system of claim 1, wherein the frame is releasably attached with at least one of a locking bite-plate and a coronal strap.
12. The system of claim 1, wherein the serial robot is releasably attached to the parallel robot.
13. The system of claim 1, wherein the at least two robotic arms are arranged to at least one of stabilizing and manipulating the eye.
14. The system of claim 1, wherein the at least two robotic arms comprise adjustable structures for adjusting into position at the initial setup of the system.
15. A tele-robotic microsurgical system for eye surgery, comprising:
a frame, a first robotic arm, a second robotic arm, and a tele-robotic master;
the frame being able to be releasably attached to an object to be operated on;
the first robotic arm and second robotic arm each comprise a parallel robot and a serial robot;
the tele-robotic master comprises a master slave user controlled interface; and
the serial robot comprises a tube and a cannula.
16. The system of claim 15, wherein at least one of the tube and cannula apply force on the eye for at least one of stabilizing, positioning, and manipulating the eye.
17. The tube of claim 16, wherein the cannula comprises a pre-bent NiTi cannula, and the cannula extending from the tube.
18. The cannula of claim 17, wherein the cannula is designed for at least one of drug delivery, aspiration, light delivery, and for delivering at least one of microgrippers, picks, and micro knives.
19. The system of claim 17, wherein at least one of the tube and the pre-bent NiTi cannula rotates about their longitudinal axis.
20. A tele-robotic microsurgical system for surgery on a hollow anatomically suspended organ, comprising:
a tele-robotic master and a slave hybrid-robot;
the tele-robotic master comprises at least one user controlled master slave interface;
the slave hybrid-robot comprises at least one robotic arm attached to a frame releasably attachable to a patient; and
the at least one robotic arm comprises a parallel robot and a serial robot.
21. The device of claim 20, wherein the parallel robot comprises a robot having six degrees of freedom and the serial robot comprises a robot having two degrees of freedom.
22. The serial robot of claim 21, further comprises a tube and a NiTi cannula that bends in one degree of freedom as it moves outside of the tube.
23. The serial robot of claim 22, wherein at least one of the tube and cannula rotate about their longitudinal axis.
24. A slave-hybrid robot for surgery on a hollow anatomically suspended organ, comprising:
a frame releasably able to be attached to a patient and at least one robotic arm is releasably attached to the frame;
the at least one robotic arm comprises a parallel robot and a serial robot;
the serial robot comprises a tube for delivering a pre-bent NiTi cannula;
at least one of the tube and the pre-bent NiTi cannula are capable of rotating about their longitudinal axis; and
the pre-bent NiTi cannula bends when extended from the tube.
US12/441,566 2006-09-19 2007-09-19 Systems, devices, and methods for surgery on a hollow anatomically suspended organ Abandoned US20100010504A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/441,566 US20100010504A1 (en) 2006-09-19 2007-09-19 Systems, devices, and methods for surgery on a hollow anatomically suspended organ

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US84568806P 2006-09-19 2006-09-19
US92084807P 2007-03-30 2007-03-30
PCT/US2007/020281 WO2008036304A2 (en) 2006-09-19 2007-09-19 Systems, devices, and methods for surgery on a hollow anatomically suspended organ
US12/441,566 US20100010504A1 (en) 2006-09-19 2007-09-19 Systems, devices, and methods for surgery on a hollow anatomically suspended organ

Publications (1)

Publication Number Publication Date
US20100010504A1 true US20100010504A1 (en) 2010-01-14

Family

ID=39201070

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/441,566 Abandoned US20100010504A1 (en) 2006-09-19 2007-09-19 Systems, devices, and methods for surgery on a hollow anatomically suspended organ

Country Status (8)

Country Link
US (1) US20100010504A1 (en)
EP (1) EP2063777A2 (en)
JP (1) JP2010504151A (en)
KR (1) KR20090057984A (en)
CN (1) CN101998841B (en)
AU (1) AU2007297702B2 (en)
CA (1) CA2663797A1 (en)
WO (1) WO2008036304A2 (en)

Cited By (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090036900A1 (en) * 2007-02-02 2009-02-05 Hansen Medical, Inc. Surgery methods using a robotic instrument system
US20090259122A1 (en) * 2008-04-14 2009-10-15 Blake Timothy Larson Device and method for mri-guided breast interventions
US20100249512A1 (en) * 2009-03-27 2010-09-30 EndoSphere Surgical, Inc. Cannula with integrated camera and illumination
US20110295427A1 (en) * 2010-05-26 2011-12-01 Motzer William P Methods and systems for inspection sensor placement
US8834358B2 (en) 2009-03-27 2014-09-16 EndoSphere Surgical, Inc. Cannula with integrated camera and illumination
US20140364870A1 (en) * 2013-06-11 2014-12-11 Auris Surgical Robotics, Inc. Method, apparatus, and a system for robotic assisted cataract surgery
US20140379038A1 (en) * 2011-09-09 2014-12-25 University Of The West Of England, Bristol System for anatomical reduction of bone fractures
EP2773279A4 (en) * 2011-11-04 2015-08-05 Univ Johns Hopkins Steady hand micromanipulation robot
WO2016040635A1 (en) * 2014-09-11 2016-03-17 Ethicon Endo-Surgery, Inc. Motorized suprachoroidal injection of therapeutic agent
US9333650B2 (en) 2012-05-11 2016-05-10 Vanderbilt University Method and system for contact detection and contact localization along continuum robots
US9539726B2 (en) 2012-04-20 2017-01-10 Vanderbilt University Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots
US9549720B2 (en) 2012-04-20 2017-01-24 Vanderbilt University Robotic device for establishing access channel
US9687303B2 (en) 2012-04-20 2017-06-27 Vanderbilt University Dexterous wrists for surgical intervention
US9772665B2 (en) 2012-10-05 2017-09-26 Analog Devices, Inc. Power switching in a two-wire conductor system
US9875152B2 (en) 2011-10-05 2018-01-23 Analog Devices, Inc. Methods for discovery, configuration, and coordinating data communications between master and slave devices in a communication system
US9946680B2 (en) 2012-10-05 2018-04-17 Analog Devices, Inc. Peripheral device diagnostics and control over a two-wire communication bus
US9956042B2 (en) 2012-01-13 2018-05-01 Vanderbilt University Systems and methods for robot-assisted transurethral exploration and intervention
US10350390B2 (en) 2011-01-20 2019-07-16 Auris Health, Inc. System and method for endoluminal and translumenal therapy
US10639114B2 (en) 2018-08-17 2020-05-05 Auris Health, Inc. Bipolar medical instrument
US10639109B2 (en) 2015-04-01 2020-05-05 Auris Health, Inc. Microsurgical tool for robotic applications
US10639108B2 (en) 2015-10-30 2020-05-05 Auris Health, Inc. Process for percutaneous operations
RU2721485C1 (en) * 2019-12-12 2020-05-19 Ассистирующие Хирургические Технологии (Аст), Лтд Combined manipulator of robotosurgical complex
US10743751B2 (en) 2017-04-07 2020-08-18 Auris Health, Inc. Superelastic medical instrument
US10751140B2 (en) 2018-06-07 2020-08-25 Auris Health, Inc. Robotic medical systems with high force instruments
US10792466B2 (en) 2017-03-28 2020-10-06 Auris Health, Inc. Shaft actuating handle
CN111772919A (en) * 2020-07-22 2020-10-16 宁夏回族自治区第五人民医院(宁夏回族自治区国家矿山医疗救护中心) Drainage device for glaucoma valve filtering bulb part
US10828118B2 (en) 2018-08-15 2020-11-10 Auris Health, Inc. Medical instruments for tissue cauterization
CN112168482A (en) * 2020-08-21 2021-01-05 西安交通大学 Operation mechanism of ophthalmic cornea transplantation operation robot
US10959792B1 (en) 2019-09-26 2021-03-30 Auris Health, Inc. Systems and methods for collision detection and avoidance
US10967504B2 (en) 2017-09-13 2021-04-06 Vanderbilt University Continuum robots with multi-scale motion through equilibrium modulation
US10980669B2 (en) 2013-01-18 2021-04-20 Auris Health, Inc. Method, apparatus and system for a water jet
US10987174B2 (en) 2017-04-07 2021-04-27 Auris Health, Inc. Patient introducer alignment
US11033330B2 (en) 2008-03-06 2021-06-15 Aquabeam, Llc Tissue ablation and cautery with optical energy carried in fluid stream
US11109928B2 (en) 2019-06-28 2021-09-07 Auris Health, Inc. Medical instruments including wrists with hybrid redirect surfaces
US11252316B2 (en) * 2019-12-02 2022-02-15 Adasky, Ltd. System and method for optical alignment and calibration of an infrared camera lens
US11331797B2 (en) * 2016-07-13 2022-05-17 Canon Kabushiki Kaisha Continuum robot, modification method of kinematic model of continuum robot, and control method of continuum robot
US20220156219A1 (en) * 2011-10-05 2022-05-19 Analog Devices, Inc. Two-wire communication systems and applications
US11350964B2 (en) 2007-01-02 2022-06-07 Aquabeam, Llc Minimally invasive treatment device for tissue resection
US11357586B2 (en) 2020-06-30 2022-06-14 Auris Health, Inc. Systems and methods for saturated robotic movement
US11369386B2 (en) 2019-06-27 2022-06-28 Auris Health, Inc. Systems and methods for a medical clip applier
US11382650B2 (en) 2015-10-30 2022-07-12 Auris Health, Inc. Object capture with a basket
US11399905B2 (en) 2018-06-28 2022-08-02 Auris Health, Inc. Medical systems incorporating pulley sharing
WO2022167935A1 (en) * 2021-02-05 2022-08-11 Alcon Inc. Direct drive robot for vitreoretinal surgery
US11439419B2 (en) 2019-12-31 2022-09-13 Auris Health, Inc. Advanced basket drive mode
US11439429B2 (en) 2019-07-11 2022-09-13 New View Surgical Cannula assembly with deployable camera
US20220288306A1 (en) * 2016-03-09 2022-09-15 Gyroscope Therapeutics Limited Apparatus for subretinal administration of therapeutic agent via a curved needle
US11464536B2 (en) 2012-02-29 2022-10-11 Procept Biorobotics Corporation Automated image-guided tissue resection and treatment
US11534248B2 (en) 2019-03-25 2022-12-27 Auris Health, Inc. Systems and methods for medical stapling
US11571229B2 (en) 2015-10-30 2023-02-07 Auris Health, Inc. Basket apparatus
US11576738B2 (en) 2018-10-08 2023-02-14 Auris Health, Inc. Systems and instruments for tissue sealing
US11582372B2 (en) 2019-12-02 2023-02-14 Adasky, Ltd. System and method for lens alignment and bonding
US11589913B2 (en) 2019-01-25 2023-02-28 Auris Health, Inc. Vessel sealer with heating and cooling capabilities
US11642242B2 (en) 2013-08-13 2023-05-09 Auris Health, Inc. Method and apparatus for light energy assisted surgery
US11737835B2 (en) 2019-10-29 2023-08-29 Auris Health, Inc. Braid-reinforced insulation sheath
US11737845B2 (en) 2019-09-30 2023-08-29 Auris Inc. Medical instrument with a capstan
US11793394B2 (en) 2016-12-02 2023-10-24 Vanderbilt University Steerable endoscope with continuum manipulator
US11839969B2 (en) 2020-06-29 2023-12-12 Auris Health, Inc. Systems and methods for detecting contact between a link and an external object
US11864849B2 (en) 2018-09-26 2024-01-09 Auris Health, Inc. Systems and instruments for suction and irrigation
US11896330B2 (en) 2019-08-15 2024-02-13 Auris Health, Inc. Robotic medical system having multiple medical instruments
US11931901B2 (en) 2021-06-23 2024-03-19 Auris Health, Inc. Robotic medical system with collision proximity indicators

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10406026B2 (en) 2008-05-16 2019-09-10 The Johns Hopkins University System and method for macro-micro distal dexterity enhancement in micro-surgery of the eye
JP5228784B2 (en) * 2008-10-15 2013-07-03 株式会社Ihi Manipulator system
US9655681B2 (en) 2010-10-01 2017-05-23 Technische Universiteit Eindhoven Surgical robot, instrument manipulator, combination of an operating table and a surgical robot, and master-slave operating system
NL1037348C2 (en) * 2009-10-02 2011-04-05 Univ Eindhoven Tech Surgical robot, instrument manipulator, combination of an operating table and a surgical robot, and master-slave operating system.
US10219936B2 (en) * 2014-09-11 2019-03-05 Orbit Biomedical Limited Therapeutic agent delivery device with advanceable cannula and needle
CN107550569B (en) * 2017-10-16 2023-08-04 鹰利视医疗科技有限公司 Vertebra minimally invasive robot
RU2692148C1 (en) * 2018-06-22 2019-06-21 Юрий Иванович Колягин Device for diagnosing postural disorders
KR102284388B1 (en) 2019-06-21 2021-08-02 한국과학기술원 Slave device and method for controliing the same
KR102284387B1 (en) 2019-06-21 2021-08-02 한국과학기술원 Surgical system
KR102277148B1 (en) * 2019-06-21 2021-07-14 한국과학기술원 Eye surgery apparatus and method for controlling the same
WO2020256503A2 (en) * 2019-06-21 2020-12-24 한국과학기술원 Slave device and control method therefor, and eye surgery device and control method therefor
WO2023112732A1 (en) * 2021-12-13 2023-06-22 ソニーグループ株式会社 Robot system and coordinate registration method

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410638A (en) * 1993-05-03 1995-04-25 Northwestern University System for positioning a medical instrument within a biotic structure using a micromanipulator
US5550953A (en) * 1994-04-20 1996-08-27 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration On-line method and apparatus for coordinated mobility and manipulation of mobile robots
US5737500A (en) * 1992-03-11 1998-04-07 California Institute Of Technology Mobile dexterous siren degree of freedom robot arm with real-time control system
US6167292A (en) * 1998-06-09 2000-12-26 Integrated Surgical Systems Sa Registering method and apparatus for robotic surgery, and a registering device constituting an application thereof
US6190353B1 (en) * 1995-10-13 2001-02-20 Transvascular, Inc. Methods and apparatus for bypassing arterial obstructions and/or performing other transvascular procedures
US20020013573A1 (en) * 1995-10-27 2002-01-31 William B. Telfair Apparatus and method for tracking and compensating for eye movements
US6363938B2 (en) * 1998-12-22 2002-04-02 Angiotrax, Inc. Methods and apparatus for perfusing tissue and/or stimulating revascularization and tissue growth
US6519860B1 (en) * 2000-10-19 2003-02-18 Sandia Corporation Position feedback control system
US6669719B2 (en) * 1996-12-09 2003-12-30 Microtherapeutics, Inc. Intracranial stent and method of use
US6723106B1 (en) * 1998-11-23 2004-04-20 Microdexterity Systems, Inc. Surgical manipulator
US20040116906A1 (en) * 2002-12-17 2004-06-17 Kenneth Lipow Method and apparatus for controlling a surgical robot to mimic, harmonize and enhance the natural neurophysiological behavior of a surgeon
US20040116832A1 (en) * 2002-06-21 2004-06-17 Curative Medical Devices Gmbh Catheter arrangement
US6788018B1 (en) * 1999-08-03 2004-09-07 Intuitive Surgical, Inc. Ceiling and floor mounted surgical robot set-up arms
US20050154379A1 (en) * 2003-01-31 2005-07-14 Innovatech Surgical, Inc. Adjustable laser probe for use in vitreoretinal surgery
US6989024B2 (en) * 2002-02-28 2006-01-24 Counter Clockwise, Inc. Guidewire loaded stent for delivery through a catheter
US20060095022A1 (en) * 2004-03-05 2006-05-04 Moll Frederic H Methods using a robotic catheter system
US7048745B2 (en) * 1998-12-08 2006-05-23 Intuitive Surgical Surgical robotic tools, data architecture, and use
US20060118119A1 (en) * 2002-08-05 2006-06-08 Michael Berthon-Jones Inextensible headgear and cpap or ventilator mask assembly with same
US7077842B1 (en) * 2001-08-03 2006-07-18 Cosman Jr Eric R Over-the-wire high frequency electrode
US7087049B2 (en) * 1998-11-20 2006-08-08 Intuitive Surgical Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery
US20070144298A1 (en) * 2005-12-27 2007-06-28 Intuitive Surgical Inc. Constraint based control in a minimally invasive surgical apparatus

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7074179B2 (en) * 1992-08-10 2006-07-11 Intuitive Surgical Inc Method and apparatus for performing minimally invasive cardiac procedures
JPH07328015A (en) * 1994-06-14 1995-12-19 Olympus Optical Co Ltd Surgical manipulator system
US6120433A (en) * 1994-09-01 2000-09-19 Olympus Optical Co., Ltd. Surgical manipulator system
US5588430A (en) * 1995-02-14 1996-12-31 University Of Florida Research Foundation, Inc. Repeat fixation for frameless stereotactic procedure
US5784542A (en) * 1995-09-07 1998-07-21 California Institute Of Technology Decoupled six degree-of-freedom teleoperated robot system
AUPN929096A0 (en) * 1996-04-17 1996-05-09 Lions Eye Institute A system for ocular ultramicrosurgery
US5943914A (en) * 1997-03-27 1999-08-31 Sandia Corporation Master-slave micromanipulator apparatus
US20020095175A1 (en) * 1998-02-24 2002-07-18 Brock David L. Flexible instrument
US6233504B1 (en) * 1998-04-16 2001-05-15 California Institute Of Technology Tool actuation and force feedback on robot-assisted microsurgery system
JP4145464B2 (en) * 2000-05-10 2008-09-03 独立行政法人科学技術振興機構 Remote microsurgery system and slave manipulator insertion method.
US8491549B2 (en) * 2001-11-21 2013-07-23 Iscience Interventional Corporation Ophthalmic microsurgical system
CN1190171C (en) * 2003-05-28 2005-02-23 天津大学 Mechanical arm used in microsurgery operation robot
JP2006055273A (en) * 2004-08-18 2006-03-02 Olympus Corp Surgery support system
CN1299650C (en) * 2005-03-11 2007-02-14 天津大学 Micro surgery operation robot control system with force sense
US8986196B2 (en) * 2006-06-13 2015-03-24 Intuitive Surgical Operations, Inc. Minimally invasive surgery instrument assembly with reduced cross section

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5737500A (en) * 1992-03-11 1998-04-07 California Institute Of Technology Mobile dexterous siren degree of freedom robot arm with real-time control system
US5410638A (en) * 1993-05-03 1995-04-25 Northwestern University System for positioning a medical instrument within a biotic structure using a micromanipulator
US5550953A (en) * 1994-04-20 1996-08-27 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration On-line method and apparatus for coordinated mobility and manipulation of mobile robots
US6190353B1 (en) * 1995-10-13 2001-02-20 Transvascular, Inc. Methods and apparatus for bypassing arterial obstructions and/or performing other transvascular procedures
US20020013573A1 (en) * 1995-10-27 2002-01-31 William B. Telfair Apparatus and method for tracking and compensating for eye movements
US6669719B2 (en) * 1996-12-09 2003-12-30 Microtherapeutics, Inc. Intracranial stent and method of use
US6167292A (en) * 1998-06-09 2000-12-26 Integrated Surgical Systems Sa Registering method and apparatus for robotic surgery, and a registering device constituting an application thereof
US7087049B2 (en) * 1998-11-20 2006-08-08 Intuitive Surgical Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery
US6723106B1 (en) * 1998-11-23 2004-04-20 Microdexterity Systems, Inc. Surgical manipulator
US7048745B2 (en) * 1998-12-08 2006-05-23 Intuitive Surgical Surgical robotic tools, data architecture, and use
US6363938B2 (en) * 1998-12-22 2002-04-02 Angiotrax, Inc. Methods and apparatus for perfusing tissue and/or stimulating revascularization and tissue growth
US6788018B1 (en) * 1999-08-03 2004-09-07 Intuitive Surgical, Inc. Ceiling and floor mounted surgical robot set-up arms
US6519860B1 (en) * 2000-10-19 2003-02-18 Sandia Corporation Position feedback control system
US7077842B1 (en) * 2001-08-03 2006-07-18 Cosman Jr Eric R Over-the-wire high frequency electrode
US6989024B2 (en) * 2002-02-28 2006-01-24 Counter Clockwise, Inc. Guidewire loaded stent for delivery through a catheter
US20040116832A1 (en) * 2002-06-21 2004-06-17 Curative Medical Devices Gmbh Catheter arrangement
US20060118119A1 (en) * 2002-08-05 2006-06-08 Michael Berthon-Jones Inextensible headgear and cpap or ventilator mask assembly with same
US20040116906A1 (en) * 2002-12-17 2004-06-17 Kenneth Lipow Method and apparatus for controlling a surgical robot to mimic, harmonize and enhance the natural neurophysiological behavior of a surgeon
US7198630B2 (en) * 2002-12-17 2007-04-03 Kenneth I. Lipow Method and apparatus for controlling a surgical robot to mimic, harmonize and enhance the natural neurophysiological behavior of a surgeon
US20050154379A1 (en) * 2003-01-31 2005-07-14 Innovatech Surgical, Inc. Adjustable laser probe for use in vitreoretinal surgery
US20060095022A1 (en) * 2004-03-05 2006-05-04 Moll Frederic H Methods using a robotic catheter system
US20070144298A1 (en) * 2005-12-27 2007-06-28 Intuitive Surgical Inc. Constraint based control in a minimally invasive surgical apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Cavusoglu et al. "A laparoscopic telesurgical workstation," Robotics and Automation, IEEE Transactions on, vol.15, no.4, pp.728-739, Aug 1999 doi: 10.1109/70.782027. *

Cited By (88)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11350964B2 (en) 2007-01-02 2022-06-07 Aquabeam, Llc Minimally invasive treatment device for tissue resection
US11478269B2 (en) 2007-01-02 2022-10-25 Aquabeam, Llc Minimally invasive methods for multi-fluid tissue ablation
US9566201B2 (en) 2007-02-02 2017-02-14 Hansen Medical, Inc. Mounting support assembly for suspending a medical instrument driver above an operating table
US20090036900A1 (en) * 2007-02-02 2009-02-05 Hansen Medical, Inc. Surgery methods using a robotic instrument system
US11033330B2 (en) 2008-03-06 2021-06-15 Aquabeam, Llc Tissue ablation and cautery with optical energy carried in fluid stream
US11759258B2 (en) 2008-03-06 2023-09-19 Aquabeam, Llc Controlled ablation with laser energy
US11172986B2 (en) 2008-03-06 2021-11-16 Aquabeam Llc Ablation with energy carried in fluid stream
US20090259122A1 (en) * 2008-04-14 2009-10-15 Blake Timothy Larson Device and method for mri-guided breast interventions
US8909319B2 (en) * 2008-04-14 2014-12-09 Mri Robotics Llc Device and method for MRI-guided breast interventions
US8439830B2 (en) 2009-03-27 2013-05-14 EndoSphere Surgical, Inc. Cannula with integrated camera and illumination
US8834358B2 (en) 2009-03-27 2014-09-16 EndoSphere Surgical, Inc. Cannula with integrated camera and illumination
US20100249512A1 (en) * 2009-03-27 2010-09-30 EndoSphere Surgical, Inc. Cannula with integrated camera and illumination
US9149929B2 (en) * 2010-05-26 2015-10-06 The Boeing Company Methods and systems for inspection sensor placement
US20110295427A1 (en) * 2010-05-26 2011-12-01 Motzer William P Methods and systems for inspection sensor placement
US10350390B2 (en) 2011-01-20 2019-07-16 Auris Health, Inc. System and method for endoluminal and translumenal therapy
US20140379038A1 (en) * 2011-09-09 2014-12-25 University Of The West Of England, Bristol System for anatomical reduction of bone fractures
US9875152B2 (en) 2011-10-05 2018-01-23 Analog Devices, Inc. Methods for discovery, configuration, and coordinating data communications between master and slave devices in a communication system
US10311010B2 (en) 2011-10-05 2019-06-04 Analog Devices, Inc. Two-wire communication systems and applications
US20220156219A1 (en) * 2011-10-05 2022-05-19 Analog Devices, Inc. Two-wire communication systems and applications
US11874791B2 (en) * 2011-10-05 2024-01-16 Analog Devices, Inc. Two-wire communication systems and applications
US9946679B2 (en) 2011-10-05 2018-04-17 Analog Devices, Inc. Distributed audio coordination over a two-wire communication bus
EP2773279A4 (en) * 2011-11-04 2015-08-05 Univ Johns Hopkins Steady hand micromanipulation robot
US9554865B2 (en) 2011-11-04 2017-01-31 The Johns Hopkins University Steady hand micromanipulation robot
US9956042B2 (en) 2012-01-13 2018-05-01 Vanderbilt University Systems and methods for robot-assisted transurethral exploration and intervention
US11737776B2 (en) 2012-02-29 2023-08-29 Procept Biorobotics Corporation Automated image-guided tissue resection and treatment
US11464536B2 (en) 2012-02-29 2022-10-11 Procept Biorobotics Corporation Automated image-guided tissue resection and treatment
US10500002B2 (en) 2012-04-20 2019-12-10 Vanderbilt University Dexterous wrists
US10300599B2 (en) 2012-04-20 2019-05-28 Vanderbilt University Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots
US9539726B2 (en) 2012-04-20 2017-01-10 Vanderbilt University Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots
US9687303B2 (en) 2012-04-20 2017-06-27 Vanderbilt University Dexterous wrists for surgical intervention
US9549720B2 (en) 2012-04-20 2017-01-24 Vanderbilt University Robotic device for establishing access channel
US9333650B2 (en) 2012-05-11 2016-05-10 Vanderbilt University Method and system for contact detection and contact localization along continuum robots
US9946680B2 (en) 2012-10-05 2018-04-17 Analog Devices, Inc. Peripheral device diagnostics and control over a two-wire communication bus
US9772665B2 (en) 2012-10-05 2017-09-26 Analog Devices, Inc. Power switching in a two-wire conductor system
US10980669B2 (en) 2013-01-18 2021-04-20 Auris Health, Inc. Method, apparatus and system for a water jet
US20140364870A1 (en) * 2013-06-11 2014-12-11 Auris Surgical Robotics, Inc. Method, apparatus, and a system for robotic assisted cataract surgery
US10744035B2 (en) * 2013-06-11 2020-08-18 Auris Health, Inc. Methods for robotic assisted cataract surgery
US11642242B2 (en) 2013-08-13 2023-05-09 Auris Health, Inc. Method and apparatus for light energy assisted surgery
WO2016040635A1 (en) * 2014-09-11 2016-03-17 Ethicon Endo-Surgery, Inc. Motorized suprachoroidal injection of therapeutic agent
CN107249523A (en) * 2014-09-11 2017-10-13 詹森生物科技公司 Injected on the electronic choroid of therapeutic agent
US10064752B2 (en) 2014-09-11 2018-09-04 Orbit Biomedical Limited Motorized suprachoroidal injection of therapeutic agent
US11723730B2 (en) 2015-04-01 2023-08-15 Auris Health, Inc. Microsurgical tool for robotic applications
US10639109B2 (en) 2015-04-01 2020-05-05 Auris Health, Inc. Microsurgical tool for robotic applications
US11571229B2 (en) 2015-10-30 2023-02-07 Auris Health, Inc. Basket apparatus
US11382650B2 (en) 2015-10-30 2022-07-12 Auris Health, Inc. Object capture with a basket
US10639108B2 (en) 2015-10-30 2020-05-05 Auris Health, Inc. Process for percutaneous operations
US11559360B2 (en) 2015-10-30 2023-01-24 Auris Health, Inc. Object removal through a percutaneous suction tube
US11534249B2 (en) 2015-10-30 2022-12-27 Auris Health, Inc. Process for percutaneous operations
US20220288306A1 (en) * 2016-03-09 2022-09-15 Gyroscope Therapeutics Limited Apparatus for subretinal administration of therapeutic agent via a curved needle
US11331797B2 (en) * 2016-07-13 2022-05-17 Canon Kabushiki Kaisha Continuum robot, modification method of kinematic model of continuum robot, and control method of continuum robot
US11793394B2 (en) 2016-12-02 2023-10-24 Vanderbilt University Steerable endoscope with continuum manipulator
US10792466B2 (en) 2017-03-28 2020-10-06 Auris Health, Inc. Shaft actuating handle
US10987174B2 (en) 2017-04-07 2021-04-27 Auris Health, Inc. Patient introducer alignment
US10743751B2 (en) 2017-04-07 2020-08-18 Auris Health, Inc. Superelastic medical instrument
US11897129B2 (en) 2017-09-13 2024-02-13 Vanderbilt University Continuum robots with multi-scale motion through equilibrium modulation
US10967504B2 (en) 2017-09-13 2021-04-06 Vanderbilt University Continuum robots with multi-scale motion through equilibrium modulation
US10751140B2 (en) 2018-06-07 2020-08-25 Auris Health, Inc. Robotic medical systems with high force instruments
US11826117B2 (en) 2018-06-07 2023-11-28 Auris Health, Inc. Robotic medical systems with high force instruments
US11399905B2 (en) 2018-06-28 2022-08-02 Auris Health, Inc. Medical systems incorporating pulley sharing
US10828118B2 (en) 2018-08-15 2020-11-10 Auris Health, Inc. Medical instruments for tissue cauterization
US11896335B2 (en) 2018-08-15 2024-02-13 Auris Health, Inc. Medical instruments for tissue cauterization
US10639114B2 (en) 2018-08-17 2020-05-05 Auris Health, Inc. Bipolar medical instrument
US11857279B2 (en) 2018-08-17 2024-01-02 Auris Health, Inc. Medical instrument with mechanical interlock
US11864849B2 (en) 2018-09-26 2024-01-09 Auris Health, Inc. Systems and instruments for suction and irrigation
US11576738B2 (en) 2018-10-08 2023-02-14 Auris Health, Inc. Systems and instruments for tissue sealing
US11589913B2 (en) 2019-01-25 2023-02-28 Auris Health, Inc. Vessel sealer with heating and cooling capabilities
US11534248B2 (en) 2019-03-25 2022-12-27 Auris Health, Inc. Systems and methods for medical stapling
US11877754B2 (en) 2019-06-27 2024-01-23 Auris Health, Inc. Systems and methods for a medical clip applier
US11369386B2 (en) 2019-06-27 2022-06-28 Auris Health, Inc. Systems and methods for a medical clip applier
US11109928B2 (en) 2019-06-28 2021-09-07 Auris Health, Inc. Medical instruments including wrists with hybrid redirect surfaces
US11439429B2 (en) 2019-07-11 2022-09-13 New View Surgical Cannula assembly with deployable camera
US11896330B2 (en) 2019-08-15 2024-02-13 Auris Health, Inc. Robotic medical system having multiple medical instruments
US10959792B1 (en) 2019-09-26 2021-03-30 Auris Health, Inc. Systems and methods for collision detection and avoidance
US11701187B2 (en) 2019-09-26 2023-07-18 Auris Health, Inc. Systems and methods for collision detection and avoidance
US11737845B2 (en) 2019-09-30 2023-08-29 Auris Inc. Medical instrument with a capstan
US11737835B2 (en) 2019-10-29 2023-08-29 Auris Health, Inc. Braid-reinforced insulation sheath
US11356585B1 (en) 2019-12-02 2022-06-07 Adasky, Ltd. System and method for optical alignment and calibration of an infrared camera lens
US11252316B2 (en) * 2019-12-02 2022-02-15 Adasky, Ltd. System and method for optical alignment and calibration of an infrared camera lens
US11582372B2 (en) 2019-12-02 2023-02-14 Adasky, Ltd. System and method for lens alignment and bonding
WO2021145792A1 (en) * 2019-12-12 2021-07-22 Общество С Ограниченной Ответственностью "Ассистирующие Хирургические Технологии" Combined manipulator for robotic surgical system
RU2721485C1 (en) * 2019-12-12 2020-05-19 Ассистирующие Хирургические Технологии (Аст), Лтд Combined manipulator of robotosurgical complex
US11439419B2 (en) 2019-12-31 2022-09-13 Auris Health, Inc. Advanced basket drive mode
US11839969B2 (en) 2020-06-29 2023-12-12 Auris Health, Inc. Systems and methods for detecting contact between a link and an external object
US11357586B2 (en) 2020-06-30 2022-06-14 Auris Health, Inc. Systems and methods for saturated robotic movement
CN111772919A (en) * 2020-07-22 2020-10-16 宁夏回族自治区第五人民医院(宁夏回族自治区国家矿山医疗救护中心) Drainage device for glaucoma valve filtering bulb part
CN112168482A (en) * 2020-08-21 2021-01-05 西安交通大学 Operation mechanism of ophthalmic cornea transplantation operation robot
WO2022167935A1 (en) * 2021-02-05 2022-08-11 Alcon Inc. Direct drive robot for vitreoretinal surgery
US11931901B2 (en) 2021-06-23 2024-03-19 Auris Health, Inc. Robotic medical system with collision proximity indicators

Also Published As

Publication number Publication date
AU2007297702B2 (en) 2013-04-04
CA2663797A1 (en) 2008-03-27
KR20090057984A (en) 2009-06-08
JP2010504151A (en) 2010-02-12
AU2007297702A1 (en) 2008-03-27
CN101998841A (en) 2011-03-30
WO2008036304A2 (en) 2008-03-27
CN101998841B (en) 2013-04-10
EP2063777A2 (en) 2009-06-03

Similar Documents

Publication Publication Date Title
US20100010504A1 (en) Systems, devices, and methods for surgery on a hollow anatomically suspended organ
US20100331858A1 (en) Systems, devices, and methods for robot-assisted micro-surgical stenting
JP7434246B2 (en) System and method for positioning a manipulator arm by clutching in zero orthogonal space simultaneously with zero space movement
KR102214811B1 (en) Systems and methods for using the null space to emphasize manipulator joint motion anisotropically
CN108143497B (en) System and method for tracking a path using null space
EP2969405B1 (en) Systems for facilitating access to edges of cartesian-coordinate space using the null space
KR102164195B1 (en) System and methods for managing multiple null-space objectives and sli behaviors
KR102167359B1 (en) Systems and methods for commanded reconfiguration of a surgical manipulator using the null-space
Wei et al. Design and theoretical evaluation of micro-surgical manipulators for orbital manipulation and intraocular dexterity
KR20190007505A (en) Computer Assisted Remote Operation Surgical System and Method
Munoz et al. A medical robotic assistant for minimally invasive surgery
Falk et al. Dexterity enhancement in endoscopic surgery by a computer-controlled mechanical wrist
He et al. IRIS: integrated robotic intraocular snake
Wei et al. Performance evaluation for multi-arm manipulation of hollow suspended organs
Lin et al. Biometry-based concentric tubes robot for vitreoretinal surgery
US11457987B2 (en) Manipulator device and therapeutic and diagnostic methods
Mitros et al. Optic nerve sheath fenestration with a multi-arm continuum robot
Song et al. Intraocular snake integrated with the steady-hand eye robot for assisted retinal microsurgery
Wang et al. Hybrid-structure hand-held robotic endoscope for sinus surgery with enhanced distal dexterity
Mitros et al. Design and quasistatic modelling of hybrid continuum multi-arm robots
US20230414306A1 (en) Integrated robotic intraocular snake
Dai et al. Eye Robotic System for Vitreoretinal Surgery

Legal Events

Date Code Title Description
AS Assignment

Owner name: THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SIMAAN, NABIL;WEI, WEI;GOLDMAN, ROGER;AND OTHERS;REEL/FRAME:022946/0419;SIGNING DATES FROM 20090616 TO 20090618

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION