US20160192827A1 - Endoscope Comprising a System with Multiple Cameras for Use in Minimal-Invasive Surgery - Google Patents

Endoscope Comprising a System with Multiple Cameras for Use in Minimal-Invasive Surgery Download PDF

Info

Publication number
US20160192827A1
US20160192827A1 US15/066,886 US201615066886A US2016192827A1 US 20160192827 A1 US20160192827 A1 US 20160192827A1 US 201615066886 A US201615066886 A US 201615066886A US 2016192827 A1 US2016192827 A1 US 2016192827A1
Authority
US
United States
Prior art keywords
support device
additional
endoscope
main support
trocar
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/066,886
Inventor
Hubertus von Grünberg
Marcel Seeber
Jens-Uwe Stolzenburg
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Avateramedical GmbH
Original Assignee
Avateramedical GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Avateramedical GmbH filed Critical Avateramedical GmbH
Priority to US15/066,886 priority Critical patent/US20160192827A1/en
Assigned to avateramedical GmBH reassignment avateramedical GmBH ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: STOLZENBURG, JENS-UWE, VON GRUNBERG, HUBERTUS, SEEBER, MARCEL
Assigned to avateramedical GmBH reassignment avateramedical GmBH CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE ADDRESS PREVIOUSLY RECORDED ON REEL 037997 FRAME 0182. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT FROM INVENTORS TO ASSIGNEE. Assignors: STOLZENBURG, JENS-UWE, VON GRUNBERG, HUBERTUS, SEEBER, MARCEL
Publication of US20160192827A1 publication Critical patent/US20160192827A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147Holding or positioning arrangements
    • A61B1/00149Holding or positioning arrangements using articulated arms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00174Optical arrangements characterised by the viewing angles
    • A61B1/00183Optical arrangements characterised by the viewing angles for variable viewing angles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/05Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0661Endoscope light sources
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/313Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/32Devices for opening or enlarging the visual field, e.g. of a tube of the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/30Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00193Optical arrangements adapted for stereoscopic vision
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3417Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
    • A61B17/3421Cannulas
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/371Surgical systems with images on a monitor during operation with simultaneous use of two cameras

Definitions

  • the present invention concerns an endoscope with a multi-camera system for use in minimally invasive surgeries and a respective surgical robot, especially for use in minimally invasive surgery, such as laparoscopy.
  • Minimally invasive surgeries such as laparoscopic operations, are performed with the use of surgical instruments, for example, forceps, cutting and sewing tools, which are inserted into the body of a patient via one or several trocars.
  • surgical instruments for example, forceps, cutting and sewing tools
  • two to four, in most cases three surgical instruments are used.
  • a visualization unit is available which allows the surgeon to observe the area of operation.
  • Such a visualization unit always comprises a camera or an endoscope, which are also inserted into the body of the patient via a trocar.
  • Such visualization is performed by means of an endoscope which represents on an external monitor image of the area of operation in 2D or 3D.
  • Prior art has provided numerous endoscopes in which a visualization unit, for example, a camera, has been integrated in the distal end.
  • a visualization unit for example, a camera
  • an endoscope can be provided with a camera either on its distal or on its proximal end.
  • the images obtained by means of an endoscope are represented on one or several external monitors via an image transmission system and an image processing unit. Numerous endoscopes have been described in prior art.
  • the camera systems or endoscopes described in prior art have the disadvantage that even if two cameras are provided for taking images of the area of operation, it is not possible for these cameras to represent simultaneously in each constellation all surgical instruments due to the varying positions of the surgical instruments and the position of the endoscope near the surgical procedure, as well as the object field angle (FoV “field of view”), wherein merely the immediate area of the surgical procedure is represented.
  • FoV object field angle
  • the invention provides an endoscope, which comprises
  • a main support device which basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device,
  • an additional support device which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device.
  • the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted.
  • each of the two imaging devices can be rotated about a rotation axis at the distal end of the main support device, wherein the rotation axes are aligned in a plane parallel to one another.
  • the additional support device is located between the trocar and the main support device, especially resting directly at the main support device, wherein in particular the main support device and the additional support device have a cylindrical design.
  • each of the imaging devices is arranged in such a way that it can be tilted by means of joints about the rotation axis, as well as about a further pivot axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the rotation axes are decoupled independently of one another.
  • the invention provides a surgical robot system having at least one robotic arm on which at least one surgical instrument and/or one endoscope can be arranged, which comprises
  • a main support device that basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device,
  • an additional support device which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device, wherein provision has been made for an image processing unit, which is connected with the two imaging devices and the additional imaging device, and a visualization unit, which represents 2D image data and/or 3D image data of the imaging devices and/or the additional imaging device.
  • the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted.
  • the two imaging devices are arranged at the distal end of the main support device, respectively, in such a manner that they can be rotated about a rotation axis, wherein the rotation axes are aligned in a plane parallel to one another.
  • the additional support device is located between the trocar and the main support device, especially resting directly at the main support device, wherein in particular the main support device and the additional support device have a cylindrical design.
  • each of the imaging devices is arranged in such a way that it can be tilted by means of joints about the rotation axis, as well as about a further rotation axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the rotation axes are decoupled independently of one another.
  • FIG. 1 is a schematic view of a designated endoscope in a preferred embodiment of a 3D detail camera which is arranged at an invention-based endoscope which is connected with an image processing unit and a visualization unit of a surgical robot system.
  • FIG. 2 is a schematic partial view of a further embodiment of a 3D detail camera with an externally connected light source which is arranged at an invention-based endoscope.
  • FIG. 3 is a schematic partial view of a further, preferred embodiment of a 3D detail camera which can be implemented by means of a reduced number of the mechanical control members arranged at an invention-based endoscope.
  • FIG. 4 is a diagram of a general view of how a visualization solution is used in a surgical robot system for use in minimally invasive surgery, for example, laparoscopy.
  • the invention is therefore based on the objective of providing an improved visualization system for minimally invasive surgeries, such as laparoscopic surgeries, which allows the surgeon to coordinate the instruments in a simple manner using a single trocar to access the body without having to use an additional trocar to access the body. According to the present invention, this objective is achieved by means of the endoscopes and surgical robot systems disclosed herein.
  • the present invention provides an endoscope with a multi-camera system for use in minimally invasive surgery, such as laparoscopy.
  • a first object of the present invention concerns an endoscope for minimally invasive surgery, especially for use within a surgical robot system, which basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device, a trocar by means of which the endoscope can enter the body, and an additional support device, which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device.
  • the present invention has the advantage that by means of providing and simultaneously using 2 imaging systems, an at least 2D overview camera and a 3D detail camera, which are inserted into the body of a patient via a single trocar (also combination trocar), it is possible to generate an at least 2D overview image with a high object field angle (wide angle of typically >) 90° and a 3D detail image with a general object field angle of up to 70°. As a result, it is possible to represent the immediate area of operation and its surrounding area during an entire minimally invasive surgery, such as laparoscopic surgery.
  • such “deposited” surgical elements are captured by the invention-based 2D overview camera and are therefore constantly under visual control of the surgeon or his assistant.
  • the additional imaging device designed as a 2D overview camera and the imaging device designed as 3D detail camera are arranged respectively on an endoscope, for example, in the form of 2 image sensors, the surgeon has no problem to watch the picture recordings of the 2D overview camera and the 3D detail camera via a mutual or separate monitor.
  • the monitoring area of the 2D overview camera which possibly can comprise a 3D lens, encompasses the monitoring area of the 2D detail camera or is larger than the object field angle of the 3D detail camera.
  • the lighting unit at the main support device together with the additional lighting unit at the additional support device improves the illumination of the 3D images, improving the quality of the representation of the images of the 3D detail camera.
  • the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted.
  • each of the two imaging devices can be rotated about a rotation axis at the distal end of the main support device, wherein the rotation axes are aligned in a plane parallel to one another, thus minimizing the constructional expenses.
  • a further structural simplification involves that the additional support device is located between the trocar and the main support device, especially resting directly at the main support device, wherein in particular the main support device and the additional support device have a cylindrical design.
  • each of the imaging devices is arranged in such a way that it can be tilted by means of joints about the rotation axis, as well as about a further rotation axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the pivot axes are decoupled independently of one another.
  • the 3D detail camera can be moved in 4 degrees of freedom independent of the 2D overview camera.
  • the 2D overview camera and the 3D detail camera are connected with one another in 2 degrees of freedom, which represent the movements in x and y direction (pivot movement of the trocar) about the insertion point of the trocar into the body.
  • a second subject matter of the present invention concerns a surgical robot system having at least one robotic arm on which at least one surgical instrument and/or one endoscope for minimally invasive surgery can be arranged, which comprises a main support device that basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device,
  • an additional support device which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device,
  • an image processing unit which is connected with the two imaging devices and the additional imaging device, and a visualization unit, which represents 2D image data and/or 3D image data of the imaging devices and/or the additional imaging device.
  • the invention-based surgical robot system has the advantage that depending on the needs the image data for the surgeon can be represented as 2D image data and/or 3D image data, i.e., the image data of the overview camera can be coupled with the image data of the 3D detail data by means of the image processing unit, providing the surgeon with a considerably improved overview through a single frame sequence on the visualization unit.
  • the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted.
  • the entire disclosure of the present invention refers to the two camera systems, as well as the endoscope encompassing the two camera systems.
  • a trocar usually through the abdominal wall or into the thorax.
  • a surgical instrument or a camera or endoscope can be inserted into the body through such a trocar.
  • a surgical procedure usually involves 2 to 4 surgical instruments and at least one camera. Therefore, 3 to 5 trocars are required for such a surgical procedure.
  • FIG. 1 shows the invention-based multi camera system being integrated in an endoscope.
  • the body of a patient is accessed by inserting a trocar 1 into the body tissue 2 .
  • an additional support device 3 for a 2D overview camera is inserted into the body.
  • the additional support device 3 is designed in such a way that a further rotationally symmetric rod-shaped main support device 4 for a 3D detail camera can be inserted into the tubular device.
  • the tubular device can be used also for surgical instruments.
  • a camera bracket 5 is attached by means of a joint 6 at the additional support device 3 in such a way that the camera bracket can be folded out through a pivot movement 7 basically by 90° to the rotation axis after being inserted into the trocar 1 .
  • the camera bracket 5 comprises an additional image sensor consisting of image sensor 9 and wide-angle lens-imaging optics 8 .
  • the camera bracket 5 is also equipped with an additional lighting unit, consisting of a light source 11 and respective wide-angle imaging optics 10 .
  • These wide-angle imaging optics 10 are designed in such a way that the complete object field captured by the image sensor 9 and the connected wide-angle imaging optics 8 is illuminated.
  • the camera bracket 5 with the additional image sensor and the additional lighting unit form the 2D overview camera for generating a 2D overview image.
  • the image sensor 9 is designed as CCD or CMOS sensor with a resolution of 1920 ⁇ 1080 pixels or higher.
  • the recorded image data are supplied via the data link 23 to a processing unit 25 , which processes the image data for representation, and via a further data link 26 they are supplied to a visualization unit 27 .
  • the visualization unit 27 can represent 2D and 3D image data separately but also combined in a single image or a single frame sequence.
  • a control unit 32 determines which image data is to be represented in what way, depending on the preferences of the surgeon.
  • the rotationally symmetric main support device 4 At the end of the rotationally symmetric main support device 4 are two camera modules or two imaging devices 12 a, 13 a, 14 a, 12 b, 13 b, 14 b consisting in particular of 2 imaging optics 14 a and 14 b, respectively, mounted on two camera brackets 12 a and 12 b. Via the joints 17 a and 17 b which form the pivot axes, the camera brackets 12 a and 12 b are connected with the main support device 4 in such a way that they can be folded out by 90° to the rotation axis of the main support device 4 after being inserted into the body in swivel direction 18 a or 18 b.
  • a lighting unit consisting of light source 15 and imaging optics 16 is mounted at the end of the main support device 4 on which also the foldable camera brackets are attached.
  • the camera brackets 12 a and 12 b comprise image receptors consisting of image sensors 13 a and 13 b and imaging optics 14 a and 14 b. Together these two imaging devices 12 a, 13 a, 14 a, 12 b, 13 b, 14 b form the 3D detail camera.
  • the lighting unit consisting of light source 15 and imaging optics 16 can be designed as LED light source in the way that the radiation angle of the LED combined with appropriate imaging optics 16 is selected in such a way that the object field represented by both image sensors 13 a and 13 b and the associated imaging optics 14 a and 14 b is completely illuminated.
  • the lighting unit at the proximal end can also comprise only imaging optics 16 .
  • the light source 30 is arranged outside the main support device 4 and therefore outside of the patient.
  • the control commands to the light source 30 are transmitted from the processing unit 25 via the data link 31 .
  • the light is fed via a light conductor to an appropriate branch circuit mechanism 28 .
  • said branch circuit mechanism 28 is designed, for example, as optical fiber bundle and conducts the light to the imaging optics 16 .
  • the branch circuit mechanism 28 can be implemented also by means of appropriate rod optics.
  • a camera bracket 12 c is located at the end of the rotationally symmetric main support device 4 .
  • Said camera bracket comprises both imaging devices 13 a, 14 a, 13 b, 14 b, which in particular consist of 2 imaging optics 14 a and 14 b, respectively, and mounted on a camera bracket 12 c.
  • the light source 15 connected with the imaging optics 16 is also mounted on the camera bracket 12 c in the center between the two imaging devices 13 a, 14 a, 13 b, 14 b.
  • the camera bracket 12 c Via a joint 17 c, which forms the swivel axis, the camera bracket 12 c is connected with the main support device 4 in such a way that the camera bracket 12 c can be folded out in a pivot movement 18 c by 90° to the rotation axis of the main support device 4 after being inserted in the body.
  • the joint 17 c is designed in such a way that the camera bracket 12 c can be pivoted in the direction 20 by at least +/ ⁇ 90° about the pivot axis 19 located orthogonally to the rotation axis 21 of the main support device 4 .
  • the recorded image data are supplied via the data link 24 to a processing unit 25 , which processes the image data of the 3D detail camera for stereo representation, and via the data link 26 they are supplied to a visualization unit 27 .
  • the visualization unit 27 can represent 2D and 3D image data.
  • a processing unit 25 controls which image data is to be represented in what way.
  • FIG. 2 shows the folding out movements of the 3D detail camera with regard to the rotation and pivot axis.
  • the joints 17 a and 17 b (see FIG. 1 ) allow the camera brackets 12 a and 12 b to be folded out (see FIG. 1 ) by 90°, starting from the rotation axis 21 of the main support device 4 .
  • joints 17 a and 17 b can allow for a synchronized pivot movement or tilting by approximately +/ ⁇ 90° of the camera brackets 12 a and 12 b about the pivot axis 19 orthogonally to the rotation axis of the main support device 4 . In this way, without changing the position of the main support device 4 , it is possible to record respective 3D images angular to the rotation axis 21 of the main support device 4 .
  • This invention-based synchronous pivot movement of the camera brackets 12 a and 12 b about the pivot axis 19 orthogonally to the rotation axis of the main support device 4 has advantages in comparison to structures of endoscopes known from prior art in which the rotation axis and the optical axis are identical, i.e., a view “with an upward inclination” or “downward inclination” requires the endoscope to be tilted by the respective angle which, in turn, requires sufficient space for movement. This can put a strain on the patient's tissue and even injure the patient. Because of the possibility of pivoting the camera bracket about the pivot axis 19 , the invention-based endoscope does not have to be tilted in the customary manner.
  • endoscopes known from prior art use different lenses with rigid angles, which differ from 0° and typically comprise 30°.
  • the surgeon has to interrupt the surgery, remove the endoscope lens, connect a different lens with the endoscope and again insert the endoscope into the patient by way of the endoscope trocar.
  • the joints 17 a and 17 b allow for an independent, decoupled pivot movement by basically +/ ⁇ 90°, respectively, of the camera brackets 12 a and 12 b about the pivot axis 19 orthogonally to the rotation axis 21 of the main support device 4 .
  • the two 2D images after being transmitted via the data link 24 (see FIG. 1 ) to a processing unit 25 (see FIG. 1 ) the two 2D images are composed in such a way that it is possible to represent on the visualization unit 27 (see FIG. 1 ) a 2D image over a larger object field angle, which is not possible when using customary endoscopes.
  • the processing unit 25 can also calculate a 3D image, which is then represented to the surgeon on the visualization unit 27 as a three-dimensional image.
  • the surgeon is able to comprehend such a three-dimensional image on the visualization unit 27 by means of an optical aid, for example, shutter glasses or polarization glasses.
  • the visualization unit 27 by means of an optical imaging system is designed in such a way that it projects a left image for the left eye and a right image for the right eye, respectively. In this embodiment, it is not required to use additional optical aids, for example, shutter glasses or polarization glasses.
  • the camera bracket 12 c comprises both imaging devices 13 a, 14 a, 13 b, 14 b, as well as the lighting unit consisting of light source 15 and imaging optics 16 . Consequently, pivoting the joint 17 c of the camera bracket basically by +/ ⁇ 90° about the pivot axis 19 located orthogonally to the rotation axis 21 of the main support device 4 has an effect on both imaging devices 13 a, 14 a, 13 b, 14 b, as well as the lighting unit consisting of light source 15 and imaging optics 16 .
  • the imaging optics 16 can be optimally adapted to the object field angle recorded by the imaging devices 13 a, 14 a, 13 b, 14 b, because in this embodiment the lighting unit is pivoting together with the imaging devices.
  • the light source 15 is preferably designed as LED illumination.
  • the position and trajectories of the inserted instruments can be calculated from the data of the 2D overview camera. This information of the trajectories can be shown as additional information when representing in an appropriate manner, for example, as overlay representation, the 3D image on the visualization unit 27 .
  • FIG. 4 shows the exemplary use of the invention-based multi-camera system 43 in a telemanipulator or robot system.
  • the surgeon controls the actuators via a display or control unit 32 .
  • the control commands generated by means of the display and control unit 32 are transmitted to a control unit 34 via data transmission 33 .
  • Said control unit 34 is connected with the robot system 37 via a further data line 35 and, equipped with a support shaft 40 , bowing 42 can be pre-positioned via joint mechanics according to the position of the patient on the OR table 38 in such a way that the robotic arm 44 allows for an optimal position of the multi-camera system 43 .
  • the image data recorded by the 2D overview camera are supplied via the data link 23 to a processing unit 25 , which processes the image data, and via a further data link 26 they are supplied to a visualization unit 27 .
  • the visualization unit 27 can represent 2D and 3D image data, for example separately, but also combined in a single image or a single frame sequence.
  • a control unit 32 determines which image data is to be represented in what way, depending on the preferences of the surgeon.
  • the control commands generated by the control unit 32 are transmitted by means of the data link 39 to the processing unit 25 .
  • two images from different positions of a scene are recorded by two imaging devices 12 a, 13 a, 14 a, 12 b, 13 b, 14 b, which in particular consist of 2 imaging optics 14 a and 14 b, respectively, and which are mounted on 2 camera brackets 12 a and 12 b.
  • the recorded image data are supplied via the data link 24 to a processing unit 25 , which processes the image data of the 3D detail camera for stereo representation, and via the data link 26 they are supplied to a visualization unit 27 .
  • the visualization unit 27 can represent 2D and 3D image data.
  • a control unit 32 determines which image data is to be represented in what way, depending on the preferences of the surgeon.
  • the control commands generated by the control unit 32 are transmitted by means of the data link 39 to the processing unit 25 .
  • Minimally invasive surgery such as laparoscopic surgery, is often performed by means of surgical manipulators, telemanipulators or robot systems.
  • the invention-based endoscopes and cameras can be used in such teelemanipulators or robot systems for minimally invasive surgery, especially for use within a surgical robot system
  • the present invention is not limited to the fact that an invention-based endoscope or invention-based camera is used in a telemanipulator or robot system in order to perform minimally invasive surgery. It can also be used in the medical field apart from such systems.

Abstract

The present invention concerns an endoscope for minimally invasive surgery, especially for use within a surgical robotic system, which comprises a main support device (4), which basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one illumination unit (15, 16) and two imaging devices (12 a, 13 a, 14 a, 12 b, 13 b, 14 b; 12 c), wherein each of the imaging devices (12 a, 13 a, 14 a, 12 b, 13 b, 14 b; 12 c) is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device (4), a trocar (1), by means of which the endoscope can enter the body, and an additional support device (3), which is provided at the trocar (1) and/or the main support device (4), wherein the additional support device (3) comprises at its distal end an additional imaging device (8, 9, 10, 11), which can be rotated from the additional support device (3) to the outside and wherein the additional imaging device (7, 8, 9, 10) comprises an additional illumination unit (10, 11) and at least an additional image sensor (8, 9), which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices (12 a, 13 a, 14 a, 12 b, 13 b, 14 b; 12 c) of the main support device (4).

Description

    CROSS REFERENCE
  • This application is a continuation of U.S. patent application Ser. No. 13/803226 filed Mar. 14, 2013, which claims priority to German Patent Application Serial No. DE 10 2012 025 102.5, filed Dec. 20, 2012, each incorporated by reference herein in its entirety.
  • FIELD OF THE INVENTION
  • The present invention concerns an endoscope with a multi-camera system for use in minimally invasive surgeries and a respective surgical robot, especially for use in minimally invasive surgery, such as laparoscopy.
  • BACKGROUND
  • Minimally invasive surgeries, such as laparoscopic operations, are performed with the use of surgical instruments, for example, forceps, cutting and sewing tools, which are inserted into the body of a patient via one or several trocars. Usually, two to four, in most cases three surgical instruments are used. In addition to these instruments, it is required that a visualization unit is available which allows the surgeon to observe the area of operation. Such a visualization unit always comprises a camera or an endoscope, which are also inserted into the body of the patient via a trocar. Usually such visualization is performed by means of an endoscope which represents on an external monitor image of the area of operation in 2D or 3D. Prior art has provided numerous endoscopes in which a visualization unit, for example, a camera, has been integrated in the distal end. However, an endoscope can be provided with a camera either on its distal or on its proximal end. The images obtained by means of an endoscope are represented on one or several external monitors via an image transmission system and an image processing unit. Numerous endoscopes have been described in prior art.
  • The camera systems or endoscopes described in prior art have the disadvantage that even if two cameras are provided for taking images of the area of operation, it is not possible for these cameras to represent simultaneously in each constellation all surgical instruments due to the varying positions of the surgical instruments and the position of the endoscope near the surgical procedure, as well as the object field angle (FoV “field of view”), wherein merely the immediate area of the surgical procedure is represented. When a surgical instrument is removed from the surgical field of view, it is no longer captured by the camera or cameras and is no longer under the visual control of the surgeon or his assistant.
  • SUMMARY OF THE INVENTION
  • In one aspect, the invention provides an endoscope, which comprises
  • a main support device, which basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device,
  • a trocar, by means of which the endoscope can enter the body, and
  • an additional support device, which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device.
  • In one embodiment, the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted. In another embodiment, each of the two imaging devices can be rotated about a rotation axis at the distal end of the main support device, wherein the rotation axes are aligned in a plane parallel to one another. In a further embodiment, the additional support device is located between the trocar and the main support device, especially resting directly at the main support device, wherein in particular the main support device and the additional support device have a cylindrical design. In another embodiment, each of the imaging devices is arranged in such a way that it can be tilted by means of joints about the rotation axis, as well as about a further pivot axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the rotation axes are decoupled independently of one another.
  • In another aspect, the invention provides a surgical robot system having at least one robotic arm on which at least one surgical instrument and/or one endoscope can be arranged, which comprises
  • a main support device that basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device,
  • a trocar, by means of which the endoscope can enter the body, and
  • an additional support device, which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device, wherein provision has been made for an image processing unit, which is connected with the two imaging devices and the additional imaging device, and a visualization unit, which represents 2D image data and/or 3D image data of the imaging devices and/or the additional imaging device.
  • In one embodiment, the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted. In another embodiment, the two imaging devices are arranged at the distal end of the main support device, respectively, in such a manner that they can be rotated about a rotation axis, wherein the rotation axes are aligned in a plane parallel to one another. In a further embodiment, the additional support device is located between the trocar and the main support device, especially resting directly at the main support device, wherein in particular the main support device and the additional support device have a cylindrical design. In another embodiment, each of the imaging devices is arranged in such a way that it can be tilted by means of joints about the rotation axis, as well as about a further rotation axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the rotation axes are decoupled independently of one another.
  • DESCRIPTION OF THE FIGURES
  • The present invention is explained in more detail by means of the enclosed exemplary figures. It is shown:
  • FIG. 1 is a schematic view of a designated endoscope in a preferred embodiment of a 3D detail camera which is arranged at an invention-based endoscope which is connected with an image processing unit and a visualization unit of a surgical robot system.
  • FIG. 2 is a schematic partial view of a further embodiment of a 3D detail camera with an externally connected light source which is arranged at an invention-based endoscope.
  • FIG. 3 is a schematic partial view of a further, preferred embodiment of a 3D detail camera which can be implemented by means of a reduced number of the mechanical control members arranged at an invention-based endoscope.
  • FIG. 4 is a diagram of a general view of how a visualization solution is used in a surgical robot system for use in minimally invasive surgery, for example, laparoscopy.
  • DETAILED DESCRIPTION OF THE INVENTION
  • The invention is therefore based on the objective of providing an improved visualization system for minimally invasive surgeries, such as laparoscopic surgeries, which allows the surgeon to coordinate the instruments in a simple manner using a single trocar to access the body without having to use an additional trocar to access the body. According to the present invention, this objective is achieved by means of the endoscopes and surgical robot systems disclosed herein.
  • The present invention provides an endoscope with a multi-camera system for use in minimally invasive surgery, such as laparoscopy.
  • A first object of the present invention concerns an endoscope for minimally invasive surgery, especially for use within a surgical robot system, which basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device, a trocar by means of which the endoscope can enter the body, and an additional support device, which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device.
  • The present invention has the advantage that by means of providing and simultaneously using 2 imaging systems, an at least 2D overview camera and a 3D detail camera, which are inserted into the body of a patient via a single trocar (also combination trocar), it is possible to generate an at least 2D overview image with a high object field angle (wide angle of typically >) 90° and a 3D detail image with a general object field angle of up to 70°. As a result, it is possible to represent the immediate area of operation and its surrounding area during an entire minimally invasive surgery, such as laparoscopic surgery. In this way, it is possible to represent all surgical instruments simultaneously even if due to their varying positions and the position of the camera or the endoscope, as well as the object field angle (FoV “field of view”), they are outside of the surgical field of view of both imaging devices at the distal end of the endoscope, because the additional imaging device can also capture instruments which are outside of the surgical field of view of both imaging devices. For example, this can be the case when a surgical instrument is temporarily not needed and “deposited”. In most cases, such “depositing” takes place outside of the immediate surgical procedure and outside of the surgical field of view so that the instruments are not in the way during surgery. According to the invention, such “deposited” surgical elements are captured by the invention-based 2D overview camera and are therefore constantly under visual control of the surgeon or his assistant. Since the additional imaging device designed as a 2D overview camera and the imaging device designed as 3D detail camera are arranged respectively on an endoscope, for example, in the form of 2 image sensors, the surgeon has no problem to watch the picture recordings of the 2D overview camera and the 3D detail camera via a mutual or separate monitor. For the surgeon it is easy to coordinate the images because the monitoring area of the 2D overview camera, which possibly can comprise a 3D lens, encompasses the monitoring area of the 2D detail camera or is larger than the object field angle of the 3D detail camera. In this regard, it should be mentioned that an arrangement of 2 separate cameras, which are positioned completely independent and have an overlapping monitoring area not attached to the endoscope, would result in unfavorable coordination for the surgeon, possibly causing him to become “seasick” because of the two completely independent cameras. This problem is solved in a simple manner by means of the invention-based endoscope with the 2D overview camera and the adjusted 3D detail camera.
  • Furthermore, the lighting unit at the main support device together with the additional lighting unit at the additional support device improves the illumination of the 3D images, improving the quality of the representation of the images of the 3D detail camera.
  • According to a preferred embodiment of the invention, the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted.
  • In particular, it is advantageous when each of the two imaging devices can be rotated about a rotation axis at the distal end of the main support device, wherein the rotation axes are aligned in a plane parallel to one another, thus minimizing the constructional expenses.
  • A further structural simplification involves that the additional support device is located between the trocar and the main support device, especially resting directly at the main support device, wherein in particular the main support device and the additional support device have a cylindrical design.
  • Furthermore, it is advantageous when each of the imaging devices is arranged in such a way that it can be tilted by means of joints about the rotation axis, as well as about a further rotation axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the pivot axes are decoupled independently of one another.
  • Consequently, according to the present invention, it is possible when using only one trocar that the 3D detail camera can be moved in 4 degrees of freedom independent of the 2D overview camera. The 2D overview camera and the 3D detail camera, in turn, are connected with one another in 2 degrees of freedom, which represent the movements in x and y direction (pivot movement of the trocar) about the insertion point of the trocar into the body.
  • A second subject matter of the present invention concerns a surgical robot system having at least one robotic arm on which at least one surgical instrument and/or one endoscope for minimally invasive surgery can be arranged, which comprises a main support device that basically extends over the entire length of the endoscope from the outside to the interior of the body, and which comprises at its distal end at least one lighting unit and two imaging devices, wherein each of the imaging devices is basically arranged in such a way that it can be rotated to the outside on the same level as the main support device,
  • a trocar, by means of which the endoscope can enter the body, and
  • an additional support device, which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end an additional imaging device, which can be rotated from the additional support device to the outside and wherein the additional imaging device comprises an additional lighting unit and at least an additional image sensor, which comprises a monitoring area, which encompasses the two monitoring areas of the imaging devices of the main support device,
  • wherein provision has been made for an image processing unit, which is connected with the two imaging devices and the additional imaging device, and a visualization unit, which represents 2D image data and/or 3D image data of the imaging devices and/or the additional imaging device.
  • In particular, the invention-based surgical robot system has the advantage that depending on the needs the image data for the surgeon can be represented as 2D image data and/or 3D image data, i.e., the image data of the overview camera can be coupled with the image data of the 3D detail data by means of the image processing unit, providing the surgeon with a considerably improved overview through a single frame sequence on the visualization unit.
  • In particular, it is advantageous that the additional image sensor comprises a wide-angle lens which is located near the distal end of the trocar when pivoted.
  • The sub-claims show further advantageous embodiments of the invention. Accordingly, the entire disclosure of the present invention refers to the two camera systems, as well as the endoscope encompassing the two camera systems.
  • In minimally invasive surgery, such as laparoscopic surgery, the body of a patient is accessed via a trocar (usually through the abdominal wall or into the thorax). A surgical instrument or a camera or endoscope can be inserted into the body through such a trocar. As mentioned before, according to the invention, via a trocar two cameras are simultaneously inserted. A surgical procedure usually involves 2 to 4 surgical instruments and at least one camera. Therefore, 3 to 5 trocars are required for such a surgical procedure.
  • Subsequently, the present invention is described with reference to the figures:
  • FIG. 1 shows the invention-based multi camera system being integrated in an endoscope. The body of a patient is accessed by inserting a trocar 1 into the body tissue 2. Via a trocar 1 an additional support device 3 for a 2D overview camera is inserted into the body. The additional support device 3 is designed in such a way that a further rotationally symmetric rod-shaped main support device 4 for a 3D detail camera can be inserted into the tubular device. Alternatively, the tubular device can be used also for surgical instruments. A camera bracket 5 is attached by means of a joint 6 at the additional support device 3 in such a way that the camera bracket can be folded out through a pivot movement 7 basically by 90° to the rotation axis after being inserted into the trocar 1. The camera bracket 5 comprises an additional image sensor consisting of image sensor 9 and wide-angle lens-imaging optics 8. To illuminate the object field, the camera bracket 5 is also equipped with an additional lighting unit, consisting of a light source 11 and respective wide-angle imaging optics 10. These wide-angle imaging optics 10 are designed in such a way that the complete object field captured by the image sensor 9 and the connected wide-angle imaging optics 8 is illuminated. The camera bracket 5 with the additional image sensor and the additional lighting unit form the 2D overview camera for generating a 2D overview image. Preferably, the image sensor 9 is designed as CCD or CMOS sensor with a resolution of 1920×1080 pixels or higher.
  • The recorded image data are supplied via the data link 23 to a processing unit 25, which processes the image data for representation, and via a further data link 26 they are supplied to a visualization unit 27. The visualization unit 27 can represent 2D and 3D image data separately but also combined in a single image or a single frame sequence. A control unit 32 determines which image data is to be represented in what way, depending on the preferences of the surgeon.
  • At the end of the rotationally symmetric main support device 4 are two camera modules or two imaging devices 12 a, 13 a, 14 a, 12 b, 13 b, 14 b consisting in particular of 2 imaging optics 14 a and 14 b, respectively, mounted on two camera brackets 12 a and 12 b. Via the joints 17 a and 17 b which form the pivot axes, the camera brackets 12 a and 12 b are connected with the main support device 4 in such a way that they can be folded out by 90° to the rotation axis of the main support device 4 after being inserted into the body in swivel direction 18 a or 18 b. To illuminate the object field, a lighting unit consisting of light source 15 and imaging optics 16 is mounted at the end of the main support device 4 on which also the foldable camera brackets are attached. Furthermore, the camera brackets 12 a and 12 b comprise image receptors consisting of image sensors 13 a and 13 b and imaging optics 14 a and 14 b. Together these two imaging devices 12 a, 13 a, 14 a, 12 b, 13 b, 14 b form the 3D detail camera.
  • Preferably, the lighting unit consisting of light source 15 and imaging optics 16 can be designed as LED light source in the way that the radiation angle of the LED combined with appropriate imaging optics 16 is selected in such a way that the object field represented by both image sensors 13 a and 13 b and the associated imaging optics 14 a and 14 b is completely illuminated. In a modified embodiment the lighting unit at the proximal end can also comprise only imaging optics 16. In this case, the light source 30 is arranged outside the main support device 4 and therefore outside of the patient. The control commands to the light source 30 are transmitted from the processing unit 25 via the data link 31. Then the light is fed via a light conductor to an appropriate branch circuit mechanism 28. Preferably, said branch circuit mechanism 28 is designed, for example, as optical fiber bundle and conducts the light to the imaging optics 16. In a further embodiment, the branch circuit mechanism 28 can be implemented also by means of appropriate rod optics.
  • In a further embodiment (FIG. 3), a camera bracket 12 c is located at the end of the rotationally symmetric main support device 4. Said camera bracket comprises both imaging devices 13 a, 14 a, 13 b, 14 b, which in particular consist of 2 imaging optics 14 a and 14 b, respectively, and mounted on a camera bracket 12 c. In this arrangement, the light source 15 connected with the imaging optics 16 is also mounted on the camera bracket 12 c in the center between the two imaging devices 13 a, 14 a, 13 b, 14 b. Via a joint 17 c, which forms the swivel axis, the camera bracket 12 c is connected with the main support device 4 in such a way that the camera bracket 12 c can be folded out in a pivot movement 18 c by 90° to the rotation axis of the main support device 4 after being inserted in the body.
  • In addition, the joint 17 c is designed in such a way that the camera bracket 12 c can be pivoted in the direction 20 by at least +/−90° about the pivot axis 19 located orthogonally to the rotation axis 21 of the main support device 4.
  • The recorded image data are supplied via the data link 24 to a processing unit 25, which processes the image data of the 3D detail camera for stereo representation, and via the data link 26 they are supplied to a visualization unit 27. The visualization unit 27 can represent 2D and 3D image data. A processing unit 25 controls which image data is to be represented in what way.
  • FIG. 2 shows the folding out movements of the 3D detail camera with regard to the rotation and pivot axis. The joints 17 a and 17 b (see FIG. 1) allow the camera brackets 12 a and 12 b to be folded out (see FIG. 1) by 90°, starting from the rotation axis 21 of the main support device 4.
  • Furthermore, the joints 17 a and 17 b can allow for a synchronized pivot movement or tilting by approximately +/−90° of the camera brackets 12 a and 12 b about the pivot axis 19 orthogonally to the rotation axis of the main support device 4. In this way, without changing the position of the main support device 4, it is possible to record respective 3D images angular to the rotation axis 21 of the main support device 4.
  • This invention-based synchronous pivot movement of the camera brackets 12 a and 12 b about the pivot axis 19 orthogonally to the rotation axis of the main support device 4 has advantages in comparison to structures of endoscopes known from prior art in which the rotation axis and the optical axis are identical, i.e., a view “with an upward inclination” or “downward inclination” requires the endoscope to be tilted by the respective angle which, in turn, requires sufficient space for movement. This can put a strain on the patient's tissue and even injure the patient. Because of the possibility of pivoting the camera bracket about the pivot axis 19, the invention-based endoscope does not have to be tilted in the customary manner. Alternatively, endoscopes known from prior art use different lenses with rigid angles, which differ from 0° and typically comprise 30°. To change the lenses, the surgeon has to interrupt the surgery, remove the endoscope lens, connect a different lens with the endoscope and again insert the endoscope into the patient by way of the endoscope trocar.
  • Furthermore, the joints 17 a and 17 b allow for an independent, decoupled pivot movement by basically +/−90°, respectively, of the camera brackets 12 a and 12 b about the pivot axis 19 orthogonally to the rotation axis 21 of the main support device 4. In this way, without changing the position of the main support device 4, it is possible to record respective 2D images over a larger object field angle. For this purpose, after being transmitted via the data link 24 (see FIG. 1) to a processing unit 25 (see FIG. 1) the two 2D images are composed in such a way that it is possible to represent on the visualization unit 27 (see FIG. 1) a 2D image over a larger object field angle, which is not possible when using customary endoscopes. If the visualization unit 27 is also suitable for representing 3D images, the processing unit 25 can also calculate a 3D image, which is then represented to the surgeon on the visualization unit 27 as a three-dimensional image. The surgeon is able to comprehend such a three-dimensional image on the visualization unit 27 by means of an optical aid, for example, shutter glasses or polarization glasses. Alternatively, the visualization unit 27 by means of an optical imaging system is designed in such a way that it projects a left image for the left eye and a right image for the right eye, respectively. In this embodiment, it is not required to use additional optical aids, for example, shutter glasses or polarization glasses.
  • In the alternative embodiment according to FIG. 3, the camera bracket 12 c comprises both imaging devices 13 a, 14 a, 13 b, 14 b, as well as the lighting unit consisting of light source 15 and imaging optics 16. Consequently, pivoting the joint 17 c of the camera bracket basically by +/−90° about the pivot axis 19 located orthogonally to the rotation axis 21 of the main support device 4 has an effect on both imaging devices 13 a, 14 a, 13 b, 14 b, as well as the lighting unit consisting of light source 15 and imaging optics 16. In this embodiment it is advantageous that the imaging optics 16 can be optimally adapted to the object field angle recorded by the imaging devices 13 a, 14 a, 13 b, 14 b, because in this embodiment the lighting unit is pivoting together with the imaging devices. In this embodiment, the light source 15 is preferably designed as LED illumination.
  • In the processing unit 25, the position and trajectories of the inserted instruments can be calculated from the data of the 2D overview camera. This information of the trajectories can be shown as additional information when representing in an appropriate manner, for example, as overlay representation, the 3D image on the visualization unit 27.
  • FIG. 4 shows the exemplary use of the invention-based multi-camera system 43 in a telemanipulator or robot system. The surgeon controls the actuators via a display or control unit 32. The control commands generated by means of the display and control unit 32 are transmitted to a control unit 34 via data transmission 33. Said control unit 34 is connected with the robot system 37 via a further data line 35 and, equipped with a support shaft 40, bowing 42 can be pre-positioned via joint mechanics according to the position of the patient on the OR table 38 in such a way that the robotic arm 44 allows for an optimal position of the multi-camera system 43. The image data recorded by the 2D overview camera are supplied via the data link 23 to a processing unit 25, which processes the image data, and via a further data link 26 they are supplied to a visualization unit 27. The visualization unit 27 can represent 2D and 3D image data, for example separately, but also combined in a single image or a single frame sequence. A control unit 32 determines which image data is to be represented in what way, depending on the preferences of the surgeon. The control commands generated by the control unit 32 are transmitted by means of the data link 39 to the processing unit 25.
  • According to FIG. 1, two images from different positions of a scene are recorded by two imaging devices 12 a, 13 a, 14 a, 12 b, 13 b, 14 b, which in particular consist of 2 imaging optics 14 a and 14 b, respectively, and which are mounted on 2 camera brackets 12 a and 12 b. The recorded image data are supplied via the data link 24 to a processing unit 25, which processes the image data of the 3D detail camera for stereo representation, and via the data link 26 they are supplied to a visualization unit 27. The visualization unit 27 can represent 2D and 3D image data. A control unit 32 determines which image data is to be represented in what way, depending on the preferences of the surgeon. The control commands generated by the control unit 32 are transmitted by means of the data link 39 to the processing unit 25. Minimally invasive surgery, such as laparoscopic surgery, is often performed by means of surgical manipulators, telemanipulators or robot systems. The invention-based endoscopes and cameras can be used in such teelemanipulators or robot systems for minimally invasive surgery, especially for use within a surgical robot system
  • The present invention is not limited to the fact that an invention-based endoscope or invention-based camera is used in a telemanipulator or robot system in order to perform minimally invasive surgery. It can also be used in the medical field apart from such systems.

Claims (7)

We claim:
1. Multi-camera system, which comprises
an endoscope or other surgical instrument with a main support device, which basically extends over the entire length of the endoscope,
a trocar, by means of which the endoscope can enter a human body,
and an additional support device, which is provided at the trocar and/or the main support device, wherein the additional support device comprises at its distal end a first imaging device, wherein the first imaging device can be rotated to the outside of the additional support device and wherein the first imaging device comprises a first lighting unit and at least a first image sensor,
wherein the first image sensor comprises a wide-angle lens and is located near a distal end of the trocar when pivoted to generate a 2D overview image, and
wherein the additional support device is located between the trocar and the main support device, resting directly at the main support device, wherein the main support device and the additional support device have a cylindrical design.
2. Multi-camera system according to claim 1, where the system comprises an endoscope, and wherein the endoscope comprises at its distal end at least a second lighting unit and two additional imaging devices, wherein each of the two additional imaging devices are basically arranged in such a way that they can be rotated to the outside of the main support device.
3. Multi-camera system according to claim 2, where the endoscope is characterized in that each of the two additional imaging devices can be rotated about a rotation axis at a distal end of the main support device, wherein the rotation axes are aligned in a plane parallel to one another.
4. Multi-camera system according to claim 2, where the endoscope is characterized in that each of the two additional imaging devices is arranged in such a way that they can be tilted by means of joints about the rotation axis, as well as about a further pivot axis, in orthogonal direction toward the longitudinal extension of the support device, wherein the rotary movements about the rotation axes and the rotation axes are decoupled independently of one another.
5. Multi-camera system according to claim 1, wherein the system comprises a surgical instrument.
6. Multi-camera system according to claim 1, wherein the first imaging device is comprised of a CCD or CMOS sensor with a resolution of 1920××1080 pixels or higher.
7. Multi-camera system of claim 1, wherein the multi-camera system is part of a surgical robot system.
US15/066,886 2012-12-20 2016-03-10 Endoscope Comprising a System with Multiple Cameras for Use in Minimal-Invasive Surgery Abandoned US20160192827A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/066,886 US20160192827A1 (en) 2012-12-20 2016-03-10 Endoscope Comprising a System with Multiple Cameras for Use in Minimal-Invasive Surgery

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE102012025102.5A DE102012025102A1 (en) 2012-12-20 2012-12-20 Endoscope with a multi-camera system for minimally invasive surgery
DE102012025102.5 2012-12-20
US13/803,226 US9307894B2 (en) 2012-12-20 2013-03-14 Endoscope comprising a system with multiple cameras for use in minimal-invasive surgery
US15/066,886 US20160192827A1 (en) 2012-12-20 2016-03-10 Endoscope Comprising a System with Multiple Cameras for Use in Minimal-Invasive Surgery

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/803,226 Continuation US9307894B2 (en) 2012-12-20 2013-03-14 Endoscope comprising a system with multiple cameras for use in minimal-invasive surgery

Publications (1)

Publication Number Publication Date
US20160192827A1 true US20160192827A1 (en) 2016-07-07

Family

ID=50070253

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/803,226 Active 2033-09-18 US9307894B2 (en) 2012-12-20 2013-03-14 Endoscope comprising a system with multiple cameras for use in minimal-invasive surgery
US15/066,886 Abandoned US20160192827A1 (en) 2012-12-20 2016-03-10 Endoscope Comprising a System with Multiple Cameras for Use in Minimal-Invasive Surgery

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/803,226 Active 2033-09-18 US9307894B2 (en) 2012-12-20 2013-03-14 Endoscope comprising a system with multiple cameras for use in minimal-invasive surgery

Country Status (7)

Country Link
US (2) US9307894B2 (en)
EP (1) EP2934279B1 (en)
JP (1) JP6254186B2 (en)
CN (1) CN104902797B (en)
DE (1) DE102012025102A1 (en)
HK (1) HK1213461A1 (en)
WO (1) WO2014094718A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022074661A1 (en) * 2020-10-08 2022-04-14 Med Smart Hub Ltd. Trocar assembly with illumination and imaging
US11602265B2 (en) 2016-03-31 2023-03-14 Sony Corporation Control device, endoscopic imaging device, control method, program, and endoscopic system
USD1022197S1 (en) 2020-11-19 2024-04-09 Auris Health, Inc. Endoscope

Families Citing this family (155)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10092359B2 (en) 2010-10-11 2018-10-09 Ecole Polytechnique Federale De Lausanne Mechanical manipulator for surgical instruments
US9696700B2 (en) 2011-07-27 2017-07-04 Ecole Polytechnique Federale De Lausanne Mechanical teleoperated device for remote manipulation
US11871901B2 (en) 2012-05-20 2024-01-16 Cilag Gmbh International Method for situational awareness for surgical network or surgical network connected device capable of adjusting function based on a sensed situation or usage
US11747895B2 (en) 2013-03-15 2023-09-05 Intuitive Surgical Operations, Inc. Robotic system providing user selectable actions associated with gaze tracking
KR102195714B1 (en) * 2013-05-02 2020-12-28 삼성전자주식회사 Trocar for surgery and method for obtaining image using the same
KR102107402B1 (en) * 2013-05-03 2020-05-07 삼성전자주식회사 Endoscope and image processing apparatus using the endoscope
CN106659540B (en) 2014-02-03 2019-03-05 迪斯塔莫申股份公司 Mechanical remote control operating device including distal end instrument can be exchanged
JP6740131B2 (en) 2014-02-21 2020-08-12 スリーディインテグレイテッド アーペーエス3Dintegrated Aps Set with surgical instrument, surgical system, and training method
US10432922B2 (en) 2014-03-19 2019-10-01 Intuitive Surgical Operations, Inc. Medical devices, systems, and methods using eye gaze tracking for stereo viewer
WO2015143067A1 (en) 2014-03-19 2015-09-24 Intuitive Surgical Operations, Inc. Medical devices, systems, and methods using eye gaze tracking
CA2946595A1 (en) 2014-05-05 2015-11-12 Vicarious Surgical Inc. Virtual reality surgical device
WO2016030767A1 (en) 2014-08-27 2016-03-03 Distalmotion Sa Surgical system for microsurgical techniques
US11504192B2 (en) 2014-10-30 2022-11-22 Cilag Gmbh International Method of hub communication with surgical instrument systems
DK3232951T3 (en) 2014-12-19 2024-01-15 Distalmotion Sa SURGICAL INSTRUMENT WITH ARTICULATED END-EFFECTOR
US10548680B2 (en) 2014-12-19 2020-02-04 Distalmotion Sa Articulated handle for mechanical telemanipulator
EP3232977B1 (en) 2014-12-19 2020-01-29 DistalMotion SA Docking system for mechanical telemanipulator
WO2016097868A1 (en) 2014-12-19 2016-06-23 Distalmotion Sa Reusable surgical instrument for minimally invasive procedures
WO2016097861A1 (en) 2014-12-19 2016-06-23 Distalmotion Sa Sterile interface for articulated surgical instruments
WO2016138128A1 (en) 2015-02-27 2016-09-01 Smith & Nephew, Inc. Expanding endoscope and method
US10363055B2 (en) 2015-04-09 2019-07-30 Distalmotion Sa Articulated hand-held instrument
US10568709B2 (en) 2015-04-09 2020-02-25 Distalmotion Sa Mechanical teleoperated device for remote manipulation
WO2016181404A1 (en) 2015-05-12 2016-11-17 Avraham Levy A dynamic field of view endoscope
DE102015109368A1 (en) * 2015-06-12 2016-12-15 avateramedical GmBH Device and method for robotic surgery and positioning aid
CN108024806B (en) 2015-07-21 2022-07-01 3D集成公司 Cannula assembly kit, trocar assembly kit, sleeve assembly, minimally invasive surgical system and method thereof
US11020144B2 (en) 2015-07-21 2021-06-01 3Dintegrated Aps Minimally invasive surgery system
US10376281B2 (en) * 2016-08-17 2019-08-13 Rebound Therapeutics Corporation Cannula with proximally mounted camera
WO2017037532A1 (en) 2015-08-28 2017-03-09 Distalmotion Sa Surgical instrument with increased actuation force
DK178899B1 (en) 2015-10-09 2017-05-08 3Dintegrated Aps A depiction system
EP3387982B1 (en) * 2015-12-07 2020-09-23 Kyocera Corporation Trocar
JP6654884B2 (en) * 2015-12-11 2020-02-26 川崎重工業株式会社 Surgery system
EP3417332A4 (en) * 2016-02-17 2019-10-30 Invuity, Inc. Systems and methods for illuminating and imaging
KR102488295B1 (en) * 2016-05-23 2023-01-16 마코 서지컬 코포레이션 Systems and methods for identifying and tracking physical objects during robotic surgical procedures
US11058503B2 (en) 2017-05-11 2021-07-13 Distalmotion Sa Translational instrument interface for surgical robot and surgical robot systems comprising the same
EP3668367A4 (en) * 2017-08-16 2021-08-04 Covidien LP Endoscope system
US11583342B2 (en) * 2017-09-14 2023-02-21 Vicarious Surgical Inc. Virtual reality surgical camera system
US11317919B2 (en) 2017-10-30 2022-05-03 Cilag Gmbh International Clip applier comprising a clip crimping system
US11911045B2 (en) 2017-10-30 2024-02-27 Cllag GmbH International Method for operating a powered articulating multi-clip applier
US11406390B2 (en) 2017-10-30 2022-08-09 Cilag Gmbh International Clip applier comprising interchangeable clip reloads
US11129636B2 (en) 2017-10-30 2021-09-28 Cilag Gmbh International Surgical instruments comprising an articulation drive that provides for high articulation angles
US11564756B2 (en) 2017-10-30 2023-01-31 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11291510B2 (en) 2017-10-30 2022-04-05 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11229436B2 (en) 2017-10-30 2022-01-25 Cilag Gmbh International Surgical system comprising a surgical tool and a surgical hub
US11311342B2 (en) 2017-10-30 2022-04-26 Cilag Gmbh International Method for communicating with surgical instrument systems
US11801098B2 (en) 2017-10-30 2023-10-31 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11510741B2 (en) 2017-10-30 2022-11-29 Cilag Gmbh International Method for producing a surgical instrument comprising a smart electrical system
US11744604B2 (en) 2017-12-28 2023-09-05 Cilag Gmbh International Surgical instrument with a hardware-only control circuit
US11109866B2 (en) 2017-12-28 2021-09-07 Cilag Gmbh International Method for circular stapler control algorithm adjustment based on situational awareness
US11432885B2 (en) 2017-12-28 2022-09-06 Cilag Gmbh International Sensing arrangements for robot-assisted surgical platforms
US11659023B2 (en) 2017-12-28 2023-05-23 Cilag Gmbh International Method of hub communication
US11376002B2 (en) 2017-12-28 2022-07-05 Cilag Gmbh International Surgical instrument cartridge sensor assemblies
US11832899B2 (en) 2017-12-28 2023-12-05 Cilag Gmbh International Surgical systems with autonomously adjustable control programs
US11202570B2 (en) 2017-12-28 2021-12-21 Cilag Gmbh International Communication hub and storage device for storing parameters and status of a surgical device to be shared with cloud based analytics systems
US11273001B2 (en) 2017-12-28 2022-03-15 Cilag Gmbh International Surgical hub and modular device response adjustment based on situational awareness
US10932872B2 (en) 2017-12-28 2021-03-02 Ethicon Llc Cloud-based medical analytics for linking of local usage trends with the resource acquisition behaviors of larger data set
US11424027B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Method for operating surgical instrument systems
US11937769B2 (en) 2017-12-28 2024-03-26 Cilag Gmbh International Method of hub communication, processing, storage and display
US11389164B2 (en) 2017-12-28 2022-07-19 Cilag Gmbh International Method of using reinforced flexible circuits with multiple sensors to optimize performance of radio frequency devices
US11419630B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Surgical system distributed processing
US11056244B2 (en) 2017-12-28 2021-07-06 Cilag Gmbh International Automated data scaling, alignment, and organizing based on predefined parameters within surgical networks
US11234756B2 (en) 2017-12-28 2022-02-01 Cilag Gmbh International Powered surgical tool with predefined adjustable control algorithm for controlling end effector parameter
US20190201039A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Situational awareness of electrosurgical systems
US11284936B2 (en) 2017-12-28 2022-03-29 Cilag Gmbh International Surgical instrument having a flexible electrode
US11266468B2 (en) 2017-12-28 2022-03-08 Cilag Gmbh International Cooperative utilization of data derived from secondary sources by intelligent surgical hubs
US11423007B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Adjustment of device control programs based on stratified contextual data in addition to the data
US11100631B2 (en) 2017-12-28 2021-08-24 Cilag Gmbh International Use of laser light and red-green-blue coloration to determine properties of back scattered light
US11633237B2 (en) 2017-12-28 2023-04-25 Cilag Gmbh International Usage and technique analysis of surgeon / staff performance against a baseline to optimize device utilization and performance for both current and future procedures
US11308075B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Surgical network, instrument, and cloud responses based on validation of received dataset and authentication of its source and integrity
US10898622B2 (en) 2017-12-28 2021-01-26 Ethicon Llc Surgical evacuation system with a communication circuit for communication between a filter and a smoke evacuation device
US11147607B2 (en) 2017-12-28 2021-10-19 Cilag Gmbh International Bipolar combination device that automatically adjusts pressure based on energy modality
US11576677B2 (en) 2017-12-28 2023-02-14 Cilag Gmbh International Method of hub communication, processing, display, and cloud analytics
US20190201042A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Determining the state of an ultrasonic electromechanical system according to frequency shift
US11026751B2 (en) 2017-12-28 2021-06-08 Cilag Gmbh International Display of alignment of staple cartridge to prior linear staple line
US11160605B2 (en) 2017-12-28 2021-11-02 Cilag Gmbh International Surgical evacuation sensing and motor control
US11832840B2 (en) 2017-12-28 2023-12-05 Cilag Gmbh International Surgical instrument having a flexible circuit
US10758310B2 (en) 2017-12-28 2020-09-01 Ethicon Llc Wireless pairing of a surgical device with another device within a sterile surgical field based on the usage and situational awareness of devices
US11364075B2 (en) 2017-12-28 2022-06-21 Cilag Gmbh International Radio frequency energy device for delivering combined electrical signals
US11678881B2 (en) 2017-12-28 2023-06-20 Cilag Gmbh International Spatial awareness of surgical hubs in operating rooms
US11096693B2 (en) 2017-12-28 2021-08-24 Cilag Gmbh International Adjustment of staple height of at least one row of staples based on the sensed tissue thickness or force in closing
US11076921B2 (en) 2017-12-28 2021-08-03 Cilag Gmbh International Adaptive control program updates for surgical hubs
US11589888B2 (en) 2017-12-28 2023-02-28 Cilag Gmbh International Method for controlling smart energy devices
US11410259B2 (en) 2017-12-28 2022-08-09 Cilag Gmbh International Adaptive control program updates for surgical devices
US11559308B2 (en) 2017-12-28 2023-01-24 Cilag Gmbh International Method for smart energy device infrastructure
US20190201146A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Safety systems for smart powered surgical stapling
US11464535B2 (en) 2017-12-28 2022-10-11 Cilag Gmbh International Detection of end effector emersion in liquid
US11179208B2 (en) 2017-12-28 2021-11-23 Cilag Gmbh International Cloud-based medical analytics for security and authentication trends and reactive measures
US11324557B2 (en) 2017-12-28 2022-05-10 Cilag Gmbh International Surgical instrument with a sensing array
US10892995B2 (en) 2017-12-28 2021-01-12 Ethicon Llc Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs
US11571234B2 (en) 2017-12-28 2023-02-07 Cilag Gmbh International Temperature control of ultrasonic end effector and control system therefor
US11602393B2 (en) 2017-12-28 2023-03-14 Cilag Gmbh International Surgical evacuation sensing and generator control
US11464559B2 (en) 2017-12-28 2022-10-11 Cilag Gmbh International Estimating state of ultrasonic end effector and control system therefor
US10987178B2 (en) 2017-12-28 2021-04-27 Ethicon Llc Surgical hub control arrangements
US11304720B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Activation of energy devices
US11317937B2 (en) 2018-03-08 2022-05-03 Cilag Gmbh International Determining the state of an ultrasonic end effector
US20190201113A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Controls for robot-assisted surgical platforms
US11069012B2 (en) 2017-12-28 2021-07-20 Cilag Gmbh International Interactive surgical systems with condition handling of devices and data capabilities
US11786245B2 (en) 2017-12-28 2023-10-17 Cilag Gmbh International Surgical systems with prioritized data transmission capabilities
US11844579B2 (en) 2017-12-28 2023-12-19 Cilag Gmbh International Adjustments based on airborne particle properties
US11540855B2 (en) 2017-12-28 2023-01-03 Cilag Gmbh International Controlling activation of an ultrasonic surgical instrument according to the presence of tissue
US11051876B2 (en) 2017-12-28 2021-07-06 Cilag Gmbh International Surgical evacuation flow paths
US11559307B2 (en) 2017-12-28 2023-01-24 Cilag Gmbh International Method of robotic hub communication, detection, and control
US11896322B2 (en) 2017-12-28 2024-02-13 Cilag Gmbh International Sensing the patient position and contact utilizing the mono-polar return pad electrode to provide situational awareness to the hub
US11857152B2 (en) 2017-12-28 2024-01-02 Cilag Gmbh International Surgical hub spatial awareness to determine devices in operating theater
US11529187B2 (en) 2017-12-28 2022-12-20 Cilag Gmbh International Surgical evacuation sensor arrangements
US11304699B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Method for adaptive control schemes for surgical network control and interaction
US11666331B2 (en) 2017-12-28 2023-06-06 Cilag Gmbh International Systems for detecting proximity of surgical end effector to cancerous tissue
US11311306B2 (en) 2017-12-28 2022-04-26 Cilag Gmbh International Surgical systems for detecting end effector tissue distribution irregularities
US11864728B2 (en) 2017-12-28 2024-01-09 Cilag Gmbh International Characterization of tissue irregularities through the use of mono-chromatic light refractivity
US11291495B2 (en) 2017-12-28 2022-04-05 Cilag Gmbh International Interruption of energy due to inadvertent capacitive coupling
US11278281B2 (en) 2017-12-28 2022-03-22 Cilag Gmbh International Interactive surgical system
US11304763B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Image capturing of the areas outside the abdomen to improve placement and control of a surgical device in use
US11304745B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Surgical evacuation sensing and display
US10943454B2 (en) 2017-12-28 2021-03-09 Ethicon Llc Detection and escalation of security responses of surgical instruments to increasing severity threats
US11166772B2 (en) 2017-12-28 2021-11-09 Cilag Gmbh International Surgical hub coordination of control and communication of operating room devices
US11132462B2 (en) 2017-12-28 2021-09-28 Cilag Gmbh International Data stripping method to interrogate patient records and create anonymized record
US11818052B2 (en) 2017-12-28 2023-11-14 Cilag Gmbh International Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs
US11257589B2 (en) 2017-12-28 2022-02-22 Cilag Gmbh International Real-time analysis of comprehensive cost of all instrumentation used in surgery utilizing data fluidity to track instruments through stocking and in-house processes
US11253315B2 (en) 2017-12-28 2022-02-22 Cilag Gmbh International Increasing radio frequency to create pad-less monopolar loop
US10944728B2 (en) 2017-12-28 2021-03-09 Ethicon Llc Interactive surgical systems with encrypted communication capabilities
US11896443B2 (en) 2017-12-28 2024-02-13 Cilag Gmbh International Control of a surgical system through a surgical barrier
US11903601B2 (en) 2017-12-28 2024-02-20 Cilag Gmbh International Surgical instrument comprising a plurality of drive systems
US11786251B2 (en) 2017-12-28 2023-10-17 Cilag Gmbh International Method for adaptive control schemes for surgical network control and interaction
US11446052B2 (en) 2017-12-28 2022-09-20 Cilag Gmbh International Variation of radio frequency and ultrasonic power level in cooperation with varying clamp arm pressure to achieve predefined heat flux or power applied to tissue
US11419667B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Ultrasonic energy device which varies pressure applied by clamp arm to provide threshold control pressure at a cut progression location
US10966791B2 (en) 2017-12-28 2021-04-06 Ethicon Llc Cloud-based medical analytics for medical facility segmented individualization of instrument function
US20190200981A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Method of compressing tissue within a stapling device and simultaneously displaying the location of the tissue within the jaws
US11213359B2 (en) 2017-12-28 2022-01-04 Cilag Gmbh International Controllers for robot-assisted surgical platforms
AU2019218707A1 (en) 2018-02-07 2020-08-13 Distalmotion Sa Surgical robot systems comprising robotic telemanipulators and integrated laparoscopy
CN108652675A (en) * 2018-02-11 2018-10-16 江苏金羿智芯科技有限公司 A kind of endoscopic images defogging system based on artificial intelligence
US11701162B2 (en) 2018-03-08 2023-07-18 Cilag Gmbh International Smart blade application for reusable and disposable devices
US11839396B2 (en) 2018-03-08 2023-12-12 Cilag Gmbh International Fine dissection mode for tissue classification
US11259830B2 (en) 2018-03-08 2022-03-01 Cilag Gmbh International Methods for controlling temperature in ultrasonic device
US11096688B2 (en) 2018-03-28 2021-08-24 Cilag Gmbh International Rotary driven firing members with different anvil and channel engagement features
US11207067B2 (en) 2018-03-28 2021-12-28 Cilag Gmbh International Surgical stapling device with separate rotary driven closure and firing systems and firing member that engages both jaws while firing
US11278280B2 (en) 2018-03-28 2022-03-22 Cilag Gmbh International Surgical instrument comprising a jaw closure lockout
US11129611B2 (en) 2018-03-28 2021-09-28 Cilag Gmbh International Surgical staplers with arrangements for maintaining a firing member thereof in a locked configuration unless a compatible cartridge has been installed therein
US11589865B2 (en) 2018-03-28 2023-02-28 Cilag Gmbh International Methods for controlling a powered surgical stapler that has separate rotary closure and firing systems
US11219453B2 (en) 2018-03-28 2022-01-11 Cilag Gmbh International Surgical stapling devices with cartridge compatible closure and firing lockout arrangements
US10973520B2 (en) 2018-03-28 2021-04-13 Ethicon Llc Surgical staple cartridge with firing member driven camming assembly that has an onboard tissue cutting feature
US11471156B2 (en) 2018-03-28 2022-10-18 Cilag Gmbh International Surgical stapling devices with improved rotary driven closure systems
US11090047B2 (en) 2018-03-28 2021-08-17 Cilag Gmbh International Surgical instrument comprising an adaptive control system
EP3827770A4 (en) * 2018-05-09 2022-08-24 Arroyo Tristan, Andres del Amor Endoscope video camera head which can be attached to a surgical wound protector, without a rigid tube or manual support
US10638921B2 (en) 2018-07-20 2020-05-05 Arthrex, Inc. Medical imaging system
DE102018120696A1 (en) * 2018-08-24 2020-02-27 Karl Storz Se & Co. Kg Endoscope with a movable component
CA3122084A1 (en) * 2018-12-06 2020-06-11 Rebound Therapeutics Corporation A cannula and proximally mounted camera with an imaging control system for rotating images
CN109602381A (en) * 2018-12-27 2019-04-12 上海交通大学医学院附属瑞金医院 A kind of 3D miniature webcam of the interior simulation human eye of modularization body
US11357503B2 (en) 2019-02-19 2022-06-14 Cilag Gmbh International Staple cartridge retainers with frangible retention features and methods of using same
US11369377B2 (en) 2019-02-19 2022-06-28 Cilag Gmbh International Surgical stapling assembly with cartridge based retainer configured to unlock a firing lockout
US11317915B2 (en) 2019-02-19 2022-05-03 Cilag Gmbh International Universal cartridge based key feature that unlocks multiple lockout arrangements in different surgical staplers
US11259807B2 (en) 2019-02-19 2022-03-01 Cilag Gmbh International Staple cartridges with cam surfaces configured to engage primary and secondary portions of a lockout of a surgical stapling device
US11751872B2 (en) 2019-02-19 2023-09-12 Cilag Gmbh International Insertable deactivator element for surgical stapler lockouts
USD964564S1 (en) 2019-06-25 2022-09-20 Cilag Gmbh International Surgical staple cartridge retainer with a closure system authentication key
USD950728S1 (en) 2019-06-25 2022-05-03 Cilag Gmbh International Surgical staple cartridge
USD952144S1 (en) 2019-06-25 2022-05-17 Cilag Gmbh International Surgical staple cartridge retainer with firing system authentication key
US11070762B2 (en) * 2019-10-10 2021-07-20 Titan Medical Inc. Imaging apparatus for use in a robotic surgery system
US11844585B1 (en) 2023-02-10 2023-12-19 Distalmotion Sa Surgical robotics systems and devices having a sterile restart, and methods thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020049367A1 (en) * 2000-02-01 2002-04-25 Irion Klaus M. Device for intracorporal, minimal-invasive treatment of a patient
US20100262162A1 (en) * 2007-12-28 2010-10-14 Terumo Kabushiki Kaisha Medical manipulator and medical robot system
US8403826B1 (en) * 2009-02-18 2013-03-26 Integrated Medical Systems International, Inc Video endoscope for diagnostic and therapeutic usage

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3921233A1 (en) * 1989-06-28 1991-02-14 Storz Karl Gmbh & Co ENDOSCOPE WITH A VIDEO DEVICE AT THE DISTAL END
US5305121A (en) * 1992-06-08 1994-04-19 Origin Medsystems, Inc. Stereoscopic endoscope system
WO1994009694A1 (en) * 1992-10-28 1994-05-11 Arsenault, Dennis, J. Electronic endoscope
JPH11309A (en) * 1997-06-12 1999-01-06 Hitachi Ltd Image processor
US6277064B1 (en) * 1997-12-30 2001-08-21 Inbae Yoon Surgical instrument with rotatably mounted offset endoscope
US6468265B1 (en) * 1998-11-20 2002-10-22 Intuitive Surgical, Inc. Performing cardiac surgery without cardioplegia
US8229549B2 (en) * 2004-07-09 2012-07-24 Tyco Healthcare Group Lp Surgical imaging device
CN100443061C (en) * 2002-01-30 2008-12-17 能量医学介入公司 Surgical imaging device
CA2633137C (en) * 2002-08-13 2012-10-23 The Governors Of The University Of Calgary Microsurgical robot system
US7066879B2 (en) * 2003-07-15 2006-06-27 The Trustees Of Columbia University In The City Of New York Insertable device and system for minimal access procedure
US8512229B2 (en) * 2004-04-14 2013-08-20 Usgi Medical Inc. Method and apparatus for obtaining endoluminal access
US8992420B2 (en) * 2004-04-14 2015-03-31 Usgi Medical, Inc. Methods and apparatus for off-axis visualization
US8562516B2 (en) 2004-04-14 2013-10-22 Usgi Medical Inc. Methods and apparatus for obtaining endoluminal access
US8602971B2 (en) * 2004-09-24 2013-12-10 Vivid Medical. Inc. Opto-Electronic illumination and vision module for endoscopy
US7621869B2 (en) * 2005-05-06 2009-11-24 Nitesh Ratnakar Next generation colonoscope
US20080275298A1 (en) * 2004-10-11 2008-11-06 Novation Science, Llc Dual View Endoscope
EP1759629B1 (en) * 2005-08-31 2014-04-02 Karl Storz GmbH & Co. KG Endoscope with variable direction of view
DE102005045729A1 (en) * 2005-09-23 2007-03-29 Karl Storz Gmbh & Co. Kg Illumination system for endoscopic examinations
US20070106113A1 (en) * 2005-11-07 2007-05-10 Biagio Ravo Combination endoscopic operative delivery system
TW200744518A (en) * 2006-01-06 2007-12-16 Olympus Medical Systems Corp Medical system conducted percutaneous or using naturally ocurring body orifice
JP4744595B2 (en) * 2006-02-27 2011-08-10 オリンパスメディカルシステムズ株式会社 Endoscopic surgical instrument
US8182415B2 (en) 2006-06-13 2012-05-22 Intuitive Surgical Operations, Inc. Minimally invasive surgical system
US8105233B2 (en) * 2007-10-24 2012-01-31 Tarek Ahmed Nabil Abou El Kheir Endoscopic system and method for therapeutic applications and obtaining 3-dimensional human vision simulated imaging with real dynamic convergence
WO2009057117A2 (en) 2007-10-30 2009-05-07 Medicop Ltd. Platform scope and tools therefor
CA2711130C (en) * 2008-01-10 2016-08-30 Power Medical Interventions, Llc Imaging system for a surgical device
US8727966B2 (en) * 2008-03-31 2014-05-20 Intuitive Surgical Operations, Inc. Endoscope with rotationally deployed arms
US20090259097A1 (en) * 2008-04-09 2009-10-15 Thompson Ronald J Cannula visualization arrangement
US8562513B2 (en) * 2008-05-20 2013-10-22 Olympus Medical Systems Corp. Endoscope device
US8414469B2 (en) * 2008-06-27 2013-04-09 Intuitive Surgical Operations, Inc. Medical robotic system having entry guide controller with instrument tip velocity limiting
US8864652B2 (en) * 2008-06-27 2014-10-21 Intuitive Surgical Operations, Inc. Medical robotic system providing computer generated auxiliary views of a camera instrument for controlling the positioning and orienting of its tip
CA2776320C (en) * 2008-10-07 2017-08-29 The Trustees Of Columbia University In The City Of New York Systems, devices, and method for providing insertable robotic sensory and manipulation platforms for single port surgery
JP2012515065A (en) * 2009-01-16 2012-07-05 ザ ボード オブ リージェンツ オブ ザ ユニバーシティー オブ テキサス システム Medical devices and methods
ES2762203T3 (en) * 2009-03-27 2020-05-22 New View Surgical Inc Cannula with lighting and integrated camera
US8834358B2 (en) * 2009-03-27 2014-09-16 EndoSphere Surgical, Inc. Cannula with integrated camera and illumination
US20120232345A1 (en) * 2011-03-07 2012-09-13 Peer Medical Ltd. Camera assembly for medical probes
US8465476B2 (en) * 2009-09-23 2013-06-18 Intuitive Surgical Operations, Inc. Cannula mounting fixture
WO2011062287A1 (en) * 2009-11-20 2011-05-26 国立大学法人東北大学 Insertion device and endoscope
CA2743187A1 (en) 2010-06-11 2011-12-11 The Hospital For Sick Children Folding endoscope and method of using the same
US20120245416A1 (en) * 2011-03-24 2012-09-27 Tyco Healthcare Group Lp Swing-out surgical camera

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020049367A1 (en) * 2000-02-01 2002-04-25 Irion Klaus M. Device for intracorporal, minimal-invasive treatment of a patient
US20100262162A1 (en) * 2007-12-28 2010-10-14 Terumo Kabushiki Kaisha Medical manipulator and medical robot system
US8403826B1 (en) * 2009-02-18 2013-03-26 Integrated Medical Systems International, Inc Video endoscope for diagnostic and therapeutic usage

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11602265B2 (en) 2016-03-31 2023-03-14 Sony Corporation Control device, endoscopic imaging device, control method, program, and endoscopic system
WO2022074661A1 (en) * 2020-10-08 2022-04-14 Med Smart Hub Ltd. Trocar assembly with illumination and imaging
USD1022197S1 (en) 2020-11-19 2024-04-09 Auris Health, Inc. Endoscope

Also Published As

Publication number Publication date
JP6254186B2 (en) 2017-12-27
CN104902797B (en) 2017-09-19
US9307894B2 (en) 2016-04-12
WO2014094718A1 (en) 2014-06-26
CN104902797A (en) 2015-09-09
EP2934279B1 (en) 2019-01-30
US20140180001A1 (en) 2014-06-26
EP2934279A1 (en) 2015-10-28
DE102012025102A1 (en) 2014-06-26
HK1213461A1 (en) 2016-07-08
JP2016505315A (en) 2016-02-25

Similar Documents

Publication Publication Date Title
US9307894B2 (en) Endoscope comprising a system with multiple cameras for use in minimal-invasive surgery
JP6389467B2 (en) Isolated multi-camera system for minimally invasive surgery
US11033338B2 (en) Medical information processing apparatus, information processing method, and medical information processing system
JP7151109B2 (en) Medical imaging device and medical observation system
EP2932886B1 (en) A video system for viewing an object on a body
JP7211364B2 (en) IMAGING DEVICE, IMAGE GENERATION METHOD, AND PROGRAM
WO2018088105A1 (en) Medical support arm and medical system
JP2021013412A (en) Medical observation system, control device, and control method
JP6469292B1 (en) Dental 3D digital microscope system and dental display support mechanism for stereoscopic viewing of observed images
JP2003250812A (en) Stereoscopic display device for medical treatment
TWI486146B (en) An operating assembly including observation apparatus, the use of such an operating assembly, and an operating facility
JP7178385B2 (en) Imaging system and observation method
JP3816599B2 (en) Body cavity treatment observation system
WO2021049220A1 (en) Medical support arm and medical system
WO2017145606A1 (en) Image processing device, image processing method, and endoscope system
JP4426770B2 (en) Endoscope holding device
WO2021256168A1 (en) Medical image-processing system, surgical image control device, and surgical image control method
WO2018043205A1 (en) Medical image processing device, medical image processing method, and program
JP2011024820A (en) Observation system for dental treatment
WO2023176133A1 (en) Endoscope holding device, endoscopic surgery system, and control method
WO2022269992A1 (en) Medical observation system, information processing device, and information processing method

Legal Events

Date Code Title Description
AS Assignment

Owner name: AVATERAMEDICAL GMBH, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VON GRUNBERG, HUBERTUS;SEEBER, MARCEL;STOLZENBURG, JENS-UWE;SIGNING DATES FROM 20130213 TO 20160209;REEL/FRAME:037997/0182

AS Assignment

Owner name: AVATERAMEDICAL GMBH, GERMANY

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE ADDRESS PREVIOUSLY RECORDED ON REEL 037997 FRAME 0182. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT FROM INVENTORS TO ASSIGNEE;ASSIGNORS:VON GRUNBERG, HUBERTUS;SEEBER, MARCEL;STOLZENBURG, JENS-UWE;SIGNING DATES FROM 20130213 TO 20160209;REEL/FRAME:038618/0046

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION