WO2015081247A1 - Real-time cephalometry for cranimaxillofacial surgery - Google Patents

Real-time cephalometry for cranimaxillofacial surgery Download PDF

Info

Publication number
WO2015081247A1
WO2015081247A1 PCT/US2014/067692 US2014067692W WO2015081247A1 WO 2015081247 A1 WO2015081247 A1 WO 2015081247A1 US 2014067692 W US2014067692 W US 2014067692W WO 2015081247 A1 WO2015081247 A1 WO 2015081247A1
Authority
WO
WIPO (PCT)
Prior art keywords
measuring
point
skeletal
cephalometry
distance
Prior art date
Application number
PCT/US2014/067692
Other languages
French (fr)
Inventor
Mehran Armand
Ehsan Basafa
Chad GORDON
Gerald GRANT
Peter LIACOURAS
Ryan Murphy
Original Assignee
The Johns Hopkins University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Johns Hopkins University filed Critical The Johns Hopkins University
Priority to US15/100,229 priority Critical patent/US20170000504A1/en
Publication of WO2015081247A1 publication Critical patent/WO2015081247A1/en
Priority to US15/529,036 priority patent/US20170273797A1/en
Priority to AU2015353523A priority patent/AU2015353523B2/en
Priority to EP15862375.1A priority patent/EP3223752A4/en
Priority to PCT/US2015/062521 priority patent/WO2016086054A1/en
Priority to AU2015353601A priority patent/AU2015353601B2/en
Priority to US15/529,042 priority patent/US10603175B2/en
Priority to PCT/US2015/062516 priority patent/WO2016086049A1/en
Priority to PCT/US2015/062507 priority patent/WO2016086041A1/en
Priority to EP15862868.5A priority patent/EP3223737A4/en

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/14Surgical saws ; Accessories therefor
    • A61B17/15Guides therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/16Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans
    • A61B17/1695Trepans or craniotomes, i.e. specially adapted for drilling thin bones such as the skull
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/16Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans
    • A61B17/17Guides or aligning means for drills, mills, pins or wires
    • A61B17/1739Guides or aligning means for drills, mills, pins or wires specially adapted for particular parts of the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/16Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans
    • A61B17/17Guides or aligning means for drills, mills, pins or wires
    • A61B17/1739Guides or aligning means for drills, mills, pins or wires specially adapted for particular parts of the body
    • A61B17/176Guides or aligning means for drills, mills, pins or wires specially adapted for particular parts of the body for the jaw
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/56Surgical instruments or methods for treatment of bones or joints; Devices specially adapted therefor
    • A61B17/58Surgical instruments or methods for treatment of bones or joints; Devices specially adapted therefor for osteosynthesis, e.g. bone plates, screws, setting implements or the like
    • A61B17/68Internal fixation devices, including fasteners and spinal fixators, even if a part thereof projects from the skin
    • A61B17/80Cortical plates, i.e. bone plates; Instruments for holding or positioning cortical plates, or for compressing bones attached to cortical plates
    • A61B17/8085Cortical plates, i.e. bone plates; Instruments for holding or positioning cortical plates, or for compressing bones attached to cortical plates with pliable or malleable elements or having a mesh-like structure, e.g. small strips
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/02Prostheses implantable into the body
    • A61F2/28Bones
    • A61F2/2803Bones for mandibular reconstruction
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101Computer-aided simulation of surgical operations
    • A61B2034/105Modelling of the patient, e.g. for ligaments or bones
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/108Computer aided selection or customisation of medical implants or cutting guides
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2051Electromagnetic tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2055Optical tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2065Tracking using image or pattern recognition
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Definitions

  • This invention relates generally to the field of surgery, particularly orthognathic and craniomaxillofacial surgery, and specifically to the field of computer- assisted craniomaxillofacial surgery and all related orthognathic, neurosurgical and head/face/neck surgical procedures and associated methods, tools and systems.
  • One known system includes pre-operative planning and cutting guides by way of computer manufactured stereolithographic models for human facial transplantation.
  • a system uses standard off-the-shelf vendor systems and does not include necessary features to mitigate the increased complexity of this particular procedure,
  • the method can include creating a first 3D reconstruction of a skeleton, selecting a cut plane to bisect the 3D reconstruction, and forming a reference guide.
  • the reference guide can include an attachment surface configured for attaching to a skeletal feature, and a navigation surface connected to the attachment surface and comprising a trackable reference geometry.
  • the attachment surface can include a contoured surface corresponding to a geometiy defined by the interface of the cut-plane and contours of portions of the skeletal feature, and the attachment surface can be configured for attaching to the skeleton at a location substantially corresponding to a preselected location.
  • a medical procedure comprising: attaching a first cranial reference unit to a skeleton; attaching a first fragment reference unit to the skeleton at a location different than the first cranial reference unit; tracking locations of the first cranial reference unit and the first fragment reference unit with a first tracker; creating a first 3D reconstruction of the skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit; superimposing a first virtual reference guide on the first 3D reconstruction at a location that corresponds to a proposed placement of an actual reference guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit; forming a first virtual fragment by segmenting the 3D reconstruction of the skeleton at a location adjacent to the first virtual reference guide; superimposing the first virtual fragment on the 3D reconstruction of the skeleton to form a hybrid 3D reconstruction, and performing an
  • a computing system for managing medical procedures can comprise: at least one memory to store data and instructions; and at least one processor configured to access the at least one memory and to execute instructions.
  • the instructions can comprise: controlling a first tracker to track the locations of a first cranial reference unit and a first fragment reference unit that are attached to a skeleton; generating a first 3D reconstruction of the skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit; superimposing a planned reference plane over portions of the first 3D reconstruction; generating a first virtual reference guide having a geometry that corresponds to an interface between intersecting portions of the planned reference plane and the first 3D reconstruction; controlling a device for manufacturing a reference guide according to the geometry of the first virtual reference guide; forming a first virtual fragment by segmenting the 3D reconstruction of the donor skeleton at a location adjacent to the first virtual reference guide
  • Advantages of at least one embodiment include 1) intraoperative plan updates based on hard tissue discrepancies between planned and executed procedure; 2) on-table feedback in the form of dynamic, real-time cephalometrics; and 3) pre-designed fixation plates matching the virtual plan.
  • Another advantage of at least one embodiment includes increasing the robustness of conventional CAS paradigms by providing a robust surgical system to deal with situations in which tools and templates designed and fabricated preoperatively may not entirely address intraoperative surgical needs. Robustness of the planning and navigation strategy is especially important in total face transplantation given the long operating times.
  • Another advantage of at least one embodiment includes improved outcomes and decreased accompanying morbidity via shortened operative times, more precise surgical maneuvers, and improved margin of safety.
  • a computer-implemented method for cephalometry for orthognathic and craniomaxillofacial surgery can comprise transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient skeletal portion in the second reference frame; calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and providing updates of the one or more cephalometry metrics that were calculated.
  • the computer-implemented method can further comprise obtaining a hybrid
  • 3D reconstruction model of a hybrid skeletal structure comprising a donor skeletal fragment anatomically positioned onto a cranium of a recipient: and identifying the set of cephalometry landmarks on the hybrid 3D reconstruction model,
  • the hybrid 3D reconstruction model can be obtained by creating a first 3D reconstruction of a skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit; superimposing a first virtual reference guide on the first 3D reconstruction at a location that corresponds to a proposed placement of an actual reference guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit; forming a first virtual fragment by segmenting the 3D reconstruction of the skeleton at a location adjacent to the first virtual reference guide; superimposing the first virtual fragment on the 3D reconstruction of the skeleton to form the hybrid 3D reconstruction.
  • the registration process can further comprise identifying, by a processor, a set of anatomical landmarks on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans; and creating, by a processor, a point-to- point registration between the set of anatomical landmarks associated with the donor skeletal fragment and the recipient skeletal.
  • the registration process can further comprise identifying, by a processor, a set of anatomical landmarks on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans; and creating, by a processor, a point-to- surface registration between the set of anatomical landmarks associated with the donor skeletal fragment and a surface model of the recipient skeletal using an iterative closest point algorithm.
  • the set of cephalometric landmarks can comprise one or more of: Gonion
  • the tracking can comprise determining, during surgery, the orientation of the donor skeletal fragment with respect to the recipient skeletal portion by measuring one or more cephalometric landmarks from the set of cephalomctric landmarks using a tracking device.
  • the measuring can comprise measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasion, and the A point ("S-N-A”), measuring an angle between the sella, nasion, and the B point ("S-N-B”), measuring an angle between the A point, nasion, and the B point ("A-N-B”), measuring a distance between the os occipital and the nasion ("Occ-N”), measuring a distance between the left and right zygomas (“Zy-Zy”), measuring a distance between the sella and the nasion ("S- N”), measuring a distance between the gonion and the menton (“Go-M”), measuring a distance between the gonion and the B point (“Go-B”), measuring a distance between the A point and the sella ("S-A”), measuring a distance between the A point and the sella ("S-A”), measuring a distance between the
  • the first frame of reference can be a donor reference frame and the second frame of reference can be a recipient or a hybrid donor-recipient reference frame.
  • the providing updates can further comprise causing an interactive user- interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison.
  • the donor skeletal fragment can comprise at least a maxilla or mandible and the providing updates can comprise providing a visual indication as to how well one r more teeth of the hybrid maxilla-mandible combination match.
  • the updates can comprise a change in appearance of a visual indicator on a hybrid model as the donor skeletal fragment is mated with the recipient skeletal fragment.
  • a system for cephalometry for craniomaxillofacial surgery can comprise a memory storing instructions; and at least one processor coupled to the memory and executing the instructions to perform a method comprising transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient skeletal portion in the second reference frame; calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and providing updates of the one or more cephalometry metrics that were calculated.
  • a computer-readable medium can comprise instructions stored therein to perform a method comprising transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephal metric landmarks associated with a recipient skeletal portion in the second reference frame; calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and providing updates of the one or more cephalometry metrics that were calculated.
  • FIG. 1 is a flowchart of general features of a surgical system of an
  • embodiment closes the loop between surgical planning, navigation and enabling
  • IGS. 2A-2C provide a schematic overview of a surgical system of an embodiment.
  • FIGS. 2D-2G are graphical representations of some components and/or features of the surgical system of FIGS. 2A-2C.
  • FIG. 3 is a flow chart depicting a procedure associated with use of the surgical system, for example, the surgical system of FIGS. 2A-2C.
  • FIG 4A is a CT-scan of reconstructed images of size-mismatched facial skeleton generated from segmentation software utilized for pre-operative planning.
  • FIG 4B shows a Segmented arterial system of craniomaxillofacial skeleton generated from CT angiography ( I A ) data allowing 3D, intraoperative mapping.
  • FIGS. 5A-5B shows depictions of on-screen images provided by a surgical system, such as the surgical system of FIG. 2A displaying real-time, dynamic cephalometrics and pertinent measurements applicable to humans.
  • FIG. 5A shows donor's face-jaw-teeth alloflap in suboptimal position as compared to recipient's cranium
  • FIG. 5B shows appropriate face-jaw-teeth positioning with immediate surgeon feedback and updated cephalometric data pertinent to a pre-clinical investigation.
  • a surgeon may adjust the position of face-jaw-teeth segment upwards, downwards, forwards or backwards based on this realtime cephalometric feedback - since this information helps to predict optimal form and function.
  • placing the face-jaw-teeth segment forward may improve the patient's airway, but if moved too far forward, it may cause at the same time the patient to have a significant overjet (i.e. malocclusion) and abnormal appearance on profile view.
  • overjet i.e. malocclusion
  • FIG. 6 shows some pre-bent fixation plates with screw holes designed virtually to accommodate the donor-to-recipient skeletal mismatch areas and matching navigational cutting guides of a surgical system, for example, the surgical system of FIGS. 2A-2C.
  • FIG. 7A is a photograph of a kinematic reference mount of an embodiment as it is affixed onto a donor ' s cranium with intermaxillary screws.
  • a permanent suture (not visible) attaches stabilizers, such as springs and/or cross bars, which allow easy removal and replacement during surgery.
  • FIG. 7B is a photograph of a detachable rigid body with reflective markers attached to the reference body
  • FIGS. 8A-8C include illustrations of cutting guides of the embodiments with navigational capabilities.
  • FIG. 8 A illustrates a donor face-jaw-teeth allofiap recovery
  • FIG. 8C shows recipient preparation prior to transplant
  • FIG. 8C illustrates custom pre-bent fixation plate and palatal splint designed to achieve face-jaw-teeth alignment and skeletal inset with standard technique.
  • FIG. 9A-9D include photographs and renderings showing exemplary surgical results according to embodiments.
  • 100441 FIGS. 1 OA- IOC are top-view (bird's eye view), left-sided profile view, and frontal view, respectively, of images displayed by an imaging system of a surgical system of the embodiments.
  • the images depict a recipient skeleton and include real-time assessment of planned versus actual face-jaw-teeth positions.
  • FIGS. 11A-11B are "on screen" images displayed by an imaging sub-system of a surgical system of the embodiments.
  • the images depict an ideal location of a cutting guide versus actual position and an actual inset position of donor alloflap for aesthetic, dental and skeletal relation in size -mismatched donors due to anterior translation of cutting guide.
  • FIG. 12 illustrates virtual osteotomy and planned cut plane placement on v irtual representations of a skeletal feature.
  • FIG. 13 shows virtual placement of a cutting guide alongside photographs of an actual placement.
  • FIG. 14A illustrates a perspective view of a variation of a cutting guide, for example, a variation of the cutting guide of FIG. 13.
  • FIG. 14B illustrates a top view of a variation of a cutting guide, for example, a variation of the cutting guide of FIG. 13.
  • FIG. 15 is an example method for real-time cephalometry for orthognathic and craniomaxillofacial surgery, according to the present teachings.
  • FIG. 16 is an example computer system that can be used to perform the methods provided herein, according to the present teachings.
  • a range of "less than 10" can include any and all sub-ranges between (and including) the minimum value of zero and the maximum value of 10, that is, any and all sub-ranges having a minimum value of equal to or greater than zero and a maximum value of equal to or less than 10, e.g., 1 to 5.
  • the numerical values as stated for the parameter can take on negative values.
  • the example value of range stated as "less that 10” can assume negative values, e.g. -1 , -2, -3, - 10, -20, -30, etc,
  • a computer-assisted surgery system that provides for large animal and human pre-operative planning, intraoperative navigation which includes trackable surgical cutting guides, and dynamic, real-time instantaneous feedback of cephalometric measurements/angles as needed for medical procedures, such as facial transplantation, and many other instances of craniomaxillofacial and orthognathic surgery.
  • Such a system can be referred to as a computer-assisted planning and execution (CA P E.) system and can be exploited in complex craniomaxillofacial surgery like Le Fort-based, face- jaw-teeth transplantation, for example, and any type of orthognathic surgical procedure affecting one's dental alignment, and can include cross-gender facial transplantation.
  • CA P E. computer-assisted planning and execution
  • the fundamental paradigm for CAS involves developing a surgical plan, registering the plan and instruments with respect to the patient, and carrying out the procedure according to the plan.
  • Embodiments described herein include features for workstation modules within a CAS paradigm.
  • a surgical system of the embodiments can enable intraoperative evaluation of a surgical plan and can provide instrumentation for intraoperative plan updates/revisions when needed.
  • Embodiments can include a system with integrated planning and navigation modules, for example, a system for tracking donor and recipient surgical procedures simultaneously.
  • a system for tracking donor and recipient surgical procedures can include: 1 ) Two networked workstations concurrently used in planning and navigation of the two simultaneous surgeries for both donor and recipient irrespective of geographic proximity. 2) Two trackers, such as electromagnetic trackers, optical trackers (e.g., Polaris, NDI Inc.), and the like, for tracking bone fragments, tools, and soft tissues, 3) Novel guides, reference kinematic markers, etc. as required for navigation.
  • Preoperative planning can include the following tasks: a) Segmentation and volumetric reconstruction of the donor and recipient facial anatomy; b) Planning for patient- specific cutting guide placement; c) Cepbalometric analysis and biomechanical simulation of the hybrid skeleton's occlusion and masticatory function, respectively; d) Fabrication of the hybrid cutting guides enabling both geometric ("snap-on" fit) and optical navigation; e) 3D mapping the vascular system on both recipient and donor facial anatomy; f) Plan updates, if necessary, based on the feedback from the intraoperative module.
  • snap-on fit or “snap-on” or “snap on” is used to describe the way an item, such as a cutting guide, attaches to a pre-determined area. That is, the cutting guide actually "snaps-on” to a certain pre-determined area along the facial skeleton, and in all other areas it doesn't fit properly since size and width varies throughout significantly with many convexities and concavities.
  • Intraoperative tasks of embodiments described herein can generally include: 1 ) registration of the preoperative model reconstructed from the CT data to donor and recipient anatomy; 2) visualization (using information from the tracker, such as an electromagnetic tracker, optical tracker, and the like) of the instruments and cutting guides to help the surgeon navigate; 3) verify the placement of cutting guides, and performing real-time cephalometric and biomechanical simulation for occlusion analysis, if, for any reason, the osteotomy sites need to be revised; 4) dynamically tracking the attachment of the donor fragment to the recipient and provide quantitative and qualitative (visual) feedback to the surgeon for the purpose of improving final outcomes related to form (i.e. overall facial aesthetics) and function (i.e. mastication, occlusion relation, airway patency).
  • Such a procedure is described in further detail below with respect to FIG. 3.
  • a method for performing a surgery includes a virtual surgical planning step that includes performing segmentation and 3D reconstruction of recipient and donor CT scans (e.g., Mimics 15.01 , Materialise, Leuven Belgium). Virtual osteotomies can then be performed within the software to optimize the donor/recipient match.
  • Patient- customized cutting guide templates can then be created (3-matic 7.01 , Materialize, Leuven, Belgium). These templates can then be rapid prototyped via an additive manufacturing modeling process, which can include, but is not limited to, stereolithography or 3D printing and the like.
  • the surgical method and system for performing surgery are described in further detail below.
  • surgeons determine a virtual plan 401 based on the recipient's craniomaxillofacial deformity irrespective of the donor.
  • segmentation software From registered CT data, segmentation software generates volume data for specific key elements (e.g., the mandible, maxilla, and cranium) used for preoperative planning and visualization.
  • the planning workstation automatically generates the expected cut geometry of the donor fragment 402 together with the recipient, thereby defining the predicted facial skeleton with accompanying hybrid occlusion. If available, blood vessels 404 are segmented from CT angiography scans as shown in FIG. 4B.
  • nerves via known nerve foramens
  • vessels both arteries and veins
  • the planning module can also perform static cephalometric analysis and evaluation of face- jaw-teeth harmon via biomechanical simulation on varying constructions of the hybrid donor and recipient jaws, such as that shown in FIGS. 5A-5B.
  • the surgeon can evaluate different placements for the donor's face- jaw-teeth alloflap on the recipient's facial skeleton in relation to orbital volumes, airway patency, facial projection, and dental alignment.
  • An automated cephalometric computation for the hybrid face indicates the validity of the planned surgery from both an aesthetic, functional, and reconstructive standpoint based on various measurements of pertinent landmarks as shown, for example, in Tables 1 A-B.
  • Gn Gnathion most convex point located at the symphysis of the mandible
  • ALV Alveola re mid-line of alveolar process of the upper jaw, at mcisor - alveolar junction
  • PA Parietale most superior aspect of skull in the midline, (formed by nuchal crest of occipital bone and parietal bone)
  • Pronasale bony landmark representing anterior limit of nasal bone
  • OCC Occipital region midpoint between the occipital condyles
  • Table 1 B Cephalometric measurements and related units.
  • the system can use validated, translational landmarks between swine and human to thereby allow effective pre-clinical investigation.
  • the cephalometric parameters defined by these landmarks can be automatically recalculated as the surgeon relocates the bone fragments using a workstation's graphical user interface.
  • Preoperative planning can also involve fabrication of custom guides 207 as shown in FIG. 6 and palatal splints 223 as illustrated in FIG. 8C.
  • Planned cut planes 403 (as shown in FIG. 4) can be used for defining the geometry of the cutting guides to thereby provide patient-specific cutting guides.
  • These cutting guides can be designed according to the skeletal features through which the cutting plane intersects, such as an outer skeletal surface of a cross section defined by the cutting plane, and can be fabricated via stereolithography, or via any additive manufacture technology.
  • custom cutting guide templates can be separately designed and navigational registration elements can be added (Freeform Plus, 3D Systems, Rock Hill, SC).
  • the surgical guides can be manufactured via additive manufacturing technology (AMT).
  • the cutting guides can, therefore, be a 3D printing material such as a polymer, and can include an attachment surface 216 configured for attaching to a skeletal feature, and can have a "snap-on" fit to both donor and recipient.
  • the attachment surface comprises a contoured surface that corresponds to contours of the skeletal feature within the planned cut planes.
  • a navigation surface such as a reference geometry 217 connected, built into, or attached to the guide structure directly or via attachment guides (not shown) enables dynamic intraoperative tracking of guides with respect to the patient' s skeleton. Palatal splints ensure planned dento- skeletal alignment fixation following Le Fort-type facial transplants or any similar type of surgery.
  • Fixation plates 216 can include a primary surface 216' and a plurality of fixation surfaces 221. such as eyelets, for screw placement to provide rigid immobilization at the irregular skeletal contour areas along various donor-to-recipient interfaces. Having pre-bent fixation plates decreases total operative times and helps to con irm accurate skeletal alignment by overcoming step-off deformities at bone-to-bone interfaces. Accordingly, at least one of the plurality of fixation surfaces can be located on one side of the primary surface and configured for attaching the fixation surface to a donor skeleton fragment, and at least one of another of the plurality of fixation surfaces is located on another side of the primary surface and configured for attaching the fixation surface to a recipient skeleton.
  • the whole fixation plate or just portions of the fixation plate, such as the primary surface or fixation surfaces can be manufactured via additive manufacturing technology.
  • the cutting guide's navigation surface can include trackable objects, for example, on the reference geometry, such as infrared (1R) reflective coatings or ! emitters.
  • the trackable objects can include a plurality of integrated tracking spheres, each of which has an 1R reflection surfaces.
  • a reference unit such as a kinematic reference mount to three intramedullary fixation (IMF) screws arranged in a triangular pattern on each the donor and recipient craniums as shown in FIG. 7 ⁇ -7 ⁇ .
  • IMF intramedullary fixation
  • the reference unit for providing real-time surgical navigation assistance can include a kinematic mount 203, at least one fixation rod 202, at least one support 204, and reference geometry 201.
  • the kinematic mount 203 can include a base with a plurality of recesses defined by sidewalls 233, at least one pair of slots 235 defined by portions of the sidewalls, with each slot of the pair formed across the recess from the other slot, and at least one guide hole 237 extending through a length of the fixation plate.
  • the at least one Fixation rod 202 can extend through the at least one guide hole 237.
  • An end of the at least one support rod can be configured for attaching to a skeleton of a being 209.
  • the at least one support can be disposed in the pair of slots and can be configured to attach to the being.
  • the reference geometry 201 can be attached to the at least one fixation rod.
  • the at least one support 204 can include at least one cross-bar 204' with ends that are configured for placement in the slots 235, and a spring 204"attached at one end to the at least one cross-bar 204' and attached at another end to the patient (e.g., a human- being).
  • the spring attached at another end to the being can be attached via a suture (further described below).
  • the 205 can further include a trackable object disposed on the reference geometry.
  • the trackable object disposed on the reference geometry can include an IK reflective surface.
  • the mount 203 can be made via additive manufacturing techniques and can therefore comprise a polymer.
  • the at least one fixation rod can include a plurality of intramedullary fixation screws.
  • the base can be configured for being detachably mounted on the skeleton of the being.
  • the intramedullary fixation screws can be arranged in a triangular pattern. Accordingly the guide-holes can be configured in a triangular pattern on the base.
  • the mount design permits flexibility in the placement of the IMF screws so that no template is necessary.
  • a spring 204" can attach to each IMF screw via suture threaded through, for example, the eyelets. These springs hold the cranial mount 203 in place and allow easy removal and replacement of the cranial mount (e.g.. during positional changes required for bone cuts and soft tissue dissections).
  • the key design advantages of the reference are detachability and use of Intramaxillary fixation ( IMF) screws for stable attachment.
  • IMF Intramaxillary fixation
  • the reference geometry 201 (e.g., which can be purchased from Brainlab,
  • the surgeon can digitize three bony landmarks (e.g. the inferior aspect of the orbits and antero-superior maxilla) to define a rough registration between the environment and virtual models. For example, three, consistent points can be selected which can be quick to find, easy to reproduce on numerous occasions, and would remain constant irrespective of the user and his/her experience with the systems of the embodiments.
  • the surgeon can thereby collect several point sets from exposed bone using a digitization tool and uses an iterative closest point registration technique to refine the registration. As shown in FIG.
  • the system can include a donor subsystem 200-D, a recipient sub-system 200- R and a communications link (indicated by the horizontal dotted-line) such as a communication link that provides TCP/IP data transfer between the donor and recipient sub-systems.
  • the donor sub-system can include a first computer workstation 21 5-1). a first cranial reference module 205-D, a first cutting guide 207-1) for attaching to a preselected location of a donor skeleton 206, a first fragment reference module 201 -I) ⁇ and a first tracker 21 3-1).
  • the first cutting guide 207-1) can include an attachment surface 219-R configured for attaching to a skeletal feature, and a navigation surface 217-D connected to the attachment surface and comprising a trackable reference geometry.
  • the first tracker 213-D may be configured to be in communication with the first computer workstation, for example, via a communications link.
  • the first tracker can be configured to track, for example via IR optical tracking, a location of a portion of the first cranial reference module, a portion of the first cutting guide and a portion of the first fragment reference module.
  • the recipient sub-system 200-R can include a second computer workstation 215-R, a second cranial reference module 205 -R, and a second tracker 213-R.
  • the second tracker 213-R can be configured to be in communication with the second computer workstation, for example, via a communications link.
  • the second tracker can be configured to track, for example, via IR optical tracking, a location of a portion of the second cranial reference module.
  • the communications link can connect the first computer workstation and the second computer workstation such that the first computer workstation and second computer workstation are able to communicate.
  • the recipient sub-system 200-R can further include a second fragment reference unit 201-R.
  • the second tracker 213-R can further be configured to track a location of a portion of the second fragment unit.
  • the recipient sub-system 200-R can further include a second cutting guide
  • the second tracker 2 13-R can further be configured to track a location of a portion of the second cutting guide.
  • the second tracker 213-R can be further con igured to track a location of a portion of the first cutting guide 207-1) so that it can be matched relative a position of the second cranial reference module 205-R.
  • the first cranial reference unit, the second cranial reference unit, or both the first and second cranial reference units can include a kinematic mount 205 as described above.
  • a surgical method such as the surgical method described in FIG. 3.
  • a donor, recipient and transplant type are identified.
  • CT/CTA scans of both the donor and recipient are collected and 3D models are created in step 304.
  • the donor and recipients are prepared for surgery with the creation of skin incisions in step 306.
  • the method continues at 307 with attachment of reference guides and performing registration.
  • a first cranial reference unit can be attached to a donor skeleton
  • a first fragment reference unit can also be attached to the donor skeleton at a location that is different that of the first cranial reference unit.
  • the locations of the first cranial reference unit and the first fragm ent reference unit ca be tracked with a first tracker.
  • 3D reconstructions of the donor skeleton can be constructed showing a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that correspond to relative positions of the first cranial reference unit and the first fragment reference unit.
  • a second cranial reference unit can be attached to a recipient skeleton.
  • a second location of the second cranial reference unit can be tracked with a second tracker.
  • a second 3D reconstruction of the recipient skeleton can be created with a second virtual cranial reference unit superimposed on the second 3D reconstruction at a location that corresponds to a location of the second cranial reference unit.
  • vessels and nerves are dissected and exposed.
  • navigation of the patient-specific cutting guides can occur, with plan revision and updates provided periodically.
  • a first cutting guide such as a patient-specific cutting guide according to the descriptions provided above, can be attached onto the donor skeleton at a preselected location such as that corresponding to a planned cut-plane.
  • the location of the first cutting guide can be tracked with the first tracker.
  • a first virtual cutting guide can be superimposed on the first 3D reconstruction at a location that corresponds to a location of the first cutting guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit.
  • a first virtual fragment can be formed by segmenting the 3D reconstruction of the donor skeleton at a location adjacent to the first virtual cutting guide.
  • the first virtual fragment can be superimposed on the second 3D reconstruction of the recipient skeleton.
  • 0080J At step 310, a surgeon can perform an osteotomy on the donor skeleton to remove the first fragment but cutting the skeleton along a cutting path defined by the first cutting guide.
  • the first cutting guide Upon transferring the removed skeletal fragment from the donor, the first cutting guide can be tracked, by the second tracker, for example, when the fragment is brought near the recipient for attachment.
  • the surgeon can then navigate placement of the cutting guide as it is dynamically tracked at step 311 , and will receive feedback from the system such as by referring to a first virtual fragment that is superimposed on the second 3D reconstruction to form a hybrid 3D reconstruction.
  • the first fragment can then be attached to the recipient skeleton via known surgical methods and the incisions can be sutured in step 314.
  • the step of superimposing the first virtual fragment on the second 3D reconstruction of the recipient skeleton can include performing an automated cephalometric computation for the hybrid reconstruction.
  • the step of superimposing the first v irtual fragment on the second 3D reconstruction can include providing a communications link between a first workstation on which the first 3D reconstruction is displayed and a second workstation on which the second 3D reconstruction is displayed, and initiating a data transfer protocol that causes the first workstation and the second workstation to send electronic signals through the communications link.
  • Surgical methods of the embodiments described above can also include attaching a second cutting guide at a preselected location on the recipient skeleton.
  • the second cutting guide can also include features of the cutting guide described above.
  • the donor skeleton can include a male skeleton or a female skeleton and the recipient skeleton comprises a female skeleton.
  • the donor skeleton can include a male or female skeleton and the recipient skeleton can include a male skeleton.
  • Surgical methods of the embodiments can further include steps for assessing a size-mismatch between the donor skeleton and the recipient skeleton by measuring a dorsal maxillary interface between the first fragment and recipient skeleton.
  • the surgical method can include selecting a location of the first fragment onto the recipient skeleton that minimizes dorsal step-off deformity at the area of osteosynthesis. 100851
  • the first cutting guide, second cutting guide or both the first cutting guide and the second guide comprise concentric cutting guides.
  • Surgical methods of embodiments can further include mapping the vascular system on the facial anatomy of both the recipient and the donor and superimposing corresponding virtual representations of the vascular system and the facial anatomy onto the first 3D representation, such as shown in FIG. 4B
  • Surgical methods of embodiments can include a method for registration of a preoperative model, for example a model reconstructed from CT data, to donor and recipient anatomy.
  • a method for registration of a preoperative model for example a model reconstructed from CT data
  • Such a method can include: creating a plurality of indentations on the donor skeleton, creating a plurality of virtual markers on the first 3D reconstruction of the donor skeleton corresponding to the locations of the indentations on the donor skeleton, placing a trackable object on at least one of the plurality of indentations, and determining whether a subsequent location of the virtual markers is within a predetermined tolerance relative to an actual subsequent location of the indentations.
  • the system also recorded information, such as rendering information which can be stored in a storage medium of a workstation, relating the donor fragment 1002 to the recipient 1010 qualitatively as shown by color mismatch 1004, which matched the postoperative CT data as shown in FIG. 10.
  • the recipient cutting guide 1107' was not placed as planned 1107, howev er, due to an unexpected collision between cranial reference mount and recipient cutting guide as shown in FIGS 1 1 ⁇ - ⁇ 1 B. In this case, there was anterior translation of the cutting guide (toward the tip of the swine's snout) by approximately 4cm.
  • an embodiment of a cutting guide 1307 can include a frame 1307' with at least one attachment surface 1319, for example 1 to 6 attachment surfaces, configured for attaching the cutting guide to a skeletal feature.
  • the cutting guide can include a navigation surface 1317 (not shown in FIG. 13) connected to the frame.
  • the navigation surface can include a reference geometry that can be tracked by a tracker, for example, via IR optical tracking.
  • the at least one attachment surface 1319 can include a contoured surface corresponding to contours of portions of the skeletal feature, for example, such as the contours of a skeletal feature that intersect a planned-cut plane as indicated by 1319' in FIG. 12.
  • the at least one attachment surface 1319 can be detachably connected to a skeletal feature.
  • the at least one attachment surface 1319 can be detachably connected to an attachment guide 1341 .
  • the attachment guide 1341 can be detachably connected to a portion of the frame 1307'.
  • attachment guides 1341 can be detachably connected via slots integrated into frame 1307', or held in place against frame 1307 with screws or the like.
  • attachment guides 1341 are formed as portions of frame 1307' but can be removed.
  • the frame can have a ring-like shape (as shown in FIG. 13) or can have a c inder-like shape (as shown in FIG. 14A).
  • Frame 1 307 ' having a cylinder like shape can have a bottom surface 1307" that rests against a patient's soft tissue to provide support for the frame.
  • a cutting guide with attachment surfaces having a contoured surface corresponding to contours of portions of the skeletal feature, for example, such as the contours of a skeletal feature that intersect a planned-cut plane is designed.
  • the designed cutting guide is manufactured via, for example, an additive manufacturing process.
  • the designed cutting guide with an integrated navigation surface is attached to the patient.
  • the cutting guide can be designed such that it has a snap-on fit over the skeletal feature, which can be further secured to the skeletal feature with set screws. A surgeon removes a donor skeletal fragment with the cutting guide attached to the fragment.
  • each of the attachment guides 1341 with a corresponding attachment surface 1319 can be detached from the frame 1 307' .
  • a cylindrical shaped frame 1307' has a bottom surface 1307" that rests against the soft tissue of the patient to provide stability for the remaining portions of the cutting guide and to hold the navigation surface 1317' in place.
  • the embodiments described herein can be used for navigation and modeling for osteotomy guidance during double-jaw face transplantation and single -jaw maxillofacial transplantation, and more traditional orthognathic cases.
  • Embodiments described herein can include a platform for preoperative planning and intraoperative predictions related to soft tissue-skeletal-dental alignment with real-time tracking of cutting guides for two mismatched jaws of varying width, height and projection. Additional safeguards, such as collection of confidence points, further enable intraoperative verification of the system accuracy. This, in addition to performing real-time plan verification via tracking and dynamic cephalometry, can considerably increase the robustness of the systems described herein. Moreover, systems of embodiments can include a modular system that allows additional functionality to be continually added.
  • Embodiments described herein can include an approach for resolving conflicts in case of position discrepancies between the placement of the guide and the guide position prompted by the navigation software.
  • Such discrepancy may be due to either the guide (soft tissue interference, iatrogenic malposition ing, changes since the CT data was obtained or imperfections in cutting guide construction/printing), and/or the navigation system (e.g. registration error, or unintended movement of the kinematic markers).
  • the guide soft tissue interference, iatrogenic malposition ing, changes since the CT data was obtained or imperfections in cutting guide construction/printing
  • the navigation system e.g. registration error, or unintended movement of the kinematic markers.
  • four indentations can be created on a bone fragment (confidence points) where a reference kinematic marker is attached.
  • Embodiments described herein can include a system that provides real-time dynamic cephalometrics and masticatory muscle simulation for both planning and intraoperative guidance.
  • FIG. 15 is an example method of a computer-implemented method for cephalometry for orthognathic and/or cran iomaxil lofac ial surgery 1500, according to the present teachings.
  • the method includes transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame.
  • "donor” can imply that the skeletal fragment is from another person or the same person from whom the donor skeletal fragment is harvested.
  • the first frame of reference can be a donor reference frame and the second frame of reference can be a recipient or a hybrid donor-recipient reference frame.
  • the transforming can be performed based, at least in part, on a hybrid 3D reconstruction model of a hybrid skeletal structure comprising a donor skeletal fragment anatomically positioned onto a cranium of a recipient.
  • a set of cephalometry landmarks can then be identified on the hybrid 3D reconstruction model.
  • the hybrid 3D reconstruction model can be created by a first 3D reconstruction of a skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit.
  • a first virtual reference guide can be superimposed on the first 3D reconstruction at a location that corresponds to a proposed placement of an actual reference guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit.
  • a first virtual fragment can be formed by segmenting the 3D reconstruction of the skeleton at a location adjacent to the first virtual reference guide. The first virtual fragment can then be superimposed on the 3D reconstruction of the skeleton to form the hybrid 3D reconstruction.
  • the method 1500 can use a set of cephalometric landmarks, which can comprise one or more of: Gonion (“Go"), Nasion (“N”), A point ("A"), B point (“B”), Sella (“S”), Menton (“M”), left/right Zygoma (“ZY”), Os occipital (“OCC”).
  • cephalometric landmarks can comprise one or more of: Gonion (“Go"), Nasion (“N”), A point (“A”), B point (“B”), Sella (“S”), Menton (“M”), left/right Zygoma (“ZY”), Os occipital (“OCC”).
  • Other suitable cephalometric landmarks may be used in conjunction with the above-listed group or in replacement of those listed above depending on the particular circumstances of the present application.
  • the registration process can be preformed by computer system 1600, discussed below, and can include identifying a set of anatomical landmarks on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans and creating a point-to-point registration between the set of anatomical landmarks associated with the donor skeletal fragment and the recipient skeletal.
  • the registration process can include collecting a set of (unknown) points on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans and creating a point-to-surface registration between the set of collected points associated with the donor skeletal fragment and a surface model of the recipient skeletal using an iterative closest point algorithm.
  • Registration techniques can be used including, but are not limited to, an image-based 2D/3D registration as is known in the art.
  • These registration techniques can use an optical tracker, such as the optical tracker 213 in FIG. 2G, or an electromagnetic tracker, as is known in the art.
  • the method includes tracking movement, based on one or more signals from one or more sensors, in real-time during surgery of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient skeletal portion in the second reference frame.
  • the tracker 213 is able to track one or more reflectors of a donor or recipient mount that can be affixed to the donor skeletal fragment or the recipient skeletal fragment, respectively.
  • the method includes calculating one or more cephalometry metrics in real-time during surgery based on the movement that is tracked.
  • the tracking can comprise determining, in real-time during surgery, the face and jaw relations of the hybrid skeleton by measuring one or more cephalometric landmarks from the set of cephalometric landmarks using a tracking device.
  • the measuring can comprise measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasi on.
  • the method includes providing updates and/or real-time feedback of the one or more cephalometry metrics that were calculated.
  • the updates and/or real-time feedback can be provided by a processor of the computer system, such as computer 21 5-R, which can cause an interactive user-interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison.
  • a computer such as computer 215-R, can display graphic that shows real-time cephalometric results as the donor skeletal fragment is mounted onto the recipient.
  • Each cephalometric metric that is calculated can be shown along a range of predetermi ned or baseline metrics for comparison, such that the surgeon can visualize the results of the surgery and can make corrections or revisions based on the feedback that is displayed.
  • the updates and/or real-time feedback can be in a form such as a change in appearance of a visual indicator on a hybrid model as the donor skeletal fragment is mated with the recipient skeletal fragment within a predetermined distance tolerance, as it is being tracked by tracker 213 and as is shown and described in relation to FTGS. 2B, 2C, 1 1 A, and 1 I B, where the appearance, i.e., color is caused to change from one color to another color.
  • other modes of indication may be used including, but are not limit to, audio and/or tactile feedback.
  • the donor skeletal fragment can comprise at least a maxilla or mandible and the real-time feedback that is provided can comprise providing a visual indication as to how well one or more teeth of the hybrid maxilla-mandible combination match.
  • FIG. 16 illustrates a schematic view of such a computing or processor system 1600, which can include the computers 21 5-1 ) and 215-R, according to an embodiment.
  • the processor system 1600 may include one or more processors 1602 of varying core configurations (including multiple cores) and clock frequencies.
  • the one or more processors 1 602 may be operable to execute instructions, apply logic, etc. It will be appreciated that these functions may be provided by multiple processors or multiple cores on a single chip operating in parallel and/or commimicably linked together.
  • the one or more processors 1602 may be or include one or more GPUs.
  • the processor system 1600 may also include a memory system, which may be or include one or more memory devices and/or computer-readable media 1604 of varying physical dimensions, accessibility, storage capacities, etc. such as flash drives, hard drives, disks, random access memory, etc., for storing data, such as images, files, and program instructions for execution by the processor 1602.
  • the computer-readable media 404 may store instructions that, when executed by the processor 1602, are configured to cause the processor system 1600 to perform operations. For example, execution of such instructions may cause the processor system 1600 to implement one or more portions and/or embodiments of the method described above.
  • the processor system 1600 may also include one or more network interfaces 1606.
  • the network interfaces 1606 may include any hardware, applications, and/or other software. Accordingly, the network interfaces 1606 may include Ethernet adapters, wireless transceivers, PCI interfaces, and/or serial network components, for communicating over wired or wireless media using protocols, such as Ethernet, wireless Ethernet etc.
  • the processor system 1600 may further include one or more peripheral interfaces 1608, for communication with a display screen, projector, keyboards, mice, touchpads, sensors, other types of input and/or output peripherals, and/or the like.
  • peripheral interfaces 1608 for communication with a display screen, projector, keyboards, mice, touchpads, sensors, other types of input and/or output peripherals, and/or the like.
  • the components of processor system 1600 need not be enclosed within a single enclosure or even located in close proximity to one another, but in other implementations, the components and/or others may be provided in a single enclosure.
  • the memory device 1604 may be physically or logically arranged or configured to store data on one or more storage devices 161 0.
  • the storage device 1610 may include one or more file systems or databases in any suitable format.
  • the storage device 1610 may also include one or more software programs 1612. which may contain interpretable or executable instructions for performing one or more of the disclosed processes. When requested by the processor 1602, one or more of the software programs 1612, or a portion thereof, may be loaded from the storage devices 1610 to the memory devices 1604 for execution by the processor 1602.
  • processor system 1600 may include any type of hardware components, including any necessary accompanying firmware or software, for performing the disclosed implementations.
  • the processor system 1600 may also be implemented in part or in whole by electronic circuit components or processors, such as application-specific integrated circuits (ASTCs) or field-programmable gate arrays (FPGAs).
  • ASSCs application-specific integrated circuits
  • FPGAs field-programmable gate arrays
  • Osseointegrated dental implants can include, and may consist of, a two-piece permanent implant device, which is placed into either the maxil la or mandible skeleton with a power drill for placement and stability. A second piece, in the shape of a tooth for example, is screwed onto the secure base.
  • An embodiments of the CAPE system described above can be used to provide the dentist or surgeon real-time cephalomteric feedback in an effort to restore ideal occlusion and predict optimized mastication with biomechanical predictions - as similar to maxillofacial transplantation. As such, the dentist or surgeon placing them needs to know the bone stock quality of the jaw(s) and angle to place the framework.
  • the CAPE system described above may be applied to this specialty.
  • the craniofacial implants can be tracked as similar to a donor face-jaw-teeth segment described above.
  • pre-placement images of the prosthetic could be fabricated, and surgical plans could be optimized since these appliances are placed with osseointegrated devices as similar to dental implants described above - with rigid plates and screws.
  • the surgeon placing them needs to know the bone stock quality and angle to place the framework, and also needs to know with visual feedback as to the ideal position in three-dimensional space.
  • the CAPE system described here may be applied to this specialty.
  • Craniomaxillofacial trauma reconstruction [00125] Patients suffering from acute or chronic facial disfigurement is a common type seen by the craniomaxillofacial surgeon. Both penetrating and/or blunt trauma may cause significant damage to the underlying facial skeleton. As such, in an embodiment, the CAPE system technology described herein allows the surgeon to assess and optimize bone fragment reduction and reconstruction with real-time feedback. In addition, fractures affecting the jaws can be aided by real-time cephalometrics in hopes to restore the patient back to their pre- trauma angle/measurements (as a way to assure proper occlusion).
  • embodiments of the CAPE system use a small, modified rigid cranial reference mount which removes the need for using a big, bulky clamp from the field and allows the surgeon to rotate the patient ' s head if and when needed.
  • a craniofacial plastic surgeon who often is consulted to assist with simultaneous scalp reconstruction, elimination/removal of such pins from the surgical field is a huge advantage.
  • elimination of the pins makes scalp reconstruction in the setting of neurosurgery much safer since the pins aren't present to hold back mobilization and dissection of the nearby scalp - which is needed often for complex closure.
  • CAPE system described herein may be applied to neurosurgical procedures as well.
  • This specialty is very diverse, and therefore the CAPE system's easy adaptability can help make it greatly valuable to this group of surgeons.
  • Orthognathic surgery describes any of surgical procedure type moving the jaw and/or jaw-teeth segments. This is most commonly performed by either oral surgeons, oral- maxillofacial surgeons (OMFS), or plastic surgeons. It is done currently both in the hospital as an insurance case or in the outpatient setting for a fee-for-service. It may be indicated for enhanced mastication, improved aesthetics, and/or both reasons. Having the ability to plan and predict jaw movements based on biomechanical muscle (ie. External) forces will be enormous valuable to this field.
  • surgeons can utilize the CAPE system described above to predict functional jaw movements both at time of surgery and after surgery (1 , 5, 10, 20 years post-op).
  • a surgeon can utilize the CAPE system to provide real-time cephalometric feedback, which provides an advancement not seen in the conventional systems.
  • oral surgeons have used splints fabricated in the dental lab pre-operatively for assistance in the operating room - to help confirm dental alignment as planned. This takes time (4-6 hours to make by hand), effort (can be done virtually nowadays but is very expensive) and money. In contrast to the conventional systems.
  • CAPE system Surgeons utilizing the CAPE system, such as an embodiment described above, can go to the operating room with pre-fabricated cutting guides and tracking instruments, cut the jaws where planned, and then match the teeth on the table based on real-time cephol metric feedback and biomechanical jaw simulation to predict postoperative mastication - unlike ever before.
  • use of the CAPE system will allow surgeons to know instantaneously if the aesthetic and functional angles/measurements are ideal and where they should be.
  • the CAPE system is able to supply palatal cutting guides and pre-bent metal fixation plates (as opposed to the conventional methods that require handbending each plate for proper shape).
  • the CAPE system will be a "game-changer" for orthognathic surgery.
  • At least some embodiments described herein can be used for the immediate surgical repair of large cranial defects (>5 cm 2 ).
  • embodiments described herein may be used for designing, forming and implanting customized craniofacial implants following benign/malignant skull neoplasm (tumor) resection (i.e.. referred to as "single- stage implant cranioplasty")-
  • single- stage implant cranioplasty a computer-assisted surgical system of an embodiment may significantly reduce the intraoperative time used for reshaping/resizing the customized implant.
  • embodiments provide visualization related to the tumor, the resulting skull defect, and the reshaped implant for exact positioning.
  • a C m pute r- A s s i s ted Planning and Execution (CAPE) system that can be utilized for I e Fort-based, Face- Jaw-Teeth transplantation may also be used for improving both the pro-operative planning and intra-operative execution of single- stage implant cranioplasties.
  • Cranioplasties may be performed to reconstruct large defects following stroke, trauma, aneurysmal bleeding, bone flap removal for infection, and oncological ablation.
  • embodiments described herein include a computer-assisted algorithm that may allow surgeons to reconstruct tumor defects with pre-customized cranial implants (CCls) for an ideal result.
  • Cls cranial implants
  • CAPE Computer- Assisted Planning and Execution
  • SINGLE seamless platform capable of being used for both planning (pre-op use) and navigation (intra-op use) which overcomes the limitations of conventional systems that do either one or the other.
  • embodiments include novel hardware such as trackable cutting guides and rigid cranial reference mount.
  • the CAPE architecture will provide reconstructive surgeons all the necessary algorithms for real-time updates related to single-stage customized implant cranioplasty.

Abstract

Provided herein is a computer-implemented method, system, computer-readable medium operable to perform the method for cephalometry for orthognathic and craniomaxillofacial surgery. The method can include transforming a set of cephalometric landmarks from a donor or mobile skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor or mobile skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient or second skeletal portion in the second reference frame; calculating one or more cephalometry metrics; and providing an update of the one or more cephalometry metrics.

Description

REAL-TIME t EPHALOME TRY FOR CRANIMAXILLOFACIAL SURGERY
Cross-Reference to Related Applications
[00011 This application claims priority from U.S. Provisional Patent Application
Ser. Nos. 61/910,204, filed November 29, 2013; 61/940,196, filed February 14, 2014; and 62/049,866, filed September 12, 2014, which are hereby incorporated by reference in their entirety.
Government Support Statement
[00021 This invention was made with government support under NCA'I'S Grant No.
UL1 TR000424-06 awarded by the National Institutes of Health. The government has certain rights in the invention.
Field of the Inv ention
[0003] This invention relates generally to the field of surgery, particularly orthognathic and craniomaxillofacial surgery, and specifically to the field of computer- assisted craniomaxillofacial surgery and all related orthognathic, neurosurgical and head/face/neck surgical procedures and associated methods, tools and systems.
Background of the In vention
[0004J Facial transplantation represents one of the most complicated scenarios in craniomaxillofacial surgery due to skeletal, aesthetic, and dental discrepancies between donor and recipient. Use of computer technology to improve accuracy and precision of craniomaxillofacial surgical procedures has been described for nearly 30 years, since the increasing availability f computed topographs (CT) prompted the development of a CT- based surgical simulation plan for osteotomies. [0005] Two broad approaches to computer-assisted surgery (CAS) have gained popularity: 1) pre-operative computer surgical planning and the use of three-dimensional computer manufactured surgical guides (3D CAD/CAM) to cut and reposition bone and soft tissue, and 2) utilizing intraoperative feedback relative to preoperative imaging for the surgeon to provide more objective data on what is happening beyond the "eyeball test". However, none are meant for real-time placement feedback m areas where guide placement is more challenging, such as the three-dimensional facial skeleton. Also, there are no single platforms built to provide BOTH planning A D navigation - with seemless integration. Additionally, standard off-the-shelf vendor computer-assisted surgery systems may not provide custom features to mitigate problems associated with the increased complexity of this particular procedure. Furthermore, there are currently no validated methods for optimizing outcomes related to facial (soft tissue), skeletal (hard tissue), and occlusal (dental) inconsistencies in the setting of donor-to-recipient anthropometric mismatch— a major hurdle to achieving this specialty's full potential.
[0006] One known system includes pre-operative planning and cutting guides by way of computer manufactured stereolithographic models for human facial transplantation. However, such a system uses standard off-the-shelf vendor systems and does not include necessary features to mitigate the increased complexity of this particular procedure,
[0007] Additionally, known CAS paradigms for craniomaxillofacial surgery provide little capacity for intraoperative plan updates. This feature becomes especially important since in some circumstances during the transplantation surgery, it may be necessary to revise and update the preoperative plans intraoperatively.
[0008] What is needed in the art, therefore, is a single, fully-integrated platform, providing a computer-assisted surgery solution customized for pre-operative planning, intraoperative navigation, and dynamic, instantaneous feedback - in the form of biomechanical simulation and real-time cephalometrics - for facial transplantation that addresses common shortcomings of existing CAS systems and has the potential to improve outcomes across both the pediatric and adult-based patient population.
SUMMARY
100091 In an embodiment, there is a method for performing a medical procedure. The method can include creating a first 3D reconstruction of a skeleton, selecting a cut plane to bisect the 3D reconstruction, and forming a reference guide. The reference guide can include an attachment surface configured for attaching to a skeletal feature, and a navigation surface connected to the attachment surface and comprising a trackable reference geometry. The attachment surface can include a contoured surface corresponding to a geometiy defined by the interface of the cut-plane and contours of portions of the skeletal feature, and the attachment surface can be configured for attaching to the skeleton at a location substantially corresponding to a preselected location.
[0010] In another embodiment there is a medical procedure, comprising: attaching a first cranial reference unit to a skeleton; attaching a first fragment reference unit to the skeleton at a location different than the first cranial reference unit; tracking locations of the first cranial reference unit and the first fragment reference unit with a first tracker; creating a first 3D reconstruction of the skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit; superimposing a first virtual reference guide on the first 3D reconstruction at a location that corresponds to a proposed placement of an actual reference guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit; forming a first virtual fragment by segmenting the 3D reconstruction of the skeleton at a location adjacent to the first virtual reference guide; superimposing the first virtual fragment on the 3D reconstruction of the skeleton to form a hybrid 3D reconstruction, and performing an automated cephalometric computation for the hybrid reconstruction.
[0011] In another embodiment, there is a computing system for managing medical procedures. The system can comprise: at least one memory to store data and instructions; and at least one processor configured to access the at least one memory and to execute instructions. The instructions can comprise: controlling a first tracker to track the locations of a first cranial reference unit and a first fragment reference unit that are attached to a skeleton; generating a first 3D reconstruction of the skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit; superimposing a planned reference plane over portions of the first 3D reconstruction; generating a first virtual reference guide having a geometry that corresponds to an interface between intersecting portions of the planned reference plane and the first 3D reconstruction; controlling a device for manufacturing a reference guide according to the geometry of the first virtual reference guide; forming a first virtual fragment by segmenting the 3D reconstruction of the donor skeleton at a location adjacent to the first virtual reference guide; generating a second 3D reconstruction of the skeleton with the virtual reference guide superimposed on the first 3D reconstruction at a location that corresponds to a relative position of a reference guide; performing a cephalometric analysis of the first 3D reconstruction and the second 3D reconstruction; and superimposing the first virtual fragment on the second 31) reconstruction of the skeleton.
[0012J Advantages of at least one embodiment include 1) intraoperative plan updates based on hard tissue discrepancies between planned and executed procedure; 2) on-table feedback in the form of dynamic, real-time cephalometrics; and 3) pre-designed fixation plates matching the virtual plan. [0013] Another advantage of at least one embodiment includes increasing the robustness of conventional CAS paradigms by providing a robust surgical system to deal with situations in which tools and templates designed and fabricated preoperatively may not entirely address intraoperative surgical needs. Robustness of the planning and navigation strategy is especially important in total face transplantation given the long operating times.
[0014] Another advantage of at least one embodiment includes improved outcomes and decreased accompanying morbidity via shortened operative times, more precise surgical maneuvers, and improved margin of safety.
[0015] In some aspects, a computer-implemented method for cephalometry for orthognathic and craniomaxillofacial surgery is disclosed. The method can comprise transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient skeletal portion in the second reference frame; calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and providing updates of the one or more cephalometry metrics that were calculated.
[0016] The computer-implemented method can further comprise obtaining a hybrid
3D reconstruction model of a hybrid skeletal structure comprising a donor skeletal fragment anatomically positioned onto a cranium of a recipient: and identifying the set of cephalometry landmarks on the hybrid 3D reconstruction model,
[0017] The hybrid 3D reconstruction model can be obtained by creating a first 3D reconstruction of a skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit; superimposing a first virtual reference guide on the first 3D reconstruction at a location that corresponds to a proposed placement of an actual reference guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit; forming a first virtual fragment by segmenting the 3D reconstruction of the skeleton at a location adjacent to the first virtual reference guide; superimposing the first virtual fragment on the 3D reconstruction of the skeleton to form the hybrid 3D reconstruction.
[00181 The registration process can further comprise identifying, by a processor, a set of anatomical landmarks on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans; and creating, by a processor, a point-to- point registration between the set of anatomical landmarks associated with the donor skeletal fragment and the recipient skeletal.
[0019] The registration process can further comprise identifying, by a processor, a set of anatomical landmarks on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans; and creating, by a processor, a point-to- surface registration between the set of anatomical landmarks associated with the donor skeletal fragment and a surface model of the recipient skeletal using an iterative closest point algorithm.
[0020J The set of cephalometric landmarks can comprise one or more of: Gonion
("Go"), Nasion ("N"), A point ("A"), B point ("B"), Sella ("S"), Menton ("M"), left/right Zygoma ("ZY"), Os occipital ("OCC").
[00211 The tracking can comprise determining, during surgery, the orientation of the donor skeletal fragment with respect to the recipient skeletal portion by measuring one or more cephalometric landmarks from the set of cephalomctric landmarks using a tracking device.
[0022] The measuring can comprise measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasion, and the A point ("S-N-A"), measuring an angle between the sella, nasion, and the B point ("S-N-B"), measuring an angle between the A point, nasion, and the B point ("A-N-B"), measuring a distance between the os occipital and the nasion ("Occ-N"), measuring a distance between the left and right zygomas ("Zy-Zy"), measuring a distance between the sella and the nasion ("S- N"), measuring a distance between the gonion and the menton ("Go-M"), measuring a distance between the gonion and the B point ("Go-B"), measuring a distance between the A point and the sella ("S-A"), measuring a distance between the A point the B point ("B-A"), measuring a vertical overlap between upper and lower teeth ("overbite"), and measuring a horizontal overlap between upper and lower teeth ("overjet").
[0023] The first frame of reference can be a donor reference frame and the second frame of reference can be a recipient or a hybrid donor-recipient reference frame.
[0024J The providing updates can further comprise causing an interactive user- interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison.
[0025] The donor skeletal fragment can comprise at least a maxilla or mandible and the providing updates can comprise providing a visual indication as to how well one r more teeth of the hybrid maxilla-mandible combination match.
[0026J The updates can comprise a change in appearance of a visual indicator on a hybrid model as the donor skeletal fragment is mated with the recipient skeletal fragment.
[0027] In some aspects, a system for cephalometry for craniomaxillofacial surgery is disclosed. The system can comprise a memory storing instructions; and at least one processor coupled to the memory and executing the instructions to perform a method comprising transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient skeletal portion in the second reference frame; calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and providing updates of the one or more cephalometry metrics that were calculated.
[00281 In some aspects, a computer-readable medium is disclosed that can comprise instructions stored therein to perform a method comprising transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame; tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephal metric landmarks associated with a recipient skeletal portion in the second reference frame; calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and providing updates of the one or more cephalometry metrics that were calculated.
[00291 Additional advantages of the embodiments will be set forth in part in the description which follows, and in part will be understood from the description, or may be learned by practice of the invention. The advantages will be realized and attained by m eans of the elements and combinations particularly pointed out in the appended claims.
[0030] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
[0031] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
100321 FIG. 1 is a flowchart of general features of a surgical system of an
embodiment closes the loop between surgical planning, navigation and enabling
intraoperative updates to the plan.
100331 IGS. 2A-2C provide a schematic overview of a surgical system of an embodiment.
[0034] FIGS. 2D-2G are graphical representations of some components and/or features of the surgical system of FIGS. 2A-2C.
[0035] FIG. 3 is a flow chart depicting a procedure associated with use of the surgical system, for example, the surgical system of FIGS. 2A-2C.
[0036] FIG 4A is a CT-scan of reconstructed images of size-mismatched facial skeleton generated from segmentation software utilized for pre-operative planning.
[0037] FIG 4B shows a Segmented arterial system of craniomaxillofacial skeleton generated from CT angiography ( I A ) data allowing 3D, intraoperative mapping.
[0038] FIGS. 5A-5B shows depictions of on-screen images provided by a surgical system, such as the surgical system of FIG. 2A displaying real-time, dynamic cephalometrics and pertinent measurements applicable to humans. FIG. 5A shows donor's face-jaw-teeth alloflap in suboptimal position as compared to recipient's cranium FIG. 5B shows appropriate face-jaw-teeth positioning with immediate surgeon feedback and updated cephalometric data pertinent to a pre-clinical investigation. A surgeon may adjust the position of face-jaw-teeth segment upwards, downwards, forwards or backwards based on this realtime cephalometric feedback - since this information helps to predict optimal form and function. For instance, placing the face-jaw-teeth segment forward may improve the patient's airway, but if moved too far forward, it may cause at the same time the patient to have a significant overjet (i.e. malocclusion) and abnormal appearance on profile view.
[0039] FIG. 6 shows some pre-bent fixation plates with screw holes designed virtually to accommodate the donor-to-recipient skeletal mismatch areas and matching navigational cutting guides of a surgical system, for example, the surgical system of FIGS. 2A-2C.
100401 FIG. 7A is a photograph of a kinematic reference mount of an embodiment as it is affixed onto a donor's cranium with intermaxillary screws. A permanent suture (not visible) attaches stabilizers, such as springs and/or cross bars, which allow easy removal and replacement during surgery.
[0041J FIG. 7B is a photograph of a detachable rigid body with reflective markers attached to the reference body
100421 FIGS. 8A-8C include illustrations of cutting guides of the embodiments with navigational capabilities. FIG. 8 A illustrates a donor face-jaw-teeth allofiap recovery, FIG. 8C shows recipient preparation prior to transplant, FIG. 8C illustrates custom pre-bent fixation plate and palatal splint designed to achieve face-jaw-teeth alignment and skeletal inset with standard technique.
[00431 FIG. 9A-9D include photographs and renderings showing exemplary surgical results according to embodiments. 100441 FIGS. 1 OA- IOC are top-view (bird's eye view), left-sided profile view, and frontal view, respectively, of images displayed by an imaging system of a surgical system of the embodiments. The images depict a recipient skeleton and include real-time assessment of planned versus actual face-jaw-teeth positions.
[0045] FIGS. 11A-11B are "on screen" images displayed by an imaging sub-system of a surgical system of the embodiments. The images depict an ideal location of a cutting guide versus actual position and an actual inset position of donor alloflap for aesthetic, dental and skeletal relation in size -mismatched donors due to anterior translation of cutting guide.
[0046] FIG. 12 illustrates virtual osteotomy and planned cut plane placement on v irtual representations of a skeletal feature.
100471 FIG. 13 shows virtual placement of a cutting guide alongside photographs of an actual placement.
[0048] FIG. 14A illustrates a perspective view of a variation of a cutting guide, for example, a variation of the cutting guide of FIG. 13.
[0049] FIG. 14B illustrates a top view of a variation of a cutting guide, for example, a variation of the cutting guide of FIG. 13.
100501 FIG. 15 is an example method for real-time cephalometry for orthognathic and craniomaxillofacial surgery, according to the present teachings.
[0051] FIG. 16 is an example computer system that can be used to perform the methods provided herein, according to the present teachings.
DESCRIPTION OF THE EMBODIMENTS
100521 Reference will now be made in detail to the present embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. [0053] Notwithstanding that the numerical ranges and parameters setting forth the broad scope of the invention are approximations, the numerical values set forth in the specific examples are reported as precisely as possible. Any numerical value, however, inherently contains certain errors necessarily resulting from the standard deviation found in their respective testing measurements. Moreover, all ranges disclosed herein are to be understood to encompass any and all sub-ranges subsumed therein. For example, a range of "less than 10" can include any and all sub-ranges between (and including) the minimum value of zero and the maximum value of 10, that is, any and all sub-ranges having a minimum value of equal to or greater than zero and a maximum value of equal to or less than 10, e.g., 1 to 5. In certain cases, the numerical values as stated for the parameter can take on negative values. In this case, the example value of range stated as "less that 10" can assume negative values, e.g. -1 , -2, -3, - 10, -20, -30, etc,
[0054] The following embodiments are described for illustrative purposes only with reference to the Figures. Those of skill in the art will appreciate that the following description is exemplary in nature, and that various modifications to the parameters set forth herein could be made without departing from the scope of the present invention. It is intended that the specification and examples be considered as examples only. The various embodiments are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments.
[0055] Disclosed are embodiments of a computer-assisted surgery system that provides for large animal and human pre-operative planning, intraoperative navigation which includes trackable surgical cutting guides, and dynamic, real-time instantaneous feedback of cephalometric measurements/angles as needed for medical procedures, such as facial transplantation, and many other instances of craniomaxillofacial and orthognathic surgery. Such a system can be referred to as a computer-assisted planning and execution (CA P E.) system and can be exploited in complex craniomaxillofacial surgery like Le Fort-based, face- jaw-teeth transplantation, for example, and any type of orthognathic surgical procedure affecting one's dental alignment, and can include cross-gender facial transplantation.
[0056] The fundamental paradigm for CAS involves developing a surgical plan, registering the plan and instruments with respect to the patient, and carrying out the procedure according to the plan. Embodiments described herein include features for workstation modules within a CAS paradigm. As shown in Fig. 1 , a surgical system of the embodiments can enable intraoperative evaluation of a surgical plan and can provide instrumentation for intraoperative plan updates/revisions when needed.
[00571 Embodiments can include a system with integrated planning and navigation modules, for example, a system for tracking donor and recipient surgical procedures simultaneously. In general, features of such a system can include: 1 ) Two networked workstations concurrently used in planning and navigation of the two simultaneous surgeries for both donor and recipient irrespective of geographic proximity. 2) Two trackers, such as electromagnetic trackers, optical trackers (e.g., Polaris, NDI Inc.), and the like, for tracking bone fragments, tools, and soft tissues, 3) Novel guides, reference kinematic markers, etc. as required for navigation. These features are described in further detail with respect to FIGS. 2A-2G.
[0058J Preoperative planning can include the following tasks: a) Segmentation and volumetric reconstruction of the donor and recipient facial anatomy; b) Planning for patient- specific cutting guide placement; c) Cepbalometric analysis and biomechanical simulation of the hybrid skeleton's occlusion and masticatory function, respectively; d) Fabrication of the hybrid cutting guides enabling both geometric ("snap-on" fit) and optical navigation; e) 3D mapping the vascular system on both recipient and donor facial anatomy; f) Plan updates, if necessary, based on the feedback from the intraoperative module. As used herein, "snap-on fit" or "snap-on" or "snap on" is used to describe the way an item, such as a cutting guide, attaches to a pre-determined area. That is, the cutting guide actually "snaps-on" to a certain pre-determined area along the facial skeleton, and in all other areas it doesn't fit properly since size and width varies throughout significantly with many convexities and concavities.
[0059] Intraoperative tasks of embodiments described herein can generally include: 1 ) registration of the preoperative model reconstructed from the CT data to donor and recipient anatomy; 2) visualization (using information from the tracker, such as an electromagnetic tracker, optical tracker, and the like) of the instruments and cutting guides to help the surgeon navigate; 3) verify the placement of cutting guides, and performing real-time cephalometric and biomechanical simulation for occlusion analysis, if, for any reason, the osteotomy sites need to be revised; 4) dynamically tracking the attachment of the donor fragment to the recipient and provide quantitative and qualitative (visual) feedback to the surgeon for the purpose of improving final outcomes related to form (i.e. overall facial aesthetics) and function (i.e. mastication, occlusion relation, airway patency). Such a procedure is described in further detail below with respect to FIG. 3.
Preoperative Planning
[00601 I general, a method for performing a surgery includes a virtual surgical planning step that includes performing segmentation and 3D reconstruction of recipient and donor CT scans (e.g., Mimics 15.01 , Materialise, Leuven Belgium). Virtual osteotomies can then be performed within the software to optimize the donor/recipient match. Patient- customized cutting guide templates can then be created (3-matic 7.01 , Materialize, Leuven, Belgium). These templates can then be rapid prototyped via an additive manufacturing modeling process, which can include, but is not limited to, stereolithography or 3D printing and the like. The surgical method and system for performing surgery are described in further detail below. [0061] During the initial planning stage, surgeons determine a virtual plan 401 based on the recipient's craniomaxillofacial deformity irrespective of the donor. From registered CT data, segmentation software generates volume data for specific key elements (e.g., the mandible, maxilla, and cranium) used for preoperative planning and visualization. The planning workstation automatically generates the expected cut geometry of the donor fragment 402 together with the recipient, thereby defining the predicted facial skeleton with accompanying hybrid occlusion. If available, blood vessels 404 are segmented from CT angiography scans as shown in FIG. 4B. That is, in an embodiment nerves (via known nerve foramens) and vessels (both arteries and veins) can be localized to provide a full anatomical "road map" to the surgeons for a more precise, time-saving anatomical dissection with perhaps decreased blood loss and smaller incisions. The planning module can also perform static cephalometric analysis and evaluation of face- jaw-teeth harmon via biomechanical simulation on varying constructions of the hybrid donor and recipient jaws, such as that shown in FIGS. 5A-5B. Using this tool, the surgeon can evaluate different placements for the donor's face- jaw-teeth alloflap on the recipient's facial skeleton in relation to orbital volumes, airway patency, facial projection, and dental alignment. An automated cephalometric computation for the hybrid face indicates the validity of the planned surgery from both an aesthetic, functional, and reconstructive standpoint based on various measurements of pertinent landmarks as shown, for example, in Tables 1 A-B.
10()62 | Table 1A. Pertinent landmarks for cephalometric analysis
SYMBOL NAME and DEFINITION
Go G on ion: a point mid-way between points defining angles of the mandible
Gn Gnathion: most convex point located at the symphysis of the mandible
ALV Alveola re: mid-line of alveolar process of the upper jaw, at mcisor - alveolar junction
Lower Incisor Base: midline of anterior border of alveolar process of mandible at the mcisor- LIB
alveolar junction
PA Parietale: most superior aspect of skull in the midline, (formed by nuchal crest of occipital bone and parietal bone)
Pronasale: bony landmark representing anterior limit of nasal bone
Zygion: most lateral point of malar bone
OCC Occipital region: midpoint between the occipital condyles
[0063] Table 1 B. Cephalometric measurements and related units.
Figure imgf000018_0001
[0064] To evaluate and predict cephalometric relationships both during planning and intra-operative environments, the system can use validated, translational landmarks between swine and human to thereby allow effective pre-clinical investigation. The cephalometric parameters defined by these landmarks can be automatically recalculated as the surgeon relocates the bone fragments using a workstation's graphical user interface.
100651 Preoperative planning can also involve fabrication of custom guides 207 as shown in FIG. 6 and palatal splints 223 as illustrated in FIG. 8C. Planned cut planes 403 (as shown in FIG. 4) can be used for defining the geometry of the cutting guides to thereby provide patient-specific cutting guides. These cutting guides can be designed according to the skeletal features through which the cutting plane intersects, such as an outer skeletal surface of a cross section defined by the cutting plane, and can be fabricated via stereolithography, or via any additive manufacture technology. In an embodiment, custom cutting guide templates can be separately designed and navigational registration elements can be added (Freeform Plus, 3D Systems, Rock Hill, SC). As discussed above, the surgical guides can be manufactured via additive manufacturing technology (AMT). The cutting guides can, therefore, be a 3D printing material such as a polymer, and can include an attachment surface 216 configured for attaching to a skeletal feature, and can have a "snap-on" fit to both donor and recipient. As described above, the attachment surface comprises a contoured surface that corresponds to contours of the skeletal feature within the planned cut planes. A navigation surface, such as a reference geometry 217 connected, built into, or attached to the guide structure directly or via attachment guides (not shown) enables dynamic intraoperative tracking of guides with respect to the patient' s skeleton. Palatal splints ensure planned dento- skeletal alignment fixation following Le Fort-type facial transplants or any similar type of surgery. Fixation plates 216 can include a primary surface 216' and a plurality of fixation surfaces 221. such as eyelets, for screw placement to provide rigid immobilization at the irregular skeletal contour areas along various donor-to-recipient interfaces. Having pre-bent fixation plates decreases total operative times and helps to con irm accurate skeletal alignment by overcoming step-off deformities at bone-to-bone interfaces. Accordingly, at least one of the plurality of fixation surfaces can be located on one side of the primary surface and configured for attaching the fixation surface to a donor skeleton fragment, and at least one of another of the plurality of fixation surfaces is located on another side of the primary surface and configured for attaching the fixation surface to a recipient skeleton. The whole fixation plate or just portions of the fixation plate, such as the primary surface or fixation surfaces can be manufactured via additive manufacturing technology.
[00661 The cutting guide's navigation surface can include trackable objects, for example, on the reference geometry, such as infrared (1R) reflective coatings or ! emitters. For example, the trackable objects can include a plurality of integrated tracking spheres, each of which has an 1R reflection surfaces.
Intraoperative Surgical Assistance
100671 Individual navigation for both donor and recipient surgeries tracks the cutting guides with respect to planned positions. Surgeons can attach a reference unit, such as a kinematic reference mount to three intramedullary fixation (IMF) screws arranged in a triangular pattern on each the donor and recipient craniums as shown in FIG. 7Λ-7Β. Accordingly, in an embodiment, there is a reference unit 205 for providing real-time surgical navigation assistance. The reference unit for providing real-time surgical navigation assistance can include a kinematic mount 203, at least one fixation rod 202, at least one support 204, and reference geometry 201. The kinematic mount 203 can include a base with a plurality of recesses defined by sidewalls 233, at least one pair of slots 235 defined by portions of the sidewalls, with each slot of the pair formed across the recess from the other slot, and at least one guide hole 237 extending through a length of the fixation plate. The at least one Fixation rod 202 can extend through the at least one guide hole 237. An end of the at least one support rod can be configured for attaching to a skeleton of a being 209. The at least one support can be disposed in the pair of slots and can be configured to attach to the being. The reference geometry 201 can be attached to the at least one fixation rod.
[0068] The at least one support 204 can include at least one cross-bar 204' with ends that are configured for placement in the slots 235, and a spring 204"attached at one end to the at least one cross-bar 204' and attached at another end to the patient (e.g., a human- being). The spring attached at another end to the being can be attached via a suture (further described below). The 205 can further include a trackable object disposed on the reference geometry. The trackable object disposed on the reference geometry can include an IK reflective surface. The mount 203 can be made via additive manufacturing techniques and can therefore comprise a polymer. The at least one fixation rod can include a plurality of intramedullary fixation screws. The base can be configured for being detachably mounted on the skeleton of the being. The intramedullary fixation screws can be arranged in a triangular pattern. Accordingly the guide-holes can be configured in a triangular pattern on the base.
[00691 Accordingly, the mount design permits flexibility in the placement of the IMF screws so that no template is necessary. A spring 204" can attach to each IMF screw via suture threaded through, for example, the eyelets. These springs hold the cranial mount 203 in place and allow easy removal and replacement of the cranial mount (e.g.. during positional changes required for bone cuts and soft tissue dissections). The key design advantages of the reference are detachability and use of Intramaxillary fixation ( IMF) screws for stable attachment.
[0070] The reference geometry 201 (e.g., which can be purchased from Brainlab,
Westchester, IL, USA) attached to the kinematic mount 203 provides a static coordinate frame attached to the patient. The surgeon can digitize three bony landmarks (e.g. the inferior aspect of the orbits and antero-superior maxilla) to define a rough registration between the environment and virtual models. For example, three, consistent points can be selected which can be quick to find, easy to reproduce on numerous occasions, and would remain constant irrespective of the user and his/her experience with the systems of the embodiments. The surgeon can thereby collect several point sets from exposed bone using a digitization tool and uses an iterative closest point registration technique to refine the registration. As shown in FIG. 8, once registered, the surgeon navigates the placement of the cutting guide 217 using the combination of "snap-on" geometric design and the tracking system coupled to visual feedback This allows assessment of inaccuracies related to soft tissue interference, iatrogenic malpositioning, anatomical changes since acquiring original C I scan data, and/or imperfections in cutting guide design or additive manufacturing process.
[0071 J Self-dril ling screws affix the cutting guide to the patient's skeleton to ensure osteotomies are performed along pre-defined planes, maximizing bony congruity. After dissecting the donor's maxillofacial fragment and preparing the recipient's anatomy, the surgical team transfers the facial alloflap. The system is configured to track the final three- dimensional placement of, for example, the Le Fort-based alloflap providing real-time visualization such as that shown in FIG. 5A-5B. This provides real-time visualization of important structures such as new orbital volumes (vertical limit of inset), airway patency ( posterior horizontal limit of inset), and facial projection (anterior horizontal limit of inset). Once confirmed, the surgeon fixates the donor alloflap to the recipient following conventional techniques with plates and screws.
[0072] Accordingly, returning to FIG. 2A-2G, there is a system 2000 for tracking donor and recipient surgical procedures simultaneously. The system can include a donor subsystem 200-D, a recipient sub-system 200- R and a communications link (indicated by the horizontal dotted-line) such as a communication link that provides TCP/IP data transfer between the donor and recipient sub-systems. The donor sub-system can include a first computer workstation 21 5-1). a first cranial reference module 205-D, a first cutting guide 207-1) for attaching to a preselected location of a donor skeleton 206, a first fragment reference module 201 -I)\ and a first tracker 21 3-1). The first cutting guide 207-1) can include an attachment surface 219-R configured for attaching to a skeletal feature, and a navigation surface 217-D connected to the attachment surface and comprising a trackable reference geometry. The first tracker 213-D may be configured to be in communication with the first computer workstation, for example, via a communications link. The first tracker can be configured to track, for example via IR optical tracking, a location of a portion of the first cranial reference module, a portion of the first cutting guide and a portion of the first fragment reference module. The recipient sub-system 200-R can include a second computer workstation 215-R, a second cranial reference module 205 -R, and a second tracker 213-R. The second tracker 213-R can be configured to be in communication with the second computer workstation, for example, via a communications link. The second tracker can be configured to track, for example, via IR optical tracking, a location of a portion of the second cranial reference module. The communications link can connect the first computer workstation and the second computer workstation such that the first computer workstation and second computer workstation are able to communicate.
100731 The recipient sub-system 200-R can further include a second fragment reference unit 201-R. The second tracker 213-R can further be configured to track a location of a portion of the second fragment unit.
1007 1 The recipient sub-system 200-R can further include a second cutting guide
219-R for attaching to a preselected location of a recipient skeleton 208. The second tracker 2 13-R can further be configured to track a location of a portion of the second cutting guide.
[0075] Additionally, when a surgeon has removed the donor skeletal fragment from the donor, it can then be transferred for attachment onto the recipient. Accordingly, the second tracker 213-R can be further con igured to track a location of a portion of the first cutting guide 207-1) so that it can be matched relative a position of the second cranial reference module 205-R.
[0076] The first cranial reference unit, the second cranial reference unit, or both the first and second cranial reference units can include a kinematic mount 205 as described above.
100771 Using the system of FIGS. 2A-2G, it is possible to execute a surgical method, such as the surgical method described in FIG. 3. For example, in step 302 a donor, recipient and transplant type are identified. CT/CTA scans of both the donor and recipient are collected and 3D models are created in step 304. The donor and recipients are prepared for surgery with the creation of skin incisions in step 306. The method continues at 307 with attachment of reference guides and performing registration. For example, a first cranial reference unit can be attached to a donor skeleton, a first fragment reference unit can also be attached to the donor skeleton at a location that is different that of the first cranial reference unit. The locations of the first cranial reference unit and the first fragm ent reference unit ca be tracked with a first tracker. 3D reconstructions of the donor skeleton can be constructed showing a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that correspond to relative positions of the first cranial reference unit and the first fragment reference unit.
[0078] A second cranial reference unit can be attached to a recipient skeleton. A second location of the second cranial reference unit can be tracked with a second tracker. A second 3D reconstruction of the recipient skeleton can be created with a second virtual cranial reference unit superimposed on the second 3D reconstruction at a location that corresponds to a location of the second cranial reference unit. At 308, vessels and nerves are dissected and exposed. At this stage, navigation of the patient-specific cutting guides can occur, with plan revision and updates provided periodically. For example, a first cutting guide, such as a patient-specific cutting guide according to the descriptions provided above, can be attached onto the donor skeleton at a preselected location such as that corresponding to a planned cut-plane. The location of the first cutting guide can be tracked with the first tracker. A first virtual cutting guide can be superimposed on the first 3D reconstruction at a location that corresponds to a location of the first cutting guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit.
100791 A first virtual fragment can be formed by segmenting the 3D reconstruction of the donor skeleton at a location adjacent to the first virtual cutting guide. The first virtual fragment can be superimposed on the second 3D reconstruction of the recipient skeleton. |0080J At step 310, a surgeon can perform an osteotomy on the donor skeleton to remove the first fragment but cutting the skeleton along a cutting path defined by the first cutting guide. Upon transferring the removed skeletal fragment from the donor, the first cutting guide can be tracked, by the second tracker, for example, when the fragment is brought near the recipient for attachment. The surgeon can then navigate placement of the cutting guide as it is dynamically tracked at step 311 , and will receive feedback from the system such as by referring to a first virtual fragment that is superimposed on the second 3D reconstruction to form a hybrid 3D reconstruction. At step 3 12. the first fragment can then be attached to the recipient skeleton via known surgical methods and the incisions can be sutured in step 314.
[0081] The step of superimposing the first virtual fragment on the second 3D reconstruction of the recipient skeleton can include performing an automated cephalometric computation for the hybrid reconstruction. In fact, the step of superimposing the first v irtual fragment on the second 3D reconstruction can include providing a communications link between a first workstation on which the first 3D reconstruction is displayed and a second workstation on which the second 3D reconstruction is displayed, and initiating a data transfer protocol that causes the first workstation and the second workstation to send electronic signals through the communications link.
100821 Surgical methods of the embodiments described above can also include attaching a second cutting guide at a preselected location on the recipient skeleton. The second cutting guide can also include features of the cutting guide described above.
100831 For the surgical methods of embodiments described herein the donor skeleton can include a male skeleton or a female skeleton and the recipient skeleton comprises a female skeleton. Alternatively, the donor skeleton can include a male or female skeleton and the recipient skeleton can include a male skeleton.
|0084| Surgical methods of the embodiments can further include steps for assessing a size-mismatch between the donor skeleton and the recipient skeleton by measuring a dorsal maxillary interface between the first fragment and recipient skeleton. In an embodiment, the surgical method can include selecting a location of the first fragment onto the recipient skeleton that minimizes dorsal step-off deformity at the area of osteosynthesis. 100851 In an embodiment, the first cutting guide, second cutting guide or both the first cutting guide and the second guide comprise concentric cutting guides.
100861 Surgical methods of embodiments can further include mapping the vascular system on the facial anatomy of both the recipient and the donor and superimposing corresponding virtual representations of the vascular system and the facial anatomy onto the first 3D representation, such as shown in FIG. 4B
[0087] Surgical methods of embodiments can include a method for registration of a preoperative model, for example a model reconstructed from CT data, to donor and recipient anatomy. Such a method can include: creating a plurality of indentations on the donor skeleton, creating a plurality of virtual markers on the first 3D reconstruction of the donor skeleton corresponding to the locations of the indentations on the donor skeleton, placing a trackable object on at least one of the plurality of indentations, and determining whether a subsequent location of the virtual markers is within a predetermined tolerance relative to an actual subsequent location of the indentations.
[0088] EXAMPLES
[0089J Example 1
100901 Live transplant surgeries (n=2) between four size-mismatched swine investigated whether or not an embodiment could actually assist a surgical team in planning and in executing a desired surgical plan. As shown in FIGS. 9A-9B, the first live surgery confirmed the proposed utility of overcoming soft and hard tissue discrepancies related to function and aesthetics. The final occlusal plane within the first recipient was ideal and consistent with the virtual plan as seen on lateral cephalogram as shown in FIG. IOC. Preoperative functional predictions of donor-to-recipient occlusion were realized based on cephalometric analyses as shown in FIG. 9C performed both before and after surgery. Soft tissue inconsistencies of the larger-to-smaller swine scenario were also reduced following the predicted movements of face, jaw and teeth as shown in FIG. l OD.
100 11 The second live surgery showed improved success as compared to its predecessor due to surgeon familiarity and technology modifications. System improvements and growing comfort of the surgeons led to reduced operative times for both donor and recipient surgeries. Overall the surgical time reduced from over 14 hours to less than 8 hours due to improved surgical workflow and increased comfort with a system of an embodiment.
[00921 Based on the results obtained in the live and plastic bone surgeries, the functions associated with setting up a system of an embodiment (attaching references, performing registration, attaching cutting guides) adds about 1 1 minutes to the total length of surgery.
1009 1 The system also recorded information, such as rendering information which can be stored in a storage medium of a workstation, relating the donor fragment 1002 to the recipient 1010 qualitatively as shown by color mismatch 1004, which matched the postoperative CT data as shown in FIG. 10. The recipient cutting guide 1107' was not placed as planned 1107, howev er, due to an unexpected collision between cranial reference mount and recipient cutting guide as shown in FIGS 1 1 Α-Ί 1 B. In this case, there was anterior translation of the cutting guide (toward the tip of the swine's snout) by approximately 4cm.
100941 Ov erall, the donor 1 106 and recipient craniums (n= ) 1 108 were registered successfully to the reference bodies for both live surgeries. The model to patient registration error across the surgeries was 0.6 (+/-0.24) mm. The cutting guide designs of the embodiments prov ed highly useful in carrying out the planned bone cuts, which compensated for size-mismatch discrepancies between donor and recipient. Marking spheres fixated to the guides allowed real-time movement tracking and "on-table" alloflap super imposition onto the recipient thereby allowing visualization of the final transplant result. [0095] Example 2
[0096] Female and male donor heads ( n=2). double-jaw, Le Fort Ill-based alloflaps were harvested using handheld osteotomes, a reciprocating saw, and a fine vibrating reciprocating saw. Both osteocutaneous alloflaps were harvested using a double-jaw, Le Fort Ill-based design (a craniomaxillofacial disjunction), with preservation of the pterygoid plates, incorporating all of the mid facial skeleton, complete anterior mandible with dentition, and overlying soft tissue components necessary for ideal reconstruction.
[00971 Prior to transplantation, both scenarios were completed virtually given the gender-specific challenges to allow custom guide fabrication as shown in panels A-H of FIG. 12, Once assimilated, the donor orthognathic two-jaw units were placed into external maxilla- mandibular fixation (MMF) using screw- fixated cutting guides to retain occlusal relationships during the mock transplants as shown in panels A-D of FIG. 13.
[0098] As shown in FIGS. 13, 14A-14B, an embodiment of a cutting guide 1307 can include a frame 1307' with at least one attachment surface 1319, for example 1 to 6 attachment surfaces, configured for attaching the cutting guide to a skeletal feature. The cutting guide can include a navigation surface 1317 (not shown in FIG. 13) connected to the frame. The navigation surface can include a reference geometry that can be tracked by a tracker, for example, via IR optical tracking. The at least one attachment surface 1319 can include a contoured surface corresponding to contours of portions of the skeletal feature, for example, such as the contours of a skeletal feature that intersect a planned-cut plane as indicated by 1319' in FIG. 12. The at least one attachment surface 1319 can be detachably connected to a skeletal feature. The at least one attachment surface 1319 can be detachably connected to an attachment guide 1341 . The attachment guide 1341 can be detachably connected to a portion of the frame 1307'. For example, attachment guides 1341 can be detachably connected via slots integrated into frame 1307', or held in place against frame 1307 with screws or the like. In another embodiment, attachment guides 1341 are formed as portions of frame 1307' but can be removed. The frame can have a ring-like shape (as shown in FIG. 13) or can have a c inder-like shape (as shown in FIG. 14A). Frame 1 307 ' having a cylinder like shape can have a bottom surface 1307" that rests against a patient's soft tissue to provide support for the frame.
[0099] For example, during a surgical procedure, 3D reconstructions of portions of a donor skeleton are created. Planned cutting planes are selected and a cutting guide with attachment surfaces having a contoured surface corresponding to contours of portions of the skeletal feature, for example, such as the contours of a skeletal feature that intersect a planned-cut plane, is designed. The designed cutting guide is manufactured via, for example, an additive manufacturing process. The designed cutting guide with an integrated navigation surface is attached to the patient. For example, the cutting guide can be designed such that it has a snap-on fit over the skeletal feature, which can be further secured to the skeletal feature with set screws. A surgeon removes a donor skeletal fragment with the cutting guide attached to the fragment. The donor skeletal fragment is then attached to the recipient. As the donor skeletal fragment is attached to the recipient, the attachment surfaces are removed from the donor fragment. For example, each of the attachment guides 1341 with a corresponding attachment surface 1319 can be detached from the frame 1 307' . As this occurs, a cylindrical shaped frame 1307' has a bottom surface 1307" that rests against the soft tissue of the patient to provide stability for the remaining portions of the cutting guide and to hold the navigation surface 1317' in place.
[00100] While the invention has been illustrated respect to one or more implementations, alterations and/or modifications can be made to the illustrated examples without departing from the spirit and scope of the appended claims. In addition, while a particular feature of the invention may have been disclosed with respect to only one of several implementations, such feature may be combined with one or more other features of the other implementations as may be desired and advantageous for any given or particular function.
[00101] For example, the embodiments described herein can be used for navigation and modeling for osteotomy guidance during double-jaw face transplantation and single -jaw maxillofacial transplantation, and more traditional orthognathic cases.
[00102] Embodiments described herein can include a platform for preoperative planning and intraoperative predictions related to soft tissue-skeletal-dental alignment with real-time tracking of cutting guides for two mismatched jaws of varying width, height and projection. Additional safeguards, such as collection of confidence points, further enable intraoperative verification of the system accuracy. This, in addition to performing real-time plan verification via tracking and dynamic cephalometry, can considerably increase the robustness of the systems described herein. Moreover, systems of embodiments can include a modular system that allows additional functionality to be continually added.
[00103] Embodiments described herein can include an approach for resolving conflicts in case of position discrepancies between the placement of the guide and the guide position prompted by the navigation software. Such discrepancy may be due to either the guide (soft tissue interference, iatrogenic malposition ing, changes since the CT data was obtained or imperfections in cutting guide construction/printing), and/or the navigation system (e.g. registration error, or unintended movement of the kinematic markers). To resolve these source(s) of discrepancy, four indentations can be created on a bone fragment (confidence points) where a reference kinematic marker is attached. At any time during an operation, a surgeon can use a digitizer and compare the consistency of the reported coordinates of the indentations via navigation to their coordinates with respect to a virtual computer model. [00104] Embodiments described herein can include a system that provides real-time dynamic cephalometrics and masticatory muscle simulation for both planning and intraoperative guidance.
[00105] FIG. 15 is an example method of a computer-implemented method for cephalometry for orthognathic and/or cran iomaxil lofac ial surgery 1500, according to the present teachings. At 1505, the method includes transforming a set of cephalometric landmarks from a donor skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame. As used herein, "donor" can imply that the skeletal fragment is from another person or the same person from whom the donor skeletal fragment is harvested. For example, the first frame of reference can be a donor reference frame and the second frame of reference can be a recipient or a hybrid donor-recipient reference frame.
[00106] By way of one example, the transforming can be performed based, at least in part, on a hybrid 3D reconstruction model of a hybrid skeletal structure comprising a donor skeletal fragment anatomically positioned onto a cranium of a recipient. A set of cephalometry landmarks can then be identified on the hybrid 3D reconstruction model. The hybrid 3D reconstruction model can be created by a first 3D reconstruction of a skeleton with a first virtual cranial reference unit and first virtual fragment reference unit superimposed on the first 3D reconstruction at locations that corresponds to relative positions of the first cranial reference unit and the first fragment reference unit. A first virtual reference guide can be superimposed on the first 3D reconstruction at a location that corresponds to a proposed placement of an actual reference guide relative to the location of the first cranial reference unit or the location of the first fragment reference unit. A first virtual fragment can be formed by segmenting the 3D reconstruction of the skeleton at a location adjacent to the first virtual reference guide. The first virtual fragment can then be superimposed on the 3D reconstruction of the skeleton to form the hybrid 3D reconstruction.
[00107] The method 1500 can use a set of cephalometric landmarks, which can comprise one or more of: Gonion ("Go"), Nasion ("N"), A point ("A"), B point ("B"), Sella ("S"), Menton ("M"), left/right Zygoma ("ZY"), Os occipital ("OCC"). Other suitable cephalometric landmarks, may be used in conjunction with the above-listed group or in replacement of those listed above depending on the particular circumstances of the present application.
[00108] By way of one example, the registration process can be preformed by computer system 1600, discussed below, and can include identifying a set of anatomical landmarks on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans and creating a point-to-point registration between the set of anatomical landmarks associated with the donor skeletal fragment and the recipient skeletal. By way of another example, the registration process can include collecting a set of (unknown) points on the donor skeletal fragment and the recipient skeletal portion from the previously acquired medical imaging scans and creating a point-to-surface registration between the set of collected points associated with the donor skeletal fragment and a surface model of the recipient skeletal using an iterative closest point algorithm. Other registration techniques can be used including, but are not limited to, an image-based 2D/3D registration as is known in the art. These registration techniques can use an optical tracker, such as the optical tracker 213 in FIG. 2G, or an electromagnetic tracker, as is known in the art.
[00109] At 1510, the method includes tracking movement, based on one or more signals from one or more sensors, in real-time during surgery of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the donor skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a recipient skeletal portion in the second reference frame. For example, as shown and discussed in relation to FIG. 2Λ - 2C. the tracker 213 is able to track one or more reflectors of a donor or recipient mount that can be affixed to the donor skeletal fragment or the recipient skeletal fragment, respectively. At 1515, the method includes calculating one or more cephalometry metrics in real-time during surgery based on the movement that is tracked.
[00110] By way of one example, the tracking can comprise determining, in real-time during surgery, the face and jaw relations of the hybrid skeleton by measuring one or more cephalometric landmarks from the set of cephalometric landmarks using a tracking device. The measuring can comprise measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasi on. and the A point ("S-N-A"), measuring an angle between the sella, nasion, and the B point ("S-N-B"), measuring an angle between the A point, nasion, and the B point ("A-N-B"), measuring a distance between the os occipital and the nasion ("Occ-N"), measuring a distance between the left and right zygomas ("Zy-Zy"), measuring a distance between the sella and the nasion ("S-N"), measuring a distance between the gonion and the menton ("Go-M"), measuring a distance between the go n ion and the B point ("Go-B"), measuring a distance between the A point and the sella ("S- A"), measuring a distance between the A point the B point ("B-A"), measuring a vertical overlap between upper and lower teeth ("overbite"), and measuring a horizontal overlap between upper and lower teeth ("overjet"). Other cephalometric metrics can also be measured for other cephalometric landmarks depending on the particular constraints and requirements under consideration.
[0011 11 At 1 520, the method includes providing updates and/or real-time feedback of the one or more cephalometry metrics that were calculated. The updates and/or real-time feedback can be provided by a processor of the computer system, such as computer 21 5-R, which can cause an interactive user-interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison. For example, as shown in discussed in relation to FIGS. 5A and 5B, a computer, such as computer 215-R, can display graphic that shows real-time cephalometric results as the donor skeletal fragment is mounted onto the recipient. Each cephalometric metric that is calculated can be shown along a range of predetermi ned or baseline metrics for comparison, such that the surgeon can visualize the results of the surgery and can make corrections or revisions based on the feedback that is displayed. Additionally, the updates and/or real-time feedback can be in a form such as a change in appearance of a visual indicator on a hybrid model as the donor skeletal fragment is mated with the recipient skeletal fragment within a predetermined distance tolerance, as it is being tracked by tracker 213 and as is shown and described in relation to FTGS. 2B, 2C, 1 1 A, and 1 I B, where the appearance, i.e., color is caused to change from one color to another color. For example in FIGS. 2B and 2C, the color changes from red to green when the donor skeletal fragment is properly mounted onto the recipient. Additionally or alternatively, other modes of indication may be used including, but are not limit to, audio and/or tactile feedback. By way of one example, the donor skeletal fragment can comprise at least a maxilla or mandible and the real-time feedback that is provided can comprise providing a visual indication as to how well one or more teeth of the hybrid maxilla-mandible combination match.
[00112] FIG. 16 illustrates a schematic view of such a computing or processor system 1600, which can include the computers 21 5-1) and 215-R, according to an embodiment. The processor system 1600 may include one or more processors 1602 of varying core configurations (including multiple cores) and clock frequencies. The one or more processors 1 602 may be operable to execute instructions, apply logic, etc. It will be appreciated that these functions may be provided by multiple processors or multiple cores on a single chip operating in parallel and/or commimicably linked together. In at least one embodiment, the one or more processors 1602 may be or include one or more GPUs.
[00113] The processor system 1600 may also include a memory system, which may be or include one or more memory devices and/or computer-readable media 1604 of varying physical dimensions, accessibility, storage capacities, etc. such as flash drives, hard drives, disks, random access memory, etc., for storing data, such as images, files, and program instructions for execution by the processor 1602. In an embodiment, the computer-readable media 404 may store instructions that, when executed by the processor 1602, are configured to cause the processor system 1600 to perform operations. For example, execution of such instructions may cause the processor system 1600 to implement one or more portions and/or embodiments of the method described above.
1001 14] The processor system 1600 may also include one or more network interfaces 1606. The network interfaces 1606 may include any hardware, applications, and/or other software. Accordingly, the network interfaces 1606 may include Ethernet adapters, wireless transceivers, PCI interfaces, and/or serial network components, for communicating over wired or wireless media using protocols, such as Ethernet, wireless Ethernet etc.
[001151 The processor system 1600 may further include one or more peripheral interfaces 1608, for communication with a display screen, projector, keyboards, mice, touchpads, sensors, other types of input and/or output peripherals, and/or the like. In some implementations, the components of processor system 1600 need not be enclosed within a single enclosure or even located in close proximity to one another, but in other implementations, the components and/or others may be provided in a single enclosure.
[00116] The memory device 1604 may be physically or logically arranged or configured to store data on one or more storage devices 161 0. The storage device 1610 may include one or more file systems or databases in any suitable format. The storage device 1610 may also include one or more software programs 1612. which may contain interpretable or executable instructions for performing one or more of the disclosed processes. When requested by the processor 1602, one or more of the software programs 1612, or a portion thereof, may be loaded from the storage devices 1610 to the memory devices 1604 for execution by the processor 1602.
[00117] Those skilled in the art will appreciate that the above-described componentry is merely one example of a hardware configuration, as the processor system 1600 may include any type of hardware components, including any necessary accompanying firmware or software, for performing the disclosed implementations. The processor system 1600 may also be implemented in part or in whole by electronic circuit components or processors, such as application-specific integrated circuits (ASTCs) or field-programmable gate arrays (FPGAs).
[00118] The foregoing description of the present disclosure, along with its associated embodiments and examples, has been presented for purposes of illustration only. It is not exhaustive and does not limit the present disclosure to the precise form disclosed. Those skilled in the art will appreciate from the foregoing description that modifications and variations are possible in light of the above teachings or may be acquired from practicing the disclosed embodiments.
[00119] ADDITIONAL EMBODIMENTS
[001201 Osseointegrated dental implants
1 0121 1 Patients with poor or missing dentition require dental implants to improve mastication. A popular modality with increasing indications include "osseointegrated dental implants". Osseointegrated dental implants can include, and may consist of, a two-piece permanent implant device, which is placed into either the maxil la or mandible skeleton with a power drill for placement and stability. A second piece, in the shape of a tooth for example, is screwed onto the secure base. An embodiments of the CAPE system described above can be used to provide the dentist or surgeon real-time cephalomteric feedback in an effort to restore ideal occlusion and predict optimized mastication with biomechanical predictions - as similar to maxillofacial transplantation. As such, the dentist or surgeon placing them needs to know the bone stock quality of the jaw(s) and angle to place the framework. In summary, the CAPE system described above may be applied to this specialty.
[00122] Osseointegrated craniofacial prosthetics
[00123] Patients with severe cranial or facial disfigurement may be poor surgical candidates due to overwhelming co-morbities and/or because of an accompanying poor prognosis. Therefore, to help return these patients into society, some use craniofacial prosthetics as a way to restore "normalcy". Application of these three-dimensional prosthetics replacing absent craniofacial features (ie. Nose, eye, etc) may either be hand-molded/painted by an anaplastologist or printed with 3D technology by a prostheticraniofacialian. Either way, in an embodiment, the CAPE system described above can provide a one-stop solution for patients requiring alloplastic and/or bioengineered prosthetic reconstruction for large craniomaxillofacial deformities. The craniofacial implants can be tracked as similar to a donor face-jaw-teeth segment described above. For example, pre-placement images of the prosthetic could be fabricated, and surgical plans could be optimized since these appliances are placed with osseointegrated devices as similar to dental implants described above - with rigid plates and screws. As such, the surgeon placing them needs to know the bone stock quality and angle to place the framework, and also needs to know with visual feedback as to the ideal position in three-dimensional space. In summary, the CAPE system described here may be applied to this specialty.
[00124] Craniomaxillofacial trauma reconstruction [00125] Patients suffering from acute or chronic facial disfigurement is a common type seen by the craniomaxillofacial surgeon. Both penetrating and/or blunt trauma may cause significant damage to the underlying facial skeleton. As such, in an embodiment, the CAPE system technology described herein allows the surgeon to assess and optimize bone fragment reduction and reconstruction with real-time feedback. In addition, fractures affecting the jaws can be aided by real-time cephalometrics in hopes to restore the patient back to their pre- trauma angle/measurements (as a way to assure proper occlusion). Navigation, as described above in an embodiment of the CAPE system, can be exceptionally helpful for orbit fractures around the eye or cranial fractures around the brain, since the nerve anatomy is delicate and consistent - which makes it applicable to the CAPE system. In summary, a surgeon (including the likes of a Plastic surgeon, ENT surgeon, oral/OMFS surgeon, oculoplastic surgeon, neurosurgeon) reducing craniofacial fractures needs to know the bone stock quality remaining, where plates/screws are best placed, and the optimal plan prior to entering the operating room. Therefore, the CAPE system described within may be applied to this area as well.
[00126] Neurosurgical procedures
|0 1271 Neurosurgeons frequently perform delicate craniotomies for access for brain surgery. Currently, there are several navigational systems available. However, none of the conventional systems include features described in the embodiments of the CAPE platform as described above. That is, the conventional systems lack the ability to assist both pre- operatively with planning AND with intra-operative navigation for execution assistance. In addition, the current neurosurgery systems require the head to be placed in antiquidated "bilateral skull clamp pins" during the entire surgery. This means that before each neurosurgery procedure starts, a big 3 -piece clamp is crunched onto the skull of the patient to make sure the head does not move during surgery, particularly to allow for use of the conventional navigation systems. However, embodiments of the CAPE system, such as those described above, use a small, modified rigid cranial reference mount which removes the need for using a big, bulky clamp from the field and allows the surgeon to rotate the patient's head if and when needed. To a craniofacial plastic surgeon, who often is consulted to assist with simultaneous scalp reconstruction, elimination/removal of such pins from the surgical field is a huge advantage. For example, elimination of the pins makes scalp reconstruction in the setting of neurosurgery much safer since the pins aren't present to hold back mobilization and dissection of the nearby scalp - which is needed often for complex closure. It also, reduces the risk of surgical contamination since the current setup with pins is bulky and makes surgical draping and sterility much more difficult and awkward. A small cranial mount as part of the CAPE system is a huge advancement for the field. As such, the CAPE system described herein may be applied to neurosurgical procedures as well.
100128| Congenital deformity7 correction
[00129] Unfortunately, newborns are commonly born with craniofacial deformities to either maternal exposure or genetic abnormalities. As such, they may have major development problems with their skeleton and the overlying structures (eyes, ears, nose) may therefore appear abnormal. Tn addition, newborns may suffer from craniosynostosis (premature fusing of their cranial sutures) which causes major shifts in the shape of their head at birth. In an embodiment, the CAPE system described above, can be utilized to address such congenital deformities, irrespective of etiology. For example, if a 16 year old needs to have major Le Fort surgery to move the central facial skeleton into better position forward to improve breathing, mastication, and appearance, use of the CAPE system technology for both pre- and intra-operatively provides a huge advancement for the field.
[00130] Head/neck and Facial reconstruction (ENT surgery) [00131] Head and neck surgeons in the specialty of Otolarygology (ENT) are frequently reconstructing facial skeletons. Reasons include post-tumor resection, facial trauma, aesthetic improvement, congenital causes and/or functional improvement (nose, mouth, eyes, etc). Therefore, this specialty would greatly benefit from use of the CAPE system technology described herein. For example, m an embodiment, use of the CAPE system can help a wide range including such instances as post-trauma fracture reduction/fixation, free tissue transfer planning and execution (ie. Free flap reconstruction with microsurgical fibula flaps for large bone defects where the leg bone receives dental implants for jaw reconstruction), smaller jaw reconstruction cases with implant materials, and/or anterior skull base reconstructions with neurosurgery following tumor resection. This specialty is very diverse, and therefore the CAPE system's easy adaptability can help make it greatly valuable to this group of surgeons.
[00132J Orthognathic Surgery
[00133] Orthognathic surgery describes any of surgical procedure type moving the jaw and/or jaw-teeth segments. This is most commonly performed by either oral surgeons, oral- maxillofacial surgeons (OMFS), or plastic surgeons. It is done currently both in the hospital as an insurance case or in the outpatient setting for a fee-for-service. It may be indicated for enhanced mastication, improved aesthetics, and/or both reasons. Having the ability to plan and predict jaw movements based on biomechanical muscle (ie. External) forces will be immensely valuable to this field. In an embodiment, surgeons can utilize the CAPE system described above to predict functional jaw movements both at time of surgery and after surgery (1 , 5, 10, 20 years post-op). In addition, in an embodiment, a surgeon can utilize the CAPE system to provide real-time cephalometric feedback, which provides an advancement not seen in the conventional systems. In comparison, for the last several centuries, oral surgeons have used splints fabricated in the dental lab pre-operatively for assistance in the operating room - to help confirm dental alignment as planned. This takes time (4-6 hours to make by hand), effort (can be done virtually nowadays but is very expensive) and money. In contrast to the conventional systems. Surgeons utilizing the CAPE system, such as an embodiment described above, can go to the operating room with pre-fabricated cutting guides and tracking instruments, cut the jaws where planned, and then match the teeth on the table based on real-time cephol metric feedback and biomechanical jaw simulation to predict postoperative mastication - unlike ever before. For example, use of the CAPE system will allow surgeons to know instantaneously if the aesthetic and functional angles/measurements are ideal and where they should be. In addition, the CAPE system is able to supply palatal cutting guides and pre-bent metal fixation plates (as opposed to the conventional methods that require handbending each plate for proper shape). In summary, the CAPE system will be a "game-changer" for orthognathic surgery.
[00134] "Computer-assisted Cranioplasty"
[00135] At least some embodiments described herein can be used for the immediate surgical repair of large cranial defects (>5 cm2). For example, embodiments described herein may be used for designing, forming and implanting customized craniofacial implants following benign/malignant skull neoplasm (tumor) resection (i.e.. referred to as "single- stage implant cranioplasty")- Currently, it is challenging to reconstruct such patients with prefabricated implants using conventional methods since the actual size/shape of the defect site is unknown until the tumor is removed. Accordingly, use of a computer-assisted surgical system of an embodiment may significantly reduce the intraoperative time used for reshaping/resizing the customized implant. For example, embodiments provide visualization related to the tumor, the resulting skull defect, and the reshaped implant for exact positioning. In other words, in an embodiment, a C m pute r- A s s i s ted Planning and Execution (CAPE) system that can be utilized for I e Fort-based, Face- Jaw-Teeth transplantation may also be used for improving both the pro-operative planning and intra-operative execution of single- stage implant cranioplasties. Cranioplasties may be performed to reconstruct large defects following stroke, trauma, aneurysmal bleeding, bone flap removal for infection, and oncological ablation. However, oncological defects are commonly reconstructed with "off- the-shelf materials, as opposed to using a pre-fabricated customized implant - simply because the exact defect size/shape is unlaiown. With this in mind, embodiments described herein include a computer-assisted algorithm that may allow surgeons to reconstruct tumor defects with pre-customized cranial implants (CCls) for an ideal result.
[00136] Nearly 250,000 primary brain tumors/skull-based neoplasms are diagnosed each year resulting in a range of 4500-5000 second-stage implant cranioplasties/year. Unfortunately, the common tumor defect cranioplasty is reconstructed with on-table manipulation of titanium mesh, liquid polymethylmethacrylate (PMMA), liquid hydroxyapatitie/bone cement (HA) or autologous split-thickness calvarial bone grafts (ref), which forces the surgeon to shape/mold these materials to an approximate size/shape. Expectantly, this results in some form of craniofacial asymmetry and a post-operative appearance which is suboptimal. Furthermore, the difficult shaping process may take several hours - which in turn increases anesthesia, total blood loss, risk for infection, morbidity, and all costs associated with longer operative times. Therefore, there is significant opportunity to extend this CAPE to thousands of patients.
[00137] In 2002, the advent of computer-aided design and manufacturing (CAD/CAM) was used for the first time to pre-emptively match the contralateral, non-operated skull for ideal contour and appearance, which provided for the use of CCls. However, cranioplasties with such CCls can only be performed as "second stage" operations during which a clinician, such as a surgeon, ensures that the CCI fits perfectly into the skull defect. Recent developments have demonstrated the feasibility of CCls for "single-stage cranioplasty", but this involves using a handheld bur to shave down the pre-Ofabricated implant artistically. However, challenges in both assessing and predicting each tumor-resection deformity pre- surgery still limits the applicability of CCIs in this patient population. For example, challenges such as 1 ) unknown exact tumor size, 2) unknown growth from time of pre-op CT scan-to-actual day of surgery, and 3) the unknown resection margins needed to minimize local recurrence. For these cases, the CCI would need to be reshaped/resized intraoperatively from a size slightly larger than expected - which is a process that may take several (2-4) hours. However, there are no established planning and execution systems available to assist these single-stage reconstructions. Accordingly, embodiments described herein may be used by surgeons in performing single-stage cranioplasty following oncological resection. Tn other words, embodiments include algorithms for real-time updates related to single-stage customized implant cranioplasty. For example, in an embodiment, there is a Computer- Assisted Planning and Execution (CAPE) system, which is a SINGLE, seamless platform capable of being used for both planning (pre-op use) and navigation (intra-op use) which overcomes the limitations of conventional systems that do either one or the other. In addition, embodiments include novel hardware such as trackable cutting guides and rigid cranial reference mount. The CAPE architecture will provide reconstructive surgeons all the necessary algorithms for real-time updates related to single-stage customized implant cranioplasty.
[00138] Table 1 . Comparison of CAPE and Competitive Solutions
Figure imgf000044_0001
[00139] Furthermore, to the extent that the terms "including", "includes", "having", "has", "with", or variants thereof are used in either the detailed description and the claims, such terms are intended to be inclusive i a manner similar to the term '"comprising." As used herein, the phrase "one or more of, for example, A, B, and C means any of the following: either A, B, or C alone; or combinations of two, such as A and B, B and C, and A and C; or combinations of three A, B and C.
[00140] Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

Claims

WHAT IS CLAIMED IS :
1 . A computer-implemented method for cephalometry for orthognathic and craniomaxillofacial surgery, the method comprising:
transforming a set of cephalometric landmarks from a skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame;
tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with the skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a second skeletal portion in the second reference frame;
calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and
providing updates of the one or more cephalometry metrics that were calculated.
2. The computer-implemented method of claim 1 , further comprising:
obtaining a hybrid 3D reconstruction model of a hybrid skeletal structure comprising a skeletal fragment anatomically positioned onto a cranium of a recipient; and
identifying the set of cephalometry landmarks on the hybrid 3D reconstruction model,
3. The computer-implemented method of claim 1, wherein the set of cephalometric landmarks comprise one or more of: Gonion ("Go"), Nasion ("N"), A point ("A"), B point ("B"), Sella ("S"), Menton ("M"), left/right Zygoma ("ZY"), Os occipital ("OCC") or any other pertinent points or angles.
4. The computer- implemented method of claim 3, wherein the tracking comprises determining, during surgery, the orientation of a skeletal fragment or facial skeletal implant with respect to the second facial skeletal portion by measuring one or more cephalometric landmarks from the set of cephalometric landmarks using a tracking device.
5. The computer-implemented method of claim 4, wherein the measuring comprises measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasion, and the A point ("S-N-A"), measuring an angle between the sella, nasion, and the B point ("S-N-B"), measuring an angle between the A point, nasion, and the B point ("A-N-B"), measuring a distance between the os occipital and the nasion ("Occ-N"), measuring a distance between the left and right zygomas ("Zy-Zy"), measuring a distance between the sella and the nasion ("S-N"), measuring a distance between the gonion and the menton ("Go-M"), measuring a distance between the gonion and the B point ("Go- B"), measuring a distance between the A point and the sella ("S-A"), measuring a distance between the A point the B point ("B-A"), measuring a vertical overlap between upper and lower teeth ("overbite"), and measuring a horizontal overlap between upper and lower teeth ("overjet") or any other pertinent angle or landmark of relevance.
6. The computer-implemented method of claim 1 , wherein the providing the updates further comprise causing an interactive user-interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison.
7. The computer-implemented method of claim 1 , wherein a skeletal fragment comprises at least a maxilla or mandible and the providing the updates comprising providing a visual indication as to how well one or more teeth of the hybrid maxilla-mandible combination match.
8. A system for cephalometry for orthognathic and craniomaxillofacial surgery, comprising:
a memory storing instructions; and
at least one processor coupled to the memory and executing the instructions to perform a method comprising:
transforming a set of cephalometric landmarks from a skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame;
tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a second skeletal portion in the second reference frame;
calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and
providing updates of the one or more cephalometry metrics that were calculated.
9. The system of claim 8, wherein the at least one process is further operable to execute the instructions comprising: obtaining a hybrid 3D reconstruction model of a hybrid skeletal structure comprising a skeletal fragment anatomically positioned onto a cranium of a recipient; and
identifying the set of cephalometry landmarks on the hybrid 3D reconstruction model.
10. The system of claim 8, wherein the set of cephalometrie landmarks comprise one or more of: Gonion ("Go"), Nasion ("N"), A point ("A"), B point ("B"), Sella ("S"), Menton ("M"), left/right Zygoma ("ZY"), Os occipital ("OCC") or any other pertinent angle or landmark.
1 1 . The system of claim 10, wherein the tracking comprises determining, during surgery, the orientation of a skeletal fragment with respect to a stable skeletal portion by measuring one or more cephalometrie landmarks from the set of cephalometrie landmarks using a tracking device.
12. The system of claim 1 1 , wherein the measuring comprises measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasion, and the A point ("S-N-A"), measuring an angle between the sella, nasion, and the B point ("S-N-B"), measuring an angle between the A point, nasion, and the B point ("A-N- B"), measuring a distance between the os occipital and the nasion ("Occ-N"), measuring a distance between the left and right zygomas ("Zy-Zy"), measuring a distance between the sella and the nasion ("S-N"), measuring a distance between the gonion and the menton ("Go- M"), measuring a distance between the gonion and the B point ("Go-B"), measuring a distance between the A point and the sella ("S-A"), measuring a distance between the A point the B point ("B-A"), measuring a vertical overlap between upper and lower teeth ("overbite"), and measuring a horizontal overlap between upper and lower teeth ("overjet") or any other relevant landmark or angle.
13. The system of claim 9. wherein the providing the updates further comprise causing an interactive user-interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison.
14. The system of claim 9, wherein a skeletal fragment comprises at least a maxilla or mandible and the providing the updates comprising providing a visual indication as to how well one or more teeth of the hybrid maxilla-mandible combination match.
1 5. The system of claim 14, wherein the updates comprise a change in appearance of a visual indicator on a hybrid model as a skeletal fragment is mated with a stable skeletal fragment.
16. A non-transitory computer-readable medium including instructions to perform a method for cephalometry for orthognathic and craniomaxillofacial surgery, the method comprising:
transforming a set of cephalometric landmarks from a skeletal fragment in a first reference frame to a second reference frame based on a registration process that maps coordinates from the first reference frame to coordinates in the second reference frame;
tracking movement, based on one or more signals from one or more sensors, during surgery, of one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a skeletal fragment with respect to one or more of the cephalometric landmarks in the set of cephalometric landmarks associated with a second skeletal portion in the second reference frame;
calculating one or more cephalometry metrics, during surgery, based on the movement that is tracked; and
providing updates of the one or more cephalometry metrics that were calculated.
17. The non-transitory computer-readable medium of claim 16, wherein the set of cephalometric landmarks comprise one or more of: Gonion ("Go"), Nasion ("N"), A point ("A"), B point ("B"), Sella ("S"), Menton ("M"), left/right Zygoma ("ZY"), Os occipital ("OCC") or any relavant landmark or angle.
1 8. The non-transitory computer-readable medium of claim 1 7, wherein the tracking comprises determining, during surgery, the orientation of a mobile skeletal fragment with respect to the second skeletal portion by measuring one or more cephalometric landmarks from the set of cephalometric landmarks using a tracking device.
1 9. The non-transitory computer-readable medium of claim 1 8, wherein the measuring comprises measuring an angle between the B point, sella, and the A point ("B-S-A"), measuring an angle between the sella, nasion, and the A point ("S-N-A"), measuring an angle between the sella, nasion, and the B point ("S-N-B"), measuring an angle between the A point, nasion, and the B point ("A-N-B"), measuring a distance between the os occipital and the nasion ("Occ-N"), measuring a distance between the left and right zygomas ("Zy-Zy"), measuring a distance between the sella and the nasion ("S-N"), measuring a distance between the gonion and the menton ("Go-M"), measuring a distance between the gonion and the B point ("Go-B"), measuring a distance between the A point and the sella ("S-A"), measuring a distance between the A point the B point ("B-A"), measuring a vertical overlap between upper and lower teeth ("overbite"), and measuring a horizontal overlap between upper and lower teeth ("overjet") or any other landmark or angle of relevance.
20. The non-transitory computer-readable medium of claim 16, wherein the providing the updates further comprise causing an interactive user-interface to be displayed that provides the one or more cephalometry metrics that are calculated with corresponding reference cephalometry metrics for comparison.
PCT/US2014/067692 2013-11-29 2014-11-26 Real-time cephalometry for cranimaxillofacial surgery WO2015081247A1 (en)

Priority Applications (10)

Application Number Priority Date Filing Date Title
US15/100,229 US20170000504A1 (en) 2013-11-29 2014-11-26 Real-time cephalometry for cranimaxillofacial surgery
US15/529,036 US20170273797A1 (en) 2014-11-24 2015-11-24 Computer-assisted cranioplasty
AU2015353523A AU2015353523B2 (en) 2014-11-24 2015-11-24 Computer-assisted cranioplasty
EP15862375.1A EP3223752A4 (en) 2014-11-24 2015-11-24 A cutting machine for resizing raw implants during surgery
PCT/US2015/062521 WO2016086054A1 (en) 2014-11-24 2015-11-24 Computer-assisted cranioplasty
AU2015353601A AU2015353601B2 (en) 2014-11-24 2015-11-24 A cutting machine for resizing raw implants during surgery
US15/529,042 US10603175B2 (en) 2014-11-24 2015-11-24 Cutting machine for resizing raw implants during surgery
PCT/US2015/062516 WO2016086049A1 (en) 2014-11-24 2015-11-24 A cutting machine for resizing raw implants during surgery
PCT/US2015/062507 WO2016086041A1 (en) 2014-11-24 2015-11-24 Patient-specific trackable soft tissue cutting guides
EP15862868.5A EP3223737A4 (en) 2014-11-24 2015-11-24 Computer-assisted cranioplasty

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201361910204P 2013-11-29 2013-11-29
US61/910,204 2013-11-29
US201461940196P 2014-02-14 2014-02-14
US61/940,196 2014-02-14
US201462049866P 2014-09-12 2014-09-12
US62/049,866 2014-09-12

Related Child Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/067581 Continuation-In-Part WO2015081177A1 (en) 2013-11-29 2014-11-26 Orthognathic biomechanical simulation

Publications (1)

Publication Number Publication Date
WO2015081247A1 true WO2015081247A1 (en) 2015-06-04

Family

ID=53199582

Family Applications (7)

Application Number Title Priority Date Filing Date
PCT/US2014/067167 WO2015081025A1 (en) 2013-11-29 2014-11-24 Cranial reference mount
PCT/US2014/067174 WO2015081027A1 (en) 2013-11-29 2014-11-24 Patient-specific trackable cutting guides
PCT/US2014/067504 WO2015081140A1 (en) 2013-11-29 2014-11-25 Computer-assisted face-jaw-teeth transplantation
PCT/US2014/067581 WO2015081177A1 (en) 2013-11-29 2014-11-26 Orthognathic biomechanical simulation
PCT/US2014/067671 WO2015081232A1 (en) 2013-11-29 2014-11-26 Computer-assisted planning and execution system
PCT/US2014/067692 WO2015081247A1 (en) 2013-11-29 2014-11-26 Real-time cephalometry for cranimaxillofacial surgery
PCT/US2014/067656 WO2015081225A1 (en) 2013-11-29 2014-11-26 Computer-assisted craniomaxillofacial surgery

Family Applications Before (5)

Application Number Title Priority Date Filing Date
PCT/US2014/067167 WO2015081025A1 (en) 2013-11-29 2014-11-24 Cranial reference mount
PCT/US2014/067174 WO2015081027A1 (en) 2013-11-29 2014-11-24 Patient-specific trackable cutting guides
PCT/US2014/067504 WO2015081140A1 (en) 2013-11-29 2014-11-25 Computer-assisted face-jaw-teeth transplantation
PCT/US2014/067581 WO2015081177A1 (en) 2013-11-29 2014-11-26 Orthognathic biomechanical simulation
PCT/US2014/067671 WO2015081232A1 (en) 2013-11-29 2014-11-26 Computer-assisted planning and execution system

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/US2014/067656 WO2015081225A1 (en) 2013-11-29 2014-11-26 Computer-assisted craniomaxillofacial surgery

Country Status (2)

Country Link
US (11) US10682147B2 (en)
WO (7) WO2015081025A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2607651C1 (en) * 2015-08-31 2017-01-10 федеральное государственное бюджетное образовательное учреждение высшего образования "Северо-Западный государственный медицинский университет имени И.И. Мечникова" Министерства здравоохранения Российской Федерации (ФГБОУ ВО СЗГМУ им. И.И. Мечникова Минздрава России) Method for simulating bone-reconstructive surgeries in treating new growths of jaw bone in childhood
CN109567942A (en) * 2018-10-31 2019-04-05 上海盼研机器人科技有限公司 Using the craniomaxillofacial surgery robot assisted system of artificial intelligence technology
US10912648B2 (en) 2016-08-30 2021-02-09 Longeviti Neuro Solutions Llc Method for manufacturing a low-profile intercranial device and the low-profile intercranial device manufactured thereby
US11589992B2 (en) 2018-01-09 2023-02-28 Longeviti Neuro Solutions Llc Universal low-profile intercranial assembly

Families Citing this family (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7968851B2 (en) 2004-01-13 2011-06-28 Spectrum Dynamics Llc Dynamic spect camera
US9943274B2 (en) * 2004-11-09 2018-04-17 Spectrum Dynamics Medical Limited Radioimaging using low dose isotope
US20070118055A1 (en) * 2005-11-04 2007-05-24 Smith & Nephew, Inc. Systems and methods for facilitating surgical procedures involving custom medical implants
WO2009111736A1 (en) 2008-03-06 2009-09-11 Aquabeam Llc Tissue ablation and cautery with optical energy carried in fluid stream
EP2819599B1 (en) 2012-02-29 2018-05-23 Procept Biorobotics Corporation Automated image-guided tissue resection and treatment
WO2014200017A1 (en) * 2013-06-11 2014-12-18 Tanji Atsushi Bone cutting assistance system, information processing device, image processing method, and image processing program
US10682147B2 (en) 2013-11-29 2020-06-16 The Johns Hopkins University Patient-specific trackable cutting guides
EP3223752A4 (en) 2014-11-24 2018-09-12 The Johns Hopkins University A cutting machine for resizing raw implants during surgery
US10188465B2 (en) * 2015-08-26 2019-01-29 Biosense Webster (Israel) Ltd. Automatic ENT surgery preplanning using a backtracking maze problem solution
KR102537926B1 (en) 2015-09-04 2023-05-31 더 존스 홉킨스 유니버시티 Low Profile Intracranial Device
US10499990B2 (en) * 2015-11-23 2019-12-10 Heartflow, Inc. Systems and methods for assessing organ and/or tissue transplantation by simulating one or more transplant characteristics
RU2607183C1 (en) * 2015-12-11 2017-01-10 федеральное государственное бюджетное учреждение "Северо-Западный федеральный медицинский исследовательский центр имени В.А. Алмазова" Министерства здравоохранения Российской Федерации Method of plasty of anterior base cranial fossa defects
KR20170079183A (en) * 2015-12-30 2017-07-10 삼성전기주식회사 Coil Component
CN105943113B (en) * 2016-04-13 2018-05-25 南方医科大学 A kind of preparation method of mandibular angle bone cutting navigation template
DE102016108433A1 (en) * 2016-05-06 2017-11-09 Karl Leibinger Medizintechnik Gmbh & Co. Kg Unterkieferresektionsschablone
US20170340390A1 (en) * 2016-05-27 2017-11-30 University Of Washington Computer-Assisted Osteocutaneous Free Flap Reconstruction
CN110167445A (en) * 2016-08-19 2019-08-23 卫理公会医院体系公司 System and method for the planning of computer assisted orthognathic surgery
KR101901646B1 (en) * 2017-03-07 2018-10-01 주식회사 메가젠임플란트 Orthognathic system using three-dimensional hybrid image constructing program
RU2635633C1 (en) * 2017-03-23 2017-11-14 Алексей Николаевич Шкарубо Method of plastics and sealing defects of dura in the field of bone defect of base of skull
US11166764B2 (en) 2017-07-27 2021-11-09 Carlsmed, Inc. Systems and methods for assisting and augmenting surgical procedures
WO2019046579A1 (en) * 2017-08-31 2019-03-07 Smith & Nephew, Inc. Intraoperative implant augmentation
WO2019068194A1 (en) * 2017-10-06 2019-04-11 Intellijoint Surgical Inc. System and method for preoperative planning for total hip arthroplasty
US11112770B2 (en) * 2017-11-09 2021-09-07 Carlsmed, Inc. Systems and methods for assisting a surgeon and producing patient-specific medical devices
US11083586B2 (en) 2017-12-04 2021-08-10 Carlsmed, Inc. Systems and methods for multi-planar orthopedic alignment
DE102017222368A1 (en) * 2017-12-11 2019-06-13 Rwth Aachen Operation planning system for the reconstruction of missing or damaged bone parts
RU2655784C1 (en) * 2018-01-09 2018-05-29 Алексей Николаевич Шкарубо Method of plastic repair and sealing of pachymeninx defects in bone loss area in the skull base
US10535427B2 (en) 2018-01-10 2020-01-14 Medtronic, Inc. System for planning implantation of a cranially mounted medical device
US11304812B1 (en) 2018-02-23 2022-04-19 Syed Khalid Method of fabricating or modifying an implant
US11432943B2 (en) 2018-03-14 2022-09-06 Carlsmed, Inc. Systems and methods for orthopedic implant fixation
US11439514B2 (en) 2018-04-16 2022-09-13 Carlsmed, Inc. Systems and methods for orthopedic implant fixation
CN109124765A (en) * 2018-06-19 2019-01-04 黑龙江拓盟科技有限公司 Application method of the assisting in diagnosis and treatment system in neurosurgery based on mixed reality
CN112423697A (en) * 2018-06-20 2021-02-26 埃因霍温医疗机器人有限公司 Mechanical interface device interfacing with bone structure with integrated targeting reference allowing surgical device attachment
US10702319B2 (en) * 2018-07-09 2020-07-07 Robert G. Hale Apparatus and method for a transalveolar dental implant
USD958151S1 (en) 2018-07-30 2022-07-19 Carlsmed, Inc. Display screen with a graphical user interface for surgical planning
EP3849453A4 (en) 2018-09-12 2022-07-20 Carlsmed, Inc. Systems and methods for orthopedic implants
EP3857562A1 (en) * 2018-09-28 2021-08-04 Institute of Science and Technology Austria (IST Austria) Method of designing a skull prosthesis, and navigation system
US10910103B2 (en) * 2018-12-14 2021-02-02 Verb Surgical Inc. Method and system for extracting an actual surgical duration from a total operating room (OR) time of a surgical procedure
CN109875684A (en) * 2019-04-16 2019-06-14 北京大学第三医院(北京大学第三临床医学院) A kind of prediction and real-time rendering method of mandibular angle bone cutting art
IT201900006834A1 (en) 2019-05-14 2020-11-14 Nuova Sima Spa SORTING APPARATUS FOR SORTING AND STACKING TILES
CN110176066B (en) * 2019-05-28 2023-04-18 中山大学附属第三医院 Skull defect structure reconstruction method and device and electronic equipment
AU2020344704A1 (en) 2019-09-13 2022-04-14 Treace Medical Concepts, Inc. Patient-specific surgical methods and instrumentation
US11376076B2 (en) 2020-01-06 2022-07-05 Carlsmed, Inc. Patient-specific medical systems, devices, and methods
US10902944B1 (en) 2020-01-06 2021-01-26 Carlsmed, Inc. Patient-specific medical procedures and devices, and associated systems and methods
CN111658065A (en) * 2020-05-12 2020-09-15 北京航空航天大学 Digital guide system for mandible cutting operation
WO2021242929A1 (en) * 2020-05-26 2021-12-02 Epica International, Inc. System for performing robot-assisted surgery
US11877818B2 (en) 2020-06-26 2024-01-23 Procept Biorobotics Corporation Integration of robotic arms with surgical probes
US11096753B1 (en) 2020-06-26 2021-08-24 Procept Biorobotics Corporation Systems and methods for defining and modifying range of motion of probe used in patient treatment
IT202100002066A1 (en) 2021-02-01 2022-08-01 H Opera S R L DEVICE AND METHOD FOR CRANIOPLASTY
US11443838B1 (en) 2022-02-23 2022-09-13 Carlsmed, Inc. Non-fungible token systems and methods for storing and accessing healthcare data
US20230401685A1 (en) * 2022-06-08 2023-12-14 PAIGE.AI, Inc. Systems and methods for processing electronic images to identify transplant donor-recipient matches
US11806241B1 (en) 2022-09-22 2023-11-07 Carlsmed, Inc. System for manufacturing and pre-operative inspecting of patient-specific implants
US11793577B1 (en) 2023-01-27 2023-10-24 Carlsmed, Inc. Techniques to map three-dimensional human anatomy data to two-dimensional human anatomy data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6845175B2 (en) * 1998-11-01 2005-01-18 Cadent Ltd. Dental image processing method and system
US20090311647A1 (en) * 2008-06-11 2009-12-17 Jing-Jing Fang 3d planning and prediction method for optimizing facial skeleton symmetry in orthognathic surgery
US7792341B2 (en) * 2004-06-25 2010-09-07 Medicim N.V. Method for deriving a treatment plan for orthognatic surgery and devices therefor
US20120259592A1 (en) * 2011-04-07 2012-10-11 Dolphin Imaging Systems, Llc System and Method for Three-Dimensional Maxillofacial Surgical Simulation and Planning
US8535063B1 (en) * 2006-12-21 2013-09-17 Amato Craniofacial Engineering, LLC Craniofacial anatomic simulator with cephalometer

Family Cites Families (120)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3457922A (en) 1966-12-13 1969-07-29 Charles D Ray Stereotaxic surgical instrument and method
US4436684A (en) 1982-06-03 1984-03-13 Contour Med Partners, Ltd. Method of forming implantable prostheses for reconstructive surgery
US5279575A (en) * 1992-08-13 1994-01-18 Brigham & Women's Hospital Locking pivotal surgical orifice
AU684546B2 (en) 1993-09-10 1997-12-18 University Of Queensland, The Stereolithographic anatomical modelling process
EP0729322A4 (en) 1993-11-15 1999-06-16 Urso Paul Steven D Surgical procedures
US20020169485A1 (en) 1995-10-16 2002-11-14 Neuropace, Inc. Differential neurostimulation therapy driven by physiological context
GB2318058B (en) 1996-09-25 2001-03-21 Ninian Spenceley Peckitt Improvements relating to prosthetic implants
US5810712A (en) * 1996-09-27 1998-09-22 Ohio Medical Instrument Company, Inc. Surgical endoscope support and pivot
US8480754B2 (en) 2001-05-25 2013-07-09 Conformis, Inc. Patient-adapted and improved articular implants, designs and related guide tools
US8545569B2 (en) 2001-05-25 2013-10-01 Conformis, Inc. Patient selectable knee arthroplasty devices
US6226548B1 (en) 1997-09-24 2001-05-01 Surgical Navigation Technologies, Inc. Percutaneous registration apparatus and method for use in computer-assisted surgical navigation
DE69828011T2 (en) * 1997-09-26 2005-12-01 Koninklijke Philips Electronics N.V. Device for holding a surgical instrument
US5951498A (en) * 1997-10-16 1999-09-14 Arnett Facial Reconstruction Courses, Inc. Soft tissue cephalometric analysis for diagnosis and cephalometric treatment planning of facial imbalance
US6120290A (en) 1997-10-22 2000-09-19 Ono Sokki Co., Ltd. Jaw movement simulator, jaw movement simulation system, and jaw movement simulation method
US5916220A (en) 1998-02-02 1999-06-29 Medidea, Llc Bone cutting guide and method to accommodate different-sized implants
DE19832513A1 (en) * 1998-07-20 2000-02-17 Impag Gmbh Medizintechnik Fastening arrangement
US6608628B1 (en) 1998-11-06 2003-08-19 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration (Nasa) Method and apparatus for virtual interactive medical imaging by multiple remotely-located users
US6285902B1 (en) 1999-02-10 2001-09-04 Surgical Insights, Inc. Computer assisted targeting device for use in orthopaedic surgery
US6470207B1 (en) * 1999-03-23 2002-10-22 Surgical Navigation Technologies, Inc. Navigational guidance via computer-assisted fluoroscopic imaging
US6491699B1 (en) * 1999-04-20 2002-12-10 Surgical Navigation Technologies, Inc. Instrument guidance method and system for image guided surgery
DE19922279A1 (en) 1999-05-11 2000-11-16 Friedrich Schiller Uni Jena Bu Procedure for generating patient-specific implants
AU6634800A (en) 1999-08-11 2001-03-05 Case Western Reserve University Method and apparatus for producing an implant
US9208558B2 (en) 1999-08-11 2015-12-08 Osteoplastics Llc Methods and systems for producing an implant
US8781557B2 (en) 1999-08-11 2014-07-15 Osteoplastics, Llc Producing a three dimensional model of an implant
US7635390B1 (en) 2000-01-14 2009-12-22 Marctec, Llc Joint replacement component having a modular articulating surface
FR2808366B1 (en) 2000-04-26 2003-12-19 Univ Paris Vii Denis Diderot VIRTUAL REALITY LEARNING METHOD AND SYSTEM, AND APPLICATION IN ODONTOLOGY
US20020035458A1 (en) 2000-09-20 2002-03-21 Chang-Hun Kim Method and system for virtual surgery
US6726678B1 (en) 2001-02-22 2004-04-27 Isurgical, Llc Implantable reservoir and system for delivery of a therapeutic agent
US20050113846A1 (en) 2001-02-27 2005-05-26 Carson Christopher P. Surgical navigation systems and processes for unicompartmental knee arthroplasty
US6796986B2 (en) * 2001-03-29 2004-09-28 David W. Duffner Adjustable tibial osteotomy jig and method
US9421074B2 (en) * 2001-04-13 2016-08-23 Orametrix, Inc. Unified three dimensional virtual craniofacial and dentition model and uses thereof
JP2003070816A (en) 2001-08-30 2003-03-11 Pentax Corp Designing method for implant, and implant
US8010180B2 (en) 2002-03-06 2011-08-30 Mako Surgical Corp. Haptic guidance system and method
DE10392506B4 (en) 2002-04-11 2017-04-06 J. Morita Manufacturing Corporation X-ray CT scanner
EP2151215B1 (en) * 2002-08-09 2012-09-19 Kinamed, Inc. Non-imaging tracking tools for hip replacement surgery
US7736368B2 (en) 2002-08-23 2010-06-15 Orthosoft Inc. Surgical universal positioning block and tool guide
US8086336B2 (en) 2002-09-30 2011-12-27 Medical Modeling Inc. Method for design and production of a custom-fit prosthesis
US20050043835A1 (en) 2002-09-30 2005-02-24 Medical Modeling Llc Method for design and production of custom-fit prosthesis
WO2004052456A1 (en) 2002-12-09 2004-06-24 Medtronic, Inc. Modular implantable medical device
US20040172044A1 (en) * 2002-12-20 2004-09-02 Grimm James E. Surgical instrument and method of positioning same
EP1638459A2 (en) 2003-06-11 2006-03-29 Case Western Reserve University Computer-aided-design of skeletal implants
FR2856268B1 (en) 2003-06-18 2005-10-21 Perception Raisonnement Action BONE CUTTING GUIDING DEVICE
US7596399B2 (en) 2004-04-29 2009-09-29 Medtronic, Inc Implantation of implantable medical device
AU2005307005A1 (en) * 2004-10-25 2006-05-26 Fsi Acquisition Sub, Llc Crossbar spinal prosthesis having a modular design and systems for treating spinal pathologies
US8535329B2 (en) * 2004-10-29 2013-09-17 Kinamed, Inc. Tracking tools and method for computer-assisted shoulder replacement surgery
US20060195111A1 (en) * 2005-01-25 2006-08-31 Orthosoft Inc. Universal positioning block assembly
GB0507204D0 (en) 2005-04-08 2005-05-18 Leuven K U Res & Dev Maxillofacial and plastic surgery
CA2562205A1 (en) 2005-09-28 2007-03-28 Medtrode Inc. Implantable transcranial pulse generator having a collapsible portion
GB0523085D0 (en) 2005-11-11 2005-12-21 Ortho Pro Teknica Ltd Tracking system for orthognathic surgery
DE102005058760A1 (en) 2005-12-05 2007-06-06 Aesculap Ag & Co. Kg Method and device for preparing an implant from an implant material
US7894872B2 (en) 2005-12-26 2011-02-22 Depuy Orthopaedics, Inc Computer assisted orthopaedic surgery system with light source and associated method
US8623026B2 (en) * 2006-02-06 2014-01-07 Conformis, Inc. Patient selectable joint arthroplasty devices and surgical tools incorporating anatomical relief
US20070207441A1 (en) 2006-03-03 2007-09-06 Lauren Mark D Four dimensional modeling of jaw and tooth dynamics
WO2007139949A2 (en) * 2006-05-25 2007-12-06 Spinemedica Corporation Patient-specific spinal implants and related systems and methods
US7953260B2 (en) 2006-06-09 2011-05-31 Craniosim Solutions, Inc. Predicting movement of soft tissue of the face in response to movement of underlying bone
CN101528158B (en) 2006-08-21 2011-10-05 21世纪国际新技术株式会社 Bone model, bone filler and process for producing bone filler
US7747318B2 (en) 2006-12-07 2010-06-29 Neuropace, Inc. Functional ferrule
US8214016B2 (en) 2006-12-12 2012-07-03 Perception Raisonnement Action En Medecine System and method for determining an optimal type and position of an implant
US8357165B2 (en) 2006-12-22 2013-01-22 Depuy Products, Inc. Reference array mounting bracket for use with a computer assisted orthopaedic surgery system
EP1955671A1 (en) * 2007-02-09 2008-08-13 Universiteit Antwerpen 3-D orthognathic surgery simulation
GB0707454D0 (en) 2007-04-18 2007-05-23 Materialise Dental Nv Computer-assisted creation of a custom tooth set-up using facial analysis
US8934961B2 (en) 2007-05-18 2015-01-13 Biomet Manufacturing, Llc Trackable diagnostic scope apparatus and methods of use
CA2696584C (en) 2007-08-17 2016-11-29 Mohamed Rashwan Mahfouz Implant design analysis suite
US8357111B2 (en) 2007-09-30 2013-01-22 Depuy Products, Inc. Method and system for designing patient-specific orthopaedic surgical instruments
WO2009046391A1 (en) 2007-10-03 2009-04-09 Bernard Gantes Assisted dental implant treatment
US8790351B2 (en) 2007-10-10 2014-07-29 Orthosoft Inc. Hip replacement in computer-assisted surgery
US9179850B2 (en) 2007-10-30 2015-11-10 Neuropace, Inc. Systems, methods and devices for a skull/brain interface
EP2227719B1 (en) 2007-11-19 2020-01-08 Blue Ortho Hip implant registration in computer assisted surgery
WO2009075562A1 (en) 2007-12-11 2009-06-18 Universiti Malaya Process to design and fabricate a custom-fit implant
US8221430B2 (en) 2007-12-18 2012-07-17 Otismed Corporation System and method for manufacturing arthroplasty jigs
EP2103270B1 (en) 2008-03-18 2012-06-27 BrainLAB AG System for navigation-supported shoulder operations for positioning navigated treatment devices relative to a bone
EP2269533B1 (en) 2008-03-21 2021-05-05 Atsushi Takahashi Three-dimensional digital magnifier operation supporting system
US20090281623A1 (en) 2008-05-12 2009-11-12 Medtronic, Inc. Customization of implantable medical devices
US9561006B2 (en) 2008-10-15 2017-02-07 The United States Of America As Represented By The Secretary Of The Navy Bayesian modeling of pre-transplant variables accurately predicts kidney graft survival
KR101129364B1 (en) 2008-12-10 2012-03-26 한국전자통신연구원 An electrode for cerebral nerve stimulus and a substrate comprising the electrode
ES2546295T3 (en) * 2009-05-06 2015-09-22 Blue Ortho Fixation system with reduced invasiveness for follow-up elements in computer-assisted surgery
US20110117530A1 (en) 2009-05-07 2011-05-19 Technion Research & Development Foundation Ltd. Method and system of simulating physical object incisions, deformations and interactions therewith
US8662900B2 (en) 2009-06-04 2014-03-04 Zimmer Dental Inc. Dental implant surgical training simulation system
US8876830B2 (en) 2009-08-13 2014-11-04 Zimmer, Inc. Virtual implant placement in the OR
AU2010292136B2 (en) * 2009-09-10 2013-07-04 Blue Ortho Alignment guides for use in computer assisted orthopedic surgery to prepare a bone element for an implant
US20110066072A1 (en) 2009-09-11 2011-03-17 Drexel University Intracranial pressure sensor
US8652148B2 (en) 2010-02-25 2014-02-18 Zimmer, Inc. Tracked cartilage repair system
US8805048B2 (en) 2010-04-01 2014-08-12 Mark Batesole Method and system for orthodontic diagnosis
US20110307015A1 (en) * 2010-06-10 2011-12-15 Spartek Medical, Inc. Adaptive spinal rod and methods for stabilization of the spine
CA2802291A1 (en) * 2010-07-23 2012-01-26 Ecole Polytechnique Federale De Lausanne (Epfl) Adjustable fixation system for neurosurgical devices
US8318771B2 (en) * 2010-07-30 2012-11-27 Universita' Degli Studi Di Bari Method of treatment of nephrogenic diabetes insipidus
US8315812B2 (en) 2010-08-12 2012-11-20 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
WO2012035538A1 (en) * 2010-09-16 2012-03-22 Mor Research Applications Ltd. Method and system for analyzing images
US9824302B2 (en) 2011-03-09 2017-11-21 Siemens Healthcare Gmbh Method and system for model-based fusion of multi-modal volumetric images
ITMI20110723A1 (en) 2011-04-29 2012-10-30 Mako Shark Srl PROSTHESES FOR CRANIOPLASTICS AND METHOD OF REALIZATION
US8939982B2 (en) * 2011-05-12 2015-01-27 Materialise N.V. Methods and devices for validating the position of patient-specific devices
US8936596B2 (en) 2011-06-21 2015-01-20 Brent Mittelstadt Method and apparatus for generating a tool path for a robotic orthopedic surgical procedure
US8827932B2 (en) * 2011-09-16 2014-09-09 Daiki HIRABAYASHI Orthodontic, dental, and dentofacial deformity indexing system and method
US8979773B2 (en) * 2011-09-16 2015-03-17 Cephmedical Corporation Dental treatment diagnostic method, method for calculating determination indicators, program and computer
US20130122463A1 (en) 2011-11-15 2013-05-16 Raphael Yitz CSILLAG Method and system for facilitating the placement of a dental implant
EP2797542B1 (en) 2011-12-30 2019-08-28 MAKO Surgical Corp. Systems and methods for customizing interactive haptic boundaries
US20130204600A1 (en) 2012-02-06 2013-08-08 Tarun Mehra Virtual articulator
BR112014027419B1 (en) * 2012-05-03 2021-05-18 Synthes Gmbh method for producing a patient-specific surgical guide
US9622820B2 (en) 2012-05-03 2017-04-18 Siemens Product Lifecycle Management Software Inc. Feature-driven rule-based framework for orthopedic surgical planning
CN104540466B (en) 2012-05-17 2017-11-07 德普伊新特斯产品有限责任公司 The method of surgery planning
US8785116B2 (en) 2012-08-10 2014-07-22 Paragonix Technologies, Inc. Methods for evaluating the suitability of an organ for transplant
WO2014043452A1 (en) 2012-09-13 2014-03-20 The Uab Research Foundation Temporomandibular joint implants
US10108266B2 (en) 2012-09-27 2018-10-23 The Board Of Trustees Of The University Of Illinois Haptic augmented and virtual reality system for simulation of surgical procedures
US10416624B2 (en) 2012-12-13 2019-09-17 University Of Washington Through Its Center For Commercialization Methods and systems for selecting surgical approaches
GB201302194D0 (en) * 2013-02-07 2013-03-27 Crisalix Sa 3D platform for aesthetic simulation
EP2967661B1 (en) 2013-03-13 2019-07-31 Think Surgical, Inc. Methods, devices and systems for planning computer-assisted robotic surgery
EP2967813A4 (en) 2013-03-15 2016-11-09 Conformis Inc Kinematic and parameterized modeling for patient-adapted implants, tools, and surgical procedures
US11172126B2 (en) 2013-03-15 2021-11-09 Occipital, Inc. Methods for reducing power consumption of a 3D image capture system
ES2667047T3 (en) 2013-04-12 2018-05-09 Cadfem Gmbh Computer implemented technique to generate a data set that geometrically defines a bone cutting configuration
WO2014178706A1 (en) 2013-04-30 2014-11-06 Universiti Malaya A method for manufacturing a customized implant
US20140329194A1 (en) 2013-05-05 2014-11-06 Rohit Sachdeva Orthodontic treatment planning using biological constraints
US9216084B2 (en) 2013-08-09 2015-12-22 Howmedica Osteonics Corp. Patient-specific craniofacial implants
EP3057537B1 (en) 2013-10-15 2019-06-12 Mohamed Rashwan Mahfouz Bone reconstruction and orthopedic implants
US10682147B2 (en) * 2013-11-29 2020-06-16 The Johns Hopkins University Patient-specific trackable cutting guides
US11628001B2 (en) 2014-03-11 2023-04-18 Ohio State Innovation Foundation Methods, devices, and manufacture of the devices for musculoskeletal reconstructive surgery
AU2015234609A1 (en) * 2014-03-27 2016-10-13 Alma Mater Studiorum Universita Di Bologna Computer aided surgical navigation and planning in implantology
KR102294927B1 (en) 2014-03-31 2021-08-30 트라이큐빅스 인크. Sns .
US11714143B2 (en) * 2014-04-24 2023-08-01 Regents Of The University Of California Omnidirectional MRI catheter resonator and related systems, methods and devices
GB2546022B (en) 2014-08-20 2020-09-16 Synaptive Medical Barbados Inc Intra-operative determination of dimensions for fabrication of artificial bone flap
US20170273797A1 (en) 2014-11-24 2017-09-28 The Johns Hopkins University Computer-assisted cranioplasty

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6845175B2 (en) * 1998-11-01 2005-01-18 Cadent Ltd. Dental image processing method and system
US7792341B2 (en) * 2004-06-25 2010-09-07 Medicim N.V. Method for deriving a treatment plan for orthognatic surgery and devices therefor
US8535063B1 (en) * 2006-12-21 2013-09-17 Amato Craniofacial Engineering, LLC Craniofacial anatomic simulator with cephalometer
US20090311647A1 (en) * 2008-06-11 2009-12-17 Jing-Jing Fang 3d planning and prediction method for optimizing facial skeleton symmetry in orthognathic surgery
US20120259592A1 (en) * 2011-04-07 2012-10-11 Dolphin Imaging Systems, Llc System and Method for Three-Dimensional Maxillofacial Surgical Simulation and Planning

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2607651C1 (en) * 2015-08-31 2017-01-10 федеральное государственное бюджетное образовательное учреждение высшего образования "Северо-Западный государственный медицинский университет имени И.И. Мечникова" Министерства здравоохранения Российской Федерации (ФГБОУ ВО СЗГМУ им. И.И. Мечникова Минздрава России) Method for simulating bone-reconstructive surgeries in treating new growths of jaw bone in childhood
US10912648B2 (en) 2016-08-30 2021-02-09 Longeviti Neuro Solutions Llc Method for manufacturing a low-profile intercranial device and the low-profile intercranial device manufactured thereby
US11446148B2 (en) 2016-08-30 2022-09-20 Longeviti Neuro Solutions Llc Method for manufacturing a low-profile intercranial device and the low-profile intercranial device manufactured thereby
US11589992B2 (en) 2018-01-09 2023-02-28 Longeviti Neuro Solutions Llc Universal low-profile intercranial assembly
CN109567942A (en) * 2018-10-31 2019-04-05 上海盼研机器人科技有限公司 Using the craniomaxillofacial surgery robot assisted system of artificial intelligence technology

Also Published As

Publication number Publication date
US20210043304A1 (en) 2021-02-11
US20170000498A1 (en) 2017-01-05
US20200029976A1 (en) 2020-01-30
US20200337712A1 (en) 2020-10-29
WO2015081027A1 (en) 2015-06-04
WO2015081025A1 (en) 2015-06-04
WO2015081232A1 (en) 2015-06-04
US10631877B2 (en) 2020-04-28
US10682147B2 (en) 2020-06-16
US20170000504A1 (en) 2017-01-05
US20170000497A1 (en) 2017-01-05
US20170000564A1 (en) 2017-01-05
US10537337B2 (en) 2020-01-21
WO2015081140A1 (en) 2015-06-04
US20170000505A1 (en) 2017-01-05
US20170000566A1 (en) 2017-01-05
WO2015081177A1 (en) 2015-06-04
US11328813B2 (en) 2022-05-10
US20210050096A1 (en) 2021-02-18
US11742071B2 (en) 2023-08-29
US11232858B2 (en) 2022-01-25
US10448956B2 (en) 2019-10-22
US20170000565A1 (en) 2017-01-05
US10842504B2 (en) 2020-11-24
WO2015081225A1 (en) 2015-06-04

Similar Documents

Publication Publication Date Title
US11328813B2 (en) Computer-assisted planning and execution system
Markiewicz et al. The use of 3D imaging tools in facial plastic surgery
Bell Computer planning and intraoperative navigation in orthognathic surgery
Lin et al. Three-dimensional computer-assisted surgical simulation and intraoperative navigation in orthognathic surgery: a literature review
US20220257383A1 (en) Computer-assisted cranioplasty
Mazzoni et al. Simulation-guided navigation: a new approach to improve intraoperative three-dimensional reproducibility during orthognathic surgery
Edwards Computer-assisted craniomaxillofacial surgery
Gateno et al. New methods to evaluate craniofacial deformity and to plan surgical correction
Gordon et al. Preliminary development of a workstation for craniomaxillofacial surgical procedures: introducing a computer-assisted planning and execution system
Tokgöz et al. Cosmetic and reconstructive facial plastic surgery related simulation and optimization efforts
Wu et al. Error analysis of robot-assisted orthognathic surgery
Xia et al. A new paradigm for complex midface reconstruction: a reversed approach
Barretto et al. The untold history of planning in orthognathic surgery: a narrative review from the beginning to virtual surgical simulation
Lee et al. Precision of a CAD/CAM–engineered surgical template based on a facebow for orthognathic surgery: an experiment with a rapid prototyping maxillary model
Piatt et al. Application of computer-assisted design in craniofacial reconstructive surgery using a commercial image guidance system
Christensen et al. The digital thread for personalized craniomaxillofacial surgery
Markiewicz et al. Technology in oral and maxillofacial reconstruction
Alkureishi et al. Patient-Specific Planning in Head and Neck Reconstruction Including Virtual Reality
Villing et al. Navigational Surgery and Computer Assisted Treatment Planning
Clijmans et al. Computer Supported pre-operative planning of craniosynostosis surgery: A MIMICS-Integrated approach
Xia et al. A New Clinical Protocol to Plan Craniomaxillofacial Surgery Using Computer‐Aided Simulation
Bianchi Simulation Guided Navigation in cranio-maxillo-facial surgery: a new approach to improve intraoperative three-dimensional accuracy and reproducibility during surgery.
WO2016086041A1 (en) Patient-specific trackable soft tissue cutting guides
Abdelatif et al. Assessment of the reliAbility of three dimensionAl virtuAl simulAtion in prediction of orthognAthic surgery cAses

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14866776

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15100229

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14866776

Country of ref document: EP

Kind code of ref document: A1