WO2013009709A2 - Systems and methods for estimating extracorporeal blood volume and for counting surgical samples - Google Patents

Systems and methods for estimating extracorporeal blood volume and for counting surgical samples Download PDF

Info

Publication number
WO2013009709A2
WO2013009709A2 PCT/US2012/045969 US2012045969W WO2013009709A2 WO 2013009709 A2 WO2013009709 A2 WO 2013009709A2 US 2012045969 W US2012045969 W US 2012045969W WO 2013009709 A2 WO2013009709 A2 WO 2013009709A2
Authority
WO
WIPO (PCT)
Prior art keywords
sample
image
blood volume
physical
physical sample
Prior art date
Application number
PCT/US2012/045969
Other languages
French (fr)
Other versions
WO2013009709A3 (en
Inventor
Siddarth Satish
Kevin Miller
Ali Zandifar
Charles ZHAO
Andrew HOSFORD
Amer ABDULLA
Michael Hsieh
David REMPEL
Mark GONZALGO
Original Assignee
Gauss Surgical
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gauss Surgical filed Critical Gauss Surgical
Priority to CN201280033911.3A priority Critical patent/CN103988057B/en
Priority to EP19156549.8A priority patent/EP3561721B8/en
Priority to JP2014519099A priority patent/JP5794597B2/en
Priority to EP12810640.8A priority patent/EP2729901B1/en
Priority to EP16183350.4A priority patent/EP3106087B8/en
Priority to EP22204488.5A priority patent/EP4147631A1/en
Publication of WO2013009709A2 publication Critical patent/WO2013009709A2/en
Publication of WO2013009709A3 publication Critical patent/WO2013009709A3/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/02042Determining blood loss or bleeding, e.g. during a surgical procedure
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/08Accessories or related features not otherwise provided for
    • A61B2090/0804Counting number of instruments used; Instrument detectors
    • A61B2090/0805Counting number of instruments used; Instrument detectors automatically, e.g. by means of magnetic, optical or photoelectric detectors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30242Counting objects in image

Definitions

  • This invention relates generally to the surgical field, and more specifically to a new and useful system and method for estimating the extracorporeal blood volume in a physical sample for use in surgical practice.
  • FIGURE lA is a flowchart representation of a method of a first preferred embodiment
  • FIGURE iB is a flowchart representation of one variation of the first preferred method
  • FIGURE 2A is a flowchart representation of a method of a second preferred embodiment
  • FIGURE 2B is a flowchart representation of one variation of the second preferred method
  • FIGURE 3A is a flowchart representation of a method of a third preferred embodiment
  • FIGURE 3B is a flowchart representation of one variation of the third preferred method
  • FIGURE 4 is a flowchart representation of one variation of the first preferred method
  • FIGURE 5 is a flowchart representation of one variation of the first preferred method
  • FIGURE 6 is a flowchart representation of one variation of the first preferred method
  • FIGURE 7 is a flowchart representation of another variation of the preferred method.
  • FIGURE 8 is a schematic of a system of a preferred embodiment
  • FIGURE 9 is a schematic of a variation of the preferred system.
  • FIGURE 10 is a graphical representation of an output in accordance with a system or a method of a preferred embodiment. DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • a method Sioo of a preferred embodiment for estimating the extracorporeal blood volume in a portion of a physical sample includes: extracting a feature from a portion of an image of the sample in Block Sno; tagging the portion of the image of the sample with a blood volume indicator according to the extracted feature in Block S120; and estimating the extracorporeal blood volume in at least the portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator in Block S130.
  • the first preferred method Sioo preferably functions to estimate the volume of blood in the physical sample by analyzing an image of the sample.
  • the image of the sample is preferably a color frame of a live video feed, wherein at least a portion of the physical sample is visible in the frame.
  • the image can alternatively be a static or still image, an infrared image, a field of view of an optical sensor, a black and white image, a fingerprint of a field of view of an optical sensor, a point cloud, or any other suitable type of image.
  • the image can be a scan of the physical sample.
  • the image can be captured and then stored on a local or remote data storage device for subsequent processing, though the image can alternatively or in parallel be processed in real time, or in parts or segments to avoid storage of the full image.
  • the first preferred method Sioo preferably estimates an extracorporeal blood volume that includes blood external the body of a patient or subject. Additionally or alternatively, the first preferred method Sioo can estimate an extravascular blood volume that includes blood within the body of a patient or subject but external the vascular system of the patient.
  • the physical sample is preferably an absorbent surgical gauze sponge, a surgical dressing, or a surgical towel, though the sample can be any other textile.
  • the physical sample can be a piece of clothing, a ground, table, wall, or floor surface, an external skin surface, a surgical glove, a surgical implement, or any other surface, material, substrate, or object.
  • a surgeon, nurse, anesthesiologist, gynecologist, soldier, paramedic, or other user can use a machine or device incorporating the first preferred method Sioo to estimate blood volume in one or more physical samples to generate a total estimated blood loss (EBL) of a patient, such as during a surgery, childbirth or any other medical or health-related event.
  • EBL estimated blood loss
  • a law enforcement officer, forensic investigator, or other user can use a machine or device implementing the first preferred method Sioo to estimate extracorporeal blood volume at a crime scene or to assess victim risk during a medical emergency,.
  • the first preferred method Sioo can additionally or alternatively function to estimate the volume, mass, or quantity of another blood-related parameter or extracorporeal blood volume indicator in the physical sample, such as hemoglobin or red blood cell mass or volume in the physical sample.
  • another blood-related parameter or extracorporeal blood volume indicator in the physical sample such as hemoglobin or red blood cell mass or volume in the physical sample.
  • Such blood-related parameters can then be evaluated against additional variables or features to calculate the volume of blood, hemoglobin, red blood cells, white blood cells, plasma, etc. in the physical sample.
  • HCT hematocrit
  • RBC red blood cell content
  • PV plasma volume
  • EBL estimated blood loss (or volume of blood in the physical sample) and is a composite of RBC and PV .
  • the first preferred method Sioo can additionally or alternatively function to detect presence of blood in the sample, compute blood spread rate, compute blood loss rate, calculate blood surface area, estimate patient risk level (e.g., hypovolemic shock), and/or determine hemorrhage classification of the patient.
  • the first preferred method Sioo can provide any other functionality, analyze any other image type or format, estimate any other blood- related parameter, and/or calculate blood volume in the physical sample in any other way.
  • the first preferred method Sioo is preferably implemented in a handheld (mobile) electronic device, such as an application (or 'app') executing on a digital music player, a smartphone, or a tablet computer, as shown in FIGURE 9, wherein a camera integral with the electronic device captures the image of the sample, wherein a processor integral with the electronic device performs Blocks S110, S120, and S130, and wherein a display integral with the electronic device performs Block S160, which recites displaying the estimated blood volume of the portion of the physical sample, the whole of the physical sample, and/or a summed total blood volume across multiple physical samples.
  • a handheld (mobile) electronic device such as an application (or 'app') executing on a digital music player, a smartphone, or a tablet computer, as shown in FIGURE 9, wherein a camera integral with the electronic device captures the image of the sample, wherein a processor integral with the electronic device performs Blocks S110, S120, and S130, and wherein a display integral with the electronic
  • the electronic device can alternatively communicate with a remote server, such as via a wireless communication module 150 implementing cellular, Wi-Fi, or Bluetooth protocol, wherein the server performs at least some of Blocks S110, S120, and S130, and wherein at least some of the outputs of Blocks S110, S120, and S130 are transmitted back to the electronic device and subsequently displayed.
  • a remote server such as via a wireless communication module 150 implementing cellular, Wi-Fi, or Bluetooth protocol, wherein the server performs at least some of Blocks S110, S120, and S130, and wherein at least some of the outputs of Blocks S110, S120, and S130 are transmitted back to the electronic device and subsequently displayed.
  • the first preferred method Sioo can also be a standalone blood volume estimation system, such as a system including a staging tray configured to support a sample, a camera configured to image the sample, and a processor configured to perform at least a portion of the first preferred method Sioo and/or a communication module that communicates with a remote server configured to perform at least a portion of the first preferred method Sioo.
  • the first preferred method Sioo can be implemented in any other system, device, or combination thereof.
  • the first preferred method Sioo can therefore be useful in a hospital setting, such as in a surgical operating room, in a clinical setting, such as in a delivery room, in a military setting, such as on a battlefield, in a law enforcement setting, such as at a crime scene, or in a residential setting, such as to monitor blood loss due to menorrhagia (heavy menstrual bleeding) or epistaxis (nosebleeds).
  • a hospital setting such as in a surgical operating room
  • a clinical setting such as in a delivery room
  • a military setting such as on a battlefield
  • a law enforcement setting such as at a crime scene
  • the first preferred method Sioo can be useful in any other setting.
  • the extracted feature of the portion of the image preferably enables correlation (or pairing) of the portion of the image with a blood loss indicator of the portion of the sample in Block S120, which can further enable estimation of the blood volume in the portion of the sample in Block S130.
  • the extracted feature is preferably an intensity, luminosity, hue, saturation, brightness, gloss, or other color-related value of the portion of the image in at least one component space, such as the red, blue, green, cyan, magenta, yellow, key, and/or Lab component spaces.
  • the extracted feature can be a histogram of various color values across a set of pixels in the portion of the image.
  • the extracted feature can be an estimated surface area of the sample shown in the image, an estimated surface area of a bloodied portion of the sample, a pixel count of the portion of the sample, a pixel count of the entire sample, or a pixel count of only the bloodied region of the sample, a color intensity value of an unsoiled portion of the sample, or any other relevant feature inherent in or available for extraction from the portion of the image of the sample.
  • Block S110 can include extracting any number of features from all or a portion of the image of the sample.
  • Block S110 can similarly include accessing non-image features, such as a current patient intravascular hematocrit, an estimated patient intravascular hematocrit, an historic patient intravascular hematocrit, a weight of the sample, a clinician- estimated sample blood volume, computer-vision-based or gravimetric or human- generated estimates of blood volumes of previous samples, an ambient lighting condition, a type or other identifier of the physical sample, properties of the physical sample, a patient vital sign, patient medical history, an identity of a surgeon, or a type of surgery.
  • non-image features such as a current patient intravascular hematocrit, an estimated patient intravascular hematocrit, an historic patient intravascular hematocrit, a weight of the sample, a clinician- estimated sample blood volume, computer-vision-based or gravimetric or human- generated estimates of blood volumes of previous samples, an ambient lighting condition, a type or other identifier of the physical sample, properties of the physical sample, a patient vital sign, patient medical history, an identity of a surgeon,
  • any of these non-image features can inform selection of template images for comparison with the portion of the sample image, selection of a particular parametric model or function, definition of alarm triggers for misplaced surgical gauze sponges, definition of alarm triggers for excess fluid or blood loss, transformation of extracted features into the blood volume indicator, and/or estimation of blood volume from the blood volume indicator.
  • any of these non-image features can modify enable, or inform any other function of the first preferred method Sioo.
  • Block S110 preferably includes segmenting the image, including isolating a first segment of the sample image representative of the physical sample that is a bloodied object (e.g., a surgical gauze sponge). Block S110 preferably subsequently further segments the first region to define the portion of the sample image that corresponds to a particular portion of the physical sample captured in the sample image. Segmenting the sample image into multiple image segments preferably increases the resolution and/or accuracy of the estimated blood volume of each portion of the physical sample.
  • the size and shape of each image segment can be static, wherein each segment comprises a predefined number of pixels in the image and/or a predefined dimension in physical space, as shown in FIGURE 9.
  • the image segment can define a ten-pixel by ten-pixel rectilinear area of the image or a five-millimeter equilateral triangular area of the physical sample.
  • the image segment can be isolated according to properties of individual pixels or groups of pixels in the image, such as hue, saturation, shade, brightness, chroma, wavelength, or any other metric of color or light, as shown in FIGURE 7.
  • the sample image can be dynamically segmented, wherein portions of the sample image are separated by color property or other features rather than by (or in addition to) pixel location or by location on the physical sample.
  • the portion of the sample image can include the whole of the physical sample associated with the sample image, or the sample image can be segmented or apportioned according to any other schema.
  • the portion of the sample image is preferably a single segment or region including multiple pixels of the image, but the portion of the sample image can alternatively be a plurality of image segments or regions of the sample image, can be of any other size, and/or can be of any other form.
  • Block S110 extracts a feature from the sample image that is a dimension of the physical sample.
  • Block S110 implements object recognition to isolate an object of known type within the field of view of the optical sensor and/or within the sample image.
  • the object can be a surgical tool, a surgical tray, an operating table, a surgical gauze sponge, a suction canister, or any other object of known dimension. From this known dimension, a dimension of the physical sample can be extrapolated, such as by estimating the distance from and/or angle between the optical sensor and the known object and comparing the position of the sample and the known object in the image.
  • Block Sno analyzes shadows in the sample image, coupled with known locations of light sources, to estimate an angle and distance between the physical sample and the capture origin (i.e. the location of the camera or optical sensor when the sample image was captured).
  • the optical sensor is arranged at a known distance from and angle to a staging tray on which the physical sample is arranged for imaging, and Block Sno includes extrapolating the dimension of the physical sample or a portion therefore based upon known placement of the optical sensor relative the staging tray.
  • Block Sno manipulates an IR, sonic, laser, or other type of distance sensor arranged adjacent the optical sensor to transmit a signal toward the physical sample to determine the distance and/or angle between the physical sample and the capture origin of the image.
  • a dimension of the physical sample or a portion thereof can be estimated or determined in any other way.
  • the distance and/or angle between the sample and the optical sensor can be automatically extracted from the image to inform a transform from pixel count of the portion of the sample image into a physical dimension (e.g., inch, centimeter) of the corresponding portion of the physical sample in Block Sno.
  • the estimated angle and/or distance can therefore define an extracted feature of the sample image that informs the generation of the blood indicator tag and/or the transformation of the blood indicator tag into the estimated blood volume in the portion of the physical sample.
  • Block Sno can additionally or alternatively implement any object localization, segmentation (e.g. using edge detection, background subtraction, graph- cut-based algorithms, etc.), gauging, clustering, pattern recognition, template matching (using any one of various metrics), feature extraction, descriptor extraction (e.g. extraction of texton maps, color histograms, HOG, SIFT, etc.), feature dimensionality reduction (e.g.
  • PCA Principal component analysis
  • K-Means linear discriminant analysis, etc.
  • feature selection thresholding, positioning, color analysis, parameteric regression, non-parametric regression, unsupervised or semisupervised parametric or non-parametric regression, or any other type of machine learning or machine vision to estimate a physical dimension of the sample.
  • Such methods preferably compensate for varying lighting conditions of the physical sample, warping of the physical sample (e.g., a wrinkle or warped gauze sponge), warping of the image of the physical sample (e.g., due to optical distortion caused by a lens of the optical sensor), variations in composition of the fluid present in or on the sample, or any other inconsistency or variable prevalent in any use scenarios. For example, once the object, materials, gauze type, etc.
  • the estimated surface area of the physical sample can be compared with a known surface area of a template sample of the same object, material, or gauze type to correct for area estimation errors, such as due to a wrinkle or other non- uniformity in the physical sample when the sample image was taken.
  • Block Sno includes assessing ambient lighting conditions, wherein the ambient lighting conditions define an extracted feature.
  • the 'redness,' 'greenness,' and 'blueness' values i.e. color values in the red, green, and blue color component spaces
  • the weighted composite color value can then be fed into a parametric function or compared against color values of template images to generate the blood volume indicator.
  • Block S110 includes extracting a feature that identifies the physical sample in the sample image as an absorbent surgical gauze sponge.
  • Block Siio preferably implements machine vision, such as object segmentation, edge detection, pattern recognition, or template matching, to determine if the sample image includes an absorbent surgical gauze sponge or if an absorbent surgical gauze sponge is within a field of view of a camera or other optical sensor.
  • Block Siio can preferably determine the type of absorbent surgical gauze sponge, such as laparotomy or RAY-TEC gauze, which can inform selection of a template image of a similar template sample type for comparison with the portion of the sample.
  • Block Siio can additionally or alternatively identify thread count, external dimension, color, physical tag, or any other identifying feature or property of the physical sample to identify the type of sample or a fluid absorptivity, saturation volume, dry weight or mass, dry color, or any other property of the physical sample. Block Siio can therefore reduce processing time necessary to return a template image match for the portion of the sample by isolating key identifying features of the physical sample. Similarly, Block Siio can improve accuracy of the blood volume estimation by isolating key properties that affect fluid absorbance and a correlation between fluid volume and optical properties of the physical sample.
  • Block Siio can additionally or alternatively extract features from the sample image that identify other relevant objects, materials, or fluids in the sample image and/or the field of view of the optical sensor. For example, Block Siio can recognize drops, pools, or smears of blood on a surgical tool, tray, table, wall, floor, or other surface as containing blood. Block Siio can initiate an estimation of blood volume in or on a sample that is other than an absorbent surgical gauze sponge, surgical dressing, or surgical towel.
  • template matching can be used to estimate blood volume in or on the physical sample, as described below, although color value, translucency, saturation, dimension, or any other metric of the sample can be used to parametrically or non-parametrically generate the blood volume indicator tag and/or estimate the extracorporeal blood volume in at least the portion of the physical sample.
  • the extracorporeal blood volume indicator tag is preferably an intermediate parameter for a region of interest in the sample image that translates pixel-level data in the sample image into a blood volume-related variable.
  • the blood volume indicator tag is therefore preferably an estimate of hemoglobin content (e.g., mass, volume, density, percentage by weight, etc.) in the portion of the sample, though the extracorporeal blood volume indicator tag can alternatively be an estimate of red blood cell count or content, white blood count or content, platelet count or content, plasma content, or any other suitable extracorporeal blood volume indicator.
  • the tag can also include any other relevant information, such as estimated hematocrit of the blood in the portion of the physical sample, a time stamp of when the sample image was taken, a time stamp of when the sample image was analyzed, or volume or concentration of other fluids present on or in the portion of the sample, such as bile, saliva, gastric fluid, mucus, pleural fluid, saline, or fecal matter.
  • the blood volume tag is preferably of a form that can be transformed or manipulated into an estimated extracorporeal blood volume in all or a portion of the sample.
  • the extracorporeal blood volume indicator tag for the portion of the sample image is preferably stored with the portion of the sample image or as a pointer to the portion of the sample image.
  • Block S120 includes comparing the extracted feature of the portion of the image of the sample against similar features extracted from template samples (e.g., a training set, samples analyzed previously) of known blood volume indicators and/or known extracorporeal blood volumes.
  • template samples e.g., a training set, samples analyzed previously
  • Block S120 can include implementing a K-nearest neighbor method to compare the extracted feature of the image that is a redness intensity in the red component space with redness intensity values of template samples.
  • Block S120 can further include implementing a K-nearest neighbor method to compare extracted features that include a greenness intensity and a blueness intensity (in conjunction with a redness intensity) of pixels from bloodied regions in the sample image with greenness and blueness intensity values of template samples.
  • Block S120 includes pairing the portion of the image of the sample to a template image of known extracorporeal blood volume indicator.
  • Each template image is preferably contained within a library of template images, and each template image is preferably an image of a template sample of known blood, hemoglobin, red blood cell mass or volume (e.g., per unit physical area), and/or any other suitable blood-related parameter, blood volume indicator, or feature.
  • Each template image in the library is preferably tagged with an extracorporeal blood volume indicator such that the portion of the sample image can be matched to a template image in Block S110, and such that a tag, indicative of the blood volume in the portion of the physical sample, can be associated with the portion of the sample image in Block S120.
  • the library of template images can be assembled in a variety of ways.
  • an image is taken of a template sample that is a used surgical gauze, blood is washed from the used gauze and assayed to determine the hemoglobin mass absorbed into the used gauze, the image of the template sample is tagged with the hemoglobin mass (the extracorporeal blood volume indicator), and the image is catalogued in the library.
  • a template sample is prepared by adding a known volume of blood (of known hematocrit) to a surgical gauze of a known size, an image of the template sample is taken, the image of the template sample is tagged with the known blood volume (the extracorporeal blood volume indicator), and the image is catalogued in the library.
  • the blood volume tag of each image template is preferably a volume or mass of a blood-related parameter, such as hemoglobin or red blood cell content per physical area (e.g., 1 cm 2 ) such that, in Block S130, a blood volume indicator tag of a portion of the image can be multiple by an estimate physical area (or volume) of the corresponding portion of the physical sample to estimate the extracorporeal blood volume in the portion of the sample, as shown in FIGURE 7.
  • a blood volume indicator tag of a portion of the image can be multiple by an estimate physical area (or volume) of the corresponding portion of the physical sample to estimate the extracorporeal blood volume in the portion of the sample, as shown in FIGURE 7.
  • the template sample for each template image can be prepared in any other way or combination of ways, and the extracorporeal blood volume indicator can be any other suitable parameter or metric.
  • the library preferably contains a large number of template images to account for variance in lighting, image quality, type of physical sample (e.g., type of surgical gauze sponge), volumes, concentrations, or hematocrits of blood or other indicator in each sample, "age" of the physical sample, surgical conditions, or any other suitable variable.
  • the template images in the library can also be grouped, such as according to: the type of template sample, such as a gauze sponge, floor, operating table, clothing; lighting or backlighting of the template sample; hematocrit of blood in a template sample; thread count of the template sample that is a textile; quality of the image of the template sample, such as depth of field, focus, distance between the template sample and an optical sensor; or any other suitable parameter.
  • the library can be stored locally on a machine or system configured to perform at least a portion of the first preferred method Sioo, or remotely, such as on a remote server or hard drive accessible by the machine or system when performing at least a portion of the first preferred method Sioo.
  • the sample image can be compared directly to the template image via template matching in Block S120.
  • each image segment can be decomposed into features that are separate color components (e.g., red, green, and blue), and the absolute difference in pixel intensity for the pixels in the portion of the sample image and the pixels in the template image can be calculated for at least one color component.
  • the sample image can alternatively be decomposed prior to segmentation.
  • the absolute difference in pixel intensity is preferably calculated at a wavelength of light that correlates with the extracorporeal blood volume indicator.
  • the absolute difference in pixel intensity for the portion of the sample image and the template image can be calculated at 40onm, a wavelength that can correlate well with hemoglobin concentration for certain absorbent surgical gauze sponges.
  • the template image is preferably paired with the portion of the image when a substantially minimal sum of absolute difference in pixel intensity between the portion of the sample image and the template image is calculated.
  • Block S120 can implement a texton map to pair the sample image with one or more template images.
  • to build the template image library patches from template (training) images can be clustered into centroid patches, such as by k-means clustering.
  • the index of the centroid patch nearest the patch surrounding the pixel can be calculated such that a histogram, of the nearest-centroid indices within a window around each pixel, can be constructed.
  • a background histogram centroid can also be constructed.
  • Clean and bloodied histogram centroids for physical samples e.g., surgical gauze sponges
  • a classification algorithm such as SVM, Naive Bayes, LDA, K- Nearest-Neighbors, or logistic regression, can be trained using histograms centered around or mostly containing background, bloodied, and unsoiled pixels.
  • histogram of the nearest-patch-centroid indices around each pixel in the portion of the sample image is generated and classified based upon a comparison of the histogram and histogram centroid of the pixel, or based upon the output of one of the learned classifiers described above.
  • the histograms and/or histogram centroids of the pixels in the portion of the sample image can then be compared with a subset of histograms and/or histogram centroids of pixels of the template images, based upon the determined class of physical sample, to pair one or more template images with the sample image.
  • Block S120 therefore preferably recites stepping through subsequent template images in the template image library until a suitable match is found for the portion of the sample image.
  • the hue, saturation, shade, brightness, chroma, intensity of wavelength, wavelength range, histogram, histogram centroid, class, or any other color property (e.g., feature) of the portion of the sample image and the template image can be compared in Block S120.
  • the portion of the sample image and the template image are preferably compared substantially directly.
  • the template image and the portion of the sample image can be compared via template matching incorporating any other vision algorithm or image processing method.
  • each template image is a different color or hue in a library of color palettes, wherein each color correlates with a different blood volume or blood volume indicator.
  • the library preferably includes color palettes for different types of surgical sponge gauzes, surgical towels, surgical tool surfaces, floor surfaces, operating or delivery table surfaces, and/or any other common surface, material, object, or feature, wherein each color that is a template image in a color palette is associated with a particular red blood cell content or indicator for a particular type of physical sample.
  • the template image that is a color can be an image of the color or a numerical color identifier, such as a HEX code value (e.g., #FFoooo, #Aooooo, #880000, etc.) or an RGB code value (e.g., (255, o, o), (160, o, o), (190, o, o), etc.).
  • a HEX code value e.g., #FFoooo, #Aooooo, #880000, etc.
  • RGB code value e.g., (255, o, o), (160, o, o), (190, o, o), etc.
  • the feature extracted from the portion of the sample image in Block S110 is a redness value, wherein the redness value is an intensity of a wavelength or composite intensity of a range of wavelengths of light, redness hue, redness saturation, or any other suitable light- or color-related value.
  • Block S110 can similarly extract greenness, blueness, or other color component values of one or more bloodied pixels in the sample image.
  • Block S110 preferably decomposes the sample image into distinct color spaces, such as red, green, and blue component spaces, wherein a color value or intensity is calculated for the portion of the sample image in each color space.
  • the portion of the sample image that is decomposed in Block S110 preferably includes red pixels indicative of blood content in the portion of the physical sample that is associated with the portion of the sample image.
  • the color value(s) of the portion of the image are then compared substantially directly with color values of template images until a suitable match is found.
  • template images with properties substantially dissimilar from those of the portion of the physical sample or the sample image can be withdrawn from comparison with the portion of the sample image in Block S120 in order to reduce processing time required to find a template image match.
  • template images of template samples of surfaces, products, materials, or dimensions substantially dissimilar from that of the portion of the physical sample are excluded from comparison.
  • Block S110 can extract a thread count feature from the sample image, wherein the thread count feature identifies the physical sample as laparotomy gauze, and wherein all template images of template samples that are not of laparotomy gauzes are removed from comparison with the portion of the sample image.
  • thresholding is used to remove substantially irrelevant template images from the test pool.
  • template images with redness values e.g., intensity, hue, saturation, shade, brightness, chroma, wavelength range
  • Tree search can additionally or alternatively be used to reduce processing time.
  • template images can be grouped in the template library and selected or deselected for comparison with the portion of the sample image according to any other schema.
  • Block S120 includes transforming the extracted feature of the portion of the image of the sample into the blood volume indicator.
  • Block S120 preferably implements an algorithm or other mathematical transformation to convert the extracted feature into the blood volume indicator for the portion of the image of the sample. Therefore, in this variation, Block S120 preferably implements parameterized generation of the blood volume indicator.
  • color values of the template images are used to generate a mathematical function, curve, or algorithm that correlates the extracted feature to the blood volume indicator.
  • the extracted feature of the portion of the sample image e.g., redness intensity in the red component space, blueness intensity in the blue component space, greenness intensity in the green component space, or a composite of two or three color intensities
  • a parametric function e.g., intensity-blood volume function
  • reflectance of oxygenated hemoglobin (Hbo2) can be correlated with certain wavelengths of light to substantially directly estimate the content of hemoglobin in the portion of the physical sample associated with the portion of the image.
  • red blood cell count can be extrapolated from hemoglobin content.
  • Blocks S120 and S130 can implement both parametric and non-parametric techniques or methods to correlate one of more extracted features to one or more blood volume indicators. For example, extracted features that are color values in the red, green, and blue color spaces can be compared with template images via non-parametric techniques (e.g., template matching) to tag the portion of the sample with the blood volume indicator, and an extracted feature that is an estimated surface area of a bloodied region of the physical sample can be transformed according to a parametric function to generate a coefficient for conversion of the blood volume indicator into an estimated blood volume in the portion of the sample.
  • non-parametric techniques e.g., template matching
  • Block S120 and S130 can manipulate any relevant image-based feature extracted in Block S110 or any non-image-based feature (e.g., sourced from a clinician, sourced from a medical record, etc.) to generate the blood volume indicator of the portion of the image and the estimated blood volume for at least the portion of the sample, respectively.
  • any relevant image-based feature extracted in Block S110 or any non-image-based feature e.g., sourced from a clinician, sourced from a medical record, etc.
  • S100 includes estimating the extracorporeal blood volume in at least a portion of the physical sample, associated with the portion of the sample image, according to the blood volume indicator tag.
  • the blood volume indicator tag that is a hemoglobin content can estimate red blood cell volume through the formulas
  • Block S130 can additionally or alternatively include estimating total hemoglobin mass or volume, total red blood cell mass or volume, or any other blood-related metric in the physical sample or across multiple samples.
  • a variation of the first preferred method S100 further includes Block S140, which recites identifying the physical sample in the image as a type of absorbent gauze sponge.
  • Block S140 preferably implements machine vision techniques to determine the type of physical sample, as described above. From identification of the type of physical sample in Block S140, the first preferred method S100 can access sample-specific data such as dry weight, absorptivity, fluid saturation volume, or any other data or property of the physical sample, which can enable extraction of additional blood-related data from the image of the physical sample.
  • Block S100 can further include Block S150, which recites indexing a sample count for the physical sample.
  • the sample count is preferably a count of absorbent surgical gauze sponges, dressings, or towels, though the sample count can additionally or alternatively be a count of blood droplets, blood drops, pools of blood, bloodied articles of clothing, bloodied surgical tools, or any other relevant or suitable blood formation or bloodied object.
  • the sample count is preferably displayed with the estimated blood volume of the portion of the physical sample, and the sample count is preferably indexed substantially in real time when the image of the physical sample is taken.
  • Block S150 can function in any other way to index the sample count and to provide this information to a user.
  • Sioo further includes Block S160, which recites displaying the estimated blood volume in the portion of the physical sample, the estimated blood volume in the whole physical sample, and/or the estimated total blood volume across multiple physical samples.
  • this data is preferably presented to a user, such as to a surgeon, a nurse, an anesthesiologist, a gynecologist, a doctor, or a soldier.
  • This data is preferably rendered on a digital display of a machine or system configured to perform at least a portion of the first preferred method Sioo. As shown in FIGURE 9, this data can be presented in the form of an augmented reality overlay on top of the static sample image depicted on the display.
  • this data can be presented in the form of a dynamic augmented reality overlay on top of a live video stream captured by the optical sensor and depicted on the display.
  • data can be presented in an augmented reality overlay on subsequent scanned images of one physical sample, wherein the camera captures digital images at a rate such as 30 frames per second and the augmented reality overlay updates with each new frame or number of frames.
  • This data can alternatively be presented in table, chart, or diagram including the estimated blood volume in one or more physical samples over a period of time.
  • Other blood-related metrics can also be estimated or maintained in the first preferred method Sioo and presented in Block S160, such as blood spread rate, blood surface area, patient risk level, or patient hemorrhage classification.
  • this data or any other blood-related metric or patient information can be presented in any other way or form in Block S160.
  • Sioo further includes Block S170, which recites estimating patient blood loss by summing the blood volume estimate of the physical sample with previous blood volume estimates of other physical samples. Additionally or alternatively, the blood volume estimate of the physical sample can be stored for future summation with blood volume estimates of additional physical samples. By summing blood volume estimates across multiple physical samples, blood loss of a patient can be tracked over time. For example, during a surgery, used surgical gauze sponges can be analyzed via Blocks Sno and S120, wherein a running summation of blood volumes in each used gauze sponge provides time-elapse estimates of total blood loss of the patient, as shown in FIGURE 10.
  • Other blood-related metrics can also be estimated or maintained in Block S130 and summed over time in Block S170.
  • Block S100 further includes Block S180, which recites comparing the identified physical sample against a set of past identified physical samples.
  • Block S150 preferably indexes the sample counter only when the identified physical sample is determined to be unique amongst the set of past identified physical samples.
  • Block S180 therefore functions to determine if a previous sample image including the same physical sample was already analyzed according to any of Blocks S110, S120, and/or S130.
  • Block S180 preferably substantially guards against double counting of the estimated blood volume in the physical sample in Block S170.
  • Each sample image, a fingerprint of each sample image, or a fingerprint of each physical sample is therefore preferably stored, such as on a local or remote sample image database, such that subsequent sample images or physical samples can be compared against past sample images or physical samples in Block S180.
  • comparison of the sample image with previous sample images can require scale, rotation, mirror, stretch or other transformations or fingerprinting of the sample image and/or or previous sample images.
  • Edge detection, segmentation, pattern recognition, feature extraction, and/or other machine vision techniques can be used to determine the uniqueness of bloodied regions of the physical sample shown in the sample image, relative to bloodied regions of other, previously analyzed physical samples.
  • Block S180 can function in any other way to identify the sample image as including the physical sample that was included in a previous sample image.
  • Block S100 further includes Block S190, which recites updating a digital medical record of the patient with the estimated blood volume in the physical sample.
  • Block S190 can additionally or alternatively update the medical record of the patient with the estimated blood volume across multiple physical samples, the estimated blood loss of the patient, patient blood loss trends, or any other relevant metric or data generated related to the circulatory system of a patient.
  • the digital medical record can be maintained locally on a machine or system implementing the first preferred method Sioo or on a local network or remote server accessed by the machine or system to retrieve, update, and/or upload the digital medical record.
  • the physical sample is a fluid canister that collects bodily fluids of a patient, such as blood, bile, saliva, gastric fluid, mucus, pleural fluid, urine, or fecal matter, wherein the image is an image of the fluid canister.
  • Block S110 can include extracting features that include a volume of fluid within the canister, as well as redness, greenness, and blueness intensities of the portion of the image of that canister that includes bloodied pixels and preferably includes little to no glare.
  • Block S120 can include estimating a percentage of blood within the canister relative to other bodily fluids based upon the extracted color values
  • Block S130 can include estimating the volume of blood within the canister.
  • the optical sensor that captures the image of the fluid canister is preferably mounted to the fluid canister.
  • the optical sensor is mounted to the side of and facing the fluid canister that is cylindrical such that the fluid level in the fluid canister can be estimated directly from the sample image.
  • the optical sensor is mounted overhead the fluid canister that also includes a fluid level sensor, wherein an output of the fluid sensor defines a non-image feature that informs at least one of the blood volume indicator and the estimated blood volume in the fluid canister.
  • the optical sensor can be incorporated into a handheld device, wherein a user scans the fluid canister with the optical sensor to capture the sample image.
  • an auxiliary light source such as a lamp or laser next to the canister
  • ambient light could be assessed and used as a feature.
  • fluid is added to the fluid canister over time
  • subsequent sample images of the fluid canister can be captured and analyzed over time, via the first preferred method Sioo, to generate a time-dependent, historical chronicle of fluid content of the fluid canister.
  • Estimated blood volume in the fluid canister can therefore be monitored over time, such as to generate a trend in blood loss for a patient.
  • Such data can be useful to trigger alarms if patient blood loss is occurring too rapidly or if patient blood loss has reached a critical total volume or critical red blood cell loss.
  • loss of other fluids can also be monitored.
  • urine content (or total water content) of the fluid canister can enable tracking of patient hydration level such that the patient can be administered saline when hydration level or hydration loss surpasses a threshold.
  • Differences between fluid color properties of one sample image at a first time and a subsequent sample image at a second time can indicate concentration changes of fluids in the fluid canister between the first and second times.
  • a change in fluid level in the canister between the first and second times, coupled with fluid concentration changes can indicate the floor rate of fluids into (or out of) the fluid canister.
  • Estimated blood and/or other fluid loss through analysis of the sample image of the fluid canister can be further fed into analyses of sample images of surgical sponge gauzes, implements, surfaces, etc. to map total blood and/or other fluid loss of the patient over time.
  • the first preferred method Sioo can function in any other way to estimate the volume of blood within the physical sample that is a fluid canister.
  • One variation of the first preferred method Sioo further comprises estimating the volume of extracorporeal non-blood fluids in the physical sample, such as ascites, saline irrigant, bile, plasma, urine, or saliva.
  • the redness of the physical sample e.g., color intensity of image pixels associated with the physical sample in the red component space
  • the total red blood cell count or volume is subtracted from the estimated total extracorporeal blood volume in the sample, according to an estimated or measured hematocrit of the blood in the physical sample, to estimate the total volume of plasma in the physical sample.
  • the estimated total extracorporeal blood volume is converted to as estimated total extracorporeal blood weight (or mass), wherein the estimated total extracorporeal blood weight (or mass) and dry weight (or mass) of the physical sample are subtracted from a wet weight (or mass) of the physical sample to estimate the total weight (or mass of volume) of substantially clear fluids (e.g., saline, intestinal ascites) in the physical sample.
  • the first preferred method Sioo preferably accessed a mass or weight measurement of the physical sample through a scale electrically coupled to the machine or device implementing the first preferred method Sioo.
  • the first preferred method Sioo preferably implements machine vision techniques to determine the type of physical sample, such as a surgical dressing, a surgical gauze sponge, or a surgical towel from a particular manufacturer.
  • the first preferred method Sioo can then access sample-specific data such as dry weight, absorptivity, fluid and/or saturation volume to enable extraction of further data related to blood or non-blood fluids in the physical sample.
  • sample-specific data such as dry weight, absorptivity, fluid and/or saturation volume
  • the first preferred method Sioo can implement any other technique or method to estimate the volume, weight, or mass of an extracorporeal non-blood fluid in the physical sample.
  • the first preferred method can additionally or alternatively analyze one or more extracted and/or non-image features to estimate any one or more of hemoglobin mass, hematocrit, hemoglobin concentration, fresh frozen plasma, packed red blood cells, colloids, platelets, crystalloid, or any other blood-related parameter of the patient. Any one or more of these blood-related parameters can additionally or alternatively be rendered on a display of the machine, system, or device implementing the first preferred method Sioo.
  • One variation of the first preferred method includes recognizing gestures of a user to control operation of the machine, system, or device implementing the first preferred method Sioo.
  • the preferred method preferably accesses a live video feed captured by the optical sensor that records the image of the physical sample or by any other optical sensor or camera coupled to the machine, system, or device implementing the first preferred method Sioo.
  • the first preferred method Sioo is preferably controlled via non-contact means.
  • this variation of the first preferred method Sioo preferably recognizes non-contact hand gestures.
  • a 'thumbs up' can indicate that the user accepts the detection of the physical sample and the extracorporeal blood volume estimation of the physical sample.
  • the extracorporeal blood volume can then be added to an aggregate extracorporeal blood volume estimated for a set of physical samples.
  • a 'thumbs down' can reject the detection and extracorporeal blood volume estimation for the physical sample.
  • a user can scroll through available physical sample types by sweeping a hand to the left or right. Similarly, the user can scroll through images of previous samples by sweeping a hand vertically.
  • any other gesture can be recognized in any other way to control any other function of the first preferred method Sioo.
  • Another variation of the first preferred method Sioo further functions to generate alarms or warnings related to the circulatory system of a patient.
  • the preferred method Sioo generates a warning that a physical sample that is a surgical sponge gauze was lost or left inside the patient if not identified within a threshold time (e.g., one hour) after being checked into a surgery.
  • the first preferred method Sioo sounds an alarm when the total estimated blood or red blood cell loss of the patient surpasses a threshold level.
  • the threshold blood or red blood cell volume can be unique to the patient and based upon any one or more of the age, gender, weight, medical history, etc. of the patient.
  • the first preferred method Sioo issues a warning of trends in patient blood loss, such as based upon blood distribution across multiple physical samples (e.g., sponges) over time.
  • the first preferred method can additionally or alternatively provide data and/or warnings relating to a rate of blood loss, a rate of blood loss relative to sponge count, a rate of sponge usage, a histogram of sponge usage, or any other suitable data or warning related to the circulatory system of the patient.
  • a second preferred method S200 for estimating the extracorporeal blood volume in a portion of a physical sample includes: comparing a portion of an image of the sample with a template image of known extracorporeal blood volume indicator in Block S210; tagging the portion of the image of the sample with a blood volume indicator according to the template image that is matched to the portion of the image of the sample in Block S220; and estimating the extracorporeal blood volume in at least a portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator in Block S230.
  • the second preferred method S200 preferably implements non- parametric estimation (e.g., template matching) of extracorporeal blood volume in the physical sample, as described above.
  • Block S220 preferably incorporates a variation of Block S220 of the first preferred method Sioo
  • Block S230 preferably incorporates a variation of Block S130 of the first preferred method Sioo.
  • the second preferred method S200 can implement any other technique, method, implementation, and/or variation of the first preferred method Sioo described above.
  • One variation of the second preferred method S200 includes accessing the template image that is a color model paired with a blood volume indicator.
  • the color model can be a template image, a representation of or feature extracted from a template image, a mathematical function or algorithm, or any other suitable color model correlating an extracted feature of the sample image with a blood volume indicator.
  • Block S210 can include comparing the portion of the image of the sample with the template image to generate the blood volume indicator tag that is a composite of the known blood volume indicators of the multiple color models, such as a first and a second template image that each include a color model paired with a blood volume indicator.
  • Block S220 of the second preferred method S200 can include tagging the portion of the image of the sample with the blood volume indicator that is an estimated hemoglobin mass. Furthermore, Block S230 of the second preferred method S200 can include estimating the extracorporeal blood volume in at least the portion of the physical sample according to the hemoglobin mass and an estimated hematocrit of blood in the physical sample. However, Blocks S220 and S230 of the second preferred method S200 can function in any other way, and the second preferred method can implement any other Block, variation, example, or implementation of the first preferred method S100.
  • a third preferred method S300 for counting physical surgical samples includes: identifying a physical sample in a field of view of an optical sensor in Block S310; indexing a sample counter for the identified physical sample in Block S320; extracting a feature from a portion of the field of the view of the optical sensor in Block S320; and estimating the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature in Block S340.
  • the third preferred method S300 preferably functions to identify a physical sample, update a sample count, and estimate the volume of blood in the physical sample by analyzing the field of view of the optical sensor that includes the physical sample.
  • the field of view of the optical sensor is preferably captured in the form of a static or still image of the sample.
  • the physical sample is preferably identified in the field of view of an optical sensor in Block S310, which preferably triggers Block S302 to capture the image of the physical sample, wherein the image of the physical sample is only taken once the physical sample is identified.
  • the image of the sponge can be captured in Block S302 and subsequently analyzed in Block S310 to identify the physical sample visible therein.
  • the physical sample can be any of a surgical dressing, a surgical gauze sponge, a surgical towel, or any other absorbent textile used to collect blood or other bodily fluids.
  • a surgeon, nurse, anesthesiologist, gynecologist, soldier, paramedic, or other user can preferably use a machine, system, or device implementing the third preferred method S300 to maintain a count of and to estimate extracorporeal blood volume in surgical towels, gauze sponges, or other absorbent textiles.
  • an estimated blood loss (EBL) for a patient can be estimated.
  • the third preferred method S300 can therefore be useful in a hospital setting, such as in a surgical operating room, or in a clinical setting, such as in a delivery room, or in any other suitable setting.
  • the third preferred method S300 is preferably implemented in a handheld or mobile electronic device, such as a native application or 'app' executing on a digital music player, a PDA, a smartphone, or a tablet computer.
  • a camera or other optical sensor integral with the electronic device can capture the image of the sample in Block S302
  • a processor integral with the electronic device can perform Blocks S310, S320, and S330, and S340
  • a display integral with the electronic device can display the sample count and the estimated blood volume in the physical sample and/or across multiple physical samples in Block S360.
  • the electronic device can also communicate with a remote server that performs at least some of Blocks S310, S320, S330, and S340.
  • the third preferred method S300 can be implemented in any other system, device, or combination thereof.
  • Block S310 of the third preferred method S300 recites identifying the physical sample in the field of view of the optical sensor.
  • the field of view of the optical sensor can be a static image or a video that was taken previously, wherein Block S310 identifies the physical sample in the static image or video substantially after the image or video was taken.
  • the field of view of the optical sensor is can alternatively be a live feed from the optical sensor, wherein Block S310 identifies the physical sample in the field of view substantially in real time.
  • the image is preferably a color image captured by any of a digital color camera, an RGB camera, or any number of charge-coupled device (CCD) sensors, complimentary metal-oxide- semiconductor (CMOS) active pixel sensors, or other optical sensors of any other type.
  • the optical sensor can capture the image of the sample in any other form or across any other wavelength or range of wavelengths in the visible spectrum, infrared spectrum, or any other spectrum.
  • Block S310 preferably implements machine vision to identify content in the field of view as including or not including a suitable sample that is surgical sponge gauze, towel, or dressing.
  • Block S310 uses edge detection to estimate the perimeter of the physical sample visible in the field of view and then determines a physical dimension of the physical sample, such as length and width in inches, through gauging.
  • the dimension of the physical sample can be estimated by transforming the field of view according to a known or anticipated distance or angle between the optical sensor and the physical sample, by estimating distance and angle according to shadows or objects of known dimension in the field of view, by accessing data from an infrared, laser, sonic, or other range finder arranged proximal the optical sensor, or by any other suitable technique or device.
  • Block S310 can determine both the presence, size, and/or and type of a physical sample in the field of view of the optical sensor.
  • Block S310 also implements edge detection to determine a boundary of the physical sample visible in the field of view and subsequently removes substantially all of the field of view that is outside the estimated boundary of the physical sample. Block S310 then performs image matching to compare generally the boundary of the physical sample visible in the field of view with boundaries of template samples in a library of proper physical samples. In this variation, deviation in boundary path, color property, contrast with a background, or other property of the estimated physical sample relative the template sample beyond a specified threshold can indicate that the sample in the field of view is not a suitable sample.
  • Block S310 implements pattern recognition and machine learning to determine the presence and/or type of physical sample in the field of view of the optical sensor.
  • This variation preferably incorporates supervised machine learning, wherein Block S310 accesses a set of training data that includes template images properly labeled as including or not including a suitable sample. A learning procedure then preferably transforms the training data into generalized patterns to create a model that can subsequently be used to analyze the field of view of the optical sensor an detect a proper physical sample shown therein.
  • Block S310 can alternatively implement unsupervised learning or semi-supervised learning (e.g. clustering, mixture of Gaussians, GrabCut) in which at least some of the training data has not been labeled.
  • Block S310 can further implement feature extraction, feature dimensionality reduction (e.g., principle component analysis (PCA)), feature selection, or any other suitable technique to prune redundant or irrelevant features from the field of view of the optical sensor (or the image).
  • PCA principle component analysis
  • the third preferred method S300 preferably accepts an input indicative of an improper identification of a physical sample in the field of view.
  • the input preferably provided by a surgeon, nurse, anesthesiologist, gynecologist, or other user, can indicate that the field of view does include a suitable sample when Block S310 incorrectly determines that the field of view does not include a suitable sample. Also or alternatively, the input can indicate that the field of view does not include a suitable sample when Block S310 incorrectly determines that the field of view does include a suitable sample.
  • This input is then preferably fed back into the set of training data, wherein the input is assumed correct, the field of view is labeled with the input, and the field of view (or image) and input tag are added to the training set, such as in Block 332 shown in FIGURE 3B.
  • the field of view can also be fed back into the set of training data, wherein the determination of Block S310 is assumed correct absent corrective input, the field of view is labeled with the determination of Block S310, and the field of view (or image) and determination tag are added to the training set.
  • the training set can grow perpetually and continue to teach Block S310, which may substantially improve the machine-learning algorithm and improve the accuracy of Block S310.
  • Block S310 can therefore implement any of segmentation, localization, edge detection, gauging, clustering, pattern recognition, template matching, feature extraction, principle component analysis (PCA), feature dimensionality reduction, feature selection, thresholding, positioning, color analysis, closed feedback, or any other type of machine learning or machine vision.
  • Such methods preferably compensate for varying lighting conditions of the physical sponge, warping of the physical sample (e.g., a wrinkle or warped sponge), warping of the image of the physical sample (e.g., due to optical distortion caused by the optical sensor), or any other inconsistency or variable common in use scenarios
  • Block S310 can additionally or alternatively function to identify other relevant objects, materials, or fluids in the field of view of the optical sensor.
  • the aforementioned machine vision techniques can again be similarly implemented in Block S310 to identify blood droplets, drops, pools, or smears on a surgical tool, tray, table, wall, floor, or other surface.
  • Such bloodies articles can also or alternatively be added to the sample count in Block S320 and/or analyzed in Blocks S330 and/or S340.
  • Block S310 can further include identifying additional physical samples in fields of view of the optical sensor and indexing the sample counter for the identified additional physical samples, either in series before or after identifying the physical sample or substantially simultaneously while identifying the physical sample.
  • Block S310 can implement and one or more of the same or different aforementioned methods or techniques to identify the additional physical samples in the field of view of the image.
  • Block S300 includes Block S302, which recites capturing the image of the physical sample.
  • Block S302 can trigger Block 110, wherein Block S302 captures the image and Block S310 subsequently identifies the presence of a suitable sample in the field of view that is the image.
  • an input from a surgeon, a nurse, an anesthesiologist, a gynecologist, or any other user can trigger Block S302.
  • Block S310 preferably triggers Block S302 when a suitable sample is identified in the field of view of the optical sensor.
  • a user preferably places the physical sample within the field of view of the optical sensor, Block S310 identifies the physical sample, and Block S302 captures the image of the sample automatically.
  • the physical sample is preferably held at a substantially known angle between and/or distance from the optical sensor such that a dimension of the physical sample in the field of view can be estimated, such as through gauging described above.
  • the image of the physical sample captured in Block S302 is preferably a color image of the physical sample against a background, wherein the image is subsequently presented to a user on a digital display in Block S360 with the sample count and the estimated blood volume in the sample defining an augmented reality overlay.
  • the image can be: a color image of the physical sample with the background removed; an infrared image or black and white image; a fingerprint of the field of view, such as with pointers or indicators of unique identifying features of the physical sample; or any other suitable type of image.
  • the image is preferably stored for later access, such as in the variation of the third preferred method S300 that includes Block S380 in which the identified physical sample is checked for a duplicate physical sample identified in a previous field of view or image.
  • the image can be stored locally, such as on a data storage module arranged within a handheld electronic device performing at least some Blocks of the third preferred method S300, or remotely, such as in digital memory accessed through a remote server or a local network.
  • Block S320 of the third preferred method S300 includes indexing the sample counter for the identified physical sample identified.
  • the sample counter is preferably a cumulative counter of successive physical samples identified as a surgical dressing, a surgical gauze sponge, or a surgical towel.
  • physical samples of various types can be tallied together in one group, though physical samples of various types can alternatively be tallied in separate groups.
  • the groups can be defined according to genus, such as according to sample type including a surgical dressing group, a surgical gauze sponge group, or a surgical towel group.
  • the groups can also be defined according to species, such as according to manufacture or purpose including a Ray-Tec surgical gauze group and a laparotomy surgical gauze group.
  • the sample count can include a tally of other blood-related samples, such as blood drops, pools, or smears of certain sizes or estimated blood volumes, though the sample count can track the number of any other relevant physical sample of any other type.
  • one variation of the preferred method includes
  • Block S324 which recites receiving confirmation of identification of the physical sample.
  • Block S320 preferably indexes the sample counter only for the physical sample that is confirmed.
  • Sample confirmation is preferably provided by a user, such as through a touch-free gesture recognition or via a foot pedal, as described below.
  • the sample count is preferably displayed to a user, such as through a display in Block S360.
  • the sample count is also preferably updated and stored on a local or remote hard drive or data storage device accessible by the machine or system performing at least portions of the third preferred method S300.
  • Block S330 of the third preferred method S300 recites extracting a feature from a portion of the field of the view of the optical sensor.
  • Block S340 of the third preferred method S300 recites estimating the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature. Therefore, Blocks S330 and S340 of the third preferred method S300 preferably cooperate to estimate extracorporeal blood volume in the physical sample according to any one or more methods of the first preferred method described above.
  • the field of view of the optical segment or the image is statically segmented according to predefined segment size and/or shape, such as a square ten-pixel by ten-pixel area.
  • image segment can be dynamically segmented, such as according to redness, hue, saturation, shade, brightness, chroma, wavelength range, or any other metric of color or light in the field of view or in the image.
  • Each segment of the image segment is preferably decomposed into separate color components (e.g., red, green, and blue), and for each color component, the absolute difference in pixel intensity for the pixels in the image segment and a template image is calculated.
  • each template image in the library of template images is preferably an image of a master sample of known extracorporeal blood volume, hematocrit, red blood cell or hemoglobin volume, density, and/or any other suitable blood-related parameter or blood volume indicator.
  • each template image preferably includes information to inform the blood volume or blood volume indicator of the image segment.
  • the blood volume indicator can be converted into a blood volume, a hemoglobin or red blood cell mass or volume, or other blood-related metric, such as correlated with an estimated physical dimension of a portion of the physical sample identified in the image segment.
  • the library of template images can additionally or alternatively be a color palette, wherein each template image is a different color indicative of a different blood volume or blood volume indicator, such as rather than each template image being of a physical master sample of known blood volume or indicator.
  • the library is preferably a color palette for different types of absorbent surgical sponge gauzes, dressings, and towels, wherein each color (i.e. template image) in a color palette for a particular type of physical sample is associated with a particular blood volume or blood volume indicator.
  • the template image that is a color can be an image of the color or a numerical color identifier, such as a HEX code value (e.g., #FFoooo, #Aooooo, #880000, etc.) or an RGB code value (e.g., (255, o, o), (160, o, o), (190, o, o), etc.).
  • a HEX code value e.g., #FFoooo, #Aooooo, #880000, etc.
  • RGB code value e.g., (255, o, o), (160, o, o), (190, o, o), etc.
  • processing time required to find a template image match for each image segment can be reduced by avoiding comparison of each image segment with certain template images substantially dissimilar from the image segment.
  • Template images of master samples of surfaces, products, materials, or dimensions substantially dissimilar from that of the physical sample can be excluded from comparison. Thresholding can also be used to remove substantially irrelevant template images from the test pool. For example, template images with redness values (e.g., intensity, hue, saturation, shade, brightness, chroma, wavelength range) or physical dimensions substantially dissimilar from that of the image segment can be excluded from comparison. Tree searching can also be used to reduce processing time.
  • template images can be grouped in the template library and selected or deselected from comparison with the image segment in any other way.
  • the image library is substantially large enough that the entire portion of the image or field of associated with a proper physical sample is compared against template images in the library, and the blood volume or blood volume indicator is directly estimated for the entire physical sample without segmentation.
  • Redness value is calculated for each image segment.
  • Redness value can be intensity of a wavelength or composite intensity of a range of wavelengths of light, redness hue, redness saturation, RGB code value (e.g., (o, o, o) through (255, o, o)) or any other suitable metric over the image segment.
  • the image of the sample is decomposed into distinct color spaces (e.g., red, green, and blue), wherein a redness value is calculated for the image segment in at least the red color space.
  • the redness value of the image segment can then be converted into a blood volume or blood volume indicator, such as through a lookup table, a regression model, a non-negative least-squares algorithm, or any other suitable algorithm, model, or method.
  • a blood volume or blood volume indicator such as through a lookup table, a regression model, a non-negative least-squares algorithm, or any other suitable algorithm, model, or method.
  • reflectance of oxygenated hemoglobin (Hb02) can be correlated with certain wavelengths of light to substantially directly estimate the volume or mass of hemoglobin in the portion of the physical sample identified in the image segment.
  • the image or field of view is not segmented, and a redness value is instead calculated for the entire portion of the image or field of view correlated with the physical sample.
  • the redness value can be an average or weighted average of redness, hue, saturation, shade, brightness, chroma, wavelength range, or any other metric of color or light of the identified image sample.
  • the blood volume or blood volume indicator for the entire portion of the physical sample identified in the field of view or in the image can be estimated according to the redness value.
  • FIGURE 3B one variation of the third preferred method
  • Block S300 further includes Block S360, which recites displaying the estimated extracorporeal blood volume in the physical sample and the sample count.
  • This data is preferably presented on a digital display of a machine or system configured to perform the Blocks of the third preferred method S300.
  • This data can be presented in the form of an augmented reality overlay on top of the static sample image depicted on the display, in the form of a dynamic augmented reality overlay on top of a live video stream captured by the optical sensor and depicted on the display, in the form of a table, chart, or diagram including the sample count and the singular and/or cumulative estimated blood volumes in one or more physical samples over a period of time or during a medical event or emergency, or in any other suitable form.
  • Blood-related metrics can also be estimated in the third preferred method S300 and presented in Block S360, such as blood spread rate, blood surface area, patient risk level, extracorporeal non-blood fluid volume, or patient hemorrhage classification.
  • the sample count, estimated blood volume(s), and/or any other blood-related metric or patient information can be presented in any other way or form in Block S360.
  • Block S300 includes Block S380, which recites comparing the identified physical sample against a set of past identified physical samples.
  • the sample counter is preferably indexed in Block S120 only when the identified physical sample is determined to be unique amongst the set of past identified physical samples.
  • the image of the sample, a fingerprint of the sample image, the extracted feature of the image, or other identifying feature of the physical sample in the image can be compared with images, fingerprints, extracted features, and/or other identifying features of images of previous physical samples.
  • Block S380 preferably substantially therefore preferably prevents double counting of the physical sample in the sample count of Block S320 and/or prevents double counting of the estimated volume of blood in a total extracorporeal blood volume estimate across multiple physical samples or total estimated blood loss of a patient.
  • comparison of the sample image with a previous sample image can require image fingerprinting or a scale, rotation, mirror, stretch or other transformation of either the sample image or the previous sample image.
  • Edge detection, pattern recognition, and/or other machine vision techniques can additionally or alternatively be used to determine the uniqueness of bloodied regions of the physical sample visible in the sample image, relative to bloodied regions of a previous physical sample.
  • Block S380 can function in any other way to identify the physical sample as shown in a previous sample image.
  • Block S300 includes Block S390, which recites updating a digital medical record of the patient with the estimated blood volume in the physical sample.
  • Block S190 can additionally or alternatively update the medical record of the patient with the estimated blood volume across multiple physical samples, the estimated blood loss of the patient, patient blood loss trends, or any other relevant metric or data generated related to the circulatory system of a patient.
  • the digital medical record can be maintained locally on a machine or system implementing the third preferred method S300 or on a local network or remote server accessed by the machine or system to retrieve, update, and/or upload the digital medical record.
  • the third preferred method S300 can further implement any one or more methods, Blocks, or variations of the first preferred method S100.
  • a preferred system 100 for estimating the extracorporeal blood volume in a portion of a physical sample includes: an optical sensor 110, a processor 120, and a display 130.
  • the optical sensor 110 captures an image of the physical sample (the 'sample image').
  • the processor 120 extracts a feature from a portion of an image of the sample, tags the portion of the image of the sample with a blood volume indicator according to the extracted feature, and estimates the extracorporeal blood volume in at least a portion of the physical sample, identified in the portion of the image of the sample, according to the blood volume indicator.
  • the display 130 depicts the estimated blood volume in at least the portion of the physical sample.
  • the system 100 preferably functions to estimate the volume of blood in the sample by analyzing the sample image.
  • the preferred system 100 is configured and/or adapted to perform one or more Blocks of the first preferred method S100.
  • the sample is preferably an absorbent surgical gauze sponge, though the sample can also be a table or floor surface, a piece of clothing, an external skin surface or surgical glove, a surgical implement, a fluid canister, or any other surface or material.
  • a surgeon, nurse, anesthesiologist, gynecologist, doctor, soldier, or other user can preferably use the system 100 to estimate blood volume in one sample and then sum the estimated blood volume in the sample with estimated blood volumes in other samples to generate a total estimated blood loss (EBL) of a patient during a surgery, child birth, or other medical event or situation.
  • EBL estimated blood loss
  • the preferred system 100 can alternatively function to estimate the content (e.g., volume, mass) of another blood-related parameter or extracorporeal blood volume indicator in the sample, such as hemoglobin, ( HGB) or red blood cell (RBC) content of the sample.
  • another blood-related parameter or extracorporeal blood volume indicator in the sample such as hemoglobin, ( HGB) or red blood cell (RBC) content of the sample.
  • the preferred system 100 can additionally or alternatively function to detect presence of blood in the sample, compute blood spread rate, calculate blood surface area, estimate patient risk level (e.g., hypovolemic shock), and/or determine hemorrhage classification of the patient.
  • the preferred system 100 can provide any other functionality, analyze any other image type or format, estimate any other blood-related parameter, and calculate blood volume in the physical sample in any other way.
  • the preferred system 100 can be configured as a handheld (e.g., mobile) electronic device, such as a smartphone or tablet running an image-based blood estimation application (or app) and including the camera 110, the processor 120, and the display 130.
  • the components of the preferred system 100 can be substantially discreet and distinct (i.e., not contained within a single housing).
  • the optical sensor 110 can be a camera substantially permanently arranged within an operating room, wherein the camera communicates with a local network or a remote server (including the processor 120) on which the sample image is analyzed (e.g., according to the method S100), and wherein a display 130 that is a computer monitor, a television, or a handheld (mobile) electronic device accesses and displays the output of the processor 120.
  • the preferred system 100 can be of any other form or include any other component.
  • the preferred system 100 can preferably be used in a variety of settings, including in a hospital setting, such as in a surgical operating room, in a clinical setting, such as in a delivery room, in a military setting, such as on a battlefield, or in a residential setting, such as aiding a consumer in monitoring blood loss due to menorrhagia (heavy menstrual bleeding) or epistaxis (nosebleeds).
  • a hospital setting such as in a surgical operating room
  • a clinical setting such as in a delivery room
  • a military setting such as on a battlefield
  • a residential setting such as aiding a consumer in monitoring blood loss due to menorrhagia (heavy menstrual bleeding) or epistaxis (nosebleeds).
  • the preferred system 100 can be used in any other setting.
  • the optical sensor 110 of the preferred system 100 functions to capture the image of the physical sample.
  • the optical sensor 110 preferably implements Block S102 of the preferred embodiment.
  • the optical sensor 110 is preferably a digital camera that captures a color sample image or an RGB camera that captures independent image components in the red, green, and blue fields.
  • the optical sensor 110 can comprise any number of cameras, charge-coupled device (CCD) sensors, complimentary metal-oxide-semiconductor (CMOS) active pixel sensors, or optical sensors of any other type.
  • the optical sensor 110 can capture the sample image in any other form or across any other wavelength or range of wavelengths in the visible spectrum, infrared spectrum, or any other spectrum.
  • the optical sensor 110 is preferably a camera arranged within a handheld electronic device, as shown in FIGURE 8.
  • the optical sensor 110 can also or alternatively be a camera or other sensor configured to be mounted on a pedestal for placement in an operating room, configured to be mounted to a ceiling over an operating table, configured for attachment to a battlefield helmet of a field nurse, configured to mount to a standalone blood volume estimation system including the processor 120, the display 130, and a staging tray that supports the physical sample for imaging, or configured for placement in or attachment to any other object or structure.
  • the processor 120 of the preferred system extracts a feature from a portion of an image of the sample, tags the portion of the image of the sample with a blood volume indicator according to the extracted feature, and estimates the extracorporeal blood volume in at least a portion of the physical sample, identified in the portion of the image of the sample, according to the blood volume indicator.
  • the processor 120 can preferably perform the Blocks of the first preferred method Sioo described above.
  • the processor 120 can be coupled to the optical sensor 110, such as via a wired connection (e.g., a trace on a shared PCB) or a wireless connection (e.g., a Wi-Fi or Bluetooth connection), such that the processor 120 can access the sample image captured by or visible in the field of view of the optical sensor 110.
  • a wired connection e.g., a trace on a shared PCB
  • a wireless connection e.g., a Wi-Fi or Bluetooth connection
  • the processor 120 is arranged within a handheld electronic device that also contains the optical sensor 110 and the display 130.
  • the processor 120 is a portion of or is tied to a remote server, wherein image data from the optical sensor 110 is transmitted (e.g., via an Internet or local network connection) to the remote processor 120, wherein the processor 120 estimates the extracorporeal blood volume in at least the portion of the physical sample by analyzing the sample image, and wherein the blood volume estimate is transmitted to the display 130.
  • the processor 120 can pair the portion of the sample image to the template image via template matching, and the template image is preferably one template image in a library of template images.
  • the processor 120 parametrically generate the blood volume indicator based upon at least one extract feature from the image of the sample.
  • the processor 120 can therefore be in communication with a local or remote data storage module, such as a hard drive in the handheld electronic device or a memory module of a remote server.
  • the processor 120 can further upload the sample image for checking subsequent sample images against duplicate analysis of the same physical sample, for example as described with reference to Block 180 of the first preferred method Sioo.
  • the processor 120 can analyze different types of images (e.g., static, streaming, .MPEG, .JPG, .TIFF) and/or images from one or more distinct cameras or optical sensors.
  • the display 130 of the preferred system 100 preferably depicts the estimated blood volume in at least the portion of the physical sample.
  • the display 130 is preferably arranged within the handheld electronic device (e.g., smartphone, tablet, personal data assistant) that also contains the optical sensor 110 and the processor 120, as shown in FIGURE 8.
  • the display can be a computer monitor, a television screen, or any other suitable display physically coextensive with any other device, as shown in FIGURE 7.
  • the display 130 can therefore be any of an LED, OLED, plasma, dot matrix, segment, e-ink, or retina display, a series of idiot lights corresponding to estimated blood volume, or any other suitable type of display.
  • the display 130 can be in communication with the processor 120 via any of a wired and a wireless connection.
  • the display 130 can preferably perform at least Block S160 by depicting the estimated blood volume in the portion of the physical sample, in the whole of the physical sample, and/or across multiple physical samples.
  • the blood volume estimate is preferably depicted in a common form, such as "cc's" (cubic centimeters).
  • this data can be presented in the form of a dynamic augmented reality overlay on top of a live video stream of the physical sample that is also depicted on the display 130, wherein images from the optical sensor 110 are relayed substantially in real time, through the processor 120, to the display 130.
  • the data can alternatively be presented in a table, chart, or graph depicting at least one of a time- elapse cumulative estimated blood volume across multiple samples analyzed over time and individual blood volume estimates for each physical sample.
  • the display 130 can also depict: previous sample images; warnings, such as patient risk level (e.g., hypovolemic shock), or a hemorrhage classification of the patient; or suggestions, such as begin blood transfusion. Any of these data, warnings, and/or suggestions can also be depicted across multiple screens or made available for access on any one of more displays.
  • one variation of the preferred system 100 can further include a handheld housing 140 configured to contain the optical sensor 110, the processor 120, and the display 130.
  • the handheld housing 140 with optical sensor 110, processor 120, and display 130 can define a handheld (mobile) electronic device capable of estimating blood volume in one or more physical samples in any number of suitable environments, such as in an operating room, a delivery room, a battlefield, a crime scene, and a home.
  • the housing 140 further contains a wireless communication module 150 that communicates the estimated blood volume in the portion of the physical sample to a remote server configured to store an electronic medical record of a patient.
  • the medical record is also preferably updated with estimated blood loss over time, patient risk level, hemorrhage classification, and/or other blood-related metrics or blood volume indicators.
  • the patient medical record can therefore be updated substantially automatically during a medical event, such as a surgery or childbirth.
  • the housing 140 is preferably of a medical-grade material such that the system 100 that is a handheld electronic device is suitable for use in an operating room or other medical or clinical setting.
  • the housing can therefore be medical-grade stainless steel, such as 316L stainless steel, a medical- grade polymer, such as high-density polyethylene (HDPE), or a medical-grade silicone rubber.
  • the housing can be of any other material or combination of materials.
  • a variation of the preferred system 100 further includes a foot pedal 160 accessible by a user to confirm or to refute the identity of the physical sample.
  • the processor 120 preferably indexes the sample count when the user confirms the identity of the physical sample through the foot pedal 160. Additionally or alternatively, the user can engage the foot pedal 160 to select an appropriate sample type (e.g., a surgical sponge gauze, a surgical towel, a surgical dressing), to scroll through previous sample images, or to control the preferred system 100 in any other way.
  • the foot pedal 160 therefore preferably includes at least two input regions that can be engaged by a foot of a user to manipulate the preferred system 100.
  • the processor additionally or alternatively compares a portion of the image of the sample with a template image of known blood volume indicator, tags the portion of the image of the sample with a blood volume indicator according to the template image that is matched to the portion of the image of the sample, and estimates the extracorporeal blood volume in at least a portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator.
  • the processor additionally or alternatively identifies the physical sample in the image, indexes a sample counter for the identified physical sample, extracts a feature from a portion of the image, estimates the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature.
  • the preferred system 100 can therefore implement the first preferred method, the third preferred method, and/or any combination or variation thereof.
  • the systems and methods of the preferred embodiments can be embodied and/or implemented at least in part as a machine configured to receive a computer- readable medium storing computer-readable instructions.
  • the instructions are preferably executed by computer-executable components preferably integrated with the system, the optical sensor, the processor, the display, hardware/firmware/software elements of a system or handheld electronic device, or any suitable combination thereof.
  • Other systems and methods of the preferred embodiments can be embodied and/or implemented at least in part as a machine configured to receive a computer-readable medium storing computer-readable instructions.
  • the instructions are preferably executed by computer-executable components preferably integrated by computer- executable components preferably integrated with apparatuses and networks of the type described above.
  • the computer-readable medium can be stored on any suitable computer readable media such as RAMs, ROMs, flash memory, EEPROMs, optical devices (CD or DVD), hard drives, floppy drives, or any suitable device.
  • the computer- executable component is preferably a processor but any suitable dedicated hardware device can (alternatively or additionally) execute the instructions.

Abstract

One method for estimating the extracorporeal blood volume in a portion of a physical sample includes: extracting a feature from a portion of an image of the sample; tagging the portion of the image of the sample with a blood volume indicator according to the extracted feature; and estimating the extracorporeal blood volume in at least the portion of the physical sample, identified in the portion of the image of the sample, according to the blood volume indicator.

Description

SYSTEMS AND METHODS FOR ESTIMATING EXTRACORPOREAL BLOOD VOLUME AND FOR COUNTING SURGICAL SAMPLES
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of U.S. Provisional Patent Application
Serial No. 61/506,082, filed 09 JUL 2011, U.S. Provisional Patent Application Serial No. 61/646,818, filed 14 MAY 2012, and U.S. Provisional Patent Application Serial No. 61/646,822, filed 14 MAY 2012, all of which are herein incorporated in their entireties by this reference.
TECHNICAL FIELD
[0002] This invention relates generally to the surgical field, and more specifically to a new and useful system and method for estimating the extracorporeal blood volume in a physical sample for use in surgical practice.
BACKGROUND
[0003] Overestimation and underestimation of patient blood loss is a significant contributor to high operating and surgical costs for hospitals, clinics and other medical facilities. Specifically, overestimation of patient blood loss results in wasted transfusion- grade blood and higher operating costs for medical institutions and can lead to blood shortages. Underestimation of patient blood loss is a key contributor of delayed resuscitation and transfusion in the event of hemorrhage and has been associated with billions of dollars in avoidable patient infections, re-hospitalizations, and lawsuits annually. Thus, there is a need in the surgical field for a new and useful system and method for estimating extracorporeal blood volume in a physical sample. This invention provides such a new and useful system and method. BRIEF DESCRIPTION OF THE FIGURES
[0004] FIGURE lA is a flowchart representation of a method of a first preferred embodiment;
[0005] FIGURE iB is a flowchart representation of one variation of the first preferred method;
[0006] FIGURE 2A is a flowchart representation of a method of a second preferred embodiment;
[0007] FIGURE 2B is a flowchart representation of one variation of the second preferred method;
[0008] FIGURE 3A is a flowchart representation of a method of a third preferred embodiment;
[0009] FIGURE 3B is a flowchart representation of one variation of the third preferred method;
[0010] FIGURE 4 is a flowchart representation of one variation of the first preferred method;
[0011] FIGURE 5 is a flowchart representation of one variation of the first preferred method;
[0012] FIGURE 6 is a flowchart representation of one variation of the first preferred method;
[0013] FIGURE 7 is a flowchart representation of another variation of the preferred method;
[0014] FIGURE 8 is a schematic of a system of a preferred embodiment;
[0015] FIGURE 9 is a schematic of a variation of the preferred system; and
[0016] FIGURE 10 is a graphical representation of an output in accordance with a system or a method of a preferred embodiment. DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] The following description of preferred embodiments of the invention is not intended to limit the invention to these preferred embodiments, but rather to enable any person skilled in the art to make and use this invention. l. First Method
[0018] As shown in FIGURE lA, a method Sioo of a preferred embodiment for estimating the extracorporeal blood volume in a portion of a physical sample includes: extracting a feature from a portion of an image of the sample in Block Sno; tagging the portion of the image of the sample with a blood volume indicator according to the extracted feature in Block S120; and estimating the extracorporeal blood volume in at least the portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator in Block S130.
[0019] As shown in FIGURE 7, the first preferred method Sioo preferably functions to estimate the volume of blood in the physical sample by analyzing an image of the sample. The image of the sample is preferably a color frame of a live video feed, wherein at least a portion of the physical sample is visible in the frame. However, the image can alternatively be a static or still image, an infrared image, a field of view of an optical sensor, a black and white image, a fingerprint of a field of view of an optical sensor, a point cloud, or any other suitable type of image. In situations in which the physical sample does not fit within a field of view of the camera or optical sensor, the image can be a scan of the physical sample. The image can be captured and then stored on a local or remote data storage device for subsequent processing, though the image can alternatively or in parallel be processed in real time, or in parts or segments to avoid storage of the full image. The first preferred method Sioo preferably estimates an extracorporeal blood volume that includes blood external the body of a patient or subject. Additionally or alternatively, the first preferred method Sioo can estimate an extravascular blood volume that includes blood within the body of a patient or subject but external the vascular system of the patient. [0020] The physical sample is preferably an absorbent surgical gauze sponge, a surgical dressing, or a surgical towel, though the sample can be any other textile. Additionally or alternatively, the physical sample can be a piece of clothing, a ground, table, wall, or floor surface, an external skin surface, a surgical glove, a surgical implement, or any other surface, material, substrate, or object. A surgeon, nurse, anesthesiologist, gynecologist, soldier, paramedic, or other user can use a machine or device incorporating the first preferred method Sioo to estimate blood volume in one or more physical samples to generate a total estimated blood loss (EBL) of a patient, such as during a surgery, childbirth or any other medical or health-related event. Alternatively, a law enforcement officer, forensic investigator, or other user can use a machine or device implementing the first preferred method Sioo to estimate extracorporeal blood volume at a crime scene or to assess victim risk during a medical emergency,.
[0021] The first preferred method Sioo can additionally or alternatively function to estimate the volume, mass, or quantity of another blood-related parameter or extracorporeal blood volume indicator in the physical sample, such as hemoglobin or red blood cell mass or volume in the physical sample. Such blood-related parameters can then be evaluated against additional variables or features to calculate the volume of blood, hemoglobin, red blood cells, white blood cells, plasma, etc. in the physical sample. For example, an estimated or measured hematocrit (HCT) of the blood of a patient can be used to estimate blood volume in the sample according to the formulas:
r,_ RBC RBC
HCT = =
EBL RBC + PV
HGB = .35 x RBC
wherein RBC (red blood cell content) is substantially correlated with hemoglobin volume, PV is plasma volume, and EBL is estimated blood loss (or volume of blood in the physical sample) and is a composite of RBC and PV . The first preferred method Sioo can additionally or alternatively function to detect presence of blood in the sample, compute blood spread rate, compute blood loss rate, calculate blood surface area, estimate patient risk level (e.g., hypovolemic shock), and/or determine hemorrhage classification of the patient. However, the first preferred method Sioo can provide any other functionality, analyze any other image type or format, estimate any other blood- related parameter, and/or calculate blood volume in the physical sample in any other way.
[0022] The first preferred method Sioo is preferably implemented in a handheld (mobile) electronic device, such as an application (or 'app') executing on a digital music player, a smartphone, or a tablet computer, as shown in FIGURE 9, wherein a camera integral with the electronic device captures the image of the sample, wherein a processor integral with the electronic device performs Blocks S110, S120, and S130, and wherein a display integral with the electronic device performs Block S160, which recites displaying the estimated blood volume of the portion of the physical sample, the whole of the physical sample, and/or a summed total blood volume across multiple physical samples. In this implementation, the electronic device can alternatively communicate with a remote server, such as via a wireless communication module 150 implementing cellular, Wi-Fi, or Bluetooth protocol, wherein the server performs at least some of Blocks S110, S120, and S130, and wherein at least some of the outputs of Blocks S110, S120, and S130 are transmitted back to the electronic device and subsequently displayed. However, the first preferred method Sioo can also be a standalone blood volume estimation system, such as a system including a staging tray configured to support a sample, a camera configured to image the sample, and a processor configured to perform at least a portion of the first preferred method Sioo and/or a communication module that communicates with a remote server configured to perform at least a portion of the first preferred method Sioo. However, the first preferred method Sioo can be implemented in any other system, device, or combination thereof.
[0023] The first preferred method Sioo can therefore be useful in a hospital setting, such as in a surgical operating room, in a clinical setting, such as in a delivery room, in a military setting, such as on a battlefield, in a law enforcement setting, such as at a crime scene, or in a residential setting, such as to monitor blood loss due to menorrhagia (heavy menstrual bleeding) or epistaxis (nosebleeds). However, the first preferred method Sioo can be useful in any other setting. [0024] As shown in FIGURES l, 2, and 3, Block S110 of the first preferred method
S100 includes extracting a feature from a portion of an image of the sample. The extracted feature of the portion of the image preferably enables correlation (or pairing) of the portion of the image with a blood loss indicator of the portion of the sample in Block S120, which can further enable estimation of the blood volume in the portion of the sample in Block S130. The extracted feature is preferably an intensity, luminosity, hue, saturation, brightness, gloss, or other color-related value of the portion of the image in at least one component space, such as the red, blue, green, cyan, magenta, yellow, key, and/or Lab component spaces. Furthermore, the extracted feature can be a histogram of various color values across a set of pixels in the portion of the image. Additionally or alternatively, the extracted feature can be an estimated surface area of the sample shown in the image, an estimated surface area of a bloodied portion of the sample, a pixel count of the portion of the sample, a pixel count of the entire sample, or a pixel count of only the bloodied region of the sample, a color intensity value of an unsoiled portion of the sample, or any other relevant feature inherent in or available for extraction from the portion of the image of the sample. Furthermore, Block S110 can include extracting any number of features from all or a portion of the image of the sample.
[0025] Block S110 can similarly include accessing non-image features, such as a current patient intravascular hematocrit, an estimated patient intravascular hematocrit, an historic patient intravascular hematocrit, a weight of the sample, a clinician- estimated sample blood volume, computer-vision-based or gravimetric or human- generated estimates of blood volumes of previous samples, an ambient lighting condition, a type or other identifier of the physical sample, properties of the physical sample, a patient vital sign, patient medical history, an identity of a surgeon, or a type of surgery. Any of these non-image features can inform selection of template images for comparison with the portion of the sample image, selection of a particular parametric model or function, definition of alarm triggers for misplaced surgical gauze sponges, definition of alarm triggers for excess fluid or blood loss, transformation of extracted features into the blood volume indicator, and/or estimation of blood volume from the blood volume indicator. However, any of these non-image features can modify enable, or inform any other function of the first preferred method Sioo.
[0026] As shown in FIGURE 4, Block S110 preferably includes segmenting the image, including isolating a first segment of the sample image representative of the physical sample that is a bloodied object (e.g., a surgical gauze sponge). Block S110 preferably subsequently further segments the first region to define the portion of the sample image that corresponds to a particular portion of the physical sample captured in the sample image. Segmenting the sample image into multiple image segments preferably increases the resolution and/or accuracy of the estimated blood volume of each portion of the physical sample. The size and shape of each image segment can be static, wherein each segment comprises a predefined number of pixels in the image and/or a predefined dimension in physical space, as shown in FIGURE 9. For example, the image segment can define a ten-pixel by ten-pixel rectilinear area of the image or a five-millimeter equilateral triangular area of the physical sample. In another variation, the image segment can be isolated according to properties of individual pixels or groups of pixels in the image, such as hue, saturation, shade, brightness, chroma, wavelength, or any other metric of color or light, as shown in FIGURE 7. In this alternative, the sample image can be dynamically segmented, wherein portions of the sample image are separated by color property or other features rather than by (or in addition to) pixel location or by location on the physical sample. However, the portion of the sample image can include the whole of the physical sample associated with the sample image, or the sample image can be segmented or apportioned according to any other schema. The portion of the sample image is preferably a single segment or region including multiple pixels of the image, but the portion of the sample image can alternatively be a plurality of image segments or regions of the sample image, can be of any other size, and/or can be of any other form.
[0027] In a variation of the first preferred method Sioo, Block S110 extracts a feature from the sample image that is a dimension of the physical sample. In one example implementation, Block S110 implements object recognition to isolate an object of known type within the field of view of the optical sensor and/or within the sample image. The object can be a surgical tool, a surgical tray, an operating table, a surgical gauze sponge, a suction canister, or any other object of known dimension. From this known dimension, a dimension of the physical sample can be extrapolated, such as by estimating the distance from and/or angle between the optical sensor and the known object and comparing the position of the sample and the known object in the image. In another example implementation, Block Sno analyzes shadows in the sample image, coupled with known locations of light sources, to estimate an angle and distance between the physical sample and the capture origin (i.e. the location of the camera or optical sensor when the sample image was captured). In yet another example implementation, the optical sensor is arranged at a known distance from and angle to a staging tray on which the physical sample is arranged for imaging, and Block Sno includes extrapolating the dimension of the physical sample or a portion therefore based upon known placement of the optical sensor relative the staging tray. A further example implementation, Block Sno manipulates an IR, sonic, laser, or other type of distance sensor arranged adjacent the optical sensor to transmit a signal toward the physical sample to determine the distance and/or angle between the physical sample and the capture origin of the image. However, a dimension of the physical sample or a portion thereof can be estimated or determined in any other way.
[0028] In the foregoing example implementations, the distance and/or angle between the sample and the optical sensor can be automatically extracted from the image to inform a transform from pixel count of the portion of the sample image into a physical dimension (e.g., inch, centimeter) of the corresponding portion of the physical sample in Block Sno. The estimated angle and/or distance can therefore define an extracted feature of the sample image that informs the generation of the blood indicator tag and/or the transformation of the blood indicator tag into the estimated blood volume in the portion of the physical sample. However, the distance and/or angle value(s) can be input by a user (e.g., a surgeon, a nurse), extrapolated from data generated by a non-optical sensor, or calculated or gathered in any other way to define a non-image feature related to the sample. [0029] Block Sno can additionally or alternatively implement any object localization, segmentation (e.g. using edge detection, background subtraction, graph- cut-based algorithms, etc.), gauging, clustering, pattern recognition, template matching (using any one of various metrics), feature extraction, descriptor extraction (e.g. extraction of texton maps, color histograms, HOG, SIFT, etc.), feature dimensionality reduction (e.g. PCA, K-Means, linear discriminant analysis, etc.), feature selection, thresholding, positioning, color analysis, parameteric regression, non-parametric regression, unsupervised or semisupervised parametric or non-parametric regression, or any other type of machine learning or machine vision to estimate a physical dimension of the sample. Such methods preferably compensate for varying lighting conditions of the physical sample, warping of the physical sample (e.g., a wrinkle or warped gauze sponge), warping of the image of the physical sample (e.g., due to optical distortion caused by a lens of the optical sensor), variations in composition of the fluid present in or on the sample, or any other inconsistency or variable prevalent in any use scenarios. For example, once the object, materials, gauze type, etc. of the physical sample is identified, the estimated surface area of the physical sample can be compared with a known surface area of a template sample of the same object, material, or gauze type to correct for area estimation errors, such as due to a wrinkle or other non- uniformity in the physical sample when the sample image was taken.
[0030] In another variation of the first preferred method Sioo and as shown in
FIGURE 4, Block Sno includes assessing ambient lighting conditions, wherein the ambient lighting conditions define an extracted feature. For example, the 'redness,' 'greenness,' and 'blueness' values (i.e. color values in the red, green, and blue color component spaces) of pixels of bloodied regions in the sample image can be combined into a weighted composite color value according to ambient lighting conditions proximal the sample when the sample image was captured. In this example, the weighted composite color value can then be fed into a parametric function or compared against color values of template images to generate the blood volume indicator.
[0031] In one variation of the first preferred method Sioo shown in FIGURE 4,
Block S110 includes extracting a feature that identifies the physical sample in the sample image as an absorbent surgical gauze sponge. In this variation, Block Siio preferably implements machine vision, such as object segmentation, edge detection, pattern recognition, or template matching, to determine if the sample image includes an absorbent surgical gauze sponge or if an absorbent surgical gauze sponge is within a field of view of a camera or other optical sensor. Furthermore, Block Siio can preferably determine the type of absorbent surgical gauze sponge, such as laparotomy or RAY-TEC gauze, which can inform selection of a template image of a similar template sample type for comparison with the portion of the sample. Block Siio can additionally or alternatively identify thread count, external dimension, color, physical tag, or any other identifying feature or property of the physical sample to identify the type of sample or a fluid absorptivity, saturation volume, dry weight or mass, dry color, or any other property of the physical sample. Block Siio can therefore reduce processing time necessary to return a template image match for the portion of the sample by isolating key identifying features of the physical sample. Similarly, Block Siio can improve accuracy of the blood volume estimation by isolating key properties that affect fluid absorbance and a correlation between fluid volume and optical properties of the physical sample.
[0032] Block Siio can additionally or alternatively extract features from the sample image that identify other relevant objects, materials, or fluids in the sample image and/or the field of view of the optical sensor. For example, Block Siio can recognize drops, pools, or smears of blood on a surgical tool, tray, table, wall, floor, or other surface as containing blood. Block Siio can initiate an estimation of blood volume in or on a sample that is other than an absorbent surgical gauze sponge, surgical dressing, or surgical towel. In this variation, template matching can be used to estimate blood volume in or on the physical sample, as described below, although color value, translucency, saturation, dimension, or any other metric of the sample can be used to parametrically or non-parametrically generate the blood volume indicator tag and/or estimate the extracorporeal blood volume in at least the portion of the physical sample.
[0033] As shown in FIGURES l, 2, and 4, Block S120 of the first preferred method
S100 includes tagging the portion of the image of the sample with the blood volume indicator according to the extracted feature. The extracorporeal blood volume indicator tag is preferably an intermediate parameter for a region of interest in the sample image that translates pixel-level data in the sample image into a blood volume-related variable. The blood volume indicator tag is therefore preferably an estimate of hemoglobin content (e.g., mass, volume, density, percentage by weight, etc.) in the portion of the sample, though the extracorporeal blood volume indicator tag can alternatively be an estimate of red blood cell count or content, white blood count or content, platelet count or content, plasma content, or any other suitable extracorporeal blood volume indicator. The tag can also include any other relevant information, such as estimated hematocrit of the blood in the portion of the physical sample, a time stamp of when the sample image was taken, a time stamp of when the sample image was analyzed, or volume or concentration of other fluids present on or in the portion of the sample, such as bile, saliva, gastric fluid, mucus, pleural fluid, saline, or fecal matter. Generally, the blood volume tag is preferably of a form that can be transformed or manipulated into an estimated extracorporeal blood volume in all or a portion of the sample. Furthermore, the extracorporeal blood volume indicator tag for the portion of the sample image is preferably stored with the portion of the sample image or as a pointer to the portion of the sample image.
[0034] In one variation of the first preferred method Sioo, Block S120 includes comparing the extracted feature of the portion of the image of the sample against similar features extracted from template samples (e.g., a training set, samples analyzed previously) of known blood volume indicators and/or known extracorporeal blood volumes. In this variation, the portion of the image is tagged with the blood volume indicator based upon a non-parametric correlation with one or more template samples. For example, in this variation of the first preferred method Sioo, Block S120 can include implementing a K-nearest neighbor method to compare the extracted feature of the image that is a redness intensity in the red component space with redness intensity values of template samples. In this example, Block S120 can further include implementing a K-nearest neighbor method to compare extracted features that include a greenness intensity and a blueness intensity (in conjunction with a redness intensity) of pixels from bloodied regions in the sample image with greenness and blueness intensity values of template samples.
[0035] In one example implementation of this variation of the first preferred method Sioo, Block S120 includes pairing the portion of the image of the sample to a template image of known extracorporeal blood volume indicator. Each template image is preferably contained within a library of template images, and each template image is preferably an image of a template sample of known blood, hemoglobin, red blood cell mass or volume (e.g., per unit physical area), and/or any other suitable blood-related parameter, blood volume indicator, or feature. Each template image in the library is preferably tagged with an extracorporeal blood volume indicator such that the portion of the sample image can be matched to a template image in Block S110, and such that a tag, indicative of the blood volume in the portion of the physical sample, can be associated with the portion of the sample image in Block S120.
[0036] The library of template images can be assembled in a variety of ways. In one example, an image is taken of a template sample that is a used surgical gauze, blood is washed from the used gauze and assayed to determine the hemoglobin mass absorbed into the used gauze, the image of the template sample is tagged with the hemoglobin mass (the extracorporeal blood volume indicator), and the image is catalogued in the library. In another example, a template sample is prepared by adding a known volume of blood (of known hematocrit) to a surgical gauze of a known size, an image of the template sample is taken, the image of the template sample is tagged with the known blood volume (the extracorporeal blood volume indicator), and the image is catalogued in the library. The blood volume tag of each image template is preferably a volume or mass of a blood-related parameter, such as hemoglobin or red blood cell content per physical area (e.g., 1 cm2) such that, in Block S130, a blood volume indicator tag of a portion of the image can be multiple by an estimate physical area (or volume) of the corresponding portion of the physical sample to estimate the extracorporeal blood volume in the portion of the sample, as shown in FIGURE 7. However, the template sample for each template image can be prepared in any other way or combination of ways, and the extracorporeal blood volume indicator can be any other suitable parameter or metric. The library preferably contains a large number of template images to account for variance in lighting, image quality, type of physical sample (e.g., type of surgical gauze sponge), volumes, concentrations, or hematocrits of blood or other indicator in each sample, "age" of the physical sample, surgical conditions, or any other suitable variable. Furthermore, the template images in the library can also be grouped, such as according to: the type of template sample, such as a gauze sponge, floor, operating table, clothing; lighting or backlighting of the template sample; hematocrit of blood in a template sample; thread count of the template sample that is a textile; quality of the image of the template sample, such as depth of field, focus, distance between the template sample and an optical sensor; or any other suitable parameter. The library can be stored locally on a machine or system configured to perform at least a portion of the first preferred method Sioo, or remotely, such as on a remote server or hard drive accessible by the machine or system when performing at least a portion of the first preferred method Sioo.
[0037] In this example implementation, the sample image can be compared directly to the template image via template matching in Block S120. In Block S110, each image segment can be decomposed into features that are separate color components (e.g., red, green, and blue), and the absolute difference in pixel intensity for the pixels in the portion of the sample image and the pixels in the template image can be calculated for at least one color component. (However, the sample image can alternatively be decomposed prior to segmentation.) In this example implementation, the absolute difference in pixel intensity is preferably calculated at a wavelength of light that correlates with the extracorporeal blood volume indicator. For example, the absolute difference in pixel intensity for the portion of the sample image and the template image can be calculated at 40onm, a wavelength that can correlate well with hemoglobin concentration for certain absorbent surgical gauze sponges. The template image is preferably paired with the portion of the image when a substantially minimal sum of absolute difference in pixel intensity between the portion of the sample image and the template image is calculated. [0038] Alternatively, Block S120 can implement a texton map to pair the sample image with one or more template images. In this implementation, to build the template image library patches from template (training) images can be clustered into centroid patches, such as by k-means clustering. For each pixel or set of pixels in each training image, the index of the centroid patch nearest the patch surrounding the pixel can be calculated such that a histogram, of the nearest-centroid indices within a window around each pixel, can be constructed. By averaging the histograms of all background pixels, a background histogram centroid can also be constructed. Clean and bloodied histogram centroids for physical samples (e.g., surgical gauze sponges) can be similarly constructed. Alternatively, a classification algorithm such as SVM, Naive Bayes, LDA, K- Nearest-Neighbors, or logistic regression, can be trained using histograms centered around or mostly containing background, bloodied, and unsoiled pixels. When the portion of the sample image is compared with template images in the template image library, histogram of the nearest-patch-centroid indices around each pixel in the portion of the sample image is generated and classified based upon a comparison of the histogram and histogram centroid of the pixel, or based upon the output of one of the learned classifiers described above. The histograms and/or histogram centroids of the pixels in the portion of the sample image can then be compared with a subset of histograms and/or histogram centroids of pixels of the template images, based upon the determined class of physical sample, to pair one or more template images with the sample image.
[0039] In this example implementation, Block S120 therefore preferably recites stepping through subsequent template images in the template image library until a suitable match is found for the portion of the sample image. However, the hue, saturation, shade, brightness, chroma, intensity of wavelength, wavelength range, histogram, histogram centroid, class, or any other color property (e.g., feature) of the portion of the sample image and the template image can be compared in Block S120. In this example implementation, the portion of the sample image and the template image are preferably compared substantially directly. However, the template image and the portion of the sample image can be compared via template matching incorporating any other vision algorithm or image processing method.
[0040] In another example implementation of this variation of the first preferred method Sioo, each template image is a different color or hue in a library of color palettes, wherein each color correlates with a different blood volume or blood volume indicator. In this example implementation, the library preferably includes color palettes for different types of surgical sponge gauzes, surgical towels, surgical tool surfaces, floor surfaces, operating or delivery table surfaces, and/or any other common surface, material, object, or feature, wherein each color that is a template image in a color palette is associated with a particular red blood cell content or indicator for a particular type of physical sample. In this example implementation, the template image that is a color can be an image of the color or a numerical color identifier, such as a HEX code value (e.g., #FFoooo, #Aooooo, #880000, etc.) or an RGB code value (e.g., (255, o, o), (160, o, o), (190, o, o), etc.).
[0041] In yet another example implementation of this variation of the first preferred method Sioo, the feature extracted from the portion of the sample image in Block S110 is a redness value, wherein the redness value is an intensity of a wavelength or composite intensity of a range of wavelengths of light, redness hue, redness saturation, or any other suitable light- or color-related value. Block S110 can similarly extract greenness, blueness, or other color component values of one or more bloodied pixels in the sample image. Generally, Block S110 preferably decomposes the sample image into distinct color spaces, such as red, green, and blue component spaces, wherein a color value or intensity is calculated for the portion of the sample image in each color space. Furthermore, the portion of the sample image that is decomposed in Block S110 preferably includes red pixels indicative of blood content in the portion of the physical sample that is associated with the portion of the sample image. In Block S120, the color value(s) of the portion of the image are then compared substantially directly with color values of template images until a suitable match is found.
[0042] In this variation of the first preferred method Sioo, template images with properties substantially dissimilar from those of the portion of the physical sample or the sample image can be withdrawn from comparison with the portion of the sample image in Block S120 in order to reduce processing time required to find a template image match. In one example implementation, template images of template samples of surfaces, products, materials, or dimensions substantially dissimilar from that of the portion of the physical sample are excluded from comparison. For example, Block S110 can extract a thread count feature from the sample image, wherein the thread count feature identifies the physical sample as laparotomy gauze, and wherein all template images of template samples that are not of laparotomy gauzes are removed from comparison with the portion of the sample image. In another variation, thresholding is used to remove substantially irrelevant template images from the test pool. In one example, template images with redness values (e.g., intensity, hue, saturation, shade, brightness, chroma, wavelength range) substantially dissimilar from that of the portion of the sample image are excluded from comparison. Tree search can additionally or alternatively be used to reduce processing time. However, template images can be grouped in the template library and selected or deselected for comparison with the portion of the sample image according to any other schema.
[0043] In another variation of the first preferred method S100, Block S120 includes transforming the extracted feature of the portion of the image of the sample into the blood volume indicator. In this variation of the first preferred method S100, Block S120 preferably implements an algorithm or other mathematical transformation to convert the extracted feature into the blood volume indicator for the portion of the image of the sample. Therefore, in this variation, Block S120 preferably implements parameterized generation of the blood volume indicator.
[0044] In one example implementation, color values of the template images are used to generate a mathematical function, curve, or algorithm that correlates the extracted feature to the blood volume indicator. Generally, the extracted feature of the portion of the sample image (e.g., redness intensity in the red component space, blueness intensity in the blue component space, greenness intensity in the green component space, or a composite of two or three color intensities) can be plugged into a parametric function (e.g., intensity-blood volume function) to directly calculate the blood volume indicator, from the extracted feature, for the portion of the sample image. For example, reflectance of oxygenated hemoglobin (Hbo2) can be correlated with certain wavelengths of light to substantially directly estimate the content of hemoglobin in the portion of the physical sample associated with the portion of the image. In this example, because the hemoglobin content of a wet (hydrated) red blood cell is typically about 35%, red blood cell count can be extrapolated from hemoglobin content.
[0045] Blocks S120 and S130 can implement both parametric and non-parametric techniques or methods to correlate one of more extracted features to one or more blood volume indicators. For example, extracted features that are color values in the red, green, and blue color spaces can be compared with template images via non-parametric techniques (e.g., template matching) to tag the portion of the sample with the blood volume indicator, and an extracted feature that is an estimated surface area of a bloodied region of the physical sample can be transformed according to a parametric function to generate a coefficient for conversion of the blood volume indicator into an estimated blood volume in the portion of the sample. In this example, another extracted feature that is the type of physical sample (e.g., laparotomy gauze, RAY-TEC gauze, surgical table, floor, article of clothing) functions to qualify the sample to inform selection of template images for comparison with the portion of the sample image. However, Block S120 and S130 can manipulate any relevant image-based feature extracted in Block S110 or any non-image-based feature (e.g., sourced from a clinician, sourced from a medical record, etc.) to generate the blood volume indicator of the portion of the image and the estimated blood volume for at least the portion of the sample, respectively.
[0046] As shown in FIGURES 1 and 5, Block S130 of the first preferred method
S100 includes estimating the extracorporeal blood volume in at least a portion of the physical sample, associated with the portion of the sample image, according to the blood volume indicator tag. For example and as described above, the blood volume indicator tag that is a hemoglobin content can estimate red blood cell volume through the formulas
RBC = HGBI35 or HCT = 3 x HGB ,
which in turn can be used to predict blood volume. The blood volume for each portion of the physical sample correlating with a portion of the image can be independently calculated and then summed to estimate a total blood volume in the physical sample. Alternatively, the blood volume indicator tags for substantially all portions of the image can be summed and/or averaged and the total blood volume in the physical sample calculated at once. The estimated blood volumes across multiple samples can then be summed to generate a total blood volume in the samples, which preferably correlates with a total estimated blood loss of a patient. However, Block S130 can additionally or alternatively include estimating total hemoglobin mass or volume, total red blood cell mass or volume, or any other blood-related metric in the physical sample or across multiple samples.
[0047] As shown in FIGURE lB, a variation of the first preferred method S100 further includes Block S140, which recites identifying the physical sample in the image as a type of absorbent gauze sponge. Block S140 preferably implements machine vision techniques to determine the type of physical sample, as described above. From identification of the type of physical sample in Block S140, the first preferred method S100 can access sample-specific data such as dry weight, absorptivity, fluid saturation volume, or any other data or property of the physical sample, which can enable extraction of additional blood-related data from the image of the physical sample.
[0048] As shown in FIGURE lB, another variation of the first preferred method
S100 can further include Block S150, which recites indexing a sample count for the physical sample. The sample count is preferably a count of absorbent surgical gauze sponges, dressings, or towels, though the sample count can additionally or alternatively be a count of blood droplets, blood drops, pools of blood, bloodied articles of clothing, bloodied surgical tools, or any other relevant or suitable blood formation or bloodied object. The sample count is preferably displayed with the estimated blood volume of the portion of the physical sample, and the sample count is preferably indexed substantially in real time when the image of the physical sample is taken. However, Block S150 can function in any other way to index the sample count and to provide this information to a user.
[0049] As shown in FIGURE lB, another variation of the first preferred method
Sioo further includes Block S160, which recites displaying the estimated blood volume in the portion of the physical sample, the estimated blood volume in the whole physical sample, and/or the estimated total blood volume across multiple physical samples. At least some of this data is preferably presented to a user, such as to a surgeon, a nurse, an anesthesiologist, a gynecologist, a doctor, or a soldier. This data is preferably rendered on a digital display of a machine or system configured to perform at least a portion of the first preferred method Sioo. As shown in FIGURE 9, this data can be presented in the form of an augmented reality overlay on top of the static sample image depicted on the display. Alternatively, this data can be presented in the form of a dynamic augmented reality overlay on top of a live video stream captured by the optical sensor and depicted on the display. For example, data can be presented in an augmented reality overlay on subsequent scanned images of one physical sample, wherein the camera captures digital images at a rate such as 30 frames per second and the augmented reality overlay updates with each new frame or number of frames. This data can alternatively be presented in table, chart, or diagram including the estimated blood volume in one or more physical samples over a period of time. Other blood-related metrics can also be estimated or maintained in the first preferred method Sioo and presented in Block S160, such as blood spread rate, blood surface area, patient risk level, or patient hemorrhage classification. However, this data or any other blood-related metric or patient information can be presented in any other way or form in Block S160.
[0050] As shown in FIGURE lB, another variation of the first preferred method
Sioo further includes Block S170, which recites estimating patient blood loss by summing the blood volume estimate of the physical sample with previous blood volume estimates of other physical samples. Additionally or alternatively, the blood volume estimate of the physical sample can be stored for future summation with blood volume estimates of additional physical samples. By summing blood volume estimates across multiple physical samples, blood loss of a patient can be tracked over time. For example, during a surgery, used surgical gauze sponges can be analyzed via Blocks Sno and S120, wherein a running summation of blood volumes in each used gauze sponge provides time-elapse estimates of total blood loss of the patient, as shown in FIGURE 10. This may be useful in estimating patient risk, in determining when to administer saline or provide a blood transfusion, in maintaining record of surgical events, and/or in estimating future blood-related events or patient needs. Other blood-related metrics can also be estimated or maintained in Block S130 and summed over time in Block S170.
[0051] As shown in FIGURE lB, another variation of the first preferred method
S100 further includes Block S180, which recites comparing the identified physical sample against a set of past identified physical samples. In this variation, Block S150 preferably indexes the sample counter only when the identified physical sample is determined to be unique amongst the set of past identified physical samples. Block S180 therefore functions to determine if a previous sample image including the same physical sample was already analyzed according to any of Blocks S110, S120, and/or S130. Block S180 preferably substantially guards against double counting of the estimated blood volume in the physical sample in Block S170. Each sample image, a fingerprint of each sample image, or a fingerprint of each physical sample is therefore preferably stored, such as on a local or remote sample image database, such that subsequent sample images or physical samples can be compared against past sample images or physical samples in Block S180. In Block S180, comparison of the sample image with previous sample images can require scale, rotation, mirror, stretch or other transformations or fingerprinting of the sample image and/or or previous sample images. Edge detection, segmentation, pattern recognition, feature extraction, and/or other machine vision techniques can be used to determine the uniqueness of bloodied regions of the physical sample shown in the sample image, relative to bloodied regions of other, previously analyzed physical samples. However, Block S180 can function in any other way to identify the sample image as including the physical sample that was included in a previous sample image.
[0052] As shown in FIGURE lB, another variation of the first preferred method
S100 further includes Block S190, which recites updating a digital medical record of the patient with the estimated blood volume in the physical sample. Block S190 can additionally or alternatively update the medical record of the patient with the estimated blood volume across multiple physical samples, the estimated blood loss of the patient, patient blood loss trends, or any other relevant metric or data generated related to the circulatory system of a patient. The digital medical record can be maintained locally on a machine or system implementing the first preferred method Sioo or on a local network or remote server accessed by the machine or system to retrieve, update, and/or upload the digital medical record.
[0053] In a further variation of the first preferred method Sioo, the physical sample is a fluid canister that collects bodily fluids of a patient, such as blood, bile, saliva, gastric fluid, mucus, pleural fluid, urine, or fecal matter, wherein the image is an image of the fluid canister. In an example implementation of this variation, Block S110 can include extracting features that include a volume of fluid within the canister, as well as redness, greenness, and blueness intensities of the portion of the image of that canister that includes bloodied pixels and preferably includes little to no glare. Furthermore, Block S120 can include estimating a percentage of blood within the canister relative to other bodily fluids based upon the extracted color values, and Block S130 can include estimating the volume of blood within the canister. In this variation of the first preferred method Sioo, the optical sensor that captures the image of the fluid canister is preferably mounted to the fluid canister. In one example implementation, the optical sensor is mounted to the side of and facing the fluid canister that is cylindrical such that the fluid level in the fluid canister can be estimated directly from the sample image. In another example implementation, the optical sensor is mounted overhead the fluid canister that also includes a fluid level sensor, wherein an output of the fluid sensor defines a non-image feature that informs at least one of the blood volume indicator and the estimated blood volume in the fluid canister. Alternatively, the optical sensor can be incorporated into a handheld device, wherein a user scans the fluid canister with the optical sensor to capture the sample image. In addition, an auxiliary light source (such as a lamp or laser next to the canister) could be added to the system to enhance the correlation of color with concentration of hemoglobin or other substances. Alternatively or in addition, ambient light could be assessed and used as a feature.
[0054] Because fluid is added to the fluid canister over time, subsequent sample images of the fluid canister can be captured and analyzed over time, via the first preferred method Sioo, to generate a time-dependent, historical chronicle of fluid content of the fluid canister. Estimated blood volume in the fluid canister can therefore be monitored over time, such as to generate a trend in blood loss for a patient. Such data can be useful to trigger alarms if patient blood loss is occurring too rapidly or if patient blood loss has reached a critical total volume or critical red blood cell loss. However, loss of other fluids can also be monitored. For example, urine content (or total water content) of the fluid canister can enable tracking of patient hydration level such that the patient can be administered saline when hydration level or hydration loss surpasses a threshold. Differences between fluid color properties of one sample image at a first time and a subsequent sample image at a second time can indicate concentration changes of fluids in the fluid canister between the first and second times. Furthermore, a change in fluid level in the canister between the first and second times, coupled with fluid concentration changes, can indicate the floor rate of fluids into (or out of) the fluid canister. Estimated blood and/or other fluid loss through analysis of the sample image of the fluid canister can be further fed into analyses of sample images of surgical sponge gauzes, implements, surfaces, etc. to map total blood and/or other fluid loss of the patient over time. However, the first preferred method Sioo can function in any other way to estimate the volume of blood within the physical sample that is a fluid canister.
[0055] One variation of the first preferred method Sioo further comprises estimating the volume of extracorporeal non-blood fluids in the physical sample, such as ascites, saline irrigant, bile, plasma, urine, or saliva. In one example implementation, the redness of the physical sample (e.g., color intensity of image pixels associated with the physical sample in the red component space) is correlated with a total red blood cell count or volume in the physical sample, wherein the total red blood cell count or volume is subtracted from the estimated total extracorporeal blood volume in the sample, according to an estimated or measured hematocrit of the blood in the physical sample, to estimate the total volume of plasma in the physical sample. In another example implementation, the estimated total extracorporeal blood volume is converted to as estimated total extracorporeal blood weight (or mass), wherein the estimated total extracorporeal blood weight (or mass) and dry weight (or mass) of the physical sample are subtracted from a wet weight (or mass) of the physical sample to estimate the total weight (or mass of volume) of substantially clear fluids (e.g., saline, intestinal ascites) in the physical sample. In this example implementation, the first preferred method Sioo preferably accessed a mass or weight measurement of the physical sample through a scale electrically coupled to the machine or device implementing the first preferred method Sioo. Furthermore, the first preferred method Sioo preferably implements machine vision techniques to determine the type of physical sample, such as a surgical dressing, a surgical gauze sponge, or a surgical towel from a particular manufacturer. The first preferred method Sioo can then access sample-specific data such as dry weight, absorptivity, fluid and/or saturation volume to enable extraction of further data related to blood or non-blood fluids in the physical sample. However, the first preferred method Sioo can implement any other technique or method to estimate the volume, weight, or mass of an extracorporeal non-blood fluid in the physical sample.
[0056] However, the first preferred method can additionally or alternatively analyze one or more extracted and/or non-image features to estimate any one or more of hemoglobin mass, hematocrit, hemoglobin concentration, fresh frozen plasma, packed red blood cells, colloids, platelets, crystalloid, or any other blood-related parameter of the patient. Any one or more of these blood-related parameters can additionally or alternatively be rendered on a display of the machine, system, or device implementing the first preferred method Sioo.
[0057] One variation of the first preferred method includes recognizing gestures of a user to control operation of the machine, system, or device implementing the first preferred method Sioo. In this variation, the preferred method preferably accesses a live video feed captured by the optical sensor that records the image of the physical sample or by any other optical sensor or camera coupled to the machine, system, or device implementing the first preferred method Sioo. Because the first preferred method is preferably implemented during a surgery or other medical event or emergency during which a user is likely wearing a glove, the first preferred method Sioo is preferably controlled via non-contact means. Generally, this variation of the first preferred method Sioo preferably recognizes non-contact hand gestures. In one example, a 'thumbs up' can indicate that the user accepts the detection of the physical sample and the extracorporeal blood volume estimation of the physical sample. The extracorporeal blood volume can then be added to an aggregate extracorporeal blood volume estimated for a set of physical samples. Similarly, a 'thumbs down' can reject the detection and extracorporeal blood volume estimation for the physical sample. In another example implementation, a user can scroll through available physical sample types by sweeping a hand to the left or right. Similarly, the user can scroll through images of previous samples by sweeping a hand vertically. However, any other gesture can be recognized in any other way to control any other function of the first preferred method Sioo.
[0058] Another variation of the first preferred method Sioo further functions to generate alarms or warnings related to the circulatory system of a patient. In one example, the preferred method Sioo generates a warning that a physical sample that is a surgical sponge gauze was lost or left inside the patient if not identified within a threshold time (e.g., one hour) after being checked into a surgery. In another example, the first preferred method Sioo sounds an alarm when the total estimated blood or red blood cell loss of the patient surpasses a threshold level. In this example, the threshold blood or red blood cell volume can be unique to the patient and based upon any one or more of the age, gender, weight, medical history, etc. of the patient. In another example, the first preferred method Sioo issues a warning of trends in patient blood loss, such as based upon blood distribution across multiple physical samples (e.g., sponges) over time. However, the first preferred method can additionally or alternatively provide data and/or warnings relating to a rate of blood loss, a rate of blood loss relative to sponge count, a rate of sponge usage, a histogram of sponge usage, or any other suitable data or warning related to the circulatory system of the patient. 2, Second Method
[0059] As shown in FIGURE 2, a second preferred method S200 for estimating the extracorporeal blood volume in a portion of a physical sample, includes: comparing a portion of an image of the sample with a template image of known extracorporeal blood volume indicator in Block S210; tagging the portion of the image of the sample with a blood volume indicator according to the template image that is matched to the portion of the image of the sample in Block S220; and estimating the extracorporeal blood volume in at least a portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator in Block S230.
[0060] The second preferred method S200 preferably implements non- parametric estimation (e.g., template matching) of extracorporeal blood volume in the physical sample, as described above. Generally, Block S220 preferably incorporates a variation of Block S220 of the first preferred method Sioo, and Block S230 preferably incorporates a variation of Block S130 of the first preferred method Sioo. However, as shown in FIGURE 3B, the second preferred method S200 can implement any other technique, method, implementation, and/or variation of the first preferred method Sioo described above.
[0061] One variation of the second preferred method S200 includes accessing the template image that is a color model paired with a blood volume indicator. The color model can be a template image, a representation of or feature extracted from a template image, a mathematical function or algorithm, or any other suitable color model correlating an extracted feature of the sample image with a blood volume indicator. In this variation, Block S210 can include comparing the portion of the image of the sample with the template image to generate the blood volume indicator tag that is a composite of the known blood volume indicators of the multiple color models, such as a first and a second template image that each include a color model paired with a blood volume indicator.
[0062] Block S220 of the second preferred method S200 can include tagging the portion of the image of the sample with the blood volume indicator that is an estimated hemoglobin mass. Furthermore, Block S230 of the second preferred method S200 can include estimating the extracorporeal blood volume in at least the portion of the physical sample according to the hemoglobin mass and an estimated hematocrit of blood in the physical sample. However, Blocks S220 and S230 of the second preferred method S200 can function in any other way, and the second preferred method can implement any other Block, variation, example, or implementation of the first preferred method S100.
3. Third Method
[0063] As shown in FIGURE 3A, a third preferred method S300 for counting physical surgical samples includes: identifying a physical sample in a field of view of an optical sensor in Block S310; indexing a sample counter for the identified physical sample in Block S320; extracting a feature from a portion of the field of the view of the optical sensor in Block S320; and estimating the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature in Block S340.
[0064] The third preferred method S300 preferably functions to identify a physical sample, update a sample count, and estimate the volume of blood in the physical sample by analyzing the field of view of the optical sensor that includes the physical sample. The field of view of the optical sensor is preferably captured in the form of a static or still image of the sample. The physical sample is preferably identified in the field of view of an optical sensor in Block S310, which preferably triggers Block S302 to capture the image of the physical sample, wherein the image of the physical sample is only taken once the physical sample is identified. Alternatively, the image of the sponge can be captured in Block S302 and subsequently analyzed in Block S310 to identify the physical sample visible therein.
[0065] The physical sample can be any of a surgical dressing, a surgical gauze sponge, a surgical towel, or any other absorbent textile used to collect blood or other bodily fluids. Like the first preferred method S100, a surgeon, nurse, anesthesiologist, gynecologist, soldier, paramedic, or other user can preferably use a machine, system, or device implementing the third preferred method S300 to maintain a count of and to estimate extracorporeal blood volume in surgical towels, gauze sponges, or other absorbent textiles. By summing the estimated blood volumes across multiple towels or gauze sponges, an estimated blood loss (EBL) for a patient can be estimated. The third preferred method S300 can therefore be useful in a hospital setting, such as in a surgical operating room, or in a clinical setting, such as in a delivery room, or in any other suitable setting.
[0066] Like the first preferred method S100, the third preferred method S300 is preferably implemented in a handheld or mobile electronic device, such as a native application or 'app' executing on a digital music player, a PDA, a smartphone, or a tablet computer. For example, a camera or other optical sensor integral with the electronic device can capture the image of the sample in Block S302, a processor integral with the electronic device can perform Blocks S310, S320, and S330, and S340, and a display integral with the electronic device can display the sample count and the estimated blood volume in the physical sample and/or across multiple physical samples in Block S360. In this variation, the electronic device can also communicate with a remote server that performs at least some of Blocks S310, S320, S330, and S340. However, the third preferred method S300 can be implemented in any other system, device, or combination thereof.
[0067] As shown in FIGURE 3A, Block S310 of the third preferred method S300 recites identifying the physical sample in the field of view of the optical sensor. The field of view of the optical sensor can be a static image or a video that was taken previously, wherein Block S310 identifies the physical sample in the static image or video substantially after the image or video was taken. However, the field of view of the optical sensor is can alternatively be a live feed from the optical sensor, wherein Block S310 identifies the physical sample in the field of view substantially in real time. The image is preferably a color image captured by any of a digital color camera, an RGB camera, or any number of charge-coupled device (CCD) sensors, complimentary metal-oxide- semiconductor (CMOS) active pixel sensors, or other optical sensors of any other type. Furthermore, the optical sensor can capture the image of the sample in any other form or across any other wavelength or range of wavelengths in the visible spectrum, infrared spectrum, or any other spectrum. [0068] Block S310 preferably implements machine vision to identify content in the field of view as including or not including a suitable sample that is surgical sponge gauze, towel, or dressing. In one variation of the third preferred method S300, Block S310 uses edge detection to estimate the perimeter of the physical sample visible in the field of view and then determines a physical dimension of the physical sample, such as length and width in inches, through gauging. The dimension of the physical sample can be estimated by transforming the field of view according to a known or anticipated distance or angle between the optical sensor and the physical sample, by estimating distance and angle according to shadows or objects of known dimension in the field of view, by accessing data from an infrared, laser, sonic, or other range finder arranged proximal the optical sensor, or by any other suitable technique or device. By comparing the physical dimension(s) of the physical sample to template samples in a library of suitable samples of known dimension(s), Block S310 can determine both the presence, size, and/or and type of a physical sample in the field of view of the optical sensor.
[0069] In another variation of the third preferred method S300, Block S310 also implements edge detection to determine a boundary of the physical sample visible in the field of view and subsequently removes substantially all of the field of view that is outside the estimated boundary of the physical sample. Block S310 then performs image matching to compare generally the boundary of the physical sample visible in the field of view with boundaries of template samples in a library of proper physical samples. In this variation, deviation in boundary path, color property, contrast with a background, or other property of the estimated physical sample relative the template sample beyond a specified threshold can indicate that the sample in the field of view is not a suitable sample.
[0070] In a further variation of the third preferred method S300, Block S310 implements pattern recognition and machine learning to determine the presence and/or type of physical sample in the field of view of the optical sensor. This variation preferably incorporates supervised machine learning, wherein Block S310 accesses a set of training data that includes template images properly labeled as including or not including a suitable sample. A learning procedure then preferably transforms the training data into generalized patterns to create a model that can subsequently be used to analyze the field of view of the optical sensor an detect a proper physical sample shown therein. However, Block S310 can alternatively implement unsupervised learning or semi-supervised learning (e.g. clustering, mixture of Gaussians, GrabCut) in which at least some of the training data has not been labeled. In this variation, Block S310 can further implement feature extraction, feature dimensionality reduction (e.g., principle component analysis (PCA)), feature selection, or any other suitable technique to prune redundant or irrelevant features from the field of view of the optical sensor (or the image).
[0071] In any of the foregoing variations of the third preferred method S300, the third preferred method S300 preferably accepts an input indicative of an improper identification of a physical sample in the field of view. The input, preferably provided by a surgeon, nurse, anesthesiologist, gynecologist, or other user, can indicate that the field of view does include a suitable sample when Block S310 incorrectly determines that the field of view does not include a suitable sample. Also or alternatively, the input can indicate that the field of view does not include a suitable sample when Block S310 incorrectly determines that the field of view does include a suitable sample. This input is then preferably fed back into the set of training data, wherein the input is assumed correct, the field of view is labeled with the input, and the field of view (or image) and input tag are added to the training set, such as in Block 332 shown in FIGURE 3B. In the event that the determination of Block S310 is not corrected via such an input, the field of view can also be fed back into the set of training data, wherein the determination of Block S310 is assumed correct absent corrective input, the field of view is labeled with the determination of Block S310, and the field of view (or image) and determination tag are added to the training set. Through this form of closed feedback, the training set can grow perpetually and continue to teach Block S310, which may substantially improve the machine-learning algorithm and improve the accuracy of Block S310.
[0072] Block S310 can therefore implement any of segmentation, localization, edge detection, gauging, clustering, pattern recognition, template matching, feature extraction, principle component analysis (PCA), feature dimensionality reduction, feature selection, thresholding, positioning, color analysis, closed feedback, or any other type of machine learning or machine vision. Such methods preferably compensate for varying lighting conditions of the physical sponge, warping of the physical sample (e.g., a wrinkle or warped sponge), warping of the image of the physical sample (e.g., due to optical distortion caused by the optical sensor), or any other inconsistency or variable common in use scenarios
[0073] Block S310 can additionally or alternatively function to identify other relevant objects, materials, or fluids in the field of view of the optical sensor. For example, the aforementioned machine vision techniques can again be similarly implemented in Block S310 to identify blood droplets, drops, pools, or smears on a surgical tool, tray, table, wall, floor, or other surface. Such bloodies articles can also or alternatively be added to the sample count in Block S320 and/or analyzed in Blocks S330 and/or S340.
[0074] However, Block S310 can further include identifying additional physical samples in fields of view of the optical sensor and indexing the sample counter for the identified additional physical samples, either in series before or after identifying the physical sample or substantially simultaneously while identifying the physical sample. In this variation, Block S310 can implement and one or more of the same or different aforementioned methods or techniques to identify the additional physical samples in the field of view of the image.
[0075] As shown in FIGURE 3B, one variation of the third preferred method
S300 includes Block S302, which recites capturing the image of the physical sample. As described above, Block S302 can trigger Block 110, wherein Block S302 captures the image and Block S310 subsequently identifies the presence of a suitable sample in the field of view that is the image. In this variation, an input from a surgeon, a nurse, an anesthesiologist, a gynecologist, or any other user can trigger Block S302. However, Block S310 preferably triggers Block S302 when a suitable sample is identified in the field of view of the optical sensor. In this variation, a user preferably places the physical sample within the field of view of the optical sensor, Block S310 identifies the physical sample, and Block S302 captures the image of the sample automatically. The physical sample is preferably held at a substantially known angle between and/or distance from the optical sensor such that a dimension of the physical sample in the field of view can be estimated, such as through gauging described above.
[0076] The image of the physical sample captured in Block S302 is preferably a color image of the physical sample against a background, wherein the image is subsequently presented to a user on a digital display in Block S360 with the sample count and the estimated blood volume in the sample defining an augmented reality overlay. Alternatively, the image can be: a color image of the physical sample with the background removed; an infrared image or black and white image; a fingerprint of the field of view, such as with pointers or indicators of unique identifying features of the physical sample; or any other suitable type of image. The image is preferably stored for later access, such as in the variation of the third preferred method S300 that includes Block S380 in which the identified physical sample is checked for a duplicate physical sample identified in a previous field of view or image. The image can be stored locally, such as on a data storage module arranged within a handheld electronic device performing at least some Blocks of the third preferred method S300, or remotely, such as in digital memory accessed through a remote server or a local network.
[0077] As shown in FIGURE 3A, Block S320 of the third preferred method S300 includes indexing the sample counter for the identified physical sample identified. The sample counter is preferably a cumulative counter of successive physical samples identified as a surgical dressing, a surgical gauze sponge, or a surgical towel. In Block S320, physical samples of various types can be tallied together in one group, though physical samples of various types can alternatively be tallied in separate groups. In this alternative, the groups can be defined according to genus, such as according to sample type including a surgical dressing group, a surgical gauze sponge group, or a surgical towel group. In this alternatively, the groups can also be defined according to species, such as according to manufacture or purpose including a Ray-Tec surgical gauze group and a laparotomy surgical gauze group. Furthermore, the sample count can include a tally of other blood-related samples, such as blood drops, pools, or smears of certain sizes or estimated blood volumes, though the sample count can track the number of any other relevant physical sample of any other type.
[0078] As shown in FIGURE 3B, one variation of the preferred method includes
Block S324, which recites receiving confirmation of identification of the physical sample. In this variation, Block S320 preferably indexes the sample counter only for the physical sample that is confirmed. Sample confirmation is preferably provided by a user, such as through a touch-free gesture recognition or via a foot pedal, as described below.
[0079] The sample count is preferably displayed to a user, such as through a display in Block S360. The sample count is also preferably updated and stored on a local or remote hard drive or data storage device accessible by the machine or system performing at least portions of the third preferred method S300.
[0080] Block S330 of the third preferred method S300 recites extracting a feature from a portion of the field of the view of the optical sensor. Block S340 of the third preferred method S300 recites estimating the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature. Therefore, Blocks S330 and S340 of the third preferred method S300 preferably cooperate to estimate extracorporeal blood volume in the physical sample according to any one or more methods of the first preferred method described above.
[0081] In one variation of the third preferred method S300, the field of view of the optical segment or the image (the 'image segment') is statically segmented according to predefined segment size and/or shape, such as a square ten-pixel by ten-pixel area. Alternatively, image segment can be dynamically segmented, such as according to redness, hue, saturation, shade, brightness, chroma, wavelength range, or any other metric of color or light in the field of view or in the image. Each segment of the image segment is preferably decomposed into separate color components (e.g., red, green, and blue), and for each color component, the absolute difference in pixel intensity for the pixels in the image segment and a template image is calculated. The image segment is preferably thus compared against available template images until a suitable match is found. Each template image in the library of template images is preferably an image of a master sample of known extracorporeal blood volume, hematocrit, red blood cell or hemoglobin volume, density, and/or any other suitable blood-related parameter or blood volume indicator. Specifically, each template image preferably includes information to inform the blood volume or blood volume indicator of the image segment. Furthermore, in Block S340, the blood volume indicator can be converted into a blood volume, a hemoglobin or red blood cell mass or volume, or other blood-related metric, such as correlated with an estimated physical dimension of a portion of the physical sample identified in the image segment. Once each segment of the image or field of view is tagged with a blood volume or indicator, the blood volume or indicator tags of all image segments of the identified physical sample visible in the image can be summed to estimate the total blood volume or indicator in the physical sample.
[0082] The library of template images can additionally or alternatively be a color palette, wherein each template image is a different color indicative of a different blood volume or blood volume indicator, such as rather than each template image being of a physical master sample of known blood volume or indicator. In this alternative, the library is preferably a color palette for different types of absorbent surgical sponge gauzes, dressings, and towels, wherein each color (i.e. template image) in a color palette for a particular type of physical sample is associated with a particular blood volume or blood volume indicator. In this variation, the template image that is a color can be an image of the color or a numerical color identifier, such as a HEX code value (e.g., #FFoooo, #Aooooo, #880000, etc.) or an RGB code value (e.g., (255, o, o), (160, o, o), (190, o, o), etc.).
[0083] In this variation of the third preferred method S300, processing time required to find a template image match for each image segment can be reduced by avoiding comparison of each image segment with certain template images substantially dissimilar from the image segment. Template images of master samples of surfaces, products, materials, or dimensions substantially dissimilar from that of the physical sample can be excluded from comparison. Thresholding can also be used to remove substantially irrelevant template images from the test pool. For example, template images with redness values (e.g., intensity, hue, saturation, shade, brightness, chroma, wavelength range) or physical dimensions substantially dissimilar from that of the image segment can be excluded from comparison. Tree searching can also be used to reduce processing time. However, template images can be grouped in the template library and selected or deselected from comparison with the image segment in any other way.
[0084] In another variation of the third preferred method S300, the image library is substantially large enough that the entire portion of the image or field of associated with a proper physical sample is compared against template images in the library, and the blood volume or blood volume indicator is directly estimated for the entire physical sample without segmentation.
[0085] In a further variation of the third preferred method S300, a redness value is calculated for each image segment. Redness value can be intensity of a wavelength or composite intensity of a range of wavelengths of light, redness hue, redness saturation, RGB code value (e.g., (o, o, o) through (255, o, o)) or any other suitable metric over the image segment. Preferably, the image of the sample is decomposed into distinct color spaces (e.g., red, green, and blue), wherein a redness value is calculated for the image segment in at least the red color space. The redness value of the image segment can then be converted into a blood volume or blood volume indicator, such as through a lookup table, a regression model, a non-negative least-squares algorithm, or any other suitable algorithm, model, or method. For example, reflectance of oxygenated hemoglobin (Hb02) can be correlated with certain wavelengths of light to substantially directly estimate the volume or mass of hemoglobin in the portion of the physical sample identified in the image segment.
[0086] In still another variation of the third preferred method S300, the image or field of view is not segmented, and a redness value is instead calculated for the entire portion of the image or field of view correlated with the physical sample. The redness value can be an average or weighted average of redness, hue, saturation, shade, brightness, chroma, wavelength range, or any other metric of color or light of the identified image sample. As in a variation above, the blood volume or blood volume indicator for the entire portion of the physical sample identified in the field of view or in the image can be estimated according to the redness value. [0087] As shown in FIGURE 3B, one variation of the third preferred method
S300 further includes Block S360, which recites displaying the estimated extracorporeal blood volume in the physical sample and the sample count. This data is preferably presented on a digital display of a machine or system configured to perform the Blocks of the third preferred method S300. This data can be presented in the form of an augmented reality overlay on top of the static sample image depicted on the display, in the form of a dynamic augmented reality overlay on top of a live video stream captured by the optical sensor and depicted on the display, in the form of a table, chart, or diagram including the sample count and the singular and/or cumulative estimated blood volumes in one or more physical samples over a period of time or during a medical event or emergency, or in any other suitable form. This may be useful in estimating patient risk, in determining when to administer saline or to provide a blood transfusion, in maintaining record of surgical events, and/or in estimating future blood- related events or patient needs. Other blood-related metrics can also be estimated in the third preferred method S300 and presented in Block S360, such as blood spread rate, blood surface area, patient risk level, extracorporeal non-blood fluid volume, or patient hemorrhage classification. However, the sample count, estimated blood volume(s), and/or any other blood-related metric or patient information can be presented in any other way or form in Block S360.
[0088] As shown in FIGURE 3B, another variation of the third preferred method
S300 includes Block S380, which recites comparing the identified physical sample against a set of past identified physical samples. In this variation, the sample counter is preferably indexed in Block S120 only when the identified physical sample is determined to be unique amongst the set of past identified physical samples. The image of the sample, a fingerprint of the sample image, the extracted feature of the image, or other identifying feature of the physical sample in the image can be compared with images, fingerprints, extracted features, and/or other identifying features of images of previous physical samples. Block S380 preferably substantially therefore preferably prevents double counting of the physical sample in the sample count of Block S320 and/or prevents double counting of the estimated volume of blood in a total extracorporeal blood volume estimate across multiple physical samples or total estimated blood loss of a patient. In Block S380, comparison of the sample image with a previous sample image can require image fingerprinting or a scale, rotation, mirror, stretch or other transformation of either the sample image or the previous sample image. Edge detection, pattern recognition, and/or other machine vision techniques can additionally or alternatively be used to determine the uniqueness of bloodied regions of the physical sample visible in the sample image, relative to bloodied regions of a previous physical sample. However, Block S380 can function in any other way to identify the physical sample as shown in a previous sample image.
[0089] As shown in FIGURE 3B, another variation of the third preferred method
S300 includes Block S390, which recites updating a digital medical record of the patient with the estimated blood volume in the physical sample. Block S190 can additionally or alternatively update the medical record of the patient with the estimated blood volume across multiple physical samples, the estimated blood loss of the patient, patient blood loss trends, or any other relevant metric or data generated related to the circulatory system of a patient. The digital medical record can be maintained locally on a machine or system implementing the third preferred method S300 or on a local network or remote server accessed by the machine or system to retrieve, update, and/or upload the digital medical record.
[0090] The third preferred method S300 can further implement any one or more methods, Blocks, or variations of the first preferred method S100.
4, Systems
[0091] As shown in FIGURES 8 and 9, a preferred system 100 for estimating the extracorporeal blood volume in a portion of a physical sample includes: an optical sensor 110, a processor 120, and a display 130. The optical sensor 110 captures an image of the physical sample (the 'sample image'). The processor 120 extracts a feature from a portion of an image of the sample, tags the portion of the image of the sample with a blood volume indicator according to the extracted feature, and estimates the extracorporeal blood volume in at least a portion of the physical sample, identified in the portion of the image of the sample, according to the blood volume indicator. The display 130 depicts the estimated blood volume in at least the portion of the physical sample.
[0092] The system 100 preferably functions to estimate the volume of blood in the sample by analyzing the sample image. The preferred system 100 is configured and/or adapted to perform one or more Blocks of the first preferred method S100. As described above, the sample is preferably an absorbent surgical gauze sponge, though the sample can also be a table or floor surface, a piece of clothing, an external skin surface or surgical glove, a surgical implement, a fluid canister, or any other surface or material. A surgeon, nurse, anesthesiologist, gynecologist, doctor, soldier, or other user can preferably use the system 100 to estimate blood volume in one sample and then sum the estimated blood volume in the sample with estimated blood volumes in other samples to generate a total estimated blood loss (EBL) of a patient during a surgery, child birth, or other medical event or situation.
[0093] The preferred system 100 can alternatively function to estimate the content (e.g., volume, mass) of another blood-related parameter or extracorporeal blood volume indicator in the sample, such as hemoglobin, ( HGB) or red blood cell (RBC) content of the sample. Furthermore, the preferred system 100 can additionally or alternatively function to detect presence of blood in the sample, compute blood spread rate, calculate blood surface area, estimate patient risk level (e.g., hypovolemic shock), and/or determine hemorrhage classification of the patient. However, the preferred system 100 can provide any other functionality, analyze any other image type or format, estimate any other blood-related parameter, and calculate blood volume in the physical sample in any other way.
[0094] As shown in FIGURE 9, the preferred system 100 can be configured as a handheld (e.g., mobile) electronic device, such as a smartphone or tablet running an image-based blood estimation application (or app) and including the camera 110, the processor 120, and the display 130. Alternatively, the components of the preferred system 100 can be substantially discreet and distinct (i.e., not contained within a single housing). For example and as shown in FIGURE 7, the optical sensor 110 can be a camera substantially permanently arranged within an operating room, wherein the camera communicates with a local network or a remote server (including the processor 120) on which the sample image is analyzed (e.g., according to the method S100), and wherein a display 130 that is a computer monitor, a television, or a handheld (mobile) electronic device accesses and displays the output of the processor 120. However, the preferred system 100 can be of any other form or include any other component.
[0095] The preferred system 100 can preferably be used in a variety of settings, including in a hospital setting, such as in a surgical operating room, in a clinical setting, such as in a delivery room, in a military setting, such as on a battlefield, or in a residential setting, such as aiding a consumer in monitoring blood loss due to menorrhagia (heavy menstrual bleeding) or epistaxis (nosebleeds). However, the preferred system 100 can be used in any other setting.
[0096] The optical sensor 110 of the preferred system 100 functions to capture the image of the physical sample. The optical sensor 110 preferably implements Block S102 of the preferred embodiment. The optical sensor 110 is preferably a digital camera that captures a color sample image or an RGB camera that captures independent image components in the red, green, and blue fields. However, the optical sensor 110 can comprise any number of cameras, charge-coupled device (CCD) sensors, complimentary metal-oxide-semiconductor (CMOS) active pixel sensors, or optical sensors of any other type. Furthermore, the optical sensor 110 can capture the sample image in any other form or across any other wavelength or range of wavelengths in the visible spectrum, infrared spectrum, or any other spectrum.
[0097] The optical sensor 110 is preferably a camera arranged within a handheld electronic device, as shown in FIGURE 8. However, the optical sensor 110 can also or alternatively be a camera or other sensor configured to be mounted on a pedestal for placement in an operating room, configured to be mounted to a ceiling over an operating table, configured for attachment to a battlefield helmet of a field nurse, configured to mount to a standalone blood volume estimation system including the processor 120, the display 130, and a staging tray that supports the physical sample for imaging, or configured for placement in or attachment to any other object or structure. [0098] The processor 120 of the preferred system extracts a feature from a portion of an image of the sample, tags the portion of the image of the sample with a blood volume indicator according to the extracted feature, and estimates the extracorporeal blood volume in at least a portion of the physical sample, identified in the portion of the image of the sample, according to the blood volume indicator. The processor 120 can preferably perform the Blocks of the first preferred method Sioo described above.
[0099] The processor 120 can be coupled to the optical sensor 110, such as via a wired connection (e.g., a trace on a shared PCB) or a wireless connection (e.g., a Wi-Fi or Bluetooth connection), such that the processor 120 can access the sample image captured by or visible in the field of view of the optical sensor 110. In one variation, the processor 120 is arranged within a handheld electronic device that also contains the optical sensor 110 and the display 130. In another variation, the processor 120 is a portion of or is tied to a remote server, wherein image data from the optical sensor 110 is transmitted (e.g., via an Internet or local network connection) to the remote processor 120, wherein the processor 120 estimates the extracorporeal blood volume in at least the portion of the physical sample by analyzing the sample image, and wherein the blood volume estimate is transmitted to the display 130.
[00100] In one variation of the preferred system 100 and as described above, the processor 120 can pair the portion of the sample image to the template image via template matching, and the template image is preferably one template image in a library of template images. In another variation of the preferred system 100 and as described above, the processor 120 parametrically generate the blood volume indicator based upon at least one extract feature from the image of the sample. The processor 120 can therefore be in communication with a local or remote data storage module, such as a hard drive in the handheld electronic device or a memory module of a remote server. The processor 120 can further upload the sample image for checking subsequent sample images against duplicate analysis of the same physical sample, for example as described with reference to Block 180 of the first preferred method Sioo. Finally, the processor 120 can analyze different types of images (e.g., static, streaming, .MPEG, .JPG, .TIFF) and/or images from one or more distinct cameras or optical sensors. [00101] The display 130 of the preferred system 100 preferably depicts the estimated blood volume in at least the portion of the physical sample. The display 130 is preferably arranged within the handheld electronic device (e.g., smartphone, tablet, personal data assistant) that also contains the optical sensor 110 and the processor 120, as shown in FIGURE 8. Alternatively, the display can be a computer monitor, a television screen, or any other suitable display physically coextensive with any other device, as shown in FIGURE 7. The display 130 can therefore be any of an LED, OLED, plasma, dot matrix, segment, e-ink, or retina display, a series of idiot lights corresponding to estimated blood volume, or any other suitable type of display. Finally, the display 130 can be in communication with the processor 120 via any of a wired and a wireless connection.
[00102] The display 130 can preferably perform at least Block S160 by depicting the estimated blood volume in the portion of the physical sample, in the whole of the physical sample, and/or across multiple physical samples. The blood volume estimate is preferably depicted in a common form, such as "cc's" (cubic centimeters). As shown in FIGURE 8, this data can be presented in the form of a dynamic augmented reality overlay on top of a live video stream of the physical sample that is also depicted on the display 130, wherein images from the optical sensor 110 are relayed substantially in real time, through the processor 120, to the display 130. As shown in FIGURE 8, the data can alternatively be presented in a table, chart, or graph depicting at least one of a time- elapse cumulative estimated blood volume across multiple samples analyzed over time and individual blood volume estimates for each physical sample. The display 130 can also depict: previous sample images; warnings, such as patient risk level (e.g., hypovolemic shock), or a hemorrhage classification of the patient; or suggestions, such as begin blood transfusion. Any of these data, warnings, and/or suggestions can also be depicted across multiple screens or made available for access on any one of more displays.
[00103] As shown in FIGURE 9, one variation of the preferred system 100 can further include a handheld housing 140 configured to contain the optical sensor 110, the processor 120, and the display 130. The handheld housing 140 with optical sensor 110, processor 120, and display 130 can define a handheld (mobile) electronic device capable of estimating blood volume in one or more physical samples in any number of suitable environments, such as in an operating room, a delivery room, a battlefield, a crime scene, and a home.
[00104] In another variation of the preferred system 100 shown in FIGURE 8, the housing 140 further contains a wireless communication module 150 that communicates the estimated blood volume in the portion of the physical sample to a remote server configured to store an electronic medical record of a patient. The medical record is also preferably updated with estimated blood loss over time, patient risk level, hemorrhage classification, and/or other blood-related metrics or blood volume indicators. The patient medical record can therefore be updated substantially automatically during a medical event, such as a surgery or childbirth. The housing 140 is preferably of a medical-grade material such that the system 100 that is a handheld electronic device is suitable for use in an operating room or other medical or clinical setting. The housing can therefore be medical-grade stainless steel, such as 316L stainless steel, a medical- grade polymer, such as high-density polyethylene (HDPE), or a medical-grade silicone rubber. However, the housing can be of any other material or combination of materials.
[00105] As shown in FIGURE 9, a variation of the preferred system 100 further includes a foot pedal 160 accessible by a user to confirm or to refute the identity of the physical sample. In this variation, the processor 120 preferably indexes the sample count when the user confirms the identity of the physical sample through the foot pedal 160. Additionally or alternatively, the user can engage the foot pedal 160 to select an appropriate sample type (e.g., a surgical sponge gauze, a surgical towel, a surgical dressing), to scroll through previous sample images, or to control the preferred system 100 in any other way. The foot pedal 160 therefore preferably includes at least two input regions that can be engaged by a foot of a user to manipulate the preferred system 100.
[00106] In one variation of the preferred system 100, the processor additionally or alternatively compares a portion of the image of the sample with a template image of known blood volume indicator, tags the portion of the image of the sample with a blood volume indicator according to the template image that is matched to the portion of the image of the sample, and estimates the extracorporeal blood volume in at least a portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator.
[00107] In a further variation of the preferred system 100, the processor additionally or alternatively identifies the physical sample in the image, indexes a sample counter for the identified physical sample, extracts a feature from a portion of the image, estimates the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature. The preferred system 100 can therefore implement the first preferred method, the third preferred method, and/or any combination or variation thereof.
[00108] The systems and methods of the preferred embodiments can be embodied and/or implemented at least in part as a machine configured to receive a computer- readable medium storing computer-readable instructions. The instructions are preferably executed by computer-executable components preferably integrated with the system, the optical sensor, the processor, the display, hardware/firmware/software elements of a system or handheld electronic device, or any suitable combination thereof. Other systems and methods of the preferred embodiments can be embodied and/or implemented at least in part as a machine configured to receive a computer-readable medium storing computer-readable instructions. The instructions are preferably executed by computer-executable components preferably integrated by computer- executable components preferably integrated with apparatuses and networks of the type described above. The computer-readable medium can be stored on any suitable computer readable media such as RAMs, ROMs, flash memory, EEPROMs, optical devices (CD or DVD), hard drives, floppy drives, or any suitable device. The computer- executable component is preferably a processor but any suitable dedicated hardware device can (alternatively or additionally) execute the instructions.
[00109] As a person skilled in the art of estimating the extracorporeal blood volume in a physical sample will recognize from the previous detailed description and from the figures and claims, modifications and changes can be made to the preferred embodiments of the invention without departing from the scope of this invention defined in the following claims.

Claims

CLAIMS We Claim:
1. A method for estimating the extracorporeal blood volume in a portion of a physical sample, the method comprising:
• extracting a feature from a portion of an image of the sample;
• tagging the portion of the image of the sample with a blood volume indicator according to the extracted feature; and
• estimating the extracorporeal blood volume in at least the portion of the physical sample, associated with the portion of the image of the sample, according to the blood volume indicator.
2. The method of Claim l, further comprising identifying the physical sample in the image as a type of absorbent gauze sponge.
3. The method of Claim 2, further comprising indexing a sample count for the physical sample that is identified as an absorbent gauze sponge.
4. The method of Claim 1, wherein tagging the portion of the image of the sample with the blood volume indicator comprises comparing the portion of the image of the sample with a template image of known extracorporeal blood volume indicator and associating the portion of the image of the sample with the blood volume indicator that is correlated with the known extracorporeal blood volume indicator of the template image.
5. The method of Claim 4, wherein comparing the portion of the image of the sample with the template image comprises pairing the portion of the image of the sample and the template image via template matching.
6. The method of Claim l, wherein tagging the portion of the image of the sample with the blood volume indicator comprises tagging the portion of the image of the sample with an estimated hemoglobin mass.
7. The method of Claim 6, wherein estimating the extracorporeal blood volume in at least the portion of the physical sample comprises estimating the extracorporeal blood volume in at least the portion of the physical sample according to the hemoglobin mass and an estimated hematocrit of the blood in the physical sample.
8. The method of Claim 1, wherein extracting the feature from the portion of the image of the sample comprises extracting the feature that comprises a color intensity value in a component space, wherein tagging the portion of the image of the sample with the blood volume indicator comprises comparing the color intensity value of the portion of the image in the sample with intensity values of color models paired with known blood volume indicators.
9. The method of Claim 1, wherein extracting the feature from the portion of the image of the sample comprises extracting the feature that comprises a color intensity value in a component space, wherein tagging the portion of the image of the sample with the blood volume indicator comprises transforming the extracted feature into the blood volume indicator according to a parametric model.
10. The method of Claim 1, wherein estimating the extracorporeal blood volume in at least a portion of the physical sample comprises associating a physical dimension of the physical sample with the portion of the image of the sample by transforming the portion of the image according to at least one of an estimated distance and an estimated angle between the capture origin of the image and the physical sample.
11. The method of Claim 1, wherein tagging the portion of the image with the blood volume indicator comprises classifying the physical sample according to a non-image feature, selecting a blood volume indicator model based upon the classification of the sample, and generating the blood volume indicator tag by passing the extracted feature into the selected blood volume indicator model.
12. The method of Claim 1, wherein estimating the extracorporeal blood volume in at least the portion of the sample comprises estimating the total extracorporeal blood volume in the physical sample based upon aggregated blood volume indicator tags of the portion of the image of the sample and substantially all other portions of the image.
13. The method of Claim 12, further comprising estimating patient blood loss by aggregating the estimated total extracorporeal blood volume in the physical sample and estimated total extracorporeal blood volumes in additional physical samples in additional images.
14. The method of Claim 12, further comprising estimating a volume of non-blood fluid in the physical sample by subtracting the weight of the estimated total extracorporeal blood volume in the physical sample from an entered weight of the physical sample.
15. The method of Claim 1, further comprising capturing the image through an optical sensor incorporated into a mobile electronic device.
16. The method of Claim 15, further comprising displaying, on a display incorporated into the mobile electronic device, the estimated extracorporeal blood volume in at least the portion of the physical sample.
17. A method for counting surgical samples comprising:
• identifying a physical sample in a field of view of an optical sensor;
• indexing a sample counter for the identified physical sample;
• extracting a feature from a portion of the field of the view of the optical sensor; and • estimating the extracorporeal blood volume in a portion of the physical sample based upon the extracted feature.
18. The method of Claim 17, further comprising capturing an image of the field of view of the optical sensor, wherein identifying the physical sample comprises identifying the physical sample in the image, and wherein extracting the feature from the portion of the field of the view of the optical sensor comprises extracting the feature from the portion of the image.
19. The method of Claim 18, wherein extracting the feature from the portion of the image of the sample comprises extracting the feature that comprises a color intensity value in a component space, wherein estimating the extracorporeal blood volume in the portion of the physical sample comprises transforming the extracted feature into the blood volume indicator according to a parametric model.
20. The method of Claim 17, wherein identifying the physical sample comprises identifying the physical sample as one of a surgical dressing, a surgical gauze sponge, and a surgical towel.
21. The method of Claim 20, wherein indexing the sample counter comprises indexing one of a surgical dressing counter, a surgical gauze sponge counter, and a surgical towel counter based upon the identified physical sample.
22. The method of Claim 17, further comprising estimating total extracorporeal blood volume in the physical sample by summing the estimated extracorporeal blood volume in the portion of the physical sample with estimated extracorporeal blood volumes in substantially all other portions of the physical sample.
23. The method of Claim 22, further comprising estimating patient blood loss by summing the estimated total extracorporeal blood volume in the physical sample with the estimated total extracorporeal blood volumes of physical samples in additional fields of view of the optical sensor.
24. The method of Claim 17, further comprising receiving confirmation of identification of the physical sample, wherein the sample counter is indexed for the physical sample that is confirmed.
25. The method of Claim 17, further comprising comparing the identified physical sample against a set of past identified physical samples, wherein the sample counter is indexed when the identified physical sample is determined to be unique amongst the set of past identified physical samples.
26. A system for determining the extracorporeal blood volume in a physical sample, the system comprising:
• an optical sensor that captures an image of the physical sample;
• a processor that extracts a feature from a portion of an image of the sample, tags the portion of the image of the sample with a blood volume indicator according to the extracted feature, and estimates the extracorporeal blood volume in at least a portion of the physical sample, identified in the portion of the image of the sample, according to the blood volume indicator; and
• a display that depicts the estimated blood volume in at least the portion of the physical sample.
27. The system of Claim 26, wherein the optical sensor is a camera, and wherein the processor further determines at least one of the angle of the camera relative to the physical sample and the distance between the camera and the physical sample at the time of the image was captured.
28. The system of Claim 26, further comprising a handheld housing that contains the optical sensor, the processor, and the display.
29. The system of Claim 26, further comprising a wireless communication module that communicates the estimated blood volume in the portion of the physical sample to a remote server that stores an electronic medical record of a patient.
30. The system of Claim 26, further comprising a data storage module configured to store a library of template images of known blood volume indicators, wherein the processor is configured to access a template image from the data storage module and to compare the template image with the portion of the image of the sample according to the extracted feature to generate the blood volume indicator tag.
31. The system of Claim 26, wherein the processor is further configured to identify the physical sample in the image and to index a sample counter for the identified physical sample.
PCT/US2012/045969 2011-07-09 2012-07-09 Systems and methods for estimating extracorporeal blood volume and for counting surgical samples WO2013009709A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN201280033911.3A CN103988057B (en) 2011-07-09 2012-07-09 Estimate extracorporeal blood volume and the system and method counted to surgery surgical samples
EP19156549.8A EP3561721B8 (en) 2011-07-09 2012-07-09 Method for estimating extracorporeal blood volume
JP2014519099A JP5794597B2 (en) 2011-07-09 2012-07-09 Extracorporeal blood volume estimation and surgically removed sample counting system and method
EP12810640.8A EP2729901B1 (en) 2011-07-09 2012-07-09 Methods for estimating extracorporeal blood volume
EP16183350.4A EP3106087B8 (en) 2011-07-09 2012-07-09 For estimating extracorporeal blood volume and for counting surgical samples
EP22204488.5A EP4147631A1 (en) 2011-07-09 2012-07-09 System for determining and method for estimating extracorporeal blood volume in a portion of a physical sample

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201161506082P 2011-07-09 2011-07-09
US61/506,082 2011-07-09
US201261646818P 2012-05-14 2012-05-14
US201261646822P 2012-05-14 2012-05-14
US61/646,818 2012-05-14
US61/646,822 2012-05-14

Publications (2)

Publication Number Publication Date
WO2013009709A2 true WO2013009709A2 (en) 2013-01-17
WO2013009709A3 WO2013009709A3 (en) 2014-05-08

Family

ID=47506844

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/045969 WO2013009709A2 (en) 2011-07-09 2012-07-09 Systems and methods for estimating extracorporeal blood volume and for counting surgical samples

Country Status (4)

Country Link
EP (4) EP2729901B1 (en)
JP (1) JP5794597B2 (en)
CN (1) CN103988057B (en)
WO (1) WO2013009709A2 (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014071399A1 (en) * 2012-11-05 2014-05-08 Gauss Surgical Method for triggering blood salvage
US8897523B2 (en) 2011-07-09 2014-11-25 Gauss Surgical System and method for counting surgical samples
US8983167B2 (en) 2012-05-14 2015-03-17 Gauss Surgical System and method for estimating a quantity of a blood component in a fluid canister
JP2015522311A (en) * 2012-05-14 2015-08-06 ガウス サージカルGauss Surgical System and method for managing patient blood loss
WO2016133767A1 (en) * 2015-02-19 2016-08-25 Sony Corporation Method and system for detection of surgical gauze during anatomical surgery
US9646375B2 (en) 2011-07-09 2017-05-09 Gauss Surgical, Inc. Method for setting a blood transfusion parameter
US9773320B2 (en) 2014-04-15 2017-09-26 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid canister
US9824441B2 (en) 2014-04-15 2017-11-21 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid canister
US9870625B2 (en) 2011-07-09 2018-01-16 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid receiver and corresponding error
JP2019505898A (en) * 2015-12-23 2019-02-28 ガウス サージカル, インコーポレイテッドGauss Surgical, Inc. Method for assessing the amount of blood components in a surgical fabric
US10426356B2 (en) 2011-07-09 2019-10-01 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid receiver and corresponding error
US10555675B2 (en) 2015-05-15 2020-02-11 Gauss Surgical, Inc. Method for projecting blood loss of a patient during a surgery
US10641644B2 (en) 2012-07-09 2020-05-05 Gauss Surgical, Inc. System and method for estimating an amount of a blood component in a volume of fluid
US10789710B2 (en) 2015-05-15 2020-09-29 Gauss Surgical, Inc. Methods and systems for characterizing fluids from a patient
EP3047796B1 (en) 2013-09-20 2020-11-04 National University Corporation Asahikawa Medical University Method and system for image processing of intravascular hemodynamics
US11109941B2 (en) 2017-01-02 2021-09-07 Gauss Surgical, Inc. Tracking surgical items with prediction of duplicate imaging of items
US11229368B2 (en) 2017-01-13 2022-01-25 Gauss Surgical, Inc. Fluid loss estimation based on weight of medical items
US11504037B2 (en) 2015-05-15 2022-11-22 Gauss Surgical, Inc. Systems and methods for assessing fluids from a patient
US11922646B2 (en) 2021-07-28 2024-03-05 Gauss Surgical Inc. Tracking surgical items with prediction of duplicate imaging of items

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6125137B1 (en) * 2016-11-17 2017-05-10 三菱電機株式会社 Water level measuring device and water level measuring method
JP7089919B2 (en) * 2018-03-29 2022-06-23 オルガノ株式会社 Component concentration measuring method and measuring device, as well as water treatment method and water treatment device
CN109448837A (en) * 2018-12-12 2019-03-08 四川大学华西第二医院 A kind of measuring for medical equipment that intelligent can summarize simultaneously real-time broadcasting
WO2021033667A1 (en) * 2019-08-19 2021-02-25 富士フイルム株式会社 Medical assistance device, operation method and operation program for same, and medical assistance system
CN111524122B (en) * 2020-04-22 2021-06-08 中国科学院重庆绿色智能技术研究院 Method for constructing gauze blood-soaking amount estimation model based on characteristic engineering
CN111920396A (en) * 2020-07-31 2020-11-13 青岛大学附属医院 Digital automatic measurement record operation gauze blood loss volume system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050163354A1 (en) 2002-01-19 2005-07-28 Michael Ziegler Method and device for the analysis of body fluids
US20100027868A1 (en) 2008-08-01 2010-02-04 Sysmex Corporation Blood sample analyzing apparatus, blood sample coagulation determining apparatus, blood sample coagulation determining method and computer program product

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4583546A (en) * 1983-11-18 1986-04-22 Garde Patria P Blood loss monitor
US5031642A (en) * 1989-04-06 1991-07-16 Nosek Bettie L Integrator - collector for surgical/medical procedures
US5190059A (en) * 1989-11-16 1993-03-02 Fabian Carl E Surgical implement detector utilizing a powered marker
US5236664A (en) * 1991-04-08 1993-08-17 University Of South Alabama Apparatus for monitoring blood loss
US5285682A (en) * 1991-04-09 1994-02-15 Micklish Clara J Sponge absorbed fluid measuring unit
US6998541B2 (en) * 1994-08-05 2006-02-14 Clearcount Medical Solutions, Inc. Automatic surgical sponge counter and blood loss determination system
JPH08247726A (en) * 1995-03-13 1996-09-27 Omron Corp Dimension measuring instrument
JPH1137845A (en) * 1997-07-22 1999-02-12 Matsushita Electric Ind Co Ltd Equipment for measuring quantity of serum
JP2003075436A (en) * 2001-09-04 2003-03-12 Daiken Iki Kk Amount-of-bleeding measuring apparatus
EP1545740A2 (en) * 2002-09-07 2005-06-29 Arizona Board of Regents Integrated apparatus and methods for treating liquids
US8712118B2 (en) * 2003-04-10 2014-04-29 Carl Zeiss Microimaging Gmbh Automated measurement of concentration and/or amount in a biological sample
JP2005052288A (en) * 2003-08-01 2005-03-03 Sanyo Electric Industries Co Ltd Gauze counter for operation
JP2005164512A (en) * 2003-12-05 2005-06-23 Casio Comput Co Ltd Size measuring instrument and program
US7905870B2 (en) * 2005-03-13 2011-03-15 Harty Robert D Device for collecting and measuring fluid loss
JP2006280445A (en) * 2005-03-31 2006-10-19 Toshiba Corp In-vivo leaving prevention system, and gauze
EP1892001A1 (en) * 2006-08-23 2008-02-27 B. Braun Medizintechnologie GmbH Medical device for extracorporeal blood treatment
CN102016578B (en) * 2008-03-21 2014-10-01 艾博特健康公司 Method and apparatus for determining the hematocrit of a blood sample utilizing the intrinsic pigmentation of hemoglobin contained within the red blood cells
US9168104B2 (en) * 2008-06-23 2015-10-27 John Richard Dein Intra-operative system for identifying and tracking surgical sharp objects, instruments, and sponges

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050163354A1 (en) 2002-01-19 2005-07-28 Michael Ziegler Method and device for the analysis of body fluids
US20100027868A1 (en) 2008-08-01 2010-02-04 Sysmex Corporation Blood sample analyzing apparatus, blood sample coagulation determining apparatus, blood sample coagulation determining method and computer program product

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2729901A4

Cited By (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11783503B2 (en) 2011-07-09 2023-10-10 Gauss Surgical Inc. Systems and method for estimating extracorporeal blood volume in a physical sample
US8897523B2 (en) 2011-07-09 2014-11-25 Gauss Surgical System and method for counting surgical samples
US10957179B2 (en) 2011-07-09 2021-03-23 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid receiver and corresponding error
US9047663B2 (en) 2011-07-09 2015-06-02 Gauss Surgical Method for triggering blood salvage
US11222189B2 (en) 2011-07-09 2022-01-11 Gauss Surgical, Inc. System and method for estimating extracorporeal blood volume in a physical sample
US10528782B2 (en) 2011-07-09 2020-01-07 Gauss Surgical, Inc. System and method for estimating extracorporeal blood volume in a physical sample
US10426356B2 (en) 2011-07-09 2019-10-01 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid receiver and corresponding error
US11670143B2 (en) 2011-07-09 2023-06-06 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid receiver and corresponding error
US9870625B2 (en) 2011-07-09 2018-01-16 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid receiver and corresponding error
US9646375B2 (en) 2011-07-09 2017-05-09 Gauss Surgical, Inc. Method for setting a blood transfusion parameter
US9652655B2 (en) 2011-07-09 2017-05-16 Gauss Surgical, Inc. System and method for estimating extracorporeal blood volume in a physical sample
US11836915B2 (en) 2012-05-14 2023-12-05 Gauss Surgical Inc. System and method for estimating a quantity of a blood component in a fluid canister
JP2015522311A (en) * 2012-05-14 2015-08-06 ガウス サージカルGauss Surgical System and method for managing patient blood loss
US9595104B2 (en) 2012-05-14 2017-03-14 Gauss Surgical, Inc. System and method for estimating a quantity of a blood component in a fluid canister
US9936906B2 (en) 2012-05-14 2018-04-10 Gauss Surgical, Inc. System and methods for managing blood loss of a patient
US11712183B2 (en) 2012-05-14 2023-08-01 Gauss Surgical Inc. System and methods for managing blood loss of a patient
US10282839B2 (en) 2012-05-14 2019-05-07 Gauss Surgical, Inc. System and method for estimating a quantity of a blood component in a fluid canister
JP2017038943A (en) * 2012-05-14 2017-02-23 ガウス サージカルGauss Surgical System for managing blood loss of patient
US8983167B2 (en) 2012-05-14 2015-03-17 Gauss Surgical System and method for estimating a quantity of a blood component in a fluid canister
US10863933B2 (en) 2012-05-14 2020-12-15 Gauss Surgical, Inc. System and methods for managing blood loss of a patient
US9171368B2 (en) 2012-05-14 2015-10-27 Gauss Surgical System and method for estimating a quantity of a blood component in a fluid canister
US10706541B2 (en) 2012-05-14 2020-07-07 Gauss Surgical, Inc. System and method for estimating a quantity of a blood component in a fluid canister
US10641644B2 (en) 2012-07-09 2020-05-05 Gauss Surgical, Inc. System and method for estimating an amount of a blood component in a volume of fluid
US10424060B2 (en) 2012-07-09 2019-09-24 Gauss Surgical, Inc. Method for estimating blood component quantities in surgical textiles
WO2014071399A1 (en) * 2012-11-05 2014-05-08 Gauss Surgical Method for triggering blood salvage
EP3047796B1 (en) 2013-09-20 2020-11-04 National University Corporation Asahikawa Medical University Method and system for image processing of intravascular hemodynamics
US9773320B2 (en) 2014-04-15 2017-09-26 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid canister
US9824441B2 (en) 2014-04-15 2017-11-21 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid canister
WO2016133767A1 (en) * 2015-02-19 2016-08-25 Sony Corporation Method and system for detection of surgical gauze during anatomical surgery
US11504037B2 (en) 2015-05-15 2022-11-22 Gauss Surgical, Inc. Systems and methods for assessing fluids from a patient
US11410311B2 (en) 2015-05-15 2022-08-09 Gauss Surgical, Inc. Methods and systems for characterizing fluids from a patient
US10789710B2 (en) 2015-05-15 2020-09-29 Gauss Surgical, Inc. Methods and systems for characterizing fluids from a patient
US10555675B2 (en) 2015-05-15 2020-02-11 Gauss Surgical, Inc. Method for projecting blood loss of a patient during a surgery
US11727572B2 (en) 2015-05-15 2023-08-15 Gauss Surgical Inc. Methods and systems for characterizing fluids from a patient
US11666226B2 (en) 2015-05-15 2023-06-06 Gauss Surgical, Inc. Method for projecting blood loss of a patient during a surgery
US11282194B2 (en) 2015-12-23 2022-03-22 Gauss Surgical, Inc. Method for estimating blood component quantities in surgical textiles
US11333545B2 (en) 2015-12-23 2022-05-17 Gauss Surgical, Inc. System and method for estimating an amount of a blood component in a volume of fluid
EP3736771A1 (en) * 2015-12-23 2020-11-11 Gauss Surgical, Inc. Method for estimating blood component quantities in surgical textiles
JP7210061B2 (en) 2015-12-23 2023-01-23 ガウス サージカル,インコーポレイテッド Method for assessing the amount of blood constituents in surgical fabric
US11176663B2 (en) 2015-12-23 2021-11-16 Gauss Surgical, Inc. Method for estimating blood component quantities in surgical textiles
EP3394831A4 (en) * 2015-12-23 2019-08-07 Gauss Surgical, Inc. Method for estimating blood component quantities in surgical textiles
JP2019505898A (en) * 2015-12-23 2019-02-28 ガウス サージカル, インコーポレイテッドGauss Surgical, Inc. Method for assessing the amount of blood components in a surgical fabric
US11790637B2 (en) 2015-12-23 2023-10-17 Gauss Surgical Inc. Method for estimating blood component quantities in surgical textiles
JP2022000147A (en) * 2015-12-23 2022-01-04 ガウス サージカル, インコーポレイテッドGauss Surgical, Inc. Method for estimating blood component quantities in surgical textiles
US11109941B2 (en) 2017-01-02 2021-09-07 Gauss Surgical, Inc. Tracking surgical items with prediction of duplicate imaging of items
US11229368B2 (en) 2017-01-13 2022-01-25 Gauss Surgical, Inc. Fluid loss estimation based on weight of medical items
US11922646B2 (en) 2021-07-28 2024-03-05 Gauss Surgical Inc. Tracking surgical items with prediction of duplicate imaging of items

Also Published As

Publication number Publication date
EP3561721B8 (en) 2022-12-21
CN103988057A (en) 2014-08-13
EP3106087B1 (en) 2019-02-13
JP2014531570A (en) 2014-11-27
EP3106087A1 (en) 2016-12-21
EP2729901A4 (en) 2015-04-29
EP3561721A1 (en) 2019-10-30
EP4147631A1 (en) 2023-03-15
WO2013009709A3 (en) 2014-05-08
CN103988057B (en) 2017-11-28
JP5794597B2 (en) 2015-10-14
EP3106087B8 (en) 2022-12-21
EP3561721B1 (en) 2022-11-02
EP2729901B1 (en) 2016-09-14
EP2729901A2 (en) 2014-05-14

Similar Documents

Publication Publication Date Title
US11783503B2 (en) Systems and method for estimating extracorporeal blood volume in a physical sample
EP2729901B1 (en) Methods for estimating extracorporeal blood volume
US11836915B2 (en) System and method for estimating a quantity of a blood component in a fluid canister
US20230255492A1 (en) Wound analyzing system and method
KR20220123165A (en) System for the diagnosis of skin diseases and the analysis of skin states using multiband imagery information based on visual artificial intelligence and method thereof
CN117426744A (en) Detection device, detection method, medical instrument and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12810640

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2012810640

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2012810640

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2014519099

Country of ref document: JP

Kind code of ref document: A