US20070227020A1 - Head-Mounted Navigation System - Google Patents
Head-Mounted Navigation System Download PDFInfo
- Publication number
- US20070227020A1 US20070227020A1 US11/424,506 US42450606A US2007227020A1 US 20070227020 A1 US20070227020 A1 US 20070227020A1 US 42450606 A US42450606 A US 42450606A US 2007227020 A1 US2007227020 A1 US 2007227020A1
- Authority
- US
- United States
- Prior art keywords
- bearing
- head
- navigation system
- mounted navigation
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/12—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification
- G02B23/125—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification head-mounted
-
- A—HUMAN NECESSITIES
- A42—HEADWEAR
- A42B—HATS; HEAD COVERINGS
- A42B3/00—Helmets; Helmet covers ; Other protective head coverings
- A42B3/04—Parts, details or accessories of helmets
- A42B3/0406—Accessories for helmets
- A42B3/0433—Detecting, signalling or lighting devices
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
Definitions
- Navigation systems and, more particularly, navigation systems that assist individuals in navigating through environments having poor visibility are particularly preferred.
- Firefighters are an example. They often need help walking through smoke or fire-filled rooms for self rescue, such as when trying to locate exits, obstacles and/or other dangers. They also often need help locating persons needing to be rescued.
- Military personnel are another example. They may need assistance running or walking on a smoke-filled battlefield or traveling through a smoke-filled room filled to rescue a hostage or to capture or incapacitate an enemy.
- Police are a still further example. They may similarly need assistance traveling through a smoke-filed filled room to rescue a hostage or to capture or incapacitate a criminal.
- a head-mounted navigation system may include an image sensor configured to sense one or more objects forward of a person and to generate image information representative of the one or more objects.
- a bearing sensor may be included and configured to detect bearing and to generate bearing information representative of the bearing.
- Securing apparatus may be included and configured to secure the bearing sensor to the person.
- a processing system may be included and configured to receive the image information and/or the bearing information and to generate display information representative of the one or more objects and/or the bearing.
- a display may be included and configured to receive the display information and to display visual information representative of the one or more objects and/or the bearing.
- Head gear may be included and configured to mount on the head of the person and to position the display along a sight path of the person.
- the image sensor may include a radar sensor.
- the head gear may include a helmet, and the radar sensor may be attached to the helmet and include a beaming antenna and an antenna sweeping system configured to cause the beaming antenna to sweep horizontally.
- the beaming antenna may include a horn and the antenna sweeping system may include a motor mechanically linked to the horn.
- the beaming antenna may output a frequency-modulated continuous-wave signal.
- the frequency-modulated continuous-wave signal may have a wavelength of less than one millimeter.
- the image sensor may be configured to generate image information that is representative of the range and reflectivity of each of the one or more objects.
- the bearing sensor may include a magnetic field sensor.
- the securing apparatus may be configured to secure the bearing sensor to the torso of the person, such as to the back of the person.
- the securing apparatus may include a clothing pocket.
- the processing system may be configured to generate display information that is representative of a three-dimensional image of the one or more objects.
- the processing system may be configured to generate bearing information that is representative of an image of a compass pointing in the direction of the bearing.
- the processing system may be configured to generate bearing information that includes a numerical representation of the bearing.
- the processing system may be configured to generate bearing information that is representative of the current bearing of the person relative to an earlier bearing of the person.
- the display include may include an LCD.
- the display may include LEDs.
- the head gear may include a face mask.
- the head gear may be configured to position all portions of the display above the horizontal line of sight of the person.
- FIG. 1 illustrates a head-mounted navigation system worn by a firefighter.
- FIGS. 2 ( a ) and ( b ) illustrate details of the helmet shown in FIG. 1 .
- FIGS. 3 ( a ) and ( b ) illustrate details of a radar sensor that may be used for the image sensor shown in FIG. 1
- FIG. 4 is a block diagram of the radar sensor shown in FIGS. 3 ( a ) and ( b ).
- FIG. 5 is a block diagram of the head-mounted navigation system shown in FIG. 1 .
- FIG. 6 is a block diagram of a power source for the head-mounted navigation system shown in FIG. 1 .
- FIG. 7 illustrates images that may be shown on the display in FIG. 1 .
- FIG. 8 illustrates a firefighter walking through a smoke-filled room wearing a head-mounted navigation system and a display he sees.
- FIG. 9 illustrates a potion of an alternate embodiment of the display in FIG. 1 using LED's.
- FIG. 10 illustrates a potion of a still further alternate embodiment of the display in FIG. 1 using a numerical representation of bearing.
- FIG. 11 illustrates an alternate embodiment of a head-mounted navigation system worn by a firefighter.
- FIG. 1 illustrates a head-mounted navigation system worn by a firefighter.
- a firefighter 101 may be wearing a helmet 103 having an image sensor 105 .
- the image sensor 105 may function to sense one or more objects forward of the firefighter. It may generate information representative of the one or more objects, such as information concerning the range of each object from the firefighter and the degree to which the object reflects a signal that may be generated by the image sensor 105 and directed to the object.
- image sensor 105 Any type of image sensor may be used for the image sensor 105 . It may be a radar sensor, an ultrasound sensor, an infrared sensor, another type of sensor, and/or any combination of these types of sensors.
- the image sensor 105 may be attached to headgear worn by the firefighter, such as to the helmet 103 . It may be attached to the top of the helmet, such as shown in FIG. 1 . It may in addition or instead be placed in front of the helmet, to the side of the helmet, to a different portion of the headgear, to another area on the firefighter, and/or to a location that is external to the firefighter.
- a housing 107 may contain a bearing sensor (not visible in FIG. 1 ) that may be configured to detect the bearing of the firefighter 101 .
- the bearing sensor may also be configured to generate bearing information indicative of the bearing of the firefighter.
- the bearing sensor may include a magnetic field sensor that detects the orientation of the bearing sensor with respect to the earth's magnetic field.
- the magnetic sensor may be configured to minimize interference by stray magnetic fields, to balance for differences between magnetic north and true north, and/or to compensate for temperature effects.
- a chip bearing sold as part number KMZ51 may be obtained from Phillips to serve as the bearing sensor.
- bearing sensors may be used in addition or instead, including a gyroscope and/or a GPS system.
- the bearing sensor may consist of a single sensor or may include several sensors.
- Securing apparatus may be included to secure the bearing sensor to the firefighter.
- the securing apparatus may secure the bearing sensor to the torso of the firefighter, such as on the back of the firefighter. It may in addition or instead secure the bearing sensor to other areas of the firefighter, such as to a shoulder or thigh.
- the securing apparatus may in addition or instead secure the bearing sensor to the head of the firefighter. When secured to the head, however, the bearing that is sensed may be the direction in which the firefighter is looking, not necessarily the direction in which the firefighter is traveling.
- the securing apparatus may be or may include a clothing pocket 109 attached to the rear portion of a jacket 111 that may be worn by the firefighter 101 .
- the pocket 109 may be positioned so as to cause the housing 107 not to come in contact with an air tank 113 that may be worn by the firefighter or the firefighter's arm 115 when moved.
- Other types of securing apparatus may be used in addition or instead to secure the bearing sensor to the firefighter, such as a strap, clip, hook, and/or Velcro.
- the head-mounted navigation system may include a display 117 .
- the display may be of any type, such as an LCD. It may include or instead consist of one or more LEDs. Any other type of display may be used in addition or instead.
- the display 117 may have a single screen or multiple screens or no screen.
- the headgear worn by the firefighter may include a face mask 119 to which the display 117 may be attached.
- the display 117 may be attached to the face mask 119 in such a position as to cause the display to lie along a sight path 121 of the firefighter 101 .
- the display 117 may be positioned with respect to the face mask 119 such that all portions of the display lie above the horizontal line of sight 123 of the firefighter 101 . This configuration is commonly referred to as a heads-up display.
- the display 117 may be configured and/or positioned so as to be viewable by one or both of the firefighter's eyes.
- the display 117 may be attached to portions of the headgear other than the face mask 119 to position it along a sight path of the firefighter 101 .
- the display 117 may be attached to the helmet 103 .
- the display 117 may be attached to a cap, head strap, eyewear, or other type of headgear that the firefighter 101 might wear instead or in addition.
- Flexible electric cabling 125 , 127 , and 131 may be used to electrically interconnect the housing 107 , the image sensor 105 , and the display 117 .
- Coiled cables may be used for this purpose, as shown in FIG. 1 .
- the cabling may be constructed of material that withstands harsh environments, such as high temperature or caustic environments.
- the cabling 125 , 127 , and 131 may be configured or routed internally so as not be exposed.
- the cabling may include appropriate end connectors, thus enabling the image sensor 105 and the display 117 to be detached from each other and from the housing 107 . This may make it easier for the firefighter 101 to put on his protective gear.
- connections between the various components of the system may be wireless, using any of the well-know wireless techniques that are in use today or that are later be invented.
- FIGS. 2 ( a ) and ( b ) illustrate details of the helmet 103 shown in FIG. 1 .
- FIG. 2 ( a ) illustrates a side view
- FIG. 2 ( b ) illustrates a front view.
- attachment mechanisms 201 and 203 that may be used to attach the image sensor 105 to the helmet 103 .
- They also illustrate a radome 205 that the image sensor 105 may have.
- FIGS. 3 ( a ) and ( b ) illustrate details of a radar sensor that may be used for the image sensor shown in FIG. 1 .
- FIG. 3 ( a ) illustrates a top view
- FIG. 3 ( b ) illustrates a side view.
- the radar sensor may include a beaming antenna 301 , a printed circuit board 303 containing electronic circuitry, a sensor module 305 , a motor 307 , a linkage arm 309 , a pivot 311 , and a housing 313 that may include a radome 315 .
- the beaming antenna 301 may be configured to radiate a narrow radar beam. It may be a horn, as illustrated in FIGS. 3 ( a ) and ( b ), or it may be in any other type of radar antenna, such as a phase array antenna or a frequency scanned antenna.
- the printed circuit board 303 may be configured to hold appropriate circuitry configured to perform one or more of the functions that are described herein and/or other functions.
- the sensor module 305 may be configured to radiate radar signals and to receive and detect reflected radar signals, as will be described more fully below.
- the sensor module 305 may be connected to the circuit board 303 with a flexible cable 306 .
- the flexible cable may be coiled, as shown in FIGS. 3 ( a ) and ( b ), or may otherwise be configured to allow the end of the beaming antenna 301 to be moved with respect to the circuit board 303 , without jeopardizing the electrical connection between the two or the movement of the beaming antenna 301 .
- the motor 307 may be configured along with the linking arm 309 and the pivot 311 so as to cause the beaming antenna 301 to sweep back and forth as shown in FIG. 3 ( a ) in response to appropriate control signals.
- the motor 307 may be any type of motor, such as a stepping motor.
- Another type of electromechanical device may be used in addition or instead to effectuate scanning of the beaming antenna 301 .
- the antenna may also or instead be scanned electronically using techniques such as phasing, particularly when the beaming antenna 301 is a phased array radar antenna.
- the housing 313 may be sized so as to allow the beaming antenna 301 to scan freely.
- the radome 315 may similarly be configured to allow the beaming antenna 301 to freely scan.
- the radome 315 may be made of material that allows the radar signal to travel through it without significant degradation or reflection, while at the same time protecting the internal components of the image sensor 105 from external contaminants.
- the beaming antenna 301 may be scanned using frequency scanning or phasing.
- FIG. 4 is a block diagram of the radar sensor shown in FIGS. 3 ( a ) and 4 .
- a voltage controlled oscillator (VCO) 401 may be used to generate a frequency modulated continuous wave radar signal.
- the signal may have a wavelength that is less than 1 mm.
- a frequency of between 30 and 110 GHz may be used, such as a frequency of approximately 76 GHz.
- the voltage controlled oscillator 401 may be configured to frequency modulate this carrier signal across a bandwidth of between 400 MHz and 1000 MHz, such as across a bandwidth of approximately 500 MHz.
- a sweep generator 403 may be used to control the frequency modulation of the radar signal by the voltage controlled oscillator 401 .
- the sweep generator 403 may be configured to generate a saw-tooth or triangular ramp signal that takes between 0.1 ms and 2 ms to ramp fully, e.g., approximately 1 ms.
- the magnitude of the ramp signal that is generated by the sweep generator 403 may be such as to cause the voltage controlled oscillator 401 to sweep through its full bandwidth.
- a power amplifier 405 may be used to amplify the signal from the voltage controlled oscillator 401 .
- the power output of the power amplifier 405 may be between 0.1 mW and 10 mW.
- a circulator 407 may be used to direct the frequency modulated continuous wave signal from the power amplifier 405 to the beaming antenna 301 .
- the objects within the beam from the beaming antenna 301 may each cause a reflection of the beam back to beaming antenna 301 .
- the delay in the arrival of each reflection at the beaming antenna 301 may be indicative of the distance (range) of each object from the beaming antenna 301 , while the amplitude of each reflection may be indicative of the radar reflectivity of each object and, in many cases, its size.
- These reflected signals may be received by the beaming antenna 301 and redirected by the circulator 407 to a mixer 409 .
- a coupler 411 may simultaneously deliver a sample of the output from the power amplifier 405 to the mixer 409 .
- the mixer 409 may be configured to multiply the output from the circulator 407 of the reflected signals by the transmitted signal from the coupler 411 . This may create a series of tones, namely beat frequencies.
- the amplitude of each tone may be proportional to the radar cross section (RCS) of an object in front of the beaming antenna 301 .
- the frequency of that tone may be proportional to the distance between the object and the beaming antenna 301 .
- a base band filter 413 may be used to filter limit the noise and enhance these beat frequencies (also known as the base band radar signal) that is outputted from the mixer 409 .
- a stepping motor 417 may be used to cause the beaming antenna 301 to sweep through an arc, as explained above in more detail in connection with FIGS. 3 ( a ) and ( b ).
- a controller 415 may be used to control the stepping motor 407 , as well as to control the sweep generator 403 .
- the controller 415 may be configured to cause the stepping motor to quickly move the beaming antenna 301 to its maximum offset position after receiving a command from an input 417 or, in an alternate embodiment, upon its own.
- the maximum offset may be between 15 and 35° from the antenna's straight-ahead position, such as approximately 25°.
- the controller 415 may then cause the stepping motor 307 to sweep the beaming antenna 301 horizontally from its maximum offset position through its straight-ahead position and to approximately the same offset position in the opposite horizontal direction. This sweeping pattern may then repeat continuously.
- the rate at which the beaming antenna 301 horizontally sweeps between its maximum offset positions may vary.
- the controller 415 may be configured to cause the stepping motor 307 to sweep the beaming antenna 301 through its entire arc in approximately 1 to 2 seconds.
- the controller 415 may cause the stepping motor 307 to sweep the beaming antenna 301 in steps of between 1 and 5°. After each step during a sweep, the controller 415 may be configured to send a triggering signal to the sweep generator 403 so as to cause the sweep generator 403 to initiate its ramp signal. Conversely, the sweep generator 403 may initiate its ramp on its own and send a signal to the controller 415 to begin a sweep. The controller 415 may in any event wait before directing the stepping motor 307 to step to the next position until the ramp that is generated by the sweep generator 403 reaches its maximum value. This may be done in an open or closed loop manner.
- the controller 415 may output a synchronization signal over its communication line 417 indicating the commanded position of the beaming antenna 301 and/or the initiation signals to the sweep generator 403 . This may assist a processing system (discussed below) in synchronizing the output from the band pass filter 413 with the angular position of the beaming antenna 301 .
- FIG. 5 is a block diagram of the head-mounted navigation system shown in FIG. 1 .
- the system may include an image sensor 105 , a bearing sensor 501 (contained within the housing 107 ), a display 117 , and a processing system 503 .
- the processing system 503 may include an analog-to-digital (A/D) converter 505 and a digital signal processing (DSP) subsystem 507 .
- A/D analog-to-digital
- DSP digital signal processing
- the processing system 503 may be configured to receive the image information from the image sensor 105 , such as the base band output from the base band filter 413 in the radar sensor shown in FIG. 4 .
- the processing system 503 may utilize the analog-to-digital converter 505 to convert the base band output from the image sensor 105 into a digital signal.
- the processing system 503 may cause this digital signal to be processed by the digital signal processing subsystem 507 for the purpose of generating display information that is representative of the one or more objects that are within the field of view of the beaming antenna 301 as it is swept across its horizontal arc.
- This display information may be representative of a three-dimensional image of each of the one or more objects.
- This display information may be created by the processing system 503 and its associated digital signal processing subsystem 507 using well-established signal processing techniques.
- the processing system 503 may classify the objects that are detected within the scanning pathway of the beaming antenna 301 into range bins, such as into 264 or 512 range bins. During the scanning process, the processing system 503 may perform data reduction by statistically classifying the objects and storing them temporarily in a memory (not shown) in accordance with well-known data reduction techniques. At the end of a scan, the data may be retrieved, scaled appropriately, and presented as display information for viewing to the display 117 . This entire process may repeat for the succeeding scans.
- the processing system 503 may be configured to communicate to the image sensor 105 and, in the embodiment shown in FIG. 4 , to the controller 415 of the image sensor, as to when to begin each sweep. Conversely, the image sensor 105 and, in the embodiment shown in FIG. 4 , the controller 415 , may instead be configured to initiate each sweep on its own and to deliver synchronizing information about that sweep to the processing system 503 . Either way, the processing system 503 may be configured to synchronize the received image information from the image sensor 105 , which in the embodiment shown in FIG. 4 is the base band output from the base band filter 413 , with the position of the beaming antenna 301 as it sweeps horizontally. This may enable the processing system 503 to generate display information that is representative of the cross-range position of each of the one or more objects that are detected by the image sensor 105 for display.
- the processing system 503 in conjunction with the digital signal processing subsystem 507 , may be configured to distinguish between stationary and moving objects by extrapolating appropriate display information from Doppler frequency shifts in the image information from the image sensor 105 , again using well-established techniques.
- the processing system 503 in conjunction with the digital signal processing subsystem 507 , may be configured in addition or instead to generate display information indicative of the temperature of detected objects. This may be accomplished using well-known techniques, such as by extrapolating the temperature information from differences in the noise level of the signal from the image sensor 105 .
- the processing system 503 may be configured to generate display information that includes a grid superimposed upon the image information that it generates.
- the grid information may include coordinate axes and numeric or other appropriate labeling of these axes. An example of such a grid is illustrated in FIG. 7 and discussed below.
- the processing system 503 may be configured to also generate display information that is representative of the bearing that is detected by the bearing sensor 501 .
- the display information that is representative of the bearing may take any form. For example, it may take the form of an image of a compass pointing in the direction of the bearing, as illustrated in FIG. 7 and discussed below.
- the display information that the processing system 503 generates that is representative of the bearing may be representative of either absolute or relative bearing.
- the display information may indicate bearing relative to the four cardinal directions (North, South, East, and West).
- the display information may indicate bearing relative to a prior bearing.
- a firefighter entering a burning room may be more concerned about his bearing relative to a known escape direction, rather than his absolute bearing.
- he Before he enters the room, he may face in the direction of the known escape route and, through actuation of an appropriate user control, cause this bearing to be recorded by the processing system 503 . Thereafter, all bearings that are communicated to him through the display 117 may be expressed in a form that is relative to this escape route.
- the display information may be representative of an arrow indicating the direction the firefighter must travel to get to this escape route.
- a position-monitoring sensor such as a GPS system
- Information from both sensors may then be used by the processing system 503 to more precisely direct the firefighter to preprogrammed locations of interest, such as to an escape route.
- a position-monitoring sensor may also be useful in embodiments used to locate something (e.g., a person or article) at a location whose coordinates are precisely known. These coordinates may be preprogrammed in the system. Information from the bearing sensor and the position sensor may then be used in conjunction with this preprogrammed information to again cause the display of an arrow on the display 117 indicating the direction the person must travel to arrive at this predetermined location.
- something e.g., a person or article
- These coordinates may be preprogrammed in the system.
- Information from the bearing sensor and the position sensor may then be used in conjunction with this preprogrammed information to again cause the display of an arrow on the display 117 indicating the direction the person must travel to arrive at this predetermined location.
- the display 117 may be configured to receive the display information from the processing system 503 and to display visual information representative of the display information. In the embodiment illustrated in FIG. 5 , this may consist of visual information representative of one or more objects within the sweeping field of the beaming antenna 301 , as well as the bearing of the bearing sensor 501 .
- the processing system 503 may include hardware, firmware, and/or software, configured in accordance with well-known techniques to implement one or more of the functions that have been described herein.
- the processing 503 may be dedicated to these functions and/or may be used to perform other functions.
- the processing system 503 may be in any location or distributed across multiple locations. In one embodiment, the processing system 503 may be housed along with the bearing sensor 501 in the housing 107 . Some or all portions of the processing system 503 may instead be housed in the housing 313 that houses components of the image sensor 105 .
- the processing system 503 may be configured to communicate with the image sensor 105 and/or the bearing sensor 501 using any type of communication system or protocol.
- an RS-232 port may be used.
- the head-mounted navigation system has thus-far been described as including the image sensor 105 , an alternate embodiment may not include any type of image sensor.
- the processing system 503 may not have the analog-to-digital converter 505 or the digital signal processing subsystem 507 .
- the processing system 503 may be configured to generate display information that represents the bearing information, but not objects forward of the user.
- FIG. 6 is a block diagram of a power source for the head-mounted navigation system shown in FIG. 1 .
- the power source may include a battery 601 and a charger 603 .
- the battery 601 may consist of more than one battery.
- the battery 601 may be configured to power all of the electrical components of the head-mounted navigation system, such as the image sensor 105 , the bearing sensor 501 , the processing system 503 , and/or the display 117 .
- the battery 601 may be of a type that can be recharged.
- the battery 601 may be configured so as to be detachably-connected to the charger 603 .
- the charger 603 may be attached to the battery 601 for the purpose of charging the battery 601 .
- the battery 601 may be located anywhere. In one embodiment, the battery 601 may be located in the housing 107 . In an alternate embodiment, the battery 601 may be located in the image sensor 105 .
- the image sensor 105 , the bearing sensor 501 , the processing system 503 , and/or the display 117 may each in addition or instead be powered by their own separate battery, which may be co-located with the device or elsewhere.
- FIG. 7 illustrates images that may be shown on the display in FIG. 1 .
- the images may include an image of a compass 701 pointing in the direction of the bearing.
- the image of the compass 701 may instead always have the needle point forward, while rotating the relative position of the four cardinal directions to reflect the new bearing.
- the visual information that is representative of the bearing that is displayed may be dictated by the display information generated by the processing system 503 .
- the display 701 may also include a three-dimensional wire-frame image of objects that are forward of the user, such as objects 705 , 707 , 709 , 711 , and 713 . These wire-frame images may be part of the display information generated by the processing system 503 .
- the display 701 may include a superimposed three-dimensional grid pattern 715 as well as axes and numerical scale markings indicating the approximate scale of the imagery. This grid, axes and scale information may be part of the display information generated by the processing system 503 .
- the head-mounted navigation systems that have now been described may be used in a broad variety of applications.
- the poor visibility may be caused by smoke, dust, fog, snow, sand, rain, flames, darkness, and/or by a combination of one or more of these factors.
- Persons in many different types of endeavors may use one or more embodiments of these head-mounted navigation systems to navigate through one or more of these types of problematic environments. For example, a firefighter may use one of these systems in connection with navigating through a room that is filled with flames and/or smoke. The firefighter may use one of these systems to help locate an exit, a person needing to be rescued, and/or to avoid obstacles and/or other dangers.
- FIG. 8 illustrates a firefighter walking through a smoke-filled room wearing a head-mounted navigation system and a display he sees. Specifically, FIG. 8 illustrates a firefighter 801 wearing a head-mounted navigation system in a smoke-filled room 803 .
- the room includes several obstructions, such as obstructions 805 , 807 and 809 . It also includes an exit 813 .
- FIG. 8 also illustrates an enlarged view 814 of what the firefighter 801 may see on the display of his head-mounted navigation system, such as on the display 117 shown in FIG. 1 .
- the image may include an image 815 i of a compass pointing in the direction that the firefighter is moving, as well as a three-dimensional wire frame image of the objects 805 (marked 805 i), 807 (marked 807 i) and 809 (marked 809 i), and the exit 813 (marked 813 i).
- the firefighter 801 may use the information that he sees on the display 814 to help navigate safely to the exit 813 .
- Police and military personnel may similarly use one of these head-mounted navigation systems to help locate a hostage in a room filled with smoke from a smoke bomb.
- the police may in addition or instead seek to use one of these systems to capture or incapacitate a criminal in such a room, while a soldier may similarly use such a system to capture or attack an enemy in such a room.
- a soldier may also use such a system to help navigate on a smoke-filled battlefield.
- FIG. 9 illustrates a portion of an alternate embodiment of the display in FIG. 1 using LEDs.
- a set of LEDs 901 may be arranged in a circular pattern around which the four cardinal directions may be displayed.
- the LED 901 a is shown as being illuminated and may correspond to the bearing that has been detected by the bearing sensor.
- the indicators 901 may, in fact, be integral to the other portions of the display, along with the cardinals, such as integral with the imagery of the grid 903 .
- LEDs may not be used. Instead, a circular set of virtual LEDs and virtual cardinals may be made to appear as part of a larger LCD display using standard graphics technology.
- FIG. 10 illustrates a portion of a still further alternate embodiment of the display in FIG. 1 using a numerical representation of bearing.
- a numerical representation 1001 of bearing may be displayed along with the image grid 1003 .
- the numerical representation 1001 may be presented in a frame 1005 .
- the portion of the display that generates the numerical representation 1001 and/or the frame 1005 may be integral to the portion that generates the grid 1003 (e.g., using a single LCD with standard graphics technology) or may be entirely separate therefrom (e.g., using LED bar segments to make up the numerals and frame).
- FIG. 11 illustrates an alternate embodiment of a head-mounted navigation system worn by a firefighter.
- the head-mounted navigation system may include a display 1101 , a housing 1103 , and a hand-held image sensor 1105 .
- the display 1101 , the housing 1103 , and/or the image sensor 1105 may be the same as, similar to, or different from the corresponding display 117 , the image sensor 105 , and the housing 107 discussed above in connection with FIG. 1 and many of the other figures.
- One difference, for example, may be that the image sensor 1105 may not be attached to a helmet 1107 . Instead, it may be configured to be held in a hand 1109 of a firefighter 1111 .
- the configuration of the image sensor 1105 may vary.
- the image sensor 1105 may be configured to look more like a flashlight. It may also or instead be configured to be held or attached at a different location, such as in a front pocket of the firefighter 1111 .
- sensory devices other than a display may be used instead or in addition.
- one or more sound transducers may be used to communicate information about objects forward of the user and/or information about the user's bearing. Variations in the frequency of tones, the spacing of tone pulses, and/or the intensity of tones may be used as a means of communicating one or more types of this information.
- the sound transducer or transducers may in addition or instead be used to deliver verbal communications in a language understood by the user, again to communicate to the user information about his bearing and/or the objects forward of him.
- Tactile devices could in a still different embodiment be used in addition or instead, again to communicate information to the user about his or her bearing and/or the objects forward of him or her.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Astronomy & Astrophysics (AREA)
- Navigation (AREA)
- Alarm Systems (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Description
- This application is based upon and claims priority to U.S. Provisional Application Ser. No. 60/786,909, entitled “Smoke-Penetrating Imaging Helmet,” filed Mar. 29, 2006 (attorney docket no. 75587-014). The entire content of this provisional application is incorporated herein by reference.
- 1. Field
- Navigation systems and, more particularly, navigation systems that assist individuals in navigating through environments having poor visibility.
- 2. Description of Related Art
- There are numerous situations in which an individual needs to navigate through environments that have poor visibility. These include environments that contain smoke, dust, fog, snow, sand, rain, flames, and/or are poorly lit.
- Firefighters are an example. They often need help walking through smoke or fire-filled rooms for self rescue, such as when trying to locate exits, obstacles and/or other dangers. They also often need help locating persons needing to be rescued.
- Military personnel are another example. They may need assistance running or walking on a smoke-filled battlefield or traveling through a smoke-filled room filled to rescue a hostage or to capture or incapacitate an enemy.
- Police are a still further example. They may similarly need assistance traveling through a smoke-filed filled room to rescue a hostage or to capture or incapacitate a criminal.
- It may be impractical for these individuals to carry heavy or bulky equipment to assist in their effort. It may also be costly to purchase expensive navigation equipment for a large number of them.
- A head-mounted navigation system may include an image sensor configured to sense one or more objects forward of a person and to generate image information representative of the one or more objects. A bearing sensor may be included and configured to detect bearing and to generate bearing information representative of the bearing. Securing apparatus may be included and configured to secure the bearing sensor to the person. A processing system may be included and configured to receive the image information and/or the bearing information and to generate display information representative of the one or more objects and/or the bearing. A display may be included and configured to receive the display information and to display visual information representative of the one or more objects and/or the bearing. Head gear may be included and configured to mount on the head of the person and to position the display along a sight path of the person.
- The image sensor may include a radar sensor. The head gear may include a helmet, and the radar sensor may be attached to the helmet and include a beaming antenna and an antenna sweeping system configured to cause the beaming antenna to sweep horizontally. The beaming antenna may include a horn and the antenna sweeping system may include a motor mechanically linked to the horn. The beaming antenna may output a frequency-modulated continuous-wave signal. The frequency-modulated continuous-wave signal may have a wavelength of less than one millimeter.
- The image sensor may be configured to generate image information that is representative of the range and reflectivity of each of the one or more objects.
- The bearing sensor may include a magnetic field sensor.
- The securing apparatus may be configured to secure the bearing sensor to the torso of the person, such as to the back of the person. The securing apparatus may include a clothing pocket.
- The processing system may be configured to generate display information that is representative of a three-dimensional image of the one or more objects.
- The processing system may be configured to generate bearing information that is representative of an image of a compass pointing in the direction of the bearing.
- The processing system may be configured to generate bearing information that includes a numerical representation of the bearing.
- The processing system may be configured to generate bearing information that is representative of the current bearing of the person relative to an earlier bearing of the person.
- The display include may include an LCD.
- The display may include LEDs.
- The head gear may include a face mask.
- The head gear may be configured to position all portions of the display above the horizontal line of sight of the person.
- These, as well as other components, steps, features, objects, benefits, and advantages, will now become clear from a review of the following detailed description of illustrative embodiments, the accompanying drawings, and the claims.
-
FIG. 1 illustrates a head-mounted navigation system worn by a firefighter. - FIGS. 2(a) and (b) illustrate details of the helmet shown in
FIG. 1 . - FIGS. 3(a) and (b) illustrate details of a radar sensor that may be used for the image sensor shown in FIG.1
-
FIG. 4 is a block diagram of the radar sensor shown in FIGS. 3(a) and (b). -
FIG. 5 is a block diagram of the head-mounted navigation system shown inFIG. 1 . - FIG.6 is a block diagram of a power source for the head-mounted navigation system shown in
FIG. 1 . -
FIG. 7 illustrates images that may be shown on the display inFIG. 1 . -
FIG. 8 illustrates a firefighter walking through a smoke-filled room wearing a head-mounted navigation system and a display he sees. -
FIG. 9 illustrates a potion of an alternate embodiment of the display inFIG. 1 using LED's. -
FIG. 10 illustrates a potion of a still further alternate embodiment of the display inFIG. 1 using a numerical representation of bearing. -
FIG. 11 illustrates an alternate embodiment of a head-mounted navigation system worn by a firefighter. -
FIG. 1 illustrates a head-mounted navigation system worn by a firefighter. As shown inFIG. 1 , afirefighter 101 may be wearing ahelmet 103 having animage sensor 105. - The
image sensor 105 may function to sense one or more objects forward of the firefighter. It may generate information representative of the one or more objects, such as information concerning the range of each object from the firefighter and the degree to which the object reflects a signal that may be generated by theimage sensor 105 and directed to the object. - Any type of image sensor may be used for the
image sensor 105. It may be a radar sensor, an ultrasound sensor, an infrared sensor, another type of sensor, and/or any combination of these types of sensors. - The
image sensor 105 may be attached to headgear worn by the firefighter, such as to thehelmet 103. It may be attached to the top of the helmet, such as shown inFIG. 1 . It may in addition or instead be placed in front of the helmet, to the side of the helmet, to a different portion of the headgear, to another area on the firefighter, and/or to a location that is external to the firefighter. - A
housing 107 may contain a bearing sensor (not visible inFIG. 1 ) that may be configured to detect the bearing of thefirefighter 101. The bearing sensor may also be configured to generate bearing information indicative of the bearing of the firefighter. - Any type of bearing-detecting device may be used for the bearing sensor. For example, the bearing sensor may include a magnetic field sensor that detects the orientation of the bearing sensor with respect to the earth's magnetic field. The magnetic sensor may be configured to minimize interference by stray magnetic fields, to balance for differences between magnetic north and true north, and/or to compensate for temperature effects. A chip bearing sold as part number KMZ51 may be obtained from Phillips to serve as the bearing sensor.
- Other types of bearing sensors may be used in addition or instead, including a gyroscope and/or a GPS system. The bearing sensor may consist of a single sensor or may include several sensors.
- Securing apparatus may be included to secure the bearing sensor to the firefighter. The securing apparatus may secure the bearing sensor to the torso of the firefighter, such as on the back of the firefighter. It may in addition or instead secure the bearing sensor to other areas of the firefighter, such as to a shoulder or thigh. The securing apparatus may in addition or instead secure the bearing sensor to the head of the firefighter. When secured to the head, however, the bearing that is sensed may be the direction in which the firefighter is looking, not necessarily the direction in which the firefighter is traveling.
- Any type of securing apparatus may be used to secure the bearing sensor to the firefighter. The securing apparatus may be or may include a
clothing pocket 109 attached to the rear portion of ajacket 111 that may be worn by thefirefighter 101. Thepocket 109 may be positioned so as to cause thehousing 107 not to come in contact with anair tank 113 that may be worn by the firefighter or the firefighter'sarm 115 when moved. Other types of securing apparatus may be used in addition or instead to secure the bearing sensor to the firefighter, such as a strap, clip, hook, and/or Velcro. - The head-mounted navigation system may include a
display 117. The display may be of any type, such as an LCD. It may include or instead consist of one or more LEDs. Any other type of display may be used in addition or instead. Thedisplay 117 may have a single screen or multiple screens or no screen. - The headgear worn by the firefighter may include a
face mask 119 to which thedisplay 117 may be attached. Thedisplay 117 may be attached to theface mask 119 in such a position as to cause the display to lie along a sight path 121of thefirefighter 101. Thedisplay 117 may be positioned with respect to theface mask 119 such that all portions of the display lie above the horizontal line ofsight 123 of thefirefighter 101. This configuration is commonly referred to as a heads-up display. - The
display 117 may be configured and/or positioned so as to be viewable by one or both of the firefighter's eyes. - The
display 117 may be attached to portions of the headgear other than theface mask 119 to position it along a sight path of thefirefighter 101. For example, thedisplay 117 may be attached to thehelmet 103. Thedisplay 117 may be attached to a cap, head strap, eyewear, or other type of headgear that thefirefighter 101 might wear instead or in addition. - Flexible
electric cabling housing 107, theimage sensor 105, and thedisplay 117. Coiled cables may be used for this purpose, as shown inFIG. 1 . The cabling may be constructed of material that withstands harsh environments, such as high temperature or caustic environments. - Unlike what is illustrated in
FIG. 1 , thecabling image sensor 105 and thedisplay 117 to be detached from each other and from thehousing 107. This may make it easier for thefirefighter 101 to put on his protective gear. - In lieu of the
cabling - FIGS. 2(a) and (b) illustrate details of the
helmet 103 shown inFIG. 1 .FIG. 2 (a) illustrates a side view, whileFIG. 2 (b) illustrates a front view. For example, they illustrateattachment mechanisms image sensor 105 to thehelmet 103. They also illustrate aradome 205 that theimage sensor 105 may have. - FIGS. 3(a) and (b) illustrate details of a radar sensor that may be used for the image sensor shown in
FIG. 1 .FIG. 3 (a) illustrates a top view, whileFIG. 3 (b) illustrates a side view. As shown inFIG. 3 , the radar sensor may include a beamingantenna 301, a printedcircuit board 303 containing electronic circuitry, asensor module 305, amotor 307, alinkage arm 309, apivot 311, and ahousing 313 that may include aradome 315. - The beaming
antenna 301 may be configured to radiate a narrow radar beam. It may be a horn, as illustrated in FIGS. 3(a) and (b), or it may be in any other type of radar antenna, such as a phase array antenna or a frequency scanned antenna. - The printed
circuit board 303 may be configured to hold appropriate circuitry configured to perform one or more of the functions that are described herein and/or other functions. - The
sensor module 305 may be configured to radiate radar signals and to receive and detect reflected radar signals, as will be described more fully below. Thesensor module 305 may be connected to thecircuit board 303 with aflexible cable 306. The flexible cable may be coiled, as shown in FIGS. 3(a) and (b), or may otherwise be configured to allow the end of the beamingantenna 301 to be moved with respect to thecircuit board 303, without jeopardizing the electrical connection between the two or the movement of the beamingantenna 301. - The
motor 307 may be configured along with the linkingarm 309 and thepivot 311 so as to cause the beamingantenna 301 to sweep back and forth as shown inFIG. 3 (a) in response to appropriate control signals. Themotor 307 may be any type of motor, such as a stepping motor. Another type of electromechanical device may be used in addition or instead to effectuate scanning of the beamingantenna 301. The antenna may also or instead be scanned electronically using techniques such as phasing, particularly when the beamingantenna 301 is a phased array radar antenna. - The
housing 313 may be sized so as to allow the beamingantenna 301 to scan freely. Theradome 315 may similarly be configured to allow the beamingantenna 301 to freely scan. Theradome 315 may be made of material that allows the radar signal to travel through it without significant degradation or reflection, while at the same time protecting the internal components of theimage sensor 105 from external contaminants. - In lieu of the
motor 307, the beamingantenna 301 may be scanned using frequency scanning or phasing. -
FIG. 4 is a block diagram of the radar sensor shown in FIGS. 3(a) and 4. As shown inFIG. 4 , a voltage controlled oscillator (VCO) 401 may be used to generate a frequency modulated continuous wave radar signal. The signal may have a wavelength that is less than 1 mm. A frequency of between 30 and 110 GHz may be used, such as a frequency of approximately 76 GHz. The voltage controlledoscillator 401 may be configured to frequency modulate this carrier signal across a bandwidth of between 400 MHz and 1000 MHz, such as across a bandwidth of approximately 500 MHz. - A
sweep generator 403 may be used to control the frequency modulation of the radar signal by the voltage controlledoscillator 401. Thesweep generator 403 may be configured to generate a saw-tooth or triangular ramp signal that takes between 0.1 ms and 2 ms to ramp fully, e.g., approximately 1 ms. The magnitude of the ramp signal that is generated by thesweep generator 403 may be such as to cause the voltage controlledoscillator 401 to sweep through its full bandwidth. - A
power amplifier 405 may be used to amplify the signal from the voltage controlledoscillator 401. The power output of thepower amplifier 405 may be between 0.1 mW and 10 mW. - A
circulator 407 may be used to direct the frequency modulated continuous wave signal from thepower amplifier 405 to the beamingantenna 301. - The objects within the beam from the beaming
antenna 301 may each cause a reflection of the beam back to beamingantenna 301. The delay in the arrival of each reflection at the beamingantenna 301 may be indicative of the distance (range) of each object from the beamingantenna 301, while the amplitude of each reflection may be indicative of the radar reflectivity of each object and, in many cases, its size. - These reflected signals may be received by the beaming
antenna 301 and redirected by thecirculator 407 to amixer 409. Acoupler 411 may simultaneously deliver a sample of the output from thepower amplifier 405 to themixer 409. - The
mixer 409 may be configured to multiply the output from thecirculator 407 of the reflected signals by the transmitted signal from thecoupler 411. This may create a series of tones, namely beat frequencies. The amplitude of each tone may be proportional to the radar cross section (RCS) of an object in front of the beamingantenna 301. The frequency of that tone may be proportional to the distance between the object and the beamingantenna 301. Abase band filter 413 may be used to filter limit the noise and enhance these beat frequencies (also known as the base band radar signal) that is outputted from themixer 409. - A stepping
motor 417 may be used to cause the beamingantenna 301 to sweep through an arc, as explained above in more detail in connection with FIGS. 3(a) and (b). Acontroller 415 may be used to control the steppingmotor 407, as well as to control thesweep generator 403. Thecontroller 415 may be configured to cause the stepping motor to quickly move the beamingantenna 301 to its maximum offset position after receiving a command from aninput 417 or, in an alternate embodiment, upon its own. The maximum offset may be between 15 and 35° from the antenna's straight-ahead position, such as approximately 25°. Once the beamingantenna 301 reaches this maximum offset position, thecontroller 415 may then cause the steppingmotor 307 to sweep the beamingantenna 301 horizontally from its maximum offset position through its straight-ahead position and to approximately the same offset position in the opposite horizontal direction. This sweeping pattern may then repeat continuously. - The rate at which the beaming
antenna 301 horizontally sweeps between its maximum offset positions may vary. In one embodiment, thecontroller 415 may be configured to cause the steppingmotor 307 to sweep the beamingantenna 301 through its entire arc in approximately 1 to 2 seconds. - The
controller 415 may cause the steppingmotor 307 to sweep the beamingantenna 301 in steps of between 1 and 5°. After each step during a sweep, thecontroller 415 may be configured to send a triggering signal to thesweep generator 403 so as to cause thesweep generator 403 to initiate its ramp signal. Conversely, thesweep generator 403 may initiate its ramp on its own and send a signal to thecontroller 415 to begin a sweep. Thecontroller 415 may in any event wait before directing the steppingmotor 307 to step to the next position until the ramp that is generated by thesweep generator 403 reaches its maximum value. This may be done in an open or closed loop manner. - The
controller 415 may output a synchronization signal over itscommunication line 417 indicating the commanded position of the beamingantenna 301 and/or the initiation signals to thesweep generator 403. This may assist a processing system (discussed below) in synchronizing the output from theband pass filter 413 with the angular position of the beamingantenna 301. -
FIG. 5 is a block diagram of the head-mounted navigation system shown inFIG. 1 . As shown inFIG. 5 , the system may include animage sensor 105, a bearing sensor 501 (contained within the housing 107), adisplay 117, and aprocessing system 503. Theprocessing system 503 may include an analog-to-digital (A/D)converter 505 and a digital signal processing (DSP)subsystem 507. - The
processing system 503 may be configured to receive the image information from theimage sensor 105, such as the base band output from thebase band filter 413 in the radar sensor shown inFIG. 4 . Theprocessing system 503 may utilize the analog-to-digital converter 505 to convert the base band output from theimage sensor 105 into a digital signal. Theprocessing system 503 may cause this digital signal to be processed by the digitalsignal processing subsystem 507 for the purpose of generating display information that is representative of the one or more objects that are within the field of view of the beamingantenna 301 as it is swept across its horizontal arc. This display information may be representative of a three-dimensional image of each of the one or more objects. This display information may be created by theprocessing system 503 and its associated digitalsignal processing subsystem 507 using well-established signal processing techniques. - The
processing system 503 may classify the objects that are detected within the scanning pathway of the beamingantenna 301 into range bins, such as into 264 or 512 range bins. During the scanning process, theprocessing system 503 may perform data reduction by statistically classifying the objects and storing them temporarily in a memory (not shown) in accordance with well-known data reduction techniques. At the end of a scan, the data may be retrieved, scaled appropriately, and presented as display information for viewing to thedisplay 117. This entire process may repeat for the succeeding scans. - The
processing system 503 may be configured to communicate to theimage sensor 105 and, in the embodiment shown inFIG. 4 , to thecontroller 415 of the image sensor, as to when to begin each sweep. Conversely, theimage sensor 105 and, in the embodiment shown inFIG. 4 , thecontroller 415, may instead be configured to initiate each sweep on its own and to deliver synchronizing information about that sweep to theprocessing system 503. Either way, theprocessing system 503 may be configured to synchronize the received image information from theimage sensor 105, which in the embodiment shown inFIG. 4 is the base band output from thebase band filter 413, with the position of the beamingantenna 301 as it sweeps horizontally. This may enable theprocessing system 503 to generate display information that is representative of the cross-range position of each of the one or more objects that are detected by theimage sensor 105 for display. - The
processing system 503, in conjunction with the digitalsignal processing subsystem 507, may be configured to distinguish between stationary and moving objects by extrapolating appropriate display information from Doppler frequency shifts in the image information from theimage sensor 105, again using well-established techniques. Theprocessing system 503, in conjunction with the digitalsignal processing subsystem 507, may be configured in addition or instead to generate display information indicative of the temperature of detected objects. This may be accomplished using well-known techniques, such as by extrapolating the temperature information from differences in the noise level of the signal from theimage sensor 105. - The
processing system 503 may be configured to generate display information that includes a grid superimposed upon the image information that it generates. The grid information may include coordinate axes and numeric or other appropriate labeling of these axes. An example of such a grid is illustrated inFIG. 7 and discussed below. - The
processing system 503 may be configured to also generate display information that is representative of the bearing that is detected by the bearingsensor 501. The display information that is representative of the bearing may take any form. For example, it may take the form of an image of a compass pointing in the direction of the bearing, as illustrated inFIG. 7 and discussed below. - The display information that the
processing system 503 generates that is representative of the bearing may be representative of either absolute or relative bearing. When it is representative of absolute bearing, for example, the display information may indicate bearing relative to the four cardinal directions (North, South, East, and West). When the display information is representative of a relative bearing, on the other hand, the display information may indicate bearing relative to a prior bearing. - For example, a firefighter entering a burning room may be more concerned about his bearing relative to a known escape direction, rather than his absolute bearing. Before he enters the room, he may face in the direction of the known escape route and, through actuation of an appropriate user control, cause this bearing to be recorded by the
processing system 503. Thereafter, all bearings that are communicated to him through thedisplay 117 may be expressed in a form that is relative to this escape route. In this embodiment, for example, the display information may be representative of an arrow indicating the direction the firefighter must travel to get to this escape route. - When displaying a relative bearing, it may be useful to include a position-monitoring sensor, such as a GPS system, in addition to the bearing sensor. Information from both sensors may then be used by the
processing system 503 to more precisely direct the firefighter to preprogrammed locations of interest, such as to an escape route. - A position-monitoring sensor may also be useful in embodiments used to locate something (e.g., a person or article) at a location whose coordinates are precisely known. These coordinates may be preprogrammed in the system. Information from the bearing sensor and the position sensor may then be used in conjunction with this preprogrammed information to again cause the display of an arrow on the
display 117 indicating the direction the person must travel to arrive at this predetermined location. - The
display 117 may be configured to receive the display information from theprocessing system 503 and to display visual information representative of the display information. In the embodiment illustrated inFIG. 5 , this may consist of visual information representative of one or more objects within the sweeping field of the beamingantenna 301, as well as the bearing of thebearing sensor 501. - The
processing system 503 may include hardware, firmware, and/or software, configured in accordance with well-known techniques to implement one or more of the functions that have been described herein. Theprocessing 503 may be dedicated to these functions and/or may be used to perform other functions. - The
processing system 503 may be in any location or distributed across multiple locations. In one embodiment, theprocessing system 503 may be housed along with the bearingsensor 501 in thehousing 107. Some or all portions of theprocessing system 503 may instead be housed in thehousing 313 that houses components of theimage sensor 105. - The
processing system 503 may be configured to communicate with theimage sensor 105 and/or thebearing sensor 501 using any type of communication system or protocol. In one embodiment, an RS-232 port may be used. - Although the head-mounted navigation system has thus-far been described as including the
image sensor 105, an alternate embodiment may not include any type of image sensor. In this embodiment, theprocessing system 503 may not have the analog-to-digital converter 505 or the digitalsignal processing subsystem 507. In this embodiment, theprocessing system 503 may be configured to generate display information that represents the bearing information, but not objects forward of the user. -
FIG. 6 is a block diagram of a power source for the head-mounted navigation system shown inFIG. 1 . As shown inFIG. 6 , the power source may include abattery 601 and acharger 603. - The
battery 601 may consist of more than one battery. Thebattery 601 may be configured to power all of the electrical components of the head-mounted navigation system, such as theimage sensor 105, the bearingsensor 501, theprocessing system 503, and/or thedisplay 117. - The
battery 601 may be of a type that can be recharged. In this instance, thebattery 601 may be configured so as to be detachably-connected to thecharger 603. When not in use, thecharger 603 may be attached to thebattery 601 for the purpose of charging thebattery 601. - The
battery 601 may be located anywhere. In one embodiment, thebattery 601 may be located in thehousing 107. In an alternate embodiment, thebattery 601 may be located in theimage sensor 105. Theimage sensor 105, the bearingsensor 501, theprocessing system 503, and/or thedisplay 117 may each in addition or instead be powered by their own separate battery, which may be co-located with the device or elsewhere. -
FIG. 7 illustrates images that may be shown on the display inFIG. 1 . As shown inFIG. 7 , the images may include an image of acompass 701 pointing in the direction of the bearing. Instead of having the needle of the compass change orientation to match the bearing, the image of thecompass 701 may instead always have the needle point forward, while rotating the relative position of the four cardinal directions to reflect the new bearing. The visual information that is representative of the bearing that is displayed may be dictated by the display information generated by theprocessing system 503. - The
display 701 may also include a three-dimensional wire-frame image of objects that are forward of the user, such asobjects processing system 503. Thedisplay 701 may include a superimposed three-dimensional grid pattern 715 as well as axes and numerical scale markings indicating the approximate scale of the imagery. This grid, axes and scale information may be part of the display information generated by theprocessing system 503. - The head-mounted navigation systems that have now been described may be used in a broad variety of applications.
- For example, they may be used in environments in which visibility is poor. The poor visibility may be caused by smoke, dust, fog, snow, sand, rain, flames, darkness, and/or by a combination of one or more of these factors.
- Persons in many different types of endeavors may use one or more embodiments of these head-mounted navigation systems to navigate through one or more of these types of problematic environments. For example, a firefighter may use one of these systems in connection with navigating through a room that is filled with flames and/or smoke. The firefighter may use one of these systems to help locate an exit, a person needing to be rescued, and/or to avoid obstacles and/or other dangers.
-
FIG. 8 illustrates a firefighter walking through a smoke-filled room wearing a head-mounted navigation system and a display he sees. Specifically,FIG. 8 illustrates afirefighter 801 wearing a head-mounted navigation system in a smoke-filledroom 803. The room includes several obstructions, such asobstructions exit 813. -
FIG. 8 also illustrates anenlarged view 814 of what thefirefighter 801 may see on the display of his head-mounted navigation system, such as on thedisplay 117 shown inFIG. 1 . The image may include animage 815 i of a compass pointing in the direction that the firefighter is moving, as well as a three-dimensional wire frame image of the objects 805 (marked 805i), 807 (marked 807i) and 809 (marked 809i), and the exit 813 (marked 813i). Thefirefighter 801 may use the information that he sees on thedisplay 814 to help navigate safely to theexit 813. - Police and military personnel may similarly use one of these head-mounted navigation systems to help locate a hostage in a room filled with smoke from a smoke bomb. The police may in addition or instead seek to use one of these systems to capture or incapacitate a criminal in such a room, while a soldier may similarly use such a system to capture or attack an enemy in such a room. A soldier may also use such a system to help navigate on a smoke-filled battlefield. These are but examples of applications for the head-mounted navigation systems that have been described.
-
FIG. 9 illustrates a portion of an alternate embodiment of the display inFIG. 1 using LEDs. As shown inFIG. 9 , a set ofLEDs 901 may be arranged in a circular pattern around which the four cardinal directions may be displayed. TheLED 901 a is shown as being illuminated and may correspond to the bearing that has been detected by the bearing sensor. - Although thus-far described as being LEDs, the
indicators 901 may, in fact, be integral to the other portions of the display, along with the cardinals, such as integral with the imagery of thegrid 903. In this alternate embodiment, LEDs may not be used. Instead, a circular set of virtual LEDs and virtual cardinals may be made to appear as part of a larger LCD display using standard graphics technology. -
FIG. 10 illustrates a portion of a still further alternate embodiment of the display inFIG. 1 using a numerical representation of bearing. As shown inFIG. 1 , anumerical representation 1001 of bearing may be displayed along with theimage grid 1003. Thenumerical representation 1001 may be presented in aframe 1005. The portion of the display that generates thenumerical representation 1001 and/or theframe 1005 may be integral to the portion that generates the grid 1003 (e.g., using a single LCD with standard graphics technology) or may be entirely separate therefrom (e.g., using LED bar segments to make up the numerals and frame). -
FIG. 11 illustrates an alternate embodiment of a head-mounted navigation system worn by a firefighter. As shown inFIG. 11 , the head-mounted navigation system may include adisplay 1101, ahousing 1103, and a hand-heldimage sensor 1105. Thedisplay 1101, thehousing 1103, and/or theimage sensor 1105 may be the same as, similar to, or different from thecorresponding display 117, theimage sensor 105, and thehousing 107 discussed above in connection withFIG. 1 and many of the other figures. One difference, for example, may be that theimage sensor 1105 may not be attached to ahelmet 1107. Instead, it may be configured to be held in ahand 1109 of afirefighter 1111. - The configuration of the
image sensor 1105 may vary. For example, theimage sensor 1105 may be configured to look more like a flashlight. It may also or instead be configured to be held or attached at a different location, such as in a front pocket of thefirefighter 1111. - The components, steps, features, objects, benefits and advantages that have been discussed are merely illustrative. None of them, nor the discussions relating to them, are intended to limit the scope of protection in any way. Numerous other embodiments are also contemplated, including embodiments that have fewer, additional, and/or different components, steps, features, objects, benefits and advantages. The components and steps may also be arranged and ordered differently.
- For example, sensory devices other than a display may be used instead or in addition. For example, one or more sound transducers may be used to communicate information about objects forward of the user and/or information about the user's bearing. Variations in the frequency of tones, the spacing of tone pulses, and/or the intensity of tones may be used as a means of communicating one or more types of this information. The sound transducer or transducers may in addition or instead be used to deliver verbal communications in a language understood by the user, again to communicate to the user information about his bearing and/or the objects forward of him.
- Tactile devices could in a still different embodiment be used in addition or instead, again to communicate information to the user about his or her bearing and/or the objects forward of him or her.
- In short, the scope of protection is limited solely by the claims that now follow. That scope is intended to be as broad as is reasonably consistent with the language that is used in the claims and to encompass all structural and functional equivalents. Nothing that has been stated or illustrated is intended to cause a dedication of any component, step, feature, object, benefit, advantage, or equivalent to the public, regardless of whether it is recited in the claims.
- The phrase “means for” when used in a claim embraces the corresponding structure and materials that have been described and their equivalents. Similarly, the phrase “step for” when used in a claim embraces the corresponding acts that have been described and their equivalents. The absence of these phrases means that the claim is not limited to any corresponding structures, materials, or acts.
Claims (32)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/424,506 US7735230B2 (en) | 2006-03-29 | 2006-06-15 | Head-mounted navigation system |
PCT/US2007/007545 WO2008057135A2 (en) | 2006-03-29 | 2007-03-29 | Head-mounted navigation system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US78690906P | 2006-03-29 | 2006-03-29 | |
US11/424,506 US7735230B2 (en) | 2006-03-29 | 2006-06-15 | Head-mounted navigation system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070227020A1 true US20070227020A1 (en) | 2007-10-04 |
US7735230B2 US7735230B2 (en) | 2010-06-15 |
Family
ID=38556783
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/424,506 Expired - Fee Related US7735230B2 (en) | 2006-03-29 | 2006-06-15 | Head-mounted navigation system |
Country Status (2)
Country | Link |
---|---|
US (1) | US7735230B2 (en) |
WO (1) | WO2008057135A2 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2141455A1 (en) | 2008-07-03 | 2010-01-06 | Yamaha Corporation | Orientation-following display apparatus, orientation-following display method, and orientation-following display program |
US20100219956A1 (en) * | 2007-06-21 | 2010-09-02 | Eugene Greco | Heat Sensor Device and System |
US8311510B2 (en) | 2010-05-26 | 2012-11-13 | Gregory Cradick | System for automatically providing firefighters with the floor plans for a burning building |
WO2015105236A1 (en) * | 2014-01-13 | 2015-07-16 | Lg Electronics Inc. | A head mounted display and method of controlling thereof |
KR101656873B1 (en) * | 2015-05-29 | 2016-09-12 | 한국교통대학교산학협력단 | Helmet for fire protection using recognizing three-dimension object |
US10374729B2 (en) * | 2017-02-10 | 2019-08-06 | FreeWave Technologies, Inc. | Antenna alignment tool and method |
US20190360807A1 (en) * | 2018-05-23 | 2019-11-28 | Ryan George Chapman | Compass attachable to hat |
CN111475130A (en) * | 2020-03-27 | 2020-07-31 | 深圳光启超材料技术有限公司 | Display method of track information, head-mounted device, storage medium and electronic device |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8354924B1 (en) * | 2010-01-18 | 2013-01-15 | Spencer Goodwin | Waterproof audio receiving device with object detection system |
TW201222001A (en) * | 2010-11-26 | 2012-06-01 | Welmore Co Ltd | Optical digital display device |
US20150228119A1 (en) | 2014-02-11 | 2015-08-13 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US9753288B2 (en) | 2014-01-21 | 2017-09-05 | Osterhout Group, Inc. | See-through computer display systems |
US9092898B1 (en) * | 2014-07-03 | 2015-07-28 | Federico Fraccaroli | Method, system and apparatus for the augmentation of radio emissions |
US11137490B2 (en) * | 2014-09-16 | 2021-10-05 | Teknologian Tutkimuskeskus Vtt | Navigational aid with adaptive radar |
CA2969871A1 (en) | 2014-12-05 | 2016-06-09 | Jeffrey L. DYKES | Directional indicator for protective face masks |
JP6518069B2 (en) * | 2015-01-09 | 2019-05-22 | キヤノン株式会社 | Display device, imaging system, display device control method, program, and recording medium |
US10878775B2 (en) | 2015-02-17 | 2020-12-29 | Mentor Acquisition One, Llc | See-through computer display systems |
US10591728B2 (en) | 2016-03-02 | 2020-03-17 | Mentor Acquisition One, Llc | Optical systems for head-worn computers |
US10667981B2 (en) | 2016-02-29 | 2020-06-02 | Mentor Acquisition One, Llc | Reading assistance system for visually impaired |
WO2019126236A1 (en) * | 2017-12-19 | 2019-06-27 | Datalogic IP Tech, S.r.l. | User-wearable systems and methods to collect data and provide information |
Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2803068A (en) * | 1956-03-08 | 1957-08-20 | Russell I Mason | Swimmer's underwater compass |
US3475957A (en) * | 1966-02-14 | 1969-11-04 | Zaklady Mekh Precyzyjnei Przed | Submarine navigation device for a self-dependent diver |
US3798527A (en) * | 1969-02-21 | 1974-03-19 | Accumulateurs Fixes | Electrochemical d.c. current transformer system |
US3888500A (en) * | 1971-11-09 | 1975-06-10 | Armand J Gauthier | Position indicating device for attachment to a ski boot |
US3978591A (en) * | 1973-11-06 | 1976-09-07 | Erkki Kalle Jaaskelainen | Compass, in particular for ski and competition track finding |
US4006397A (en) * | 1972-11-01 | 1977-02-01 | General Electric Company | Controlled battery charger system |
US4283798A (en) * | 1977-04-22 | 1981-08-18 | Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence | Attitude indicator for divers |
US4722601A (en) * | 1983-07-23 | 1988-02-02 | Ferranti Plc | Apparatus for determining the direction of a line of sight |
US4843300A (en) * | 1988-01-19 | 1989-06-27 | Dual-Lite Manufacturing, Inc. | Improved power supply for intermittently energizing an external device requiring high power during intermittent periods of time from an input power source with relatively lower instantaneous power capability |
US5106179A (en) * | 1990-05-17 | 1992-04-21 | Sony Corporation | Eyesight auxiliary liquid crystal device |
US5162828A (en) * | 1986-09-25 | 1992-11-10 | Furness Thomas A | Display system for a head mounted viewing transparency |
US5254929A (en) * | 1991-04-09 | 1993-10-19 | Yang Tai Her | Intermediate storage battery charging system |
US5313712A (en) * | 1992-06-29 | 1994-05-24 | Dacor Corporation | Scuba diving instrument console having swivelling compass assembly |
US5504416A (en) * | 1993-12-15 | 1996-04-02 | Unitrode Corporation | Battery charger circuit including battery temperature control |
US5790085A (en) * | 1994-10-19 | 1998-08-04 | Raytheon Company | Portable interactive heads-up weapons terminal |
US5818381A (en) * | 1994-06-24 | 1998-10-06 | Roscoe C. Williams Limited | Electronic viewing aid |
US5982286A (en) * | 1998-05-15 | 1999-11-09 | Vanmoor; Arthur | Object detecting apparatus |
US6066075A (en) * | 1995-07-26 | 2000-05-23 | Poulton; Craig K. | Direct feedback controller for user interaction |
US6144187A (en) * | 1998-11-12 | 2000-11-07 | Fairchild Semiconductor Corporation | Power measurement for adaptive battery charger |
US6234277B1 (en) * | 1999-05-07 | 2001-05-22 | Draka Elevator Products, Inc. | Cable sway reduction device |
US6329771B1 (en) * | 1996-10-11 | 2001-12-11 | Wheelchair Carrier, Inc. | Lightweight motorized wheelchair |
US6351110B1 (en) * | 1999-04-29 | 2002-02-26 | Stmicroelectronics S.R.L. | Battery charger with current regulating circuit |
US6417797B1 (en) * | 1998-07-14 | 2002-07-09 | Cirrus Logic, Inc. | System for A multi-purpose portable imaging device and methods for using same |
US6421031B1 (en) * | 1993-10-22 | 2002-07-16 | Peter A. Ronzani | Camera display system |
US6803746B2 (en) * | 2001-11-02 | 2004-10-12 | Aker Wade Power Technologies, Llc | Fast charger for high capacity batteries |
US6917370B2 (en) * | 2002-05-13 | 2005-07-12 | Charles Benton | Interacting augmented reality and virtual reality |
US6930608B2 (en) * | 2002-05-14 | 2005-08-16 | Motorola, Inc | Apparel having multiple alternative sensors and corresponding method |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS51140775A (en) | 1975-05-30 | 1976-12-03 | Akio Shimozaka | Detecting system of obstables in smoke |
IL122416A0 (en) | 1997-12-02 | 1998-06-15 | Electric Fuel Ltd | Battery |
US5982285A (en) | 1998-05-14 | 1999-11-09 | Bueche; Kenneth M. | Compliance monitoring system |
US6326771B1 (en) | 1999-03-08 | 2001-12-04 | 02 Micro International Limited | Buffer battery power supply system |
TWI237916B (en) | 2002-05-13 | 2005-08-11 | Sun Bridge Corp | Cordless device system |
US7471062B2 (en) | 2002-06-12 | 2008-12-30 | Koninklijke Philips Electronics N.V. | Wireless battery charging |
JP4560598B2 (en) | 2003-02-12 | 2010-10-13 | 山本光学株式会社 | Anomaly exploration support equipment |
JP2005324566A (en) | 2004-05-12 | 2005-11-24 | Matsushita Electric Ind Co Ltd | Obstacle detecting device |
JP4367251B2 (en) | 2004-06-15 | 2009-11-18 | ソニー株式会社 | Power supply device and electronic device |
GB2416208A (en) | 2004-07-15 | 2006-01-18 | Alexander Russell Warren | Ultrasonic distance senor attachable to a fireman's breathing apparatus |
-
2006
- 2006-06-15 US US11/424,506 patent/US7735230B2/en not_active Expired - Fee Related
-
2007
- 2007-03-29 WO PCT/US2007/007545 patent/WO2008057135A2/en active Application Filing
Patent Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2803068A (en) * | 1956-03-08 | 1957-08-20 | Russell I Mason | Swimmer's underwater compass |
US3475957A (en) * | 1966-02-14 | 1969-11-04 | Zaklady Mekh Precyzyjnei Przed | Submarine navigation device for a self-dependent diver |
US3798527A (en) * | 1969-02-21 | 1974-03-19 | Accumulateurs Fixes | Electrochemical d.c. current transformer system |
US3888500A (en) * | 1971-11-09 | 1975-06-10 | Armand J Gauthier | Position indicating device for attachment to a ski boot |
US4006397A (en) * | 1972-11-01 | 1977-02-01 | General Electric Company | Controlled battery charger system |
US3978591A (en) * | 1973-11-06 | 1976-09-07 | Erkki Kalle Jaaskelainen | Compass, in particular for ski and competition track finding |
US4283798A (en) * | 1977-04-22 | 1981-08-18 | Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence | Attitude indicator for divers |
US4722601A (en) * | 1983-07-23 | 1988-02-02 | Ferranti Plc | Apparatus for determining the direction of a line of sight |
US5162828A (en) * | 1986-09-25 | 1992-11-10 | Furness Thomas A | Display system for a head mounted viewing transparency |
US4843300A (en) * | 1988-01-19 | 1989-06-27 | Dual-Lite Manufacturing, Inc. | Improved power supply for intermittently energizing an external device requiring high power during intermittent periods of time from an input power source with relatively lower instantaneous power capability |
US5106179A (en) * | 1990-05-17 | 1992-04-21 | Sony Corporation | Eyesight auxiliary liquid crystal device |
US5254929A (en) * | 1991-04-09 | 1993-10-19 | Yang Tai Her | Intermediate storage battery charging system |
US5313712A (en) * | 1992-06-29 | 1994-05-24 | Dacor Corporation | Scuba diving instrument console having swivelling compass assembly |
US6421031B1 (en) * | 1993-10-22 | 2002-07-16 | Peter A. Ronzani | Camera display system |
US5504416A (en) * | 1993-12-15 | 1996-04-02 | Unitrode Corporation | Battery charger circuit including battery temperature control |
US5818381A (en) * | 1994-06-24 | 1998-10-06 | Roscoe C. Williams Limited | Electronic viewing aid |
US5790085A (en) * | 1994-10-19 | 1998-08-04 | Raytheon Company | Portable interactive heads-up weapons terminal |
US6066075A (en) * | 1995-07-26 | 2000-05-23 | Poulton; Craig K. | Direct feedback controller for user interaction |
US6329771B1 (en) * | 1996-10-11 | 2001-12-11 | Wheelchair Carrier, Inc. | Lightweight motorized wheelchair |
US5982286A (en) * | 1998-05-15 | 1999-11-09 | Vanmoor; Arthur | Object detecting apparatus |
US6417797B1 (en) * | 1998-07-14 | 2002-07-09 | Cirrus Logic, Inc. | System for A multi-purpose portable imaging device and methods for using same |
US6144187A (en) * | 1998-11-12 | 2000-11-07 | Fairchild Semiconductor Corporation | Power measurement for adaptive battery charger |
US6351110B1 (en) * | 1999-04-29 | 2002-02-26 | Stmicroelectronics S.R.L. | Battery charger with current regulating circuit |
US6234277B1 (en) * | 1999-05-07 | 2001-05-22 | Draka Elevator Products, Inc. | Cable sway reduction device |
US6803746B2 (en) * | 2001-11-02 | 2004-10-12 | Aker Wade Power Technologies, Llc | Fast charger for high capacity batteries |
US6917370B2 (en) * | 2002-05-13 | 2005-07-12 | Charles Benton | Interacting augmented reality and virtual reality |
US6930608B2 (en) * | 2002-05-14 | 2005-08-16 | Motorola, Inc | Apparel having multiple alternative sensors and corresponding method |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100219956A1 (en) * | 2007-06-21 | 2010-09-02 | Eugene Greco | Heat Sensor Device and System |
EP2141455A1 (en) | 2008-07-03 | 2010-01-06 | Yamaha Corporation | Orientation-following display apparatus, orientation-following display method, and orientation-following display program |
US8311510B2 (en) | 2010-05-26 | 2012-11-13 | Gregory Cradick | System for automatically providing firefighters with the floor plans for a burning building |
WO2015105236A1 (en) * | 2014-01-13 | 2015-07-16 | Lg Electronics Inc. | A head mounted display and method of controlling thereof |
US9639986B2 (en) | 2014-01-13 | 2017-05-02 | Lg Electronics Inc. | Head mounted display and method of controlling thereof |
KR101656873B1 (en) * | 2015-05-29 | 2016-09-12 | 한국교통대학교산학협력단 | Helmet for fire protection using recognizing three-dimension object |
US10374729B2 (en) * | 2017-02-10 | 2019-08-06 | FreeWave Technologies, Inc. | Antenna alignment tool and method |
US20190360807A1 (en) * | 2018-05-23 | 2019-11-28 | Ryan George Chapman | Compass attachable to hat |
US10746547B2 (en) * | 2018-05-23 | 2020-08-18 | Ryan George Chapman | Compass attachable to hat |
CN111475130A (en) * | 2020-03-27 | 2020-07-31 | 深圳光启超材料技术有限公司 | Display method of track information, head-mounted device, storage medium and electronic device |
Also Published As
Publication number | Publication date |
---|---|
WO2008057135A3 (en) | 2008-10-09 |
US7735230B2 (en) | 2010-06-15 |
WO2008057135A2 (en) | 2008-05-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7735230B2 (en) | Head-mounted navigation system | |
US11947387B2 (en) | Headset computer that uses motion and voice commands to control information display and remote devices | |
FI87048B (en) | ACOUSTIC SOEKARE. | |
US6826117B2 (en) | Tracking, safety and navigation system for firefighters | |
US9867013B2 (en) | Method and system for determining object motion by capturing motion data via radio frequency phase and direction of arrival detection | |
JP5430882B2 (en) | Method and system for relative tracking | |
EP1528410B1 (en) | Method and apparatus for detecting a moving projectile | |
AU707286B2 (en) | Helmet mounted, laser detection system | |
US8995678B2 (en) | Tactile-based guidance system | |
DK2227676T3 (en) | APPARATUS AND METHOD OF LANDING A ROTOR AIR | |
US20190243357A1 (en) | Wearable uav control device and uav system | |
US4611209A (en) | Navigation warning system and method | |
US20170045337A1 (en) | Smart wearable mine detector | |
EP2628019B1 (en) | Search and rescue using ultraviolet radiation | |
CN107106400A (en) | With the navigation flame float for adapting to radar | |
JP2008504597A (en) | Apparatus and method for displaying peripheral image | |
US11774547B2 (en) | Self-positioning method, self-positioning system and tracking beacon unit | |
US7294815B2 (en) | System and method for generating positional and orientation information of an object | |
US7873181B1 (en) | Visual image sensor organ replacement: implementation | |
US6072524A (en) | Electronic observation post with communications relay | |
JP2022521523A (en) | Weapon targeting training system and its methods | |
JP2006065831A (en) | Operation control method and apparatus for vessel | |
US20230397686A1 (en) | System, Method, and Apparatus for Detecting IR Radiation in a Marker System | |
Kaushik et al. | Real-Time Human Detection & Tracking System Incorporating MEMS Technology | |
JP2565883B2 (en) | Underwater reporting device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NOVATAC, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BARANY, LASZLO;REEL/FRAME:019087/0878 Effective date: 20060613 Owner name: NOVATAC, INC.,CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BARANY, LASZLO;REEL/FRAME:019087/0878 Effective date: 20060613 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20140615 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20180615 |