US20040127955A1 - Artificial system for vision and the like - Google Patents

Artificial system for vision and the like Download PDF

Info

Publication number
US20040127955A1
US20040127955A1 US10/694,642 US69464203A US2004127955A1 US 20040127955 A1 US20040127955 A1 US 20040127955A1 US 69464203 A US69464203 A US 69464203A US 2004127955 A1 US2004127955 A1 US 2004127955A1
Authority
US
United States
Prior art keywords
subject
sensations
nervous system
electrodes
viewed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/694,642
Inventor
William Dobelle
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US10/694,642 priority Critical patent/US20040127955A1/en
Publication of US20040127955A1 publication Critical patent/US20040127955A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception

Definitions

  • the present invention relates to improvements in artificial systems for vision and the like which produce sensations such as phosphenes in the subjects.
  • subject is here used to refer to an individual, such as a totally or partially blind individual, using the system in question.
  • a pulse or train of pulses directed to a given electrode connected to a unique location results in the stimulated perception by the subject of a spot or cluster of light, called a phosphene, at its own particular location.
  • a relatively small number of phosphenes created by stimulation of electrodes appropriately selected from an implanted array will present to the subject a pattern of light corresponding to that which, at any given instant, a camera aimed by the subject, as by being attached to his head, “sees”.
  • the term “camera” is here used in its broadest sense to denote a device which senses [“sees”] a particular object or series of objects and produces a corresponding set of signals.
  • Those signals are, in a known artificial vision system, conveyed through the subject's skull to a series of individual electrodes in contact with predetermined spots at appropriate locations of the subject's brain cortex, whether the visual cortex or the association cortex, each such electrode, when appropriately energized by a received signal, producing a uniquely located phosphene sensed by the subject.
  • the selection of individual electrodes to be signal-energized at any particular moment defines the stimulated image corresponding to what the camera senses.
  • the subject aware of the phosphenes existing at any given moment, thus “sees” something which to him represents a particular object or shape.
  • a meaningful image can be produced in the nervous system of a subject using only a limited number of available electrodes, thus reducing the signal-producing and -manipulating requirement of the system.
  • the effectiveness of such an image can advantageously be improved by applying, for a given camera signal, a series of similar pulses to each operative electrode.
  • a given pulse is applied sequentially to each of a series of selected electrodes, that pulse is then reapplied sequentially to that series of electrodes, and so on, so that a given camera signal is effectively utilized to energize a group of selected electrodes with sequential pulses.
  • the camera used in a system of the type under discussion must be extremely simple.
  • the camera is a miniaturized TV camera carried by, and contained within, a single lens area of what appears to be an ordinary pair of sunglasses.
  • Optically such a camera is not very versatile and in particular cannot optically magnify or modify that which it senses.
  • That disadvantage is avoided, in accordance with the present invention, by causing the distance sensed by the rangefinder to produce in the nervous system a visible distance indication—illumination of specific phosphenes to represent specific distances (e.g., near, medium or far) or periodic variations in the produced stimulation, for example, a variation in intensity in visible stimulation, and preferably a blinking on and off, at a rate corresponding to the sensed distance, thereby conveying distance-intelligence to the subject while at the same time not significantly interfering with the visual representation then being conveyed to him of the object being viewed nor with his normal auditory activities.
  • a visible distance indication illumination of specific phosphenes to represent specific distances (e.g., near, medium or far) or periodic variations in the produced stimulation, for example, a variation in intensity in visible stimulation, and preferably a blinking on and off
  • the data processing carried out by the system in question takes the signal produced by the camera, feeds it through a link to a sub-notebook computer, obtains a corresponding output from the sub-notebook computer and feeds that output to a micro-controller, the corresponding output of the micro-controller being amplified before being applied selectively to the electrodes in the subject's nervous system.
  • the supervisor-designer of the system may be kept aware in detail of the manner in which that system is operating in order for that individual to be able to conceive of and implement improvements.
  • the camera is provided with means for indicating to the supervisor-designer where the camera is pointed at any given point in time.
  • That pointer may conveniently comprise a small laser source attached to the subject's sunglasses which produces a visible narrow light beam which will impinge upon the object being viewed by the subject.
  • the supervisor-designer is provided with a dual display system which simultaneously exhibits for purposes of comparison what the camera actually sees and the corresponding configuration of the stimulations produced in the subject's brain.
  • a more accurate phosphene map is obtained by first energizing two selected electrodes to produce two separated reference phosphenes to define a reference line, such as a vertical line, then individually energizing additional electrodes each producing its own associated phosphene, and obtaining from the subject an estimate of the position of that additional phosphene relative to the two originally selected referenced phosphenes and to the reference line which the latter define.
  • FIG. 1 is a pictorial view of the head of a subject utilizing an artificial vision system including the improvements of the present invention and showing the camera and the laser pointer mounted on sunglasses worn by the subject;
  • FIG. 2 is a side pictorial view of a subject showing the computer and electronics package which the subject carries;
  • FIG. 3 is a block diagram of a typical system
  • FIG. 4 is an enlarged planar view of the electrode layout as applied to the surface of the subject's brain
  • FIG. 5 is a typical map in visual space of some of the phosphenes produced by particular electrodes of the array of FIG. 4;
  • FIG. 6 is a photographic view of a particular test scene to be viewed by a subject.
  • FIG. 7 is a representation of what the subject preferably “sees” when he views the test scene of FIG. 6.
  • the subject is provided with a camera generally designated A which, for convenience, is mounted on the right lens 2 of a pair of sunglasses 4 worn by the subject. That camera is electrically connected to a computer and electronics package generally designated B carried by the subject, that package having an output cable 6 which is connected through the subject's scalp to an array of electrodes generally designated C and shown in FIG. 4 implanted on the subject's brain, either on the visual cortex or the association cortex.
  • the associated circuitry and particularly the associated software converts what the camera A “sees” into electric signals applied to selected electrodes of the array C, thereby to produce in the subject's consciousness a series of phosphenes.
  • FIG. 5 represents a typical map in visual space showing the location, for one subject, of the phosphenes associated with certain selected electrodes identified by corresponding number in FIG. 4.
  • each electrode When stimulated, each electrode produces perhaps 1-4 closely spaced phosphenes.
  • Each phosphene in a cluster ranges in size up to the diameter of a pencil at arms length. Neighboring phosphenes in each cluster are generally too close to the adjacent phosphenes for another phosphene to be located between them.
  • the electrical connection between the electrodes of the array C and the appropriate locations on the brain of the subject is preferably accomplished through the use of a platinum foil ground plane perforated with a hexagonal array of 5 mm. diameter holes on 3 mm. centers. Flat platinum electrodes 1 mm, in diameter are centered in each hole.
  • This ground plane confines all current to a location beneath the dura, thus eliminating discomfort due to dural excitation when stimulating some single electrodes and when other arrays of electrodes are stimulated simultaneously.
  • the ground plane also eliminates most phosphene interaction when multiple electrodes are stimulated simultaneously, and provides an additional means of electrical safety that is not possible when stimulating between cortical electrodes and a ground plane outside the skull.
  • Each electrode is connected by a separate teflon insulated wire to a connector contained in a percutaneous pedestal accessible at the interior of the subject's scalp.
  • link 6 such as the known National Television Standard Committee (“NTSC”) link, which converts the normal television signal to a digital video signal that a computer can “understand”.
  • the output of that link 6 is fed to a sub-notebook computer 8 , which in turn feeds a micro-controller and stimulus generator 10 , which in turn produces the signals to select and stimulate the appropriate electrodes of the implanted array C.
  • NTSC National Television Standard Committee
  • the camera A is a 492 ⁇ 512 pixel CCD (Charge-Coupled-Device”) black and white television camera powered by a 9 volt battery.
  • This f 14.5 camera has a 69° field of vision and utilizes a pinhole aperture instead of a lens to minimize size and weight. It also incorporates an electronic “iris” for automatic exposure control.
  • the sub-notebook computer 8 incorporates a 233 MHz microprocessor with 32 MB of RAM and a 4.0 GB hard drive. It also has an LCD screen and keyboard. It was selected because of its very small size and light weight.
  • the belt pack B contains the link 6 , the sub-notebook computer 8 , the micro-controller 10 and associated circuitry and software.
  • the computer and electronics package together are about the size of a dictionary and weigh approximately 10 pounds, including camera, cables, and rechargeable batteries.
  • the battery pack for the computer will operate for approximately 3 hours and the battery pack for the other elements will operate for approximately 6 hours.
  • Stimulation delivered to each electrode typically consists of a train of six pulses delivered at 30 Hz to produce each frame of the image. Frames have been produced with 1-50 pulses, and frame rates have been varied from 1 to 20 frames per second. Frame rates of 4 per second currently seem best, even with trains containing only a single pulse.
  • Each pulse is symmetric, biphasic ( ⁇ /+), with a pulse width of 500 usec per phase (1,000 usec total).
  • Threshold amplitudes may vary +/ ⁇ 20% from day to day; they are higher than the thresholds of similar electrodes without the ground plane, presumably because current shunts across the surface of the piarachnoid and encapsulating membrane. The system is calibrated each morning by re-computing the thresholds for each electrode, a simple procedure that takes the volunteer approximately 15 minutes with a numeric keypad.
  • the conventional demultiplexer circuit accepts a series of inputs and feeds them in predetermined order to a single output.
  • the demultiplexer circuit will take a single input signal and feed it seriatim to a number of outputs corresponding to the desired number of electrodes to be energized.
  • the multiplexer circuit will feed a first pulse to a series of electrodes in order, it will then feed a second pulse to the same series of electrodes preferably in the same order, and so on.
  • the frequency at which the pulses are produced and the width of those pulses determine the intervals of time available for pulses to be directed to a selected series of electrodes.
  • Brightness of the phosphenes can easily be modulated by changes in pulse amplitude.
  • provision of “gray scale” has not proven very valuable so far, probably because of the combination of tunnel vision and limited resolution.
  • the phosphene display is planar, but is of uncertain distance, like the stars, in the sky. This presents to the subject a problem in depth perception. It is normally difficult for him to determine whether one sensed object is at the same distance from the camera as another sensed object.
  • Ultrasonic rangefinders have been known for many years and have been used by the blind. Conventionally such rangefinders translate sensed distance into normally sensed signals such as audio signals, but those normally sensed signals interfere with the ability of the subject to use his sense of hearing or other sense in its normal fashion.
  • an ultrasonic rangefinder may be utilized with the present system, as, for example, being secured to the left lens 10 of the sunglasses 4 , but the output of that rangefinder is caused to give rise in the nervous system to a visible distance indication—illumination of specific phosphenes to represent specific distances (e.g., near, medium, or far) or periodic variations in the produced stimulation, for example a periodic variation in brightness, and preferably a blinking on and off, at a rate corresponding to the sensed distance.
  • a visible distance indication illumination of specific phosphenes to represent specific distances (e.g., near, medium, or far) or periodic variations in the produced stimulation, for example a periodic variation in brightness, and preferably a blinking on and off, at a rate corresponding to the sensed distance.
  • the camera A must be small, light and inconspicuous if it is to be carried by the sunglasses 4 .
  • Such a camera is necessarily optically simple.
  • the camera 2 disclosed in FIG. 1 has a non-variable 69° field of vision and any attempt to alter its field of vision or to provide a “zoom” feature would involve heavy and conspicuous equipment, which is of course contraindicated.
  • the system between the camera A and the electrode array C is provided with appropriate circuitry to controllably magnify the amplitude of the stimulation, magnification of the signals fourfold or more will produce an image which, because the field of vision is limited, exceeds the tunnel limitation of the camera, thus producing a “zoom” effect.
  • the amplification can be under the control of the subject if desired.
  • Darkness inversion means that the signal from the camera A is in effect reversed or inverted, so that dark-sensed portions of the camera-viewed image result in light-producing signals applied to the electrodes and light-sensed portions of the camera-viewed image result in dark-producing signals applied to the electrodes.
  • Edge detection producing an image in which edges are sensed and intensified—is a known procedure in other contexts. When edge detection, particularly using Sobel filters, is employed in a system of the type under discussion, and particularly when it is used in conjunction with darkness inversion, that permits processing and transmitting images in a 233 MHz system at, a speed up to 8 frames per second with existing equipment, which in turn results in greatly improved transmissions of intelligence to the subject.
  • FIG. 6 discloses a typical demonstration set up comprising a mannequin 12 , a cap 14 , and three different sockets 16 , 18 , and 20 mounted on a wall 22 .
  • the resultant phosphene image is as shown in FIG. 7.
  • Sensing an image of the type disclosed in FIG. 7 the subject is easily able to find the mannequin and the cap and to detect the sockets.
  • doorways would appear as an outline of white phosphenes on a black background, making the location of the doorway very clear to the subject.
  • the supervisor-designer (hereinafter generically designated “operator”) know what particular phosphene pattern or other stimulation is being presented to the subject at any given moment.
  • the sub-notebook computer 8 may not only send intelligence to the micro-controller 10 but also send it to an RF transmitter 26 which is electromagnetically linked at 28 with RF receiver 30 which in turn is linked to a VCR and monitor 32 .
  • the monitor 32 lets the operator know what the subject is “seeing”.
  • a display may show to the operator what the camera A is seeing. In its preferred form the two displays—what the camera sees and the corresponding phosphene map—may be provided on a split screen for convenient comparison.
  • the sunglasses 4 worn by the subject carry on a temple piece a laser generator 38 which emits a narrow beam of light directed in the same direction as that in which the subject is looking and which therefore will produce a visible spot of light at the appropriate point on the scene being viewed.
  • the phosphene map is produced by selectively energizing particular electrodes and asking the subject to identify the location of the phosphene as he sees it. This procedure is complicated by the fact that all phosphenes are produced in a relatively small area, which makes pointing difficult, and that difficulty is compounded by the fact that phosphenes move with movement of the subject's eye. Accuracy of the phosphene map for each subject is important in selecting the particular electrodes to be energized at any given moment in order to produce in the subject's brain an accurate image of what the camera is “seeing”.
  • a blind subject is readily able to navigate among a “family” of three mannequins—standing adult male, seated adult female and standing 3-year old child—randomly placed in a large room, without bumping into any of them. He can then retrieve a cap which has been placed on a wall in a random location, and can place that cap on the head of a designated mannequin.
  • Subjects are able to recognize and identify characters in various standardized forms used in acuity tests, such as Snellen letters, Landolt links and Lea figures displayed to the subjects as pure black figures on a pure white background of a size corresponding to a visual acuity of approximately 20/2400.
  • the artificial vision system in its present stage of development has not yet been perfected to the degree that it will permit the subject to read easily, but it does give the subject sufficient intelligence so that he can move about safely and perform various physical tasks.
  • a subject provided with a system of the type here described has not only been able to move about an apartment but has even been able to enter a subway station and determine the location of the doors on a train that has pulled into the station.

Abstract

An artificial system for vision and the like, in which a camera views an object and creates signals corresponding thereto which are conveyed to the nervous system of the subject, in which observation, control and improvement of the system is achieved by providing a display which enables the supervisor to simultaneously see what the camera sees at any particular moment and what sensations the subject experiences, and to determine the relative locations of the sensations in the nervous system of a particular subject by producing individual sensations in a particular sequence and spatially locating the sensations in a particular fashion with the assistance of the subject.

Description

    BACKGROUND OF THE INVENTION
  • The present invention relates to improvements in artificial systems for vision and the like which produce sensations such as phosphenes in the subjects. (The term “subject” is here used to refer to an individual, such as a totally or partially blind individual, using the system in question.) [0001]
  • It has long been known that a blind individual can be made to perceive a truly visual sensation when stimulations such as brief pulses are applied to electrodes implanted in contact with the nervous system of the subject. A pulse or train of pulses directed to a given electrode connected to a unique location results in the stimulated perception by the subject of a spot or cluster of light, called a phosphene, at its own particular location. A relatively small number of phosphenes created by stimulation of electrodes appropriately selected from an implanted array will present to the subject a pattern of light corresponding to that which, at any given instant, a camera aimed by the subject, as by being attached to his head, “sees”. (The term “camera” is here used in its broadest sense to denote a device which senses [“sees”] a particular object or series of objects and produces a corresponding set of signals.) [0002]
  • Those signals are, in a known artificial vision system, conveyed through the subject's skull to a series of individual electrodes in contact with predetermined spots at appropriate locations of the subject's brain cortex, whether the visual cortex or the association cortex, each such electrode, when appropriately energized by a received signal, producing a uniquely located phosphene sensed by the subject. The selection of individual electrodes to be signal-energized at any particular moment defines the stimulated image corresponding to what the camera senses. The subject, aware of the phosphenes existing at any given moment, thus “sees” something which to him represents a particular object or shape. [0003]
  • Recently significant improvements have been made in such systems, especially but not exclusively artificial vision systems, giving to the subject an increasingly effective “sight”, and providing to the supervisor of such systems and the designer of improvements therein a greater facility in understanding what the subject actually “sees” and to what extent that corresponds to actuality, so that potential improvements can more expeditiously be carried out and evaluated. [0004]
  • SUMMARY OF THE INVENTION
  • To create in the subject's brain a set of sensations which represent a particular object or shape has presented a problem. To do so with equipment which can be conveniently carried about by the subject greatly complicates the problem. This patent relates to recent improvements in systems of this type which materially expand their usability and practicability. Those improvements fall into two closely related categories—matters directly affecting what the subject “sees”, and matters improving the ability of the designer-supervisor of the system to ascertain and evaluate how the system is actually functioning so as to guide him in making further improvements. [0005]
  • To these ends it has been found that the intelligibility and meaningfulness to the subject of the phosphene-produced image is significantly enhanced when (a) that image is caused to be a negative rather than a positive of what the camera senses—in other words, the dark and light portions of the camera-sensed object are reversed into light and dark signal portions respectively—and (b) the edges of the viewed object are brightly outlined. [0006]
  • A meaningful image can be produced in the nervous system of a subject using only a limited number of available electrodes, thus reducing the signal-producing and -manipulating requirement of the system. Moreover, it has been found that the effectiveness of such an image can advantageously be improved by applying, for a given camera signal, a series of similar pulses to each operative electrode. Through the use of a multiplexing circuit a given pulse is applied sequentially to each of a series of selected electrodes, that pulse is then reapplied sequentially to that series of electrodes, and so on, so that a given camera signal is effectively utilized to energize a group of selected electrodes with sequential pulses. [0007]
  • Primarily because of weight and size considerations, the camera used in a system of the type under discussion must be extremely simple. For example, in the artificial vision system presently in use the camera is a miniaturized TV camera carried by, and contained within, a single lens area of what appears to be an ordinary pair of sunglasses. Optically such a camera is not very versatile and in particular cannot optically magnify or modify that which it senses. However, I have found that if approximate circuitry is provided between the camera and the electrodes on the subject's nervous system which will controllably magnify the amplitude of the signal produced thereby, that will in effect magnify the perceived object and thus produce a “zoom” effect upon the phosphene image, the area of which is fixed. That amplification variation can be under the control of the subject, who can then produce the “zoom” effect whenever and to whatever extent desired. [0008]
  • One problem with phosphene-produced images is that they appear to be at no particular distance from the subject but instead to more or less float in space, whether the object they represent is close to or at a distance from the subject. This clearly limits the effectiveness of the image in advising the subject accurately with respect to the object viewed. Rangefinders with variable audible output are known and could be used by blind subjects but they have the disadvantage of interfering with the subject's normal hearing or other senses. That disadvantage is avoided, in accordance with the present invention, by causing the distance sensed by the rangefinder to produce in the nervous system a visible distance indication—illumination of specific phosphenes to represent specific distances (e.g., near, medium or far) or periodic variations in the produced stimulation, for example, a variation in intensity in visible stimulation, and preferably a blinking on and off, at a rate corresponding to the sensed distance, thereby conveying distance-intelligence to the subject while at the same time not significantly interfering with the visual representation then being conveyed to him of the object being viewed nor with his normal auditory activities. [0009]
  • In particular the data processing carried out by the system in question takes the signal produced by the camera, feeds it through a link to a sub-notebook computer, obtains a corresponding output from the sub-notebook computer and feeds that output to a micro-controller, the corresponding output of the micro-controller being amplified before being applied selectively to the electrodes in the subject's nervous system. [0010]
  • There are several ways in which the supervisor-designer of the system may be kept aware in detail of the manner in which that system is operating in order for that individual to be able to conceive of and implement improvements. To that end, in the system of the present invention the camera is provided with means for indicating to the supervisor-designer where the camera is pointed at any given point in time. That pointer may conveniently comprise a small laser source attached to the subject's sunglasses which produces a visible narrow light beam which will impinge upon the object being viewed by the subject. Further to the same end, the supervisor-designer is provided with a dual display system which simultaneously exhibits for purposes of comparison what the camera actually sees and the corresponding configuration of the stimulations produced in the subject's brain. [0011]
  • Essential to such an evaluation in a particular artificial vision system is an accurate map setting forth, as precisely as possible, the location of each phosphene or group of phosphenes in the subject's “sight” corresponding to a given electrode. Phosphene maps have been made in the past by energizing a particular electrode and asking the subject to state or indicate where the phosphene thus produced is located. This is not as easy as it sounds because phosphenes as a group sometimes move about in the subject's visual field and because objective statements from the subject as to where a particular phosphene is located are often vague and sometimes misleading. According to the present invention a more accurate phosphene map, not as subject to such vagaries, is obtained by first energizing two selected electrodes to produce two separated reference phosphenes to define a reference line, such as a vertical line, then individually energizing additional electrodes each producing its own associated phosphene, and obtaining from the subject an estimate of the position of that additional phosphene relative to the two originally selected referenced phosphenes and to the reference line which the latter define. [0012]
  • Each of these improvements enables and enhances the functioning of a system such as an artificial vision system effective to promote individual mobility. The cumulative effect of these improvements gives rise to a significant step forward in such artificial sensing systems.[0013]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a pictorial view of the head of a subject utilizing an artificial vision system including the improvements of the present invention and showing the camera and the laser pointer mounted on sunglasses worn by the subject; [0014]
  • FIG. 2 is a side pictorial view of a subject showing the computer and electronics package which the subject carries; [0015]
  • FIG. 3 is a block diagram of a typical system; [0016]
  • FIG. 4 is an enlarged planar view of the electrode layout as applied to the surface of the subject's brain; [0017]
  • FIG. 5 is a typical map in visual space of some of the phosphenes produced by particular electrodes of the array of FIG. 4; [0018]
  • FIG. 6 is a photographic view of a particular test scene to be viewed by a subject; and [0019]
  • FIG. 7 is a representation of what the subject preferably “sees” when he views the test scene of FIG. 6. [0020]
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • While many of the improvements here disclosed and claimed are applicable to several different types of artificial sensing systems, they are here specifically described as embodied in the at present preferred embodiment, a particular artificial vision system. [0021]
  • As may best be seen in FIGS. 1 and 2, the subject is provided with a camera generally designated A which, for convenience, is mounted on the right lens [0022] 2 of a pair of sunglasses 4 worn by the subject. That camera is electrically connected to a computer and electronics package generally designated B carried by the subject, that package having an output cable 6 which is connected through the subject's scalp to an array of electrodes generally designated C and shown in FIG. 4 implanted on the subject's brain, either on the visual cortex or the association cortex. The associated circuitry and particularly the associated software, converts what the camera A “sees” into electric signals applied to selected electrodes of the array C, thereby to produce in the subject's consciousness a series of phosphenes. The location of the phosphene or phosphenes associated with a particular electrode does not correspond to the location of that electrode on the array C, and hence it is necessary to ascertain, for each such electrode, where the associated phosphene or phosphenes as sensed by the subject are located. This must be done in order to direct the signals produced by the camera A to the appropriate electrodes so as to produce for the subject a group of phosphenes representing what the camera “sees”. FIG. 5 represents a typical map in visual space showing the location, for one subject, of the phosphenes associated with certain selected electrodes identified by corresponding number in FIG. 4.
  • When stimulated, each electrode produces perhaps 1-4 closely spaced phosphenes. Each phosphene in a cluster ranges in size up to the diameter of a pencil at arms length. Neighboring phosphenes in each cluster are generally too close to the adjacent phosphenes for another phosphene to be located between them. [0023]
  • The electrical connection between the electrodes of the array C and the appropriate locations on the brain of the subject is preferably accomplished through the use of a platinum foil ground plane perforated with a hexagonal array of 5 mm. diameter holes on 3 mm. centers. [0024] Flat platinum electrodes 1 mm, in diameter are centered in each hole. This ground plane confines all current to a location beneath the dura, thus eliminating discomfort due to dural excitation when stimulating some single electrodes and when other arrays of electrodes are stimulated simultaneously. The ground plane also eliminates most phosphene interaction when multiple electrodes are stimulated simultaneously, and provides an additional means of electrical safety that is not possible when stimulating between cortical electrodes and a ground plane outside the skull. Each electrode is connected by a separate teflon insulated wire to a connector contained in a percutaneous pedestal accessible at the interior of the subject's scalp.
  • As shown in FIG. 3, the signals produced by the camera A—normal conventional television signals—are fed to link [0025] 6, such as the known National Television Standard Committee (“NTSC”) link, which converts the normal television signal to a digital video signal that a computer can “understand”. The output of that link 6 is fed to a sub-notebook computer 8, which in turn feeds a micro-controller and stimulus generator 10, which in turn produces the signals to select and stimulate the appropriate electrodes of the implanted array C.
  • In a preferred embodiment the camera A is a 492×512 pixel CCD (Charge-Coupled-Device”) black and white television camera powered by a 9 volt battery. This f 14.5 camera has a 69° field of vision and utilizes a pinhole aperture instead of a lens to minimize size and weight. It also incorporates an electronic “iris” for automatic exposure control. [0026]
  • The [0027] sub-notebook computer 8 incorporates a 233 MHz microprocessor with 32 MB of RAM and a 4.0 GB hard drive. It also has an LCD screen and keyboard. It was selected because of its very small size and light weight. The belt pack B contains the link 6, the sub-notebook computer 8, the micro-controller 10 and associated circuitry and software. The computer and electronics package together are about the size of a dictionary and weigh approximately 10 pounds, including camera, cables, and rechargeable batteries. The battery pack for the computer will operate for approximately 3 hours and the battery pack for the other elements will operate for approximately 6 hours.
  • Stimulation delivered to each electrode typically consists of a train of six pulses delivered at 30 Hz to produce each frame of the image. Frames have been produced with 1-50 pulses, and frame rates have been varied from 1 to 20 frames per second. Frame rates of 4 per second currently seem best, even with trains containing only a single pulse. Each pulse is symmetric, biphasic (−/+), with a pulse width of 500 usec per phase (1,000 usec total). Threshold amplitudes may vary +/− 20% from day to day; they are higher than the thresholds of similar electrodes without the ground plane, presumably because current shunts across the surface of the piarachnoid and encapsulating membrane. The system is calibrated each morning by re-computing the thresholds for each electrode, a simple procedure that takes the volunteer approximately 15 minutes with a numeric keypad. [0028]
  • In order to extract intelligence from the camera segment it is not necessary to use all of the 64 electrodes that are provided in the installation illustrated in FIG. 4, but as a practical matter a plurality of such electrodes must be simultaneously energized if a meaningful phosphene image is to be produced. It has been found that as few as 10 electrodes need be energized to produce a particular frame. With an appropriate pulse width and pulse frequency it is possible to energize the desired number of electrodes from a single drive by utilizing the time slots between the pulses destined for one electrode to receive pulses selected for a series of other electrodes. This is readily accomplished by using a conventional demultiplexer circuit in reverse. The conventional demultiplexer circuit accepts a series of inputs and feeds them in predetermined order to a single output. As used here, the demultiplexer circuit will take a single input signal and feed it seriatim to a number of outputs corresponding to the desired number of electrodes to be energized. Thus the multiplexer circuit will feed a first pulse to a series of electrodes in order, it will then feed a second pulse to the same series of electrodes preferably in the same order, and so on. The frequency at which the pulses are produced and the width of those pulses determine the intervals of time available for pulses to be directed to a selected series of electrodes. [0029]
  • Brightness of the phosphenes can easily be modulated by changes in pulse amplitude. However, provision of “gray scale” has not proven very valuable so far, probably because of the combination of tunnel vision and limited resolution. [0030]
  • The phosphene display is planar, but is of uncertain distance, like the stars, in the sky. This presents to the subject a problem in depth perception. It is normally difficult for him to determine whether one sensed object is at the same distance from the camera as another sensed object. Ultrasonic rangefinders have been known for many years and have been used by the blind. Conventionally such rangefinders translate sensed distance into normally sensed signals such as audio signals, but those normally sensed signals interfere with the ability of the subject to use his sense of hearing or other sense in its normal fashion. In accordance with the present invention, to overcome that disadvantage an ultrasonic rangefinder may be utilized with the present system, as, for example, being secured to the [0031] left lens 10 of the sunglasses 4, but the output of that rangefinder is caused to give rise in the nervous system to a visible distance indication—illumination of specific phosphenes to represent specific distances (e.g., near, medium, or far) or periodic variations in the produced stimulation, for example a periodic variation in brightness, and preferably a blinking on and off, at a rate corresponding to the sensed distance. Thus the acuity and intelligibility of the subject's sense of hearing is not compromised although the subject is given an indication of the relative distance to various objects.
  • The camera A must be small, light and inconspicuous if it is to be carried by the [0032] sunglasses 4. Such a camera is necessarily optically simple. For example, the camera 2 disclosed in FIG. 1 has a non-variable 69° field of vision and any attempt to alter its field of vision or to provide a “zoom” feature would involve heavy and conspicuous equipment, which is of course contraindicated. However, if the system between the camera A and the electrode array C is provided with appropriate circuitry to controllably magnify the amplitude of the stimulation, magnification of the signals fourfold or more will produce an image which, because the field of vision is limited, exceeds the tunnel limitation of the camera, thus producing a “zoom” effect. The amplification can be under the control of the subject if desired.
  • One limitation on the intelligibility of phosphene images in the subject's brain is the number of frames that can be sequentially created in a given period of time. The greater the number of frames in a period of time the more intelligence is transmitted to the subject, but the greater are the demands which are placed on the system, and the system is essentially limited by the state-of-the-art and the necessity that it be readily portable by the subject. Producing one frame per second is too slow to provide good mobility to the subject, and merely increasing the frame rate, all else being constant, does not itself produce an phosphene image of appropriate clarity. These problems have been greatly ameliorated by two steps—darkness inversion and edge detection. Darkness inversion means that the signal from the camera A is in effect reversed or inverted, so that dark-sensed portions of the camera-viewed image result in light-producing signals applied to the electrodes and light-sensed portions of the camera-viewed image result in dark-producing signals applied to the electrodes. Edge detection—producing an image in which edges are sensed and intensified—is a known procedure in other contexts. When edge detection, particularly using Sobel filters, is employed in a system of the type under discussion, and particularly when it is used in conjunction with darkness inversion, that permits processing and transmitting images in a 233 MHz system at, a speed up to 8 frames per second with existing equipment, which in turn results in greatly improved transmissions of intelligence to the subject. FIGS. 6 and 7 are illustrative of the effects thus achieved. FIG. 6 discloses a typical demonstration set up comprising a [0033] mannequin 12, a cap 14, and three different sockets 16, 18, and 20 mounted on a wall 22. With darkness inversion and particularly with edge detection the resultant phosphene image is as shown in FIG. 7. Sensing an image of the type disclosed in FIG. 7 the subject is easily able to find the mannequin and the cap and to detect the sockets. Similarly, doorways would appear as an outline of white phosphenes on a black background, making the location of the doorway very clear to the subject.
  • Important to the operation and particularly the improvement of the system is the ability of the supervisor or designer of the system to know precisely how the system is operating, what it is accomplishing and what it is not accomplishing the system of the present invention is provided with several new features to improve supervision and facilitate improvement of design. [0034]
  • For example, it is important that the supervisor-designer (hereinafter generically designated “operator”) know what particular phosphene pattern or other stimulation is being presented to the subject at any given moment. To that end, and as shown in FIG. 3, the [0035] sub-notebook computer 8 may not only send intelligence to the micro-controller 10 but also send it to an RF transmitter 26 which is electromagnetically linked at 28 with RF receiver 30 which in turn is linked to a VCR and monitor 32. Hence the monitor 32 lets the operator know what the subject is “seeing”. Simultaneously a display may show to the operator what the camera A is seeing. In its preferred form the two displays—what the camera sees and the corresponding phosphene map—may be provided on a split screen for convenient comparison.
  • Along the same lines, it is helpful to the operator, as he observes the subject using the system, to know precisely in what direction the subject is “looking” at any given moment, that information to be correlated with the displays just described, observation of the physical movements of the subject, or otherwise. To that end, and as may be seen in FIG. 1, the [0036] sunglasses 4 worn by the subject carry on a temple piece a laser generator 38 which emits a narrow beam of light directed in the same direction as that in which the subject is looking and which therefore will produce a visible spot of light at the appropriate point on the scene being viewed.
  • The phosphene map is produced by selectively energizing particular electrodes and asking the subject to identify the location of the phosphene as he sees it. This procedure is complicated by the fact that all phosphenes are produced in a relatively small area, which makes pointing difficult, and that difficulty is compounded by the fact that phosphenes move with movement of the subject's eye. Accuracy of the phosphene map for each subject is important in selecting the particular electrodes to be energized at any given moment in order to produce in the subject's brain an accurate image of what the camera is “seeing”. In order to produce a more accurate phosphene map a new procedure has been created—first two pre-selected electrodes are energized to produce two spaced phosphenes which define a reference line, generally but not necessarily vertical. Then while those two phosphenes continue to be produced, other individual electrodes are individually energized and the subject is asked to identify the location of the phosphene thus produced relative to the locations of the two original phosphenes and the reference line which the latter define. This is usually done in terms of the vertical spacing between each individually produced phosphene and the two reference phosphenes as well as the distance of the individually produced phosphene to one side or the other of the reference line connecting the original phosphenes. In this way, a more accurate phosphene map is produced. [0037]
  • With a system of the type here disclosed a blind subject is readily able to navigate among a “family” of three mannequins—standing adult male, seated adult female and standing 3-year old child—randomly placed in a large room, without bumping into any of them. He can then retrieve a cap which has been placed on a wall in a random location, and can place that cap on the head of a designated mannequin. Subjects are able to recognize and identify characters in various standardized forms used in acuity tests, such as Snellen letters, Landolt links and Lea figures displayed to the subjects as pure black figures on a pure white background of a size corresponding to a visual acuity of approximately 20/2400. [0038]
  • The conversion of camera signals or other signals into appropriate electrode pulses is accomplished by means of circuity and particularly software which is state-of-the-art. [0039]
  • The artificial vision system in its present stage of development has not yet been perfected to the degree that it will permit the subject to read easily, but it does give the subject sufficient intelligence so that he can move about safely and perform various physical tasks. By way of example, a subject provided with a system of the type here described has not only been able to move about an apartment but has even been able to enter a subway station and determine the location of the doors on a train that has pulled into the station. [0040]
  • While a limited number of embodiments of the present invention have been here specifically disclosed, which can function individually or cumulatively, and many of which are not limited to use in an artificial vision system, it will be apparent that many variations may be made therein, all without departing from the spirit of the invention as defined in the following claims. [0041]

Claims (15)

I claim:
1. In an artificial sensing system comprising producing first signals corresponding to light and dark portions of a particular object to be sensed and conveying to the nervous system of the subject second signals producing sensations in said nervous system corresponding at least in part to said object; the improvement which comprises converting light-corresponding and dark-corresponding portions of said first signal into dark-corresponding and light-corresponding portions respectively of said second signal.
2. In an artificial sensing system in which a particular object is sensed and at least some light and dark portions of said object are converted into signals which are conveyed to the nervous system of a subject to produce sensations corresponding at least in part to said object; the improvement which comprises sensing light and dark portions of said object and causing said sensation-producing signals to represent an inversion of said light and dark portions of said object into dark and light portions thereof respectively.
3. In an artificial sensing system in which a particular object is sensed and at least some portions of said object are converted into electrical signals which are conveyed to the nervous system of a subject to produce phosphenes corresponding at least in part to said object; the improvement which comprises causing the phosphenes produced by said signals to produce in said subject's brain a comparatively bright outline of the image of said object when compared to the produced image of the remaining portion of said object.
4. In an artificial sensing system comprising creating a plurality of sensations in the nervous system of the subject corresponding to a particular object to be viewed by stimulating a corresponding plurality of electrodes electrically connected respectively to appropriate locations of the subject's nervous system; the improvement which comprises, for a given view of said object, providing for each of a plurality of selected electrodes a given signal comprising a plurality of time-spaced pulses, and applying those pulses to those electrodes through a multiplexer effective to accept a given signal, convert said signal to a plurality of pulses for each selected electrode, and apply the first of those pulses sequentially to said electrodes, then the second of those pulses sequentially to said second electrode, and so on.
5. In an artificial sensing system comprising creating a plurality of sensations in the nervous system of the subject corresponding to a particular object to be viewed by stimulating a corresponding plurality of electrodes electrically connected respectively to appropriate locations of the subject's nervous system; the improvement which comprises, for a given view of said object, providing for each of a plurality of selected electrodes a given signal comprising a plurality of time-spaced pulses, and applying those pulses to those electrodes through a multiplexer effective to accept a given signal, converting said signal to a plurality of pulses for each selected electrode, and applying those pulses sequentially to said electrodes one electrode at a time, a first pulse being applied sequentially to one electrode at a time, a second pulse then being applied sequentially to one electrode at a time, and so on.
6. In an artificial sensing system comprising creating in the nervous system of a subject sensations corresponding to a particular object to be viewed, thereby to produce for said subject a sensed representation of that object; the improvement which comprises providing the subject with a rangefinder effective to detect the distance from the subject to said object and indicate to the subject what that distance is by causing the stimulation produced in the subject to sensibly reflect said distance, thereby conveying distance-intelligence to said subject while at the same time conveying to said subject a visual representation of the object in question.
7. The artificial sensing system of claim 6 in which said variation in stimulation is constituted by essentially blinking said stimulation on and off at a rate corresponding to said distance.
8. To assist in the monitoring of an artificial sensing system which creates sensations in the nervous system of the subject corresponding to a particular object to be viewed by providing the subject with a camera which produces signals corresponding to the object to be viewed which are converted into sensations in the subject's nervous system; the improvement which comprises providing said subject with a device producing a beam of light corresponding in direction to the direction in which said camera is pointed, thereby enabling those monitoring the actions of said subject to know what the camera is looking at any given moment.
9. To assist in the monitoring of an artificial sensing system which creates sensations in the nervous system of the subject corresponding to a particular object to be viewed by providing the subject with a camera which produces signals corresponding to the object to be viewed which are converted into sensations in the subject's nervous system; the improvement which comprises a display device which produces simultaneously viewable representations of (a) what the camera sees when viewing a particular object and, (b) a map representing the sensations then being present in the subject's nervous system.
10. To assist in the monitoring of an artificial sensing system which creates sensations in the nervous system of the subject corresponding to a particular object to be viewed by selectively stimulating a plurality of electrodes electrically connected respectively to appropriate locations in the subject's nervous system and producing, when thus stimulated, one or more sensations in particular locations in the subject's field of consciousness; the improvement comprising (a) energizing two selected electrodes to produce two separated reference sensations, (b) then, while keeping said reference sensations sensed by the subject, individually sequentially energizing additional electrodes to sequentially produce additional sensations each corresponding respectively to the electrode then being energized, (c) for each such additional sensation obtaining from the subject an estimate of the relative position of said additional sensation relative to said referenced sensations, and (d) mapping the estimated positions of said sensations.
11. To assist in the monitoring of an artificial sensing system which creates sensations in the nervous system of the subject corresponding to a particular object to be viewed by selectively stimulating a plurality of electrodes electrically connected respectively to appropriate locations in the subject's nervous system and producing, when thus stimulated, one or more sensations in a particular location in the subject's field of consciousness; the improvement comprising (a) energizing two selected electrodes to produce two separated reference sensations to define a reference line, (b) then, while keeping said reference sensations sensed by the subject, individually sequentially energizing additional electrodes to sequentially produce additional sensations each corresponding respectively to the electrode then being energized, (c) for each such additional sensation obtaining from the subject an estimate of the vertical spacing of each additional sensation relative to the two referenced sensations and an estimate of the distance of said additional sensation to one side or the other of said reference line, and (d) mapping the estimated positions of said sensations.
12. In an artificial sensing system comprising creating a plurality of sensations in the nervous system of the subject corresponding to a particular object to be viewed by producing a series of signals corresponding to the object to be viewed and converting those signals into sensations in the subject's nervous system; the improvement which comprises providing a variable signal amplifier active on said signals before they are converted into sensations, and varying the degree of signal amplification thus produced, thereby to vary the area of said object producing said sensations and thus giving rise to a “zoom” effect.
13. The artificial sensing system of claim 12 in which the variation in said magnification is under the control of the subject.
14. In an artificial sensing system which creates sensations in the nervous system of the subject corresponding to a particular object to be viewed by providing the subject with a device which produces a signal corresponding to an object to be viewed and circuitry conveying said signals to electrodes connected to particular areas of the subject's nervous system, thereby to produce sensations in said nervous system; the improvement which comprises obtaining from said device a first signal corresponding to said object, feeding said, first signal through a link and thence through a sub-notebook computer, feeding the output of the sub-notebook computer to a micro-controller and amplifying the output of the latter to electrodes corresponding to phosphene positions in the subject's brain.
15. In the artificial sensing system of claims 1, electromagnetically coupling an output of said sub-notebook computer to a visual display device and thus creating a visible representation of said object.
US10/694,642 2000-01-04 2003-10-29 Artificial system for vision and the like Abandoned US20040127955A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/694,642 US20040127955A1 (en) 2000-01-04 2003-10-29 Artificial system for vision and the like

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/477,554 US6658299B1 (en) 2000-01-04 2000-01-04 Artificial system for vision and the like
US10/694,642 US20040127955A1 (en) 2000-01-04 2003-10-29 Artificial system for vision and the like

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/477,554 Continuation US6658299B1 (en) 2000-01-04 2000-01-04 Artificial system for vision and the like

Publications (1)

Publication Number Publication Date
US20040127955A1 true US20040127955A1 (en) 2004-07-01

Family

ID=29550281

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/477,554 Expired - Fee Related US6658299B1 (en) 2000-01-04 2000-01-04 Artificial system for vision and the like
US10/694,642 Abandoned US20040127955A1 (en) 2000-01-04 2003-10-29 Artificial system for vision and the like
US10/695,537 Abandoned US20040127956A1 (en) 2000-01-04 2003-10-29 Artificial system for vision and the like

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/477,554 Expired - Fee Related US6658299B1 (en) 2000-01-04 2000-01-04 Artificial system for vision and the like

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/695,537 Abandoned US20040127956A1 (en) 2000-01-04 2003-10-29 Artificial system for vision and the like

Country Status (1)

Country Link
US (3) US6658299B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080161915A1 (en) * 2006-12-29 2008-07-03 Qiushi Ren System for creating visual images
CN107995391A (en) * 2017-11-28 2018-05-04 信利光电股份有限公司 A kind of ocular prosthesis and electronic equipment

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE519733C2 (en) * 2000-07-05 2003-04-01 Olof Lindahl System and method for interpreting visual information transmits to a person through tactile influence on sensory organs on the person's body
US7756584B2 (en) 2000-07-13 2010-07-13 Advanced Neuromodulation Systems, Inc. Methods and apparatus for effectuating a lasting change in a neural-function of a patient
US7672730B2 (en) * 2001-03-08 2010-03-02 Advanced Neuromodulation Systems, Inc. Methods and apparatus for effectuating a lasting change in a neural-function of a patient
US7010351B2 (en) 2000-07-13 2006-03-07 Northstar Neuroscience, Inc. Methods and apparatus for effectuating a lasting change in a neural-function of a patient
US7831305B2 (en) 2001-10-15 2010-11-09 Advanced Neuromodulation Systems, Inc. Neural stimulation system and method responsive to collateral neural activity
ATE336279T1 (en) * 2000-11-16 2006-09-15 Polyvalor Sec ELECTRONIC BODY IMPLANT AND ARTIFICIAL VISION SYSTEM
ITRE20010037A1 (en) * 2001-04-06 2002-10-06 Athos Claudio Mattioli AUTOMATIC LABEL APPLICATOR WITHOUT GLUE
US7236830B2 (en) * 2002-12-10 2007-06-26 Northstar Neuroscience, Inc. Systems and methods for enhancing or optimizing neural stimulation therapy for treating symptoms of Parkinson's disease and/or other movement disorders
US20050075680A1 (en) 2003-04-18 2005-04-07 Lowry David Warren Methods and systems for intracranial neurostimulation and/or sensing
US7574263B2 (en) * 2003-01-31 2009-08-11 Second Sight Medical Products, Inc. Pixel re-mapping for visual prosthesis
AU2005275209B2 (en) 2004-07-15 2010-06-24 Advanced Neuromodulation Systems, Inc. Systems and methods for enhancing or affecting neural stimulation efficiency and/or efficacy
US7565200B2 (en) 2004-11-12 2009-07-21 Advanced Neuromodulation Systems, Inc. Systems and methods for selecting stimulation sites and applying treatment, including treatment of symptoms of Parkinson's disease, other movement disorders, and/or drug side effects
JP4873897B2 (en) * 2005-07-29 2012-02-08 株式会社ニデック Visual reproduction assist device
AU2006292277A1 (en) * 2005-09-16 2007-03-29 Second Sight Medical Products, Inc. Downloadable filters for a visual prosthesis
US8929991B2 (en) 2005-10-19 2015-01-06 Advanced Neuromodulation Systems, Inc. Methods for establishing parameters for neural stimulation, including via performance of working memory tasks, and associated kits
US8311634B2 (en) * 2006-06-16 2012-11-13 Second Sight Medical Products Inc. Apparatus and method for electrical stimulation of human retina
CN100444812C (en) * 2006-06-22 2008-12-24 上海交通大学 Intra-ocular camera head for visual prosthesis
US8285394B1 (en) 2006-10-27 2012-10-09 Sandia Corporation Demultiplexer circuit for neural stimulation
AU2008222789B2 (en) * 2007-03-08 2013-08-22 Doheny Eye Institute Saliency-based apparatus and methods for visual prostheses
US8150526B2 (en) * 2009-02-09 2012-04-03 Nano-Retina, Inc. Retinal prosthesis
US8442641B2 (en) 2010-08-06 2013-05-14 Nano-Retina, Inc. Retinal prosthesis techniques
US8706243B2 (en) 2009-02-09 2014-04-22 Rainbow Medical Ltd. Retinal prosthesis techniques
US8718784B2 (en) 2010-01-14 2014-05-06 Nano-Retina, Inc. Penetrating electrodes for retinal stimulation
US8428740B2 (en) 2010-08-06 2013-04-23 Nano-Retina, Inc. Retinal prosthesis techniques
WO2011041842A1 (en) * 2009-10-09 2011-04-14 National Ict Australia Limited Vision enhancement for a vision impaired user
US8571669B2 (en) 2011-02-24 2013-10-29 Nano-Retina, Inc. Retinal prosthesis with efficient processing circuits
AU2012304260B2 (en) * 2011-08-30 2017-06-08 Monash University System and method for processing sensor data for the visually impaired
US9370417B2 (en) 2013-03-14 2016-06-21 Nano-Retina, Inc. Foveated retinal prosthesis
US9474902B2 (en) 2013-12-31 2016-10-25 Nano Retina Ltd. Wearable apparatus for delivery of power to a retinal prosthesis
US9331791B2 (en) 2014-01-21 2016-05-03 Nano Retina Ltd. Transfer of power and data
CN104983511A (en) * 2015-05-18 2015-10-21 上海交通大学 Voice-helping intelligent glasses system aiming at totally-blind visual handicapped
CN111182863B (en) * 2017-07-18 2022-01-04 辛特科技有限公司 System for acquiring and processing artificial eye image
CN111450420A (en) * 2020-04-08 2020-07-28 北京光彩明天儿童眼科医院有限公司 Brain function rehabilitation therapeutic apparatus

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4751507A (en) * 1984-07-23 1988-06-14 International Business Machines Corporation Method for simultaneously displaying an image and an enlarged view of a selectable portion of the image with different levels of dot detail resolution
US5761485A (en) * 1995-12-01 1998-06-02 Munyan; Daniel E. Personal electronic book system
US6442431B1 (en) * 1998-07-27 2002-08-27 Axon Engineering, Inc., Device and method for production of visual sensations by optic nerve stimulation

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2721316A (en) 1953-06-09 1955-10-18 Joseph D Shaw Method and means for aiding the blind
US3320947A (en) 1963-10-25 1967-05-23 Knoll Max Hans Device for the excitation of nerve networks
US3449768A (en) 1966-12-27 1969-06-17 James H Doyle Artificial sense organ
US3594823A (en) 1969-02-11 1971-07-27 Patent Management Inc Visual substitution system with receptor scanning means
US3628193A (en) 1969-02-19 1971-12-21 Inst Of Medical Sciences The Tactile image projection system
GB1319774A (en) 1969-06-26 1973-06-06 Nat Res Dev Visual prosthetic device
GB1286316A (en) 1969-11-13 1972-08-23 Hermann Mengeler Method and apparatus for transmitting optical impressions upon the visual regions of the human cerebral cortex
US3848608A (en) 1973-07-23 1974-11-19 Gen Electric Subject integument spatial stimulator
JPS5382980A (en) 1976-12-28 1978-07-21 Agency Of Ind Science & Technol Distribution type information transmission unit by multi point electric stimulas
GB2016276B (en) 1978-01-21 1982-02-10 Ross Foundation For Research I Sensory system
US4611596A (en) 1980-10-14 1986-09-16 Purdue Research Foundation Sensory prostheses
US4793353A (en) 1981-06-30 1988-12-27 Borkan William N Non-invasive multiprogrammable tissue stimulator and method
US4551149A (en) 1982-02-16 1985-11-05 Michael Sciarra Prosthetic vision system
US4979508A (en) 1984-10-09 1990-12-25 Beck Stephen C Apparatus for generating phosphenes
US4664117A (en) 1984-10-09 1987-05-12 Beck Stephen C Apparatus and method for generating phosphenes
JPH0685024B2 (en) * 1984-10-26 1994-10-26 オリンパス光学工業株式会社 Endoscope device
US4837049A (en) 1986-06-17 1989-06-06 Alfred E. Mann Foundation For Scientific Research Method of making an electrode array
US5037376A (en) 1988-07-22 1991-08-06 The United States Of America As Represented By The Department Of Health And Human Services Apparatus and method for transmitting prosthetic information to the brain
US5159927A (en) 1989-07-26 1992-11-03 Ferdinand Schmid Visual prosthesis apparatus and method
GB9201856D0 (en) * 1992-01-29 1992-03-18 British Telecomm Method of forming a template
US5563713A (en) * 1992-12-16 1996-10-08 Canon Kabushiki Kaisha Image processing method and apparatus with adding of a white outline to an outline of a character image
US5411540A (en) 1993-06-03 1995-05-02 Massachusetts Institute Of Technology Method and apparatus for preferential neuron stimulation
DE4339237C2 (en) 1993-11-12 1996-09-19 Winfried Dr In Schimmelpfennig Image recognition device for blind and visually impaired
JPH08297465A (en) 1995-04-26 1996-11-12 Hiroshi Yamamoto Optic nerve video output device and its method
IL120840A (en) * 1997-05-16 2000-09-28 Planop Planar Optics Ltd Distant aiming apparatus particularly for a firearm

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4751507A (en) * 1984-07-23 1988-06-14 International Business Machines Corporation Method for simultaneously displaying an image and an enlarged view of a selectable portion of the image with different levels of dot detail resolution
US5761485A (en) * 1995-12-01 1998-06-02 Munyan; Daniel E. Personal electronic book system
US6442431B1 (en) * 1998-07-27 2002-08-27 Axon Engineering, Inc., Device and method for production of visual sensations by optic nerve stimulation

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080161915A1 (en) * 2006-12-29 2008-07-03 Qiushi Ren System for creating visual images
CN107995391A (en) * 2017-11-28 2018-05-04 信利光电股份有限公司 A kind of ocular prosthesis and electronic equipment

Also Published As

Publication number Publication date
US20040127956A1 (en) 2004-07-01
US6658299B1 (en) 2003-12-02

Similar Documents

Publication Publication Date Title
US6658299B1 (en) Artificial system for vision and the like
US4528989A (en) Screening method for monitoring physiological variables
CN206214373U (en) Object detection from visual information to blind person, analysis and prompt system for providing
CN1322445C (en) Hands-free, portable computer and system
US10780272B2 (en) Visual prosthesis fitting
EP1488618B1 (en) Multifunctional mobile phone for medical diagnosis and rehabilitation
CN111202663B (en) Vision training learning system based on VR technique
CA2094650C (en) Apparatus for analyzing depth perception
CA2368232A1 (en) Pupilometer and method for detecting a neurological condition
US20100151426A1 (en) Electric tactile display
CA2261647A1 (en) Visual field testing method and apparatus
EP0743051A2 (en) Apparatus and method for providing an image output to optic nerves
KR20090105531A (en) The method and divice which tell the recognized document image by camera sensor
Patterson et al. Temporal integration differences between crossed and uncrossed stereoscopic mechanisms
CN107648719A (en) The eye wearable system stimulated based on fatigue detecting with awakening
DE19642830A1 (en) Method of stopping person falling asleep esp to stop car or boat driver from dozing off
Hoang et al. Obstacle detection and warning for visually impaired people based on electrode matrix and mobile Kinect
WO1997015033A2 (en) Method and device for preventing drivers, etc. from falling asleep and for monitoring people's reactions
EP1392156B1 (en) Apparatus and method for testing visual response
Boyle et al. Challenges in digital imaging for artificial human vision
WO1998052309A1 (en) Method and device for measuring the attention of living organisms in a plurality of living organisms
BOWD et al. Enduring stereoscopic motion aftereffects induced by prolonged adaptation
KR20220056652A (en) recognition rehabilitation training system and method thereof
Boyle et al. Image enhancement for electronic visual prostheses
CN205356513U (en) Special tiepin formula camera module of blind person's image touch sensing device

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION