WO2002007072A2 - Touch panel display system - Google Patents

Touch panel display system Download PDF

Info

Publication number
WO2002007072A2
WO2002007072A2 PCT/NZ2001/000146 NZ0100146W WO0207072A2 WO 2002007072 A2 WO2002007072 A2 WO 2002007072A2 NZ 0100146 W NZ0100146 W NZ 0100146W WO 0207072 A2 WO0207072 A2 WO 0207072A2
Authority
WO
WIPO (PCT)
Prior art keywords
display screen
energy beams
touch
touch panel
emitters
Prior art date
Application number
PCT/NZ2001/000146
Other languages
French (fr)
Other versions
WO2002007072A3 (en
Inventor
John David Newton
Original Assignee
Next Holdings Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Next Holdings Limited filed Critical Next Holdings Limited
Priority to AU2001282713A priority Critical patent/AU2001282713A1/en
Publication of WO2002007072A2 publication Critical patent/WO2002007072A2/en
Publication of WO2002007072A3 publication Critical patent/WO2002007072A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen

Definitions

  • the present invention relates generally to a touch panel display system that displays information and allows a user to interact with the system by touching on or near the displayed information. More particularly, the present invention relates to a touch panel display system that includes energy emitters for emitting energy beams across the surface of a display screen and detectors for detecting the energy beams, a touch of the display surface causing an interruption of the energy beams.
  • Touch panel display screens allow a user to touch an area of a display screen to supply a command to a computer system associated with the display screen, and hence control the operation of the computer system.
  • a touch panel display screen can provide an intuitive method by which people can easily interact with and control certain functions performed by a computer system.
  • a touch panel display screen can display icon elements representing a keyboard to allow the user to key in text to the associated computer system.
  • An interactive graphical representation of a keyboard eliminates the need to configure the computer system with a physical keyboard and/or other peripheral input devices (eg a mouse).
  • Touch panel display screens can be produced in a range of different types and sizes and can be used in a wide variety of systems, such as kiosks, personal computer systems, portable consumer electronics (eg cellular telephones, personal digital assistants or hand held computers, video game devices, etc.) domestic appliances, vehicles information systems (eg GPS locators), and industrial equipment or tools. Businesses can use touch panel display screens to display information to potential customers, and to receive feedback or commands from these customers as to what other information they require. Touch panel display systems can also be used to facilitate business and/or consumer transactions. However as compared with regular (non-touch panel) display devices, touch panel display systems are relatively expensive and time consuming to produce and are thus not widely used.
  • One type of touch panel display system can be constructed by capacitance forming elements formed integrally into the display screen. The user placing a finger or stylus on the display screen will change the capacitance in a particular region of the display screen, thereby indicating to the computer system which area of the display screen has been touched.
  • Other types of touch panel displays transmit energy beams across the face of the display screen. These beams are transmitted in an arrangement of columns and rows. When a finger or stylus interrupts a beam from one column to one row, the computer system can detect which area of the display screen has been touched.
  • Touch panel display systems that emit beams of energy across the face of the display screen are also highly susceptible to component failure. Such a system will not be able to accurately detect the touch of a user in an area of the display screen that is covered by a failed emitter and/or a failed detector. A failed emitter and/or detector can also result in the system being unable to detect any touches at all in a particular area of the display screen. Furthermore, if the emitters or detectors become dirty, their ability to detect or transmit energy beams will be impaired and will lead to the same problems as if the components had failed.
  • a large number of energy emission and detection components may also be required if the system is to have a reasonable degree of accuracy in determining the location of a touch on the display.
  • the resolution or smallest area within which the system can detect a touch will be determined by the number of energy beams transmitted across the screen, and how close these beams are to one another. If the system needs to detect the touch of a smaller element, such as a stylus, then large numbers of energy beam emitters and detectors will need to be incorporated into the display system. This increased component count will correspondingly increase the cost of manufacturing the display.
  • a touch panel display system that has a reduced susceptibility to component failure or dirt build-up on components and which also reduces the number of components required to implement the display system.
  • an improved touch panel display system having reduced susceptibility to component failure or dirt build-up that may be incorporated into any type of system employing a display device.
  • an improved touch panel display system that may be retro-fitted to an existing non-touch panel display device or be provided as an after market product.
  • Display screens can now also be found in a number of vehicles information systems, (such as GPS locators) and also in industrial equipment or tools which need to display information to and receive instructions from a user.
  • vehicles information systems such as GPS locators
  • an improved display system which could work with any number of a range of different types of technology used to implement a display and which also allowed for the implementation of a touch panel display system would be of advantage.
  • an improved display system that could be retro fitted to an existing display or be provided as an after market product would also be of advantage.
  • a touch panel display system which includes
  • the present invention provides a touch panel display system that allows user interaction therewith through a touch panel display screen.
  • the touch panel display system of the present invention may be designed to include a minimal number of components, so as to reduce the system's susceptibility to inaccuracies due to component failures or dirty components.
  • the present invention may be used in conjunction with any size touch panel display screen, eg from centimetres across upwards of several metres wide if desired.
  • the present invention may also be implemented with numerous different types of display screen technology.
  • a touch panel display system which includes at least one display surface, a plurality of energy emitters, and a plurality of detectors, whereby said plurality of detectors are adapted to receive energy emitted from said energy emitters over a range of angles.
  • a method of operating a touch panel display system characterised by the steps of: displaying an image inviting a command from a user, emitting energy from at least one energy emitter, and detecting the energy emitted from said at least one emitter using a detector adapted to detect said emitted energy over a range of angles, and detecting an interruption of said energy by the user, and determining the area or location on the display surface adjacent to where the user interrupted the energy emitted by said at last one energy emitter.
  • a method of operating a touch panel display system characterised by the steps of: displaying an image inviting a command from a user, and emitting energy from at least one energy emitter, and detecting the energy emitted from said at least one emitter using a detector adapted to detect said emitted energy over a range of angles, and detecting the interruption by the user of at least two pairs of intersecting energy beams, and calculating the angle of intersection between each of the pairs of intersecting energy beams, and determining the point of intersection of each of the pairs of intersecting energy beams, and determining the area or location on the display surface adjacent to where the user interrupted the said pairs of intersecting beams using the intersection angle and intersection point of each of the pairs of intersecting energy beams.
  • a user may touch near the information displayed by the display screen, which will interrupt at least one energy beam.
  • the interruption of an energy beam will cause a detector to either not detect the interrupted energy beam to the emitter, or alternatively may cause the detector to detect the interrupted energy beam being reflected from the touching object, with the emitted energy beam reflected or bounced back onto a detector adjacent to or associated with the energy emitter involved.
  • the interruption of at least two energy beams may be used to calculate the touch position involved. By making a comparison of which of the emitted energy beams were interrupted at approximately the same time a calculation can be made of where the touch on the screen occurred.
  • more than one interrupted and reflected energy beam may be used to calculate a position value of the touching object.
  • the calculations employed to determine the touch location may be similar to those used when the obstruction of an energy beam is detected and employed to calculate touch location.
  • Figure 1 is a block diagram illustrating a top schematic view of a touch panel display system implemented in accordance with an exemplary embodiment of the present invention
  • Figure 2 is a block diagram illustrating a touch panel display system in accordance with an exemplary embodiment of the present invention
  • Figure 3 is a block diagram illustrating the paths across the surface of a touch panel display device in which energy beams in accordance with an exemplary embodiment of the present invention
  • Figure 4 is a flow chart illustrating an exemplary method for calculating a touch point location on a touch panel display screen in accordance with an exemplary embodiment of the present invention.
  • the present invention provides a touch panel display system that is adapted to detect user feedback commands using a reduced number of components.
  • a touch panel display system of the present invention may employ one or more emitters that are adapted to emit beams of energy to be channelled across the face of the touch panel display screen. The energy beams emitted by the emitters may be invisible to the human eye and may be of a power or frequency that will not cause health problems in a user.
  • a touch panel display system may also include one or more detectors that are adapted to detect and receive the energy beams generated by the emitters. Those skilled in the art should appreciate that the type of detector involved will be determined by the type of energy emitted by each of the energy emitters. Examples of energy types that may be used in the present invention include, but are not limited to, infrared, visible light, microwave radiation, and acoustic energy.
  • a touch panel display system of the present invention includes at least one touch panel display screen and any other hardware and/or software components necessary for detecting and calculating the location of a touch thereon.
  • a touch panel display screen may be adapted to display information in the form of static images, video images, text or any other type of graphics.
  • the information displayed by a touch panel display screen may be used to inform a user of the system and/or form part of a user interface.
  • the user may interact with the user interface to instruct the system to perform a function or task.
  • the touch panel display screen may be used to display advertising material to a user and may also display images to assist in the completion of a financial transaction.
  • User feedback commands can be provided by way of the user touching with a stylus, finger or other pointing device, a selected area of the touch panel display screen that indicates a desired function or portion of the displayed information.
  • a finger, stylus or other pointing device placed on or adjacent to the touch panel display screen will interrupt the energy beams emitted by the emitters.
  • the detectors may generate signals from which the touch panel display system is able to calculate the location of the touch on the touch panel display screen.
  • the detectors used to create the touch panel display surface are adapted to detect energy beams over a range of angles.
  • the present invention eliminates the need to provide a horizontal/vertical grid of emitters and detectors having a one-to-one ratio of detectors to emitters.
  • a touch panel display system of the present invention may be constructed using fewer detectors and/or emitters, without sacrificing sensitivity or accuracy.
  • a reduced number of detectors and/or emitters may reduce the overall costs of the touch panel display system and its susceptibility to failure and dirt build-up.
  • FIG. 1 is a block diagram illustrating a top schematic view of a touch panel display screen 100 in accordance with a an exemplary embodiment of the present invention.
  • a touch panel display screen 100 comprises a display screen 102 configured with hardware and/possibly software components for detecting a touch provided by a user.
  • the display screen 102 may be, for example, a liquid crystal display (“LCD”) screen.
  • LCD liquid crystal display
  • display screen examples include cathode ray technology, polysilicon thin film transistor ("TFT"), super twisted nematic (“STN”), twist nematic (“TN”), plasma display panels (“PDP”), or electro-luminescence display technology.
  • TFT polysilicon thin film transistor
  • STN super twisted nematic
  • TN twist nematic
  • PDP plasma display panels
  • electro-luminescence display technology examples include vacuum fluorescent displays, field emission displays, digital micro metre devices or light emitting diodes display technology.
  • plasma addressed liquid crystal displays, anti ferroelectric liquid crystal displays, and also ferroelectric liquid crystal displays can all also be used to provide a display screen in conjunction with the present invention.
  • the display screen 102 may be a component of any number of different types of computing devices. This display screen 102 may form part of, for example, a laptop computer or a wireless application protocol enabled cellular or digital phone display. A wide number and range of applications are envisioned for the present invention and discussion of particular applications throughout this specification should in no way be seen as limiting.
  • a display screen 102 may also be a surface for mounting a graphic, such as a poster, bill or other static image. Such an embodiment may be used in simple applications, where the information provided to the user remains constant over certain periods of time. For example, in an exemplary embodiment, a static image (eg a poster or other signage) associated with a taxi company may be displayed on the display screen 102 and the user may touch the display screen 102 in order to generate a request for a taxi pick-up.
  • a static image eg a poster or other signage
  • the touch panel display system of the present invention may include one display screen 102.
  • One single display screen 102 may be adequate for most applications of the present invention, where existing computer technology can be used to control the images or graphics that are displayed on different portions of the display screen 102.
  • any number of display screens may be used in conjunction with the present invention, and reference to a single display screen throughout this specification should in no way be seen as limiting.
  • a display screen 102 can be described as being a standard rectangular or square display screen commonly used in existing computer systems, but again this should in no way be seen as limiting.
  • the present invention may be adapted for implementation with a display screen 102 of any shape or configuration.
  • a display screen 102 of the present invention may be surrounded by a plurality of emitters 106, such as infrared emitters, and a plurality of detectors 109, such as infrared detectors.
  • emitters 106 such as infrared emitters
  • detectors 109 such as infrared detectors.
  • infrared radiation can be emitted at low power or low energy in a focused linear beam that is invisible to normal human vision.
  • Infrared emitters and detectors are well known in the art and can be purchased and installed within a touch panel display screen 100 of the present invention at relatively low cost.
  • other forms of energy may be used in conjunction with the present invention and reference to infrared throughout this specification should in no way be seen as limiting.
  • visible light, microwave energy or even acoustic waves may potentially be emitted and detected in accordance with the present invention.
  • a touch panel display screen 100 of the present invention may include at least one energy emitter 106 that is adapted to emit beams of energy to be channelled across the face of the display screen 102.
  • a touch panel display screen 100 of the present invention includes at least two emitters 106 that emit intersecting energy beams, so that a position at which both energy beams are interrupted can be calculated to determine the location at which user touched the display screen.
  • Each emitter 106 may be adapted to emit a single energy beam that diverges out from the location of the emitter 106 across an area of the display screen 102.
  • Figure 1 shows a number of ray lines 107 of the diverging beams emitted by two of the emitters 106a and 106b.
  • Each emitter 106 may be adapted to diverge an emitted energy beam to cover a particular area of the display screen 102, so as to ensure that each energy beam can be detected by more than one detector 109 positioned around the edges of the display screen 102.
  • the touch panel display screen 100 of the present invention also includes at least one detector 109 adapted to receive and detect an energy beam generated by an emitter 106.
  • a detector 109 in accordance with the present invention is adapted to receive and detect a ray 107 of an energy beam that is directed towards it at an incident angle.
  • a detector 109 may be capable of receiving energy beams transmitted to it over a range of angles, as opposed to merely receiving energy beams transmitted directly at it or at 90° to the edge of the display screen 102 on which it is mounted.
  • a detector 109 may be able to detect an energy beam transmitted to it over a range of angles from zero to 180°.
  • a number of detectors 109 are arranged or positioned around the edges of the display screen 102 in such a manner as to ensure that all the energy beams generated by emitters 106 can be received and detected by the detectors 109.
  • the location of a touch may be calculated through the blocking of energy beams which in normal circumstances would be received and detected by at least one detector. The absence of such detection signals can then indicate that the display system has been touched. Through analysing which detectors are not receiving energy beams the location of the touch can be calculated.
  • a touch on the display system may be detected through reflection of energy beams from the object touching the screen. The original energy emitted may be reflected back towards or close to the original energy beam emitter to be received by an appropriate detector.
  • such detectors may also record the time taken for the energy beam to travel from the emitter, to be reflected, and then to be received by the detector to calculate the distance between the detector and the touching object.
  • a calculation of the position of the touch on the system may be made.
  • a detector may also be formed from an imaging system or imaging components such as charge couple devices normally employed in camera systems.
  • the output from such detector systems may be progressively scanned ("line scanned") to detect the presence of an energy beam at particular portions of the area in view of the detector at selected periods of time.
  • the actual number and positioning of the detectors 109 may be dictated by the geometry of the display screen 102, the angles at which each detector 109 can receive an energy beam, and the number of emitters 106 positioned around each side of the display screen 102.
  • Each detector 109 may be used to receive and detect energy beams transmitted by a number of different emitters 106, thereby reducing the number of components that are required to detect all energy beams generated by the emitters 106.
  • each side of the display screen 102 may include, or have located adjacent to it, two detectors 109.
  • the emitters 106 may be activated according to a particular cycle. For example, each of the emitters 106 positioned around the edge of the display screen 102 may be activated in a relatively rapid sequence. Activating the emitters 106 in a relatively rapid sequence help to ensure that a single touch by a user on or adjacent to the display screen 102 will interrupt the energy beams emitted by several different emitters 106, where each of the interrupted energy beams are emitted at different times. Cyclical activation of the emitters 106 can be used to either increase the sensitivity or resolution of the touch panel display system or to potentially reduce the number of emitters 106 required to accurately detect the user's touch on the display screen 102.
  • Each emitter 106 may be configured to emit an energy beam to several detectors 109 at a set time. Detectors 109 incorporated into the present invention may then be used to build a detection map indicating which detectors 109 should be receiving energy beams from particular emitters 106 at any point in time. This configuration of both the emitters 106 and detectors 109 can be used to either substantially reduce the number of components used to implement a touch panel display system without compromising its accuracy, or alternatively may be used to improve the resolution or accuracy of such a touch panel display system. The activation of each of the emitters 106 may be timed so that only a limited number of emitters 106 emit energy beams across the display screen 102 at one particular point in time.
  • the emitters 106 and detectors 109 may be configured such that a finger or stylus placed on or adjacent to the display screen 102 will interrupt two or more of the rays 107 with the interruption of these rays being detected by one or more of the detectors 109.
  • Each detector 109 may be connected via a cable or wiring harness 110 to a computing device (see Figure 2) which may execute one or more software program modules for controlling the emitters 106 and detectors 109, calculating the position of a user's touch on the display screen 102, and controlling the display of information on the display screen 102.
  • the computing device may be configured to determine the location of the display screen 102 that was touched and hence which portion of the displayed information a user of the system was attempting to interact with. In response to determining the portion of the displayed information that the user was attempting to interact with, the computing device may, for example, be configured to supply additional information to the user or receive information from the user.
  • FIG. 2 is a block diagram illustrating an exemplary touch panel display system in accordance with an exemplary embodiment of the present invention.
  • the touch panel display system comprises a computing device 200 functionally coupled to a touch panel display screen 100.
  • the computing device 200 used in conjunction with the present invention may be any type of processor-driven device 200, such as a personal computer, a laptop computer, a handheld computer, a personal digital assistant (PDA), a digital and/or cellular telephone, a pager, a video game device, etc.
  • PDA personal digital assistant
  • processors will be apparent to one of ordinary skill in the art.
  • the term "processor” is meant to refer to any type of programmable logic device, including a microprocessor and any other type of similar device.
  • the computing device 200 may include, for example, a processor 202 a system memory 204 and various system interfaces 206.
  • the processor 202, system memory 204 and system interfaces 206 may be functionally connected via a system bus 208.
  • the system interfaces enable the processor 202 to communicate with peripheral devices.
  • a storage interface 210 provides an interface between the processor 202 and a storage device 211 (removable and/or non-removable), such as a disk drive.
  • a network interface 212 may optionally be provided as an interface between the processor 202 and a network communications device (not shown), so that the computing device 200 may be connected to a network.
  • a display screen interface 214 provides an interface between the processor 202 and a display screen 102.
  • I/O port interfaces 216 may be provided as interfaces between the processor 202 and various input devices and/or various output devices.
  • the detectors 109 of the touch panel display screen 100 may be connected to the computing device 200 by way of an input port and may provide input to the processor 202 via an input port interface.
  • the emitters 106 of the touch panel display screen 100 may be connected to the computing device 200 by way of an output port and may receive output from the processor 202 via an output port interface.
  • a number of program modules may be stored in the system memory 204 and any other computer-readable medium associated with a storage device 211 (eg a hard disk drive), including an operating system 217.
  • a storage device 211 eg a hard disk drive
  • Certain aspects of the present invention may be embodied in an "Information Display” program module 219 comprising computer-executable instructions of for displaying images or other information on display screen 102.
  • Other aspects of the present invention may be embodied in a "Touch Panel Control" program module 221 for controlling the emitters 106 and detectors 109 of a touch panel display screen 100 and for calculating touch positions on the display screen 102 based on signals received from the detectors 109.
  • the images or other information displayed by the "Information Display” program module 219 may be store in one or more information data files 223 stored on any computer readable medium associated with the computing device 200.
  • the processor 202 controlled by the operating system, may be configured to execute the computer-executable instructions of the "Information Display” program module 215, the "Touch Panel Control” program module 217, and/or other program modules in order to perform or facilitate the methods of the present invention.
  • the processor 202 may execute computer-executable instructions for determining or receiving information from each detector 109 when a beam of energy is received.
  • the processor 202 may also be adapted to determine when the user has attempted to touch an element or graphic displayed on the display screen 102.
  • the processor 202 may be configured to determine which of the energy beams transmitted across the face of the display screen 102 are interrupted by the user's finger, pen, stylus or other element.
  • the processor 202 may monitor activation of the emitters 106 and energy beam detection signals generated by the detectors 109 in order to build a profile or "detection map" indicating which detectors 109 receive energy beams at any particular time.
  • One or more detection maps may be stored in the system memory 204 or on any other computer-readable medium associated with the computing device 200.
  • the processor 202 may determine the absence of an expected detection signal by comparing a detection map created at the time of the touch to one or more detection maps created when the display screen 102 was not being touched. Based on information regarding the interrupted energy beam(s), the processor 202 may be configured to calculate or determine the location of the user's touch on or in proximity to the display screen 102. Exemplary methods for calculating or determining the location of a user's touch on or in proximity to the display screen 102 will be described below with reference to Figure 3 and Figure 4.
  • detection maps and the cyclical divergence of energy beams across the display screen 102 improves the tolerance of the touch panel display system to component failure or dirt build- up on emitters 106 or detectors 109.
  • detection maps may be created which will take into account any failed or malfunctioning detectors or emitters.
  • the processor 202 may determine that a continued absence of a detection signal by one or more detectors is not the result of temporary energy beam interruption caused by a touch.
  • exemplary embodiment of the present invention may have an inherent robustness and redundancy that will allow the touch panel display system to continue to function effectively even if one or more emitters 106 or detectors 109 fails.
  • the "Information Display” program module 215 and the “Touch Panel Control” program module 217 are described herein by way of illustration only. Functionality of the present invention may be provided by way of any type and number of program modules, created in any programming language, which may or may not be stored locally at the computing device 200.
  • the computing device 200 may comprise a network server, client, or appliance that may be configured for executing program modules (eg 215 and 217) that are stored on another network device and/or for controlling a remotely located touch panel display screen 100.
  • the touch panel display screen 100 of the present invention may provide an intuitive control interface for any computing device that can easily detect the position of a display screen 102 that has been touched by a user.
  • Figure 3 is a block diagram illustrating a touch panel display screen 100 that has been touched by a user.
  • a touch is illustrated by a touch position 300.
  • Ray lines 107 show the paths across the surface of the display screen 102 in which a number of energy beams may travel.
  • a first emitter 106a is transmitting a first ray 107a across the face of the display screen 102
  • a second emitter 106b is transmitting a second ray 107b across the face of the display screen 102
  • a third emitter 106c is transmitting a third ray 107c across the face of the display screen 102
  • a fourth emitter 106d is transmitting a fourth ray 107d across the face of the display screen 102.
  • Each of the four rays 107a-d represents a portion of an energy beam that is diverged across the touch screen 102.
  • the energy beams are each interrupted by the user's touch at touch position 300, causing the rays 107a-d to not be detected by the corresponding detectors 109a-d.
  • a determination may be made as to which beams (represented by rays 107a-d) have been interrupted. Then, all of the interrupted beams may be examined to identify each pair of intersecting beams. As shown in the figure, the first ray 107a intersects the second ray 107b at a first intersection point 310a creating a first angle of intersection 322a, intersects the third ray 107c at a second intersection point 310b creating a second angle of intersection 322b and intersects the fourth ray 107d at a third intersection point 310c creating a third angle of intersection 322c.
  • the second ray 107b intersects the third ray 107c at a fourth intersection point 310d creating a fourth angle of intersection 322d and intersects the fourth ray 107d at a fifth intersection point 310e creating a fifth angle of intersection 322e.
  • the third ray 107c intersects the fourth ray 107d at a sixth intersection point 3 lOf creating a sixth angle of intersection 322e.
  • the six intersection points 310a-f are located at various distances relative to the touch position 300.
  • the first intersection point 310 is further from the touch point 300 than the third intersection point 310c because the first angle of intersection 322a between the first ray 107a and the second ray 107b is smaller than the sixth angle of intersection 322f between the third ray 107c and the fourth ray 107d.
  • intersection points 310a-f and the corresponding angles of intersection between each pair of intersection rays 107a-d may be used to calculate the position of the touch point 300 on the display screen 102.
  • Cartesian coordinates (X,Y) of each intersection point 310a-f may be determined.
  • the Cartesian coordinates of each intersection point 310a-f may then be multiplied by the corresponding angle of intersection (eg expressed in radians).
  • the resulting products may be added together and divided by the sum (eg expressed in radians) of all the angles of intersection 322a-f. The result of such a calculation will represent a weighted average location value for the touch point 300.
  • FIG. 4 is a flow chart illustrating an exemplary method 400 for calculating the location of a touch on a touch panel display screen 100 in accordance with an exemplary embodiment of the present invention.
  • the method 400 begins at starting block 401, where a user touches a touch panel display screen 100.
  • the energy beams interrupted by the user's touch are identified. For example, based on detection signals from detectors 106, a detection map may be created and compared to one or more previously stored detection maps in order to identify the energy beams that are interrupted by the touch. In a preferred embodiment, at least two pairs of energy beams are interrupted by the touch.
  • the emitters 106 of the present invention may be activated such that the energy beams are diverged across the face of the display screen 102 in a cyclical manner.
  • the emitter activation cycle may have a frequency that ensures that a typical touch will cause the interruption of at least two pairs of intersecting energy beams. In other words the emitter activation cycle may be fast enough such that four emitters 106 will transmit an energy beam across the touch screen 102 during the duration of a typical touch.
  • the detection by multiple detectors 109 of "shadows" (ie the absence of an energy beam) caused by a touch can be used to determine the location on the display screen 102 where the touch occurred.
  • the interrupted energy beams are examined to identify all pairs of intersecting interrupted energy beams. Then, at step 406, the angle of intersection between each pair of intersecting interrupted energy beams is calculated. Next at step 408, the intersection point of each pair of intersecting interrupted energy beams is located. For example, a Cartesian coordinate system may be assigned to the display screen 102 and the coordinates of each intersection point may be determined. At step 410, the location of the touch on the display screen 102 is determined based on an average of the intersection point positions optionally weighted based on angle of intersection. By way of illustration, each intersection point can be considered to represent a possible location of the touch point on the display screen 102.
  • the coordinates of each intersection point may be summed together and divided by the total number of intersection points in order to obtain average coordinate values (X averages Y average ).
  • the average coordinate values may provide an adequate estimation of the location of the touch point on the display screen 102.
  • the angle of intersection corresponding to each intersection point may be used to weight the calculation of average intersection point coordinates.
  • the coordinates of each intersection point may be multiplied by the angle of intersection (eg expressed in radians) corresponding to that intersection point.
  • Each angle of intersection and intersection point product may be added together and the resulting sum may be divided by a summation of all the angles of intersection (eg expressed in radians) to arrive at the coordinated of a weighted average intersection point.
  • the weighted average intersection point may provide a more accurate estimation of the location of the touch point on the display screen 102. Intersecting interrupted energy beams having a small angle of intersection will converge and diverge from one another slowly, which can result in an inaccurate estimation of the location of the touch point.
  • the present invention provides many potential advantages over existing prior art systems.
  • Emitters may be provided that are configured to diverge energy beams across a number of different areas of a display screen.
  • Detectors may also be provided that are adapted to receive energy beams over a wide range of angles.
  • the present invention may provide a touch panel display system that may be implemented with a minimal number of components.
  • the present invention's ability to detect diverging energy beams across the face of a display screen can provide improved resolution, accuracy and resistance to component failures when a sufficient number of emitters and detectors used. By gathering energy beam detection signals from the detectors over time, the present invention may continue to function accurately if one or more components fail, or if any emitters or detectors are covered in dirt or dust.
  • the present invention may also be used with a wide range of different types of display screens. Any display screen that can display an image to a user can be used in conjunction with a touch panel display system of the present invention.
  • a touch panel display screen of the present invention may be produced in a factory situation where an original display screen is manufactured.
  • the touch panel functionality of the present invention may be incorporated into an after-market product that may be adapted to be fitted to an existing display screen already owned by a user.
  • a processor may be incorporated into a touch panel product and may be interfaced with existing components of the display screen.
  • a retro-fitted touch panel system may harness a processor that pre-exists in the existing display screen.
  • the improved touch panel functionality provided by the present invention gives it the ability to improve on a number of different types of devices that employ display screens.
  • devices that may incorporate display screens with which the present invention may be used include: cellular phones, personal digital assistants or hand held computers, lap top computers, telephones, calculators, televisions, standard computers, appliances and tools of all shapes and forms, games machines, security devices, information kiosks, vehicle information systems, medical equipment, testing equipment, and commercial point of sale devices.
  • a touch panel display system of the present invention may provide an intuitive and easily understood interface to control the functions or operations of any of these and other devices.

Abstract

Emitters and one or more detectors are positioned in proximity to a display screen. Emitters emit energy beams that are diverged across the surface of the display screen. Emitters may be activated/deactivated in sequence, rapid enough to substantially ensure that several energy beams are interrupted by a touch of the display screen. Detectors receive energy beams over a range of angles and generate detection signals upon detecting energy beams. Detection maps are generated based on detection signals. Detection maps indicate which detector sould receive an energy beam from which emitter at any point in time. Detection maps are compared to determine that energy beams have been interrupted by a touch. Based on the interrupted energy beams, the location of the touch on the display screen may be determined. The invention serves to reduce the number of emitters and detectors required in touch panel display system and/or increase the sensitivity and accuracy thereof.

Description

TOUCH PANEL DISPLAY SYSTEM
TECHNICAL FIELD
The present invention relates generally to a touch panel display system that displays information and allows a user to interact with the system by touching on or near the displayed information. More particularly, the present invention relates to a touch panel display system that includes energy emitters for emitting energy beams across the surface of a display screen and detectors for detecting the energy beams, a touch of the display surface causing an interruption of the energy beams.
BACKGROUND ART
Touch panel display screens allow a user to touch an area of a display screen to supply a command to a computer system associated with the display screen, and hence control the operation of the computer system. A touch panel display screen can provide an intuitive method by which people can easily interact with and control certain functions performed by a computer system. Furthermore, a touch panel display screen can display icon elements representing a keyboard to allow the user to key in text to the associated computer system. An interactive graphical representation of a keyboard eliminates the need to configure the computer system with a physical keyboard and/or other peripheral input devices (eg a mouse).
Touch panel display screens can be produced in a range of different types and sizes and can be used in a wide variety of systems, such as kiosks, personal computer systems, portable consumer electronics (eg cellular telephones, personal digital assistants or hand held computers, video game devices, etc.) domestic appliances, vehicles information systems (eg GPS locators), and industrial equipment or tools. Businesses can use touch panel display screens to display information to potential customers, and to receive feedback or commands from these customers as to what other information they require. Touch panel display systems can also be used to facilitate business and/or consumer transactions. However as compared with regular (non-touch panel) display devices, touch panel display systems are relatively expensive and time consuming to produce and are thus not widely used.
One type of touch panel display system can be constructed by capacitance forming elements formed integrally into the display screen. The user placing a finger or stylus on the display screen will change the capacitance in a particular region of the display screen, thereby indicating to the computer system which area of the display screen has been touched. Other types of touch panel displays transmit energy beams across the face of the display screen. These beams are transmitted in an arrangement of columns and rows. When a finger or stylus interrupts a beam from one column to one row, the computer system can detect which area of the display screen has been touched.
Touch panel display systems that emit beams of energy across the face of the display screen are also highly susceptible to component failure. Such a system will not be able to accurately detect the touch of a user in an area of the display screen that is covered by a failed emitter and/or a failed detector. A failed emitter and/or detector can also result in the system being unable to detect any touches at all in a particular area of the display screen. Furthermore, if the emitters or detectors become dirty, their ability to detect or transmit energy beams will be impaired and will lead to the same problems as if the components had failed.
In touch panel display screens that employ beams of energy transmitted across the face of the display screen, a large number of energy emission and detection components may also be required if the system is to have a reasonable degree of accuracy in determining the location of a touch on the display. The resolution or smallest area within which the system can detect a touch will be determined by the number of energy beams transmitted across the screen, and how close these beams are to one another. If the system needs to detect the touch of a smaller element, such as a stylus, then large numbers of energy beam emitters and detectors will need to be incorporated into the display system. This increased component count will correspondingly increase the cost of manufacturing the display. Accordingly, there remains a need for a touch panel display system that has a reduced susceptibility to component failure or dirt build-up on components and which also reduces the number of components required to implement the display system. There is a further need for an improved touch panel display system having reduced susceptibility to component failure or dirt build-up that may be incorporated into any type of system employing a display device. There is yet a further need for an improved touch panel display system that may be retro-fitted to an existing non-touch panel display device or be provided as an after market product.
Different types and sizes of display screen are becoming more commonly in day to day life. Cellular telephones, personal digital assistants or hand held computers, games machines and even domestic appliances now incorporate a range of different types and sizes of display screens. Display screens can now also be found in a number of vehicles information systems, (such as GPS locators) and also in industrial equipment or tools which need to display information to and receive instructions from a user. Preferably an improved display system which could work with any number of a range of different types of technology used to implement a display and which also allowed for the implementation of a touch panel display system would be of advantage. Furthermore an improved display system that could be retro fitted to an existing display or be provided as an after market product would also be of advantage.
DISCLOSURE OF INVENTION
According to one aspect of the present invention there is provided a touch panel display system which includes
at least one display surface, and
a plurality of energy emitters, and
at least one detector,
whereby said detector is adapted to receive energy emitted from said energy emitters over a range of angles. The present invention provides a touch panel display system that allows user interaction therewith through a touch panel display screen. Preferably, although optionally, the touch panel display system of the present invention may be designed to include a minimal number of components, so as to reduce the system's susceptibility to inaccuracies due to component failures or dirty components. Those skilled in the art should appreciate that the present invention may be used in conjunction with any size touch panel display screen, eg from centimetres across upwards of several metres wide if desired. The present invention may also be implemented with numerous different types of display screen technology.
According to one aspect of the present invention there is provided a touch panel display system which includes at least one display surface, a plurality of energy emitters, and a plurality of detectors, whereby said plurality of detectors are adapted to receive energy emitted from said energy emitters over a range of angles. According to anther aspect of the present invention there is provided a method of operating a touch panel display system substantially as described above, characterised by the steps of: displaying an image inviting a command from a user, emitting energy from at least one energy emitter, and detecting the energy emitted from said at least one emitter using a detector adapted to detect said emitted energy over a range of angles, and detecting an interruption of said energy by the user, and determining the area or location on the display surface adjacent to where the user interrupted the energy emitted by said at last one energy emitter.
According to another aspect of the present invention there is provided a method of operating a touch panel display system substantially as described above, characterised by the steps of: displaying an image inviting a command from a user, and emitting energy from at least one energy emitter, and detecting the energy emitted from said at least one emitter using a detector adapted to detect said emitted energy over a range of angles, and detecting the interruption by the user of at least two pairs of intersecting energy beams, and calculating the angle of intersection between each of the pairs of intersecting energy beams, and determining the point of intersection of each of the pairs of intersecting energy beams, and determining the area or location on the display surface adjacent to where the user interrupted the said pairs of intersecting beams using the intersection angle and intersection point of each of the pairs of intersecting energy beams.
A user may touch near the information displayed by the display screen, which will interrupt at least one energy beam. The interruption of an energy beam will cause a detector to either not detect the interrupted energy beam to the emitter, or alternatively may cause the detector to detect the interrupted energy beam being reflected from the touching object, with the emitted energy beam reflected or bounced back onto a detector adjacent to or associated with the energy emitter involved.
In the case of the non-detection of an energy beam, preferably the interruption of at least two energy beams may be used to calculate the touch position involved. By making a comparison of which of the emitted energy beams were interrupted at approximately the same time a calculation can be made of where the touch on the screen occurred.
In yet another alternative embodiment where the reflection of an energy beam from a touching object is detected, more than one interrupted and reflected energy beam may be used to calculate a position value of the touching object. In such instances the calculations employed to determine the touch location may be similar to those used when the obstruction of an energy beam is detected and employed to calculate touch location.
Further aspects of the present invention will become apparent from the following description and with reference to the accompanying drawings.
BRIEF DESCRD?TION OF DRAWINGS
Figure 1 is a block diagram illustrating a top schematic view of a touch panel display system implemented in accordance with an exemplary embodiment of the present invention;
Figure 2 is a block diagram illustrating a touch panel display system in accordance with an exemplary embodiment of the present invention; and Figure 3 is a block diagram illustrating the paths across the surface of a touch panel display device in which energy beams in accordance with an exemplary embodiment of the present invention, and
Figure 4 is a flow chart illustrating an exemplary method for calculating a touch point location on a touch panel display screen in accordance with an exemplary embodiment of the present invention.
BEST MODES FOR CARRYING OUT THE INVENTION
The present invention provides a touch panel display system that is adapted to detect user feedback commands using a reduced number of components. A touch panel display system of the present invention may employ one or more emitters that are adapted to emit beams of energy to be channelled across the face of the touch panel display screen. The energy beams emitted by the emitters may be invisible to the human eye and may be of a power or frequency that will not cause health problems in a user. A touch panel display system may also include one or more detectors that are adapted to detect and receive the energy beams generated by the emitters. Those skilled in the art should appreciate that the type of detector involved will be determined by the type of energy emitted by each of the energy emitters. Examples of energy types that may be used in the present invention include, but are not limited to, infrared, visible light, microwave radiation, and acoustic energy.
A touch panel display system of the present invention includes at least one touch panel display screen and any other hardware and/or software components necessary for detecting and calculating the location of a touch thereon. A touch panel display screen may be adapted to display information in the form of static images, video images, text or any other type of graphics.
The information displayed by a touch panel display screen may be used to inform a user of the system and/or form part of a user interface. The user may interact with the user interface to instruct the system to perform a function or task. For example, in one embodiment the touch panel display screen may be used to display advertising material to a user and may also display images to assist in the completion of a financial transaction. User feedback commands can be provided by way of the user touching with a stylus, finger or other pointing device, a selected area of the touch panel display screen that indicates a desired function or portion of the displayed information. A finger, stylus or other pointing device placed on or adjacent to the touch panel display screen will interrupt the energy beams emitted by the emitters. In response to detecting the interruption of the energy beams, the detectors may generate signals from which the touch panel display system is able to calculate the location of the touch on the touch panel display screen.
In accordance with the present invention, the detectors used to create the touch panel display surface are adapted to detect energy beams over a range of angles. By employing detectors that can detect energy beams over a range of angles, the present invention eliminates the need to provide a horizontal/vertical grid of emitters and detectors having a one-to-one ratio of detectors to emitters. Thus, a touch panel display system of the present invention may be constructed using fewer detectors and/or emitters, without sacrificing sensitivity or accuracy. A reduced number of detectors and/or emitters may reduce the overall costs of the touch panel display system and its susceptibility to failure and dirt build-up.
The following description will hereinafter refer to the drawing, in which like numerals indicate like elements throughout the several figures. Figure 1 is a block diagram illustrating a top schematic view of a touch panel display screen 100 in accordance with a an exemplary embodiment of the present invention. A touch panel display screen 100 comprises a display screen 102 configured with hardware and/possibly software components for detecting a touch provided by a user. The display screen 102 may be, for example, a liquid crystal display ("LCD") screen. Those skilled in the art will appreciate, however, that any type of display screen may be used in conjunction with the present invention. By way of example only, other types of display screen that may be used in conjunction with the present invention include cathode ray technology, polysilicon thin film transistor ("TFT"), super twisted nematic ("STN"), twist nematic ("TN"), plasma display panels ("PDP"), or electro-luminescence display technology. In addition, vacuum fluorescent displays, field emission displays, digital micro metre devices or light emitting diodes display technology may also be used. The applicants also consider that plasma addressed liquid crystal displays, anti ferroelectric liquid crystal displays, and also ferroelectric liquid crystal displays can all also be used to provide a display screen in conjunction with the present invention.
The display screen 102 may be a component of any number of different types of computing devices. This display screen 102 may form part of, for example, a laptop computer or a wireless application protocol enabled cellular or digital phone display. A wide number and range of applications are envisioned for the present invention and discussion of particular applications throughout this specification should in no way be seen as limiting. A display screen 102 may also be a surface for mounting a graphic, such as a poster, bill or other static image. Such an embodiment may be used in simple applications, where the information provided to the user remains constant over certain periods of time. For example, in an exemplary embodiment, a static image (eg a poster or other signage) associated with a taxi company may be displayed on the display screen 102 and the user may touch the display screen 102 in order to generate a request for a taxi pick-up.
In a preferred embodiment the touch panel display system of the present invention may include one display screen 102. One single display screen 102 may be adequate for most applications of the present invention, where existing computer technology can be used to control the images or graphics that are displayed on different portions of the display screen 102. However, those skilled in the art should appreciate that any number of display screens may be used in conjunction with the present invention, and reference to a single display screen throughout this specification should in no way be seen as limiting. Furthermore, a display screen 102 can be described as being a standard rectangular or square display screen commonly used in existing computer systems, but again this should in no way be seen as limiting. The present invention may be adapted for implementation with a display screen 102 of any shape or configuration.
A display screen 102 of the present invention may be surrounded by a plurality of emitters 106, such as infrared emitters, and a plurality of detectors 109, such as infrared detectors. Those skilled in the art will appreciate that infrared radiation can be emitted at low power or low energy in a focused linear beam that is invisible to normal human vision. Infrared emitters and detectors are well known in the art and can be purchased and installed within a touch panel display screen 100 of the present invention at relatively low cost. However, it should be appreciated that other forms of energy may be used in conjunction with the present invention and reference to infrared throughout this specification should in no way be seen as limiting. For example, in other embodiments, visible light, microwave energy or even acoustic waves may potentially be emitted and detected in accordance with the present invention.
A touch panel display screen 100 of the present invention may include at least one energy emitter 106 that is adapted to emit beams of energy to be channelled across the face of the display screen 102. Preferably, a touch panel display screen 100 of the present invention includes at least two emitters 106 that emit intersecting energy beams, so that a position at which both energy beams are interrupted can be calculated to determine the location at which user touched the display screen. By having each emitter 106 transmit a beam of energy over different parts or areas of the display screen 102 the number of separate emitters 106 that need to be incorporated into the touch panel display screen 100 are substantially reduced compared to prior art touch panel designs.
Each emitter 106 may be adapted to emit a single energy beam that diverges out from the location of the emitter 106 across an area of the display screen 102. For the sake of clarity, Figure 1 shows a number of ray lines 107 of the diverging beams emitted by two of the emitters 106a and 106b. Each emitter 106 may be adapted to diverge an emitted energy beam to cover a particular area of the display screen 102, so as to ensure that each energy beam can be detected by more than one detector 109 positioned around the edges of the display screen 102.
The touch panel display screen 100 of the present invention also includes at least one detector 109 adapted to receive and detect an energy beam generated by an emitter 106. A detector 109 in accordance with the present invention is adapted to receive and detect a ray 107 of an energy beam that is directed towards it at an incident angle. Accordingly, a detector 109 may be capable of receiving energy beams transmitted to it over a range of angles, as opposed to merely receiving energy beams transmitted directly at it or at 90° to the edge of the display screen 102 on which it is mounted. In a preferred embodiment, a detector 109 may be able to detect an energy beam transmitted to it over a range of angles from zero to 180°. Those skilled in the art should appreciate that as the angle at which a beam strikes a detector 109 moves away from 90° relative to the surface on which the detector 109 is mounted, the strength or power of the energy beam involved would need to increase to ensure that the beam is detected.
Preferably, a number of detectors 109 are arranged or positioned around the edges of the display screen 102 in such a manner as to ensure that all the energy beams generated by emitters 106 can be received and detected by the detectors 109.
Numerous different configurations of such a touch panel display system are also envisioned. For example, in one instance the location of a touch may be calculated through the blocking of energy beams which in normal circumstances would be received and detected by at least one detector. The absence of such detection signals can then indicate that the display system has been touched. Through analysing which detectors are not receiving energy beams the location of the touch can be calculated. Alternatively, a touch on the display system may be detected through reflection of energy beams from the object touching the screen. The original energy emitted may be reflected back towards or close to the original energy beam emitter to be received by an appropriate detector. In some instances such detectors may also record the time taken for the energy beam to travel from the emitter, to be reflected, and then to be received by the detector to calculate the distance between the detector and the touching object. In combination with the same information from other detectors (or alternatively information with regard to the angle at which the energy beam is emitted from the emitter) a calculation of the position of the touch on the system may be made.
In some embodiments a detector may also be formed from an imaging system or imaging components such as charge couple devices normally employed in camera systems. The output from such detector systems may be progressively scanned ("line scanned") to detect the presence of an energy beam at particular portions of the area in view of the detector at selected periods of time. The actual number and positioning of the detectors 109 may be dictated by the geometry of the display screen 102, the angles at which each detector 109 can receive an energy beam, and the number of emitters 106 positioned around each side of the display screen 102. Each detector 109 may be used to receive and detect energy beams transmitted by a number of different emitters 106, thereby reducing the number of components that are required to detect all energy beams generated by the emitters 106. In an exemplary embodiment each side of the display screen 102 may include, or have located adjacent to it, two detectors 109.
The emitters 106 may be activated according to a particular cycle. For example, each of the emitters 106 positioned around the edge of the display screen 102 may be activated in a relatively rapid sequence. Activating the emitters 106 in a relatively rapid sequence help to ensure that a single touch by a user on or adjacent to the display screen 102 will interrupt the energy beams emitted by several different emitters 106, where each of the interrupted energy beams are emitted at different times. Cyclical activation of the emitters 106 can be used to either increase the sensitivity or resolution of the touch panel display system or to potentially reduce the number of emitters 106 required to accurately detect the user's touch on the display screen 102.
Each emitter 106 may be configured to emit an energy beam to several detectors 109 at a set time. Detectors 109 incorporated into the present invention may then be used to build a detection map indicating which detectors 109 should be receiving energy beams from particular emitters 106 at any point in time. This configuration of both the emitters 106 and detectors 109 can be used to either substantially reduce the number of components used to implement a touch panel display system without compromising its accuracy, or alternatively may be used to improve the resolution or accuracy of such a touch panel display system. The activation of each of the emitters 106 may be timed so that only a limited number of emitters 106 emit energy beams across the display screen 102 at one particular point in time.
As mentioned, the emitters 106 and detectors 109 may be configured such that a finger or stylus placed on or adjacent to the display screen 102 will interrupt two or more of the rays 107 with the interruption of these rays being detected by one or more of the detectors 109. Each detector 109 may be connected via a cable or wiring harness 110 to a computing device (see Figure 2) which may execute one or more software program modules for controlling the emitters 106 and detectors 109, calculating the position of a user's touch on the display screen 102, and controlling the display of information on the display screen 102. Based on the signals supplied from each of the detectors 109, the computing device may be configured to determine the location of the display screen 102 that was touched and hence which portion of the displayed information a user of the system was attempting to interact with. In response to determining the portion of the displayed information that the user was attempting to interact with, the computing device may, for example, be configured to supply additional information to the user or receive information from the user.
Figure 2 is a block diagram illustrating an exemplary touch panel display system in accordance with an exemplary embodiment of the present invention. The touch panel display system comprises a computing device 200 functionally coupled to a touch panel display screen 100. The computing device 200 used in conjunction with the present invention may be any type of processor-driven device 200, such as a personal computer, a laptop computer, a handheld computer, a personal digital assistant (PDA), a digital and/or cellular telephone, a pager, a video game device, etc. These and other types of processor-driven devices will be apparent to one of ordinary skill in the art. As used herein, the term "processor" is meant to refer to any type of programmable logic device, including a microprocessor and any other type of similar device.
The computing device 200 may include, for example, a processor 202 a system memory 204 and various system interfaces 206. The processor 202, system memory 204 and system interfaces 206 may be functionally connected via a system bus 208. The system interfaces enable the processor 202 to communicate with peripheral devices. For example, a storage interface 210 provides an interface between the processor 202 and a storage device 211 (removable and/or non-removable), such as a disk drive. A network interface 212 may optionally be provided as an interface between the processor 202 and a network communications device (not shown), so that the computing device 200 may be connected to a network. A display screen interface 214 provides an interface between the processor 202 and a display screen 102. Input/Output ("I/O") port interfaces 216 may be provided as interfaces between the processor 202 and various input devices and/or various output devices. For example, the detectors 109 of the touch panel display screen 100 may be connected to the computing device 200 by way of an input port and may provide input to the processor 202 via an input port interface. Similarly, the emitters 106 of the touch panel display screen 100 may be connected to the computing device 200 by way of an output port and may receive output from the processor 202 via an output port interface.
A number of program modules may be stored in the system memory 204 and any other computer-readable medium associated with a storage device 211 (eg a hard disk drive), including an operating system 217. Certain aspects of the present invention may be embodied in an "Information Display" program module 219 comprising computer-executable instructions of for displaying images or other information on display screen 102. Other aspects of the present invention may be embodied in a "Touch Panel Control" program module 221 for controlling the emitters 106 and detectors 109 of a touch panel display screen 100 and for calculating touch positions on the display screen 102 based on signals received from the detectors 109. Furthermore, the images or other information displayed by the "Information Display" program module 219 may be store in one or more information data files 223 stored on any computer readable medium associated with the computing device 200.
The processor 202, controlled by the operating system, may be configured to execute the computer-executable instructions of the "Information Display" program module 215, the "Touch Panel Control" program module 217, and/or other program modules in order to perform or facilitate the methods of the present invention. For example, the processor 202 may execute computer-executable instructions for determining or receiving information from each detector 109 when a beam of energy is received. The processor 202 may also be adapted to determine when the user has attempted to touch an element or graphic displayed on the display screen 102. In one embodiment, the processor 202 may be configured to determine which of the energy beams transmitted across the face of the display screen 102 are interrupted by the user's finger, pen, stylus or other element.
For example, the processor 202 may monitor activation of the emitters 106 and energy beam detection signals generated by the detectors 109 in order to build a profile or "detection map" indicating which detectors 109 receive energy beams at any particular time. One or more detection maps may be stored in the system memory 204 or on any other computer-readable medium associated with the computing device 200. When a user touches on or in proximity to the display screen 102, the transmission of an energy beam (preferably two or more energy beams) will be interrupted for a short period of time. When the interruption of an energy beam occurs, a detector 109 will not detect the energy beam as expected and will not generate a detection signal. The processor 202 may determine the absence of an expected detection signal by comparing a detection map created at the time of the touch to one or more detection maps created when the display screen 102 was not being touched. Based on information regarding the interrupted energy beam(s), the processor 202 may be configured to calculate or determine the location of the user's touch on or in proximity to the display screen 102. Exemplary methods for calculating or determining the location of a user's touch on or in proximity to the display screen 102 will be described below with reference to Figure 3 and Figure 4.
The use of detection maps and the cyclical divergence of energy beams across the display screen 102 improves the tolerance of the touch panel display system to component failure or dirt build- up on emitters 106 or detectors 109. As multiple energy beams are diverged across the surface of the display screen 102 over time, detection maps may be created which will take into account any failed or malfunctioning detectors or emitters. By examining an average of several previously stored detection maps, the processor 202 may determine that a continued absence of a detection signal by one or more detectors is not the result of temporary energy beam interruption caused by a touch. Thus, exemplary embodiment of the present invention may have an inherent robustness and redundancy that will allow the touch panel display system to continue to function effectively even if one or more emitters 106 or detectors 109 fails. Those skilled in the art should appreciate that the "Information Display" program module 215 and the "Touch Panel Control" program module 217 are described herein by way of illustration only. Functionality of the present invention may be provided by way of any type and number of program modules, created in any programming language, which may or may not be stored locally at the computing device 200. For example, the computing device 200 may comprise a network server, client, or appliance that may be configured for executing program modules (eg 215 and 217) that are stored on another network device and/or for controlling a remotely located touch panel display screen 100. Accordingly, the touch panel display screen 100 of the present invention may provide an intuitive control interface for any computing device that can easily detect the position of a display screen 102 that has been touched by a user.
Figure 3 is a block diagram illustrating a touch panel display screen 100 that has been touched by a user. A touch is illustrated by a touch position 300. Ray lines 107 show the paths across the surface of the display screen 102 in which a number of energy beams may travel. In the instance shown, a first emitter 106a is transmitting a first ray 107a across the face of the display screen 102, and a second emitter 106b is transmitting a second ray 107b across the face of the display screen 102, a third emitter 106c is transmitting a third ray 107c across the face of the display screen 102 and a fourth emitter 106d is transmitting a fourth ray 107d across the face of the display screen 102. Each of the four rays 107a-d represents a portion of an energy beam that is diverged across the touch screen 102. The energy beams are each interrupted by the user's touch at touch position 300, causing the rays 107a-d to not be detected by the corresponding detectors 109a-d.
By comparing a detection map created at the instant in time of the touch to a stored detection match created when the touch panel display screen 100 is not being touched, a determination may be made as to which beams (represented by rays 107a-d) have been interrupted. Then, all of the interrupted beams may be examined to identify each pair of intersecting beams. As shown in the figure, the first ray 107a intersects the second ray 107b at a first intersection point 310a creating a first angle of intersection 322a, intersects the third ray 107c at a second intersection point 310b creating a second angle of intersection 322b and intersects the fourth ray 107d at a third intersection point 310c creating a third angle of intersection 322c. Similarly, the second ray 107b intersects the third ray 107c at a fourth intersection point 310d creating a fourth angle of intersection 322d and intersects the fourth ray 107d at a fifth intersection point 310e creating a fifth angle of intersection 322e. Also, the third ray 107c intersects the fourth ray 107d at a sixth intersection point 3 lOf creating a sixth angle of intersection 322e.
As can be seen from the figure, the six intersection points 310a-f are located at various distances relative to the touch position 300. The smaller the angle of intersection between two rays, the further from the touch point the intersection point will be. For example, the first intersection point 310 is further from the touch point 300 than the third intersection point 310c because the first angle of intersection 322a between the first ray 107a and the second ray 107b is smaller than the sixth angle of intersection 322f between the third ray 107c and the fourth ray 107d.
The intersection points 310a-f and the corresponding angles of intersection between each pair of intersection rays 107a-d may be used to calculate the position of the touch point 300 on the display screen 102. By way of example only, Cartesian coordinates (X,Y) of each intersection point 310a-f may be determined. The Cartesian coordinates of each intersection point 310a-f may then be multiplied by the corresponding angle of intersection (eg expressed in radians). The resulting products may be added together and divided by the sum (eg expressed in radians) of all the angles of intersection 322a-f. The result of such a calculation will represent a weighted average location value for the touch point 300. Those skilled in the art will recognise that the above calculation assigns greater weight (ie importance) to an intersection point (eg 310f) having a larger corresponding angle of intersection (eg 322f), because that intersection point (eg 31 Of) will be closer to the touch point 300 than an intersection point (eg 310a) having a smaller angle of intersection (eg 322a). Additionally, those skilled in the art will appreciate that any linear or non-linear weighting function may be used in accordance with the present invention.
Figure 4 is a flow chart illustrating an exemplary method 400 for calculating the location of a touch on a touch panel display screen 100 in accordance with an exemplary embodiment of the present invention. The method 400 begins at starting block 401, where a user touches a touch panel display screen 100. Next, at step 402, the energy beams interrupted by the user's touch are identified. For example, based on detection signals from detectors 106, a detection map may be created and compared to one or more previously stored detection maps in order to identify the energy beams that are interrupted by the touch. In a preferred embodiment, at least two pairs of energy beams are interrupted by the touch. As mentioned, the emitters 106 of the present invention may be activated such that the energy beams are diverged across the face of the display screen 102 in a cyclical manner. The emitter activation cycle may have a frequency that ensures that a typical touch will cause the interruption of at least two pairs of intersecting energy beams. In other words the emitter activation cycle may be fast enough such that four emitters 106 will transmit an energy beam across the touch screen 102 during the duration of a typical touch. The detection by multiple detectors 109 of "shadows" (ie the absence of an energy beam) caused by a touch can be used to determine the location on the display screen 102 where the touch occurred. Those skilled in the art will appreciate that the emitter activation cycle may be varied without departing from the spirit and scope of the present invention.
At step 404, the interrupted energy beams are examined to identify all pairs of intersecting interrupted energy beams. Then, at step 406, the angle of intersection between each pair of intersecting interrupted energy beams is calculated. Next at step 408, the intersection point of each pair of intersecting interrupted energy beams is located. For example, a Cartesian coordinate system may be assigned to the display screen 102 and the coordinates of each intersection point may be determined. At step 410, the location of the touch on the display screen 102 is determined based on an average of the intersection point positions optionally weighted based on angle of intersection. By way of illustration, each intersection point can be considered to represent a possible location of the touch point on the display screen 102. In the case where a Cartesian coordinate system is employed, the coordinates of each intersection point may be summed together and divided by the total number of intersection points in order to obtain average coordinate values (Xaverages Y average). The average coordinate values may provide an adequate estimation of the location of the touch point on the display screen 102.
Optionally, the angle of intersection corresponding to each intersection point may be used to weight the calculation of average intersection point coordinates. For example, the coordinates of each intersection point may be multiplied by the angle of intersection (eg expressed in radians) corresponding to that intersection point. Each angle of intersection and intersection point product may be added together and the resulting sum may be divided by a summation of all the angles of intersection (eg expressed in radians) to arrive at the coordinated of a weighted average intersection point. The weighted average intersection point may provide a more accurate estimation of the location of the touch point on the display screen 102. Intersecting interrupted energy beams having a small angle of intersection will converge and diverge from one another slowly, which can result in an inaccurate estimation of the location of the touch point. Thus, by using angles of intersection as a weighting factor, intersecting interrupted energy beams having small angles of intersection will have less effect on the estimation of the touch point location, as compared to intersecting interrupted energy beams having relatively large angles of intersection. After the location of the touch point is calculated at step 410, the method ends at step 412.
Those skilled in the art will appreciate that the above-described methods for calculating the location on the display screen 102 of a touch are provided by way of example only and many modifications and variations thereof are possible. For example, in one alternative embodiment, only intersection points having corresponding angles of intersection falling within a particular range of angles (eg 45° and 135°) may be considered when determining a weighted average intersection point. All intersection points having corresponding angles of intersection that fall outside the particular range of angles (eg less than 45° or greater than and 135°) may be discarded. These and other modifications and variations to the above-described methods, as well as alternate methods for calculating the location of a touch on a display screen 102, are considered to be within the spirit and scope of the present invention.
From the foregoing description of certain exemplary embodiment, it may be seen that the present invention provides many potential advantages over existing prior art systems. Emitters may be provided that are configured to diverge energy beams across a number of different areas of a display screen. Detectors may also be provided that are adapted to receive energy beams over a wide range of angles. Accordingly, the present invention may provide a touch panel display system that may be implemented with a minimal number of components. Furthermore, the present invention's ability to detect diverging energy beams across the face of a display screen can provide improved resolution, accuracy and resistance to component failures when a sufficient number of emitters and detectors used. By gathering energy beam detection signals from the detectors over time, the present invention may continue to function accurately if one or more components fail, or if any emitters or detectors are covered in dirt or dust.
The present invention may also be used with a wide range of different types of display screens. Any display screen that can display an image to a user can be used in conjunction with a touch panel display system of the present invention. A touch panel display screen of the present invention may be produced in a factory situation where an original display screen is manufactured. Alternatively the touch panel functionality of the present invention may be incorporated into an after-market product that may be adapted to be fitted to an existing display screen already owned by a user. In a retro-fitted embodiment, a processor may be incorporated into a touch panel product and may be interfaced with existing components of the display screen. Alternatively, a retro-fitted touch panel system may harness a processor that pre-exists in the existing display screen.
The improved touch panel functionality provided by the present invention gives it the ability to improve on a number of different types of devices that employ display screens. By way of example only and not by way of limitation, devices that may incorporate display screens with which the present invention may be used include: cellular phones, personal digital assistants or hand held computers, lap top computers, telephones, calculators, televisions, standard computers, appliances and tools of all shapes and forms, games machines, security devices, information kiosks, vehicle information systems, medical equipment, testing equipment, and commercial point of sale devices. A touch panel display system of the present invention may provide an intuitive and easily understood interface to control the functions or operations of any of these and other devices.
It should be appreciated that the foregoing related to a description of certain exemplary embodiments. Modifications and variations to the exemplary embodiments may become apparent to those skilled in the art. It should also be appreciated that many features and aspects of the present invention are described above by way of example only and are therefore not to be interpreted as required or essential elements of the invention, unless so stated. Accordingly, the scope of the present invention is to be defined only by the following claims and not by the foregoing description of exemplary embodiments.

Claims

THE CLAIMS DEFINING THE INVENTION ARE:
1. A touch panel display screen which includes;
a display screen for displaying information;
a plurality of emitters positioned in proximity to the display screen, each of the emitters adapted for emitting energy beams that are diverged across a surface of the display screen; and
at least one detector positioned in proximity to the display screen and adapted to receive the energy beams over a range of angles.
2. A touch panel display screen as claimed in claim 1 wherein the plurality of emitters are positioned in proximity to the display screen in such a manner that the energy beams cover substantially the entire area of the surface of the display screen.
3. A touch panel display screen as claimed in any one of claims 1 or 2, wherein the energy beams are selected from the group consisting of infrared energy beams, visible light energy beams, microwave energy beams and acoustic wave energy beams.
4. A touch panel display screen as claimed in any previous claim wherein the information displayed on the display screen comprises a dynamically changeable image.
5. A touch panel display screen as claimed in any one of claims 1 to 3, wherein the information displayed on the display screen comprises a static image.
6. A touch panel display screen as claimed in any previous claim, wherein location of the touch on the display screen is calculated based on the interrupted energy beams.
7. A touch panel display screen as claimed in any previous claim wherein a touch will interrupt at least one of the energy beams and will cause the at least one detector to not detect the at least one interrupted energy beam.
8. A touch panel display screen as claimed in any one of claims 1 to 6 wherein a touch will interrupt at least one of the energy beams and will cause the at least one detector to detect the reflection of said at least one interrupted energy beam.
9. A touch panel display screen as claimed in any previous claim, wherein the display screen comprises a top edge, a left edge, a right edge and a bottom edge; and
wherein the plurality of emitters positioned in proximity to the display screen comprises a first set of emitters positioned relative to the top side of the display screen,
a second set of emitters positioned relative to the left side of the display screen, a third set of emitters positioned relative to the right side of the display screen, and a fourth set of emitters positioned relative to the bottom side of the display screen.
10. A touch panel display screen as claimed in claim 9, wherein the at least one detector positioned in proximity to the display screen includes a first set of detectors positioned relative to the top side of the display screen, a second set of detectors positioned relative to the left side of the display screen, a third set of detectors positioned relative to the right side of the display screen, and a fourth set of detectors positioned relative to the bottom side of the display screen.
11. A touch panel display screen as claimed in claim 10, wherein each set of detectors comprises two detectors.
12. A touch panel display system which includes:
a display screen for displaying information;
a plurality of emitters positioned in proximity to the display screen, each of the emitters adapted for emitting energy beams that are diverged across a surface of the display screen; a plurality of detectors positioned in proximity to the display screen, each of the detectors adapted to receive the energy beams over a range of angles and to generate detection signals upon detecting any one of the energy beams; and
a processor for executing computer-executable instructions for:
based on an absence or presence of a detection signal from at least one of the detectors, determining that at least one of the energy beams has been interrupted by a touch of the display screen, and
based on the at least one interrupted energy beam, determining the location of the touch on the display screen.
13. A touch panel display system as claimed in claim 12, wherein the processor executes further computer executable instructions for controlling activation of the emitters.
14. A touch panel display system as claimed in claim 13, wherein the processor controls the emitters to emit energy beams in a cycle such that each emitter is activated and deactivated according to a sequence.
15. A touch panel display system as claimed in claim 14, wherein the cycle is rapid enough to substantially ensure that a plurality of energy beams will be interrupted by a touch of the display screen, each of the interrupted energy beams being emitted by different ones of the emitters at different times.
16. A touch panel display system as claimed in any one of claims 11 to 15, further including a computer-readable medium associated with the processor; and
wherein the processor executes further computer-executable instructions for:
generating a plurality of detection maps based on the detection signals generated by the detectors over time, the detection maps indicating which of the detectors should be receiving one of the energy beams from at least one of the emitters at any point in time, and storing the detection map on the computer readable medium.
17. A touch panel display system as claimed in claim 16, wherein the processor executes further computer-readable instructions for comparing a current detection map to a previously stored detection map in order to determine that at least one of the energy beams has been interrupted by the touch of the display screen.
18. A touch panel display system as claimed in any one of claims 11 to 17, wherein at least two pairs of intersecting energy beams are interrupted by the touch of the display screen; and
wherein determining the location of the touch on the display screen comprises:
determining an intersection point location for each pair of intersecting interrupted energy beams, each intersection point location representing a possible location of the touch on the display screen, and
calculating an average intersection point location by averaging the intersection point locations, the average intersection point location representing an estimation of the location of the touch on the display screen.
19. A touch panel display system as claimed in claim 18, wherein determining the location of the touch on the display screen further includes determining an angle of intersection for each pair of intersecting interrupted energy beams; and
wherein calculating the average intersection point location includes weighting each intersection point location based on the corresponding angle of intersection and averaging the weighted intersection point locations.
20. A method for implementing a touch panel display screen including the steps of:
providing a display screen for displaying information; and providing a plurality of emitters positioned in proximity to the display screen, each of the emitters adapted for emitting energy beams that are diverged across a surface of the display screen; and
providing at least one detector positioned in proximity to the display screen and adapted to receive the energy beams over a range of angles and to generate detection signals upon detecting any one of the energy beams.
21. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 20.
22. A method as claimed in claim 20 wherein the plurality of emitters are positioned in proximity to the display screen in such a manner that the energy beams cover substantially the entire area of the surface of the display screen.
23. A method as claimed in any one of claims 20 or 22, wherein a touch of the display screen will interrupt at least one of the energy beams and will cause the at least one detector to not detect the at least one interrupted energy beam.
24. A method for implementing a touch panel display screen as claimed in any one of claims 20 or 22 wherein a touch of the display screen will interrupt at least one of the energy beams and will cause the at least one detector to detect a reflection of the at least one interrupted energy beam.
25. A method as claimed in any one of claims 23 or 24, further comprising determining a location of the touch on the display screen based on the interrupted energy beams.
26. A method as claimed in claim 25, wherein at least two pairs of intersecting energy beams are interrupted by the touch of the display screen; and
wherein determining the location of the touch on the display screen includes: determining an intersection point location for each pair of intersecting interrupted energy beams, each intersection point location representing a possible location of the touch on the display screen, and
calculating an average intersection point location by averaging the intersection point locations, the average intersection point location representing an estimation of the location of the touch on the display screen.
27. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 26.
28. A method as claimed in claim 26, wherein determining the location of the touch on the display screen further includes determining an angle of intersection for each pair of intersecting interrupted energy beams; and
wherein calculating the average intersection point location includes weighting each intersection point location based on the corresponding angle of intersection and averaging the weighted intersection point locations.
29. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 27.
30. A method as claimed in claim 20, further including controlling activation of the emitters such that each emitter is activated and deactivated according to a sequence.
31. A method as claimed in claim 30, wherein the cycle is rapid enough to substantially ensure that a plurality of energy beams will be interrupted by a touch of the display screen, each of the interrupted energy beams being emitted by different ones of the emitters at different times.
32. A method as claimed in claim 20, further including generating a plurality of detection maps based on the detection signals generated by the at least one detector over time, the detection maps indicating from which of the emitters the at least one detector should receive an energy beam at any point in time.
33. A method as claimed in claim 32, further comprising comparing a current detection map to a previously stored detection map in order to determine that at least one of the energy beams has been interrupted by the touch of the display screen.
34. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 33.
35. A method for implementing a touch panel display screen including the steps of:
providing a display screen for displaying information; and
providing a plurality of emitters positioned in proximity to the display screen in such a manner that the energy beams cover substantially the entire area of a surface of the display screen, each of the emitters adapted for emitting energy beams that are diverged across the surface of the display screen, the emitters being further adapted to be activated and deactivated according to a sequence that is rapid enough to substantially ensure that a plurality of the energy beams will be interrupted by a touch of the display screen, each of the interrupted energy beams being emitted by different ones of the emitters at different times; and
providing a plurality of detectors positioned in proximity to the display screen and adapted to receive the energy beams over a range of angles and to generate detection signals upon detecting any one of the energy beams; and
generating a plurality of detection maps based on the detection signals generated by the detectors over time, the detection maps indicating from which of the emitters each of the detectors should receive one of the energy beam at any point in time; and comparing a current detection map to a previously stored detection map in order to determine that the plurality of energy beams has been interrupted by the touch of the display screen; and
determining a location of the touch on the display screen based on the interrupted energy beams.
36. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 35.
37. A method as claimed in claim 35, wherein at least two pairs of intersecting energy beams are interrupted by the touch of the display screen; and
wherein determining the location of the touch on the display screen includes:
determining an intersection point location for each pair of intersecting interrupted energy beams, each intersection point location representing a possible location of the touch on the display screen, and
calculating an average intersection point location by averaging the intersection point locations, the average intersection point location representing an estimation of the location of the touch on the display screen.
38. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 37.
39. A method as claimed in claim 37, wherein determining the location of the touch on the display screen further comprises determining an angle of intersection for each pair of intersecting interrupted energy beams; and
wherein calculating the average intersection point location comprises weighting each intersection point location based on the corresponding angle of intersection and averaging the weighted intersection points locations.
40. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 39.
41. A touch panel display screen substantially as herein described with reference to and as illustrated by the accompanying drawings and/or examples.
42. A touch panel display system substantially as herein described with reference to and as illustrated by the accompanying drawings and/or examples.
43. A method of implementing a touch panel display screen or system substantially as herein described with reference to and as illustrated by the accompanying drawings and/or examples.
PCT/NZ2001/000146 2000-07-19 2001-07-19 Touch panel display system WO2002007072A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001282713A AU2001282713A1 (en) 2000-07-19 2001-07-19 Touch panel display system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
NZ50523900 2000-07-19
NZ505239 2000-07-19
NZ509547 2001-01-26
NZ50954701 2001-01-26

Publications (2)

Publication Number Publication Date
WO2002007072A2 true WO2002007072A2 (en) 2002-01-24
WO2002007072A3 WO2002007072A3 (en) 2002-12-19

Family

ID=26652183

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NZ2001/000146 WO2002007072A2 (en) 2000-07-19 2001-07-19 Touch panel display system

Country Status (3)

Country Link
US (1) US6690363B2 (en)
AU (1) AU2001282713A1 (en)
WO (1) WO2002007072A2 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008007276A2 (en) 2006-06-28 2008-01-17 Koninklijke Philips Electronics, N.V. Method and apparatus for object learning and recognition based on optical parameters
WO2010064983A3 (en) * 2008-12-05 2010-08-05 Flatfrog Laboratories Ab A touch sensing apparatus and method of operating the same
WO2011049511A1 (en) * 2009-10-19 2011-04-28 Flatfrog Laboratories Ab Extracting touch data that represents one or more objects on a touch surface
WO2011060487A1 (en) * 2009-11-17 2011-05-26 Rpo Pty Limited Apparatus and method for receiving a touch input
CN102221938A (en) * 2010-04-16 2011-10-19 北京汇冠新技术股份有限公司 Touch positioning method and system as well as display
WO2013055282A3 (en) * 2011-10-11 2013-06-06 Flatfrog Laboratories Ab Improved multi-touch detection in a touch system
US8780066B2 (en) 2010-05-03 2014-07-15 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
CN103984445A (en) * 2013-02-07 2014-08-13 深圳市艾博德科技有限公司 Infrared touch screen and touch point positioning method thereof
EP2852879A4 (en) * 2012-05-23 2016-02-17 Flatfrog Lab Ab Touch-sensitive apparatus with improved spatial resolution
EP2852878A4 (en) * 2012-05-23 2016-02-17 Flatfrog Lab Ab Touch-sensitive apparatus with improved spatial resolution
US9430079B2 (en) 2009-10-19 2016-08-30 Flatfrog Laboratories Ab Determining touch data for one or more objects on a touch surface
EP2541386B1 (en) * 2011-06-28 2019-08-07 Vestel Elektronik Sanayi ve Ticaret A.S. Display device with touch control feature
US11893189B2 (en) 2020-02-10 2024-02-06 Flatfrog Laboratories Ab Touch-sensing apparatus

Families Citing this family (190)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4052498B2 (en) 1999-10-29 2008-02-27 株式会社リコー Coordinate input apparatus and method
JP2001184161A (en) 1999-12-27 2001-07-06 Ricoh Co Ltd Method and device for inputting information, writing input device, method for managing written data, method for controlling display, portable electronic writing device, and recording medium
US6803906B1 (en) * 2000-07-05 2004-10-12 Smart Technologies, Inc. Passive touch system and method of detecting user input
ATE345525T1 (en) * 2000-07-05 2006-12-15 Smart Technologies Inc CAMERA BASED TOUCH SYSTEM
JP5109212B2 (en) * 2001-05-01 2012-12-26 ソニー株式会社 Navigation device, information display device, object generation method, and storage medium
US6985137B2 (en) * 2001-08-13 2006-01-10 Nokia Mobile Phones Ltd. Method for preventing unintended touch pad input due to accidental touching
US6927384B2 (en) * 2001-08-13 2005-08-09 Nokia Mobile Phones Ltd. Method and device for detecting touch pad unit
TW528981B (en) * 2001-10-25 2003-04-21 Compal Electronics Inc Portable computer and related method for preventing input interruption by write-tracking input region
US9471170B2 (en) * 2002-11-04 2016-10-18 Neonode Inc. Light-based touch screen with shift-aligned emitter and receiver lenses
US20120188206A1 (en) * 2001-11-02 2012-07-26 Neonode, Inc. Optical touch screen with tri-directional micro-lenses
US7952570B2 (en) 2002-06-08 2011-05-31 Power2B, Inc. Computer navigation
US7023427B2 (en) * 2002-06-28 2006-04-04 Microsoft Corporation Method and system for detecting multiple touches on a touch-sensitive screen
US6954197B2 (en) * 2002-11-15 2005-10-11 Smart Technologies Inc. Size/scale and orientation determination of a pointer in a camera-based touch system
US7042444B2 (en) * 2003-01-17 2006-05-09 Eastman Kodak Company OLED display and touch screen
US7629967B2 (en) 2003-02-14 2009-12-08 Next Holdings Limited Touch screen signal processing
US8508508B2 (en) 2003-02-14 2013-08-13 Next Holdings Limited Touch screen signal processing with single-point calibration
US8456447B2 (en) 2003-02-14 2013-06-04 Next Holdings Limited Touch screen signal processing
US20080084374A1 (en) 2003-02-20 2008-04-10 Planar Systems, Inc. Light sensitive display
US7532206B2 (en) 2003-03-11 2009-05-12 Smart Technologies Ulc System and method for differentiating between pointers used to contact touch surface
CN100458670C (en) * 2003-05-19 2009-02-04 株式会社伊特 Location detecting apparatus using area image sensor
FR2859277B1 (en) * 2003-09-02 2006-01-27 H2I Technologies METHOD AND DEVICE FOR OPTICALLY DETECTING POSITION BY REFLECTING AN OBJECT ON ANY SURFACE
US7411575B2 (en) * 2003-09-16 2008-08-12 Smart Technologies Ulc Gesture recognition method and touch system incorporating the same
US7274356B2 (en) 2003-10-09 2007-09-25 Smart Technologies Inc. Apparatus for determining the location of a pointer within a region of interest
US7355593B2 (en) * 2004-01-02 2008-04-08 Smart Technologies, Inc. Pointer tracking across multiple overlapping coordinate input sub-regions defining a generally contiguous input region
US7232986B2 (en) * 2004-02-17 2007-06-19 Smart Technologies Inc. Apparatus for detecting a pointer within a region of interest
JP2007525669A (en) * 2004-02-27 2007-09-06 オーチス エレベータ カンパニー Ultrasonic / electromagnetic non-contact button / switch for elevator
US20050227217A1 (en) * 2004-03-31 2005-10-13 Wilson Andrew D Template matching on interactive surface
US7394459B2 (en) 2004-04-29 2008-07-01 Microsoft Corporation Interaction between objects and a virtual environment display
US7460110B2 (en) * 2004-04-29 2008-12-02 Smart Technologies Ulc Dual mode touch system
US7492357B2 (en) 2004-05-05 2009-02-17 Smart Technologies Ulc Apparatus and method for detecting a pointer relative to a touch surface
US7538759B2 (en) 2004-05-07 2009-05-26 Next Holdings Limited Touch panel display system with illumination and detection provided from a single edge
US8120596B2 (en) * 2004-05-21 2012-02-21 Smart Technologies Ulc Tiled touch system
US7787706B2 (en) 2004-06-14 2010-08-31 Microsoft Corporation Method for controlling an intensity of an infrared source used to detect objects adjacent to an interactive display surface
US7593593B2 (en) 2004-06-16 2009-09-22 Microsoft Corporation Method and system for reducing effects of undesired signals in an infrared imaging system
US7519223B2 (en) 2004-06-28 2009-04-14 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
TWI291161B (en) * 2004-07-15 2007-12-11 N trig ltd Automatic switching for a dual mode digitizer
US8341522B2 (en) * 2004-10-27 2012-12-25 The Invention Science Fund I, Llc Enhanced contextual user assistance
US8282003B2 (en) * 2004-09-30 2012-10-09 The Invention Science Fund I, Llc Supply-chain side assistance
US7664736B2 (en) * 2005-01-18 2010-02-16 Searete Llc Obtaining user assistance
US10514816B2 (en) * 2004-12-01 2019-12-24 Uber Technologies, Inc. Enhanced user assistance
US20100146390A1 (en) * 2004-09-30 2010-06-10 Searete Llc, A Limited Liability Corporation Obtaining user assestance
US9098826B2 (en) * 2004-09-30 2015-08-04 The Invention Science Fund I, Llc Enhanced user assistance
US9038899B2 (en) * 2004-09-30 2015-05-26 The Invention Science Fund I, Llc Obtaining user assistance
US9307577B2 (en) * 2005-01-21 2016-04-05 The Invention Science Fund I, Llc User assistance
US10687166B2 (en) * 2004-09-30 2020-06-16 Uber Technologies, Inc. Obtaining user assistance
US7798401B2 (en) * 2005-01-18 2010-09-21 Invention Science Fund 1, Llc Obtaining user assistance
US7922086B2 (en) * 2004-09-30 2011-04-12 The Invention Science Fund I, Llc Obtaining user assistance
US9747579B2 (en) * 2004-09-30 2017-08-29 The Invention Science Fund I, Llc Enhanced user assistance
US20060075344A1 (en) * 2004-09-30 2006-04-06 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Providing assistance
US10445799B2 (en) 2004-09-30 2019-10-15 Uber Technologies, Inc. Supply-chain side assistance
US8762839B2 (en) * 2004-09-30 2014-06-24 The Invention Science Fund I, Llc Supply-chain side assistance
US20060090132A1 (en) * 2004-10-26 2006-04-27 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Enhanced user assistance
JP2006099608A (en) * 2004-09-30 2006-04-13 Touch Panel Systems Kk Display device with touch detection function
US20060117001A1 (en) * 2004-12-01 2006-06-01 Jung Edward K Enhanced user assistance
US7694881B2 (en) * 2004-09-30 2010-04-13 Searete Llc Supply-chain side assistance
US8704675B2 (en) * 2004-09-30 2014-04-22 The Invention Science Fund I, Llc Obtaining user assistance
US20100223162A1 (en) * 2004-09-30 2010-09-02 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Supply-chain side assistance
CN101103289A (en) * 2004-12-09 2008-01-09 Rpo私人有限公司 Optical power distribution devices
US7892096B2 (en) * 2005-02-22 2011-02-22 Wms Gaming Inc. Gaming machine with configurable button panel
WO2006090386A2 (en) * 2005-02-24 2006-08-31 Vkb Inc. A virtual keyboard device
EP1859339A2 (en) * 2005-03-10 2007-11-28 Koninklijke Philips Electronics N.V. System and method for detecting the location, size and shape of multiple objects that interact with a touch screen display
US7825902B2 (en) * 2005-03-31 2010-11-02 Avego Technologies General Ip (Singapore) Pte. Ltd. Controller, system and method for identifying a number of interactions with a computer input area
US7499027B2 (en) * 2005-04-29 2009-03-03 Microsoft Corporation Using a light pointer for input on an interactive display surface
US8487910B2 (en) * 2005-05-02 2013-07-16 Smart Technologies Ulc Large scale touch system and methods for interacting with same
US10452207B2 (en) 2005-05-18 2019-10-22 Power2B, Inc. Displays and information input devices
WO2008111079A2 (en) 2007-03-14 2008-09-18 Power2B, Inc. Interactive devices
US7525538B2 (en) * 2005-06-28 2009-04-28 Microsoft Corporation Using same optics to image, illuminate, and project
US7911444B2 (en) * 2005-08-31 2011-03-22 Microsoft Corporation Input method for surface of interactive display
WO2007029257A2 (en) * 2005-09-08 2007-03-15 Power2B, Inc. Displays and information input devices
US20070132742A1 (en) * 2005-12-08 2007-06-14 Deng-Peng Chen Method and apparatus employing optical angle detectors adjacent an optical input area
US8060840B2 (en) 2005-12-29 2011-11-15 Microsoft Corporation Orientation free user interface
CN100338565C (en) * 2005-12-29 2007-09-19 广东威创日新电子有限公司 Infrared touch device
US7515143B2 (en) * 2006-02-28 2009-04-07 Microsoft Corporation Uniform illumination of interactive display panel
US20070205994A1 (en) * 2006-03-02 2007-09-06 Taco Van Ieperen Touch system and method for interacting with the same
US8358976B2 (en) 2006-03-24 2013-01-22 The Invention Science Fund I, Llc Wireless device with an aggregate user interface for controlling other devices
US8013598B2 (en) * 2006-06-19 2011-09-06 Newcom, Inc. Object detecting device for detecting object using electromagnetic induction
JP5016049B2 (en) * 2006-09-13 2012-09-05 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Determining target direction
WO2008050468A1 (en) * 2006-10-24 2008-05-02 Newcom, Inc. Operating tool with conductor piece
US9442607B2 (en) 2006-12-04 2016-09-13 Smart Technologies Inc. Interactive input system and method
US8212857B2 (en) * 2007-01-26 2012-07-03 Microsoft Corporation Alternating light sources to reduce specular reflection
CN101595448B (en) * 2007-01-29 2013-09-04 皇家飞利浦电子股份有限公司 Method and system for locating an object on a surface
EP2135155B1 (en) * 2007-04-11 2013-09-18 Next Holdings, Inc. Touch screen system with hover and click input methods
US8130202B2 (en) * 2007-05-01 2012-03-06 International Business Machines Corporation Infrared touch screen gated by touch force
US8094137B2 (en) 2007-07-23 2012-01-10 Smart Technologies Ulc System and method of detecting contact on a display
US8432377B2 (en) * 2007-08-30 2013-04-30 Next Holdings Limited Optical touchscreen with improved illumination
WO2009029764A1 (en) 2007-08-30 2009-03-05 Next Holdings, Inc. Low profile touch panel systems
AR064377A1 (en) * 2007-12-17 2009-04-01 Rovere Victor Manuel Suarez DEVICE FOR SENSING MULTIPLE CONTACT AREAS AGAINST OBJECTS SIMULTANEOUSLY
US20090213093A1 (en) * 2008-01-07 2009-08-27 Next Holdings Limited Optical position sensor using retroreflection
US8405636B2 (en) * 2008-01-07 2013-03-26 Next Holdings Limited Optical position sensing system and optical position sensor assembly
US20090207144A1 (en) * 2008-01-07 2009-08-20 Next Holdings Limited Position Sensing System With Edge Positioning Enhancement
EP2250546A2 (en) * 2008-02-11 2010-11-17 Next Holdings Limited Systems and methods for resolving multitouch scenarios for optical touchscreens
US20090278794A1 (en) * 2008-05-09 2009-11-12 Smart Technologies Ulc Interactive Input System With Controlled Lighting
US20090277697A1 (en) * 2008-05-09 2009-11-12 Smart Technologies Ulc Interactive Input System And Pen Tool Therefor
US8902193B2 (en) * 2008-05-09 2014-12-02 Smart Technologies Ulc Interactive input system and bezel therefor
JP4513918B2 (en) * 2008-06-03 2010-07-28 エプソンイメージングデバイス株式会社 Illumination device and electro-optical device
US8531435B2 (en) * 2008-08-07 2013-09-10 Rapt Ip Limited Detecting multitouch events in an optical touch-sensitive device by combining beam information
US9092092B2 (en) 2008-08-07 2015-07-28 Rapt Ip Limited Detecting multitouch events in an optical touch-sensitive device using touch event templates
KR101593574B1 (en) * 2008-08-07 2016-02-18 랩트 아이피 리미티드 Method and apparatus for detecting a multitouch event in an optical touch-sensitive device
JP5588982B2 (en) 2008-08-07 2014-09-10 ラプト アイピー リミテッド Optical control system with modulated emitter
EP2338103A1 (en) * 2008-08-07 2011-06-29 Owen Drumm Optical control systems with feedback control
US20100079385A1 (en) * 2008-09-29 2010-04-01 Smart Technologies Ulc Method for calibrating an interactive input system and interactive input system executing the calibration method
KR20110066198A (en) * 2008-10-02 2011-06-16 넥스트 홀딩즈 리미티드 Stereo optical sensors for resolving multi-touch in a touch detection system
US8339378B2 (en) * 2008-11-05 2012-12-25 Smart Technologies Ulc Interactive input system with multi-angle reflector
US20100120486A1 (en) * 2008-11-10 2010-05-13 Igt Gaming system, gaming device and method providing server based configurable game presentations
KR100982331B1 (en) * 2008-12-01 2010-09-15 삼성에스디아이 주식회사 Plasma display device
US20100201637A1 (en) * 2009-02-11 2010-08-12 Interacta, Inc. Touch screen display system
US20100207909A1 (en) * 2009-02-13 2010-08-19 Ming-Cho Wu Detection module and an optical detection device comprising the same
US20100229090A1 (en) * 2009-03-05 2010-09-09 Next Holdings Limited Systems and Methods for Interacting With Touch Displays Using Single-Touch and Multi-Touch Gestures
TWI524238B (en) 2009-03-31 2016-03-01 萬國商業機器公司 Multi-touch optical touch panel
JP2012530303A (en) 2009-06-18 2012-11-29 バーント インターナショナル リミテッド System and method for detecting and tracking objects obstructing radiation on a surface
US8692768B2 (en) 2009-07-10 2014-04-08 Smart Technologies Ulc Interactive input system
TW201108070A (en) * 2009-08-28 2011-03-01 Coretronic Corp Optical touch apparatus
US8373679B2 (en) * 2009-10-12 2013-02-12 Garmin International, Inc. Infrared touchscreen electronics
CN102043575B (en) * 2009-10-23 2012-12-19 鸿富锦精密工业(深圳)有限公司 Touch electronic device with optimization configuration function and optimization configuration method of touch electronic device
US20110095977A1 (en) * 2009-10-23 2011-04-28 Smart Technologies Ulc Interactive input system incorporating multi-angle reflecting structure
JP5326989B2 (en) * 2009-10-26 2013-10-30 セイコーエプソン株式会社 Optical position detection device and display device with position detection function
WO2011052264A1 (en) * 2009-10-26 2011-05-05 シャープ株式会社 Position detection system, display panel, and display device
JP5493702B2 (en) * 2009-10-26 2014-05-14 セイコーエプソン株式会社 Projection display with position detection function
CN102053757B (en) * 2009-11-05 2012-12-19 上海精研电子科技有限公司 Infrared touch screen device and multipoint positioning method thereof
JP2011099994A (en) 2009-11-06 2011-05-19 Seiko Epson Corp Projection display device with position detecting function
KR101627715B1 (en) * 2009-11-18 2016-06-14 엘지전자 주식회사 Touch Panel, Driving Method for Touch Panel, and Display Apparatus having a Touch Panel
TWI412838B (en) * 2009-11-23 2013-10-21 Coretronic Corp Touch display apparatus and backlight module
WO2011066343A2 (en) * 2009-11-24 2011-06-03 Next Holdings Limited Methods and apparatus for gesture recognition mode control
US20110199387A1 (en) * 2009-11-24 2011-08-18 John David Newton Activating Features on an Imaging Device Based on Manipulations
EP2507692A2 (en) * 2009-12-04 2012-10-10 Next Holdings Limited Imaging methods and systems for position detection
TWI522869B (en) * 2009-12-17 2016-02-21 中強光電股份有限公司 Optical touch display apparatus
WO2011078769A1 (en) * 2009-12-21 2011-06-30 Flatfrog Laboratories Ab Touch surface with identification of reduced performance
TWI492128B (en) * 2009-12-22 2015-07-11 Coretronic Corp Optical touch display apparatus
US10356465B2 (en) * 2010-01-06 2019-07-16 Sony Corporation Video system demonstration
US20110181624A1 (en) * 2010-01-26 2011-07-28 Daniel Michael Paul Nugara Interactive Publication and Associated Method of Displaying Community-Based Content Therewith
US20110187678A1 (en) * 2010-01-29 2011-08-04 Tyco Electronics Corporation Touch system using optical components to image multiple fields of view on an image sensor
KR101657216B1 (en) * 2010-03-02 2016-09-19 삼성디스플레이 주식회사 Touch panel and touch position detection method of touch panel
JP5853016B2 (en) * 2010-03-24 2016-02-09 ネオノード インコーポレイテッド Lens array for light-based touch screen
US20110234542A1 (en) * 2010-03-26 2011-09-29 Paul Marson Methods and Systems Utilizing Multiple Wavelengths for Position Detection
WO2011153620A2 (en) * 2010-06-09 2011-12-15 Baanto International Ltd. Modular position sensing systems and methods
US8766155B2 (en) * 2010-11-03 2014-07-01 Toshiba Tec Kabushiki Kaisha Coordinate recognizing apparatus and control method therefor
FR2967788B1 (en) * 2010-11-23 2012-12-14 Commissariat Energie Atomique SYSTEM FOR DETECTION AND LOCATION OF A DISTURBANCE IN AN ENVIRONMENT, CORRESPONDING PROCESS AND COMPUTER PROGRAM
US8836672B2 (en) 2011-02-09 2014-09-16 Dornerworks, Ltd. System and method for improving machine vision in the presence of ambient light
TWI420369B (en) * 2011-05-12 2013-12-21 Wistron Corp Optical touch control device and optical touch control system
EP2712435A4 (en) * 2011-05-16 2015-03-18 Flatfrog Lab Ab Device and method for determining reduced performance of a touch sensitive apparatus
US8333657B1 (en) 2011-09-26 2012-12-18 Igt Gaming system, gaming device and method for displaying multiple concurrent games using dynamic focal points
TWI563437B (en) * 2011-09-26 2016-12-21 Egalax Empia Technology Inc Apparatus for detecting position by infrared rays and touch panel using the same
US9229575B2 (en) * 2011-10-20 2016-01-05 Garmin International, Inc. Adaptive touchscreen system
CN111443832A (en) * 2012-04-30 2020-07-24 拉普特知识产权公司 Detecting multi-touch events with touch event templates in an optical touch-sensitive device
US9396518B2 (en) * 2012-05-15 2016-07-19 Salvadore Ragusa System of organizing digital images
US10168835B2 (en) 2012-05-23 2019-01-01 Flatfrog Laboratories Ab Spatial resolution in touch displays
US9626040B2 (en) 2012-05-23 2017-04-18 Flatfrog Laboratories Ab Touch-sensitive apparatus with improved spatial resolution
US9726803B2 (en) * 2012-05-24 2017-08-08 Qualcomm Incorporated Full range gesture system
US9524060B2 (en) 2012-07-13 2016-12-20 Rapt Ip Limited Low power operation of an optical touch-sensitive device for detecting multitouch events
CN102902422A (en) * 2012-08-30 2013-01-30 深圳市印天印象科技有限公司 Multi-point touch system and method
US9164625B2 (en) 2012-10-14 2015-10-20 Neonode Inc. Proximity sensor for determining two-dimensional coordinates of a proximal object
US10324565B2 (en) 2013-05-30 2019-06-18 Neonode Inc. Optical proximity sensor
US9921661B2 (en) 2012-10-14 2018-03-20 Neonode Inc. Optical proximity sensor and associated user interface
US10585530B2 (en) 2014-09-23 2020-03-10 Neonode Inc. Optical proximity sensor
WO2014168567A1 (en) 2013-04-11 2014-10-16 Flatfrog Laboratories Ab Tomographic processing for touch detection
CN105283744B (en) * 2013-06-05 2018-05-18 Ev 集团 E·索尔纳有限责任公司 To determine the measuring device and method of pressure map
WO2015005847A1 (en) 2013-07-12 2015-01-15 Flatfrog Laboratories Ab Partial detect mode
EP2854024A1 (en) * 2013-09-27 2015-04-01 Siemens Aktiengesellschaft Display panel suitable for use in human-machine interface devices
WO2015076731A1 (en) * 2013-11-22 2015-05-28 Flatfrog Laboratories Ab A touch sensitive apparatus with improved spatial resolution
US10126882B2 (en) 2014-01-16 2018-11-13 Flatfrog Laboratories Ab TIR-based optical touch systems of projection-type
WO2015108479A1 (en) 2014-01-16 2015-07-23 Flatfrog Laboratories Ab Light coupling in tir-based optical touch systems
US10458801B2 (en) 2014-05-06 2019-10-29 Uber Technologies, Inc. Systems and methods for travel planning that calls for at least one transportation vehicle unit
US9552559B2 (en) 2014-05-06 2017-01-24 Elwha Llc System and methods for verifying that one or more directives that direct transport of a second end user does not conflict with one or more obligations to transport a first end user
US9483744B2 (en) 2014-05-06 2016-11-01 Elwha Llc Real-time carpooling coordinating systems and methods
US11100434B2 (en) 2014-05-06 2021-08-24 Uber Technologies, Inc. Real-time carpooling coordinating system and methods
WO2015199602A1 (en) 2014-06-27 2015-12-30 Flatfrog Laboratories Ab Detection of surface contamination
US9652082B1 (en) 2014-08-20 2017-05-16 Amazon Technologies, Inc. Space efficient electronic device component configurations
US9965101B2 (en) 2014-09-02 2018-05-08 Rapt Ip Limited Instrument detection with an optical touch sensitive device
DE112015004010T5 (en) 2014-09-02 2017-06-14 Rapt Ip Limited Instrument detection with an optical touch-sensitive device
US10108301B2 (en) 2014-09-02 2018-10-23 Rapt Ip Limited Instrument detection with an optical touch sensitive device, with associating contacts with active instruments
KR102309863B1 (en) * 2014-10-15 2021-10-08 삼성전자주식회사 Electronic device, controlling method thereof and recording medium
US9791977B2 (en) * 2014-12-16 2017-10-17 Rapt Ip Limited Transient deformation detection for a touch-sensitive surface
WO2016122927A1 (en) 2015-01-26 2016-08-04 Neonode Inc. Optical proximity sensor and associated user interface
EP3250993B1 (en) 2015-01-28 2019-09-04 FlatFrog Laboratories AB Dynamic touch quarantine frames
US10318074B2 (en) 2015-01-30 2019-06-11 Flatfrog Laboratories Ab Touch-sensing OLED display with tilted emitters
US10496227B2 (en) 2015-02-09 2019-12-03 Flatfrog Laboratories Ab Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel
WO2016140612A1 (en) 2015-03-02 2016-09-09 Flatfrog Laboratories Ab Optical component for light coupling
TWI562038B (en) * 2015-07-08 2016-12-11 Wistron Corp Method of detecting touch position and touch apparatus thereof
TWI612445B (en) * 2015-09-21 2018-01-21 緯創資通股份有限公司 Optical touch apparatus and a method for determining a touch position
JP2018536944A (en) 2015-12-09 2018-12-13 フラットフロッグ ラボラトリーズ アーベーFlatFrog Laboratories AB Improved stylus identification
US10761657B2 (en) 2016-11-24 2020-09-01 Flatfrog Laboratories Ab Automatic optimisation of touch signal
KR20240012622A (en) 2016-12-07 2024-01-29 플라트프로그 라보라토리즈 에이비 An improved touch device
CN116679845A (en) 2017-02-06 2023-09-01 平蛙实验室股份公司 Touch sensing device
US10606414B2 (en) 2017-03-22 2020-03-31 Flatfrog Laboratories Ab Eraser for touch displays
EP4036697A1 (en) 2017-03-28 2022-08-03 FlatFrog Laboratories AB Optical touch sensing apparatus
CN117311543A (en) 2017-09-01 2023-12-29 平蛙实验室股份公司 Touch sensing device
WO2019172826A1 (en) 2018-03-05 2019-09-12 Flatfrog Laboratories Ab Improved touch-sensing apparatus
US11943563B2 (en) 2019-01-25 2024-03-26 FlatFrog Laboratories, AB Videoconferencing terminal and method of operating the same
KR20220098024A (en) 2019-12-31 2022-07-08 네오노드, 인크. Non-contact touch input system
CN116420125A (en) 2020-09-30 2023-07-11 内奥诺德公司 Optical touch sensor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1989001677A1 (en) * 1986-01-03 1989-02-23 Wales Langdon R Touch screen input system
DE3836429A1 (en) * 1988-10-26 1990-05-03 Paul Nolden Sensor matrix for screens
US5785439A (en) * 1992-08-24 1998-07-28 Product Engineering & Manufacturing, Inc. Environmentally safe machine control security switch

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3764813A (en) 1972-04-12 1973-10-09 Bell Telephone Labor Inc Coordinate detection system
US4243879A (en) 1978-04-24 1981-01-06 Carroll Manufacturing Corporation Touch panel with ambient light sampling
US4459476A (en) 1982-01-19 1984-07-10 Zenith Radio Corporation Co-ordinate detection system
US4766424A (en) * 1984-03-30 1988-08-23 Zenith Electronics Corporation Light collecting and redirecting means
US4943806A (en) 1984-06-18 1990-07-24 Carroll Touch Inc. Touch input device having digital ambient light sampling
US4703316A (en) * 1984-10-18 1987-10-27 Tektronix, Inc. Touch panel input apparatus
US4673918A (en) * 1984-11-29 1987-06-16 Zenith Electronics Corporation Light guide having focusing element and internal reflector on same face
JPS61262917A (en) 1985-05-17 1986-11-20 Alps Electric Co Ltd Filter for photoelectric touch panel
US5025411A (en) 1986-12-08 1991-06-18 Tektronix, Inc. Method which provides debounced inputs from a touch screen panel by waiting until each x and y coordinates stop altering
US4928094A (en) 1988-01-25 1990-05-22 The Boeing Company Battery-operated data collection apparatus having an infrared touch screen data entry device
US4851664A (en) 1988-06-27 1989-07-25 United States Of America As Represented By The Secretary Of The Navy Narrow band and wide angle hemispherical interference optical filter
US4916308A (en) 1988-10-17 1990-04-10 Tektronix, Inc. Integrated liquid crystal display and optical touch panel
US5179369A (en) * 1989-12-06 1993-01-12 Dale Electronics, Inc. Touch panel and method for controlling same
US5105186A (en) 1990-05-25 1992-04-14 Hewlett-Packard Company Lcd touch screen
US5162783A (en) 1990-07-23 1992-11-10 Akzo N.V. Infrared touch screen device for a video monitor
US5148015A (en) * 1990-12-24 1992-09-15 Pitney Bowes Inc. Touch switch input device for computer system
US5196836A (en) * 1991-06-28 1993-03-23 International Business Machines Corporation Touch panel display
GB2263765A (en) 1992-01-25 1993-08-04 Paul Philip Oliver Touch screen systems
GB9201949D0 (en) 1992-01-30 1992-03-18 Jenkin Michael Large-scale,touch-sensitive video display
US5422494A (en) 1992-10-16 1995-06-06 The Scott Fetzer Company Barrier transmission apparatus
US5457289A (en) 1994-03-16 1995-10-10 Microtouch Systems, Inc. Frontally shielded capacitive touch sensor system
US5577733A (en) 1994-04-08 1996-11-26 Downing; Dennis L. Targeting system
US5804773A (en) 1995-02-16 1998-09-08 Elo Touchsystems, Inc. Simplified touch screen with improved position accuracy
US5591945A (en) 1995-04-19 1997-01-07 Elo Touchsystems, Inc. Acoustic touch position sensor using higher order horizontally polarized shear wave propagation
US5698845A (en) 1995-05-23 1997-12-16 Stanley Electric Co., Ltd. Optical detection apparatus for detecting light interruption
US5739479A (en) 1996-03-04 1998-04-14 Elo Touchsystems, Inc. Gentle-bevel flat acoustic wave touch sensor
US5940065A (en) 1996-03-15 1999-08-17 Elo Touchsystems, Inc. Algorithmic compensation system and method therefor for a touch sensor panel
US5784054A (en) 1996-03-22 1998-07-21 Elo Toughsystems, Inc. Surface acoustic wave touchscreen with housing seal
JP3217972B2 (en) 1996-08-02 2001-10-15 松下電器産業株式会社 Mobile communication device with touch panel
KR100269070B1 (en) 1996-08-30 2000-10-16 모리 하루오 Car navigation system
JP3800274B2 (en) 1996-12-25 2006-07-26 タッチパネル・システムズ株式会社 Acoustic contact detection device
CA2393164C (en) * 1999-12-02 2008-04-01 Elo Touchsystems, Inc. Apparatus and method to improve resolution of infrared touch systems
US6864882B2 (en) 2000-05-24 2005-03-08 Next Holdings Limited Protected touch panel display system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1989001677A1 (en) * 1986-01-03 1989-02-23 Wales Langdon R Touch screen input system
DE3836429A1 (en) * 1988-10-26 1990-05-03 Paul Nolden Sensor matrix for screens
US5785439A (en) * 1992-08-24 1998-07-28 Product Engineering & Manufacturing, Inc. Environmentally safe machine control security switch

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008007276A2 (en) 2006-06-28 2008-01-17 Koninklijke Philips Electronics, N.V. Method and apparatus for object learning and recognition based on optical parameters
US8237685B2 (en) 2006-06-28 2012-08-07 Koninklijke Philips Electronics N.V. Method and apparatus for object learning and recognition based on optical parameters
WO2008007276A3 (en) * 2006-06-28 2008-07-17 Koninkl Philips Electronics Nv Method and apparatus for object learning and recognition based on optical parameters
US10048773B2 (en) 2008-12-05 2018-08-14 Flatfrog Laboratories Ab Touch sensing apparatus and method of operating the same
WO2010064983A3 (en) * 2008-12-05 2010-08-05 Flatfrog Laboratories Ab A touch sensing apparatus and method of operating the same
EP2370884A4 (en) * 2008-12-05 2012-05-23 Flatfrog Lab Ab A touch sensing apparatus and method of operating the same
US8581884B2 (en) 2008-12-05 2013-11-12 Flatfrog Laboratories Ab Touch sensing apparatus and method of operating the same
US9442574B2 (en) 2008-12-05 2016-09-13 Flatfrog Laboratories Ab Touch sensing apparatus and method of operating the same
EP2983070A1 (en) * 2008-12-05 2016-02-10 FlatFrog Laboratories AB A touch sensing apparatus and method of operating the same
WO2011049511A1 (en) * 2009-10-19 2011-04-28 Flatfrog Laboratories Ab Extracting touch data that represents one or more objects on a touch surface
CN102648445A (en) * 2009-10-19 2012-08-22 平蛙实验室股份公司 Extracting touch data that represents one or more objects on a touch surface
US9430079B2 (en) 2009-10-19 2016-08-30 Flatfrog Laboratories Ab Determining touch data for one or more objects on a touch surface
US9024916B2 (en) 2009-10-19 2015-05-05 Flatfrog Laboratories Ab Extracting touch data that represents one or more objects on a touch surface
WO2011060487A1 (en) * 2009-11-17 2011-05-26 Rpo Pty Limited Apparatus and method for receiving a touch input
CN102221938A (en) * 2010-04-16 2011-10-19 北京汇冠新技术股份有限公司 Touch positioning method and system as well as display
WO2011127836A1 (en) * 2010-04-16 2011-10-20 北京汇冠新技术股份有限公司 Touch locating method and system, display
US8780066B2 (en) 2010-05-03 2014-07-15 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
US9547393B2 (en) 2010-05-03 2017-01-17 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
US9996196B2 (en) 2010-05-03 2018-06-12 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
EP2541386B1 (en) * 2011-06-28 2019-08-07 Vestel Elektronik Sanayi ve Ticaret A.S. Display device with touch control feature
EP3543835A1 (en) * 2011-06-28 2019-09-25 Vestel Elektronik Sanayi ve Ticaret A.S. Display device with touch control feature
US9377884B2 (en) 2011-10-11 2016-06-28 Flatfrog Laboratories Ab Multi-touch detection in a touch system
WO2013055282A3 (en) * 2011-10-11 2013-06-06 Flatfrog Laboratories Ab Improved multi-touch detection in a touch system
EP2852878A4 (en) * 2012-05-23 2016-02-17 Flatfrog Lab Ab Touch-sensitive apparatus with improved spatial resolution
EP2852879A4 (en) * 2012-05-23 2016-02-17 Flatfrog Lab Ab Touch-sensitive apparatus with improved spatial resolution
CN103984445A (en) * 2013-02-07 2014-08-13 深圳市艾博德科技有限公司 Infrared touch screen and touch point positioning method thereof
US11893189B2 (en) 2020-02-10 2024-02-06 Flatfrog Laboratories Ab Touch-sensing apparatus

Also Published As

Publication number Publication date
US6690363B2 (en) 2004-02-10
AU2001282713A1 (en) 2002-01-30
WO2002007072A3 (en) 2002-12-19
US20020075243A1 (en) 2002-06-20

Similar Documents

Publication Publication Date Title
US6690363B2 (en) Touch panel display system
US6864882B2 (en) Protected touch panel display system
Bhalla et al. Comparative study of various touchscreen technologies
EP2135155B1 (en) Touch screen system with hover and click input methods
US8130202B2 (en) Infrared touch screen gated by touch force
US8373679B2 (en) Infrared touchscreen electronics
EP1759378B1 (en) Touch panel display system with illumination and detection provided from a single edge
US8325160B2 (en) Contact sensitive device for detecting temporally overlapping traces
JP2016129064A (en) Multipoint touch screen
US20100302211A1 (en) Touch Screen Detecting Method and Apparatus
US20110205189A1 (en) Stereo Optical Sensors for Resolving Multi-Touch in a Touch Detection System
US20080180399A1 (en) Flexible Multi-touch Screen
US20100026667A1 (en) Acoustic multi-touch sensor panel
US20110012856A1 (en) Methods for Operation of a Touch Input Device
US10564759B2 (en) Method and apparatus for providing touch interface
KR101426376B1 (en) Touch Screen Panel With Electro Static Discharge
US20120256845A1 (en) Verifying input to a touch-sensitive display screen according to timing of multiple signals
EP2428881A2 (en) Input device for mobile phone
KR20090006543A (en) A source of light type touch sensing method, touch panel and the system
US20080001072A1 (en) Position detecting apparatus
KR20100129015A (en) An apparatus for detection touch, display apparatus thereto and a method for recognition coordinates
CN101799733A (en) Method for detecting multi-point touch and touch screen
TWI423094B (en) Optical touch apparatus and operating method thereof
CN104035638B (en) Touch electrode structure, touch panel, display device and touch point positioning method
KR101310744B1 (en) System To Detect Touch Signal Of Touch Screen Panel

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)