US20090295723A1

US20090295723A1 - Interactive display system

Info

Publication number: US20090295723A1
Application number: US12/539,012
Authority: US
Inventors: Andrew Robert Oakley; Ian Spencer Joscelyne; Peter Unsworth
Original assignee: Promethean Ltd
Current assignee: Promethean Ltd
Priority date: 1999-01-13
Filing date: 2009-08-11
Publication date: 2009-12-03
Also published as: DE60001631D1; EP1141815B1; EP1141815A1; AU1883400A; WO2000042494A1; DE60001631T2; CA2355649A1; JP2002535704A; CA2355649C; US7584432B1

Abstract

An interactive display system comprises a white board which communicates with a PC. A projector receives signals from the PC which are translated into corresponding project image which is projected on to the white board. The image projected on to the white board is the same as that shown on a computer screen. By using an electronic pen the position of which can be detected electronically by means of a plurality of wires embedded beneath the surface of the white board and using methods already known in the art, the electronic pen can function in the same way as a computer mouse. The image projected on to the white board may also be manipulated by means of a remote control device, which uses Infra red communication to transmit signals to a transponder built within the white board.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 09/889,137, filed Jul. 12, 2001, which is the National Stage of International Application No. PCT/GB00/00012 filed Jan. 5, 2000, which claims the benefit of GB99/00555.5 filed on Jan. 13, 1999. Each of these applications and patents are incorporated herein by reference in their entirety.

BACKGROUND OF THE INVENTION

This invention relates to an interactive display system, particularly, but not limited to an interactive display system which includes a remote signaling device.
Existing interactive displays make use of an electronic whiteboard which can sense the position of an electronic pen on the surface of the whiteboard. When a computer display is projected onto the whiteboard and its position calibrated, the electronic pen can be used in the same way as a computer mouse to manipulate objects on the computer display by passing the electronic pen over the surface of the whiteboard. This type of interactive whiteboard enables the teacher to manipulate and annotate material rapidly as a result of audience questions. The use of interactive whiteboards improves teaching productivity and also improves student comprehension. Such whiteboards allow use to be made of good quality digital teaching materials, and allow data to be manipulated and presented using audio visual technologies.
Problems arise with these existing interactive whiteboards in that it is difficult to assess a student's comprehension of the material. Also, the systems require a cumbersome amount of wiring between the various parts of the system.

SUMMARY OF THE INVENTION

It is an object of the present invention to address to above mentioned disadvantages.
According to a first aspect of the present invention an interactive display system comprises a display device, an image projector, computing means and at least one remote signaling device, in which the computing means is arranged to supply image information to the projector, which is arranged to project said image information onto the display device; and in which the or each remote signaling device is operable to transmit signals to a receiver portion of the display device, the display device, being arranged to supply the signals to the computing means, said signals being stored by the computing means for display.
The display means is preferably a communications hub of the display system arranged to receive control signals from a pointing device and/or a remote control device and transmit those signals to the computing means in order to control the image projected onto the display means. In preferred embodiments the display means uses a single communications link between it and the computing means which is capable of conveying signals both from the pointing device and the or each remote signaling device, to enable a most efficient transfer of data. Preferably this single link is a wireless connection such as infra-red means or radio means.
The or each remote signaling device, may be a remote control device which is operable to transmit control signals to a receiver portion of the display device, which control signals are supplied to the computing means and are operable to control the computing means and thus image information supplied to the projector.
The display device may include a wireless transmitting portion, preferably integral with the receiver portion.
The display device may include position indication means for indicating the position of a pointing device relative to a surface of the display device.
The interactive display system may be operable to calibrate the location of an image projected onto the display device relative to the display device. The pointing device may be operable to effect the calibration.
The pointing device may be operable to induce image control signals in the position indication means, which image control signals are operable to control the computing means and thus image information projected onto the display means. Alternatively, pressure exerted by the pointing device on the display means may induce control signals in the position indication means. A further alternative is that the pointing device may include a laser, the position of light from which on the display means is used to cause control signals in the position indication means to be generated.
The pointing device may be arranged to take precedence over the or each remote signaling device, with signals from the or each remote signaling device being ignored if signals from the pointing device are being received.
The pointing device may be operable to selectively enable the or each remote signaling device, preferably by signals supplied via the display means.
The receiver portion of the display device may be located in an upper part thereof, preferably on a front face thereof.
The display device may include an output portion arranged to transmit signals from both the receiver portion and the position indication means to the computing means. The output portion may transmit the signals by wire link or by wireless link. The output portion may be operable to pass signals by wire to a separate wireless transmitter for transmission. Said wireless transmitter portion may be mounted for ease of transmission to the computing means, on a ceiling for instance. The wireless transmitter may also be a wireless receiver, to receive signals from the or each remote signaling device.
The computing means may be a standalone computer, such as a personal computer or may be a networked computer or networked computer server.
The or each remote signaling device may be operable to transmit signals to the receiver portion only in response to a request signal from the display means, preferably from the transmitter portion. Where a plurality of remote signaling devices are provided, the display means may request information from each remote signaling device in turn, by polling. For instance, by interrogating each remote signaling device in turn to gather data from them sequentially. It will be understood however that other arrangements may be utilized and that the system may allow for simultaneous reception of data from more than one such remote signaling device.
The or each remote control device may be operable to control the computing means in substantially the same manner as a keyboard and mouse combination.
The system preferably comprises one master control device, which may be a remote control device or a pointing device, and a plurality of subsidiary remote signaling devices, in which case the master control device is preferably operable to control display means and computer to selectively activate and deactivate the subsidiary signaling devices.
The subsidiary remote signaling devices may be response devices for responding to information displayed on the display means by a person controlling the master control device.
According to another aspect of the invention an interactive display system comprises a display device, computing means and at least one remote signaling device, in which the computing means is arranged to supply image information to the display device; and in which the or each remote signaling device is operable to transmit signals to a receiver portion of the display device, the display device being arranged to supply the signals to the computing means, said signals being stored by the computing means for display.
According to another aspect of the present invention a method of operating an interactive display system comprises projecting an image of a computer display of a computer onto a display device, receiving signals at a receiver portion of the display device, which signals are transmitted from at least one remote signaling device, and transmitting those signals to the computer.
The method may include the signals from the or each remote signaling device being independent of the location of the remote signaling device relative to the display means, for instance the signals from the remote signaling device may contain non-position related data.
The signals from the or each remote signaling device are preferably transmitted in response to information displayed on the display device.
According to a further aspect of the present invention an interactive display device comprises a receiver portion for receiving signals from a remote signaling device, the display device being operable to supply the received signals to a computing means and suitable for displaying an image from the computing means projected onto said display device.
The display device preferably forms a communications hub for an interactive display system.
The invention extends to a remote signaling device for use with the interactive display system described in the first aspect.
All of the features described herein may be combined with any of the above aspects, in any combination.
Specific embodiments of the present invention will now be described by way of example and with reference to the accompanying drawings, in which:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic view from above of an interactive display system installed in a classroom;

FIG. 2 is a schematic side view of the layout in FIG. 1;

FIG. 3 is a schematic front view of an interactive display device;

FIG. 4 is a schematic block diagram of the parts of interactive display device;

FIG. 5 is a schematic block diagram of the parts of a feedback device for use with the interactive display system;

FIG. 6 is a schematic diagram of the interconnections between the various parts of an interactive display system installation;

FIG. 7 is a schematic view from above of a classroom layout for an alternative embodiment of interactive display system; and

FIG. 8 is a schematic block diagram of the parts of a remote receiver of a computer/projector portion of the interactive display system.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

Referring to FIG. 2, an interactive display system comprises a whiteboard 10 which communicates with a PC 12. A projector 14 receives signals from the PC 12 which are translated in to a corresponding projection image which is projected on to the whiteboard 10.
The image projected on to the whiteboard 10 is the same as that shown on a computer screen 28. By using an electronic pen 16, the position of which can be detected electronically by means of a plurality of wires embedded beneath the surface of the whiteboard 10, and using methods already known in the art, the electronic pen 16 can function in the same way as a computer mouse. Alternatively, the whiteboard may be of the resistive type, in which the presence of a pointing device is detected by pressure causing two layers to contact each other at a particular location, which location is then detected. A further alternative is the use of a laser pen. The position on the whiteboard of a light spot from the pen is calculated by detecting a reflection of the laser light from the whiteboard back to the laser pen by triangulation.
The image projected on to the whiteboard 10 may also be manipulated by means of a remote control device 18, which uses infrared communication to transmit signals to a transponder 20 built into the whiteboard 10. The signals received by the transponder 20 are then relayed to the PC 12, either by a wire link or a wireless link.
FIG. 6 shows a typical schematic of the connections between various parts of the interactive display system.
The whiteboard 10 comprises a grid portion 52 which comprises two sets of wire loops arranged orthogonally to each other. An electric signal from the pen 16 induces a current in the wire loops which can be used to determine the position of the pen 16. The infrared transponder 20 is located behind an optical window 24 on an upper part of the front of the whiteboard 10 which allows two way infrared communications. Also, a connector (not shown) is provided on the rear of the whiteboard 10, which connector allows signals to and from the infrared transponder 20 of the whiteboard to be directed to an auxiliary high power and high sensitivity infrared transponder module 26 (see FIG. 2) which could be attached to the ceiling of a classroom to provide greater coverage for a large classroom.
The whiteboard 10 is connected to the PC 12 via an RS232 serial port or a USB (universal serial bus) port. The PC 12 may alternatively be a semi-intelligent network device controlled by a central server system or it could be a local PC, which is stand alone or networked.
Display data from the PC 12 is fed to the project 14 which can either be freestanding or ceiling mounted. The display, which is normally seen on the monitor 28 of the PC 12 is projected on to the whiteboard 10.
The electronic pen 16 assumes the functionality of the mouse of the PC 12 and allows a presenter to control the computer desktop and any applications run by the PC 12. By using suitable software the pen 16 may be able to function as a keyboard.
FIG. 4 is a schematic block diagram of the whiteboard 10. As described above, the whiteboard 10 includes a grid 52 which comprises two sets of wire loops arranged at right angles to each other. A signal processing unit 54 determines the position of the electronic pen 16 on the whiteboard grid 52. An analogue to digital converter 56 converts signals from the signal processing unit 54 into digital information which is passed to a microprocessor 58 which includes flash memory 60. Output from the microprocessor can optionally be put through an RS232 serial port 62 or a USB port 64. Signals from the microprocessor 58 and the signal processing unit 54 are supplied to a control logic unit which passes signals to a wireless communications expansion port 68 which in turn communicates with one of an infrared transponder module, a 418/433 MHz or 868/870 MHz radio module or a 2.4 GHz spread spectrum module, whichever is selected.
FIG. 5 shows a schematic block diagram of one of the remote control devices 18. The blocks shown in dashed lines are optional. Each remote control device 18 comprises a microprocessor 36 which is powered by a battery module 32 and power management hardware 34. The battery module 32 has a battery charger circuit 30. The microprocessor 36 includes flash memory 38. The microprocessor 36 may receive input from one or both of a tablet module 40 or a keypad 42. The remote control device 18 may optionally have an LCD display 44. The microprocessor 36 may receive external signals from an infrared transceiver module 46, a 418/433 MHz or 868/870 MHz radio module 48 or a 2.4 GHz spread spectrum module 50.
The electronics within the whiteboard 10 process the signals from the whiteboard surface and grid portion 52 (see FIG. 6) and thus determine the position of the pen and information corresponding to buttons (not shown) pressed on the electronic pen 16. The infrared transponder 20 uses a standardized infrared technology which is commonly available. This facility allows “wireless” connectivity to third party devices using pre-existing software drivers. An alternative would be to use existing radio frequency technology instead of infrared technology.
The remote control device 18 communicates with the transponder 20 of the white board 10 using infrared. The remote control device 18 is suitably for use by a teacher to control the display projected onto the whiteboard 10 in a similar manner to a standard computer mouse or the electronic pen 16 mentioned above. The remote control device 18 may alternatively be used by a student who would be allowed to write on the whiteboard 10 or control applications of the PC 12 projected onto the whiteboard 10 without the student having to leave his seat. When the remote control device 18 is arranged for use by a student, a teacher would typically have control of the electronic pen 16. The pen 16 takes precedence over the remote control device 18 in the situation where signals are supplied to control the whiteboard 10 from the remote control device 18 and the electronic pen 16 simultaneously.
In addition to or as a replacement for the remote control device 18 the display system may comprise a plurality of student remote control units 18. In this case access to control the display on the whiteboard 10 can be controlled by a teacher having a master remote control device 18 or by using the electronic pen 16. The control of precedence of signals from the electronic pen 16 over those form one or more of the remote control device 18 is effected by suitable communication protocols.
The remote control devices 18 may take the form of a keypad unit or a display device or a combination of the two.
When a plurality of remote control devices 18 are used a teacher may pose questions which are displayed on the whiteboard 10, which are answered by students having one of the remote control devices 18. In order to obtain the students' answers, the whiteboard 10 transmits a request from the transponder 20 to all of the remote control devices 18 in turn. The request includes an address and a type code for a particular device with which it wishes to communicate. The relevant device having the specified address will then transmit a response given by a student (and stored in memory) back to the whiteboard 10. Depending on the type of control device 18 the response data may be positional (i.e.; to give a location on the whiteboard display), alphanumeric, information on a simple button press on the device (i.e.; where the student has been asked to a YES/NO answer by pressing one of two buttons) or the response data may be a combination of all three.
For remote control devices 18 which include a display, the transponder 20 on the whiteboard 10 will transmit alphanumeric or graphical information to the device which is to be displayed on the remote control device display.
In a situation where a teacher is setting a student comprehension test, the teacher either requests graphical interaction from a particular student or alternatively, poses a set of questions on the whiteboard 10 and invites alphanumeric responses from the whole class. In the former case, the whiteboard 10 transmits information to a particular remote control device 18 via the transponder 20, which transponder 20 then waits for a response from the chosen remote control device 18. In the latter case the transponder 20 of the whiteboard 10 sends out requests for information from each of the individual remote control devices 18 within the room. These requests are made on a sequential basis with only one remote control device 18 replying at a particular time. This is achieved by each remote control device 18 having a specific device type code and a unique address.
FIG. 7 shows an alternative arrangement of the interactive display in which rather than using the serial port 62 or the USB port 64 with a corresponding wire connection shown in FIG. 4 between the whiteboard 10 and the PC 12, instructions are sent between the whiteboard 10 and the PC 12 by means of a transponder on the whiteboard 10 which transmits signals to an infrared or radio receiver unit 70 which is connected to the PC 12. In the example shown in FIG. 7 the projector and PC are separate units, but the two could be a single integrated unit.
FIG. 8 is a schematic block diagram of the receiver unit 70 shown in FIG. 7. The receiver unit 70 comprises a microprocessor 72 having flash memory 74. Signals are sent from the microprocessor 72 to the PC via a serial interface 76. Signals are received from the whiteboard 10 via an infrared transceiver module 78 of 418/433 MHz radio module 80 or a 2.4 GHz spread spectrum module 82.
The interactive display system disclosed herein uses a whiteboard as a controller for the computer system. This takes advantage of the fact that a whiteboard is the focus of attention in a classroom, making it well suited to host a response system for student feedback devices. The provision of student feedback devices gives a student the ability to control the whiteboard display without leaving his seat. This includes the capability of freehand drawing and annotation. Data from both the whiteboard and from student responses are fed to the host computer down the same serial communications channel, which minimizes wiring infrastructures.
The top of a typical whiteboard is above head height and as a result is an ideal vehicle for mounting an infrared transceiver.
The system gives a teacher the ability to test students for assimilation of material which has just been given to students. This has distinct advantages over previous systems which would require the setting of a test and subsequent marking of the test which introduces undesirable time delays into the teaching process.
The provision of the receiver for the student feedback devices on the whiteboard allows the computer which generates the images to be out of the classroom, perhaps in the form of a larger network computer.
The reader's attention is directed to all papers and documents which are filed concurrently with or previous to this specification in connection with this application which are open to public inspection with this specification, and the contents of all such papers and documents are incorporated herein by reference.
All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive.
Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent or similar features.
The invention is not restricted to the details of the foregoing embodiment(s). The invention extends to any novel one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method or process so disclosed.

Claims

1. An interactive display system comprising: a projector; a device onto which an image is projected from the projector; a computing means; a pointing device; and a plurality of remote signaling devices, in which system:

the computing means is arranged to supply image information to the device onto which an image is projected from the projector;

the plurality of remote signaling devices are operable to transmit signals;

the device onto which an image is projected from the projector includes position indication means for determining the position of the pointing device relative to a surface of the device onto which an image is projected from the projector;

the pointing device is operable to:

take precedence over the remote signaling devices; and

selectively enable each remote signaling device.

2. An interactive display system as claimed in claim 1, in which the display means is a communications hub of the display system arranged to receive control signals from a pointing device and/or a remote control device and arranged to transmit those signals to the computing means in order to control an image on the display means.

3. An interactive display system as claimed in claim 1, in which the display means uses a single communications link between it and the computing means, which link is capable of conveying signals both from the pointing device and the or each remote signaling device, to enable a most efficient transfer of data.

4. An interactive display system as claimed in claim 3, in which the single link is a wireless connection such as infra red means or radio means.

5. An interactive display system as claimed in claim 1, in which the or each remote signaling device is a remote control device which is operable to transmit control signals to a receiver portion of the display device, which control signals are supplied to the computing means and are operable to control the computing means and thus image information supplied to the display means.

6. An interactive display system as claimed in claim 1, in which the display device includes position indication means for indicating the position of a pointing device relative to a surface of the display device.

7. An interactive display system as claimed in claim 1, which is operable to calibrate the location of an image on the display device relative to the display surface.

8. An interactive display system as claimed in claim 1, in which the pointing device is operable to induce image control signals in the position indication means, which image control signals are operable to control the computing means and thus image information is displayed on the display means.

9. An interactive display system as claimed in claim 1, in which the pointing device is arranged to take precedence over the or each remote signaling device.

10. An interactive display system as claimed in claim 1, in which the pointing device is operable to selectively enable the or each remote signaling device.

11. An interactive display system as claimed in claim 1, in which the display device includes an output portion arranged to transmit signals from both the receiver portion and the position indication means to the computing means.

12. An interactive display system as claimed in claim 1, in which the or each remote signaling device is operable to transmit signals to the receiver portion only in response to a request signal from the display means.

13. An interactive display system as claimed in claim 1, in which where a plurality of remote signaling devices are provided, the display means requests information from each remote signaling device in turn, by polling.

14. An interactive display system as claimed in claim 1, in which the or each remote control device is operable to control the computing means in substantially the same manner as a keyboard and mouse combination.

15. An interactive display system as claimed in claim 1, in which the system comprises one master control device which is a remote control device or a pointing device, and a plurality of subsidiary remote signaling devices.

16. A method of operating an interactive display system including: a projector; a device onto which an image is projected from the projector; a computing means; a pointing device; and a plurality of remote signaling devices, the method comprising the steps of:

projecting an image of a computer display of a computer onto the device onto which an image is projected from the projector,

adapting the plurality of remote signaling devices to transmit signals;

determining the position of the pointing device relative to a surface of the device onto which an image is projected from the projector;

arranging for the pointing device to:

take precedence over the remote signaling devices, and selectively enable each remote signaling device.

17. A method as claimed in claim 16, which includes the signals from the or each remote signaling device being independent of the location of the remote signaling device relative to the display means.

18. A method as claimed in claim 16, in which the signals from the or each remote signaling device are transmitted in response to information displayed on the display device.