WO1999053433A1

WO1999053433A1 - Computer mouse

Info

Publication number: WO1999053433A1
Application number: PCT/GB1999/001054
Authority: WO
Inventors: Thomas Norman Reid
Original assignee: Thomas Norman Reid
Priority date: 1998-04-09
Filing date: 1999-04-07
Publication date: 1999-10-21
Also published as: GB2336195A; GB9807548D0; GB2336195B

Abstract

A computer mouse suitable for scanning documents into a computer comprises a base (2), a shell (1), three buttons (3, 4, 5), and a lead (9) for connecting the mouse to a port of a computer. The base (2) has a first ball (6) for recording a change in position of the mouse, a second ball (7) for recording a change in orientation of the mouse, and a downwardly directed scanning unit (8) adapted to scan indicia visible on a surface over which the mouse is positioned. Means are provided for transmitting signals from said first and second balls and said scanning unit to the computer.

Description

COMPUTER MOUSE

This invention relates to a mouse for use with a computer. More specifically, it relates to a mouse which is capable of being used both in the conventional manner for moving a pointer over a computer screen and for controlling functions of the computer, and as a scanning device for transferring visible data from the surface of a document to the computer for display, incorporation into various documents, transmitted to a remote location by fax or E-mail, etc.

It is known that text or pictures from a document can be transferred to a computer by means of a scanning device. Such devices may either be dedicated "stand alone" equipment, or can be provided as an additional function in other equipment, such as a printer or combined printer and fax device. Such equipment can, however, be bulky, and in the case of a dedicated scanner, require an additional port on the processing unit of the computer.

Various attempts have been made to combine the functions of a computer move with an optical scanner. EP-A-0296837, US-A-4804944, -481804949 and -5633489 all describe mice with a built-in scanner. US-4906843 describes a mouse, into which various additional units, including a scanner, may be slotted. All such devices, however, have one or more disadvantages, including the need for accurate registration on the image to be scanned, and usually the need to move the device in straight lines.

There is, accordingly, a need for a simple device which was easy to operate and could conveniently be combined with a personal computer for domestic as well as business use. According to the present invention, therefore, there is provided a computer mouse comprising a base, a shell, three buttons, a lead for connecting the mouse to a port of a computer, a first ball for recording a change in position of the mouse, a second ball for recording a change in orientation of the mouse, and a downwardly directed scanning unit adapted to scan indicia visible on a surface over which the mouse is positioned, and means for transmitting signals from said first and second balls and said scanning unit to the computer.

The present invention will be further described with reference to the accompanying Drawings in which:

Fig 1 is a perspective top view of a mouse according to the invention;

Fig 2 is a perspective view of the bottom of one embodiment of a mouse.

Fig 3 is a perspective view of the bottom of a second embodiment of a mouse.

Fig 4 is a side view, partly in section, of the second embodiment of the mouse; Fig 5 is an underside view of the second embodiment of the mouse.

Referring now to the Drawings, the mouse is provided with an upper shell [1 ] and a base [2] . Left, right and central buttons [3,4,5] are provided for operation in a manner to be described below. On the bottom of the mouse, as shown in Figs 2 and 3, there is a first ball [6] for providing information concerning changes in the position of the mouse, in a conventional manner. In addition, there is provided a second ball [7] which provides data as to the orientation of the mouse, which is important for accurate scanning, as will be described in more detail below. There is further a scanning bar [8] . The mouse is connected to a computer e.g. to the PS/2 socket of the computer by means of a cable [9]. In the first embodiment of the invention, shown in Fig 2, the scanning bar [8] is positioned between the first bar [6] and the cable [9] . In the second embodiment, shown in Fig 3, the scanning bar [8] is located between the first [6] and second [7] balls.

As will be more easily understood by reference to Figs 4 and 5, the first ball [6] is retained by the pressure of a roller [10], on the end of a spring loaded arm depending from the shell, against two spindles [1 1] and [12], bearing respective slotted discs [13] and [14] . Spindle [1 1 ] turns on bearings [15] and [16], while spindle [12] turns on a bearing [17] and an X-bearing [1 5], in common with spindle [1 1 ] .

In a corresponding manner, the second ball [7] is urged by a roller [18] in contact with a second longitudinal spindle [19], carrying a disc [20] and turning in bearings [22] and [23], and a second transverse spindle [21 ], rotating in bearing [24] and to second bearing which is conveniently formed as a unit with bearing [23].

The spring loaded rollers [10] and [18] allow balls [6] and [7] to regress against respective end-stop ball-scraper cups [25] and [26] in the event of excessive down-pressure.

Rotation of the first ball [6] about the longitudinal axis of the mouse, results in rotation of spindle [12] and hence of disc [14] . Correspondingly, rotation of the ball in the transverse direction results in rotation of spindle [1 1 ] and hence of disc [13] . The function of the first ball [6] is to provide information as to the position of the mouse. The function of the second ball [7] is to provide information as to the orientation of the mouse relative to the surface of the image being scanned. Therefore only motion radially with respect to the first ball needs detection. Information as to rotation of this ball is transmitted by rotation of spindle [19] and hence of disc [20]. Spindle [21 ] merely rotates passively and serves to assist in retention of the second ball within the housing.

Rotation of discs [13], [14] and [20] is determined by respective sensors [27], [28] and [29]. In one embodiment of the invention, each of these sensors comprises one light emitting device (LED), and two charge-coupled devices (CCD). The discs are provided with perforations so that light from the (LED) will be detected by the CCDs, by means of which the extent and direction of rotation of the disc can be determined.

Most quality, ink-jet printers can achieve 1440 dpi resolution. Scanners have no difficulty in matching this resolving power. However, Mightymouse must be capable of delivery mechanical tracking of the same accuracy in order to meet the market expectations of domestic and small business use.

Gearing between both balls and their spindles can be 14: 1 . So, if the spindle- disc were to be perforated around a one inch (2.54 cm) diameter, that circumference of 3.14159 (π) inches (7.62 cm) would require 103 'apertures', i.e. one every 3/100^th inch (approx 0.77mm). However, the apertures would be 01 5/1000^th inch in order to leave a blank of the same dimensions:- when two CCDs, of the same dimensions could be positioned to both count and detect direction of rotation.

In the above-described embodiment, the scanning bar [8] comprises a slit- camera whose lens projects an image (illuminated by a light source, e.g. a white light-emitting polymer) on to three parallel rows of charge-coupled devices. Each row is coated with a primary colour filter (RGB).

For each incremental movement of the mouse, the on-board processing chip scans the output of the CCDs through an anaiogue-to-digital ( 10 bit) converter which translates the varying voltages (due to different light intensities) into 1s and Os. Typically twice as many CCDs are arranged along the slit as the desired resolution of the host computer's printer resolution. So, to achieve 1440 dpi output (a typical resolution for an ink jet printer), the 'slit' would need to hold three parallel rows of 2880 CCDs.

The transmission to the host computer for each primary colour increment (pixel) viewed from the indicia is 8 bits : but only after the imaging chip has eliminated noise and check bits. Thus, for each incremental movement of the mouse, 2880 x 3 bytes (8-bit) of image information is transmitted after the position information(obviously less if lower resolution is selected). So, a transmission protocol must be used which will accept at least 64K bits-sec for the speed of the mouse capture of indicia to be 'user-friendly'.

The major problem with scanning is that the document must be accurately registered with respect to the scanning head. Thus conventional, "flat-bed" scanners are relatively large machines which feed documents under a scanning head (or move the scanner over the contained document) while positional control is accurately maintained.

The most ubiquitous position device for a PC is the mouse. But as it exists, it is not suitable for scanning, as it is used to push a pointer around a computer screen - relying on the hand-to-eye coordination of the operator to locate it by compensating movements of his hand without regard to the absolute position of the mouse on the desktop. If the mouse is lifted up and moved to another position, the pointer on the screen stays where it was until the mouse is put down (anywhere) and moved again.

The present invention solves the problem of registering the mouse on the desktop to a fixed point on the screen, and ensures that all its movements on the screen faithfully represent its movements over the desktop, thereby providing the vehicle for a scanning device. The driver software associated with the mouse allows the left and right buttons [3] and [5] to be configurable for right or left-handed operation. In the following description, it is assumed that the driver software has been set up for a right-handed person.

Viewed from the top, this mouse looks like a conventional, three-button mouse, but viewed from below the difference becomes apparent. The mouse according to the invention has two balls, and it also has a scanning bar.

The single ball of a conventional mouse is used to record relative movement of the position of the whole mouse: as it rolls, in one direction or another, it drives 'x' and 'y' coordinate rollers whose increments of rotation send signals to the computer.

When a scanning unit is incorporated, it is necessary to provide information not only of the position and any displacement of the mouse, indicated by the coordinates determined by the first ball, but also of the orientation of the mouse, i.e. the angle made by the scanner to the indicia on the document being scanned. According to the invention this information concerning the orientation is provided by the second ball, whose rollers send signals to the computer to indicate any angular changes as the mouse is moved to scan the document.

For compatibility, the mouse is capable of being connected to a computer through its standard PS/2 socket. Consequently, the signal cables [9] are used to carry the orientation data to the computer and the scan data in parallel with the position coordinates.

'Active' scanners tend to transmit a lot of image information in parallel and so cannot use the serial ports of a computer. The mouse according to the invention is a 'passive' scanner: it will only transmit image information when it is moved (in scan mode). 1440 bytes (for example) of attribute information will be transmitted for each incremental movement of the scanning slit. Such image information would be preceded by position information from the first ball [6] and orientation information (x-displacement) from the second ball [7] . This minimum transmission should make it possible to use the PS2 or (new) USB ports of a personal computer. However, the on-board processing chip of the mouse can ensure that queuing problems do not occur and, if information is lost, this will be apparent on the screen so that the mouse can be moved to recapture it.

The host computer's driver software would examine received image information to see if it varied from that already displayed at the same position. If no new information were present then no changes would be made to the display.

Before scanning, the mouse orientation must first be registered, i.e. aligned with the screen of the computer and the image document before the scanning process.

The mouse according to the invention will operate as a conventional one-ball mouse until the centre button is double-clicked to activate scanning mode.

This double click is detected by the driver software, which interacts with the application software (e.g. Microsoft Word, active at the top level of tasks running on the PC at the time) to open a 'frame' at the then current text- cursor position in the text document on the screen.

Movement of the mouse while holding down the left mouse-button, causes the screen pointer to 'drag' one 'tool-bar' of the frame at a time to create an insertion area of the correct size for the image to be scanned into it. Next, the top-left corner of this frame must be aligned with the top-left reference point of the document to be scanned. To do this, the mouse must be lifted on to the document, its nose-pointer placed on the document's top- left reference point and the right mouse button given a single click. This will cause the driver software to align the top-left of the frame on the screen with the top-left of the document under the mouse. It will set both the position and angular coordinates to 0,0 and zero degrees, respectively.

A pop-up window will appear on the screen, asking the user to set the resolution of the scan, and the gearing between the movement of the mouse over the image and the rate at which it appears on the screen (with conventional mice, quite small movements can cause quite rapid 'acceleration' of the pointer on the screen. In scan mode, the mouse according to the invention will allow no acceleration.

The right mouse-button having clicked Registration, the left should be held down as the mouse scan-bar is wiped over the document area to be copied to the frame on the screen. If the button is released, copying will cease, but the mouse must be kept firmly in contact with the document as it is moved on to copy a disjoint area (if the mouse is lifted. Registration will be lost and upon replacement, copying will end up in the screen frame next to the last area copied - there is also a risk of overwriting existing copy).

To cease scanning, the left mouse-button is released and the centre button is double-clicked (a single click will be ignored). On detecting the double click, the driver software will cause a pop-up window to appear to allow the user to key in the name of a '* .bmp' file and its directory where the copied image in the frame on the screen can be saved (in a Word Processing application the image would also be saved in the text of the user's document file). Upon closing the pop-up window the image will be saved, the frame will be closed and control restored to the current application(Word Processing) package, with the mouse reverting to conventional mode.

The scanning device may, if desired, be made to record either in monochrome or record colour images. Various forms of scanner are possible including a laser scanner which will, for instance, comprise a single projector (for monochrome scanning) or three primary colour laser-projectors for colour scanning, a mirror-prism which may be oscillated or rotated, and an appropriate photoreceptor or receptors.

An alternative form of scanner can use technology similar to that of the Camcorder and would include a means, such as a lens, for projecting an image of a portion of a target document on to a charge-coupled device (CCD) divided into an array of pixels scannable by an image processing clip.

A further embodiment could comprise a lens bar for projecting a slit of light e.g. from an electro-luminescent phosphor or from a fluorescing polymer through the lens on to a document to be scanned. Light reflected from the document passes through the lens and is then refracted through a prism on to photoreceptors for the primary colours.

Various uses of the mouse according to the invention will be possible. Apart from recording images on to files stored in the computer for subsequent processing and incorporation into other documents, it can also be used as a means for incorporating a signature on to a document for fax transmission from the computer. There are already various software packages for signature verification of 'biometric tokens' which are employed for electronic commerce by means of the Internet.

It could be used to scan signatures, amendment notes, business cards, logos, photographs of the grandchildren and embed them in documents that could be 10 e-mailed to anywhere in the world. Authentification could be accomplished formally by existing methods. But the more prevalent were the samples of handwriting then the easier would be the verification.

Ease of use requires that scanning be carried out in a manner similar to polishing a table rather than be subject to rigid geometric rules.

The only imposition for its use as a scanner is that it must remain in contact with the scanned surface throughout the process of data acquisition. If it is lifted up then registration is lost. This may be carried out voluntarily for artistic reasons, but if it is an error then the process of scanning must be restarted.

Claims

1 1CLAIMS

1 . A computer mouse comprising a base, a shell, three buttons, and a lead for connecting the mouse to a port of a computer, said base having a first ball for recording a change in position of the mouse, a second ball for recording a change in orientation of the mouse, and a downwardly directed scanning unit adapted to scan indicia visible on a surface over which the mouse is positioned, and means for transmitting signals from said first and second balls and said scanning unit to the computer.

2. A computer mouse as claimed in Claim 1 wherein the scanning unit comprises a laser scanner.

3. A computer mouse as claimed in Claim 1 wherein the scanning unit comprises means for projecting an image on to a charge-coupled device divided into an array of pixels scannable by an image-processing chip.

4. A computer mouse as claimed in Claim 1 wherein the scanning unit comprises a bar lens for projecting light from a light source on to a surface to be scanned, and for projecting reflected light from said surface to a prism for refracting said reflected light on to photoreceptors.

5. A computer mouse as claimed in Claim 1 wherein the scanner bar comprises a light source, and three parallel rows of charge coupled deices, each row having a coating of a colour filter for receiving light reflected from an image being scanned.

6. A computer mouse as claimed in any of Claims 1 to 5 wherein the scanning unit is located between the first and second bails.

7. A computer mouse as claimed in any of Claims 1 to 5 wherein the scanning unit is located between the balls and an end of the mouse.