WO1999057678A1 - Device for recording information in different modes - Google Patents

Device for recording information in different modes

Info

Publication number
WO1999057678A1
WO1999057678A1 PCT/SE1999/000716 SE9900716W WO9957678A1 WO 1999057678 A1 WO1999057678 A1 WO 1999057678A1 SE 9900716 W SE9900716 W SE 9900716W WO 9957678 A1 WO9957678 A1 WO 9957678A1
Authority
WO
WIPO (PCT)
Prior art keywords
mode
information
area
images
information carrier
Prior art date
Application number
PCT/SE1999/000716
Other languages
French (fr)
Inventor
Christer FÅHRAEUS
Original Assignee
C Technologies Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE9801531A external-priority patent/SE9801531L/en
Application filed by C Technologies Ab filed Critical C Technologies Ab
Priority to EP99948569A priority Critical patent/EP1073989A1/en
Priority to BR9910579-9A priority patent/BR9910579A/en
Priority to IL13910699A priority patent/IL139106A0/en
Priority to JP2000547582A priority patent/JP2002514021A/en
Priority to KR1020007012068A priority patent/KR20010052280A/en
Priority to CA002331121A priority patent/CA2331121A1/en
Priority to AU43031/99A priority patent/AU758236B2/en
Publication of WO1999057678A1 publication Critical patent/WO1999057678A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/10Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces
    • H04N1/107Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces with manual scanning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/142Image acquisition using hand-held instruments; Constructional details of the instruments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387Composing, repositioning or otherwise geometrically modifying originals
    • H04N1/3872Repositioning or masking
    • H04N1/3873Repositioning or masking defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/19Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
    • H04N1/195Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/0402Arrangements not specific to a particular one of the scanning methods covered by groups H04N1/04 - H04N1/207
    • H04N2201/043Viewing the scanned area
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/0402Arrangements not specific to a particular one of the scanning methods covered by groups H04N1/04 - H04N1/207
    • H04N2201/0452Indicating the scanned area, e.g. by projecting light marks onto the medium

Definitions

  • the present invention relates to a device for recording information according to the preamble to the appended claim 1.
  • a known way of feeding text and image information into a computer is to use a scanner. Scanners of both the stationary and the portable type are available. A stationary scanner is used for scanning whole pages of text and image information, the scanner being passed over the page automatically at a constant speed. This type of scanner is not suitable for scanning selected parts of information on a page. On the other hand, a portable scanner may be suitable for this purpose.
  • US 5 301 243 discloses a hand-held scanner for scanning characters from a character sequence on a substrate.
  • the scanner which is passed over the characters which are to be read in contact with the substrate, has an optical system which "sees" a small part of the substrate.
  • the optical system comprises a CCD type line sensor, which has a plurality of light-sensitive elements arranged in a row.
  • OCR software OCR Optical Character Recognition
  • OCR Optical Character Recognition
  • US 4 949 391 Another type of hand-held scanner for inputting text is described in US 4 949 391. Unlike the one described above, this scanner has a two-dimensional sensor, which records images of the underlying surface when the scanner is passed over the same. The scanner can only be moved in a direction determined by a wheel abutting against the surface. Redundant information is removed from the recorded images, which are subsequently combined into a larger image. The larger image can be analysed in a computer for identifying characters.
  • the object of the present invention is to provide a solution to the problem described above.
  • the device is adjustable between a first operating mode and a second operating mode, in which images of an area with a first small and a second large size of the information carrier are recorded so that the information on the information carrier can be recorded at different degrees of selectivity.
  • the device In the first operating mode, the device is adapted to be passed over the information while recording a plurality of images with partially overlapping contents, which are put together into a composite image of the information and which each are related to an area with the first small 3 size of the information carrier.
  • the device is adapted to image the information by means of at least one image which relates to an area with the second large size of the information carrier.
  • the device thus has a first mode for recording information at a high degree of selectivity, e.g. individual words or character sequences, and a second mode for recording larger amounts of information at a lower degree of selectivity, e.g. several lines of text or an image, at the same time.
  • An advantage of this device is that the user can choose whether he or she wishes to record information at a high or low degree of selectivity. This can be achieved by a simple adjustment of the device. The user can thus first use the device in the first mode for recording a sentence in a text and subsequently adjust it to the second mode and use it for fast recording of an illustration which takes half a page.
  • the information carrier can be any two- or three- dimensional object. Of course, it will usually be a sheet of paper.
  • the information on the surface may be composed of characters in the form of letters, numbers, or other written characters or symbols, or of various types of images .
  • the recording is carried out with the aid of a light-sensitive sensor having a two-dimensional sensor surface.
  • a two-dimensional sensor surface refers to the fact that the sensor surface must be able to image a surface with a matrix of pixels so that images with overlapping contents can be recorded.
  • the light-sensitive sensor is preferably of the CCD or CMOS type. It can record images in grey scale or in colour.
  • the images comprise a plurality of pixels, each having an intensity value .
  • the device can be adjusted by the user or automatically by the device. The adjustment involves the adaptation of the device in some manner, e.g. physically or in 4 terms of software, to make it suitable for use in the mode in question.
  • the device is preferably provided with indicating means for indicating the size of the imaging area. It is particularly important that the user knows the size of the imaging area in the second mode since this area is larger in that mode. However, the size of the imaging area is preferably indicated in the first mode as well.
  • the size of the imaging area can be indicated on the information carrier itself so that the user can see exactly which information will be recorded. It can be indicated by, for example, dots, lines, or colour, etc.
  • the indicating can be effected by means of a single luminous spot or by means of a line showing where on a line the recording will commence. What is important is that the user gets an idea of the size of the imaging area.
  • the indicating means comprise an illumination means, e.g. a light-emitting diode or a laser diode.
  • the imag- ing area is indicated by a plurality of luminous spots between which the imaging area is located.
  • a less complicated optical design of the device as well as more accurate image recording are achieved in this way, since no coloured light is recorded in the image. This is par- ticularly important in connection with the use of colour- sensitive sensors.
  • Another way of indicating the imaging area can be to show what is located within the field of vision of the device on a display which in this case constitutes the indicating means.
  • the indicating means may comprise a display as well as an illumination means for indicating on the information carrier. 5
  • the device can be acted upon for continuous adjustment of the size of the area which is to be imaged between the first small size in the first mode and the second large size in the second mode.
  • the user can himself determine, e.g. with the aid of a slider control, the exact size of the imaging area, something which can be advantageous, for example, in connection with the recording of images.
  • the indicating means is also acted upon in connection with the continuous adjustment so that the user can see how the size of the imaging area changes.
  • the change of the size of the imaging area between the first and the second mode can advantageously be effected by utilising a smaller part of the sensor sur- face in the first mode and a larger part of the sensor surface in the second mode. This can be achieved by only saving information from the desired part of the sensor surface.
  • the continuous adjustment of the imaging area can also be achieved in this way.
  • the indicating means advantageously consist of a display.
  • An alternative way of changing the size of the imaging area is to provide the device with a lens means, which is adapted to project the images of the information carrier onto the sensor surface and which is adjustable for changing the imaging area.
  • the lens means can comprise one or more lenses. The advantage of this alternative is that it provides better resolution.
  • One way of changing the size of the imaging area with the aid of the lens means is to change the focal distance of the lens means. This can be achieved by the lens means being adjustable between a first position in the first mode and a second position in the second mode.
  • the lens means can also be continuously adjustable for continuous adjustment of the position of the lens means between the first and the second position, so that an optional size of the imaging area can be obtained.
  • the putting-together is preferably carried out both vertically and horizontally. This has the advantage that the device can be held at different angles and even be turned while being passed over the information carrier and yet the images can be put together well enough that the characters in the composite image can be identified and OCR processed.
  • the signal-processing unit preferably comprises software for identifying characters in the composite image and for storing the same in the device in character-coded format, e.g. ASCII code.
  • the character identification can, for example, be carried out with the aid of a neural network.
  • the device may advantageously comprise a transceiver for wireless communication with an external unit.
  • the transceiver can be an IR transceiver, a mobile radio transceiver, or some other suitable transceiver.
  • the device can advantageously operate as a scanner also in the second operating mode, in which case it is adapted to be passed over the information while recording a plurality of images with partially overlapping contents, which images are put together into a composite image of the information and which each relate to an area of the second large size.
  • Fig. 1 schematically shows a first embodiment of a device according to the invention
  • Fig. 2 is a block diagram of the electronic circuitry in a first embodiment of the device according to the invention
  • Fig. 3 schematically shows the indicating area in connection with the use of the device in the first mode and the second mode respectively;
  • Fig. 4 is a flowchart showing how the device is intended to be used in the first mode
  • Fig. 5 is a flowchart showing how the device is intended to be used in the second mode.
  • FIG. 6 schematically shows a second embodiment of a device according to the invention. Description of Preferred Embodiments
  • a casing 1 having approximately the same shape as a conventional highlighter pen.
  • One short side of the casing has a window 2, which is intended to be directed at an area on an information carrier which a user wishes to image.
  • the informa- tion carrier can, for example, consist of a sheet of paper or some other type of storage medium, from which a user wishes to record information in character or image format .
  • the window 2 is somewhat recessed in the casing 1 in order to reduce the risk of scratches or other damage when the device is not in use.
  • the casing 1 essentially contains an optics part 3, an electronic circuitry part 4, and a power supply part 5.
  • the optics part 3 comprises four light-emitting diodes 6 jointly constituting an indicating means, but of which only two are visible in the Figure, as well as an adjustable lens system 7 and a light-sensitive sensor 8 which constitutes the interface with the electronic circuitry part 4.
  • the LEDs 6 are used for indicating the area on the information carrier under the device which can be imaged by means of the device.
  • the lens system 7 fulfils two tasks simultaneously. One of its tasks is to project light from the LEDs 6 onto the information-carrying surface towards which the window of the device is directed for defining the imaging area. The light from the LEDs can be seen on the surface in the form of luminous spots.
  • the other task of the lens system 7 is to image the area indicated by the device on the light-sensitive sensor 8 as accurately as possible.
  • the lens system 7 is adjustable between two positions. The adjustment of the lens system can be effected by means of the same technique as is used in cameras.
  • Fig. 3 schematically shows how the device is held over a surface in the first mode and the second mode respectively and how, as a result, two imaging areas of different sizes are provided.
  • the lens system 7 is also schematically indicated in the Figure in two different positions corresponding to the first mode and the second mode respectively.
  • CCD charge coupled device
  • the sensor 8 is mounted on its own printed circuit board 11.
  • the power supply to the device is obtained from a battery 12 which is mounted in a separate compartment 13 in the casing.
  • the block diagram in Fig. 2 schematically shows the electronic circuitry part 4.
  • This comprises a processor 20, which by the intermediary of a bus 21 is connected to a ROM 22, in which the programs of the processor are stored, to a read/write memory 23, which constitutes the 10 working memory of the processor and in which the images from the sensor as well as the characters identified and interpreted are stored in the first mode, to a control logic unit 24, to the sensor 8, as well as to the lens system 7 and the LEDs 6.
  • the control logic unit 24 is in turn connected to a number of peripheral units, comprising a display 25, which is mounted in the casing, an IR transceiver 26 for transferring information to/from an external computer, buttons 27, by means of which the user can control the device, as well as an operation indicator 28 comprising, for example, a couple of additional LEDs indicating which mode the device is in and whether or not recording is taking place.
  • Control signals to the memories, the sen- sor, and the peripheral units are generated in the control logic unit 24.
  • the control logic also handles generation and prioritisation of interrupts to the processor.
  • the buttons 27, the IR transceiver 26, the display 25, and the LEDs 6 are accessed by the processor writing and reading in the register in the control logic unit.
  • the buttons 27 generate interrupts to the processor 20 when they are activated.
  • the device functions as follows. First, the user wishes to record the section of text. He starts the device by pressing a button 27, whereby two of the LEDs 6 are turned on projecting two luminous spots onto the sheet of paper. These luminous spots show the height of the imaging area, thereby indi- eating its size since the imaging area is square. The user places these spots to the left of the first letter in the section of text he wishes to record.
  • the proces- sor 20 commands the device to begin recording images at a predetermined frequency, e.g. 25 Hz, whereupon the images recorded by the sensor are stored in the read/write memory 23.
  • a predetermined frequency e.g. 25 Hz
  • text which is stored in image format requires a large amount of memory space. Consequently, to save memory space in this mode, the characters in the images are identified and stored with the aid of ASCII code.
  • the processor 20 turns off the image recording.
  • the user can control the device to show the recorded text on the display 25 or to transfer the text to an external computer by the intermediary of the IR transceiver 26.
  • the possi- bility of showing the scanned information directly on the screen has proven very important since a user often wishes to verify that the correct information has been scanned.
  • the flowchart in Fig. 4 shows how the device is adapted to operate in the first mode.
  • the device indicates the imaging area with the aid of luminous spots from the LEDs 6.
  • the user moves the luminous spots across the area he wishes to record, whereupon the device records images with overlapping contents and stores them in a current image area in the read/write memory 23.
  • the images are stored as images, i.e. with the aid of a plurality of pixels, each having a grey scale value in a range from white to black.
  • step 403 if such an image is available. If there is no previous image, the 12 current image is entered directly into a line image area in the read/write memory.
  • the overlap position providing the highest overlap measurement as stated above is selected.
  • the mean value of the grey scale value of the overlapping pixels is used. In this way, noise can be suppressed in the overlap area.
  • the putting-together is thus carried out both vertically and horizontally. If it is detected that, when being put together, the images do not end up on a horizontal line, the composite image is suitably adjusted so that it becomes horizontal, for example by turning the composite image.
  • Neural network software is commercially available from, for example, MATLAB Neural Network Toolbox, The MathWorks Inc., 24 Prime Park Way, Natick, MA 01760, USA.
  • the user also wishes to record the image included on the sheet of paper.
  • the lens system 7 is moved from its position in the first mode to the position required for the second mode. Further, the two LEDs 6 which were previously switched off are turned on.
  • the focal distance of the lens system 7 is changed and the four luminous spots move diagonally outwards from the centre of the imageable section, so that a larger image- able section is provided, something which is also shown in Fig. 3.
  • the user directs the device so that the luminous spots projected onto the paper surround the image he wishes to record.
  • the user can adjust the size of the imaging area by changing the distance to the paper. He then presses the button 27 to activate the device which then records an image of the section between the luminous spots.
  • the user can control the device to either show the recorded image on the display 25 or transfer the image to an external computer by the intermediary of the IR transceiver 26. If the image on the paper which the user wishes to record is too big to fit within the sec- tion defined by the luminous spots, the user can record a number of sub- images, which are put together into a larger image in the same way as in connection with the use of the device in the first mode. Subsequently, the text and image information recorded by the user can be shown either on the display 25 of the device or on an external computer. ⁇ to to

Abstract

A device for recording information by means of imaging with the aid of a light-sensitive sensor with a two-dimensional sensor surface is described. The device is adjustable between a first mode and a second mode. In the first mode, the imaging is effected by means of a plurality of images with partially overlapping contents. Each of the images depicts a small area on an information carrier and the images are put together into a composite image. In the second mode, the imaging is effected by means of at least one image of a larger area of the information carrier. The device has means for indicating the size of the imaging area.

Description

DEVICE FOR RECORDING INFORMATION IN DIFFERENT MODES,
Field of the Invention
The present invention relates to a device for recording information according to the preamble to the appended claim 1. Background of the Invention
There are many situations where someone wishes to combine selected parts of text or image information into a document which can be edited by means of suitable software in a computer. A known way of feeding text and image information into a computer is to use a scanner. Scanners of both the stationary and the portable type are available. A stationary scanner is used for scanning whole pages of text and image information, the scanner being passed over the page automatically at a constant speed. This type of scanner is not suitable for scanning selected parts of information on a page. On the other hand, a portable scanner may be suitable for this purpose.
US 5 301 243 discloses a hand-held scanner for scanning characters from a character sequence on a substrate. The scanner, which is passed over the characters which are to be read in contact with the substrate, has an optical system which "sees" a small part of the substrate. The optical system comprises a CCD type line sensor, which has a plurality of light-sensitive elements arranged in a row. When the scanner is passed over the characters on the substrate, a sequence of vertical "slices" of the characters and of the spaces between them is recorded. The "slices" are stored in the scanner as a digital bitmap. Subsequently, OCR software (OCR = Optical Character Recognition) is used to identify the scanned characters and to store them in character-coded format, e.g. with the aid of ASCII code, in a memory. The character recognition can be performed either in the scanner or 2 in an external computer to which the bitmapped characters have been transferred.
Another type of hand-held scanner for inputting text is described in US 4 949 391. Unlike the one described above, this scanner has a two-dimensional sensor, which records images of the underlying surface when the scanner is passed over the same. The scanner can only be moved in a direction determined by a wheel abutting against the surface. Redundant information is removed from the recorded images, which are subsequently combined into a larger image. The larger image can be analysed in a computer for identifying characters.
A drawback of the above scanner and similar handheld scanners is that their "field of vision" is rela- tively small. Consequently, in order to record a larger amount of information, such as a text section comprising several lines, a user must pass the scanner back and forth repeatedly over the surface, which is often regarded as boring and a waste of time. Summary of the Invention
The object of the present invention is to provide a solution to the problem described above.
This object is achieved according to the invention by the device having the features recited in the append- ed claim 1, with preferred embodiments in the appended claims 2-19.
More specifically, the device is adjustable between a first operating mode and a second operating mode, in which images of an area with a first small and a second large size of the information carrier are recorded so that the information on the information carrier can be recorded at different degrees of selectivity. In the first operating mode, the device is adapted to be passed over the information while recording a plurality of images with partially overlapping contents, which are put together into a composite image of the information and which each are related to an area with the first small 3 size of the information carrier. In the second operating mode, the device is adapted to image the information by means of at least one image which relates to an area with the second large size of the information carrier. The device thus has a first mode for recording information at a high degree of selectivity, e.g. individual words or character sequences, and a second mode for recording larger amounts of information at a lower degree of selectivity, e.g. several lines of text or an image, at the same time.
An advantage of this device is that the user can choose whether he or she wishes to record information at a high or low degree of selectivity. This can be achieved by a simple adjustment of the device. The user can thus first use the device in the first mode for recording a sentence in a text and subsequently adjust it to the second mode and use it for fast recording of an illustration which takes half a page.
The information carrier can be any two- or three- dimensional object. Of course, it will usually be a sheet of paper. The information on the surface may be composed of characters in the form of letters, numbers, or other written characters or symbols, or of various types of images . The recording is carried out with the aid of a light-sensitive sensor having a two-dimensional sensor surface. In this context, a two-dimensional sensor surface refers to the fact that the sensor surface must be able to image a surface with a matrix of pixels so that images with overlapping contents can be recorded. The light-sensitive sensor is preferably of the CCD or CMOS type. It can record images in grey scale or in colour. The images comprise a plurality of pixels, each having an intensity value . The device can be adjusted by the user or automatically by the device. The adjustment involves the adaptation of the device in some manner, e.g. physically or in 4 terms of software, to make it suitable for use in the mode in question.
Since areas of different sizes are imaged in the different modes, it may be difficult for the user to know exactly which information he is recording. To solve this problem, the device is preferably provided with indicating means for indicating the size of the imaging area. It is particularly important that the user knows the size of the imaging area in the second mode since this area is larger in that mode. However, the size of the imaging area is preferably indicated in the first mode as well.
Advantageously, the size of the imaging area can be indicated on the information carrier itself so that the user can see exactly which information will be recorded. It can be indicated by, for example, dots, lines, or colour, etc. In the first mode, the indicating can be effected by means of a single luminous spot or by means of a line showing where on a line the recording will commence. What is important is that the user gets an idea of the size of the imaging area.
In a preferred embodiment, the indicating means comprise an illumination means, e.g. a light-emitting diode or a laser diode.
Preferably, at least in the second mode, the imag- ing area is indicated by a plurality of luminous spots between which the imaging area is located. A less complicated optical design of the device as well as more accurate image recording are achieved in this way, since no coloured light is recorded in the image. This is par- ticularly important in connection with the use of colour- sensitive sensors.
Another way of indicating the imaging area can be to show what is located within the field of vision of the device on a display which in this case constitutes the indicating means. In some cases, the indicating means may comprise a display as well as an illumination means for indicating on the information carrier. 5
In a preferred embodiment, the device can be acted upon for continuous adjustment of the size of the area which is to be imaged between the first small size in the first mode and the second large size in the second mode. In this way, the user can himself determine, e.g. with the aid of a slider control, the exact size of the imaging area, something which can be advantageous, for example, in connection with the recording of images. Preferably, the indicating means is also acted upon in connection with the continuous adjustment so that the user can see how the size of the imaging area changes.
The change of the size of the imaging area between the first and the second mode can advantageously be effected by utilising a smaller part of the sensor sur- face in the first mode and a larger part of the sensor surface in the second mode. This can be achieved by only saving information from the desired part of the sensor surface. The continuous adjustment of the imaging area can also be achieved in this way. In connection with an adjustment of the sensor surface, the indicating means advantageously consist of a display.
An alternative way of changing the size of the imaging area is to provide the device with a lens means, which is adapted to project the images of the information carrier onto the sensor surface and which is adjustable for changing the imaging area. The lens means can comprise one or more lenses. The advantage of this alternative is that it provides better resolution.
One way of changing the size of the imaging area with the aid of the lens means is to change the focal distance of the lens means. This can be achieved by the lens means being adjustable between a first position in the first mode and a second position in the second mode. The lens means can also be continuously adjustable for continuous adjustment of the position of the lens means between the first and the second position, so that an optional size of the imaging area can be obtained. J ) t to F1 σi o Jl o CJl σ σi
£ F- Ω Hi TJ TJ tr Φ CD 0 CD CD TJ ft ts F- tr rt Mi PJ ft 0 F- ft F- rt 3 Hi CO rt tr 3 0 F- £ F- F, Φ <; 3 Hi 0 PJ J F- •<; 3 PJ tr F- ft F- Hi 3 0 tr 3 - O F- 3 tr
Φ PJ ts F. rt CQ F- F φ F- 3 F, 0 <! Φ F, o CQ F- CQ 3 φ F, r Φ
Φ CQ ft CD rt Φ CO CL j rt tr ft Φ rt 3 3 Ω φ CD J 3 rt tr Ω CQ CO CL CQ Mi
FJ Φ Φ ft F- Φ Φ 0 F- ft PJ tr 0 Φ tr •* rt PJ 5»
^ PJ F- tr CO -4
CD ω ti 3 ft CQ H tr CQ PJ CL ^ C PJ 3 o 3 CL Fl F, F- 3 tr F- Ω H OS
^ ~ rt ft 3 rt F- F, rt TJ 3 3 3 Hi PJ F- tr ^ CQ CL Ω Hi J 3 3 φ F- 3 --a
3 CQ tr 3 00
CQ o Φ PJ φ tr CD Φ tr o CO Φ o 3 CQ Φ S F- P) 0 CD 0 ^« CQ
Hi rt CL rt P) τ O PJ rt rt Hi Φ 3 Ω ^ F, CL ft tr Φ tr F CD F, ft CL p- PJ
0 tr 0 Φ 0 TJ CQ Φ F, CL 3 tr PJ Φ F, 0 ft 3 PJ CL Φ F- Φ Φ rt tr Φ ft tt 3
F Φ Mi . CQ J F- TJ CL F- CL Φ 3 φ 0 Hi F- PJ J ft 3 φ PJ Ω Ω F- Φ tr 0
Φ F. CQ F, 0 Φ CQ Ω PJ 0 F, O rt tr Ω <! 3 0 tr ft rt 3 0 PJ φ CD rt
F, CL ft 03 rt rt 3 φ Hi F, rt ≤ 3 φ tr Hi PJ 3 rt F- Φ φ F- CL Φ tr CQ CO 3 Φ tr
Φ φ tr ^ tr F- J Hi PJ tr CD h-1 - F- 0 Ω TJ F- 3 CL Φ ft CL Φ CL 0 3 Φ
Ω < Φ Φ PJ Φ F, Hi 3 Φ φ Hi ^ 3 CL 0 3 CO Hi Φ J 3 0 PJ F- Ω 3 CO F,
0 F- <J F, F, Φ 0 Ω 3 F F *" Ω Φ F- Φ rl ft φ CL PJ 3 3 Hi 0 ft φ F-
F Ω F- F- TJ t Ω F, Φ 0 PJ ft < ft CL Ω Ω 0 Ω tr 3 φ ft CO Ω Mi 3 tr rt Φ
CL Φ 3 F, rt * F Φ 0 Ω F- 3 rt 3 tr F- tr F- PJ 0 3 PJ rt Φ Φ Φ CL Φ F" F-
F- PJ ft tr 0 C r ft 3 tr CD tr Φ Ω 3 F, 3 3 Hi tr ft F, F, F- < ti ti CQ 3 Φ 0 Ω CL 3J J PJ rt Φ PJ Φ tt φ F, CL rt 0 F- Φ tr 0 Φ 3 0 CQ φ 0
CQ Φ Φ Φ < Φ Φ F- Φ ^ 3 3 tr Hi tr 3 F- tr PJ F, O Φ F- 3 3 0 ft tr CL
Φ CO F- Φ CD 3 CQ o Φ CO o P) Φ CQ Φ 3 Φ CL 0 CO Φ ft CL tr ft CD F- rt CL 0 3 F, CQ CQ CL tr F- rt Φ 0 r Ω F- ^ 0 <i Φ ft F, F- φ Φ φ 3 tr PJ Hi PJ F- 0 Φ Φ 3 F- < 3 Ω 3 0 CL F- PJ PJ tr 3 J P) tr . F, CD 3 φ
Φ 3 F, CQ PJ 3 CL ra <; CQ F, 3 F- tr 0 ft 3 CL Φ 3 3 Ω PJ ω Hi ft Φ φ CD 3
0 Φ ft Φ TJ CQ F- F- F- cπ Φ Ml Ω Φ 0 F- PJ 0 • Mi ft tr rt tr 0 PJ H 3 0 tt
TJ ft tr CO TJ 3 rt Ω ft iQ 0 Φ Ml CL F" Φ 0 PJ Φ F, 0 Φ 3 3 F- CD ri -
0 c Φ F- 3 Φ 3 Φ F1 tr 3 F F- F- F- CO ι-3 F CQ CQ F- 3 ≤ PJ CQ F-
CO Ω CD F- 3 3 3 PJ Jl Φ F- 3 F- 3 ft 3 CQ φ tr 3 Φ Φ rt P) φ Ω TJ rt tr (t ζ rt n
F- 0 Φ Mi 3 CQ F- rt rt ft ) CQ PJ tr CQ J X 3 F- PJ 0 3 PJ ft CL tr J r rt F- F- tr rt ti CL J ft ft - F- 0 Ω CQ Φ rt CQ F, (t rt 0 CQ rt 3 CQ F- 3 F- rt F- <! rt Φ
F- rt Ω 0 Ω 0 3 F- CL F- PJ Φ Φ rt F- Φ rt F- CO 0 CD rt 0 tt Φ tr CQ CD Φ -
0 J Hi ft O rt 3 tr N 0 CL CL Φ 0 0 3 tr O F, CO 3 0 3 CQ Φ CL t! F- 0 PJ 3 tr " Φ Φ ft 3 PJ • 3 rt 3 PJ 3 "< • TJ CL φ 3 CD J Φ
3 F ft ft F- Φ 0 TJ CL ft •> Φ CD 0 rt ft Ω J g CQ Φ <
O tr Ω Φ Ω F- Φ 0 Ω ft F- tr 0 Φ Ω tr ω 0 0 tr 0 3 ' F- 3 rt F-
Hi PJ TJ PJ 0 3 tr CL ft PJ Mi Ω J Φ 3 Φ Hi Z CL rt PJ Φ O 0 Hi CL 0 rt CO $. Ω ti rt 3 tt Φ CD tr » CL φ tr tr F, F- 3 tr o CL F- 0 0 Φ ft ^ rt TJ O F- <! F- <; ft PJ F 3 F- TJ F- ft Φ F, PJ tr CO Φ CQ ft rt F- <! F, tr rt rt 0 CO F- CQ tr 3 F- ft O 3 F Ω 0 F- CL Φ Φ tr Z 3 Φ CL Ω
Φ 3 F- tr ω 0 Ω rt Φ Q φ 0 F- <! F- tr PJ Φ J φ . Φ 0 φ tr F- 0 φ t! Φ F- Hi PJ Φ CD 0 Φ F, 0 Φ 0 tr L F, TJ Φ £ 3 CQ φ 3 3
CL J CQ rt CL 3 F- tr 3 3 F, F- Φ < tt rt ι-3 Ω tr Ω CL rt φ F- Φ TJ
Φ ti o φ ft PJ Mi F- tr 3 rt F- Φ PJ rt CD PJ F- Φ 0 tr 0 F- P) F- - 3 3 3 F,
< CQ rt < tr T 3 rt PJ J tr 3 F- J TJ 3 3 L Φ rl Ω CQ Mi CO CQ CO F-
F- - 0 Φ F- Φ ft PJ 3 CQ Φ tr 0 F. (t ft tr CL tr F- Ml ft 0 F- CO
Ω CQ F, 3 Φ ft tr L F- tr Φ 0 3 rt tr PJ PJ tr rt PJ PJ Φ 3 Φ tr F, 3 0 Φ
Φ Φ Φ P F- CL tr 3 TJ 0 FJ tr - Φ 3 CQ 0 0 <! CL CL 0 CQ F, Φ CD 3 CQ
• rt J CQ 3 Φ •<; Φ CQ 0 rt co Φ Φ ft Φ < TJ Φ tr Φ PJ
F, IQ tr TJ φ PJ rt F CD tr φ F- Ω Ω tr tr J CL φ 3 CL Φ CL J PJ n 8
Φ . Φ TJ CQ 0 tr F- PJ F- P) Ω 3 P) PJ 3 rt Φ P) 3 Φ 3 F- ft Φ F- H
F, F- F- Φ Ω J 3 H (t 3 rt ft Hi 3 CD 0 tr rt rt T F- 3 <! 3 F- CD Hi CΛ
PJ 3 3 ω 3 o 3 Φ F- o CQ 0 3 Φ F, J tr tr CD J Φ 3 0 F- CQ 3 Φ 3 w rt rt CQ rt 3 CL PJ 0 L rt i Φ ft Φ Φ ft CQ 3 CQ TJ Ω 3 F,
F- tr ft Hi F- 3 Φ tr 3 F, F-1 PJ Φ CL Φ Φ ft CD
<! Φ tr 0 CO Φ O PJ CD CL F- 3 tr 0
Figure imgf000008_0001
Φ φ F > F • CQ Φ F
7 to the information carrier or for measuring the distance between the images. This results in considerably improved user-friendliness .
The putting-together is preferably carried out both vertically and horizontally. This has the advantage that the device can be held at different angles and even be turned while being passed over the information carrier and yet the images can be put together well enough that the characters in the composite image can be identified and OCR processed.
In order to enable as much information as possible to be stored in the device, the signal-processing unit preferably comprises software for identifying characters in the composite image and for storing the same in the device in character-coded format, e.g. ASCII code. The character identification can, for example, be carried out with the aid of a neural network.
Moreover, the device may advantageously comprise a transceiver for wireless communication with an external unit. In this way, information can be transferred between the device and, for example, an external computer. The transceiver can be an IR transceiver, a mobile radio transceiver, or some other suitable transceiver.
As mentioned above, the device can advantageously operate as a scanner also in the second operating mode, in which case it is adapted to be passed over the information while recording a plurality of images with partially overlapping contents, which images are put together into a composite image of the information and which each relate to an area of the second large size. Brief Description of the Drawings
The present invention will be described below by way of an example showing how the invention can be implemented. The description refers to the accompanying drawings, in which
Fig. 1 schematically shows a first embodiment of a device according to the invention; 8
Fig. 2 is a block diagram of the electronic circuitry in a first embodiment of the device according to the invention;
Fig. 3 schematically shows the indicating area in connection with the use of the device in the first mode and the second mode respectively;
Fig. 4 is a flowchart showing how the device is intended to be used in the first mode;
Fig. 5 is a flowchart showing how the device is intended to be used in the second mode; and
Fig. 6 schematically shows a second embodiment of a device according to the invention. Description of Preferred Embodiments
In the embodiment of the device according to the invention shown in Fig. 1, it comprises a casing 1 having approximately the same shape as a conventional highlighter pen. One short side of the casing has a window 2, which is intended to be directed at an area on an information carrier which a user wishes to image. The informa- tion carrier can, for example, consist of a sheet of paper or some other type of storage medium, from which a user wishes to record information in character or image format .
The window 2 is somewhat recessed in the casing 1 in order to reduce the risk of scratches or other damage when the device is not in use.
The casing 1 essentially contains an optics part 3, an electronic circuitry part 4, and a power supply part 5. The optics part 3 comprises four light-emitting diodes 6 jointly constituting an indicating means, but of which only two are visible in the Figure, as well as an adjustable lens system 7 and a light-sensitive sensor 8 which constitutes the interface with the electronic circuitry part 4. 9
The LEDs 6 are used for indicating the area on the information carrier under the device which can be imaged by means of the device.
The lens system 7 fulfils two tasks simultaneously. One of its tasks is to project light from the LEDs 6 onto the information-carrying surface towards which the window of the device is directed for defining the imaging area. The light from the LEDs can be seen on the surface in the form of luminous spots. The other task of the lens system 7 is to image the area indicated by the device on the light-sensitive sensor 8 as accurately as possible. In order to achieve imaging of areas of different sizes when the device is held at a given distance from the information carrier, the lens system 7 is adjustable between two positions. The adjustment of the lens system can be effected by means of the same technique as is used in cameras.
Fig. 3 schematically shows how the device is held over a surface in the first mode and the second mode respectively and how, as a result, two imaging areas of different sizes are provided. Moreover, the lens system 7 is also schematically indicated in the Figure in two different positions corresponding to the first mode and the second mode respectively. In this example, the light-sensitive sensor 8 comprises a two-dimensional, square CCD unit (CCD = charge coupled device) with a built-in A/D converter. Such sensors are commercially available. In this case, the sensor 8 is mounted on its own printed circuit board 11. The power supply to the device is obtained from a battery 12 which is mounted in a separate compartment 13 in the casing.
The block diagram in Fig. 2 schematically shows the electronic circuitry part 4. This comprises a processor 20, which by the intermediary of a bus 21 is connected to a ROM 22, in which the programs of the processor are stored, to a read/write memory 23, which constitutes the 10 working memory of the processor and in which the images from the sensor as well as the characters identified and interpreted are stored in the first mode, to a control logic unit 24, to the sensor 8, as well as to the lens system 7 and the LEDs 6.
The control logic unit 24 is in turn connected to a number of peripheral units, comprising a display 25, which is mounted in the casing, an IR transceiver 26 for transferring information to/from an external computer, buttons 27, by means of which the user can control the device, as well as an operation indicator 28 comprising, for example, a couple of additional LEDs indicating which mode the device is in and whether or not recording is taking place. Control signals to the memories, the sen- sor, and the peripheral units are generated in the control logic unit 24. The control logic also handles generation and prioritisation of interrupts to the processor. The buttons 27, the IR transceiver 26, the display 25, and the LEDs 6 are accessed by the processor writing and reading in the register in the control logic unit. The buttons 27 generate interrupts to the processor 20 when they are activated.
An example of how the device is intended to be used will now be described. Suppose that a user wishes to record a section of text and an image from a sheet of paper. In this case, he holds the device at a comfortable distance from the sheet. Naturally, the distance will vary from person to person, but it is usually within the 5-15 cm range. In the first mode, the device functions as follows. First, the user wishes to record the section of text. He starts the device by pressing a button 27, whereby two of the LEDs 6 are turned on projecting two luminous spots onto the sheet of paper. These luminous spots show the height of the imaging area, thereby indi- eating its size since the imaging area is square. The user places these spots to the left of the first letter in the section of text he wishes to record. Subsequently, 11 he presses the button 27 to activate the device and moves the device so that the luminous spots move across the text to be recorded, in the same way as when one reads the text. When the user activates the device, the proces- sor 20 commands the device to begin recording images at a predetermined frequency, e.g. 25 Hz, whereupon the images recorded by the sensor are stored in the read/write memory 23. However, text which is stored in image format requires a large amount of memory space. Consequently, to save memory space in this mode, the characters in the images are identified and stored with the aid of ASCII code. When the user has come to the end of a line or has let the luminous spots move across the selected section of text, he releases the activating button, whereupon the processor 20 turns off the image recording. When the selected section of text has been recorded, the user can control the device to show the recorded text on the display 25 or to transfer the text to an external computer by the intermediary of the IR transceiver 26. The possi- bility of showing the scanned information directly on the screen has proven very important since a user often wishes to verify that the correct information has been scanned.
The flowchart in Fig. 4 shows how the device is adapted to operate in the first mode. In step 401, the device indicates the imaging area with the aid of luminous spots from the LEDs 6. In step 402, the user moves the luminous spots across the area he wishes to record, whereupon the device records images with overlapping contents and stores them in a current image area in the read/write memory 23. The images are stored as images, i.e. with the aid of a plurality of pixels, each having a grey scale value in a range from white to black.
As soon as an image has been stored in the current image area, the putting-together of the image with the previous image is suitably commenced, step 403, if such an image is available. If there is no previous image, the 12 current image is entered directly into a line image area in the read/write memory.
In order to determine how the current image is to be put together with the previous image so that the best match is achieved between the contents of the images, every possible overlap position between the images is examined, at the pixel level, and an overlap measurement is determined as follows:
1) For each overlapping pixel position, the grey scale values of the two relevant pixels are added up if the latter are not white. Such a pixel position in which none of the pixels are white is designated a plus position.
2) The grey scale sums for all the plus positions are added up.
3) The neighbours of each pixel position are examined. If an overlapping pixel position is not a neighbour of a plus position and consists of a pixel which is white and a pixel position which is not white, the grey scale value of the non-white pixel is subtracted, possibly multiplied by a constant, from the sum in point 2) .
4) The overlap position providing the highest overlap measurement as stated above is selected. In the composite image the mean value of the grey scale value of the overlapping pixels is used. In this way, noise can be suppressed in the overlap area. The putting-together is thus carried out both vertically and horizontally. If it is detected that, when being put together, the images do not end up on a horizontal line, the composite image is suitably adjusted so that it becomes horizontal, for example by turning the composite image.
Our Swedish patent application No. 9704924-1 and the corresponding US Application No. 024 641 describe an alternative way of matching the images in order to find the best overlap position. The content of these applications is herewith incorporated by reference. ω ω to to F1 F σi o Jl O CJl Jl
PJ Ω rt ft Φ> CD rt TJ PJ F- Ω TJ ft ≤ . 0 PJ rt F- Ω Φ 0 F- Ω < 3 TJ F- CL 0 tt F- O tr PJ tr tr O φ tr hi 3 3 0 hj tr o tr 3 Ω 0 3 0 PJ tr 3 0 PJ tr Φ 3 3 F- Hi tr 3
0 3 Φ 3 F Λ Φ 0 CL rt CL Φ Φ F, F- rt ft Q rt 3 Ω tt rt 1— ' φ rt hi ft <! Φ PJ
< CQ 3 Ω Φ Φ CL X Ω TJ Φ Φ Φ TJ tr PJ Φ 3 3 ≤ TJ 0 F- 3 CQ
Φ tr J Φ 3 Φ CD F. Φ Ω tr 3 hi rt hi o F- 3 Φ CL 0 0 C 0 Φ
Φ Q Ω FI 3 CD CQ ft TJ rt tr , rt tr TJ CD CTj Ω 3 CQ CQ F- CO CQ Φ M ri F- h3
F- ω J 3 Ω Φ O 0 hj F- Φ PJ tr rt PJ φ i F- 3 tr Φ F- < φ 3 CQ 3 3 3 J tr
3 Ω 0 F, Φ F 0 F, Φ 3 H F, F- tr Hi hi hi Φ ft tr PJ CL ft F- 0 F- tr PJ Φ F, Φ
CO F, Ω F, rt F, F- rt 3 PJ Ω Φ Φ ft Φ CD i ^ 3 Hi CO CQ 0 ft CQ φ ft Φ F- F- tr ft 3 Φ ft F- Ω tr 0 Ω Φ Φ PJ F- o Hi F- tr ft F- PJ Ω hi PJ PJ Φ Φ to tr PJ CQ CL tr 3 rt 3 3 Hi o CL F- n Ω tr 3 rt ft 0 Hi 3 Φ Φ rt 3 0
3 rt ft CL ft PJ Ω Φ Φ Φ tr Φ Φ 3 • 3 3 rt 0 F- tr tr 3 (t ft PJ TJ : tr CQ Ω τ3 PJ F-
Ω Φ φ Hi Φ rt ft F- Ω CL H J ft rt CL CD PJ Φ Φ 3 3 Φ Φ s CQ 3 TJ ft CL CL 0 F- TJ F- 3 tr F, CD Z tr ft H CQ 3 F, 3 F- F- PJ F- Φ 0 > Φ Φ 0
F- 3 F, F- <! PJ φ Ω rt 0 Φ PJ F- tr φ rt CL 3 Ω TJ CQ F Cfl CQ 3 o s; ft CQ o tr 3 rt CQ J-. rt PJ Ω hi PJ tr tr rt i CD ft Φ F- PJ P) 0 F- Φ TJ tO hi PJ tr F-
3 *< 3 ft o ft tr J CL PJ 3 tr 3 3 0 ^ 3 hi 3 X Φ F- φ 0 - F- hi φ ft O F- tr -J F- φ PJ Ω n CD Φ Φ F- ft Q Hi F- Hi TJ Φ Hi £ CQ PJ CO rt Φ Φ
. rt rt ^ 3 • CQ CO F, ft s: PJ Ω 3 3 φ i ft φ 0 0 Hi tr Ω F- ft rt PJ F, tr CQ o PJ φ F, Ω Ω tr P) F, TJ Φ ft F- tr CQ F, CQ CD Φ F- rt tr rt tr Φ φ F-
H φ rt CL O F, rt Ω F, F- rt tr F- 3 PJ 3 PJ ; tr 3 Φ F- Ω Ω 0 Φ φ 3 tr PJ 3 tr p) tr φ 3 Φ tr rt CD rt Φ 0 CQ ft Φ Ω ft ft Hi ft tr Ω Φ CL PJ φ ω 3 Φ ^ tr PJ Φ Φ • Φ i CD tr F- CD CO CO F- PJ tr Φ 0 Φ Ω 0 F- CD rt CQ rV CL CO CL j φ Φ 3 ra 3 Ω Ω ft 3 3 Φ CL F- hi 3 3 o Φ F1 Φ
Ω F- T ft φ ^ 0 3 Ω 3 CD Φ Φ F- tr PJ tr Φ J F- CD Φ ft PJ Hi X PJ hj tr O F, tr Λ TJ Ω tr Φ O ft 3 rt CQ PJ TJ CQ tr hi 3 Φ tr PJ J CQ rt rt hi F- CQ
PJ F" 3 0 φ 3 (t Φ 0 Φ 3 CL F- rt S 3 F- Φ F Φ Φ 0 PJ PJ ^ ft ft F- Φ £ . CQ ft F,
F, Φ F- Ω Φ 0 F, CL 3 0 Φ CD 0 F- 0 PJ 3 PJ - • ≤ CQ Ω 0 Φ 3 PJ Φ Φ PJ
PJ CL (t Φ CO 3 PJ Φ F, 3 Hi -> PJ <! Ω o CL Φ tr J F- F- hi
Ω PJ CD rt rt F, rt CL rt ^ Hi CD rt ^ x CD CQ J rt Jl φ CQ . CL F- F- !~!
3 3 Φ Φ 3 3 ω rt T tr CD φ Φ F- tr 0 ft TJ • φ F1 Φ - ft 3 T CL 3 3 CQ 3 φ J
Φ Φ 0 TJ
^ Ω 0 Hi Φ to F, 0 3 ft 3 F, φ 3 rj F- F- ft TJ rt 0 0 O 3 F"
F, rl Φ F, 0 3 o ) 3 F, ft Fl φ 0 Ω Φ φ hi CO ^ X 3 Φ 3 0 tr Hi 3 0 F1
CQ F, F Ω ) Φ tr TJ 0 CO CD PJ 3 Φ CQ hi ft 3 Φ Q F,
CL ^
F 0 CO to F- F- 3 tr F- ft CL CD Φ PJ 3 Φ Ω F- PJ CQ TJ ft tr ;
Φ 3 0 O φ rt 3 PJ PJ 3 ~ F- φ rt 0 ►Q tr 3 3 ft 3 hi CQ <: - tr CL
Ω Hi CQ PJ CL rt F, F- CQ 0 CD 3 PJ Hi 3 φ CL 3 F, TJ Φ F- F- Φ rt φ
0 z rt ≤ Ω CQ F- P) PJ Hi 3 3 3 φ Φ F- Φ Ω CL CL 0 ft CQ 0 3 0 H <!
CQ F- F- F 0 3 Ω F- Ω 0 PJ rt 3 3 3 ft 3 tr Ω ^ z, tt 3 3 Φ TJ ft φ
3 rt PJ (t F- Φ Φ P) CD rt 3 F CO F" TJ ft hi F- tr Ω J Hi 0 F- tr ft PJ Φ hi CO
F- tr F, tr tr CD ≤ ft Φ Φ rt 3 CD J 3 Φ Φ i 0 F" 3 PJ Φ tr h-J F- o tt F- 0
(t Φ Φ 0 Ω H 3 Φ Φ F- rt CQ J F 3 CQ 3 Φ CQ Ω Ω
CL 3 0 CO TJ
F- ft • rt tr Ω F, 0 0 X TJ CO J TJ F- Ω CL Q tr J Φ hi CO
0 tr tr PJ tr 3 F- ri PJ Hi 3 0 F- 3 rt rt p rt hi Ω ft PJ CQ O Φ TJ
3 Φ CΛ Φ PJ Ω PJ t TJ CL *< 3 . Ω F Ω Φ 3 X PJ Φ tr tr Φ Φ tr 0 F, Φ CO F, F-
3 tr rV n oo Φ TJ o tr 0 tr rt Φ CQ hi Φ CQ Φ PJ ^ PJ J 0 J Φ 3
F- PJ Ω PJ 0 J Φ 3 J en 0 3 ) £ ^ φ 3 Ω hi rt Ω 3 ti
CO F tr F- <! rt Ω ft rt rt F, 3 ι-i - Φ CD H, O CD CL F- Φ 3 h-J tr CO PJ tr ft Φ Φ ft
CL CL Φ 0 rt 0 Φ F- Φ 3 φ rt J h{ 0 3 X CQ o Ω Ω Φ φ
Φ 3 to > h{ tr
TJ CO CL Hi PJ CD 3 tr o rV 3 £, F- ft Ω TJ PJ rt F o o ιl hi Φ n
Φ o o o PJ CO F F- •* F- W F- Φ ft • Φ tr CQ rt φ ft PJ F- F1 Φ H
3 j Φ
F Hi Mi Hi rt 3 Ω Hi n 3 PJ φ F- ΪT 3 tr X Φ i Φ "<; h- CL <
Hi rt Φ Φ Hi ft J 0 H CQ 3 3 t Ω Ω φ rt m
3 Φ CD 3 H F- F- vθ
O ft ≤ TJ O tr ft F, CL φ PJ tr tr CD 1— ' hi tr PJ 3 ft 3
F tr PJ F Φ F- J rt Ω PJ o PJ Φ hi φ tr φ ≥
3 Φ F, 3 0 tr i Hi φ PJ O
Figure imgf000015_0001
3 -1
Φ P) ft
14 ed with the aid of neural network software, which is trained in a suitable manner. Neural network software is commercially available from, for example, MATLAB Neural Network Toolbox, The MathWorks Inc., 24 Prime Park Way, Natick, MA 01760, USA.
In this example, the user also wishes to record the image included on the sheet of paper. In order to do this, he presses a button 27, whereby the device changes modes and the processor sends a signal to lens system 7. The lens system 7 is moved from its position in the first mode to the position required for the second mode. Further, the two LEDs 6 which were previously switched off are turned on. In connection with the adjustment, the focal distance of the lens system 7 is changed and the four luminous spots move diagonally outwards from the centre of the imageable section, so that a larger image- able section is provided, something which is also shown in Fig. 3. Subsequently, the user directs the device so that the luminous spots projected onto the paper surround the image he wishes to record. In this connection, he can adjust the size of the imaging area by changing the distance to the paper. He then presses the button 27 to activate the device which then records an image of the section between the luminous spots. When the image has been recorded, the user can control the device to either show the recorded image on the display 25 or transfer the image to an external computer by the intermediary of the IR transceiver 26. If the image on the paper which the user wishes to record is too big to fit within the sec- tion defined by the luminous spots, the user can record a number of sub- images, which are put together into a larger image in the same way as in connection with the use of the device in the first mode. Subsequently, the text and image information recorded by the user can be shown either on the display 25 of the device or on an external computer. ω to to
LΠ o o
F- ≤ rt 3 φ CD CO t Φ * 3 Φ J CO CD 3 rt F- F- rt rt 3 $. F tr CO Φ PJ 0
3 3- 0 0 φ Φ Φ - g F- 0 < Q F- 0 0 tr 3 3 tr tr tr tr Φ tr 3 Φ - 3 X CL
PJ F- i 3 φ Ω 3 1 Q CL Φ 3 Φ PJ Φ φ Φ F- PJ Φ rt Ω Φ 3 rt PJ
CQ Ω rt rt Ω 0 CD F- 0 Φ F $. CQ TJ rt CQ ≤ Ω CL rt F- Φ TJ ϋi
Φ tr F- tr rt 3 0 3 CL - Φ J £ Φ tr TJ Ω 3 tr F- 0 F- TJ 3 3 Q 3 Φ PJ CL F- F h-1 Φ F- F- hi 3 ≤ 3 3 0 PJ 0 rt φ h3
CD p) Ω 0 3 3 3 CD tr Ω 0 Ω hi J 3 TJ 3 C tr φ CQ 0 Ω 3 tr φ Ω tr φ to tr PJ tr Ω hi PJ F- CQ t Φ CO 0 Φ
3 F- rt 0 F- Φ - φ 3 0 CQ Φ PJ F- ^ F- CD Φ Φ 3 Φ 0 rt
CQ 3 tr F, Ω 3 rt 3 • CQ CQ tr PJ rt CQ rt CQ 3 Φ • CO 0
0 CQ Φ CL CD 2 O CL tr φ F- 0 tr p CQ rt tr F- PJ TJ hi hi F- Ω F- F- F- CL cr\ Φ F- rt 3 0 Φ Φ 3 PJ 3 CD 3 0 tr 0 rt 3 F- 3 CL 3 <! 3 φ J 3 φ Φ Ω F- ! φ CL tr tr rt Φ 3 ^
CQ *i φ tr φ tr CD F- CD 3 CQ CQ φ PJ 3 F- 0 3 3 Φ 3 Hi Φ φ CO 3 tr PJ Ω J ^ φ tr Ω rt Φ o Φ φ CL 3 3 PJ 0 0 Φ 3 F- Ω Ω
Φ 3 rt 3 3 PJ o F- 0 Φ tr 3 0 rt TJ ^ PJ rt CQ s; Φ hi Ω F- TJ 3 tr
0 F- CD CQ 3 £ φ CL rt tr rt CQ F- Φ F- ^ O 3 PJ rt F PJ F- PJ
Φ PJ rt rt . o CD Ω F- 0 φ rt 0 Φ 3 . Ω rt F, TJ tr 0 Q 0 H
TJ CL ^ r ≤ rt CL PJ CQ 3 tr 0 3 tr tr ≤ CL Φ Φ 3 Φ 3
Φ F- ^ - o tr F- CO 3 φ φ tr CL Φ Φ F- Φ o Φ F- Φ F PJ
Ω PJ 3 CQ φ ^ Ω Ω <J 3 Φ PJ CO CL CQ CD 0 CL 3 rt tr F- F- rt Ω CD • TJ ≤ CL F- tr PJ o Φ CD F- Ω CO tr TJ tr CQ tr 3 3 hi Φ J tr F- Ω rt Φ Φ 3 tr 3 0) CQ J Φ CQ F- PJ Φ Φ Φ
0 3 F1 F- 3 PJ tr CL 3 rt CL CQ CL Φ Φ PJ 3 tr hi rt 3 CD F rt ^
3 PJ φ . Ω φ CD Φ PJ Φ Φ Φ Ω CL CQ tr 0 0 φ £ Φ tr o tr1 01 tr F-
F- CQ 3 tr 3 F- rt F 3 3 CO 0 φ PJ Φ F 3 tr •<: Φ t tr F- a Φ φ CQ
Ω rt ≤ CO 3 CL O 3 o Ω Hi *- Φ CQ 3 Φ tr • Φ CQ σ Ω •
Ξ tr CD Ω F- CQ Φ Ω CL 0 hi CL F- 3 CL CL CO rt CD PJ Φ Φ O CQ
Ω Φ 0 Φ PJ 0 ^ < tr J Φ F- φ 3 rt Φ Φ rt φ tr Ω F- 3 CD F- Φ
F- 3 3 3 F- PJ • t CL φ tr S <! F- tr F Φ PJ CL Ω tr PJ σ\ 0 Ω hi tr PJ J Ω <i F" <! => Φ . Φ F- 3 φ hi 3 φ 3 rt 3 0
Ω S J Φ tr Φ Φ ^ Φ tr CL tr F- Ω CL Φ 0 hi PJ F- Ξ 3 tr
3 ) tr CL PJ CQ CD F- TJ 3 Φ rt CD Φ o hi F- hi CO tr F- CL 0
F- CQ F- ι_ι. CQ <! ω Φ tr rt tr Ω PJ hi ) tr 0 Ω hi < Φ 3 X F- CO z rt Ω 3 PJ φ φ Ω PJ £ 0 3 tr tr 0 CQ F- φ F- PJ PJ 3 PJ Φ F- Ω 3 CD hi P) tr CO 3 3 0 CO 0 ≤ tr φ o Ω Φ 3 F- 3 rt CQ CL Φ tr F- 0
^ 3 φ PJ O 3 PJ 3 F- < Φ • CL 3 φ 0 3 TJ Φ CL 3 CL tr
CD F- O CL J CD rt < rt CQ Φ 0 CD F- Φ CD rt Φ F" F- O PJ CL Φ 0
TJ J Φ 3 PJ < hi Φ 3* Φ F- - CO H Ω 3 CO 3 3 F- 3 F F- . ≤
PJ CL 3 CQ CD PJ CO 3 φ 0 3 CO PJ 0 F- tr hi PJ CQ tr Φ Ω hi CD F, CQ F- φ CD J 3 CQ rt rt Ω hi 3 O Φ 0 PJ tQ PJ M rt rt 3 0 F- F- 3 CQ Ω 0 φ Φ Φ tr Φ 0 Φ >< Φ hi φ rt TJ rt 3 tr
CD hi 3 PJ i tr 0 hi •3 CO CL CL Φ TJ 3 tr CQ $. F- tr tr F Φ Φ
Ω rt 0 tr 3 CO C " φ rt φ - to rt Φ F- Ω PJ φ Φ rt 0 CL CO
0 3 3 PJ CL • 0 3 J F- CL F- 0 Φ CO 0 ^ hi 3 tr CL
F1 Φ tr Φ Ω CD CL CO tr 3 φ o 3 3 F- • TJ tr φ TJ Φ Φ tr Φ Φ
3 0 Φ Φ φ £ F- 0 0 <l F> 3 CO 3 CD Φ 0 0 PJ hi hi Ω ^ TJ <
Φ rt 3 » 3 F- 3 3 F, <; F- Φ φ S rt CO 3 φ φ H F-
Ω Ω Φ Φ 0 CQ 3 φ Φ tr Ω F- CD CD tr Φ tr F, 0 Ω CD F- Φ Ω 13
0 Ω PJ F- CL 3 - Φ Φ 3 rt Φ TJ Φ rt TJ 0 CD CQ CL 0 o Φ n
F- 3 3 3 o 3" rt 0 CL φ 3 o <! F- hi Φ tr 3 F1
< o 0 O CL F- z Φ F tr tr 0 0 TJ F- J X rt CL CQ rt O F. ~ F-
P) CL CL • < F- o PJ hi 0 φ rt o 3 ? Φ tr φ 3 CD hi φ F- PJ Φ 3 Φ Z O CL 3 CD tr > PJ Φ 3 Φ CL P) rt
0 φ m PJ Φ o Φ - Q Φ Φ CO 0 tr rt ≥
3 CL tr Ω PJ hi Φ TJ CD ** Φ
Figure imgf000017_0001
Φ tr

Claims

16 CLAIMS
1. A device for recording information available on an information carrier by means of imaging of the information with the aid of a light-sensitive sensor with a two-dimensional sensor surface, c h a r a c t e r i s e d in that the device is adjustable between a first operating mode and a second operating mode, in which images of an area with a first small and a second large size of the information carrier are recorded so that the information on the information carrier can be recorded at different degrees of selectivity, the device in the first operating mode being adapted to be passed over the information while recording a plurality of images with partially overlapping contents, which are put together into a composite image of the information and which each relate to an area with the first small size of the information car- rier, and the device in the second operating mode being adapted to image the information by means of at least one image which relates to an area with the second large size of the information carrier.
2. A device according to claim 1, further comprising an indicating means (6) for indicating, at least in the second mode, the size of the area to be imaged.
3. A device according to claim 2, wherein the indicating means are adapted to carry out said indication on the information carrier.
4. A device according to claim 2 or 3 , wherein the indicating means (6) further comprise an illumination means which is adapted to indicate the imageable area on the information carrier.
5. A device according to any one of claims 2-4, wherein the indicating means (6) are adapted to generate the indication of the area on the surface which is 17 imageable and consist of a plurality of illuminous spots on the information carrier.
6. A device according to any one of claims 2-5, wherein the indicating means comprise a display.
7. A device according to any one of the preceding claims, wherein said device is capable of being acted upon for continuous adjustment of the size of the area to be imaged between the first small area in the first mode and the second large area in the second mode .
8. A device according to any one of the preceding claims, wherein said device is adapted to utilise a smaller part of the sensor surface in the first mode and a larger part of the sensor surf ce in the second mode .
9. A device according to any one of claims 1-7, further comprising a lens means (7) which is adapted to project the images of the information carrier onto the sensor surface and which is adjustable for changing the size of said area.
10. A device according to claim 9, wherein the lens means (7) is adjustable between a first position in the first mode and a second position in the second mode.
11. A device according to any one of the preceding claims, further comprising an additional light-sensitive sensor with a two-dimensional sensor surface, one light- sensitive sensor being used in the first mode and the other light-sensitive sensor being used in the second mode .
12. A device according to any one of the preceding claims, wherein the device is adapted to be held at a distance from the information carrier in both the first mode and the second mode .
13. A device according to claim 12 , wherein the device is adapted to be held at essentially the same distance from the information carrier in both the first mode and the second mode.
1 . A device according to any one of the preceding claims, wherein the device is of the hand-held type. 18
15. A device according to any one of the preceding claims, further comprising a signal -processing unit (20) , which is adapted to utilise the partially overlapping contents of the images for putting together the images into a composite image, no recording being required of the position of the device relative to the surface which is being imaged.
16. A device according to claim 15, wherein the signal -processing unit (20) is adapted to carry out the putting-together of the images horizontally as well as vertically.
17. A device according to claim 13 or 14, wherein the signal-processing unit (20) further comprises software for identifying characters in the composite image and storing the same in the device in character- coded format .
18. A device according to any one of the preceding claims, further comprising a transceiver for wireless communication with an external unit.
19. A device according to any one of the preceding claims, wherein the device also in this second operating mode is adapted to be passed over the information while recording a plurality of images with partially overlapping contents, said images being put together into a com- posite image of the information and each relating to an area of the second larger size.
PCT/SE1999/000716 1998-04-30 1999-04-30 Device for recording information in different modes WO1999057678A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP99948569A EP1073989A1 (en) 1998-04-30 1999-04-30 Device for recording information in different modes
BR9910579-9A BR9910579A (en) 1998-04-30 1999-04-30 Device for recording information in different modes
IL13910699A IL139106A0 (en) 1998-04-30 1999-04-30 Device for recording information in different modes
JP2000547582A JP2002514021A (en) 1998-04-30 1999-04-30 Device for recording information in different modes
KR1020007012068A KR20010052280A (en) 1998-04-30 1999-04-30 Device for recording information in different modes
CA002331121A CA2331121A1 (en) 1998-04-30 1999-04-30 Device for recording information in different modes
AU43031/99A AU758236B2 (en) 1998-04-30 1999-04-30 Device for recording information in different modes

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
SE9801531-6 1998-04-30
SE9801531A SE9801531L (en) 1998-04-30 1998-04-30 Device for recording information II
US9132498P 1998-06-30 1998-06-30
US60/091,324 1998-06-30

Publications (1)

Publication Number Publication Date
WO1999057678A1 true WO1999057678A1 (en) 1999-11-11

Family

ID=26663291

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/SE1999/000716 WO1999057678A1 (en) 1998-04-30 1999-04-30 Device for recording information in different modes
PCT/SE1999/000725 WO1999060516A1 (en) 1998-04-30 1999-04-30 Recording of information

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/SE1999/000725 WO1999060516A1 (en) 1998-04-30 1999-04-30 Recording of information

Country Status (9)

Country Link
EP (2) EP1073989A1 (en)
JP (1) JP2002514021A (en)
KR (1) KR20010052280A (en)
CN (1) CN1138227C (en)
AU (2) AU758236B2 (en)
BR (1) BR9910579A (en)
CA (1) CA2331121A1 (en)
IL (1) IL139106A0 (en)
WO (2) WO1999057678A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002037405A1 (en) * 2000-11-06 2002-05-10 C Technologies Ab A focusing method and device for a pen reader
EP1318659A1 (en) * 2001-12-06 2003-06-11 Hewlett-Packard Company, A Delaware Corporation Image capture device and method of selecting and capturing a desired portion of text
US6839453B1 (en) 2000-05-16 2005-01-04 The Upper Deck Company, Llc Method and apparatus for authenticating unique items such as sports memorabilia
US7221810B2 (en) 2000-11-13 2007-05-22 Anoto Group Ab Method and device for recording of information

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4876697B2 (en) * 2006-04-28 2012-02-15 ブラザー工業株式会社 Image processing apparatus and image processing program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994010653A1 (en) * 1992-10-30 1994-05-11 Massachusetts Institute Of Technology Method and apparatus for creating a high resolution still image using a plurality of images
US5581637A (en) * 1994-12-09 1996-12-03 Xerox Corporation System for registering component image tiles in a camera-based scanner device transcribing scene images
US5721624A (en) * 1989-10-15 1998-02-24 Minolta Co., Ltd. Image reading apparatus improving the joining state of a plurality of image data obtained by dividing and reading out an original image

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3168443B2 (en) * 1993-01-27 2001-05-21 京セラ株式会社 Panoramic electronic still camera
KR0160632B1 (en) * 1993-07-30 1999-05-01 김광호 Image print control apparatus
EP0683596B1 (en) * 1994-05-18 2000-08-30 Sharp Kabushiki Kaisha Card type camera with image processing function
JPH1049001A (en) * 1996-08-01 1998-02-20 Ricoh Co Ltd Image forming device
US6867801B1 (en) * 1997-09-03 2005-03-15 Casio Computer Co., Ltd. Electronic still camera having photographed image reproducing function

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5721624A (en) * 1989-10-15 1998-02-24 Minolta Co., Ltd. Image reading apparatus improving the joining state of a plurality of image data obtained by dividing and reading out an original image
WO1994010653A1 (en) * 1992-10-30 1994-05-11 Massachusetts Institute Of Technology Method and apparatus for creating a high resolution still image using a plurality of images
US5581637A (en) * 1994-12-09 1996-12-03 Xerox Corporation System for registering component image tiles in a camera-based scanner device transcribing scene images

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6839453B1 (en) 2000-05-16 2005-01-04 The Upper Deck Company, Llc Method and apparatus for authenticating unique items such as sports memorabilia
US7027623B2 (en) 2000-05-16 2006-04-11 The Upper Deck Company, Llc Apparatus for capturing an image
WO2002037405A1 (en) * 2000-11-06 2002-05-10 C Technologies Ab A focusing method and device for a pen reader
US7221810B2 (en) 2000-11-13 2007-05-22 Anoto Group Ab Method and device for recording of information
EP1318659A1 (en) * 2001-12-06 2003-06-11 Hewlett-Packard Company, A Delaware Corporation Image capture device and method of selecting and capturing a desired portion of text
JP2003208604A (en) * 2001-12-06 2003-07-25 Hewlett Packard Co <Hp> Image catching device for selecting and catching desired part of text and method therefor
US7139445B2 (en) 2001-12-06 2006-11-21 Hewlett-Packard Development Company L.P. Image capture device and method of selecting and capturing a desired portion of text

Also Published As

Publication number Publication date
WO1999060516A1 (en) 1999-11-25
CN1303504A (en) 2001-07-11
EP1073989A1 (en) 2001-02-07
AU4303999A (en) 1999-12-06
BR9910579A (en) 2001-01-09
CA2331121A1 (en) 1999-11-11
JP2002514021A (en) 2002-05-14
AU4303199A (en) 1999-11-23
AU758236B2 (en) 2003-03-20
KR20010052280A (en) 2001-06-25
IL139106A0 (en) 2001-11-25
CN1138227C (en) 2004-02-11
EP1073991A1 (en) 2001-02-07

Similar Documents

Publication Publication Date Title
US6529645B2 (en) Recording method and apparatus
AU758036B2 (en) Input unit, method for using the same and input system
US6906699B1 (en) Input unit, method for using the same and input system
US6721465B1 (en) Non-contact image reader and system using the same
US6985643B1 (en) Device and method for recording hand-written information
US7015969B2 (en) Hand-held image capture apparatus with scanning arrangement
US7221810B2 (en) Method and device for recording of information
WO1999057678A1 (en) Device for recording information in different modes
EP1073945B1 (en) Device and method for recording hand-written information
US6715686B1 (en) Device for recording information in different modes
WO1999060515A1 (en) Device for recording information in different modes
US20070122057A1 (en) Method of scanning an image using surface coordinate values and device using thereof
MXPA00010548A (en) Device and method for recording hand-written information
MXPA00010541A (en) Input unit, method for using the same and input system
JPH02247782A (en) Scanner

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 99806676.1

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AT AU AZ BA BB BG BR BY CA CH CN CU CZ CZ DE DE DK DK EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 139106

Country of ref document: IL

Ref document number: 43031/99

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 09673703

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: PA/a/2000/010544

Country of ref document: MX

ENP Entry into the national phase

Ref document number: 2331121

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 1020007012068

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 1999948569

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1999948569

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 1020007012068

Country of ref document: KR

WWG Wipo information: grant in national office

Ref document number: 43031/99

Country of ref document: AU

WWW Wipo information: withdrawn in national office

Ref document number: 1020007012068

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 1999948569

Country of ref document: EP