WO1997032433A1 - Method for enhancing usability of fax on small devices - Google Patents

Method for enhancing usability of fax on small devices Download PDF

Info

Publication number
WO1997032433A1
WO1997032433A1 PCT/US1997/001706 US9701706W WO9732433A1 WO 1997032433 A1 WO1997032433 A1 WO 1997032433A1 US 9701706 W US9701706 W US 9701706W WO 9732433 A1 WO9732433 A1 WO 9732433A1
Authority
WO
WIPO (PCT)
Prior art keywords
facsimile transmission
data file
computer system
viewscreen
transmittal data
Prior art date
Application number
PCT/US1997/001706
Other languages
French (fr)
Inventor
Michael Man-Hak Tso
Original Assignee
Intel Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corporation filed Critical Intel Corporation
Priority to AU21163/97A priority Critical patent/AU2116397A/en
Publication of WO1997032433A1 publication Critical patent/WO1997032433A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32128Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image
    • H04N1/32133Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image on the same paper sheet, e.g. a facsimile page header
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00204Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0008Connection or combination of a still picture apparatus with another apparatus
    • H04N2201/0065Converting image data to a format usable by the connected apparatus or vice versa
    • H04N2201/0068Converting from still picture data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3212Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to a job, e.g. communication, capture or filing of an image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3242Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of processing required or performed, e.g. for reproduction or before recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3273Display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3278Transmission

Definitions

  • the present invention relates to the field of use of telecommunications. More particularly, the present invention relates to enhancing the usability of faxes and other image transmissions for display on small screens such as the display of a Personal Digital Assistant or handheld computer or other devices having a limited display and/or limited storage capacity.
  • Image and text data transmitted by fax machines are among the most widespread new uses 'of voice and data communications devices such as telephones. These faxed images are usually transmitted through the telephone and received for printout or storage of the image on a destination fax machine or computer for the use of the recipient. Since the destination machine has typically been a fax, computer, printer or other such large capacity storage and output device, there has not been a need to compress the fax significantly for the destination output device. Furthermore, scaling of the fax to fit small hand-held viewscreens has not been necessary since the traditional destination has been either a full size print-out, computer monitor or mass storage media.
  • PDAs Personal Digital Assistants
  • the display and handling schemes for fax images must be adapted to overcome the limitations of such devices if they are to adequately receive fax transmissions.
  • these PDAs unlike their fax machine or computer counterparts, have extremely limited storage and video capabilities. For instance on a PDA, the typical storage space totals only one megabyte (1 MB) , and this space would be quickly filled by just six pages of fax data which would total 900 Kilobytes (900 KB) .
  • the present invention is a method and system for viewing a facsimile (hereinafter referred to as "fax") on a viewscreen of a limited storage/processing capability destination device such as Personal Digital Assistant (PDA) or handheld computer.
  • a facsimile hereinafter referred to as "fax"
  • PDA Personal Digital Assistant
  • the fax is processed in the computer system by decomposing the fax into recognizable text elements, and then outputting the text elements to a transmittal file.
  • rendering information such as position or color is provided, so that the text may be rendered more accurately at the destination device.
  • graphical elements are recognized and stored by their coordinates and other rendering information.
  • the graphical elements are also edge-fitted so that curves and polygons are more efficiently represented.
  • the graphical information is also output to the transmittal file.
  • the completed transmittal file which can be further compressed, will therefore contain all the information necessary to reconstruct the fax at the destination device.
  • the transmittal file is received by the destination device which then uses the information within the file to reconstruct an image of the fax on the viewscreen.
  • the invention is advantageous in that the transmittal file is orders of magnitude smaller than the original fax itself and can be more easily and quickly scaled and viewed at a device with limited storage/processing capability such as a PDA.
  • Figure 1 is a routing diagram showing the data path of the fax.
  • Figure 2 is a detailed system diagram showing the process of adapting the fax for display on the viewscree .
  • Figure 3 is a block diagram showing the fax image processing components on the computer system.
  • Figure 4 is a block diagram showing the fax image displaying components on the Personal Digital Assistant device.
  • Figure 5 is a pictorial representation of the stages of processing that the invention employs upon a fax.
  • Figure 1 shows a pictorial routing diagram of the path the fax data travels before reaching a destination PDA device 40.
  • An originating fax machine 10 (or other fax capable device) dials a phone number corresponding to the destination PDA device 40 in order to transmit the data to it for viewing by a recipient.
  • a router 20, may be a cellular switch/PSTN (Public Switched Telephone Network) or other communications router such as ethernet, intercepts and re-routes the incoming fax call to a computer system 30, which may be single machine or a network of machines that can be located remotely away from the PDA device 40, for processing. Though described herein as implemented in a PDA device, the present invention may also be employed in a handheld computer.
  • PSTN Public Switched Telephone Network
  • the computer system 30 then can either store the entire fax in the computer system or process the fax as the packets of the transmission are being received and store a processed version of the fax. If the fax is received and stored, then the communications port of the computer system is freed for other tasks, perhaps to receive another incoming fax. The re-routing of the fax to the computer system 30 also prevents tying up the PDA device 40 so that it can receive all of its faxes at once if the recipient so chooses. The faxes may be collected and stored by the computer system 30 for later download. The computer can therefore, act as a server storing faxes and the user can select whether to receive the fax(es) immediately or wait.
  • the fax is processed for display on a viewscreen 45 of the PDA device 40.
  • the fax rather than being processed on the PDA device 40, can be sent to a real fax machine for output.
  • the computer system 30 outputs a processed version of the fax into a fax data transmittal file (referring to Figure 2) which contains all the essential information regarding the location and content of the elements (graphics and text) comprising the fax (the process is detailed later) .
  • the computer system 30 then compresses the transmittal data file so that it can be more efficiently transmitted than ordinary data.
  • the computer system through a communications port (detailed later) , transmits the compressed fax transmittal data file to the PDA device 40.
  • the PDA device 40 decompresses the file and renders the fax image for display on its viewscreen 45.
  • the components and software that handle and process the fax from source to destination is detailed in Figure 2.
  • the fax machine 10 has a fax send unit 15 which dials the phone number corresponding to the destination PDA device 40. This phone number is intercepted by the router 20.
  • the router 20 can be described, when it is implemented as a PSTN or cellular switch as follows: 1) The router 20 that receives the phone number corresponding to the destination PDA device 40 recognizes that the incoming call is a fax and looks up a forwarding number corresponding to the phone number for calling the computer system's communication device shown as modem 310; and 2) the router 20 dials up the forwarding number and the incoming fax call is forwarded to the computer system through the modem 310 interfacing with the computer through communications port 380.
  • the steps involved in such relaying and re-routing is well known in the art of communications and will not be discussed further.
  • the computer system has fax receive software 320 that can enable the computer system to correctly receive the incoming fax from modem 310 and interpret the incoming call as being a fax.
  • the fax thus received is then processed by at least three distinct software functions— an optical character recognition software 340, an edge fitting scheme 350 and a compression scheme 370.
  • block 340 is a custom optical character recognition software (OCR) which takes the fax and "scans" it for textual elements (recognizable text conforming to, for instance, the ASCII character set) .
  • OCR optical character recognition software
  • FIG. 2 shows a system level diagram of the present invention
  • block 340 is a custom optical character recognition software (OCR) which takes the fax and "scans" it for textual elements (recognizable text conforming to, for instance, the ASCII character set) .
  • OCR optical character recognition software
  • OCR 340 of the present invention only extracts text elements that are readily recognizable and have a high probability of being correct, leaving the remaining images to be broken down by edge-fitting block 350 since the ultimate goal is merely to display the fax on a viewscreen small in comparison to a standard computer monitor.
  • OCR 340 operates at a lower error rate than a traditional OCR.
  • One skilled in the art of OCR will be able to make such modifications to traditional software as are needed for the present invention.
  • the OCR 340 filters out recognizable ASCII text elements and assigns them coordinates (that define for instance a rectangular window) to fix their position relative to other elements on the fax page.
  • the resulting text elements along with their coordinates are copied to a transmittal data file 500 which will ultimately be transferred to the PDA device 40.
  • Figure 5 shows the words "This is representative text” being assigned the window coordinates (12, 12) -(29, 14) , (in the form (x,y) where x is the horizontal component and y the vertical component) and then being copied into the data transmittal file 500.
  • the original fax is removed of the textual elements that have been recognized by the OCR which are then preserved in transmittal data file 500.
  • the resulting intermediate version of the fax contains only images which the OCR 340 could not recognize as text. Additionally, the original fax in its entirety may also be preserved on the computer system 30 in a backup file for archiving as a fail-safe or for editing so that the original fax is not destroyed.
  • This intermediate version of the fax will be provided to the edge-fitting scheme 350 which can reduce the images, remaining after OCR 340 has filtered out text, as a composite of lines that edge fit to approximate the shapes of the images.
  • the edge-fitting scheme 350 will convert the images remaining (after the OCR 340 has filtered out textual elements) into polygons and lines by edge-fitting.
  • Edge-fitting is well known in the art of graphics compression and rendering and will not be described in detail. Edge-fitting commonly consists of converting curved lines into a series of straight lines.
  • edge-fitting scheme 350 is optimized to provide a fewer number of linear approximations so that the interpolation is not as exact as would be required with a standard rendering for a full-size screen.
  • Such edge fitting is illustrated in Figure 5, where the images remaining after OCR are reduced to be represented by renderable coordinates.
  • Figure 5 shows the curved line as being edge-fit into a series of two connected lines.
  • Detailed images are difficult to render on a small, low resolution screen such as would be found on a small device such as a PDA.
  • Edge-fitting scheme 350 operates under looser linear approximation than edge-fitting schemes of standard computer aided drafting software, as the target output of the present invention is also of lower resolution.
  • edge-fitting scheme 350 can be equipped with polygon mesh utilities that reduce a closed shape into a series of connected lines that approximate the curvature of the closed shape.
  • a leading identifier type identifying that the coordinates to follow as representing polygons rather isolated lines
  • an unbroken series of coordinates an entire polygon is preserved for rendering later at the destination. This is advantageous in that for a single line, two coordinates--a start and an end— need to be copied into the transmittal data file 500 and a series of such lines would double the number of coordinates copied. The number of coordinates copied to capture a polygon is therefore reduced by approximately half.
  • the polygon mesh information in addition to identifier type and coordinates, have a "fill" flag upon which the closed polygon is filled in upon its final rendering at the destination viewscreen.
  • This "fill” flag prevents storing multiple lines that under pure edge-fitting are necessary to represent closed shapes that are shaded.
  • a more detailed description of edge-fitting and polygonization may be found in James D. Foley, Andries van Dam, et al . , Computer Graphics, Principles and Practice. Addison Wesley, (Reading, Massachusetts 1990) [hereinafter Computer Graphics1 at pages 26-38 and 472-473.
  • Figure 5 shows, for instance, a circle from the fax image copied to the data transmittal file 500 by giving the endpoint coordinates of a radial line of the circle. This prevents having to represent the circle by a large number of lines.
  • a type identifier (identifying the coordinates following as those of a circle) and "fill" flag similar to the polygon mesh information can also be provided by the edge-fitting scheme 350 and copied along with the coordinates to the transmittal data file 500.
  • Figure 5 shows, for instance that the circle is given the type identifier of 4, whereas an ordinary line is given an identifier of 2.
  • the edge-fitting scheme 350 completes the sequence of breaking down the fax image into elements and corresponding coordinates (along with type information or fill flags) by copying the information into the transmittal data file 500 which also contains the textual elements (and window coordinates) obtained from the OCR software 340.
  • the resulting data file thus constitutes all graphical and textual elements that were in the original fax and is used at the destination to scale and render the fax for display on the PDA viewscreen 45.
  • the transmittal data file 500 when completed with all the information necessary to reconstruct the fax, is then compressed by a compression technique 370 such as Pkzip (a product of PKWare, Inc.) .
  • Pkzip a product of PKWare, Inc.
  • the transmittal data file 500 is reduced to a very small size often 10 to 100 times smaller than the original fax size.
  • the typical page of fax ranges approximately between 100K and 200K in size, and thus the final transmittal data file in compressed form is less than IK (roughly the size of one page of ASCII text and numeric data) .
  • the compression technique 370 is well-known in - li ⁇
  • bitmap image file version of a fax such as a GIF (Graphics Interchange Format) or JPEG because these files are already in compressed form.
  • scaling a bitmap image such as a GIF requires computing power that a small device such as a PDA device does not have.
  • the transmittal data file containing only text, position information for the text and coordinates for lines and polygons, is easier to scale and render (as described) in terms of computing resources required than a bitmap image would be.
  • the compressed transmittal data file exits the compression program and is sent to the data transmission unit 330 for transmittal by the modem 310 via its interface with the communications port 380 of the computer system.
  • the modem 310 dials the PDA device 40.
  • the router 20 receives an identifier identifying the call as not a fax, but as a data file and prevents forwarding to the computer system 20 as previously done with the fax. Router 20 then seeks out the PDA device 40 and connects the call.
  • the transmittal data file 500 in compressed form, is received by the PDA device 40 through its communications port 480 which then communicates the file to data receive unit 410 which interprets the transmission as a data file.
  • the recipient may simply get a message indicating the number and size of faxes due to be sent by the computer, and may choose, as a command option, to store the fax for retrieval and whether it is stored or immediately transmitted, the recipient may also choose to send the fax to a real fax machine rather than the PDA.
  • a typical PDA device such as Apple Computer Co. 's SIMON, must be modified to enable reconstruction of an image of the original fax using the transmittal data file 500.
  • the PDA device 40 of the present invention will have suitable decompression software, such as Pkunzip, a product of PKWare, Inc.) either embedded within the phone or connected via a module, to decompress the transmittal data file 500.
  • the PDA device 40 will have code to render lines and shapes by using coordinates provided them by the transmittal data file 500.
  • the PDA device 40 also has the ability to convert ASCII codes into characters or directly output the text from the transmittal data file 500.
  • the PDA device 40 has limited memory capability, much like other PDAs, but should also perform simple arithmetic (add, subtract, multiply and divide) for the purpose of scaling rendered images. Unlike the computer system 30, therefore, the PDA device 40 may have only the limited ability to translate coordinates, draw lines, draw text and scale the images on the viewscreen 45. These capabilities of the PDA device 40 are discussed below in greater detail.
  • the data receive unit 410 provides the compressed file to decompression scheme 420.
  • the data file is then decompressed by a decompression scheme 420, using Pkunzip (if Pkzip were used at the computer system compression stage) for instance, so that the text elements, position information for the text and coordinates for lines and polygons can be made available to a fax image scaling and rendering unit 430.
  • Pkunzip if Pkzip were used at the computer system compression stage
  • the fax image scaling and rendering unit 430 temporarily places into memory the text elements, line by line, or word by word using their ASCII codes and then scales down the line or word of text by reducing the font size of the text (determined by calculating the size of the text window coordinates supplied) .
  • the relative position of the text lines is preserved to give the rendered image the same look-and-feel as the original.
  • a ratio is calculated that is equal to the quotient of the fax page size to the size of viewscreen 45.
  • the ratio can be calculated using some increment of the actual size of the viewscreen 45.
  • the reduced font size can be implemented either through scalable fonts (like TrueType fonts) which can handle any reduction ratio or by fonts that are limited to predetermined sizes. Using fonts limited to predetermined sizes, the ratio will be used to divide the original font size down and then the closest font size available will be used to render the text.
  • the fax image scaling and rendering unit 430 then translates the coordinates provided by the transmittal file (representing a window) that correspond to the text element to coordinates suitable for the viewscreen 45. The text is then output on the viewscreen at the coordinates provided (representing a window) . In this manner, all the text elements are output to the viewscreen 45.
  • the transmittal data file 500 when decompressed, will also contain line and polygon information which is provided to the fax scaling and rendering unit 430.
  • the scaling and rendering unit 430 translates (maps) the coordinates provided from the transmittal data file 500 to be fit the viewscreen 45 using, for example, the ratio calculated for font reduction. In doing so, unit 430 has also automatically scaled the lines and polygons to fit the viewscreen since the coordinate system of the viewscreen upon which the fax coordinates are mapped covers the viewscreen edge-to-edge. Then, the unit 430 renders the lines and polygons to be drawn on the viewscreen 45.
  • the coordinate translation of the polygons and lines and the font reduction of the text elements all require only simple arithmetic and thus can easily be performed with the limited processor capability of the PDA device 40 (in comparison to the computer system 30) .
  • the complicated process of pixel-by-pixel bitmap image compression, rendering, and scaling (to fit the small viewscreen) is therefore bypassed and the result is an easily scalable and quickly viewable screen image of the fax.
  • Scaling a bitmap image requires linear edge- fitting of all pixels on an enormous level and cannot be performed by such devices as a PDA.
  • the present invention also uses a form of linear edge-fitting, it does so on a larger computer with the necessary processor, memory and storage capability to carry out edge-fitting. Further, since the present invention breaks down the image into a series of pre-defined lines and objects, the PDA device 40 can easily display and scale these objects and lines and reconstitute the image.
  • a zooming function on the PDA device 40 so that the recipient user can enlarge an area of the fax image as displayed on the viewscreen.
  • a zoom feature is implemented by merely mapping the coordinates of the lines and polygons desired to be zoomed onto the entire viewscreen 45. Again, such an operation is simple arithmetic and not as compute intensive as scaling an ordinary bitmap image which must decide which pixels to keep and which to fill in.
  • the text elements contained within the zoom area coordinates are scaled by adjusting their font size up/down to a size in proportion with the coordinate mapping ratio used to zoom the lines and polygons.
  • FIG 3 is a simple block diagram of the components and schemes of the computer system 30 that process the fax and transmit it to the PDA device 40.
  • the incoming fax runs through an OCR 340, the result of which are two files -- one, the transmittal data file containing ASCII text and position information and the other, the filtered out file containing left over graphical images that the OCR 340 did not recognize.
  • the filtered out file is then fed to the edge-fitting scheme 350 which edge fits the images into polygons and lines.
  • the coordinates of the lines and polygons (and other pertinent information) are stored in the transmittal data file.
  • the transmittal data file once complete, is then compressed by a compression scheme 370.
  • the compressed transmittal data file is then transmitted by a data transmission unit 330 of computer system 30 to PDA device 40 for displaying.
  • Figure 4 is a simplified block diagram of the components and schemes of PDA device 40 that displays the fax onto the viewscreen.
  • the data transmittal file is received and then decompressed to its original form by the decompression block 420.
  • the text information of the transmittal file i.e., text and corresponding position information, are provided to the fax scaling block 432.
  • the fax scaling block 432 maps the coordinates provided in a proportion roughly corresponding to the ratio of the original scanned image size of the fax to the viewscreen coordinates.
  • the scaling block 432 also reduces the font size of the text elements corresponding to this ratio.
  • Figure 5 illustrates sample images of fax at various stages of processing.
  • a fax image is shown with various different elements, text, a straight line, a circle, a curved line and a shape with 5 sides.
  • the text "[t]his is representative text" is filtered out by - 16 -
  • the OCR software also provides the coordinates of a window where the text is located, e.g. (12,12)- (29,14) .
  • the transmittal data file receives the coordinates along with an identifier type of "1" which indicates that the coordinates to follow are a rectangular text window where the text is to be located.
  • the text is then copied into the transmittal file after the coordinates.
  • the pictorial is only illustrative, as the text is likely represented by a sequence of ASCII codes.
  • the file remaining will contain images that were not recognized as text by the OCR.
  • the straight line is converted into coordinates (11,17)- (19,19) and also has a leading type identifier of "2" indicating that it is a line.
  • the curved line is converted into two straight lines and are represented in the data transmittal file as two lines.
  • the circle is represented by the edge-fitting software by the coordinates of a radial line, with a leading type identifier of "4".
  • the polygon is likewise split into a stream of connecting coordinates instead of lines since they are inherently connected.
  • a leading identifier type different from those used for circles, lines or text is also provided leading the coordinate stream.
  • an option fill flag that may be provided with the circle and polygon to indicate that it should be filled in solid upon rendering.
  • a number representing color can also be transmitted along with the other text and graphics information such that the rendering at the viewscreen can be achieved in color as well as black-and-white.
  • the scaling that occurs on the PDA device 40 can be achieved at the computer system 30.
  • the computer system 30 may have a look-up file identifying the type of PDA device and size of its viewscreen to which the fax will be sent.
  • Such a look-up file may contain, in case the computer system 30 is utilized to process different faxes for different recipients at different times, the phone-number of the destination device as a key. Matching this key, the computer system 30 can determine the parameters of the PDA device and viewscreen, by hwich it can convert the coordinates into a form and size utilized by the PDA device 40.
  • the PDA device need not even perform the arithmetic scaling and may display the image directly using the coordinates resident in the transmittal data file 500.

Abstract

In a device with limited processor and/or memory capability, such as a Personal Digital Assistant or handheld computer, that has a viewscreen (45), a method and system for viewing a facsimile transmission image. After being sent, the facsimile transmission is routed to and intercepted by a computer system for processing before it reaches the device. The processing of the facsimile transmission includes recognizing text and outputting it, along with rendering information such as position, to a transmittal file. Once the recognizable text has been filtered from the facsimile transmission, the remaining images are edge-fit and output to the transmittal data file by position and other rendering information. The transmittal file is sent to the device with the viewscreen. The device then uses the information contained within the transmittal file to render a version of the facsimile transmission image and display it on the viewscreen.

Description

METHOD FOR ENHANCING USABILITY OF FAX ON SMALL
DEVICES
BACKGROUND OF THE INVENTION
Field of the Invention
The present invention relates to the field of use of telecommunications. More particularly, the present invention relates to enhancing the usability of faxes and other image transmissions for display on small screens such as the display of a Personal Digital Assistant or handheld computer or other devices having a limited display and/or limited storage capacity.
Description of Related Art
Image and text data transmitted by fax machines are among the most widespread new uses 'of voice and data communications devices such as telephones. These faxed images are usually transmitted through the telephone and received for printout or storage of the image on a destination fax machine or computer for the use of the recipient. Since the destination machine has typically been a fax, computer, printer or other such large capacity storage and output device, there has not been a need to compress the fax significantly for the destination output device. Furthermore, scaling of the fax to fit small hand-held viewscreens has not been necessary since the traditional destination has been either a full size print-out, computer monitor or mass storage media.
With the ongoing development of devices such as
Personal Digital Assistants (PDAs) having small graphical viewscreens, the display and handling schemes for fax images must be adapted to overcome the limitations of such devices if they are to adequately receive fax transmissions. Though equipped with graphical viewscreens, these PDAs, unlike their fax machine or computer counterparts, have extremely limited storage and video capabilities. For instance on a PDA, the typical storage space totals only one megabyte (1 MB) , and this space would be quickly filled by just six pages of fax data which would total 900 Kilobytes (900 KB) .
Devices such as PDAs or handheld computers have the ability to receive fax information even though they are used primarily to send out f xes. But using such a device, the recipient must scroll through portions of the faxed document image, or receive the fax in parts and is unable to receive several pages or multiple faxes at once due to storage limitations. Thus, there is an urgent need for compressing incoming fax transmissions before they are finally viewed by the recipient on the destination PDA and display. Further, since the screen size is small compared to normal displays and as compared with the fax, there is a need to efficiently scale the image to avoid the recipient having to scroll through the image once it is received.
Many techniques are known and have been developed to scale and compress images but these techniques are usually too compute intensive for a PDA which has no significant memory system nor microprocessor capability compared to a desktop computer. Further, these compression and scaling schemes have never been adapted to transmit a fax such that it be adequately displayed on a very small display screen like a PDA display screen. Rather, many of the techniques used rely on scaling and compressing the entire image pixel-by-pixel as a bitmap and do not optimize for a fax document which is largely text with some image data. Thus, there is required a system and method for compressing and scaling fax images for the specific purpose of efficiently receiving and displaying them on PDA display screens or other small device screens with limited microprocessor and storage capability.
SUMMARY
The present invention is a method and system for viewing a facsimile (hereinafter referred to as "fax") on a viewscreen of a limited storage/processing capability destination device such as Personal Digital Assistant (PDA) or handheld computer. When the fax is sent to the device, the call is transferred to a computer or other apparatus having significantly greater storage/processing capability compared to the destination device. The fax is processed in the computer system by decomposing the fax into recognizable text elements, and then outputting the text elements to a transmittal file. Along with the text elements themselves, rendering information such as position or color is provided, so that the text may be rendered more accurately at the destination device. Similarly, graphical elements are recognized and stored by their coordinates and other rendering information. The graphical elements are also edge-fitted so that curves and polygons are more efficiently represented. The graphical information is also output to the transmittal file.
The completed transmittal file, which can be further compressed, will therefore contain all the information necessary to reconstruct the fax at the destination device. The transmittal file is received by the destination device which then uses the information within the file to reconstruct an image of the fax on the viewscreen. The invention is advantageous in that the transmittal file is orders of magnitude smaller than the original fax itself and can be more easily and quickly scaled and viewed at a device with limited storage/processing capability such as a PDA.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 is a routing diagram showing the data path of the fax.
Figure 2 is a detailed system diagram showing the process of adapting the fax for display on the viewscree .
Figure 3 is a block diagram showing the fax image processing components on the computer system.
Figure 4 is a block diagram showing the fax image displaying components on the Personal Digital Assistant device.
Figure 5 is a pictorial representation of the stages of processing that the invention employs upon a fax.
DETAILED DESCRIPTION OF THE INVENTION
While the present invention has been particularly described with reference to the various figures, it should be understood that the figures are for illustration only and should not be taken as limiting the scope of the invention. Many changes and modifications may be made to the invention, by one having ordinary skill in the art, without departing from the spirit and scope of the invention.
Figure 1 shows a pictorial routing diagram of the path the fax data travels before reaching a destination PDA device 40. An originating fax machine 10 (or other fax capable device) dials a phone number corresponding to the destination PDA device 40 in order to transmit the data to it for viewing by a recipient. A router 20, may be a cellular switch/PSTN (Public Switched Telephone Network) or other communications router such as ethernet, intercepts and re-routes the incoming fax call to a computer system 30, which may be single machine or a network of machines that can be located remotely away from the PDA device 40, for processing. Though described herein as implemented in a PDA device, the present invention may also be employed in a handheld computer.
The computer system 30 then can either store the entire fax in the computer system or process the fax as the packets of the transmission are being received and store a processed version of the fax. If the fax is received and stored, then the communications port of the computer system is freed for other tasks, perhaps to receive another incoming fax. The re-routing of the fax to the computer system 30 also prevents tying up the PDA device 40 so that it can receive all of its faxes at once if the recipient so chooses. The faxes may be collected and stored by the computer system 30 for later download. The computer can therefore, act as a server storing faxes and the user can select whether to receive the fax(es) immediately or wait. In either case, the fax is processed for display on a viewscreen 45 of the PDA device 40. However, alternatively, if the user chooses to, the fax, rather than being processed on the PDA device 40, can be sent to a real fax machine for output.
The computer system 30 outputs a processed version of the fax into a fax data transmittal file (referring to Figure 2) which contains all the essential information regarding the location and content of the elements (graphics and text) comprising the fax (the process is detailed later) . The computer system 30 then compresses the transmittal data file so that it can be more efficiently transmitted than ordinary data. The computer system, through a communications port (detailed later) , transmits the compressed fax transmittal data file to the PDA device 40. The PDA device 40 decompresses the file and renders the fax image for display on its viewscreen 45.
The components and software that handle and process the fax from source to destination is detailed in Figure 2. The fax machine 10 has a fax send unit 15 which dials the phone number corresponding to the destination PDA device 40. This phone number is intercepted by the router 20. The router 20 can be described, when it is implemented as a PSTN or cellular switch as follows: 1) The router 20 that receives the phone number corresponding to the destination PDA device 40 recognizes that the incoming call is a fax and looks up a forwarding number corresponding to the phone number for calling the computer system's communication device shown as modem 310; and 2) the router 20 dials up the forwarding number and the incoming fax call is forwarded to the computer system through the modem 310 interfacing with the computer through communications port 380. The steps involved in such relaying and re-routing is well known in the art of communications and will not be discussed further.
The computer system has fax receive software 320 that can enable the computer system to correctly receive the incoming fax from modem 310 and interpret the incoming call as being a fax. The fax thus received is then processed by at least three distinct software functions— an optical character recognition software 340, an edge fitting scheme 350 and a compression scheme 370.
Referring still to Figure 2, which shows a system level diagram of the present invention, block 340 is a custom optical character recognition software (OCR) which takes the fax and "scans" it for textual elements (recognizable text conforming to, for instance, the ASCII character set) . Though OCR is well-known and commonly used in the art of scanning images (for example, OmniPage which is available from Caere Corporation) to extract text, the application of viewing a fax on a small device display screen requires modifying traditional OCR. Traditional OCR software places great emphasis on extracting as many, if not all, of the characters there are since the goal of traditional OCR scanning software is to get a version of the fax that is editable by word processing software. However, OCR 340 of the present invention only extracts text elements that are readily recognizable and have a high probability of being correct, leaving the remaining images to be broken down by edge-fitting block 350 since the ultimate goal is merely to display the fax on a viewscreen small in comparison to a standard computer monitor. By modifying the traditional OCR in this manner, OCR 340 operates at a lower error rate than a traditional OCR. One skilled in the art of OCR will be able to make such modifications to traditional software as are needed for the present invention.
The OCR 340 filters out recognizable ASCII text elements and assigns them coordinates (that define for instance a rectangular window) to fix their position relative to other elements on the fax page. The resulting text elements along with their coordinates are copied to a transmittal data file 500 which will ultimately be transferred to the PDA device 40. For instance, Figure 5 shows the words "This is representative text" being assigned the window coordinates (12, 12) -(29, 14) , (in the form (x,y) where x is the horizontal component and y the vertical component) and then being copied into the data transmittal file 500. The original fax is removed of the textual elements that have been recognized by the OCR which are then preserved in transmittal data file 500. Referring again to Figure 5, the resulting intermediate version of the fax contains only images which the OCR 340 could not recognize as text. Additionally, the original fax in its entirety may also be preserved on the computer system 30 in a backup file for archiving as a fail-safe or for editing so that the original fax is not destroyed.
This intermediate version of the fax will be provided to the edge-fitting scheme 350 which can reduce the images, remaining after OCR 340 has filtered out text, as a composite of lines that edge fit to approximate the shapes of the images. The edge-fitting scheme 350 will convert the images remaining (after the OCR 340 has filtered out textual elements) into polygons and lines by edge-fitting. Edge-fitting is well known in the art of graphics compression and rendering and will not be described in detail. Edge-fitting commonly consists of converting curved lines into a series of straight lines. Advantageously, and unlike prior art edge-fitting, edge-fitting scheme 350 is optimized to provide a fewer number of linear approximations so that the interpolation is not as exact as would be required with a standard rendering for a full-size screen. Such edge fitting is illustrated in Figure 5, where the images remaining after OCR are reduced to be represented by renderable coordinates.
For instance, Figure 5 shows the curved line as being edge-fit into a series of two connected lines. The smaller the size of the viewscreen 45, the larger the resolution of the edge-fitting and the fewer the lines that need be computed. Detailed images are difficult to render on a small, low resolution screen such as would be found on a small device such as a PDA. Thus, there is no requirement that the number of edges (lines) be as great nor that the incremental distance of each line computed be as small as compared with edge- fitting for display on a standard size screen such as a 15" computer monitor. Edge-fitting scheme 350 operates under looser linear approximation than edge-fitting schemes of standard computer aided drafting software, as the target output of the present invention is also of lower resolution.
Additionally, edge-fitting scheme 350 can be equipped with polygon mesh utilities that reduce a closed shape into a series of connected lines that approximate the curvature of the closed shape. Thus, with a leading identifier type (identifying that the coordinates to follow as representing polygons rather isolated lines) and an unbroken series of coordinates, an entire polygon is preserved for rendering later at the destination. This is advantageous in that for a single line, two coordinates--a start and an end— need to be copied into the transmittal data file 500 and a series of such lines would double the number of coordinates copied. The number of coordinates copied to capture a polygon is therefore reduced by approximately half. Furthermore, the polygon mesh information, in addition to identifier type and coordinates, have a "fill" flag upon which the closed polygon is filled in upon its final rendering at the destination viewscreen. This "fill" flag prevents storing multiple lines that under pure edge-fitting are necessary to represent closed shapes that are shaded. A more detailed description of edge-fitting and polygonization may be found in James D. Foley, Andries van Dam, et al . , Computer Graphics, Principles and Practice. Addison Wesley, (Reading, Massachusetts 1990) [hereinafter Computer Graphics1 at pages 26-38 and 472-473.
Likewise, it may be advantageous to have circles represented by the edge-fitting scheme 350 by a center coordinate and a coordinate for a point of the circumference (or alternatively, a radius length) of the circle. Figure 5 shows, for instance, a circle from the fax image copied to the data transmittal file 500 by giving the endpoint coordinates of a radial line of the circle. This prevents having to represent the circle by a large number of lines. A type identifier (identifying the coordinates following as those of a circle) and "fill" flag similar to the polygon mesh information can also be provided by the edge-fitting scheme 350 and copied along with the coordinates to the transmittal data file 500. Figure 5 shows, for instance that the circle is given the type identifier of 4, whereas an ordinary line is given an identifier of 2.
The edge-fitting scheme 350 completes the sequence of breaking down the fax image into elements and corresponding coordinates (along with type information or fill flags) by copying the information into the transmittal data file 500 which also contains the textual elements (and window coordinates) obtained from the OCR software 340. The resulting data file thus constitutes all graphical and textual elements that were in the original fax and is used at the destination to scale and render the fax for display on the PDA viewscreen 45.
The transmittal data file 500, when completed with all the information necessary to reconstruct the fax, is then compressed by a compression technique 370 such as Pkzip (a product of PKWare, Inc.) . Thus, the transmittal data file 500 is reduced to a very small size often 10 to 100 times smaller than the original fax size. The typical page of fax ranges approximately between 100K and 200K in size, and thus the final transmittal data file in compressed form is less than IK (roughly the size of one page of ASCII text and numeric data) . The compression technique 370 is well-known in - li ¬
the art, but will not work to compress a standard bitmap image file version of a fax such as a GIF (Graphics Interchange Format) or JPEG because these files are already in compressed form. Further, scaling a bitmap image such as a GIF requires computing power that a small device such as a PDA device does not have. But, the transmittal data file, containing only text, position information for the text and coordinates for lines and polygons, is easier to scale and render (as described) in terms of computing resources required than a bitmap image would be.
The compressed transmittal data file exits the compression program and is sent to the data transmission unit 330 for transmittal by the modem 310 via its interface with the communications port 380 of the computer system. The modem 310 dials the PDA device 40. The router 20 receives an identifier identifying the call as not a fax, but as a data file and prevents forwarding to the computer system 20 as previously done with the fax. Router 20 then seeks out the PDA device 40 and connects the call. The transmittal data file 500, in compressed form, is received by the PDA device 40 through its communications port 480 which then communicates the file to data receive unit 410 which interprets the transmission as a data file. As described earlier, the recipient may simply get a message indicating the number and size of faxes due to be sent by the computer, and may choose, as a command option, to store the fax for retrieval and whether it is stored or immediately transmitted, the recipient may also choose to send the fax to a real fax machine rather than the PDA.
A typical PDA device, such as Apple Computer Co. 's SIMON, must be modified to enable reconstruction of an image of the original fax using the transmittal data file 500. Thus, the PDA device 40 of the present invention will have suitable decompression software, such as Pkunzip, a product of PKWare, Inc.) either embedded within the phone or connected via a module, to decompress the transmittal data file 500. Further, unlike a typical PDA with a viewscreen and graphics engine, the PDA device 40 will have code to render lines and shapes by using coordinates provided them by the transmittal data file 500. The PDA device 40 also has the ability to convert ASCII codes into characters or directly output the text from the transmittal data file 500. The PDA device 40 has limited memory capability, much like other PDAs, but should also perform simple arithmetic (add, subtract, multiply and divide) for the purpose of scaling rendered images. Unlike the computer system 30, therefore, the PDA device 40 may have only the limited ability to translate coordinates, draw lines, draw text and scale the images on the viewscreen 45. These capabilities of the PDA device 40 are discussed below in greater detail.
The data receive unit 410 provides the compressed file to decompression scheme 420. The data file is then decompressed by a decompression scheme 420, using Pkunzip (if Pkzip were used at the computer system compression stage) for instance, so that the text elements, position information for the text and coordinates for lines and polygons can be made available to a fax image scaling and rendering unit 430.
The fax image scaling and rendering unit 430 temporarily places into memory the text elements, line by line, or word by word using their ASCII codes and then scales down the line or word of text by reducing the font size of the text (determined by calculating the size of the text window coordinates supplied) . By scaling the text information on a line by line basis, the relative position of the text lines is preserved to give the rendered image the same look-and-feel as the original. Optimally, to achieve scaling, a ratio is calculated that is equal to the quotient of the fax page size to the size of viewscreen 45. Of course, if it is desired to have a fax that can be scrolled, the ratio can be calculated using some increment of the actual size of the viewscreen 45. The reduced font size can be implemented either through scalable fonts (like TrueType fonts) which can handle any reduction ratio or by fonts that are limited to predetermined sizes. Using fonts limited to predetermined sizes, the ratio will be used to divide the original font size down and then the closest font size available will be used to render the text. The fax image scaling and rendering unit 430 then translates the coordinates provided by the transmittal file (representing a window) that correspond to the text element to coordinates suitable for the viewscreen 45. The text is then output on the viewscreen at the coordinates provided (representing a window) . In this manner, all the text elements are output to the viewscreen 45.
The transmittal data file 500, when decompressed, will also contain line and polygon information which is provided to the fax scaling and rendering unit 430. The scaling and rendering unit 430 translates (maps) the coordinates provided from the transmittal data file 500 to be fit the viewscreen 45 using, for example, the ratio calculated for font reduction. In doing so, unit 430 has also automatically scaled the lines and polygons to fit the viewscreen since the coordinate system of the viewscreen upon which the fax coordinates are mapped covers the viewscreen edge-to-edge. Then, the unit 430 renders the lines and polygons to be drawn on the viewscreen 45.
The coordinate translation of the polygons and lines and the font reduction of the text elements all require only simple arithmetic and thus can easily be performed with the limited processor capability of the PDA device 40 (in comparison to the computer system 30) . The complicated process of pixel-by-pixel bitmap image compression, rendering, and scaling (to fit the small viewscreen) is therefore bypassed and the result is an easily scalable and quickly viewable screen image of the fax. Scaling a bitmap image requires linear edge- fitting of all pixels on an enormous level and cannot be performed by such devices as a PDA. Though, the present invention also uses a form of linear edge-fitting, it does so on a larger computer with the necessary processor, memory and storage capability to carry out edge-fitting. Further, since the present invention breaks down the image into a series of pre-defined lines and objects, the PDA device 40 can easily display and scale these objects and lines and reconstitute the image.
In addition, it may be advantageous to have a zooming function on the PDA device 40 so that the recipient user can enlarge an area of the fax image as displayed on the viewscreen. Such a zoom feature is implemented by merely mapping the coordinates of the lines and polygons desired to be zoomed onto the entire viewscreen 45. Again, such an operation is simple arithmetic and not as compute intensive as scaling an ordinary bitmap image which must decide which pixels to keep and which to fill in. The text elements contained within the zoom area coordinates are scaled by adjusting their font size up/down to a size in proportion with the coordinate mapping ratio used to zoom the lines and polygons.
Figure 3 is a simple block diagram of the components and schemes of the computer system 30 that process the fax and transmit it to the PDA device 40. Referring also to Figure 5, the incoming fax runs through an OCR 340, the result of which are two files -- one, the transmittal data file containing ASCII text and position information and the other, the filtered out file containing left over graphical images that the OCR 340 did not recognize. The filtered out file is then fed to the edge-fitting scheme 350 which edge fits the images into polygons and lines. The coordinates of the lines and polygons (and other pertinent information) are stored in the transmittal data file. The transmittal data file, once complete, is then compressed by a compression scheme 370. The compressed transmittal data file is then transmitted by a data transmission unit 330 of computer system 30 to PDA device 40 for displaying.
Figure 4 is a simplified block diagram of the components and schemes of PDA device 40 that displays the fax onto the viewscreen. The data transmittal file is received and then decompressed to its original form by the decompression block 420. The text information of the transmittal file, i.e., text and corresponding position information, are provided to the fax scaling block 432. The fax scaling block 432 maps the coordinates provided in a proportion roughly corresponding to the ratio of the original scanned image size of the fax to the viewscreen coordinates. The scaling block 432 also reduces the font size of the text elements corresponding to this ratio. Either in parallel or in a pipeline manner, the text, lines and polygons are then displayed, either simultaneously or instantaneously upon completion of scaling, on the viewscreen 45 by the rendering block 434. An example of a scaling algorithm commonly employed is found in Computer Graphics at pages 202-204.
Figure 5 illustrates sample images of fax at various stages of processing. A fax image is shown with various different elements, text, a straight line, a circle, a curved line and a shape with 5 sides. The text "[t]his is representative text" is filtered out by - 16 -
the OCR software. The software also provides the coordinates of a window where the text is located, e.g. (12,12)- (29,14) . The transmittal data file receives the coordinates along with an identifier type of "1" which indicates that the coordinates to follow are a rectangular text window where the text is to be located. The text is then copied into the transmittal file after the coordinates. Of course one skilled in the art will recognize that the pictorial is only illustrative, as the text is likely represented by a sequence of ASCII codes. After the OCR, the file remaining will contain images that were not recognized as text by the OCR. The straight line is converted into coordinates (11,17)- (19,19) and also has a leading type identifier of "2" indicating that it is a line. The curved line is converted into two straight lines and are represented in the data transmittal file as two lines. The circle is represented by the edge-fitting software by the coordinates of a radial line, with a leading type identifier of "4".
Not shown in the Figure 5 representation of the transmittal data file, the polygon is likewise split into a stream of connecting coordinates instead of lines since they are inherently connected. A leading identifier type different from those used for circles, lines or text is also provided leading the coordinate stream. Also not shown is an option fill flag that may be provided with the circle and polygon to indicate that it should be filled in solid upon rendering. One skilled in the art, will readily understand that a number representing color can also be transmitted along with the other text and graphics information such that the rendering at the viewscreen can be achieved in color as well as black-and-white.
Though the present invention has been described as operating with a PDA, the method is equally applicable to any viewscreen on a device requiring limited processor and memory capability, such as a PDA, in comparison to a computer system.
As an alternate embodiment, the scaling that occurs on the PDA device 40 can be achieved at the computer system 30. The computer system 30 may have a look-up file identifying the type of PDA device and size of its viewscreen to which the fax will be sent. Such a look-up file may contain, in case the computer system 30 is utilized to process different faxes for different recipients at different times, the phone-number of the destination device as a key. Matching this key, the computer system 30 can determine the parameters of the PDA device and viewscreen, by hwich it can convert the coordinates into a form and size utilized by the PDA device 40. Thus, the PDA device need not even perform the arithmetic scaling and may display the image directly using the coordinates resident in the transmittal data file 500.

Claims

CLAIMSWhat is claimed is:
1. A method of viewing an incoming facsimile transmission on a viewscreen of a facsimile transmission receiving device comprising the steps of: transferring the facsimile transmission to a computer system for processing; processing the facsimile transmission on the computer system into a transmittal data file containing a set of objects and rendering information for displaying the set of objects; receiving the transmittal data file at the facsimile transmission receiving device; and constructing and displaying an image of the facsimile transmission on the viewscreen of the facsimile transmission receiving device using the set of objects and rendering information contained in the transmittal data file.
2. A method according to claim 1 wherein the step of transferring the facsimile transmission comprises the steps of: intercepting the incoming facsimile transmission at a router; forwarding the incoming facsimile transmission using the router to the computer system for processing; and receiving the facsimile transmission at a communications port of the computer system.
3. A method according to claim 1 wherein the rendering information for displaying the objects contains defining, positioning and scaling information. 4. A method according to claim 1 wherein the step of receiving the transmittal data file comprises the steps of: transmitting the transmittal data file through a communications port of the computer system to the facsimile receiving device; intercepting the transmittal data file at the router and recognizing the transmittal data file as carrying data; and forwarding the transmittal data file to the facsimile transmission receiving device.
5. A method according claim 1 wherein the step of constructing and displaying includes the step of rendering the set of objects into graphical and textual elements.
6. A method according to claim 5 wherein the graphical elements includes lines and polygons.
7. A method according to claim 5 wherein the step of constructing and displaying includes the steps of positioning and scaling the rendered graphical and textual elements to fit on the viewscreen of the facsimile transmission receiving device.
8. A method according to claim 4 wherein the step of receiving the transmittal data file includes the steps of compressing the transmittal data file prior to transmitting the transmittal data file to the facsimile transmission receiving device, and further includes decompressing the transmittal data file after forwarding to the facsimile transmission receiving device.
9. A method according to claim 1 wherein the step of processing the facsimile transmission comprises the steps of: utilizing an optical character recognition algorithm to filter out recognizable text from the facsimile transmission; and utilizing an edge-fitting algorithm linearly fitting any images of the facsimile transmission that have not been filtered out by the optical character recognition algorithm.
10. A method according to claim 1 further comprising the step of storing the transmittal data file and the facsimile transmission on the computer system for later use.
11. A method according to claim 1 wherein the step of processing the facsimile transmission on the computer system includes scaling the set objects, using the computer system, to fit on the viewscreen of the facsimile transmission receiving device.
12. A system for viewing a facsimile transmission on a viewscreen of a facsimile transmission receiving device, said system comprising: sending means for creating and transmitting the facsimile transmission; routing means for forwarding the facsimile transmission transmitted by said sending means; processing means for receiving said forwarded facsimile transmission and for decomposing the forwarded facsimile transmission into a transmittal data file containing a set of objects and rendering information, said processing means transmitting the transmittal data file to the facsimile transmission receiving device via the switching means; and reconstruction means coupled to said facsimile receiving device for displaying an image of the facsimile transmission on the viewscreen of the facsimile transmission receiving device using the set of objects and rendering information contained in the transmittal data file.
13. A system according to claim 12 wherein said sending means includes a facsimile machine.
14. A system according to claim 12 wherein said routing means includes a public switched telephone network for accessing a phone number corresponding to the processing means and then routing the facsimile transmission to the processing means.
15. A system according to claim 12 wherein said processing means includes a computer system.
16. A system according to claim 12 wherein said facsimile receiving device is a Personal Digital Assistant having a viewscreen.
17. A system according to claim 12 wherein said processing means is at a remote location from the fax receiving device.
18. A system according to claim 12 wherein said processing means stores the facsimile transmission and transmittal data file for later use.
AMENDED CLAIMS
[received by the International bureau on 14 July 1997 (14.07.97); original claims 1-18 replaced by new claims 1-20 (4 pages)]
1. A method of viewing an incoming facsimile transmission on a viewscreen of an information device comprising the steps of: processing on a computer system, said computer system located remotely from and having more computing than said information device, said facsimile transmission into a transmittal data file containing a set of objects and rendering information for displaying the set of objects; constructing and displaying a simplified version of the facsimile transmission on the viewscreen of said information device, said simplified version matching said set of objects and rendering information.
2. A method according to claim 1 further comprising the step of transferring the facsimile transmission to said computer system to perform said processing step.
3. A method according to claim 1 wherein the rendering information for displaying the objects contains defining, positioning and scaling information.
4. A method according claim 1 wherein the step of constructing and displaying includes the step of rendering the set of objects into graphical and textual elements.
5. A method according to claim 5 wherein the graphical elements includes lines and polygons.
6. A method according to claim 5 wherein the step of constructing and displaying includes the steps of positioning and scaling the rendered graphical and textual elements to fit on the viewscreen said information device.
7. A method according to claim 19 wherein the step of receiving the transmittal data file includes the steps of compressing the transmittal data file prior to transmitting the transmittal data file to said information device, and further includes decompressing the transmittal data file after forwarding to said information device.
8. A method according to claim 1 wherein the step of processing the facsimile transmission comprises the steps of: utilizing an optical character recognition algorithm to filter out recognizable text from the facsimile transmission; and utilizing an edge-fitting algorithm linearly fitting any images of the facsimile transmission that have not been filtered out by the optical character recognition algorithm.
9. A method according to claim 1 further comprising the step of storing the transmittal data file and the facsimile transmission on the computer system for later use.
10. A method according to claim 1 wherein the step of processing the facsimile transmission on said computer system includes scaling the set objects, using said computer system, to fit on the viewscreen of said information device.
>
11. A system for viewing a facsimile transmission on a viewscreen of a information device, said system comprising: computer system for intercepting said facsimile transmission and for decomposing the facsimile transmission into a transmittal data file containing a set of objects and rendering information, said computer system transmitting the transmittal data file to information device via a switching means, said information device having less computing capability than said computer system; and reconstruction means coupled within said information device for displaying a simplified version of said facsimile transmission on said viewscreen of information device, said simplified version set of objects and rendering information contained in said transmittal data file.
12. A system according to claim 12 further comprising a sending means.
13. A system according to claim 12 further comprsing a routing means.
14. A system according to claim 12 wherein said information device is a Personal Digital Assistant having a viewscreen.
15. A system according to claim 12 wherein said computer system is at a remote location from said information device.
16. A system according to claim 12 wherein said computer system stores the facsimile transmission and transmittal data file for later use.
17. The method according to claim 2 wherein said transferring step comprises the steps of: intercepting the incoming facsimile transmission at a router; forwarding the incoming facsimile transmission using the router to said computer system for processing; and receiving the facsimile transmission at a communications port of said computer system.
18. A system according to claim 13 wherein said sending means includes a facsimile machine.
19. A system according to claim 14 wherein said routing means includes a public switched telephone network for accessing a phone number corresponding to said computer system and then routing the facsimile transmission to said computer system.
20. A system for viewing a facsimile transmission on a viewscreen of a facsimile transmission receiving device, said system connected over a network having a router, said system comprising: a computer coupled to the network wherein said computer receives the facsimile transmission from the router and processes the facsimile transmission into a transmittal data file containing a set of objects and rendering information; and a personal digital assistant having a viewscreen, wherein said personal digital assistant receives the transmittal data file and reconstitutes an image of the fax onto the viewscreen by rendering the set of objects using the rendering information from the transmittal data file.
PCT/US1997/001706 1996-02-27 1997-02-11 Method for enhancing usability of fax on small devices WO1997032433A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU21163/97A AU2116397A (en) 1996-02-27 1997-02-11 Method for enhancing usability of fax on small devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60673496A 1996-02-27 1996-02-27
US08/606,734 1996-02-27

Publications (1)

Publication Number Publication Date
WO1997032433A1 true WO1997032433A1 (en) 1997-09-04

Family

ID=24429237

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1997/001706 WO1997032433A1 (en) 1996-02-27 1997-02-11 Method for enhancing usability of fax on small devices

Country Status (3)

Country Link
AU (1) AU2116397A (en)
TW (1) TW399387B (en)
WO (1) WO1997032433A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1191783A3 (en) * 2000-09-22 2004-05-19 Seiko Epson Corporation Image processing system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4180798A (en) * 1977-02-09 1979-12-25 Nippon Telegraph & Telephone Public Corporation Character recognition and communication system
US5182656A (en) * 1989-08-04 1993-01-26 International Business Machines Corporation Method for compressing and decompressing forms by means of very large symbol matching
US5231663A (en) * 1991-03-18 1993-07-27 Earl Joseph G Image processing system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4180798A (en) * 1977-02-09 1979-12-25 Nippon Telegraph & Telephone Public Corporation Character recognition and communication system
US5182656A (en) * 1989-08-04 1993-01-26 International Business Machines Corporation Method for compressing and decompressing forms by means of very large symbol matching
US5231663A (en) * 1991-03-18 1993-07-27 Earl Joseph G Image processing system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1191783A3 (en) * 2000-09-22 2004-05-19 Seiko Epson Corporation Image processing system

Also Published As

Publication number Publication date
AU2116397A (en) 1997-09-16
TW399387B (en) 2000-07-21

Similar Documents

Publication Publication Date Title
US6072598A (en) Method for enhancing usability of fax on small device
EP0511467B1 (en) Apparatus and method of operation for a facsimile subsystem in an image archiving system
US7203739B2 (en) Terminal device for controlling transmission size of documents with capability of receiving device
US6288799B1 (en) Image communicating apparatus
US7639388B2 (en) Image processing apparatus, image reproduction apparatus, system, method and storage medium for image processing and image reproduction
CN100477672C (en) Electronic equipment
JP2007089136A (en) Image processing method, image processing program, recording medium, and composite device
JP2002125090A (en) Communication equipment and communication method and storage medium and its program
JPH07105892B2 (en) Data communication device
EP0864222A1 (en) Downloading image graphics with accelerated text character and line art creation
US7466456B2 (en) Apparatus for transmitting read data
JP2007199983A (en) Document file browsing system, document file browsing method and document browsing program
US20020052974A1 (en) Data processing apparatus for generating reduced images of transmission images or reduced data of transmission data in list form and control method thereof
US20070130526A1 (en) Storing and recalling groups of electronic mail addresses on user interfaces of multifunction devices
JP5153277B2 (en) Image processing apparatus, image processing method, and image processing program
WO1997032433A1 (en) Method for enhancing usability of fax on small devices
JP3384139B2 (en) Image input device
GB2417590A (en) Page composition
JPH05266247A (en) Picture data processing system
WO2000055739A1 (en) Method of transmitting e-mail using two-dimensional code, and e-mail transmission system
JPH11184767A (en) Equipment and method for transmitting image data for facsimile equipment
JP2000151890A (en) Facsimile terminal
JPH118728A (en) Original reader and original read system
JP2001028654A (en) Communication device, its method and storage medium
JPS6261168A (en) Image information retrieval network system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AT AU AZ BA BB BG BR BY CA CH CN CU CZ CZ DE DE DK DK EE EE ES FI FI GB GE HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SK TJ TM TR TT UA UG US UZ VN YU AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE LS MW SD SZ UG AT BE CH DE DK ES FI FR GB GR IE IT LU

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 97530953

Format of ref document f/p: F

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase