US20020152236A1 - Method and system for generating hyperlinked physical copies of hyperlinked electronic documents - Google Patents

Method and system for generating hyperlinked physical copies of hyperlinked electronic documents Download PDF

Info

Publication number
US20020152236A1
US20020152236A1 US10/028,218 US2821801A US2002152236A1 US 20020152236 A1 US20020152236 A1 US 20020152236A1 US 2821801 A US2821801 A US 2821801A US 2002152236 A1 US2002152236 A1 US 2002152236A1
Authority
US
United States
Prior art keywords
page
physical
hyperlink
hyperlinked
item
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US10/028,218
Other versions
US6940491B2 (en
Inventor
Fernando Incertis-Carro
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyndryl Inc
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION reassignment INTERNATIONAL BUSINESS MACHINES CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CARRO, FERNANDO INCERTIS
Publication of US20020152236A1 publication Critical patent/US20020152236A1/en
Application granted granted Critical
Publication of US6940491B2 publication Critical patent/US6940491B2/en
Assigned to KYNDRYL, INC. reassignment KYNDRYL, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTERNATIONAL BUSINESS MACHINES CORPORATION
Adjusted expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9558Details of hyperlinks; Management of linked annotations

Definitions

  • the present invention relates to interactive hypermedia systems, electronic publishing and “print-on-demand” systems, and more particularly to a method and system for generating, from an electronic document comprising a plurality of hyperlinks to multimedia information or services, a physical document copy of the electronic document, and a look-up table comprising, for all hyperlinks present in the electronic document, corresponding physical coordinates (i.e., page number and physical page coordinates) in the physical copy.
  • the Internet is a global network of computers and computers networks (the “Net”).
  • the Internet connects computers that use a variety of different operating systems or languages, including UNIX, DOS, Windows, Macintosh, and others.
  • TCP/IP Transmission Control Protocol/Internet Protocol
  • TCP/IP protocol supports three basic applications on the Internet:
  • TCP Transmission Control Protocol
  • IP Internet Protocol
  • TCP/IP Internet Protocol Suite
  • the more common term TCP/IP is used to refer to the entire protocol suite.
  • the first design goal of TCP/IP is to build an interconnection of networks that provide universal communication services: an internetwork, or Internet.
  • Each physical network has its own technology dependent communication interface, in the form of a programming interface that provides basic communication functions running between the physical network and the user applications.
  • the architecture of the physical networks is hidden from the user.
  • the second goal of TCP/IP is to interconnect different physical networks to form what appears to the user to be one large network.
  • TCP is a transport layer protocol providing end to end data transfer. It is responsible for providing a reliable exchange of information between 2 computer systems. Multiple applications can be supported simultaneously over one TCP connection between two computer systems.
  • IP is an internetwork layer protocol hiding the physical network architecture bellow it. Part of the communicating messages between computers is a routing function that ensures that messages will be correctly directed within the network to be delivered to their destination. IP provides this routing function. An IP message is called an IP Datagram.
  • Application Level protocols are used on top of TCP/IP to transfer user and application data from one origin computer system to one destination computer system.
  • Such Application Level protocols are for instance File Transfer Protocol (FTP), Telnet, Gopher, Hyper Text Transfer Protocol (HTTP).
  • FTP File Transfer Protocol
  • Telnet Telnet
  • Gopher Gopher
  • Hyper Text Transfer Protocol HTTP
  • a “Router” is a computer that interconnects two networks and forwards messages from one network to the other. Routers are able to select the best transmission path between networks.
  • the basic routing function is implemented in the IP layer of the TCP/IP protocol stack, so any host (or computer) or workstation running TCP/IP over more than one interface could, in theory, forward messages between networks. Because IP implements the basic routing functions, the term “IP Router” is often used. However, dedicated network hardware devices called “Routers” can provide more sophisticated routing functions than the minimum functions implemented in IP.
  • GUI graphical user interface
  • the Web uses hypertext and hypermedia.
  • Hypertext is a subset of hypermedia and refers to computer-based “documents” in which readers move from one place to another in a document, or to another document, in a non-linear manner.
  • the Web uses a client-server architecture.
  • the Web servers enable the user to access hypertext and hypermedia information through the Web and the user's computer. (The user's computer is referred to as a client computer of the Web Server computers.)
  • the clients send requests to the Web Servers, which react, search and respond.
  • the Web allows client application software to request and receive hypermedia documents (including formatted text, audio, video and graphics) with hypertext link capabilities to other hypermedia documents, from a Web file server.
  • the Web can be viewed as a collection of document files residing on Web host computers that are interconnected by hyperlinks using networking protocols, forming a virtual “web” that spans the Internet.
  • a resource of the Internet is unambiguously identified by a Uniform Resource Locator (URL), which is a pointer to a particular resource at a particular location.
  • a URL specifies the protocol used to access a server (e.g. HTTP, FTP, . . . ), the name of the server, and the location of a file on that server.
  • every “device” i.e., PC workstation, HTTP Server, File Server, etc.
  • IP address is presently a 32 bit binary address, which is fine for computers to read, but is cumbersome for a human user to memorize or use. To make them more “user-friendly”, symbolic names are assigned to IP addresses.
  • the mapping between IP addresses and symbolic names, for example myhost.ibm.com is done by a “Domain Name Server”.
  • Each Web page that appears on client monitors of the Web may appear as a complex document that integrates, for example, text, images, sounds and animation.
  • Each such page may also contain hyperlinks to other Web documents so that a user at a client computer using a mouse may click on icons and may activate hyperlink jumps to a new page (which is a graphical representation of another document file) on the same or a different Web server.
  • a Web server is a software program on a Web host computer that answers requests from Web clients, typically over the Internet. All Web servers use a language or protocol to communicate with Web clients which is called Hyper Text Transfer Protocol (“HTTP”). All types of data can be exchanged among Web servers and clients using this protocol, including Hyper Text Markup Language (“HTML”), graphics, sound and video. HTML describes the layout, contents and hyperlinks of the documents and pages. Web clients when browsing:
  • the response from the server can be the requested document or an error message.
  • First version of HTTP is a stateless protocol. That is, with HTTP there is no continuous connection between each client and each server. The Web client using HTTP receives a response as HTML data or other data. This description applies to version 1.0 of HTTP protocol, while the new version 1.1 breaks this barrier of stateless protocol by keeping the connection between the server and client alive under certain conditions.
  • the Web client formats and presents the data received from the Web server for example by activating an ancillary application such as a sound player.
  • the Web Client is also referred to as the Web browser, since it in fact browses documents retrieved from the Web Server.
  • Web browsers are used by the Internet user to convert information received into a format that can be displayed by the Web browser on the video screen (or through the audio speakers) of the user workstation.
  • the Web browser is thus an application program that runs on the user workstation and that acts as a translator of HTML information.
  • Several different commercial Web browsers are available including, for example, the Netscape Communicator browser.
  • the Web browser is also used to recognize clicks on the screen made by a user with the pointing device of his workstation.
  • the Web browser When the user clicks with his pointing device on a portion of the screen associated with a hypertext link, the Web browser recognizes the user's action as a request to get a file from a Web site identified by an URL.
  • the Web server delivers the data to the Web browser, which translates it into a format that can be presented to the user.
  • the information returned from the Web server cannot be processed by the particular Web browser used in the user workstation.
  • This occurs for example, when video data is returned to a Web browser that does not have the appropriate application software to display the video on the user workstation.
  • the Web browser enlists a specific application resident on the Web client to display the incoming data. For example, when the Web browser receives video data from the Internet, it frequently opens a viewer, which appears as a window on the screen of the Web client. This viewer will process the incoming video data through the Web browser and will display the video on the user's screen.
  • the Web browser knows which viewer is required for a particular file based on an extension (Multipurpose Internet Mail Extension (MIME)) attached to the file name.
  • MIME Multipurpose Internet Mail Extension
  • hyperlinks can be assigned to textual information or to pictures.
  • a hypertext link may appear as a picture, or as a word or sentence, possibly underlined or otherwise accentuated to indicate that it is an embedded link and not just normal, informative text.
  • FIG. 1 shows a conventional method for activating hyperlinks present in an electronic document.
  • the Web browser When the user clicks on an hyperlink, the Web browser records the position of the pointer. The Web browser then refers to a look-up table to identify the URL address assigned to the position of the pointer.
  • the Web browser program requests a connection to the Web server hosting the file, and also requests from the Web server the file identified by the URL. Once the Web server accepts the connection requested by the Web browser, the Web server transmits back to the Web browser the requested file. Once the requested file is received, the Web browser delivers or presents the content of the file to the requesting user.
  • the Internet page comprises linked locations or “hot spots,” located at (X, Y) coordinates on the page.
  • the Web browser detects the click of a pointing device over a “hotspot, it identifies the associated URL and sends the filename portion of the URL to the Web server located at the domain name portion of the URL.
  • a picture may further be flagged as having a “map” associated with it. If it does, the relative coordinates of the click within the picture are sent to the Web server as well. The Web server then determines which page to return, based on the location of the click.
  • paper is easy to read, mark, and manipulate
  • paper is portable, familiar and can be easily distributed.
  • a book represents a fundamentally different entity than a computer screen in that it is a physical embodiment of a large number of simultaneous high-resolution displays. When we turn the page, we do not lose the previous page.
  • the brain has developed a highly sophisticated spatial map. Persons familiar with a manual or textbook can find information that they are seeking with high specificity, as evidenced by their ability to remember whether something that was seen only briefly was on the right side or left side of a page, for instance.
  • their haptic connection with the brain's spatial map comprises a highly natural and effective interface, when such information is embodied on actual multiple physical pages.
  • Another aspect of embodying information on multiple, simultaneous pages is that of serendipity and comparison.
  • Paper continues to be the information display system the most used. Among all other display systems, paper is portable, available everywhere, can be easily used and manipulated and provides the highest resolution. The accumulation of documents from meetings, mail, paper-based creative and planning work is a common experience. Moreover, because a paper document is more usable than a computer screen for displaying information, it is obvious that a large portion of the paper accumulation results from the print of electronic documents. Most people perform their daily work (such as reading, revisions, additions, meetings, projects, presentations, annotations) on paper and use printed copies of original electronic documents.
  • Print-on-demand is in fact a new printing technology, and also a new form of information distribution that makes possible the production of very low print runs. It is a production system where just the required number of copies is printed. Unlike so-called “short-run” printing, defined as traditional book printing in small batches (50-100) for very limited stockholding, print-on-demand enables the printing of a single book in response to a particular customer order. That means that on-demand titles never goes into stock. The ultimate step in print-on-demand is the production of one copy at a time. This technology dramatically reduces the storage of hard copies and thus reduces the inventories, the distribution costs and the expense for recycling or destroying unused copies.
  • Print-on-demand requires the application of so-called “digital printing”, which is a computer-to-print method producing electronically black and white or multicolored printed products directly from an information system using a digitally controlled printing system.
  • hypertext e.g. an e-book with hyperlinks from different items—words, pictures, foot notes, symbols, icons—to multimedia information or services
  • hypertext e.g. an e-book with hyperlinks from different items—words, pictures, foot notes, symbols, icons—to multimedia information or services
  • attachements e.g., an e-mail with several files attached, anchored by file icons or “hotspots” on the same note
  • the present invention discloses a method and a system for automatically generating an hyperlink table, from an electronic document comprising hyperlinks, for identifying, locating and activating these hyperlinks from a physical copy of this electronic document.
  • the method for use in a user system, comprises the steps of:
  • FIG. 1 shows the conventional method for accessing hypermedia information or services directly from an hyperlinked electronic document (e.g., by activating a hyperlink on a Web page).
  • FIG. 2 is a general view of the system and method for generating, from an hyperlinked electronic document, a physical copy and an associated hyperlink table according to the present invention.
  • FIG. 3 shows the system and method for selecting and accessing hypermedia information or services from a physical document.
  • FIG. 4 shows the method for translating the position (coordinates Xe,Ye) of an hyperlink on an electronic document into a position (page number and coordinates Xp,Yp)) on a physical copy of said electronic document according to the present invention.
  • FIG. 5 shows an example of hyperlink table automatically generated from an electronic document according to the present invention.
  • FIG. 6 shows how the different components of the invention interact for activating an hyperlink from the physical copy of the electronic document.
  • FIG. 7 shows the internal structure of an opto-touch foil as used in the present invention.
  • FIG. 8 is a flow chart of the method for automatically generating an hyperlink table associated with the physical copy of an electronic document according to the present invention.
  • FIG. 9 is a flow chart of the method for activating hyperlinks from a physical copy of an electronic document according to the present invention.
  • FIG. 10 shows a physical copy of an electronic document and its associated hyperlink table according to the present invention.
  • Non-published European patent application FR9-2000-0022 (European Application n° 00480037.1) entitled “ Method and System for Accessing Interactive Multimedia Information or Services by Touching Highlighted Items on Physical Documents ”, by Fernando INCERTIS CARRO, discloses a method and system for creating hyperlinks from selected items (e.g., words, pictures, foot notes, symbols, icons) on hard-copy documents to locally or remotely accessible servers, for highlighting by means of a light emitting source the position of each selected item, and for activating anyone of said hyperlinks simply by touching the hard-copy document over said highlighted items.
  • the system according to the referenced invention comprises:
  • a physical document e.g., a book
  • a physical document comprising one or a plurality of pages.
  • a user workstation (preferably connected to a communication network) for accessing and displaying multimedia information and services.
  • the physical document ( 303 ) can be of any kind, for example, a newspaper, a geographic map, a novel book, a text book, a technical book, a commercial catalog or even any other type of engraved, written, or printed surface (e.g., a painting in a museum of art).
  • the material of the document can be paper, plastic, wood or any other material.
  • the opto-touch foil is built by stacking a transparent resistive or capacitive film, of the type commonly used to manufacture touch screens over a transparent organic light emitting device film (TOLED film).
  • FIG. 7 shows the cross section of an opto-touch foil ( 700 ) comprising:
  • a transparent resistive or capacitive touch foil ( 701 ), of the type used commonly to manufacture touch screens.
  • the generated signal is generally proportional to the coordinates of the point that is pressed or touched ( 703 ),
  • a transparent light emitting foil ( 702 ), which is a transparent, bright, self-emitting display that can emit light ( 704 ) from either one or both surfaces.
  • FIG. 7 represents an opto-touch foil placed and aligned over a physical document ( 705 ) comprising a plurality of items ( 706 ) (i.e., words, pictures, icons, etc.) printed (or written, painted, engraved . . . ) on its surface.
  • touch foil technology it would be possible to use, is the TouchTek4 (4-wire Analog Resistive Touchscreens) of MICRO TOUCH company (TouchTekTM is a trademark of the MICRO TOUCH Company).
  • TouchTeck4 technology is fully described in the Web site of MICRO TOUCH Company at
  • the light emitting foil may be made of an array of TOLED's (Transparent Organic Light Emitting Devices), of the type used today to create vision area displays on windshields, cockpits, helmets and eyeglasses.
  • TOLED displays which can be up to 85% transparent when not energized are today manufactured with standard silicon semiconductors.
  • One example of light emitting foil technology it would be possible to use is the technology used for the TOLEDs manufactured by UNIVERSAL DISPLAY CORPORATION. The TOLED technology is fully described in the Web site of UNIVERSAL DISPLAY CORPORATION at
  • the user workstation ( 300 ) is used to access information and/or services stored locally or located on one or a plurality of servers ( 306 ) connected to the network ( 305 ).
  • the user workstation may be, for example, an Internet appliance, a multimedia Personal Computer (PC), a set-top box, a TV monitor, a game console . . . .
  • the opto-touch foil may communicate with the user workstation by means of a cable, a wire pair, an infrared link, or a wireless radio link.
  • the user When the user goes to a new portion of a document ( 303 ) (a new page of a book for example), he places the opto-touch foil ( 304 ) over (or under) the selected portion and enters in the workstation the reference of this portion (the page number for instance).
  • the page number can be entered simply by touching some buttons marked on the top (or bottom) of the opto-touch foil.
  • the page number may be also entered directly by means of the keyboard, the mouse or the touch screen of the user workstation or by any other means such as a bar code reader . . . .
  • the hyperlinked items (items that can be selected to access information on a server) on this page are then automatically illuminated and highlighted on the surface of the document by the light emitting foil.
  • This light emitting foil operates under the control of the user workstation ( 300 ). This illumination and highlighting allows the localization and identification of all hyperlinked items on the page selected by the user.
  • Illuminated items are selected by pressing the opto-touch foil.
  • the user workstation ( 300 ) receives from the opto-touch foil ( 304 ) a signal indicating the position of this selected item on the physical document ( 303 ).
  • the user workstation identifies and locates referring to a hyperlink table ( 308 ) the information and/or the service associated with the position of the selected item ( 307 ). If the information and/or service is located in a remote server ( 306 ), a request is sent to this server. If the information and/or the service is stored in the user workstation ( 300 ), then this information and/or service is accessed locally.
  • the user workstation ( 600 ) is connected to the Internet network ( 601 ).
  • the user workstation comprises a user interface ( 602 ) including a Web Browser ( 603 ) (also called “Web Client”) to access the World-Wide-Web (WWW).
  • a Web Browser 603
  • Web Client World-Wide-Web
  • the position of the illuminated item selected on the opto-touch foil identifies the Web server ( 604 ) and the Web pages the user wants to retrieve and display.
  • the Web Browser program ( 603 ) sends a HTTP request ( 610 ) to the identified Web Server ( 604 ).
  • the response ( 611 ) to the request (HTTP response) is sent by the Web Server ( 604 ) in the reverse direction to the Web Browser ( 603 ).
  • the HTTP response comprises the requested Web pages associated with the selected illuminated item.
  • the foregoing referenced invention also discloses a manual method of creating hyperlinks, by touching hyperlinked items on a physical document.
  • the method comprises the steps of:
  • the physical document is an hard-copy of an original hyperlinked electronic document
  • An object of the present invention is to automatically generate an hyperlinked hard-copy of any hyperlinked electronic document.
  • the user receives an electronic document like, for example, a “e-book” (i.e., an electronic book) entitled “Early British Kingdoms” in AdobeTM Portable Document Format (PDF).
  • e-book i.e., an electronic book entitled “Early British Kingdoms” in AdobeTM Portable Document Format (PDF).
  • PDF AdobeTM Portable Document Format
  • An Adobe PDF file offers an exact representation of a printed document.
  • Adobe PDF files can also be directly generated from HTML files, from documents created with Lotus Word Pro, Microsoft Office, or virtually from any electronic file. With the Adobe PDF creation process, links and bookmarks from table of contents, index, or any cross-references can be automatically generated. Once created, Adobe PDF files can be distributed digitally, exactly as intended. It is important to note that it is possible to create with Adobe Acrobat, PDF hyperlinked documents. Article entitled “Create a Web Link”, Adobe Tips & Techniques, which can be found on the Web site:
  • [0127] describes the technique for creating Web hyperlinks with Adobe Acrobat 4.0 PDF documents.
  • Adobe PDF files can be linked to any URL, whether this URL is a path to a local file or a Web site.
  • URLs can be added to PDF documents by importing them from a file or a Web site.
  • the hyperlink information i.e., hyperlink sources, hyperlink names and destination URLs ) of a PDF file is stored in the “Hyperlinks palette” of the file.
  • FIG. 8 shows a preferred embodiment of the invention.
  • the method for generating (or creating) an hyperlink table ( 201 ) from an electronic document ( 203 ) comprising one or a plurality of hyperlinks, for associating said hyperlink table to a physical copy ( 202 ) of this electronic document, and for selecting and accessing information or services ( 301 ) simply by touching over this physical copy ( 303 ) the positions corresponding to the hyperlinked items ( 302 ) of the electronic document ( 203 ), comprises the steps of:
  • the user assigns a reference number (e.g., 387 ) for identifying the physical copy of the electronic document and the hyperlink table associated with this physical copy.
  • a document can be uniquely identified by the combination of the seller ID and the document ID.
  • Standards like “ Digital Object Identifiers ” (DOI) that can be used for generating documents IDs. More information on DOI can be found on:
  • the reference number can be automatically assigned by the user workstation from a list of stored reference numbers.
  • This hyperlink table comprises the reference number of the physical copy
  • the user optionally stores in the header of this hyperlink table other relevant information related to the electronic document such as title, author, ISBN (International Standard Book Number), date of creation, etc . . . .
  • the hyperlink table may be stored within the user workstation or may be stored in an external memory accessible from the user workstation.
  • the information related to hyperlinks (such as hyperlink name or description, type of service, destination URL . . . ) comprised in the data structure associated with the electronic document is identified and copied in the hyperlink table of the physical copy;
  • the list of hyperlinked items and hyperlinks destination addresses (e.g., URLs) of the PDF file of the e-book entitled “Early British Kingdoms” shown in FIG. 2 is copied from the “ Hyperlinks palette ” of the PDF file to the hyperlink table by means API techniques described by Adobe in document entitled “ Adobe Solutions Network: Developer Program ” that can be accessed on the Web site:
  • the information or service associated with the hyperlinked item may be stored locally in the user workstation.
  • an identification of the information or service local address, file name, exec name . . . ) within the user workstation must be stored in the hyperlink table.
  • This step is optional if the dimensions of the electronic document, as shown on the user workstation screen are identical to the dimensions the printed document. This is the case for files edited with modern word processors, like Lotus Word Pro, MS Word or Adobe Acrobat.
  • the dimensions of the displayed document and the dimensions of the printed document are different (i.e., if the vertical or horizontal dimensions are reduced or magnified), then the horizontal (X) and vertical (Y) dimensions (e.g., in millimeters) of the printed document must be specified.
  • the object of this step is to compute two scale factors (for axis X and Y) for transforming the coordinates (Xe, Ye) of each hyperlinked item in the electronic document (e.g., coordinates of a point centered on the position of an hyperlinked item, word or picture) into “paper” coordinates.
  • the paper coordinates of a point located on a hard-copy document comprise two components:
  • a page number (optionally if the physical document comprises a plurality of pages);
  • the electronic coordinates of the hyperlinks comprised in the electronic document are translated into physical coordinates.
  • Electronic coordinates of hyperlinked items are retrieved from the electronic document.
  • the physical coordinates of an hyperlinked item correspond to the position of said hyperlinked item on the physical document.
  • the physical coordinates are preferably expressed as follows:
  • page number if the physical document comprises a plurality of pages
  • page co ordinates (Xp, Yp) (position of the hyperlinked item on the page corresponding to the page number).
  • the present method generates at the same time a physical copy of the original electronic document, and an hyperlink table. Both of them can be locally stored or transmitted over the network to other users or systems. Any hard-copy document in portable format (e.g., in PostScript, PDF, LWP, etc.) can be transmitted as a file ready to be printed by the end user.
  • Any hard-copy document in portable format e.g., in PostScript, PDF, LWP, etc.
  • Any hard-copy document in portable format e.g., in PostScript, PDF, LWP, etc.
  • an hyperlink table is associated with a physical (printed) copy of an electronic document (in the present example, the document is entitled “Early British Kingdoms”, (Doc: 387 ).
  • the hyperlink table ( 608 ) is loaded in the user workstation ( 600 ).
  • the method, described in FIG. 9, for locating, visualizing and highlighting hyperlinked items on the physical copy, and for accessing information and/or services directly from the hyperlinked items highlighted on the pages of the physical copy, comprises the steps of:
  • this hyperlink table comprising for each illuminated item of the selected page the identification of the requested information and/or service within the user workstation or within the network (preferably by means of a destination address);
  • the user By means of any user interface (keyboard, mouse, touch screen, . . . ) or any reading means (bar code reader . . . ), the user enters the reference number (identifier) of the physical document (e.g.: document 387 ) he wants to select.
  • the user enters the reference number of the physical document (e.g.: Doc: 387 ) by means of an array of pressure sensible “touch buttons” printed on the opto-touch foil. The user presses in the following order:
  • any user interface keyboard, mouse, touch screen . . .
  • any reading means bar code reader . . .
  • the user enters the page of the physical document (or the portion of the document) (e.g.: page 16 ) he wants to select.
  • the user enters the page number to select (e.g.: Pg. 116 ).
  • the opto-touch foil can be on any position (normally the opto-touch foil is placed over the page comprising the hyperlink to trigger). The user presses in the following order:
  • numerical touch buttons ( 613 ) corresponding to each digit of the page number (e.g., “1”, “1” and “6”) to select.
  • This procedure gives access to the selected page (e.g., Pg. 116 ) within the hyperlink table associated with the selected document (e.g., Doc: 387 ).
  • the opto-touch foil ( 605 ) receives the information sent by the user workstation ( 600 ). This information comprises the position (coordinates Xp and Yp) of each hyperlinked item defined on the selected page.
  • the opto-touch foil decodes this information and visualizes (highlights or illumines) the position of each of the hyperlinked items ( 607 ).
  • the opto-touch foil ( 605 ) generates one or a plurality of light spots ( 607 ) signaling that one or more hyperlinks have been defined for this page. Then, the opto-touch foil is:
  • the opto-touch foil is placed and aligned over the selected page.
  • the position of the light spots ( 607 ) emitted by the opto-touch foil corresponds to the position of the hyperlinked items defined for this page.
  • the hyperlinked items appear through the transparent opto-touch foil and are identified by the user thanks to the light spots emitted by the opto-touch foil.
  • the user selects an (hyperlinked) item (“Avalon”) on the page by pressing (e.g., by means of his fingertip) the opto-touch foil on the illuminated point ( 609 ) corresponding to the selected item.
  • a signal is sent to the user workstation ( 600 ) to identify the selected item.
  • This signal indicates the position on the page of the point that has been pressed by the user on the opto-touch foil.
  • the generated signal is generally proportional to the coordinates (Xp/Yp) of the point that has been pressed.
  • the illuminated item selected on the opto-touch foil ( 605 ) by the user is identified thanks to the hyperlink table.
  • the hyperlink table comprises an indication of the coordinates Xp and Yp ( 501 ) of each illuminated item ( 504 ) on each page ( 502 ) of the physical document.
  • the hyperlink table comprises for each hyperlinked (illuminated) item ( 504 ) of each page ( 502 ) of the physical document the location within the network of the requested information and/or service ( 503 ).
  • the information and/or service may be located by means of a destination address.
  • Web pages in Web Servers are identified by an URL (Uniform resource Locator).
  • URL Uniform resource Locator
  • the user workstation Web activates the hyperlink (destination address, URL, . . . ) associated in the hyperlink table, with the identified selected hyperlinked item.
  • a simple pressure near the illuminated item “Avalon” automatically activates the following hyperlink on the Web:
  • the information comprised at the selected destination address (URL) can be displayed ( 301 ) on the user workstation ( 300 ). Additional information (e.g., document number, page number, hyperlinked item, physical coordinates on the foil and URL) related to the hyperlinked (illuminated) item selected by the user can be shown on the Web Browser along with the information retrieved from the Web Server.
  • Additional information e.g., document number, page number, hyperlinked item, physical coordinates on the foil and URL
  • the hyperlinked physical documents according to the present invention can be generated from electronic documents like, for example, technical manuals with illustrations and flowcharts in Microsoft Word, the latest novels and biographies created by Adobe PageMaker, financial business analyses created in QuarkXpress, electronic dictionaries, encyclopedias, or even information published from an office application, like Lotus SmartSuite or information captured from the Web.

Abstract

The present invention discloses a method and a system for automatically generating an hyperlink table from an electronic document comprising hyperlinks, for identifying, locating and activating these hyperlinks from a physical copy of this electronic document. The method, for use in a user system, comprises the steps of:
selecting an electronic document;
creating an hyperlink table;
associating said hyperlink table with a physical copy of said electronic document, said physical copy comprising one or a plurality of pages;
for each page of the physical copy:
identifying in the electronic document, the one or plurality of hyperlink items comprised in the page;
storing in the hyperlink table an identification of each identified hyperlink item;
retrieving from the electronic document identification and location of information and/or service associated with each identified hyperlink item on the page;
storing in the hyperlink table said identification and location of information and/or service associated with each identified hyperlink item;
retrieving from the electronic document, electronic coordinates of each identified hyperlinked item on the page;
translating said electronic coordinates into physical coordinates on the page of the physical copy;
storing said physical coordinates in the hyperlink table.

Description

    FIELD OF THE INVENTION
  • The present invention relates to interactive hypermedia systems, electronic publishing and “print-on-demand” systems, and more particularly to a method and system for generating, from an electronic document comprising a plurality of hyperlinks to multimedia information or services, a physical document copy of the electronic document, and a look-up table comprising, for all hyperlinks present in the electronic document, corresponding physical coordinates (i.e., page number and physical page coordinates) in the physical copy. [0001]
  • BACKGROUND OF THE INVENTION
  • Internet [0002]
  • The Internet is a global network of computers and computers networks (the “Net”). The Internet connects computers that use a variety of different operating systems or languages, including UNIX, DOS, Windows, Macintosh, and others. To facilitate and allow the communication among these various systems and languages, the Internet uses a language referred to as TCP/IP (“Transmission Control Protocol/Internet Protocol”). TCP/IP protocol supports three basic applications on the Internet: [0003]
  • transmitting and receiving electronic mail, [0004]
  • logging into remote computers (the “Telnet”), and [0005]
  • transferring files and programs from one computer to another (“FTP” or “File Transfer Protocol”). [0006]
  • TCP/IP [0007]
  • The TCP/IP protocol suite is named for two of the most important protocols: [0008]
  • a Transmission Control Protocol (TCP), and [0009]
  • an Internet Protocol (IP). [0010]
  • Another name for it is the Internet Protocol Suite. The more common term TCP/IP is used to refer to the entire protocol suite. The first design goal of TCP/IP is to build an interconnection of networks that provide universal communication services: an internetwork, or Internet. Each physical network has its own technology dependent communication interface, in the form of a programming interface that provides basic communication functions running between the physical network and the user applications. The architecture of the physical networks is hidden from the user. The second goal of TCP/IP is to interconnect different physical networks to form what appears to the user to be one large network. [0011]
  • TCP is a transport layer protocol providing end to end data transfer. It is responsible for providing a reliable exchange of information between 2 computer systems. Multiple applications can be supported simultaneously over one TCP connection between two computer systems. [0012]
  • IP is an internetwork layer protocol hiding the physical network architecture bellow it. Part of the communicating messages between computers is a routing function that ensures that messages will be correctly directed within the network to be delivered to their destination. IP provides this routing function. An IP message is called an IP Datagram. [0013]
  • Application Level protocols are used on top of TCP/IP to transfer user and application data from one origin computer system to one destination computer system. Such Application Level protocols are for instance File Transfer Protocol (FTP), Telnet, Gopher, Hyper Text Transfer Protocol (HTTP). [0014]
  • IP Router [0015]
  • A “Router” is a computer that interconnects two networks and forwards messages from one network to the other. Routers are able to select the best transmission path between networks. The basic routing function is implemented in the IP layer of the TCP/IP protocol stack, so any host (or computer) or workstation running TCP/IP over more than one interface could, in theory, forward messages between networks. Because IP implements the basic routing functions, the term “IP Router” is often used. However, dedicated network hardware devices called “Routers” can provide more sophisticated routing functions than the minimum functions implemented in IP. [0016]
  • World Wide Web [0017]
  • With the increasing size and complexity of the Internet, tools have been developed to help find information on the network, often called navigators or navigation systems. Navigation systems that have been developed include standards such as Archie, Gopher and WAIS. The World Wide Web (“WWW” or “the Web”) is a recent superior navigation system. The Web is: [0018]
  • an Internet-based navigation system, [0019]
  • an information distribution and management system for the Internet, and [0020]
  • a dynamic format for communicating on the Web. [0021]
  • The Web seamlessly, for the use, integrates format of information, including still images, text, audio and video. A user on the Web using a graphical user interface (“GUI”, pronounced “gooey”) may transparently communicate with different host computers on the system, different system applications (including FTP and Telnet), and different information formats for files and documents including, for example, text, sound and graphics. [0022]
  • Hypermedia [0023]
  • The Web uses hypertext and hypermedia. Hypertext is a subset of hypermedia and refers to computer-based “documents” in which readers move from one place to another in a document, or to another document, in a non-linear manner. To do this, the Web uses a client-server architecture. The Web servers enable the user to access hypertext and hypermedia information through the Web and the user's computer. (The user's computer is referred to as a client computer of the Web Server computers.) The clients send requests to the Web Servers, which react, search and respond. The Web allows client application software to request and receive hypermedia documents (including formatted text, audio, video and graphics) with hypertext link capabilities to other hypermedia documents, from a Web file server. The Web, then, can be viewed as a collection of document files residing on Web host computers that are interconnected by hyperlinks using networking protocols, forming a virtual “web” that spans the Internet. [0024]
  • Uniform Resource Locators [0025]
  • A resource of the Internet is unambiguously identified by a Uniform Resource Locator (URL), which is a pointer to a particular resource at a particular location. A URL specifies the protocol used to access a server (e.g. HTTP, FTP, . . . ), the name of the server, and the location of a file on that server. To insure that data is sent to and received by the appropriate systems on the Internet, every “device” (i.e., PC workstation, HTTP Server, File Server, etc.) has a unique address, called IP address. The IP address is presently a 32 bit binary address, which is fine for computers to read, but is cumbersome for a human user to memorize or use. To make them more “user-friendly”, symbolic names are assigned to IP addresses. The mapping between IP addresses and symbolic names, for example myhost.ibm.com, is done by a “Domain Name Server”. [0026]
  • Hyper Text Transfer Protocol [0027]
  • Each Web page that appears on client monitors of the Web may appear as a complex document that integrates, for example, text, images, sounds and animation. Each such page may also contain hyperlinks to other Web documents so that a user at a client computer using a mouse may click on icons and may activate hyperlink jumps to a new page (which is a graphical representation of another document file) on the same or a different Web server. [0028]
  • Web Servers [0029]
  • A Web server is a software program on a Web host computer that answers requests from Web clients, typically over the Internet. All Web servers use a language or protocol to communicate with Web clients which is called Hyper Text Transfer Protocol (“HTTP”). All types of data can be exchanged among Web servers and clients using this protocol, including Hyper Text Markup Language (“HTML”), graphics, sound and video. HTML describes the layout, contents and hyperlinks of the documents and pages. Web clients when browsing: [0030]
  • convert user specified commands into HTTP GET requests, [0031]
  • connect to the appropriate Web server to get information, and [0032]
  • wait for a response. The response from the server can be the requested document or an error message. [0033]
  • After the document or an error message is returned, the connection between the Web client and the Web server is closed. [0034]
  • First version of HTTP is a stateless protocol. That is, with HTTP there is no continuous connection between each client and each server. The Web client using HTTP receives a response as HTML data or other data. This description applies to version 1.0 of HTTP protocol, while the new version 1.1 breaks this barrier of stateless protocol by keeping the connection between the server and client alive under certain conditions. [0035]
  • Web Browser [0036]
  • The Web client formats and presents the data received from the Web server for example by activating an ancillary application such as a sound player. The Web Client is also referred to as the Web browser, since it in fact browses documents retrieved from the Web Server. Web browsers are used by the Internet user to convert information received into a format that can be displayed by the Web browser on the video screen (or through the audio speakers) of the user workstation. The Web browser is thus an application program that runs on the user workstation and that acts as a translator of HTML information. Several different commercial Web browsers are available including, for example, the Netscape Communicator browser. The Web browser is also used to recognize clicks on the screen made by a user with the pointing device of his workstation. When the user clicks with his pointing device on a portion of the screen associated with a hypertext link, the Web browser recognizes the user's action as a request to get a file from a Web site identified by an URL. The Web server delivers the data to the Web browser, which translates it into a format that can be presented to the user. [0037]
  • Sometimes, the information returned from the Web server (and subsequently to the Web browser) cannot be processed by the particular Web browser used in the user workstation. This occurs, for example, when video data is returned to a Web browser that does not have the appropriate application software to display the video on the user workstation. In this case, the Web browser enlists a specific application resident on the Web client to display the incoming data. For example, when the Web browser receives video data from the Internet, it frequently opens a viewer, which appears as a window on the screen of the Web client. This viewer will process the incoming video data through the Web browser and will display the video on the user's screen. The Web browser knows which viewer is required for a particular file based on an extension (Multipurpose Internet Mail Extension (MIME)) attached to the file name. [0038]
  • Activating Hyperlinks [0039]
  • On an internet page, hyperlinks can be assigned to textual information or to pictures. A hypertext link may appear as a picture, or as a word or sentence, possibly underlined or otherwise accentuated to indicate that it is an embedded link and not just normal, informative text. [0040]
  • FIG. 1 shows a conventional method for activating hyperlinks present in an electronic document. When the user clicks on an hyperlink, the Web browser records the position of the pointer. The Web browser then refers to a look-up table to identify the URL address assigned to the position of the pointer. When clicked, the Web browser program requests a connection to the Web server hosting the file, and also requests from the Web server the file identified by the URL. Once the Web server accepts the connection requested by the Web browser, the Web server transmits back to the Web browser the requested file. Once the requested file is received, the Web browser delivers or presents the content of the file to the requesting user. [0041]
  • By placing and clicking the pointing device on the text or on a picture, the user selects a new internet page. In either case, text or picture, the Internet page comprises linked locations or “hot spots,” located at (X, Y) coordinates on the page. When the Web browser detects the click of a pointing device over a “hotspot, it identifies the associated URL and sends the filename portion of the URL to the Web server located at the domain name portion of the URL. A picture may further be flagged as having a “map” associated with it. If it does, the relative coordinates of the click within the picture are sent to the Web server as well. The Web server then determines which page to return, based on the location of the click. [0042]
  • User Interaction with Electronic and Physical Documents [0043]
  • During the last years, due mainly to the widespread use of personal computers and CD-ROMs and due to the universal access of millions of users to the World Wide Web, the “multimedia publishing” has veritably exploded. An enormous amount of multimedia and hypermedia information combining text, images and sounds, are now accessible to users of personal computers. [0044]
  • During many years, conventional electronic documents (e.g., e-books) were displayed on computer screens on a page-by-page format. The page-by-page presentation has made the on-line review of large electronic documents a slow and inefficient operation. To solve this problem, specific programs for reading softcopy book have been devised. For example, IBM BookManager (TM) or Adobe Acrobat (TM) programs have been specially designed to help users to manage, search and read books directly on the screen. [0045]
  • Also, when browsing a document on the Web, the problem with most conventional Web browsers is that, when a user selects and activates a hyperlink, a new page is loaded in the Web browser, and this new page completely replaces the previous page. The previous page is not displayed simultaneously with the new page, although the user can easily go back and forth between the two pages (the content of the pages is commonly cached), using the familiar browser commands “forward” and “backward”. However, the user often desires to see at the same time both the original page and the linked page, but this is not possible with conventional Web browsers unless doing complicated actions. For example, two different windows can be opened; some Web browsers allow multiple parent windows while others only allow multiple children windows. In either case, additional user actions are required. It may also be difficult to arrange the two windows on the screen so as to satisfactorily view the two pages. Even when a feature in a Web browser allows the simultaneous display of multiple fields or “frames” within a single window, this feature cannot be used to simultaneously display an original page and a linked page. All of the frames within the window collectively constitute a “page” or document, so when a hyperlink in any given frame within the window is selected, the original page is still replaced. [0046]
  • For the reasons discussed above and for many other technical or ergonomic reasons, it is a fact today that reading paper cannot be compared with reading an electronic media (e.g., an e-book by using a MS Reader). Even if the enthusiasm of the public for new computer-based multimedia services has been considered by many analysts as a threat to the conventional forms of hard-copied publishing, the experience shows that reading paper remains preferable for most people, whether they are familiar with computers or not. [0047]
  • For most people, paper has a number of advantages: [0048]
  • paper is easy to read, mark, and manipulate; [0049]
  • paper is portable, familiar and can be easily distributed. [0050]
  • In fact, people are very skilled at browsing through paper catalogs, magazines, newspapers, maps and books by flipping through the pages and glancing at pictures and text. A collection of printed color photographs can be much easily and quickly browsed than a sequence of computer screens. In publication entitled “The Last Book”, IBM Systems Journal, Vol 36, No. 3 Vol 36, No. 3-1997, by J. Jacobson, B. Comiskey, C. Turner, J. Albert, and P. Tsao of the MIT Media Laboratory, the authors compare printed books and computer screens in the following terms: [0051]
  • “A book represents a fundamentally different entity than a computer screen in that it is a physical embodiment of a large number of simultaneous high-resolution displays. When we turn the page, we do not lose the previous page. Through evolution the brain has developed a highly sophisticated spatial map. Persons familiar with a manual or textbook can find information that they are seeking with high specificity, as evidenced by their ability to remember whether something that was seen only briefly was on the right side or left side of a page, for instance. Furthermore their haptic connection with the brain's spatial map comprises a highly natural and effective interface, when such information is embodied on actual multiple physical pages. [0052]
  • Another aspect of embodying information on multiple, simultaneous pages is that of serendipity and comparison. We may leaf through a large volume of text and graphics, inserting a finger bookmark into those areas of greatest interest. Similarly, we may assemble a large body of similar matter in order to view elements in contrast to one another, such as might be done to determine which of a particular set of graphical designs is most satisfying”. [0053]
  • Notwithstanding the advances made in computer technology in the field of recording and processing data, the use of paper has not decreased. Paper continues to be the information display system the most used. Among all other display systems, paper is portable, available everywhere, can be easily used and manipulated and provides the highest resolution. The accumulation of documents from meetings, mail, paper-based creative and planning work is a common experience. Moreover, because a paper document is more usable than a computer screen for displaying information, it is obvious that a large portion of the paper accumulation results from the print of electronic documents. Most people perform their daily work (such as reading, revisions, additions, meetings, projects, presentations, annotations) on paper and use printed copies of original electronic documents. [0054]
  • As a conclusion, even if many electronic document systems (e.g., Web browsers, e-books readers) attempt to replace paper by providing new applications such as the access to multimedia information and services, however a lot of users today still work with paper. Many analysts admit that: “consumers will insist on printing most of their documents” (e.g., e-books, for reading, for browsing, for consulting). Moreover, a new publishing technology that has been named “Printing-on-demand” is contributing to keep alive this preference of people for printed information. [0055]
  • Print-on-demand is in fact a new printing technology, and also a new form of information distribution that makes possible the production of very low print runs. It is a production system where just the required number of copies is printed. Unlike so-called “short-run” printing, defined as traditional book printing in small batches (50-100) for very limited stockholding, print-on-demand enables the printing of a single book in response to a particular customer order. That means that on-demand titles never goes into stock. The ultimate step in print-on-demand is the production of one copy at a time. This technology dramatically reduces the storage of hard copies and thus reduces the inventories, the distribution costs and the expense for recycling or destroying unused copies. Moreover this technology enables on-demand reprinting, which means that titles no longer fall “out of print”. Print-on-demand requires the application of so-called “digital printing”, which is a computer-to-print method producing electronically black and white or multicolored printed products directly from an information system using a digitally controlled printing system. [0056]
  • The widespread use of Internet and mobile communications offer a lot of new opportunities to combine electronic and printed media, in other words to create “media-adaptive multimedia” products. The philosophy behind the concept of “media-adaptive multimedia” is that information must be transferred to users in a form adapted to their needs. In fact, traditionally printed documents, digitally printed documents and multimedia products must be complementary. The different components must be combined depending on the users needs. To facilitate this evolution, the “electronic content should be accessible directly from the printed medium”. [0057]
  • When an electronic document comprising: [0058]
  • hypertext (e.g. an e-book with hyperlinks from different items—words, pictures, foot notes, symbols, icons—to multimedia information or services), or [0059]
  • attachements (e.g., an e-mail with several files attached, anchored by file icons or “hotspots” on the same note), [0060]
  • is printed, the fundamental characteristic of this electronic document which consists in accessing multimedia services disappears. It becomes impossible to activate the hyperlinks comprised in the electronic document or to edit and view the attachments from the printed copy. Complementary means are required to identify the locations of the hyperlinks on the printed surface of the physical copy and to activate them directly. [0061]
  • Therefore, there is a real need to provide users with new systems and methods for improving physical copies of electronic (hyperlinked) documents, (e.g., e-books, Web pages, Lotus Notes, MS Word, Lotus WordPro or Adobe Portable Document Format (PDF)) and in particular for accessing from a physical copy information accessible from an original electronic document, said information comprising images, sounds and/or additional text. [0062]
  • None of the methods referenced in the prior art describes a system that would enable a user to automatically generate, from an electronic hyperlinked document, the information required to access to hypermedia information or services simply by touching with a fingertip a physical unmarked copy of the original electronic document, (for instance, to edit and view an attached file simply by touching the printed icon of the attachment on the printed copy of an IBM Lotus Notes note). [0063]
  • OBJECTS OF THE INVENTION
  • It is an object of the present invention to improve the current systems and methods of selecting and accessing electronic multimedia information or services. [0064]
  • It is another object of the present invention to select and to access from a physical copy the electronic multimedia information or services that can be accessed from the original electronic document. [0065]
  • It is another object of the present invention to select and access electronic multimedia information or services simply by touching a physical copy of an electronic document. [0066]
  • SUMMARY OF THE INVENTION
  • The present invention discloses a method and a system for automatically generating an hyperlink table, from an electronic document comprising hyperlinks, for identifying, locating and activating these hyperlinks from a physical copy of this electronic document. The method, for use in a user system, comprises the steps of: [0067]
  • selecting an electronic document; [0068]
  • creating an hyperlink table; [0069]
  • associating said hyperlink table with a physical copy of said electronic document, said physical copy comprising one or a plurality of pages; [0070]
  • for each page of the physical copy: [0071]
  • identifying in the electronic document, the one or plurality of hyperlink items comprised in the page; [0072]
  • storing in the hyperlink table an identification of each identified hyperlink item; [0073]
  • retrieving from the electronic document identification and location of information and/or service associated with each identified hyperlink item on the page; [0074]
  • storing in the hyperlink table said identification and location of information and/or service associated with each identified hyperlink item; [0075]
  • retrieving from the electronic document, electronic coordinates of each identified hyperlinked item on the page; [0076]
  • translating said electronic coordinates into physical coordinates on the page of the physical copy; [0077]
  • storing said physical coordinates in the hyperlink table. [0078]
  • The foregoing, together with other objects, features, and advantages of this invention can be better appreciated with reference to the following specification, claims and drawings.[0079]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The novel and inventive features believed characteristics of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objects and advantages thereof, will best be understood by reference to the following detailed description of an illustrative detailed embodiment when read in conjunction with the accompanying drawings, wherein [0080]
  • FIG. 1 shows the conventional method for accessing hypermedia information or services directly from an hyperlinked electronic document (e.g., by activating a hyperlink on a Web page). [0081]
  • FIG. 2 is a general view of the system and method for generating, from an hyperlinked electronic document, a physical copy and an associated hyperlink table according to the present invention. [0082]
  • FIG. 3 shows the system and method for selecting and accessing hypermedia information or services from a physical document. [0083]
  • FIG. 4 shows the method for translating the position (coordinates Xe,Ye) of an hyperlink on an electronic document into a position (page number and coordinates Xp,Yp)) on a physical copy of said electronic document according to the present invention. [0084]
  • FIG. 5 shows an example of hyperlink table automatically generated from an electronic document according to the present invention. [0085]
  • FIG. 6 shows how the different components of the invention interact for activating an hyperlink from the physical copy of the electronic document. [0086]
  • FIG. 7 shows the internal structure of an opto-touch foil as used in the present invention. [0087]
  • FIG. 8 is a flow chart of the method for automatically generating an hyperlink table associated with the physical copy of an electronic document according to the present invention. [0088]
  • FIG. 9 is a flow chart of the method for activating hyperlinks from a physical copy of an electronic document according to the present invention. [0089]
  • FIG. 10 shows a physical copy of an electronic document and its associated hyperlink table according to the present invention.[0090]
  • PREFERRED EMBODIMENT OF THE INVENTION
  • System for Selecting and Accessing Multimedia Information from Physical Documents [0091]
  • Non-published european patent application FR9-2000-0022 (European Application n° 00480037.1) entitled “[0092] Method and System for Accessing Interactive Multimedia Information or Services by Touching Highlighted Items on Physical Documents”, by Fernando INCERTIS CARRO, discloses a method and system for creating hyperlinks from selected items (e.g., words, pictures, foot notes, symbols, icons) on hard-copy documents to locally or remotely accessible servers, for highlighting by means of a light emitting source the position of each selected item, and for activating anyone of said hyperlinks simply by touching the hard-copy document over said highlighted items. As shown in FIG. 3, the system according to the referenced invention comprises:
  • ([0093] 303) A physical document (e.g., a book) comprising one or a plurality of pages.
  • ([0094] 304) An opto-touch foil connected to a user workstation. The opto-touch foil is to be placed over or under a page (or a portion) of the document.
  • ([0095] 300) A user workstation (preferably connected to a communication network) for accessing and displaying multimedia information and services.
  • Physical Document [0096]
  • The physical document ([0097] 303) can be of any kind, for example, a newspaper, a geographic map, a novel book, a text book, a technical book, a commercial catalog or even any other type of engraved, written, or printed surface (e.g., a painting in a museum of art). The material of the document can be paper, plastic, wood or any other material.
  • Opto-Touch Foil [0098]
  • In a preferred embodiment of the referenced patent application, the opto-touch foil is built by stacking a transparent resistive or capacitive film, of the type commonly used to manufacture touch screens over a transparent organic light emitting device film (TOLED film). FIG. 7 shows the cross section of an opto-touch foil ([0099] 700) comprising:
  • a transparent resistive or capacitive touch foil ([0100] 701), of the type used commonly to manufacture touch screens. The generated signal is generally proportional to the coordinates of the point that is pressed or touched (703),
  • a transparent light emitting foil ([0101] 702), which is a transparent, bright, self-emitting display that can emit light (704) from either one or both surfaces.
  • The combination of both foils (i.e., the touch foil stacked over the light emitting foil) forms an opto-touch foil ([0102] 700). FIG. 7 represents an opto-touch foil placed and aligned over a physical document (705) comprising a plurality of items (706) (i.e., words, pictures, icons, etc.) printed (or written, painted, engraved . . . ) on its surface. One example of touch foil technology it would be possible to use, is the TouchTek4 (4-wire Analog Resistive Touchscreens) of MICRO TOUCH company (TouchTek™ is a trademark of the MICRO TOUCH Company). The TouchTeck4 technology is fully described in the Web site of MICRO TOUCH Company at
  • http://www.microtouch. com/. [0103]
  • The light emitting foil may be made of an array of TOLED's (Transparent Organic Light Emitting Devices), of the type used today to create vision area displays on windshields, cockpits, helmets and eyeglasses. TOLED displays, which can be up to 85% transparent when not energized are today manufactured with standard silicon semiconductors. One example of light emitting foil technology it would be possible to use is the technology used for the TOLEDs manufactured by UNIVERSAL DISPLAY CORPORATION. The TOLED technology is fully described in the Web site of UNIVERSAL DISPLAY CORPORATION at [0104]
  • http://www.universaldi splay.com/toled.html. [0105]
  • User Workstation [0106]
  • The user workstation ([0107] 300) is used to access information and/or services stored locally or located on one or a plurality of servers (306) connected to the network (305). The user workstation may be, for example, an Internet appliance, a multimedia Personal Computer (PC), a set-top box, a TV monitor, a game console . . . . The opto-touch foil may communicate with the user workstation by means of a cable, a wire pair, an infrared link, or a wireless radio link.
  • Information and/or Service Access [0108]
  • When the user goes to a new portion of a document ([0109] 303) (a new page of a book for example), he places the opto-touch foil (304) over (or under) the selected portion and enters in the workstation the reference of this portion (the page number for instance). In a preferred embodiment of the referenced invention, the page number can be entered simply by touching some buttons marked on the top (or bottom) of the opto-touch foil. The page number may be also entered directly by means of the keyboard, the mouse or the touch screen of the user workstation or by any other means such as a bar code reader . . . . The hyperlinked items (items that can be selected to access information on a server) on this page, are then automatically illuminated and highlighted on the surface of the document by the light emitting foil. This light emitting foil operates under the control of the user workstation (300). This illumination and highlighting allows the localization and identification of all hyperlinked items on the page selected by the user.
  • Illuminated items are selected by pressing the opto-touch foil. When the user selects an item ([0110] 307) among all illuminated items (302), the user workstation (300) receives from the opto-touch foil (304) a signal indicating the position of this selected item on the physical document (303). The user workstation identifies and locates referring to a hyperlink table (308) the information and/or the service associated with the position of the selected item (307). If the information and/or service is located in a remote server (306), a request is sent to this server. If the information and/or the service is stored in the user workstation (300), then this information and/or service is accessed locally.
  • In a particular embodiment of the referenced invention, shown in FIG. 6, the user workstation ([0111] 600) is connected to the Internet network (601). The user workstation comprises a user interface (602) including a Web Browser (603) (also called “Web Client”) to access the World-Wide-Web (WWW). In order to access the Web pages associated with an illuminated item (607) on a document (606), the user touches with its finger the opto-touch foil (605) over the illuminated item (609) he wishes to select. The position of the illuminated item selected on the opto-touch foil identifies the Web server (604) and the Web pages the user wants to retrieve and display. The Web Browser program (603) sends a HTTP request (610) to the identified Web Server (604). The response (611) to the request (HTTP response) is sent by the Web Server (604) in the reverse direction to the Web Browser (603). The HTTP response comprises the requested Web pages associated with the selected illuminated item.
  • Manual Creation of Hyperlinks on a Physical Document [0112]
  • The foregoing referenced invention also discloses a manual method of creating hyperlinks, by touching hyperlinked items on a physical document. The method comprises the steps of: [0113]
  • creating a hyperlink table for a physical document; said physical document comprising one or a plurality of pages; [0114]
  • receiving and storing in said hyperlink table an identification of the physical document; [0115]
  • for each page of said physical document: [0116]
  • receiving and storing in said hyperlink table an identification of the page and an identification of hyperlinked items defined by the user on said page; [0117]
  • receiving and storing in said hyperlink table identification and location of information or service associated with each defined hyperlinked item; [0118]
  • determining the position of points pressed on a opto-touch foil; said opto-touch foil being placed and aligned over or under the page of the physical document; said opto-touch foil being pressed at points corresponding to the position of said defined hyperlinked items; [0119]
  • storing the position of the points pressed in the hyperlink table, said hyperlink table comprising for each hyperlinked item, an indication of its position on the page. [0120]
  • The herein referenced method for building the hyperlink table of a physical document has the main drawback of being a cumbersome, time consuming and manually intensive procedure. [0121]
  • In many instances, for example when the physical document is an hard-copy of an original hyperlinked electronic document, it would be advantageous to automatically generate directly from the original electronic document, the hyperlink table required for identifying, highlighting and activating the hyperlinks from the physical copy (e.g., a printed copy, a micro-filmed copy, a photograph or a faxed copy). An object of the present invention is to automatically generate an hyperlinked hard-copy of any hyperlinked electronic document. [0122]
  • Automatic Generation of an Hyperlink Table [0123]
  • As shown in FIG. 2, the user receives an electronic document like, for example, a “e-book” (i.e., an electronic book) entitled “Early British Kingdoms” in Adobe™ Portable Document Format (PDF). [0124]
  • Note: An Adobe PDF file offers an exact representation of a printed document. There are special tools from Adobe and third party vendors for easily creating an Adobe PDF file. If the existing digital content of the file is available in PostScript (as are many archived printed materials), the file can be directly converted into Adobe PDF. Adobe PDF files can also be directly generated from HTML files, from documents created with Lotus Word Pro, Microsoft Office, or virtually from any electronic file. With the Adobe PDF creation process, links and bookmarks from table of contents, index, or any cross-references can be automatically generated. Once created, Adobe PDF files can be distributed digitally, exactly as intended. It is important to note that it is possible to create with Adobe Acrobat, PDF hyperlinked documents. Article entitled “Create a Web Link”, Adobe Tips & Techniques, which can be found on the Web site: [0125]
  • http://www.adobe.com/epaper/tips/acweblinks/main.html [0126]
  • describes the technique for creating Web hyperlinks with Adobe Acrobat 4.0 PDF documents. Adobe PDF files can be linked to any URL, whether this URL is a path to a local file or a Web site. Also URLs can be added to PDF documents by importing them from a file or a Web site. The hyperlink information (i.e., hyperlink sources, hyperlink names and destination URLs ) of a PDF file is stored in the “Hyperlinks palette” of the file. [0127]
  • FIG. 8 shows a preferred embodiment of the invention. The method for generating (or creating) an hyperlink table ([0128] 201) from an electronic document (203) comprising one or a plurality of hyperlinks, for associating said hyperlink table to a physical copy (202) of this electronic document, and for selecting and accessing information or services (301) simply by touching over this physical copy (303) the positions corresponding to the hyperlinked items (302) of the electronic document (203), comprises the steps of:
  • ([0129] 801) assigning a reference number to a physical copy of an electronic document;
  • ([0130] 802) creating an hyperlink table and associating said hyperlink table with the physical copy using the assigned reference number;
  • ([0131] 803) identifying the one or plurality of hyperlinks comprised in the electronic document; retrieving from the electronic document, information related to each identified hyperlink, said information comprising hyperlink name or description, linked service and destination URL and copying said information in the hyperlink table;
  • ([0132] 804) defining the relative scale of the physical copy compared with the electronic document;
  • ([0133] 805) retrieving from the electronic document, electronic coordinates of each identified hyperlinked item and translating said electronic coordinates to physical coordinates on the physical copy;
  • ([0134] 806) storing said physical coordinates in the hyperlink table associated with the physical copy;
  • ([0135] 807) generating the physical copy of the electronic document; printing on the physical copy a reference number; and printing on each page of the physical copy, a page number;
  • ([0136] 808) storing or transmitting the physical copy and the associated hyperlink table.
  • ([0137] 801) Assigning a Reference Number to the Physical Copy
  • The user assigns a reference number (e.g., [0138] 387) for identifying the physical copy of the electronic document and the hyperlink table associated with this physical copy. For example, a document can be uniquely identified by the combination of the seller ID and the document ID. Standards like “Digital Object Identifiers” (DOI) that can be used for generating documents IDs. More information on DOI can be found on:
  • http://www.doi.org. [0139]
  • Alternatively, the reference number can be automatically assigned by the user workstation from a list of stored reference numbers. [0140]
  • (802) Creating an Hyperlink Table and Associating said Hyperlink Table with the Physical Copy [0141]
  • The system then: [0142]
  • creates an hyperlink table (e.g. a new table, or a new record in a database) accessible from the workstation. [0143]
  • This hyperlink table comprises the reference number of the physical copy; [0144]
  • optionally the user stores in the header of this hyperlink table other relevant information related to the electronic document such as title, author, ISBN (International Standard Book Number), date of creation, etc . . . . [0145]
  • The hyperlink table may be stored within the user workstation or may be stored in an external memory accessible from the user workstation. [0146]
  • The header of the new created hyperlink table associated with the e-book (electronic book) entitled “Early British Kingdoms”, shown in FIG. 2, can be built as follows: [0147]
    Doc: 0387 Title: “Early British Kingdoms” Author: David Nash
    Ford of Binfield,
    Berkshire, UK
    Date: 28/01/2000 ISBN: 84-344-0856-2
    Pg:
    X= Y= Link:
  • ([0148] 803) Copying Information related to Hyperlinks from the Electronic Document to the Hyperlink Table
  • The information related to hyperlinks (such as hyperlink name or description, type of service, destination URL . . . ) comprised in the data structure associated with the electronic document is identified and copied in the hyperlink table of the physical copy; [0149]
  • Using the present method, the list of hyperlinked items and hyperlinks destination addresses (e.g., URLs) of the PDF file of the e-book entitled “Early British Kingdoms” shown in FIG. 2, is copied from the “[0150] Hyperlinks palette” of the PDF file to the hyperlink table by means API techniques described by Adobe in document entitled “Adobe Solutions Network: Developer Program” that can be accessed on the Web site:
  • http://partners.adobe.com/asn/developer/acrosdk/docs.html. [0151]
  • Once this step completed, the hyperlink table appears as follows: [0152]
    Doc: Title: “Early British Kingdoms” Author: David Nash Ford of
    0378 Binfield, Berkshire, UK
    Date: 28/01/2000 ISBN: 84-344-0856-2
    Link: Buelit & Gwerthrynion http://freespace.virgin.net/david.
    ford2/buellt.html
    Link: Caer-Baddan (Bath) http://freespace.virgin.net/david.
    ford2/south.html#Gloui
    Link: Caer-Celemion http://freespace.virgin.net/david.
    (Silchester) ford2/vortigern.html
    Link: Ceredigion http://freespace.virgin.net/david.
    ford2/ceredigion.html
    ........ ........ ........
    Link: Editor Phone Number Phone://54-26-555-1234
    ........ ........ ........
    ........ ........ ........
    Link: Mabinogion http://www.cyberphile.co.uk/˜
    taff/taffnet/mabinogion/
    mabinogion.htm
    Link: Avalon http://freespace.virgin.net/david.
    ford2/avalon.html
    Link: Afallach http://freespace.virgin.net/david.
    ford2/gods.html#Afallach
    Link: Beli Mawr http://freespace.virgin.net/david.
    ford2/gods.html#Beli
    ........ ........ ........
    ........ ........ ........
    Link: St.Joseph of Arimathea http://freespace.virgin.net/david.
    ford2/joseph.html
    Link: The Kings of Dumnonia http://freespace.virgin.net/david.
    ford2/dumnonia.html
    Link: Eudaf Hen & Conan http://freespace.virgin.net/david.
    Meri ford2/eudanc.html
    ........ ........ ........
  • The information or service associated with the hyperlinked item may be stored locally in the user workstation. In this case, an identification of the information or service (local address, file name, exec name . . . ) within the user workstation must be stored in the hyperlink table. [0153]
  • ([0154] 804) Determining the Relative Scale of the Physical Copy Compared with the Electronic Document;
  • This step is optional if the dimensions of the electronic document, as shown on the user workstation screen are identical to the dimensions the printed document This is the case for files edited with modern word processors, like Lotus Word Pro, MS Word or Adobe Acrobat. [0155]
  • If the dimensions of the displayed document and the dimensions of the printed document are different (i.e., if the vertical or horizontal dimensions are reduced or magnified), then the horizontal (X) and vertical (Y) dimensions (e.g., in millimeters) of the printed document must be specified. [0156]
  • The object of this step is to compute two scale factors (for axis X and Y) for transforming the coordinates (Xe, Ye) of each hyperlinked item in the electronic document (e.g., coordinates of a point centered on the position of an hyperlinked item, word or picture) into “paper” coordinates. The paper coordinates of a point located on a hard-copy document comprise two components: [0157]
  • a page number (optionally if the physical document comprises a plurality of pages); and [0158]
  • page coordinates (Xp, Yp). [0159]
  • Transformation of “electronic” coordinates into “paper” or “physical” (hard-copy or printed) coordinates is illustrated in FIG. 4 with the PDF electronic book entitled “Early British Kingdoms”. Since Adobe PDF files offers the exact representation of the printed document, the step of determining the scale factors is not required in the present case. Scale factors of 1.0 for X and Y dimensions are used by default to perform the transformation of “electronic” coordinates to “paper” coordinates. [0160]
  • ([0161] 805) Translating the Electronic Coordinates of each Hyperlinked item into Physical Coordinates
  • Using the scale factors computed in the previous step ([0162] 804), (or the default scale factors equal to of 1.0), the electronic coordinates of the hyperlinks comprised in the electronic document are translated into physical coordinates. Electronic coordinates of hyperlinked items are retrieved from the electronic document. The physical coordinates of an hyperlinked item correspond to the position of said hyperlinked item on the physical document. The physical coordinates are preferably expressed as follows:
  • page number (if the physical document comprises a plurality of pages), and [0163]
  • page co ordinates (Xp, Yp) (position of the hyperlinked item on the page corresponding to the page number). [0164]
  • As shown in FIG. 4, the “electronic” coordinates (Xe, Ye) of the hyperlinked item “Beli Mawr”, ([0165] 401) on the electronic document (e.g., on an HTML page) are translated into the “paper” or “physical” coordinates with:
  • a page number ([0166] 402) (page 116), and
  • page coordinates (Xp, Yp) ([0167] 403).
  • Since an Adobe PDF file is the exact representation of the printed copy, the page numbers and page coordinates measured when the PDF file is displayed in full size with Acrobat Reader are the same as the page numbers and page coordinates measured on the printed copy of the same PDF file. [0168]
  • ([0169] 806) Storing Physical Coordinates of Hyperlinked Items in the Hyperlink Table
  • Once the translation of “electronic” coordinates into “paper” or “physical” coordinates is completed, the hyperlink table is updated. The physical coordinates of each hyperlinked item in the electronic document are copied in the hyperlink table as follows: [0170]
    Doc: 0378 Title: “Early British Author: David Nash Ford of
    Kingdoms” Binfield, Berkshire, UK
    Date: 28/01/2000 ISBN: 84-344-0856-2
    Pg: 3
    X=45 | Y=130 Link: Buelit & http://freespace.virgin.net/david.
    Gwerthrynion ford2/buellt.html
    X=205 | Y=170 Link: Caer-Baddan http://freespace.virgin.net/david.
    (Bath) ford2/south.html#Gloui
    X=75 | Y=190 Link: Caer- http://freespace.virgin.net/david.
    Celemion ford2/vortigern.html
    (Silchester)
    X=110 | Y=255 Link: Ceredigion http://freespace.virgin.net/david.
    ford2/ceredigion.html
    ........
    X=30 | Y=260 Link: Editor Phone Phone://54-26-555-1234
    Number
    ........
    Pg: 116
    X=30 Y=95 Link: Mabinogion http://www.cyberphile.co.uk/˜
    taff/taffnet/mabinogion/
    mabinogion.htm
    X=255 | Y=150 Link: Avalon http://freespace.virgin.net/david.
    ford2/avalon.html
    X=225 | Y=160 Link: Afallach http://freespace.virgin.net/david.
    ford2/gods.html#Afallach
    X=190 | Y=230 Link: Beli Mawr http://freespace.virgin.net/david.
    ford2/gods.html#Beli
    .........
    .......
    Pg: 139
    X=25 | Y=30 Link: St.Joseph of http://freespace.virgin.net/david.
    Arimathea ford2/joseph.html
    X=80 | Y=75 Link: The Kings of http://freespace.virgin.net/david.
    Dumnonia ford2/dumnonia.html
    X=140 | Y=135 Link: Eudaf Hen & http://freespace.virgin.net/david.
    Conan Meri ford2/eudanc.html
    . . . . . . . .
  • For example, on [0171] page 116 of physical document 387 (hyperlink table ID) entitled “Early British Kingdoms” written by David Nash Ford of Binfield, the page coordinates of the hyperlinked word “Mabinogion” are X=30 /Y=95. The hyperlinked word “Mabinogion” points to the URL address:
  • http://www.cyberphile.co.uk/˜taff/taffnet/mabinogion/mabinog ion.htm. [0172]
  • ([0173] 807) Generating the Physical Copy of the Electronic Document As shown in FIG. 2, the print or physical copy (202) of the electronic document (203) is generated, and the reference number or Document ID (204) is marked on it. This reference number 38 (204) is used to identify, both the physical copy and the associated hyperlink table.
  • ([0174] 808) Storing or Transmitting the Physical Copy and the Associated Hyperlink Table
  • As shown in FIG. 10, the present method generates at the same time a physical copy of the original electronic document, and an hyperlink table. Both of them can be locally stored or transmitted over the network to other users or systems. Any hard-copy document in portable format (e.g., in PostScript, PDF, LWP, etc.) can be transmitted as a file ready to be printed by the end user. [0175]
  • From a received a physical document and an hyperlink table, all multimedia services defined in the hyperlink table can be accessed and retrieved from the Web simply by activating the hyperlinks by means of an opto-touch foil placed over the pages of the physical copy. [0176]
  • Activating Hyperlinks from the Physical Copy [0177]
  • As illustrated in FIG. 10, an hyperlink table is associated with a physical (printed) copy of an electronic document (in the present example, the document is entitled “Early British Kingdoms”, (Doc: [0178] 387). The hyperlink table (608) is loaded in the user workstation (600). The method, described in FIG. 9, for locating, visualizing and highlighting hyperlinked items on the physical copy, and for accessing information and/or services directly from the hyperlinked items highlighted on the pages of the physical copy, comprises the steps of:
  • ([0179] 901) selecting the hyperlink table associated with the physical copy by specifying the reference number of the physical copy;
  • ([0180] 902) selecting a page of the physical copy and specifying the page number;
  • ([0181] 903) identifying for the selected page the positions of hyperlinked items referring to the hyperlink table, said hyperlink table comprising for each page of the document, a list of hyperlinked items, and for each hyperlinked item, an indication of the position on an opto-touch foil;
  • ([0182] 904) illuminating (or visualizing, or highlighting) the position corresponding to each of said hyperlinked items by means of an opto-touch foil connected to the user workstation;
  • ([0183] 905) placing and aligning the opto-touch foil over (or under) the selected page;
  • ([0184] 906) selecting an hyperlinked item on the selected page by pressing the opto-touch foil on the illuminated point (light spot) corresponding to the selected hyperlinked item;
  • ([0185] 907) determining the position of the point pressed on the opto-touch foil;
  • ([0186] 908) identifying the selected hyperlinked item referring to the hyperlink table, this hyperlink table comprising an indication of the position of each hyperlinked item (illuminated item) on the selected page of the document;
  • ([0187] 909) identifying the information or/and the service associated with the selected illuminated item referring to the hyperlink table, this hyperlink table comprising for each illuminated item of the selected page the identification of the requested information and/or service within the user workstation or within the network (preferably by means of a destination address);
  • ([0188] 910) accessing the information and/or service;
  • ([0189] 911) retrieving and displaying this information and/or service on the user workstation.
  • ([0190] 901) Specifying the Reference Number of the Physical Copy
  • By means of any user interface (keyboard, mouse, touch screen, . . . ) or any reading means (bar code reader . . . ), the user enters the reference number (identifier) of the physical document (e.g.: document [0191] 387) he wants to select. In the particular embodiment shown in FIG. 6, the user enters the reference number of the physical document (e.g.: Doc: 387) by means of an array of pressure sensible “touch buttons” printed on the opto-touch foil. The user presses in the following order:
  • a touch button marked “Doc, ([0192] 612) and then
  • numerical touch buttons ([0193] 613) corresponding to each digit of the physical document reference number (e.g., “3”, “8” and “7”)
  • This procedure gives access to the hyperlink table associated with this document. [0194]
  • ([0195] 902) Selecting a Page and Highlighting Hyperlinks on the Selected Page
  • By means of any user interface (keyboard, mouse, touch screen . . . ) or any reading means (bar code reader . . . ), the user enters the page of the physical document (or the portion of the document) (e.g.: page [0196] 16) he wants to select. In the particular embodiment shown in FIG. 6, by means of the array of pressure sensible touch buttons printed on the opto-touch foil, the user enters the page number to select (e.g.: Pg. 116). The opto-touch foil can be on any position (normally the opto-touch foil is placed over the page comprising the hyperlink to trigger). The user presses in the following order:
  • a touch button marked as “Pg” ([0197] 614), and then
  • numerical touch buttons ([0198] 613) corresponding to each digit of the page number (e.g., “1”, “1” and “6”) to select.
  • This procedure gives access to the selected page (e.g., Pg. [0199] 116) within the hyperlink table associated with the selected document (e.g., Doc: 387).
  • ([0200] 903) Identifying the Position of Predefined Hyperlinked Items referring to the Hyperlink Table
  • The page coordinates Xp and Yp ([0201] 501) of all the hyperlinked items (504) previously defined for the page (502) selected by the user are retrieved from the hyperlink table (608) and sent by the user workstation (600) to the opto-touch foil (605).
  • ([0202] 904) Illuminating the Positions Corresponding to each of said Predefined Hyperlinked Items
  • The opto-touch foil ([0203] 605) receives the information sent by the user workstation (600). This information comprises the position (coordinates Xp and Yp) of each hyperlinked item defined on the selected page. The opto-touch foil decodes this information and visualizes (highlights or illumines) the position of each of the hyperlinked items (607).
  • ([0204] 905) Placing and Aligning the Opto-touch Foil over the Selected Page of the Physical Copy
  • Once a physical document and a page have been selected, the opto-touch foil ([0205] 605) generates one or a plurality of light spots (607) signaling that one or more hyperlinks have been defined for this page. Then, the opto-touch foil is:
  • placed over (or under) the page, and [0206]
  • aligned with the borders of the selected page by some conventional means (e.g., by adjusting the upper left corner of the touch foil with the upper left corner of the page). [0207]
  • As shown also on FIG. 6, the opto-touch foil is placed and aligned over the selected page. The position of the light spots ([0208] 607) emitted by the opto-touch foil corresponds to the position of the hyperlinked items defined for this page. The hyperlinked items appear through the transparent opto-touch foil and are identified by the user thanks to the light spots emitted by the opto-touch foil.
  • ([0209] 906) Selecting an Illuminated Item on this Page
  • As shown in FIG. 6, the user selects an (hyperlinked) item (“Avalon”) on the page by pressing (e.g., by means of his fingertip) the opto-touch foil on the illuminated point ([0210] 609) corresponding to the selected item.
  • ([0211] 907) Determining the Position on the Page of the Point Pressed on the Opto-touch Foil
  • When a particular point on the opto-touch foil ([0212] 605) is pressed, a signal is sent to the user workstation (600) to identify the selected item. This signal indicates the position on the page of the point that has been pressed by the user on the opto-touch foil. The generated signal is generally proportional to the coordinates (Xp/Yp) of the point that has been pressed. In our example, the opto-touch foil measures the position on the selected page of the point that has been pressed (near the light spot over the word “Avalon”) by the user. The coordinates measured at this point are around Xp=255 and Yp=150.
  • ([0213] 908) Identifying the Selected Item
  • The illuminated item selected on the opto-touch foil ([0214] 605) by the user is identified thanks to the hyperlink table. The hyperlink table comprises an indication of the coordinates Xp and Yp (501) of each illuminated item (504) on each page (502) of the physical document. In our example, the coordinates measured by the opto-touch foil are around (close to) Xp=255 and Yp=150. They corresponds in the hyperlink table to the hyperlinked item “Avalon”.
  • ([0215] 909) Identifying the Information Associated with the Selected Item
  • The hyperlink table comprises for each hyperlinked (illuminated) item ([0216] 504) of each page (502) of the physical document the location within the network of the requested information and/or service (503). The information and/or service may be located by means of a destination address. In the Internet network, Web pages in Web Servers are identified by an URL (Uniform resource Locator). In our example, the hyperlink table associates the illuminated item “Avalon” with the URL:
  • http://freespace.virgin.net/david.ford[0217] 2/avalon.html
  • ([0218] 910) Accessing the Information and/or Service
  • The user workstation Web activates the hyperlink (destination address, URL, . . . ) associated in the hyperlink table, with the identified selected hyperlinked item. In our example, the hyperlink labeled “Avalon” is activated since the system determines from the hyperlink table that, for this page (i.e., Pg. [0219] 116), Xp=255, Yp=150 are the physical coordinates of the hyperlinked item located the nearest to the pressed position. Thus, in this example, a simple pressure near the illuminated item “Avalon” automatically activates the following hyperlink on the Web:
  • http://freespace.virgin.net/david.ford2/avalon.html [0220]
  • ([0221] 911) Retrieving and Displaying the requested Information and/or Service
  • The information comprised at the selected destination address (URL) can be displayed ([0222] 301) on the user workstation (300). Additional information (e.g., document number, page number, hyperlinked item, physical coordinates on the foil and URL) related to the hyperlinked (illuminated) item selected by the user can be shown on the Web Browser along with the information retrieved from the Web Server.
  • The hyperlinked physical documents according to the present invention can be generated from electronic documents like, for example, technical manuals with illustrations and flowcharts in Microsoft Word, the latest novels and biographies created by Adobe PageMaker, financial business analyses created in QuarkXpress, electronic dictionaries, encyclopedias, or even information published from an office application, like Lotus SmartSuite or information captured from the Web. [0223]
  • What has been described is merely illustrative of the application of the principles of the present invention. Other arrangements and methods can be implemented by those skilled in the art without departing from the spirit and scope of the present invention. [0224]

Claims (19)

What is claimed is:
1. A method, for use in a user system (200), of generating an hyperlinked physical copy of an electronic document (203) comprising one or a plurality of hyperlinks, said method comprising the steps of:
selecting an electronic document (203);
creating (802) an hyperlink table (201);
associating (802) said hyperlink table with a physical copy (202) of said electronic document, said physical copy comprising one or a plurality of pages;
for each page of the physical copy:
identifying (803) in the electronic document, the one or plurality of hyperlink items comprised in the page;
storing (803) in the hyperlink table an identification of each identified hyperlink item;
retrieving (803) from the electronic document identification and location of information and/or service associated with each identified hyperlink item on the page;
storing (803) in the hyperlink table said identification and location of information and/or service associated with each identified hyperlink item;
retrieving (805) from the electronic document, electronic coordinates of each identified hyperlinked item on the page;
translating (805) said electronic coordinates into physical coordinates on the page of the physical copy; storing (806) said physical coordinates in the hyperlink table.
2. The method according to claim 1 wherein said physical copy (202) is a paper printed copy of said electronic document (203).
3. The method according to claim 1 wherein the step of creating an hyperlink table, comprises the further step of:
storing in said hyperlink table an identification of the physical copy.
4. The method according to claim 1 wherein the step of identifying (803) in the electronic document, the one or plurality of hyperlink items comprised in the page, comprises the further step of:
storing in the hyperlink table an identification of the page.
5. The method according to claim 1 wherein the step of translating said electronic coordinates into physical coordinates on the page of the physical copy, comprises the step of:
defining (804) the relative scale of the physical copy compared with the electronic document.
6. The method according to claim 1 wherein said user system (300) is connected to a communication network (305) comprising one or plurality of servers (306), and wherein the information and/or service associated with each hyperlinked item are located on said one or plurality of servers (306).
7. The method according to claim 1 wherein the information and/or services associated with each hyperlinked item are located on the user system.
8. The method according to claim 1 wherein the step of storing (803) in the hyperlink table said identification and location of information and/or service associated with each identified hyperlink item, comprises the step of:
storing a destination address in the communication network where the information and/or service associated with the hyperlinked item can be accessed.
9. The method according to claim 1 wherein:
said communication network (305) is an Internet Protocol (IP) network;
said servers (306) are Web servers;
said user system (300) comprises a Web browser;
said destination address is an Uniform Resource Locator (URL address);
said information and/or service are Web pages.
10. The method according to claim 1 wherein an hyperlinked item is a word, a letter, an icon, a graphic, a symbol, a mark or any other sign.
11. The method according to claim 1 comprising the further step of:
storing in the hyperlink table additional information related to said physical document such as title, author, date.
12. The method according to claim 1 wherein each page is a portion of said physical document.
13. The method according to claim 1 comprising the further steps of:
identifying a page of the physical copy, said page comprising one or a plurality of hyperlinked items;
identifying position of hyperlinked items comprised in said identified page referring to the hyperlink table associated with the physical copy, said hyperlink table comprising for each page of the document, a list of hyperlink items, and for each hyperlink item, the physical coordinates on said page;
sending for visualization on an opto-touch foil, the physical coordinates of said hyperlinked items, said opto-touch foil being connected to the user system.
14. The method according to claim 1 comprising the further steps of:
determining the physical coordinates of a point pressed on said opto-touch foil; said opto-touch foil being placed and aligned over or under the identified page of the physical copy; each one of hyperlinked items on said page corresponding to a visualized position on said opto-touch foil; said opto-touch foil being pressed at a point corresponding to a selected hyperlinked item;
identifying the selected hyperlinked item corresponding to the physical coordinates of the point pressed on said opto-touch foil referring to the hyperlink table, said hyperlink table comprising the physical coordinates of each hyperlinked item on the identified page;
identifying and locating information and/or service associated with the selected hyperlinked item referring to the hyperlink table, said hyperlink table comprising for each hyperlinked item of each page of the document the identification and location of the information and/or service associated with the hyperlinked item;
accessing the information or service associated with the selected hyperlinked item.
15. An hyperlink table generated according to the method according to claim 1.
16. An user system comprising means adapted for carrying out the method according to claim 1.
17. A system comprising:
an opto-touch foil to be placed over or under a page of a physical document;
a user system according to claim 1;
a connection between said opto-touch foil and said user system.
18. The system according to claim 1 wherein the opto-touch foil is sensible to the pressure exercised over any point and comprises a transparent film with light emitting elements for visualizing selected positions on its surface.
19. A computer program comprising computer readable instructions for carrying out the method according to claim 1.
US10/028,218 2000-10-27 2001-10-25 Method and system for generating hyperlinked physical copies of hyperlinked electronic documents Expired - Fee Related US6940491B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP00480098 2000-10-27
EP00480098.3 2000-10-27

Publications (2)

Publication Number Publication Date
US20020152236A1 true US20020152236A1 (en) 2002-10-17
US6940491B2 US6940491B2 (en) 2005-09-06

Family

ID=8174267

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/028,218 Expired - Fee Related US6940491B2 (en) 2000-10-27 2001-10-25 Method and system for generating hyperlinked physical copies of hyperlinked electronic documents

Country Status (1)

Country Link
US (1) US6940491B2 (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010047374A1 (en) * 2000-02-28 2001-11-29 Xerox Corporation Method ans system for information retrieval from query evaluations of very large full-text databases
US20050022108A1 (en) * 2003-04-18 2005-01-27 International Business Machines Corporation System and method to enable blind people to have access to information printed on a physical document
US20060129949A1 (en) * 2004-12-15 2006-06-15 Chien-Li Wu Multi-window information platform user interface
US20070233661A1 (en) * 2006-04-04 2007-10-04 Fuji Xerox Co., Ltd. Information processing apparatus, information processing method, storage medium and data signal
WO2009023245A1 (en) * 2007-08-14 2009-02-19 Somatic Digital, Llc Interactive hybrid printed material interface system and method
US7496835B1 (en) * 2004-10-31 2009-02-24 Adobe Systems Incorporated Document generation from web pages
US7581175B1 (en) * 2005-05-10 2009-08-25 Adobe Systems, Incorporated File format conversion of an interactive element in a graphical user interface
US20090235162A1 (en) * 2008-03-11 2009-09-17 Disney Enterprises, Inc. Method and system for providing enhanced virtual books
US20090276690A1 (en) * 2008-05-02 2009-11-05 Reagan Inventions, Llc. System and method of embedding symbology in alphabetic letters and then linking the letters to a site or sites on the global computer network
US7900191B1 (en) * 2005-06-20 2011-03-01 The Math Works, Inc. System and method of using an active link in a state programming environment to locate an element in a graphical programming environment
US8112363B2 (en) 2002-10-10 2012-02-07 International Business Machines Corporation Selecting, ordering and accessing copyrighted information from physical documents
US8196041B2 (en) 2003-06-26 2012-06-05 International Business Machines Corporation Method and system for processing information relating to active regions of a page of physical document
US20130117644A1 (en) * 2007-03-17 2013-05-09 Anmol Dhawan Generating and printing target page numbers over links while printing documents or web pages
US20130311862A1 (en) * 2005-12-14 2013-11-21 Prajno Malla Intelligent bookmarks and information management system based on the same
US8726233B1 (en) 2005-06-20 2014-05-13 The Mathworks, Inc. System and method of using an active link in a state programming environment to locate an element
US20160055254A1 (en) * 2007-06-07 2016-02-25 Thomson Reuters Global Resources Method and System for Click-Thru Capability in Electronic Media
US20160139777A1 (en) * 2014-11-18 2016-05-19 Sony Corporation Screenshot based indication of supplemental information
US20190102368A1 (en) * 2017-10-02 2019-04-04 Xerox Corporation Systems and methods for managing documents containing one or more hyper texts and related information
US10664153B2 (en) 2001-12-21 2020-05-26 International Business Machines Corporation Device and system for retrieving and displaying handwritten annotations
JPWO2020184704A1 (en) * 2019-03-14 2021-09-13 パロニム株式会社 Information processing system
CN113946774A (en) * 2021-10-26 2022-01-18 掌阅科技股份有限公司 Book webpage skipping method, computing device and computer storage medium

Families Citing this family (67)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7916124B1 (en) 2001-06-20 2011-03-29 Leapfrog Enterprises, Inc. Interactive apparatus using print media
US8046708B1 (en) * 2003-08-07 2011-10-25 The Mathworks, Inc. Reversed links from graphical diagram representation
JP2003242135A (en) * 2002-02-20 2003-08-29 Minolta Co Ltd Printing data preparing program
US7181502B2 (en) * 2002-03-21 2007-02-20 International Business Machines Corporation System and method for locating on electronic documents items referenced in a physical document
US7831933B2 (en) * 2004-03-17 2010-11-09 Leapfrog Enterprises, Inc. Method and system for implementing a user interface for a device employing written graphical elements
US20060048051A1 (en) * 2004-08-25 2006-03-02 Research In Motion Limited Method for rendering formatted content on a mobile device
US8856108B2 (en) 2006-07-31 2014-10-07 Ricoh Co., Ltd. Combining results of image retrieval processes
US8005831B2 (en) * 2005-08-23 2011-08-23 Ricoh Co., Ltd. System and methods for creation and use of a mixed media environment with geographic location information
US8156116B2 (en) 2006-07-31 2012-04-10 Ricoh Co., Ltd Dynamic presentation of targeted information in a mixed media reality recognition system
US7920759B2 (en) * 2005-08-23 2011-04-05 Ricoh Co. Ltd. Triggering applications for distributed action execution and use of mixed media recognition as a control input
US8176054B2 (en) 2007-07-12 2012-05-08 Ricoh Co. Ltd Retrieving electronic documents by converting them to synthetic text
US8838591B2 (en) * 2005-08-23 2014-09-16 Ricoh Co., Ltd. Embedding hot spots in electronic documents
US8195659B2 (en) * 2005-08-23 2012-06-05 Ricoh Co. Ltd. Integration and use of mixed media documents
US9373029B2 (en) 2007-07-11 2016-06-21 Ricoh Co., Ltd. Invisible junction feature recognition for document security or annotation
US8276088B2 (en) 2007-07-11 2012-09-25 Ricoh Co., Ltd. User interface for three-dimensional navigation
US8156115B1 (en) 2007-07-11 2012-04-10 Ricoh Co. Ltd. Document-based networking with mixed media reality
US9384619B2 (en) * 2006-07-31 2016-07-05 Ricoh Co., Ltd. Searching media content for objects specified using identifiers
US8144921B2 (en) 2007-07-11 2012-03-27 Ricoh Co., Ltd. Information retrieval using invisible junctions and geometric constraints
US8335789B2 (en) * 2004-10-01 2012-12-18 Ricoh Co., Ltd. Method and system for document fingerprint matching in a mixed media environment
US8086038B2 (en) * 2007-07-11 2011-12-27 Ricoh Co., Ltd. Invisible junction features for patch recognition
US8332401B2 (en) * 2004-10-01 2012-12-11 Ricoh Co., Ltd Method and system for position-based image matching in a mixed media environment
US7702673B2 (en) * 2004-10-01 2010-04-20 Ricoh Co., Ltd. System and methods for creation and use of a mixed media environment
US8156427B2 (en) * 2005-08-23 2012-04-10 Ricoh Co. Ltd. User interface for mixed media reality
US7991778B2 (en) * 2005-08-23 2011-08-02 Ricoh Co., Ltd. Triggering actions with captured input in a mixed media environment
US9530050B1 (en) 2007-07-11 2016-12-27 Ricoh Co., Ltd. Document annotation sharing
US7885955B2 (en) * 2005-08-23 2011-02-08 Ricoh Co. Ltd. Shared document annotation
US8825682B2 (en) 2006-07-31 2014-09-02 Ricoh Co., Ltd. Architecture for mixed media reality retrieval of locations and registration of images
US8868555B2 (en) 2006-07-31 2014-10-21 Ricoh Co., Ltd. Computation of a recongnizability score (quality predictor) for image retrieval
US7669148B2 (en) * 2005-08-23 2010-02-23 Ricoh Co., Ltd. System and methods for portable device for mixed media system
US9171202B2 (en) * 2005-08-23 2015-10-27 Ricoh Co., Ltd. Data organization and access for mixed media document system
US7672543B2 (en) * 2005-08-23 2010-03-02 Ricoh Co., Ltd. Triggering applications based on a captured text in a mixed media environment
US8521737B2 (en) * 2004-10-01 2013-08-27 Ricoh Co., Ltd. Method and system for multi-tier image matching in a mixed media environment
US9405751B2 (en) * 2005-08-23 2016-08-02 Ricoh Co., Ltd. Database for mixed media document system
US7917554B2 (en) 2005-08-23 2011-03-29 Ricoh Co. Ltd. Visibly-perceptible hot spots in documents
US8949287B2 (en) * 2005-08-23 2015-02-03 Ricoh Co., Ltd. Embedding hot spots in imaged documents
US8385589B2 (en) 2008-05-15 2013-02-26 Berna Erol Web-based content detection in images, extraction and recognition
US7812986B2 (en) * 2005-08-23 2010-10-12 Ricoh Co. Ltd. System and methods for use of voice mail and email in a mixed media environment
US8369655B2 (en) 2006-07-31 2013-02-05 Ricoh Co., Ltd. Mixed media reality recognition using multiple specialized indexes
US8184155B2 (en) 2007-07-11 2012-05-22 Ricoh Co. Ltd. Recognition and tracking using invisible junctions
US8600989B2 (en) * 2004-10-01 2013-12-03 Ricoh Co., Ltd. Method and system for image matching in a mixed media environment
US7639387B2 (en) * 2005-08-23 2009-12-29 Ricoh Co., Ltd. Authoring tools using a mixed media environment
US7587412B2 (en) * 2005-08-23 2009-09-08 Ricoh Company, Ltd. Mixed media reality brokerage network and methods of use
US8510283B2 (en) 2006-07-31 2013-08-13 Ricoh Co., Ltd. Automatic adaption of an image recognition system to image capture devices
US7970171B2 (en) 2007-01-18 2011-06-28 Ricoh Co., Ltd. Synthetic image and video generation from ground truth data
US7551780B2 (en) * 2005-08-23 2009-06-23 Ricoh Co., Ltd. System and method for using individualized mixed document
US7922099B1 (en) 2005-07-29 2011-04-12 Leapfrog Enterprises, Inc. System and method for associating content with an image bearing surface
US7769772B2 (en) * 2005-08-23 2010-08-03 Ricoh Co., Ltd. Mixed media reality brokerage network with layout-independent recognition
US7698256B1 (en) * 2005-11-30 2010-04-13 Oracle International Corporation History support for stateless Javascript Web client
US8261967B1 (en) 2006-07-19 2012-09-11 Leapfrog Enterprises, Inc. Techniques for interactively coupling electronic content with printed media
US8676810B2 (en) 2006-07-31 2014-03-18 Ricoh Co., Ltd. Multiple index mixed media reality recognition using unequal priority indexes
US8073263B2 (en) 2006-07-31 2011-12-06 Ricoh Co., Ltd. Multi-classifier selection and monitoring for MMR-based image recognition
US9020966B2 (en) * 2006-07-31 2015-04-28 Ricoh Co., Ltd. Client device for interacting with a mixed media reality recognition system
US9063952B2 (en) * 2006-07-31 2015-06-23 Ricoh Co., Ltd. Mixed media reality recognition with image tracking
US8201076B2 (en) 2006-07-31 2012-06-12 Ricoh Co., Ltd. Capturing symbolic information from documents upon printing
US9176984B2 (en) 2006-07-31 2015-11-03 Ricoh Co., Ltd Mixed media reality retrieval of differentially-weighted links
US8489987B2 (en) 2006-07-31 2013-07-16 Ricoh Co., Ltd. Monitoring and analyzing creation and usage of visual content using image and hotspot interaction
US8127219B1 (en) * 2007-01-22 2012-02-28 Adobe Systems Incorporated Printing and rendering hyperlink destinations
US8161369B2 (en) 2007-03-16 2012-04-17 Branchfire, Llc System and method of providing a two-part graphic design and interactive document application
US20080235564A1 (en) * 2007-03-21 2008-09-25 Ricoh Co., Ltd. Methods for converting electronic content descriptions
US8812969B2 (en) * 2007-03-21 2014-08-19 Ricoh Co., Ltd. Methods for authoring and interacting with multimedia representations of documents
US8584042B2 (en) * 2007-03-21 2013-11-12 Ricoh Co., Ltd. Methods for scanning, printing, and copying multimedia thumbnails
US8286068B2 (en) * 2008-04-25 2012-10-09 Microsoft Corporation Linking digital and paper documents
JP4780169B2 (en) * 2008-09-30 2011-09-28 ブラザー工業株式会社 Data generation device, scanner, and computer program
US8385660B2 (en) * 2009-06-24 2013-02-26 Ricoh Co., Ltd. Mixed media reality indexing and retrieval for repeated content
US9058331B2 (en) 2011-07-27 2015-06-16 Ricoh Co., Ltd. Generating a conversation in a social network based on visual search results
US8504906B1 (en) * 2011-09-08 2013-08-06 Amazon Technologies, Inc. Sending selected text and corresponding media content
US11461272B2 (en) 2019-09-11 2022-10-04 Dropbox, Inc. Generating and modifying a collection content item for organizing and presenting content items

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5739814A (en) * 1992-09-28 1998-04-14 Sega Enterprises Information storage system and book device for providing information in response to the user specification
US6035330A (en) * 1996-03-29 2000-03-07 British Telecommunications World wide web navigational mapping system and method
US6256638B1 (en) * 1998-04-14 2001-07-03 Interval Research Corporation Printable interfaces and digital linkmarks
US20010039587A1 (en) * 1998-10-23 2001-11-08 Stephen Uhler Method and apparatus for accessing devices on a network
US6330976B1 (en) * 1998-04-01 2001-12-18 Xerox Corporation Marking medium area with encoded identifier for producing action through network
US20020076111A1 (en) * 2000-12-18 2002-06-20 Xerox Corporation Method and apparatus for formatting OCR text
US20020083090A1 (en) * 2000-12-27 2002-06-27 Jeffrey Scott R. Document management system
US20020116477A1 (en) * 1999-12-08 2002-08-22 Parvathi Somashekar Technique for configuring network deliverable components
US20030002068A1 (en) * 2001-06-27 2003-01-02 Michael Constantin Method of routing and processing document images sent using a digital scanner and transceiver
US20030048487A1 (en) * 2001-08-31 2003-03-13 Johnston Kairi Ann Variable resolution scanning
US6771283B2 (en) * 2000-04-26 2004-08-03 International Business Machines Corporation Method and system for accessing interactive multimedia information or services by touching highlighted items on physical documents
US6824066B2 (en) * 2000-10-06 2004-11-30 Leon H. Weyant Electronic access security key card pamphlet

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5739814A (en) * 1992-09-28 1998-04-14 Sega Enterprises Information storage system and book device for providing information in response to the user specification
US6035330A (en) * 1996-03-29 2000-03-07 British Telecommunications World wide web navigational mapping system and method
US6587859B2 (en) * 1997-10-07 2003-07-01 Interval Research Corporation Printable interfaces and digital linkmarks
US6330976B1 (en) * 1998-04-01 2001-12-18 Xerox Corporation Marking medium area with encoded identifier for producing action through network
US6256638B1 (en) * 1998-04-14 2001-07-03 Interval Research Corporation Printable interfaces and digital linkmarks
US20010039587A1 (en) * 1998-10-23 2001-11-08 Stephen Uhler Method and apparatus for accessing devices on a network
US20020116477A1 (en) * 1999-12-08 2002-08-22 Parvathi Somashekar Technique for configuring network deliverable components
US6771283B2 (en) * 2000-04-26 2004-08-03 International Business Machines Corporation Method and system for accessing interactive multimedia information or services by touching highlighted items on physical documents
US6824066B2 (en) * 2000-10-06 2004-11-30 Leon H. Weyant Electronic access security key card pamphlet
US20020076111A1 (en) * 2000-12-18 2002-06-20 Xerox Corporation Method and apparatus for formatting OCR text
US20020083090A1 (en) * 2000-12-27 2002-06-27 Jeffrey Scott R. Document management system
US20030002068A1 (en) * 2001-06-27 2003-01-02 Michael Constantin Method of routing and processing document images sent using a digital scanner and transceiver
US20030048487A1 (en) * 2001-08-31 2003-03-13 Johnston Kairi Ann Variable resolution scanning

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010047374A1 (en) * 2000-02-28 2001-11-29 Xerox Corporation Method ans system for information retrieval from query evaluations of very large full-text databases
US7114124B2 (en) * 2000-02-28 2006-09-26 Xerox Corporation Method and system for information retrieval from query evaluations of very large full-text databases
US10664153B2 (en) 2001-12-21 2020-05-26 International Business Machines Corporation Device and system for retrieving and displaying handwritten annotations
US8112363B2 (en) 2002-10-10 2012-02-07 International Business Machines Corporation Selecting, ordering and accessing copyrighted information from physical documents
US20050022108A1 (en) * 2003-04-18 2005-01-27 International Business Machines Corporation System and method to enable blind people to have access to information printed on a physical document
US10614729B2 (en) 2003-04-18 2020-04-07 International Business Machines Corporation Enabling a visually impaired or blind person to have access to information printed on a physical document
US9165478B2 (en) * 2003-04-18 2015-10-20 International Business Machines Corporation System and method to enable blind people to have access to information printed on a physical document
US10276065B2 (en) 2003-04-18 2019-04-30 International Business Machines Corporation Enabling a visually impaired or blind person to have access to information printed on a physical document
US8196041B2 (en) 2003-06-26 2012-06-05 International Business Machines Corporation Method and system for processing information relating to active regions of a page of physical document
US7496835B1 (en) * 2004-10-31 2009-02-24 Adobe Systems Incorporated Document generation from web pages
US7640494B1 (en) 2004-10-31 2009-12-29 Adobe Systems Incorporated Document generation from web pages
US20060129949A1 (en) * 2004-12-15 2006-06-15 Chien-Li Wu Multi-window information platform user interface
US20130125065A1 (en) * 2005-05-10 2013-05-16 Adobe Systems Incorporated File format conversion of an interactive element in a graphical user interface
US8793565B2 (en) * 2005-05-10 2014-07-29 Adobe Systems Incorporated File format conversion of an interactive element in a graphical user interface
US7581175B1 (en) * 2005-05-10 2009-08-25 Adobe Systems, Incorporated File format conversion of an interactive element in a graphical user interface
US8700374B1 (en) 2005-06-20 2014-04-15 The Mathworks, Inc. System and method of using an active link in a state programming environment to locate an element in a graphical programming environment
US8726233B1 (en) 2005-06-20 2014-05-13 The Mathworks, Inc. System and method of using an active link in a state programming environment to locate an element
US7900191B1 (en) * 2005-06-20 2011-03-01 The Math Works, Inc. System and method of using an active link in a state programming environment to locate an element in a graphical programming environment
US20130311862A1 (en) * 2005-12-14 2013-11-21 Prajno Malla Intelligent bookmarks and information management system based on the same
US20140298152A1 (en) * 2005-12-14 2014-10-02 Unifi Scientific Advances, Inc Intelligent bookmarks and information management system based on the same
US20070233661A1 (en) * 2006-04-04 2007-10-04 Fuji Xerox Co., Ltd. Information processing apparatus, information processing method, storage medium and data signal
US20130117644A1 (en) * 2007-03-17 2013-05-09 Anmol Dhawan Generating and printing target page numbers over links while printing documents or web pages
US11042598B2 (en) * 2007-06-07 2021-06-22 Refinitiv Us Organization Llc Method and system for click-thru capability in electronic media
US20160055254A1 (en) * 2007-06-07 2016-02-25 Thomson Reuters Global Resources Method and System for Click-Thru Capability in Electronic Media
WO2009023245A1 (en) * 2007-08-14 2009-02-19 Somatic Digital, Llc Interactive hybrid printed material interface system and method
US20090235162A1 (en) * 2008-03-11 2009-09-17 Disney Enterprises, Inc. Method and system for providing enhanced virtual books
US20090276690A1 (en) * 2008-05-02 2009-11-05 Reagan Inventions, Llc. System and method of embedding symbology in alphabetic letters and then linking the letters to a site or sites on the global computer network
US20170337165A1 (en) * 2008-05-02 2017-11-23 Reagan Inventions, Llc System and method of embedding symbology in alphabetic letters and then linking the letters to a site or sites on the global computer network
US9747261B2 (en) 2008-05-02 2017-08-29 Reagan Inventions, Llc System and method of embedding symbology in alphabetic letters and then linking the letters to a site or sites on the global computer network
US8832542B2 (en) 2008-05-02 2014-09-09 Leigh M. Rothschild System and method of embedding symbology in alphabetic letters and then linking the letters to a site or sites on the global computer network
US8151180B2 (en) * 2008-05-02 2012-04-03 Reagan Inventions, Llc System and method of embedding symbology in alphabetic letters and then linking the letters to a site or sites on the global computer network
US20160139777A1 (en) * 2014-11-18 2016-05-19 Sony Corporation Screenshot based indication of supplemental information
US20190102368A1 (en) * 2017-10-02 2019-04-04 Xerox Corporation Systems and methods for managing documents containing one or more hyper texts and related information
US10572577B2 (en) * 2017-10-02 2020-02-25 Xerox Corporation Systems and methods for managing documents containing one or more hyper texts and related information
US10922475B2 (en) 2017-10-02 2021-02-16 Xerox Corporation Systems and methods for managing documents containing one or more hyper texts and related information
JPWO2020184704A1 (en) * 2019-03-14 2021-09-13 パロニム株式会社 Information processing system
CN113946774A (en) * 2021-10-26 2022-01-18 掌阅科技股份有限公司 Book webpage skipping method, computing device and computer storage medium

Also Published As

Publication number Publication date
US6940491B2 (en) 2005-09-06

Similar Documents

Publication Publication Date Title
US6940491B2 (en) Method and system for generating hyperlinked physical copies of hyperlinked electronic documents
US7373588B2 (en) Method and system for accessing interactive multimedia information or services by touching marked items on physical documents
US7181502B2 (en) System and method for locating on electronic documents items referenced in a physical document
US6771283B2 (en) Method and system for accessing interactive multimedia information or services by touching highlighted items on physical documents
TW494323B (en) System and method for locating on a physical document items referenced in another physical document
US6271840B1 (en) Graphical search engine visual index
US6593944B1 (en) Displaying a web page on an electronic display device having a limited display area
US8645848B2 (en) Systems and methods for dynamic menus
RU2245577C2 (en) Electronic message board and mail server
US7073121B2 (en) Web page thumbnails and user configured complementary information provided from a server
US6405222B1 (en) Requesting concurrent entries via bookmark set
US7562287B1 (en) System, method and apparatus for selecting, displaying, managing, tracking and transferring access to content of web pages and other sources
US6697838B1 (en) Method and system for annotating information resources in connection with browsing, in both connected and disconnected states
US10013484B2 (en) User driven computerized selection, categorization, and layout of live content components
JP2006309801A (en) Distributed publishing for hypermedia on wide area network and integrated development platform for management
US7747949B2 (en) System and method comprising an electronic document from physical documents
JP2002169743A (en) System and method for showing item referred to in electronic document on physical document
KR100556331B1 (en) System and method for selecting electronic documents from a physical document and for displaying the electronic documents over said physical document
US7631256B2 (en) Web page display system, and image server and method of controlling the same
US7196806B2 (en) Data processing system for converting content relative to a space used as an advertising medium into a printable object
US20050080818A1 (en) Active images
US20040225959A1 (en) Appearance properties for web applications using TagLibs
US20030225858A1 (en) Method and apparatus for traversing Web pages in a network data processing system
US20050114545A1 (en) Method and apparatus for marking of web pages
JP3737310B2 (en) WWW server system

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CARRO, FERNANDO INCERTIS;REEL/FRAME:012627/0699

Effective date: 20020122

FPAY Fee payment

Year of fee payment: 4

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20130906

AS Assignment

Owner name: KYNDRYL, INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTERNATIONAL BUSINESS MACHINES CORPORATION;REEL/FRAME:057885/0644

Effective date: 20210930