US20090282329A1 - Methods and apparatus to identify graphical elements - Google Patents
Methods and apparatus to identify graphical elements Download PDFInfo
- Publication number
- US20090282329A1 US20090282329A1 US12/505,561 US50556109A US2009282329A1 US 20090282329 A1 US20090282329 A1 US 20090282329A1 US 50556109 A US50556109 A US 50556109A US 2009282329 A1 US2009282329 A1 US 2009282329A1
- Authority
- US
- United States
- Prior art keywords
- graphical element
- document
- text
- instructions
- obtaining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99933—Query processing, i.e. searching
- Y10S707/99935—Query augmenting and refining, e.g. inexact access
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99933—Query processing, i.e. searching
- Y10S707/99936—Pattern matching access
Definitions
- graphical user interface in applications, such as operating systems, and graphical editors (i.e., web page editors, document editors, etc.) that enable users to quickly provide input and create documents and/or projects using “What You See Is What You Get” (WYSIWYG) technology.
- graphical editors i.e., web page editors, document editors, etc.
- WYSIWYG “What You See Is What You Get”
- a user uses a graphical user interface, a user operates an input device such as a mouse or keyboard to manipulate graphical objects on a computer display.
- the graphical objects are often represented as icons, and the user can operate an input device such as a mouse to move a mouse pointer onto an icon (i.e., graphically overlapping the icon) on the graphical user interface.
- the application By depressing a mouse button, the application (such as the operating system desktop) selects the icon, and if the user maintains the mouse button in a depressed state, the user can drag the icon across the graphical user interface. By releasing the mouse button, the icon is placed on the graphical user interface at the current position of the mouse pointer.
- users can create and update documents (i.e., web pages, brochures, etc) and/or projects by dragging and dropping text, text boxes, graphical elements, etc. into the document and/or project.
- Users can select the graphical elements (i.e., photographs, graphics, etc) used in the documents by selecting images from content providers.
- Content providers provide graphical elements (e.g., photographs, graphics, etc) for document developers to view and/or purchase from content provider web sites.
- Document developers are able to perform online searches by providing search criteria such as keywords, and then choose from the results to make a purchase. As an example, if a document developer is looking for pictures of cars, they can visit a content provider web site that sells graphical elements and can enter the search term “cars”. In response, the content provider web site searches a library of graphical elements (that may include more than one content provider web site) and can compile the results of the search. The document developer can then choose the appropriate graphical element(s) from the search results.
- Embodiments disclosed herein significantly overcome such deficiencies and provide a system that includes a computer system executing a graphical element identifying process.
- the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element from, for example, a content provider web site.
- the graphical elements are provided by the application in which the user enters the content.
- the graphical element is chosen to match the concept of the digital composition.
- the graphical element identifying process then places the selected graphical element (i.e., the graphical elements for selection by a user) in a graphical element location within the digital composition.
- the graphical element identifying process can display one or more graphical elements for the user to select. Graphical elements are chosen to match the concept of the digital composition by matching keywords associated with the graphical element to keywords associated with the content (i.e., text and/or graphical elements already existing within the content).
- the graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element (or multiple graphical elements) within the digital composition.
- a document developer is developing a brochure for a charity golf event.
- the document developer enters the details of the charity golf event (i.e., the time, location, the charity involved, celebrities who will be in attendance, etc) into an application used to develop the brochure.
- the graphical element identifying process receives a selection of the details of the charity golf event, for example, via a user highlighting the selection within the application used to develop the brochure.
- the graphical element identifying process derives the concept of the brochure by identifying keywords within the selection, such as “golf course”.
- the graphical element identifying process matches the search criteria to one or more graphical element databases containing photographs, images and other graphical elements.
- the graphical element identifying process then obtains those graphical elements that match the search criteria of “golf course”, and displays those graphical elements within the application used to develop the brochure, at an appropriate location on the brochure.
- inventions of the disclosed herein include any type of computerized device, workstation, handheld or laptop computer, or the like configured with software and/or circuitry (e.g., a processor) to process any or all of the method operations disclosed herein.
- a computerized device such as a computer or a data communications device or any type of processor that is programmed or configured to operate as explained herein is considered an embodiment disclosed herein.
- One such embodiment comprises a computer program product that has a computer-readable medium including computer program logic encoded thereon that, when performed in a computerized device having a coupling of a memory and a processor, programs the processor to perform the operations disclosed herein.
- Such arrangements are typically provided as software, code and/or other data (e.g., data structures) arranged or encoded on a computer readable medium such as an optical medium (e.g., CD-ROM), floppy or hard disk or other a medium such as firmware or microcode in one or more ROM or RAM or PROM chips or as an Application Specific Integrated Circuit (ASIC).
- the software or firmware or other such configurations can be installed onto a computerized device to cause the computerized device to perform the techniques explained as embodiments disclosed herein.
- system disclosed herein may be embodied strictly as a software program, as software and hardware, or as hardware alone.
- Embodiments disclosed herein may be employed in data communications devices and other computerized devices and software systems for such devices such as those manufactured by Adobe Systems, Inc. of San Jose, Calif.
- FIG. 1 shows a high-level block diagram of a computer system according to one embodiment disclosed herein.
- FIG. 2 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a graphical element within the digital composition.
- FIG. 3 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a plurality of graphical elements within the digital composition.
- FIG. 4 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process derives conceptual information associated with the content.
- FIG. 5 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process displays the graphical element within the digital composition.
- Embodiments disclosed herein include a computer system that performs a graphical element identifying process that executing a graphical element identifying process. Based on the content (i.e., the text and/or the graphical elements) within a digital composition (i.e., a document, etc), the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element (i.e., image, photograph, video, etc) from a content provider web site, such as a graphical element database (or more than one graphical element databases). The graphical element is chosen to match the concept of the digital composition. The graphical element identifying process places the selected graphical element in a graphical element location within the digital composition.
- a graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element (i.e., image, photograph, video, etc) from a content provider web site, such as a graphical element database (or more than one graphical element databases).
- the content can be selected by a user and the graphical element identifying process invoked by the user.
- the graphical element identifying process automatically obtains graphical elements that match the concept of the content, and dynamically updates those results (i.e., the graphical elements obtained to match the concept of the content) as additional content is added to the digital composition.
- the graphical element identifying process automatically obtains graphical elements based on, for example, words, that occur within the content more than a predefined number of times, within the content. For example, if the phrase ‘golf course’ occurs within the content, for example, more than three times, then the graphical element identifying process would automatically obtain graphical elements that match the concept of a golf course.
- the graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element within the digital composition, for a user to view. The user can select the displayed graphical element, or choose from multiple graphical elements that are presented to the user.
- FIG. 1 is a block diagram illustrating example architecture of a computer system 110 that executes, runs, interprets, operates or otherwise performs a graphical element identifying application 140 - 1 and process 140 - 2 suitable for use in explaining example embodiments disclosed herein.
- the computer system 110 may be any type of computerized device such as a personal computer, workstation, portable computing device, console, laptop, network terminal or the like.
- the computer system 110 includes an interconnection mechanism 111 such as a data bus or other circuitry that couples a memory system 112 , a processor 113 , an input/output interface 114 , and a communications interface 115 .
- An input device 116 (e.g., one or more user/developer controlled devices such as a keyboard, mouse, etc.) couples to processor 113 through I/O interface 114 and enables a user 108 to provide input commands and generally control the graphical user interface 160 on the display 130 .
- the graphical user interface 160 contains a digital composition 180 containing content 185 (that can also contain graphical elements 145 -N) and a graphical element location 150 .
- the graphical element location 150 contains a graphical element 145 - 1 and attributes 155 - 1 associated with the graphical element 145 - 1 .
- a graphical elements database 125 stores graphical elements 145 -N (and attributes 155 -N associated with those graphical elements 145 -N) developed in accordance with techniques described herein within a computer readable medium.
- the communications interface 115 enables the computer system 110 to communicate with other devices (i.e., other computers) on a network (not shown). This can allow access to the graphical element identifying application by remote computer systems.
- the memory system 112 is any type of computer readable medium and in this example is encoded with a graphical element identifying application 140 - 1 that supports generation, display, and implementation of functional operations of the graphical user interface 160 as explained herein.
- the graphical element identifying application 140 - 1 may be embodied as software code such as data and/or logic instructions (e.g., code stored in the memory or on another computer readable medium such as a removable disk) that supports processing functionality according to different embodiments described herein.
- the processor 113 accesses the memory system 112 via the interconnect 111 in order to launch, run, execute, interpret or otherwise perform the logic instructions of the graphical element identifying application 140 - 1 .
- Execution of graphical element identifying application 140 - 1 in this manner produces processing functionality in a graphical element identifying process 140 - 2 .
- the graphical element identifying process 140 - 2 represents one or more portions or runtime instances of the graphical element identifying application 140 - 1 (or the entire application 140 - 1 ) performing or executing within or upon the processor 113 in the computerized device 110 at runtime.
- the graphical element identifying process 140 - 2 operates as explained herein to identify graphical elements 145 -N to be used in the development of a digital composition 180 within the graphical user interface 160 .
- example configurations disclosed herein include the graphical element identifying application 140 - 1 .
- the graphical element identifying application 140 - 1 may be stored on a computer readable medium (such as a floppy disk), hard disk, electronic, magnetic, and optical or other computer readable medium.
- the graphical element identifying application 140 - 1 may also be stored in a memory system 112 such as in firmware, read only memory (ROM), or, as in this example, as executable code in, for example, Random Access Memory (RAM).
- ROM read only memory
- RAM Random Access Memory
- other embodiments herein include the execution of the graphical element identifying application 140 - 1 in the processor 113 as the graphical element identifying process 140 - 2 .
- the computer system 110 may include other processes and/or software and hardware components, such as an operating system not shown in this example.
- a display 130 need not be coupled directly to computer system 110 .
- the graphical element identifying application 140 - 1 can be executed on a remotely accessible computerized device via the network interface 115 .
- the graphical user interface 160 may be displayed locally to a user of the remote computer and execution of the processing herein may be client-server based.
- FIG. 2 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it receives a selection of content 185 from a digital composition 180 and obtains a graphical element 145 - 1 that matches the concept of the selected content 185 , according to one embodiment disclosed herein.
- the graphical element identifying process 140 - 2 receives a selection of content 185 within the digital composition 180 .
- a pop up window appears containing the selection of content 185 that the graphical element identifying process 140 - 2 will use to obtain a graphical element 145 - 1 that matches the concept (i.e., the central ‘theme’) of the selection of content 185 .
- content 185 can contain, but is not limited to, graphical elements 145 -N as well as other content 185 , such as text.
- the concept is determined by keywords contained within the content.
- the graphical element identifying process 140 - 2 receives notification, via a notification mechanism, that a selection of content 185 within the digital composition 180 has been identified as the selection of content 185 to which a graphical element 145 - 1 will be associated.
- the notification mechanism could be a pop up window, a menu button, content 185 selected by a user 108 , or accentuated content 185 .
- the graphical element identifying process 140 - 2 receives notification of selected content 185 via a pop up window that appears, displaying a selection of content 185 from the digital composition 180 that is used to derive the concept of the selected content 185 .
- the application used to create the digital composition 180 provides a menu button that a user 108 can select to notify the graphical element identifying process 140 - 2 that a portion of content 185 has been selected.
- a user 108 who highlights a portion of content 185 , identifies the selection of content 185 .
- the selection of content 185 such as text, is accentuated within the digital composition 180 , for example, by either highlighting the content 185 or underlining the content 185 in a color that matches or contrasts with the color of the font in which the content (i.e., text) is written.
- the user 108 can then request that the graphical element identifying process 140 - 2 obtains a graphical element 145 - 1 or multiple graphical elements 145 -N.
- the graphical element identifying process 140 - 2 automatically obtains a graphical element 145 - 1 or multiple graphical elements 145 -N.
- the graphical element identifying process 140 - 2 receives selection criteria provided by the user 108 .
- the selection criteria are used to identify the graphical element 145 - 1 associated with the selection of content 185 .
- a user 108 can specify selection criteria from which the graphical element 145 - 1 should be selected by the graphical element identifying process 140 - 2 .
- a user 108 might provide keywords to use to select the graphical element 145 - 1 , as well as operators, such as “and” and “or” with which to further refine the search criteria.
- a user 108 could specify “golf and course” as selection criteria from which the graphical element 145 - 1 would be selected by the graphical element identifying process 140 - 2 . This selection criteria would result in the selection of graphical elements 145 -N related to “golf courses”.
- the graphical element identifying process 140 - 2 derives conceptual information associated with the content 185 .
- the conceptual information is used to identify the graphical element 145 - 1 associated with the selection of content 185 .
- the concept of the selection of content 185 is derived from one word of text within the digital composition 180 or a plurality of words, or even a combination of words and graphical elements 145 -N that already exist within the digital composition 180 .
- the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 associated with the content 185 .
- the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 from a graphical elements database 125 .
- the graphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites.
- the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 within the digital composition 180 .
- the graphical element identifying process 140 - 2 automatically displays appropriate graphical elements 145 -N within the digital composition 180 . It should be noted that the graphical elements 145 -N could be images, videos, etc.
- FIG. 3 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it receives a selection of content 185 from a digital composition 180 , via an upload of an application containing the digital composition 180 , and obtains a graphical element 145 - 1 that matches the concept of the selected content 185 , according to one embodiment disclosed herein.
- the graphical element identifying process 140 - 2 receives a selection of content 185 within the digital composition 180 .
- the selection of content 185 is all of the content 185 contained within the digital composition 180 .
- the graphical element identifying process 140 - 2 receives an application containing the contents 185 within the digital composition 180 .
- the graphical element identifying process 140 - 2 receives an application, for example, an MS Word document or a PowerPoint presentation, as the selection of content 185 .
- the graphical element identifying process 140 - 2 derives conceptual information associated with the content 185 .
- the graphical element identifying process 140 - 2 derives the concept of a whole PowerPoint presentation (i.e., the text of the PowerPoint presentation as well as any graphical elements 145 -N within the PowerPoint presentation).
- step 209 the graphical element identifying process 140 - 2 obtains the graphical elements 145 -N associated with the content 185 .
- the graphical elements 145 -N are obtained from the graphical elements database 125 .
- the graphical element identifying process 140 - 2 obtains a plurality of graphical elements 145 -N associated with the application.
- the graphical element identifying process 140 - 2 obtains a plurality of graphical elements 145 -N that match the concept of the PowerPoint presentation.
- the graphical element identifying process 140 - 2 identifies a plurality of locations within the application. Each location within the plurality of locations identifies where each respective graphical element 145 - 1 within the plurality of graphical elements 145 -N should be positioned in the application.
- the graphical element identifying process 140 - 2 provides the graphical elements 145 -N that match the concept of the PowerPoint presentation, and also provides information as to where within the PowerPoint presentation (i.e., which pages within the PowerPoint presentation), those graphical elements 145 -N should be placed.
- FIG. 4 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it derives conceptual information associated with the content 185 , and obtains the graphical element 145 - 1 based on that derived concept, according to one embodiment disclosed herein.
- the graphical element identifying process 140 - 2 derives conceptual information associated with the content 185 .
- the conceptual information is used to identify the graphical element 145 - 1 associated with the selection of content 185 .
- the concept of the selection of content 185 is derived from one word of text within the digital composition 180 or a plurality of words, or even a combination of words and graphical elements 145 - 1 that already exist within the digital composition 180 .
- the graphical element identifying process 140 - 2 applies a policy to the content 185 to derive a concept associated with the content 185 .
- the graphical element identifying process 140 - 2 views the selected content 185 , and applies a policy to the selected content 185 to determine the concept of the content 185 .
- the policy might dictate to strip out unnecessary words, such as “the”, “an”, “a”, etc. from the content 185 , and then use the remaining words in the selected content 185 as keywords with which to search the graphical elements database 125 .
- the graphical element identifying process 140 - 2 obtains attributes 155 -N associated with a plurality of graphical elements 145 -N contained within the selection of content 185 , to determine attributes associated with the concept of the selection of content 185 .
- the selected content 185 contains both text and graphical elements 145 -N.
- Attributes 155 -N (or metadata) of those graphical elements 145 -N are used as search criteria when searching for graphical elements 145 -N within the graphical elements database 125 that match the concept of the graphical elements 145 -N already contained within the selection of content 185 within the digital composition 180 .
- the graphical element identifying process 140 - 2 obtains a plurality of content keywords from the content 185 .
- the graphical element identifying process 140 - 2 obtains a plurality of content keywords associated with the content 185 .
- the keywords can be gleaned from the text within the content, or can be keywords (i.e., attributes 155 -N) associated with graphical elements 145 -N already contained within the selection of content 185 within the digital composition 180 .
- the graphical element identifying process 140 - 2 evaluates the plurality of content keywords to give a priority to a portion of the content keywords within the plurality of content keywords.
- the priority is utilized when correlating the content keywords to the concept associated with the content 185 .
- some of the keywords will be given greater weight than others when determining the concept of the selection of content 185 . For example, if the content 185 contains keywords such as “night life” and “Paris”, the concept of the content 185 has more to do with “night life in Paris” than with “night life” in general.
- the graphical element identifying process 140 - 2 deduces the concept associated with the content 185 based on the plurality of content keywords obtained from the content 185 . For example, if the keywords gleaned from the content 185 are “dog”, “car” and “beach”, the graphical element identifying process 140 - 2 could infer that the concept of the content 185 is related to leisure time activities.
- the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 associated with the content 185 .
- the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 from a graphical elements database 125 .
- the graphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites.
- the graphical element identifying process 140 - 2 matches the portion of the content keywords to graphical element keywords associated with a plurality of potential graphical elements 145 -N to determine the graphical element 145 - 1 that matches the concept of the content 185 .
- the graphical element identifying process 140 - 2 uses those content keywords as search criteria when searching the graphical elements database 125 (i.e., the graphical elements provider web sites).
- the content keywords are matched against graphical element keywords (i.e., attributes 155 -N) that are associated with the graphical elements 145 -N contained within the graphical elements database 125 .
- FIG. 5 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it displays the graphical element 145 - 1 within the digital composition 180 , and allows a user 108 to perform an action on the displayed graphical element 145 - 1 , according to one embodiment disclosed herein.
- step 220 the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 within the digital composition 180 .
- the digital composition 180 contains areas designated for text and areas designated for displaying graphical elements 145 -N.
- the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 within a graphical element location 150 within the digital composition 180 .
- the digital composition 180 contains a graphical element location 150 where the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 for the user 108 to view the graphical element 145 - 1 selected by the graphical element identifying process 140 - 2 .
- the graphical element identifying process 140 - 2 indicates there is at least one additional graphical element 145 - 1 available to be viewed within the graphical element location 150 within the digital composition 180 .
- the graphical element identifying process 140 - 2 displays only one graphical element 145 - 1 at a time.
- the graphical element identifying process 140 - 2 indicates there are more graphical elements 145 -N for viewing by modifying the graphical elements location 150 to include, for example, slider bars indicating there are more graphical elements 145 -N for display.
- the graphical element identifying process 140 - 2 indicates there is a plurality of graphical elements 145 -N exceeding a threshold associated with the digital composition 180 .
- the threshold identifies a maximum number of graphical elements 145 -N to be viewed within the graphical element location 150 within the digital composition 180 .
- the digital composition 180 has a maximum number of graphical elements 145 -N that can be displayed within the graphical elements location 150 .
- the graphical element identifying process 140 - 2 indicates to the user 108 that more graphical elements 145 -N (that have been identified as matching the concept derived from the selection of content 185 ) have been identified.
- the graphical element identifying process 140 - 2 directs the user 108 to a graphical elements database 125 to view the plurality of graphical elements 145 -N.
- the graphical element identifying process 140 - 2 notifies the user 108 that the maximum number of graphical elements 145 -N (that can be displayed within the graphical elements location 150 ) has been reached, and the graphical elements 145 -N (that have been identified as matching the concept derived from the selection of content 185 ) can be viewed at the graphical elements provider web site(s).
- the graphical element identifying process 140 - 2 then directs the user 108 to those web sites.
- the graphical element identifying process 140 - 2 allow a user to perform an action, such as selecting, downloading and/or purchasing the graphical element 145 -N.
- the user 108 views the available graphical elements 145 -N, selects one graphical element 145 - 1 that is matches the concept of the digital composition 180 , purchases that graphical element 145 - 1 from the graphical element content provider, and downloads the graphical element 145 - 1 for use in the digital composition 180 .
- the graphical element identifying process 140 - 2 is automatically invoked based on the entire content 185 of the digital composition 180 . In another example configuration, the graphical element identifying process 140 - 2 is automatically invoked based on a portion of the content 185 , such as a page, chapter, paragraph, sentence, etc.
Abstract
A system receives a selection of content within the digital composition, and derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The system obtains the graphical element associated with the content, and displays the graphical element within the digital composition.
Description
- This patent application is a Continuation of U.S. patent application Ser. No. 11/316,441 filed on Dec. 22, 2005, entitled, “METHODS AND APPARATUS TO IDENTIFY GRAPHICAL ELEMENTS”, the contents and teachings of which are hereby incorporated by reference in their entirety.
- Conventional computerized devices, such as personal computers, laptop computers, and the like utilize graphical user interface in applications, such as operating systems, and graphical editors (i.e., web page editors, document editors, etc.) that enable users to quickly provide input and create documents and/or projects using “What You See Is What You Get” (WYSIWYG) technology. In general, using a graphical user interface, a user operates an input device such as a mouse or keyboard to manipulate graphical objects on a computer display. The graphical objects are often represented as icons, and the user can operate an input device such as a mouse to move a mouse pointer onto an icon (i.e., graphically overlapping the icon) on the graphical user interface. By depressing a mouse button, the application (such as the operating system desktop) selects the icon, and if the user maintains the mouse button in a depressed state, the user can drag the icon across the graphical user interface. By releasing the mouse button, the icon is placed on the graphical user interface at the current position of the mouse pointer.
- Using graphical user interface technology, users can create and update documents (i.e., web pages, brochures, etc) and/or projects by dragging and dropping text, text boxes, graphical elements, etc. into the document and/or project. Users can select the graphical elements (i.e., photographs, graphics, etc) used in the documents by selecting images from content providers. Content providers provide graphical elements (e.g., photographs, graphics, etc) for document developers to view and/or purchase from content provider web sites. Document developers are able to perform online searches by providing search criteria such as keywords, and then choose from the results to make a purchase. As an example, if a document developer is looking for pictures of cars, they can visit a content provider web site that sells graphical elements and can enter the search term “cars”. In response, the content provider web site searches a library of graphical elements (that may include more than one content provider web site) and can compile the results of the search. The document developer can then choose the appropriate graphical element(s) from the search results.
- Conventional technologies for providing customers with purchasable graphical elements suffer from a variety of deficiencies. In particular, conventional technologies that provide users with graphical elements are limited in that the user has to go to a content provider web site, search for graphical elements that match the user's requirements, view the available graphical elements that match those requirements, choose the suitable graphical element(s), and place the chosen graphical element(s) in the appropriate place in the user's document.
- Embodiments disclosed herein significantly overcome such deficiencies and provide a system that includes a computer system executing a graphical element identifying process. Based on the content (i.e., the text and/or the graphical elements) within a digital composition (i.e., a document, etc), the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element from, for example, a content provider web site. In an example configuration, the graphical elements are provided by the application in which the user enters the content. The graphical element is chosen to match the concept of the digital composition. The graphical element identifying process then places the selected graphical element (i.e., the graphical elements for selection by a user) in a graphical element location within the digital composition. The graphical element identifying process can display one or more graphical elements for the user to select. Graphical elements are chosen to match the concept of the digital composition by matching keywords associated with the graphical element to keywords associated with the content (i.e., text and/or graphical elements already existing within the content).
- The graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element (or multiple graphical elements) within the digital composition.
- During an example operation of one embodiment, suppose a document developer is developing a brochure for a charity golf event. The document developer enters the details of the charity golf event (i.e., the time, location, the charity involved, celebrities who will be in attendance, etc) into an application used to develop the brochure. The graphical element identifying process receives a selection of the details of the charity golf event, for example, via a user highlighting the selection within the application used to develop the brochure. The graphical element identifying process derives the concept of the brochure by identifying keywords within the selection, such as “golf course”. The graphical element identifying process matches the search criteria to one or more graphical element databases containing photographs, images and other graphical elements. The graphical element identifying process then obtains those graphical elements that match the search criteria of “golf course”, and displays those graphical elements within the application used to develop the brochure, at an appropriate location on the brochure.
- Other embodiments of the disclosed herein include any type of computerized device, workstation, handheld or laptop computer, or the like configured with software and/or circuitry (e.g., a processor) to process any or all of the method operations disclosed herein. In other words, a computerized device such as a computer or a data communications device or any type of processor that is programmed or configured to operate as explained herein is considered an embodiment disclosed herein.
- Other embodiments that are disclosed herein include software programs to perform the steps and operations summarized above and disclosed in detail below. One such embodiment comprises a computer program product that has a computer-readable medium including computer program logic encoded thereon that, when performed in a computerized device having a coupling of a memory and a processor, programs the processor to perform the operations disclosed herein. Such arrangements are typically provided as software, code and/or other data (e.g., data structures) arranged or encoded on a computer readable medium such as an optical medium (e.g., CD-ROM), floppy or hard disk or other a medium such as firmware or microcode in one or more ROM or RAM or PROM chips or as an Application Specific Integrated Circuit (ASIC). The software or firmware or other such configurations can be installed onto a computerized device to cause the computerized device to perform the techniques explained as embodiments disclosed herein.
- It is to be understood that the system disclosed herein may be embodied strictly as a software program, as software and hardware, or as hardware alone. Embodiments disclosed herein, may be employed in data communications devices and other computerized devices and software systems for such devices such as those manufactured by Adobe Systems, Inc. of San Jose, Calif.
- The foregoing disclosed herein will be apparent from the following description of particular embodiments disclosed herein, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles disclosed herein.
-
FIG. 1 shows a high-level block diagram of a computer system according to one embodiment disclosed herein. -
FIG. 2 illustrates a flowchart of an embodiment of a procedure performed by the system ofFIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a graphical element within the digital composition. -
FIG. 3 illustrates a flowchart of an embodiment of a procedure performed by the system ofFIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a plurality of graphical elements within the digital composition. -
FIG. 4 illustrates a flowchart of an embodiment of a procedure performed by the system ofFIG. 1 when the graphical element identifying process derives conceptual information associated with the content. -
FIG. 5 illustrates a flowchart of an embodiment of a procedure performed by the system ofFIG. 1 when the graphical element identifying process displays the graphical element within the digital composition. - Embodiments disclosed herein include a computer system that performs a graphical element identifying process that executing a graphical element identifying process. Based on the content (i.e., the text and/or the graphical elements) within a digital composition (i.e., a document, etc), the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element (i.e., image, photograph, video, etc) from a content provider web site, such as a graphical element database (or more than one graphical element databases). The graphical element is chosen to match the concept of the digital composition. The graphical element identifying process places the selected graphical element in a graphical element location within the digital composition. In an example embodiment, the content can be selected by a user and the graphical element identifying process invoked by the user. In another example embodiment, the graphical element identifying process automatically obtains graphical elements that match the concept of the content, and dynamically updates those results (i.e., the graphical elements obtained to match the concept of the content) as additional content is added to the digital composition. In yet another example embodiment, the graphical element identifying process automatically obtains graphical elements based on, for example, words, that occur within the content more than a predefined number of times, within the content. For example, if the phrase ‘golf course’ occurs within the content, for example, more than three times, then the graphical element identifying process would automatically obtain graphical elements that match the concept of a golf course.
- In one embodiment, the graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element within the digital composition, for a user to view. The user can select the displayed graphical element, or choose from multiple graphical elements that are presented to the user.
-
FIG. 1 is a block diagram illustrating example architecture of acomputer system 110 that executes, runs, interprets, operates or otherwise performs a graphical element identifying application 140-1 and process 140-2 suitable for use in explaining example embodiments disclosed herein. Thecomputer system 110 may be any type of computerized device such as a personal computer, workstation, portable computing device, console, laptop, network terminal or the like. As shown in this example, thecomputer system 110 includes aninterconnection mechanism 111 such as a data bus or other circuitry that couples amemory system 112, aprocessor 113, an input/output interface 114, and acommunications interface 115. An input device 116 (e.g., one or more user/developer controlled devices such as a keyboard, mouse, etc.) couples toprocessor 113 through I/O interface 114 and enables auser 108 to provide input commands and generally control thegraphical user interface 160 on thedisplay 130. Thegraphical user interface 160 contains adigital composition 180 containing content 185 (that can also contain graphical elements 145-N) and agraphical element location 150. Thegraphical element location 150 contains a graphical element 145-1 and attributes 155-1 associated with the graphical element 145-1. Also in this example configuration, agraphical elements database 125 stores graphical elements 145-N (and attributes 155-N associated with those graphical elements 145-N) developed in accordance with techniques described herein within a computer readable medium. Thecommunications interface 115 enables thecomputer system 110 to communicate with other devices (i.e., other computers) on a network (not shown). This can allow access to the graphical element identifying application by remote computer systems. - The
memory system 112 is any type of computer readable medium and in this example is encoded with a graphical element identifying application 140-1 that supports generation, display, and implementation of functional operations of thegraphical user interface 160 as explained herein. The graphical element identifying application 140-1 may be embodied as software code such as data and/or logic instructions (e.g., code stored in the memory or on another computer readable medium such as a removable disk) that supports processing functionality according to different embodiments described herein. During operation of thecomputer system 110, theprocessor 113 accesses thememory system 112 via theinterconnect 111 in order to launch, run, execute, interpret or otherwise perform the logic instructions of the graphical element identifying application 140-1. Execution of graphical element identifying application 140-1 in this manner produces processing functionality in a graphical element identifying process 140-2. In other words, the graphical element identifying process 140-2 represents one or more portions or runtime instances of the graphical element identifying application 140-1 (or the entire application 140-1) performing or executing within or upon theprocessor 113 in thecomputerized device 110 at runtime. The graphical element identifying process 140-2 operates as explained herein to identify graphical elements 145-N to be used in the development of adigital composition 180 within thegraphical user interface 160. - It is noted that example configurations disclosed herein include the graphical element identifying application 140-1. The graphical element identifying application 140-1 may be stored on a computer readable medium (such as a floppy disk), hard disk, electronic, magnetic, and optical or other computer readable medium. The graphical element identifying application 140-1 may also be stored in a
memory system 112 such as in firmware, read only memory (ROM), or, as in this example, as executable code in, for example, Random Access Memory (RAM). In addition to these embodiments, it should also be noted that other embodiments herein include the execution of the graphical element identifying application 140-1 in theprocessor 113 as the graphical element identifying process 140-2. Those skilled in the art will understand that thecomputer system 110 may include other processes and/or software and hardware components, such as an operating system not shown in this example. - A
display 130 need not be coupled directly tocomputer system 110. For example, the graphical element identifying application 140-1 can be executed on a remotely accessible computerized device via thenetwork interface 115. In this instance, thegraphical user interface 160 may be displayed locally to a user of the remote computer and execution of the processing herein may be client-server based. - Further details of configurations explained herein will now be provided with respect to a flow chart of processing steps that show the high level operations disclosed herein to perform the graphical element identifying process 140-2.
-
FIG. 2 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it receives a selection ofcontent 185 from adigital composition 180 and obtains a graphical element 145-1 that matches the concept of the selectedcontent 185, according to one embodiment disclosed herein. - In
step 200, the graphical element identifying process 140-2 receives a selection ofcontent 185 within thedigital composition 180. In an example configuration, as auser 108 enterscontent 185 into thedigital composition 180, a pop up window appears containing the selection ofcontent 185 that the graphical element identifying process 140-2 will use to obtain a graphical element 145-1 that matches the concept (i.e., the central ‘theme’) of the selection ofcontent 185. It should be noted thatcontent 185 can contain, but is not limited to, graphical elements 145-N as well asother content 185, such as text. In an example embodiment, the concept is determined by keywords contained within the content. - In step 201, the graphical element identifying process 140-2 receives notification, via a notification mechanism, that a selection of
content 185 within thedigital composition 180 has been identified as the selection ofcontent 185 to which a graphical element 145-1 will be associated. For example, the notification mechanism could be a pop up window, a menu button,content 185 selected by auser 108, or accentuatedcontent 185. In an example configuration, the graphical element identifying process 140-2 receives notification of selectedcontent 185 via a pop up window that appears, displaying a selection ofcontent 185 from thedigital composition 180 that is used to derive the concept of the selectedcontent 185. In another example configuration, the application used to create thedigital composition 180 provides a menu button that auser 108 can select to notify the graphical element identifying process 140-2 that a portion ofcontent 185 has been selected. In yet another example configuration, auser 108, who highlights a portion ofcontent 185, identifies the selection ofcontent 185. In yet another example configuration, the selection ofcontent 185, such as text, is accentuated within thedigital composition 180, for example, by either highlighting thecontent 185 or underlining thecontent 185 in a color that matches or contrasts with the color of the font in which the content (i.e., text) is written. Theuser 108 can then request that the graphical element identifying process 140-2 obtains a graphical element 145-1 or multiple graphical elements 145-N. In an example configuration, the graphical element identifying process 140-2 automatically obtains a graphical element 145-1 or multiple graphical elements 145-N. - In step 202, the graphical element identifying process 140-2 receives selection criteria provided by the
user 108. The selection criteria are used to identify the graphical element 145-1 associated with the selection ofcontent 185. In an example configuration, auser 108 can specify selection criteria from which the graphical element 145-1 should be selected by the graphical element identifying process 140-2. In this example, auser 108 might provide keywords to use to select the graphical element 145-1, as well as operators, such as “and” and “or” with which to further refine the search criteria. In other words, auser 108 could specify “golf and course” as selection criteria from which the graphical element 145-1 would be selected by the graphical element identifying process 140-2. This selection criteria would result in the selection of graphical elements 145-N related to “golf courses”. - In step 203, the graphical element identifying process 140-2 derives conceptual information associated with the
content 185. The conceptual information is used to identify the graphical element 145-1 associated with the selection ofcontent 185. In an example configuration, the concept of the selection ofcontent 185 is derived from one word of text within thedigital composition 180 or a plurality of words, or even a combination of words and graphical elements 145-N that already exist within thedigital composition 180. - In
step 204, the graphical element identifying process 140-2 obtains the graphical element 145-1 associated with thecontent 185. The graphical element identifying process 140-2 obtains the graphical element 145-1 from agraphical elements database 125. In an example configuration, thegraphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites. - In
step 205, the graphical element identifying process 140-2 displays the graphical element 145-1 within thedigital composition 180. In an example configuration, as auser 108 enterscontent 185 within thedigital composition 180, the graphical element identifying process 140-2 automatically displays appropriate graphical elements 145-N within thedigital composition 180. It should be noted that the graphical elements 145-N could be images, videos, etc. -
FIG. 3 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it receives a selection ofcontent 185 from adigital composition 180, via an upload of an application containing thedigital composition 180, and obtains a graphical element 145-1 that matches the concept of the selectedcontent 185, according to one embodiment disclosed herein. - In
step 206, the graphical element identifying process 140-2 receives a selection ofcontent 185 within thedigital composition 180. In an example configuration, the selection ofcontent 185 is all of thecontent 185 contained within thedigital composition 180. - In
step 207, the graphical element identifying process 140-2 receives an application containing thecontents 185 within thedigital composition 180. In an example configuration, the graphical element identifying process 140-2 receives an application, for example, an MS Word document or a PowerPoint presentation, as the selection ofcontent 185. - In step 208, the graphical element identifying process 140-2 derives conceptual information associated with the
content 185. The conceptual information to be used to identify the graphical elements 145-N associated with thecontent 185. In an example configuration, the graphical element identifying process 140-2 derives the concept of a whole PowerPoint presentation (i.e., the text of the PowerPoint presentation as well as any graphical elements 145-N within the PowerPoint presentation). - In
step 209, the graphical element identifying process 140-2 obtains the graphical elements 145-N associated with thecontent 185. The graphical elements 145-N are obtained from thegraphical elements database 125. - In
step 210, the graphical element identifying process 140-2 obtains a plurality of graphical elements 145-N associated with the application. In an example configuration, based on the concept derived from the whole PowerPoint presentation uploaded to the graphical element identifying process 140-2, the graphical element identifying process 140-2 obtains a plurality of graphical elements 145-N that match the concept of the PowerPoint presentation. - In
step 211, the graphical element identifying process 140-2 identifies a plurality of locations within the application. Each location within the plurality of locations identifies where each respective graphical element 145-1 within the plurality of graphical elements 145-N should be positioned in the application. In an example configuration, the graphical element identifying process 140-2 provides the graphical elements 145-N that match the concept of the PowerPoint presentation, and also provides information as to where within the PowerPoint presentation (i.e., which pages within the PowerPoint presentation), those graphical elements 145-N should be placed. -
FIG. 4 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it derives conceptual information associated with thecontent 185, and obtains the graphical element 145-1 based on that derived concept, according to one embodiment disclosed herein. - In step 212, the graphical element identifying process 140-2 derives conceptual information associated with the
content 185. The conceptual information is used to identify the graphical element 145-1 associated with the selection ofcontent 185. In an example configuration, the concept of the selection ofcontent 185 is derived from one word of text within thedigital composition 180 or a plurality of words, or even a combination of words and graphical elements 145-1 that already exist within thedigital composition 180. - In
step 213, the graphical element identifying process 140-2 applies a policy to thecontent 185 to derive a concept associated with thecontent 185. In an example configuration, the graphical element identifying process 140-2 views the selectedcontent 185, and applies a policy to the selectedcontent 185 to determine the concept of thecontent 185. For example, the policy might dictate to strip out unnecessary words, such as “the”, “an”, “a”, etc. from thecontent 185, and then use the remaining words in the selectedcontent 185 as keywords with which to search thegraphical elements database 125. - In
step 214, the graphical element identifying process 140-2 obtains attributes 155-N associated with a plurality of graphical elements 145-N contained within the selection ofcontent 185, to determine attributes associated with the concept of the selection ofcontent 185. In an example configuration, the selectedcontent 185 contains both text and graphical elements 145-N. Attributes 155-N (or metadata) of those graphical elements 145-N, such as keywords associated with the graphical elements 145-N, or the color space of those graphical elements 145-N (i.e., the color schemes, the brightness value, contrast value, colored images versus black and white images, etc) are used as search criteria when searching for graphical elements 145-N within thegraphical elements database 125 that match the concept of the graphical elements 145-N already contained within the selection ofcontent 185 within thedigital composition 180. - Alternatively, in
step 215, the graphical element identifying process 140-2 obtains a plurality of content keywords from thecontent 185. In an example configuration, the graphical element identifying process 140-2 obtains a plurality of content keywords associated with thecontent 185. The keywords can be gleaned from the text within the content, or can be keywords (i.e., attributes 155-N) associated with graphical elements 145-N already contained within the selection ofcontent 185 within thedigital composition 180. - In
step 216, the graphical element identifying process 140-2 evaluates the plurality of content keywords to give a priority to a portion of the content keywords within the plurality of content keywords. The priority is utilized when correlating the content keywords to the concept associated with thecontent 185. In other words, within the group of keywords gleaned from the selection ofcontent 185, some of the keywords will be given greater weight than others when determining the concept of the selection ofcontent 185. For example, if thecontent 185 contains keywords such as “night life” and “Paris”, the concept of thecontent 185 has more to do with “night life in Paris” than with “night life” in general. - In
step 217, the graphical element identifying process 140-2 deduces the concept associated with thecontent 185 based on the plurality of content keywords obtained from thecontent 185. For example, if the keywords gleaned from thecontent 185 are “dog”, “car” and “beach”, the graphical element identifying process 140-2 could infer that the concept of thecontent 185 is related to leisure time activities. - In
step 218, the graphical element identifying process 140-2 obtains the graphical element 145-1 associated with thecontent 185. The graphical element identifying process 140-2 obtains the graphical element 145-1 from agraphical elements database 125. In an example configuration, thegraphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites. - In step 219, the graphical element identifying process 140-2 matches the portion of the content keywords to graphical element keywords associated with a plurality of potential graphical elements 145-N to determine the graphical element 145-1 that matches the concept of the
content 185. In other words, the graphical element identifying process 140-2 uses those content keywords as search criteria when searching the graphical elements database 125 (i.e., the graphical elements provider web sites). The content keywords are matched against graphical element keywords (i.e., attributes 155-N) that are associated with the graphical elements 145-N contained within thegraphical elements database 125. -
FIG. 5 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it displays the graphical element 145-1 within thedigital composition 180, and allows auser 108 to perform an action on the displayed graphical element 145-1, according to one embodiment disclosed herein. - In
step 220, the graphical element identifying process 140-2 displays the graphical element 145-1 within thedigital composition 180. In an example configuration, thedigital composition 180 contains areas designated for text and areas designated for displaying graphical elements 145-N. - In
step 221, the graphical element identifying process 140-2 displays the graphical element 145-1 within agraphical element location 150 within thedigital composition 180. In an example configuration, thedigital composition 180 contains agraphical element location 150 where the graphical element identifying process 140-2 displays the graphical element 145-1 for theuser 108 to view the graphical element 145-1 selected by the graphical element identifying process 140-2. - In
step 222, the graphical element identifying process 140-2 indicates there is at least one additional graphical element 145-1 available to be viewed within thegraphical element location 150 within thedigital composition 180. In an example configuration, if there is more than one graphical element 145-1 to display within thegraphical element location 150, the graphical element identifying process 140-2 displays only one graphical element 145-1 at a time. The graphical element identifying process 140-2 indicates there are more graphical elements 145-N for viewing by modifying thegraphical elements location 150 to include, for example, slider bars indicating there are more graphical elements 145-N for display. - In
step 223, the graphical element identifying process 140-2 indicates there is a plurality of graphical elements 145-N exceeding a threshold associated with thedigital composition 180. The threshold identifies a maximum number of graphical elements 145-N to be viewed within thegraphical element location 150 within thedigital composition 180. In an example configuration, thedigital composition 180 has a maximum number of graphical elements 145-N that can be displayed within thegraphical elements location 150. Once that maximum is reached, the graphical element identifying process 140-2 indicates to theuser 108 that more graphical elements 145-N (that have been identified as matching the concept derived from the selection of content 185) have been identified. - In step 224, the graphical element identifying process 140-2 directs the
user 108 to agraphical elements database 125 to view the plurality of graphical elements 145-N. In an example configuration, the graphical element identifying process 140-2 notifies theuser 108 that the maximum number of graphical elements 145-N (that can be displayed within the graphical elements location 150) has been reached, and the graphical elements 145-N (that have been identified as matching the concept derived from the selection of content 185) can be viewed at the graphical elements provider web site(s). The graphical element identifying process 140-2 then directs theuser 108 to those web sites. - In step 225, the graphical element identifying process 140-2 allow a user to perform an action, such as selecting, downloading and/or purchasing the graphical element 145-N. In an example configuration, the
user 108 views the available graphical elements 145-N, selects one graphical element 145-1 that is matches the concept of thedigital composition 180, purchases that graphical element 145-1 from the graphical element content provider, and downloads the graphical element 145-1 for use in thedigital composition 180. - In an example configuration, the graphical element identifying process 140-2 is automatically invoked based on the
entire content 185 of thedigital composition 180. In another example configuration, the graphical element identifying process 140-2 is automatically invoked based on a portion of thecontent 185, such as a page, chapter, paragraph, sentence, etc. - While computer systems and methods have been particularly shown and described above with references to configurations thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope disclosed herein. Accordingly, embodiments disclosed herein are not intended to be limited by the example configurations provided above.
Claims (20)
1. A method comprising:
receiving input of multiple portions of text within a document displayed in a display area associated with at least one computer system;
while receiving the input of multiple portions of text, monitoring occurrences of each portion of text in the document;
upon determining a first portion of text occurs in the document a predetermined number of times, deriving conceptual information associated with the first portion of text;
obtaining a graphical element associated with the conceptual information;
identifying a document location for display of the graphical element; and
displaying the graphical element in the document location.
2. The method as in claim 1 , comprising:
wherein obtaining the graphical element includes: obtaining multiple graphical elements associated with conceptual information; and
wherein displaying the graphical element in the document location includes:
(i) modifying the document location in the document by adding at least one slide bar at the document location;
(ii) displaying a first graphical element at the document location; and
(iii) based on detected advancement of the slide bar, gradually displaying a second graphical element in place of the displayed first graphical element.
3. The method as in claim 2 , comprising:
indicating whether the multiple graphical elements exceeds a threshold associated with the document, the threshold representing a maximum number of graphical elements to be viewed within the document location;
wherein obtaining the multiple graphical element includes: obtaining a first subset of the multiple graphical elements, the first subset comprising a number of graphical elements equal to the threshold associated with the document; and
wherein displaying the graphical element in the document location includes:
(i) providing display of each graphical element from first subset of graphical elements based on advancement of the slide bar in the document location; and
(ii) indicating there is at least one additional graphical element accessible via at least one web site.
4. The method as in claim 1 , comprising:
while displaying the graphical element in the document location, determining a second portion of text occurs in the document the predetermined number of times;
deriving second conceptual information associated with the second portion of text;
obtaining a second graphical element associated with the second conceptual information;
identifying a second document location for display of the second graphical element; and
displaying the second graphical element in the second document location in conjunction with display of the graphical element in the document location.
5. The method as in claim 1 , comprising:
wherein determining the first portion of text occurs in the document the predetermined number of times includes: determining a phrase occurs in the document the predetermined number of times, the phrase comprising at least two words;
wherein deriving conceptual information associated with the first portion of text includes:
(i) obtaining at least one keyword from the phrase upon discarding any predefined unnecessary words from the phrase;
(ii) inferring the at least one keyword from the phrase relates to category of activities; and
wherein obtaining the graphical element includes: obtaining a first graphical element associated with the category of activities.
6. The method as in claim 1 , wherein deriving conceptual information associated with the first portion of text includes:
upon deriving the conceptual information associated with the first portion of text, displaying the conceptual information in a pop-up window as additional portions of text are being received in the document, the document displayed in a document text editor; and
wherein displaying the graphical element in the document location includes: displaying an image devoid of text.
7. The method as in claim 1 , wherein obtaining the graphical element associated with the conceptual information includes:
obtaining the graphical element according to a color space indicated in the graphical element's metadata, the color space selected from the group comprising: a color scheme, a brightness value, a contrast value, an identification of being a black-and-white image, and an identification of being a color image.
8. The method as in claim 1 , comprising:
detecting at least one highlighted portion of text in the document; and
deriving the conceptual information associated with the first portion of text and the at least one highlighted portion of text.
9. The method as in claim 1 , comprising:
wherein determining the first portion of text occurs in the document the predetermined number of times includes: determining a first phrase occurs in the document the predetermined number of times, the first phrase comprising at least two words;
wherein deriving conceptual information associated with the first portion of text includes:
(i) obtaining at least one keyword from the first phrase upon discarding any predefined unnecessary words from the first phrase;
(ii) inferring the at least one keyword from the first phrase relates to a first category of activities;
wherein obtaining the graphical element includes: obtaining a first graphical element associated with the first category of activities;
upon deriving the first category of activities associated with the first portion of text, displaying the first category of activities in a pop-up window as additional portions of text are being received in the document,
determining a second portion of text occurs in the document the predetermined number of times, the second portion of text comprising a second phrase of at least two words;
deriving second conceptual information associated with the second portion of text by repeating the steps of (i) obtaining at least one keyword and (ii) inferring with respect to the second phrase in order to determine a second category of activities;
displaying the second category of activities in the pop-up window as additional portions of text are being received in the document;
obtaining a second graphical element associated with the second category of activities;
identifying a second document location for display of the second graphical element; and
displaying the second graphical element in the second document location in conjunction with display of the first graphical element in the document location.
10. A computer readable medium comprising executable instructions encoded thereon operable on a computerized device to perform processing comprising:
instructions for receiving input of multiple portions of text within a document displayed in a display area associated with at least one computer system;
instructions for monitoring occurrences of each portion of text in the document while receiving the input of multiple portions of text;
instructions for deriving conceptual information associated with the first portion of text upon determining a first portion of text occurs in the document a predetermined number of times;
instructions for obtaining a graphical element associated with the conceptual information;
instructions for identifying a document location for display of the graphical element; and
instructions for displaying the graphical element in the document location.
11. The computer readable medium as in claim 10 , comprising:
wherein the instructions for obtaining the graphical element include: instructions for obtaining multiple graphical elements associated with conceptual information; and
wherein the instructions for displaying the graphical element in the document location include:
instructions for modifying the document location in the document by adding at least one slide bar at the document location;
instructions for displaying a first graphical element at the document location; and
instructions for gradually displaying a second graphical element in place of the displayed first graphical element based on detected advancement of the slide bar.
12. The computer readable medium as in claim 11 , comprising:
instructions for indicating whether the multiple graphical elements exceeds a threshold associated with the document, the threshold representing a maximum number of graphical elements to be viewed within the document location;
wherein the instructions for obtaining the multiple graphical element include:
instructions for obtaining a first subset of the multiple graphical elements, the first subset comprising a number of graphical elements equal to the threshold associated with the document; and
wherein the instructions for displaying the graphical element in the document location include:
instructions for providing display of each graphical element from first subset of graphical elements based on advancement of the slide bar in the document location; and
instructions for indicating there is at least one additional graphical element accessible via at least one web site.
13. The computer readable medium as in claim 10 , comprising:
instructions for determining a second portion of text occurs in the document the predetermined number of times while displaying the graphical element in the document location;
instructions for deriving second conceptual information associated with the second portion of text;
instructions for obtaining a second graphical element associated with the second conceptual information;
instructions for identifying a second document location for display of the second graphical element; and
instructions for displaying the second graphical element in the second document location in conjunction with display of the graphical element in the document location.
14. The computer readable medium as in claim 10 , comprising:
wherein the instructions for determining the first portion of text occurs in the document the predetermined number of times include: instructions for determining a phrase occurs in the document the predetermined number of times, the phrase comprising at least two words;
wherein the instructions for deriving conceptual information associated with the first portion of text include:
instructions for obtaining at least one keyword from the phrase upon discarding any predefined unnecessary words from the phrase;
instructions for inferring the at least one keyword from the phrase relates to category of activities; and
wherein the instructions for obtaining the graphical element include: instructions for obtaining a first graphical element associated with the category of activities.
15. The computer readable medium as in claim 10 , wherein the instructions for deriving conceptual information associated with the first portion of text include:
instructions for displaying the conceptual information in a pop-up window, upon deriving the conceptual information associated with the first portion of text, as additional portions of text are being received in the document, the document displayed in a document text editor; and
wherein instructions for displaying the graphical element in the document location include: instructions for displaying an image devoid of text.
16. The computer readable medium as in claim 10 , wherein the instructions for obtaining the graphical element associated with the conceptual information include:
instructions for obtaining the graphical element according to a color space indicated in the graphical element's metadata, the color space selected from the group comprising: a color scheme, a brightness value, a contrast value, an identification of being a black-and-white image, and an identification of being a color image.
17. The computer readable medium as in claim 10 , comprising:
instructions for detecting at least one highlighted portion of text in the document; and
instructions for deriving the conceptual information associated with the first portion of text and the at least one highlighted portion of text.
18. The computer readable medium as in claim 10 , comprising:
wherein the instructions for determining the first portion of text occurs in the document the predetermined number of times include: determining a first phrase occurs in the document the predetermined number of times, the first phrase comprising at least two words;
wherein the instructions for deriving conceptual information associated with the first portion of text include:
instructions for obtaining at least one keyword from the first phrase upon discarding any predefined unnecessary words from the first phrase;
instructions for inferring the at least one keyword from the first phrase relates to a first category of activities;
wherein the instructions for obtaining the graphical element include:
instructions for obtaining a first graphical element associated with the first category of activities;
instructions for displaying the first category of activities in a pop-up window, upon deriving the first category of activities associated with the first portion of text, as additional portions of text are being received in the document,
instructions for determining a second portion of text occurs in the document the predetermined number of times, the second portion of text comprising a second phrase of at least two words;
instructions for deriving second conceptual information associated with the second portion of text by repeating the steps of (i) obtaining at least one keyword and (ii) inferring with respect to the second phrase in order to determine a second category of activities;
instructions for displaying the second category of activities in the pop-up window as additional portions of text are being received in the document;
instructions for obtaining a second graphical element associated with the second category of activities;
instructions for identifying a second document location for display of the second graphical element; and
instructions for displaying the second graphical element in the second document location in conjunction with display of the first graphical element in the document location.
19. A computer system comprising:
a processor;
a memory unit that stores instructions associated with an application executed by the processor; and
an interconnect coupling the processor and the memory unit, enabling the computer system to execute the application and perform operations of:
receiving input of multiple portions of text within a document displayed in a display area associated with at least one computer system;
while receiving the input of multiple portions of text, monitoring occurrences of each portion of text in the document;
upon determining a first portion of text occurs in the document a predetermined number of times, deriving conceptual information associated with the first portion of text;
obtaining a graphical element associated with the conceptual information;
identifying a document location for display of the graphical element; and
displaying the graphical element in the document location.
20. The computer system as in claim 19 , comprising
wherein determining the first portion of text occurs in the document the predetermined number of times includes: determining a first phrase occurs in the document the predetermined number of times, the first phrase comprising at least two words;
wherein deriving conceptual information associated with the first portion of text includes:
obtaining at least one keyword from the first phrase upon discarding any predefined unnecessary words from the first phrase;
inferring the at least one keyword from the first phrase relates to a first category of activities;
wherein obtaining the graphical element includes: obtaining a first graphical element associated with the first category of activities;
upon deriving the first category of activities associated with the first portion of text, displaying the first category of activities in a pop-up window as additional portions of text are being received in the document,
determining a second portion of text occurs in the document the predetermined number of times, the second portion of text comprising a second phrase of at least two words;
deriving second conceptual information associated with the second portion of text by repeating the steps of (i) obtaining at least one keyword and (ii) inferring with respect to the second phrase in order to determine a second category of activities;
displaying the second category of activities in the pop-up window as additional portions of text are being received in the document;
obtaining a second graphical element associated with the second category of activities;
identifying a second document location for display of the second graphical element; and
displaying the second graphical element in the second document location in conjunction with display of the first graphical element in the document location.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/505,561 US20090282329A1 (en) | 2005-12-22 | 2009-07-20 | Methods and apparatus to identify graphical elements |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/316,441 US7584411B1 (en) | 2005-12-22 | 2005-12-22 | Methods and apparatus to identify graphical elements |
US12/505,561 US20090282329A1 (en) | 2005-12-22 | 2009-07-20 | Methods and apparatus to identify graphical elements |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/316,441 Continuation US7584411B1 (en) | 2005-12-22 | 2005-12-22 | Methods and apparatus to identify graphical elements |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090282329A1 true US20090282329A1 (en) | 2009-11-12 |
Family
ID=41009285
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/316,441 Active 2026-11-06 US7584411B1 (en) | 2005-12-22 | 2005-12-22 | Methods and apparatus to identify graphical elements |
US12/505,561 Abandoned US20090282329A1 (en) | 2005-12-22 | 2009-07-20 | Methods and apparatus to identify graphical elements |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/316,441 Active 2026-11-06 US7584411B1 (en) | 2005-12-22 | 2005-12-22 | Methods and apparatus to identify graphical elements |
Country Status (1)
Country | Link |
---|---|
US (2) | US7584411B1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120185329A1 (en) * | 2008-07-25 | 2012-07-19 | Anke Audenaert | Method and System for Determining Overall Content Values for Content Elements in a Web Network and for Optimizing Internet Traffic Flow Through the Web Network |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7584411B1 (en) * | 2005-12-22 | 2009-09-01 | Adobe Systems, Inc. | Methods and apparatus to identify graphical elements |
US8161369B2 (en) | 2007-03-16 | 2012-04-17 | Branchfire, Llc | System and method of providing a two-part graphic design and interactive document application |
US20090157609A1 (en) * | 2007-12-12 | 2009-06-18 | Yahoo! Inc. | Analyzing images to derive supplemental web page layout characteristics |
US20110283195A1 (en) * | 2010-05-11 | 2011-11-17 | Microsoft Corporation | Device theme matching |
EP2600311A1 (en) * | 2011-11-30 | 2013-06-05 | Thomson Licensing | Method and apparatus for visualizing a data set |
KR102072113B1 (en) | 2012-10-17 | 2020-02-03 | 삼성전자주식회사 | User terminal device and control method thereof |
US10902192B2 (en) * | 2017-11-20 | 2021-01-26 | Adobe Inc. | Dynamic digital document visual aids in a digital medium environment |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5960448A (en) * | 1995-12-15 | 1999-09-28 | Legal Video Services Inc. | System and method for displaying a graphically enhanced view of a region of a document image in which the enhanced view is correlated with text derived from the document image |
US6021412A (en) * | 1996-04-02 | 2000-02-01 | Microsoft Corporation | Method and system for automatically adding graphics to a document to illustrate concepts referred to therein |
US6496206B1 (en) * | 1998-06-29 | 2002-12-17 | Scansoft, Inc. | Displaying thumbnail images of document pages in an electronic folder |
US20050086223A1 (en) * | 1999-09-13 | 2005-04-21 | Microsoft Corporation | Image retrieval based on relevance feedback |
US20050108001A1 (en) * | 2001-11-15 | 2005-05-19 | Aarskog Brit H. | Method and apparatus for textual exploration discovery |
US7028253B1 (en) * | 2000-10-10 | 2006-04-11 | Eastman Kodak Company | Agent for integrated annotation and retrieval of images |
US7051019B1 (en) * | 1999-08-17 | 2006-05-23 | Corbis Corporation | Method and system for obtaining images from a database having images that are relevant to indicated text |
US7099860B1 (en) * | 2000-10-30 | 2006-08-29 | Microsoft Corporation | Image retrieval systems and methods with semantic and feature based relevance feedback |
US7143348B1 (en) * | 1997-01-29 | 2006-11-28 | Philip R Krause | Method and apparatus for enhancing electronic reading by identifying relationships between sections of electronic text |
US20070209004A1 (en) * | 2004-05-17 | 2007-09-06 | Gordon Layard | Automated E-Learning and Presentation Authoring System |
US7283992B2 (en) * | 2001-11-30 | 2007-10-16 | Microsoft Corporation | Media agent to suggest contextually related media content |
US20090083208A1 (en) * | 2006-03-15 | 2009-03-26 | Raghavan Vijay V | System, method, and computer program product for data mining and automatically generating hypotheses from data repositories |
US7584411B1 (en) * | 2005-12-22 | 2009-09-01 | Adobe Systems, Inc. | Methods and apparatus to identify graphical elements |
US7844918B1 (en) * | 2005-12-22 | 2010-11-30 | Adobe Systems Incorporated | Desktop thumbnails with page controllers |
-
2005
- 2005-12-22 US US11/316,441 patent/US7584411B1/en active Active
-
2009
- 2009-07-20 US US12/505,561 patent/US20090282329A1/en not_active Abandoned
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5960448A (en) * | 1995-12-15 | 1999-09-28 | Legal Video Services Inc. | System and method for displaying a graphically enhanced view of a region of a document image in which the enhanced view is correlated with text derived from the document image |
US6021412A (en) * | 1996-04-02 | 2000-02-01 | Microsoft Corporation | Method and system for automatically adding graphics to a document to illustrate concepts referred to therein |
US7143348B1 (en) * | 1997-01-29 | 2006-11-28 | Philip R Krause | Method and apparatus for enhancing electronic reading by identifying relationships between sections of electronic text |
US6496206B1 (en) * | 1998-06-29 | 2002-12-17 | Scansoft, Inc. | Displaying thumbnail images of document pages in an electronic folder |
US7051019B1 (en) * | 1999-08-17 | 2006-05-23 | Corbis Corporation | Method and system for obtaining images from a database having images that are relevant to indicated text |
US20050086223A1 (en) * | 1999-09-13 | 2005-04-21 | Microsoft Corporation | Image retrieval based on relevance feedback |
US7028253B1 (en) * | 2000-10-10 | 2006-04-11 | Eastman Kodak Company | Agent for integrated annotation and retrieval of images |
US7099860B1 (en) * | 2000-10-30 | 2006-08-29 | Microsoft Corporation | Image retrieval systems and methods with semantic and feature based relevance feedback |
US20050108001A1 (en) * | 2001-11-15 | 2005-05-19 | Aarskog Brit H. | Method and apparatus for textual exploration discovery |
US7283992B2 (en) * | 2001-11-30 | 2007-10-16 | Microsoft Corporation | Media agent to suggest contextually related media content |
US20070209004A1 (en) * | 2004-05-17 | 2007-09-06 | Gordon Layard | Automated E-Learning and Presentation Authoring System |
US7584411B1 (en) * | 2005-12-22 | 2009-09-01 | Adobe Systems, Inc. | Methods and apparatus to identify graphical elements |
US7844918B1 (en) * | 2005-12-22 | 2010-11-30 | Adobe Systems Incorporated | Desktop thumbnails with page controllers |
US20090083208A1 (en) * | 2006-03-15 | 2009-03-26 | Raghavan Vijay V | System, method, and computer program product for data mining and automatically generating hypotheses from data repositories |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120185329A1 (en) * | 2008-07-25 | 2012-07-19 | Anke Audenaert | Method and System for Determining Overall Content Values for Content Elements in a Web Network and for Optimizing Internet Traffic Flow Through the Web Network |
US9177326B2 (en) * | 2008-07-25 | 2015-11-03 | OpenX Technologies, Inc. | Method and system for determining overall content values for content elements in a web network and for optimizing internet traffic flow through the web network |
Also Published As
Publication number | Publication date |
---|---|
US7584411B1 (en) | 2009-09-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20090282329A1 (en) | Methods and apparatus to identify graphical elements | |
US10929449B2 (en) | Generating a structured document guiding view | |
US8069421B2 (en) | Methods and apparatus for graphical object implementation | |
RU2633115C2 (en) | Formation of search request on basis of context | |
US10762283B2 (en) | Multimedia document summarization | |
US9805010B2 (en) | Methods and apparatus for redacting related content in a document | |
US5590264A (en) | Method and apparatus for graphic association of user dialog displays with primary applications in a data processing system | |
US8645812B1 (en) | Methods and apparatus for automated redaction of content in a document | |
US9569541B2 (en) | Evaluating preferences of content on a webpage | |
US20170052937A1 (en) | Previews for Contextual Searches | |
US8601393B2 (en) | System and method for supporting document navigation on mobile devices using segmentation and keyphrase summarization | |
US8489602B2 (en) | Systems and methods for determining exclusion efficiencies of a plurality of keywords appearing in a search result | |
US10169374B2 (en) | Image searches using image frame context | |
CN105528388B (en) | Search recommendation method and device | |
US10353721B2 (en) | Systems and methods for guided live help | |
US9959269B1 (en) | Method and system for implementing a website builder | |
WO2012021221A1 (en) | Systems and methods for providing modular configurable creative units for delivery via intext advertising | |
US20080154869A1 (en) | System and method for constructing a search | |
Adar et al. | CommandSpace: modeling the relationships between tasks, descriptions and features | |
Chen et al. | How should i improve the ui of my app? a study of user reviews of popular apps in the google play | |
US20170083196A1 (en) | Computer-Aided Navigation of Digital Graphic Novels | |
CN110674620A (en) | Target file generation method, device, medium and electronic equipment | |
Erickson | Magician’s corner: how to start learning about deep learning | |
US8423913B1 (en) | Methods and apparatus to display style-related information | |
US7801890B1 (en) | Methods and apparatus to identify accessed digital content |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |