US20090282329A1 - Methods and apparatus to identify graphical elements - Google Patents

Methods and apparatus to identify graphical elements Download PDF

Info

Publication number
US20090282329A1
US20090282329A1 US12/505,561 US50556109A US2009282329A1 US 20090282329 A1 US20090282329 A1 US 20090282329A1 US 50556109 A US50556109 A US 50556109A US 2009282329 A1 US2009282329 A1 US 2009282329A1
Authority
US
United States
Prior art keywords
graphical element
document
text
instructions
obtaining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/505,561
Inventor
James M. Alexander
Karen A. Melchior
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US12/505,561 priority Critical patent/US20090282329A1/en
Publication of US20090282329A1 publication Critical patent/US20090282329A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • Y10S707/99935Query augmenting and refining, e.g. inexact access
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • Y10S707/99936Pattern matching access

Definitions

  • graphical user interface in applications, such as operating systems, and graphical editors (i.e., web page editors, document editors, etc.) that enable users to quickly provide input and create documents and/or projects using “What You See Is What You Get” (WYSIWYG) technology.
  • graphical editors i.e., web page editors, document editors, etc.
  • WYSIWYG “What You See Is What You Get”
  • a user uses a graphical user interface, a user operates an input device such as a mouse or keyboard to manipulate graphical objects on a computer display.
  • the graphical objects are often represented as icons, and the user can operate an input device such as a mouse to move a mouse pointer onto an icon (i.e., graphically overlapping the icon) on the graphical user interface.
  • the application By depressing a mouse button, the application (such as the operating system desktop) selects the icon, and if the user maintains the mouse button in a depressed state, the user can drag the icon across the graphical user interface. By releasing the mouse button, the icon is placed on the graphical user interface at the current position of the mouse pointer.
  • users can create and update documents (i.e., web pages, brochures, etc) and/or projects by dragging and dropping text, text boxes, graphical elements, etc. into the document and/or project.
  • Users can select the graphical elements (i.e., photographs, graphics, etc) used in the documents by selecting images from content providers.
  • Content providers provide graphical elements (e.g., photographs, graphics, etc) for document developers to view and/or purchase from content provider web sites.
  • Document developers are able to perform online searches by providing search criteria such as keywords, and then choose from the results to make a purchase. As an example, if a document developer is looking for pictures of cars, they can visit a content provider web site that sells graphical elements and can enter the search term “cars”. In response, the content provider web site searches a library of graphical elements (that may include more than one content provider web site) and can compile the results of the search. The document developer can then choose the appropriate graphical element(s) from the search results.
  • Embodiments disclosed herein significantly overcome such deficiencies and provide a system that includes a computer system executing a graphical element identifying process.
  • the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element from, for example, a content provider web site.
  • the graphical elements are provided by the application in which the user enters the content.
  • the graphical element is chosen to match the concept of the digital composition.
  • the graphical element identifying process then places the selected graphical element (i.e., the graphical elements for selection by a user) in a graphical element location within the digital composition.
  • the graphical element identifying process can display one or more graphical elements for the user to select. Graphical elements are chosen to match the concept of the digital composition by matching keywords associated with the graphical element to keywords associated with the content (i.e., text and/or graphical elements already existing within the content).
  • the graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element (or multiple graphical elements) within the digital composition.
  • a document developer is developing a brochure for a charity golf event.
  • the document developer enters the details of the charity golf event (i.e., the time, location, the charity involved, celebrities who will be in attendance, etc) into an application used to develop the brochure.
  • the graphical element identifying process receives a selection of the details of the charity golf event, for example, via a user highlighting the selection within the application used to develop the brochure.
  • the graphical element identifying process derives the concept of the brochure by identifying keywords within the selection, such as “golf course”.
  • the graphical element identifying process matches the search criteria to one or more graphical element databases containing photographs, images and other graphical elements.
  • the graphical element identifying process then obtains those graphical elements that match the search criteria of “golf course”, and displays those graphical elements within the application used to develop the brochure, at an appropriate location on the brochure.
  • inventions of the disclosed herein include any type of computerized device, workstation, handheld or laptop computer, or the like configured with software and/or circuitry (e.g., a processor) to process any or all of the method operations disclosed herein.
  • a computerized device such as a computer or a data communications device or any type of processor that is programmed or configured to operate as explained herein is considered an embodiment disclosed herein.
  • One such embodiment comprises a computer program product that has a computer-readable medium including computer program logic encoded thereon that, when performed in a computerized device having a coupling of a memory and a processor, programs the processor to perform the operations disclosed herein.
  • Such arrangements are typically provided as software, code and/or other data (e.g., data structures) arranged or encoded on a computer readable medium such as an optical medium (e.g., CD-ROM), floppy or hard disk or other a medium such as firmware or microcode in one or more ROM or RAM or PROM chips or as an Application Specific Integrated Circuit (ASIC).
  • the software or firmware or other such configurations can be installed onto a computerized device to cause the computerized device to perform the techniques explained as embodiments disclosed herein.
  • system disclosed herein may be embodied strictly as a software program, as software and hardware, or as hardware alone.
  • Embodiments disclosed herein may be employed in data communications devices and other computerized devices and software systems for such devices such as those manufactured by Adobe Systems, Inc. of San Jose, Calif.
  • FIG. 1 shows a high-level block diagram of a computer system according to one embodiment disclosed herein.
  • FIG. 2 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a graphical element within the digital composition.
  • FIG. 3 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a plurality of graphical elements within the digital composition.
  • FIG. 4 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process derives conceptual information associated with the content.
  • FIG. 5 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process displays the graphical element within the digital composition.
  • Embodiments disclosed herein include a computer system that performs a graphical element identifying process that executing a graphical element identifying process. Based on the content (i.e., the text and/or the graphical elements) within a digital composition (i.e., a document, etc), the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element (i.e., image, photograph, video, etc) from a content provider web site, such as a graphical element database (or more than one graphical element databases). The graphical element is chosen to match the concept of the digital composition. The graphical element identifying process places the selected graphical element in a graphical element location within the digital composition.
  • a graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element (i.e., image, photograph, video, etc) from a content provider web site, such as a graphical element database (or more than one graphical element databases).
  • the content can be selected by a user and the graphical element identifying process invoked by the user.
  • the graphical element identifying process automatically obtains graphical elements that match the concept of the content, and dynamically updates those results (i.e., the graphical elements obtained to match the concept of the content) as additional content is added to the digital composition.
  • the graphical element identifying process automatically obtains graphical elements based on, for example, words, that occur within the content more than a predefined number of times, within the content. For example, if the phrase ‘golf course’ occurs within the content, for example, more than three times, then the graphical element identifying process would automatically obtain graphical elements that match the concept of a golf course.
  • the graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element within the digital composition, for a user to view. The user can select the displayed graphical element, or choose from multiple graphical elements that are presented to the user.
  • FIG. 1 is a block diagram illustrating example architecture of a computer system 110 that executes, runs, interprets, operates or otherwise performs a graphical element identifying application 140 - 1 and process 140 - 2 suitable for use in explaining example embodiments disclosed herein.
  • the computer system 110 may be any type of computerized device such as a personal computer, workstation, portable computing device, console, laptop, network terminal or the like.
  • the computer system 110 includes an interconnection mechanism 111 such as a data bus or other circuitry that couples a memory system 112 , a processor 113 , an input/output interface 114 , and a communications interface 115 .
  • An input device 116 (e.g., one or more user/developer controlled devices such as a keyboard, mouse, etc.) couples to processor 113 through I/O interface 114 and enables a user 108 to provide input commands and generally control the graphical user interface 160 on the display 130 .
  • the graphical user interface 160 contains a digital composition 180 containing content 185 (that can also contain graphical elements 145 -N) and a graphical element location 150 .
  • the graphical element location 150 contains a graphical element 145 - 1 and attributes 155 - 1 associated with the graphical element 145 - 1 .
  • a graphical elements database 125 stores graphical elements 145 -N (and attributes 155 -N associated with those graphical elements 145 -N) developed in accordance with techniques described herein within a computer readable medium.
  • the communications interface 115 enables the computer system 110 to communicate with other devices (i.e., other computers) on a network (not shown). This can allow access to the graphical element identifying application by remote computer systems.
  • the memory system 112 is any type of computer readable medium and in this example is encoded with a graphical element identifying application 140 - 1 that supports generation, display, and implementation of functional operations of the graphical user interface 160 as explained herein.
  • the graphical element identifying application 140 - 1 may be embodied as software code such as data and/or logic instructions (e.g., code stored in the memory or on another computer readable medium such as a removable disk) that supports processing functionality according to different embodiments described herein.
  • the processor 113 accesses the memory system 112 via the interconnect 111 in order to launch, run, execute, interpret or otherwise perform the logic instructions of the graphical element identifying application 140 - 1 .
  • Execution of graphical element identifying application 140 - 1 in this manner produces processing functionality in a graphical element identifying process 140 - 2 .
  • the graphical element identifying process 140 - 2 represents one or more portions or runtime instances of the graphical element identifying application 140 - 1 (or the entire application 140 - 1 ) performing or executing within or upon the processor 113 in the computerized device 110 at runtime.
  • the graphical element identifying process 140 - 2 operates as explained herein to identify graphical elements 145 -N to be used in the development of a digital composition 180 within the graphical user interface 160 .
  • example configurations disclosed herein include the graphical element identifying application 140 - 1 .
  • the graphical element identifying application 140 - 1 may be stored on a computer readable medium (such as a floppy disk), hard disk, electronic, magnetic, and optical or other computer readable medium.
  • the graphical element identifying application 140 - 1 may also be stored in a memory system 112 such as in firmware, read only memory (ROM), or, as in this example, as executable code in, for example, Random Access Memory (RAM).
  • ROM read only memory
  • RAM Random Access Memory
  • other embodiments herein include the execution of the graphical element identifying application 140 - 1 in the processor 113 as the graphical element identifying process 140 - 2 .
  • the computer system 110 may include other processes and/or software and hardware components, such as an operating system not shown in this example.
  • a display 130 need not be coupled directly to computer system 110 .
  • the graphical element identifying application 140 - 1 can be executed on a remotely accessible computerized device via the network interface 115 .
  • the graphical user interface 160 may be displayed locally to a user of the remote computer and execution of the processing herein may be client-server based.
  • FIG. 2 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it receives a selection of content 185 from a digital composition 180 and obtains a graphical element 145 - 1 that matches the concept of the selected content 185 , according to one embodiment disclosed herein.
  • the graphical element identifying process 140 - 2 receives a selection of content 185 within the digital composition 180 .
  • a pop up window appears containing the selection of content 185 that the graphical element identifying process 140 - 2 will use to obtain a graphical element 145 - 1 that matches the concept (i.e., the central ‘theme’) of the selection of content 185 .
  • content 185 can contain, but is not limited to, graphical elements 145 -N as well as other content 185 , such as text.
  • the concept is determined by keywords contained within the content.
  • the graphical element identifying process 140 - 2 receives notification, via a notification mechanism, that a selection of content 185 within the digital composition 180 has been identified as the selection of content 185 to which a graphical element 145 - 1 will be associated.
  • the notification mechanism could be a pop up window, a menu button, content 185 selected by a user 108 , or accentuated content 185 .
  • the graphical element identifying process 140 - 2 receives notification of selected content 185 via a pop up window that appears, displaying a selection of content 185 from the digital composition 180 that is used to derive the concept of the selected content 185 .
  • the application used to create the digital composition 180 provides a menu button that a user 108 can select to notify the graphical element identifying process 140 - 2 that a portion of content 185 has been selected.
  • a user 108 who highlights a portion of content 185 , identifies the selection of content 185 .
  • the selection of content 185 such as text, is accentuated within the digital composition 180 , for example, by either highlighting the content 185 or underlining the content 185 in a color that matches or contrasts with the color of the font in which the content (i.e., text) is written.
  • the user 108 can then request that the graphical element identifying process 140 - 2 obtains a graphical element 145 - 1 or multiple graphical elements 145 -N.
  • the graphical element identifying process 140 - 2 automatically obtains a graphical element 145 - 1 or multiple graphical elements 145 -N.
  • the graphical element identifying process 140 - 2 receives selection criteria provided by the user 108 .
  • the selection criteria are used to identify the graphical element 145 - 1 associated with the selection of content 185 .
  • a user 108 can specify selection criteria from which the graphical element 145 - 1 should be selected by the graphical element identifying process 140 - 2 .
  • a user 108 might provide keywords to use to select the graphical element 145 - 1 , as well as operators, such as “and” and “or” with which to further refine the search criteria.
  • a user 108 could specify “golf and course” as selection criteria from which the graphical element 145 - 1 would be selected by the graphical element identifying process 140 - 2 . This selection criteria would result in the selection of graphical elements 145 -N related to “golf courses”.
  • the graphical element identifying process 140 - 2 derives conceptual information associated with the content 185 .
  • the conceptual information is used to identify the graphical element 145 - 1 associated with the selection of content 185 .
  • the concept of the selection of content 185 is derived from one word of text within the digital composition 180 or a plurality of words, or even a combination of words and graphical elements 145 -N that already exist within the digital composition 180 .
  • the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 associated with the content 185 .
  • the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 from a graphical elements database 125 .
  • the graphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites.
  • the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 within the digital composition 180 .
  • the graphical element identifying process 140 - 2 automatically displays appropriate graphical elements 145 -N within the digital composition 180 . It should be noted that the graphical elements 145 -N could be images, videos, etc.
  • FIG. 3 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it receives a selection of content 185 from a digital composition 180 , via an upload of an application containing the digital composition 180 , and obtains a graphical element 145 - 1 that matches the concept of the selected content 185 , according to one embodiment disclosed herein.
  • the graphical element identifying process 140 - 2 receives a selection of content 185 within the digital composition 180 .
  • the selection of content 185 is all of the content 185 contained within the digital composition 180 .
  • the graphical element identifying process 140 - 2 receives an application containing the contents 185 within the digital composition 180 .
  • the graphical element identifying process 140 - 2 receives an application, for example, an MS Word document or a PowerPoint presentation, as the selection of content 185 .
  • the graphical element identifying process 140 - 2 derives conceptual information associated with the content 185 .
  • the graphical element identifying process 140 - 2 derives the concept of a whole PowerPoint presentation (i.e., the text of the PowerPoint presentation as well as any graphical elements 145 -N within the PowerPoint presentation).
  • step 209 the graphical element identifying process 140 - 2 obtains the graphical elements 145 -N associated with the content 185 .
  • the graphical elements 145 -N are obtained from the graphical elements database 125 .
  • the graphical element identifying process 140 - 2 obtains a plurality of graphical elements 145 -N associated with the application.
  • the graphical element identifying process 140 - 2 obtains a plurality of graphical elements 145 -N that match the concept of the PowerPoint presentation.
  • the graphical element identifying process 140 - 2 identifies a plurality of locations within the application. Each location within the plurality of locations identifies where each respective graphical element 145 - 1 within the plurality of graphical elements 145 -N should be positioned in the application.
  • the graphical element identifying process 140 - 2 provides the graphical elements 145 -N that match the concept of the PowerPoint presentation, and also provides information as to where within the PowerPoint presentation (i.e., which pages within the PowerPoint presentation), those graphical elements 145 -N should be placed.
  • FIG. 4 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it derives conceptual information associated with the content 185 , and obtains the graphical element 145 - 1 based on that derived concept, according to one embodiment disclosed herein.
  • the graphical element identifying process 140 - 2 derives conceptual information associated with the content 185 .
  • the conceptual information is used to identify the graphical element 145 - 1 associated with the selection of content 185 .
  • the concept of the selection of content 185 is derived from one word of text within the digital composition 180 or a plurality of words, or even a combination of words and graphical elements 145 - 1 that already exist within the digital composition 180 .
  • the graphical element identifying process 140 - 2 applies a policy to the content 185 to derive a concept associated with the content 185 .
  • the graphical element identifying process 140 - 2 views the selected content 185 , and applies a policy to the selected content 185 to determine the concept of the content 185 .
  • the policy might dictate to strip out unnecessary words, such as “the”, “an”, “a”, etc. from the content 185 , and then use the remaining words in the selected content 185 as keywords with which to search the graphical elements database 125 .
  • the graphical element identifying process 140 - 2 obtains attributes 155 -N associated with a plurality of graphical elements 145 -N contained within the selection of content 185 , to determine attributes associated with the concept of the selection of content 185 .
  • the selected content 185 contains both text and graphical elements 145 -N.
  • Attributes 155 -N (or metadata) of those graphical elements 145 -N are used as search criteria when searching for graphical elements 145 -N within the graphical elements database 125 that match the concept of the graphical elements 145 -N already contained within the selection of content 185 within the digital composition 180 .
  • the graphical element identifying process 140 - 2 obtains a plurality of content keywords from the content 185 .
  • the graphical element identifying process 140 - 2 obtains a plurality of content keywords associated with the content 185 .
  • the keywords can be gleaned from the text within the content, or can be keywords (i.e., attributes 155 -N) associated with graphical elements 145 -N already contained within the selection of content 185 within the digital composition 180 .
  • the graphical element identifying process 140 - 2 evaluates the plurality of content keywords to give a priority to a portion of the content keywords within the plurality of content keywords.
  • the priority is utilized when correlating the content keywords to the concept associated with the content 185 .
  • some of the keywords will be given greater weight than others when determining the concept of the selection of content 185 . For example, if the content 185 contains keywords such as “night life” and “Paris”, the concept of the content 185 has more to do with “night life in Paris” than with “night life” in general.
  • the graphical element identifying process 140 - 2 deduces the concept associated with the content 185 based on the plurality of content keywords obtained from the content 185 . For example, if the keywords gleaned from the content 185 are “dog”, “car” and “beach”, the graphical element identifying process 140 - 2 could infer that the concept of the content 185 is related to leisure time activities.
  • the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 associated with the content 185 .
  • the graphical element identifying process 140 - 2 obtains the graphical element 145 - 1 from a graphical elements database 125 .
  • the graphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites.
  • the graphical element identifying process 140 - 2 matches the portion of the content keywords to graphical element keywords associated with a plurality of potential graphical elements 145 -N to determine the graphical element 145 - 1 that matches the concept of the content 185 .
  • the graphical element identifying process 140 - 2 uses those content keywords as search criteria when searching the graphical elements database 125 (i.e., the graphical elements provider web sites).
  • the content keywords are matched against graphical element keywords (i.e., attributes 155 -N) that are associated with the graphical elements 145 -N contained within the graphical elements database 125 .
  • FIG. 5 is an embodiment of the steps performed by the graphical element identifying process 140 - 2 when it displays the graphical element 145 - 1 within the digital composition 180 , and allows a user 108 to perform an action on the displayed graphical element 145 - 1 , according to one embodiment disclosed herein.
  • step 220 the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 within the digital composition 180 .
  • the digital composition 180 contains areas designated for text and areas designated for displaying graphical elements 145 -N.
  • the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 within a graphical element location 150 within the digital composition 180 .
  • the digital composition 180 contains a graphical element location 150 where the graphical element identifying process 140 - 2 displays the graphical element 145 - 1 for the user 108 to view the graphical element 145 - 1 selected by the graphical element identifying process 140 - 2 .
  • the graphical element identifying process 140 - 2 indicates there is at least one additional graphical element 145 - 1 available to be viewed within the graphical element location 150 within the digital composition 180 .
  • the graphical element identifying process 140 - 2 displays only one graphical element 145 - 1 at a time.
  • the graphical element identifying process 140 - 2 indicates there are more graphical elements 145 -N for viewing by modifying the graphical elements location 150 to include, for example, slider bars indicating there are more graphical elements 145 -N for display.
  • the graphical element identifying process 140 - 2 indicates there is a plurality of graphical elements 145 -N exceeding a threshold associated with the digital composition 180 .
  • the threshold identifies a maximum number of graphical elements 145 -N to be viewed within the graphical element location 150 within the digital composition 180 .
  • the digital composition 180 has a maximum number of graphical elements 145 -N that can be displayed within the graphical elements location 150 .
  • the graphical element identifying process 140 - 2 indicates to the user 108 that more graphical elements 145 -N (that have been identified as matching the concept derived from the selection of content 185 ) have been identified.
  • the graphical element identifying process 140 - 2 directs the user 108 to a graphical elements database 125 to view the plurality of graphical elements 145 -N.
  • the graphical element identifying process 140 - 2 notifies the user 108 that the maximum number of graphical elements 145 -N (that can be displayed within the graphical elements location 150 ) has been reached, and the graphical elements 145 -N (that have been identified as matching the concept derived from the selection of content 185 ) can be viewed at the graphical elements provider web site(s).
  • the graphical element identifying process 140 - 2 then directs the user 108 to those web sites.
  • the graphical element identifying process 140 - 2 allow a user to perform an action, such as selecting, downloading and/or purchasing the graphical element 145 -N.
  • the user 108 views the available graphical elements 145 -N, selects one graphical element 145 - 1 that is matches the concept of the digital composition 180 , purchases that graphical element 145 - 1 from the graphical element content provider, and downloads the graphical element 145 - 1 for use in the digital composition 180 .
  • the graphical element identifying process 140 - 2 is automatically invoked based on the entire content 185 of the digital composition 180 . In another example configuration, the graphical element identifying process 140 - 2 is automatically invoked based on a portion of the content 185 , such as a page, chapter, paragraph, sentence, etc.

Abstract

A system receives a selection of content within the digital composition, and derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The system obtains the graphical element associated with the content, and displays the graphical element within the digital composition.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This patent application is a Continuation of U.S. patent application Ser. No. 11/316,441 filed on Dec. 22, 2005, entitled, “METHODS AND APPARATUS TO IDENTIFY GRAPHICAL ELEMENTS”, the contents and teachings of which are hereby incorporated by reference in their entirety.
  • BACKGROUND
  • Conventional computerized devices, such as personal computers, laptop computers, and the like utilize graphical user interface in applications, such as operating systems, and graphical editors (i.e., web page editors, document editors, etc.) that enable users to quickly provide input and create documents and/or projects using “What You See Is What You Get” (WYSIWYG) technology. In general, using a graphical user interface, a user operates an input device such as a mouse or keyboard to manipulate graphical objects on a computer display. The graphical objects are often represented as icons, and the user can operate an input device such as a mouse to move a mouse pointer onto an icon (i.e., graphically overlapping the icon) on the graphical user interface. By depressing a mouse button, the application (such as the operating system desktop) selects the icon, and if the user maintains the mouse button in a depressed state, the user can drag the icon across the graphical user interface. By releasing the mouse button, the icon is placed on the graphical user interface at the current position of the mouse pointer.
  • Using graphical user interface technology, users can create and update documents (i.e., web pages, brochures, etc) and/or projects by dragging and dropping text, text boxes, graphical elements, etc. into the document and/or project. Users can select the graphical elements (i.e., photographs, graphics, etc) used in the documents by selecting images from content providers. Content providers provide graphical elements (e.g., photographs, graphics, etc) for document developers to view and/or purchase from content provider web sites. Document developers are able to perform online searches by providing search criteria such as keywords, and then choose from the results to make a purchase. As an example, if a document developer is looking for pictures of cars, they can visit a content provider web site that sells graphical elements and can enter the search term “cars”. In response, the content provider web site searches a library of graphical elements (that may include more than one content provider web site) and can compile the results of the search. The document developer can then choose the appropriate graphical element(s) from the search results.
  • SUMMARY
  • Conventional technologies for providing customers with purchasable graphical elements suffer from a variety of deficiencies. In particular, conventional technologies that provide users with graphical elements are limited in that the user has to go to a content provider web site, search for graphical elements that match the user's requirements, view the available graphical elements that match those requirements, choose the suitable graphical element(s), and place the chosen graphical element(s) in the appropriate place in the user's document.
  • Embodiments disclosed herein significantly overcome such deficiencies and provide a system that includes a computer system executing a graphical element identifying process. Based on the content (i.e., the text and/or the graphical elements) within a digital composition (i.e., a document, etc), the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element from, for example, a content provider web site. In an example configuration, the graphical elements are provided by the application in which the user enters the content. The graphical element is chosen to match the concept of the digital composition. The graphical element identifying process then places the selected graphical element (i.e., the graphical elements for selection by a user) in a graphical element location within the digital composition. The graphical element identifying process can display one or more graphical elements for the user to select. Graphical elements are chosen to match the concept of the digital composition by matching keywords associated with the graphical element to keywords associated with the content (i.e., text and/or graphical elements already existing within the content).
  • The graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element (or multiple graphical elements) within the digital composition.
  • During an example operation of one embodiment, suppose a document developer is developing a brochure for a charity golf event. The document developer enters the details of the charity golf event (i.e., the time, location, the charity involved, celebrities who will be in attendance, etc) into an application used to develop the brochure. The graphical element identifying process receives a selection of the details of the charity golf event, for example, via a user highlighting the selection within the application used to develop the brochure. The graphical element identifying process derives the concept of the brochure by identifying keywords within the selection, such as “golf course”. The graphical element identifying process matches the search criteria to one or more graphical element databases containing photographs, images and other graphical elements. The graphical element identifying process then obtains those graphical elements that match the search criteria of “golf course”, and displays those graphical elements within the application used to develop the brochure, at an appropriate location on the brochure.
  • Other embodiments of the disclosed herein include any type of computerized device, workstation, handheld or laptop computer, or the like configured with software and/or circuitry (e.g., a processor) to process any or all of the method operations disclosed herein. In other words, a computerized device such as a computer or a data communications device or any type of processor that is programmed or configured to operate as explained herein is considered an embodiment disclosed herein.
  • Other embodiments that are disclosed herein include software programs to perform the steps and operations summarized above and disclosed in detail below. One such embodiment comprises a computer program product that has a computer-readable medium including computer program logic encoded thereon that, when performed in a computerized device having a coupling of a memory and a processor, programs the processor to perform the operations disclosed herein. Such arrangements are typically provided as software, code and/or other data (e.g., data structures) arranged or encoded on a computer readable medium such as an optical medium (e.g., CD-ROM), floppy or hard disk or other a medium such as firmware or microcode in one or more ROM or RAM or PROM chips or as an Application Specific Integrated Circuit (ASIC). The software or firmware or other such configurations can be installed onto a computerized device to cause the computerized device to perform the techniques explained as embodiments disclosed herein.
  • It is to be understood that the system disclosed herein may be embodied strictly as a software program, as software and hardware, or as hardware alone. Embodiments disclosed herein, may be employed in data communications devices and other computerized devices and software systems for such devices such as those manufactured by Adobe Systems, Inc. of San Jose, Calif.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The foregoing disclosed herein will be apparent from the following description of particular embodiments disclosed herein, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles disclosed herein.
  • FIG. 1 shows a high-level block diagram of a computer system according to one embodiment disclosed herein.
  • FIG. 2 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a graphical element within the digital composition.
  • FIG. 3 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process receives a selection of content within the digital composition, and displays a plurality of graphical elements within the digital composition.
  • FIG. 4 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process derives conceptual information associated with the content.
  • FIG. 5 illustrates a flowchart of an embodiment of a procedure performed by the system of FIG. 1 when the graphical element identifying process displays the graphical element within the digital composition.
  • DETAILED DESCRIPTION
  • Embodiments disclosed herein include a computer system that performs a graphical element identifying process that executing a graphical element identifying process. Based on the content (i.e., the text and/or the graphical elements) within a digital composition (i.e., a document, etc), the graphical element identifying process determines the concept, or theme of the digital composition, and obtains a graphical element (i.e., image, photograph, video, etc) from a content provider web site, such as a graphical element database (or more than one graphical element databases). The graphical element is chosen to match the concept of the digital composition. The graphical element identifying process places the selected graphical element in a graphical element location within the digital composition. In an example embodiment, the content can be selected by a user and the graphical element identifying process invoked by the user. In another example embodiment, the graphical element identifying process automatically obtains graphical elements that match the concept of the content, and dynamically updates those results (i.e., the graphical elements obtained to match the concept of the content) as additional content is added to the digital composition. In yet another example embodiment, the graphical element identifying process automatically obtains graphical elements based on, for example, words, that occur within the content more than a predefined number of times, within the content. For example, if the phrase ‘golf course’ occurs within the content, for example, more than three times, then the graphical element identifying process would automatically obtain graphical elements that match the concept of a golf course.
  • In one embodiment, the graphical element identifying process receives a selection of content within the digital composition. Based on that selection, the graphical element identifying process derives conceptual information associated with the content. The conceptual information is used to identify the graphical element associated with the selection of content. The graphical element identifying process then obtains the graphical element associated with the content, and displays the graphical element within the digital composition, for a user to view. The user can select the displayed graphical element, or choose from multiple graphical elements that are presented to the user.
  • FIG. 1 is a block diagram illustrating example architecture of a computer system 110 that executes, runs, interprets, operates or otherwise performs a graphical element identifying application 140-1 and process 140-2 suitable for use in explaining example embodiments disclosed herein. The computer system 110 may be any type of computerized device such as a personal computer, workstation, portable computing device, console, laptop, network terminal or the like. As shown in this example, the computer system 110 includes an interconnection mechanism 111 such as a data bus or other circuitry that couples a memory system 112, a processor 113, an input/output interface 114, and a communications interface 115. An input device 116 (e.g., one or more user/developer controlled devices such as a keyboard, mouse, etc.) couples to processor 113 through I/O interface 114 and enables a user 108 to provide input commands and generally control the graphical user interface 160 on the display 130. The graphical user interface 160 contains a digital composition 180 containing content 185 (that can also contain graphical elements 145-N) and a graphical element location 150. The graphical element location 150 contains a graphical element 145-1 and attributes 155-1 associated with the graphical element 145-1. Also in this example configuration, a graphical elements database 125 stores graphical elements 145-N (and attributes 155-N associated with those graphical elements 145-N) developed in accordance with techniques described herein within a computer readable medium. The communications interface 115 enables the computer system 110 to communicate with other devices (i.e., other computers) on a network (not shown). This can allow access to the graphical element identifying application by remote computer systems.
  • The memory system 112 is any type of computer readable medium and in this example is encoded with a graphical element identifying application 140-1 that supports generation, display, and implementation of functional operations of the graphical user interface 160 as explained herein. The graphical element identifying application 140-1 may be embodied as software code such as data and/or logic instructions (e.g., code stored in the memory or on another computer readable medium such as a removable disk) that supports processing functionality according to different embodiments described herein. During operation of the computer system 110, the processor 113 accesses the memory system 112 via the interconnect 111 in order to launch, run, execute, interpret or otherwise perform the logic instructions of the graphical element identifying application 140-1. Execution of graphical element identifying application 140-1 in this manner produces processing functionality in a graphical element identifying process 140-2. In other words, the graphical element identifying process 140-2 represents one or more portions or runtime instances of the graphical element identifying application 140-1 (or the entire application 140-1) performing or executing within or upon the processor 113 in the computerized device 110 at runtime. The graphical element identifying process 140-2 operates as explained herein to identify graphical elements 145-N to be used in the development of a digital composition 180 within the graphical user interface 160.
  • It is noted that example configurations disclosed herein include the graphical element identifying application 140-1. The graphical element identifying application 140-1 may be stored on a computer readable medium (such as a floppy disk), hard disk, electronic, magnetic, and optical or other computer readable medium. The graphical element identifying application 140-1 may also be stored in a memory system 112 such as in firmware, read only memory (ROM), or, as in this example, as executable code in, for example, Random Access Memory (RAM). In addition to these embodiments, it should also be noted that other embodiments herein include the execution of the graphical element identifying application 140-1 in the processor 113 as the graphical element identifying process 140-2. Those skilled in the art will understand that the computer system 110 may include other processes and/or software and hardware components, such as an operating system not shown in this example.
  • A display 130 need not be coupled directly to computer system 110. For example, the graphical element identifying application 140-1 can be executed on a remotely accessible computerized device via the network interface 115. In this instance, the graphical user interface 160 may be displayed locally to a user of the remote computer and execution of the processing herein may be client-server based.
  • Further details of configurations explained herein will now be provided with respect to a flow chart of processing steps that show the high level operations disclosed herein to perform the graphical element identifying process 140-2.
  • FIG. 2 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it receives a selection of content 185 from a digital composition 180 and obtains a graphical element 145-1 that matches the concept of the selected content 185, according to one embodiment disclosed herein.
  • In step 200, the graphical element identifying process 140-2 receives a selection of content 185 within the digital composition 180. In an example configuration, as a user 108 enters content 185 into the digital composition 180, a pop up window appears containing the selection of content 185 that the graphical element identifying process 140-2 will use to obtain a graphical element 145-1 that matches the concept (i.e., the central ‘theme’) of the selection of content 185. It should be noted that content 185 can contain, but is not limited to, graphical elements 145-N as well as other content 185, such as text. In an example embodiment, the concept is determined by keywords contained within the content.
  • In step 201, the graphical element identifying process 140-2 receives notification, via a notification mechanism, that a selection of content 185 within the digital composition 180 has been identified as the selection of content 185 to which a graphical element 145-1 will be associated. For example, the notification mechanism could be a pop up window, a menu button, content 185 selected by a user 108, or accentuated content 185. In an example configuration, the graphical element identifying process 140-2 receives notification of selected content 185 via a pop up window that appears, displaying a selection of content 185 from the digital composition 180 that is used to derive the concept of the selected content 185. In another example configuration, the application used to create the digital composition 180 provides a menu button that a user 108 can select to notify the graphical element identifying process 140-2 that a portion of content 185 has been selected. In yet another example configuration, a user 108, who highlights a portion of content 185, identifies the selection of content 185. In yet another example configuration, the selection of content 185, such as text, is accentuated within the digital composition 180, for example, by either highlighting the content 185 or underlining the content 185 in a color that matches or contrasts with the color of the font in which the content (i.e., text) is written. The user 108 can then request that the graphical element identifying process 140-2 obtains a graphical element 145-1 or multiple graphical elements 145-N. In an example configuration, the graphical element identifying process 140-2 automatically obtains a graphical element 145-1 or multiple graphical elements 145-N.
  • In step 202, the graphical element identifying process 140-2 receives selection criteria provided by the user 108. The selection criteria are used to identify the graphical element 145-1 associated with the selection of content 185. In an example configuration, a user 108 can specify selection criteria from which the graphical element 145-1 should be selected by the graphical element identifying process 140-2. In this example, a user 108 might provide keywords to use to select the graphical element 145-1, as well as operators, such as “and” and “or” with which to further refine the search criteria. In other words, a user 108 could specify “golf and course” as selection criteria from which the graphical element 145-1 would be selected by the graphical element identifying process 140-2. This selection criteria would result in the selection of graphical elements 145-N related to “golf courses”.
  • In step 203, the graphical element identifying process 140-2 derives conceptual information associated with the content 185. The conceptual information is used to identify the graphical element 145-1 associated with the selection of content 185. In an example configuration, the concept of the selection of content 185 is derived from one word of text within the digital composition 180 or a plurality of words, or even a combination of words and graphical elements 145-N that already exist within the digital composition 180.
  • In step 204, the graphical element identifying process 140-2 obtains the graphical element 145-1 associated with the content 185. The graphical element identifying process 140-2 obtains the graphical element 145-1 from a graphical elements database 125. In an example configuration, the graphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites.
  • In step 205, the graphical element identifying process 140-2 displays the graphical element 145-1 within the digital composition 180. In an example configuration, as a user 108 enters content 185 within the digital composition 180, the graphical element identifying process 140-2 automatically displays appropriate graphical elements 145-N within the digital composition 180. It should be noted that the graphical elements 145-N could be images, videos, etc.
  • FIG. 3 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it receives a selection of content 185 from a digital composition 180, via an upload of an application containing the digital composition 180, and obtains a graphical element 145-1 that matches the concept of the selected content 185, according to one embodiment disclosed herein.
  • In step 206, the graphical element identifying process 140-2 receives a selection of content 185 within the digital composition 180. In an example configuration, the selection of content 185 is all of the content 185 contained within the digital composition 180.
  • In step 207, the graphical element identifying process 140-2 receives an application containing the contents 185 within the digital composition 180. In an example configuration, the graphical element identifying process 140-2 receives an application, for example, an MS Word document or a PowerPoint presentation, as the selection of content 185.
  • In step 208, the graphical element identifying process 140-2 derives conceptual information associated with the content 185. The conceptual information to be used to identify the graphical elements 145-N associated with the content 185. In an example configuration, the graphical element identifying process 140-2 derives the concept of a whole PowerPoint presentation (i.e., the text of the PowerPoint presentation as well as any graphical elements 145-N within the PowerPoint presentation).
  • In step 209, the graphical element identifying process 140-2 obtains the graphical elements 145-N associated with the content 185. The graphical elements 145-N are obtained from the graphical elements database 125.
  • In step 210, the graphical element identifying process 140-2 obtains a plurality of graphical elements 145-N associated with the application. In an example configuration, based on the concept derived from the whole PowerPoint presentation uploaded to the graphical element identifying process 140-2, the graphical element identifying process 140-2 obtains a plurality of graphical elements 145-N that match the concept of the PowerPoint presentation.
  • In step 211, the graphical element identifying process 140-2 identifies a plurality of locations within the application. Each location within the plurality of locations identifies where each respective graphical element 145-1 within the plurality of graphical elements 145-N should be positioned in the application. In an example configuration, the graphical element identifying process 140-2 provides the graphical elements 145-N that match the concept of the PowerPoint presentation, and also provides information as to where within the PowerPoint presentation (i.e., which pages within the PowerPoint presentation), those graphical elements 145-N should be placed.
  • FIG. 4 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it derives conceptual information associated with the content 185, and obtains the graphical element 145-1 based on that derived concept, according to one embodiment disclosed herein.
  • In step 212, the graphical element identifying process 140-2 derives conceptual information associated with the content 185. The conceptual information is used to identify the graphical element 145-1 associated with the selection of content 185. In an example configuration, the concept of the selection of content 185 is derived from one word of text within the digital composition 180 or a plurality of words, or even a combination of words and graphical elements 145-1 that already exist within the digital composition 180.
  • In step 213, the graphical element identifying process 140-2 applies a policy to the content 185 to derive a concept associated with the content 185. In an example configuration, the graphical element identifying process 140-2 views the selected content 185, and applies a policy to the selected content 185 to determine the concept of the content 185. For example, the policy might dictate to strip out unnecessary words, such as “the”, “an”, “a”, etc. from the content 185, and then use the remaining words in the selected content 185 as keywords with which to search the graphical elements database 125.
  • In step 214, the graphical element identifying process 140-2 obtains attributes 155-N associated with a plurality of graphical elements 145-N contained within the selection of content 185, to determine attributes associated with the concept of the selection of content 185. In an example configuration, the selected content 185 contains both text and graphical elements 145-N. Attributes 155-N (or metadata) of those graphical elements 145-N, such as keywords associated with the graphical elements 145-N, or the color space of those graphical elements 145-N (i.e., the color schemes, the brightness value, contrast value, colored images versus black and white images, etc) are used as search criteria when searching for graphical elements 145-N within the graphical elements database 125 that match the concept of the graphical elements 145-N already contained within the selection of content 185 within the digital composition 180.
  • Alternatively, in step 215, the graphical element identifying process 140-2 obtains a plurality of content keywords from the content 185. In an example configuration, the graphical element identifying process 140-2 obtains a plurality of content keywords associated with the content 185. The keywords can be gleaned from the text within the content, or can be keywords (i.e., attributes 155-N) associated with graphical elements 145-N already contained within the selection of content 185 within the digital composition 180.
  • In step 216, the graphical element identifying process 140-2 evaluates the plurality of content keywords to give a priority to a portion of the content keywords within the plurality of content keywords. The priority is utilized when correlating the content keywords to the concept associated with the content 185. In other words, within the group of keywords gleaned from the selection of content 185, some of the keywords will be given greater weight than others when determining the concept of the selection of content 185. For example, if the content 185 contains keywords such as “night life” and “Paris”, the concept of the content 185 has more to do with “night life in Paris” than with “night life” in general.
  • In step 217, the graphical element identifying process 140-2 deduces the concept associated with the content 185 based on the plurality of content keywords obtained from the content 185. For example, if the keywords gleaned from the content 185 are “dog”, “car” and “beach”, the graphical element identifying process 140-2 could infer that the concept of the content 185 is related to leisure time activities.
  • In step 218, the graphical element identifying process 140-2 obtains the graphical element 145-1 associated with the content 185. The graphical element identifying process 140-2 obtains the graphical element 145-1 from a graphical elements database 125. In an example configuration, the graphical elements database 125 is a graphical elements provider web site, or more than one graphical elements provider web sites.
  • In step 219, the graphical element identifying process 140-2 matches the portion of the content keywords to graphical element keywords associated with a plurality of potential graphical elements 145-N to determine the graphical element 145-1 that matches the concept of the content 185. In other words, the graphical element identifying process 140-2 uses those content keywords as search criteria when searching the graphical elements database 125 (i.e., the graphical elements provider web sites). The content keywords are matched against graphical element keywords (i.e., attributes 155-N) that are associated with the graphical elements 145-N contained within the graphical elements database 125.
  • FIG. 5 is an embodiment of the steps performed by the graphical element identifying process 140-2 when it displays the graphical element 145-1 within the digital composition 180, and allows a user 108 to perform an action on the displayed graphical element 145-1, according to one embodiment disclosed herein.
  • In step 220, the graphical element identifying process 140-2 displays the graphical element 145-1 within the digital composition 180. In an example configuration, the digital composition 180 contains areas designated for text and areas designated for displaying graphical elements 145-N.
  • In step 221, the graphical element identifying process 140-2 displays the graphical element 145-1 within a graphical element location 150 within the digital composition 180. In an example configuration, the digital composition 180 contains a graphical element location 150 where the graphical element identifying process 140-2 displays the graphical element 145-1 for the user 108 to view the graphical element 145-1 selected by the graphical element identifying process 140-2.
  • In step 222, the graphical element identifying process 140-2 indicates there is at least one additional graphical element 145-1 available to be viewed within the graphical element location 150 within the digital composition 180. In an example configuration, if there is more than one graphical element 145-1 to display within the graphical element location 150, the graphical element identifying process 140-2 displays only one graphical element 145-1 at a time. The graphical element identifying process 140-2 indicates there are more graphical elements 145-N for viewing by modifying the graphical elements location 150 to include, for example, slider bars indicating there are more graphical elements 145-N for display.
  • In step 223, the graphical element identifying process 140-2 indicates there is a plurality of graphical elements 145-N exceeding a threshold associated with the digital composition 180. The threshold identifies a maximum number of graphical elements 145-N to be viewed within the graphical element location 150 within the digital composition 180. In an example configuration, the digital composition 180 has a maximum number of graphical elements 145-N that can be displayed within the graphical elements location 150. Once that maximum is reached, the graphical element identifying process 140-2 indicates to the user 108 that more graphical elements 145-N (that have been identified as matching the concept derived from the selection of content 185) have been identified.
  • In step 224, the graphical element identifying process 140-2 directs the user 108 to a graphical elements database 125 to view the plurality of graphical elements 145-N. In an example configuration, the graphical element identifying process 140-2 notifies the user 108 that the maximum number of graphical elements 145-N (that can be displayed within the graphical elements location 150) has been reached, and the graphical elements 145-N (that have been identified as matching the concept derived from the selection of content 185) can be viewed at the graphical elements provider web site(s). The graphical element identifying process 140-2 then directs the user 108 to those web sites.
  • In step 225, the graphical element identifying process 140-2 allow a user to perform an action, such as selecting, downloading and/or purchasing the graphical element 145-N. In an example configuration, the user 108 views the available graphical elements 145-N, selects one graphical element 145-1 that is matches the concept of the digital composition 180, purchases that graphical element 145-1 from the graphical element content provider, and downloads the graphical element 145-1 for use in the digital composition 180.
  • In an example configuration, the graphical element identifying process 140-2 is automatically invoked based on the entire content 185 of the digital composition 180. In another example configuration, the graphical element identifying process 140-2 is automatically invoked based on a portion of the content 185, such as a page, chapter, paragraph, sentence, etc.
  • While computer systems and methods have been particularly shown and described above with references to configurations thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope disclosed herein. Accordingly, embodiments disclosed herein are not intended to be limited by the example configurations provided above.

Claims (20)

1. A method comprising:
receiving input of multiple portions of text within a document displayed in a display area associated with at least one computer system;
while receiving the input of multiple portions of text, monitoring occurrences of each portion of text in the document;
upon determining a first portion of text occurs in the document a predetermined number of times, deriving conceptual information associated with the first portion of text;
obtaining a graphical element associated with the conceptual information;
identifying a document location for display of the graphical element; and
displaying the graphical element in the document location.
2. The method as in claim 1, comprising:
wherein obtaining the graphical element includes: obtaining multiple graphical elements associated with conceptual information; and
wherein displaying the graphical element in the document location includes:
(i) modifying the document location in the document by adding at least one slide bar at the document location;
(ii) displaying a first graphical element at the document location; and
(iii) based on detected advancement of the slide bar, gradually displaying a second graphical element in place of the displayed first graphical element.
3. The method as in claim 2, comprising:
indicating whether the multiple graphical elements exceeds a threshold associated with the document, the threshold representing a maximum number of graphical elements to be viewed within the document location;
wherein obtaining the multiple graphical element includes: obtaining a first subset of the multiple graphical elements, the first subset comprising a number of graphical elements equal to the threshold associated with the document; and
wherein displaying the graphical element in the document location includes:
(i) providing display of each graphical element from first subset of graphical elements based on advancement of the slide bar in the document location; and
(ii) indicating there is at least one additional graphical element accessible via at least one web site.
4. The method as in claim 1, comprising:
while displaying the graphical element in the document location, determining a second portion of text occurs in the document the predetermined number of times;
deriving second conceptual information associated with the second portion of text;
obtaining a second graphical element associated with the second conceptual information;
identifying a second document location for display of the second graphical element; and
displaying the second graphical element in the second document location in conjunction with display of the graphical element in the document location.
5. The method as in claim 1, comprising:
wherein determining the first portion of text occurs in the document the predetermined number of times includes: determining a phrase occurs in the document the predetermined number of times, the phrase comprising at least two words;
wherein deriving conceptual information associated with the first portion of text includes:
(i) obtaining at least one keyword from the phrase upon discarding any predefined unnecessary words from the phrase;
(ii) inferring the at least one keyword from the phrase relates to category of activities; and
wherein obtaining the graphical element includes: obtaining a first graphical element associated with the category of activities.
6. The method as in claim 1, wherein deriving conceptual information associated with the first portion of text includes:
upon deriving the conceptual information associated with the first portion of text, displaying the conceptual information in a pop-up window as additional portions of text are being received in the document, the document displayed in a document text editor; and
wherein displaying the graphical element in the document location includes: displaying an image devoid of text.
7. The method as in claim 1, wherein obtaining the graphical element associated with the conceptual information includes:
obtaining the graphical element according to a color space indicated in the graphical element's metadata, the color space selected from the group comprising: a color scheme, a brightness value, a contrast value, an identification of being a black-and-white image, and an identification of being a color image.
8. The method as in claim 1, comprising:
detecting at least one highlighted portion of text in the document; and
deriving the conceptual information associated with the first portion of text and the at least one highlighted portion of text.
9. The method as in claim 1, comprising:
wherein determining the first portion of text occurs in the document the predetermined number of times includes: determining a first phrase occurs in the document the predetermined number of times, the first phrase comprising at least two words;
wherein deriving conceptual information associated with the first portion of text includes:
(i) obtaining at least one keyword from the first phrase upon discarding any predefined unnecessary words from the first phrase;
(ii) inferring the at least one keyword from the first phrase relates to a first category of activities;
wherein obtaining the graphical element includes: obtaining a first graphical element associated with the first category of activities;
upon deriving the first category of activities associated with the first portion of text, displaying the first category of activities in a pop-up window as additional portions of text are being received in the document,
determining a second portion of text occurs in the document the predetermined number of times, the second portion of text comprising a second phrase of at least two words;
deriving second conceptual information associated with the second portion of text by repeating the steps of (i) obtaining at least one keyword and (ii) inferring with respect to the second phrase in order to determine a second category of activities;
displaying the second category of activities in the pop-up window as additional portions of text are being received in the document;
obtaining a second graphical element associated with the second category of activities;
identifying a second document location for display of the second graphical element; and
displaying the second graphical element in the second document location in conjunction with display of the first graphical element in the document location.
10. A computer readable medium comprising executable instructions encoded thereon operable on a computerized device to perform processing comprising:
instructions for receiving input of multiple portions of text within a document displayed in a display area associated with at least one computer system;
instructions for monitoring occurrences of each portion of text in the document while receiving the input of multiple portions of text;
instructions for deriving conceptual information associated with the first portion of text upon determining a first portion of text occurs in the document a predetermined number of times;
instructions for obtaining a graphical element associated with the conceptual information;
instructions for identifying a document location for display of the graphical element; and
instructions for displaying the graphical element in the document location.
11. The computer readable medium as in claim 10, comprising:
wherein the instructions for obtaining the graphical element include: instructions for obtaining multiple graphical elements associated with conceptual information; and
wherein the instructions for displaying the graphical element in the document location include:
instructions for modifying the document location in the document by adding at least one slide bar at the document location;
instructions for displaying a first graphical element at the document location; and
instructions for gradually displaying a second graphical element in place of the displayed first graphical element based on detected advancement of the slide bar.
12. The computer readable medium as in claim 11, comprising:
instructions for indicating whether the multiple graphical elements exceeds a threshold associated with the document, the threshold representing a maximum number of graphical elements to be viewed within the document location;
wherein the instructions for obtaining the multiple graphical element include:
instructions for obtaining a first subset of the multiple graphical elements, the first subset comprising a number of graphical elements equal to the threshold associated with the document; and
wherein the instructions for displaying the graphical element in the document location include:
instructions for providing display of each graphical element from first subset of graphical elements based on advancement of the slide bar in the document location; and
instructions for indicating there is at least one additional graphical element accessible via at least one web site.
13. The computer readable medium as in claim 10, comprising:
instructions for determining a second portion of text occurs in the document the predetermined number of times while displaying the graphical element in the document location;
instructions for deriving second conceptual information associated with the second portion of text;
instructions for obtaining a second graphical element associated with the second conceptual information;
instructions for identifying a second document location for display of the second graphical element; and
instructions for displaying the second graphical element in the second document location in conjunction with display of the graphical element in the document location.
14. The computer readable medium as in claim 10, comprising:
wherein the instructions for determining the first portion of text occurs in the document the predetermined number of times include: instructions for determining a phrase occurs in the document the predetermined number of times, the phrase comprising at least two words;
wherein the instructions for deriving conceptual information associated with the first portion of text include:
instructions for obtaining at least one keyword from the phrase upon discarding any predefined unnecessary words from the phrase;
instructions for inferring the at least one keyword from the phrase relates to category of activities; and
wherein the instructions for obtaining the graphical element include: instructions for obtaining a first graphical element associated with the category of activities.
15. The computer readable medium as in claim 10, wherein the instructions for deriving conceptual information associated with the first portion of text include:
instructions for displaying the conceptual information in a pop-up window, upon deriving the conceptual information associated with the first portion of text, as additional portions of text are being received in the document, the document displayed in a document text editor; and
wherein instructions for displaying the graphical element in the document location include: instructions for displaying an image devoid of text.
16. The computer readable medium as in claim 10, wherein the instructions for obtaining the graphical element associated with the conceptual information include:
instructions for obtaining the graphical element according to a color space indicated in the graphical element's metadata, the color space selected from the group comprising: a color scheme, a brightness value, a contrast value, an identification of being a black-and-white image, and an identification of being a color image.
17. The computer readable medium as in claim 10, comprising:
instructions for detecting at least one highlighted portion of text in the document; and
instructions for deriving the conceptual information associated with the first portion of text and the at least one highlighted portion of text.
18. The computer readable medium as in claim 10, comprising:
wherein the instructions for determining the first portion of text occurs in the document the predetermined number of times include: determining a first phrase occurs in the document the predetermined number of times, the first phrase comprising at least two words;
wherein the instructions for deriving conceptual information associated with the first portion of text include:
instructions for obtaining at least one keyword from the first phrase upon discarding any predefined unnecessary words from the first phrase;
instructions for inferring the at least one keyword from the first phrase relates to a first category of activities;
wherein the instructions for obtaining the graphical element include:
instructions for obtaining a first graphical element associated with the first category of activities;
instructions for displaying the first category of activities in a pop-up window, upon deriving the first category of activities associated with the first portion of text, as additional portions of text are being received in the document,
instructions for determining a second portion of text occurs in the document the predetermined number of times, the second portion of text comprising a second phrase of at least two words;
instructions for deriving second conceptual information associated with the second portion of text by repeating the steps of (i) obtaining at least one keyword and (ii) inferring with respect to the second phrase in order to determine a second category of activities;
instructions for displaying the second category of activities in the pop-up window as additional portions of text are being received in the document;
instructions for obtaining a second graphical element associated with the second category of activities;
instructions for identifying a second document location for display of the second graphical element; and
instructions for displaying the second graphical element in the second document location in conjunction with display of the first graphical element in the document location.
19. A computer system comprising:
a processor;
a memory unit that stores instructions associated with an application executed by the processor; and
an interconnect coupling the processor and the memory unit, enabling the computer system to execute the application and perform operations of:
receiving input of multiple portions of text within a document displayed in a display area associated with at least one computer system;
while receiving the input of multiple portions of text, monitoring occurrences of each portion of text in the document;
upon determining a first portion of text occurs in the document a predetermined number of times, deriving conceptual information associated with the first portion of text;
obtaining a graphical element associated with the conceptual information;
identifying a document location for display of the graphical element; and
displaying the graphical element in the document location.
20. The computer system as in claim 19, comprising
wherein determining the first portion of text occurs in the document the predetermined number of times includes: determining a first phrase occurs in the document the predetermined number of times, the first phrase comprising at least two words;
wherein deriving conceptual information associated with the first portion of text includes:
obtaining at least one keyword from the first phrase upon discarding any predefined unnecessary words from the first phrase;
inferring the at least one keyword from the first phrase relates to a first category of activities;
wherein obtaining the graphical element includes: obtaining a first graphical element associated with the first category of activities;
upon deriving the first category of activities associated with the first portion of text, displaying the first category of activities in a pop-up window as additional portions of text are being received in the document,
determining a second portion of text occurs in the document the predetermined number of times, the second portion of text comprising a second phrase of at least two words;
deriving second conceptual information associated with the second portion of text by repeating the steps of (i) obtaining at least one keyword and (ii) inferring with respect to the second phrase in order to determine a second category of activities;
displaying the second category of activities in the pop-up window as additional portions of text are being received in the document;
obtaining a second graphical element associated with the second category of activities;
identifying a second document location for display of the second graphical element; and
displaying the second graphical element in the second document location in conjunction with display of the first graphical element in the document location.
US12/505,561 2005-12-22 2009-07-20 Methods and apparatus to identify graphical elements Abandoned US20090282329A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/505,561 US20090282329A1 (en) 2005-12-22 2009-07-20 Methods and apparatus to identify graphical elements

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/316,441 US7584411B1 (en) 2005-12-22 2005-12-22 Methods and apparatus to identify graphical elements
US12/505,561 US20090282329A1 (en) 2005-12-22 2009-07-20 Methods and apparatus to identify graphical elements

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/316,441 Continuation US7584411B1 (en) 2005-12-22 2005-12-22 Methods and apparatus to identify graphical elements

Publications (1)

Publication Number Publication Date
US20090282329A1 true US20090282329A1 (en) 2009-11-12

Family

ID=41009285

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/316,441 Active 2026-11-06 US7584411B1 (en) 2005-12-22 2005-12-22 Methods and apparatus to identify graphical elements
US12/505,561 Abandoned US20090282329A1 (en) 2005-12-22 2009-07-20 Methods and apparatus to identify graphical elements

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/316,441 Active 2026-11-06 US7584411B1 (en) 2005-12-22 2005-12-22 Methods and apparatus to identify graphical elements

Country Status (1)

Country Link
US (2) US7584411B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120185329A1 (en) * 2008-07-25 2012-07-19 Anke Audenaert Method and System for Determining Overall Content Values for Content Elements in a Web Network and for Optimizing Internet Traffic Flow Through the Web Network

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7584411B1 (en) * 2005-12-22 2009-09-01 Adobe Systems, Inc. Methods and apparatus to identify graphical elements
US8161369B2 (en) 2007-03-16 2012-04-17 Branchfire, Llc System and method of providing a two-part graphic design and interactive document application
US20090157609A1 (en) * 2007-12-12 2009-06-18 Yahoo! Inc. Analyzing images to derive supplemental web page layout characteristics
US20110283195A1 (en) * 2010-05-11 2011-11-17 Microsoft Corporation Device theme matching
EP2600311A1 (en) * 2011-11-30 2013-06-05 Thomson Licensing Method and apparatus for visualizing a data set
KR102072113B1 (en) 2012-10-17 2020-02-03 삼성전자주식회사 User terminal device and control method thereof
US10902192B2 (en) * 2017-11-20 2021-01-26 Adobe Inc. Dynamic digital document visual aids in a digital medium environment

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5960448A (en) * 1995-12-15 1999-09-28 Legal Video Services Inc. System and method for displaying a graphically enhanced view of a region of a document image in which the enhanced view is correlated with text derived from the document image
US6021412A (en) * 1996-04-02 2000-02-01 Microsoft Corporation Method and system for automatically adding graphics to a document to illustrate concepts referred to therein
US6496206B1 (en) * 1998-06-29 2002-12-17 Scansoft, Inc. Displaying thumbnail images of document pages in an electronic folder
US20050086223A1 (en) * 1999-09-13 2005-04-21 Microsoft Corporation Image retrieval based on relevance feedback
US20050108001A1 (en) * 2001-11-15 2005-05-19 Aarskog Brit H. Method and apparatus for textual exploration discovery
US7028253B1 (en) * 2000-10-10 2006-04-11 Eastman Kodak Company Agent for integrated annotation and retrieval of images
US7051019B1 (en) * 1999-08-17 2006-05-23 Corbis Corporation Method and system for obtaining images from a database having images that are relevant to indicated text
US7099860B1 (en) * 2000-10-30 2006-08-29 Microsoft Corporation Image retrieval systems and methods with semantic and feature based relevance feedback
US7143348B1 (en) * 1997-01-29 2006-11-28 Philip R Krause Method and apparatus for enhancing electronic reading by identifying relationships between sections of electronic text
US20070209004A1 (en) * 2004-05-17 2007-09-06 Gordon Layard Automated E-Learning and Presentation Authoring System
US7283992B2 (en) * 2001-11-30 2007-10-16 Microsoft Corporation Media agent to suggest contextually related media content
US20090083208A1 (en) * 2006-03-15 2009-03-26 Raghavan Vijay V System, method, and computer program product for data mining and automatically generating hypotheses from data repositories
US7584411B1 (en) * 2005-12-22 2009-09-01 Adobe Systems, Inc. Methods and apparatus to identify graphical elements
US7844918B1 (en) * 2005-12-22 2010-11-30 Adobe Systems Incorporated Desktop thumbnails with page controllers

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5960448A (en) * 1995-12-15 1999-09-28 Legal Video Services Inc. System and method for displaying a graphically enhanced view of a region of a document image in which the enhanced view is correlated with text derived from the document image
US6021412A (en) * 1996-04-02 2000-02-01 Microsoft Corporation Method and system for automatically adding graphics to a document to illustrate concepts referred to therein
US7143348B1 (en) * 1997-01-29 2006-11-28 Philip R Krause Method and apparatus for enhancing electronic reading by identifying relationships between sections of electronic text
US6496206B1 (en) * 1998-06-29 2002-12-17 Scansoft, Inc. Displaying thumbnail images of document pages in an electronic folder
US7051019B1 (en) * 1999-08-17 2006-05-23 Corbis Corporation Method and system for obtaining images from a database having images that are relevant to indicated text
US20050086223A1 (en) * 1999-09-13 2005-04-21 Microsoft Corporation Image retrieval based on relevance feedback
US7028253B1 (en) * 2000-10-10 2006-04-11 Eastman Kodak Company Agent for integrated annotation and retrieval of images
US7099860B1 (en) * 2000-10-30 2006-08-29 Microsoft Corporation Image retrieval systems and methods with semantic and feature based relevance feedback
US20050108001A1 (en) * 2001-11-15 2005-05-19 Aarskog Brit H. Method and apparatus for textual exploration discovery
US7283992B2 (en) * 2001-11-30 2007-10-16 Microsoft Corporation Media agent to suggest contextually related media content
US20070209004A1 (en) * 2004-05-17 2007-09-06 Gordon Layard Automated E-Learning and Presentation Authoring System
US7584411B1 (en) * 2005-12-22 2009-09-01 Adobe Systems, Inc. Methods and apparatus to identify graphical elements
US7844918B1 (en) * 2005-12-22 2010-11-30 Adobe Systems Incorporated Desktop thumbnails with page controllers
US20090083208A1 (en) * 2006-03-15 2009-03-26 Raghavan Vijay V System, method, and computer program product for data mining and automatically generating hypotheses from data repositories

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120185329A1 (en) * 2008-07-25 2012-07-19 Anke Audenaert Method and System for Determining Overall Content Values for Content Elements in a Web Network and for Optimizing Internet Traffic Flow Through the Web Network
US9177326B2 (en) * 2008-07-25 2015-11-03 OpenX Technologies, Inc. Method and system for determining overall content values for content elements in a web network and for optimizing internet traffic flow through the web network

Also Published As

Publication number Publication date
US7584411B1 (en) 2009-09-01

Similar Documents

Publication Publication Date Title
US20090282329A1 (en) Methods and apparatus to identify graphical elements
US10929449B2 (en) Generating a structured document guiding view
US8069421B2 (en) Methods and apparatus for graphical object implementation
RU2633115C2 (en) Formation of search request on basis of context
US10762283B2 (en) Multimedia document summarization
US9805010B2 (en) Methods and apparatus for redacting related content in a document
US5590264A (en) Method and apparatus for graphic association of user dialog displays with primary applications in a data processing system
US8645812B1 (en) Methods and apparatus for automated redaction of content in a document
US9569541B2 (en) Evaluating preferences of content on a webpage
US20170052937A1 (en) Previews for Contextual Searches
US8601393B2 (en) System and method for supporting document navigation on mobile devices using segmentation and keyphrase summarization
US8489602B2 (en) Systems and methods for determining exclusion efficiencies of a plurality of keywords appearing in a search result
US10169374B2 (en) Image searches using image frame context
CN105528388B (en) Search recommendation method and device
US10353721B2 (en) Systems and methods for guided live help
US9959269B1 (en) Method and system for implementing a website builder
WO2012021221A1 (en) Systems and methods for providing modular configurable creative units for delivery via intext advertising
US20080154869A1 (en) System and method for constructing a search
Adar et al. CommandSpace: modeling the relationships between tasks, descriptions and features
Chen et al. How should i improve the ui of my app? a study of user reviews of popular apps in the google play
US20170083196A1 (en) Computer-Aided Navigation of Digital Graphic Novels
CN110674620A (en) Target file generation method, device, medium and electronic equipment
Erickson Magician’s corner: how to start learning about deep learning
US8423913B1 (en) Methods and apparatus to display style-related information
US7801890B1 (en) Methods and apparatus to identify accessed digital content

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION