US20100057555A1 - Media object metadata association and ranking - Google Patents

Media object metadata association and ranking Download PDF

Info

Publication number
US20100057555A1
US20100057555A1 US12/555,706 US55570609A US2010057555A1 US 20100057555 A1 US20100057555 A1 US 20100057555A1 US 55570609 A US55570609 A US 55570609A US 2010057555 A1 US2010057555 A1 US 2010057555A1
Authority
US
United States
Prior art keywords
server
metadatum
media object
user
metadata
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/555,706
Inventor
Daniel Stewart Butterfield
Eric Costello
Caterina Fake
Callum James Henderson-Begg
Serguei Mourachov
Joshua Eli Schachter
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yahoo Inc
Verizon Patent and Licensing Inc
Original Assignee
Yahoo Inc until 2017
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yahoo Inc until 2017 filed Critical Yahoo Inc until 2017
Priority to US12/555,706 priority Critical patent/US20100057555A1/en
Assigned to YAHOO! INC. reassignment YAHOO! INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FAKE, CATERINA, BUTTERFIELD, DANIEL STEWART, HENDERSON-BEGG, CALLUM JAMES, MOURACHOV, SERGUEI, SCHACHTER, JOSHUA ELI, COSTELLO, ERIC
Publication of US20100057555A1 publication Critical patent/US20100057555A1/en
Assigned to YAHOO HOLDINGS, INC. reassignment YAHOO HOLDINGS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAHOO! INC.
Assigned to OATH INC. reassignment OATH INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAHOO HOLDINGS, INC.
Assigned to VERIZON PATENT AND LICENSING INC. reassignment VERIZON PATENT AND LICENSING INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VERIZON MEDIA INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • G06F16/447Temporal browsing, e.g. timeline
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • G06Q30/0245Surveys
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results

Definitions

  • the present invention generally relates to the organization and display of media objects, and particularly to the association of metadata with media objects, such as images, and the ranking thereof.
  • Search results rely upon rankings of items to determine the most relevant items to be presented to the searcher. These rankings may be based upon criteria such as the number of times a particular item was “clicked on” or viewed by a user. It is desired to make available a wider variety of user-derived information concerning media objects, and to develop more relevant rankings for media objects based upon that information.
  • Embodiments of the present invention enable the association of metadata with a media object by providing one or more media objects for display to one or more users, and accepting input from users concerning the one or more media objects.
  • the media object may include an image (e.g., a still or moving image) or an audio media object (e.g., a soundtrack).
  • the input may include at least two different types of metadata, such types including tags, comments, annotations, descriptions and additions to favorites (“favoriting”) or playlists (“playlisting”).
  • the tag metadata may include location metadata.
  • the logic implementing the embodiments herein may be located at a server, and each user may be associated with a corresponding client computer.
  • Embodiments of the invention may also perform a search of media objects using at least one metadatum, and rank the one or more images that return from the search.
  • the ranking may be based at least in part on user action related to the media object, including the quantity of user-entered metadata concerning the media object, the number of users who have assigned metadata to the media object, and/or an access pattern related to the media object.
  • the access pattern may be based at least in part upon the number of click throughs or views of the media object.
  • the ranking may also be based at least in part on a relationship between a poster of the media object and a user who initiated the search, and/or a lapse of time related to the media object.
  • Embodiments of the invention may base the rank at least in part on the relevance of one or more tags to the media object, where the relevance itself is based upon relevance input from one or more users.
  • Embodiments of the invention may include statistics logic for determining a relatedness metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the same media object.
  • the statistics logic may determine clusters of related metadata based upon the metrics for multiple metadata associated with multiple media objects, and perform separate rankings of the multiple media objects within each cluster.
  • the statistics logic may also provide the first and second metadata for display as related metadata if the determined metric exceeds a threshold relatedness value.
  • Embodiments of the invention may determine the relevance of the first and second metadata to the media object based at least in part upon a relevance input from a user, in which case the statistics logic may vary the relatedness metric based at least in part upon the determined relevance.
  • Embodiments of the invention may determine the frequency with which at least one particular metadatum has been assigned to media objects over a predetermined time period, and/or determine the number of media objects to which at least one particular metadatum is assigned.
  • Embodiments of the invention may provide information for use by an ad server, which associates an advertisement with an image or other media object.
  • a media object may be provided for display to a user in response to a search or other user action that may result in access to the media object.
  • Metadata logic may accept metadata from multiple users concerning the media object.
  • Statistics logic may determine a relatedness metric based at least in part upon the frequency with which metadata is assigned to the media object. The metadata and the metric may be made available to the ad server.
  • the ad server may associate the advertisement with the media object based at least in part upon the metadata and, optionally, the relatedness metric.
  • the statistics logic may determine the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the media object.
  • the first and second metadata may be made available to the ad server.
  • FIG. 1 illustrates a client-server system according to an embodiment of the present invention.
  • FIG. 2 is a screenshot illustrating the entry of tag metadata to a media object according to an embodiment of the present invention.
  • FIG. 3 illustrates adding annotation metadata according to an embodiment of the invention.
  • FIG. 4 illustrates setting permissions according to an embodiment of the invention.
  • FIG. 1 illustrates a client-server system according to an embodiment of the present invention.
  • a media server may include http web server logic, a scripting engine (such as a PHP scripting engine), a database, and an aggregation engine.
  • the media server may communicate with multiple clients over a network, such as the Internet.
  • the scripting engine may include authentication logic, upload logic, metadata processing logic, and permissions handling logic.
  • the authentication logic authenticates a user signing on to the media server web site.
  • the upload logic may be used to upload from the client to the server data conforming to any media format, e.g., still photograph (e.g., JPEG, TIFF), video (e.g., MPEG, AVI), or audio (e.g., MP3, OGG).
  • the aggregation engine may include a statistics engine and a search engine.
  • a client for use with the server of the invention may include a typical web browser application. Much of the functionality of the invention may be observed at www.flickr.com, which is incorporated by reference herein in its entirety.
  • a user at a client uses a browser to access the media server, and requests an upload of media objects.
  • the upload logic stores the media objects from the client into the database.
  • images For the sake of convenience, we will frequently use images as examples of media objects manipulated by the system, but those skilled in the art will recognize that the invention applies to other media objects, subject to appropriate modifications and use of other functions where appropriate (e.g., viewing a media object may apply to viewing a still or moving image or listening to an audio media object, such as a soundtrack).
  • the metadata processing logic permits the user to enter metadata to describe each image.
  • metadata may refer to one metadatum or plural metadata.
  • the metadata may take the form of one or more tags for each image, such as four distinct tags entered as one space-delimited list “clouds seagull birds sky” for an image of a flying seagull.
  • Other types of metadata include a title (e.g., “Last gull (for now)”), a description of the image, annotations, and comments.
  • An annotation is a descriptive note displayed directly over a section of the image being annotated. The annotation may be hidden from view until the user passes a cursor over the annotated section. Referring to FIG.
  • the user may add an annotation near the seagull's wing such as “Note the sunlight coming through the wings.”
  • a comment may be entered in a text input box similar to that used for entering comments on a message board. Multiple comments from any permitted user may be made and displayed for a media object.
  • the permissions logic enables the user to set permissions concerning who is allowed to view each image.
  • the user may set the permissions to allow access only to the user herself, to a limited group of people, e.g., family and/or friends, or to the public (e.g., the entire user base).
  • the permissions logic allows the user to permit others to provide metadata regarding each image.
  • the user may allow friends and/or family, any other user, someone from the user's contact list, or no one else, to add tags, comments (e.g., “I like the way the seagull is hovering”), or annotations.
  • the database enables organization of the media objects in a variety of ways. For example, a user's media objects may be organized chronologically, allowing the user to search media objects by date. This organization allows presentation of the media objects (e.g., photographic images, still images used to represent video files, or icons representing audio files) on the user's display along a timeline or in a calendar format (e.g., with a selected image from each day displayed at the corresponding date entry). The media objects may be displayed according to the date of upload, or the date that the media object was created, pursuant to the user's display format choice. Moreover, the scripting engine allows the display of the media objects in a slide show format.
  • the media objects e.g., photographic images, still images used to represent video files, or icons representing audio files
  • the media objects may be displayed according to the date of upload, or the date that the media object was created, pursuant to the user's display format choice.
  • the scripting engine allows the display of the media objects in a slide show format.
  • the date of creation may be based upon device-supplied metadata, such as metadata from the camera that took the picture, including metadata regarding aperture, shutter speed and other settings.
  • metadata may be extracted, for example, from the EXIF (Exchangeable Image File) header stored inside the uploaded file by many digital cameras, or the IPTC (International Press Telecommunications Council) header stored inside the uploaded file by many photo management and organization software packages.
  • EXIF Exchangeable Image File
  • IPTC International Press Telecommunications Council
  • the database also permits the user to organize media objects uploaded by the user into sets identified and described by user-provided set identifiers and descriptions.
  • Each set of images for example, is analogous to a photo album.
  • Each media object may belong to multiple sets.
  • the set identifier and description themselves are also metadata.
  • media objects from multiple users may be pooled into a “group” using the database.
  • Each group is identified by a group identifier provided by the user who establishes the group.
  • the grouping of all groups together represents all the media objects of a particular type (e.g., images) accessible on the media server hosting the media objects.
  • the group creator may set various permission levels for accessing and adding media objects to the group.
  • the permission levels may include, for example, public for the entire user base, or private for friends/family or a user-defined social network. Users permitted access to a group may also be permitted to add tags, comments and/or annotations.
  • the database Similar to the display and organization of an individual user's media objects, the database enables the organization and display of group media objects in a time line or calendar format arranged by date, as well as in slide show.
  • the media server may include an RSS feed generator to allow a user to subscribe to a “feed” of media objects, such as media objects belonging to a particular grouping, or identified by a particular tag, that are, for example, ordered by the date they were posted.
  • a “grouping” may refer to any collection, such as all groups of media objects, a single group of multiple users' media objects, all of an individual user's media objects, or a set (i.e., subset) of the individual's media objects.
  • An RSS reader at the user's client computer may be configured so that only new media objects posted since the user last accessed the media objects (e.g., updates) will be presented to the user. Similarly, the reader may be configured so that only the most recent of a string of comments relating to a particular media object may be displayed using this feature.
  • the statistics engine generates statistics and other metrics based upon aggregated metadata.
  • the statistics engine determines the popularity of metadata (e.g., tags) within a grouping of media objects over a predetermined time period. For example, the statistics engine may determine the number of different users that have assigned a particular tag to one or more media objects within all groups on the system, within a single group, or within a set of media objects, over the last 24 hours.
  • the aggregation engine may determine (and display) a histogram of the tags, and may determine the most frequently assigned tags (at any point in time or over a predetermined time period) by determining those tags either having a frequency exceeding a minimum threshold frequency or belonging to a predetermined number of the most popular tags.
  • a predetermined number of metadata e.g., tags
  • terms within metadata e.g., terms within comments
  • the statistics engine may determine the “relatedness” of metadata, i.e., a co-occurrence measure of the frequency with which a particular metadatum (e.g., tag) (or term within a metadatum (e.g., within a comment)) is assigned to a media object along with at least one other particular metadatum (or term within a metadatum).
  • the co-occurrence measure may determine the frequency of co-occurrence of metadata of the same type.
  • Tag MD can include location.
  • the relatedness metric may be made user-specific, so that it is a co-occurrence measure of the frequency of the number of users who have (e.g., have uploaded, or have in their user account) at least one media object assigned a particular metadatum (e.g., tag) (or term within a metadatum (e.g., a comment)) along with at least one other particular metadatum (or term within a metadatum).
  • a particular metadatum e.g., tag
  • metadatum e.g., a comment
  • a predefined number of the metadata (e.g., tags) having the highest co-occurrence indices, or those having co-occurrence indices exceeding a predefined threshold may be displayed to the user as “related” metadata (e.g., tags), with at least one metadatum (e.g., tag) not satisfying the predefined condition being displayed under “See also.”
  • the predefined threshold may be computed as a percentage of the maximum possible value of the index. All such displayed metadata may act as hyperlinks to all media objects assigned the designated metadata.
  • the relatedness measure may be applied to all “public” media objects (i.e., those available to anyone on the system), or to smaller groupings (such as those within a group or set).
  • the statistics engine may employ a statistical clustering analysis known in the art to determine the statistical proximity between metadata (e.g., tags), and to group the metadata and associated media objects according to corresponding cluster. For example, out of 10,000 images tagged with the word “Vancouver,” one statistical cluster within a threshold proximity level may include images also tagged with “Canada” and “British Columbia.” Another statistical cluster within the threshold proximity may instead be tagged with “Washington” and “space needle” along with “Vancouver.” Clustering analysis allows the statistics engine to associate “Vancouver” with both the “Vancouver-Canada” cluster and the “Vancouver-Washington” cluster.
  • the media server may provide for display to the user the two sets of related tags to indicate they belong to different clusters corresponding to different subject matter areas, for example.
  • An embodiment of the invention permits a user to determine the relevance of a tag to a media object, in particular to media objects posted by other users.
  • Relevance-setting icons or other input graphics may be displayed next to each tag.
  • the icons may include “+” and “ ⁇ ” buttons to indicate whether the user believes that the tag is relevant or not relevant, respectively, to the displayed media object.
  • the statistics engine may collect the relevance entries for each media object to determine a relevance metric for the object. For example, the metric may simply be the number of entered “+”s divided by the total number of relevance entries for each media object.
  • the statistics engine associates each vote with the voting user to prevent “stuffing the ballot box,” i.e., the statistics engine avoids counting multiple votes by a single user concerning the relevance of a tag to a media object.
  • the statistics engine may factor the relevance value into the clustering analysis to affect the relatedness metric. For example, a tag that has a low relevance value would be treated as less related to other tags associated with the same media objects (i.e., weighted to have a longer statistical distance).
  • the metadata processing logic 118 may compute an “interestingness” metric for each media object, according to an embodiment of the invention.
  • Interestingness may be a function of user actions related to a media object, including, for example, the quantity of user-entered and/or user-edited metadata and/or access patterns for the media objects. Alternatively or in addition to those factors, interestingness may be a function of time, system settings, and/or the relationship of the user to the poster of the media object.
  • each of the above factors may be clipped by a maximum value set by the system designer, which is one way of weighting each factor.
  • each factor may be more directly weighted by a weighting coefficient that multiplies the factor.
  • the factors may be summed together to create an interestingness score (i.e., rank).
  • the weighting and clipping may, of course, be applied at a finer level to each parameter (described below) contributing to any of these factors.
  • the interestingness score may be computed for any media object for any grouping, e.g., from all groups containing the media object, from one group containing the media object, from the area of the web site associated with the poster of the media object, or from within a set of that user's media objects containing the media object being scored, for example.
  • the quantity of user-entered metadata may include, for example, parameters such as the number of tags, comments and/or annotations assigned to the media object, and/or the number of users who have added the media object to their favorites/bookmarks. (Adding an audio media object to a user's favorites may include adding the media object to a user's playlist.)
  • the quantity of user-entered metadata may be user-related and include, for example, the number of users who have added tags, comments and/or annotations to the media object, and/or added the media object to their favorites/bookmarks.
  • the metadata processing logic 118 may factor into the interestingness score access patterns for the media object, such as the number of viewings (or playbacks) and/or click throughs of the media object, and/or the number of users who have viewed (or played back), and/or clicked through the media object or tags related to the media object.
  • the interestingness algorithm treats a user's action as a “click through,” or, conversely, a “view” or “viewing” of a media object may depend upon the route the user took to access the media object, i.e., the access pattern. For example, a search for images assigned a particular tag may return multiple thumbnail images. The algorithm may treat a user's clicking on a particular one of those thumbnails as a “click through.”
  • an image emailed to a user from another user may be considered to be “viewed” by the user.
  • the user's browser may present the images as thumbnails. The user may click on a thumbnail to “view” it.
  • the identical action of clicking on a thumbnail image may be treated as a “view” or a “click through” depending upon the path the user took to reach the image, i.e., the access pattern.
  • the system designer may want to treat certain access patterns as indicating a higher degree of user interest than others, and assign such access patterns a higher weight in computing the interestingness score.
  • the metadata processing logic 118 may factor into the score the relationship of the poster of the media object to the user (e.g., a user entering a search query).
  • a user may be a member of a private group (e.g., friends and family, an interest group, or a social network) allowed access to the poster's media objects, or a user listed in the poster's contact list, for example. Given the potentially higher likelihood of a similarity of interests between such a user and the poster relative to other users, this relationship may be weighted and summed into the interestingness score to increase it.
  • the score may be based upon the identity of the requester of the interestingness score for the media object.
  • reference to the “requester” or to one who requests an interestingness score or rank of a media object refers to one who explicitly requests the score, or who takes an action through any access pattern, such as entering a search query, that results in presentation of the media object along with computation of the interestingness score by the metadata processing logic 118 , whether or not the score itself is provided to the requester.
  • the score may be based upon the relationship between the poster of the media object and a user requesting the score.
  • the personalized score for a media object associated with a user may be based upon the number of media objects assigned the same type of metadata (e.g., tags or favorites) by that user and the score requester.
  • the media object may be associated with the user by, for example, being assigned metadata by a user or posted by the user. For example, assume that a first user and a second user store in their on-line albums 100 and 200 photo images, respectively. The second user may search for images associated with a particular tag. The search engine 111 may return an image stored in the first user's album.
  • the metadata processing logic 118 may assign to that image a score as an increasing function of the number of other images in the first and second users' albums that have been commonly designated as favorites or commonly tagged by the first and second users, under the theory that such shared behavior serves as a predictor that the second user may be especially interested in images in the first user's album that the second user has not yet “favorited” or tagged.
  • the metadata processing logic 118 may compute the interestingness score based upon a location associated with the media object and with a user requesting a score for the media object. For example, the metadata processing logic 118 may indicate that a media object is more interesting to a particular user if the location associated with the media object is associated with a residence of the user (e.g., near or in the same geographic region as the user's residence), associated with a residence of another user having a predefined relationship with the user, such as a friend or family member, or associated with a location that is itself associated with a threshold number of media objects that have been assigned metadata (e.g., tagged or favorited) by the user.
  • a residence of the user e.g., near or in the same geographic region as the user's residence
  • a predefined relationship with the user such as a friend or family member
  • a threshold number of media objects that have been assigned metadata e.g., tagged or favorited
  • the metadata processing logic 118 may, for a particular user, positively factor into the interestingness score of an image of the Washington Monument the fact that the user has designated as favorites a large number of images associated with the Washington, D.C. area. This assumes that location metadata indicating the Washington area has been associated with the image of the Monument, e.g., by the poster of the image or another user entering the location through a tag field or separate “location” field when assigning metadata to the image.
  • Other interestingness score components may be set by the system designer. For example, some media objects may be treated as undesirable because they contain objectionable content such as obscene imagery or promotions of a competitor's product.
  • the system designer may, for example, set up the score computation to decrement the thus-far accumulated score by a predetermined score offset percentage assigned to a media object having a tag or other metadata on a “blacklist.” Because a media object may be associated with more than one blacklisted tag, the score offset value may be chosen to be the greatest score offset associated with those tags.
  • Another score component may take time into account. For example, the system designer may set up the score computation to decrement the thus-far accumulated score by a predetermined percentage over time starting at the time the media object was posted. For example, this time decay may cause the score to decrement by 2% per day from the day of posting. This and other means may be employed to prevent the occurrence of “positive feedback loops” where the sorting of media objects by interestingness itself skews the results, causing those same media objects to be more frequently accessed, thereby unnaturally increasing their interestingness scores.
  • the ultimate interestingness score may be normalized, so that, for example, the interestingness score always falls between 0 and 100, or 0 and 1.
  • One way of achieving normalization is to divide the actual score value by the maximum possible score value.
  • the search engine 111 allows the user to search media objects in the database according to various metadata. For example, a user may conduct a boolean search of tags among all media objects accessible to the user. Alternatively, the user may perform a full-text boolean search of terms in comments, annotations, titles or descriptions.
  • the media objects accessible to a user include, for example, public media objects, media objects within a group, media objects for which the user is a friend/family member or member of another private group, all media objects posted by the user, or the user's media objects within a user-defined set.
  • the media objects returned from a search may be ranked according to interestingness.
  • the media server may, in one embodiment, provide for display to the searching user only the media objects having an interestingness score above a predetermined threshold, or a predetermined number of the highest scoring media objects.
  • the statistics engine 109 may determine the tags (or other metadata) that are most highly related to the one or more tags (or other metadata) in the search query (according to the relatedness metric).
  • the media server 100 may return to the user at a client the most highly related tags (or other metadata) along with the retrieved media objects. If the relatedness computation results in two clusters of related tags (or other metadata), then media objects associated with the two clusters may be ranked (and displayed) in order of interestingness.
  • advertisements may be associated with their own metadata/keywords, such as “Rome Italy hotels tourism travel” for an Italian hotel advertisement.
  • an ad server 122 may use the relatedness metric and set of related tags or other metadata provided by the media server via the web server 102 to determine which advertisements sponsoring the web site are associated with predefined metadata/keywords that most closely match the set of related tags.
  • the ad server may be a third-party server on the network 112 .
  • the ad server may provide to the user for display the most closely matching advertisements.
  • the ad server may provide for display at the user's client computer the ad for Italian hotels in conjunction with the display of pictures from the media server having a set of highly related tags “Rome Italy honeymoon.” In this manner, the ad server uses the relatedness metric and set of highly related tags to provide the advertisements most highly related to the displayed media objects.
  • the statistics engine may also prevent a media object assigned a tag (or other metadatum) that has a relevance score falling below a relevance threshold from being returned as a search result.
  • the invention can be implemented in any suitable form including hardware, software, firmware or any combination thereof. Different aspects of the invention may be implemented at least partly as computer software or firmware running on one or more data processors and/or digital signal processors.
  • the elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit or may be physically and functionally distributed between different units and processors.

Abstract

Metadata may be associated with media objects by providing media objects for display, and accepting input concerning the media objects, where the input may include at least two different types of metadata. For example, metadata may be in the form of tags, comments, annotations or favorites. The media objects may be searched according to metadata, and ranked in a variety of ways.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a Divisional of U.S. Ser. No. 11,350,635, filed Feb. 8, 2006 which claims the benefit of priority to U.S. Application No. 60/674,109, filed Apr. 21, 2005, and entitled “GENERATION AND USE OF METADATA FOR MEDIA OBJECTS,” both of which are incorporated herein by reference in their entirety and for all purposes.
  • This application is related to U.S. application Ser. No. 11/350,981, filed Feb. 8, 2006, and entitled “INTERESTINGNESS RANKING OF MEDIA OBJECTS,” which is incorporated by reference in its entirety herein.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention generally relates to the organization and display of media objects, and particularly to the association of metadata with media objects, such as images, and the ranking thereof.
  • 2. Description of the Related Art
  • Existing web sites allow users to comment upon or review media such as books or movies. However, conventional web sites are limited in the type of information concerning media objects that can be provided either directly by a user or indirectly through the user's actions, and the use of that information to generate search results.
  • Search results rely upon rankings of items to determine the most relevant items to be presented to the searcher. These rankings may be based upon criteria such as the number of times a particular item was “clicked on” or viewed by a user. It is desired to make available a wider variety of user-derived information concerning media objects, and to develop more relevant rankings for media objects based upon that information.
  • SUMMARY OF THE INVENTION
  • Embodiments of the present invention enable the association of metadata with a media object by providing one or more media objects for display to one or more users, and accepting input from users concerning the one or more media objects. The media object may include an image (e.g., a still or moving image) or an audio media object (e.g., a soundtrack). The input may include at least two different types of metadata, such types including tags, comments, annotations, descriptions and additions to favorites (“favoriting”) or playlists (“playlisting”). The tag metadata may include location metadata. The logic implementing the embodiments herein may be located at a server, and each user may be associated with a corresponding client computer.
  • Embodiments of the invention may also perform a search of media objects using at least one metadatum, and rank the one or more images that return from the search. The ranking may be based at least in part on user action related to the media object, including the quantity of user-entered metadata concerning the media object, the number of users who have assigned metadata to the media object, and/or an access pattern related to the media object. The access pattern may be based at least in part upon the number of click throughs or views of the media object. The ranking may also be based at least in part on a relationship between a poster of the media object and a user who initiated the search, and/or a lapse of time related to the media object. Embodiments of the invention may base the rank at least in part on the relevance of one or more tags to the media object, where the relevance itself is based upon relevance input from one or more users.
  • Embodiments of the invention may include statistics logic for determining a relatedness metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the same media object. The statistics logic may determine clusters of related metadata based upon the metrics for multiple metadata associated with multiple media objects, and perform separate rankings of the multiple media objects within each cluster. The statistics logic may also provide the first and second metadata for display as related metadata if the determined metric exceeds a threshold relatedness value. Embodiments of the invention may determine the relevance of the first and second metadata to the media object based at least in part upon a relevance input from a user, in which case the statistics logic may vary the relatedness metric based at least in part upon the determined relevance.
  • Embodiments of the invention may determine the frequency with which at least one particular metadatum has been assigned to media objects over a predetermined time period, and/or determine the number of media objects to which at least one particular metadatum is assigned.
  • Embodiments of the invention may provide information for use by an ad server, which associates an advertisement with an image or other media object. A media object may be provided for display to a user in response to a search or other user action that may result in access to the media object. Metadata logic may accept metadata from multiple users concerning the media object. Statistics logic may determine a relatedness metric based at least in part upon the frequency with which metadata is assigned to the media object. The metadata and the metric may be made available to the ad server.
  • The ad server may associate the advertisement with the media object based at least in part upon the metadata and, optionally, the relatedness metric. In embodiments of the invention, the statistics logic may determine the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the media object. The first and second metadata may be made available to the ad server.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates a client-server system according to an embodiment of the present invention.
  • FIG. 2 is a screenshot illustrating the entry of tag metadata to a media object according to an embodiment of the present invention.
  • FIG. 3 illustrates adding annotation metadata according to an embodiment of the invention.
  • FIG. 4 illustrates setting permissions according to an embodiment of the invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • The following description is presented to enable a person of ordinary skill in the art to make and use the invention. Descriptions of specific devices, techniques, and applications are provided only as examples. Various modifications to the examples described herein will be readily apparent to those of ordinary skill in the art, and the general principles defined herein may be applied to other examples and applications without departing from the spirit and scope of the invention. Thus, the present invention is not intended to be limited to the examples described herein and shown, but is to be accorded the scope consistent with the claims.
  • FIG. 1 illustrates a client-server system according to an embodiment of the present invention. A media server according to an embodiment of the invention may include http web server logic, a scripting engine (such as a PHP scripting engine), a database, and an aggregation engine. The media server may communicate with multiple clients over a network, such as the Internet.
  • The scripting engine may include authentication logic, upload logic, metadata processing logic, and permissions handling logic. The authentication logic authenticates a user signing on to the media server web site. The upload logic may be used to upload from the client to the server data conforming to any media format, e.g., still photograph (e.g., JPEG, TIFF), video (e.g., MPEG, AVI), or audio (e.g., MP3, OGG). The aggregation engine may include a statistics engine and a search engine. A client for use with the server of the invention may include a typical web browser application. Much of the functionality of the invention may be observed at www.flickr.com, which is incorporated by reference herein in its entirety.
  • According to an embodiment of the invention, a user at a client uses a browser to access the media server, and requests an upload of media objects. In response, the upload logic stores the media objects from the client into the database. For the sake of convenience, we will frequently use images as examples of media objects manipulated by the system, but those skilled in the art will recognize that the invention applies to other media objects, subject to appropriate modifications and use of other functions where appropriate (e.g., viewing a media object may apply to viewing a still or moving image or listening to an audio media object, such as a soundtrack).
  • The metadata processing logic permits the user to enter metadata to describe each image. (As used herein, “metadata” may refer to one metadatum or plural metadata.) Referring to FIG. 2, the metadata may take the form of one or more tags for each image, such as four distinct tags entered as one space-delimited list “clouds seagull birds sky” for an image of a flying seagull. Other types of metadata include a title (e.g., “Last gull (for now)”), a description of the image, annotations, and comments. An annotation is a descriptive note displayed directly over a section of the image being annotated. The annotation may be hidden from view until the user passes a cursor over the annotated section. Referring to FIG. 3, for example, the user may add an annotation near the seagull's wing such as “Note the sunlight coming through the wings.” A comment may be entered in a text input box similar to that used for entering comments on a message board. Multiple comments from any permitted user may be made and displayed for a media object.
  • Referring to FIG. 4, the permissions logic enables the user to set permissions concerning who is allowed to view each image. For example, the user may set the permissions to allow access only to the user herself, to a limited group of people, e.g., family and/or friends, or to the public (e.g., the entire user base). In addition, the permissions logic allows the user to permit others to provide metadata regarding each image. For example, the user may allow friends and/or family, any other user, someone from the user's contact list, or no one else, to add tags, comments (e.g., “I like the way the seagull is hovering”), or annotations.
  • The database enables organization of the media objects in a variety of ways. For example, a user's media objects may be organized chronologically, allowing the user to search media objects by date. This organization allows presentation of the media objects (e.g., photographic images, still images used to represent video files, or icons representing audio files) on the user's display along a timeline or in a calendar format (e.g., with a selected image from each day displayed at the corresponding date entry). The media objects may be displayed according to the date of upload, or the date that the media object was created, pursuant to the user's display format choice. Moreover, the scripting engine allows the display of the media objects in a slide show format.
  • For photographs, the date of creation may be based upon device-supplied metadata, such as metadata from the camera that took the picture, including metadata regarding aperture, shutter speed and other settings. Such metadata may be extracted, for example, from the EXIF (Exchangeable Image File) header stored inside the uploaded file by many digital cameras, or the IPTC (International Press Telecommunications Council) header stored inside the uploaded file by many photo management and organization software packages. The chronological organization of photographic images may be referred to as a “photostream.”
  • The database also permits the user to organize media objects uploaded by the user into sets identified and described by user-provided set identifiers and descriptions. Each set of images, for example, is analogous to a photo album. Each media object may belong to multiple sets. The set identifier and description themselves are also metadata.
  • In contrast to a set, which includes media objects from just one user, media objects from multiple users may be pooled into a “group” using the database. Each group is identified by a group identifier provided by the user who establishes the group. The grouping of all groups together represents all the media objects of a particular type (e.g., images) accessible on the media server hosting the media objects. The group creator may set various permission levels for accessing and adding media objects to the group. The permission levels may include, for example, public for the entire user base, or private for friends/family or a user-defined social network. Users permitted access to a group may also be permitted to add tags, comments and/or annotations. Similar to the display and organization of an individual user's media objects, the database enables the organization and display of group media objects in a time line or calendar format arranged by date, as well as in slide show.
  • The media server may include an RSS feed generator to allow a user to subscribe to a “feed” of media objects, such as media objects belonging to a particular grouping, or identified by a particular tag, that are, for example, ordered by the date they were posted. (A “grouping” may refer to any collection, such as all groups of media objects, a single group of multiple users' media objects, all of an individual user's media objects, or a set (i.e., subset) of the individual's media objects.) An RSS reader at the user's client computer may be configured so that only new media objects posted since the user last accessed the media objects (e.g., updates) will be presented to the user. Similarly, the reader may be configured so that only the most recent of a string of comments relating to a particular media object may be displayed using this feature.
  • The statistics engine generates statistics and other metrics based upon aggregated metadata. In one embodiment, the statistics engine determines the popularity of metadata (e.g., tags) within a grouping of media objects over a predetermined time period. For example, the statistics engine may determine the number of different users that have assigned a particular tag to one or more media objects within all groups on the system, within a single group, or within a set of media objects, over the last 24 hours. The aggregation engine may determine (and display) a histogram of the tags, and may determine the most frequently assigned tags (at any point in time or over a predetermined time period) by determining those tags either having a frequency exceeding a minimum threshold frequency or belonging to a predetermined number of the most popular tags.
  • In one embodiment of the invention, a predetermined number of metadata (e.g., tags) or terms within metadata (e.g., terms within comments) may have their frequency indicated by the size of the font used to display them. For example, the 100 most popular tags within all groups may be arranged on a user's display alphabetically, with increasing popularity indicated by increasing font size.
  • In another embodiment, the statistics engine may determine the “relatedness” of metadata, i.e., a co-occurrence measure of the frequency with which a particular metadatum (e.g., tag) (or term within a metadatum (e.g., within a comment)) is assigned to a media object along with at least one other particular metadatum (or term within a metadatum). In one embodiment, the co-occurrence measure may determine the frequency of co-occurrence of metadata of the same type. For example, out of all 100 images tagged with the word “Italy,” 50 of those images may also be tagged with “Rome,” 25 tagged with “Venice,” 10 with “Florence,” and 2 with “Sienna.” The co-occurrence index would respectively be 50 for “Italy-Rome,” 25 for “Italy-Venice,” 10 for “Italy-Florence,” and 2 for “Italy-Sienna.” In summary, include location as subset of tags, Tag MD can include location.
  • In another embodiment, the relatedness metric may be made user-specific, so that it is a co-occurrence measure of the frequency of the number of users who have (e.g., have uploaded, or have in their user account) at least one media object assigned a particular metadatum (e.g., tag) (or term within a metadatum (e.g., a comment)) along with at least one other particular metadatum (or term within a metadatum). For example, out of all 100 users that have at least one image tagged with the word “Italy,” 50 of those users may have images tagged with “Italy” also tagged with “Rome,” 25 also tagged with “Venice,” 10 with “Florence,” and 2 with “Sienna.” The co-occurrence index would respectively be 50 for “Italy-Rome,” 25 for “Italy-Venice,” 10 for “Italy-Florence,” and 2 for “Italy-Sienna.”
  • A predefined number of the metadata (e.g., tags) having the highest co-occurrence indices, or those having co-occurrence indices exceeding a predefined threshold, may be displayed to the user as “related” metadata (e.g., tags), with at least one metadatum (e.g., tag) not satisfying the predefined condition being displayed under “See also.” The predefined threshold may be computed as a percentage of the maximum possible value of the index. All such displayed metadata may act as hyperlinks to all media objects assigned the designated metadata. The relatedness measure may be applied to all “public” media objects (i.e., those available to anyone on the system), or to smaller groupings (such as those within a group or set).
  • As part of the relatedness computation, the statistics engine may employ a statistical clustering analysis known in the art to determine the statistical proximity between metadata (e.g., tags), and to group the metadata and associated media objects according to corresponding cluster. For example, out of 10,000 images tagged with the word “Vancouver,” one statistical cluster within a threshold proximity level may include images also tagged with “Canada” and “British Columbia.” Another statistical cluster within the threshold proximity may instead be tagged with “Washington” and “space needle” along with “Vancouver.” Clustering analysis allows the statistics engine to associate “Vancouver” with both the “Vancouver-Canada” cluster and the “Vancouver-Washington” cluster. The media server may provide for display to the user the two sets of related tags to indicate they belong to different clusters corresponding to different subject matter areas, for example.
  • An embodiment of the invention permits a user to determine the relevance of a tag to a media object, in particular to media objects posted by other users. Relevance-setting icons or other input graphics may be displayed next to each tag. For example, the icons may include “+” and “−” buttons to indicate whether the user believes that the tag is relevant or not relevant, respectively, to the displayed media object. The statistics engine may collect the relevance entries for each media object to determine a relevance metric for the object. For example, the metric may simply be the number of entered “+”s divided by the total number of relevance entries for each media object. The statistics engine associates each vote with the voting user to prevent “stuffing the ballot box,” i.e., the statistics engine avoids counting multiple votes by a single user concerning the relevance of a tag to a media object.
  • The statistics engine may factor the relevance value into the clustering analysis to affect the relatedness metric. For example, a tag that has a low relevance value would be treated as less related to other tags associated with the same media objects (i.e., weighted to have a longer statistical distance).
  • The metadata processing logic 118 may compute an “interestingness” metric for each media object, according to an embodiment of the invention. Interestingness may be a function of user actions related to a media object, including, for example, the quantity of user-entered and/or user-edited metadata and/or access patterns for the media objects. Alternatively or in addition to those factors, interestingness may be a function of time, system settings, and/or the relationship of the user to the poster of the media object.
  • Each of the above factors may be clipped by a maximum value set by the system designer, which is one way of weighting each factor. Alternatively, or in addition, before any clipping, each factor may be more directly weighted by a weighting coefficient that multiplies the factor. In either case, the factors (whether weighted or not) may be summed together to create an interestingness score (i.e., rank). The weighting and clipping may, of course, be applied at a finer level to each parameter (described below) contributing to any of these factors.
  • The interestingness score may be computed for any media object for any grouping, e.g., from all groups containing the media object, from one group containing the media object, from the area of the web site associated with the poster of the media object, or from within a set of that user's media objects containing the media object being scored, for example.
  • The quantity of user-entered metadata may include, for example, parameters such as the number of tags, comments and/or annotations assigned to the media object, and/or the number of users who have added the media object to their favorites/bookmarks. (Adding an audio media object to a user's favorites may include adding the media object to a user's playlist.) Alternatively or in addition to those parameters, the quantity of user-entered metadata may be user-related and include, for example, the number of users who have added tags, comments and/or annotations to the media object, and/or added the media object to their favorites/bookmarks.
  • Alternatively or in addition to those parameters, the metadata processing logic 118 may factor into the interestingness score access patterns for the media object, such as the number of viewings (or playbacks) and/or click throughs of the media object, and/or the number of users who have viewed (or played back), and/or clicked through the media object or tags related to the media object. Whether the interestingness algorithm treats a user's action as a “click through,” or, conversely, a “view” or “viewing” of a media object may depend upon the route the user took to access the media object, i.e., the access pattern. For example, a search for images assigned a particular tag may return multiple thumbnail images. The algorithm may treat a user's clicking on a particular one of those thumbnails as a “click through.”
  • In contrast, for example, an image emailed to a user from another user may be considered to be “viewed” by the user. In another example, when a user accesses a group pool of images, the user's browser may present the images as thumbnails. The user may click on a thumbnail to “view” it. Thus, it can be seen that the identical action of clicking on a thumbnail image may be treated as a “view” or a “click through” depending upon the path the user took to reach the image, i.e., the access pattern. Based upon psychological insights, marketing research or other factors, the system designer may want to treat certain access patterns as indicating a higher degree of user interest than others, and assign such access patterns a higher weight in computing the interestingness score. As perhaps a more illustrative example, if a user reaches and clicks upon a thumbnail image based upon paying $10.00 to access the image, then the system designer is likely to assign such an access path a higher weighting coefficient than a free access of an image. Conversely, certain sources of traffic, search terms, tag queries or other precursors to the display of thumbnail images may be determined to correlate with a motivation that is inconsistent with a high interestingness, and thus the system designer is likely to assign such access paths relatively low weighting coefficients.
  • In addition, the metadata processing logic 118 may factor into the score the relationship of the poster of the media object to the user (e.g., a user entering a search query). A user may be a member of a private group (e.g., friends and family, an interest group, or a social network) allowed access to the poster's media objects, or a user listed in the poster's contact list, for example. Given the potentially higher likelihood of a similarity of interests between such a user and the poster relative to other users, this relationship may be weighted and summed into the interestingness score to increase it.
  • The above functionality is an example of “personalization” of the interestingness score. In general, the score may be based upon the identity of the requester of the interestingness score for the media object. (As used herein, reference to the “requester” or to one who requests an interestingness score or rank of a media object refers to one who explicitly requests the score, or who takes an action through any access pattern, such as entering a search query, that results in presentation of the media object along with computation of the interestingness score by the metadata processing logic 118, whether or not the score itself is provided to the requester.) In particular, the score may be based upon the relationship between the poster of the media object and a user requesting the score.
  • In another embodiment, the personalized score for a media object associated with a user may be based upon the number of media objects assigned the same type of metadata (e.g., tags or favorites) by that user and the score requester. The media object may be associated with the user by, for example, being assigned metadata by a user or posted by the user. For example, assume that a first user and a second user store in their on-line albums 100 and 200 photo images, respectively. The second user may search for images associated with a particular tag. The search engine 111 may return an image stored in the first user's album. The metadata processing logic 118 may assign to that image a score as an increasing function of the number of other images in the first and second users' albums that have been commonly designated as favorites or commonly tagged by the first and second users, under the theory that such shared behavior serves as a predictor that the second user may be especially interested in images in the first user's album that the second user has not yet “favorited” or tagged.
  • In another embodiment, the metadata processing logic 118 may compute the interestingness score based upon a location associated with the media object and with a user requesting a score for the media object. For example, the metadata processing logic 118 may indicate that a media object is more interesting to a particular user if the location associated with the media object is associated with a residence of the user (e.g., near or in the same geographic region as the user's residence), associated with a residence of another user having a predefined relationship with the user, such as a friend or family member, or associated with a location that is itself associated with a threshold number of media objects that have been assigned metadata (e.g., tagged or favorited) by the user.
  • In the latter case, for example, the metadata processing logic 118 may, for a particular user, positively factor into the interestingness score of an image of the Washington Monument the fact that the user has designated as favorites a large number of images associated with the Washington, D.C. area. This assumes that location metadata indicating the Washington area has been associated with the image of the Monument, e.g., by the poster of the image or another user entering the location through a tag field or separate “location” field when assigning metadata to the image.
  • Other interestingness score components may be set by the system designer. For example, some media objects may be treated as undesirable because they contain objectionable content such as obscene imagery or promotions of a competitor's product. The system designer may, for example, set up the score computation to decrement the thus-far accumulated score by a predetermined score offset percentage assigned to a media object having a tag or other metadata on a “blacklist.” Because a media object may be associated with more than one blacklisted tag, the score offset value may be chosen to be the greatest score offset associated with those tags.
  • Another score component may take time into account. For example, the system designer may set up the score computation to decrement the thus-far accumulated score by a predetermined percentage over time starting at the time the media object was posted. For example, this time decay may cause the score to decrement by 2% per day from the day of posting. This and other means may be employed to prevent the occurrence of “positive feedback loops” where the sorting of media objects by interestingness itself skews the results, causing those same media objects to be more frequently accessed, thereby unnaturally increasing their interestingness scores.
  • The ultimate interestingness score may be normalized, so that, for example, the interestingness score always falls between 0 and 100, or 0 and 1. One way of achieving normalization is to divide the actual score value by the maximum possible score value.
  • The search engine 111 allows the user to search media objects in the database according to various metadata. For example, a user may conduct a boolean search of tags among all media objects accessible to the user. Alternatively, the user may perform a full-text boolean search of terms in comments, annotations, titles or descriptions. The media objects accessible to a user include, for example, public media objects, media objects within a group, media objects for which the user is a friend/family member or member of another private group, all media objects posted by the user, or the user's media objects within a user-defined set.
  • The media objects returned from a search may be ranked according to interestingness. For example, the media server may, in one embodiment, provide for display to the searching user only the media objects having an interestingness score above a predetermined threshold, or a predetermined number of the highest scoring media objects.
  • In response to a search by tag, for example, the statistics engine 109 may determine the tags (or other metadata) that are most highly related to the one or more tags (or other metadata) in the search query (according to the relatedness metric). The media server 100 may return to the user at a client the most highly related tags (or other metadata) along with the retrieved media objects. If the relatedness computation results in two clusters of related tags (or other metadata), then media objects associated with the two clusters may be ranked (and displayed) in order of interestingness.
  • In an advertising context, advertisements may be associated with their own metadata/keywords, such as “Rome Italy hotels tourism travel” for an Italian hotel advertisement. Based upon those related keywords, an ad server 122 may use the relatedness metric and set of related tags or other metadata provided by the media server via the web server 102 to determine which advertisements sponsoring the web site are associated with predefined metadata/keywords that most closely match the set of related tags. (The ad server may be a third-party server on the network 112.) The ad server may provide to the user for display the most closely matching advertisements. For example, the ad server may provide for display at the user's client computer the ad for Italian hotels in conjunction with the display of pictures from the media server having a set of highly related tags “Rome Italy honeymoon.” In this manner, the ad server uses the relatedness metric and set of highly related tags to provide the advertisements most highly related to the displayed media objects.
  • In another embodiment, in response to a search by tag (or other metadatum), the statistics engine may also prevent a media object assigned a tag (or other metadatum) that has a relevance score falling below a relevance threshold from being returned as a search result.
  • It will be appreciated that the above description for clarity has described embodiments of the invention with reference to different functional units. However, it will be apparent that any suitable distribution of functionality between different functional units may be used without detracting from the invention. Hence, references to specific functional units are only to be seen as references to suitable means for providing the described functionality rather than indicative of a strict logical or physical structure or organization.
  • The invention can be implemented in any suitable form including hardware, software, firmware or any combination thereof. Different aspects of the invention may be implemented at least partly as computer software or firmware running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit or may be physically and functionally distributed between different units and processors.
  • Although the present invention has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the scope of the present invention is limited only by the claims. Additionally, although a feature may appear to be described in connection with a particular embodiment, one skilled in the art would recognize that various features of the described embodiments may be combined in accordance with the invention. Moreover, aspects of the invention describe in connection with an embodiment may stand alone as an invention.
  • Moreover, it will be appreciated that various modifications and alterations may be made by those skilled in the art without departing from the spirit and scope of the invention. The invention is not to be limited by the foregoing illustrative details, but is to be defined according to the claims.

Claims (23)

1. An apparatus for providing information for use by an ad server, the ad server for associating an advertisement with a media object, the apparatus comprising a computer-readable storage medium having computer readable instructions for:
providing the media object for presentation to at least one user;
accepting metadata from a plurality of users concerning the media object; and
statistics logic for determining a metric based at least in part upon the frequency with which at least one metadatum is assigned to the media object, wherein the at least one metadatum is available to the ad server.
2. The apparatus of claim 1, the ad server for associating the advertisement with the media object based at least in part upon the at least one metadatum.
3. The apparatus of claim 1, wherein the at least one metadatum and the metric are available to the ad server, the ad server for associating the advertisement with the media object based at least in part upon the metadatum and the metric.
4. The apparatus of claim 1, wherein the statistics logic is operable to determine the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the media object, wherein the first and second metadata are available to the ad server.
5. The apparatus of claim 1, wherein the at least one metadatum comprises at least one tag.
6. The apparatus of claim 1, wherein the media object is an image.
7. The apparatus of claim 1, wherein the media object is an audio media object.
8. A computer-implemented method for providing information for use by an ad server, the ad server for associating an advertisement with an image, the method comprising:
providing the image for display to at least one user;
accepting metadata from a plurality of users concerning the image;
determining a metric based at least in part upon the frequency with which at least one metadatum is assigned to the image, and
making the at least one metadatum available to the ad server.
9. The method of claim 8, further comprising making the metric available to the ad server, the ad server for associating the advertisement with the image based at least in part upon the metadatum and the metric.
10. The method of claim 8, determining comprising determining the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the image, wherein the first and second metadata are available to the ad server.
11. The method of claim 8, wherein the at least one metadatum comprises at least one tag.
12. A computer-implemented method for providing information for use by an ad server, the ad server for associating an advertisement with an audio media object, the method comprising:
providing the audio media object for playback to at least one user;
accepting metadata from a plurality of users concerning the audio media object;
determining a metric based at least in part upon the frequency with which at least one metadatum is assigned to the audio media object, and
making the at least one metadatum available to the ad server.
13. The method of claim 12, further comprising making the metric available to the ad server, the ad server for associating the advertisement with the audio media object based at least in part upon the metadatum and the metric.
14. The method of claim 12, determining comprising determining the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the audio media object, wherein the first and second metadata are available to the ad server.
15. The method of claim 12, wherein the at least one metadatum comprises at least one tag.
16. A computer program product including computer-executable program code for providing information for use by an ad server, the ad server for associating an advertisement with an image, the product comprising program code for:
providing the image for display to at least one user;
accepting metadata from a plurality of users concerning the image;
determining a metric based at least in part upon the frequency with which at least one metadatum is assigned to the image, and
making the at least one metadatum available to the ad server.
17. The computer program product of claim 16, further comprising program code for making the metric available to the ad server, the ad server for associating the advertisement with the image based at least in part upon the metadatum and the metric.
18. The computer program product of claim 16, determining comprising determining the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the image, wherein the first and second metadata are available to the ad server.
19. The computer program product of claim 16, wherein the at least one metadatum comprises at least one tag.
20. A computer program product including computer-executable program code for providing information for use by an ad server, the ad server for associating an advertisement with an audio media object, the product comprising program code for:
providing the audio media object for playback to at least one user;
accepting metadata from a plurality of users concerning the audio media object;
determining a metric based at least in part upon the frequency with which at least one metadatum is assigned to the audio media object, and
making the at least one metadatum available to the ad server.
21. The computer program product of claim 20, further comprising program code for making the metric available to the ad server, the ad server for associating the advertisement with the audio media object based at least in part upon the metadatum and the metric.
22. The computer program product of claim 20, determining comprising determining the metric based at least in part upon the frequency with which a first metadatum and a second metadatum are commonly assigned to the audio media object, wherein the first and second metadata are available to the ad server.
23. The computer program product of claim 20, wherein the at least one metadatum comprises at least one tag.
US12/555,706 2005-04-21 2009-09-08 Media object metadata association and ranking Abandoned US20100057555A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/555,706 US20100057555A1 (en) 2005-04-21 2009-09-08 Media object metadata association and ranking

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US67410905P 2005-04-21 2005-04-21
US11/350,635 US10210159B2 (en) 2005-04-21 2006-02-08 Media object metadata association and ranking
US12/555,706 US20100057555A1 (en) 2005-04-21 2009-09-08 Media object metadata association and ranking

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/350,635 Division US10210159B2 (en) 2005-04-21 2006-02-08 Media object metadata association and ranking

Publications (1)

Publication Number Publication Date
US20100057555A1 true US20100057555A1 (en) 2010-03-04

Family

ID=37188310

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/350,635 Active 2029-12-13 US10210159B2 (en) 2005-04-21 2006-02-08 Media object metadata association and ranking
US12/555,706 Abandoned US20100057555A1 (en) 2005-04-21 2009-09-08 Media object metadata association and ranking

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/350,635 Active 2029-12-13 US10210159B2 (en) 2005-04-21 2006-02-08 Media object metadata association and ranking

Country Status (6)

Country Link
US (2) US10210159B2 (en)
EP (1) EP1877972A4 (en)
JP (1) JP5666088B2 (en)
KR (2) KR100942885B1 (en)
CN (1) CN103902656B (en)
WO (1) WO2006116196A2 (en)

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060242178A1 (en) * 2005-04-21 2006-10-26 Yahoo! Inc. Media object metadata association and ranking
US20080040474A1 (en) * 2006-08-11 2008-02-14 Mark Zuckerberg Systems and methods for providing dynamically selected media content to a user of an electronic device in a social network environment
US20080263466A1 (en) * 2007-04-18 2008-10-23 Dialego Ag Method of and apparatus for ascertaining and providing information in relation to an image
US20090276437A1 (en) * 2008-04-30 2009-11-05 Microsoft Corporation Suggesting long-tail tags
US20110029612A1 (en) * 2006-08-11 2011-02-03 Andrew Bosworth Generating a Consolidated Social Story for a User of a Social Networking System
US20110087842A1 (en) * 2009-10-12 2011-04-14 Microsoft Corporation Pre-fetching content items based on social distance
US20110106784A1 (en) * 2008-04-04 2011-05-05 Merijn Camiel Terheggen System and method for publishing media objects
US20110161423A1 (en) * 2009-12-27 2011-06-30 James Pratt Method and system for providing a collaborative event-share service
US20110218946A1 (en) * 2010-03-03 2011-09-08 Microsoft Corporation Presenting content items using topical relevance and trending popularity
US20110320715A1 (en) * 2010-06-23 2011-12-29 Microsoft Corporation Identifying trending content items using content item histograms
US20120036482A1 (en) * 2010-08-04 2012-02-09 Copia Interactive, Llc Method of and System for Browsing and Displaying Items from a Collection
US8140953B1 (en) * 2007-10-26 2012-03-20 Adobe Systems Incorporated Flexible media catalog for multi-format project export
US20120072428A1 (en) * 2010-09-16 2012-03-22 Wayne Kao Action clustering for news feeds
US20120084731A1 (en) * 2010-09-30 2012-04-05 Microsoft Corporation Displaying images interesting to a user
US20120117142A1 (en) * 2010-11-05 2012-05-10 Inventec Corporation Cloud computing system and data accessing method thereof
US20120254806A1 (en) * 2011-03-30 2012-10-04 Google Inc. System and method for dynamic, feature-based playlist generation
US20120249571A1 (en) * 2011-03-30 2012-10-04 Casio Computer Co., Ltd. Image display method, server, and image display system
US8311792B1 (en) * 2009-12-23 2012-11-13 Intuit Inc. System and method for ranking a posting
WO2013048968A1 (en) * 2011-09-26 2013-04-04 Google Inc. Media content voting, ranking, and playing system
US8732175B2 (en) 2005-04-21 2014-05-20 Yahoo! Inc. Interestingness ranking of media objects
US20140380420A1 (en) * 2010-05-27 2014-12-25 Nokia Corporation Method and apparatus for expanded content tag sharing
US8965409B2 (en) 2006-03-17 2015-02-24 Fatdoor, Inc. User-generated community publication in an online neighborhood social network
US9002754B2 (en) 2006-03-17 2015-04-07 Fatdoor, Inc. Campaign in a geo-spatial environment
US9004396B1 (en) 2014-04-24 2015-04-14 Fatdoor, Inc. Skyteboard quadcopter and method
US9022324B1 (en) 2014-05-05 2015-05-05 Fatdoor, Inc. Coordination of aerial vehicles through a central server
US9037516B2 (en) 2006-03-17 2015-05-19 Fatdoor, Inc. Direct mailing in a geo-spatial environment
US9064288B2 (en) 2006-03-17 2015-06-23 Fatdoor, Inc. Government structures and neighborhood leads in a geo-spatial environment
US9071367B2 (en) 2006-03-17 2015-06-30 Fatdoor, Inc. Emergency including crime broadcast in a neighborhood social network
US9070101B2 (en) 2007-01-12 2015-06-30 Fatdoor, Inc. Peer-to-peer neighborhood delivery multi-copter and method
US9098545B2 (en) 2007-07-10 2015-08-04 Raj Abhyanker Hot news neighborhood banter in a geo-spatial social network
US9355110B1 (en) 2011-07-14 2016-05-31 Google Inc. Dynamic presentation of data items based on prioritized associations
US20160170994A1 (en) * 2014-12-10 2016-06-16 Samsung Electronics Co., Ltd. Semantic enrichment of trajectory data
US9373149B2 (en) 2006-03-17 2016-06-21 Fatdoor, Inc. Autonomous neighborhood vehicle commerce network and community
US9441981B2 (en) 2014-06-20 2016-09-13 Fatdoor, Inc. Variable bus stops across a bus route in a regional transportation network
US9439367B2 (en) 2014-02-07 2016-09-13 Arthi Abhyanker Network enabled gardening with a remotely controllable positioning extension
US9451020B2 (en) 2014-07-18 2016-09-20 Legalforce, Inc. Distributed communication of independent autonomous vehicles to provide redundancy and performance
US9459622B2 (en) 2007-01-12 2016-10-04 Legalforce, Inc. Driverless vehicle commerce network and community
US9457901B2 (en) 2014-04-22 2016-10-04 Fatdoor, Inc. Quadcopter with a printable payload extension system and method
US9544379B2 (en) 2009-08-03 2017-01-10 Wolfram K. Gauglitz Systems and methods for event networking and media sharing
US20170109419A1 (en) * 2015-10-15 2017-04-20 Disney Enterprises, Inc. Metadata Extraction and Management
US9971985B2 (en) 2014-06-20 2018-05-15 Raj Abhyanker Train based community
US10345818B2 (en) 2017-05-12 2019-07-09 Autonomy Squared Llc Robot transport method with transportation container
US10574614B2 (en) 2009-08-03 2020-02-25 Picpocket Labs, Inc. Geofencing of obvious geographic locations and events
US10785323B2 (en) 2015-01-05 2020-09-22 Picpocket Labs, Inc. Use of a dynamic geofence to control media sharing and aggregation associated with a mobile target

Families Citing this family (207)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US7904187B2 (en) 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US7606819B2 (en) 2001-10-15 2009-10-20 Maya-Systems Inc. Multi-dimensional locating system and method
WO2007109890A1 (en) 2006-03-29 2007-10-04 Mathieu Audet Multi-dimensional locating system and method
US20080058106A1 (en) 2002-10-07 2008-03-06 Maya-Systems Inc. Multi-dimensional locating game system and method
JP4478513B2 (en) * 2004-06-10 2010-06-09 キヤノン株式会社 Digital camera, digital camera control method, program, and recording medium storing the same
US20060253421A1 (en) * 2005-05-06 2006-11-09 Fang Chen Method and product for searching title metadata based on user preferences
US8346950B1 (en) 2005-05-19 2013-01-01 Glam Media, Inc. Hosted application server
US7603352B1 (en) * 2005-05-19 2009-10-13 Ning, Inc. Advertisement selection in an electronic application system
US7962462B1 (en) 2005-05-31 2011-06-14 Google Inc. Deriving and using document and site quality signals from search query streams
KR100664959B1 (en) * 2005-07-07 2007-01-04 삼성전자주식회사 Apparatus and method for image clustering
US7756945B1 (en) 2005-08-02 2010-07-13 Ning, Inc. Interacting with a shared data model
US7788266B2 (en) 2005-08-26 2010-08-31 Veveo, Inc. Method and system for processing ambiguous, multi-term search queries
US7779011B2 (en) 2005-08-26 2010-08-17 Veveo, Inc. Method and system for dynamically processing ambiguous, reduced text search queries and highlighting results thereof
US20070124208A1 (en) * 2005-09-20 2007-05-31 Yahoo! Inc. Method and apparatus for tagging data
US8768772B2 (en) * 2005-09-20 2014-07-01 Yahoo! Inc. System and method for selecting advertising in a social bookmarking system
US20070106627A1 (en) * 2005-10-05 2007-05-10 Mohit Srivastava Social discovery systems and methods
US7945653B2 (en) * 2006-10-11 2011-05-17 Facebook, Inc. Tagging digital media
US20070150341A1 (en) * 2005-12-22 2007-06-28 Aftab Zia Advertising content timeout methods in multiple-source advertising systems
US20070150342A1 (en) * 2005-12-22 2007-06-28 Law Justin M Dynamic selection of blended content from multiple media sources
US7813959B2 (en) * 2005-12-22 2010-10-12 Aol Inc. Altering keyword-based requests for content
US20070150343A1 (en) * 2005-12-22 2007-06-28 Kannapell John E Ii Dynamically altering requests to increase user response to advertisements
US7809605B2 (en) * 2005-12-22 2010-10-05 Aol Inc. Altering keyword-based requests for content
US20070150347A1 (en) * 2005-12-22 2007-06-28 Bhamidipati Venkata S J Dynamic backfill of advertisement content using second advertisement source
US20070150348A1 (en) * 2005-12-22 2007-06-28 Hussain Muhammad M Providing and using a quality score in association with the serving of ADS to determine page layout
US20070150346A1 (en) * 2005-12-22 2007-06-28 Sobotka David C Dynamic rotation of multiple keyphrases for advertising content supplier
US7725451B2 (en) * 2006-01-23 2010-05-25 Microsoft Corporation Generating clusters of images for search results
US7644373B2 (en) 2006-01-23 2010-01-05 Microsoft Corporation User interface for viewing clusters of images
US7836050B2 (en) 2006-01-25 2010-11-16 Microsoft Corporation Ranking content based on relevance and quality
US7822846B1 (en) * 2006-01-26 2010-10-26 Sprint Spectrum L.P. Method and system for brokering media files
US7814040B1 (en) 2006-01-31 2010-10-12 The Research Foundation Of State University Of New York System and method for image annotation and multi-modal image retrieval using probabilistic semantic models
US7657526B2 (en) 2006-03-06 2010-02-02 Veveo, Inc. Methods and systems for selecting and presenting content based on activity level spikes associated with the content
US8285595B2 (en) 2006-03-29 2012-10-09 Napo Enterprises, Llc System and method for refining media recommendations
US20070233732A1 (en) * 2006-04-04 2007-10-04 Mozes Incorporated Content request, storage and/or configuration systems and methods
US7603351B2 (en) * 2006-04-19 2009-10-13 Apple Inc. Semantic reconstruction
EP2911071A1 (en) 2006-04-20 2015-08-26 Veveo, Inc. User interface methods and systems for selecting and presenting content based on user navigation and selection actions associated with the content
US8793579B2 (en) * 2006-04-20 2014-07-29 Google Inc. Graphical user interfaces for supporting collaborative generation of life stories
US20070255742A1 (en) * 2006-04-28 2007-11-01 Microsoft Corporation Category Topics
US9507778B2 (en) * 2006-05-19 2016-11-29 Yahoo! Inc. Summarization of media object collections
US7831928B1 (en) 2006-06-22 2010-11-09 Digg, Inc. Content visualization
US8869037B2 (en) * 2006-06-22 2014-10-21 Linkedin Corporation Event visualization
US8327266B2 (en) 2006-07-11 2012-12-04 Napo Enterprises, Llc Graphical user interface system for allowing management of a media item playlist based on a preference scoring system
US9003056B2 (en) 2006-07-11 2015-04-07 Napo Enterprises, Llc Maintaining a minimum level of real time media recommendations in the absence of online friends
US8707160B2 (en) * 2006-08-10 2014-04-22 Yahoo! Inc. System and method for inferring user interest based on analysis of user-generated metadata
US20080071784A1 (en) * 2006-08-31 2008-03-20 Eyal Hertzog Enhancing posting of digital media content
US20080059897A1 (en) * 2006-09-02 2008-03-06 Whattoread, Llc Method and system of social networking through a cloud
US7707208B2 (en) * 2006-10-10 2010-04-27 Microsoft Corporation Identifying sight for a location
US7657504B2 (en) * 2006-10-10 2010-02-02 Microsoft Corporation User interface for displaying images of sights
JP4274226B2 (en) * 2006-10-25 2009-06-03 ソニー株式会社 Information processing apparatus and method, and program
US8087019B1 (en) 2006-10-31 2011-12-27 Aol Inc. Systems and methods for performing machine-implemented tasks
US8594702B2 (en) 2006-11-06 2013-11-26 Yahoo! Inc. Context server for associating information based on context
US8078884B2 (en) 2006-11-13 2011-12-13 Veveo, Inc. Method of and system for selecting and presenting content based on user identification
US9110903B2 (en) 2006-11-22 2015-08-18 Yahoo! Inc. Method, system and apparatus for using user profile electronic device data in media delivery
US8402356B2 (en) 2006-11-22 2013-03-19 Yahoo! Inc. Methods, systems and apparatus for delivery of media
TWI322362B (en) * 2006-11-29 2010-03-21 Quanta Comp Inc Data transmitting and receiving system and method
US8881011B2 (en) * 2006-12-05 2014-11-04 Crackle, Inc. Tool for creating content for video sharing platform
US9142253B2 (en) * 2006-12-22 2015-09-22 Apple Inc. Associating keywords to media
US20080154889A1 (en) * 2006-12-22 2008-06-26 Pfeiffer Silvia Video searching engine and methods
US7954065B2 (en) * 2006-12-22 2011-05-31 Apple Inc. Two-dimensional timeline display of media items
US8276098B2 (en) 2006-12-22 2012-09-25 Apple Inc. Interactive image thumbnails
US8769099B2 (en) 2006-12-28 2014-07-01 Yahoo! Inc. Methods and systems for pre-caching information on a mobile computing device
CN101211354B (en) * 2006-12-28 2012-01-11 广达电脑股份有限公司 Data transmitting-receiving system and method
US7707226B1 (en) 2007-01-29 2010-04-27 Aol Inc. Presentation of content items based on dynamic monitoring of real-time context
US7593928B2 (en) * 2007-01-29 2009-09-22 Aol Llc Dynamically altering search result page layout to increase user response
US9405830B2 (en) 2007-02-28 2016-08-02 Aol Inc. Personalization techniques using image clouds
US20080215588A1 (en) * 2007-03-02 2008-09-04 Toshiba Europe Gmbh Electronic object sharing system
US20080222531A1 (en) * 2007-03-09 2008-09-11 Microsoft Corporation Conversation tracking and notification
US7904825B2 (en) * 2007-03-14 2011-03-08 Xerox Corporation Graphical user interface for gathering image evaluation information
JP5028128B2 (en) * 2007-04-02 2012-09-19 株式会社野村総合研究所 Attribute determination device, attribute determination method, and computer program
US7941764B2 (en) 2007-04-04 2011-05-10 Abo Enterprises, Llc System and method for assigning user preference settings for a category, and in particular a media category
US8826123B2 (en) 2007-05-25 2014-09-02 9224-5489 Quebec Inc. Timescale for presenting information
US8839141B2 (en) 2007-06-01 2014-09-16 Napo Enterprises, Llc Method and system for visually indicating a replay status of media items on a media device
US8934717B2 (en) * 2007-06-05 2015-01-13 Intellectual Ventures Fund 83 Llc Automatic story creation using semantic classifiers for digital assets and associated metadata
US8775474B2 (en) * 2007-06-29 2014-07-08 Microsoft Corporation Exposing common metadata in digital images
US20090006471A1 (en) * 2007-06-29 2009-01-01 Microsoft Corporation Exposing Specific Metadata in Digital Images
US10318110B2 (en) * 2007-08-13 2019-06-11 Oath Inc. Location-based visualization of geo-referenced context
JP2010537492A (en) * 2007-08-16 2010-12-02 イーストマン コダック カンパニー Embedded message in image
US20090046940A1 (en) * 2007-08-16 2009-02-19 Beato Louis J Embedded messages in pictures
US8601392B2 (en) 2007-08-22 2013-12-03 9224-5489 Quebec Inc. Timeline for presenting information
US8069404B2 (en) 2007-08-22 2011-11-29 Maya-Systems Inc. Method of managing expected documents and system providing same
US20090064005A1 (en) * 2007-08-29 2009-03-05 Yahoo! Inc. In-place upload and editing application for editing media assets
US20090063496A1 (en) * 2007-08-29 2009-03-05 Yahoo! Inc. Automated most popular media asset creation
US9330071B1 (en) * 2007-09-06 2016-05-03 Amazon Technologies, Inc. Tag merging
US20130326338A1 (en) * 2007-09-07 2013-12-05 Adobe Systems Incorporated Methods and systems for organizing content using tags and for laying out images
US20090070371A1 (en) * 2007-09-12 2009-03-12 Yahoo! Inc. Inline rights request and communication for remote content
US20090070370A1 (en) * 2007-09-12 2009-03-12 Yahoo! Inc. Trackbacks for media assets
US20090089322A1 (en) * 2007-09-28 2009-04-02 Mor Naaman Loading predicted tags onto electronic devices
US8640030B2 (en) * 2007-10-07 2014-01-28 Fall Front Wireless Ny, Llc User interface for creating tags synchronized with a video playback
US8285121B2 (en) 2007-10-07 2012-10-09 Fall Front Wireless Ny, Llc Digital network-based video tagging system
US20090094189A1 (en) * 2007-10-08 2009-04-09 At&T Bls Intellectual Property, Inc. Methods, systems, and computer program products for managing tags added by users engaged in social tagging of content
US20090100037A1 (en) * 2007-10-15 2009-04-16 Yahoo! Inc. Suggestive meeting points based on location of multiple users
US8775420B2 (en) * 2007-10-31 2014-07-08 Yahoo! Inc. Text display of geo-referenced information based on relative distance to a user location
AU2007231829A1 (en) * 2007-11-02 2009-05-21 Smart Internet Technology Crc Pty Ltd Systems and methods for file transfer to a pervasive computing system
US20090132935A1 (en) * 2007-11-15 2009-05-21 Yahoo! Inc. Video tag game
US20090138457A1 (en) * 2007-11-26 2009-05-28 Concert Technology Corporation Grouping and weighting media categories with time periods
US8224856B2 (en) 2007-11-26 2012-07-17 Abo Enterprises, Llc Intelligent default weighting process for criteria utilized to score media content items
US10210259B2 (en) * 2007-12-04 2019-02-19 International Business Machines Corporation Contributor characteristic based tag clouds
US8019772B2 (en) * 2007-12-05 2011-09-13 International Business Machines Corporation Computer method and apparatus for tag pre-search in social software
US8069142B2 (en) 2007-12-06 2011-11-29 Yahoo! Inc. System and method for synchronizing data on a network
US8307029B2 (en) 2007-12-10 2012-11-06 Yahoo! Inc. System and method for conditional delivery of messages
US8671154B2 (en) 2007-12-10 2014-03-11 Yahoo! Inc. System and method for contextual addressing of communications on a network
US8340492B2 (en) * 2007-12-17 2012-12-25 General Instrument Corporation Method and system for sharing annotations in a communication network
US8166168B2 (en) 2007-12-17 2012-04-24 Yahoo! Inc. System and method for disambiguating non-unique identifiers using information obtained from disparate communication channels
US8131731B2 (en) * 2007-12-27 2012-03-06 Microsoft Corporation Relevancy sorting of user's browser history
US8254684B2 (en) * 2008-01-02 2012-08-28 Yahoo! Inc. Method and system for managing digital photos
US9706345B2 (en) 2008-01-04 2017-07-11 Excalibur Ip, Llc Interest mapping system
US9626685B2 (en) 2008-01-04 2017-04-18 Excalibur Ip, Llc Systems and methods of mapping attention
US8762285B2 (en) 2008-01-06 2014-06-24 Yahoo! Inc. System and method for message clustering
US20090182618A1 (en) * 2008-01-16 2009-07-16 Yahoo! Inc. System and Method for Word-of-Mouth Advertising
US8856643B2 (en) * 2008-02-28 2014-10-07 Red Hat, Inc. Unique URLs for browsing tagged content
US8468447B2 (en) * 2008-02-28 2013-06-18 Red Hat, Inc. Tracking tag content by keywords and communities
US8606807B2 (en) * 2008-02-28 2013-12-10 Red Hat, Inc. Integration of triple tags into a tagging tool and text browsing
US8607136B2 (en) * 2008-02-28 2013-12-10 Red Hat, Inc. Maintaining tags for individual communities
US8538811B2 (en) 2008-03-03 2013-09-17 Yahoo! Inc. Method and apparatus for social network marketing with advocate referral
US8560390B2 (en) 2008-03-03 2013-10-15 Yahoo! Inc. Method and apparatus for social network marketing with brand referral
US8554623B2 (en) * 2008-03-03 2013-10-08 Yahoo! Inc. Method and apparatus for social network marketing with consumer referral
CA2657835C (en) 2008-03-07 2017-09-19 Mathieu Audet Documents discrimination system and method thereof
US7860866B2 (en) * 2008-03-26 2010-12-28 Microsoft Corporation Heuristic event clustering of media using metadata
US8745133B2 (en) * 2008-03-28 2014-06-03 Yahoo! Inc. System and method for optimizing the storage of data
US8589486B2 (en) 2008-03-28 2013-11-19 Yahoo! Inc. System and method for addressing communications
US8271506B2 (en) 2008-03-31 2012-09-18 Yahoo! Inc. System and method for modeling relationships between entities
CA2666016C (en) 2008-05-15 2014-07-22 Mathieu Audet Method for building a search algorithm and method for linking documents with an object
US8527876B2 (en) * 2008-06-12 2013-09-03 Apple Inc. System and methods for adjusting graphical representations of media files based on previous usage
US20090313564A1 (en) * 2008-06-12 2009-12-17 Apple Inc. Systems and methods for adjusting playback of media files based on previous usage
US8706406B2 (en) 2008-06-27 2014-04-22 Yahoo! Inc. System and method for determination and display of personalized distance
US8452855B2 (en) * 2008-06-27 2013-05-28 Yahoo! Inc. System and method for presentation of media related to a context
US8813107B2 (en) 2008-06-27 2014-08-19 Yahoo! Inc. System and method for location based media delivery
EP2297685A1 (en) * 2008-07-04 2011-03-23 Yogesh Chunilal Rathod Methods and systems for brands social networks (bsn) platform
US8086700B2 (en) 2008-07-29 2011-12-27 Yahoo! Inc. Region and duration uniform resource identifiers (URI) for media objects
US8583668B2 (en) 2008-07-30 2013-11-12 Yahoo! Inc. System and method for context enhanced mapping
US10230803B2 (en) 2008-07-30 2019-03-12 Excalibur Ip, Llc System and method for improved mapping and routing
US20100042615A1 (en) * 2008-08-12 2010-02-18 Peter Rinearson Systems and methods for aggregating content on a user-content driven website
US8386506B2 (en) 2008-08-21 2013-02-26 Yahoo! Inc. System and method for context enhanced messaging
US8396246B2 (en) * 2008-08-28 2013-03-12 Microsoft Corporation Tagging images with labels
CA2677921C (en) 2008-09-12 2017-06-13 Mathieu Ma Audet Method of managing groups of arrays of documents
US8281027B2 (en) 2008-09-19 2012-10-02 Yahoo! Inc. System and method for distributing media related to a location
US20100082650A1 (en) * 2008-09-24 2010-04-01 Davin Wong Method, System, and Apparatus for Ranking Media Sharing Channels
US20100082653A1 (en) * 2008-09-29 2010-04-01 Rahul Nair Event media search
US8108778B2 (en) 2008-09-30 2012-01-31 Yahoo! Inc. System and method for context enhanced mapping within a user interface
US9600484B2 (en) 2008-09-30 2017-03-21 Excalibur Ip, Llc System and method for reporting and analysis of media consumption data
US20100082427A1 (en) * 2008-09-30 2010-04-01 Yahoo! Inc. System and Method for Context Enhanced Ad Creation
JP4729089B2 (en) * 2008-10-06 2011-07-20 三菱電機インフォメーションシステムズ株式会社 Website counting device and website counting program
US8171043B2 (en) * 2008-10-24 2012-05-01 Yahoo! Inc. Methods for improving the diversity of image search results
US8364718B2 (en) * 2008-10-31 2013-01-29 International Business Machines Corporation Collaborative bookmarking
US8024317B2 (en) 2008-11-18 2011-09-20 Yahoo! Inc. System and method for deriving income from URL based context queries
US8060492B2 (en) 2008-11-18 2011-11-15 Yahoo! Inc. System and method for generation of URL based context queries
US9805123B2 (en) 2008-11-18 2017-10-31 Excalibur Ip, Llc System and method for data privacy in URL based context queries
US8032508B2 (en) 2008-11-18 2011-10-04 Yahoo! Inc. System and method for URL based query for retrieving data related to a context
US9110927B2 (en) * 2008-11-25 2015-08-18 Yahoo! Inc. Method and apparatus for organizing digital photographs
US9224172B2 (en) 2008-12-02 2015-12-29 Yahoo! Inc. Customizable content for distribution in social networks
US8055675B2 (en) 2008-12-05 2011-11-08 Yahoo! Inc. System and method for context based query augmentation
US8166016B2 (en) 2008-12-19 2012-04-24 Yahoo! Inc. System and method for automated service recommendations
US8914359B2 (en) 2008-12-30 2014-12-16 Microsoft Corporation Ranking documents with social tags
US20100169326A1 (en) * 2008-12-31 2010-07-01 Nokia Corporation Method, apparatus and computer program product for providing analysis and visualization of content items association
US20100185509A1 (en) * 2009-01-21 2010-07-22 Yahoo! Inc. Interest-based ranking system for targeted marketing
US20100185518A1 (en) * 2009-01-21 2010-07-22 Yahoo! Inc. Interest-based activity marketing
US20100191728A1 (en) * 2009-01-23 2010-07-29 James Francis Reilly Method, System Computer Program, and Apparatus for Augmenting Media Based on Proximity Detection
US8150967B2 (en) 2009-03-24 2012-04-03 Yahoo! Inc. System and method for verified presence tracking
JP2010267018A (en) 2009-05-13 2010-11-25 Canon Inc Apparatus and method for processing information processor and information
FR2945651A1 (en) * 2009-05-15 2010-11-19 France Telecom DEVICE AND METHOD FOR UPDATING A USER PROFILE
US20120059855A1 (en) * 2009-05-26 2012-03-08 Hewlett-Packard Development Company, L.P. Method and computer program product for enabling organization of media objects
JP5425531B2 (en) * 2009-06-10 2014-02-26 株式会社Nttドコモ Browsing situation analysis system, browsing situation analysis server
US20100325552A1 (en) * 2009-06-19 2010-12-23 Sloo David H Media Asset Navigation Representations
US10223701B2 (en) 2009-08-06 2019-03-05 Excalibur Ip, Llc System and method for verified monetization of commercial campaigns
US8914342B2 (en) 2009-08-12 2014-12-16 Yahoo! Inc. Personal data platform
US8364611B2 (en) 2009-08-13 2013-01-29 Yahoo! Inc. System and method for precaching information on a mobile device
US9166714B2 (en) 2009-09-11 2015-10-20 Veveo, Inc. Method of and system for presenting enriched video viewing analytics
US9135225B2 (en) * 2009-10-02 2015-09-15 Adobe Systems Incorporated Data description injection
JP5551913B2 (en) * 2009-10-13 2014-07-16 株式会社クローラ研究所 Information provision system by video tracking
US20110099488A1 (en) * 2009-10-26 2011-04-28 Verizon Patent And Licensing Inc. Method and apparatus for presenting video assets
US20110191332A1 (en) 2010-02-04 2011-08-04 Veveo, Inc. Method of and System for Updating Locally Cached Content Descriptor Information
US8140570B2 (en) * 2010-03-11 2012-03-20 Apple Inc. Automatic discovery of metadata
US10692093B2 (en) * 2010-04-16 2020-06-23 Microsoft Technology Licensing, Llc Social home page
WO2012066557A1 (en) 2010-11-16 2012-05-24 Hewlett-Packard Development Company L.P. System and method for using information from intuitive multimodal interactions for media tagging
US9058093B2 (en) 2011-02-01 2015-06-16 9224-5489 Quebec Inc. Active element
KR20120099836A (en) 2011-03-02 2012-09-12 삼성전자주식회사 Apparatus and method for sharing comment in mobile communication teminal
US20120272171A1 (en) * 2011-04-21 2012-10-25 Panasonic Corporation Apparatus, Method and Computer-Implemented Program for Editable Categorization
US9946429B2 (en) * 2011-06-17 2018-04-17 Microsoft Technology Licensing, Llc Hierarchical, zoomable presentations of media sets
US8639706B1 (en) * 2011-07-01 2014-01-28 Google Inc. Shared metadata for media files
US11068532B2 (en) 2011-09-21 2021-07-20 Horsetooth Ventures, LLC Interactive image display and selection system
US9734167B2 (en) 2011-09-21 2017-08-15 Horsetooth Ventures, LLC Interactive image display and selection system
CA2790799C (en) 2011-09-25 2023-03-21 Mathieu Audet Method and apparatus of navigating information element axes
US10043022B2 (en) 2012-03-05 2018-08-07 R.R. Donnelley & Sons Company Systems and methods for digital content delivery
US9519693B2 (en) 2012-06-11 2016-12-13 9224-5489 Quebec Inc. Method and apparatus for displaying data element axes
US9646080B2 (en) 2012-06-12 2017-05-09 9224-5489 Quebec Inc. Multi-functions axis-based interface
US20150242689A1 (en) * 2012-08-06 2015-08-27 See-Out Pty, Ltd System and method for determining graph relationships using images
US9519685B1 (en) * 2012-08-30 2016-12-13 deviantArt, Inc. Tag selection, clustering, and recommendation for content hosting services
US9678961B2 (en) * 2012-09-13 2017-06-13 Canon Europa N.V. Method and device for associating metadata to media objects
WO2014055593A1 (en) * 2012-10-03 2014-04-10 Elateral, Inc. Content analytics
GB2507036A (en) * 2012-10-10 2014-04-23 Lifecake Ltd Content prioritization
US20150143103A1 (en) * 2013-11-18 2015-05-21 Life of Two Messaging and networking keepsakes
ITMI20132085A1 (en) * 2013-12-13 2015-06-14 Business Competence Srl RESEARCH METHOD AND CLASSIFICATION OF MULTIMEDIA CONTENT MADE AVAILABLE ON THE INTERNET
US20150286865A1 (en) * 2014-04-08 2015-10-08 Sony Corporation Coordination of object location data with video data
US10877955B2 (en) 2014-04-29 2020-12-29 Microsoft Technology Licensing, Llc Using lineage to infer data quality issues
US10089409B2 (en) 2014-04-29 2018-10-02 Microsoft Technology Licensing, Llc Event-triggered data quality verification
US10482095B2 (en) * 2016-04-20 2019-11-19 Disney Enterprises, Inc. System and method for providing a searchable platform for online content including metadata
CN107870938B (en) * 2016-09-27 2021-06-25 洪晓勤 Integrated system for picture interactive processing application interface
US10262010B2 (en) 2016-11-02 2019-04-16 International Business Machines Corporation Screen capture data amalgamation
US10726163B2 (en) 2016-11-17 2020-07-28 International Business Machines Corporation Protecting cryptographic systems from cold boot and other side channel attacks
CN107229713A (en) * 2017-05-27 2017-10-03 灵犀智数(北京)科技发展有限公司 A kind of object storage method and device
US10417184B1 (en) 2017-06-02 2019-09-17 Keith George Long Widely accessible composite computer file operative in a plurality of forms by renaming the filename extension
CA3007166A1 (en) 2017-06-05 2018-12-05 9224-5489 Quebec Inc. Method and apparatus of aligning information element axes
JP7204321B2 (en) * 2017-12-20 2023-01-16 株式会社D4エンタープライズ terminal and server
US11748418B2 (en) 2018-07-31 2023-09-05 Marvell Asia Pte, Ltd. Storage aggregator controller with metadata computation control
US10928982B2 (en) * 2018-10-31 2021-02-23 Salesforce.Com, Inc. Automatic grouping of user interface elements into components
US11023524B2 (en) * 2019-03-27 2021-06-01 Slack Technologies, Inc. Expandable data object management and indexing architecture for intersystem data exchange compatibility
EP4124971A1 (en) * 2021-07-30 2023-02-01 L&A Video Consulting GmbH Media platform and method for providing structured access to media content

Citations (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5642502A (en) * 1994-12-06 1997-06-24 University Of Central Florida Method and system for searching for relevant documents from a text database collection, using statistical ranking, relevancy feedback and small pieces of text
US20010047298A1 (en) * 2000-03-31 2001-11-29 United Video Properties,Inc. System and method for metadata-linked advertisements
US20020016786A1 (en) * 1999-05-05 2002-02-07 Pitkow James B. System and method for searching and recommending objects from a categorically organized information repository
US20020032772A1 (en) * 2000-09-14 2002-03-14 Bjorn Olstad Method for searching and analysing information in data networks
US20020065844A1 (en) * 2000-11-30 2002-05-30 Rich Robinson Metadata internet platform for enabling customization of tags in digital images
US20020069218A1 (en) * 2000-07-24 2002-06-06 Sanghoon Sull System and method for indexing, searching, identifying, and editing portions of electronic multimedia files
US20020152267A1 (en) * 2000-12-22 2002-10-17 Lennon Alison J. Method for facilitating access to multimedia content
US20020194200A1 (en) * 2000-08-28 2002-12-19 Emotion Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20030036848A1 (en) * 2001-08-16 2003-02-20 Sheha Michael A. Point of interest spatial rating search method and system
US6526411B1 (en) * 1999-11-15 2003-02-25 Sean Ward System and method for creating dynamic playlists
US20040044661A1 (en) * 2002-08-28 2004-03-04 Allen Bradley P. Method and apparatus for using faceted metadata to navigate through information resources
US6757661B1 (en) * 2000-04-07 2004-06-29 Netzero High volume targeting of advertisements to user of online service
US20040199657A1 (en) * 2000-01-24 2004-10-07 Aviv Eyal Streaming media search and playback system
US20040230572A1 (en) * 2001-06-22 2004-11-18 Nosa Omoigui System and method for semantic knowledge retrieval, management, capture, sharing, discovery, delivery and presentation
US20040230676A1 (en) * 2002-11-20 2004-11-18 Radar Networks, Inc. Methods and systems for managing offers and requests in a network
US20040267725A1 (en) * 2003-06-30 2004-12-30 Harik Georges R Serving advertisements using a search of advertiser Web information
US20050010553A1 (en) * 2000-10-30 2005-01-13 Microsoft Corporation Semi-automatic annotation of multimedia objects
US20050060741A1 (en) * 2002-12-10 2005-03-17 Kabushiki Kaisha Toshiba Media data audio-visual device and metadata sharing system
US20050131866A1 (en) * 2003-12-03 2005-06-16 Badros Gregory J. Methods and systems for personalized network searching
US20050131918A1 (en) * 2003-12-12 2005-06-16 W. Daniel Hillis Personalized profile for evaluating content
US20050165757A1 (en) * 2000-10-25 2005-07-28 Broder Andrei Z. Method and apparatus for ranking web page search results
US6977679B2 (en) * 2001-04-03 2005-12-20 Hewlett-Packard Development Company, L.P. Camera meta-data for content categorization
US20050289163A1 (en) * 2004-06-03 2005-12-29 Eric Gordon Occasion for media objects
US20050288959A1 (en) * 2004-06-16 2005-12-29 David Eraker Map-based search for real estate service providers
US20060004732A1 (en) * 2002-02-26 2006-01-05 Odom Paul S Search engine methods and systems for generating relevant search results and advertisements
US7032178B1 (en) * 2001-03-30 2006-04-18 Gateway Inc. Tagging content for different activities
US20060116983A1 (en) * 2004-11-30 2006-06-01 International Business Machines Corporation System and method for ordering query results
US20060129907A1 (en) * 2004-12-03 2006-06-15 Volk Andrew R Syndicating multimedia information with RSS
US7073193B2 (en) * 2002-04-16 2006-07-04 Microsoft Corporation Media content descriptions
US20060184566A1 (en) * 2005-02-15 2006-08-17 Infomato Crosslink data structure, crosslink database, and system and method of organizing and retrieving information
US20060190281A1 (en) * 2005-02-22 2006-08-24 Microsoft Corporation Systems and methods to facilitate self regulation of social networks through trading and gift exchange
US7099946B2 (en) * 2000-11-13 2006-08-29 Canon Kabushiki Kaishsa Transferring a media browsing session from one device to a second device by transferring a session identifier and a session key to the second device
US20060200490A1 (en) * 2005-03-03 2006-09-07 Abbiss Roger O Geographical indexing system and method
US20060218141A1 (en) * 2004-11-22 2006-09-28 Truveo, Inc. Method and apparatus for a ranking engine
US20060224738A1 (en) * 2001-06-26 2006-10-05 Mcintyre Dale F Method and system for managing images over a communication network
US20060235843A1 (en) * 2005-01-31 2006-10-19 Textdigger, Inc. Method and system for semantic search and retrieval of electronic documents
US20060242178A1 (en) * 2005-04-21 2006-10-26 Yahoo! Inc. Media object metadata association and ranking
US20060242139A1 (en) * 2005-04-21 2006-10-26 Yahoo! Inc. Interestingness ranking of media objects
US7149755B2 (en) * 2002-07-29 2006-12-12 Hewlett-Packard Development Company, Lp. Presenting a collection of media objects
US20070011155A1 (en) * 2004-09-29 2007-01-11 Sarkar Pte. Ltd. System for communication and collaboration
US7181438B1 (en) * 1999-07-21 2007-02-20 Alberti Anemometer, Llc Database access system
US20070100898A1 (en) * 2000-02-10 2007-05-03 Involve Technology, Inc. System for Creating and Maintaining a Database of Information Utilizing User Opinions
US7220910B2 (en) * 2002-03-21 2007-05-22 Microsoft Corporation Methods and systems for per persona processing media content-associated metadata
US20070177586A1 (en) * 2000-01-24 2007-08-02 Aviv Eyal Rating system for streaming media playback system
US20070185858A1 (en) * 2005-08-03 2007-08-09 Yunshan Lu Systems for and methods of finding relevant documents by analyzing tags
US20070186267A1 (en) * 2003-08-28 2007-08-09 Sony Corporation Information providing device, information providing method, and computer program
US7257774B2 (en) * 2002-07-30 2007-08-14 Fuji Xerox Co., Ltd. Systems and methods for filtering and/or viewing collaborative indexes of recorded media
US20070208613A1 (en) * 2006-02-09 2007-09-06 Alejandro Backer Reputation system for web pages and online entities
US7353214B2 (en) * 2001-06-27 2008-04-01 Nec Corporation Outlier determination rule generation device and outlier detection device, and outlier determination rule generation method and outlier detection method thereof
US7440948B2 (en) * 2005-09-20 2008-10-21 Novell, Inc. System and method of associating objects in search results
US7793326B2 (en) * 2001-08-03 2010-09-07 Comcast Ip Holdings I, Llc Video and digital multimedia aggregator
US7925669B2 (en) * 2004-10-13 2011-04-12 Sony Corporation Method and apparatus for audio/video attribute and relationship storage and retrieval for efficient composition
US8200617B2 (en) * 2009-04-15 2012-06-12 Evri, Inc. Automatic mapping of a location identifier pattern of an object to a semantic type using object metadata

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US102005A (en) * 1870-04-19 John houpt
US7515733B2 (en) * 1993-11-18 2009-04-07 Digimarc Corporation Methods and arrangements employing digital content items
US6681029B1 (en) * 1993-11-18 2004-01-20 Digimarc Corporation Decoding steganographic messages embedded in media signals
US6813366B1 (en) * 1995-05-08 2004-11-02 Digimarc Corporation Steganographic decoding with transform to spatial domain
JP3636830B2 (en) 1996-07-10 2005-04-06 株式会社日立製作所 Intelligent video camera and intelligent still camera
JPH10254886A (en) 1997-03-07 1998-09-25 Fujitsu Ltd Addition/retrieval system for additional information to retrieval result content in retrieval system
JP3727794B2 (en) 1998-12-22 2005-12-14 株式会社東芝 Information storage search method, information storage search device, and recording medium
GB9922765D0 (en) 1999-09-28 1999-11-24 Koninkl Philips Electronics Nv Television
US6589752B1 (en) 1999-10-01 2003-07-08 Yoon Kong Recombinant antigen of Taenia solium metacestodes
US7284064B1 (en) 2000-03-21 2007-10-16 Intel Corporation Method and apparatus to determine broadcast content and scheduling in a broadcast system
KR20010100702A (en) 2000-05-06 2001-11-14 최준호 Method for providing purchase information on goods
US6697800B1 (en) * 2000-05-19 2004-02-24 Roxio, Inc. System and method for determining affinity using objective and subjective data
US7925967B2 (en) 2000-11-21 2011-04-12 Aol Inc. Metadata quality improvement
KR20040065260A (en) 2001-12-13 2004-07-21 코닌클리케 필립스 일렉트로닉스 엔.브이. Recommending media content on a media system
EP1762949A3 (en) 2001-12-26 2007-08-08 Eastman Kodak Company Digital imaging method using importance rating
JP3689790B2 (en) 2002-02-28 2005-08-31 コニカミノルタフォトイメージング株式会社 Image forming program and image forming apparatus
US7234117B2 (en) * 2002-08-28 2007-06-19 Microsoft Corporation System and method for shared integrated online social interaction
KR100497428B1 (en) * 2002-09-24 2005-07-01 전자부품연구원 Recommending service method of intellectual program using meta data
KR100745995B1 (en) * 2003-06-04 2007-08-06 삼성전자주식회사 Device for managing meta data and method thereof
US20050165785A1 (en) * 2004-01-23 2005-07-28 Ibm Corporation Social network surfing
US20050210008A1 (en) * 2004-03-18 2005-09-22 Bao Tran Systems and methods for analyzing documents over a network
US20050223031A1 (en) * 2004-03-30 2005-10-06 Andrew Zisserman Method and apparatus for retrieving visual object categories from a database containing images
US7478078B2 (en) * 2004-06-14 2009-01-13 Friendster, Inc. Method for sharing relationship information stored in a social network database with third party databases
GB2424091A (en) * 2005-03-11 2006-09-13 Alamy Ltd Ranking of images in the results of a search

Patent Citations (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5642502A (en) * 1994-12-06 1997-06-24 University Of Central Florida Method and system for searching for relevant documents from a text database collection, using statistical ranking, relevancy feedback and small pieces of text
US7031961B2 (en) * 1999-05-05 2006-04-18 Google, Inc. System and method for searching and recommending objects from a categorically organized information repository
US20020016786A1 (en) * 1999-05-05 2002-02-07 Pitkow James B. System and method for searching and recommending objects from a categorically organized information repository
US7181438B1 (en) * 1999-07-21 2007-02-20 Alberti Anemometer, Llc Database access system
US6526411B1 (en) * 1999-11-15 2003-02-25 Sean Ward System and method for creating dynamic playlists
US20040199657A1 (en) * 2000-01-24 2004-10-07 Aviv Eyal Streaming media search and playback system
US20070177586A1 (en) * 2000-01-24 2007-08-02 Aviv Eyal Rating system for streaming media playback system
US20070100898A1 (en) * 2000-02-10 2007-05-03 Involve Technology, Inc. System for Creating and Maintaining a Database of Information Utilizing User Opinions
US20010047298A1 (en) * 2000-03-31 2001-11-29 United Video Properties,Inc. System and method for metadata-linked advertisements
US6757661B1 (en) * 2000-04-07 2004-06-29 Netzero High volume targeting of advertisements to user of online service
US20020069218A1 (en) * 2000-07-24 2002-06-06 Sanghoon Sull System and method for indexing, searching, identifying, and editing portions of electronic multimedia files
US20020194200A1 (en) * 2000-08-28 2002-12-19 Emotion Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20020032772A1 (en) * 2000-09-14 2002-03-14 Bjorn Olstad Method for searching and analysing information in data networks
US20050165757A1 (en) * 2000-10-25 2005-07-28 Broder Andrei Z. Method and apparatus for ranking web page search results
US20050010553A1 (en) * 2000-10-30 2005-01-13 Microsoft Corporation Semi-automatic annotation of multimedia objects
US7099946B2 (en) * 2000-11-13 2006-08-29 Canon Kabushiki Kaishsa Transferring a media browsing session from one device to a second device by transferring a session identifier and a session key to the second device
US20020065844A1 (en) * 2000-11-30 2002-05-30 Rich Robinson Metadata internet platform for enabling customization of tags in digital images
US20020152267A1 (en) * 2000-12-22 2002-10-17 Lennon Alison J. Method for facilitating access to multimedia content
US7277928B2 (en) * 2000-12-22 2007-10-02 Canon Kabushiki Kaisha Method for facilitating access to multimedia content
US7032178B1 (en) * 2001-03-30 2006-04-18 Gateway Inc. Tagging content for different activities
US6977679B2 (en) * 2001-04-03 2005-12-20 Hewlett-Packard Development Company, L.P. Camera meta-data for content categorization
US20040230572A1 (en) * 2001-06-22 2004-11-18 Nosa Omoigui System and method for semantic knowledge retrieval, management, capture, sharing, discovery, delivery and presentation
US20060224738A1 (en) * 2001-06-26 2006-10-05 Mcintyre Dale F Method and system for managing images over a communication network
US7353214B2 (en) * 2001-06-27 2008-04-01 Nec Corporation Outlier determination rule generation device and outlier detection device, and outlier determination rule generation method and outlier detection method thereof
US7793326B2 (en) * 2001-08-03 2010-09-07 Comcast Ip Holdings I, Llc Video and digital multimedia aggregator
US20030036848A1 (en) * 2001-08-16 2003-02-20 Sheha Michael A. Point of interest spatial rating search method and system
US20060004732A1 (en) * 2002-02-26 2006-01-05 Odom Paul S Search engine methods and systems for generating relevant search results and advertisements
US7220910B2 (en) * 2002-03-21 2007-05-22 Microsoft Corporation Methods and systems for per persona processing media content-associated metadata
US7073193B2 (en) * 2002-04-16 2006-07-04 Microsoft Corporation Media content descriptions
US7149755B2 (en) * 2002-07-29 2006-12-12 Hewlett-Packard Development Company, Lp. Presenting a collection of media objects
US7257774B2 (en) * 2002-07-30 2007-08-14 Fuji Xerox Co., Ltd. Systems and methods for filtering and/or viewing collaborative indexes of recorded media
US20040044661A1 (en) * 2002-08-28 2004-03-04 Allen Bradley P. Method and apparatus for using faceted metadata to navigate through information resources
US20040230676A1 (en) * 2002-11-20 2004-11-18 Radar Networks, Inc. Methods and systems for managing offers and requests in a network
US20050060741A1 (en) * 2002-12-10 2005-03-17 Kabushiki Kaisha Toshiba Media data audio-visual device and metadata sharing system
US20040267725A1 (en) * 2003-06-30 2004-12-30 Harik Georges R Serving advertisements using a search of advertiser Web information
US20070186267A1 (en) * 2003-08-28 2007-08-09 Sony Corporation Information providing device, information providing method, and computer program
US20050131866A1 (en) * 2003-12-03 2005-06-16 Badros Gregory J. Methods and systems for personalized network searching
US20050131918A1 (en) * 2003-12-12 2005-06-16 W. Daniel Hillis Personalized profile for evaluating content
US20050289163A1 (en) * 2004-06-03 2005-12-29 Eric Gordon Occasion for media objects
US20050288959A1 (en) * 2004-06-16 2005-12-29 David Eraker Map-based search for real estate service providers
US20070011155A1 (en) * 2004-09-29 2007-01-11 Sarkar Pte. Ltd. System for communication and collaboration
US7925669B2 (en) * 2004-10-13 2011-04-12 Sony Corporation Method and apparatus for audio/video attribute and relationship storage and retrieval for efficient composition
US20060218141A1 (en) * 2004-11-22 2006-09-28 Truveo, Inc. Method and apparatus for a ranking engine
US20060116983A1 (en) * 2004-11-30 2006-06-01 International Business Machines Corporation System and method for ordering query results
US20060129907A1 (en) * 2004-12-03 2006-06-15 Volk Andrew R Syndicating multimedia information with RSS
US20060235843A1 (en) * 2005-01-31 2006-10-19 Textdigger, Inc. Method and system for semantic search and retrieval of electronic documents
US20060184566A1 (en) * 2005-02-15 2006-08-17 Infomato Crosslink data structure, crosslink database, and system and method of organizing and retrieving information
US20060190281A1 (en) * 2005-02-22 2006-08-24 Microsoft Corporation Systems and methods to facilitate self regulation of social networks through trading and gift exchange
US20060200490A1 (en) * 2005-03-03 2006-09-07 Abbiss Roger O Geographical indexing system and method
US20060242139A1 (en) * 2005-04-21 2006-10-26 Yahoo! Inc. Interestingness ranking of media objects
US20060242178A1 (en) * 2005-04-21 2006-10-26 Yahoo! Inc. Media object metadata association and ranking
US20120317110A1 (en) * 2005-04-21 2012-12-13 Butterfield Daniel S Interestingness ranking of media objects
US20070185858A1 (en) * 2005-08-03 2007-08-09 Yunshan Lu Systems for and methods of finding relevant documents by analyzing tags
US7440948B2 (en) * 2005-09-20 2008-10-21 Novell, Inc. System and method of associating objects in search results
US20070208613A1 (en) * 2006-02-09 2007-09-06 Alejandro Backer Reputation system for web pages and online entities
US8200617B2 (en) * 2009-04-15 2012-06-12 Evri, Inc. Automatic mapping of a location identifier pattern of an object to a semantic type using object metadata

Cited By (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8732175B2 (en) 2005-04-21 2014-05-20 Yahoo! Inc. Interestingness ranking of media objects
US10216763B2 (en) 2005-04-21 2019-02-26 Oath Inc. Interestingness ranking of media objects
US20060242178A1 (en) * 2005-04-21 2006-10-26 Yahoo! Inc. Media object metadata association and ranking
US10210159B2 (en) 2005-04-21 2019-02-19 Oath Inc. Media object metadata association and ranking
US10348792B2 (en) 2005-12-14 2019-07-09 Facebook, Inc. Dynamically updating media content for display to a user of a social network environment based on user interactions
US9071367B2 (en) 2006-03-17 2015-06-30 Fatdoor, Inc. Emergency including crime broadcast in a neighborhood social network
US9002754B2 (en) 2006-03-17 2015-04-07 Fatdoor, Inc. Campaign in a geo-spatial environment
US9373149B2 (en) 2006-03-17 2016-06-21 Fatdoor, Inc. Autonomous neighborhood vehicle commerce network and community
US9037516B2 (en) 2006-03-17 2015-05-19 Fatdoor, Inc. Direct mailing in a geo-spatial environment
US8965409B2 (en) 2006-03-17 2015-02-24 Fatdoor, Inc. User-generated community publication in an online neighborhood social network
US9064288B2 (en) 2006-03-17 2015-06-23 Fatdoor, Inc. Government structures and neighborhood leads in a geo-spatial environment
US8171128B2 (en) * 2006-08-11 2012-05-01 Facebook, Inc. Communicating a newsfeed of media content based on a member's interactions in a social network environment
US9065791B2 (en) 2006-08-11 2015-06-23 Facebook, Inc. Generating a consolidated social story in a feed of stories for a user of a social networking system
US8521787B2 (en) 2006-08-11 2013-08-27 Facebook, Inc. Generating a consolidated social story for a user of a social networking system
US20110029612A1 (en) * 2006-08-11 2011-02-03 Andrew Bosworth Generating a Consolidated Social Story for a User of a Social Networking System
US8312140B2 (en) * 2006-08-11 2012-11-13 Facebook, Inc. Dynamically updating media content for display to a user of a social network environment based on user interactions
US20080040474A1 (en) * 2006-08-11 2008-02-14 Mark Zuckerberg Systems and methods for providing dynamically selected media content to a user of an electronic device in a social network environment
US8412821B2 (en) * 2006-08-11 2013-04-02 Facebook, Inc. Dynamically updating media content for display to a user of a social networking environment based on user interaction
US9070101B2 (en) 2007-01-12 2015-06-30 Fatdoor, Inc. Peer-to-peer neighborhood delivery multi-copter and method
US9459622B2 (en) 2007-01-12 2016-10-04 Legalforce, Inc. Driverless vehicle commerce network and community
US8677258B2 (en) * 2007-04-18 2014-03-18 Smartmunk Gmbh Method of and apparatus for ascertaining and providing information in relation to an image
US20080263466A1 (en) * 2007-04-18 2008-10-23 Dialego Ag Method of and apparatus for ascertaining and providing information in relation to an image
US9098545B2 (en) 2007-07-10 2015-08-04 Raj Abhyanker Hot news neighborhood banter in a geo-spatial social network
US8140953B1 (en) * 2007-10-26 2012-03-20 Adobe Systems Incorporated Flexible media catalog for multi-format project export
US20110106784A1 (en) * 2008-04-04 2011-05-05 Merijn Camiel Terheggen System and method for publishing media objects
US7996418B2 (en) * 2008-04-30 2011-08-09 Microsoft Corporation Suggesting long-tail tags
US20090276437A1 (en) * 2008-04-30 2009-11-05 Microsoft Corporation Suggesting long-tail tags
US10574614B2 (en) 2009-08-03 2020-02-25 Picpocket Labs, Inc. Geofencing of obvious geographic locations and events
US9544379B2 (en) 2009-08-03 2017-01-10 Wolfram K. Gauglitz Systems and methods for event networking and media sharing
US10856115B2 (en) 2009-08-03 2020-12-01 Picpocket Labs, Inc. Systems and methods for aggregating media related to an event
US8539161B2 (en) * 2009-10-12 2013-09-17 Microsoft Corporation Pre-fetching content items based on social distance
US20110087842A1 (en) * 2009-10-12 2011-04-14 Microsoft Corporation Pre-fetching content items based on social distance
US8670968B1 (en) * 2009-12-23 2014-03-11 Intuit Inc. System and method for ranking a posting
US8311792B1 (en) * 2009-12-23 2012-11-13 Intuit Inc. System and method for ranking a posting
US8862663B2 (en) * 2009-12-27 2014-10-14 At&T Intellectual Property I, L.P. Method and system for providing a collaborative event-share service
US10805250B2 (en) 2009-12-27 2020-10-13 At&T Intellectual Property I, L.P. Method and system for providing a collaborative event-share service
US10171393B2 (en) 2009-12-27 2019-01-01 At&T Intellectual Property I, L.P. Method and system for providing a collaborative event-share service
US20110161423A1 (en) * 2009-12-27 2011-06-30 James Pratt Method and system for providing a collaborative event-share service
US20110218946A1 (en) * 2010-03-03 2011-09-08 Microsoft Corporation Presenting content items using topical relevance and trending popularity
US10382438B2 (en) * 2010-05-27 2019-08-13 Nokia Technologies Oy Method and apparatus for expanded content tag sharing
US20140380420A1 (en) * 2010-05-27 2014-12-25 Nokia Corporation Method and apparatus for expanded content tag sharing
US20110320715A1 (en) * 2010-06-23 2011-12-29 Microsoft Corporation Identifying trending content items using content item histograms
US20120036482A1 (en) * 2010-08-04 2012-02-09 Copia Interactive, Llc Method of and System for Browsing and Displaying Items from a Collection
US9038000B2 (en) * 2010-08-04 2015-05-19 Copia Interactive, Llc Method of and system for browsing and displaying items from a collection
US20120072428A1 (en) * 2010-09-16 2012-03-22 Wayne Kao Action clustering for news feeds
US9256674B2 (en) 2010-09-16 2016-02-09 Facebook, Inc. Action clustering for news feeds
US8700636B2 (en) * 2010-09-16 2014-04-15 Facebook, Inc. Action clustering for news feeds
US20120084731A1 (en) * 2010-09-30 2012-04-05 Microsoft Corporation Displaying images interesting to a user
US9588992B2 (en) * 2010-09-30 2017-03-07 Microsoft Technology Licensing, Llc Displaying images interesting to a user
US20120117142A1 (en) * 2010-11-05 2012-05-10 Inventec Corporation Cloud computing system and data accessing method thereof
US20120254806A1 (en) * 2011-03-30 2012-10-04 Google Inc. System and method for dynamic, feature-based playlist generation
US20120249571A1 (en) * 2011-03-30 2012-10-04 Casio Computer Co., Ltd. Image display method, server, and image display system
US8319087B2 (en) * 2011-03-30 2012-11-27 Google Inc. System and method for dynamic, feature-based playlist generation
US9100678B2 (en) * 2011-03-30 2015-08-04 Casio Computer Co., Ltd. Image display method, server, and image display system
US9355110B1 (en) 2011-07-14 2016-05-31 Google Inc. Dynamic presentation of data items based on prioritized associations
WO2013048968A1 (en) * 2011-09-26 2013-04-04 Google Inc. Media content voting, ranking, and playing system
US8438171B2 (en) 2011-09-26 2013-05-07 Google Inc. Media content voting, ranking, and playing system
US9439367B2 (en) 2014-02-07 2016-09-13 Arthi Abhyanker Network enabled gardening with a remotely controllable positioning extension
US9457901B2 (en) 2014-04-22 2016-10-04 Fatdoor, Inc. Quadcopter with a printable payload extension system and method
US9004396B1 (en) 2014-04-24 2015-04-14 Fatdoor, Inc. Skyteboard quadcopter and method
US9022324B1 (en) 2014-05-05 2015-05-05 Fatdoor, Inc. Coordination of aerial vehicles through a central server
US9971985B2 (en) 2014-06-20 2018-05-15 Raj Abhyanker Train based community
US9441981B2 (en) 2014-06-20 2016-09-13 Fatdoor, Inc. Variable bus stops across a bus route in a regional transportation network
US9451020B2 (en) 2014-07-18 2016-09-20 Legalforce, Inc. Distributed communication of independent autonomous vehicles to provide redundancy and performance
US20160170994A1 (en) * 2014-12-10 2016-06-16 Samsung Electronics Co., Ltd. Semantic enrichment of trajectory data
US10430805B2 (en) * 2014-12-10 2019-10-01 Samsung Electronics Co., Ltd. Semantic enrichment of trajectory data
US10785323B2 (en) 2015-01-05 2020-09-22 Picpocket Labs, Inc. Use of a dynamic geofence to control media sharing and aggregation associated with a mobile target
US20170109419A1 (en) * 2015-10-15 2017-04-20 Disney Enterprises, Inc. Metadata Extraction and Management
US10007713B2 (en) * 2015-10-15 2018-06-26 Disney Enterprises, Inc. Metadata extraction and management
US10520948B2 (en) 2017-05-12 2019-12-31 Autonomy Squared Llc Robot delivery method
US10459450B2 (en) 2017-05-12 2019-10-29 Autonomy Squared Llc Robot delivery system
US10345818B2 (en) 2017-05-12 2019-07-09 Autonomy Squared Llc Robot transport method with transportation container
US11009886B2 (en) 2017-05-12 2021-05-18 Autonomy Squared Llc Robot pickup method

Also Published As

Publication number Publication date
CN103902656A (en) 2014-07-02
KR100942885B1 (en) 2010-02-17
KR20100023023A (en) 2010-03-03
KR20080005561A (en) 2008-01-14
EP1877972A2 (en) 2008-01-16
US10210159B2 (en) 2019-02-19
WO2006116196A2 (en) 2006-11-02
EP1877972A4 (en) 2011-03-09
JP2008538842A (en) 2008-11-06
WO2006116196A3 (en) 2007-11-01
US20060242178A1 (en) 2006-10-26
KR101148529B1 (en) 2012-05-21
CN103902656B (en) 2019-11-29
JP5666088B2 (en) 2015-02-12

Similar Documents

Publication Publication Date Title
US20190179849A1 (en) Graphical user interface for overlaying annotations on media objects
US10210159B2 (en) Media object metadata association and ranking
US11681736B2 (en) System and method for tagging a region within a frame of a distributed video file
US9588992B2 (en) Displaying images interesting to a user
KR101686594B1 (en) Ranking objects by social relevance
ES2616953T3 (en) Method and apparatus for automatic recommendation generation
US20220237247A1 (en) Selecting content objects for recommendation based on content object collections
Tjondronegoro et al. A study and comparison of multimedia Web searching: 1997–2006
US20150066897A1 (en) Systems and methods for conveying passive interest classified media content
Nguyen et al. NowAndThen: a social network-based photo recommendation tool supporting reminiscence
van Zwol et al. Multimedia information retrieval: " new challenges in audio visual search"
Elahi et al. Relation based image retrival in online social network

Legal Events

Date Code Title Description
AS Assignment

Owner name: YAHOO| INC.,CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BUTTERFIELD, DANIEL STEWART;FAKE, CATERINA;HENDERSON-BEGG, CALLUM JAMES;AND OTHERS;SIGNING DATES FROM 20060605 TO 20060607;REEL/FRAME:023210/0244

AS Assignment

Owner name: YAHOO HOLDINGS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO| INC.;REEL/FRAME:042963/0211

Effective date: 20170613

AS Assignment

Owner name: OATH INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO HOLDINGS, INC.;REEL/FRAME:045240/0310

Effective date: 20171231

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: VERIZON PATENT AND LICENSING INC., NEW JERSEY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VERIZON MEDIA INC.;REEL/FRAME:057453/0431

Effective date: 20210801