WO2008004181A2 - Methods and devices for managing a play-list of digital content - Google Patents

Methods and devices for managing a play-list of digital content Download PDF

Info

Publication number
WO2008004181A2
WO2008004181A2 PCT/IB2007/052578 IB2007052578W WO2008004181A2 WO 2008004181 A2 WO2008004181 A2 WO 2008004181A2 IB 2007052578 W IB2007052578 W IB 2007052578W WO 2008004181 A2 WO2008004181 A2 WO 2008004181A2
Authority
WO
WIPO (PCT)
Prior art keywords
content item
digital content
unavailable
parameter
given
Prior art date
Application number
PCT/IB2007/052578
Other languages
French (fr)
Other versions
WO2008004181A3 (en
Inventor
Sandeep Lakshmipathy
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2008004181A2 publication Critical patent/WO2008004181A2/en
Publication of WO2008004181A3 publication Critical patent/WO2008004181A3/en

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded

Definitions

  • the present invention relates to managing a play- list of digital content such as audio and/or videos and/or the like. More specifically, the invention relates to methods of and devices for managing a play-list comprising digital content items associated with at least one feature parameter. Furthermore, the invention relates to a computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to the invention.
  • play-lists are typically used for organizing and rendering various digital content items.
  • a play-list may comprise further play-lists or groupings e.g. one for each artist, genre, rating, mood, and/or the like.
  • the play- list is traversed by the player in a random, ascending or descending order.
  • the play- list need not be an actual list of descriptive text containing references to the actual digital content items but may also be a list or collection of graphical icons or the like, each icon representing a specific digital content item.
  • the play-list when a digital content item (forth only referred to as content item) is unavailable for being rendered by the appropriate player or renderer, the play-list simply skips to the next content item in the list until a playable content item is encountered. This skipping causes an additional pause that is noticeable by a user and thus detracts from the user's experience. Furthermore, if, as an example, the play-list comprises 10 audio tracks and 5 of them are missing or unavailable, a user will only get to listen for half of the expected time, which also detracts from the user's experience.
  • a content item may e.g.
  • DRM Digital Rights Management
  • content items are distributed over a variety of devices connected in a network.
  • portable devices e.g. an MP3-player
  • content items related in some way e.g. being from the same album or DVD, same artist, same genre, etc.
  • the digital player will not render several content items causing even longer periods of pause and shorter overall play-time.
  • Patent application US 2005/0021500 Al discloses a system and a method for repairing play-lists where a user's content experience (e.g. music playing experience) is monitored and metadata describing this experience is collected. Meta-data or information related to a song is used for repairing a play- list. Information related to a song is collected but is based on static and explicit external inputs. The collected information identifying a given song comprises information like title, artist name, album name, genre, etc. (often referred to as the well-known ID3 metadata or ID3 tags) and collected information related to an end- user's experience or preference of the particular song. Static inputs including ID3 tag information are used to determine the song identifiers. However, the ID3 tag information can be, and often is, edited by an end-user and thus cannot be used in a reliable way to identify a song uniquely.
  • ID3 tag information can be, and often is, edited by an end-user and thus cannot be used in a reliable way to identify a song uniquely.
  • valid metadata may be missing for a given song, i.e. the ID3 information may be blank.
  • the ID3 information may be blank. This happens for example, when a set of personal recordings is part of a play- list file. If a user for example rips songs from a CD and does not enter any metadata and there is no service running doing this, the tracks will all be named in the same way, simply 'track##' with the number used from the order on the CD and the following metadata 'unknown album', 'unknown artist', etc.
  • the metadata can also be in different languages. Additionally, some of the inputs related to the user-experience may not always be available, e.g. if a user has some songs in the play- list that recently has been purchased.
  • ID3 information may be incomplete or the information may not be unique since duplication of metadata is possible, e.g. 2 songs may be deliberately or unintentionally be assigned the same metadata by a user.
  • the metadata can also be in different languages.
  • Patent application US 2005/0021500 Al is only related to repairing a play-list due to a content item being moved and thus only facilitates correction of an old path to the content item.
  • a method (and corresponding device) of managing a play- list comprising at least one digital content item, where the at least one digital content item belonging to the play-list is associated with at least one feature parameter, which has been derived based on the actual digital content item to which it is associated the method comprising: checking the availability for rendering of a given digital content item belonging to the play- list before the given digital content item is rendered, and if the check results in that the given digital content item is unavailable for rendering then obtaining at least one feature parameter associated with the unavailable digital content item, and determining a replacement digital content item by comparing at least one feature parameter of other content items with the at least one feature parameter of the unavailable content item.
  • a simple, reliable and efficient way of managing a play- list is obtained. Furthermore, a user will be presented without any detractions of user experience since the play-list does not skip rendering the unavailable content item(s). Additionally, the user is also presented with a replacement content item that to a high degree should be very similar (at least as best as possible) to the unavailable content item, especially when the feature parameter(s) are carefully selected or derived.
  • determining a replacement digital content item comprises searching among a number of feature parameters of a number of digital content items by comparing said feature parameters with the at least one feature parameter associated with the unavailable digital content item to locate at least one feature parameter of a digital content item that best matches the at least one feature parameter associated with the unavailable digital content item according to at least one predetermined criteria, and determining a replacement digital content item as the digital content item being associated with the located at least one feature parameter best matching the at least one feature parameter associated with the unavailable digital content item.
  • the method further comprises automatically rendering the replacement digital content item instead of the unavailable digital content item.
  • the at least one feature parameter associated with a digital content item is a feature vector comprising a plurality of parameters where at least one feature parameter is derived based on the actual content of the digital content item using a fingerprinting or hash technique so it uniquely identifies the content of the given digital content item.
  • the at least one feature parameter associated with a given content item comprises at least one parameter selected from the group of: a parameter representing a timbre of the given content item or segments or windows thereof, a parameter representing a tone quality of the given content item or segments or windows thereof, a parameter representing a tone color of the given content item or segments or windows thereof, a parameter representing an audio feature of the given content item or segments or windows thereof, a parameter representing an acoustic parameter of the given content item or segments or windows thereof, a parameter representing a spectral envelope of the given content item or segments or windows thereof, a parameter representing a time envelope of the given content item or segments or windows thereof, one or more parameters representing one or more of attack, interonset interval, decay, sustain, release and/or transients of the given content item or segments or windows thereof, one or more parameters representing one or more of a short- time signal level
  • the feature parameters of a content item is comprised by a feature vector and said predetermined criteria or said determining a replacement digital content item comprises subtracting the feature vector for the unavailable content item and a feature vector for a potential replacement content item resulting in a result vector, normalizing said result vector giving a scalar size representing a distance between the unavailable content item and the potential replacement content item where one or more content items giving a scalar size within a predetermined range is determined as one or more replacement digital content items.
  • the replacement digital content item is equal to the unavailable content item but being stored at a location different from the location of the unavailable content item. In this way, the unavailable digital content item is replaced by an exact copy from another location.
  • the check is done automatically or is done upon request from a user.
  • a play-list is processed in order to determine an integer number of closest matching other content items for each content item of the play- list and storing an identifier or reference to each closest matching content items for each content item in the play-list and when an unavailable content item is encountered looking up the closest matching content items for that particular content item. In this way, the determination of closest content item(s) will be quicker but will require a bit more pre-processing and a bit more storage.
  • the embodiments of the devices according to the present invention correspond to the embodiments of the methods according to the present invention and have the same advantages for the same reasons.
  • the invention also relates to a computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to the present invention.
  • Figure 1 schematically illustrates a relationship between a play-list, content items, a replacement content item and associated feature parameter(s) for each content item;
  • Figure 2 schematically illustrates a rendering device.
  • Figure 1 schematically illustrates a relationship between a play-list, content items and associated feature parameters. Shown are a number of content items (110, 110', 111) and a play-list (100) comprising a representation of a content item and a reference (101) to each content item (110, 110') being part of the play-list (100).
  • a reference (101) would typically contain a reference, URL or link to an actual location of the content item e.g. a local location or a remote location if the content item is stored on a device connected in a network with the playing or rendering device processing the play-list (100).
  • Each content item (110; 110') of the play-list has associated with it at least one feature parameter (130) where the feature parameter(s) (130) has been derived earlier, as explained in the following, based on the actual content item (110; 110') to which it is associated.
  • the number of feature parameters (130) of each content item (HO; 100') is 20. In alternative embodiments the number may be different (both larger and smaller).
  • the feature parameters (130) of the content items (110, 110', 111) are stored in one or more databases, storage structures or similar structures (120) available for query by the playing or rendering device processing the play-list (100).
  • the database (120) storing the feature parameters may be a different (or the same) as the one storing at least part of the content items and may be stored on a separate device. They may be stored locally in connection with the playing or rendering device or at a network connected remote device. Also shown is a content item that is determined to be a replacement content item (111) as explained in the following.
  • the replacement content item (111) also has at least one feature parameter (130) associated with it.
  • the content item that is determined to be a replacement content item (111) is not part of the play-list (100) (but may e.g. be part of another play- list or no play- list).
  • the replacement content item (111) may be a part of the play-list (100) and the play-list (100) would comprise a reference to it.
  • the availability for rendering of the content (110; 110') is checked. This check may e.g. be done just about before the content item (110; 110') is to be rendered (giving sufficient time for replacement) or it can be done once a given play-list is loaded or activated or at a time between.
  • the playing or rendering device will proceed as normal and render the content item, e.g. by playing or streaming the content item, at the appropriate moment.
  • a content item may be unavailable e.g. due to being damaged, being moved or deleted without the play-list being updated, an associated DRM license not currently being available or if the user has not purchased the associated license, etc. or due to being located at a remote device not being connected with the rendering device at the present moment or the like.
  • a content item (110) is available for rendering while another content item (110') is not as indicated by the broken reference (101) connecting the unavailable content item (HO') with the play-list (100).
  • the feature parameter(s) (130) of the unavailable content item (HO') is obtained from the database or storage structure (120) using an identifier of the unavailable content item (HO'). Based on the obtained feature parameter(s) (130) of the unavailable content item (HO'), it is determined which feature parameter(s) (130) of other content items that best matches the feature parameter(s) of the unavailable content item (HO') according to at least one predetermined criteria.
  • the content item (111) having the best matching feature parameter(s) with the feature parameter(s) of the unavailable content item (HO') is then designated as a replacement content item (111) for the unavailable content item (HO').
  • the feature parameters of a content item are comprised by a feature vector.
  • the best matching feature parameters of a given content item are determined by subtracting the feature vector for the unavailable content item (130) and the feature vector for the potential replacement content item (111). After subtraction the resulting vector is normalized to arrive at a scalar distance denoting the distance between two content items. The lesser the distance the more the two content items are determined to be similar to each other. The best matching content item(s) are then determined as replacement content item(s) (111).
  • the feature parameter(s) (130) for each content item (110, 110', 111) represent its timbre, tone quality, tone color, etc. and/or other audio features and/or acoustic parameters. Such parameters may be extracted using fingerprinting, a hashing technique, etc.
  • the feature parameter(s) (130) of a content item may e.g. represent one or more of spectral envelope, time envelope, attack, interonset interval, decay, sustain, release, transients, short-time signal level, average signal spectrum, modulation cepstra, average power spectrum correlation, etc. e.g. for the entire content item or segments or windows thereof.
  • any sound or signal parameter or characteristic usable for characterizing a content item and/or parts thereof may be used.
  • at least some of the used feature parameters are robust towards noise or the like.
  • the feature parameter(s) (130) need not be extracted on an exact version of the content item. They (or some of them) may e.g. be derived based on a mono version and/or a version having another sampling frequency of the content item that they are derived for.
  • only the best matching content item (111) (or content items if they are equally matching) is returned.
  • a plurality of matching content items (111) is returned being within a range of acceptable value(s) or (e.g. adaptable) threshold (e.g. of a weighted sum) for the feature parameter(s).
  • a threshold may e.g. be a calculated Hamming distance, which is well known in the art.
  • One of this plurality of content items may then be selected as the replacement content item (111) according to other criteria (e.g.
  • a determination of a replacement content item (111) may be made among only the feature parameter(s) of the content items that currently are available. Alternatively, feature parameter(s) of all content items in the database (120) is checked and the availability of the associated content items is checked at a later time. In this embodiment, if the best matching content item is not available then the second best matching content item is selected and so forth.
  • a play-list is processed in order to determine a number (e.g. 10 or generally n, n being an integer) of closest matching (e.g. available) other content items for each content item of the play- list.
  • An identifier or reference to each closest matching content items may then be stored, e.g. in database (120) or another database for each content item in the play-list.
  • database (120) or another database for each content item in the play-list.
  • the closest matching content items for that particular content item is simply looked up. This requires a bit more pre-processing and requires more storage but the determination of closest content item(s) will be quicker.
  • the replacement content item (111) is then rendered instead of the unavailable content item (HO').
  • the check may be done automatically by the rendering or playing device or may be done upon request from a user. In this way, a user will be presented without any detractions of user experience since the play-list does not skip rendering due to the unavailable content item(s). Furthermore, the user is also presented with a replacement content item that to a high degree should be very similar (at least as best as possible) to the unavailable content item, especially when the feature parameter(s) are carefully selected or derived.
  • the replacement content item (111) may both be a different content item or it may be the same content item as the unavailable one but stored in a different location.
  • the feature parameter(s) (130) of a given content item (110, 110', 111) may e.g. be derived using the well-known so-called fingerprinting technique or a hash function used on the content-item.
  • a fingerprint can be regarded as a short summary of an object. Therefore, a fingerprint function should map a given object consisting of a relatively large number of bits to a fingerprint of a relatively more limited number of bits. This enables a more quick comparison between objects instead of comparing the larger number of bits and also makes the comparison more robust. For good fingerprint functions, a severely degraded signal will still yield a similar fingerprint to a fingerprint of an original un-degraded signal. See e.g.
  • patent application WO 2005/050620 Al (Haitsma, Kalker and Oostveen), incorporated herein by reference, for further details of matching a query data object with a candidate object comparing fingerprints of the data objects using a statistical model of the query fingerprint. See e.g. also patent application US 2002/0178410 Al (Haitsma, Kalker, Bagen and Oostveen), incorporated herein by reference, for a method and apparatus for generating and matching fingerprints of multimedia content where it is described on page 4 how two 3 second audio clips are declared similar if the Hamming distance between two derived fingerprint blocks is less than a certain threshold value.
  • a fingerprint may e.g. be based on extracting a feature-vector, such as the one used in the LikeMusicTM system from an originating audio or video signal.
  • FIG. 2 schematically illustrates a rendering device.
  • a rendering or playing device such as an mp3-player, a media center, a home entertainment system, a digital audio and/or video player, a PDA, a computer, a laptop, a mobile telephone, etc.
  • a render circuit (202) comprising one or more processors and a memory and/or storage (203) for storing relevant program information and e.g. content items and the database (120 of Figure 1 if this is not stored at another device or system).
  • the rendering device (200) also optionally comprises an input/output circuit (206) e.g. for receiving user input and giving user output e.g. via an optional display unit (204), which may be integrated in the device (200) or externally connected.
  • the rendering device (200) further comprises a communications circuit (201) for communicating information like queries, content items, results of queries, feature parameters, etc. with another device or system.
  • the rendering device (200) functions as described in connection with Figure 1.
  • any reference signs placed between parentheses shall not be constructed as limiting the claim.
  • the word “comprising” does not exclude the presence of elements or steps other than those listed in a claim.
  • the word “a” or “an” preceding an element does not exclude the presence of a plurality of such elements.
  • the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer.
  • the device claim enumerating several means several of these means can be embodied by one and the same item of hardware.
  • the mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Abstract

This invention relates to devices for and methods of managing a play- list (100) comprising at least one digital content item (110), where the digital content items (110) belonging to the play- list (100) is associated with at least one feature parameter (130), which has been derived based on the actual digital content item (110) to which it is associated, where the rendering availability of a given digital content item (110) is checked before the given digital content item (110) is rendered, and if the check results in that the given digital content item (110) is unavailable then obtaining the feature parameter(s) (130) of the unavailable digital content item (110') and determining a replacement digital content item (111) by comparing feature parameter(s) (130) of other content items (110, 111) with the feature parameter(s) (130) of the unavailable content item (110'). In this way, a simple, reliable and efficient way of managing a play-list is obtained. Further, a user will be presented without any detractions of user experience since the play-list does not skip rendering the unavailable content item(s). Furthermore, the user is also presented with a replacement content item that to a high degree should be very similar (at least as best as possible) to the unavailable content item, especially when the feature parameter(s) are carefully selected or derived. The replacement content item (111) may both be a different content item or it may be the same content item as the unavailable one but stored in a different location.

Description

Methods and devices for managing a play- list of digital content
FIELD OF THE INVENTION
The present invention relates to managing a play- list of digital content such as audio and/or videos and/or the like. More specifically, the invention relates to methods of and devices for managing a play-list comprising digital content items associated with at least one feature parameter. Furthermore, the invention relates to a computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to the invention.
BACKGROUND OF THE INVENTION When playing or rendering digital content such as audio and/or videos and/or the like on a system or device such as an mp3-player, a media center, a home entertainment system, a digital audio and/or video player, a PDA, a computer, a laptop, a mobile telephone, etc. play-lists are typically used for organizing and rendering various digital content items. A play-list may comprise further play-lists or groupings e.g. one for each artist, genre, rating, mood, and/or the like. Typically the play- list is traversed by the player in a random, ascending or descending order. The play- list need not be an actual list of descriptive text containing references to the actual digital content items but may also be a list or collection of graphical icons or the like, each icon representing a specific digital content item.
In such play-lists, when a digital content item (forth only referred to as content item) is unavailable for being rendered by the appropriate player or renderer, the play-list simply skips to the next content item in the list until a playable content item is encountered. This skipping causes an additional pause that is noticeable by a user and thus detracts from the user's experience. Furthermore, if, as an example, the play-list comprises 10 audio tracks and 5 of them are missing or unavailable, a user will only get to listen for half of the expected time, which also detracts from the user's experience. A content item may e.g. be unavailable due to being un-renderable, damaged or simply due to not being present or reachable by the player and/or if a DRM (Digital Rights Management) license or another type of license is not available or reachable. The latter situations can arise quite often if content items are distributed over a variety of devices connected in a network. Especially, if certain portable devices (e.g. an MP3-player) is connected to the network e.g. due to it being powered off, not being connected, etc. Furthermore, content items related in some way (e.g. being from the same album or DVD, same artist, same genre, etc.) will typically be stored on the same device. If such a device (or the digital rights) is unreachable and the current play- list contains several related content items, the digital player will not render several content items causing even longer periods of pause and shorter overall play-time.
Patent application US 2005/0021500 Al discloses a system and a method for repairing play-lists where a user's content experience (e.g. music playing experience) is monitored and metadata describing this experience is collected. Meta-data or information related to a song is used for repairing a play- list. Information related to a song is collected but is based on static and explicit external inputs. The collected information identifying a given song comprises information like title, artist name, album name, genre, etc. (often referred to as the well-known ID3 metadata or ID3 tags) and collected information related to an end- user's experience or preference of the particular song. Static inputs including ID3 tag information are used to determine the song identifiers. However, the ID3 tag information can be, and often is, edited by an end-user and thus cannot be used in a reliable way to identify a song uniquely.
Furthermore, valid metadata may be missing for a given song, i.e. the ID3 information may be blank. This happens for example, when a set of personal recordings is part of a play- list file. If a user for example rips songs from a CD and does not enter any metadata and there is no service running doing this, the tracks will all be named in the same way, simply 'track##' with the number used from the order on the CD and the following metadata 'unknown album', 'unknown artist', etc. The metadata can also be in different languages. Additionally, some of the inputs related to the user-experience may not always be available, e.g. if a user has some songs in the play- list that recently has been purchased. In this situation, information related to the user's experience is not readily available and other inputs like play-count, user rating, etc. will not be known. Additionally, the ID3 information may be incomplete or the information may not be unique since duplication of metadata is possible, e.g. 2 songs may be deliberately or unintentionally be assigned the same metadata by a user. The metadata can also be in different languages.
The disclosure of Patent application US 2005/0021500 Al is only related to repairing a play-list due to a content item being moved and thus only facilitates correction of an old path to the content item. OBJECT AND SUMMARY OF THE INVENTION
It is an object of the invention to provide a method (and corresponding device) of managing a play- list that at least alleviates the above situation(s).
This is achieved by a method (and corresponding device) of managing a play- list comprising at least one digital content item, where the at least one digital content item belonging to the play-list is associated with at least one feature parameter, which has been derived based on the actual digital content item to which it is associated, the method comprising: checking the availability for rendering of a given digital content item belonging to the play- list before the given digital content item is rendered, and if the check results in that the given digital content item is unavailable for rendering then obtaining at least one feature parameter associated with the unavailable digital content item, and determining a replacement digital content item by comparing at least one feature parameter of other content items with the at least one feature parameter of the unavailable content item.
In this way, a simple, reliable and efficient way of managing a play- list is obtained. Furthermore, a user will be presented without any detractions of user experience since the play-list does not skip rendering the unavailable content item(s). Additionally, the user is also presented with a replacement content item that to a high degree should be very similar (at least as best as possible) to the unavailable content item, especially when the feature parameter(s) are carefully selected or derived. In one embodiment, determining a replacement digital content item comprises searching among a number of feature parameters of a number of digital content items by comparing said feature parameters with the at least one feature parameter associated with the unavailable digital content item to locate at least one feature parameter of a digital content item that best matches the at least one feature parameter associated with the unavailable digital content item according to at least one predetermined criteria, and determining a replacement digital content item as the digital content item being associated with the located at least one feature parameter best matching the at least one feature parameter associated with the unavailable digital content item.
In one embodiment, the method further comprises automatically rendering the replacement digital content item instead of the unavailable digital content item.
In one embodiment, the at least one feature parameter associated with a digital content item is a feature vector comprising a plurality of parameters where at least one feature parameter is derived based on the actual content of the digital content item using a fingerprinting or hash technique so it uniquely identifies the content of the given digital content item.
In this way, a very efficient and robust way of identifying content items are obtained resulting in a very efficient and robust way of managing a play-list. In one embodiment, the at least one feature parameter associated with a given content item comprises at least one parameter selected from the group of: a parameter representing a timbre of the given content item or segments or windows thereof, a parameter representing a tone quality of the given content item or segments or windows thereof, a parameter representing a tone color of the given content item or segments or windows thereof, a parameter representing an audio feature of the given content item or segments or windows thereof, a parameter representing an acoustic parameter of the given content item or segments or windows thereof, a parameter representing a spectral envelope of the given content item or segments or windows thereof, a parameter representing a time envelope of the given content item or segments or windows thereof, one or more parameters representing one or more of attack, interonset interval, decay, sustain, release and/or transients of the given content item or segments or windows thereof, one or more parameters representing one or more of a short- time signal level, an average signal spectrum, a modulation cepstra, an average power spectrum correlation of the given content item or segments or windows thereof, and one or more parameters representing a sound or signal parameter or characteristic usable for characterizing the given the entire content item or segments or windows thereof.
In one embodiment, the feature parameters of a content item is comprised by a feature vector and said predetermined criteria or said determining a replacement digital content item comprises subtracting the feature vector for the unavailable content item and a feature vector for a potential replacement content item resulting in a result vector, normalizing said result vector giving a scalar size representing a distance between the unavailable content item and the potential replacement content item where one or more content items giving a scalar size within a predetermined range is determined as one or more replacement digital content items.
In this way, a very efficient way of determining how well content items match the unavailable content item is provided.
In one embodiment, the replacement digital content item is equal to the unavailable content item but being stored at a location different from the location of the unavailable content item. In this way, the unavailable digital content item is replaced by an exact copy from another location.
In one embodiment, the check is done automatically or is done upon request from a user. In one embodiment, a play-list is processed in order to determine an integer number of closest matching other content items for each content item of the play- list and storing an identifier or reference to each closest matching content items for each content item in the play-list and when an unavailable content item is encountered looking up the closest matching content items for that particular content item. In this way, the determination of closest content item(s) will be quicker but will require a bit more pre-processing and a bit more storage.
Other advantageous embodiments of the methods and devices are defined in the sub-claims and explained in the following.
The embodiments of the devices according to the present invention correspond to the embodiments of the methods according to the present invention and have the same advantages for the same reasons.
Further, the invention also relates to a computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to the present invention.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 schematically illustrates a relationship between a play-list, content items, a replacement content item and associated feature parameter(s) for each content item;
Figure 2 schematically illustrates a rendering device.
DESCRIPTION OF PREFERRED EMBODIMENTS
Figure 1 schematically illustrates a relationship between a play-list, content items and associated feature parameters. Shown are a number of content items (110, 110', 111) and a play-list (100) comprising a representation of a content item and a reference (101) to each content item (110, 110') being part of the play-list (100). A reference (101) would typically contain a reference, URL or link to an actual location of the content item e.g. a local location or a remote location if the content item is stored on a device connected in a network with the playing or rendering device processing the play-list (100). Each content item (110; 110') of the play-list has associated with it at least one feature parameter (130) where the feature parameter(s) (130) has been derived earlier, as explained in the following, based on the actual content item (110; 110') to which it is associated. In one embodiment the number of feature parameters (130) of each content item (HO; 100') is 20. In alternative embodiments the number may be different (both larger and smaller). The feature parameters (130) of the content items (110, 110', 111) are stored in one or more databases, storage structures or similar structures (120) available for query by the playing or rendering device processing the play-list (100). The database (120) storing the feature parameters may be a different (or the same) as the one storing at least part of the content items and may be stored on a separate device. They may be stored locally in connection with the playing or rendering device or at a network connected remote device. Also shown is a content item that is determined to be a replacement content item (111) as explained in the following. The replacement content item (111) also has at least one feature parameter (130) associated with it. In the shown exemplary situation, the content item that is determined to be a replacement content item (111) is not part of the play-list (100) (but may e.g. be part of another play- list or no play- list). In another situation (not shown), the replacement content item (111) may be a part of the play-list (100) and the play-list (100) would comprise a reference to it.
Before a given content item (110; 110') in the play-list (100) is to be played or rendered, the availability for rendering of the content (110; 110') is checked. This check may e.g. be done just about before the content item (110; 110') is to be rendered (giving sufficient time for replacement) or it can be done once a given play-list is loaded or activated or at a time between.
If the check results in that the given content item (110) is available then the playing or rendering device will proceed as normal and render the content item, e.g. by playing or streaming the content item, at the appropriate moment. A content item may be unavailable e.g. due to being damaged, being moved or deleted without the play-list being updated, an associated DRM license not currently being available or if the user has not purchased the associated license, etc. or due to being located at a remote device not being connected with the rendering device at the present moment or the like. In the exemplary situation shown in Figure 1, a content item (110) is available for rendering while another content item (110') is not as indicated by the broken reference (101) connecting the unavailable content item (HO') with the play-list (100). If the check results in that the given content item (HO') is unavailable for being rendered then the following actions are taken. Firstly, the feature parameter(s) (130) of the unavailable content item (HO') is obtained from the database or storage structure (120) using an identifier of the unavailable content item (HO'). Based on the obtained feature parameter(s) (130) of the unavailable content item (HO'), it is determined which feature parameter(s) (130) of other content items that best matches the feature parameter(s) of the unavailable content item (HO') according to at least one predetermined criteria. The content item (111) having the best matching feature parameter(s) with the feature parameter(s) of the unavailable content item (HO') is then designated as a replacement content item (111) for the unavailable content item (HO'). In one embodiment, the feature parameters of a content item are comprised by a feature vector. In this embodiment, the best matching feature parameters of a given content item are determined by subtracting the feature vector for the unavailable content item (130) and the feature vector for the potential replacement content item (111). After subtraction the resulting vector is normalized to arrive at a scalar distance denoting the distance between two content items. The lesser the distance the more the two content items are determined to be similar to each other. The best matching content item(s) are then determined as replacement content item(s) (111).
In one embodiment, the feature parameter(s) (130) for each content item (110, 110', 111) represent its timbre, tone quality, tone color, etc. and/or other audio features and/or acoustic parameters. Such parameters may be extracted using fingerprinting, a hashing technique, etc. The feature parameter(s) (130) of a content item may e.g. represent one or more of spectral envelope, time envelope, attack, interonset interval, decay, sustain, release, transients, short-time signal level, average signal spectrum, modulation cepstra, average power spectrum correlation, etc. e.g. for the entire content item or segments or windows thereof.
In general any sound or signal parameter or characteristic usable for characterizing a content item and/or parts thereof may be used. In one embodiment, at least some of the used feature parameters are robust towards noise or the like.
Please note, the feature parameter(s) (130) need not be extracted on an exact version of the content item. They (or some of them) may e.g. be derived based on a mono version and/or a version having another sampling frequency of the content item that they are derived for.
In one embodiment, only the best matching content item (111) (or content items if they are equally matching) is returned. Alternatively, a plurality of matching content items (111) is returned being within a range of acceptable value(s) or (e.g. adaptable) threshold (e.g. of a weighted sum) for the feature parameter(s). Such a threshold may e.g. be a calculated Hamming distance, which is well known in the art. One of this plurality of content items may then be selected as the replacement content item (111) according to other criteria (e.g. user selection, most similar to last rendered content item, having same user rating as the unavailable content item, having highest play-count, having least play-count where a user has not yet explored the content item, of similar duration as the unavailable content item, from the same artist as the unavailable content item, from the same album as the unavailable content item, etc.). In one embodiment, if no matches are within a certain predetermined threshold or fulfils the other criteria then no replacement is made.
A determination of a replacement content item (111) may be made among only the feature parameter(s) of the content items that currently are available. Alternatively, feature parameter(s) of all content items in the database (120) is checked and the availability of the associated content items is checked at a later time. In this embodiment, if the best matching content item is not available then the second best matching content item is selected and so forth.
In an alternative embodiment, a play-list is processed in order to determine a number (e.g. 10 or generally n, n being an integer) of closest matching (e.g. available) other content items for each content item of the play- list. An identifier or reference to each closest matching content items may then be stored, e.g. in database (120) or another database for each content item in the play-list. When an unavailable content item is encountered the closest matching content items for that particular content item is simply looked up. This requires a bit more pre-processing and requires more storage but the determination of closest content item(s) will be quicker. At the appropriate time for rendering of the unavailable content item (HO') the replacement content item (111), i.e. a best matching (available) content item, is then rendered instead of the unavailable content item (HO').
The check may be done automatically by the rendering or playing device or may be done upon request from a user. In this way, a user will be presented without any detractions of user experience since the play-list does not skip rendering due to the unavailable content item(s). Furthermore, the user is also presented with a replacement content item that to a high degree should be very similar (at least as best as possible) to the unavailable content item, especially when the feature parameter(s) are carefully selected or derived. The replacement content item (111) may both be a different content item or it may be the same content item as the unavailable one but stored in a different location.
The feature parameter(s) (130) of a given content item (110, 110', 111) may e.g. be derived using the well-known so-called fingerprinting technique or a hash function used on the content-item. A fingerprint can be regarded as a short summary of an object. Therefore, a fingerprint function should map a given object consisting of a relatively large number of bits to a fingerprint of a relatively more limited number of bits. This enables a more quick comparison between objects instead of comparing the larger number of bits and also makes the comparison more robust. For good fingerprint functions, a severely degraded signal will still yield a similar fingerprint to a fingerprint of an original un-degraded signal. See e.g. patent application WO 2005/050620 Al (Haitsma, Kalker and Oostveen), incorporated herein by reference, for further details of matching a query data object with a candidate object comparing fingerprints of the data objects using a statistical model of the query fingerprint. See e.g. also patent application US 2002/0178410 Al (Haitsma, Kalker, Bagen and Oostveen), incorporated herein by reference, for a method and apparatus for generating and matching fingerprints of multimedia content where it is described on page 4 how two 3 second audio clips are declared similar if the Hamming distance between two derived fingerprint blocks is less than a certain threshold value.
A fingerprint may e.g. be based on extracting a feature-vector, such as the one used in the LikeMusic™ system from an originating audio or video signal.
Figure 2 schematically illustrates a rendering device. Shown is a rendering or playing device (200) such as an mp3-player, a media center, a home entertainment system, a digital audio and/or video player, a PDA, a computer, a laptop, a mobile telephone, etc. comprising a render circuit (202) comprising one or more processors and a memory and/or storage (203) for storing relevant program information and e.g. content items and the database (120 of Figure 1 if this is not stored at another device or system). The rendering device (200) also optionally comprises an input/output circuit (206) e.g. for receiving user input and giving user output e.g. via an optional display unit (204), which may be integrated in the device (200) or externally connected. The rendering device (200) further comprises a communications circuit (201) for communicating information like queries, content items, results of queries, feature parameters, etc. with another device or system. The rendering device (200) functions as described in connection with Figure 1.
In the claims, any reference signs placed between parentheses shall not be constructed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps other than those listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Claims

CLAIMS:
1. A method of managing a play- list (100) comprising at least one digital content item (110), where the at least one digital content item (110) belonging to the play-list (100) is associated with at least one feature parameter (130), which has been derived based on the actual digital content item (110) to which it is associated, the method comprising: checking the availability for rendering of a given digital content item (110) belonging to the play-list (100) before the given digital content item (110) is rendered, and if the check results in that the given digital content item (110) is unavailable for rendering then obtaining at least one feature parameter (130) associated with the unavailable digital content item (HO'), and determining a replacement digital content item (111) by comparing at least one feature parameter (130) of other content items (110, 111) with the at least one feature parameter (130) of the unavailable content item (HO').
2. The method according to claim 1, wherein determining a replacement digital content item (111) comprises searching among a number of feature parameters (130; 131) of a number of digital content items (110; 111) by comparing said feature parameters (130; 131) with the at least one feature parameter (130) associated with the unavailable digital content item (HO') to locate at least one feature parameter (130; 131) of a digital content item (110; 111) that best matches the at least one feature parameter (130) associated with the unavailable digital content item (HO') according to at least one predetermined criteria, and determining a replacement digital content item (111) as the digital content item (111) being associated with the located at least one feature parameter (131) best matching the at least one feature parameter (130) associated with the unavailable digital content item (HO').
3. The method according to claims 1 - 2, wherein the method further comprises automatically rendering the replacement digital content item (111) instead of the unavailable digital content item (HO').
4. The method according to claims 1 - 3, wherein the at least one feature parameter (130) associated with a digital content item (110; 110'; 111) is a feature vector comprising a plurality of parameters where at least one feature parameter is derived based on the actual content of the digital content item (110; 110'; 111) using a fingerprinting or hash technique so it uniquely identifies the content of the given digital content item (110; 110'; 111).
5. The method according to claims 1 - 4, wherein the at least one feature parameter (130) associated with a given content item (110; 110'; 111) comprises at least one parameter selected from the group of: a parameter representing a timbre of the given content item or segments or windows thereof, a parameter representing a tone quality of the given content item or segments or windows thereof, a parameter representing a tone color of the given content item or segments or windows thereof, a parameter representing an audio feature of the given content item or segments or windows thereof, a parameter representing an acoustic parameter of the given content item or segments or windows thereof, a parameter representing a spectral envelope of the given content item or segments or windows thereof, a parameter representing a time envelope of the given content item or segments or windows thereof, one or more parameters representing one or more of attack, interonset interval, decay, sustain, release and/or transients of the given content item or segments or windows thereof, one or more parameters representing one or more of a short-time signal level, an average signal spectrum, a modulation cepstra, an average power spectrum correlation of the given content item or segments or windows thereof, and one or more parameters representing a sound or signal parameter or characteristic usable for characterizing the given the entire content item or segments or windows thereof.
6. The method according to claims 1 - 5, wherein the feature parameters (130) of a content item (110; 110'; 111) is comprised by a feature vector and said predetermined criteria or said step of determining a replacement digital content item (111) comprises subtracting the feature vector for the unavailable content item (HO') and a feature vector for a potential replacement content item resulting in a result vector, normalizing said result vector giving a scalar size representing a distance between the unavailable content item
(HO') and the potential replacement content item where one or more content items giving a scalar size within a predetermined range is determined as one or more replacement digital content items (111).
7. The method according to claims 1 - 6, wherein the replacement digital content item (111) is equal to the unavailable content item (HO') but being stored at a location different from the location of the unavailable content item (HO').
8. The method according to claims 1 - 7, wherein said check is done automatically or is done upon request from a user.
9. The method according to claims 1 - 8, wherein a play- list (100) is processed in order to determine an integer number of closest matching other content items for each content item (110; 110') of the play-list (100) and storing an identifier or reference to each closest matching content items for each content item in the play-list and when an unavailable content item (110') is encountered looking up the closest matching content items for that particular content item.
10. A device for managing a play- list (100) comprising at least one digital content item (110), where the at least one digital content item (110) belonging to the play-list (100) is associated with at least one feature parameter (130), which has been derived based on the actual digital content item (110) to which it is associated, the device comprising: a processor (202) for checking the availability for rendering of a given digital content item (110) belonging to the play-list (100) before the given digital content item (110) is rendered, and means (202) for obtaining at least one feature parameter (130) associated with the unavailable digital content item (HO') if the check results in that the given digital content item (110) is unavailable for rendering, and a processor (202) for determining a replacement digital content item (111) by comparing at least one feature parameter (130) of other content items (110, 111) with the at least one feature parameter (130) of the unavailable content item (HO').
11. The device according to claim 10, wherein said processor (202) for determining a replacement digital content item (111) is further adapted to search among a number of feature parameters (130; 131) of a number of digital content items (110; 111) by comparing said feature parameters (130; 131) with the at least one feature parameter (130) associated with the unavailable digital content item (HO') to locate at least one feature parameter (130; 131) of a digital content item (110; 111) that best matches the at least one feature parameter (130) associated with the unavailable digital content item (HO') according to at least one predetermined criteria, and determine a replacement digital content item (111) as the digital content item (111) being associated with the located at least one feature parameter (131) best matching the at least one feature parameter (130) associated with the unavailable digital content item (HO').
12. The device according to claims 10 - 11, wherein the device further comprises a render (202) for automatically rendering the replacement digital content item (111) instead of the unavailable digital content item (HO').
13. The device according to claims 10 - 12, wherein the at least one feature parameter (130) associated with a digital content item (110; 110'; 111) is a feature vector comprising a plurality of parameters where at least one feature parameter is derived based on the actual content of the digital content item (110; 110'; 111) using a fingerprinting or hash technique so it uniquely identifies the content of the given digital content item (110; 110'; 111).
14. The device according to claims 10 - 13, wherein the at least one feature parameter (130) associated with a given content item (110; 110'; 111) comprises at least one parameter selected from the group of: a parameter representing a timbre of the given content item or segments or windows thereof, a parameter representing a tone quality of the given content item or segments or windows thereof, a parameter representing a tone color of the given content item or segments or windows thereof, a parameter representing an audio feature of the given content item or segments or windows thereof, a parameter representing an acoustic parameter of the given content item or segments or windows thereof, a parameter representing a spectral envelope of the given content item or segments or windows thereof, a parameter representing a time envelope of the given content item or segments or windows thereof, one or more parameters representing one or more of attack, interonset interval, decay, sustain, release and/or transients of the given content item or segments or windows thereof, one or more parameters representing one or more of a short-time signal level, an average signal spectrum, a modulation cepstra, an average power spectrum correlation of the given content item or segments or windows thereof, and one or more parameters representing a sound or signal parameter or characteristic usable for characterizing the given the entire content item or segments or windows thereof.
15. The device according to claims 10 - 14, wherein the feature parameters (130) of a content item (110; 110'; 111) is comprised by a feature vector and said predetermined criteria comprises or said processor (202) for determining a replacement digital content item (111) is adapted to subtract the feature vector for the unavailable content item (HO') and a feature vector for a potential replacement content item resulting in a result vector, normalize said result vector giving a scalar size representing a distance between the unavailable content item (HO') and the potential replacement content item where one or more content items giving a scalar size within a predetermined range is determined as one or more replacement digital content items (111).
16. The device according to claims 10 - 15, wherein the replacement digital content item (111) is equal to the unavailable content item (HO') but being stored at a location different from the location of the unavailable content item (HO').
17. The device according to claims 10 - 16, wherein said check is done automatically or is done upon request from a user.
18. The device according to claims 10 - 17, wherein the processor (202) is adapted to process a play- list (100) in order to determine an integer number of closest matching other content items for each content item (110; 110') of the play-list (100) and store an identifier or reference to each closest matching content items for each content item in the play-list and when an unavailable content item (HO') is encountered to look up the closest matching content items for that particular content item.
19. A computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to any one of claims 1 - 8.
PCT/IB2007/052578 2006-07-06 2007-07-03 Methods and devices for managing a play-list of digital content WO2008004181A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP06116692.2 2006-07-06
EP06116692 2006-07-06

Publications (2)

Publication Number Publication Date
WO2008004181A2 true WO2008004181A2 (en) 2008-01-10
WO2008004181A3 WO2008004181A3 (en) 2008-05-29

Family

ID=38894965

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2007/052578 WO2008004181A2 (en) 2006-07-06 2007-07-03 Methods and devices for managing a play-list of digital content

Country Status (1)

Country Link
WO (1) WO2008004181A2 (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110119293A1 (en) * 2009-10-21 2011-05-19 Randy Gilbert Taylor Method And System For Reverse Pattern Recognition Matching
EP2334059A1 (en) * 2009-11-19 2011-06-15 Robert Bosch GmbH Entertainment system smart keys
US8688253B2 (en) 2010-05-04 2014-04-01 Soundhound, Inc. Systems and methods for sound recognition
US8694537B2 (en) 2010-07-29 2014-04-08 Soundhound, Inc. Systems and methods for enabling natural language processing
US8694534B2 (en) 2010-07-29 2014-04-08 Soundhound, Inc. Systems and methods for searching databases by sound input
US8856148B1 (en) * 2009-11-18 2014-10-07 Soundhound, Inc. Systems and methods for determining underplayed and overplayed items
WO2015006226A1 (en) 2013-07-09 2015-01-15 Sonos, Inc. Systems and methods to provide play/pause content
US9390167B2 (en) 2010-07-29 2016-07-12 Soundhound, Inc. System and methods for continuous audio matching
WO2016109553A3 (en) * 2015-01-02 2016-08-25 Gracenote, Inc. Machine-led mood change
CN105915965A (en) * 2016-04-15 2016-08-31 无锡天脉聚源传媒科技有限公司 Broadcasting list checking method and apparatus
US9507849B2 (en) 2013-11-28 2016-11-29 Soundhound, Inc. Method for combining a query and a communication command in a natural language computer system
US9564123B1 (en) 2014-05-12 2017-02-07 Soundhound, Inc. Method and system for building an integrated user profile
US9788777B1 (en) 2013-08-12 2017-10-17 The Neilsen Company (US), LLC Methods and apparatus to identify a mood of media
US10121165B1 (en) 2011-05-10 2018-11-06 Soundhound, Inc. System and method for targeting content based on identified audio and multimedia
WO2018220735A1 (en) 2017-05-31 2018-12-06 三菱電機株式会社 Current blocking element and ozone generation device
US10200749B2 (en) 2008-04-10 2019-02-05 Gvbb Holdings S.A.R.L. Method and apparatus for content replacement in live production
US10957310B1 (en) 2012-07-23 2021-03-23 Soundhound, Inc. Integrated programming framework for speech and text understanding with meaning parsing
US11295730B1 (en) 2014-02-27 2022-04-05 Soundhound, Inc. Using phonetic variants in a local context to improve natural language understanding

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050021500A1 (en) * 2002-03-21 2005-01-27 Microsoft Corporation Methods and systems for repairing playlists
EP1515340A1 (en) * 2003-09-15 2005-03-16 Microsoft Corporation System and method for creating and playing globally relevant playlists
US6993532B1 (en) * 2001-05-30 2006-01-31 Microsoft Corporation Auto playlist generator
WO2006050731A2 (en) * 2004-11-09 2006-05-18 Bang & Olufsen A/S A procedure and apparatus for generating automatic replay of recordings

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6993532B1 (en) * 2001-05-30 2006-01-31 Microsoft Corporation Auto playlist generator
US20050021500A1 (en) * 2002-03-21 2005-01-27 Microsoft Corporation Methods and systems for repairing playlists
EP1515340A1 (en) * 2003-09-15 2005-03-16 Microsoft Corporation System and method for creating and playing globally relevant playlists
WO2006050731A2 (en) * 2004-11-09 2006-05-18 Bang & Olufsen A/S A procedure and apparatus for generating automatic replay of recordings

Cited By (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10200749B2 (en) 2008-04-10 2019-02-05 Gvbb Holdings S.A.R.L. Method and apparatus for content replacement in live production
US20110119293A1 (en) * 2009-10-21 2011-05-19 Randy Gilbert Taylor Method And System For Reverse Pattern Recognition Matching
US8856148B1 (en) * 2009-11-18 2014-10-07 Soundhound, Inc. Systems and methods for determining underplayed and overplayed items
EP2334059A1 (en) * 2009-11-19 2011-06-15 Robert Bosch GmbH Entertainment system smart keys
US9280598B2 (en) 2010-05-04 2016-03-08 Soundhound, Inc. Systems and methods for sound recognition
US8688253B2 (en) 2010-05-04 2014-04-01 Soundhound, Inc. Systems and methods for sound recognition
US9390167B2 (en) 2010-07-29 2016-07-12 Soundhound, Inc. System and methods for continuous audio matching
US10055490B2 (en) 2010-07-29 2018-08-21 Soundhound, Inc. System and methods for continuous audio matching
US10657174B2 (en) 2010-07-29 2020-05-19 Soundhound, Inc. Systems and methods for providing identification information in response to an audio segment
US8694534B2 (en) 2010-07-29 2014-04-08 Soundhound, Inc. Systems and methods for searching databases by sound input
US8694537B2 (en) 2010-07-29 2014-04-08 Soundhound, Inc. Systems and methods for enabling natural language processing
US10832287B2 (en) 2011-05-10 2020-11-10 Soundhound, Inc. Promotional content targeting based on recognized audio
US10121165B1 (en) 2011-05-10 2018-11-06 Soundhound, Inc. System and method for targeting content based on identified audio and multimedia
US11776533B2 (en) 2012-07-23 2023-10-03 Soundhound, Inc. Building a natural language understanding application using a received electronic record containing programming code including an interpret-block, an interpret-statement, a pattern expression and an action statement
US10996931B1 (en) 2012-07-23 2021-05-04 Soundhound, Inc. Integrated programming framework for speech and text understanding with block and statement structure
US10957310B1 (en) 2012-07-23 2021-03-23 Soundhound, Inc. Integrated programming framework for speech and text understanding with meaning parsing
US10114606B1 (en) 2013-07-09 2018-10-30 Sonos, Inc. Providing media for playback
JP2016532889A (en) * 2013-07-09 2016-10-20 ソノズ インコーポレイテッド System and method for playing / pausing content
US11809779B2 (en) 2013-07-09 2023-11-07 Sonos, Inc. Providing media for playback
WO2015006226A1 (en) 2013-07-09 2015-01-15 Sonos, Inc. Systems and methods to provide play/pause content
US20220253271A1 (en) * 2013-07-09 2022-08-11 Sonos, Inc. Providing Media for Playback
US11169768B2 (en) 2013-07-09 2021-11-09 Sonos, Inc. Providing media for playback
US10740061B2 (en) 2013-07-09 2020-08-11 Sonos, Inc. Providing media for playback
US9788777B1 (en) 2013-08-12 2017-10-17 The Neilsen Company (US), LLC Methods and apparatus to identify a mood of media
US11357431B2 (en) 2013-08-12 2022-06-14 The Nielsen Company (Us), Llc Methods and apparatus to identify a mood of media
US10806388B2 (en) 2013-08-12 2020-10-20 The Nielsen Company (Us), Llc Methods and apparatus to identify a mood of media
US9507849B2 (en) 2013-11-28 2016-11-29 Soundhound, Inc. Method for combining a query and a communication command in a natural language computer system
US11295730B1 (en) 2014-02-27 2022-04-05 Soundhound, Inc. Using phonetic variants in a local context to improve natural language understanding
US11030993B2 (en) 2014-05-12 2021-06-08 Soundhound, Inc. Advertisement selection by linguistic classification
US10311858B1 (en) 2014-05-12 2019-06-04 Soundhound, Inc. Method and system for building an integrated user profile
US9564123B1 (en) 2014-05-12 2017-02-07 Soundhound, Inc. Method and system for building an integrated user profile
WO2016109553A3 (en) * 2015-01-02 2016-08-25 Gracenote, Inc. Machine-led mood change
US10613821B2 (en) 2015-01-02 2020-04-07 Gracenote, Inc. Machine-led mood change
US10048931B2 (en) 2015-01-02 2018-08-14 Gracenote, Inc. Machine-led mood change
US11513760B2 (en) 2015-01-02 2022-11-29 Gracenote, Inc. Machine-led mood change
US9792084B2 (en) 2015-01-02 2017-10-17 Gracenote, Inc. Machine-led mood change
US11853645B2 (en) 2015-01-02 2023-12-26 Gracenote, Inc. Machine-led mood change
CN105915965A (en) * 2016-04-15 2016-08-31 无锡天脉聚源传媒科技有限公司 Broadcasting list checking method and apparatus
WO2018220735A1 (en) 2017-05-31 2018-12-06 三菱電機株式会社 Current blocking element and ozone generation device

Also Published As

Publication number Publication date
WO2008004181A3 (en) 2008-05-29

Similar Documents

Publication Publication Date Title
WO2008004181A2 (en) Methods and devices for managing a play-list of digital content
US8886531B2 (en) Apparatus and method for generating an audio fingerprint and using a two-stage query
US8352259B2 (en) Methods and apparatus for audio recognition
US7650563B2 (en) Aggregating metadata for media content from multiple devices
US7921116B2 (en) Highly meaningful multimedia metadata creation and associations
US7546288B2 (en) Matching media file metadata to standardized metadata
JP4398242B2 (en) Multi-stage identification method for recording
US7451078B2 (en) Methods and apparatus for identifying media objects
US8346801B2 (en) Context based video finder
US20110173185A1 (en) Multi-stage lookup for rolling audio recognition
US20140280304A1 (en) Matching versions of a known song to an unknown song
EP1728195A1 (en) Method and system for semantically segmenting scenes of a video sequence
US8751494B2 (en) Constructing album data using discrete track data from multiple sources
WO2007001607A2 (en) Creating standardized playlists and maintaining coherency
KR101942459B1 (en) Method and system for generating playlist using sound source content and meta information
Allik et al. Musiclynx: Exploring music through artist similarity graphs
CN114661939A (en) Song matching method, medium, device and computing equipment
EP1531405A1 (en) Information search apparatus, information search method, and information recording medium on which information search program is recorded
KR20050003457A (en) Signal processing method and arrangement
KR100916310B1 (en) System and Method for recommendation of music and moving video based on audio signal processing
KR101002732B1 (en) Online digital contents management system
JP2009147775A (en) Program reproduction method, apparatus, program, and medium
Kuznetsov et al. Searching for music: from melodies in mind to the resources on the web
KR100838208B1 (en) Multimedia Contents Providing Server and Method for Providing Metadata, and Webhard Server and Method for Managing Files using the Metadata
Brinkman et al. Online music recognition: the Echoprint system

Legal Events

Date Code Title Description
NENP Non-entry into the national phase in:

Ref country code: DE

NENP Non-entry into the national phase in:

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 07825876

Country of ref document: EP

Kind code of ref document: A2