WO2011148054A1

WO2011148054A1 - User interface for media device

Info

Publication number: WO2011148054A1
Application number: PCT/FI2011/050472
Authority: WO
Inventors: Harri Pekonen; Teemu Johannes Pakarinen
Original assignee: Axel Technologies
Priority date: 2010-05-25
Filing date: 2011-05-24
Publication date: 2011-12-01
Also published as: FI20105574A0

Abstract

A user interface for a media device for: determining a present context of a media usage application; determining search terms based on metadata related to media items that are available within the present context; forming a search criteria collection comprising a plurality of search criteria from the determined search terms; graphically displaying the search criteria collection to a user; allowing the user to select desired search criteria; detecting user selection of a search criterion in the search criteria collection and responsively after each selection of a search criterion updating the search criteria collection such that the search criteria in the updated search criteria collection match with all the selected search criteria; and searching for media items that are available within the present context to filter media items the metadata of which matches with the selected search criteria.

Description

USER INTERFACE FOR MEDIA DEVICE

TECHNICAL FIELD

The present invention generally relates to a user interface for a media device. The invention relates particularly, though not exclusively, to a user interface of mobile television with a touch display.

BACKGROUND ART

Television sets have become increasingly intelligent appliances. Some television sets featu re record ing , electron ic prog ram g u ide and even time sh ifting capabilities. On the other hand, similar features are being provided for mobile devices such as portable television receivers and dedicated portable television sets. Moreover, other sources of media are also being used for rendering media to a user by various media devices. However, the portable devices in particular may suffer from restricted display size such that typical menu based access to various functions and operations may appear laborious and unintuitive. This problem is further accented by the increasing number of new functions and decreasing size of mobile televisions or media devices in general. Hence, it is an object of the invention to further enhance the user interface of media devices.

SUMMARY

According to a first aspect of the invention there is provided a method comprising: determining a present context of a media usage application;

determining search terms based on metadata related to media items that are available within the present context;

forming a search criteria collection comprising a plurality of search criteria from the determined search terms;

graphically displaying the search criteria collection to a user;

allowing the user to select desired search criteria;

detecting user selection of a search criterion in the search criteria collection and responsively after each selection of a search criterion updating the search criteria collection such that the search criteria in the updated search criteria collection match with all the selected search criteria; and searching for media items that are available within the present context to filter media items the metadata of which matches with the selected search criteria.

Advantageously, the method may enable performing context-sensitive searches without need to type search words. Moreover, by automatically adapting the search criteria collection, the search may rapidly be focused to media items desired by the user.

The determining of the present context may involve determining a broadcast context in which broadcast media items are being defaulted to content source.

The determining of the present context may involve determining a streaming context in which streaming media items are being defaulted to content source. The determining of the present context may involve determining a cable context in which cable television media items are being defaulted to content source.

The method may further comprise selecting one or more alternative content sources of med ia items. Advantageously, when checking other television programs while watching terrestrial TV, the user may quickly expand or shift the search to other media sources.

The method may further comprise determining one or more attributes related to presently consumed media content and determining the present context using said one or more attributes. The attributes may relate to metadata items, genres and content sources.

The method may further comprise allowing the user to define a group of search criteria for producing a representative single Boolean value for combining with one or more other search criteria or groups of search criteria. Advantageously, the method may allow forming powerful searches by combining cond itions related to two or more d ifferent search criteria into a sing l e representative Boolean value. The method may further comprise modifying search conditions that link different search criteria together. The search conditions may comprise one or more of the following: AND; NOT; OR; NEAR; XOR (exclusive OR).

Advantageously, the search may be easily and intuitively modified by the user. The modification of the search may be implemented by selecting again a selected search criterion and cycling associated search condition through a set of different alternatives for the search condition.

The method may further comprise removing a given search criterion from the selected search criteria by selecting said given search criterion again . The removing may be performed when the search condition has been selected again so many times that all the available search conditions have been cycled through.

The method may further comprise additionally searching for media items that are available within the present context to filter media items the metadata of which matches at least partially with the selected search criteria. The add itional searching may be carried out simultaneously with the searching for media items that are available within the present context to filter media items the metadata of which matches with the selected search criteria. The results (or their subset) of the additional searching may be presented on or after presenting the results of the searching for media items that are available within the present context to filter media items the metadata of which matches with the selected search criteria.

According to a second aspect of the invention there is provided an apparatus configured to perform a method according to the first aspect of the invention. The apparatus may be configured to perform any embodiment of the first aspect. According to a third aspect of the invention there is provided a computer program configured to cause a computer, when performing the computer program, to perform a method according to the first aspect of the invention. The computer program may be configured to cause the computer to perform any embodiment of the first aspect.

According to a third aspect of the invention there is provided a memory medium carrying any foregoing computer program. The memory medium may comprise a digital data storage such as a data disc or diskette, optical storage, magnetic storage, holographic storage, opto-magnetic storage, phase-change memory, resistive random access memory, magnetic random access memory, solid-electrolyte memory, ferroelectric random access memory, organic memory or polymer memory. The memory medium may be formed into a device without other substantial functions than storing memory or it may be formed as part of a device with other functions, including but not limited to a memory of a computer, a chip set, and a sub assembly of an electronic device.

Different non-binding aspects and embodiments of the present invention have been illustrated in the foregoing. The above embodiments are used merely to explain selected aspects or steps that may be utilized in implementations of the present invention. Some embodiments may be presented only with reference to certain aspects of the invention. It should be appreciated that corresponding embodiments may apply to other aspects as well.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described, by way of example only, with reference to the accompanying drawings, in which: Figs. 1 .1 to 1 .6 show a set of different drawings illustrating different screens and acts by a user in a use case according to a first example of the invention; Figs. 2.1 to 2.8 show a set of different drawings illustrating different screens and acts by a user in a use case according to a second example of the invention;

Figs. 3.1 to 3.6 show a set of different drawings illustrating different screens and acts by a user in a use case according to a third example of the invention;

Figs. 4.1 to 4.4 show a set of different drawings illustrating different screens and acts by a user in a use case according to a first example of the invention;

Figs. 5.1 and 5.2 show a set of different drawings illustrating different screens and acts by a user in a use case according to a fifth example of the invention; and

Fig. 6 shows a schematic drawing of a mobile media device according to an embodiment of the invention.

DETAILED DESCRIPTION

In the following description, like numbers denote like elements.

This description discloses various embodiments of the invention. The description uses only for illustration an example apparatus a mobile media device with a touch screen and also with a television receiver or more decoder. It is appreciated that other input methods are likewise applicable for use, such as input methods as the following: computer mouse, multi-touch track pad, keyboard and remote controller.

Moreover, it is not intended to restrict the invention to mobile media devices: to the contrary, embodiments of the invention exist in which a desktop computer, set top box, television set, game console or other fixed applicance or home appliance is used to provide one or more features of the invention.

Numerous different embodiments are explained here in connection with one another solely to demonstrate at least one way in which these embodiments can interwork without intention to restrict the invention to use of all or any of these embodiments. Instead, each of these embodiments is intended to serve as an invention for this patent application or any continuation or divisional application. In this document, the term television decoder is intended to cover both television broadcast signal reception (and decoding) devices for cable, terrestrial or satellite networks as well as packet data and other distribution networks provided media reception.

Fig. 6 shows a schematic drawing of a mobile media device 100 according to an embodiment of the invention. The mobile media device 100 comprises an antenna connection 1 10 that either is configured for coupling with an antenna connector or is connected with a mobile antenna . The mobile media device 100 further comprises a display 120, a memory 130 comprising work memory 140 and nonvolatile memory 150 with computer executable program code 160. The mobile media device 100 further comprises a television decoder or receiver 170, a user input device 180 and a processor 190 configured to control operation of the mobile media device 100 according to the program code 160 by executing the program code in place in the non-volatile memory 150 or in the work memory 140. The user input device 1 80 may comprise dedicated parts such as one or more keys, a cursor control device or the like, or the user input device 180 may be formed using the display 120 if the display 120 is a touch display.

The mobile media device 100 may be, for instance, a portable television, game device, mobile phone, personal digital assistant, or a navigation device.

The inventors have realized that when the amount of available audio and video content is large, the user may not easily find the things he is looking for by just browsing. Moreover, entry of text with small media devices is also often challenging because of lack of a proper keyboard. For instance, many devices that have a touch screen user interface are lacking keyboards but instead sport virtual keyboards that are displayed on-screen.

It is next described how using a sophisticated search functionality the user may easily find available desired content. This search functionality provides the user with ability to gather information of the context in which the user invoked the search and to propose different context-sensitive search criteria (e.g. search key strings) to the user. This search functionality provides the user with ability to modify the proposed search criteria by adding search criteria, removing search criteria and changing search conditions (such as Boolean operators) that are applied to combine the search criteria.

In the following example, a graphical user interface (G U I ) is used with an advantage of ease of use to modify search criteria. The GUI has a presentation output for show to the user context related keywords which include pre-selected criteria and other criteria (or criterion) which the user may add to the search criteria.

USE CASE EXAMPLES

Use case 1 : sci-fi tonight

The user desires to check if there will be a sci-fi movie broadcasted tonight. This use case is described in the following with reference to Figs. 1 .1 to 1 .6.

1 .1 . The user opens a search view from a media management application - initial keywords 102 are shown to the user in a criteria collection. Fig. 1 .1 illustrates step 1 .1 . This is the initial view for a search window 101 . The keywords 102 as well as genres 103 and content sources 104 are selected based on existing data and user viewing habits. With shown keywords, it is guaranteed to be found at least one result. At least one content source 104 has to be selected in this particular embod iment. Here the broadcast content source has been automatically selected. In other words, in this phase, a present context of a media usage application is determined, search criteria are formed and displayed to the user.

1 .2. The user selects desired program genres 103. The selected genres form part of search criteria and the keywords in the criteria collection are updated based on the selected one or more genres. The user has selected one genre (sci-fi) wh ich is then identified by highlight. As content source, broadcasting has been selected by the user or automatically based on the determined present context. In response to the selection of a search criterion (the genre), the keywords in the criteria collection are automatically updated, based on the selected genre and content source.

In response, remaining keywords in the criteria collection are updated based on the user keyword selection. New keywords are shown in the collection of criteria. At this point, all the shown keywords match with selected search criteria "sci-fi" and "broadcast". All of the d isplayed keywords are extracted from available content items e.g. by looking into program guide data or other available metadata. It is appreciated that selecting either of the desired program genre 103 or desired keywords 102 may correspond to selecting by the user of desired search criteria.

The user selects the desired keywords 102. The user selects keywords "Star" and "Galactica". The other keywords of the criteria collection are automatically updated.

The user desires to conduct a search using the selected criteria. The available content is searched by checking metadata of each content item among a plurality of different content items and then a hit l ist will be produced indicative of found contents and displayed to the user. All the shown keywords match to the search criteria "sci-fi", "broadcast". All the shown keywords and also related to the selected further criteria i .e. keywords "Star" and "Galactica". The user is happy with these search options and selects "Search" 105.

A hit list 1 06 is shown in result of searching with the selected search criteria. If the user is not happy with the results, the user may try changing the search criteria and performing the search again. The search results are shown to the user. A back-key 107 may be provided for the user so that if the user is not satisfied with the results, the user can go back and refine the search options using the back-key. Alternatively, or additionally, the user may edit the selected criteria.

The previously presented first use case exemplified how few keystrokes may suffice to identify desired content item. Moreover, the user need not remember exact keywords by heart as he is provided with different alternatives to choose from. Further advantageously, there is no need to tap in entire words for use in the search so that also problems caused by typographic errors may be avoided simultaneously with accelerating the search process.

Use case 2: context related search

This use case relates to a case in which the user wants to see what else there is to see related to a user-selected program such as the program being presented or the program for which the user has invoked an information display. In this use case it is shown that keywords are updated every time user modifies search criteria. Another alternative is to maintain a static list of keywords. This alternative may suit in cases where the user sees several valid keywords and wants add them all into search criteria. In order to temporarily freeze the search criteria selection i.e. the keyword list, the user may use a corresponding control or enter individual selections in a manner that is indicative of the desire to avoid adapting of the remaining search criteria. For instance, the user may tap and hold for a while an item in order to avoid changing the remaining search criteria, or tap the screen with many fingers (e.g. on two or more different sides about the criteria selection). An example of this use case is presented in the following with reference to illustrative Figs. 2.1 ...2.8:

2.1 . The user has program event info 201 displayed, user selects search.

2.2. The search window 101 with keywords, and preselected genres and content source based on current event is shown.

2.3. The user adds also streaming sites to the search options by tapping on this option among the shown alternatives in the sources group 104.

2.4. Search view updates the keywords based on data received from streaming media sites.

2.5. Updated keywords 102 are shown.

2.6. The user selects two keywords 102 "Flashforward" and "teaser", and keywords are updated automatically.

2.7. The user selects "Search" 105.

2.8. The search result view 202 is shown with programs matching to genre "Sci- fi" and "action" and are from content sources "broadcast" and "streaming" and contain keywords "Flashforward" and "teaser".

Use case 3: Advanced criteria editing

This use case relates to a case in wh ich the user wants to change the way in which the selected search criteria are combined by grouping some search criteria and by excluding some keywords. This use case presents features similar to using parenthesis marks in text-based Boolean search. In the following, a process is explained with reference to Figs. 3.1 to 3.6:

3.1 . The user has in itiated search and has a search window 301 with a collection of search criteria some of which have been selected, genres and content source based on current event. The selected search criteria are shown as search terms combined by AND function in a search term field 302.

3.2. The user taps to end of the search criteria area as an indication of a desire to modify the search criteria by adding parentheses to the proposed search criteria. In response, parentheses are added around the selected search criteria in the search term field 302.

3.3. The user selects a further keyword 303 from the keyword collection by tapping that word. The selected further keyword 303 is appended to the search criteria with a Boolean operator "AND" in the search term field 302.

3.4. The user taps once more the further keyword 303 in order to change the Boolean operator that links this keyword to the search criteria. In response, the Boolean operator that links this further keyword to other selected keywords is changed to OR operator.

3.5. The user taps the further keyword 303 once more so that the Boolean operator is changed to NOT. The user is happy with this choice of Boolean operator. If the user tapped fourth time on a given keyword (e.g. on the further keyword), that keyword would be removed from the selected keywords.

3.6. The user desires to change the search criteria so that the Boolean operator between two keywords within the parentheses would be connected by the Boolean operator OR. The user taps once the latter of these keywords. In response, the latter keyword (Scientists in this example) is tapped and the Boolean operator between the two selected search terms in parentheses is changed. In one further example, the tapped search term is moved to the end of the selected search terms within its nesting level (in parentheses or if outside parentheses, then to the last search term in the list outside the parentheses). Using the example of the starting state of Fig. 3.6, if the user taps again the search term Flashforward, then that term is moved to be the latter search term (in read ing direction , accounting for such cultural customization). The previously present Boolean operator AND is removed, and the following Boolean operator OR is inserted before the moved search term.

Use case 4: Results view

This use case starts from the state in which the user has completed search for content items and a results window 202 shows the found items.

4.1 . The user desires to see more information of the first item, so he taps the screen on the first item area. Some related action buttons are also shown to the user, such as Record 401 , Recommend 402, Remind 403 and/or set favourite 404.

4.2. The user desires to see more information of the third item, so he taps that item or an area about that item that is associated to that item.

4.3. The user desires to set reminder for third item, so he taps the shown reminder button 403. In response, a dialog 405 about the taken action is shown for the user. The dialog may be produced e.g. by presenting to the user a callout that provides a response to the user about the taken action.

The callout may disappear automatically. Alternatively, the callout may be closed by using a particular closing control or by tapping outside the callout.

4.4. The user decides to start watching first item, so he taps and holds it.

Content 406 of the selected item is rendered for the user.

Use case 5: Automatically updating search results

In large and high resolution devices, the search results and criteria may be displayed simultaneously e.g. in single combination window 501 . In th is case search results may be updated every time user modifies the selected search criteria.

5.1 . The user has opened the combination window 501 and has some search criteria selected. Related results are shown in response to the selecting of the search criteria. The user further modifies the selected search criteria.

5.2. After the selected search criteria have been modified, the displayed search results are automatically updated correspondingly in the combination window 501 .

MISCELLANEOUS FURTHER EMBODIMENTS

Some further examples of different alternatives and options involve the possibility to add day or date criteria such as search today, this week, given date or date range; using of parental guidance rating as a search criterion, and using keywords other than contextually related words, such as recently used or frequently used search criteria. Moreover, various implementations have been designed such as grouping of the search criteria of different types (Related, Last, Most used, etc.) on different tabs; indicating the Boolean operator used with each of the selected search criteria by associated appearance (hatch, color, font appearance etc), displaying of a legend that illustrates which Boolean operator is associated with each of the selected search criteria; and providing a list of different content types for use as search criteria. Moreover, the search criteria or a subset of the search criteria (such as the genre, type and/or source) may be presenting with scrolling controls so that a portion of the search criteria is logically outside the presently displayed area. Further still, the search with the search criteria may comprise two parts, including a first part in which it is searched for media items with metadata that matches with the search criteria, and a second part, in which it is searched for media items with metadata that partially matches with the search criteria. The second part of the search may be carried out simultaneously with the first part, or separately from the first part. For instance, the second part of the search may be carried out on ly if th e n umber of matching media items is lower than a predetermined lower threshold so that the user can then be presented with a desired number of media items. The number of media items searched and / or presented for the second part may be defined using a) a constant amount, b) based on their matching rate (percentage of similarity with search criteria), c) total number of media items when counting also the found media items of the first part, or d) any combination of the options a) to c).

Various embodiments have been presented. It should be appreciated that in this document, words comprise, include and contain are each used as open-ended expressions with no intended exclusivity.

The foregoing description has provided by way of non-limiting examples of particular implementations and embodiments of the invention a full and informative description of the best mode presently contemplated by the inventors for carrying out the invention. It is however clear to a person skilled in the art that the invention is not restricted to details of the embodiments presented above, but that it can be implemented in other embod iments using equ ivalent means or in d ifferent combinations of embodiments without deviating from the characteristics of the invention.

Furthermore, some of the features of the above-disclosed embodiments of this invention may be used to advantage without the corresponding use of other features. As such, the foregoing description shall be considered as merely illustrative of the principles of the present invention, and not in limitation thereof. Hence, the scope of the invention is only restricted by the appended patent claims.

Claims

Claims:

A method comprising:

determining a present context of a media usage application;

graphically displaying the search criteria collection to a user;

allowing the user to select desired search criteria;

detecting user selection of a search criterion in the search criteria collection and responsively after each selection of a search criterion updating the search criteria collection such that the search criteria in the updated search criteria collection match with all the selected search criteria; and

searching for media items that are available within the present context to filter media items the metadata of which matches with the selected search criteria.

The method of claim 1 , wherein the determining of the present context involves determining a present content source context in which present content source is defaulted to content source.

The method of claim 2, wherein the determining of the present context is based on the metadata of a currently selected program.

The method of claim 2 or 3, wherein the determining of the present context involves determining presently available content sources and defaulting to the content source the presently available content sources. 5. The method of any one of the preceding claims, wherein the method further comprises selecting one or more alternative content sources of media items.

6. The method of any one of the preceding claims, wherein the method further comprises determining one or more attributes related to presently consumed media content and determining the present context using said one or more attributes.

7. The method of any one of the preceding claims, wherein the method further comprises allowing the user to define a group of search criteria for producing a representative single Boolean value for combining with one or more other search criteria or groups of search criteria.

8. The method of any one of the preceding claims, wherein the method further comprises modifying search cond itions that l in k different search criteria together. 9. An apparatus comprising a memory comprising operating instructions and a processor configured to cause the apparatus to perform according to the operating instructions the method accord ing to any one of the preceding claims. 10. A computer executable program comprising computer executable program code configured to cause a program, when executing the program code, to perform the method according to any one of the claims 1 to 8.