WO2003063474A1

WO2003063474A1 - Sequenced icons, and systems and methods for using same

Info

Publication number: WO2003063474A1
Application number: PCT/US2002/000418
Authority: WO
Inventors: Ratha Reth
Original assignee: Ub Port, Inc.
Priority date: 2002-01-08
Filing date: 2002-01-08
Publication date: 2003-07-31

Abstract

Computer display icons include are associated with sequencing designations, and are positioned on a display in a visually recognizable order corresponding to the respective sequencing designations. Sequencing designations can be numeric, alphabetic, or have some other recognizable order. Icons sequenced in this manner can be used to trigger a software application, or operation of a function of a peripheral device. A remote control handset can include a microphone, and can be used as the handset of a telephone or e-phone. The microphone is preferably used in conjunction with software to recognize voice commands, and especially voice intonations of the sequencing designations associated with the icons. A security device reader can be used to limit access to icons, contents of local or distal storage, web sites, and so forth. A preferred embodiment provides an interface layer for applications software that standardizes and simplifies access to functionality using sequenced icons.

Description

SEQUENCED ICONS, AND SYSTEMS

AND METHODS FOR USING SAME

Field of the Invention

The field of the invention is controllers for interactive television systems.

Background of the Invention

Televisions are self-contained units that include a radio signal receiver to receive audio and image information, a screen in the form of a cathode ray tube, a speaker, and control buttons or knobs to select channels, control image characteristics, and control the audio output level. Many television sets are equipped to cooperate with hand-held remote controls that allow a viewer to operate the television from a distance of several feet. Many television sets also have video input ports that receive input from video/DVD players, and that cooperate with cable demodulation boxes.

Early personal computers frequently utilized a television screen as the computer display. The resolution was extremely poor, however, and such usage gave way to higher resolution dedicated computer monitors. When digital television became available, it once again became practical to utilize a television screen as the display for a computer. The much-publicized interactive television concept attempts to marry television and computing, usually with a "set top box" computer coupled to a digital television.

The name "set top box" is somewhat of a misnomer because the computer portion need not be physically located on top of the television set, and indeed is often positioned to the side of, below, or even within the housing of a television set. Moreover, set top boxes do not need to have a separate housing at all, and certainly do not need to have a boxy housing.

The more accurate term for a set-top box would be a "television controller". The key feature that distinguishes a television controller from a PC or other computer that can receive and display television images accessed via Internet is that a television controller cooperates with a television set rather than a dedicated computer monitor. The term Internet is used herein as a euphemism for any public package switched network.

One of the advantages of using a television controller is that the television screen can be used for both (a) viewing television programming and (b) operating standard computer applications. Thus, a user may choose to use the television controller and the television screen to "surf the Internet, operate a word processing or spreadsheet program, or place an Internet phone call. Interaction with many such applications is commonly handled with a keyboard, and several wireless keyboards are now available that facilitate just such operations.

5 In many instances, however, it is not especially desirable to employ a full QWERTY or other text-based keyboard to operate a television. Certainly changing television channels and altering the audio volume does not require a full keyboard. Indeed, hand-held remotes are already on the market that can cooperate with a television controller to navigate and select among icons when using the television screen as a computer display. Some of these remotes are

.0 quite sophisticated, having numerous specialized keys, and even a built-in trackball.

Nevertheless, a continuing problem is that hand-held remotes that omit text keys can be quite difficult to use in navigating computer applications designed for text-based keyboards. One problem is that computer icons can be located anywhere on a display, and in any order. They are designed to be accessed in an analog manner, i.e., by "moving" a cursor across a L5 display using an analog selection device such as a mouse, track point button, or similar device. For these reasons it can be difficult to select a specific icon using known hand-held remotes. Even where cursor movement control is relatively easy, the freeform placement of icons on a display can make some icons difficult to locate and select.

Another problem is that the many thousands of known applications are inconsistent with 10 each other in their presentations and operations. Different video mail applications, for example, usually access the stop, forward, and rewind functions using different keystrokes. The inconsistent interfaces mean that users familiar with one software package typically still need to learn anew how to access another software package for the same type of operation.

Thus, there is a continuing need to provide systems and methods that simplify and 5 standardize presentation and access to icons, and functions that are represented by such icons.

Summary of the Invention

The present invention provides apparatus and methods in which a controller operates a television receiver and a display, where the display displays at least three icons, each of which has a sequencing designation logically independent from any descriptive name or symbol, and 0 all of which are positioned on the display in a visually recognizable order corresponding to the respective sequencing designations. Preferred sequencing designations are sequential, such as 1, 2, 3, 4 etc, or red, orange, yellow, green, blue, etc. Preferred icons trigger a software application, or operation of a function of a peripheral device, which may include any record, stop, play, rewind, fast forward, change disk, change track, answer, dial, save number, access number, change channel, volume up, volume down, picture within picture, select channel, start time, stop time, and duration.

A remote control handset can communicate with the controller using a wireless connection. Preferred handsets include at least a microphone, and more preferably a speaker. The microphone is preferably used in conjunction with software to recognize voice commands, and especially voice intonations of the sequencing designations associated with the icons. The handset can also be used as a telephone to make calls through HPNA or other electronics employed by the controller.

A security device reader can cooperate with software to limit access in some manner. For example, access can be limited to one or more icons, to contents of local or distal storage, web sites, and so forth.

A preferred embodiment provides an interface layer for applications software that standardizes and simplifies access to functionality using sequenced icons. In that manner, the same play, stop, fast forward, and rewind display icons, numbered 1, 2, 3, and 4, respectively, could be used to control those functions for multiple different software and hardware configurations, such as DND and NCR devices.

Various objects, features, aspects, and advantages of the present invention will become more apparent from the following detailed description of preferred embodiments of the invention, along with the accompanying drawings in which like numerals represent like components.

Brief Description of the Drawings

Figure 1 is a block diagram of an interactive television system according to the present invention.

Figure 2 is a block diagram of the controller of Figure 1. Figure 3 is a block diagram of a display with sequencing designations overlaid on icons representing disc player devices according to the present invention.

Figure 4 is a block diagram of a remote control handset according to the present invention.

Detailed Description

In Figure 1 an interactive television system 10 generally includes a controller 20, a television 80, and a remote control handset 40. The controller 20 communicates with a plurality of built-in or peripheral devices, optionally including a security card reader 50, a digital camera 82, a phone 84, a video recorder 86, a DND player 88, and household appliances 90. The double-ended arrows, not numbered, depict communication pathways. Television system 10 receives signals from Internet service providers 60, and television program providers 70. Sequentially designated icons 32 are displayed on the display 30 of the television screen for operation of the various peripheral devices, web browsing, television access, and other functions. For simplicity of description, sequentially designated icons are referred from time to time herein simply as sequenced icons. In this particular instance, numerals 34 are utilized to sequentially designate the sequenced icons 32.

In Figure 2 the controller 20 generally comprises a memory 100, a microprocessor 110, a security device reader 55, and various interfaces. The interfaces depicted are a television interface 120, a modem 130, a remote control interface 45, a network interface 65, television signal receiver 75, peripheral device control 91, audio transmitter 93, and an audio receiver 95. Each of these components by itself is well known in the electronic industry, with the exception of the programming of the microprocessor in accordance with the functionality set forth herein.

The various components of controller 20 may be co-located in a single housing (not shown). The controller housing may or may not be physically coupled to the television set 80 housing. Alternatively, one or more of the various components of controller 20 may be disposed in the television set 80 housing.

Controller 20 is an example of a "set-top box", and may be used to access the Internet or other network through the network interface 65 or a telephone modem 130. Alternatively, network access can be made through a cable television line, satellite dish, or any other suitable equipment. In a preferred embodiment, the television screen (i.e. display) 30 comprises a high definition screen having a dot pitch of no more than 0.25 Mm. At least three sequenced icons 32 are displayed on the screen, although the total number of sequenced icons 32 displayed can vary considerably. Six to twenty-one of the sequenced icons are preferably displayed, more 5 preferably six to twelve icons, and most preferably nine to twelve icons. The sequenced icons 32 may be placed anywhere on the display 30, but are advantageously placed in rows and columns, substantially centered in the display area. Sequenced icons 32 can have any suitable shape, including rectangular, ovals, circles, and irregular shapes.

Sequenced icons 32 can be used to symbolically represent all manner of processes, 10 programs or commands. For example, one of the sequenced icons 32 may be linked to an application trigger that initiates a session of an Internet browser. Another one of the sequenced icons 32 may be used to initiate a session of an office product selected from the group consisting of a word processor, a spreadsheet program, and an email program.

Sequenced icons 32 may also be used to trigger functions of peripheral devices. For 15 example, sequenced icons 32 may be used to trigger the record, stop, play, rewind, and fast forward functions of digital camera 82. Other sequenced icons 32 may be used to trigger the play, stop, change disk, and change track of DVD player 88, or the answer, dial, save number, and access number functions of a telephone.

Television screen 30 may also be one of the peripheral devices, with various sequenced 20 icons 32 being used to initiate functions such as change channel, volume up, volume down, and picture within picture. A video recorder is still another contemplated peripheral device, and appropriate sequenced icons 32 in that case would be used to trigger functions such as select channel, record, start time, stop time, duration, play, rewind, and fast forward, and so forth. Other contemplated peripheral devices are household appliances such as coffee pots and 25. watering systems, provided that they have sufficient communications capabilities, or at least can be controlled by switches or valves operated by controller 20. It should thus be appreciated that sequenced icons 32 may be linked to any application trigger or function trigger that is involved in a process, program or command involving any element that would be included in an interactive television system 10.

30 Installation software (not numbered) can be run by the controller 20 to simplify installation and use of a peripheral device. Such software advantageously assigns sequential icons 32 to functions that would otherwise be accessed by hot keys, non-sequential icons, menu selections, or some other triggers. For example, if a user installs a video mail program that operates a video camera, the software might assign icons numbered one through nine to functions record, playback, forward, reverse, mark segment, delete segment, select recipient, send, and receive, respectively. Such icons could be assigned completely independently from any icons or control procedures provided by the video mail program.

Some or all of the sequenced icons 32 can be hierarchically related to one another. Thus, in an especially preferred set top box configuration, a preliminary display screen ("desktop" in Microsoft™ parlance) might show sequenced icons 32 for major peripherals and functions such as: television, radio, Internet, DND, CD, VPΝ (virtual private network access), Office Applications, telephone, and so forth. Those "top level" sequenced icons 32 may advantageously be numbered one through fifteen, and accessing any of them would trigger display of a second level set of sequenced icons 32. For example, sequenced icon 32 numbered 12 may correspond to Office Applications, and accessing that sequenced icon 32 may trigger display of other sequenced icons 32 for word processor, spreadsheet, database controller, and so on. Those second level sequenced icons 32 may be sequenced using the same scheme as the top level sequenced icons 32, or may utilize some other sequencing. For example, both the top level sequenced icons 32 and the second level sequenced icons 32 may utilize numerals (1, 2, 3, 4, 5 . . . n), or the top level sequenced icons 32 may utilize numerals (1, 2, 3, 4, 5 . . . n) and the second level sequenced icons 32 may utilize letters (A, B, C, D, E, etc). There may also be third and fourth levels or sequenced icons 32, and so on. A lower level of sequenced icons 32 may also be related to a higher level of sequenced icons 32 by incorporating at least a portion of the higher level sequencing scheme, such as where the upper level uses 1, 2, 3, 4, etc, and the lower level uses 1.1, 1.2, 1.3, 1.4, 2.1, 2.2, 3.1, 3.2, 3.3, etc. In another example (not shown), a top level of sequenced icons could be colored, and a second level could be numbered. Thus, a second level icon could be accessed by speaking "red three", or "blue four". Those skilled in the art will appreciate that there are at least many hundreds of permutations.

It is important to distinguish the sequenced icons 32 disclosed herein from numeral, letter, and other designations used in prior art menus and elsewhere. One distinction is that number, letter and other sequencing designations contemplated herein are logically independent from any descriptive name or symbol. This excludes, for example, icons numbered to correspond to steps in a process. In such instances the icons would represent sequential steps, and any corresponding numbers would be logically dependent with respect to a descriptive name or symbol. Another distinction is that the sequencing designations contemplated herein are employed in conjunction with an icon. Ordinary text-based computer menus, such as that shown below, correlate a sequencing designation with a description this is entirely, or at least primarily textual. Icons represent information in a primarily graphical, rather a primarily textual representation..

1. word processor

2. spreadsheet

3. database controller

4. modem access

Enter

A corollary is that the icons and sequencing designations contemplated herein can be distributed about a display in two dimensions. Outline type lists are almost by definition only one dimensional, i.e., the sequencing designations are listed vertically above one another, albeit perhaps indented.

The security card 50, security device reader 55, and security software (not shown) collectively comprise a security system. Security device reader 55 is preferably located inside the controller 20, and cooperates with the software to limit access to at least one of the various peripherals or functions controlled by controller 20. In preferred embodiments, limitations are reflected in information stored in a security card 50. Such limitations can include any combination of temporal limitations, such as when viewers could watch the television of play music; content limitations, such as what web sites a user could or could not access; or function limitations, such as how loud music could be played, or how long a telephone call could take place.

It is especially contemplated that the security system can be used to enable selection, or enable function of selected ones of the sequenced icons 32. Alternatively, the security system can be used to prevent selection, or disable function of selected ones of the sequenced icons 32. In that way a user could be precluded from executing a process, program or command. The security system can even be used to allow or prevent access to all or a portion of the hard drive from a connected network, thereby effectively locking the controller 20 from outside attack when it is not being used.

In Figure 3 a letter type of sequencing designation 34 is overlaid on the sequencing icon 32. The sequencing designations 34 are preferably overlaid in the upper left corner of the sequencing icons 32, but they can be placed anywhere on or near the sequencing icons 32, and need not be overlaid in the sense of obscuring any underlying material. A critical aspect is that a typical user would properly associate specific sequencing designations 34 with corresponding specific icons 32.

It is considered advantageous that at any given time, the underlying hardware, software, or functions designated by most of the sequencing icons 32 displayed on a single display would be logically correlated in some manner. The correlation may simply be that they are all of the same level, as in a hierarchical ranking as discussed above with respect to hierarchical presentation, or the correlation may be a functional relationship, such as all functions of a given peripheral device. The caveat that "most", rather than all of the sequencing icons 32 are likely to be related, acknowledges an expectation that users will still have use for navigational icons, such as those for main menu, back, forward, and so forth.

Sequencing designations 34 comprise a numeral. They may, however, comprise a letter, a color, a tone or any other designation that would differentiate one icon 32 from another icon 32, and provide some logical rationale for ordering, i.e., sequencing the corresponding icons. Sequenced icons 32 are preferably lined up in rows and columns as shown in Figure 3. The Western convention of left to right and top to bottom is depicted, but alternative arrangements are also contemplated to correspond to different languages and cultures. It is even contemplated to utilize sequencing designations 34 on the sequenced icons 32, but to display the sequenced icons 32 out of any readily recognizable sequence, such as by using random positioning of the icons.

Colors can also be used as sequencing designations, either by themselves, or in combination with other sequencing designations. In Figure 3, the six icons labeled A - F are colored red, orange, yellow, green, blue, and violet, respectively.

Figure 4 generally depicts a remote control handset 40 that is a cross between a telephone handset and a television handset. In the manner of a telephone handset, there is a speaker 200 near the upper end, a microphone 290 near the lower end, and in between various telephone control keys: call/talk button 270, a send button 271, a redial button 272, a mute button 273, and a numeric/alphabetic keypad 280. In the manner of a television handset, there are function selectors: TV button 210, TV/STB (set top box) selector button 211, STB button 212, channel and volume controls 215, 216, respectively, and AM/FM radio button 231. Since the television set is to be used as a computer monitor for Internet access and other computer type functions, handset 40 may also advantageously include buttons for main menu 220, print 230, surf 232. A trackball 240 or other cursor control device cooperates with a "left-click" or select button 250, and a "right click" button 260 for cursor control.

Remote control handset 40 can be used in many different ways to access the sequenced icons 32, or perhaps more strictly speaking can be used to access the functions or devices designated by the sequenced icons 32. One can, of course, us the trackball 240 to move a cursor around a display containing the sequenced icons 32, and then access a particular icon by clicking on or near the icon using the select button 250.

It is preferred, however, that a particular sequenced icon 32 is selected using a remote control handset, which selects the particular sequenced icon 32 via its corresponding sequencing designation 34. This can be done in numerous ways, one of which is to press on a numeric or other key carried by the handset. Thus, to access a sequenced icon 32 having the numeral 11 as its corresponding sequencing designation 34, one could press the numeral 1 key twice in relatively rapid succession. Sequenced icons 32 having letters as their corresponding sequencing designations 34 could be accessed using letter keys, which may be laid out for example, in the manner of the letter keys on a cellular telephone. Thus, a key for the numeral 2 may also suffice for the letters A, B, and C, with the user pressing the key twice in rapid succession to obtain the letter B, and three times to obtain the letter C. -

Access can also be accomplished by voice. Instead of manually depressing a number on the remote control handset 40, an individual could access a particular sequenced icon 32 by speaking a number, letter, color, or other word or phrase corresponding to one of the sequencing designations 34.

There are several advantages to using numerals to access devices or function rather than the actual names of the devices or functions. For one thing, there are relatively few numerals in most cultures, and they are relatively consistent across cultures. For example, in most of the technologically developed world only ten numerals are needed to express any real integer, the ten numerals being zero and one through nine. Thus, sequenced icon having the numeral 15 as its sequence designation would be accessed by typing the numerals 1 followed by 5. The small set of numerals required greatly reduces the resources needed to program and interpret voice commands. Letters could also be used in this manner, but they would not necessarily translate well across languages and cultures, thus increasing development, production, and maintenance costs. Voice recognition software could be installed in the remote control handset 40, the controller 20, or some combination of the two.

Since a single household may well have users that speak different languages, the voice recognition software preferably contains sample voice patterns in at least ten different languages, at the very least for each of the numerals zero through nine. However, the voice recognition software may contain sample voice patterns for less than or more than ten different languages. More preferred is that the voice recognition software contains at least 100 sample voice patterns for each of the ten different languages for each of the numerals zero through nine, requiring at least 10,000 total sample voice patterns. Even more preferred software recognizes at least 25,000 total sample voice patterns, and still more preferred software recognizes at least 50,000 total sample voice patterns.

It is further contemplated that the voice command does not have to be received by the microphone 290 disposed in the remote control handset 40. The voice command may be received directly by a microphone in the controller 20, or elsewhere.

Historically, a typical universal remote control handset has electronics that wirelessly couples the remote control handset to a television controller to control the television, video recorder and other devices that are connected to the television set. In embodiments disclosed herein, the remote control handset 40 has similar electronics to a universal remote control handset for the control of the television, video recorder and other devices that are connected to the television set. Additionally, the remote control handset 40 selects icons 32 by selecting a sequencing designation 34 overlaid on the icon 32 that represents various processes, programs or commands involving elements that are a part of an interactive television system 10. It is further contemplated that the remote control handset 40 will, in cooperation with the controller 20, be used to conduct telephone calls through a conventional telephone, videophone, e-phone or other type of phone. In preferred embodiments, the remote control handset 40 is wirelessly coupled to the controller 20, and thence to a typical household hardwired or cellular telephone connection. Conventional telephone software installed in the controller 20 enables telephone calls to be made between a user and a third party. Typically, a user would use the remote control handset 40 to select the sequenced icon 32 that is linked to a telephone trigger by pressing the appropriate number on the numerical keypad 280. The user would then manually depress the call button 270, and enter the telephone numbers of the third party by depressing whatever numbers on the numerical keypad 280 coincide with the telephone number. The user would then manually depress the send button 271. As soon as the third party answered, the user would communicate with the third party by speaking into the microphone 290 and receiving information from the third party via the speaker 200. It is further contemplated that the remote control handset 40 in cooperation with the controller 20, Figure 2 will be used to receive calls. Some of the above steps, such as manually depressing the call button 270, and manually depressing the send button 271, could alternatively be accomplished by selecting an appropriate "receive call" sequenced icon 32. As noted elsewhere herein, the manual operations of keys could be replaced by appropriate verbal instructions. In addition a desired telephone number may be selected from a listing of telephone numbers, by accessing an appropriate sequenced icon 32.

It is contemplated that the remote control handset 40 can cooperate with the controller 20 to conduct telephone calls over the Internet. This is accomplished through the network interface 65, with the controller 20 running any necessary e-phone software. Appropriate home phone line networking alliance (HPNA) or other electronics is included in, or coupled to, the controller 20 as needed. Here again, access to the software and/or hardware equipment and functions can advantageously be made through sequenced icons 32, with icon selection being made manually or by voice.

Thus, specific embodiments and applications of sequenced icons have been disclosed. It should be apparent, however, to those skilled in the art that many more modifications besides those described are possible without departing from the inventive concepts herein. The inventive subject matter, therefore, is not to be restricted except in the spirit of the appended claim.

Claims

CLAIMSWhat is claimed is:

1. A controller that operates a television receiver and a display, the display displaying at least three icons, each of the at least three icons having a sequencing designation logically independent from any descriptive name or symbol, and all of the at least three icons positioned on the display in a visually recognizable order corresponding to the respective sequencing designations.

2. The controller of claim 1 , wherein all of the at least three icons form a set in which the sequencing designations are sequential.

3. The controller of claim 1, wherein each of the sequencing designations of the at least three icons comprise a numeral.

4. The controller of claim 1, wherein each of the sequencing designations of the at least three icons comprise a letter.

5. The controller of claim 1 , wherein each of the sequencing designations of the at least three icons comprise a color.

6. The controller of claim 1 , wherein at least one of the icons is linked to an application trigger.

7. The controller of claim 6, wherein the application trigger initiates a session of an Internet browser.

8. The controller of claim 6, wherein the application trigger initiates a session of an office product selected from the group consisting of a word processor, a spreadsheet program/ and an email program.

9. The controller of claim 1, wherein at least at least one of the icons is linked to a function trigger of a peripheral device.

10. The controller of claim 9, wherein the peripheral device comprises a digital camera, and the function trigger initiates a function selected from the group consisting of record, stop, play, rewind, and fast forward.

11. The controller of claim 9, wherein the peripheral device comprises a DVD player, and the function trigger initiates a function selected from the group consisting of play, stop, change disk, and change track.

12. The controller of claim 9, wherein the peripheral device comprises a phone, and the function trigger initiates a function selected from the group consisting of answer, dial, save number, and access number.

13. The controller of claim 9, wherein the peripheral device comprises a television screen, and the function trigger initiates a function selected from the group consisting of change channel, volume up, volume down, and picture within picture.

14. The controller of claim 9, wherein the peripheral device comprises a video recorder, screen, and the function trigger initiates a function selected from the group consisting of select channel, record, start time, stop time, duration, play, rewind, and fast forward.

15. The controller of claim 1 , wherein the television has a display located in a housing, and the controller for the television is located within the housing.

16. The controller of claim 1 , further comprising a wireless connection with a remote control handset having a microphone.

17. The controller of claim 16, further comprising voice recognition software in at least one of the controller and remote control handset, which recognizes voice intonations of the sequencing designations associated with the icons.

18. The controller of claim 16, wherein the voice recognition software contains sample voice patterns in at least ten different languages for each of the sequencing designations associated with the icons.

19. The controller of claim 16, wherein the voice recognition software contains at least 500 sample voice patterns for each of the sequencing designations associated with the icons.

20. The controller of claim 1 , further comprising a security device reader that cooperates with software to limit access to at least one of the at least three icons.

21. The controller of claim 1 , further comprising software that customizes installation of a peripheral device having a plurality of functions, by assigning the at least three icons to at least three of the plurality of functions, respectively.

22. The controller of claim 21, wherein at least one of the plurality of functions is selected from the group consisting of: displaying a list; dialing a telephone number; recording an audio sound; recording a video image; playing an audio sound; and playing a video image.

23. A remote control system for a television, comprising: a controller for the television coupled to a public package switched network, the controller running an e-phone software that enables telephone calls over the network; and a remote control handset having: electronics that wirelessly couples the remote control handset to the controller; manual controls operating through the electronics for changing channels of the television; and a microphone and a speaker.

24. The remote control system of claim 23, further comprising HPNA electronics that cooperates with the e-phone software to enable the telephone calls.