WO2001093590A2

WO2001093590A2 - Video message sending

Info

Publication number: WO2001093590A2
Application number: PCT/IB2001/000897
Authority: WO
Inventors: Toni Kopra
Original assignee: Nokia Corporation; Nokia Inc.
Priority date: 2000-05-30
Filing date: 2001-05-22
Publication date: 2001-12-06
Also published as: EP1290894A2; CN1197379C; WO2001093590A3; CN1444829A

Abstract

A video signal of an event is digitized as soon as it is recorded and sent to a location remote from the event. The digitized video includes timestamps marking the time at which frames of the video were recorded. A person, watching the event but quite possibly taking no part in the recording of the video, separately enters a text or other type of message into his mobile terminal and sends it to the remote location. The text message, and the portion of the digitized video signal corresponding in time to the message, are automatically marked and placed in a file. The file and the video segment can be made available in an interactive application to other persons with little delay.

Description

VIDEO MESSAGE SENDING

TECHNICAL FIELD

The present invention relates to the field of telecommunications. In particular, the present invention relates to a technique for quickly and efficiently creating and sending segments of video with related information in real-time or near real-time. BACKGROUND ART

^'Digital television is deliverable to moving receivers. Currently, analog television reception is non-existent or severally limited in moving receivers. However, digital receivers allow for clear reception in cars, buses, trains, and in handheld television sets such as the Sony atchman_. With a GSM mobile phone connected to a laptop and a DVB-T (terrestrial) receiver plug-in card, browsing the web at speeds of 2-14 Mb/s is possible .

Most of the equipment used to create, edit, and distribute television programs is now digital . The analog reception of a television signal, via cable, aerial, or satellite, is the end result of a long chain of events, most of which have taken place in the digital domain. For example, in delivering a new broadcast, the field reporter uses digital satellite news gathering equipment to uplink her report to a programming center. The material is digitally received, decoded, and compiled with live program feeds in a studio. The broadcast is then sent digitally around the world to professional receivers. Finally, the broadcast is converted to an analog signal and sent to the end viewer.

A typical television video circuit includes a tuner that receives the RF signals from an antenna or cable port. The tuner selects a particular frequency of the RF signal representing a viewing channel. The selected channel frequency from the tuner is processed through an IF amplifier and detector that amplifies the selected channel and reduces its frequency to a baseband video signal. A National Television Standards Committee (NTSC) decoder receives the baseband video signal from Intermediate Frequency (IF) amplifier and detector and separates the RGB signals according to the NTSC format. A microprocessor controls the tuner, IF amplifier, and NTSC decoder.

It is common in modern television receivers to provide functions such as picture-in-picture (PIP) , enhanced audio, and other special features, as options. Current television receivers incorporate such modules on a hard-wired basis. The PIP feature requires a composite video signal from a source other than the television tuner. The signal from that external video source is displayed on a selected portion of the cathode ray tube (CRT) viewing screen along with the main video signal.

An intelligent TV is for receiving communication services by connecting a TV to a value added network (VAN) . The intelligent TV includes an information signal processing unit for receiving information communication data (hereinafter, "information data") when the intelligent TV is connected to the VAN, and for generating information RGB signals, and switching control signals in order to display the information data on a screen. The intelligent TV selects and displays on the screen one of the information data signals processed in the information signal processing unit and a TV RGB signal processed in a TV signal processing unit, in accordance with the switching control signal output from the information signal processing unit. Intelligent TV makes it possible to view, through a TV screen, several communication services, such as stock quotes, news services, weather reports, and TV program lists, being transmitted through the VANs . Therefore, it has an advantage that persons who are not familiar with the usage of a computer can easily receive communication services. Even though intelligent TV has the advantage of receiving communication services through the TV screen, it cannot display multiple signals at the same time. Information signals for displaying information data on a screen, a TV signal, a Picture-In-Picture (PIP) signal for enabling two screens to be viewed simultaneously, and a TV on-screen-display (OSD) signal must be displayed one at a time. Therefore, signals are displayed according to a predetermined priority. For example, an information signal is displayed preferentially over a TV signal, a PIP signal is displayed preferentially over an information signal, and a TV OSD signal is displayed preferentially over a PIP signal.

Current information delivery services described above lack many features that would enhance their usability and desirability by the public. As mentioned, the intelligent TV lacks an ability to display multiple signals simultaneously. In addition, an online connection of interlinked video and text content in an interactive application is not available. Current technologies are dependent on stationary receivers. Since multiple signals cannot be integrated by the IRD, information delivery is dependent on the location or site. DISCLOSURE OF INVENTION

Recent improvements in technology have allowed the widespread proliferation of higher speed Internet access, such as 56K modems, Digital Subscriber Line (DSL) and cable TV Internet connections, etc. These high speed Internet connections can support video streaming - the transmission of compressed video signals over the Internet so as to produce picture and sound comparable to that of a standard television receiver. Furthermore, high speed data services to mobile terminals are supported by advanced Third Generation (3G) Universal Mobile Telecommunications System (UMTS) or Global System for Mobile Communication/General Packet Radio Service (GSM/GPRS) mobile networks.

One aspect of the present invention takes advantage of these technologies by interlinking video and text content so that it is available for transmission to mobile device in real-time or near real-time.

A video signal of an event is digitized as soon as it is recorded and sent to a location remote from the event. The digitized video includes timestamps marking the time at which frames of the video were recorded. A person, watching the event but quite possibly taking no part in the recording of the video, separately enters a text or other type of message into his mobile terminal and sends it to the remote location. The text message, and the portion of the digitized video signal corresponding in time to the message, are automatically marked and placed in a file. The file and the video segment can be made available in an interactive application to other persons with little delay. BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing and a better understanding of the present invention will become more apparent from the following detailed description of example embodiments in the claims when read in connection with the accompanying drawings, all being part of the disclosure of this invention. While the foregoing and following written and illustrated disclosure focuses on disclosing example embodiments of the invention, it should be clearly understood that the same is by way of illustration and example only and the invention is not limited thereto. The spirit and scope of the present invention are limited only by the terms of the appended claims .

Fig. 1 illustrates an example of the architecture of a video message sending system in which an embodiment of the present invention can be practiced.

Fig. 2 is an example of a method of creating an interlinked video clip and message in real-time or near real-time . Fig. 3 illustrates an example of a process method of providing an interlinked video clip and message in an interactive application in real-time or near real-time.

Fig. 4 illustrates the structure of an applications server in which a plurality of interlinked video clips and messages can be stored for use in interactive applications . BEST MODE(S) FOR CARRYING OUT THE INVENTION

The numerous innovative teachings of the present application will be described with particular reference to the presently preferred embodiment. However, it should be understood that this class of embodiments provides only a few examples of the many advantageous uses of the innovative teachings herein. In general, statements made in the specification of the present application do not necessarily delimit any of the various claimed inventions. Moreover, some statements may apply to some inventive features but not to others.

The presently preferred embodiment of the disclosed innovations is the simultaneous reception and display of a portion of a DVB-T video signal and an accompanying message having content related to portion of the DVB-T video signal. Digital broadcast technology allows for services that can present many-to-one, many-to-many, and one-to-one communication. DVB has defined delivery media for satellite services (DVB-S, direct-to-home viewing, cable (DVB-C) run in several countries, and terrestrial, or "over the air", (DVB-T) planned for 17 countries. Use of return channels enables digital receivers to provide a variety of services including Internet, television, and web content. Processing of the digital signal can be accomplished on a desktop or laptop computer. However, it should be noted that DVB is just one of many digital services that can be used with the invention.

Fig. 1 illustrates an example of the architecture of a video message sending system in which an embodiment of the present invention can be practiced. It consists of an "input center", comprising a plurality of video cameras 110 recording the actual event and one or more commentator (s) 120 giving their expertise on the event. They may create and edit short messages of a type such as the Short Messaging Service (SMS) supported by Global System for Mobile Communications (GSM) networks.

The digitized data, including the digitized video, text comments from the commentator (s) of the event and timestamps of these, are sent through a communications network, such as Internet 120 for example, to applications server 130. Applications server 130 processes the data and converts it into the form that can be distributed to mobile terminals such as monitor 140 and mobile terminal 150.

Fig. 2 illustrates an example of a real-time or near real-time method of creating an interlinked video clip and message from the input center. Of course, first the video cameras record the game (Step 210) while the reporter is observing the game (Step 220) . When the reporter sees something important, he composes a messages and sends it to applications server 130 (Step 230) . Preferably, the message is a message posting HTML form. When application server 130 receives the form, the text is stored in a database such as that shown in Fig. 4. The "in" and "out" positions in the digitized video corresponding to the message are counted automatically and are also stored to the database shown in Fig. 4 (Step 240) . Preferably, the SMIL standard is used to describe the beginning and ending of the video clip. The reporter's input and video recording are thus functionally integrated to form a video with expert comments that can be easily distributed only a few seconds after the event actually happened (Step 250) . It may be distributed in any number of ways. For example, it can be broadcast, multicast, made available for downloading from a central location, etc.

Application server 130 combines the video and message in synchronization according to the timestamps prior to forwarding it. Although only the Internet is shown in Fig. 1, it is understood that communication networks provide communication services between monitor 140 and mobile terminal 150. Because the video in the server is digitized all the time, any video segment is immediately available for Internet users.

Monitor 140 can be any type of display, for example, a television or computer monitor, including flat panel type displays. In any event, it preferably includes a plug-in PIP module. Most monitors that incorporate PIP and other features also include a microprocessor control which, via a suitable control bus, periodically interrogates certain functional blocks and modules in the chassis to determine whether they are present and, if so, to control their operation. In the case of a PIP module, polling by the microprocessor indicates whether the module is present. If it is, the microprocessor arranges to switch the composite video signals (from any tuner and external sources) through the PIP processor and then to the main video processor of the monitor, in preference to the normal composite video produced. Thus, the video processor of the monitor has its inputs supplied from either the main chassis in the event there is no PIP module or from the PIP processing module.

The mobile terminal 150 can be any type of unit capable of receiving and displaying signals. For instance, it may be a cellular phone with a small display, an Internet appliance with web browser capability, a handheld computer or a laptop computer. In any event, it preferably has PIP functionality as well. This functionality allows the user to simultaneously view two applications in the display. The applications can be, for example, the video segment with interlinked message as described herein in one window and an interactive betting service involving the game in another window. The interactive betting service can be web-based and personalized so that pages of interactive content can be configured by said client terminal to display pertinent information information according to the preferences of the client terminal and the interactive content is tailored to the transmission and reception capabilities of the client. A description of the interactive betting service can be found in the realted patent applications incorporated herein by reference. In the presently preferred embodiment, the monitor 140 and mobile terminal 150 receive an integrated digital broadcast signal (DVB-T) . Reception of the signal can be accomplished through various means. In the presently preferred embodiment, the mobile terminal receives the signal over a GSM, GSM++, POTS, UMTS, or other type of connection 145. The mobile connection 145 itself may be connected to a network such as an extranet, intranet, or the Internet. Mobile connection to applications server 130 takes place in a conventional manner over a modem pool with user dial-in and authentication services. Depending on the capabilities of mobile terminal 150, intermediate protocols and network connections may not be required to achieve connection.

The flowchart of another possible process is illustrated in Fig. 3. The cameras record the entire game and digitize the content for later use (Step 310) . The commentator marks the time when something interesting happens (Step 320) . Specifically, he sends the time-mark of the interesting happening as an "in" information to application server 130. Then, he writes a short expert comment, preferably in the form of text (Step 330) . The commentator sends the message to application server 130 and, when the interesting scene ends, marks the ending time of the interesting happening (Step 340) .

Application Server 130 receives the data (Step 350) , processes it with the time-mark information and makes it available for subscribers via the Internet (Step 360) . The time marks aid the server to operate correctly. When the time mark is "in" the server links the expert comments and the video clip together. When the time mark is "out", the linking ends. Application server 130 can then offer the file to subscribers (Step 370) .

There are several ways to distribute the service to subscribers. Of course, video and audio streaming of the game may be accomplished, in the presently preferred embodiment, with a live video/audio streaming server (VAS) transferring the whole game through a network such as an extranet, intranet, or the Internet or through an RF receiver at the server, where comments are added. The audio can be digitized using one of several digital compression schemes, for example, H.728, H.729, or GSM. Likewise the digitized video can be compressed using a scheme such as MPEG, MVC, H.261, etc. The digitally compressed audio and video are packaged for network transfer e . g. , TCP/IP, UDP and then broadcast to the network controlled by a streaming/multicasting controller.

However, streaming demands a great deal of bandwidth and resources at the client side. An interactive application of intermittent video clips with accompanying messages may be preferable in may circumstances, especially when the client is simultaneously supporting another interactive application, such as a betting service which is described in detail in the related applications incorporated by reference.

One embodiment of an interactive application is an "action list" of interesting happenings in all the games played at the same time. When something interesting happens in any of the games, a line indicating the happening appears on the list. The line may include one sentence describing the action and the time of the happening. When user notices something that interests him in the games "action list", he can send a request for downloading the video clip by clicking on the line, and can see the happening just moments later after it actually occurred.

In another embodiment, the happenings in a video message sending system can be linked to, for example, an interactive betting service which is simultaneously displayed or active in a window or PIP capability of a terminal device when the happening occurs. As shown in Fig. 4, applications server 140 can store any links from video clips to other applications, such as an interactive betting application. Details of an interactive betting application are provided in applicant's related patent applications incorporated herein by reference. The link can be set by the betting application in the client terminal notifying the applications server that the user has bet on Jokerit-Tappara game for example or has bet that Gretzsky will score when at the time the bet is placed. Alternatively, the betting database can have a mark for that happening in the client's data. The video signal can be automatically forwarded to the client terminal or an observation or other notification can be provided to the client. Moreover, the video signals and the betting information can be compared at any time or for any reason to determine if the action has happened. Since the video clip with identification "froi2345" is a clip of Gretzky scoring in the Jokerit-Tappara game in the example of Fig. 4, the video clip can be automatically forward by applications server 130 to the client terminal .

While interactive sports betting has been described, other interactive events can be integrated, and broadcast. Such events can include, for example, video games, shopping, and educational activities.

The preferred context of the disclosed embodiments contemplates digital delivery of broadcasts. However, depending on the hardware setup, analog signals may be used for delivery of the event broadcast and the interactive display.

The preferred context of the disclosed embodiments contemplates delivery of events and betting information.

However, a software stand-alone version, for example, an interactive CD-ROM video game, can be created having the functionality of the network and servers and terminals. Random generation can simulate live events. The video or interactive content of the game can remain the same with the random generation providing the variation needed for multiple plays.

In another context, software, for example, an interactive CD-ROM video game, can be created which depends on interactivity with the network and servers of a betting provider to generate the random events and betting opportunities in a simulated game. Such a game can be played interactively with other participants at remote locations all receiving the same randomly generated events and betting opportunities. While there has been illustrated and described what are considered to be examples of embodiments of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made, and equivalents may be substituted for elements thereof without departing from the true scope of the present invention. Furthermore, many modifications may be made to adapt a particular situation to the teachings of the present invention without departing from the central scope of the present invention. Therefore, it is intended that the present invention not be limited to the particular embodiments disclosed rather that the present invention includes all embodiments falling within the scope of the appended claims .

Claims

IN THE CLAIMS ;

1. A video message sending method comprising the steps of : providing a segment of video signal of an event; separately providing a text message describing the event during the segment of video signal; marking the times at which the segment of video signal begins and ends; and generating and sending a video message linked with the text message.

2. The method of claim 1, wherein the video message comprises a video message on the Internet.

3. The method of claim 2, wherein the video message comprises a video message requested by a client from an Internet server and the server forwards the requested video message and linked text message to the client via the Internet.

4. The method of claim 1, wherein said steps are performed by software.

5. The method of claim 2, wherein said steps are performed by software .

6. The method of claim 3 , wherein said steps are performed by software .

7. A video message sending system comprising: an input center providing a digital video signal of an event and a text message from an observer of the event ; an applications server configured to receive a digital video signal and a related text message; a processing circuit for linking the text message to a portion of the digital video signal corresponding to time marks included with the text message; and a means for sending a video message signal in which a portion of the digital video signal corresponding to the time marks is linked with the text message.

8. The system of claim 7, wherein the video message signal comprises a video message signal on the Internet .

9. The system of claim 8, wherein the video message signal comprises a video message signal requested by the client from the applications server and the applications server forwards the requested video message signal to the client via the Internet.

10. The system of claim 7, wherein the time marks are provided by the observer.

11. A computer program embodied in a tangible medium, the program comprising instructions which, when executed, carries out a video message sending method comprising the steps of: providing a segment of video signal of an event; separately providing a text message describing the event during the segment of video signal; marking the times at which the segment of video signal begins and ends; and generating and sending a video message linked with the text message.

12. The program of claim 11, wherein the video message signal comprises a video message signal on the Internet .

13. The program of claim 12, wherein the video message signal is requested by a mobile terminal and the applications server forwards the video message signal to the mobile terminal via the Internet.

14. A system for interactive services, comprising: a client connected to receive and respond to signals based on interactive content over a communications channel ; an interactive provider server connected to receive said client responses and respond to said client; an interface page for providing information pertinent to said interactive content to said client; wherein said page can be configured by said client to display said pertinent information according to the preferences of said client and the interactive content is tailored to the transmission and reception capabilities of said client.

15. A system as recited in claim 14, wherein said interactive content includes a betting service and a video signal which are linked together so that the client will automatically receive a video signal for a, if the user has bet a certain game, he/she will automatically get a video stream to his/her terminal due to the certain predetermined action has happened in the game and due the betting database has a mark for that action in the client's data.

16. A system as recited in claim 15, wherein the video stream information and the betting information is compared and if the predetermined action has happened, the video or at least an observation is sent to the client .