SYSTEM AND METHOD FOR REMOTELY PROCESSING MULTIMEDIA DATA
FIELD OF THE INVENTION
The present invention is related generally to computer processing systems, and more particularly, to a system and method for processing multimedia data.
BACKGROUND OF THE INVENTION
Posters are displayed for a variety of reasons, one of which is to provide information to the viewer. For example, mass transit systems often display maps having the various transit routes highlighted in order to assist the traveler in choosing the appropriate route to arrive at their destination. Posters are also used in directories to help the viewer navigate in a large building, such as a shopping mall, or athletic stadium.
Posters are also often used for the purpose of advertisement. In this capacity, posters not only provide information about the product or its manufacturer, but also must be designed to capture and retain the attention of the viewer. One such example comes in the form of a movie poster. The movie poster must have the aesthetic quality necessary to draw a viewer's attention to it, and also provide information about the movie itself, such as the actors in the movie, the director, producers, and the studio distributing the movie. The aesthetic qualities work in tandem with the informative qualities to persuade the viewer to see the movie, or the very least, to further investigate the movie. If the viewer is left with
any impression of the movie, then the poster has succeeded in its function.
Product manufacturers similarly use posters to increased exposure of their products in the public's awareness. Like a movie poster, the poster must initially draw the attention of a viewer and capture the viewer's interest long enough to leave an impression about the product. In the case of product advertisement, the impression created, or the viewer's perception of the product, maybe more important than the information provided by the advertisement. Nevertheless, using a poster in this manner has proven itself to be an effective means of advertising a product.
Although posters are effective tools for conveying information, there are limitations to their effectiveness. For example, there are practical limitations as to the space required to display more than one poster. Furthermore, posters are often ignored by people passing by, thus defeating the purpose of displaying the poster in the first place. Therefore, it can be appreciated that there is a need for an apparatus and means of providing information to a viewer that overcome some or all of the deficiencies of a conventional poster. The present invention provides this and other advantages, as will be apparent from the following detailed description and accompanying figures.
SUMMARY OF THE INVENTION
The present invention is embodied in a system and method directed to a remote multimedia processing system that receives multimedia data at the command and under the control of a central
controller with which the remote processing system is in communication. The remote multimedia processing system processes the multimedia data according to instruction data that is also transmitted from the central controller. In one embodiment, the system includes a remote data processor coupled to a central data source that provides digital video data and instruction data. A storage location is included to store the digital video data, as well as a video processor for processing the stored data. A display upon which the processed data is displayed is also included in the system. Selection of the digital data and instruction data transmitted to the remote data processor is under the control of a central controller.
In another embodiment, a motion detector that can generate an activation signal upon detecting motion in proximity of the display is included in the system. The activation signal may consequently be used to initiate the data processing operation and displaying of the digital data. Thus, images may be displayed in response to a viewer passing in proximity to the display.
In another embodiment, a data logging device is included in the system. The data logging device generates log data indicative of whether the digital data was successfully processed and displayed according to the instruction data. The log data may be used by an operator at the central controller to verify whether successful processing was completed.
In another embodiment of the system, a plurality of remote processors are connected to one central controller. The central controller may transmit different digital data or instruction data to the individual
remote processors to which it is connected. Furthermore, data may be transmitted to the individual remote processors simultaneously.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a functional block diagram of a system according to an embodiment of the present invention.
FIG. 2 illustrates a functional block diagram of a remote multimedia processing system according to an embodiment of the present invention.
FIG. 3 illustrates an example of the data provided to the multimedia processing system of FIG. 2.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention provides significant improvement over a conventional poster by using a system that includes a remote multimedia processing system to provide video and audio information via a flat panel display and conventional audio speakers. Multimedia data is transmitted to the remote processing system under the control and at the command of a central controller with which the remote processing system is in communication. Multimedia data generally includes data related to a visual image, which may be moving, still, or both, and data related to an audio signal. However, as used herein, the term "multimedia data" refers to data related to either visual images and/ or audio signals. The multimedia data is stored by the remote
processing system for later processing according to instruction data also provided by the central controller.
As a result of the remote processing system's ability to store and process the multimedia data it receives from the central controller, multiple remote processing systems may be coupled to a single central controller. Each remote processing system can operate independently from each other, as well as from the central controller. Each remote processing system will continue to process and display the multimedia data in accordance with its particular instruction data until new multimedia data or instruction data are transmitted bv the central controller.
The system embodying the principles of the present invention is capable of providing significantly more information than a conventional poster while occupying nearly the same display area. Information may be conveyed in a manner not possible with the static images of conventional posters. That is, the multimedia processing capability of the remote processing system allows advertisers to use active images and sounds, in addition to static images, to draw the attention of viewers. Furthermore, a system according to the principles of the present invention allows for new multimedia and instruction data to be easily transmitted from the central controller to each remote processing system. Thus, updating multimedia data or instruction can be accomplished quickly and centrally by a single operator at the central controller. The present invention is embodied in a system 100 illustrated in the functional block diagram of FIG. 1. The system 100 includes a central controller 102 and a remote multimedia processing
system 202. The central controller 102 and the multimedia processing system 202 are in communication over a communication link 104. The communication link 104 may take the form of several well-known communication media, including, but not limited to, a conventional computer network, conventional telephone land lines, the Internet, or wireless media. Accordingly, the present invention is not limited by the specific form of the communication link 104.
Shown in FIG. 1 is an embodiment of the central controller 102 according to the principles of the present invention. The central controller 102 includes a controller 110 to control the operation of the central controller 102. A compression engine 112, also included in the central controller 102, compresses digital multimedia data prior to storing the data in a non-volatile storage unit 114. As mentioned previously, the digital multimedia data typically includes both video and audio data that are transmitted to the multimedia processing system 202 under the control of the controller 102. Various conventional compression techniques may be applied by the compression engine 112, including, but not limited to, MPEG-1, MPEG-2, and motion JPEG. Accordingly, the present invention is not limited by the specific compression technique of the compression engine 112.
The central controller 102 further includes an I/O interface 116 to facilitate communication with the multimedia processing system 202 over the communication link 104. The central controller 102 may be implemented using a conventional computer, such as a personal computer (PC), having a central processing unit, memory, video display, and keyboard. For the sake of brevity, these conventional components are not illustrated in FIG. 1. Other components, such as the non-volatile
storage unit 114, may be implemented using a conventional hard disk drive in the PC, while the I/O interface 116 may be implemented by a conventional modem, network card or the like. Those skilled in the art will further appreciate that some components illustrated in FIG. 1, such as the compression engine 112, may be implemented by a series of computer instructions executed by the CPU (not shown) in the PC.
The components of the central controller 102 are coupled together by a bus system 118, which may include a power bus, control signal bus, and status signal bus in addition to a data bus. However, for the sake of clarity, the various buses are illustrated in FIG. 1 as the bus system 118. A data logger 120 may also be included in the central controller 102. However, as will be discussed below, the data logger may be included in the multimedia processing system 202 instead. The data logger 120 generates log data indicating whether the multimedia data has been successfully processed by the multimedia processing system 202, as instructed by the central controller 102. Although illustrated in FIG. 1 as a separate component, those skilled in the art will recognize that the data logger 120 may simply be a data file in a computer memory (not shown) or a file stored on the non-volatile storage unit 114. Shown in FIG. 2 is an embodiment of a multimedia processing system 202 according to the present invention. The multimedia processing system 202 includes an I/O interface 204 coupled between the communication link 104 and a bus system 206. As with the bus system 118 of the central controller 102, the bus system 206 of the remote multimedia processing system 202 may include a power bus, control signal bus, and status signal bus, in addition to a data bus. For
the sake of clarity, the various buses are illustrated in FIG. 2 as the bus system 206.
The multimedia processing system 202 may also be implemented using conventional microprocessor technology and include a central processing unit (CPU) 208 coupled to the bus system 206 to receive and initially process data transmitted to the multimedia processing system 202 over the communication link 104. The multimedia processing system 202 further includes a memory 210, which may include both read-only memory (ROM) and random access memory (RAM). A portion of the memory 210 may also include non-volatile random access memory to store information that must be present upon powering up the multimedia processing svstem 202. The memory 210 is used generally to store data for processing by the CPU 208. The multimedia processing system 202 also includes a non-volatile storage unit 212 to store the digital multimedia data transmitted by the central controller 102.
The multimedia processing system 202 further includes a decompression engine 214 for decompressing the digital data stored by the non-volatile storage unit 212 and providing the decompressed data to a video processor 216. The video processor 216 processes the data and drives a flat panel video display 218 to display the resulting image. An audio output device 220 is also included in the multimedia processing system 202. The audio output device 220 operates in a conventional manner to produce audio signals that accompany the images displayed on the display 218.
Also included in the multimedia processing system 202 is a timer 222, which may typically be included in the CPU 208. As will be
discussed in greater detail below, the multimedia processing system 202 uses the timer 222 to determine the time and date. This information is required when instruction data transmitted by the central controller 102 specifies the times at which the multimedia data is to be processed and displayed by the multimedia processing system 202.
In an alternative embodiment, a motion detector assembly 12A having motion detectors 226 proximate the display 218 generates an activation signal when motion in proximity and with respect to the display 218 is detected. The motion detector assembly 224 may also be adapted to detect direction of motion relative to the motion detectors 226, or detect the approximate number of viewers in proximity to the display 218, and generate corresponding activation signals. Such motion detector assemblies are well known in the art and will not be described in detail herein in the interest of brevity. The activation signals can be used to activate the multimedia processing system 202 to begin processing the multimedia data. Thus, in an embodiment including both the timer 222 and a motion detector assembly 224, the multimedia data may be processed at either a specific time as specified by the instruction data, or when motion is detected in proximity to the display 218. In another embodiment, a data logger 228 is included in the multimedia processing system 202. As mentioned previously, the data logger, which may be a data file in the memory 210, the non-volatile storage unit 212 or a separate device, contains log data indicating whether the multimedia data has been successfully processed according to instruction data transmitted by the central controller 102. A data logger 120 was previously shown as being included in the central
controller 102 of FIG. 1. However, the data logger 228 may be located in the processing system 202 instead.
In an exemplary embodiment, many of the elements of the multimedia processing system 202 previously described may be physically located in a common housing. For example, the multimedia processing system 202 may be implemented using a single board microcomputer that includes the elements illustrated in FIG. 2. The board may be located within a housing that also includes the display 218, and the audio output device 220. Therefore, the physical location of the particular elements of the remote processing system 202 should not limit the scope of the present invention.
In another embodiment of the multimedia processing system 202, several elements may be adapted to accommodate placement of the multimedia processing system 202 in a location having only a conventional AC power outlet. For example, multimedia data and instruction data may be transmitted to the multimedia data processor 202 by modulating the data on the power signal provided through the conventional AC power outlet. Consequently, the I/O interface 204 would need to be able to accommodate receiving the multimedia and instruction data from the power signal. Such techniques of transmitting and receiving information are well known in the art, and do not need to be discussed in detail herein. Other elements may also be need to be adapted in addition to the I/O interface, however, a person of ordinary skill in the art would appreciate such modifications, and thus, discussion herein has been omitted for the sake of brevity.
A person of ordinary skill in the art will appreciate that the central controller 102 and the multimedia processing system 202 also
include many other components not shown in FIGS. 1 and 2. For example, both the central controller 102 and the multimedia processing system 202 require a power supply to power the electrical components. Additionally, the central controller 102 will also typically include input devices, such as a keyboard or a mouse, and output devices, such as a printer or display, that allow an operator to interface with the central controller 102. However, these and other elements have been omitted from FIGS. 1 and 2 in the interest of brevity, and should not be interpreted as limiting the scope of the present invention. Shown in FIG. 3 is an example of data 300 that may be transmitted by the central controller 102 to the multimedia processing system 202. Multimedia data 302 transmitted to the multimedia processing system 202 are initially received by the CPU 208 and then stored in the non-volatile storage unit 212. As mentioned previously, the multimedia data 302 are typically files of video and audio data that will be processed by the multimedia processing system 202. In the case where several files of multimedia data 302 are transmitted and stored, file header data 304 included with the multimedia data 302 are used bv the CPU 208 (see FIG. 2) to identify the individual files. In addition to transmitting multimedia data, the central controller 102 also transmits instruction data 306 to the multimedia processing system 202. The instruction data 306 may include data used by the CPU 208 to determine which multimedia data files stored in the non-volatile storage 212 are to be processed and displayed, and also when and how often an image is to be displayed. Additional data that may be included in the instruction data 306 may specify the volume of the audio output, or whether processing should be initiated when motion
is detected by the motion detector assembly 224. As a person skilled in the art will appreciate, the instruction data 306 may be transmitted independently of the multimedia data 302 to permit modification of the instruction data 306, such as altering the selection of the multimedia data file, or altering the time or frequency of processing the multimedia data. In the case where more than one multimedia processing system 202 is coupled to the central controller 102 via the communication link 104, remote identification data 308 may also be included with the multimedia data 302 and instruction data 306, as shown in FIG. 3. The central controller 102 may be connected to the multimedia processing systems 202 located within a city, state, or any geographic region. The connectivity of such a system will be limited by practical considerations such as the type of communication link used, the operating speed of the central controller 102, and the cost of implementing such a system. Each multimedia processing system 202 may be assigned a unique code that can be used for identification. When data 300 are transmitted by the central controller 102 through the communication link 104, the identification data 308 can use the unique codes to specify which of the processing systems 202 should download the data 300. Consequently, multimedia data 302 or instruction data 306 may be updated for a particular multimedia processing system 202 without affecting any of the other remote processing systems also connected to the central controller 102.
The unique code identifying each multimedia processing system 202, as well as the identification data 308, may also include a unique group identifier, in addition to the individual unique code. By including a group identifier, the central controller 102 may transmit
multimedia data or instruction data to a group of multimedia processing systems 202 all having the same group identifier. Thus, simultaneous transmission of data to the multimedia processing systems 202 of a particular geographic region can be easily accomplished by including the particular group identifier in the identification data 308 when transmitting the data.
As mentioned previously, in operation the central controller 102 transmits multimedia data and instruction data to the multimedia processing system 202. No new data need be transmitted to the multimedia processing system 202 until the central controller 102 determines that new data is required. Thus, once the data has been transmitted, the multimedia processing system 202 can operate independently of the central controller 102, and process and display the multimedia data in accordance with the instruction data. For example, consider the case where the system 100 is being used for the purpose of advertising movies. At the central controller 102, multimedia data are compressed by the compression engine 112 and stored in the non-volatile storage 114 until transmitted to the multimedia processing system 202 at the command of the controller 110. For this example, the multimedia data 302 (see FIG. 3) includes both graphic data for a still image of a movie poster, and video and audio data for the related movie trailer. The resulting multimedia file enables the multimedia processing system 202 to display the static image of the movie poster on the display 218, and simultaneously play the movie trailer in a smaller portion in the foreground of the display 218. The audio data related to the movie trailer will be reproduced by the audio output device 220. In the case where both the display 218 and the audio
output device 220 are located on the exterior of a movie theater, viewers passing by the theater will be drawn to the display 218 when it becomes active.
Transmitted along with the multimedia data is instruction data 306 (see FIG. 3) generated by the controller 110. The instruction data commands the multimedia processing system 202 to process and display the multimedia data according to a schedule selected by an operator at the central controller 102. For example, the operator may have determined that the most effective schedule is to begin displaying the static image of the movie poster at times each day that coincide with one hour prior to the daily show times of the movie. The multimedia processing system 202 is also instructed to play the movie trailer in the foreground of the display 218 at times corresponding to ten minute intervals after the display 218 initially displays the image of the movie poster. The instruction data further instruct the system 202 to cease displaying both the static image and the movie trailer at times coinciding with half an hour following the daily show times of the movie. It should be understood that the times and frequencies previously described are provided merely as examples to illustrate the versatility of the system 100, and are not meant to limit the scope of the present invention.
Both the multimedia and instruction data are transmitted through the communication link 104 to the multimedia processing system 202. The CPU 208 (see FIG. 2) initially receives and processes the data 300 by separating the multimedia data 302 and the instruction data 306. The multimedia data 302 is stored in the non-volatile storage unit 212 to be processed at a later time in accordance with the instruction data 306. The non-volatile storage 212 may contain other multimedia files, but
the file header data included with each multimedia data file can be used by the CPU 208 to identify the specific files.
The time and date are maintained in the multimedia processing system 202 by the timer 222. At the time specified by the instruction data 306 to display the static image of the movie poster, the CPU 208 retrieves the multimedia data file corresponding to the movie poster identified in the instruction data. The CPU 208 subsequently commands the decompression engine 214 to begin decompressing the multimedia data file. The decompressed image data is provided to the video processor 216 and the static image of the movie poster is displayed on the display 218.
In the present example, the CPU 208 retrieves the multimedia data file corresponding to the movie trailer ten minutes after displaying the static image and commands the decompression engine 214 to begin decompressing the multimedia file. The decompressed data of the movie trailer is subsequently provided to the video processor 216, as well as to the audio output device 220. Consequently, the video processor 216 drives the display 218 to play the movie trailer on a portion of the display 218. In an exemplary embodiment, the display 218 maintains the static image of the movie poster on the remaining portion of the display. As instructed by the instruction data 306 (see FIG. 3), the multimedia processing system 202 will repeat the process of decompressing, processing, and displaying at times every ten minutes, until thirty minutes after the movie has begun. In an alternative embodiment, the motion detector assembly
224 having motion detectors 226 mounted in proximity with the display 218 can be used to initiate the display process. The motion detector
assembly 224 may be designed to detect both motion in proximity to the display 218, as well as the direction of motion with respect to the display 218. Such a motion detector is well known in the art and need not be described in greater detail herein. Use of the motion detector assembly 224 may be illustrated by modifying the previous movie advertisement example. Assume that rather than instructing the multimedia processing system 202 to play the movie trailer every ten minutes, the instruction data commands the multimedia processing system 202 to play the movie trailer in response to detecting motion in proximity to the display 218. That is, upon detecting motion near the display 218, the motion detector assembly 224 generates an activation signal that is provided to the CPU 208. In accordance with the instruction data 306 (see FIG. 3), upon receiving the activation signal, the CPU 208 retrieves the multimedia data corresponding to the movie trailer and commands the decompression engine 214 to begin decompressing the video and audio data. The decompressed data is provided to the video processor 216 and, consequently, the movie trailer will begin playing in the foreground of the display 218 as a viewer passes near the display 218.
In the case where the motion detector assembly 224 can detect both motion and direction of motion, the multimedia processing system 202 may be instructed to process and display different multimedia data files based on the direction of motion detected. That is, a viewer approaching the display 218 from the right will cause the multimedia processing system 202 to process and display a first multimedia data file, while a viewer approaching the display from the left will cause the processing system to process and display a second
multimedia data file. In this manner, viewers may be further engaged by the active nature of the displayed image.
As mentioned previously, the motion detector assembly 224 may also be designed to detect the approximate number of viewers in proximity to the display 218 and generate a corresponding number data. With such a motion detector assembly, a logging device (not shown) may be coupled to receive the number data generated by the motion detector assembly 224 and store the number data. If the logging device is included in the multimedia processing system 202, it will be adapted to transmit the number data to the central controller 102. Such a data logging device may be included with the data logger 120 (see FIG. 1) or 228 (see FIG. 2).
Similarly, the motion detector assembly 224 may include a video camera assembly (not shown) in addition to or in place of the motion detectors 226 to detect motion, the direction of motion, or the number of viewers present. In such an embodiment, the motion detector assembly 224 would be adapted to have an image recognition unit to analyze the video image produced by the video camera assembly for motion, direction, and number of viewers. Such a video camera assembly and image recognition unit are well known in the art. As a person skilled in the art will appreciate, the image recognition unit may be implemented by a series of computer instructions executed by a processor located at either the central controller 102 or the multimedia processing system 202. As shown in FIGS. 1 and 2, a data logger may be included in either the central controller 102 or the multimedia processing system 202. The data logger unit provides data that may be used by an operator at
the central controller 102 to verify whether a particular multimedia data file was successfully processed and displayed in accordance with the associated instruction data. For example, in the case where a multimedia data file is to be played at specific times coinciding with a ten minute interval, the data logger 120 located at the central controller 102 may be commanded by the controller 110 to communicate with the multimedia processing system 202 every ten minutes to ensure that the multimedia data file is being displayed. Alternatively, the multimedia processing system 202 can initiate a transmission to the central controller 102 when a particular multimedia file is played to indicate the time and date when the particular multimedia file was played. The specific form of verification data can be implemented in accordance with industry standards. Similarly, the data logger 228, alternatively included in the multimedia processing system 202, can generate log data in response to successfully processing and displaying a multimedia data file according to the instruction data. The log data may be transmitted back to the central controller 102 for verification, or stored in the non-volatile storage 212 for periodic verification. As mentioned previously, the data logger 120 (see FIG. 1) or 228 (see FIG. 2) may be modified to also store and transmit number data generated by the motion detector assembly 224.
It is to be understood that even though various embodiments and advantages of the present invention have been set forth in the foregoing description, the above disclosure is illustrative only, and changes may be made in detail, yet to remain within the broad principles of the invention. For example, the system 100 has been only described in the context of advertising a movie. However, as one ordinarily skilled in the art will appreciate, the system 100 may be
employed in a variety of appUcations, including its use as a directory for navigating in a large building, or displaying transit routes of a mass transit system. Generally, the system 100 may be used in applications where information is to be conveyed to a viewer. Another example is modifying the multimedia processing system 202 to be interactive with a viewer. In the case where the system 100 is used to display various transit routes, a touch sensitive screen may be included in the multimedia processing system 202 so that a viewer touching a particular route on the display will be provided with the pick-up times for that route, or with information on how to connect to the particular route.
As illustrated herein, the various applications for the system 100 are numerous. However, the general principles applied in the various applications remain within the scope of the present invention. Therefore, the present invention is limited only by the appended claims.