WO2015042655A1

WO2015042655A1 - Variable speed and detection automated media display

Info

Publication number: WO2015042655A1
Application number: PCT/AU2014/050206
Authority: WO
Inventors: Brett Thornton
Original assignee: Brett Thornton
Priority date: 2013-09-05
Filing date: 2014-09-02
Publication date: 2015-04-02

Abstract

The present invention is a computer implemented method for detecting a moving subject (i.e. a person) within a predetermined area. Upon detection of the subject various sensors are used to calculate the height, speed and "Point of View" of the subject. An embodiment of the invention includes a method of displaying images or video on a pre-determined medium, with the aid of detection and/or recorded trigger points. Depending on the detected speed, trigger points will detect and track moving object and display a desired media on a screen/ billboard, keeping the displayed media in synchronisation with the viewers "Point Of View" or "Line of Sight". The method disclosed embodies the methods of constant detection/tracking and the method of displaying a moving media, for the purpose of attracting an intended viewer whilst in motion.

Description

BRIEF DESCRIPTION OF DRAWINGS

Flow Diagram 1

The diagram indicates the present invention illustrating a flow diagram method of detection and query process, in relation to the position of moving media to the

embodiments and the POS/LOS of the intended viewer. Also the embodiment to the invention further comprises the iflustration of incorporated devices to the method, suc as: audio interfaces, display methods, input modules, networks and smart devices.

Diagram 1

The diagram illustrates the intended pedestrian's POS/LOS and the detection

components of the present invention embodiments. The diagram also illustrates the methods of communication and input devices, in relation to the intended viewer and the displayed media.

Diagram 2

The diagram illustrates the intended viewer's POS/LOS within a vehicle (e.g. car) and the detection components of the present invention embodiments. The diagram also ilfustrates the methods of communication and input devices, in relation to the intended viewer and the displayed media.

Diagram 3

The diagram illustrates the intended viewer's POS/LOS within a transportation vehicle (e.g. passenger train) and the detection components of the present invention

embodiments. The diagram also ilfustrates the methods of communication and input devices, in relation to the intended viewer and the displayed media.

Brief Description of Flow Diagram 1

Summary of Flow Diagram

Characteristics of the designed invention, takes form of a hardware embodiment, a software embodiment or a joint hardware/software embodiment. The flow diagram 1 , illustrates features and operating functions of the designed method of displaying media/mediums. The deteqtion-to-dtsp!ay apparatus will be engineered to encompass the hardware and software outlined in "Flow diagram 1 ". The design will consist of a various methods of detection devices [002][003] to accurately track and utilise UWB [019] technology to continually monitor the movement of the intended viewer, for the use of calculating the speed and velocity (Speed = Distance ÷ Time) the displayed

media/medium is required to keep the media frame rate in synchronisation.

Depending on the application, the design also incorporates different methods of displays that can be used. Some of the methods can consist of projectors, plasma screens, LED displays, Quantum dot display, I nterf era metric modulator display, OLED, TFT, LCD, Carbon nanotubes (CNTs) or 3D device displays as such applications. These displays can be attached side-by-side and along the length of the featured wal!. Wit the implementation and arrangement of these technologies, a moving/fixed image can be displayed the length of the selected object [018] at synchronised speed of the targeted viewer/trigger.

Audio interface's [005] can also be implemented along with the wailed display [018]. This can add further enhancements to display telecast. An array of speaker tranducer's [0 4] can be used to sync audio to the received viewer, at the viewer's POS/LOS. The audio can travel through separate speakers at the speed of the viewer and can vary its near field volume, relative to the viewer's position.

The Computer Management System [007] plays a crucial role in this design. The CMS

[007] will be central to computing and handling the detection system. Also, it will control the display interfaces, managing the synchronisation of detection and display; manage audio/visual output, networks systems [008] and all other sub-systems.

In some aspects of the embodiment, human input devices [006] can be integrated into the system for further functionality. Various uses of touch screens [006] and voice activating

[013] modules can be implemented to make the experience interactive. For example, if an advertising media sequence has commenced [001 a], a selected viewer can interact with the display by touch [006] or speech [013], until the end of displayed sequence [001 b]. This wili allow the user to control various features of the media medium, e.g. select a link to an advertised shop/retailer.

In further additions to the embodiment, telecommunications apparatus [008] incorporated into the CMS [007] can tailor desired media to the intentioned detected viewer. Using a viewer's smart telecommunications device [009], metadata can be transmitted from the user's device, through a central database and personalise information back to the Variable Speed Automated Media Display units CMS [007], ready for the media medium to be displayed. Figure 1

Another example of the application can be used for advertising to a pedestrian. As a pedestrian passes a fixed object (e.g. walkway wail), a sequence of displayed

media/mediums will move in frame in time (Speed = Distance ÷ Time) with the pedestrians' POS/LOS.

Motion detectors [010], in combination with thermal imaging detectors [012], speed cameras [003] or laser [011 ] PIR system can detected and pin point a pedestrian and display the sequenced images on the passing wall [018]. By constantly calculating the target's speed and velocity, the displayed image sequence can vary in speed, and synchronise the images on the wall. In relation the pedestrian's POS/LOS. Further to the tracking embodiments, eye tracking devices [004]/software can be implemented to further enhance the detection system and human interface functionality. By registering eye movements, the CMS can interpret the intended pedestrian's interest, and cater further functionality.

In another addition to the embodiment of the invention, audio interfaces [005] can be implemented to enhance the pedestrian's experience with the displayed media/medium. Along with displayed media/medium, an array of speakers can be employed the length of the displayed object, and can vary in "near field" volume, to attract the pedestrian.

In further additions to the embodiment, human input devices [005] [006] and

telecommunications apparatus' [008] can be incorporated to interact with the

communication to the CMS [007]. This is so the metadata collected from the devices can be used to tailor desired media to the intentioned/detected viewer. By using touc screens [006] and/or a pedestrian's smart telecommunications device [009], metadata can be displayed on-wall or transmitted to/from the user's device, through a central database and personalise information back to the Variable Speed Automated Media Display units CMS [007], ready for the media medium to be displayed.

Figure 2

Another example of the application can be used for displaying information to a

driver/passenger of a vehicle (e.g. car). As a viewer is detected and tracked passing a fixed object (e.g. tunnel wall), a sequence of displayed media/mediums will move in frame in time with the driver/passenger's POS/LOS.

Motion detector's [010], in combination with thermal detectors [012]. speed cameras [003] or laser [011] PIR system can detected and pin point a vehicle and display the sequenced images on the passing tunnel wall [018]. By constantly calculating the target's speed and velocity (Speed = Distance ÷ Time), the displayed image sequence can vary in speed, and synchronise the images on the wail, in relation the driver/passenger POS/LOS. In another addition to the embodiment of the invention, audio interfaces [005] can be implemented to enhance the driver/passenger experience with the displayed

media/medium. Along with displayed media medium, an array of transmission devices can be employed the length of the displayed object, and can connected via transmission to attention the driver/passenger.

In further additions to the embodiment, human input devices [005] [006] and

telecommunications apparatus's [009], within the vehicle, can be incorporated to interact with the CMS [007]. This is so the metadata collected from the devices can be used to tailor desired media to the intentioned/detected viewer. By using the vehicle

input/transmitting device or the driver's/passenger's smart telecommunications device [009], metadata can be displayed on-wall or transmitted to/from the user's device, through a central database and personalise information back to the Variable Speed Automated Media Display units CMS [007], ready for the media/medium to be displayed.

Figure 3

Another example of the application can be used for displaying information to a

driver/passenger of a transport vehicle (e.g. passenger train). As a viewer passes a fixed object (e.g. tunnel wall), a sequence of displayed media/mediums will move in frame in time with the driver/passenger^'s POS/LOS.

Motion detectors [010], in combination with thermal detectors [0123, speed cameras [003] or laser [011] trip wire system can detected and pin point the vehicle and display the sequenced images on the passing tunnel wall [018]. By constantly calculating the target's speed and velocity (Speed - Distance ÷ Time), the displayed image sequence can vary in speed, and synchronise the images on the wall, in relation the driver/passenger POS/LOS. In another addition to the embodiment of the invention, audio interfaces [005] can be implemented to enhance the driver/passenger experience with the displayed

media/medium. Along with displayed media medium, an array of transmission devices

[008][009] can be employed the length of the displayed object, and can connected via transmission to attract the driver/passenger.

In further additions to the embodiment, human input devices [005] [006] and

telecommunications apparatus's [009], within the train can be incorporated to interact with the CMS [007]. This is so the metadata collected from the devices can be used to tailor desired media to the intentioned/detected viewer. By using the train's inpu transmitting devices or the driver's/passengers smart telecommunications device [009], metadata can be displayed on-wall or transmitted to/from the user's device, through a central database and personalise information back to the Variable Speed Automated Media Display units CMS [007], ready for the media medium to be displayed.

DETAILED DESCRIPTION

[1001 ] An embodiment of the disclosed invention defines the use of designed detection devices, strategicaliy engineered to detect and track an intended viewer. In addition to the embodiment, the hardware and software outlined in "Flow Diagram 1 ", the detection devices will constantly detect and track the length of desired zone. The use of software based calculations, will be developed for continual tracking of speed, distance and velocity. The use of these algorithms will be used in the mapping of the viewer in the zone and tagging process. The use of both hardware/software, will be required to determine the speed the media-'medium will required along the Object Medium for Display", to keep the media in synchronisation at the POS/LOS/LOS of the intended viewer.

[1002] According to some embodiments, the design will consist of pre-determined "Object Medium for Display", for which a still or moving images/media will be projected or displayed. For example, included in the embodiment, such options can include pedestrian tunnel walls, a length of fixed wall in which a vehicle will travel through, or a train tunnel.

The disclosed embodiments relate generally to identify a length of a fixed object that can b used to display the media/medium in relation to speed of the detected/tracked object. According to an embodiment of the invention, the data of the detection devices will be analysed and calculated to determine the precise and correct position of the displayed media in relation to the POS/LOS/LOS of the intended viewer.

The use of different methods of displays can be used to maximise the dimensions of the pre-determined wall. For example, an array of LCD display would be suitable for wall fiat and straight wall. Or a projected image could be used for a cylindrical medium, in which the projectors software can be used to correct the centering and sizing geometry of the imaged on a distorted wall. According to another embodiment of the invention, this will allow the viewer to view the moving medium without the loss the image/media quality at the speed of the detected/tracked object

Another example of the embodiment is to use flexible LED technology to encompass various and challenging dimensions of a fixed object. The flexible LED technology can be wrapped around a curved or obfong object and calibrated to allow fully viewing enhancements to the intended viewer.

[1003] The design invention will use computer based technology to calculate data, process media displays and mediums interface with audio devices and input devices, as well as connect to various methods of telecommunications in order to manage and operate the "display/projected image and media sequence" . Furthermore, in at feast one embodiment of the invention, speed/iocation detection, eye recognition/detection, telecommunication technology, etc., can be used to quickly identify an intended target's location in either single or plural object in the detected zone. Program code embodied within the "Computer Management System, will then be able to isolate objects within the zone, and use detection technology algorithms to single out each person within the zone in order to process the moving media sequence in sync with the intended viewer's POS/LOS.

In addition, at least one embodiment of the invention, eye movement via eye-detection hardware/software within the detection zone analyses data to query the intended viewer's POS/LOS and attention in relation to the displayed media sequence on the predetermined location on th displayed wall.

With large amounts of data collected, the software allows the algorithm query process images from different situations (such as: detection and location, eye-detection, audio, input devices, etc.) and to analyse and develop templates for analytical purposes. In creating a database of such metadata, a query can be computed with speed and accuracy within the CMS and network systems and adapted for the displayed media.

[1004] An embodiment of the invention includes the methods of process and the use of an array of audio hardware/software to enhance the data of the intended viewer and can be queried and identified. Media audio can projected at near field volume in syne with position of the displayed media/medium and the location of the viewer's POS/LOS. With this embodiment, the focus of the media's audio can adjust with the movement and direction of the detected and tracked viewer.

An inclusion of another embodiment of the design, are audio condensers. An array of microphones can e strategicall installed to allow the viewer's audio input to determine various features of the media displayed. An example of the embodiment is that a determined location of sequenced media, and with incorporation of eye tracking, a intended viewer can instruct the media to display further features e.g. menu selection, playback, location instructions, telecommunication connectivity, etc. Eye tracking can detect whether the viewer shows interested in the featured media, and prompt various features or be instructed with the inclusion of voice instructions.

An embodiment of the invention includes voice recognition software embedded onto the CMS to recognise voice commands. Voice commands can be identified by speech characteristics such as pitch, syllables, notes, etc. These characteristics can be identified and programmed to can carry out specific menu functions

Thus at least one embodiment of the invention uses the microphone to record voice captions which can be added to the media, for data gathering of statistical purposes. The audio file can be embedded onto the media file format, or as a separat media file that can be identified and stamped with image coding and be transmitted to the intended viewer's smart device, e.g. smart phone. [1005] An example of the design, is that with determined location of sequenced media, a intended viewer can instruct the media to display, with the use of human input interaction, and further enhance features e.g. menu selection, playback, location instructions, telecommunication connectivity, etc. Eye tracking can detect whether the viewer shows interested in the featured media, and prompt various features or be instructed with the adaption of this technology.

[1006] Thus at least one embodiment of the invention incorporates network and telecommunications modules within the design. These modules integration defines communications to remote website servers/data storage and/or social networking sites.

Another embodiment of the invention includes the methods of process and the use of network systems of physical hardware/software to enhance the data of the intended viewer and can be queried and identified. These types of technologies can be streamed to further enhance the intended viewer's human interaction with the displayed media.

For example, in at least one embodiment, a method of network systems will be used for the data and streaming of known detected target's location and detection statistics and the use of any updated profiles or status, and can retrieve such data from the social network's API for analysis and templating.

The program embodied in the CMS and network systems will be used to carry out various methods of computing and storing data. With the use of other programming languages alongside the iOS {e.g. C++, Java, Flash Media, Excel, API programmes), details and descriptions will be added to complete the format of file ready for displaying, editing, storing and transmitting.

[1007] In addition, at least one embodiment uses the access of metadata and

communications for geo-city locations and information/data. With the stamping of coordinates and location, mapping software such as Google Maps, Apple Maps, etc can accurately locate the intended viewer. With the metadata queried and analysed, templates based on these locations, data and information, and recognition identifiers can be placed on to the media medium. With the use of computer programming languages, media information can be controlled by the devices input (voice recognition), touch-screen, smart devices) methods to add web-based hyper links at selected points on the displayed media, to add creation and expansion to enhance the advertised experience.

[1008] In addition to the embodiment, the constant and continual use of detection devices, serve as an integral integration to interface with the CMS embedded software. With detection devices queries and telecommunication aided queries, together with eye detection, voice recognition and human input devices, location and media metadata matches can be singularly or plurality cross-referenced, calculated and relayed to the CMS to further enhance the viewer's experience and media content.

[0009] The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. Therefore, the illustrative descriptions or discussions above are not intended to be exhaustive or limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to best utilize the inventions and various embodiments with various modifications as are suited to the principal use contemplated.

The corresponding structures, matertais, acts, and equivalents of all means plus function elements in the claims below are intended to include any structure, or material, to perform the function in combination with other claimed elements as specifically claimed.

Claims

What is claimed:

A computer-implemented method of detecting and querying an intended target, calculating geometry parameters, processing information and displaying a medium/media in relating to the tracked target's "Point Of View". The method from detection to media output will be performed on a various def ined apparatus' having one or more processors and memory storing one or more programs for execution by the one or more processors to perform the method comprising:

(1 ) A computer management system comprising:

a. at least one or more microprocessors;

b. a memory;

c. at least two or more signal emitters;

d. at least two or more signal receiver.

e. one or more network connection means;

f . a power source;

g. a base station in wired or wireless communication with said transceiver and comprising;

(2) The device of claim 1 , method of detecting motion using a transceiver and a base station, comprising the steps of:

i. entering a beginning state of motion and speed detection, wherein a first and

second signal emitters are activated;

II. transmitting a first transmission signal from said first emitter and a second

transmission signal from said second emitter;

III. receiving a initial set of return signals, comprising a first and second return signal with a receiver, wherein said signals are reflected from an object in front of at least one of said first or second emitter;

IV. calculating a difference between said first and second return signals against a first and second predetermined threshold signal;

V. determining whether a foreign object is present based on said difference

calculation;

VI. entering another operational state based on said determination of the presence of a foreign object

(3) The device of claim 2, a detection system, comprising: an infrared motion detector generating a signal indicative of detected motion; characterized in that

I. an infrared signal reflecting surface for directing an incident infrared signal (MIR) to said infrared motion detector;

II. a generator generating infrared remote control encoded data responsive to said signal indicative of detected motion;

Hi. an infrared emitter coupled to said generator for modulation by said infrared

remote control encoded data (IRC); and,

IV. a modulated infrared signal (G!R) from said infrared emitter being directed to said infrared signal reflecting surface for transmission. (4) The device of claim 2, a detection system, comprising: a sensor to detect speed and distance simultaneously, comprising:

I. a target position information provider;

II. a setting target speed information provider;

III. a detected position information detector;

IV. a processor to add position feedback information, position feed-forward

information, speed feedback information and detected position speed information;

(5) The method of claim 2, a detection system, comprising: a thermal detection device wherein the processor is configured to:

I. receiving, by a computing device, thermal event data corresponding to thermal activity,

li, where the computing device is associated with a detection zone and thermal event data is received from a sensor device associated with the detection zone;

III. determining, by the computing device, whether the thermal event data,

corresponding to the thermal activity, exceeds a detection threshold;

iV, when the thermal event data corresponding to the thermal activity exceeds a

detection threshold,

V. creating, by the computing device, a response to the thermal event data

corresponding to the thermal activity; and

VI. when the thermal event data corresponding to the thermal activity does not exceed the detection threshold,

VII. disregarding, by the computing device, the thermal event data corresponding to the thermal activity.

(6) The method of claim 2, 3, 4 and 5 further comprising the step of:

initiating an alarm after a direction of motion is determined.

(7) The method of claim 2, 3, 4 and 5, where creating the response comprises at least one of:

I. creating an audio signal,

II. creating a visual signal,

III. creating an audio-visual signal,

IV. creating computer instructions for data, analysis and process,

V. creating computer instructions for network data, analysis and process

VI.

{8} The method of claim 1 , 2, 3. 4 and 5, further comprising the steps:

I. transmitting a wired/wireless notification to a local computer after a direction of motion is determined;

II. transmitting a wired/wireless notification to a remote computer after a direction of motion is determined;

III. transmitting a wired/wireless notification to a network after a direction of motion is determined; (9) The device of claim 1 , 2, 3, 4, and 5, where the processor is further to:

I. A computer implemented method for displaying/projecting a moving

medium/media including:

i. receiving an identified location of a intended person of interest;

ii. detecting one or more moving persons in a zone for each frame in a plurality of frames of comparison video data,

iii. commencing an image of moving media at the desired detection and trigger point

iv. implementing a computer based synchronisation system to display a

medium at a desired speed in reference to "Point Of View"; and v. applying the detection devices to constantly track and evaluate geometries of the person of interest and the displayed medium.

(10) The method of claim 1 , further comprising: wherein the computer display processor is configured to:

I. receiving, by a computing device, an image o moving media event data

corresponding to a person of interest detection in zone,

II. where the computing device is associated with a detection zone and the display data is received from a sensor device associated with the detection zone;

III. determining, by the computing device, whether the media displa event data, corresponding to the detection activity, exceeds a detection zone;

IV. creating, by the computing device, a response to the display event data

corresponding to the detection activity; and

V. when the display event data corresponding to the detection activity does not

exceed the detection zone,

(1 1 ) The method of claim 9 and 10, further comprising: wherein the computer display touchscreen processor is configured to:

I. receiving, by a computing device, an image o moving media event data

corresponding to a person of interest detection in zone,

Hi. determining, by the computing device, whether the media display event data, corresponding to the detection activity, exceeds a detection zone;

IV. creating, by the computing device, a response to the display event data

corresponding to the detection activity; and

V. when the display event data corresponding to the detection activity does not

exceed the detection zone (12) A method of claim 1 , 8, 9 and 10 further comprising: executable by a host

communicating via a network with a client and a media serve configured to process media content, the method comprising:

I. receiving a first message from the client at the host via the network;

in response to the first message, establishing a session between the host and the media server via the network;

II. receiving information about the media content processed at the media server at the host from the media server via the session;

III. providing the information about the media content processed at the media server from the host to the client via the network;

IV. receiving an instruction from the client at the host to control the media server; and directing the media server to execute the instruction via the session.

(13) The method of claim 1 , 2, 8, 9. 10, 1 1 and 12, further comprising: wherein the computer audio interface processor is configured to:

i. receiving, by a computing device, audio media event data corresponding to a

person of interest detection in zone,

II. where the computing device is associated with a detection zone and the audio data is received from a sensor device associated with the detection zone;

III. determining, by the computing device, whether the audio event data,

corresponding to the detection activity, exceeds a detection zone;

IV. creating, by the computing device, a response to the audio event data

corresponding to the detection activity; and

V. when the display event data corresponding to the detection activity does not

exceed the detection zone

(14) The method of claim 1 , 2, 8, 9, 10, and 11 , further comprising; wherein the computer eye detection interface processor is configured to:

I. receiving, by a computing device, eye-detection event data corresponding to a person of interest detection in zone,

II. where the computing device is associated with a detection zone and the eye- detection data is received from a sensor device associated with the detection zone;

III. determining, by the computing device, whether the eye-detection event data, corresponding to the detection activity, exceeds a detection zone;

IV. creating, by the computing device, a response to the eye-detection event data corresponding to the detection activity; and

V. when the eye-detection event data corresponding to the detection activity does not exceed the detection zone (15) The method of claim 1 , 7, 8, 9. 10, 12 and 13, Wi-Fi, Bluetooth, GPS communications further comprising the steps:

III. transmitting a wired/wireless notification to a network after a direction of motion is determined;

(1Θ) The method of claim 14, further comprtsing: wherein the input recjuest processor is configured to:

Vi. receivings by a computing device, a input request event data corresponding to a person of interest detection in zone,

Vli. where the computing device is associated with a detection zone and the display data is received from a sensor device associated with the detection zone; Vlli. determining, by the computing device, whether the input request event data,

corresponding to the detection activity, exceeds a detection zone;

IX. creating, by the computing device, a response to the input request event data

corresponding to the detection activity; and

X. when the input request event data corresponding to the detection activity does not.

exceed the detection zone

(17) The computer-implemented smart device method of claim 12 and 15,

I. in which the selected group of applications consist of one or more

communications of plural applications: social networking applications, QR codes, Hyper-links, POS and postage, instant messaging applications, social micro-blogs, etc.