CN100452868C - Remote video display method, video acquisition device, method thereof, and program thereof - Google Patents
Remote video display method, video acquisition device, method thereof, and program thereof Download PDFInfo
- Publication number
- CN100452868C CN100452868C CNB2004800001653A CN200480000165A CN100452868C CN 100452868 C CN100452868 C CN 100452868C CN B2004800001653 A CNB2004800001653 A CN B2004800001653A CN 200480000165 A CN200480000165 A CN 200480000165A CN 100452868 C CN100452868 C CN 100452868C
- Authority
- CN
- China
- Prior art keywords
- signal
- image
- information
- lock
- video camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title description 17
- 230000008859 change Effects 0.000 claims abstract description 155
- 238000001514 detection method Methods 0.000 claims description 62
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 56
- 230000005540 biological transmission Effects 0.000 claims description 32
- 230000011664 signaling Effects 0.000 claims description 30
- 238000000605 extraction Methods 0.000 claims description 25
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 230000000712 assembly Effects 0.000 claims description 10
- 238000000429 assembly Methods 0.000 claims description 10
- 238000012856 packing Methods 0.000 claims description 6
- 238000003672 processing method Methods 0.000 claims description 4
- 230000001915 proofreading effect Effects 0.000 claims description 4
- 238000000926 separation method Methods 0.000 claims description 4
- 239000000284 extract Substances 0.000 abstract description 22
- 238000012545 processing Methods 0.000 description 32
- 230000009467 reduction Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 8
- 238000005259 measurement Methods 0.000 description 7
- 230000007246 mechanism Effects 0.000 description 7
- 230000008520 organization Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000011084 recovery Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 239000013256 coordination polymer Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006386 neutralization reaction Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Abstract
An omnidirectional camera performs image sensing of a panoramic object 6 surrounding it, and sends the video signal to an image capturing device 1 , then the image capturing device 1 extracts a video signal of a partial object 61 and sends the extracted video signal to a camera-equipped portable terminal 3 carried in user's hand at a place distant from the omnidirectional camera 2 to display the image of the video signal on a display surface 32 a of the portable terminal, and the user shoots a surrounding object 8 with the portable terminal 3 and sends the surrounding video signal to the device 1 . When the shooting direction of the portable terminal 3 is turned as indicated by the broken line, the device 1 detects a change in the shooting direction of he portable terminal 3 from a difference between the surrounding video signals generated before and after the turning of the portable terminal, and extracts, from a panorama video signal, a video signal of a partial object 62 turned from the partial object 61 in correspondence to the difference and sends the extracted video signal to the portable terminal 3 to display the image of the video signal.
Description
Technical field
The present invention relates to a kind of remote image display packing, be used for by imageing sensor, promptly the video camera (being designated hereinafter simply as video camera) by outputting video signal carries out image detection to the panorama object, and be used for showing the image of being caught to being positioned at apart from the user of video camera remote location; The present invention also relates to image capture apparatus and method thereof and image prize procedure.
Background technology
In order to observe the traffic conditions on road, general method is the pan video camera to be set come the monitoring and controlling traffic situation now; Be sent to the monitoring arrangement that is positioned at the distant place by the vision signal of using the video camera shooting to obtain by order wire, wherein the vision signal that is received is played to show traffic conditions on display.The beholder handles the action button or the bar of remote controller in observation display, to send the control signal of the shooting direction (level and vertical direction) that is used to change rig camera or/and be used to change the zoom lens's of video camera the control signal of zoom amount to the controlling organization of rig camera,, the control rig camera takes direction and shooting condition (disclosing the 205775/99th (announcement on July 30th, 1999)) referring to for example Japanese patent application Koukai so that changing it by order wire.
A kind of service is provided, and it is called as the net cast by the pan video camera on the roof that is arranged on high constructure; The user visits video camera to take the video camera preset time via internet or similar communication network from his personal computer, receive the capture video signal of video camera with broadcast video signal by personal computer, on display, to show their image, and in the image of watching on display, the user operates the zoom amount that described personal computer is taken direction or lens with remote control camera, the various piece of watching wide region panorama object with enjoyment.
Father and mother can the visit of control personal computer be provided with in the kindergarten in its oneself family or in the office video camera, on personal computer, showing from described video camera broadcast video signal, and the shooting direction of the described video camera of remote control or child in all cases the activity of zoom amount to observe him.
And, on the vision signal of the safety camera that is provided with in coming comfortable convenience store is played with display a long way off display image the time, the guard might be when watching the image that is shown the shooting direction or the zoom amount of remote control security video camera.
Such remote control of video camera is can be used for various purposes from its display video signal.In the prior art, control the shooting direction that changes video camera itself by machinery, perhaps button (button) operation by using personal computer or bar are operated and are realized being used for the mechanically control of motion zoom lens.And in the time of user's remote control camera, other users can not control described video camera; That is, by CU video camera scheduled time for example.
Because obtaining the control of desired image by traditional remote image displaying scheme is to come remote control camera itself by action button (button) or bar, therefore the operability of video camera is poorer with the situation that obtains desired image than manual operation video camera in staff or on the remote control The Cloud Terrace, that is, the image that so obtains becomes somewhat different with desired person in some cases.
The purpose of this invention is to provide a kind of remote image display packing, it makes the remote image that can directly show expectation with the user by his same way as of manual manipulation video camera, the present invention and provide a kind of image capture apparatus and method and image prize procedure.
Summary of the invention
According to remote image display packing of the present invention: the remote image sensing apparatus is carried out the image detection of panorama object, and sends by the vision signal of the part of the panorama object of image detection to the image display device in the position different with the remote image sensing apparatus via image capture apparatus; The vision signal that described image display device playback and demonstration are received is come the image as the part of described panorama object; Be positioned at portable terminal device that demonstration place that can see on described image display device has been equipped with video camera and carry out image sensing around it and the vision signal around described image capture apparatus sends; Image acquiring device comes to obtain about the change information of image on every side from the portable terminal device that has disposed video camera according to vision signal around vision signal and current reception around the preceding reception, obtain the vision signal of the part of the panorama object that changes corresponding to the change of image on every side then according to described change information from the remote image sensing apparatus, and send the picture signal that is obtained to image display device.
The width of panorama object is enough to make the degree that it can not be shown as a display frame image of described display unit, perhaps it can be shown to the image of a display frame to a certain degree, but it equals to make every part to show the angular field of view that can both be seen in detail, and the angle of visual field be 360 the degree or still less, the image that show needn't be always continuous.Exist two schemes that are used for image capture apparatus to obtain the vision signal of the change part of panorama object from the remote image sensing apparatus.According to a kind of scheme: by change that checkout gear detects the vision signal around received about the image (hereinafter referred to as present image) of vision signal around current with respect to the change information of the image (hereinafter referred to as at preceding image) of vision signal around preceding that receives from the portable terminal device that has been equipped with video camera; Produce the lock-on signal of the vision signal of a part that is used to obtain the panorama object according to the change information that is detected by the lock-on signal generation device; The lock-on signal that is produced is sent to the remote image sensing apparatus; And the vision signal that is received by the remote image sensing apparatus is sent to image display device by the image relay.Use this scheme, image capture apparatus sends lock-on signal to the remote image sensing apparatus, and receives the vision signal of the change part of panorama object from the remote image sensing apparatus, with the image of the vision signal of the change part that obtains the panorama object thus.
According to another scheme, pan in the image of the user has been equipped with video camera in manual operation portable terminal device with a part of watching the panorama object that shows on the image display device part of object thus might long-range shooting and show the expectation part of panorama object; In this case, can with the user this in he can direct viewing panorama object the same way as operation video camera of position operation video camera.Therefore, the operability of video camera is good, deviation can not occur between the expectation of panorama object part and the image that shows.
Particularly, the invention provides a kind of remote image display packing, comprise step:
Utilize the remote image sensing apparatus that the panorama object is carried out image sensing;
Send described via image capture apparatus to image display device by the vision signal of the part of the panorama object of image sensing in the position different with described remote image sensing apparatus;
The vision signal that described image display device playback and demonstration are received is with the parts of images as described panorama object;
Utilization be positioned at described image display device present position outfit the portable terminal device of the video camera image detection around carrying out, and described vision signal on every side sent to described image capture apparatus;
Change detecting device in the described image capture apparatus according to receive from the portable terminal device that has disposed video camera the preceding around vision signal and current around vision signal obtain about the change information of image on every side;
Obtain the vision signal of the part of the described panorama object that the change corresponding to image around described changes from described remote image sensing apparatus according to described change information; With
Send described obtained picture signal to described image display device.
The present invention also provides a kind of image capture apparatus, comprising:
Image received device is used for receiving vision signal on every side from the portable terminal device that has been equipped with video camera on every side;
Change detecting device, be used for around received video signal detection described around image received device receive current around the image of vision signal with respect to the information of the variation of the image of vision signal around preceding, wherein following image with vision signal around current is called present image, and following will being called at preceding image at the preceding image of vision signal on every side;
The lock-on signal generation device is used for producing lock-on signal from the described change information of the vision signal of the part that is used to obtain the panorama object;
Sender unit is used for sending described lock-on signal to the image detection of carrying out the panorama object and the remote image sensing apparatus of outputting video signal;
The image relay is used for receiving described vision signal from described remote image sensing apparatus, and is used for to sending the vision signal that is received with the described image display device that has been equipped with the portable terminal device same position of video camera.
The present invention also provides a kind of image capture apparatus, comprising:
Image received device is used for receiving vision signal on every side from the portable terminal device that has been equipped with video camera on every side;
Change detecting device, be used for around received video signal detection described around image received device receive current around the image of vision signal with respect to the information of the variation of the image of vision signal around preceding, wherein vision signal around current is called present image, and following will being called at preceding image in preceding vision signal on every side;
The lock-on signal generation device is used for from described change information and produces the lock-on signal of the vision signal of a part that is used to obtain the panorama object at the preceding lock-on signal that produces;
The remote image receiving system is used to receive the vision signal that sends from the remote image sensing apparatus of the image sensing of having carried out the panorama object;
Image capture assemblies is used for catching from the vision signal that is received according to described lock-on signal the vision signal of the part of panorama object;
Picture transmitter device is used for sending described captive vision signal to the image display device that is positioned at the same position place with the described portable terminal device that has been equipped with video camera.
The present invention also provides a kind of processing method of image capture apparatus, comprising:
First step determines whether to receive the shooting direction that is used to change video camera or/and the operational order at lens field angle, wherein following this operation is called camera operation, and the lens field angle is called the zoom amount;
Second step receives the vision signal on every side of object on every side from the portable terminal device that has been equipped with video camera when determining to receive described order in described first step;
Third step is used for video signal detection change information around received, described change information be used to point out described around the image of vision signal with respect to the variation of the image of vision signal around preceding;
The 4th step is used for the lock-on signal according to the vision signal that produces a part that is used to catch the panorama object at preceding lock-on signal and described change information, and wherein this is called as the part object below part panorama object;
The 5th step is used for sending the described lock-on signal that is produced to the remote image sensing apparatus of the image detection of carrying out described panorama object;
The 6th step is used for from remote image sensing apparatus receiving video signals;
The 7th step is used for to sending described received vision signal with the described image display device that has been equipped with the portable terminal device same position of video camera; With
The 8th step is used to determine whether to receive camera operation and ceases and desist order;
If wherein in described first step, do not receive described operational order, then handle and proceed to described the 6th step, if do not receive described ceasing and desisting order, then handle and return described third step in described the 8th step.
The present invention also provides a kind of processing method of image capture apparatus, comprising:
First step determines whether to receive the shooting direction that is used to change video camera or/and the operational order at lens field angle, wherein following this operation is called camera operation, and the lens field angle is called the zoom amount;
Second step receives the vision signal on every side of object on every side from the portable terminal device that has been equipped with video camera when determining to receive described order in described first step;
Third step is used for video signal detection change information around received, described change information be used to point out described around the image of vision signal with respect to the variation of the image of vision signal around preceding;
The 4th step is used for the lock-on signal according to the vision signal that produces a part that is used to catch the panorama object at preceding lock-on signal and described change information, and wherein this is called as the part object below part panorama object;
The 5th step is used for from remote image sensing apparatus receiving video signals;
The 6th step is used for catching from described received vision signal according to the described lock-on signal that is produced the vision signal of the part of panorama object;
The 7th step is used for to sending described captive vision signal with the described image display device that has been equipped with the portable terminal device same position of video camera;
The 8th step is used to determine whether to receive camera operation and ceases and desist order;
If wherein in described first step, do not receive described operational order, then handle and proceed to described the 5th step, if do not receive described ceasing and desisting order, then handle and return described third step in described the 8th step.
The present invention also provides a kind of image capture apparatus, comprising:
Signal receiving device, each that is used for from a plurality of user terminals receives variation information signal;
The lock-on signal generation device, be included in the front signal memory, be used to store the lock-on signal of previous generation of each information that has sent the user terminal of described variation information signal in order to identification, described lock-on signal generation device be used for from the variation information signal that is received and formerly memory user terminals stored identifying information produce a lock-on signal at the preceding lock-on signal that is produced, be used to catch the vision signal of the part of panorama object, be called as the user terminal identifying information below wherein discerning the information of user terminal, and this is called as the part object below part panorama object;
Sender unit is used for sending described lock-on signal that is produced and corresponding user terminal identifying information to the remote image sensing apparatus of the image detection of carrying out the panorama object and its vision signal of output; With
The image relay is used for receiving described vision signal and corresponding user terminal identifying information from described remote image sensing apparatus, and sends described vision signal to the image display device corresponding to the user terminal of user terminal identifying information,
Wherein:
Described variation information signal is represented directional information or/and expect from the zoom information of the part object that forwardly divides the object conversion;
Described lock-on signal generation device is such device, and it is used to produce the extraction benchmark pixel position signalling that obtains by following manner and is used as described lock-on signal: according to described directional information or/and amplify/dwindle signal corresponding to the image of described zoom information and proofread and correct at preceding extraction benchmark pixel position signalling.
The present invention also provides a kind of image capture apparatus, comprising:
Signal receiving device, each that is used for from a plurality of user terminals receives variation information signal;
The lock-on signal generation device, be included in the front signal memory, be used to store the lock-on signal of previous generation of each information that has sent the user terminal of described variation information signal in order to identification, described lock-on signal generation device be used for from the variation information signal that is received and formerly memory user terminals stored identifying information produce a lock-on signal at the preceding lock-on signal that is produced, be used to catch the vision signal of the part of panorama object, be called as the user terminal identifying information below wherein discerning the information of user terminal, and this is called as the part object below part panorama object;
Sender unit is used for sending described lock-on signal that is produced and corresponding user terminal identifying information to the remote image sensing apparatus of the image detection of carrying out the panorama object and its vision signal of output; With
The image relay is used for receiving described vision signal and corresponding user terminal identifying information from described remote image sensing apparatus, and sends described vision signal to the image display device corresponding to the user terminal of user terminal identifying information; With
The camera direction storage device has wherein been stored and has been provided in described remote image sensing apparatus and each identifying information of a plurality of video cameras of angular separation in their shooting direction;
Wherein:
The representative of described variation information signal is desirably in the first direction from the first direction information of forwardly dividing the part object that object changes and/or is desirably in the second direction vertical with first direction from the second direction information of forwardly dividing the part object that object changes or/and the zoom information of the part object of expectation; With
Described lock-on signal generation device is such device, it is by also determining to take direction with reference to the identifying information of storing in the described camera direction storage device according to transmission video camera identifying information signal and described first direction information in preceding generation, be used to produce transmission video camera identifying information signal corresponding to the video camera identifying information of the described shooting direction that is determined as described lock-on signal, and/or the benchmark pixel position signalling that obtains by the benchmark pixel position that is produced of proofreading and correct corresponding to described second direction information is or/and amplify/dwindle signal corresponding to the image of described zoom information.
The present invention also provides a kind of image capture apparatus, comprising:
Signal receiving device, each that is used for from a plurality of user terminals receives variation information signal;
The lock-on signal generation device, be included in the front signal memory, be used to store the lock-on signal of the previous generation of each information that is used to discern the user terminal that has sent described variation information signal, described lock-on signal generation device is used for producing a lock-on signal from the variation information signal that is received with at the lock-on signal in preceding generation of preceding memory user terminals stored identifying information, be used to catch the vision signal of the part of panorama object, be called as the user terminal identifying information below wherein discerning the information of user terminal, and this is called as the part object below part panorama object;
Sender unit is used for sending the described lock-on signal that is produced to the remote image sensing apparatus of the image detection of carrying out the panorama object and its vision signal of output;
The remote image receiving system is used to receive the vision signal that sends from the remote image sensing apparatus of the image detection of having carried out the panorama object;
Image capture assemblies is used for according to the vision signal that is used for to catch from described received vision signal at the lock-on signal of described each user terminal identifying information of storing at the front signal memory part of panorama object;
Picture transmitter device is used for sending described captive vision signal to the user terminal corresponding to described user terminal identifying information.
Description of drawings
Fig. 1 is the figure of the example of the diagram system configuration that is used to illustrate principle of the present invention.
Fig. 2 is the figure that is used to that the image sensor apparatus of omnidirectional's video camera is described and extracts the picture signal of each part object.
Fig. 3 A illustrates the figure that how captive image moves when rotating on the direction of the portable terminal device that has been equipped with video camera at photographic images for example on imageing sensor.
Fig. 3 B is the figure that is illustrated in the image of image before and after moving in Fig. 3 A.
Fig. 4 is the block diagram of example of the system configuration of illustrated embodiment 1.
Fig. 5 is each the figure of example of functional configuration that describes the change detecting device 12 of Fig. 4 and lock-on signal generation device 13.
Fig. 6 is the figure of example that is illustrated in the operation sequence of whole system shown in Figure 4.
Fig. 7 is the flow chart of example of program that is illustrated in the image capture apparatus 1 of Fig. 4.
Fig. 8 is the block diagram of example of the system configuration of illustrated embodiment 2.
Fig. 9 is the flow chart of example that is illustrated in the program of the image capture apparatus 1 among Fig. 8.
Figure 10 be for example at the remote image sensing apparatus 2 that uses a plurality of video cameras and the figure of the relation between the panorama object 6.
Figure 11 is the block diagram of example of the system configuration of illustrated embodiment 3.
Figure 12 is used for illustrating at the image sensing device of the video camera of Figure 11 and extracts the figure of the lock-on signal of part object.
Figure 13 is the block diagram that is illustrated in the modification of the remote image acquisition equipment 2 among Figure 11.
Figure 14 is the figure of example that the memory contents of the example of concrete function configuration of lock-on signal generation device 13 and the camera direction storage device 19 in Figure 11 is shown.
Figure 15 is the flow chart of example that is illustrated in the program of the video camera determining section 13b among Figure 14.
Figure 16 is the figure of another example that the memory contents of camera direction storage device 19 is shown.
Figure 17 is the block diagram of example of the system configuration of illustrated embodiment 4.
Figure 18 is the block diagram of example of the system configuration of illustrated embodiment 5.
Figure 19 is the figure of example that is illustrated in the outward appearance of the pan video camera among Figure 18.
Figure 20 is the block diagram of example of the system configuration of illustrated embodiment 6.
Figure 21 is the block diagram of example that is illustrated in the functional configuration of the image capture apparatus 1 among Figure 20.
Embodiment
Principle explanation of the present invention
With reference to Fig. 1 principle of the present invention is described.
This example uses the omnirange video camera as remote image sensing apparatus 2.Described omnirange video camera is a kind of digital camera, and it is to spend the omnirange imageing sensor of the image of object on every side by sensing 360; Referring to for example Kazumasa Yamazaki, " Principle and Characteristics ofOmnidirectional camera with a mirror, " Computer Vision and Image Media, 125-21, P.155～160, January 19,2001 (Kazumasa Yamazaki, " principle and characteristic " with omnirange video camera of reflective mirror, computer vision and image media, 125-21, the 155th～160 page, January 19 calendar year 2001).The omnirange video camera is commercial obtainable; By it, have images predetermined reference direction, 360 degree panorama objects at as shown in Figure 20 degree and be formed on the rectangle two dimensional image transducer 7 such as CCD, can extract photoelectric conversion signal from it corresponding to respective pixel.
In Fig. 1, remote image sensing apparatus 2 can be spent panorama object 6 on every side by image sensing 360.In this example, the vision signal of the part of the panorama object of being caught by remote image sensing apparatus 2 is extracted and sends to image capture apparatus 1 by transmission line 4, a described part for example is away from the part (hereinafter referred to as the part object) 61 of described benchmark, i.e. each picture element signal in the zone 71 in the imageing sensor in Fig. 27 in 180 degree directions.
Incidentally, in this example, the portable terminal device 3 that has been equipped with video camera also has been provided image display device, and the adaptation signal that is hunted down of the part object 61 that sends and receive from image capture apparatus 1 from remote image sensing apparatus 2 is play by described image display device, and is shown on its display surface 32a.
The user holds the portable terminal device 3 that has been equipped with video camera in his hand, and takes the image of object 8 on every side by the video camera (portable image sensering device) 33 of terminal 3; When he sees part object 61 in the panorama object 6 that shows on display surface 32a, if he will see another part object in the panorama object 6 that he wishes to show a long way off, this user operates the portable terminal device 3 that has been equipped with video camera and takes the image of the part object that expectation sees to guide its video camera 33.For example, taking the right side with part object 62 under the situation of the image of the part object 62 in the 45 degree directions, the direction 33a of video camera 33 that has been equipped with the portable terminal device 3 of video camera 45 degree that turn right are as shown in the chain-dotted line among Fig. 1.
By the video camera 33 of the portable terminal device 3 that has been equipped with video camera carry out image sensing around the vision signal (this vision signal hereinafter referred to as vision signal) on every side of object be sent to image capture apparatus 1 by portable associated transport line 5.Image capture apparatus 1 is from the change the image around being taken by the portable terminal device 3 that has been equipped with video camera of previous and current video signal detection on every side.
Shown in Fig. 3 A, the scope of object 8 was to move right coverage 8b from coverage 8a around the portable terminal device 3 that has been equipped with video camera was taken.Therefore, when seeing the reproduced image of part object 61 received around vision signal be vision signal at the coverage 8a shown in the upside of Fig. 3 B, but the shooting direction that has been equipped with the portable terminal device 3 of video camera rotate that 45 degree are received around vision signal be vision signal at the coverage 8b shown in the downside of Fig. 3 B.The same image section of relatively pointing out of vision signal moves in the accompanying drawings from right to left around being received, and the shooting direction that therefrom can detect the portable terminal device 3 that has been equipped with video camera is turned right.
Receiving on the basis of described instruction, remote image sensing apparatus 2 extracts vision signal from the zone 72 of imageing sensor 7, and send the vision signal of being extracted via remote transmission line 4 to image capture apparatus 1, image capture apparatus 1 sends the vision signal that is received via portable associated transport line 5 to the portable terminal device 3 that has been equipped with video camera.The portable terminal device 3 that has been equipped with video camera shows the reproduced image corresponding to part object 62 on its display surface 32a.
Remote image sensing apparatus 2 object 6 that always pans, and in response to instruction always sends these part objects to the portable terminal device 3 that has been equipped with video camera with the speed of for example per second 30 frames via the image lock-on signal the vision signal of catching from image capture apparatus 1.The portable terminal device 3 that has been equipped with video camera also always sends its vision signal on every side to image capture apparatus 1.
Can be from finding out, the method according to this invention, can realize long-range shooting and show the part object of expecting by following manner: when directly seeing the panorama object, the portable terminal device 3 that operation has been equipped with video camera with the panorama object 6 of taking desired display described part---this provides the operability of the enhancing of video camera, and make and can not bring deviation between the reproduced image of the part object of expectation and its vision signal.For example, come under the situation of remote control camera at button by operation such as the portable terminal device of portable phone, because button operation and operability is relatively poor, and because the little and compact package of button, therefore the operation of error may take place, but method of the present invention there is not this possibility.
Fig. 4 illustrates an example of the system configuration of embodiments of the invention 1 with the block diagram form.In this application, identical drawing reference numeral is represented the parts of identical function, not repeat specification they.
Remote image sensing apparatus 2 comprises: omnirange video camera 21, as the remote image sensing apparatus that is used for image detection panorama object; Signal receiving device 23 is used for receiving the lock-on signal that sends from image capture apparatus 1 by remote transmission line 4; Image acquiring apparatus 24 is used for from the capturing video signal of omnirange video camera 21 extraction part objects; Picture transmitter device 22 is used for sending the video captured signal by remote transmission line 4 to image capture apparatus 1.
The portable terminal device 3 that has been equipped with video camera comprises: image received device 31 is used for receiving the video captured signal that sends from remote image sensing apparatus 2 by portable associated transport line 5; Image display device 32 is used to play and show the capturing video signal that is received; Digital video camcorder 33, it is to be used for the image detection portable image detection device of object on every side; Dispensing device 34 is used for sending the vision signal on every side that is provided for it by portable associated transport line 5 to image capture apparatus 1 from video camera 33.
The image acquiring apparatus 24 of remote image sensing apparatus 2 extracts the vision signal that is hunted down of a frame of being determined by the lock-on signal that is received from omnirange video camera 21.For example, according to described lock-on signal, image capture apparatus extracts corresponding to about a location of pixels (x in imageing sensor shown in Figure 2
1, y
1) pixel (x+a
pI, y+a
pI) burst (wherein i=0, ± 1 ..., ± I, J=0, ± 1 ..., ± J, 2I is the quantity corresponding to the x direction pixel of a frame, and 2J is the quantity corresponding to the y direction pixel of a frame), so the signal that extracts is output as the capturing video signal in zone 71.That is, in this example, the center of the part object that expectation is extracted and the zoom amount signal that is hunted down is specified.In this example, the formation of lock-on signal is benchmark pixel position signalling x, y and the signal a that furthers/zoom out
p
The vision signal that is hunted down is sent to the portable terminal device 3 that has been equipped with video camera via image capture apparatus, and---to be the image of the part object 62 among Fig. 1 in this example---at the image by the part object in the panorama object of remote image sensing apparatus 2 image detection be displayed on the image display device 32 of the portable terminal device 3 that has been equipped with video camera.
The change detecting device 12 of image capture apparatus 1 around received video signal detection about the information of the variation between the image (this will be called present image below image) of current video signal and the image that receives from the portable terminal device 3 that has been equipped with video camera in preceding vision signal.For example, as shown in Figure 5, vision signal is stored in and receives among the buffer storage 12a around being received, and before this, the vision signal on every side in preceding being received and being stored in reception buffer storage 12a is stored in preceding frame memory 12b.Vision signal all is imported into change-detection part 12c around storing in memory 12a and 12b.Change-detection part 12c detects from the direction of motion of preceding image to present image, perhaps detect degrees of motion (distance) or/and present image with respect to the change in the size of the object of preceding image, i.e. zoom amount.Can be for example by being used to analyze the camera operation during taking technology, be that so-called video camera work comes change detected information.Video camera job analysis technology is disclosed in for example YukinobuTANIGUCHI, et al., " PanoramExcerpts:Video Cataloging by Automatic Synthesisand Layout of Panoramic Images; " IECEJ Journal D-II, Vol.J82-D-II No.3, PP.390-398, March 1999 (Yukinobu TANIGUCHI etc., " panorama is taken passages: the video synthetic automatically and layout by panoramic picture is made a catalogue ", the NEC communication enineer D-II of association journal, J82-D-II rolls up No. 3,392 pages, in March, 1999) and a book supervised by Kenji KOGURE, written by Kazuhiko YAMAMORI, " Future Network Technology Series; MediaProcessing Techniques 4; " Denki-Tsuushin Kyoukai, First Edition, November 10,1999 (by Kenji KOGURE supervision and the book " future network technology series; medium treatment technology 4 " write by Kazuhiko YAMAMORI, 20, Denki-Tsuushin Kyoukai, front page, on November 10th, 1999).
Explanation is used to analyze about video camera work operation (pan), the scheme example of operation (inclinations) and the operation (zoom) by camera lens change visual angle up and down.Before being located at image be f (x, y) and present image be f ' (x ', y '), wherein
(x’，y’)＝(ax+d
x，ay+d
y)
That is, establish a, d
xAnd d
yExpression is used to illustrate the parameter of zoom, pan and inclination respectively.Below the computational minimization image f (x, y) and parameter a, the d of the variance between the f ' (x ', y ')
xAnd d
y:
(1/N)∑
x，y{f(x，y)-f’(x’，y’)}
2。
These parameters a, d
xAnd d
yBe used as change information.In other words, change-detection part 12c calculated example such as a, d
xAnd d
yTo obtain change information; That is, a is the information that furthers/zoom out, d
xAnd d
yIt is directional information.Under the situation of the left-right rotation that only detects the portable terminal device 3 that has been equipped with video camera, described parameter only needs to be set at a=1 and d
y=0; Under the situation that only detects the behavior of rotating up and down, a=1 and d
x=0; Under the situation that only detects the change in zoom, d
x=d
y=0; Under the situation that only detects the rotation behavior, a=1.
Lock-on signal generation device 13 is from the change information that detected by change detecting device 12 and produce the lock-on signal of the vision signal that is hunted down of the part object that is used to obtain the panorama object at preceding lock-on signal.For example, as shown in Figure 5, in lock-on signal generation device 13, at lock-on signal x, y and a of preceding generation and current use
pBe stored in front signal memory 13a; These signals x, y and a
pWith such as a, d
xAnd d
yThe x+d of calculating by in addition part 13b of change information
x→ x, the y+d in addition part 13c
y→ y and a in the part 13d that multiplies each other
p* a → a
p, and they are replenished to produce new lock-on signal x, y and a
p, new lock-on signal x, y and a
pBe provided to the lock-on signal of wherein storing with renewal from its 13a at front signal, they are output to dispensing device 14 simultaneously.When image capture apparatus 1 carries out image do not catch when handling, in front signal memory 13a, storing predetermined lock-on signal as initial value.Such as the center x of the transducer in Fig. 2, y and at the half value a of maximum zoom amount
pWhen image capture apparatus 1 begins to catch processing, at initial value signal x, y and a in front signal memory 13a
pBe used as lock-on signal and send to remote image sensing apparatus 2.
When the value of information converting hour, for example work as d
x=1 o'clock, the image of the part object of the panorama object that shows on the portable terminal device 3 that has been equipped with video camera remained basically unchanged; In order to handle this point, preferably provide round off part 13e, 13f and 13g, by them, if d
x, d
yWith the predetermined value of a less than them, then d
xAnd d
yBe rounded to 0, a is rounded to 1, and they are provided to addition part 13b and 13c and the part 13d that multiplies each other.Described abandon the above-mentioned predetermined value that is provided with among part 13e, 13f and the 13g in the neutralization of described discarded part branch according to the use pattern of this remote display system and different.Under the situation of the part object that shows remote scene, described predetermined value is selected as bigger, and prevents that at using system they are selected as less under the situation of error behavior of space; For for example d
x, when its minimum be 5 or more hour it to be considered round down be 0.
Generally, it is not preferred upgrading the lock-on signal that will send to remote image sensing apparatus 2 when frame of each reception, because its increases treating capacity.Even carry out renewal for each frame, the user also is difficult to perceive the change in the part subject image that is received.Therefore, can come at interval to send lock-on signal by reasonable time to remote image sensing apparatus 2.Can come suitably to determine this time interval according to the use pattern of system: for example, when changing quickly the situation of object is under the situation at traffic monitoring, be per 1/10 second; When object was scenery, for example per 1/3 second was every several seconds in some cases.For this reason, update instruction part 12d for example is provided in change detecting device 12, and receive buffer storage 12a and come to catch the vision signal on every side of a frame predetermined update time at interval in response to the instruction from update instruction part 12d, change-detection part 12c is to come change detected information update time at interval.Perhaps, receive the content of buffer storage 12a for each frame update of vision signal on every side, and when detecting change information, the content that receives buffer storage 12a is sent at preceding frame memory 12b at every turn.When all changes information that detects in change-detection part 12c is zero, promptly as d in this example
x=d
y=0 and during a=1, needn't produce and send lock-on signal to the remote image sensing apparatus, in the remote image sensing apparatus, also needn't produce lock-on signal.Can only optionally produce and send lock-on signal corresponding to having experienced those change informations that change.
In remote image sensing apparatus 2, the lock-on signal that is received by signal receiving device 23 is imported into image acquiring apparatus shown in Figure 4 24, and the previous lock-on signal that receives is stored among the storage area 24a with the new lock-on signal that receives.According to the lock-on signal in storage area 24a of renewal like this, image acquiring apparatus 24 is extracted in the vision signal of the part object in the panorama object of being taken by omnirange video camera 21.For example, the output of the imageing sensor 7 of omnirange video camera 21 is as shown in Figure 2 from always according to treating that lock-on signal (benchmark pixel position signalling) is extracted in its center (benchmark) and has pixel (x, the state of the vision signal in a frame zone 71 y) is always changed into according to the lock-on signal that upgrades and is extracted in the state of vision signal that its center has a frame zone 72 of pixel (x ', y ').In the example of Fig. 2, the shooting direction out of plumb ground that has been equipped with the portable terminal device 3 of video camera changes, and zoom amount and shooting direction also not only turn right, i.e. change information d
y=0 and a=1 and d
xDetected, and lock-on signal is from x, y, a
pBecome x ← x+d
x, y ', a '
p← a
pUpdated information x, y, a
pEach is coupled with a left-falling stroke, and ['] is to distinguish between they and the information to be updated.D in Fig. 4
x=D
1
The vision signal of extracting from remote image sensing apparatus 2 that is hunted down is sent to the portable terminal device 3 that has been equipped with video camera via image capture apparatus 1 from picture transmitter device 22.Therefore, the image that shakes on the image display device 32 that is presented at the portable terminal device 3 that has been equipped with video camera also changes.That is, the expectation part object in the panorama object changes according to the video camera work (direction and/or zoom operation) of the portable terminal device 3 that has been equipped with video camera, and the vision signal that is hunted down of the part object that changes is reproduced and be presented on the image display device 32.
Zoom amount a will be described
pAt maximum zoom amount a
PMThe time, image acquiring apparatus 24 extracts 2I and the 2J in y direction of picture element signal in the x direction of imageing sensor 7 (Fig. 2).When the zoom amount is a
pThe time, with a
PM/ a
pThe interval of pixel is extracted 2I and 2J signal respectively in x and y direction.By this way, as zoom amount a
pWhen big, from the narrow zone imageing sensor 7, extract the vision signal that is hunted down of part object, and work as a
pHour, from the vision signal that is hunted down of a wide extracted region part object, and the image that shows on the image display device 32 of the portable terminal device 3 that has been equipped with video camera is also along with at zoom amount a
pIn change dwindle/amplify.
The image relay 15 of image capture apparatus 1 is introduced be hunted down vision signal that change back to portable terminal device 3 transmissions that have been equipped with video camera from remote image sensing apparatus 2 receive according to the grade of the portable terminal device 3 that has been equipped with video camera and the specification of portable associated transport line 5 to vision signal in conversion portion 15a (see figure 4), and the screen size of described change such as the vision signal that is hunted down is to the conversion of the conversion of the screen size of image display device 32 and the amplitude of each pixel (brightness) resolution or compressed encoding.
Referring to Fig. 6, the flow process of the processing in the system that summary is shown in Figure 4.The portable terminal device 3 that has been equipped with video camera sends to image capture apparatus 1 and begins visit (F1).Image capture apparatus 1 sends to remote image sensing apparatus 2 and begins visit or lock-on signal (initial value) (F2).Remote image sensing apparatus 2 extracts predetermined or corresponding to the vision signal that is hunted down (should will be also referred to as " signal is hunted down " below " vision signal is hunted down " in some cases) of the part object of lock-on signal (F3), and the signal that is hunted down is sent to image capture apparatus (F4) in real time.The signal that is hunted down (F5) that image capture apparatus 1 is received to portable terminal device 3 relayings that have been equipped with video camera.
The portable terminal device 3 that has been equipped with video camera is play the image (F6) of signal with the display part object that be hunted down that is received.The image detection of object has been equipped with portable terminal device 3 execution (F7) of video camera on every side.Sent to image capture apparatus 1 (F8) in real time by taking signal around the image detection operation.
The change of image capture apparatus 1 from the image of vision signal around being received detects the change (F9) in the camera operation of the portable terminal device 3 that has been equipped with video camera, if and detect such change, then produce lock-on signal (F10), and send described lock-on signal (F11) to remote image sensing apparatus 2.
Remote image sensing apparatus 2 changes the vision signal (F12) of the part object that will extract according to the lock-on signal that is received.Repeat the processing behind the F3 that extracts the signal that is hunted down according to lock-on signal thereafter, and from the portable terminal device 3 that has been equipped with video camera when image capture apparatus 1 sends the finish command (F13), image capture apparatus 1 is to described the finish commands of remote image sensing apparatus 2 relayings (F14), and remote image sensing apparatus 2 stops to send the signal that is hunted down (F15) of part object.
Referring to Fig. 7, the example of the program of image capture apparatus 1 will be described below.
Step S1: wait for from portable terminal device 3 receptions that have been equipped with video camera beginning visit.
Step S2: receiving when beginning to visit, sending to remote image sensing apparatus 2 and begin to handle or at the lock-on signal (initial value) in front signal memory 13a.
Step S3: determine whether to receive the camera operation order.
Step S4: if the operational order of not receiving, then from the signal that is hunted down of remote image sensing apparatus receiving unit object.
Step S5: send the signal that is hunted down that is received to the portable terminal device 3 that has been equipped with video camera.
Step S6: if receive operational order, then preserve described order or mark is set, and receive vision signal on every side from the portable terminal device 3 that has been equipped with video camera at step S3.
Step S7: check whether to arrive to change and detect regularly, if so, then
Step S8: carry out change detection by change detection device 12 and handle to obtain change information.
Step S9: use the change information obtained and produce new lock-on signal, and use the new lock-on signal that produces to be updated in preceding lock-on signal at preceding lock-on signal.
Step S10: send the new lock-on signal that produces to remote image sensing apparatus 2, and return step S4.
Step S11: behind step S5, determine whether to receive operation stop command,, then return step S7 if do not have.
Step S12: cease and desist order if receive, then eliminate the operational order or the described mark of being preserved so far that resets, and determine whether to receive the operation recovery order at step S11.
Step S13: if do not receive the operation recovery order, then determine whether to receive the finish command, if not then return step S4.
If in step S7 no show change detection regularly, then arrive step S4, if receive the operation recovery order, then preserve described order and mark for example is set at step S12, return step S6 thereafter.
Use above-mentioned such program, when the user sends when beginning to visit to image capture apparatus 1 from the portable terminal device 3 that has been equipped with video camera, the signal that is hunted down of part object is played and is presented on the portable terminal device 3 that has been equipped with video camera; If the user will see with the image of shown different part object or with its amplification or dwindle, then send the camera operation of camera operation order to remote image sensing apparatus 2 to be used to expect from the portable terminal device 3 that has been equipped with video camera, and when the image of the part object that shows expectation, transmit operation is ceased and desisted order.Therefore, allow the user when therewith carrying the portable terminal device 3 that has been equipped with video camera, to keep watching for example image of part object.Can only change the part object that expectation is watched as required by sending the operation recovery order.
When receiving the finish command in step S13, image capture apparatus 1 can send the finish command (S14) so that remote image sensing apparatus 2 finishes to send the signal that is hunted down of part object immediately when receiving described the finish command to remote image sensing apparatus 2 as required.Another kind of possible method is to finish to send the signal that is hunted down behind the signal that is hunted down that sends for the first time the part object in the past during certain time.Vision signal around also can in reception begins to visit and receive by the interval between the operational order shown in the dotted line among Fig. 7, receiving.Though check that at preset time change-detection regularly handles for example therefore to carry out change-detection at step S7 at interval in the above, also may omit step S7, and always carry out the change-detection processing.Shown in the dotted line among Fig. 7, the image on every side that can determine whether current reception after change-detection is handled is different with image around preceding reception, and if find to change, then program proceeds to step S4, if and discovery changes, then program proceeds to step S9 (S15).
In embodiment 1, the omnirange video camera is used as the image detection device of remote image sensing apparatus 2, and image capture apparatus 1 sends lock-on signal so that it extracts the signal that is hunted down of part object to the remote image sensing apparatus, but in embodiment 2, the omnirange video camera is used as the image detection device of remote image sensing apparatus 2, and make remote image sensing apparatus 2 send all captive vision signals to image capture apparatus 1, image capture apparatus 1 extracts the signal that is hunted down of part object from the vision signal that is hunted down that is received.
Fig. 8 illustrates an example of the system configuration of this embodiment.The element different with Fig. 4 only is described below.In remote image sensing apparatus 2, omit image acquiring apparatus 24, and sent all vision signals that are hunted down of omnirange video camera 21 from picture transmitter device 22 to image capture apparatus 1.Signal receiving device 23 can be omitted, but also can be provided on the contrary so as the remote image sensing apparatus in response to begin from the beginning orientation of image capture apparatus 1 by omnirange video camera 21 image referring to or beginning send captive vision signal to image capture apparatus 1, and finish to send captive vision signal to image capture apparatus 1 in response to the finish command.
In image capture apparatus 1, remote image receiving system 16, image acquiring apparatus 17 and picture transmitter device 18 are provided, and have not sent lock-on signal to remote image sensing apparatus 2.The vision signal that is hunted down from remote image sensing apparatus 2 is received by remote image receiving system 16, and is used for extracting the part objects signal that is hunted down by image acquiring apparatus 17 from the lock-on signal of lock-on signal generation device 13.For example, the vision signal that is hunted down that is received is stored among the buffer storage 17a in the image acquiring apparatus 17; In this case, vision signal is stored, and each picture element signal uses the pattern identical with the pixel arrangement in the imageing sensor 7 for example shown in Figure 2 to arrange.By extracting the be hunted down identical method of method of signal of part objects, according to the lock-on signal in front signal memory 13a (see figure 5) in the lock-on signal generation device with the image acquiring apparatus in remote image sensing apparatus 2 in embodiment 1 24---be according to benchmark pixel position signalling x, y in this example and dwindle/amplifying signal a
p---come to read the part object signal that is hunted down from buffering memory 17a.The part object of so the reading signal that is hunted down is sent to the portable terminal device 3 that has been equipped with video camera from picture transmitter device 18.In this case, can as in embodiment 1, before transmission is hunted down signal, in conversion portion 18a, carry out the Signal Processing that is hunted down, handle such as screen size conversion and compression.Can send as remote image sensing apparatus 2 by dispensing device 14 as requested and begin visit and the finish command.This embodiment is except above-mentioned identical with embodiment 1 these.
Fig. 9 shows the example of the program of the image capture apparatus 1 in embodiment 2.The same with the program described in Fig. 7, execution in step S1, S2 and S3.If in step S3, do not receive the order that is used for camera operation, then in step S4 ', receive the vision signal that is hunted down from remote image sensing apparatus 2, then in step S16 according to the signal that is hunted down that comes to extract the part object at the information converting of in front signal memory 13a, storing from the vision signal that is hunted down that is received, and in step S17, send the part object that so the extracts signal that is hunted down to the portable terminal device 3 that has been equipped with video camera.
After transmission is hunted down image, program proceeds to step S11, determines whether that wherein receiving camera operation as in embodiment 1 ceases and desist order, then execution in step S12 and S13 in regular turn, if and do not receive the finish command, then program would proceed to step S4.This embodiment is identical with embodiment 1 except above-mentioned, and generation and the obtainable identical work effect of the latter.The handling process of system is with identical in embodiment 1, except: remote image sensing apparatus 2 sends all vision signals that are hunted down in step F 3 to image capture apparatus 1; Omit step F 12; And image capture apparatus 1 is carried out processing shown in Figure 9.
The a plurality of digital cameras of embodiment 3 uses are used as the image detection device of remote image sensing apparatus 2, and image capture apparatus 1 is captured in the vision signal of the part object in the panorama object by extract it in remote image sensing apparatus 2.
In Figure 10, show the relation between remote image sensing apparatus 2 and panorama object 6 in embodiment 3 for example.In this example, as the video camera with 8 video cameras 2 of remote image sensing apparatus 2
1To 2
8Be set at the shooting direction that fixes them on 360 degree and with angle same at interval.In this example, video camera 2
1To 2
8The view angle theta of each is selected as being slightly larger than the angular distance of 45 degree, so that the field of adjacent camera partially overlaps to allow the continuous part object of image referring to the panorama object.Content provider (CP) 6 forms cylinder in the same distance with remote image sensing apparatus 2, but in order to understand the part object easily, panorama object 6 is shown as its following diameter less than last diameter.
For example, video camera 2
1Photographing section object 61, and video camera 2
2The part object 62 of shooting from the 45 degree directions on the direction right side of photographing section object 61.Use this remote image sensing apparatus 2, might take the employed the 2nd
nBranch panorama objects 6 such as individual video camera and any part object that obtains.Incidentally, the quantity of video camera is not limited to 8 especially.Take that the angular distance of direction always do not equate, promptly when panorama object 6 comprises the part that needn't see, video camera is oriented does not take such part that do not need.
An example of the system configuration of embodiment 3 is illustrated among Figure 11.With only explanation and those different parts in the configuration of Fig. 4.Remote image sensing apparatus 2 has for example a plurality of video cameras of arranging as shown in figure 10 2
1To 2
N Video camera 2
1To 2
NHas identical structure, below in conjunction with video camera 2
1It is described.Situation in image acquiring apparatus 24 image patterns 4 equally is used, but its structure and processing (operation) are different from the image acquiring apparatus 24 of Fig. 4.That is, the formation of the lock-on signal that receives from image capture apparatus 1 comprises video camera identifying information IDp and comprises zoom parameters a in case of necessity
POr/and location parameter y.Therefore, image acquiring apparatus 24 comprises: storage area 24a is used to store a
P, y; ID storage area 24b is used to store video camera 2
1Video camera identifying information ID1.When not using a
PDuring with any one of y, omit storage area 24a.
When the coupling of the video camera identifying information IDp in the lock-on signal that receives by signal receiving device 23 when to be stored in described video camera identifying information among the ID storage area 24b---be ID1 in this example---, video camera 2
1 Video camera 21 begin to take, and carries out image is caught processing; Otherwise video camera 21 always remains in the shooting state, and catches image from video camera 21.Use a in lock-on signal respectively
PBe updated in memory contents a among the storage area 24a with y
PAnd y.
Can use the mode identical to come carries out image to extract and handle, but ought not use a with essence in the situation in embodiment 1
PDuring with y, be hunted down as the signal that is hunted down of the part object from video camera 21 from the picture signal of video camera 21 output, and be imported into picture transmitter device 22.The transducer 7 of video camera 21 for example is a rectangle, as shown in figure 12; Width is by the quantity 2 (a of pixel
PM/ a
PS) the I qualification, 2 (a
PM/ a
PS) I is that quantity 2I by the level of the image that will show (x direction) pixel multiply by a value (a
PM/ a
PS) and a value of acquisition, (a
PM/ a
PS) be by with a
PMaximum a
PMDivided by a
PMinimum value a
SAnd a value that obtains, length is by the quantity 2 (a of pixel
PM/ a
PS) Δ y
MJ limits, and promptly the quantity 2J of vertical (y direction) pixel by the image that will show multiply by 2 (a
PM/ a
PS) and multiply by the quantity Δ y of the pixel that is used for maximum (lifting/reduction) inclination angle again
MAnd a value that obtains.On the contrary, determine a by the quantity of the pixel in the Width of device 7
PMinimum value a
PS, and by the minimum value a based on the pixel quantity in the length direction of device 7
PSDetermine maximum (lifting/reduction) inclination angle Δ y
M
For example, if stored parameters is a in storage area 24a
PAnd y, then pixel ((a
PM/ a
P) i, y+ (a
PM/ a
P) j) (i=0, ± 1 ..., ± I, j=0, ± 1 ..., ± J) signal is hunted down as the signal that is hunted down of the part object from zone 71, and described regional 71 width is 2 (a
PM/ a
P) I, length is 2 (a
PM/ a
P) J, a position y on the bisector (center line) of the device 7 in the x direction of its center in Figure 12 is when using a
PAnd y ' is when coming undated parameter, pixel ((a
PM/ a
P') i, y '+(a
PM/ a
P') j) and signal be hunted down as the signal that is hunted down from zone 72 part object, the width in zone 72 is 2 (a
PM/ a
P') I, length is 2 (a
PM/ a
P') J, the position y ' of its center on described center line.
As mentioned above, in remote image sensing apparatus 2, come from video camera 2 according to the lock-on signal that sends from image capture apparatus 1
1To 2
NAny one take out part object signal that is hunted down, and send described signal to image capture apparatus 1 by picture transmitter device 22.Remote image sensing apparatus 2 and image capture apparatus 1 can interconnect as shown in figure 11, and wherein video camera 2
1To 2
NBe connected to image capture apparatus 1 via partial line, but remote image sensing apparatus 2 also can be via being connected at the reversible line shown in Figure 13 4 with image capture apparatus 1.That is, received by signal receiving device 23 from the lock-on signal of image capture apparatus 1, the lock-on signal that is received is divided device 26 and is distributed to video camera 2 then
1To 2
NEach image acquiring apparatus 24,, make up from video camera 2 by composite set 27 then
1To 2
NThe part object of the video camera separately 21 of (usually from only in the them) signal that is hunted down, and the part object that the is combined signal that is hunted down is sent to image capture apparatus 1 by picture transmitter device 22.
Go back to Figure 11, in image capture apparatus 1, corresponding to video camera 2
1To 2
NEach the directional information of shooting direction be stored in accordingly in the camera direction storage device 19 with the video camera identifying information IDi of each video camera.For example, the angle between the shooting direction of adjacent camera is stored.Figure 14 shows an example.In Figure 14, video camera 2
NQuantity N be 8, and video camera 2
1To 2
NVideo camera identifying information separately be represented as ID1 to ID8.In taking direction at video camera 2
1With 2
2Between the angular distance Δ * 1 (value of the quantity form of the pixel of the image that is hunted down on display surface; Explanation below this same sound source) by for ID1ID2 storage, and in taking direction at video camera 2
2With 2
3Between angular distance Δ * 2 by for the ID2ID3 storage, and the angular distance between other adjacent camera is stored similarly.
Lock-on signal generation device 13 is gone up with the related device in Fig. 4 different in structure and processing (operation).In Figure 14, show an example of functional configuration.In this example, change detecting device 12 is shown as by aforesaid configuration of reference Fig. 5 and method and detects directional information d as information converting
x, d
yWith zoom information a.In front signal memory 13a, at preceding video camera identifying information IDp, y direction position y and zoom amount a
PBe stored.As their initial value, for identifying information IDp, y=0 predetermined video camera identifying information ID1 is set, and zoom amount a
PBe set at the median between its maximum and the minimum value.
Information d
xBe imported into video camera identification division 13b.With reference to Figure 15 processing in video camera identification division 13b is described below.If d
xSymbol be positive (S1), then use IDpIDp+1 to read out in video camera among preceding video camera identifying information IDp from camera direction storage device 19 and take direction and the video camera in current video camera identifying information IDp+1 and take angle delta x between the direction as the address
+ 1(S2).Check to determine whether d
xBe equal to or greater than Δ x
+ 1(S3), if it is equal to or greater than Δ x
+ 1, then export IDp+1 (S4), if it is not equal to or greater than Δ x
+ 1, then former state is exported IDp (S5).
If d in step S1
xSymbol be not positive, then use IDp-1IDp to read out in video camera IDp-1 and the IDp from storage device 19 and take angle delta x between the direction as the address
-1(S6), check then to determine whether d
xAbsolute value be equal to or greater than Δ x
-1(S7),, then export IDp-1 (S8), if it is not equal to or greater than Δ x if so
-1, then former state is exported IDp (S9).
During hour maybe when the shooting direction flip-flop wide-angle of the portable terminal device 3 that has been equipped with video camera, omit step S4 and S8, at the angular distance between the shooting direction of adjacent video camera shown in the dotted line among Figure 15; If at step S3 d
xBe equal to or greater than Δ x
+ 1, then read the angular distance of distance in abutting connection with the shooting direction of video camera, i.e. angular distance Δ x between the shooting direction in IDp+1 and IDp+2 from storage device 19
+ 1(step S10) checks then to determine whether d
xBe equal to or greater than Δ x
+ 1+ Δ x
+ 2(S11),, then export IDp+2 (S12), if it is not equal to or greater than Δ x if so
+ 1+ Δ x
+ 2, then export IDp+1 (S13).
When in step S7 | d
x| be equal to or greater than Δ x
-1The time, then use IDp-2IDp-1 to read the angular distance of distance in abutting connection with the shooting direction of video camera, i.e. angular distance Δ x from storage device 19
-2And check (S14), to determine whether | d
x| be equal to or greater than Δ x
-1+ Δ x
-2(S15), if so, then export IDp-2 (S16),, then export IDp-1 (S17) if not like this.Similarly, can determine angular distance with the shooting direction of another remote video camera.
When the angular distance when in the example at Figure 10 between the shooting direction of the video camera of adjacency equates entirely, the quantity Δ x of the pixel that---is 45 degree in this example---only corresponding to that angle is stored in the camera direction storage device 19, shown in dotted line, and omit step S2 and S6; In step S3, check to determine whether Δ x≤d
x, in step S7, check with determine whether Δ x≤| d
x|.For the wide-angle camera operation, be omitted in step S4, S8, S10 and S14 among Figure 15, shown in dotted line, whether in step S11, check 2 Δ x≤d then
x, whether in step S15, check 2 Δ x≤| d
x|.Also under this situation, can determine to take the angular distance of direction similarly apart from the video camera of another remote video camera.
Go back to Figure 14, below lock-on signal generation device 13 will be described.Information d for input
yAnd a, in addition part 13c, d
yBe coupled with at preceding information y, in the part 13d that multiplies each other, a is multiplied with the in preceding information a
P, as above described with reference to Fig. 5.Output from various piece 13b, 13c and 13d is provided to sender unit 14, is upgraded with above-mentioned same way as in the content of front signal memory 13a simultaneously.For each input, can provide to abandon part 13e, 13f and 13g.In this case, work as d
xWhen being equal to or less than the predetermined value in abandoning part 13e, currency IDp (IDp in memory 13a) is output and not be used in processing among the video camera identification division 13b.
In camera direction storage device 19, the shooting direction that can store a plurality of video cameras in advance is with respect to for example as shown in figure 16 the angle of one wherein predetermined shooting direction.In the example of Figure 16, the shooting direction of the video camera of video camera identifying information ID4 is used as normative reference, and each shooting direction of other seven video cameras is stored as the quantity of the pixel in a frame of the image that is hunted down with respect to the angle of this reference direction.In this case, in processing shown in Figure 15, for example read out in angle among IDp and the IDp+1, and determine whether d at step S2
xBe equal to or greater than poor between two angles.
According to the use pattern, when being scheduled to the direction of the part object that the user will at first see, must make each video camera identifying information corresponding to the south and north, east and west direction, for example north, northeast, east ... direction.The shooting direction of video camera that can be by predetermined each video camera identifying information and therefore arrange that remote image sensing apparatus 2 is limited to the correspondence between video camera identifying information and the south and north, east and west direction.But, in some cases, arrange that in this wise remote image sensing apparatus 2 is consuming time.For fear of this point, as shown in figure 11, video camera information measurement mechanism 25 is provided at each video camera 2
1To 2
NIn, and the similar side's transducer 25a by magnetic compass or video camera information measurement mechanism 25 measures and takes the angle of direction with respect to positive north, with obtain about south, north, east or west in the information of shooting direction of each video camera.In graphic example, obliquity sensor 25b by accelerometer also is provided, detect a value Δ y by it, it represents angle with respect to the shooting direction of horizontal screen, the i.e. angle of the y axle of the imageing sensor 7 of video camera 21 (lifting/decline angle) with the quantity of the pixel on the frame of image that is hunted down.South, north, east or west to inclination angle Δ yn and the video camera 2 measured by video camera information measurement mechanism 25
n(n=1 ..., video camera identifying information IDn N) is sent to image capture apparatus 1 by the signal transmission 23 that the project in the bracket in Figure 11 and 13 is pointed out together.Image capture apparatus 1 passes through signal transmission 14 from each video camera 2
nReceive its identifying information IDn, south, north, east or west to inclination angle Δ yn, and they are stored in the camera direction storage device 19 corresponding to sign IDn for example shown in Figure 16.
When the user begins to visit to image capture apparatus 1, image capture apparatus 1 is read the identifying information of video camera, in the example of Figure 16, be ID3, it takes direction be south, north, east or west in be scheduled to one, for example be north---the ID3 in Figure 16 example, and image capture apparatus 1 read liftings/reduction angle Δ y3, and to remote image sensing apparatus 2 these values of reading of transmission, if necessary, also send the initial value a of the parameter (zoom level) that furthers/zoom out
PInitial value a
PCan be stored in each video camera 2 in advance
1To 2
NThe storage area 24a of image acquiring apparatus 24 in.Described lifting/reduction angle Δ yn is deducted in the output of the addition part 13c from the correction portion 13h among Figure 14, is provided to sender unit 14.Use value to be corrected in correction portion 13h is carried out the renewal of a y in front signal memory 13a.For example, when the user wants read fortune for the part subject image of horizontal direction, omit high with respect to horizontal plane if video camera is taken direction, then the part subject image of part subject image from horizontal direction that forms on the imageing sensor 7 of video camera 21 moved a value corresponding to the shooting direction that makes progress, i.e. Δ yn.Therefore, the Δ yn's in correction portion 13h the part subject image that provides with respect to horizontal direction is provided.Incidentally, the initial value of y is set up y=0.
As mentioned above, in response to lock-on signal, from video camera 2 from image capture apparatus 1
nSend part object vision signal to catch described signal to image capture apparatus 1, as the situation in embodiment 1, described signal is by relaying and send to the portable terminal device 3 that has been equipped with video camera; Therefore, can understand easily, as in embodiment 1.The user can directly see the panorama object and select its part object in the video camera of operation portable terminal device 3.The program of image capture apparatus 1 in this case is with shown in Figure 7 identical.Program in this case also can be changed so that receiving when beginning to handle, and image capture apparatus sends it to remote image sensing apparatus 2, and remote image sensing apparatus 2 begins to visit and from predetermined video camera 2 in response to described
nSend the signal that is hunted down of part object to image capture apparatus 1.
Also using a plurality of video cameras 2
1To 2
NBe used as under the situation of remote image sensing apparatus 2, as in embodiment 2, image capture apparatus 1 can extract the part object signal that be hunted down from the vision signal that receives from remote image sensing apparatus 2.Embodiment 4 relates to this operation, and the difference of itself and embodiment 3 is described with reference to Figure 17.
In remote image sensing apparatus 2, each video camera 2
1To 2
N Image acquiring apparatus 24 be omitted, and sent to image capture apparatus 1 by picture transmitter device 22 from the vision signal of each video camera 21.In this case, the video camera identifying information IDn that stores in ID storage area 24b for example is added on the vision signal of video camera 21 so that image capture apparatus 1 can be discerned the video camera 2 that receives vision signal from it
nIncidentally, if the input terminal of the remote image receiving system 16 in image capture apparatus 1 is corresponding to video camera 2
1To 2
NAnd scheduled, then needn't send video camera identifying information IDn.Can be for each video camera 2
1To 2
N Picture transmitter device 22 is provided, but also can provides jointly to them.And, video camera information measurement mechanism 25 can be provided as required.
In image capture apparatus 1, omitted image relay 15, and in image acquiring apparatus 17, select step 17b select corresponding to the video camera identifying information IDp that comprises in the lock-on signal from lock-on signal generation device 13, that is from video camera 2
1To 2
NVision signal.In other words, select that received signal of its video camera identifying information IDn coupling IDp.Can itself carry out this selection by image acquiring apparatus 17.And, image acquiring apparatus 17 have with Fig. 8 in identical buffer storage 17a, in this buffer storage 17a, vision signal is stored, and its picture element signal is arranged with the pattern identical with pixel arrangement in the example imageing sensor 7 as shown in Figure 12; Image acquiring apparatus 24 bases are as above with reference to a in the described lock-on signal of Figure 12
PAnd/or y extracts the signal that is hunted down of part object.
When lock-on signal only comprises IDp, can omit buffer storage 17a.Can replace by the selection part 16a in image received device 16 and select part 17a to carry out the selection of vision signal; Perhaps, as mentioned above, correspond respectively to video camera 2
1To 2
NCome the receiving terminal of predetermined image receiving system, so that select the picture signal of receiving terminal to select to be received corresponding to Information ID p.
Accessed during with beginning from the portable terminal device 3 that has been equipped with video camera, image capture apparatus 1 catch corresponding to predetermined video camera identifying information or south, north, east and west to predetermined one part object vision signal, and send the signal that is hunted down to the portable terminal device 3 that has been equipped with video camera.The program of the image capture apparatus 1 in the system of embodiment 4 is with identical in the program shown in Fig. 9.Therefore, understand that easily embodiment 4 also produces the obtainable identical work effect of embodiment 1-3.
The image detection device 21 of remote image sensing apparatus 2 is mounted in the video camera 28 on the pan platform 27 shown in Figure 19; Can change the shooting direction of video camera 28 by control signal, and also can change the angle of visual field that is called as the zoom amount by scioptics from the distant place.Image detection device will be called as pan video camera 21 below 21.From image capture apparatus 1 to image acquiring apparatus 24 input as lock-on signal, azimuth signal θ, lifting/reduction angle signal φ and zoom signal Z.Azimuth control signal 24c is according to azimuth signal θ controlling party parallactic angle controlling organization 24d, makes the azimuth of shooting direction of video camera 21 become θ.Lifting/reduction control section 24e controls lifting/reduction controlling organization 24f according to lifting/reduction angle signal φ, makes the lifting/reduction angle of shooting direction of video camera become φ.Zoom control section 24g controls zoom controlling organization 24h according to zoom signal Z, makes that the zoom quantitative change of video camera 21 is Z.These control sections 24c, 24e, 24g and control structure 24d, 24f, 14h can with the pan platform 27 of the obtainable remote control pan of commerce video camera in be provided with those are identical.
Therefore, removed and sent to image capture apparatus 1 corresponding to the panorama subject image signal in panorama object 6 of lock-on signal from video camera 21.Remote image sensing apparatus 2 also can be provided the aforesaid video camera information measurement mechanism 25 with reference to Figure 11.
In image capture apparatus 1, all lock-on signal generation devices 13 as shown in Figure 5 produce signal z, x and a according to the change information that is detected by change detecting device 12
P, these signals x, y and a
PBe converted the zoom change signal that part 13j is converted to direction signal azimuth signal θ and lifting/reduction angle signal φ and zoom signal Z, they are sent to remote image sensing apparatus 2.
Sending when beginning to visit to remote image sensing apparatus 2 from image capture apparatus 1, remote image sensing apparatus 2 sends by take the part object vision signal that obtains in predetermined reference direction with benchmark zoom amount to image capture apparatus 1.In remote image sensing apparatus 2, video camera information measurement mechanism 25 is provided, image capture apparatus 1 obtain in response to beginning to handle such as the north to the situation of partial video signal in a horizontal direction, in a predetermined direction under, initialize signal produces part 13
kProduce the initial acquisition signal.That is the azimuth angle theta of measuring by the video camera information measurement mechanism 25 of remote image sensing apparatus 2,
iAnd lifting/reduction angle φ
iBe respectively stored in storage area 13
mWith 13
nIn, and in benchmark calculating section 13p and 13q, calculate at the angle θ that is stored
iAnd φ
iAnd the direction of the difference between predetermined reference azimuth and the reference lifting/reduction angle comprises angle signal, and these signals are used as the initial acquisition signal and send to remote image sensing apparatus 2.Promptly, be used as lock-on signal in the current shooting direction of pan video camera 21 and the difference between the reference direction and send to remote image sensing apparatus 2, remote image sensing apparatus 2 is controlled pan video camera 21 and is changed it according to above-mentioned difference and take direction in response to described lock-on signal.About zoom amount Z, the initial acquisition signal is zero on difference.Under the situation that realizes such control, based on the change information that detects by change detecting device 12 lock-on signal---they point out the precondition of work as of pan video camera 21, the only variation on shooting direction and zoom amount---also be sent to remote image sensing apparatus 2.Therefore, as shown in figure 18, for example, by the change information d of change detecting device 12 detections
x, d
yBe directly inputted to the conversion portion 13j of lock-on signal generation device 13 with a, and the output that is converted accordingly is used as the lock-on signal that is produced and sends to remote image sensing apparatus 2.Remote image sensing apparatus 2 is respectively according to coming controlling party parallactic angle controlling organization 24d, lifting/reduction controlling organization 24f and zoom amount controlling organization 24h by the variation of representing corresponding to its lock-on signal that receives.
As mentioned above, under the predetermined situation that is used as benchmark in using the south and north, east and west direction, and be used as under the situation of benchmark in the initial condition of using the pan video camera, also possible: as to produce the lock-on signal of expression corresponding to the variation of the change information that detects by change detecting device 12; Send described lock-on signal to remote image sensing apparatus 2; And in image capture apparatus 1, realize control with the current direction of pan video camera 21 or/and the zoom amount changes the variable quantity of being represented by the lock-on signal of institute's data.Wherein produce and send and only represent based on the method for the lock-on signal of the variation of change information also sound source embodiment 2 and 4 to remote image sensing apparatus 2.In this case, in embodiment 1, for example in remote image sensing apparatus 2, provide and 13 identical lock-on signal generation devices in Fig. 5.
Illustrate that at first remote image sensing apparatus 2 is similar to the front with reference to embodiment 2 described situations in configuration.Figure 21 illustrates the example of the functional configuration of the image capture apparatus 1 in this example.Provide: be used for a plurality of portable terminal devices 3 that have been equipped with video camera, be a plurality of around image received devices 11
1To 11
SS the circuit that connects; Receive buffer storage 12a
1To 12a
SAt preceding frame memory 12b
s, have the S zone that is used to store peripheral image signal, each peripheral image signal corresponding to one of line number s (s=1,2 ..., S); Mark memory 92 is used for storing a mark corresponding to each row s, and described mark is used to point out whether corresponding video camera is operated; Update instruction part 12d
s, corresponding to each row s; One or more change-detection part 12c (one of them only is shown); One or more lock-on signal generation devices 13 (one of them only is shown); Image detection device 18
s, with image received device 11 around every row
sIn pairs; Remote image receiving system 16; One or more image capture apparatus 17 (one of them only is shown); Control device 93.In front signal memory 13a, provide the zone in preceding lock-on signal (current use) of storing each row s.Control device 93 has been provided a memory, wherein stored and be used for control microprocessor or CPU (CPU) is used as image capture apparatus 1 a needed program, and control device 93 is carried out described program with the read-write that realizes each memory and operate various piece in regular turn.The function of some functional blocks in Figure 21 itself is carried out by control device 93.
The following describes following situation: specific outfit the portable terminal device 3 of the video camera image received device 11 that is being connected to row s
sUse described capable s up to finishing receiving unit subject image signal to begin the back.For image received device 11 on every side
sWhen beginning to visit, from the zone of front signal memory 13a, reading lock-on signal corresponding to described capable s, and use the described lock-on signal of reading to come, and the part object vision signal that is extracted is sent to the portable terminal device 3 that has been equipped with video camera by the picture transmitter device 18s of row s by the panoramic video signal extraction part object vision signal of image acquiring apparatus 17 from receiving by remote image receiving system 17.In its initial condition, in its All Ranges, stored lock-on signal x at front signal memory 13a
0, y
0And a
P0---the part object that in this example, is used to be scheduled to.In the portable terminal device 3 that has been equipped with video camera, when image capture apparatus 1 receives vision signal, the vision signal that is received is play by image display device 32 and is shown.Use above-mentioned same way as to carry out the operation that is used for catching part object vision signal at image acquiring apparatus 17 for embodiment 2.
At image received device 11 on every side by row s
sWhen receiving the camera operation order, for described row s a mark is set in mark memory 92, promptly described mark to " 1 " conversion (described mark initially is set to 0), is provided with update instruction part 12d from " 0 " then
STimer, and receiving buffer storage 12a
sIn stored around image received device 11
sVision signal around being received.
At every turn from update instruction part 12d
sWhen sending update instruction, by change-detection part 12c from receiving buffer storage 12a
sIn and being received in preceding frame memory 12b around vision signal change detected information d
x, d
yAnd a, lock-on signal generation device 13 is producing lock-on signal at preceding generation signal by handling according to the change information that detected in the regional s of front signal memory 13a then, be updated in lock-on signal in the regional s of front signal memory 13a with the lock-on signal of new generation then, and by picture transmitter device 18
sSend the part object vision signal of passing through image capture apparatus 17 to the portable terminal device 3 that has been equipped with video camera.Receiving buffer storage 12a
sIn the regional s that is sent at preceding frame memory 12b of vision signal.
Image received device 11 around passing through
sReceive camera operation when ceasing and desisting order, the mark of the row s in mark memory 92 is reset to " 0 ", stops update instruction part 12d
sOperation.According at the lock-on signal in the regional s of front signal memory 13a, part object vision signal is hunted down, and it is by picture transmitter device 18
sSend in real time.Image received device 11 around passing through
sWhen receiving the operation recovery order, the mark of the capable s in mark memory 92 is set to " 1 " so that update instruction part 12d
sWork, carry out thereafter with the situation that receives the camera operation order in identical processing.When image received device 11 on every side
sWhen receiving the finish command, at preceding buffer storage 12a
s, be eliminated update instruction part 12d in regional s and the content in the regional s of front signal memory 13a of preceding frame memory 12b
sStopped from the operation that requires, and the mark of the capable s in mark memory 92 is reset to " 0 ".
For fast processing, can be based upon image capture apparatus 1 and the connection that has been equipped with between the portable terminal device 3 of video camera sends and receives with each signal during being used for, up at portable terminal device 3 from being equipped with video camera
m(m=1,2 ..., M) send to image capture apparatus 1 and to begin to finish image capture operation after the visit.Under these circumstances, be equipped with the portable terminal device 3 of video camera
mTo each signal attaching terminal identifying information Idm that is sent out.Employed terminal identification information Idm for example is the portable terminal device 3 that has been equipped with video camera
mTelephone number or address or if necessary be the portable terminal device 3 that has been equipped with video camera
mDevice numbering, user's name etc.Handle the processing numbering s that numbering memory 91 is provided to be defined in terminal identification information Idm and channel number (s=1,2 ..., S) between correspondence.Receiving when beginning to visit, terminal identification information Idm and the idle numbering s (being used for pointing out current obsolete numbering) that handles are stored in with corresponding to each other and are handled numbering memory 91.Thereafter, at each portable terminal device 3 from being equipped with video camera
mWhen receiving signal, image capture apparatus 1 uses its terminal identification information Idm to read processing numbering s from handling numbering memory 91, and carries out the processing corresponding to the processing numbering s that is read.That is, according to terminal identification information Idm, the mark Be Controlled of the processing numbering s in mark memory 91, and update instruction part 12d
sThe operation Be Controlled; According to vision signal on every side, use receiving buffer storage 12a
sWith the regional s in preceding frame memory 12b, and at the lock-on signal in front signal memory 13a and the signal in the memory of image acquiring apparatus 17 of lock-on signal generation device 13; And come the transmission of operating part object vision signal by following manner: read terminal identification information Idm corresponding to the processing numbering s in handling numbering memory 91, and with picture transmitter device 18
sBe connected to the above-mentioned terminal identification information Idm that reads outfit the portable terminal device 3 of video camera
mAs mentioned above, according to embodiment 6, the outfit that a plurality of users can be by operating them independently of one another the portable terminal device of video camera see the part subject image that they expect via a remote image acquisition equipment 1.Incidentally, when processing is crowded, use a plurality of change-detection part 12c, lock-on signal generation device 13 and image capture apparatus 17 simultaneously.
When employed remote image sensing apparatus 1 also with shown in Figure 10 when identical, a plurality of users can use a remote image sensing apparatus 1 simultaneously.That is, in the described configuration of Figure 21, remote image receiving system 16, lock-on signal generation device 13 and image acquiring apparatus 17 are by configuration shown in Figure 14 and 17; And, in order to carry out a plurality of portable terminal devices 3 that have been equipped with video camera
mIn time, handle, and image capture apparatus 1 has a plurality of image received devices 11 on every side shown in body 21
s, a plurality of buffer storage 12a
s, a plurality of update instruction part 12d
s, have a plurality of storage areas preceding frame memory 12b, have a plurality of storage areas at front signal memory 13a, a plurality of picture transmitter device 18
s, mark memory 92 and control device 93.And, as as shown in the bracket in front signal memory 13a, use video camera sign IDp is substituted in the signal x in the lock-on signal, and uses and carry out the portable terminal device 3 that has been equipped with video camera for each with mode identical under the situation of omnirange video camera
mProcessing, but to coming operating part object vision signal to catch operation like that with reference to as above embodiment 4 is described.Also in this case, can understand easily that a plurality of users can be simultaneously at a plurality of portable terminal devices 3 that have been equipped with video camera
mOn see from a plurality of video cameras 2
1To 2
NThe part subject image of the vision signal of their expectations on a plurality of directions that receive simultaneously.
Embodiment 1 and 3 system also can be by the simultaneously adaptive portable terminal devices 3 that comes by being equipped with video camera
mCatch the part subject image.In this case, the image acquiring apparatus 17 in Figure 21 is omitted, and the portable terminal device 3 that is used to be equipped with video camera that produces in image capture apparatus 1
mLock-on signal by additional instance as being used to discern the processing numbering s of purposes, and be sent to remote image sensing apparatus 2; In remote image sensing apparatus 2, under the situation of Fig. 4 example, in image acquiring apparatus 24, be provided for storing the storage area 24a ' of the lock-on signal that is used for each processing numbering, as shown in phantom in Figure 20, upgrade the lock-on signal in storage area 24a then corresponding to the processing numbering that is received, extract part object vision signal according to as above lock-on signal then, and added and handled the part object vision signal that is extracted of numbering and be sent to image capture apparatus 1 with reference to the described storage among each storage area 24a ' of embodiment 1.In image capture apparatus 1, by corresponding to the outfit of the processing that received numbering the portable terminal device 3 of video camera
mThe part object vision signal of Jie Shouing is by relaying and transmission simultaneously; Image acquiring apparatus 17 is omitted.
Under the situation of system shown in Figure 11, the same with above-mentioned situation, in the image acquiring apparatus 24 of remote image sensing apparatus 2, provide to be used to store the storage area 24a that each handles the lock-on signal of numbering; Upgraded to number simultaneously received lock-on signal corresponding to the processing that is received lock-on signal numbering, in storage area 24a, then according to each lock-on signal IDp, the x, a that in storage area 24a, store with described processing
P, from the video camera 2 of correspondence
nCatch part object vision signal, and captive vision signal is sent to image capture apparatus 1 with handling numbering.
Revise
In above-mentioned any one embodiment, image display device 32 can be the fixing display that is used for personal computer etc., shown in the dotted line among Fig. 4,8,18 and 20.But under any circumstance, described display is used to play and show the part object vision signal that sends to the portable terminal device that has been equipped with video camera from image capture apparatus 1.In this case, user's operation seeing the image that shows on fixing image display device 32 when portable terminal device 3 of being equipped with video camera is used for video camera work.As in above-mentioned example, fixed image display device 32 outfit the portable terminal device 3 of video camera easily use because the user might in addition any position when for example walking use it so that see his child in the kindergarten.
In either case, might be in above-mentioned example left-right rotation has been equipped with the shooting direction of portable terminal device 3 of video camera to select the part object of expectation by only using x or IDp to be used as lock-on signal; And, might be by increasing y or and a in above-mentioned example to lock-on signal
PRotate the shooting direction of the portable terminal device 3 that has been equipped with video camera up and down or/and the video camera that seesaws is selected the part object expected.Above, for each camera operation, detection comprises the change information of its operational ton, and proofread and correct the lock-on signal that will produce corresponding to described change information, but the variation that might detect separately on direction is arranged and non-change detected degree (quantity), it is to increasing predetermined value d at preceding lock-on signal x
xOr deduct it from it.
Following situation takes place sometimes: wherein, when taking on every side by the portable terminal device 3 that has been equipped with video camera, owing to some reasons, intense flash is radiated at suddenly on the video camera 33, vision signal around having disturbed.If according to producing lock-on signal the change information of video signal detection around disturbed, then receive and what show is complete unacceptable part subject image from such.For fear of this point, being recommended in the change detecting device 12 of the image capture apparatus 1 among each embodiment provides a kind of error-detecting to prevent part.Illustrate that below in conjunction with embodiment 1 error-detecting prevents the example of part.Shown in the dotted line among Fig. 4, in hysteresis storage area 12e, stored information afterwards about the change information that is sent to lock-on signal generation device 13.Described hysteresis storage area is configured to always store by for example three change informations that tight preceding detection obtains.For example, when detecting change information among the test section 12c in Fig. 5, determining section 12f departs from from the continuity of the change information stored among hysteresis storage area 12e widely by relatively determining whether described change information.If determine that current change information does not depart from widely from described continuity, if promptly current information is not unusual, then provide described change information to lock-on signal generation device 13, and simultaneously, it is stored among the hysteresis storage area 12e as up-to-date information, removes the oldest information from it.If determining section 12f determines that the change information of current detection is not unusual, then change detecting device abandons described information in refusal part 12g, or waits for next update instruction, or receives new vision signal on every side and carry out the change-detection processing.
When a plurality of users use a remote image sensing apparatus 2 simultaneously, can so that: when watching the time such as the image on the display surface 3a of the image display device of the user's of personal computer terminal 3 ', each user by button, bar, mouse or tracking ball come operating operation part 3b with from the panoramic video signal capture by the motion of the part object of the expectation the panorama object 6 of image capture apparatus 1 image detection or/and the version of zoom.X axle control signal and y axle control signal that operation part 3b uses the operation by the demonstration on the display plane of for example personal computer that is used for moving to produce are come as the d at above-mentioned change information
xWith above-mentioned d
y, and output is used for amplifying/dwindle a that the control signal of demonstration in the plane is used as at above-mentioned change information, and send this change information d to image capture apparatus 1
xIn this example, image capture apparatus 1 only uses signal receiving device 11s to come as image received device 11 on every side
sSubstitute, and lock-on signal generation device 13 according to use based on the processing numbering of the row of signal processing apparatus 11s number or the customer identification information that receives simultaneously the change information that receives from each user terminal 3 ' by receiving system 11s and among front signal memory 13a at preceding lock-on signal x (or IDp), y, a
PAnd the generation lock-on signal.Identical with in embodiment 6 of processing subsequently.But lock-on signal is sent to user terminal 3 '.
When a plurality of users use remote image sensing apparatus 2 jointly, can catch the part object vision signal that is used for each user as in embodiment 1 or 3, carrying out by image capture apparatus 1.Under these circumstances, image capture apparatus 1 uses identical as mentioned above mode to come the change information d that receives according to for each user terminal
x, d
y, a and produce lock-on signal, but described lock-on signal is IDp, y, a, but as described near the tail end of the explanation of embodiment 6, for example added the lock-on signal of handling numbering and be sent to remote image sensing apparatus 2, and remote image sensing apparatus 2 sends the part object vision signal of handling the lock-on signal of numbering corresponding to each similarly.
Though it is fixing that user terminal 3 ' has been described to as personal computer, obviously, it can be the portable terminal device of portable phone, PDA or pleasure.That is, user terminal wants image pattern for example to represent with respect to the direction of predetermined benchmark and/or the change information d of zoom as acquisition equipment 1 transmission
x, d
y, a so that specify part object in the panorama object of being taken by remote image sensing apparatus 2.
That uses in each of embodiment 1-6 1 can be implemented by computer.That is, the functional programs that is used to carry out each image capture apparatus 1 is installed on computers from the recording medium such as CD-ROM, disk and semiconductor memory, perhaps is downloaded to computer via communication line, to be carried out by computer.
Claims (19)
1. remote image display packing is characterized in that step:
Utilize the remote image sensing apparatus that the panorama object is carried out image sensing;
Send described via image capture apparatus to image display device by the vision signal of the part of the panorama object of image sensing in the position different with described remote image sensing apparatus;
The vision signal that described image display device playback and demonstration are received is with the parts of images as described panorama object;
Utilization be positioned at described image display device present position outfit the portable terminal device of the video camera image detection around carrying out, and described vision signal on every side sent to described image capture apparatus;
Change detecting device in the described image capture apparatus according to receive from the portable terminal device that has disposed video camera the preceding around vision signal and current around vision signal obtain about the change information of image on every side;
Obtain the vision signal of the part of the described panorama object that the change corresponding to image around described changes from described remote image sensing apparatus according to described change information; With
Send described obtained picture signal to described image display device.
2. image capture apparatus comprises:
Image received device is used for receiving vision signal on every side from the portable terminal device that has been equipped with video camera on every side;
Change detecting device, be used for around received video signal detection described around image received device receive current around the image of vision signal with respect to the information of the variation of the image of vision signal around preceding, wherein following image with vision signal around current is called present image, and following will being called at preceding image at the preceding image of vision signal on every side;
The lock-on signal generation device is used for producing lock-on signal from the described change information of the vision signal of the part that is used to obtain the panorama object;
Sender unit is used for sending described lock-on signal to the image detection of carrying out the panorama object and the remote image sensing apparatus of outputting video signal;
The image relay is used for receiving described vision signal from described remote image sensing apparatus, and is used for to sending the vision signal that is received with the described image display device that has been equipped with the portable terminal device same position of video camera.
3. according to the image capture apparatus of claim 2, wherein:
Described change detecting device is such device, and it is used to detect the following message as described change information: corresponding to the directional information of described present image with respect to the described direction of motion at preceding image; Or/and corresponding to the size of the part of the described corresponding described present image of a part at preceding image on the zoom information of change;
Described lock-on signal generation device is such device, and it is used to produce the extraction benchmark pixel position signalling that obtains by following manner and comes as described lock-on signal: according to described directional information or/and amplify/dwindle signal corresponding to the image of described zoom information and proofread and correct at preceding extraction benchmark pixel position signalling.
4. according to the image capture apparatus of claim 2, it also comprises:
The camera direction storage device wherein, has stored that identifying information and a plurality of video camera of each is separated with angle in a plurality of video cameras that provide on the shooting direction of a plurality of video cameras in described remote image sensing apparatus;
Wherein:
Described change detecting device is such device, and it is used to detect corresponding to the directional information of described present image with respect to the described direction of motion at preceding image, as described change information;
Described lock-on signal generation device is such device, it is being by determining to take direction with reference to the identifying information of storing in the described camera direction storage device on the basis of the transmission video camera identifying information signal of preceding generation and described directional information, to produce the transmission video camera identifying information signal as the video camera identifying information corresponding with the definite described shooting direction of described lock-on signal generation device of described lock-on signal.
5. according to the image capture apparatus of claim 2, wherein:
Described change detecting device is such device, and it is used to detect the following message as described change information: corresponding to the directional information of described present image with respect to the described direction of motion at preceding image; Or/and corresponding to the zoom information of described present image with respect to the change of described size at preceding image; With
Described lock-on signal generation device is such device, and it is used to produce, and the shooting direction corresponding to described directional information as described lock-on signal changes signal or/and change signal corresponding to the zoom of described zoom information.
6. according to the image capture apparatus of claim 2, wherein:
Image received device is such device around described, vision signal around being used for receiving from each of a plurality of portable terminal devices that have been equipped with video camera; With
Described change detecting device is such device, it is provided with one at preceding frame memory, be used for storage vision signal on every side, around described vision signal be used to detect each portable terminal device that has been equipped with video camera at preceding change information, described change detecting device is used for detecting each described change information that has been equipped with the portable terminal device of video camera corresponding to vision signal around having sent according to following message: around being received vision signal and with sent around the described portable terminal device that has been equipped with video camera of each of vision signal corresponding, be stored in described vision signal on every side in preceding frame memory;
Described lock-on signal generation device is such device, it is provided with one at the front signal memory, each that is used to store vision signal around having sent be equipped with video camera portable terminal device at the preceding lock-on signal that is produced, described lock-on signal generation device be used for from corresponding to described each be equipped with video camera portable terminal device change information and corresponding to described each be equipped with the portable terminal device of video camera, described in the front signal memory, store described the preceding lock-on signal that is produced produce corresponding to described each be equipped with the lock-on signal of the portable terminal device of video camera, and be used for using the described lock-on signal that is produced to be updated in described respective signal at the front signal memory;
Described sender unit is such device, and it is used to send the lock-on signal that is produced and has been used to discern the outfit corresponding with it information of the portable terminal device of video camera; With
Described image relay is such device, it is used for sending the vision signal that it receives to the described image display device of the portable terminal device that has been equipped with video camera, and this portable terminal device that has been equipped with video camera is by pointing out with the received portable terminal device identifying information that has been equipped with video camera of described vision signal.
7. image capture apparatus comprises:
Image received device is used for receiving vision signal on every side from the portable terminal device that has been equipped with video camera on every side;
Change detecting device, be used for around received video signal detection described around image received device receive current around the image of vision signal with respect to the information of the variation of the image of vision signal around preceding, wherein vision signal around current is called present image, and following will being called at preceding image in preceding vision signal on every side;
The lock-on signal generation device is used for from described change information and produces the lock-on signal of the vision signal of a part that is used to obtain the panorama object at the preceding lock-on signal that produces;
The remote image receiving system is used to receive the vision signal that sends from the remote image sensing apparatus of the image sensing of having carried out the panorama object;
Image capture assemblies is used for catching from the vision signal that is received according to described lock-on signal the vision signal of the part of panorama object;
Picture transmitter device is used for sending described captive vision signal to the image display device that is positioned at the same position place with the described portable terminal device that has been equipped with video camera.
8. according to the image capture apparatus of claim 7, wherein:
The vision signal that is received by described remote image receiving system is the panoramic video signal;
Described change detecting device is such device, and it is used to detect the following message as described change information: corresponding to the directional information of described present image with respect to the described direction of motion at preceding image; Or/and corresponding to the size of the part of the described corresponding described present image of a part at preceding image on the zoom information of change;
Described lock-on signal generation device is such device, it be used to produce as described lock-on signal, by according to described directional information or/and amplify/dwindle signal to proofreading and correct the extraction benchmark pixel position signalling that is obtained at preceding extraction benchmark pixel position signalling corresponding to the image of described zoom information;
Described image capture assemblies is such assembly, it be used for from described panoramic video signal catch by utilize with respect to the described image at the image of the front captive vision signal that sends dwindle/amplifying signal dwindles/amplifies position on the definite panoramic image of a frame, the described extraction benchmark pixel position signalling that is corrected of reference of the vision signal that produces by frame of vision signal or/and at the parts of images of the panoramic picture of the extraction benchmark pixel position signalling that front is produced or the described defined described panoramic video signal of extraction benchmark pixel position signalling that is corrected.
9. according to the image capture apparatus of claim 7, wherein:
The vision signal that is received by described remote image receiving system is the vision signal from a plurality of video cameras of described remote image sensing apparatus, and the shooting direction of described a plurality of video cameras is with angular separation;
Described image capture apparatus also comprises:
The camera direction storage device has wherein been stored about the identifying information of described a plurality of video cameras with corresponding to their information of shooting direction;
Wherein:
Described change detecting device is such device, and it is used to detect corresponding to the directional information of described present image with respect to the described direction of motion at preceding image, as described change information;
Described lock-on signal generation device is such device, it is by according to determining the shooting direction in the transmission video camera identifying information signal of preceding generation and described directional information and with reference to the identifying information of storing in the described camera direction storage device, is used to produce transmission video camera identifying information signal corresponding to the video camera identifying information of the described shooting direction that is determined as described lock-on signal; With
Described image capture assemblies is the assembly that is used to catch one of a plurality of vision signals corresponding to the described transmission video camera identifying information signal that is produced.
10. according to the image capture apparatus of claim 9, wherein:
Described change detecting device comprises a kind of device, and it is used for detecting following message and is used as described change information: corresponding to perpendicular to the direction of the direction of motion of described detected directional information, described present image is with respect to the second direction information of the described direction of motion at preceding image; Or/and corresponding to the size of that part of the described corresponding described present image of a part at preceding image on the zoom information of change;
Described lock-on signal generation device is such device, and it is used for producing and obtains to extract the benchmark pixel position signalling by following manner and be used as described lock-on signal: according to described second direction information or/and amplify/dwindle signal corresponding to the image of described zoom information and proofread and correct at preceding extraction benchmark pixel position signalling; With
Described image capture assemblies is such assembly, it be used for from described captive vision signal catch by utilize with respect to the described image at the image of the preceding captive vision signal that sends dwindle/amplifying signal dwindles/amplifies a frame of the vision signal that produces, position on the image of determining with reference to the described extraction benchmark pixel position signalling that is corrected is by frame of vision signal or/and at the parts of images of the image of preceding extraction benchmark pixel position signalling that is produced or the described defined described vision signal that is hunted down of extraction benchmark pixel position signalling that is corrected.
11. according to the image capture apparatus of claim 7, wherein:
Image received device around described, vision signal around being used for receiving from each of a plurality of portable terminal devices that have been equipped with video camera;
Described change detecting device is such device, it has been provided at preceding frame memory, be used for storage vision signal on every side, around described vision signal be used to detect sent around vision signal described each be equipped with video camera portable terminal device at preceding change information, described change detecting device be used for according to following message detect corresponding to described each be equipped with the change information of the portable terminal device of video camera: vision signal and corresponding around being received with the described portable terminal device that has been equipped with video camera, be stored in described vision signal on every side in preceding frame memory;
Described lock-on signal generation device is such device, it has been provided at the front signal memory, be used to store vision signal around having sent described each be equipped with video camera portable terminal device at the preceding lock-on signal that is produced, described lock-on signal generation device be used for from corresponding to described each be equipped with video camera portable terminal device the change information that is detected and corresponding to described each be equipped with the portable terminal device of video camera, described in the front signal memory, store described the preceding lock-on signal that is produced produce corresponding to described each be equipped with the lock-on signal of the portable terminal device of video camera, and be used for using the described lock-on signal that is produced to be updated in described respective signal at the front signal memory;
Described image capture assemblies is to be used for being captured in the assembly of vision signal of described each lock-on signal of storing at the front signal memory that has been equipped with the portable terminal device of video camera corresponding to each;
Described picture transmitter device is such device, be used for to described each image display device that has been equipped with the portable terminal device same position of video camera send described each be equipped with the described vision signal that is hunted down of the portable terminal device of video camera.
12., it is characterized in that comprising according to the image capture apparatus of claim 2 or 7:
Change the hysteresis storage device, the hysteresis that is used to store described change information;
Determine device, be used for by determining with reference to the lag information of storing whether the change information that is detected by described change detecting device is unusual at described variation hysteresis storage device; With
When determining that described change information is unusual, forbids in described definite device providing the device of described detected change information to described lock-on signal generation device.
13. the processing method of an image capture apparatus is characterized in that:
First step determines whether to receive the shooting direction that is used to change video camera or/and the operational order at lens field angle, wherein following this operation is called camera operation, and the lens field angle is called the zoom amount;
Second step receives the vision signal on every side of object on every side from the portable terminal device that has been equipped with video camera when determining to receive described order in described first step;
Third step is used for video signal detection change information around received, described change information be used to point out described around the image of vision signal with respect to the variation of the image of vision signal around preceding;
The 4th step is used for the lock-on signal according to the vision signal that produces a part that is used to catch the panorama object at preceding lock-on signal and described change information, and wherein this is called as the part object below part panorama object;
The 5th step is used for sending the described lock-on signal that is produced to the remote image sensing apparatus of the image detection of carrying out described panorama object;
The 6th step is used for from remote image sensing apparatus receiving video signals;
The 7th step is used for to sending described received vision signal with the described image display device that has been equipped with the portable terminal device same position of video camera; With
The 8th step is used to determine whether to receive camera operation and ceases and desist order;
If wherein in described first step, do not receive described operational order, then handle and proceed to described the 6th step, if do not receive described ceasing and desisting order, then handle and return described third step in described the 8th step.
14. the processing method of an image capture apparatus is characterized in that:
First step determines whether to receive the shooting direction that is used to change video camera or/and the operational order at lens field angle, wherein following this operation is called camera operation, and the lens field angle is called the zoom amount;
Second step receives the vision signal on every side of object on every side from the portable terminal device that has been equipped with video camera when determining to receive described order in described first step;
Third step is used for video signal detection change information around received, described change information be used to point out described around the image of vision signal with respect to the variation of the image of vision signal around preceding;
The 4th step is used for the lock-on signal according to the vision signal that produces a part that is used to catch the panorama object at preceding lock-on signal and described change information, and wherein this is called as the part object below part panorama object;
The 5th step is used for from remote image sensing apparatus receiving video signals;
The 6th step is used for catching from described received vision signal according to the described lock-on signal that is produced the vision signal of the part of panorama object;
The 7th step is used for to sending described captive vision signal with the described image display device that has been equipped with the portable terminal device same position of video camera;
The 8th step is used to determine whether to receive camera operation and ceases and desist order;
If wherein in described first step, do not receive described operational order, then handle and proceed to described the 5th step, if do not receive described ceasing and desisting order, then handle and return described third step in described the 8th step.
15. an image capture apparatus comprises:
Signal receiving device, each that is used for from a plurality of user terminals receives variation information signal;
The lock-on signal generation device, be included in the front signal memory, be used to store the lock-on signal of previous generation of each information that has sent the user terminal of described variation information signal in order to identification, described lock-on signal generation device be used for from the variation information signal that is received and formerly memory user terminals stored identifying information produce a lock-on signal at the preceding lock-on signal that is produced, be used to catch the vision signal of the part of panorama object, be called as the user terminal identifying information below wherein discerning the information of user terminal, and this is called as the part object below part panorama object;
Sender unit is used for sending described lock-on signal that is produced and corresponding user terminal identifying information to the remote image sensing apparatus of the image detection of carrying out the panorama object and its vision signal of output; With
The image relay is used for receiving described vision signal and corresponding user terminal identifying information from described remote image sensing apparatus, and sends described vision signal to the image display device corresponding to the user terminal of user terminal identifying information,
Wherein:
Described variation information signal is represented directional information or/and expect from the zoom information of the part object that forwardly divides the object conversion;
Described lock-on signal generation device is such device, and it is used to produce the extraction benchmark pixel position signalling that obtains by following manner and is used as described lock-on signal: according to described directional information or/and amplify/dwindle signal corresponding to the image of described zoom information and proofread and correct at preceding extraction benchmark pixel position signalling.
16. an image capture apparatus comprises:
Signal receiving device, each that is used for from a plurality of user terminals receives variation information signal;
The lock-on signal generation device, be included in the front signal memory, be used to store the lock-on signal of previous generation of each information that has sent the user terminal of described variation information signal in order to identification, described lock-on signal generation device be used for from the variation information signal that is received and formerly memory user terminals stored identifying information produce a lock-on signal at the preceding lock-on signal that is produced, be used to catch the vision signal of the part of panorama object, be called as the user terminal identifying information below wherein discerning the information of user terminal, and this is called as the part object below part panorama object;
Sender unit is used for sending described lock-on signal that is produced and corresponding user terminal identifying information to the remote image sensing apparatus of the image detection of carrying out the panorama object and its vision signal of output; With
The image relay is used for receiving described vision signal and corresponding user terminal identifying information from described remote image sensing apparatus, and sends described vision signal to the image display device corresponding to the user terminal of user terminal identifying information; With
The camera direction storage device has wherein been stored and has been provided in described remote image sensing apparatus and each identifying information of a plurality of video cameras of angular separation in their shooting direction;
Wherein:
The representative of described variation information signal is desirably in the first direction from the first direction information of forwardly dividing the part object that object changes and/or is desirably in the second direction vertical with first direction from the second direction information of forwardly dividing the part object that object changes or/and the zoom information of the part object of expectation; With
Described lock-on signal generation device is such device, it is by also determining to take direction with reference to the identifying information of storing in the described camera direction storage device according to transmission video camera identifying information signal and described first direction information in preceding generation, be used to produce transmission video camera identifying information signal corresponding to the video camera identifying information of the described shooting direction that is determined as described lock-on signal, and/or the benchmark pixel position signalling that obtains by the benchmark pixel position that is produced of proofreading and correct corresponding to described second direction information is or/and amplify/dwindle signal corresponding to the image of described zoom information.
17. an image capture apparatus comprises:
Signal receiving device, each that is used for from a plurality of user terminals receives variation information signal;
The lock-on signal generation device, be included in the front signal memory, be used to store the lock-on signal of the previous generation of each information that is used to discern the user terminal that has sent described variation information signal, described lock-on signal generation device is used for producing a lock-on signal from the variation information signal that is received with at the lock-on signal in preceding generation of preceding memory user terminals stored identifying information, be used to catch the vision signal of the part of panorama object, be called as the user terminal identifying information below wherein discerning the information of user terminal, and this is called as the part object below part panorama object;
Sender unit is used for sending the described lock-on signal that is produced to the remote image sensing apparatus of the image detection of carrying out the panorama object and its vision signal of output;
The remote image receiving system is used to receive the vision signal that sends from the remote image sensing apparatus of the image detection of having carried out the panorama object;
Image capture assemblies is used for according to the vision signal that is used for to catch from described received vision signal at the lock-on signal of described each user terminal identifying information of storing at the front signal memory part of panorama object;
Picture transmitter device is used for sending described captive vision signal to the user terminal corresponding to described user terminal identifying information.
18. according to the image capture apparatus of claim 17, wherein:
The vision signal that is received by described remote image receiving system is the panoramic video signal;
Described variation information signal representative expectation from the directional information of the part object that forwardly divides the object conversion or/and zoom information;
Described lock-on signal generation device is such device, and it is used to produce the extraction benchmark pixel position signalling that obtains by following manner and is used as described lock-on signal: according to described directional information or/and amplify/dwindle signal corresponding to the image of described zoom information and proofread and correct at preceding extraction benchmark pixel position signalling; With
Described image capture assemblies is such assembly, it be used for from described panoramic video signal catch by utilize with respect to the described image at the image of the front captive vision signal that sends dwindle/amplifying signal dwindles/amplifies position on the definite panoramic image of a frame, the described extraction benchmark pixel position signalling that is corrected of reference of the vision signal that produces by frame of vision signal or/and at the parts of images of the panoramic picture of the extraction benchmark pixel position signalling that front is produced or the described defined described panoramic video signal of extraction benchmark pixel position signalling that is corrected.
19. according to the image capture apparatus of claim 17, wherein:
The vision signal that is received by described remote image receiving system is the vision signal from a plurality of video cameras of described remote image sensing apparatus, and the shooting direction of described a plurality of video cameras is with angular separation;
Described image capture apparatus also comprises:
The camera direction storage device has wherein been stored about the identifying information of described a plurality of video cameras with corresponding to their information of shooting direction;
Wherein:
Described variation information signal representative expectation from the first direction information of the part object that forwardly divides object and change or/and the second direction information of the part object of direction, expecting perpendicular to the first direction direction message or/and the zoom information of the part object of expectation;
Described lock-on signal generation device is such device, it is by also determining to take direction with reference to the identifying information of storing in the described camera direction storage device according to transmission video camera identifying information signal and described first direction information in preceding generation, be used to produce transmission video camera identifying information signal corresponding to the video camera identifying information of the described shooting direction that is determined as described lock-on signal, and/or the benchmark pixel position signalling that obtains by the benchmark pixel position that is produced of proofreading and correct corresponding to described second direction information is or/and amplify/dwindle signal corresponding to the image of described zoom information;
Described image capture assemblies is such assembly, it is used to catch corresponding to a plurality of vision signals of the described video camera identification signal that is produced one, and be used for from described captive vision signal catch by utilize with respect to the described image at the image of the preceding captive vision signal that sends dwindle/amplifying signal dwindles/amplifies a frame of the vision signal that produces, position on the panoramic image of determining with reference to the described extraction benchmark pixel position signalling that is corrected is by frame of vision signal or/and at the parts of images of the image of preceding extraction benchmark pixel position signalling that is produced or the described defined described vision signal that is hunted down of extraction benchmark pixel position signalling that is corrected.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP009277/2003 | 2003-01-17 | ||
| JP009278/2003 | 2003-01-17 | ||
| JP2003009277 | 2003-01-17 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1698380A CN1698380A (en) | 2005-11-16 |
| CN100452868C true CN100452868C (en) | 2009-01-14 |
Family
ID=35350225
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004800001653A Expired - Lifetime CN100452868C (en) | 2003-01-17 | 2004-01-15 | Remote video display method, video acquisition device, method thereof, and program thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100452868C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106233701A (en) * | 2014-04-30 | 2016-12-14 | Ice网关有限公司 | For make information can apparatus and method |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103957356B (en) * | 2010-02-19 | 2018-11-09 | 株式会社尼康 | The image acquisition method of electronic equipment and electronic equipment |
| JP5791931B2 (en) * | 2011-03-29 | 2015-10-07 | オリンパス株式会社 | Image reproduction apparatus, imaging apparatus, and image reproduction program |
| CN103552676B (en) * | 2013-11-15 | 2015-10-07 | 河南师范大学 | A kind of buoy type submarine periscope and communicator |
| CN103763470A (en) * | 2014-01-10 | 2014-04-30 | 重庆路威科技发展有限公司 | Portable scene shooting device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0678341A (en) * | 1992-08-24 | 1994-03-18 | Kawai Musical Instr Mfg Co Ltd | Picture device |
| JP2000101992A (en) * | 1998-09-25 | 2000-04-07 | Canon Inc | Camera control system, its method, storage medium with its program stored therein, and its client |
| CN1278384A (en) * | 1997-09-04 | 2000-12-27 | 发现通信公司 | Apparatus for video access and control over computer network, including image correction |
| EP1130906A2 (en) * | 2000-01-18 | 2001-09-05 | Hewlett-Packard Company, A Delaware Corporation | Pointing device for digital camera display |
| US20010019355A1 (en) * | 1997-04-21 | 2001-09-06 | Masakazu Koyanagi | Controller for photographing apparatus and photographing system |
| US6411275B1 (en) * | 1997-12-23 | 2002-06-25 | Telefonaktiebolaget Lm Ericsson (Publ) | Hand-held display device and a method of displaying screen images |
| JP2002185952A (en) * | 2000-12-12 | 2002-06-28 | New Industry Research Organization | Image map system of real time image and its image map providing method |
| US20020175896A1 (en) * | 2001-05-16 | 2002-11-28 | Myorigo, L.L.C. | Method and device for browsing information on a display |
-
2004
- 2004-01-15 CN CNB2004800001653A patent/CN100452868C/en not_active Expired - Lifetime
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0678341A (en) * | 1992-08-24 | 1994-03-18 | Kawai Musical Instr Mfg Co Ltd | Picture device |
| US20010019355A1 (en) * | 1997-04-21 | 2001-09-06 | Masakazu Koyanagi | Controller for photographing apparatus and photographing system |
| CN1278384A (en) * | 1997-09-04 | 2000-12-27 | 发现通信公司 | Apparatus for video access and control over computer network, including image correction |
| US6411275B1 (en) * | 1997-12-23 | 2002-06-25 | Telefonaktiebolaget Lm Ericsson (Publ) | Hand-held display device and a method of displaying screen images |
| JP2000101992A (en) * | 1998-09-25 | 2000-04-07 | Canon Inc | Camera control system, its method, storage medium with its program stored therein, and its client |
| EP1130906A2 (en) * | 2000-01-18 | 2001-09-05 | Hewlett-Packard Company, A Delaware Corporation | Pointing device for digital camera display |
| JP2002185952A (en) * | 2000-12-12 | 2002-06-28 | New Industry Research Organization | Image map system of real time image and its image map providing method |
| US20020175896A1 (en) * | 2001-05-16 | 2002-11-28 | Myorigo, L.L.C. | Method and device for browsing information on a display |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106233701A (en) * | 2014-04-30 | 2016-12-14 | Ice网关有限公司 | For make information can apparatus and method |
| US10257652B2 (en) | 2014-04-30 | 2019-04-09 | Ice Gateway Gmbh | Apparatus and method for making information available |
| CN106233701B (en) * | 2014-04-30 | 2019-12-31 | Ice网关有限公司 | Apparatus and method for making information available |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1698380A (en) | 2005-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1585332B1 (en) | Remote video display method, video acquisition device, method thereof, and program thereof | |
| JP7223978B2 (en) | Calibration device and calibration method | |
| US9438806B2 (en) | Photographing apparatus and photographing method for displaying combined avatar and map information related to a subject | |
| CN100473131C (en) | Display equipment, image processing equipment and image processing method, imaging equipment and program | |
| US8994785B2 (en) | Method for generating video data and image photographing device thereof | |
| CN103562791A (en) | Apparatus and method for panoramic video imaging with mobile computing devices | |
| CN103907340A (en) | Image generation device and image generation method | |
| CN104321803A (en) | Image processing device, image processing method, and program | |
| US9438340B2 (en) | Communication method | |
| JP2009267792A (en) | Imaging apparatus | |
| US10600188B2 (en) | Method and system for correcting field of view using user terminal information upon playback of 360-degree image | |
| US10156898B2 (en) | Multi vantage point player with wearable display | |
| CN108141540A (en) | Omnidirectional camera with mobile detection | |
| CN104885441A (en) | Image processing device and method, and program | |
| US11770605B2 (en) | Apparatus and method for remote image capture with automatic subject selection | |
| AU2019271924B2 (en) | System and method for adjusting an image for a vehicle mounted camera | |
| CN111787347A (en) | Live broadcast time length calculation method, live broadcast display method, device and equipment | |
| CN100452868C (en) | Remote video display method, video acquisition device, method thereof, and program thereof | |
| JP4603403B2 (en) | Video album automatic creation system and computer program | |
| JP2003037838A (en) | Picture distribution system | |
| JP2008085408A (en) | System of adding information to photographed image | |
| CN111641774B (en) | Relay terminal, communication system, input system, relay control method | |
| KR20180101115A (en) | Video snow measurement system | |
| CN112887663A (en) | Image display method, image communication system, image capturing apparatus, and storage medium | |
| KR101906718B1 (en) | Method and system for correcting play areas using user terminal information during 360 degree content playback |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CX01 | Expiry of patent term | ||
| CX01 | Expiry of patent term |
Granted publication date: 20090114 |