CA2101437C - Television system for displaying multiple views of a remote location - Google Patents
Television system for displaying multiple views of a remote locationInfo
- Publication number
- CA2101437C CA2101437C CA002101437A CA2101437A CA2101437C CA 2101437 C CA2101437 C CA 2101437C CA 002101437 A CA002101437 A CA 002101437A CA 2101437 A CA2101437 A CA 2101437A CA 2101437 C CA2101437 C CA 2101437C
- Authority
- CA
- Canada
- Prior art keywords
- view
- cameras
- video signal
- field
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Abstract
A television system (100) comprises a sending station (70), a composing station (80) and a receiving station (90). The sending station (70) comprises a sequence of cameras (1, 2, 3,..., N) arranged so that the fields of view merge contiguously to form an aggregate field of view. The composing station (80) includes circuitry which enables a local viewer at the receiving station (90) to select an arbitrary and continuously variable subsection of the aggregate field of view for display on a local monitor (200).
Description
~~~.~.o~ a TELEVISION SYSTEM FOR DISPLAYING MULTIPLE
VIEWS OF A REMOTE LOCATION
' S Field of the Invention The present invention relates to a television system including a plurality of cameras located at a remote location and having individual fields of view which merge contiguously with one another to form an aggregate wide angle field of view. One or more display systems in communication with the plurality of remotely located cameras enables each of one or more local viewers to select an independent and arbitrary section of the aggregate field of view for display on a local monitor. The inventive system is especially useful in teleconferencing applications.
Backqround of the Invention Since the beginning of wire, and later wireless, communications, an implicit goal of communications systems has always been to bring remotely located participants as close together as possible. This is also the goal of a traditional teleconferencing system.
Ideally, the effect obtained in good communications should be one of "being theta."
A conventional teleconferencing system comprises two or more stations which are illustratively connected via the public switched telephone network. At each station, there is a camera for transmitting a video image to a remote station. There is also a microphone for picking up sound and forming an audio signal for transmission to the remote station. The typical teleconferencing station also includes a video monitor for receiving a video signal from the remote station to produce an image of a conferee at the remote station and a speaker for receiving an audio signal from the remote station.
In most teleconferencing systems, the video camera at a sending station is an NTSC camera which has a limited field of view. This camera forms an image on a conventional NTSC monitor at a receiving station remotely located relative to the sending station. One problem with this arrangement is that the conventional NTSC monitor is relatively small-sized. When the number of teleconference participants at the sending-end of a teleconference is larger than one, the image of each participant occupies a small portion of a small viewing area on the receiving monitor. As a result it becomes difficult for viewers at the receiving end of such an image to pick up non-verbal cuss from the speaker's body and face. Indeed, in many cases it is often difficult to discern at the receiving-end who of the many participants at the sending-end is actually speaking.
U.S. Patent 4,890,314 discloses a teleconferencing station which solves one aspect of this problem. In particular, in accordance with U.S. Patent 4,890,314, a transmitting teleconferencing station includes, for example, first and second cameras which are specially arranged to have contiguous fields of view over a range of ' distances from the cameras. The two cameras produce first and second video signals corresponding to first and second sub-images. At the receiving teleconferencing station, the two sub-images are displayed using a unique display device so that the two sub-images merge contiguously to form a single high resolution image. The cameras at the transmitting station collectively have a larger field of view than a single camera would have, and, at the receiving-end, a much larger image is formed than would be the case if a conventional NTSC monitor were to be utilized.
Another problem associated with the conventional teleconferencing station is that a teleconference participant has no control over the view of a remote location that is displayed on the local monitor.
Typically, at a sending teleconferencing station, whether the imaging device is a single NTSC camera or a combination of cameras as described in U.S. Patent 4,890,314, there is a fixed field of view which is transmitted to a receiving participant. The receiving participant only sees whatever object or persons happen to be in the fixed field of view.
Of course, a remote camera can be gimbal mounted and controlled by the viewer. However, in this case, there can only be a single locally available view of the remote station so that each of a plurality of viewers cannot choose their own view of the remote station.
. WO 92/l4341 ~ ~ ~ ~ ~ P~ r,~ PCT/US92/00347 Accordingly, it is an object of the present invention to provide a television system which provides a local viewer with a locally controllable view of a remote location. In particular, it is an object of the present invention to provide a system in which a local viewer can select an arbitrary and continuously variable section of a remote wide angle field of view for display on a local monitor.
It is a further object of the invention to provide a television system in which a plurality of viewers at different locations can each select his/her own view of a remote location. Specifically, it is an object of the invention to provide a television system in which each of a plurality of viewers can choose his/her own section of a remote wide angle field of view for display on his/her own monitor.
The inventive television system is especially useful in teleconferencing applications.
Summary of tho Invention In accordance with an illustrative embodiment of the present invention, a television system comprises a sequence of cameras, such as NTSC cameras, located at a remote location. The cameras are arranged so that their fields of view merge contiguously to form an aggregate wide angle field of view. The cameras are synchronized so that a horizontal line of displayable video in one WO 92/1434l PCT/US92/00347 _ 5 _ ~~ L~ ~' camera ends just at the start of a horizontal line of displayable video of the next camera in the sequence.
A local viewer has the capability of selecting an arbitrary and continuously variable section of the aggregate wide angle field of view for display on a local monitor. The arbitrarily chosen section of the overall field of view at the remote location is preferably equal in angular width to the field of view of an individual NTSC camera so that the arbitrarily chosen section of the remote field of view can be displayed on an NTSC monitor. In this case, the arbitrarily chosen section of the aggregate wide angle field of view comprises portions of the individual fields of view of at most two adjacent cameras from the sequence of remotely located cameras.
To form a composite video signal for display on the local monitor of a user, the inventive television system comprises a multiplexes which multiplexes together portions of the video signals from first and second adjacent cameras selected by the viewer and a black burst from a video sync generator. The black burst includes everything that goes into a video signal such as horizontal and vertical synchronization signals except the video information itself. Tha purpose of the multiplexes is to combine the black burst with a portion of the video information from each of the first and second selected cameras to form a composite video signal for display on the local monitor of the viewer. In particular, in addition to selecting the first and second cameras, the viewer controls the timing of the black burst signal relative to a line of video in the signal of the first selected camera. Therefore, a line of video in the composite signal includes the portion of a line of video from the first selected camera which starts at the end of the horizontal blanking interval of the black burst and which ends at the start of the next horizontal blanking interval of the video signal of the first selected camera. The line of video in the composite signal continues with a portion of a line of video from the second selected camera which ends at the start of the next horizontal blanking interval of the black burst. This is possible because as indicated above, the two selected adjacent cameras are synchronized so that a line of displayable video of the first camera ends just when a line of displayable video of the second camera begins.
Accordingly, a viewer, such as a teleconference participant, can arbitrarily choose a desired field of view of a remote location to display on a local monitor.
In particular, a viewer can control the displayed field of view by controlling the selection of up to two remotely located cameras out of a sequence of remotely located cameras and by controlling the relative portions of the video signal from the two selected cameras which are combined to form a composite video signal displayed on the local monitor.
''~- ~~ 0 ~ 4 3 ~.
It should be noted that the composing circuitry for forming the composite video signal may be located at the transmitting-end along with the cameras, or at the receiving-end. Alternatively, the circuitry for forming the composite video image may be located at a location separate from the transmitting-end and the receiving-end, such as for example a central office of a telephone network. It is a significant advantage of the invention that the video signals produced by the sequence of cameras can be utilized by a plurality of viewers to form individual composite video signals so that each individual viewer can choose his/her own section of the aggregate field of view for display on his/her own monitor.
In accordance with one aspect of the present invention there is provided a television system comprising a sending station comprising a sequence of cameras and means for optically arranging said cameras such that the individual fields of view of adjacent ones of said cameras merge contiguously to form an aggregate wide angle field of view a composing station comprising means for generating a composite video signal for displaying an image of an arbitrary and contiguously variable subsection of said aggregate wide angle field of view, and a receiving station comprising a monitor for displaying said image.
In accordance with another aspect of the present invention there is provided an optical arrangement for contiguously merging image to form an aggregate wide angle field of view, comprising a plurality of cameras, i, (i=1 to N), each of said plurality of cameras having a field of view 9~, a plurality of first mirrors, j~, and a plurality of second mirrors, k~, wherein each of said first and second mirrors, j~ and k~, respectively, correspond to one of said plurality of cameras, i, are positioned to fold the optical rays comprising the field of view of camera, i, such that there is enough room to mount said plurality of cameras at the common optical vertex, and wherein the - 7a -field of view of each of said cameras merge contiguously with the fields of view of adjacent cameras so that the fields of view A~, are combined to form an aggregate wide angle field of view.
Brief Description of the Drawing FIG 1 schematically illustrates the difficulty in arranging a sequence of cameras with contiguous fields of view.
FIG 2 illustrates an optical system comprising a sequence of cameras and associated mirrors arranged so that the cameras have contiguous fields of view, in accordance with the present invention.
FIG 3 illustrates one of the cameras and associated mirrors of FIG 2 in greater detail.
FIG 4 and FIG 5 illustrate an alternative optical system wherein a sequence of cameras is arranged so that the cameras have contiguous fields of view.
_ 8 FIG 6 schematically illustrates a system for selecting a section of the aggregate field of view of the cameras in FIG 2 for display by a viewer on a local monitor, in accordance with the present invention.
FIG 7 shows how the cameras of FIG 2 and FIG 6 are synchronized.
FIG 8 schematically illustrates a synchronization control circuit utilized in the system of FIG 6.
FIG 9 shows the formation of a composite video signal corresponding to an arbitrarily chosen section of the aggregate field of view of the cameras of FIG 2 and FIG 6.
FIG 10 shows an example of an image formed using a composite video signal of the type illustrated in FIG 9.
Detailed Description of the Invention The detailed description of the invention is divided into two sections. Section A describes arrangements of sequences of cameras in which the cameras have contiguous fields of view that merge together to form an aggregate wide angle field of view.
section B describes a television system which enables a viewer to select a section of the aggregate field of view for display on a local monitor.
A. Optical Arrangement FIG 1 schematically illustrates the difficulty in arranging a plurality of video cameras to have _ g contiguous fields of view. In FIG 1, the field of view of video camera 1 is labeled a, the field of view of video camera 2 is labeled b, and the field of view of video camera 3 is labeled c. The fields of view of the three cameras are contiguous over a range of distances from the cameras and merge together to form an aggregate field of view labeled d. However, in order for the fields of view a, b, c to be contiguous, the corresponding cameras 1, 2, 3 must a11 be located at the common vertex O of the three fields of view. As shown in FIG 1, this is physically impossible, since it is not possible for a11 three cameras to occupy the same position in space. Thus, to achieve contiguous fields of view, it is not possible to simply place a sequence of cameras one next to the other.
FIG 2 illustrates a physically realizable arrangement of cameras and mirrors where the cameras and mirrors are positioned so that the fields of view of adjacent cameras merge contiguously to form an aggregate wide angle field of view. FIG 2 illustrates a plurality of cameras i, i=1,2,3,...,N. In FIG 2, N=8 so that there is a sequence of eight cameras illustrated in FIG
2. The field of view of each camera 1,2,...,N, is labeled 81,-82,...,8N, respectively. The field of view of each camera in FIG 2 merges continuously with the fields of view of adjacent cameras so that the fields of view B1, 82,...,8N are aggregated together to form an aggregate wide angle field of view ~.
WO 92/l4341 PCT/US92/00347 ,-, Associated with each camera i in FIG 2 are the mirrors 10-i and 20-i. Thus, associated with the camera 1 are the mirrors 10-1 and 20-1 and associated with the camera N are the mirrors 10-N and 20-N. The mirrors 5 10-i and 20-i associated with each camera i fold the optical rays comprising the field of view of each camera so that there is enough room to mount actual cameras at the common vertex.
The operation of the two mirrors associated with 10 each camera may be understood in connection with FIG 3.
FIG 3 shows the mirrors 10-i and 20-i associated with the camera i. The field of view of the camera i is folded twice by the mirrors 10-i and 20-i to eliminate overall mirror inversion and to allow the various cameras to be physically separated in space as shown in FIG 2.
In FIG 3, the mirror 10-i is oriented at an angle with respect to the lefthand ray 12 entering the camera.
As shown in FIG 3, the ray 12 is reflected at the lafthand edge of the mirror 10-i and reflected again at the lefthand edge of the mirror 20-i before entering the camera i. The righthand ray 14 is reflected from the righthand edge of the mirror 10-i and reflected again at the righthand edge of the mirror 20-i before entering the camera i. The left and right hand rays 12 and 14 define the left and righthand boundaries of the field of view B i of the camera i .
WO 92/1434l PCT/US92/00347 The problem is to insure that the lefthand ray 12 does not intersect the first mirror 10-i a second time after reflection by the second mirror 20-i. A solution exists provided the angle ~ is positive. In particular, the first mirror 10-i does not interfere with the beam path coming off the second mirror, i.e. ~ is positive, when D
a -< 2 +ø (1) to where a is the angle between the ray 12 and the mirror 20-i after reflection from the mirror 20-i.
The angle a is fixed when the angles B and ~ are specified. In particular, the angle a is determined by ~.lllC s SUI~o'f'~I~
(2) + cos(o+~) where g and k are the sides of a triangle having the mirror 20-i as one side as shown in FIG 3. As shown in FIG 3, the side k is formed by part of the mirror 10-(i-1) associated with the preceding camera i-I in the sequence (see FIG 2).
There is a free scale factor which can be set to unity in which case ' Sln _ Sll1 sia(0-i-~) 1 sin(o.f.?.~),' _ sin0 _ sin0 ~ ( 3 ) sin(20+~) (~ sin(0+2~) - ~
Illustratively, when B~=30°, interference with the mirror 10-i is avoided with an angle ~ up to 30°.
In the implementation of an array of cameras having contiguous fields of view as shown in FIGS 2 and 3, the use of the second mirror 20-i associated with the camera i, provides a second inversion which compensates for the inversion caused by the first mirror 10-i. However, if the camera itself or the display device on which the image is displayed accomplishes an inversion, only one mirror may be utilized with each camera.
For example, if the scan reversal is accomplished to electrically through the use of reverse scan cameras, then a very compact camera arrangement can be utilized to obtain the aggregate wide angle field of view.
FIG 4 shows a side view and FIG 5 shows a top view of a six-sided pyramidal mirror 50. Each of the mirror sides 52 captures a field of view 8 of an associated video camera 54 with scan reversal. In this manner a six camera arrangement with an aggregate field of view of substantially 360° may be achieved.
2o H. Disnlav And Composition System Section A above describes how a plurality of cameras, such as NTSC cameras, can be arranged so that the fields of view of adjacent cameras merge contiguously to form an aggregate wide angle field of view. Section B describes how a viewer can select an arbitrary and continuously variable section of the aggregate field of view, such as the subsection B' of FIG 2, and display a video image corresponding to the selected subsection of the aggregate field of view.
A television system which enables a viewer to select an arbitrary subsection of a wide angle field of view is illustrated in FIG 6. The television system 100 of FIG 6 comprises a sending station 70, a composing station 80 and a receiving station 90. Physically, the composing station 80 may be located at the sending station 70, at the receiving station 90, or at a location separate from the sending station 70 and the receiving station 90 such as at a central office of a telecommunications network. The composing station is the location of the circuitry for composing a composite video signal corresponding to an arbitrary and variable section of the aggregate field of view of FIG 2.
At the sending station 70, there is a sequence of cameras 1,2,...,N arranged as shown in FIG 2, to have contiguously merging fields of view. At the receiving station 90, a monitor 20o displays an image corresponding to a section B' (see FIG 2) of the aggregate field of view formed by the cameras 1,2,...,N.
Preferably, the viewer selected field of view B' is equal in angular width to the field of view Bi of an individual camera. Thus, B' comprises portions of at most two adjacent individual fields of view. For example, in FIG 2, B'comprises a portion of the field of view B1 of camera 1 and a portion of the field of view B 2 of camera 2 .
WO 92/14341 ~, PGT/US92/00347 In FIG 6, cameras 1,2,....,N at the sending station 70 are synchronized by a synchronization control circuit 102. The cameras are synchronized so that a horizontal line of displayable video of one camera ends just when a q horizontal line of displayable video of the next adjacent camera begins.
FIG 7 shows the synchronization relationship between the cameras 1,2,3,.... In particular, FIG 7 shows segments of the video signals generated by the video camera 1,2,3, and 4 of FIG 6. Each segment of video signal comprises in a repetitive pattern a horizontal line of video information followed by a horizontal blanking interval. As can be seen in FIG 7, a horizontal line .~ of information of one camera (e. g.
camera 1) ends just at the beginning of a like-numbered horizontal line ,t of information of the next camera (e.g. camera 2).
An illustrative embodiment of the synchronization control circuit 102 (see FIG 6) is shown in FIG 8. As shown in FIG 8, the synchronization control circuit 102 comprises one sync generator for each, video camera.
Thus, corresponding to the video cameras 1,2,...,N are the sync generators 1,2,...,N, respectively. Each sync generator outputs to its corresponding camera a plurality of synchronization signals such as horizontal timing, vertical timing and color subcarrier synchronization signals. The input to each sync generator is a sequence of pulses. Thasa pulses are P~i'lU~ 9 ? ~/ t~ 0 ~ ~ 7 15 - ~ ~P~S 13 D E D 199Z
generated by a pulse generator 103. The input pulses for each successive sync generator shown in FIG 8 are delayed by a delay D relative to the preceding sync generator in the sequence. Each delay D is equal to the duration of one horizontal line of video information.
When this delay is utilized, the video signals generated by the cameras 1,2,3,...,N have the phase relationship shown in FIG 7.
Returning now to FIG 6, the video signals from the cameras 1,2,3,...,N era transmitted to a plurality of composing stations such as the station 80 of FIG 6.
Illustratively in FIG 2 the number of cameras N is chosen as 8 allowing the use of 3 binary select lines Q0~ Q1~ Q2 as shown in FIG 6 to select one among eight camera pairs. Iiowsver, m select lines can ba used to select any camsra pair among 2m+1 cameras. In particular, the video signals from all but the last of the cameras at the sanding station 70, i.e. the video signals troa the cameras 1,2,3,...,N-1, are transmitted to a first multiplsxer at the composing station 80, which first multiplaxar is designated herein as MUX A.
The video signals from all but the first of the cameras at the sanding station 70, i.e. the cameras 2,3,...,N-1,N, are also transmitted to a second multiplaxer at the composing station 80 designated herein as MUX H. Note that the input lines to the MUX A
which receive the video signals are numbered 1,2,...,N-1 and that the input lines of MUX H which receive the S~gSTtTUTE SN~ET
IPEAIIJS
WO 92!l4341 PCT/US92/00347 video signals are numbered 2,3,...,N-1,N. Both MUX A
and MUX H receive the same set of user generated selection signals. This single set of selection signals Q0. Q1~ Q2 is generated at the receiver station 90 and serves to select the video signal from one camera, designated herein as camera A, on the output line 104 of MUX A and the video signal from the adjacent camera, designated herein as camera B, on the output line 106 of MIJX B .
The video signal for camera A on line 104 and the video signal for camera H on line 106 are transmitted to a third multiplexes, designated herein as MUX C. Also transmitted to the MUX C on line 108 is a black burst generated by the video sync generator 110. The black burst contains a11 the components of a video signal including horizontal and vertical sync pulses and color burst but does not contain any video information. Thus, the MUX C receives the video signal from camera A on line 104, the video signal from camera H on line 106 and the black burst on line 108. The multiplexes C also receives three selection signals on lines 114, 116, and 118. Tha selection signal on 118 is a logic low during the composite blanking interval and is derived from the video sync generator 110. When the selection signals on lines 114, 116, 1l8 have the pattern LO, HI, HI, the video signal from camera A is transmitted to the output 12o of MUX C. When the selection signals on lines 114, 116, 118 have the pattern HI, L0, HI, the video signal of camera H is transmitted to the output 120 of MUX C.
Similarly, when the selection signals on lines 114, 116, 118 have the pattern HI, HI, L0, the black burst is transmitted to the output 12o. In this manner, the video signals from selected cameras A and B and the black burst are combined to form a composite video signal for display on the viewer monitor 200. The logic network used to generate the selection signals to the MUX C is discussed below.
l0 At the composing station 80, the horizontal drive signal (HD), the vertical drive signal (VD) and the odd field signal OF of the selected camera A are recovered using conventional circuitry (not shown). The horizontal drive signal for camera A (HD) is connected to the "R" input of the flip-flop 136. The "S~' input of the flip-flop 136 receives the composite blanking signal (CB) from the video sync generator 110. A first input of the NAND-gate 137 is connected to the Q output of the flip-flop 136 and a first input of the NAND-gate 139 is connected to the Q output of the flip-flop 136. The second input of the gate 137 and the second input of the NAND-gate 139 receive the composite blanking signal (CB) of the video sync generator 110. The flip-flop 136 and the NAND gates 137 and 139 form a logic network which generates the selection signals on lines 114 and 116.
As indicated previously, the selection signal on line 118 is the composite blanking signal (CB) generated by the video sync generator 110.
FIG 9 illustrates the video signal of camera A, the video signal for camera B, the black burst and the composite output signal. As indicated previously, cameras A and B are synchronized so that a horizontal line ,~ of displayable video information of camera A ends just at the start of a horizontal displayable video line ,~ of camera B. The selection signals on lines 114, 116, and 118 are generated by the vido sync generator 110 and logic elements 136, 137, and 139 so that the black burst is transmitted to the output 120 of the MUX C during the horizontal and vertical blanking intervals. Thus, the composite output video signal includes the horizontal blanking interval signals of the black burst. As shown in FIG 9, the horizontal blanking interval of the black burst ends at a point in time x which is located in a horizontal line .~ of video for camera A. At this point, the selection signals of MUX C change so that the signal of camera A is transmitted to the output 120 of the MUX
C. Thus from the point x to tha end of the video line of camera A at point y, the video signal of camera A is used to form the composite output signal. At the end of the horizontal line of camera A at point y, the select signals change so that the video from camera B is transmitted to the output 120 of the MUX C. Thus the composite signal is now formed from the video signal for camera H. This continues until the start of the next horizontal blanking interval of the black burst. At this point, the selection signals of the MUX C change again so that the horizontal blanking interval signal of the black burst is transmitted to the output 120 of the MUX C. Thus the composite video output signal comprises the horizontal and vertical sync signals and color burst from the black burst, and each horizontal line in the composite video output signal is made up in part from the video of camera A and in part from the video of camera B.
The image which results from the composite video signal of FIG 9 may be understood in connection with FIG
10. FIG 10 shows the image that is produced by the video signal of camera A alone, the image that is produced by the video signal of camera 8 alone and the video image which is produced by the composite video signal. Note that the composite image has the same length as the video image of camera A and camera 8 as they all are NTSC images, and that the composite image starts at point x in the image of camera A.
As discussed previously, it is an object of the system 100 0! FIG 6 to display an arbitrary and continuously variable section B' (sae FIG 2) of the aggregate field of view ~ of the cameras 1,2,...N. To do this, the user needs to select two consecutive cameras from the sequence of cameras 1,2,3,...N and once the two cameras A and H are selected, choose a point x in the horizontal video line of the first camera at which the composite image is to start. As indicated previously, the cameras A and B are determined by the selection 2p signals Q0, Q1, Q2 generated at the receiving station 90. The generation of these signals is discussed below.
The point x is determined by the timing of the pulses from the pulse generator 150. The pulse generator 150 illustratively generates 300nsec wide pulses. The timing of these pulses determines the timing of the horizontal blanking signal of the black burst, i.e., the location of the horizontal blanking signal of the black burst relative to the video signal of camera A.
The timing of the pulses from the pulse generator 150 is determined by the count in the counter 160. The count in the counter 160 is determined as follows. The viewer who controls the receiving station 90 utilizes a user input device 170. Under the control of the viewer, the input device 170 outputs a sequence of pulses on line 172. Depending on the signal on line 174, the pulses on line 172 cause the count Q'0, Q'1, Q'2 in the counter 180 to increase or decrease. Illustratively, view selection within a camera pair is shown with three binary signals QO', Q1', Q2' allowing a total of eight selectable views. However, the number of selectable views can be increased to 2m (for m > 3) where m binary signals are transferred from the counter 180 to the counter 160. The count in the counter 180 is transferred to the counter 160 so as to control the timing of the pulses generated by the pulse generator 150 and thus control the location of the point x in FIGS
9 and 10. The count is transferred from the counter 18o ... - 21 ~~~_~~
to the counter l60 in response to an OF pulse of camera A being transferred to the ld input of the counter 160 after inversion by the inverter 163.
Typically, the pulse generator 150 is required to deliver a pulse at a time which is delayed from the start of a new frame in camera A. A flip-flop 161 is set by the odd field (OF) pulse of camera A after inversion by the inverter 163 so that when the next vertical drive pulse (VD) of camera A occurs, logical low level signal Vp can be passed through an OR-gate 162 to enable the counter 160. At that time the counter 160 counts downward from the count loaded from the counter 180 to zero. When the counter 160 reaches zero, the counter 160 outputs a signal to the pulse generator 150 and the pulse generator 150 in turn sends a 300 nsec pulse to the video sync generator 110. The flip-flop 161 is reset by the output signal of the counter 160.
Illustratively, if the count in the counter 180 is decreased, the point x is moved to the left, and if the count in the counter 180 is increased, the point x is moved to the right. In other words, if the count in the counter 180 is decreased, the image on the monitor 200 pans to the left and if the count in the counter 18o is increased the image on the monitor 200 pans to the right. If the count in the counter 180 remains constant, the field of view of the image on the monitor 200 remains the same.
Connected to the panning counter 180 of FIG 6 is the camera selection counter 190. The counter 190 outputs the camera selection signals Q0, Q1, Q2. The counter 190 receives the signal on line 174 which indicates whether it is to count up or count down. The camera selection signals Q0, Q1, Q2 are generated as follows. When the viewer selects the count up direction and when the viewer generates so many pulses on line 172 that the panning counter 180 overflows, a signal is transmitted on line 182 from the panning counter 180 to the camera selection counter 190 causing the count in the camera selection counter 190 to increase by one.
when the counter 18o reaches its maximum count, it means that the image on the monitor 200 has panned as far to the right as possible for the selected cameras A and B
and to pan further to the right it is necessary to change the selected cameras by increasing the count in the counter 190 by one.
Similarly, when the viewer selects the count down direction and when the viewer generates so many pulses on line 172 that the counter 180 reaches zero, a signal is transmitted on line 180 to the counter 19o causing the count in the counter 190 to decrease by one. When the panning counter 180 reaches its minimum count, it means that the image on the monitor 200 has panned as far to the left as possible for the selected cameras A
and B and to pan further to the left it is necessary to WO 92/14341 PCT/US92/00347~
Z~~(~-~~
change the selected cameras by decreasing the count in the counter 190 by one.
CONCLUSION
A television system has been disclosed which enables a viewer to display on a local monitor an arbitrary and continuously variable subsection of a remotely located aggregate ffield of view formed by an array of cameras.
Finally, the above-described embodiments of the invention are intended to be illustrative only.
Numerous alternative embodiments may be devised by those skilled in the art without departing from the spirit and scope of the following claims.
VIEWS OF A REMOTE LOCATION
' S Field of the Invention The present invention relates to a television system including a plurality of cameras located at a remote location and having individual fields of view which merge contiguously with one another to form an aggregate wide angle field of view. One or more display systems in communication with the plurality of remotely located cameras enables each of one or more local viewers to select an independent and arbitrary section of the aggregate field of view for display on a local monitor. The inventive system is especially useful in teleconferencing applications.
Backqround of the Invention Since the beginning of wire, and later wireless, communications, an implicit goal of communications systems has always been to bring remotely located participants as close together as possible. This is also the goal of a traditional teleconferencing system.
Ideally, the effect obtained in good communications should be one of "being theta."
A conventional teleconferencing system comprises two or more stations which are illustratively connected via the public switched telephone network. At each station, there is a camera for transmitting a video image to a remote station. There is also a microphone for picking up sound and forming an audio signal for transmission to the remote station. The typical teleconferencing station also includes a video monitor for receiving a video signal from the remote station to produce an image of a conferee at the remote station and a speaker for receiving an audio signal from the remote station.
In most teleconferencing systems, the video camera at a sending station is an NTSC camera which has a limited field of view. This camera forms an image on a conventional NTSC monitor at a receiving station remotely located relative to the sending station. One problem with this arrangement is that the conventional NTSC monitor is relatively small-sized. When the number of teleconference participants at the sending-end of a teleconference is larger than one, the image of each participant occupies a small portion of a small viewing area on the receiving monitor. As a result it becomes difficult for viewers at the receiving end of such an image to pick up non-verbal cuss from the speaker's body and face. Indeed, in many cases it is often difficult to discern at the receiving-end who of the many participants at the sending-end is actually speaking.
U.S. Patent 4,890,314 discloses a teleconferencing station which solves one aspect of this problem. In particular, in accordance with U.S. Patent 4,890,314, a transmitting teleconferencing station includes, for example, first and second cameras which are specially arranged to have contiguous fields of view over a range of ' distances from the cameras. The two cameras produce first and second video signals corresponding to first and second sub-images. At the receiving teleconferencing station, the two sub-images are displayed using a unique display device so that the two sub-images merge contiguously to form a single high resolution image. The cameras at the transmitting station collectively have a larger field of view than a single camera would have, and, at the receiving-end, a much larger image is formed than would be the case if a conventional NTSC monitor were to be utilized.
Another problem associated with the conventional teleconferencing station is that a teleconference participant has no control over the view of a remote location that is displayed on the local monitor.
Typically, at a sending teleconferencing station, whether the imaging device is a single NTSC camera or a combination of cameras as described in U.S. Patent 4,890,314, there is a fixed field of view which is transmitted to a receiving participant. The receiving participant only sees whatever object or persons happen to be in the fixed field of view.
Of course, a remote camera can be gimbal mounted and controlled by the viewer. However, in this case, there can only be a single locally available view of the remote station so that each of a plurality of viewers cannot choose their own view of the remote station.
. WO 92/l4341 ~ ~ ~ ~ ~ P~ r,~ PCT/US92/00347 Accordingly, it is an object of the present invention to provide a television system which provides a local viewer with a locally controllable view of a remote location. In particular, it is an object of the present invention to provide a system in which a local viewer can select an arbitrary and continuously variable section of a remote wide angle field of view for display on a local monitor.
It is a further object of the invention to provide a television system in which a plurality of viewers at different locations can each select his/her own view of a remote location. Specifically, it is an object of the invention to provide a television system in which each of a plurality of viewers can choose his/her own section of a remote wide angle field of view for display on his/her own monitor.
The inventive television system is especially useful in teleconferencing applications.
Summary of tho Invention In accordance with an illustrative embodiment of the present invention, a television system comprises a sequence of cameras, such as NTSC cameras, located at a remote location. The cameras are arranged so that their fields of view merge contiguously to form an aggregate wide angle field of view. The cameras are synchronized so that a horizontal line of displayable video in one WO 92/1434l PCT/US92/00347 _ 5 _ ~~ L~ ~' camera ends just at the start of a horizontal line of displayable video of the next camera in the sequence.
A local viewer has the capability of selecting an arbitrary and continuously variable section of the aggregate wide angle field of view for display on a local monitor. The arbitrarily chosen section of the overall field of view at the remote location is preferably equal in angular width to the field of view of an individual NTSC camera so that the arbitrarily chosen section of the remote field of view can be displayed on an NTSC monitor. In this case, the arbitrarily chosen section of the aggregate wide angle field of view comprises portions of the individual fields of view of at most two adjacent cameras from the sequence of remotely located cameras.
To form a composite video signal for display on the local monitor of a user, the inventive television system comprises a multiplexes which multiplexes together portions of the video signals from first and second adjacent cameras selected by the viewer and a black burst from a video sync generator. The black burst includes everything that goes into a video signal such as horizontal and vertical synchronization signals except the video information itself. Tha purpose of the multiplexes is to combine the black burst with a portion of the video information from each of the first and second selected cameras to form a composite video signal for display on the local monitor of the viewer. In particular, in addition to selecting the first and second cameras, the viewer controls the timing of the black burst signal relative to a line of video in the signal of the first selected camera. Therefore, a line of video in the composite signal includes the portion of a line of video from the first selected camera which starts at the end of the horizontal blanking interval of the black burst and which ends at the start of the next horizontal blanking interval of the video signal of the first selected camera. The line of video in the composite signal continues with a portion of a line of video from the second selected camera which ends at the start of the next horizontal blanking interval of the black burst. This is possible because as indicated above, the two selected adjacent cameras are synchronized so that a line of displayable video of the first camera ends just when a line of displayable video of the second camera begins.
Accordingly, a viewer, such as a teleconference participant, can arbitrarily choose a desired field of view of a remote location to display on a local monitor.
In particular, a viewer can control the displayed field of view by controlling the selection of up to two remotely located cameras out of a sequence of remotely located cameras and by controlling the relative portions of the video signal from the two selected cameras which are combined to form a composite video signal displayed on the local monitor.
''~- ~~ 0 ~ 4 3 ~.
It should be noted that the composing circuitry for forming the composite video signal may be located at the transmitting-end along with the cameras, or at the receiving-end. Alternatively, the circuitry for forming the composite video image may be located at a location separate from the transmitting-end and the receiving-end, such as for example a central office of a telephone network. It is a significant advantage of the invention that the video signals produced by the sequence of cameras can be utilized by a plurality of viewers to form individual composite video signals so that each individual viewer can choose his/her own section of the aggregate field of view for display on his/her own monitor.
In accordance with one aspect of the present invention there is provided a television system comprising a sending station comprising a sequence of cameras and means for optically arranging said cameras such that the individual fields of view of adjacent ones of said cameras merge contiguously to form an aggregate wide angle field of view a composing station comprising means for generating a composite video signal for displaying an image of an arbitrary and contiguously variable subsection of said aggregate wide angle field of view, and a receiving station comprising a monitor for displaying said image.
In accordance with another aspect of the present invention there is provided an optical arrangement for contiguously merging image to form an aggregate wide angle field of view, comprising a plurality of cameras, i, (i=1 to N), each of said plurality of cameras having a field of view 9~, a plurality of first mirrors, j~, and a plurality of second mirrors, k~, wherein each of said first and second mirrors, j~ and k~, respectively, correspond to one of said plurality of cameras, i, are positioned to fold the optical rays comprising the field of view of camera, i, such that there is enough room to mount said plurality of cameras at the common optical vertex, and wherein the - 7a -field of view of each of said cameras merge contiguously with the fields of view of adjacent cameras so that the fields of view A~, are combined to form an aggregate wide angle field of view.
Brief Description of the Drawing FIG 1 schematically illustrates the difficulty in arranging a sequence of cameras with contiguous fields of view.
FIG 2 illustrates an optical system comprising a sequence of cameras and associated mirrors arranged so that the cameras have contiguous fields of view, in accordance with the present invention.
FIG 3 illustrates one of the cameras and associated mirrors of FIG 2 in greater detail.
FIG 4 and FIG 5 illustrate an alternative optical system wherein a sequence of cameras is arranged so that the cameras have contiguous fields of view.
_ 8 FIG 6 schematically illustrates a system for selecting a section of the aggregate field of view of the cameras in FIG 2 for display by a viewer on a local monitor, in accordance with the present invention.
FIG 7 shows how the cameras of FIG 2 and FIG 6 are synchronized.
FIG 8 schematically illustrates a synchronization control circuit utilized in the system of FIG 6.
FIG 9 shows the formation of a composite video signal corresponding to an arbitrarily chosen section of the aggregate field of view of the cameras of FIG 2 and FIG 6.
FIG 10 shows an example of an image formed using a composite video signal of the type illustrated in FIG 9.
Detailed Description of the Invention The detailed description of the invention is divided into two sections. Section A describes arrangements of sequences of cameras in which the cameras have contiguous fields of view that merge together to form an aggregate wide angle field of view.
section B describes a television system which enables a viewer to select a section of the aggregate field of view for display on a local monitor.
A. Optical Arrangement FIG 1 schematically illustrates the difficulty in arranging a plurality of video cameras to have _ g contiguous fields of view. In FIG 1, the field of view of video camera 1 is labeled a, the field of view of video camera 2 is labeled b, and the field of view of video camera 3 is labeled c. The fields of view of the three cameras are contiguous over a range of distances from the cameras and merge together to form an aggregate field of view labeled d. However, in order for the fields of view a, b, c to be contiguous, the corresponding cameras 1, 2, 3 must a11 be located at the common vertex O of the three fields of view. As shown in FIG 1, this is physically impossible, since it is not possible for a11 three cameras to occupy the same position in space. Thus, to achieve contiguous fields of view, it is not possible to simply place a sequence of cameras one next to the other.
FIG 2 illustrates a physically realizable arrangement of cameras and mirrors where the cameras and mirrors are positioned so that the fields of view of adjacent cameras merge contiguously to form an aggregate wide angle field of view. FIG 2 illustrates a plurality of cameras i, i=1,2,3,...,N. In FIG 2, N=8 so that there is a sequence of eight cameras illustrated in FIG
2. The field of view of each camera 1,2,...,N, is labeled 81,-82,...,8N, respectively. The field of view of each camera in FIG 2 merges continuously with the fields of view of adjacent cameras so that the fields of view B1, 82,...,8N are aggregated together to form an aggregate wide angle field of view ~.
WO 92/l4341 PCT/US92/00347 ,-, Associated with each camera i in FIG 2 are the mirrors 10-i and 20-i. Thus, associated with the camera 1 are the mirrors 10-1 and 20-1 and associated with the camera N are the mirrors 10-N and 20-N. The mirrors 5 10-i and 20-i associated with each camera i fold the optical rays comprising the field of view of each camera so that there is enough room to mount actual cameras at the common vertex.
The operation of the two mirrors associated with 10 each camera may be understood in connection with FIG 3.
FIG 3 shows the mirrors 10-i and 20-i associated with the camera i. The field of view of the camera i is folded twice by the mirrors 10-i and 20-i to eliminate overall mirror inversion and to allow the various cameras to be physically separated in space as shown in FIG 2.
In FIG 3, the mirror 10-i is oriented at an angle with respect to the lefthand ray 12 entering the camera.
As shown in FIG 3, the ray 12 is reflected at the lafthand edge of the mirror 10-i and reflected again at the lefthand edge of the mirror 20-i before entering the camera i. The righthand ray 14 is reflected from the righthand edge of the mirror 10-i and reflected again at the righthand edge of the mirror 20-i before entering the camera i. The left and right hand rays 12 and 14 define the left and righthand boundaries of the field of view B i of the camera i .
WO 92/1434l PCT/US92/00347 The problem is to insure that the lefthand ray 12 does not intersect the first mirror 10-i a second time after reflection by the second mirror 20-i. A solution exists provided the angle ~ is positive. In particular, the first mirror 10-i does not interfere with the beam path coming off the second mirror, i.e. ~ is positive, when D
a -< 2 +ø (1) to where a is the angle between the ray 12 and the mirror 20-i after reflection from the mirror 20-i.
The angle a is fixed when the angles B and ~ are specified. In particular, the angle a is determined by ~.lllC s SUI~o'f'~I~
(2) + cos(o+~) where g and k are the sides of a triangle having the mirror 20-i as one side as shown in FIG 3. As shown in FIG 3, the side k is formed by part of the mirror 10-(i-1) associated with the preceding camera i-I in the sequence (see FIG 2).
There is a free scale factor which can be set to unity in which case ' Sln _ Sll1 sia(0-i-~) 1 sin(o.f.?.~),' _ sin0 _ sin0 ~ ( 3 ) sin(20+~) (~ sin(0+2~) - ~
Illustratively, when B~=30°, interference with the mirror 10-i is avoided with an angle ~ up to 30°.
In the implementation of an array of cameras having contiguous fields of view as shown in FIGS 2 and 3, the use of the second mirror 20-i associated with the camera i, provides a second inversion which compensates for the inversion caused by the first mirror 10-i. However, if the camera itself or the display device on which the image is displayed accomplishes an inversion, only one mirror may be utilized with each camera.
For example, if the scan reversal is accomplished to electrically through the use of reverse scan cameras, then a very compact camera arrangement can be utilized to obtain the aggregate wide angle field of view.
FIG 4 shows a side view and FIG 5 shows a top view of a six-sided pyramidal mirror 50. Each of the mirror sides 52 captures a field of view 8 of an associated video camera 54 with scan reversal. In this manner a six camera arrangement with an aggregate field of view of substantially 360° may be achieved.
2o H. Disnlav And Composition System Section A above describes how a plurality of cameras, such as NTSC cameras, can be arranged so that the fields of view of adjacent cameras merge contiguously to form an aggregate wide angle field of view. Section B describes how a viewer can select an arbitrary and continuously variable section of the aggregate field of view, such as the subsection B' of FIG 2, and display a video image corresponding to the selected subsection of the aggregate field of view.
A television system which enables a viewer to select an arbitrary subsection of a wide angle field of view is illustrated in FIG 6. The television system 100 of FIG 6 comprises a sending station 70, a composing station 80 and a receiving station 90. Physically, the composing station 80 may be located at the sending station 70, at the receiving station 90, or at a location separate from the sending station 70 and the receiving station 90 such as at a central office of a telecommunications network. The composing station is the location of the circuitry for composing a composite video signal corresponding to an arbitrary and variable section of the aggregate field of view of FIG 2.
At the sending station 70, there is a sequence of cameras 1,2,...,N arranged as shown in FIG 2, to have contiguously merging fields of view. At the receiving station 90, a monitor 20o displays an image corresponding to a section B' (see FIG 2) of the aggregate field of view formed by the cameras 1,2,...,N.
Preferably, the viewer selected field of view B' is equal in angular width to the field of view Bi of an individual camera. Thus, B' comprises portions of at most two adjacent individual fields of view. For example, in FIG 2, B'comprises a portion of the field of view B1 of camera 1 and a portion of the field of view B 2 of camera 2 .
WO 92/14341 ~, PGT/US92/00347 In FIG 6, cameras 1,2,....,N at the sending station 70 are synchronized by a synchronization control circuit 102. The cameras are synchronized so that a horizontal line of displayable video of one camera ends just when a q horizontal line of displayable video of the next adjacent camera begins.
FIG 7 shows the synchronization relationship between the cameras 1,2,3,.... In particular, FIG 7 shows segments of the video signals generated by the video camera 1,2,3, and 4 of FIG 6. Each segment of video signal comprises in a repetitive pattern a horizontal line of video information followed by a horizontal blanking interval. As can be seen in FIG 7, a horizontal line .~ of information of one camera (e. g.
camera 1) ends just at the beginning of a like-numbered horizontal line ,t of information of the next camera (e.g. camera 2).
An illustrative embodiment of the synchronization control circuit 102 (see FIG 6) is shown in FIG 8. As shown in FIG 8, the synchronization control circuit 102 comprises one sync generator for each, video camera.
Thus, corresponding to the video cameras 1,2,...,N are the sync generators 1,2,...,N, respectively. Each sync generator outputs to its corresponding camera a plurality of synchronization signals such as horizontal timing, vertical timing and color subcarrier synchronization signals. The input to each sync generator is a sequence of pulses. Thasa pulses are P~i'lU~ 9 ? ~/ t~ 0 ~ ~ 7 15 - ~ ~P~S 13 D E D 199Z
generated by a pulse generator 103. The input pulses for each successive sync generator shown in FIG 8 are delayed by a delay D relative to the preceding sync generator in the sequence. Each delay D is equal to the duration of one horizontal line of video information.
When this delay is utilized, the video signals generated by the cameras 1,2,3,...,N have the phase relationship shown in FIG 7.
Returning now to FIG 6, the video signals from the cameras 1,2,3,...,N era transmitted to a plurality of composing stations such as the station 80 of FIG 6.
Illustratively in FIG 2 the number of cameras N is chosen as 8 allowing the use of 3 binary select lines Q0~ Q1~ Q2 as shown in FIG 6 to select one among eight camera pairs. Iiowsver, m select lines can ba used to select any camsra pair among 2m+1 cameras. In particular, the video signals from all but the last of the cameras at the sanding station 70, i.e. the video signals troa the cameras 1,2,3,...,N-1, are transmitted to a first multiplsxer at the composing station 80, which first multiplaxar is designated herein as MUX A.
The video signals from all but the first of the cameras at the sanding station 70, i.e. the cameras 2,3,...,N-1,N, are also transmitted to a second multiplaxer at the composing station 80 designated herein as MUX H. Note that the input lines to the MUX A
which receive the video signals are numbered 1,2,...,N-1 and that the input lines of MUX H which receive the S~gSTtTUTE SN~ET
IPEAIIJS
WO 92!l4341 PCT/US92/00347 video signals are numbered 2,3,...,N-1,N. Both MUX A
and MUX H receive the same set of user generated selection signals. This single set of selection signals Q0. Q1~ Q2 is generated at the receiver station 90 and serves to select the video signal from one camera, designated herein as camera A, on the output line 104 of MUX A and the video signal from the adjacent camera, designated herein as camera B, on the output line 106 of MIJX B .
The video signal for camera A on line 104 and the video signal for camera H on line 106 are transmitted to a third multiplexes, designated herein as MUX C. Also transmitted to the MUX C on line 108 is a black burst generated by the video sync generator 110. The black burst contains a11 the components of a video signal including horizontal and vertical sync pulses and color burst but does not contain any video information. Thus, the MUX C receives the video signal from camera A on line 104, the video signal from camera H on line 106 and the black burst on line 108. The multiplexes C also receives three selection signals on lines 114, 116, and 118. Tha selection signal on 118 is a logic low during the composite blanking interval and is derived from the video sync generator 110. When the selection signals on lines 114, 116, 1l8 have the pattern LO, HI, HI, the video signal from camera A is transmitted to the output 12o of MUX C. When the selection signals on lines 114, 116, 118 have the pattern HI, L0, HI, the video signal of camera H is transmitted to the output 120 of MUX C.
Similarly, when the selection signals on lines 114, 116, 118 have the pattern HI, HI, L0, the black burst is transmitted to the output 12o. In this manner, the video signals from selected cameras A and B and the black burst are combined to form a composite video signal for display on the viewer monitor 200. The logic network used to generate the selection signals to the MUX C is discussed below.
l0 At the composing station 80, the horizontal drive signal (HD), the vertical drive signal (VD) and the odd field signal OF of the selected camera A are recovered using conventional circuitry (not shown). The horizontal drive signal for camera A (HD) is connected to the "R" input of the flip-flop 136. The "S~' input of the flip-flop 136 receives the composite blanking signal (CB) from the video sync generator 110. A first input of the NAND-gate 137 is connected to the Q output of the flip-flop 136 and a first input of the NAND-gate 139 is connected to the Q output of the flip-flop 136. The second input of the gate 137 and the second input of the NAND-gate 139 receive the composite blanking signal (CB) of the video sync generator 110. The flip-flop 136 and the NAND gates 137 and 139 form a logic network which generates the selection signals on lines 114 and 116.
As indicated previously, the selection signal on line 118 is the composite blanking signal (CB) generated by the video sync generator 110.
FIG 9 illustrates the video signal of camera A, the video signal for camera B, the black burst and the composite output signal. As indicated previously, cameras A and B are synchronized so that a horizontal line ,~ of displayable video information of camera A ends just at the start of a horizontal displayable video line ,~ of camera B. The selection signals on lines 114, 116, and 118 are generated by the vido sync generator 110 and logic elements 136, 137, and 139 so that the black burst is transmitted to the output 120 of the MUX C during the horizontal and vertical blanking intervals. Thus, the composite output video signal includes the horizontal blanking interval signals of the black burst. As shown in FIG 9, the horizontal blanking interval of the black burst ends at a point in time x which is located in a horizontal line .~ of video for camera A. At this point, the selection signals of MUX C change so that the signal of camera A is transmitted to the output 120 of the MUX
C. Thus from the point x to tha end of the video line of camera A at point y, the video signal of camera A is used to form the composite output signal. At the end of the horizontal line of camera A at point y, the select signals change so that the video from camera B is transmitted to the output 120 of the MUX C. Thus the composite signal is now formed from the video signal for camera H. This continues until the start of the next horizontal blanking interval of the black burst. At this point, the selection signals of the MUX C change again so that the horizontal blanking interval signal of the black burst is transmitted to the output 120 of the MUX C. Thus the composite video output signal comprises the horizontal and vertical sync signals and color burst from the black burst, and each horizontal line in the composite video output signal is made up in part from the video of camera A and in part from the video of camera B.
The image which results from the composite video signal of FIG 9 may be understood in connection with FIG
10. FIG 10 shows the image that is produced by the video signal of camera A alone, the image that is produced by the video signal of camera 8 alone and the video image which is produced by the composite video signal. Note that the composite image has the same length as the video image of camera A and camera 8 as they all are NTSC images, and that the composite image starts at point x in the image of camera A.
As discussed previously, it is an object of the system 100 0! FIG 6 to display an arbitrary and continuously variable section B' (sae FIG 2) of the aggregate field of view ~ of the cameras 1,2,...N. To do this, the user needs to select two consecutive cameras from the sequence of cameras 1,2,3,...N and once the two cameras A and H are selected, choose a point x in the horizontal video line of the first camera at which the composite image is to start. As indicated previously, the cameras A and B are determined by the selection 2p signals Q0, Q1, Q2 generated at the receiving station 90. The generation of these signals is discussed below.
The point x is determined by the timing of the pulses from the pulse generator 150. The pulse generator 150 illustratively generates 300nsec wide pulses. The timing of these pulses determines the timing of the horizontal blanking signal of the black burst, i.e., the location of the horizontal blanking signal of the black burst relative to the video signal of camera A.
The timing of the pulses from the pulse generator 150 is determined by the count in the counter 160. The count in the counter 160 is determined as follows. The viewer who controls the receiving station 90 utilizes a user input device 170. Under the control of the viewer, the input device 170 outputs a sequence of pulses on line 172. Depending on the signal on line 174, the pulses on line 172 cause the count Q'0, Q'1, Q'2 in the counter 180 to increase or decrease. Illustratively, view selection within a camera pair is shown with three binary signals QO', Q1', Q2' allowing a total of eight selectable views. However, the number of selectable views can be increased to 2m (for m > 3) where m binary signals are transferred from the counter 180 to the counter 160. The count in the counter 180 is transferred to the counter 160 so as to control the timing of the pulses generated by the pulse generator 150 and thus control the location of the point x in FIGS
9 and 10. The count is transferred from the counter 18o ... - 21 ~~~_~~
to the counter l60 in response to an OF pulse of camera A being transferred to the ld input of the counter 160 after inversion by the inverter 163.
Typically, the pulse generator 150 is required to deliver a pulse at a time which is delayed from the start of a new frame in camera A. A flip-flop 161 is set by the odd field (OF) pulse of camera A after inversion by the inverter 163 so that when the next vertical drive pulse (VD) of camera A occurs, logical low level signal Vp can be passed through an OR-gate 162 to enable the counter 160. At that time the counter 160 counts downward from the count loaded from the counter 180 to zero. When the counter 160 reaches zero, the counter 160 outputs a signal to the pulse generator 150 and the pulse generator 150 in turn sends a 300 nsec pulse to the video sync generator 110. The flip-flop 161 is reset by the output signal of the counter 160.
Illustratively, if the count in the counter 180 is decreased, the point x is moved to the left, and if the count in the counter 180 is increased, the point x is moved to the right. In other words, if the count in the counter 180 is decreased, the image on the monitor 200 pans to the left and if the count in the counter 18o is increased the image on the monitor 200 pans to the right. If the count in the counter 180 remains constant, the field of view of the image on the monitor 200 remains the same.
Connected to the panning counter 180 of FIG 6 is the camera selection counter 190. The counter 190 outputs the camera selection signals Q0, Q1, Q2. The counter 190 receives the signal on line 174 which indicates whether it is to count up or count down. The camera selection signals Q0, Q1, Q2 are generated as follows. When the viewer selects the count up direction and when the viewer generates so many pulses on line 172 that the panning counter 180 overflows, a signal is transmitted on line 182 from the panning counter 180 to the camera selection counter 190 causing the count in the camera selection counter 190 to increase by one.
when the counter 18o reaches its maximum count, it means that the image on the monitor 200 has panned as far to the right as possible for the selected cameras A and B
and to pan further to the right it is necessary to change the selected cameras by increasing the count in the counter 190 by one.
Similarly, when the viewer selects the count down direction and when the viewer generates so many pulses on line 172 that the counter 180 reaches zero, a signal is transmitted on line 180 to the counter 19o causing the count in the counter 190 to decrease by one. When the panning counter 180 reaches its minimum count, it means that the image on the monitor 200 has panned as far to the left as possible for the selected cameras A
and B and to pan further to the left it is necessary to WO 92/14341 PCT/US92/00347~
Z~~(~-~~
change the selected cameras by decreasing the count in the counter 190 by one.
CONCLUSION
A television system has been disclosed which enables a viewer to display on a local monitor an arbitrary and continuously variable subsection of a remotely located aggregate ffield of view formed by an array of cameras.
Finally, the above-described embodiments of the invention are intended to be illustrative only.
Numerous alternative embodiments may be devised by those skilled in the art without departing from the spirit and scope of the following claims.
Claims (17)
1. A television system comprising a sending station comprising a sequence of cameras and means for optically arranging said cameras such that the individual fields of view of adjacent ones of said cameras merge contiguously to form an aggregate wide angle field of view, a composing station comprising means for generating a composite video signal for displaying an image of an arbitrary and contiguously variable subsection of said aggregate wide angle field of view, and a receiving station comprising a monitor for displaying said image.
2. The television system of claim 1 wherein said sending station further comprises a synchronization control circuit for synchronizing said cameras so that a horizontal line of a video signal generated by one camera ends at the beginning of a horizontal line of a video signal generated by the next camera in said sequence.
3. The television system of claim 1 wherein said cameras are NTSC cameras and stud monitor is an NTSC monitor.
4. The television system of claim 1 wherein said generating means comprises, first selection means for selecting first and second video signals produced by first and second cameras from said sequence, and second selection means for selecting a portion of said first video signal and a portion of said second video signal for forming said composite video signal.
5. A television system comprising a sending station comprising a sequence of cameras arranged so that the individual fields of view of adjacent ones of said cameras merge contiguously to form an aggregate wide angle field of view, a composing station comprising means for generating a composite video signal for displaying an image of an arbitrary and continuously variable subsection of said aggregate wide angle field of view, and a receiving station comprising a monitor for displaying said image, wherein said generating means comprises, first selection means for selecting first and second video signals produced by first and second cameras from said sequence, and second selection means for selecting a portion of said first video signal and a portion of said second video signal for forming said composite video signal, wherein said first selection means comprises first multiplexing means for receiving a video signal from all but the last of said cameras in said sequence and second multiplexing means for receiving a video signal from all but the first of said cameras in said sequence, and wherein said receiving station comprises a first counter for generating a selection signal for said first and second multiplexing means to output said first and second video signals, respectively.
6. The television system of claim 5 wherein said generating means further comprises a video sync generator for generating a black burst.
7. The television system of claim 6 wherein said generating means further comprises a third multiplexing means for multiplexing said selected portion of said first and second video signals of said first and second cameras and said black burst to form said composite video signal.
8. The television system of claim 7 wherein said generating means further comprises means for controlling the position of a horizontal blanking interval of said black burst relative to a line of video in said first video signal of said first camera.
9. The television system of claim 8 wherein said controlling means comprises a pulse generator for transmitting timing pulses to said video sync generator, and wherein said receiving station comprises a second counter for controlling the timing of said timing pulses relative to said first video signal of said first camera.
10. A composing station for use in a television system comprising means for receiving a video signal from each of a sequence of cameras arranged so that their individual fields of view merge contiguously to form an aggregate wide angle field of view, and means for generating from said received video signals a composite video signal for displaying on a display monitor an image of an arbitrary and continuously variable subsection of said aggregate field of view.
11. A composing station for use in a television system comprising means for receiving a video signal from each of a sequence of cameras arranged so that their individual fields of view merge contiguously to form an aggregate wide angle field of view, and means for generating from said received video signals a composite video signal for displaying on a display monitor an image of an arbitrary and continuously variable subsection of said aggregate field of view, wherein said generating means comprises means for selecting from said received video signals first and second video signals transmitted from first and second adjacent ones of said cameras, means for generating a black burst, and means for multiplexing selected portions of said first and second video signals and said black burst to form said composite video signal.
12. A television system comprising a sending station comprising a sequence of cameras arranged so that the individual fields of view of adjacent ones of said cameras merge contiguously to form an aggregate wide angle field of view, means for receiving video signals generated by said cameras and for generating one or more composite video signals, each composite video signal being formed from one or more of said received video signals and corresponding to an arbitrary and continuously variable subsection of said aggregate wide angle field of view, and one or more monitors for receiving one of said composite video signals and for displaying an image of a subsection of said aggregate field of view.
13. A television system comprising a sending station comprising a sequence of cameras arranged so that the individual fields of view of adjacent ones of said cameras merge contiguously to form an aggregated wide angle field of view, a composing station comprising means for generating a composite video signal for displaying an image of an arbitrary and continuously variable subsection of said aggregate wide angle field of view, and a receiving station comprising a monitor for displaying said image, wherein said sending station comprises first and second minors corresponding to each of said cameras, said first and second mirrors being positioned to fold the optical rays comprising the field of view of the corresponding camera such that there is sufficient room to mount said cameras at the common optical vertex.
14. An optical arrangement for contiguously merging image to form an aggregate wide angle field of view, comprising:
a plurality of cameras, i, (i=l to N), each of said plurality of cameras having a field of view .theta.i, a plurality of first mirrors, j i, and a plurality of second mirrors, k i, wherein each of said first and second mirrors, j i and k i, respectively, correspond to one of said plurality of cameras, i, are positioned to fold the optical rays comprising the field of view of camera, i, such that there is enough room to mount said plurality of cameras at the common optical vertex, and wherein the field of view of each of said cameras merge contiguously with the fields of view of adjacent cameras so that the fields of view .theta.
i, are combined to form an aggregate wide angle field of view.
a plurality of cameras, i, (i=l to N), each of said plurality of cameras having a field of view .theta.i, a plurality of first mirrors, j i, and a plurality of second mirrors, k i, wherein each of said first and second mirrors, j i and k i, respectively, correspond to one of said plurality of cameras, i, are positioned to fold the optical rays comprising the field of view of camera, i, such that there is enough room to mount said plurality of cameras at the common optical vertex, and wherein the field of view of each of said cameras merge contiguously with the fields of view of adjacent cameras so that the fields of view .theta.
i, are combined to form an aggregate wide angle field of view.
15. The optical arrangement of claim 14 wherein a leftmost ray in the field of view .theta. of each of said plurality of cameras does not intersect said first mirror, j i, a second time after being reflected by said second mirror, k i.
16. An optical arrangement for contiguously merging images to form an aggregate wide angle field of view, comprising:
a plurality of cameras, (i=1 to N), each having a field of view .theta. i, and a plurality of mirrors, h i, wherein each of said mirrors, corresponds to one of said plurality of cameras, i, wherein each of said mirrors, h i, is positioned to fold the optical rays comprising the field of view of camera, i, so that there is enough room to mount said plurality of cameras at the common optical vertex, and wherein the field of view of each of said cameras merge contiguously with the fields of view of adjacent camera so that the fields of view .theta. i are combined to form an aggregate wide angle field of view.
a plurality of cameras, (i=1 to N), each having a field of view .theta. i, and a plurality of mirrors, h i, wherein each of said mirrors, corresponds to one of said plurality of cameras, i, wherein each of said mirrors, h i, is positioned to fold the optical rays comprising the field of view of camera, i, so that there is enough room to mount said plurality of cameras at the common optical vertex, and wherein the field of view of each of said cameras merge contiguously with the fields of view of adjacent camera so that the fields of view .theta. i are combined to form an aggregate wide angle field of view.
17. The optical arrangement of claim 16 wherein each camera of said plurality of cameras inverts the image in its field of view.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US649,025 | 1991-02-01 | ||
| US07/649,025 US5187571A (en) | 1991-02-01 | 1991-02-01 | Television system for displaying multiple views of a remote location |
| PCT/US1992/000347 WO1992014341A1 (en) | 1991-02-01 | 1992-01-14 | Television system for displaying multiple views of a remote location |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2101437A1 CA2101437A1 (en) | 1992-08-02 |
| CA2101437C true CA2101437C (en) | 1999-08-17 |
Family
ID=24603171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002101437A Expired - Lifetime CA2101437C (en) | 1991-02-01 | 1992-01-14 | Television system for displaying multiple views of a remote location |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US5187571A (en) |
| EP (1) | EP0569466A4 (en) |
| JP (1) | JP2696272B2 (en) |
| CA (1) | CA2101437C (en) |
| WO (1) | WO1992014341A1 (en) |
Families Citing this family (154)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE4290947T1 (en) * | 1991-04-08 | 1993-04-01 | Hitachi, Ltd., Tokio/Tokyo, Jp | |
| US5267039A (en) * | 1991-12-31 | 1993-11-30 | Elbex Video Ltd. | Method and apparatus for processing, recording and retrieving a plurality of coded video signals |
| US6449011B1 (en) * | 1992-03-27 | 2002-09-10 | Canon Kabushiki Kaisha | Video camera system having panhead for use in video conference or the like |
| US5317394A (en) * | 1992-04-30 | 1994-05-31 | Westinghouse Electric Corp. | Distributed aperture imaging and tracking system |
| US6121966A (en) * | 1992-11-02 | 2000-09-19 | Apple Computer, Inc. | Navigable viewing system |
| DE69324224T2 (en) * | 1992-12-29 | 1999-10-28 | Koninkl Philips Electronics Nv | Image processing method and apparatus for generating an image from a plurality of adjacent images |
| US5532737A (en) * | 1993-05-03 | 1996-07-02 | Bell Communications Research, Inc. | Camera arrangement with wide field of view |
| GB2281672A (en) * | 1993-09-03 | 1995-03-08 | Ibm | Video conferencing system |
| DE69411849T2 (en) * | 1993-10-20 | 1999-03-04 | Philips Electronics Nv | Process for processing luminance levels in a composite image and image processing system using this process |
| US5440337A (en) * | 1993-11-12 | 1995-08-08 | Puritan-Bennett Corporation | Multi-camera closed circuit television system for aircraft |
| JPH09507620A (en) * | 1994-01-10 | 1997-07-29 | フイスズ，リチャード，シー． | Observing a captured object from a selected viewpoint |
| US6064355A (en) * | 1994-05-24 | 2000-05-16 | Texas Instruments Incorporated | Method and apparatus for playback with a virtual reality system |
| US5572248A (en) * | 1994-09-19 | 1996-11-05 | Teleport Corporation | Teleconferencing method and system for providing face-to-face, non-animated teleconference environment |
| JPH08149130A (en) * | 1994-11-25 | 1996-06-07 | Canon Inc | Video communication system |
| US5659323A (en) * | 1994-12-21 | 1997-08-19 | Digital Air, Inc. | System for producing time-independent virtual camera movement in motion pictures and other media |
| US5703961A (en) * | 1994-12-29 | 1997-12-30 | Worldscape L.L.C. | Image transformation and synthesis methods |
| US6327381B1 (en) | 1994-12-29 | 2001-12-04 | Worldscape, Llc | Image transformation and synthesis methods |
| US6972786B1 (en) | 1994-12-30 | 2005-12-06 | Collaboration Properties, Inc. | Multimedia services using central office |
| US5751338A (en) * | 1994-12-30 | 1998-05-12 | Visionary Corporate Technologies | Methods and systems for multimedia communications via public telephone networks |
| US6195122B1 (en) | 1995-01-31 | 2001-02-27 | Robert Vincent | Spatial referenced photography |
| WO1996027983A1 (en) * | 1995-03-07 | 1996-09-12 | Interval Research Corporation | System and method for selective recording of information |
| US5990934A (en) * | 1995-04-28 | 1999-11-23 | Lucent Technologies, Inc. | Method and system for panoramic viewing |
| US5737011A (en) * | 1995-05-03 | 1998-04-07 | Bell Communications Research, Inc. | Infinitely expandable real-time video conferencing system |
| US5657096A (en) * | 1995-05-03 | 1997-08-12 | Lukacs; Michael Edward | Real time video conferencing system and method with multilayer keying of multiple video images |
| US5793415A (en) * | 1995-05-15 | 1998-08-11 | Imagetel International Inc. | Videoconferencing and multimedia system |
| US5703604A (en) * | 1995-05-22 | 1997-12-30 | Dodeca Llc | Immersive dodecaherdral video viewing system |
| US5657073A (en) * | 1995-06-01 | 1997-08-12 | Panoramic Viewing Systems, Inc. | Seamless multi-camera panoramic imaging with distortion correction and selectable field of view |
| JPH11509064A (en) * | 1995-07-10 | 1999-08-03 | サーノフ コーポレイション | Methods and systems for representing and combining images |
| US5963250A (en) * | 1995-10-20 | 1999-10-05 | Parkervision, Inc. | System and method for controlling the field of view of a camera |
| US6115176A (en) * | 1995-11-30 | 2000-09-05 | Lucent Technologies Inc. | Spherical viewing/projection apparatus |
| US6111702A (en) | 1995-11-30 | 2000-08-29 | Lucent Technologies Inc. | Panoramic viewing system with offset virtual optical centers |
| JP3618891B2 (en) * | 1996-04-08 | 2005-02-09 | キヤノン株式会社 | Camera control apparatus and camera control information display method |
| US5708469A (en) * | 1996-05-03 | 1998-01-13 | International Business Machines Corporation | Multiple view telepresence camera system using a wire cage which surroundss a plurality of movable cameras and identifies fields of view |
| CN1311679C (en) * | 1996-05-31 | 2007-04-18 | 松下电器产业株式会社 | Data transmitter and receiver and method thereof |
| US6373642B1 (en) | 1996-06-24 | 2002-04-16 | Be Here Corporation | Panoramic imaging arrangement |
| US6459451B2 (en) | 1996-06-24 | 2002-10-01 | Be Here Corporation | Method and apparatus for a panoramic camera to capture a 360 degree image |
| US6331869B1 (en) | 1998-08-07 | 2001-12-18 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
| US6341044B1 (en) | 1996-06-24 | 2002-01-22 | Be Here Corporation | Panoramic imaging arrangement |
| US6493032B1 (en) | 1996-06-24 | 2002-12-10 | Be Here Corporation | Imaging arrangement which allows for capturing an image of a view at different resolutions |
| US6133943A (en) * | 1996-09-30 | 2000-10-17 | Intel Corporation | Method and apparatus for producing a composite image |
| US7092012B2 (en) * | 1996-11-15 | 2006-08-15 | Canon Kabushiki Kaisha | Image processing apparatus and method, storage medium, and communication system |
| US5893062A (en) | 1996-12-05 | 1999-04-06 | Interval Research Corporation | Variable rate video playback with synchronized audio |
| US6263507B1 (en) * | 1996-12-05 | 2001-07-17 | Interval Research Corporation | Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data |
| WO1998047291A2 (en) * | 1997-04-16 | 1998-10-22 | Isight Ltd. | Video teleconferencing |
| US6466254B1 (en) | 1997-05-08 | 2002-10-15 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
| US6043837A (en) | 1997-05-08 | 2000-03-28 | Be Here Corporation | Method and apparatus for electronically distributing images from a panoptic camera system |
| US6356296B1 (en) | 1997-05-08 | 2002-03-12 | Behere Corporation | Method and apparatus for implementing a panoptic camera system |
| US6624846B1 (en) | 1997-07-18 | 2003-09-23 | Interval Research Corporation | Visual user interface for use in controlling the interaction of a device with a spatial region |
| US7280134B1 (en) * | 1998-01-26 | 2007-10-09 | Thales Avionics, Inc. | Landscape camera system with electronic field of view switching |
| US6226035B1 (en) * | 1998-03-04 | 2001-05-01 | Cyclo Vision Technologies, Inc. | Adjustable imaging system with wide angle capability |
| WO1999052288A1 (en) | 1998-04-02 | 1999-10-14 | Kewazinga Corp. | A navigable telepresence method and system utilizing an array of cameras |
| US6522325B1 (en) * | 1998-04-02 | 2003-02-18 | Kewazinga Corp. | Navigable telepresence method and system utilizing an array of cameras |
| US6924832B1 (en) | 1998-08-07 | 2005-08-02 | Be Here Corporation | Method, apparatus & computer program product for tracking objects in a warped video image |
| US6285365B1 (en) | 1998-08-28 | 2001-09-04 | Fullview, Inc. | Icon referenced panoramic image display |
| US6195204B1 (en) * | 1998-08-28 | 2001-02-27 | Lucent Technologies Inc. | Compact high resolution panoramic viewing system |
| US6128143A (en) * | 1998-08-28 | 2000-10-03 | Lucent Technologies Inc. | Panoramic viewing system with support stand |
| US6141145A (en) * | 1998-08-28 | 2000-10-31 | Lucent Technologies | Stereo panoramic viewing system |
| US6144501A (en) * | 1998-08-28 | 2000-11-07 | Lucent Technologies Inc. | Split mirrored panoramic image display |
| US6369818B1 (en) | 1998-11-25 | 2002-04-09 | Be Here Corporation | Method, apparatus and computer program product for generating perspective corrected data from warped information |
| US6175454B1 (en) | 1999-01-13 | 2001-01-16 | Behere Corporation | Panoramic imaging arrangement |
| US6227862B1 (en) | 1999-02-12 | 2001-05-08 | Advanced Drivers Education Products And Training, Inc. | Driver training system |
| CA2309459A1 (en) * | 1999-06-10 | 2000-12-10 | International Business Machines Corporation | System for personalized field of view in a broadcast environment |
| US7015954B1 (en) * | 1999-08-09 | 2006-03-21 | Fuji Xerox Co., Ltd. | Automatic video system using multiple cameras |
| US7155735B1 (en) * | 1999-10-08 | 2006-12-26 | Vulcan Patents Llc | System and method for the broadcast dissemination of time-ordered data |
| US6757682B1 (en) | 2000-01-28 | 2004-06-29 | Interval Research Corporation | Alerting users to items of current interest |
| US6738356B1 (en) | 2000-08-10 | 2004-05-18 | Convedia Corporation | Object oriented video merging system |
| KR20020025301A (en) * | 2000-09-28 | 2002-04-04 | 오길록 | Apparatus and Method for Furnishing Augmented-Reality Graphic using Panoramic Image with Supporting Multiuser |
| FR2818860B1 (en) * | 2000-12-22 | 2004-01-16 | France Telecom | INTERACTIVE AUDIOVISUAL SYSTEM COMPRISING MULTIPLE SHOOTING DEVICES |
| US20020147991A1 (en) * | 2001-04-10 | 2002-10-10 | Furlan John L. W. | Transmission of panoramic video via existing video infrastructure |
| US6658348B2 (en) * | 2001-10-09 | 2003-12-02 | Hewlett-Packard Development Company, L.P. | Systems and methods for providing information to users |
| US7239345B1 (en) | 2001-10-12 | 2007-07-03 | Worldscape, Inc. | Camera arrangements with backlighting detection and methods of using same |
| US7058239B2 (en) * | 2001-10-29 | 2006-06-06 | Eyesee360, Inc. | System and method for panoramic imaging |
| JP2003219389A (en) * | 2002-01-18 | 2003-07-31 | Nippon Telegr & Teleph Corp <Ntt> | Video distribution method, system, and apparatus, user terminal, video distribution program, and storage medium storing the video distribution program |
| JP2003230127A (en) * | 2002-01-31 | 2003-08-15 | Matsushita Electric Ind Co Ltd | Digest image specifying system, digest image providing system, digest image specifying method, medium and program |
| AU2003226047A1 (en) * | 2002-04-10 | 2003-10-27 | Pan-X Imaging, Inc. | A digital imaging system |
| FR2839232B1 (en) * | 2002-04-30 | 2005-06-03 | France Telecom | IMAGE DISPLAY AND RECORDING DEVICE |
| US7525576B2 (en) * | 2003-02-17 | 2009-04-28 | Axis, Ab | Method and apparatus for panning and tilting a camera |
| SE0300428D0 (en) * | 2003-02-17 | 2003-02-17 | Axis Ab | Digital camera having panning and / or tilting functionality |
| US7463280B2 (en) | 2003-06-03 | 2008-12-09 | Steuart Iii Leonard P | Digital 3D/360 degree camera system |
| US20050010874A1 (en) * | 2003-07-07 | 2005-01-13 | Steven Moder | Virtual collaborative editing room |
| SE0302065D0 (en) * | 2003-07-14 | 2003-07-14 | Stefan Carlsson | Video - method and apparatus |
| US7119829B2 (en) * | 2003-07-31 | 2006-10-10 | Dreamworks Animation Llc | Virtual conference room |
| US20100013917A1 (en) * | 2003-08-12 | 2010-01-21 | Keith Hanna | Method and system for performing surveillance |
| US20060031916A1 (en) * | 2004-04-30 | 2006-02-09 | Vulcan Inc. | Management and non-linear presentation of broadcasted or streamed multimedia content |
| US20060031879A1 (en) * | 2004-04-30 | 2006-02-09 | Vulcan Inc. | Management and non-linear presentation of news-related broadcasted or streamed multimedia content |
| US20060031885A1 (en) * | 2004-04-30 | 2006-02-09 | Vulcan Inc. | Management and non-linear presentation of music-related broadcasted or streamed multimedia content |
| US7515174B1 (en) | 2004-12-06 | 2009-04-07 | Dreamworks Animation L.L.C. | Multi-user video conferencing with perspective correct eye-to-eye contact |
| US7524119B2 (en) * | 2005-02-03 | 2009-04-28 | Paul Sandhu | Apparatus and method for viewing radiographs |
| CN101496387B (en) * | 2006-03-06 | 2012-09-05 | 思科技术公司 | System and method for access authentication in a mobile wireless network |
| US7823056B1 (en) * | 2006-03-15 | 2010-10-26 | Adobe Systems Incorporated | Multiple-camera video recording |
| US20070279483A1 (en) * | 2006-05-31 | 2007-12-06 | Beers Ted W | Blended Space For Aligning Video Streams |
| US7623755B2 (en) | 2006-08-17 | 2009-11-24 | Adobe Systems Incorporated | Techniques for positioning audio and video clips |
| US8498497B2 (en) * | 2006-11-17 | 2013-07-30 | Microsoft Corporation | Swarm imaging |
| WO2008068456A2 (en) * | 2006-12-06 | 2008-06-12 | Sony United Kingdom Limited | A method and an apparatus for generating image content |
| GB2444533B (en) | 2006-12-06 | 2011-05-04 | Sony Uk Ltd | A method and an apparatus for generating image content |
| JP4684262B2 (en) * | 2007-06-07 | 2011-05-18 | ルネサスエレクトロニクス株式会社 | CCD image sensor |
| US8570373B2 (en) * | 2007-06-08 | 2013-10-29 | Cisco Technology, Inc. | Tracking an object utilizing location information associated with a wireless device |
| US9666091B2 (en) | 2008-01-10 | 2017-05-30 | Lifelong Driver Llc | Driver training system |
| US20090184981A1 (en) * | 2008-01-23 | 2009-07-23 | De Matos Lucio D Orazio Pedro | system, method and computer program product for displaying images according to user position |
| US8355041B2 (en) * | 2008-02-14 | 2013-01-15 | Cisco Technology, Inc. | Telepresence system for 360 degree video conferencing |
| US8797377B2 (en) * | 2008-02-14 | 2014-08-05 | Cisco Technology, Inc. | Method and system for videoconference configuration |
| US8319819B2 (en) * | 2008-03-26 | 2012-11-27 | Cisco Technology, Inc. | Virtual round-table videoconference |
| US8390667B2 (en) | 2008-04-15 | 2013-03-05 | Cisco Technology, Inc. | Pop-up PIP for people not in picture |
| US9661275B2 (en) * | 2008-06-13 | 2017-05-23 | Scott Gordon | Dynamic multi-perspective interactive event visualization system and method |
| US8694658B2 (en) * | 2008-09-19 | 2014-04-08 | Cisco Technology, Inc. | System and method for enabling communication sessions in a network environment |
| US8659637B2 (en) * | 2009-03-09 | 2014-02-25 | Cisco Technology, Inc. | System and method for providing three dimensional video conferencing in a network environment |
| US8477175B2 (en) * | 2009-03-09 | 2013-07-02 | Cisco Technology, Inc. | System and method for providing three dimensional imaging in a network environment |
| US20100283829A1 (en) * | 2009-05-11 | 2010-11-11 | Cisco Technology, Inc. | System and method for translating communications between participants in a conferencing environment |
| US8659639B2 (en) * | 2009-05-29 | 2014-02-25 | Cisco Technology, Inc. | System and method for extending communications between participants in a conferencing environment |
| US9082297B2 (en) * | 2009-08-11 | 2015-07-14 | Cisco Technology, Inc. | System and method for verifying parameters in an audiovisual environment |
| US8555406B2 (en) | 2009-10-06 | 2013-10-08 | At&T Intellectual Property I, L.P. | Remote viewing of multimedia content |
| US9225916B2 (en) * | 2010-03-18 | 2015-12-29 | Cisco Technology, Inc. | System and method for enhancing video images in a conferencing environment |
| USD626103S1 (en) | 2010-03-21 | 2010-10-26 | Cisco Technology, Inc. | Video unit with integrated features |
| USD628175S1 (en) | 2010-03-21 | 2010-11-30 | Cisco Technology, Inc. | Mounted video unit |
| USD628968S1 (en) | 2010-03-21 | 2010-12-14 | Cisco Technology, Inc. | Free-standing video unit |
| USD626102S1 (en) | 2010-03-21 | 2010-10-26 | Cisco Tech Inc | Video unit with integrated features |
| JP2011199735A (en) * | 2010-03-23 | 2011-10-06 | Toshiba Corp | Image processing device, and image processing system |
| US9313452B2 (en) | 2010-05-17 | 2016-04-12 | Cisco Technology, Inc. | System and method for providing retracting optics in a video conferencing environment |
| US8896655B2 (en) | 2010-08-31 | 2014-11-25 | Cisco Technology, Inc. | System and method for providing depth adaptive video conferencing |
| US8599934B2 (en) | 2010-09-08 | 2013-12-03 | Cisco Technology, Inc. | System and method for skip coding during video conferencing in a network environment |
| CN102438153B (en) * | 2010-09-29 | 2015-11-25 | 华为终端有限公司 | Multi-camera image correction method and equipment |
| US8599865B2 (en) | 2010-10-26 | 2013-12-03 | Cisco Technology, Inc. | System and method for provisioning flows in a mobile network environment |
| US8699457B2 (en) | 2010-11-03 | 2014-04-15 | Cisco Technology, Inc. | System and method for managing flows in a mobile network environment |
| US8730297B2 (en) | 2010-11-15 | 2014-05-20 | Cisco Technology, Inc. | System and method for providing camera functions in a video environment |
| US8902244B2 (en) | 2010-11-15 | 2014-12-02 | Cisco Technology, Inc. | System and method for providing enhanced graphics in a video environment |
| US9338394B2 (en) | 2010-11-15 | 2016-05-10 | Cisco Technology, Inc. | System and method for providing enhanced audio in a video environment |
| US9143725B2 (en) | 2010-11-15 | 2015-09-22 | Cisco Technology, Inc. | System and method for providing enhanced graphics in a video environment |
| US8542264B2 (en) | 2010-11-18 | 2013-09-24 | Cisco Technology, Inc. | System and method for managing optics in a video environment |
| US8723914B2 (en) | 2010-11-19 | 2014-05-13 | Cisco Technology, Inc. | System and method for providing enhanced video processing in a network environment |
| US9111138B2 (en) | 2010-11-30 | 2015-08-18 | Cisco Technology, Inc. | System and method for gesture interface control |
| USD678308S1 (en) | 2010-12-16 | 2013-03-19 | Cisco Technology, Inc. | Display screen with graphical user interface |
| USD678320S1 (en) | 2010-12-16 | 2013-03-19 | Cisco Technology, Inc. | Display screen with graphical user interface |
| USD682864S1 (en) | 2010-12-16 | 2013-05-21 | Cisco Technology, Inc. | Display screen with graphical user interface |
| USD678894S1 (en) | 2010-12-16 | 2013-03-26 | Cisco Technology, Inc. | Display screen with graphical user interface |
| USD682294S1 (en) | 2010-12-16 | 2013-05-14 | Cisco Technology, Inc. | Display screen with graphical user interface |
| USD682854S1 (en) | 2010-12-16 | 2013-05-21 | Cisco Technology, Inc. | Display screen for graphical user interface |
| USD682293S1 (en) | 2010-12-16 | 2013-05-14 | Cisco Technology, Inc. | Display screen with graphical user interface |
| USD678307S1 (en) | 2010-12-16 | 2013-03-19 | Cisco Technology, Inc. | Display screen with graphical user interface |
| US8692862B2 (en) | 2011-02-28 | 2014-04-08 | Cisco Technology, Inc. | System and method for selection of video data in a video conference environment |
| US8670019B2 (en) | 2011-04-28 | 2014-03-11 | Cisco Technology, Inc. | System and method for providing enhanced eye gaze in a video conferencing environment |
| US8786631B1 (en) | 2011-04-30 | 2014-07-22 | Cisco Technology, Inc. | System and method for transferring transparency information in a video environment |
| US8934026B2 (en) | 2011-05-12 | 2015-01-13 | Cisco Technology, Inc. | System and method for video coding in a dynamic environment |
| US10013893B2 (en) | 2011-10-31 | 2018-07-03 | Lifelong Driver Llc | Driver training |
| US9349300B2 (en) | 2011-10-31 | 2016-05-24 | Lifelong Driver Llc | Senior driver training |
| US8947493B2 (en) | 2011-11-16 | 2015-02-03 | Cisco Technology, Inc. | System and method for alerting a participant in a video conference |
| US8682087B2 (en) | 2011-12-19 | 2014-03-25 | Cisco Technology, Inc. | System and method for depth-guided image filtering in a video conference environment |
| US20130250040A1 (en) * | 2012-03-23 | 2013-09-26 | Broadcom Corporation | Capturing and Displaying Stereoscopic Panoramic Images |
| CN102665031B (en) | 2012-04-28 | 2016-09-07 | 华为技术有限公司 | Video signal processing method and picture pick-up device |
| US9681154B2 (en) | 2012-12-06 | 2017-06-13 | Patent Capital Group | System and method for depth-guided filtering in a video conference environment |
| US9843621B2 (en) | 2013-05-17 | 2017-12-12 | Cisco Technology, Inc. | Calendaring activities based on communication processing |
| US9742991B2 (en) | 2013-05-24 | 2017-08-22 | Robert Frank Latorre | 360 degree photobooth kiosk |
| US10614726B2 (en) | 2014-12-08 | 2020-04-07 | Life Long Driver, Llc | Behaviorally-based crash avoidance system |
| JP2018507650A (en) | 2015-03-01 | 2018-03-15 | ネクストブイアール・インコーポレイテッド | Method and apparatus for supporting content generation, transmission, and / or playback |
| JP6833498B2 (en) * | 2016-12-21 | 2021-02-24 | キヤノン株式会社 | Imaging device, imaging method and computer program |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3697678A (en) * | 1970-11-23 | 1972-10-10 | Ibm | Method and system for selective display of images from a video buffer |
| JPS5242318A (en) * | 1975-09-30 | 1977-04-01 | Mitsubishi Electric Corp | Television monitor set |
| US4004084A (en) * | 1976-03-03 | 1977-01-18 | Bell Telephone Laboratories, Incorporated | Video conferencing system using spatial reduction and temporal resolution |
| JPS5735473A (en) * | 1980-08-12 | 1982-02-26 | Matsushita Electric Ind Co Ltd | Picture reader |
| US4355328A (en) * | 1981-02-23 | 1982-10-19 | The United States Of America As Represented By The Secretary Of The Navy | 360 Degree closed circuit television system |
| US4400727A (en) * | 1981-11-27 | 1983-08-23 | The Bendix Corporation | Moving map display |
| US4517593A (en) * | 1983-04-29 | 1985-05-14 | The United States Of America As Represented By The Secretary Of The Navy | Video multiplexer |
| GB2157526B (en) * | 1983-05-16 | 1986-08-28 | Barr & Stroud Ltd | Imaging systems |
| US4797942A (en) * | 1987-03-02 | 1989-01-10 | General Electric | Pyramid processor for building large-area, high-resolution image by parts |
| JPH0194788A (en) * | 1987-10-07 | 1989-04-13 | Hitachi Ltd | Special image device |
| US4870314A (en) * | 1987-11-23 | 1989-09-26 | The Coleman Company, Inc. | Cam-actuated piezoelectric ignition device for gas appliance |
| JPH02194788A (en) * | 1989-01-23 | 1990-08-01 | Furuno Electric Co Ltd | Plane position display device for optical image |
| US5023725A (en) * | 1989-10-23 | 1991-06-11 | Mccutchen David | Method and apparatus for dodecahedral imaging system |
-
1991
- 1991-02-01 US US07/649,025 patent/US5187571A/en not_active Expired - Lifetime
-
1992
- 1992-01-14 WO PCT/US1992/000347 patent/WO1992014341A1/en not_active Application Discontinuation
- 1992-01-14 EP EP19920904511 patent/EP0569466A4/en not_active Withdrawn
- 1992-01-14 CA CA002101437A patent/CA2101437C/en not_active Expired - Lifetime
- 1992-01-14 JP JP4504579A patent/JP2696272B2/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| CA2101437A1 (en) | 1992-08-02 |
| EP0569466A4 (en) | 1993-12-01 |
| JP2696272B2 (en) | 1998-01-14 |
| US5187571A (en) | 1993-02-16 |
| WO1992014341A1 (en) | 1992-08-20 |
| EP0569466A1 (en) | 1993-11-18 |
| JPH06505370A (en) | 1994-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2101437C (en) | Television system for displaying multiple views of a remote location | |
| US4890314A (en) | Teleconference facility with high resolution video display | |
| US4004084A (en) | Video conferencing system using spatial reduction and temporal resolution | |
| CA2119776C (en) | Video teleconferencing system employing aspect ratio transformation | |
| US4931872A (en) | Methods of and apparatus for the generation of split-screen video displays | |
| JPH03174886A (en) | Resolution improvement in television system and circuit device | |
| JPS62210797A (en) | Stereoscopic picture viewing device | |
| JP2683504B2 (en) | Video communication equipment | |
| US6183089B1 (en) | Motion picture, TV and computer 3-D imaging system and method of use | |
| US3745242A (en) | Multiplex tv system for transmitting and receiving a plurality of pictures on a line sharing basis | |
| US3449509A (en) | Colour television systems including a high resolution luminance camera and a plurality of lower resolution colour cameras | |
| JPH0481088A (en) | Coincident glance type figure picture display image pickup device | |
| GB1173918A (en) | Improvements in or relating to Video Telephone Systems | |
| JPS61177889A (en) | Stereoscopic television system | |
| JPH0715646A (en) | Network camera | |
| EP0490682A1 (en) | Small, high-resolution color display apparatus | |
| JPS6259473A (en) | Solid-state image pickup device | |
| JPH0379191A (en) | Input/output device for image communication | |
| JPH05504873A (en) | Videophone camera throughput compression method and videophone camera | |
| JPH0451690A (en) | Television conference recording controlling system | |
| JPS60172888A (en) | Wide angle television camera | |
| JPH04145788A (en) | Eyes matching image pickup display device | |
| JPS646595B2 (en) | ||
| JPH02203692A (en) | Synthesis system for multi-point picture | |
| JPH04321394A (en) | Visual line coincidence display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed | ||
| MKEC | Expiry (correction) |
Effective date: 20121202 |