WO1994026057A1 - Background separation for still and moving images - Google Patents
Background separation for still and moving images Download PDFInfo
- Publication number
- WO1994026057A1 WO1994026057A1 PCT/GB1994/000917 GB9400917W WO9426057A1 WO 1994026057 A1 WO1994026057 A1 WO 1994026057A1 GB 9400917 W GB9400917 W GB 9400917W WO 9426057 A1 WO9426057 A1 WO 9426057A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- background
- signal
- subject
- picture signal
- foreground
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/48—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus
- G03B17/50—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with both developing and finishing apparatus
- G03B17/53—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with both developing and finishing apparatus for automatically delivering a finished picture after a signal causing exposure has been given, e.g. by pushing a button, by inserting a coin
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
Definitions
- This invention concerns image enhancement techniques and apparatus therefor, particularly those employing bit map/ pixel digitisation.
- the image capture and ehnhancement field has traditionally been dominated by direct photographic techniques in which a subject is imaged directly onto a photographic medium to produce a latent image.
- the development of video technology has enabld the growth of electronic imaging, where the image is recorded as a time-varying electronic signal.
- the demand for 'special effects' and improved image quality, combined with the development of computer technologies and CCD camera systems has driven a rapid growth in digital imaging.
- the electronic signal is stored in digital form in a computer memory, allowing the data to be processed and the image enhanced.
- the most common technique for background separation for both still and moving images is to ensure that the background is a substantially different colour from the foreground image. Then, on a pixel-by-pixel basis, the background can be eliminated or replaced in the captured image by selecting and removing those pixels which are close to the background colour and replacing them with pixels from a "different" background on a point for point correspondence basis.
- An alternative method is to determine the effective transparency of each pixel in the captured image by measuring the deviation from the background colour. The captured image can then be merged with a background image, weighting the two images by the measured transparency so that very transparent pixels become dominated by the background image while opaque pixels are weighted in favour of the captured image.
- a method of generating digital pixel data of a field of view containing foreground and background content so that the former can be separated from the latter comprises:-
- the digitised signal relating to the foreground can be separated from the digitised signal relating to the background and can then be merged with a digital signal corresponding to another background which may for example be plain or represent a different scene so that the separated foreground image content can be superimposed on a different background.
- the scanning to produce the gating signal can be performed either before or after the normal scan.
- both scans are undertaken in rapid succession so that any movement in the original field of view is effectively arrested so that the image data obtained by the two scans remains substantially aligned.
- the illumination employed of is typically ordinary incandescent light or daylight or a flash lamp source.
- the illumination for the other scanning to produce the gating signal may be similar but more preferably is infrared. Both may be pulsed or modulated in some way.
- the image content of the foreground must be readily distinguishable from the image content of the background in the scan producing the second picture signal. Infrared sources are particularly preferred since the infrared radiation is invisible to the subject particularly where the latter is human.
- a shutter may be incorporated with the scanning camera and the operation of a shutter may be synchronised to the duration of the flash so as to reduce the effect of ambient light in the production of the gating signal.
- the background may comprise an illuminated diffusive panel in fornt of which the subject is placed, so that image captured during the scanning to produce a second picture signal is a direct measure of the transparency of the foreground subject, and in the case of a generally opaque subject corresponds to a silhouette of the subject.
- An advantage of the invention is that the restriction on the range of hues colours and the like otherwise imposed on the foreground subject is lifted completely since the transparency is now measured directly without the use of a reserved parameter such as colour or hue.
- the method of producing the gating signal preferably includes at least one thresholding step so that a sharp silhouette of the foreground content can be obtained and the otherwise analogue signal converted into a true binary signal.
- the second picture signal may comprise for example the head and shoulders of a person to be photographed. This can be processed to form a gating signal which enables the digital data relating to the head and shoulders of the person concerned to be separated from the remainder of the data (the background) in the scanned image.
- the source of illumination need not be changed in either direction, position or wavelength if data processing is provided so as to enhance the pixel content of the silhouette image.
- the foreground subject image content can be selected from the background image content on the basis of colour provided that the background colour is not present at any edge of the silhouette.
- the enhancement method thus entails analysing the silhouette content as compared with the background colour or colours and determining digital signals within the silhouette signal which differ from the background colours so as to generate the gating signal pixels. Using look ahead techniques and suitable algorithms and thresholding techniques, it is possible to identify pixels having a background colour which are wholly surrounded by pixels which do not contain any background colour, and to disregard them as background and identify them as foreground image content.
- the shirt can be identified as belonging to the subject provided the shirt is wholly surrounded by pixels the colour or other parameter of which has no counterpart in the background.
- the pixel data corresponding to the "shirt” can then be modified so as to produce a colour which is quite distinct from the background so that when the pixel data relating to the complete field is subjected to a thresholding technique, the pixels relating to the head and shoulders of the subject will all have a colour or other parameter which is not present in the background.
- illumination for producing the gating signal may be derived from a small source positioned in such a way so that the subject in the foreground is illuminated to a considerably higher intentsity then in the background.
- the data in the image will thus correspond to a brightly lit subject against a relatively dark background.
- the pixel intensity of the image gives directly a measure of the image transparency allowing the same benefits as above described.
- This further aspect of the invention has the additional advantage of not requiring any special elements behind the subject, thus the imaging system could be wall mounted greatly reducing floor space requirements.
- At least a first picture signal is produced by scanning the field of view using appropriate illumination so as to obtain a silhouette of the subject relative to the background.
- two silhouette images may be produced one in which the illumination is straight on and another in which the illumination is from the side so as to bring into relief by appropriate shadow and highlighting different features of the surface subject such as for example the chin of the head of someone whose head and shoulders is to be photographed.
- This second silhouette image may then be processed so as to locate the position of the particular feature or features of the subject identified by adjacent maximum and minimum regions of brightness or by using a neural network pattern recognition technique. Once the location of the known feature is identified, this positional information may be combined with other positional data of the subject found from the other silhouette gating signal, enabling the image to be resized and relocated accurately in relation to the identified feature.
- This aspect of the invention is of particular application in the field of passport photography since it allows the chin position for example to be pre-selected and maintained and the remainder of the head scaled relative to the chin position so as to occupy the appropriate area on the photograph.
- the invention also lies in apparatus for performing the above methods and techniques.
- the invention also lies in photographic prints or transparencies produced using the gated image data.
- the invention also lies in a method of producing photographs from image data relating to the pixels in the scanned image of the overall field of view albeit with the background modified as required and with image content relating to the foreground subject scaled if appropriate so as to be of a correct size and position in relation to the final photograph to be obtained.
- the invention also resides in a photobooth in which a subject can stand or sit for self-take photographs
- scanning and signal processing apparatus as aforesaid, means for illuminating the subject and the background from the front to enable a conventional scanned image of the subject and background to be obtained and means for differentially illuminating the background and subject to enable a picture signal to be obtained representative of a silhouette of the subject, and a gating signal to be derived therefrom; and gating means for selecting the image content relating to the subject from the first picture signal using the silhouette signal as a gating signal, and superimposing the selected subject picture content on a fresh background and means for printing a representation of the superimposed picture content and different background.
- the printing process may comprise laser-jet, ink-jet, dot matrix, plotter or photographic process in which the picture signals are displayed on an appropriate CRT display and conventional photographic film is exposed to the displayed image and subsequently processed.
- the invention also lies in a photographic studio having selectable background media, adjustable and selectable lighting for illuminating the background and/or a subject placed in front of the background, imaging means and scanning means associated therewith for scanning an image of the subject and the background in quick succession when subjected to differential illumination so as to obtain a gating signal for separating picture signals relating to the subject from the picture signal relating to the background, to allow a picture signal relating to the subject to be superimposed on a different background and means for generating a composite picture signal relating thereto for subsequent processing to enable a print to be obtained therefrom.
- the invention is not limited to the superimposition of the abstracted image content onto a plain background but additionally envisages within its scope in respect of each of the aspects of the invention herein described the super imposition of the abstracted subject image content onto a different background which may itself comprise a picture or scene of pattern.
- buffer storage means for storing the abstracted video signal relating to two or more different subjects and means for mixing the video signals so as to enable the video signals of selected ones of the different subjects to be combined for superimposition or combination side by side or one above the other on one or more selected backgrounds.
- each "take" of a sequence of pictures which are subsequently to be presented in rapid succession to be illuminated twice, once "normally” and the other so as to differentially illuminate the foreground and background to enable a silhouette gating picture signal to be produced as aforesaid, one gating signal for each frame.
- the resultant picture signals may be printed into a sequence of transparencies for projection in a conventional manner using a movie projector or may be presented to a CRT display for sequential display thereon in the manner of a television display and/or may be stored on a video tape or other data carrier for subsequent playback via a CRT display.
- the invention lies in a method of producing a moving pictorial representation as aforesaid and in apparatus for performing the said method.
- An alternative printer may be employed such as a dye diffusion thermal transfer printer, such as made by Tektronic Corporation and marketed under Phaser 480.
- Figure 1 is a diagrammatic illustration of a photobooth for self-take photographs.
- FIG. 2 is a block schematic diagram on the control unit for a camera and illumination system for the photobooth of Figure 1 ,
- Figure 3 illustrates the process which is followed through when a photograph is required.
- Figures 4a and 4b show the primary and secondary images obtained using the process of Figure 4,
- Figure 5 illustrates a wall mounted self-take photographic unit for producing photographs suitable for passports.
- Figure 6 illustrates an alternative illumination arrangement
- Figure 7 illustrates the three pictures obtained using the system of Figure 5 with the illumination system of Figure
- Figure 1 shows a photobooth 10 comprising a seat 12 on which a subject 14 can sit.
- a window 16 in a partition wall 18 enables the head and shoulders of the subject to be viewed by a camera shown diagrammatically at 20 mounted above a control unit 22 and connected thereto by cabling 24.
- a primary source of illumination is shown at 26 and a secondary illumination source is shown at 28.
- the booth shown in Figure 1 when operated in accordance with the present invention can produce images of customers with a substituted high quality background matched accurately to the boundaries of the subject.
- the primary illumination is provided by flashing a lamp 26 which illuminates both the subject and the background.
- a flash-type of illumination is also used for the secondary illumination at 28 and typically this comprises a diffusive panel behind the subject through an infrared filter which does not transmit the visible component of the spectral output of the flash.
- the camera 20 is able to detect infrared light as well as visible light. If an infrared filter is fitted, this must of course be removed from the camera.
- the camera 20 operates in a frame integration mode that is a single exposure is used to capture both the odd and even fields of each video frame.
- the camera outputs both a video signal, from which sync pulses are extracted to control the flash timing, and RGB signals which are fed into a frame grabber.
- the frame grabber is capable of capturing one colour image at the full PAL resolution of 768 x 512 pixels with 24 bits per pixel and another monochrom image of the same resolution with 8 bits per pixel from each successive video frames.
- camera 20 RGB signals are shown passing to the frame grabber designated 30 and the digital data from the frame grabber is processed via an image processing unit 32 located in the control unit 22 and when required can be outputted to a print engine 34 such as a video to photographic film converter.
- a print engine 34 such as a video to photographic film converter.
- the control unit essentially comprises a micro-computer programmed to produce control signals and timing signals along the dotted line to and from the camera frame grabber and flash sources 26 and 28.
- the sync pulses from the camera 20 are shown directed to the flash sources although it may be preferred that the sync signals are provided to the control unit 22 to proceed via that unit to control the synchronous flashing of the two illumination sources.
- the micro-computer is also programmed to provide whatever image processing and enhancement functions are desired to enable the booths print engine to operate. Control signals are also derived from the micro-computer/control unit to control the operation of the print engine 34.
- the secondary illumination flashes triggered by the next sync pulse. This flash is not seen by the subject because of the infrared filter which cuts out the visible component of the flash.
- the secondary image is captured by the frame grabber in monochrom.
- the form of the primary and secondary images is illustrated in Figures 4a and 4b.
- the primary image contains a full colour high resolution portrait of the subject and the secondary image is a monochrom silhouette of the subject in the form of a binary signal which can be used to gate out the image content relating to the subject from the background.
- the brightness of the secondary image gives a direct measure of the transparency of the subject and a pixel-by-pixel basis.
- the image processing function is performed.
- the primary image is adjusted for colour balance, brightness and contrast using look-up table conversions (LUT conversions), where each pixel value is replaced by another pixel value if require.
- the primary image is then combined with a stored background image by averaging the pixel values from the primary image with those from the background image using the secondary image pixel values as weights, creating a high quality composite image. Further image enhancement might involve superimposing other images or text onto the composite image.
- the camera frame grabber control an illumination system is mounted on a wall at about face height as shown in Figure 5.
- the same reference numerals are used to denote the same items as are employed in the photobooth of Figure 1 with the exception of the secondary illumination which is denoted by reference numeral 29 instead of 28.
- the system shown in Figure 5 is capable of determining the size of the subjects head and re-scaling the image to meet the image size requirement of a passport photograph.
- both primary and secondary illuminations are achieved by using flash illumination, but in order to provide a second secondary image, additional visible light illumination sources are provided 36 and 38 on the right and lefthand side of the camera and the normal secondary illumination source is denoted by reference numeral 40 and comprises a small infrared source close to the camera.
- Figure 6 shows the arrangement best from above. The resulting images are illustrated at Figures 7a, 7b and 7c.
- Figure 7a That in Figure 7a is the one which is obtained by using the primary illuminations source shown in Figure 5 at 26 and 29. No vertical shadows were produced since the two light sources 26 and 29 respectively illuminate shadowed regions created by the other.
- the first secondary image using the infrared source 40 produces a silhouette image shown in Figure 7b.
- the second secondary illumination produces a dark shadow under the subjects chin since the two light sources of Figure 6, 36 and 38 are above the level of the subjects head and there is no compensating illumination from a source such as 29. This is shown in Figure 7c and the dark region immediately below the subjects chin can be used to locate this particular region of the image during subsequent image processing.
- the background of the primary image is subsituted as before by mixing the primary image with a stored or generated background using the pixel values of the silhouette images weights.
- the top of the subject's head is found by examining the silhouette image.
- the top of the head may be defined as the first row of pixels, starting from the top of the image, that contains more than say 2% bright pixels.
- the width of the head is easily found from the silhouette image by finding the maximum width of the bright region in the centre of the image below the top of the head.
- the second signatory image is used to locate the subject's chin. Starting from the corners at the top and centre of the head, a search is made for the dark shadow cast under the chin by the illumination from 36 and 38. The top edge of this shadow represents the underside of the chin in the image .
- This rectangle can be mapped, (translated and scaled) onto a corresponding rectanle defined by the relevant passport authority so that the bit-mapped content therein can be displayed with a pixel spacing in both X and Y directions so as to just fill the passport authority defined rectangle so that whatever the size of the head as imaged during the scanning, the reproduction of the video signal will be to a scale which enables the head to just fill the rectangle laid down by the passport authority.
Abstract
A method and apparatus is described in which by differential illumination, two separate picture signals can be obtained of a subject in front of a background one of which corresponds to a silhouette of the subject and a gating signal is derived from the silhouette size and the other a normal picture signal of the subject and the background. By using the gating signal, signal content of the subject from the background signal content in the said other picture signal, so the background can be sublimated relative to the subject for example by substituting for a 'busy background' a plain neutral background which contains no shadow. Differential illumination is achieved using visible light followed by infrared light or vice versa or by illuminating the subject and background from the front for one scan and back illuminating the subject during the other scan, to produce the silhouette signal by illuminating the subject and the background by an intense source of illumination so that the subject appears very bright against a less bright background. By synchronously switching the video signal which contains image content relating to both subject and background, the latter can be removed from the subject image content so the latter can be superimposed onto a different background. A second secondary image may be produced using side or top illumination to cast a shadow adjacent a particular feature. Image analysis may be used to detect the position of the shadow to enable the feature position to be determined. The technique is of particular application to the automatic production of passport photographs.
Description
Title: Background Separation for Still and Moving Images
Field of the invention
This invention concerns image enhancement techniques and apparatus therefor, particularly those employing bit map/ pixel digitisation.
Background to the invention
The image capture and ehnhancement field has traditionally been dominated by direct photographic techniques in which a subject is imaged directly onto a photographic medium to produce a latent image. The development of video technology has enabld the growth of electronic imaging, where the image is recorded as a time-varying electronic signal. More recently, the demand for 'special effects' and improved image quality, combined with the development of computer technologies and CCD camera systems has driven a rapid growth in digital imaging. Here the electronic signal is stored in digital form in a computer memory, allowing the data to be processed and the image enhanced.
Most of the demand for special effects has been from the entertainment industry, in particular for large-budget movies. On the other hand, digital image quality enhancement has been driven by the advertising and publishing industries.
There is now a growing demand for similar image processing
techniques from other areas of the photographic and imaging industries, including home photography, security imaging and photobooths. Two key requirements which are emerging in these fields are:
(1) To separate the subject, or foreground image, from the background in the captured image. This will allow both elimination of the background and its replacement by another image. Further image components can be added to the 'composite image', building up a complete, realistic picture of the original subject apparently in a different environment.
(2) To detect and locate significant features of the subject within the captured image. This ability is particularly important in preparing passport photographs where the size of the head in the final picture is specified by the authorities. Currently, many photobooths produce four copies of the same image at different magnifications in the hope that one of the images will meet the required specification.
Prior Art
The most common technique for background separation for both still and moving images is to ensure that the background is a substantially different colour from the foreground image. Then, on a pixel-by-pixel basis, the background can be eliminated or replaced in the captured image by selecting and removing those pixels which are close to the background colour and replacing them with pixels from a "different" background on a point for point correspondence basis. An alternative method is to determine the effective transparency of each pixel in the
captured image by measuring the deviation from the background colour. The captured image can then be merged with a background image, weighting the two images by the measured transparency so that very transparent pixels become dominated by the background image while opaque pixels are weighted in favour of the captured image.
The chief drawback of these techniques is that the background colour must not appear in the "subject". Thus if the background is blue, the subject must not contain any areas of similar hue.
It is an object of the present invention to provide a method and apparatus for distinguishing between the subject (foreground) and background of an image, and for detecting and locating significant features of the subject (foreground) image.
Summary of the Invention
According to one aspect of the present invention a method of generating digital pixel data of a field of view containing foreground and background content so that the former can be separated from the latter comprises:-
1. Scanning the field of view whilst subjecting the latter to normal illumination and storing the digitised data on a pixel by pixel basis relating as a first picture signal;
2. illuminating the field so as to render the foreground distinguishable from the background and scanning the field of view and storing the digitised signal so obtained on a pixel by pixel basis as a second picture signal;
3. generating the binary gating signal from the digitised video signal wherein the pixels in the gating signal have one value if they relate to the foreground and a second value if they relate to the background, and
4. processing the first picture signal using the binary gating signal so as to select the digital signals corresponding to the pixels which relate to the foreground content of the field of view from those relating to the background, to form a third picture signal.
By using this approach the digitised signal relating to the foreground can be separated from the digitised signal relating to the background and can then be merged with a digital signal corresponding to another background which may for example be plain or represent a different scene so that the separated foreground image content can be superimposed on a different background.
The scanning to produce the gating signal can be performed either before or after the normal scan.
Preferably both scans are undertaken in rapid succession so that any movement in the original field of view is effectively arrested so that the image data obtained by the two scans remains substantially aligned.
The illumination employed of is typically ordinary incandescent light or daylight or a flash lamp source. The illumination for the other scanning to produce the gating signal may be similar but more preferably is infrared. Both may be pulsed or modulated in some way.
The image content of the foreground must be readily distinguishable from the image content of the background in the scan producing the second picture signal. Infrared sources are particularly preferred since the infrared radiation is invisible to the subject particularly where the latter is human.
Where the illumination for producing the gating signal is to be pulsed, a shutter may be incorporated with the scanning camera and the operation of a shutter may be synchronised to the duration of the flash so as to reduce the effect of ambient light in the production of the gating signal.
In a photobooth or studio situation, the background may comprise an illuminated diffusive panel in fornt of which the subject is placed, so that image captured during the scanning to produce a second picture signal is a direct measure of the transparency of the foreground subject, and in the case of a generally opaque subject corresponds to a silhouette of the subject.
An advantage of the invention is that the restriction on the range of hues colours and the like otherwise imposed on the foreground subject is lifted completely since the transparency is now measured directly without the use of a reserved parameter such as colour or hue.
Since the scanning to produce the gating signal will still produce digital information which varies according to reflectivity, transparency, colour and the like, the method of producing the gating signal preferably includes at least one thresholding step so that a sharp silhouette of the foreground content can be obtained and the
otherwise analogue signal converted into a true binary signal.
In the case of a photobooth or studio situation, the second picture signal may comprise for example the head and shoulders of a person to be photographed. This can be processed to form a gating signal which enables the digital data relating to the head and shoulders of the person concerned to be separated from the remainder of the data (the background) in the scanned image.
By adjusting the direction or position of the illumination, it is not necessary to use a different source of illumination or wavelength in order to produce a silhouette image of the subject. It is merely necessary to ensure that the background in front of which the subject is positioned is illuminated in such a way that the subject is silhouetted against the illuminated background, thereby enabling the gating signal to be generated corresponding to the pixels which relate to the silhouette.
According to a further aspect of the present invention, the source of illumination need not be changed in either direction, position or wavelength if data processing is provided so as to enhance the pixel content of the silhouette image. Also the foreground subject image content can be selected from the background image content on the basis of colour provided that the background colour is not present at any edge of the silhouette. The enhancement method thus entails analysing the silhouette content as compared with the background colour or colours and determining digital signals within the silhouette signal which differ from the background colours so as to
generate the gating signal pixels. Using look ahead techniques and suitable algorithms and thresholding techniques, it is possible to identify pixels having a background colour which are wholly surrounded by pixels which do not contain any background colour, and to disregard them as background and identify them as foreground image content.
Thus for example if a subject comprises a man whose shirt colour happens to correspond rather closely to a colour within the background, the shirt can be identified as belonging to the subject provided the shirt is wholly surrounded by pixels the colour or other parameter of which has no counterpart in the background. The pixel data corresponding to the "shirt" can then be modified so as to produce a colour which is quite distinct from the background so that when the pixel data relating to the complete field is subjected to a thresholding technique, the pixels relating to the head and shoulders of the subject will all have a colour or other parameter which is not present in the background.
According to another aspect of the invention, illumination for producing the gating signal may be derived from a small source positioned in such a way so that the subject in the foreground is illuminated to a considerably higher intentsity then in the background.
The data in the image will thus correspond to a brightly lit subject against a relatively dark background. As for the back lit case, the pixel intensity of the image gives directly a measure of the image transparency allowing the same benefits as above described.
This further aspect of the invention has the additional advantage of not requiring any special elements behind the subject, thus the imaging system could be wall mounted greatly reducing floor space requirements.
According to a further implementation the invention, at least a first picture signal is produced by scanning the field of view using appropriate illumination so as to obtain a silhouette of the subject relative to the background. Thus for example two silhouette images may be produced one in which the illumination is straight on and another in which the illumination is from the side so as to bring into relief by appropriate shadow and highlighting different features of the surface subject such as for example the chin of the head of someone whose head and shoulders is to be photographed. This second silhouette image may then be processed so as to locate the position of the particular feature or features of the subject identified by adjacent maximum and minimum regions of brightness or by using a neural network pattern recognition technique. Once the location of the known feature is identified, this positional information may be combined with other positional data of the subject found from the other silhouette gating signal, enabling the image to be resized and relocated accurately in relation to the identified feature.
This aspect of the invention is of particular application in the field of passport photography since it allows the chin position for example to be pre-selected and maintained and the remainder of the head scaled relative to the chin position so as to occupy the appropriate area on the photograph.
The invention also lies in apparatus for performing the above methods and techniques.
The invention also lies in photographic prints or transparencies produced using the gated image data.
The invention also lies in a method of producing photographs from image data relating to the pixels in the scanned image of the overall field of view albeit with the background modified as required and with image content relating to the foreground subject scaled if appropriate so as to be of a correct size and position in relation to the final photograph to be obtained.
The invention also resides in a photobooth in which a subject can stand or sit for self-take photographs comprising scanning and signal processing apparatus as aforesaid, means for illuminating the subject and the background from the front to enable a conventional scanned image of the subject and background to be obtained and means for differentially illuminating the background and subject to enable a picture signal to be obtained representative of a silhouette of the subject, and a gating signal to be derived therefrom; and gating means for selecting the image content relating to the subject from the first picture signal using the silhouette signal as a gating signal, and superimposing the selected subject picture content on a fresh background and means for printing a representation of the superimposed picture content and different background.
The printing process may comprise laser-jet, ink-jet, dot matrix, plotter or photographic process in which the picture signals are displayed on an appropriate CRT
display and conventional photographic film is exposed to the displayed image and subsequently processed.
The invention also lies in a photographic studio having selectable background media, adjustable and selectable lighting for illuminating the background and/or a subject placed in front of the background, imaging means and scanning means associated therewith for scanning an image of the subject and the background in quick succession when subjected to differential illumination so as to obtain a gating signal for separating picture signals relating to the subject from the picture signal relating to the background, to allow a picture signal relating to the subject to be superimposed on a different background and means for generating a composite picture signal relating thereto for subsequent processing to enable a print to be obtained therefrom.
The invention is not limited to the superimposition of the abstracted image content onto a plain background but additionally envisages within its scope in respect of each of the aspects of the invention herein described the super imposition of the abstracted subject image content onto a different background which may itself comprise a picture or scene of pattern.
Also within the scope of the invention is the provision of buffer storage means for storing the abstracted video signal relating to two or more different subjects and means for mixing the video signals so as to enable the video signals of selected ones of the different subjects to be combined for superimposition or combination side by side or one above the other on one or more selected backgrounds.
So far the invention has been described primarily in relation to still subject matter, i.e. a motionless subject sitting in front of a motionless background. It is to be understood that the same technique may be employed for producing video signals relating to a moving subject relative to a stationary background or when both subject and background are moving relative to the viewing device. Whatever the scenario, it is merely necessary for each "take" of a sequence of pictures which are subsequently to be presented in rapid succession, to be illuminated twice, once "normally" and the other so as to differentially illuminate the foreground and background to enable a silhouette gating picture signal to be produced as aforesaid, one gating signal for each frame. By storing the different picture signals separately and synchronously reading out the signals and gating one signal relative to another before mixing, so the same effect as described in relation to a still picture can be obtained for each of the pictures which are to be presented in a moving sequence of pictures.
The resultant picture signals may be printed into a sequence of transparencies for projection in a conventional manner using a movie projector or may be presented to a CRT display for sequential display thereon in the manner of a television display and/or may be stored on a video tape or other data carrier for subsequent playback via a CRT display.
The invention lies in a method of producing a moving pictorial representation as aforesaid and in apparatus for performing the said method.
An alternative printer may be employed such as a dye diffusion thermal transfer printer, such as made by Tektronic Corporation and marketed under Phaser 480.
The invention will now be described by way of example with reference to the accompanying drawings in which:-
Figure 1 is a diagrammatic illustration of a photobooth for self-take photographs.
Figure 2 is a block schematic diagram on the control unit for a camera and illumination system for the photobooth of Figure 1 ,
Figure 3 illustrates the process which is followed through when a photograph is required.
Figures 4a and 4b show the primary and secondary images obtained using the process of Figure 4,
Figure 5 illustrates a wall mounted self-take photographic unit for producing photographs suitable for passports.
Figure 6 illustrates an alternative illumination arrangement and
Figure 7 illustrates the three pictures obtained using the system of Figure 5 with the illumination system of Figure
6.
Figure 1 shows a photobooth 10 comprising a seat 12 on which a subject 14 can sit. A window 16 in a partition wall 18 enables the head and shoulders of the subject to be viewed by a camera shown diagrammatically at 20 mounted above a control unit 22 and connected thereto by cabling 24. A primary source of illumination is shown at 26 and a secondary illumination source is shown at 28.
Unlike conventional booths the booth shown in Figure 1 when operated in accordance with the present invention can produce images of customers with a substituted high quality background matched accurately to the boundaries of the subject.
Although shown in a seat the subject of course could stand within the booth but the seated position is preferred.
The primary illumination is provided by flashing a lamp 26 which illuminates both the subject and the background.
A flash-type of illumination is also used for the secondary illumination at 28 and typically this comprises a diffusive panel behind the subject through an infrared filter which does not transmit the visible component of the spectral output of the flash.
It is of course important that the camera 20 is able to detect infrared light as well as visible light. If an infrared filter is fitted, this must of course be removed from the camera.
The camera 20 operates in a frame integration mode that is a single exposure is used to capture both the odd and even fields of each video frame. The camera outputs both a
video signal, from which sync pulses are extracted to control the flash timing, and RGB signals which are fed into a frame grabber. The frame grabber is capable of capturing one colour image at the full PAL resolution of 768 x 512 pixels with 24 bits per pixel and another monochrom image of the same resolution with 8 bits per pixel from each successive video frames.
The signal processing and camera control circuits are shown in Figure 2. Thus camera 20 RGB signals are shown passing to the frame grabber designated 30 and the digital data from the frame grabber is processed via an image processing unit 32 located in the control unit 22 and when required can be outputted to a print engine 34 such as a video to photographic film converter.
The control unit essentially comprises a micro-computer programmed to produce control signals and timing signals along the dotted line to and from the camera frame grabber and flash sources 26 and 28. The sync pulses from the camera 20 are shown directed to the flash sources although it may be preferred that the sync signals are provided to the control unit 22 to proceed via that unit to control the synchronous flashing of the two illumination sources.
The micro-computer is also programmed to provide whatever image processing and enhancement functions are desired to enable the booths print engine to operate. Control signals are also derived from the micro-computer/control unit to control the operation of the print engine 34.
The basic operation of the control booth is shown in Figure 3.
When the image acquisition sequence is initiated, the primary illumination flashes on the next sync pulse for an odd video field. The frame grabber captures this video frame when it is read out from the camera.
The secondary illumination flashes triggered by the next sync pulse. This flash is not seen by the subject because of the infrared filter which cuts out the visible component of the flash. The secondary image is captured by the frame grabber in monochrom.
The form of the primary and secondary images is illustrated in Figures 4a and 4b. The primary image contains a full colour high resolution portrait of the subject and the secondary image is a monochrom silhouette of the subject in the form of a binary signal which can be used to gate out the image content relating to the subject from the background. In fact the brightness of the secondary image gives a direct measure of the transparency of the subject and a pixel-by-pixel basis.
When both images have been captured the image processing function is performed. The primary image is adjusted for colour balance, brightness and contrast using look-up table conversions (LUT conversions), where each pixel value is replaced by another pixel value if require. The primary image is then combined with a stored background image by averaging the pixel values from the primary image with those from the background image using the secondary image pixel values as weights, creating a high quality composite image. Further image enhancement might involve superimposing other images or text onto the composite image.
In another embodiment of the invention the camera frame grabber control an illumination system is mounted on a wall at about face height as shown in Figure 5. The same reference numerals are used to denote the same items as are employed in the photobooth of Figure 1 with the exception of the secondary illumination which is denoted by reference numeral 29 instead of 28.
In addition to requiring very little space, the system shown in Figure 5 is capable of determining the size of the subjects head and re-scaling the image to meet the image size requirement of a passport photograph.
As before both primary and secondary illuminations are achieved by using flash illumination, but in order to provide a second secondary image, additional visible light illumination sources are provided 36 and 38 on the right and lefthand side of the camera and the normal secondary illumination source is denoted by reference numeral 40 and comprises a small infrared source close to the camera.
Figure 6 shows the arrangement best from above. The resulting images are illustrated at Figures 7a, 7b and 7c.
That in Figure 7a is the one which is obtained by using the primary illuminations source shown in Figure 5 at 26 and 29. No vertical shadows were produced since the two light sources 26 and 29 respectively illuminate shadowed regions created by the other. The first secondary image using the infrared source 40 produces a silhouette image shown in Figure 7b.
The second secondary illumination produces a dark shadow
under the subjects chin since the two light sources of Figure 6, 36 and 38 are above the level of the subjects head and there is no compensating illumination from a source such as 29. This is shown in Figure 7c and the dark region immediately below the subjects chin can be used to locate this particular region of the image during subsequent image processing.
An additional difference from the previous embodiment is that the camera now has a limited exposure (integration) time, and the flashes are synchronised to this period by delaying the trigger pulse for a short period after the video sync pulse. This has the benefit of increasing the rejection of ambient lighting over which there is now no control.
The background of the primary image is subsituted as before by mixing the primary image with a stored or generated background using the pixel values of the silhouette images weights.
The top of the subject's head is found by examining the silhouette image. The top of the head may be defined as the first row of pixels, starting from the top of the image, that contains more than say 2% bright pixels. The width of the head is easily found from the silhouette image by finding the maximum width of the bright region in the centre of the image below the top of the head.
The second signatory image is used to locate the subject's chin. Starting from the corners at the top and centre of the head, a search is made for the dark shadow cast under the chin by the illumination from 36 and 38. The top edge of this shadow represents the underside of the chin in the
image .
These procedures define a rectangle which fits around the of the subject in the image.
This rectangle can be mapped, (translated and scaled) onto a corresponding rectanle defined by the relevant passport authority so that the bit-mapped content therein can be displayed with a pixel spacing in both X and Y directions so as to just fill the passport authority defined rectangle so that whatever the size of the head as imaged during the scanning, the reproduction of the video signal will be to a scale which enables the head to just fill the rectangle laid down by the passport authority.
Claims
1. A method of generating digital pixel data of a field of view containing foreground and background content so that the former can be separated from the latter, comprising:-
(a) scanning the field of view whilst subjecting the latter to normal illumination and storing the digitised data on a pixel-by-pixel basis as a first picture signal,
(b) illuminating the field of view so as to render the foreground distinguishable from the background and scanning the field of view and storing the digitised data so obtained on a pixel-by-pixel basis as a second picture signal,
(c) generating a binary gating signal from the dsecond picture signal wherein the pixels in the gating signal have one value if they relate to the foreground and a second value if they relate to the background, and
(d) processing the first picture signal using the binary gating signal so as to select the digital signals corresponding to the pixels which relate to the foreground content of the field of view from those relating to the background, to form a third picture signal.
2. A method as claimed in claim 1 in which the third signal (relating to the foreground) is combined with a picture signal corresponding to a different background from that of the original field of view.
3. A method as claimed in claim 2 wherein the different background picture signal is of a single colour.
4. A method as claimed in any of claims 1 to 3 wherein the scanning to produce the gating signal is performed before the scanning to produce the first picture signal.
5. A method as claimed in any of claims 1 to 3 wherein the scanning to produce the gating signal is performed after the scanning which produces the first picture signal.
6. A method as claimed in either of claims 4 and 5 wherein both scans are undertaken in rapid succession so that any movement of the original field of view is effectively arrested so that image data obtained by the two scans remains substantially aligned.
7. A method as claimed in any of the preceding claims wherein the scanning device is responsive to visible light and infrared light and a source of infrared radiation is used to illuminate the field of view so as to produce the second picture signal.
8. A method as claimed in any of claims 1 to 7 wherein visible light is used to illuminate the foreground and background and during the scanning to produce the first picture signal at least the foreground is front lit and during the scanning to produce the second picture signal at least the foreground is back lit.
9. A method as claimed in any of claims 1 to 8 wherein flash illumination or pulsed illumination is employed during one or other or both of the scans.
10. A method as claimed in any of the preceding claims wherein the scanning device is rendered insensitive to light or other radiation except in synchronism with each of the flashes so that the effect of ambient light is reduced.
11. A method as claimed in claim 8 wherein the back lighting is achieved by an illuminated diffusive panel in front of which a subject constituting the foreground is placed, so that the background image is captured during the scanning to produce the gating signal which is a direct measure of the transparency of the foreground material.
12. A method as claimed in any of the preceding claims wherein a gating signal is derived from the second picture signal using at least one thresholding step so that a picture signal of a sharp silhouette of the foreground content is obtained.
13. A method as claimed in any of the preceding claims further comprising the step of comparing the colours of the pixels in the third picture signal with the colours present in the background of the first picture signal and changing the colour of any pixels in the foreground picture signal content to a colour different from any colour present in the background of the first picture signal.
14. A method as claimed in any of the preceding claims wherein the second picture signal is obtained by illuminating the foreground to a much greater intensity than the background so that the pixels relating to the foreground can be distinguished from the pixels relating to the background on the basis of brightness.
15. A method as claimed in any of the preceding claims in which at least a fourth picture signal is produced by scanning the field of view using a source of illumination from the side or below or above so as to bring into relief and create a dark shadow of at least one selected feature of the foreground subject so that the position of the feature thrown into relief in the fourth picture signal because of the shadow can be readily distinguished by thresholding within the fourth picture signal to permit positional information to be derived of the feature or features within the first picture signal.
16. A method as claimed in claim 15 wherein the positional information obtained from the fourth picture signal is combined with the gating signal during processing of the first picture signal so as to enable scaling and positioning of the foreground content of the first picture signal in a fifth picture signal.
17. A method as claimed in any of the preceding claims wherein the finally processed signal is stored and/or processed so as to produce a print such as a photographic print of the selected foreground against a selected background.
18. Apparatus for performing the method of any one of claims 1 to 16.
19. Photographic prints or transparancies produced using the method of any one of claims 1 to 16 or the apparatus for claim 17.
20. A photobooth in which a subject can stand or sit for self-take photographs comprising scanning and signalling processing apparatus as claimed in claim 17, means for illuminating the subject and the background from the front to enable a conventional scanned image of the subject and background to be obtained and means for differentially illuminating the background and subject to enable an image signal to be obtained representative of a silhouette of the subject so that a gating signal can be derived therefrom, and gating means for selecting the image content relating to the subject from the first picture signal using the silhouette signal as a gating signal, superimposing the selected subject picture content on a fresh background picture signal, and means for printing a representation of the superimposed picture content and different background as a final print.
21. A photobooth as claimed in claim 19 in which the printing process comprises a laser jet printer, ink jet printer, dot matrix printer, plotter, dye diffusion thermal transfer printer or a photographic processor.
22. Apparatus as claimed in claim 20 wherein the picture signals are displayed by means of a CRT display or the like and conventional photographic film is exposed to the displayed image and subsequently processed to produce a photograph thereof.
23. A photographic studio having selectable background media, adjustable and selectable lighting for illuminating the background and/or a subject placed in front thereof, imaging means and scanning means associated therewith for scanning an image of the subject and the background in quick succession when subjected to differential illumination, so as to obtain a gating signal for separating picture signals relating to the subject from picture signals relating to the background, to allow a picture signal relating only to the subject to be produced for combining with a different background picture signal, so that when displayed the subject appears superimposed on the different background, and means for generating a composite picture signal relating thereto for subsequent processing to enable a print to be obtained therefrom.
24. A method as claimed in any of claims 1 to 16 wherein the combination of the picture signal relating to the foreground includes the combination of that selected picture signal content with another similarly selected picture signal content of other foreground material from other scannings and the super imposition of two or more such foreground picture signals on a background picture signal to produce a composite final picture signal.
25. Apparatus for performing the method of claim 4 which includes buffer storage means for storing the abstracted picture signals relating to two or more different subjects and means for mixing the picture signals so as to enable the picture signals of selected ones of the different subjects to be combined for superimposition or in combination side-by-side, or one above the other against one or more selected backgrounds.
26. A method as claimed in any of claims 1 to 16 wherein each take of a sequence of pictures which are to be presented in rapid succession to form a moving picture, is illuminated twice, once normally and the other so as to differentially illuminate the foreground and background in the field of view thereby to enable a silhouette gating signal to be produced as aforesaid, one gating signal for each take, storage means is provided for storing the different picture signals separately and means is provided for synchronously reading out the signals and the gating signals before combining the signals so as to abstract from each signal the foreground content relating to each take and a final signal is produced by combining the abstracted foreground picture signal content with a desired background signal for the final moving picture signal to be displayed or printed.
27. A method as claimed in claim 25 wherein the sequence of takes are printed in the form of a sequence of transparancies for projection in a conventional manner using a movie projector.
28. A method as claimed in claim 25 wherein the final signal is read out as a real time video signal for display on a CRT display such as a television monitor.
29. Methods and apparatus for imaging enhancement constructed and arranged and adapted to operate substantially as herein described with reference to and as illustrated in Figures 1 to 7 of the accompanying drawings.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU65771/94A AU6577194A (en) | 1993-04-29 | 1994-04-29 | Background separation for still and moving images |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB939308869A GB9308869D0 (en) | 1993-04-29 | 1993-04-29 | A novel image enhancement technique |
GB9308869.8 | 1993-04-29 | ||
GB9406743.6 | 1994-04-06 | ||
GB9406743A GB9406743D0 (en) | 1994-04-06 | 1994-04-06 | Image enhancement technique |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1994026057A1 true WO1994026057A1 (en) | 1994-11-10 |
Family
ID=26302829
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/GB1994/000917 WO1994026057A1 (en) | 1993-04-29 | 1994-04-29 | Background separation for still and moving images |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU6577194A (en) |
WO (1) | WO1994026057A1 (en) |
Cited By (48)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0756419A1 (en) * | 1995-07-28 | 1997-01-29 | Nippon Hoso Kyokai | Method and apparatus for picking-up an image of a subject to be superimposed on base image |
WO1997015140A1 (en) * | 1995-10-18 | 1997-04-24 | Polaroid Corporation | Background replacement for an image |
WO1997017803A1 (en) * | 1995-11-07 | 1997-05-15 | Imagini Corporation Limited | Camera system with flash illumination and chroma-keying |
WO1997027702A1 (en) * | 1996-01-25 | 1997-07-31 | Polaroid Corporation | Method for replacing the background of an image |
EP0797351A1 (en) * | 1996-03-18 | 1997-09-24 | Nippon Television Network Corporation | Picture replacement system and method |
EP0809408A1 (en) * | 1996-05-24 | 1997-11-26 | THOMSON multimedia | Special effects camera |
GB2320638A (en) * | 1996-12-20 | 1998-06-24 | Eastman Kodak Co | Photographic system using chroma-key processing |
WO1999029102A1 (en) * | 1997-12-01 | 1999-06-10 | Sensar, Inc. | Image subtraction to remove ambient illumination |
GB2341507A (en) * | 1998-06-24 | 2000-03-15 | Alan William Robinson | Removing shadows from television signals |
EP1298584A2 (en) * | 2001-10-01 | 2003-04-02 | L'oreal | Method and apparatus to capture and analyze an image of a human body part |
US6545742B2 (en) | 1999-03-16 | 2003-04-08 | O'hagan Paul Allan Peter | Lighting systems |
WO2003030526A1 (en) * | 2001-10-03 | 2003-04-10 | Koninklijke Philips Electronics N.V. | Method and system for detecting and selecting foreground objects |
WO2007073781A1 (en) * | 2005-12-27 | 2007-07-05 | Fotonation Vision Limited | Digital image acquisition system with portrait mode |
EP1858255A1 (en) * | 2005-03-10 | 2007-11-21 | Fuji Photo Film Co., Ltd. | Background replacement device, background replacement program, and background replacement method |
EP1909493A1 (en) * | 2005-03-10 | 2008-04-09 | FUJIFILM Corporation | Photographing system |
WO2008124263A1 (en) * | 2007-04-03 | 2008-10-16 | Lifetouch Inc. | Method and apparatus for background replacement in still photographs |
DE102006046395B4 (en) * | 2006-09-24 | 2008-10-23 | Kai Baumann | Mini-Studio for the creation of biometric digital passport photos |
DE102008031697A1 (en) * | 2008-07-04 | 2010-01-07 | Bayerische Motoren Werke Aktiengesellschaft | Object identification i.e. person's biometric identification, device for e.g. motor vehicle, has evaluation unit arranged in operating mode to analyze and close contour with respect to course of contour based on existence of object |
US7679786B2 (en) | 2006-09-06 | 2010-03-16 | Eastman Kodak Company | Color correction method |
WO2010049578A1 (en) * | 2008-10-28 | 2010-05-06 | Mika Daniel Letonsaari | Video processing |
US7835571B2 (en) | 2005-03-10 | 2010-11-16 | Fujifilm Corporation | Background replacing apparatus, background replacing program, and background replacing method |
US7912285B2 (en) | 2004-08-16 | 2011-03-22 | Tessera Technologies Ireland Limited | Foreground/background segmentation in digital images with differential exposure calculations |
US7957597B2 (en) | 2004-08-16 | 2011-06-07 | Tessera Technologies Ireland Limited | Foreground/background segmentation in digital images |
US8498453B1 (en) | 2009-09-30 | 2013-07-30 | Lifetouch, Inc. | Evaluating digital images using head points |
US8593542B2 (en) | 2005-12-27 | 2013-11-26 | DigitalOptics Corporation Europe Limited | Foreground/background separation using reference images |
US8693731B2 (en) | 2012-01-17 | 2014-04-08 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging |
US20140232838A1 (en) * | 2011-07-08 | 2014-08-21 | Visual Retailing Holding B.V. | Imaging apparatus and controller for photographing products |
US20150036898A1 (en) * | 2012-02-23 | 2015-02-05 | Thales | Station for acquiring biometric and biographic data |
EP2860582A1 (en) * | 2013-10-14 | 2015-04-15 | Photo-Me International Plc | System for acquiring photographic portraits |
US9058535B2 (en) | 2011-04-05 | 2015-06-16 | Franck Guigan | Security barcode |
US9070019B2 (en) | 2012-01-17 | 2015-06-30 | Leap Motion, Inc. | Systems and methods for capturing motion in three-dimensional space |
US9153028B2 (en) | 2012-01-17 | 2015-10-06 | Leap Motion, Inc. | Systems and methods for capturing motion in three-dimensional space |
US9285893B2 (en) | 2012-11-08 | 2016-03-15 | Leap Motion, Inc. | Object detection and tracking with variable-field illumination devices |
US9465461B2 (en) | 2013-01-08 | 2016-10-11 | Leap Motion, Inc. | Object detection and tracking with audio and optical signals |
US9613262B2 (en) | 2014-01-15 | 2017-04-04 | Leap Motion, Inc. | Object detection and tracking for providing a virtual device experience |
US9679215B2 (en) | 2012-01-17 | 2017-06-13 | Leap Motion, Inc. | Systems and methods for machine control |
US9702977B2 (en) | 2013-03-15 | 2017-07-11 | Leap Motion, Inc. | Determining positional information of an object in space |
US9916009B2 (en) | 2013-04-26 | 2018-03-13 | Leap Motion, Inc. | Non-tactile interface systems and methods |
US10609285B2 (en) | 2013-01-07 | 2020-03-31 | Ultrahaptics IP Two Limited | Power consumption in motion-capture systems |
US10691219B2 (en) | 2012-01-17 | 2020-06-23 | Ultrahaptics IP Two Limited | Systems and methods for machine control |
US10739862B2 (en) | 2013-01-15 | 2020-08-11 | Ultrahaptics IP Two Limited | Free-space user interface and control using virtual constructs |
US10846942B1 (en) | 2013-08-29 | 2020-11-24 | Ultrahaptics IP Two Limited | Predictive information for free space gesture control and communication |
EP4184456A1 (en) * | 2021-11-23 | 2023-05-24 | Bundesdruckerei GmbH | Method and device for determining a digital biometric template for a security document and method for personalizing a security document |
US11720180B2 (en) | 2012-01-17 | 2023-08-08 | Ultrahaptics IP Two Limited | Systems and methods for machine control |
US11740705B2 (en) | 2013-01-15 | 2023-08-29 | Ultrahaptics IP Two Limited | Method and system for controlling a machine according to a characteristic of a control object |
US11778159B2 (en) | 2014-08-08 | 2023-10-03 | Ultrahaptics IP Two Limited | Augmented reality with motion sensing |
US11775033B2 (en) | 2013-10-03 | 2023-10-03 | Ultrahaptics IP Two Limited | Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation |
US11868687B2 (en) | 2013-10-31 | 2024-01-09 | Ultrahaptics IP Two Limited | Predictive information for free space gesture control and communication |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB638937A (en) * | 1947-11-06 | 1950-06-21 | Cinema Television Ltd | Improvements in or relating to television or like systems |
FR1064950A (en) * | 1951-10-26 | 1954-05-19 | Pye Ltd | Improved method and apparatus for producing television images |
WO1990010251A1 (en) * | 1989-02-28 | 1990-09-07 | Photostar Limited | Automatic picture taking machine |
US5109281A (en) * | 1987-05-25 | 1992-04-28 | Hitachi, Ltd. | Video printer with separately stored digital signals printed in separate areas to form a print of multiple images |
US5117283A (en) * | 1990-06-25 | 1992-05-26 | Eastman Kodak Company | Photobooth compositing apparatus |
-
1994
- 1994-04-29 WO PCT/GB1994/000917 patent/WO1994026057A1/en active Application Filing
- 1994-04-29 AU AU65771/94A patent/AU6577194A/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB638937A (en) * | 1947-11-06 | 1950-06-21 | Cinema Television Ltd | Improvements in or relating to television or like systems |
FR1064950A (en) * | 1951-10-26 | 1954-05-19 | Pye Ltd | Improved method and apparatus for producing television images |
US5109281A (en) * | 1987-05-25 | 1992-04-28 | Hitachi, Ltd. | Video printer with separately stored digital signals printed in separate areas to form a print of multiple images |
WO1990010251A1 (en) * | 1989-02-28 | 1990-09-07 | Photostar Limited | Automatic picture taking machine |
US5117283A (en) * | 1990-06-25 | 1992-05-26 | Eastman Kodak Company | Photobooth compositing apparatus |
Non-Patent Citations (1)
Title |
---|
A. J. HENK: "A new approach to overlay in monochrome television", JOURNAL OF THE SMPTE, vol. 78, October 1969 (1969-10-01), pages 861 - 866 * |
Cited By (98)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0756419A1 (en) * | 1995-07-28 | 1997-01-29 | Nippon Hoso Kyokai | Method and apparatus for picking-up an image of a subject to be superimposed on base image |
WO1997015140A1 (en) * | 1995-10-18 | 1997-04-24 | Polaroid Corporation | Background replacement for an image |
AU706252B2 (en) * | 1995-10-18 | 1999-06-10 | Polaroid Corporation | Background replacement for an image |
WO1997017803A1 (en) * | 1995-11-07 | 1997-05-15 | Imagini Corporation Limited | Camera system with flash illumination and chroma-keying |
AU709844B2 (en) * | 1996-01-25 | 1999-09-09 | Polaroid Corporation | Method for replacing the background of an image |
WO1997027702A1 (en) * | 1996-01-25 | 1997-07-31 | Polaroid Corporation | Method for replacing the background of an image |
EP0797351A1 (en) * | 1996-03-18 | 1997-09-24 | Nippon Television Network Corporation | Picture replacement system and method |
EP0809408A1 (en) * | 1996-05-24 | 1997-11-26 | THOMSON multimedia | Special effects camera |
FR2749116A1 (en) * | 1996-05-24 | 1997-11-28 | Thomson Multimedia Sa | CAMERA WITH SPECIAL EFFECTS |
US6124887A (en) * | 1996-05-24 | 2000-09-26 | Thomson Licensing S.A. | Specal effects camera and system including such a camera |
GB2320638B (en) * | 1996-12-20 | 1999-06-16 | Eastman Kodak Co | A photographic system using chroma-key processing |
GB2320638A (en) * | 1996-12-20 | 1998-06-24 | Eastman Kodak Co | Photographic system using chroma-key processing |
US6021210A (en) * | 1997-12-01 | 2000-02-01 | Sensar, Inc. | Image subtraction to remove ambient illumination |
WO1999029102A1 (en) * | 1997-12-01 | 1999-06-10 | Sensar, Inc. | Image subtraction to remove ambient illumination |
GB2341507A (en) * | 1998-06-24 | 2000-03-15 | Alan William Robinson | Removing shadows from television signals |
US6545742B2 (en) | 1999-03-16 | 2003-04-08 | O'hagan Paul Allan Peter | Lighting systems |
EP1298584A2 (en) * | 2001-10-01 | 2003-04-02 | L'oreal | Method and apparatus to capture and analyze an image of a human body part |
EP1298584A3 (en) * | 2001-10-01 | 2005-01-12 | L'oreal | Method and apparatus to capture and analyze an image of a human body part |
WO2003030526A1 (en) * | 2001-10-03 | 2003-04-10 | Koninklijke Philips Electronics N.V. | Method and system for detecting and selecting foreground objects |
US7912285B2 (en) | 2004-08-16 | 2011-03-22 | Tessera Technologies Ireland Limited | Foreground/background segmentation in digital images with differential exposure calculations |
US8175385B2 (en) | 2004-08-16 | 2012-05-08 | DigitalOptics Corporation Europe Limited | Foreground/background segmentation in digital images with differential exposure calculations |
US8170350B2 (en) | 2004-08-16 | 2012-05-01 | DigitalOptics Corporation Europe Limited | Foreground/background segmentation in digital images |
US7957597B2 (en) | 2004-08-16 | 2011-06-07 | Tessera Technologies Ireland Limited | Foreground/background segmentation in digital images |
US7974467B2 (en) | 2005-03-10 | 2011-07-05 | Fujifilm Corporation | Image-taking system |
EP1909493A1 (en) * | 2005-03-10 | 2008-04-09 | FUJIFILM Corporation | Photographing system |
EP1909493A4 (en) * | 2005-03-10 | 2010-01-13 | Fujifilm Corp | Photographing system |
EP1858255A4 (en) * | 2005-03-10 | 2010-01-13 | Fujifilm Corp | Background replacement device, background replacement program, and background replacement method |
US7835571B2 (en) | 2005-03-10 | 2010-11-16 | Fujifilm Corporation | Background replacing apparatus, background replacing program, and background replacing method |
EP1858255A1 (en) * | 2005-03-10 | 2007-11-21 | Fuji Photo Film Co., Ltd. | Background replacement device, background replacement program, and background replacement method |
WO2007073781A1 (en) * | 2005-12-27 | 2007-07-05 | Fotonation Vision Limited | Digital image acquisition system with portrait mode |
US8593542B2 (en) | 2005-12-27 | 2013-11-26 | DigitalOptics Corporation Europe Limited | Foreground/background separation using reference images |
US8212897B2 (en) | 2005-12-27 | 2012-07-03 | DigitalOptics Corporation Europe Limited | Digital image acquisition system with portrait mode |
US7679786B2 (en) | 2006-09-06 | 2010-03-16 | Eastman Kodak Company | Color correction method |
DE102006046395B4 (en) * | 2006-09-24 | 2008-10-23 | Kai Baumann | Mini-Studio for the creation of biometric digital passport photos |
US8134576B2 (en) | 2007-04-03 | 2012-03-13 | Lifetouch Inc. | Method and apparatus for background replacement in still photographs |
EP3099060A1 (en) * | 2007-04-03 | 2016-11-30 | Lifetouch Inc. | Method and apparatus for background replacement in still photographs |
WO2008124263A1 (en) * | 2007-04-03 | 2008-10-16 | Lifetouch Inc. | Method and apparatus for background replacement in still photographs |
US8319797B2 (en) | 2007-04-03 | 2012-11-27 | Lifetouch Inc. | Method and apparatus for background replacement in still photographs |
US7834894B2 (en) | 2007-04-03 | 2010-11-16 | Lifetouch Inc. | Method and apparatus for background replacement in still photographs |
DE102008031697A1 (en) * | 2008-07-04 | 2010-01-07 | Bayerische Motoren Werke Aktiengesellschaft | Object identification i.e. person's biometric identification, device for e.g. motor vehicle, has evaluation unit arranged in operating mode to analyze and close contour with respect to course of contour based on existence of object |
DE102008031697B4 (en) | 2008-07-04 | 2023-08-24 | Bayerische Motoren Werke Aktiengesellschaft | Device and method for object identification |
WO2010049578A1 (en) * | 2008-10-28 | 2010-05-06 | Mika Daniel Letonsaari | Video processing |
US8498453B1 (en) | 2009-09-30 | 2013-07-30 | Lifetouch, Inc. | Evaluating digital images using head points |
US9058535B2 (en) | 2011-04-05 | 2015-06-16 | Franck Guigan | Security barcode |
US20140232838A1 (en) * | 2011-07-08 | 2014-08-21 | Visual Retailing Holding B.V. | Imaging apparatus and controller for photographing products |
US9729780B2 (en) * | 2011-07-08 | 2017-08-08 | Visual Retailing Holding B.V. | Imaging apparatus and controller for photographing products |
US10410411B2 (en) | 2012-01-17 | 2019-09-10 | Leap Motion, Inc. | Systems and methods of object shape and position determination in three-dimensional (3D) space |
US10366308B2 (en) | 2012-01-17 | 2019-07-30 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging based on differences between images |
US11782516B2 (en) | 2012-01-17 | 2023-10-10 | Ultrahaptics IP Two Limited | Differentiating a detected object from a background using a gaussian brightness falloff pattern |
US8693731B2 (en) | 2012-01-17 | 2014-04-08 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging |
US9436998B2 (en) | 2012-01-17 | 2016-09-06 | Leap Motion, Inc. | Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections |
US11720180B2 (en) | 2012-01-17 | 2023-08-08 | Ultrahaptics IP Two Limited | Systems and methods for machine control |
US9495613B2 (en) | 2012-01-17 | 2016-11-15 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging using formed difference images |
US9070019B2 (en) | 2012-01-17 | 2015-06-30 | Leap Motion, Inc. | Systems and methods for capturing motion in three-dimensional space |
US11308711B2 (en) | 2012-01-17 | 2022-04-19 | Ultrahaptics IP Two Limited | Enhanced contrast for object detection and characterization by optical imaging based on differences between images |
US9626591B2 (en) | 2012-01-17 | 2017-04-18 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging |
US10767982B2 (en) | 2012-01-17 | 2020-09-08 | Ultrahaptics IP Two Limited | Systems and methods of locating a control object appendage in three dimensional (3D) space |
US9652668B2 (en) | 2012-01-17 | 2017-05-16 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging based on differences between images |
US10699155B2 (en) | 2012-01-17 | 2020-06-30 | Ultrahaptics IP Two Limited | Enhanced contrast for object detection and characterization by optical imaging based on differences between images |
US9672441B2 (en) | 2012-01-17 | 2017-06-06 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging based on differences between images |
US9679215B2 (en) | 2012-01-17 | 2017-06-13 | Leap Motion, Inc. | Systems and methods for machine control |
US9697643B2 (en) | 2012-01-17 | 2017-07-04 | Leap Motion, Inc. | Systems and methods of object shape and position determination in three-dimensional (3D) space |
US10691219B2 (en) | 2012-01-17 | 2020-06-23 | Ultrahaptics IP Two Limited | Systems and methods for machine control |
US10565784B2 (en) | 2012-01-17 | 2020-02-18 | Ultrahaptics IP Two Limited | Systems and methods for authenticating a user according to a hand of the user moving in a three-dimensional (3D) space |
US9741136B2 (en) | 2012-01-17 | 2017-08-22 | Leap Motion, Inc. | Systems and methods of object shape and position determination in three-dimensional (3D) space |
US9767345B2 (en) | 2012-01-17 | 2017-09-19 | Leap Motion, Inc. | Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections |
US9778752B2 (en) | 2012-01-17 | 2017-10-03 | Leap Motion, Inc. | Systems and methods for machine control |
US9153028B2 (en) | 2012-01-17 | 2015-10-06 | Leap Motion, Inc. | Systems and methods for capturing motion in three-dimensional space |
US9934580B2 (en) | 2012-01-17 | 2018-04-03 | Leap Motion, Inc. | Enhanced contrast for object detection and characterization by optical imaging based on differences between images |
US9945660B2 (en) | 2012-01-17 | 2018-04-17 | Leap Motion, Inc. | Systems and methods of locating a control object appendage in three dimensional (3D) space |
US20150036898A1 (en) * | 2012-02-23 | 2015-02-05 | Thales | Station for acquiring biometric and biographic data |
US9659206B2 (en) * | 2012-02-23 | 2017-05-23 | Thales | Station for acquiring biometric and biographic data |
US9285893B2 (en) | 2012-11-08 | 2016-03-15 | Leap Motion, Inc. | Object detection and tracking with variable-field illumination devices |
US10609285B2 (en) | 2013-01-07 | 2020-03-31 | Ultrahaptics IP Two Limited | Power consumption in motion-capture systems |
US9465461B2 (en) | 2013-01-08 | 2016-10-11 | Leap Motion, Inc. | Object detection and tracking with audio and optical signals |
US10097754B2 (en) | 2013-01-08 | 2018-10-09 | Leap Motion, Inc. | Power consumption in motion-capture systems with audio and optical signals |
US9626015B2 (en) | 2013-01-08 | 2017-04-18 | Leap Motion, Inc. | Power consumption in motion-capture systems with audio and optical signals |
US11353962B2 (en) | 2013-01-15 | 2022-06-07 | Ultrahaptics IP Two Limited | Free-space user interface and control using virtual constructs |
US11874970B2 (en) | 2013-01-15 | 2024-01-16 | Ultrahaptics IP Two Limited | Free-space user interface and control using virtual constructs |
US11740705B2 (en) | 2013-01-15 | 2023-08-29 | Ultrahaptics IP Two Limited | Method and system for controlling a machine according to a characteristic of a control object |
US10739862B2 (en) | 2013-01-15 | 2020-08-11 | Ultrahaptics IP Two Limited | Free-space user interface and control using virtual constructs |
US9702977B2 (en) | 2013-03-15 | 2017-07-11 | Leap Motion, Inc. | Determining positional information of an object in space |
US11693115B2 (en) | 2013-03-15 | 2023-07-04 | Ultrahaptics IP Two Limited | Determining positional information of an object in space |
US10585193B2 (en) | 2013-03-15 | 2020-03-10 | Ultrahaptics IP Two Limited | Determining positional information of an object in space |
US9916009B2 (en) | 2013-04-26 | 2018-03-13 | Leap Motion, Inc. | Non-tactile interface systems and methods |
US10452151B2 (en) | 2013-04-26 | 2019-10-22 | Ultrahaptics IP Two Limited | Non-tactile interface systems and methods |
US11099653B2 (en) | 2013-04-26 | 2021-08-24 | Ultrahaptics IP Two Limited | Machine responsiveness to dynamic user movements and gestures |
US11776208B2 (en) | 2013-08-29 | 2023-10-03 | Ultrahaptics IP Two Limited | Predictive information for free space gesture control and communication |
US11282273B2 (en) | 2013-08-29 | 2022-03-22 | Ultrahaptics IP Two Limited | Predictive information for free space gesture control and communication |
US10846942B1 (en) | 2013-08-29 | 2020-11-24 | Ultrahaptics IP Two Limited | Predictive information for free space gesture control and communication |
US11461966B1 (en) | 2013-08-29 | 2022-10-04 | Ultrahaptics IP Two Limited | Determining spans and span lengths of a control object in a free space gesture control environment |
US11775033B2 (en) | 2013-10-03 | 2023-10-03 | Ultrahaptics IP Two Limited | Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation |
EP2860582A1 (en) * | 2013-10-14 | 2015-04-15 | Photo-Me International Plc | System for acquiring photographic portraits |
US9366944B2 (en) | 2013-10-14 | 2016-06-14 | Photo-Me International Plc | Installation for the acquisition of photographic portraits |
US11868687B2 (en) | 2013-10-31 | 2024-01-09 | Ultrahaptics IP Two Limited | Predictive information for free space gesture control and communication |
US9613262B2 (en) | 2014-01-15 | 2017-04-04 | Leap Motion, Inc. | Object detection and tracking for providing a virtual device experience |
US11778159B2 (en) | 2014-08-08 | 2023-10-03 | Ultrahaptics IP Two Limited | Augmented reality with motion sensing |
EP4184456A1 (en) * | 2021-11-23 | 2023-05-24 | Bundesdruckerei GmbH | Method and device for determining a digital biometric template for a security document and method for personalizing a security document |
Also Published As
Publication number | Publication date |
---|---|
AU6577194A (en) | 1994-11-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO1994026057A1 (en) | Background separation for still and moving images | |
US3778541A (en) | System for analyzing multicolored scenes | |
US5923380A (en) | Method for replacing the background of an image | |
US5335292A (en) | Document processing system and method | |
US3835245A (en) | Information modification in image analysis systems employing line scanning | |
US5369463A (en) | Apparatus for recording position information of principal image and method of detecting principal image | |
US5050984A (en) | Method for colorizing footage | |
US5767945A (en) | Methods of changing the visibility of some characteristic or information to be included in a hard copy of a recorded image | |
EP0758515A1 (en) | Improved chromakeying system | |
JPS62189456A (en) | Main picture detection method and photographic printing exposure decision method employing said detection | |
JPS62189457A (en) | Main picture detection method and photographic printing exposure decision method employing said detection | |
CA2409224C (en) | Image recording for a document generation system | |
JPH0437383A (en) | Method and apparatus for picture synthesis | |
AU709844B2 (en) | Method for replacing the background of an image | |
JPH09212620A (en) | Manufacture of face image | |
JP2007114233A (en) | Photographing method and device | |
JPH05120417A (en) | Color adjusting and picture synthesizing method and device for color picture | |
CA1332192C (en) | Method for colorizing footage | |
GB2253319A (en) | Photographic printing apparatus | |
JP2001197352A (en) | Main object extracting method | |
JP2002218498A (en) | Background separation system | |
JP2006059162A (en) | Tooth image correction method and device | |
JPH04347778A (en) | Video photograph printing device | |
WO2000079779A2 (en) | System and method for differentiating between image foreground and background in an image based on an invisible keying signal | |
JPH0667320A (en) | Method for extracting data of person's face and method for determining exposure |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AT AU BB BG BR BY CA CH CN CZ DE DK ES FI GB GE HU JP KG KP KR KZ LK LU LV MD MG MN MW NL NO NZ PL PT RO RU SD SE SK TJ TT UA US UZ VN |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG |
|
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: CA |