WO1994026057A1 - Background separation for still and moving images - Google Patents

Background separation for still and moving images Download PDF

Info

Publication number
WO1994026057A1
WO1994026057A1 PCT/GB1994/000917 GB9400917W WO9426057A1 WO 1994026057 A1 WO1994026057 A1 WO 1994026057A1 GB 9400917 W GB9400917 W GB 9400917W WO 9426057 A1 WO9426057 A1 WO 9426057A1
Authority
WO
WIPO (PCT)
Prior art keywords
background
signal
subject
picture signal
foreground
Prior art date
Application number
PCT/GB1994/000917
Other languages
French (fr)
Inventor
Colin Dennis Ager
Alan Edward Green
Lawrence John Robinson
Original Assignee
Scientific Generics Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GB939308869A external-priority patent/GB9308869D0/en
Priority claimed from GB9406743A external-priority patent/GB9406743D0/en
Application filed by Scientific Generics Limited filed Critical Scientific Generics Limited
Priority to AU65771/94A priority Critical patent/AU6577194A/en
Publication of WO1994026057A1 publication Critical patent/WO1994026057A1/en

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/48Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus
    • G03B17/50Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with both developing and finishing apparatus
    • G03B17/53Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with both developing and finishing apparatus for automatically delivering a finished picture after a signal causing exposure has been given, e.g. by pushing a button, by inserting a coin
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay

Definitions

  • This invention concerns image enhancement techniques and apparatus therefor, particularly those employing bit map/ pixel digitisation.
  • the image capture and ehnhancement field has traditionally been dominated by direct photographic techniques in which a subject is imaged directly onto a photographic medium to produce a latent image.
  • the development of video technology has enabld the growth of electronic imaging, where the image is recorded as a time-varying electronic signal.
  • the demand for 'special effects' and improved image quality, combined with the development of computer technologies and CCD camera systems has driven a rapid growth in digital imaging.
  • the electronic signal is stored in digital form in a computer memory, allowing the data to be processed and the image enhanced.
  • the most common technique for background separation for both still and moving images is to ensure that the background is a substantially different colour from the foreground image. Then, on a pixel-by-pixel basis, the background can be eliminated or replaced in the captured image by selecting and removing those pixels which are close to the background colour and replacing them with pixels from a "different" background on a point for point correspondence basis.
  • An alternative method is to determine the effective transparency of each pixel in the captured image by measuring the deviation from the background colour. The captured image can then be merged with a background image, weighting the two images by the measured transparency so that very transparent pixels become dominated by the background image while opaque pixels are weighted in favour of the captured image.
  • a method of generating digital pixel data of a field of view containing foreground and background content so that the former can be separated from the latter comprises:-
  • the digitised signal relating to the foreground can be separated from the digitised signal relating to the background and can then be merged with a digital signal corresponding to another background which may for example be plain or represent a different scene so that the separated foreground image content can be superimposed on a different background.
  • the scanning to produce the gating signal can be performed either before or after the normal scan.
  • both scans are undertaken in rapid succession so that any movement in the original field of view is effectively arrested so that the image data obtained by the two scans remains substantially aligned.
  • the illumination employed of is typically ordinary incandescent light or daylight or a flash lamp source.
  • the illumination for the other scanning to produce the gating signal may be similar but more preferably is infrared. Both may be pulsed or modulated in some way.
  • the image content of the foreground must be readily distinguishable from the image content of the background in the scan producing the second picture signal. Infrared sources are particularly preferred since the infrared radiation is invisible to the subject particularly where the latter is human.
  • a shutter may be incorporated with the scanning camera and the operation of a shutter may be synchronised to the duration of the flash so as to reduce the effect of ambient light in the production of the gating signal.
  • the background may comprise an illuminated diffusive panel in fornt of which the subject is placed, so that image captured during the scanning to produce a second picture signal is a direct measure of the transparency of the foreground subject, and in the case of a generally opaque subject corresponds to a silhouette of the subject.
  • An advantage of the invention is that the restriction on the range of hues colours and the like otherwise imposed on the foreground subject is lifted completely since the transparency is now measured directly without the use of a reserved parameter such as colour or hue.
  • the method of producing the gating signal preferably includes at least one thresholding step so that a sharp silhouette of the foreground content can be obtained and the otherwise analogue signal converted into a true binary signal.
  • the second picture signal may comprise for example the head and shoulders of a person to be photographed. This can be processed to form a gating signal which enables the digital data relating to the head and shoulders of the person concerned to be separated from the remainder of the data (the background) in the scanned image.
  • the source of illumination need not be changed in either direction, position or wavelength if data processing is provided so as to enhance the pixel content of the silhouette image.
  • the foreground subject image content can be selected from the background image content on the basis of colour provided that the background colour is not present at any edge of the silhouette.
  • the enhancement method thus entails analysing the silhouette content as compared with the background colour or colours and determining digital signals within the silhouette signal which differ from the background colours so as to generate the gating signal pixels. Using look ahead techniques and suitable algorithms and thresholding techniques, it is possible to identify pixels having a background colour which are wholly surrounded by pixels which do not contain any background colour, and to disregard them as background and identify them as foreground image content.
  • the shirt can be identified as belonging to the subject provided the shirt is wholly surrounded by pixels the colour or other parameter of which has no counterpart in the background.
  • the pixel data corresponding to the "shirt” can then be modified so as to produce a colour which is quite distinct from the background so that when the pixel data relating to the complete field is subjected to a thresholding technique, the pixels relating to the head and shoulders of the subject will all have a colour or other parameter which is not present in the background.
  • illumination for producing the gating signal may be derived from a small source positioned in such a way so that the subject in the foreground is illuminated to a considerably higher intentsity then in the background.
  • the data in the image will thus correspond to a brightly lit subject against a relatively dark background.
  • the pixel intensity of the image gives directly a measure of the image transparency allowing the same benefits as above described.
  • This further aspect of the invention has the additional advantage of not requiring any special elements behind the subject, thus the imaging system could be wall mounted greatly reducing floor space requirements.
  • At least a first picture signal is produced by scanning the field of view using appropriate illumination so as to obtain a silhouette of the subject relative to the background.
  • two silhouette images may be produced one in which the illumination is straight on and another in which the illumination is from the side so as to bring into relief by appropriate shadow and highlighting different features of the surface subject such as for example the chin of the head of someone whose head and shoulders is to be photographed.
  • This second silhouette image may then be processed so as to locate the position of the particular feature or features of the subject identified by adjacent maximum and minimum regions of brightness or by using a neural network pattern recognition technique. Once the location of the known feature is identified, this positional information may be combined with other positional data of the subject found from the other silhouette gating signal, enabling the image to be resized and relocated accurately in relation to the identified feature.
  • This aspect of the invention is of particular application in the field of passport photography since it allows the chin position for example to be pre-selected and maintained and the remainder of the head scaled relative to the chin position so as to occupy the appropriate area on the photograph.
  • the invention also lies in apparatus for performing the above methods and techniques.
  • the invention also lies in photographic prints or transparencies produced using the gated image data.
  • the invention also lies in a method of producing photographs from image data relating to the pixels in the scanned image of the overall field of view albeit with the background modified as required and with image content relating to the foreground subject scaled if appropriate so as to be of a correct size and position in relation to the final photograph to be obtained.
  • the invention also resides in a photobooth in which a subject can stand or sit for self-take photographs
  • scanning and signal processing apparatus as aforesaid, means for illuminating the subject and the background from the front to enable a conventional scanned image of the subject and background to be obtained and means for differentially illuminating the background and subject to enable a picture signal to be obtained representative of a silhouette of the subject, and a gating signal to be derived therefrom; and gating means for selecting the image content relating to the subject from the first picture signal using the silhouette signal as a gating signal, and superimposing the selected subject picture content on a fresh background and means for printing a representation of the superimposed picture content and different background.
  • the printing process may comprise laser-jet, ink-jet, dot matrix, plotter or photographic process in which the picture signals are displayed on an appropriate CRT display and conventional photographic film is exposed to the displayed image and subsequently processed.
  • the invention also lies in a photographic studio having selectable background media, adjustable and selectable lighting for illuminating the background and/or a subject placed in front of the background, imaging means and scanning means associated therewith for scanning an image of the subject and the background in quick succession when subjected to differential illumination so as to obtain a gating signal for separating picture signals relating to the subject from the picture signal relating to the background, to allow a picture signal relating to the subject to be superimposed on a different background and means for generating a composite picture signal relating thereto for subsequent processing to enable a print to be obtained therefrom.
  • the invention is not limited to the superimposition of the abstracted image content onto a plain background but additionally envisages within its scope in respect of each of the aspects of the invention herein described the super imposition of the abstracted subject image content onto a different background which may itself comprise a picture or scene of pattern.
  • buffer storage means for storing the abstracted video signal relating to two or more different subjects and means for mixing the video signals so as to enable the video signals of selected ones of the different subjects to be combined for superimposition or combination side by side or one above the other on one or more selected backgrounds.
  • each "take" of a sequence of pictures which are subsequently to be presented in rapid succession to be illuminated twice, once "normally” and the other so as to differentially illuminate the foreground and background to enable a silhouette gating picture signal to be produced as aforesaid, one gating signal for each frame.
  • the resultant picture signals may be printed into a sequence of transparencies for projection in a conventional manner using a movie projector or may be presented to a CRT display for sequential display thereon in the manner of a television display and/or may be stored on a video tape or other data carrier for subsequent playback via a CRT display.
  • the invention lies in a method of producing a moving pictorial representation as aforesaid and in apparatus for performing the said method.
  • An alternative printer may be employed such as a dye diffusion thermal transfer printer, such as made by Tektronic Corporation and marketed under Phaser 480.
  • Figure 1 is a diagrammatic illustration of a photobooth for self-take photographs.
  • FIG. 2 is a block schematic diagram on the control unit for a camera and illumination system for the photobooth of Figure 1 ,
  • Figure 3 illustrates the process which is followed through when a photograph is required.
  • Figures 4a and 4b show the primary and secondary images obtained using the process of Figure 4,
  • Figure 5 illustrates a wall mounted self-take photographic unit for producing photographs suitable for passports.
  • Figure 6 illustrates an alternative illumination arrangement
  • Figure 7 illustrates the three pictures obtained using the system of Figure 5 with the illumination system of Figure
  • Figure 1 shows a photobooth 10 comprising a seat 12 on which a subject 14 can sit.
  • a window 16 in a partition wall 18 enables the head and shoulders of the subject to be viewed by a camera shown diagrammatically at 20 mounted above a control unit 22 and connected thereto by cabling 24.
  • a primary source of illumination is shown at 26 and a secondary illumination source is shown at 28.
  • the booth shown in Figure 1 when operated in accordance with the present invention can produce images of customers with a substituted high quality background matched accurately to the boundaries of the subject.
  • the primary illumination is provided by flashing a lamp 26 which illuminates both the subject and the background.
  • a flash-type of illumination is also used for the secondary illumination at 28 and typically this comprises a diffusive panel behind the subject through an infrared filter which does not transmit the visible component of the spectral output of the flash.
  • the camera 20 is able to detect infrared light as well as visible light. If an infrared filter is fitted, this must of course be removed from the camera.
  • the camera 20 operates in a frame integration mode that is a single exposure is used to capture both the odd and even fields of each video frame.
  • the camera outputs both a video signal, from which sync pulses are extracted to control the flash timing, and RGB signals which are fed into a frame grabber.
  • the frame grabber is capable of capturing one colour image at the full PAL resolution of 768 x 512 pixels with 24 bits per pixel and another monochrom image of the same resolution with 8 bits per pixel from each successive video frames.
  • camera 20 RGB signals are shown passing to the frame grabber designated 30 and the digital data from the frame grabber is processed via an image processing unit 32 located in the control unit 22 and when required can be outputted to a print engine 34 such as a video to photographic film converter.
  • a print engine 34 such as a video to photographic film converter.
  • the control unit essentially comprises a micro-computer programmed to produce control signals and timing signals along the dotted line to and from the camera frame grabber and flash sources 26 and 28.
  • the sync pulses from the camera 20 are shown directed to the flash sources although it may be preferred that the sync signals are provided to the control unit 22 to proceed via that unit to control the synchronous flashing of the two illumination sources.
  • the micro-computer is also programmed to provide whatever image processing and enhancement functions are desired to enable the booths print engine to operate. Control signals are also derived from the micro-computer/control unit to control the operation of the print engine 34.
  • the secondary illumination flashes triggered by the next sync pulse. This flash is not seen by the subject because of the infrared filter which cuts out the visible component of the flash.
  • the secondary image is captured by the frame grabber in monochrom.
  • the form of the primary and secondary images is illustrated in Figures 4a and 4b.
  • the primary image contains a full colour high resolution portrait of the subject and the secondary image is a monochrom silhouette of the subject in the form of a binary signal which can be used to gate out the image content relating to the subject from the background.
  • the brightness of the secondary image gives a direct measure of the transparency of the subject and a pixel-by-pixel basis.
  • the image processing function is performed.
  • the primary image is adjusted for colour balance, brightness and contrast using look-up table conversions (LUT conversions), where each pixel value is replaced by another pixel value if require.
  • the primary image is then combined with a stored background image by averaging the pixel values from the primary image with those from the background image using the secondary image pixel values as weights, creating a high quality composite image. Further image enhancement might involve superimposing other images or text onto the composite image.
  • the camera frame grabber control an illumination system is mounted on a wall at about face height as shown in Figure 5.
  • the same reference numerals are used to denote the same items as are employed in the photobooth of Figure 1 with the exception of the secondary illumination which is denoted by reference numeral 29 instead of 28.
  • the system shown in Figure 5 is capable of determining the size of the subjects head and re-scaling the image to meet the image size requirement of a passport photograph.
  • both primary and secondary illuminations are achieved by using flash illumination, but in order to provide a second secondary image, additional visible light illumination sources are provided 36 and 38 on the right and lefthand side of the camera and the normal secondary illumination source is denoted by reference numeral 40 and comprises a small infrared source close to the camera.
  • Figure 6 shows the arrangement best from above. The resulting images are illustrated at Figures 7a, 7b and 7c.
  • Figure 7a That in Figure 7a is the one which is obtained by using the primary illuminations source shown in Figure 5 at 26 and 29. No vertical shadows were produced since the two light sources 26 and 29 respectively illuminate shadowed regions created by the other.
  • the first secondary image using the infrared source 40 produces a silhouette image shown in Figure 7b.
  • the second secondary illumination produces a dark shadow under the subjects chin since the two light sources of Figure 6, 36 and 38 are above the level of the subjects head and there is no compensating illumination from a source such as 29. This is shown in Figure 7c and the dark region immediately below the subjects chin can be used to locate this particular region of the image during subsequent image processing.
  • the background of the primary image is subsituted as before by mixing the primary image with a stored or generated background using the pixel values of the silhouette images weights.
  • the top of the subject's head is found by examining the silhouette image.
  • the top of the head may be defined as the first row of pixels, starting from the top of the image, that contains more than say 2% bright pixels.
  • the width of the head is easily found from the silhouette image by finding the maximum width of the bright region in the centre of the image below the top of the head.
  • the second signatory image is used to locate the subject's chin. Starting from the corners at the top and centre of the head, a search is made for the dark shadow cast under the chin by the illumination from 36 and 38. The top edge of this shadow represents the underside of the chin in the image .
  • This rectangle can be mapped, (translated and scaled) onto a corresponding rectanle defined by the relevant passport authority so that the bit-mapped content therein can be displayed with a pixel spacing in both X and Y directions so as to just fill the passport authority defined rectangle so that whatever the size of the head as imaged during the scanning, the reproduction of the video signal will be to a scale which enables the head to just fill the rectangle laid down by the passport authority.

Abstract

A method and apparatus is described in which by differential illumination, two separate picture signals can be obtained of a subject in front of a background one of which corresponds to a silhouette of the subject and a gating signal is derived from the silhouette size and the other a normal picture signal of the subject and the background. By using the gating signal, signal content of the subject from the background signal content in the said other picture signal, so the background can be sublimated relative to the subject for example by substituting for a 'busy background' a plain neutral background which contains no shadow. Differential illumination is achieved using visible light followed by infrared light or vice versa or by illuminating the subject and background from the front for one scan and back illuminating the subject during the other scan, to produce the silhouette signal by illuminating the subject and the background by an intense source of illumination so that the subject appears very bright against a less bright background. By synchronously switching the video signal which contains image content relating to both subject and background, the latter can be removed from the subject image content so the latter can be superimposed onto a different background. A second secondary image may be produced using side or top illumination to cast a shadow adjacent a particular feature. Image analysis may be used to detect the position of the shadow to enable the feature position to be determined. The technique is of particular application to the automatic production of passport photographs.

Description

Title: Background Separation for Still and Moving Images
Field of the invention
This invention concerns image enhancement techniques and apparatus therefor, particularly those employing bit map/ pixel digitisation.
Background to the invention
The image capture and ehnhancement field has traditionally been dominated by direct photographic techniques in which a subject is imaged directly onto a photographic medium to produce a latent image. The development of video technology has enabld the growth of electronic imaging, where the image is recorded as a time-varying electronic signal. More recently, the demand for 'special effects' and improved image quality, combined with the development of computer technologies and CCD camera systems has driven a rapid growth in digital imaging. Here the electronic signal is stored in digital form in a computer memory, allowing the data to be processed and the image enhanced.
Most of the demand for special effects has been from the entertainment industry, in particular for large-budget movies. On the other hand, digital image quality enhancement has been driven by the advertising and publishing industries.
There is now a growing demand for similar image processing techniques from other areas of the photographic and imaging industries, including home photography, security imaging and photobooths. Two key requirements which are emerging in these fields are:
(1) To separate the subject, or foreground image, from the background in the captured image. This will allow both elimination of the background and its replacement by another image. Further image components can be added to the 'composite image', building up a complete, realistic picture of the original subject apparently in a different environment.
(2) To detect and locate significant features of the subject within the captured image. This ability is particularly important in preparing passport photographs where the size of the head in the final picture is specified by the authorities. Currently, many photobooths produce four copies of the same image at different magnifications in the hope that one of the images will meet the required specification.
Prior Art
The most common technique for background separation for both still and moving images is to ensure that the background is a substantially different colour from the foreground image. Then, on a pixel-by-pixel basis, the background can be eliminated or replaced in the captured image by selecting and removing those pixels which are close to the background colour and replacing them with pixels from a "different" background on a point for point correspondence basis. An alternative method is to determine the effective transparency of each pixel in the captured image by measuring the deviation from the background colour. The captured image can then be merged with a background image, weighting the two images by the measured transparency so that very transparent pixels become dominated by the background image while opaque pixels are weighted in favour of the captured image.
The chief drawback of these techniques is that the background colour must not appear in the "subject". Thus if the background is blue, the subject must not contain any areas of similar hue.
It is an object of the present invention to provide a method and apparatus for distinguishing between the subject (foreground) and background of an image, and for detecting and locating significant features of the subject (foreground) image.
Summary of the Invention
According to one aspect of the present invention a method of generating digital pixel data of a field of view containing foreground and background content so that the former can be separated from the latter comprises:-
1. Scanning the field of view whilst subjecting the latter to normal illumination and storing the digitised data on a pixel by pixel basis relating as a first picture signal;
2. illuminating the field so as to render the foreground distinguishable from the background and scanning the field of view and storing the digitised signal so obtained on a pixel by pixel basis as a second picture signal; 3. generating the binary gating signal from the digitised video signal wherein the pixels in the gating signal have one value if they relate to the foreground and a second value if they relate to the background, and
4. processing the first picture signal using the binary gating signal so as to select the digital signals corresponding to the pixels which relate to the foreground content of the field of view from those relating to the background, to form a third picture signal.
By using this approach the digitised signal relating to the foreground can be separated from the digitised signal relating to the background and can then be merged with a digital signal corresponding to another background which may for example be plain or represent a different scene so that the separated foreground image content can be superimposed on a different background.
The scanning to produce the gating signal can be performed either before or after the normal scan.
Preferably both scans are undertaken in rapid succession so that any movement in the original field of view is effectively arrested so that the image data obtained by the two scans remains substantially aligned.
The illumination employed of is typically ordinary incandescent light or daylight or a flash lamp source. The illumination for the other scanning to produce the gating signal may be similar but more preferably is infrared. Both may be pulsed or modulated in some way. The image content of the foreground must be readily distinguishable from the image content of the background in the scan producing the second picture signal. Infrared sources are particularly preferred since the infrared radiation is invisible to the subject particularly where the latter is human.
Where the illumination for producing the gating signal is to be pulsed, a shutter may be incorporated with the scanning camera and the operation of a shutter may be synchronised to the duration of the flash so as to reduce the effect of ambient light in the production of the gating signal.
In a photobooth or studio situation, the background may comprise an illuminated diffusive panel in fornt of which the subject is placed, so that image captured during the scanning to produce a second picture signal is a direct measure of the transparency of the foreground subject, and in the case of a generally opaque subject corresponds to a silhouette of the subject.
An advantage of the invention is that the restriction on the range of hues colours and the like otherwise imposed on the foreground subject is lifted completely since the transparency is now measured directly without the use of a reserved parameter such as colour or hue.
Since the scanning to produce the gating signal will still produce digital information which varies according to reflectivity, transparency, colour and the like, the method of producing the gating signal preferably includes at least one thresholding step so that a sharp silhouette of the foreground content can be obtained and the otherwise analogue signal converted into a true binary signal.
In the case of a photobooth or studio situation, the second picture signal may comprise for example the head and shoulders of a person to be photographed. This can be processed to form a gating signal which enables the digital data relating to the head and shoulders of the person concerned to be separated from the remainder of the data (the background) in the scanned image.
By adjusting the direction or position of the illumination, it is not necessary to use a different source of illumination or wavelength in order to produce a silhouette image of the subject. It is merely necessary to ensure that the background in front of which the subject is positioned is illuminated in such a way that the subject is silhouetted against the illuminated background, thereby enabling the gating signal to be generated corresponding to the pixels which relate to the silhouette.
According to a further aspect of the present invention, the source of illumination need not be changed in either direction, position or wavelength if data processing is provided so as to enhance the pixel content of the silhouette image. Also the foreground subject image content can be selected from the background image content on the basis of colour provided that the background colour is not present at any edge of the silhouette. The enhancement method thus entails analysing the silhouette content as compared with the background colour or colours and determining digital signals within the silhouette signal which differ from the background colours so as to generate the gating signal pixels. Using look ahead techniques and suitable algorithms and thresholding techniques, it is possible to identify pixels having a background colour which are wholly surrounded by pixels which do not contain any background colour, and to disregard them as background and identify them as foreground image content.
Thus for example if a subject comprises a man whose shirt colour happens to correspond rather closely to a colour within the background, the shirt can be identified as belonging to the subject provided the shirt is wholly surrounded by pixels the colour or other parameter of which has no counterpart in the background. The pixel data corresponding to the "shirt" can then be modified so as to produce a colour which is quite distinct from the background so that when the pixel data relating to the complete field is subjected to a thresholding technique, the pixels relating to the head and shoulders of the subject will all have a colour or other parameter which is not present in the background.
According to another aspect of the invention, illumination for producing the gating signal may be derived from a small source positioned in such a way so that the subject in the foreground is illuminated to a considerably higher intentsity then in the background.
The data in the image will thus correspond to a brightly lit subject against a relatively dark background. As for the back lit case, the pixel intensity of the image gives directly a measure of the image transparency allowing the same benefits as above described. This further aspect of the invention has the additional advantage of not requiring any special elements behind the subject, thus the imaging system could be wall mounted greatly reducing floor space requirements.
According to a further implementation the invention, at least a first picture signal is produced by scanning the field of view using appropriate illumination so as to obtain a silhouette of the subject relative to the background. Thus for example two silhouette images may be produced one in which the illumination is straight on and another in which the illumination is from the side so as to bring into relief by appropriate shadow and highlighting different features of the surface subject such as for example the chin of the head of someone whose head and shoulders is to be photographed. This second silhouette image may then be processed so as to locate the position of the particular feature or features of the subject identified by adjacent maximum and minimum regions of brightness or by using a neural network pattern recognition technique. Once the location of the known feature is identified, this positional information may be combined with other positional data of the subject found from the other silhouette gating signal, enabling the image to be resized and relocated accurately in relation to the identified feature.
This aspect of the invention is of particular application in the field of passport photography since it allows the chin position for example to be pre-selected and maintained and the remainder of the head scaled relative to the chin position so as to occupy the appropriate area on the photograph. The invention also lies in apparatus for performing the above methods and techniques.
The invention also lies in photographic prints or transparencies produced using the gated image data.
The invention also lies in a method of producing photographs from image data relating to the pixels in the scanned image of the overall field of view albeit with the background modified as required and with image content relating to the foreground subject scaled if appropriate so as to be of a correct size and position in relation to the final photograph to be obtained.
The invention also resides in a photobooth in which a subject can stand or sit for self-take photographs comprising scanning and signal processing apparatus as aforesaid, means for illuminating the subject and the background from the front to enable a conventional scanned image of the subject and background to be obtained and means for differentially illuminating the background and subject to enable a picture signal to be obtained representative of a silhouette of the subject, and a gating signal to be derived therefrom; and gating means for selecting the image content relating to the subject from the first picture signal using the silhouette signal as a gating signal, and superimposing the selected subject picture content on a fresh background and means for printing a representation of the superimposed picture content and different background.
The printing process may comprise laser-jet, ink-jet, dot matrix, plotter or photographic process in which the picture signals are displayed on an appropriate CRT display and conventional photographic film is exposed to the displayed image and subsequently processed.
The invention also lies in a photographic studio having selectable background media, adjustable and selectable lighting for illuminating the background and/or a subject placed in front of the background, imaging means and scanning means associated therewith for scanning an image of the subject and the background in quick succession when subjected to differential illumination so as to obtain a gating signal for separating picture signals relating to the subject from the picture signal relating to the background, to allow a picture signal relating to the subject to be superimposed on a different background and means for generating a composite picture signal relating thereto for subsequent processing to enable a print to be obtained therefrom.
The invention is not limited to the superimposition of the abstracted image content onto a plain background but additionally envisages within its scope in respect of each of the aspects of the invention herein described the super imposition of the abstracted subject image content onto a different background which may itself comprise a picture or scene of pattern.
Also within the scope of the invention is the provision of buffer storage means for storing the abstracted video signal relating to two or more different subjects and means for mixing the video signals so as to enable the video signals of selected ones of the different subjects to be combined for superimposition or combination side by side or one above the other on one or more selected backgrounds. So far the invention has been described primarily in relation to still subject matter, i.e. a motionless subject sitting in front of a motionless background. It is to be understood that the same technique may be employed for producing video signals relating to a moving subject relative to a stationary background or when both subject and background are moving relative to the viewing device. Whatever the scenario, it is merely necessary for each "take" of a sequence of pictures which are subsequently to be presented in rapid succession, to be illuminated twice, once "normally" and the other so as to differentially illuminate the foreground and background to enable a silhouette gating picture signal to be produced as aforesaid, one gating signal for each frame. By storing the different picture signals separately and synchronously reading out the signals and gating one signal relative to another before mixing, so the same effect as described in relation to a still picture can be obtained for each of the pictures which are to be presented in a moving sequence of pictures.
The resultant picture signals may be printed into a sequence of transparencies for projection in a conventional manner using a movie projector or may be presented to a CRT display for sequential display thereon in the manner of a television display and/or may be stored on a video tape or other data carrier for subsequent playback via a CRT display.
The invention lies in a method of producing a moving pictorial representation as aforesaid and in apparatus for performing the said method. An alternative printer may be employed such as a dye diffusion thermal transfer printer, such as made by Tektronic Corporation and marketed under Phaser 480.
Figure imgf000014_0001
The invention will now be described by way of example with reference to the accompanying drawings in which:-
Figure 1 is a diagrammatic illustration of a photobooth for self-take photographs.
Figure 2 is a block schematic diagram on the control unit for a camera and illumination system for the photobooth of Figure 1 ,
Figure 3 illustrates the process which is followed through when a photograph is required.
Figures 4a and 4b show the primary and secondary images obtained using the process of Figure 4,
Figure 5 illustrates a wall mounted self-take photographic unit for producing photographs suitable for passports.
Figure 6 illustrates an alternative illumination arrangement and
Figure 7 illustrates the three pictures obtained using the system of Figure 5 with the illumination system of Figure
6.
Figure imgf000015_0001
Figure 1 shows a photobooth 10 comprising a seat 12 on which a subject 14 can sit. A window 16 in a partition wall 18 enables the head and shoulders of the subject to be viewed by a camera shown diagrammatically at 20 mounted above a control unit 22 and connected thereto by cabling 24. A primary source of illumination is shown at 26 and a secondary illumination source is shown at 28.
Unlike conventional booths the booth shown in Figure 1 when operated in accordance with the present invention can produce images of customers with a substituted high quality background matched accurately to the boundaries of the subject.
Although shown in a seat the subject of course could stand within the booth but the seated position is preferred.
The primary illumination is provided by flashing a lamp 26 which illuminates both the subject and the background.
A flash-type of illumination is also used for the secondary illumination at 28 and typically this comprises a diffusive panel behind the subject through an infrared filter which does not transmit the visible component of the spectral output of the flash.
It is of course important that the camera 20 is able to detect infrared light as well as visible light. If an infrared filter is fitted, this must of course be removed from the camera.
The camera 20 operates in a frame integration mode that is a single exposure is used to capture both the odd and even fields of each video frame. The camera outputs both a video signal, from which sync pulses are extracted to control the flash timing, and RGB signals which are fed into a frame grabber. The frame grabber is capable of capturing one colour image at the full PAL resolution of 768 x 512 pixels with 24 bits per pixel and another monochrom image of the same resolution with 8 bits per pixel from each successive video frames.
The signal processing and camera control circuits are shown in Figure 2. Thus camera 20 RGB signals are shown passing to the frame grabber designated 30 and the digital data from the frame grabber is processed via an image processing unit 32 located in the control unit 22 and when required can be outputted to a print engine 34 such as a video to photographic film converter.
The control unit essentially comprises a micro-computer programmed to produce control signals and timing signals along the dotted line to and from the camera frame grabber and flash sources 26 and 28. The sync pulses from the camera 20 are shown directed to the flash sources although it may be preferred that the sync signals are provided to the control unit 22 to proceed via that unit to control the synchronous flashing of the two illumination sources.
The micro-computer is also programmed to provide whatever image processing and enhancement functions are desired to enable the booths print engine to operate. Control signals are also derived from the micro-computer/control unit to control the operation of the print engine 34.
The basic operation of the control booth is shown in Figure 3. When the image acquisition sequence is initiated, the primary illumination flashes on the next sync pulse for an odd video field. The frame grabber captures this video frame when it is read out from the camera.
The secondary illumination flashes triggered by the next sync pulse. This flash is not seen by the subject because of the infrared filter which cuts out the visible component of the flash. The secondary image is captured by the frame grabber in monochrom.
The form of the primary and secondary images is illustrated in Figures 4a and 4b. The primary image contains a full colour high resolution portrait of the subject and the secondary image is a monochrom silhouette of the subject in the form of a binary signal which can be used to gate out the image content relating to the subject from the background. In fact the brightness of the secondary image gives a direct measure of the transparency of the subject and a pixel-by-pixel basis.
When both images have been captured the image processing function is performed. The primary image is adjusted for colour balance, brightness and contrast using look-up table conversions (LUT conversions), where each pixel value is replaced by another pixel value if require. The primary image is then combined with a stored background image by averaging the pixel values from the primary image with those from the background image using the secondary image pixel values as weights, creating a high quality composite image. Further image enhancement might involve superimposing other images or text onto the composite image. In another embodiment of the invention the camera frame grabber control an illumination system is mounted on a wall at about face height as shown in Figure 5. The same reference numerals are used to denote the same items as are employed in the photobooth of Figure 1 with the exception of the secondary illumination which is denoted by reference numeral 29 instead of 28.
In addition to requiring very little space, the system shown in Figure 5 is capable of determining the size of the subjects head and re-scaling the image to meet the image size requirement of a passport photograph.
As before both primary and secondary illuminations are achieved by using flash illumination, but in order to provide a second secondary image, additional visible light illumination sources are provided 36 and 38 on the right and lefthand side of the camera and the normal secondary illumination source is denoted by reference numeral 40 and comprises a small infrared source close to the camera.
Figure 6 shows the arrangement best from above. The resulting images are illustrated at Figures 7a, 7b and 7c.
That in Figure 7a is the one which is obtained by using the primary illuminations source shown in Figure 5 at 26 and 29. No vertical shadows were produced since the two light sources 26 and 29 respectively illuminate shadowed regions created by the other. The first secondary image using the infrared source 40 produces a silhouette image shown in Figure 7b.
The second secondary illumination produces a dark shadow under the subjects chin since the two light sources of Figure 6, 36 and 38 are above the level of the subjects head and there is no compensating illumination from a source such as 29. This is shown in Figure 7c and the dark region immediately below the subjects chin can be used to locate this particular region of the image during subsequent image processing.
An additional difference from the previous embodiment is that the camera now has a limited exposure (integration) time, and the flashes are synchronised to this period by delaying the trigger pulse for a short period after the video sync pulse. This has the benefit of increasing the rejection of ambient lighting over which there is now no control.
The background of the primary image is subsituted as before by mixing the primary image with a stored or generated background using the pixel values of the silhouette images weights.
The top of the subject's head is found by examining the silhouette image. The top of the head may be defined as the first row of pixels, starting from the top of the image, that contains more than say 2% bright pixels. The width of the head is easily found from the silhouette image by finding the maximum width of the bright region in the centre of the image below the top of the head.
The second signatory image is used to locate the subject's chin. Starting from the corners at the top and centre of the head, a search is made for the dark shadow cast under the chin by the illumination from 36 and 38. The top edge of this shadow represents the underside of the chin in the image .
These procedures define a rectangle which fits around the of the subject in the image.
This rectangle can be mapped, (translated and scaled) onto a corresponding rectanle defined by the relevant passport authority so that the bit-mapped content therein can be displayed with a pixel spacing in both X and Y directions so as to just fill the passport authority defined rectangle so that whatever the size of the head as imaged during the scanning, the reproduction of the video signal will be to a scale which enables the head to just fill the rectangle laid down by the passport authority.

Claims

Claims :
1. A method of generating digital pixel data of a field of view containing foreground and background content so that the former can be separated from the latter, comprising:-
(a) scanning the field of view whilst subjecting the latter to normal illumination and storing the digitised data on a pixel-by-pixel basis as a first picture signal,
(b) illuminating the field of view so as to render the foreground distinguishable from the background and scanning the field of view and storing the digitised data so obtained on a pixel-by-pixel basis as a second picture signal,
(c) generating a binary gating signal from the dsecond picture signal wherein the pixels in the gating signal have one value if they relate to the foreground and a second value if they relate to the background, and
(d) processing the first picture signal using the binary gating signal so as to select the digital signals corresponding to the pixels which relate to the foreground content of the field of view from those relating to the background, to form a third picture signal.
2. A method as claimed in claim 1 in which the third signal (relating to the foreground) is combined with a picture signal corresponding to a different background from that of the original field of view.
3. A method as claimed in claim 2 wherein the different background picture signal is of a single colour.
4. A method as claimed in any of claims 1 to 3 wherein the scanning to produce the gating signal is performed before the scanning to produce the first picture signal.
5. A method as claimed in any of claims 1 to 3 wherein the scanning to produce the gating signal is performed after the scanning which produces the first picture signal.
6. A method as claimed in either of claims 4 and 5 wherein both scans are undertaken in rapid succession so that any movement of the original field of view is effectively arrested so that image data obtained by the two scans remains substantially aligned.
7. A method as claimed in any of the preceding claims wherein the scanning device is responsive to visible light and infrared light and a source of infrared radiation is used to illuminate the field of view so as to produce the second picture signal.
8. A method as claimed in any of claims 1 to 7 wherein visible light is used to illuminate the foreground and background and during the scanning to produce the first picture signal at least the foreground is front lit and during the scanning to produce the second picture signal at least the foreground is back lit.
9. A method as claimed in any of claims 1 to 8 wherein flash illumination or pulsed illumination is employed during one or other or both of the scans.
10. A method as claimed in any of the preceding claims wherein the scanning device is rendered insensitive to light or other radiation except in synchronism with each of the flashes so that the effect of ambient light is reduced.
11. A method as claimed in claim 8 wherein the back lighting is achieved by an illuminated diffusive panel in front of which a subject constituting the foreground is placed, so that the background image is captured during the scanning to produce the gating signal which is a direct measure of the transparency of the foreground material.
12. A method as claimed in any of the preceding claims wherein a gating signal is derived from the second picture signal using at least one thresholding step so that a picture signal of a sharp silhouette of the foreground content is obtained.
13. A method as claimed in any of the preceding claims further comprising the step of comparing the colours of the pixels in the third picture signal with the colours present in the background of the first picture signal and changing the colour of any pixels in the foreground picture signal content to a colour different from any colour present in the background of the first picture signal.
14. A method as claimed in any of the preceding claims wherein the second picture signal is obtained by illuminating the foreground to a much greater intensity than the background so that the pixels relating to the foreground can be distinguished from the pixels relating to the background on the basis of brightness.
15. A method as claimed in any of the preceding claims in which at least a fourth picture signal is produced by scanning the field of view using a source of illumination from the side or below or above so as to bring into relief and create a dark shadow of at least one selected feature of the foreground subject so that the position of the feature thrown into relief in the fourth picture signal because of the shadow can be readily distinguished by thresholding within the fourth picture signal to permit positional information to be derived of the feature or features within the first picture signal.
16. A method as claimed in claim 15 wherein the positional information obtained from the fourth picture signal is combined with the gating signal during processing of the first picture signal so as to enable scaling and positioning of the foreground content of the first picture signal in a fifth picture signal.
17. A method as claimed in any of the preceding claims wherein the finally processed signal is stored and/or processed so as to produce a print such as a photographic print of the selected foreground against a selected background.
18. Apparatus for performing the method of any one of claims 1 to 16.
19. Photographic prints or transparancies produced using the method of any one of claims 1 to 16 or the apparatus for claim 17.
20. A photobooth in which a subject can stand or sit for self-take photographs comprising scanning and signalling processing apparatus as claimed in claim 17, means for illuminating the subject and the background from the front to enable a conventional scanned image of the subject and background to be obtained and means for differentially illuminating the background and subject to enable an image signal to be obtained representative of a silhouette of the subject so that a gating signal can be derived therefrom, and gating means for selecting the image content relating to the subject from the first picture signal using the silhouette signal as a gating signal, superimposing the selected subject picture content on a fresh background picture signal, and means for printing a representation of the superimposed picture content and different background as a final print.
21. A photobooth as claimed in claim 19 in which the printing process comprises a laser jet printer, ink jet printer, dot matrix printer, plotter, dye diffusion thermal transfer printer or a photographic processor.
22. Apparatus as claimed in claim 20 wherein the picture signals are displayed by means of a CRT display or the like and conventional photographic film is exposed to the displayed image and subsequently processed to produce a photograph thereof.
23. A photographic studio having selectable background media, adjustable and selectable lighting for illuminating the background and/or a subject placed in front thereof, imaging means and scanning means associated therewith for scanning an image of the subject and the background in quick succession when subjected to differential illumination, so as to obtain a gating signal for separating picture signals relating to the subject from picture signals relating to the background, to allow a picture signal relating only to the subject to be produced for combining with a different background picture signal, so that when displayed the subject appears superimposed on the different background, and means for generating a composite picture signal relating thereto for subsequent processing to enable a print to be obtained therefrom.
24. A method as claimed in any of claims 1 to 16 wherein the combination of the picture signal relating to the foreground includes the combination of that selected picture signal content with another similarly selected picture signal content of other foreground material from other scannings and the super imposition of two or more such foreground picture signals on a background picture signal to produce a composite final picture signal.
25. Apparatus for performing the method of claim 4 which includes buffer storage means for storing the abstracted picture signals relating to two or more different subjects and means for mixing the picture signals so as to enable the picture signals of selected ones of the different subjects to be combined for superimposition or in combination side-by-side, or one above the other against one or more selected backgrounds.
26. A method as claimed in any of claims 1 to 16 wherein each take of a sequence of pictures which are to be presented in rapid succession to form a moving picture, is illuminated twice, once normally and the other so as to differentially illuminate the foreground and background in the field of view thereby to enable a silhouette gating signal to be produced as aforesaid, one gating signal for each take, storage means is provided for storing the different picture signals separately and means is provided for synchronously reading out the signals and the gating signals before combining the signals so as to abstract from each signal the foreground content relating to each take and a final signal is produced by combining the abstracted foreground picture signal content with a desired background signal for the final moving picture signal to be displayed or printed.
27. A method as claimed in claim 25 wherein the sequence of takes are printed in the form of a sequence of transparancies for projection in a conventional manner using a movie projector.
28. A method as claimed in claim 25 wherein the final signal is read out as a real time video signal for display on a CRT display such as a television monitor.
29. Methods and apparatus for imaging enhancement constructed and arranged and adapted to operate substantially as herein described with reference to and as illustrated in Figures 1 to 7 of the accompanying drawings.
PCT/GB1994/000917 1993-04-29 1994-04-29 Background separation for still and moving images WO1994026057A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU65771/94A AU6577194A (en) 1993-04-29 1994-04-29 Background separation for still and moving images

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB939308869A GB9308869D0 (en) 1993-04-29 1993-04-29 A novel image enhancement technique
GB9308869.8 1993-04-29
GB9406743.6 1994-04-06
GB9406743A GB9406743D0 (en) 1994-04-06 1994-04-06 Image enhancement technique

Publications (1)

Publication Number Publication Date
WO1994026057A1 true WO1994026057A1 (en) 1994-11-10

Family

ID=26302829

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB1994/000917 WO1994026057A1 (en) 1993-04-29 1994-04-29 Background separation for still and moving images

Country Status (2)

Country Link
AU (1) AU6577194A (en)
WO (1) WO1994026057A1 (en)

Cited By (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0756419A1 (en) * 1995-07-28 1997-01-29 Nippon Hoso Kyokai Method and apparatus for picking-up an image of a subject to be superimposed on base image
WO1997015140A1 (en) * 1995-10-18 1997-04-24 Polaroid Corporation Background replacement for an image
WO1997017803A1 (en) * 1995-11-07 1997-05-15 Imagini Corporation Limited Camera system with flash illumination and chroma-keying
WO1997027702A1 (en) * 1996-01-25 1997-07-31 Polaroid Corporation Method for replacing the background of an image
EP0797351A1 (en) * 1996-03-18 1997-09-24 Nippon Television Network Corporation Picture replacement system and method
EP0809408A1 (en) * 1996-05-24 1997-11-26 THOMSON multimedia Special effects camera
GB2320638A (en) * 1996-12-20 1998-06-24 Eastman Kodak Co Photographic system using chroma-key processing
WO1999029102A1 (en) * 1997-12-01 1999-06-10 Sensar, Inc. Image subtraction to remove ambient illumination
GB2341507A (en) * 1998-06-24 2000-03-15 Alan William Robinson Removing shadows from television signals
EP1298584A2 (en) * 2001-10-01 2003-04-02 L'oreal Method and apparatus to capture and analyze an image of a human body part
US6545742B2 (en) 1999-03-16 2003-04-08 O'hagan Paul Allan Peter Lighting systems
WO2003030526A1 (en) * 2001-10-03 2003-04-10 Koninklijke Philips Electronics N.V. Method and system for detecting and selecting foreground objects
WO2007073781A1 (en) * 2005-12-27 2007-07-05 Fotonation Vision Limited Digital image acquisition system with portrait mode
EP1858255A1 (en) * 2005-03-10 2007-11-21 Fuji Photo Film Co., Ltd. Background replacement device, background replacement program, and background replacement method
EP1909493A1 (en) * 2005-03-10 2008-04-09 FUJIFILM Corporation Photographing system
WO2008124263A1 (en) * 2007-04-03 2008-10-16 Lifetouch Inc. Method and apparatus for background replacement in still photographs
DE102006046395B4 (en) * 2006-09-24 2008-10-23 Kai Baumann Mini-Studio for the creation of biometric digital passport photos
DE102008031697A1 (en) * 2008-07-04 2010-01-07 Bayerische Motoren Werke Aktiengesellschaft Object identification i.e. person's biometric identification, device for e.g. motor vehicle, has evaluation unit arranged in operating mode to analyze and close contour with respect to course of contour based on existence of object
US7679786B2 (en) 2006-09-06 2010-03-16 Eastman Kodak Company Color correction method
WO2010049578A1 (en) * 2008-10-28 2010-05-06 Mika Daniel Letonsaari Video processing
US7835571B2 (en) 2005-03-10 2010-11-16 Fujifilm Corporation Background replacing apparatus, background replacing program, and background replacing method
US7912285B2 (en) 2004-08-16 2011-03-22 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images with differential exposure calculations
US7957597B2 (en) 2004-08-16 2011-06-07 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images
US8498453B1 (en) 2009-09-30 2013-07-30 Lifetouch, Inc. Evaluating digital images using head points
US8593542B2 (en) 2005-12-27 2013-11-26 DigitalOptics Corporation Europe Limited Foreground/background separation using reference images
US8693731B2 (en) 2012-01-17 2014-04-08 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging
US20140232838A1 (en) * 2011-07-08 2014-08-21 Visual Retailing Holding B.V. Imaging apparatus and controller for photographing products
US20150036898A1 (en) * 2012-02-23 2015-02-05 Thales Station for acquiring biometric and biographic data
EP2860582A1 (en) * 2013-10-14 2015-04-15 Photo-Me International Plc System for acquiring photographic portraits
US9058535B2 (en) 2011-04-05 2015-06-16 Franck Guigan Security barcode
US9070019B2 (en) 2012-01-17 2015-06-30 Leap Motion, Inc. Systems and methods for capturing motion in three-dimensional space
US9153028B2 (en) 2012-01-17 2015-10-06 Leap Motion, Inc. Systems and methods for capturing motion in three-dimensional space
US9285893B2 (en) 2012-11-08 2016-03-15 Leap Motion, Inc. Object detection and tracking with variable-field illumination devices
US9465461B2 (en) 2013-01-08 2016-10-11 Leap Motion, Inc. Object detection and tracking with audio and optical signals
US9613262B2 (en) 2014-01-15 2017-04-04 Leap Motion, Inc. Object detection and tracking for providing a virtual device experience
US9679215B2 (en) 2012-01-17 2017-06-13 Leap Motion, Inc. Systems and methods for machine control
US9702977B2 (en) 2013-03-15 2017-07-11 Leap Motion, Inc. Determining positional information of an object in space
US9916009B2 (en) 2013-04-26 2018-03-13 Leap Motion, Inc. Non-tactile interface systems and methods
US10609285B2 (en) 2013-01-07 2020-03-31 Ultrahaptics IP Two Limited Power consumption in motion-capture systems
US10691219B2 (en) 2012-01-17 2020-06-23 Ultrahaptics IP Two Limited Systems and methods for machine control
US10739862B2 (en) 2013-01-15 2020-08-11 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US10846942B1 (en) 2013-08-29 2020-11-24 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
EP4184456A1 (en) * 2021-11-23 2023-05-24 Bundesdruckerei GmbH Method and device for determining a digital biometric template for a security document and method for personalizing a security document
US11720180B2 (en) 2012-01-17 2023-08-08 Ultrahaptics IP Two Limited Systems and methods for machine control
US11740705B2 (en) 2013-01-15 2023-08-29 Ultrahaptics IP Two Limited Method and system for controlling a machine according to a characteristic of a control object
US11778159B2 (en) 2014-08-08 2023-10-03 Ultrahaptics IP Two Limited Augmented reality with motion sensing
US11775033B2 (en) 2013-10-03 2023-10-03 Ultrahaptics IP Two Limited Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation
US11868687B2 (en) 2013-10-31 2024-01-09 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB638937A (en) * 1947-11-06 1950-06-21 Cinema Television Ltd Improvements in or relating to television or like systems
FR1064950A (en) * 1951-10-26 1954-05-19 Pye Ltd Improved method and apparatus for producing television images
WO1990010251A1 (en) * 1989-02-28 1990-09-07 Photostar Limited Automatic picture taking machine
US5109281A (en) * 1987-05-25 1992-04-28 Hitachi, Ltd. Video printer with separately stored digital signals printed in separate areas to form a print of multiple images
US5117283A (en) * 1990-06-25 1992-05-26 Eastman Kodak Company Photobooth compositing apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB638937A (en) * 1947-11-06 1950-06-21 Cinema Television Ltd Improvements in or relating to television or like systems
FR1064950A (en) * 1951-10-26 1954-05-19 Pye Ltd Improved method and apparatus for producing television images
US5109281A (en) * 1987-05-25 1992-04-28 Hitachi, Ltd. Video printer with separately stored digital signals printed in separate areas to form a print of multiple images
WO1990010251A1 (en) * 1989-02-28 1990-09-07 Photostar Limited Automatic picture taking machine
US5117283A (en) * 1990-06-25 1992-05-26 Eastman Kodak Company Photobooth compositing apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
A. J. HENK: "A new approach to overlay in monochrome television", JOURNAL OF THE SMPTE, vol. 78, October 1969 (1969-10-01), pages 861 - 866 *

Cited By (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0756419A1 (en) * 1995-07-28 1997-01-29 Nippon Hoso Kyokai Method and apparatus for picking-up an image of a subject to be superimposed on base image
WO1997015140A1 (en) * 1995-10-18 1997-04-24 Polaroid Corporation Background replacement for an image
AU706252B2 (en) * 1995-10-18 1999-06-10 Polaroid Corporation Background replacement for an image
WO1997017803A1 (en) * 1995-11-07 1997-05-15 Imagini Corporation Limited Camera system with flash illumination and chroma-keying
AU709844B2 (en) * 1996-01-25 1999-09-09 Polaroid Corporation Method for replacing the background of an image
WO1997027702A1 (en) * 1996-01-25 1997-07-31 Polaroid Corporation Method for replacing the background of an image
EP0797351A1 (en) * 1996-03-18 1997-09-24 Nippon Television Network Corporation Picture replacement system and method
EP0809408A1 (en) * 1996-05-24 1997-11-26 THOMSON multimedia Special effects camera
FR2749116A1 (en) * 1996-05-24 1997-11-28 Thomson Multimedia Sa CAMERA WITH SPECIAL EFFECTS
US6124887A (en) * 1996-05-24 2000-09-26 Thomson Licensing S.A. Specal effects camera and system including such a camera
GB2320638B (en) * 1996-12-20 1999-06-16 Eastman Kodak Co A photographic system using chroma-key processing
GB2320638A (en) * 1996-12-20 1998-06-24 Eastman Kodak Co Photographic system using chroma-key processing
US6021210A (en) * 1997-12-01 2000-02-01 Sensar, Inc. Image subtraction to remove ambient illumination
WO1999029102A1 (en) * 1997-12-01 1999-06-10 Sensar, Inc. Image subtraction to remove ambient illumination
GB2341507A (en) * 1998-06-24 2000-03-15 Alan William Robinson Removing shadows from television signals
US6545742B2 (en) 1999-03-16 2003-04-08 O'hagan Paul Allan Peter Lighting systems
EP1298584A2 (en) * 2001-10-01 2003-04-02 L'oreal Method and apparatus to capture and analyze an image of a human body part
EP1298584A3 (en) * 2001-10-01 2005-01-12 L'oreal Method and apparatus to capture and analyze an image of a human body part
WO2003030526A1 (en) * 2001-10-03 2003-04-10 Koninklijke Philips Electronics N.V. Method and system for detecting and selecting foreground objects
US7912285B2 (en) 2004-08-16 2011-03-22 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images with differential exposure calculations
US8175385B2 (en) 2004-08-16 2012-05-08 DigitalOptics Corporation Europe Limited Foreground/background segmentation in digital images with differential exposure calculations
US8170350B2 (en) 2004-08-16 2012-05-01 DigitalOptics Corporation Europe Limited Foreground/background segmentation in digital images
US7957597B2 (en) 2004-08-16 2011-06-07 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images
US7974467B2 (en) 2005-03-10 2011-07-05 Fujifilm Corporation Image-taking system
EP1909493A1 (en) * 2005-03-10 2008-04-09 FUJIFILM Corporation Photographing system
EP1909493A4 (en) * 2005-03-10 2010-01-13 Fujifilm Corp Photographing system
EP1858255A4 (en) * 2005-03-10 2010-01-13 Fujifilm Corp Background replacement device, background replacement program, and background replacement method
US7835571B2 (en) 2005-03-10 2010-11-16 Fujifilm Corporation Background replacing apparatus, background replacing program, and background replacing method
EP1858255A1 (en) * 2005-03-10 2007-11-21 Fuji Photo Film Co., Ltd. Background replacement device, background replacement program, and background replacement method
WO2007073781A1 (en) * 2005-12-27 2007-07-05 Fotonation Vision Limited Digital image acquisition system with portrait mode
US8593542B2 (en) 2005-12-27 2013-11-26 DigitalOptics Corporation Europe Limited Foreground/background separation using reference images
US8212897B2 (en) 2005-12-27 2012-07-03 DigitalOptics Corporation Europe Limited Digital image acquisition system with portrait mode
US7679786B2 (en) 2006-09-06 2010-03-16 Eastman Kodak Company Color correction method
DE102006046395B4 (en) * 2006-09-24 2008-10-23 Kai Baumann Mini-Studio for the creation of biometric digital passport photos
US8134576B2 (en) 2007-04-03 2012-03-13 Lifetouch Inc. Method and apparatus for background replacement in still photographs
EP3099060A1 (en) * 2007-04-03 2016-11-30 Lifetouch Inc. Method and apparatus for background replacement in still photographs
WO2008124263A1 (en) * 2007-04-03 2008-10-16 Lifetouch Inc. Method and apparatus for background replacement in still photographs
US8319797B2 (en) 2007-04-03 2012-11-27 Lifetouch Inc. Method and apparatus for background replacement in still photographs
US7834894B2 (en) 2007-04-03 2010-11-16 Lifetouch Inc. Method and apparatus for background replacement in still photographs
DE102008031697A1 (en) * 2008-07-04 2010-01-07 Bayerische Motoren Werke Aktiengesellschaft Object identification i.e. person's biometric identification, device for e.g. motor vehicle, has evaluation unit arranged in operating mode to analyze and close contour with respect to course of contour based on existence of object
DE102008031697B4 (en) 2008-07-04 2023-08-24 Bayerische Motoren Werke Aktiengesellschaft Device and method for object identification
WO2010049578A1 (en) * 2008-10-28 2010-05-06 Mika Daniel Letonsaari Video processing
US8498453B1 (en) 2009-09-30 2013-07-30 Lifetouch, Inc. Evaluating digital images using head points
US9058535B2 (en) 2011-04-05 2015-06-16 Franck Guigan Security barcode
US20140232838A1 (en) * 2011-07-08 2014-08-21 Visual Retailing Holding B.V. Imaging apparatus and controller for photographing products
US9729780B2 (en) * 2011-07-08 2017-08-08 Visual Retailing Holding B.V. Imaging apparatus and controller for photographing products
US10410411B2 (en) 2012-01-17 2019-09-10 Leap Motion, Inc. Systems and methods of object shape and position determination in three-dimensional (3D) space
US10366308B2 (en) 2012-01-17 2019-07-30 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US11782516B2 (en) 2012-01-17 2023-10-10 Ultrahaptics IP Two Limited Differentiating a detected object from a background using a gaussian brightness falloff pattern
US8693731B2 (en) 2012-01-17 2014-04-08 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging
US9436998B2 (en) 2012-01-17 2016-09-06 Leap Motion, Inc. Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections
US11720180B2 (en) 2012-01-17 2023-08-08 Ultrahaptics IP Two Limited Systems and methods for machine control
US9495613B2 (en) 2012-01-17 2016-11-15 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging using formed difference images
US9070019B2 (en) 2012-01-17 2015-06-30 Leap Motion, Inc. Systems and methods for capturing motion in three-dimensional space
US11308711B2 (en) 2012-01-17 2022-04-19 Ultrahaptics IP Two Limited Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9626591B2 (en) 2012-01-17 2017-04-18 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging
US10767982B2 (en) 2012-01-17 2020-09-08 Ultrahaptics IP Two Limited Systems and methods of locating a control object appendage in three dimensional (3D) space
US9652668B2 (en) 2012-01-17 2017-05-16 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US10699155B2 (en) 2012-01-17 2020-06-30 Ultrahaptics IP Two Limited Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9672441B2 (en) 2012-01-17 2017-06-06 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9679215B2 (en) 2012-01-17 2017-06-13 Leap Motion, Inc. Systems and methods for machine control
US9697643B2 (en) 2012-01-17 2017-07-04 Leap Motion, Inc. Systems and methods of object shape and position determination in three-dimensional (3D) space
US10691219B2 (en) 2012-01-17 2020-06-23 Ultrahaptics IP Two Limited Systems and methods for machine control
US10565784B2 (en) 2012-01-17 2020-02-18 Ultrahaptics IP Two Limited Systems and methods for authenticating a user according to a hand of the user moving in a three-dimensional (3D) space
US9741136B2 (en) 2012-01-17 2017-08-22 Leap Motion, Inc. Systems and methods of object shape and position determination in three-dimensional (3D) space
US9767345B2 (en) 2012-01-17 2017-09-19 Leap Motion, Inc. Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections
US9778752B2 (en) 2012-01-17 2017-10-03 Leap Motion, Inc. Systems and methods for machine control
US9153028B2 (en) 2012-01-17 2015-10-06 Leap Motion, Inc. Systems and methods for capturing motion in three-dimensional space
US9934580B2 (en) 2012-01-17 2018-04-03 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9945660B2 (en) 2012-01-17 2018-04-17 Leap Motion, Inc. Systems and methods of locating a control object appendage in three dimensional (3D) space
US20150036898A1 (en) * 2012-02-23 2015-02-05 Thales Station for acquiring biometric and biographic data
US9659206B2 (en) * 2012-02-23 2017-05-23 Thales Station for acquiring biometric and biographic data
US9285893B2 (en) 2012-11-08 2016-03-15 Leap Motion, Inc. Object detection and tracking with variable-field illumination devices
US10609285B2 (en) 2013-01-07 2020-03-31 Ultrahaptics IP Two Limited Power consumption in motion-capture systems
US9465461B2 (en) 2013-01-08 2016-10-11 Leap Motion, Inc. Object detection and tracking with audio and optical signals
US10097754B2 (en) 2013-01-08 2018-10-09 Leap Motion, Inc. Power consumption in motion-capture systems with audio and optical signals
US9626015B2 (en) 2013-01-08 2017-04-18 Leap Motion, Inc. Power consumption in motion-capture systems with audio and optical signals
US11353962B2 (en) 2013-01-15 2022-06-07 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US11874970B2 (en) 2013-01-15 2024-01-16 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US11740705B2 (en) 2013-01-15 2023-08-29 Ultrahaptics IP Two Limited Method and system for controlling a machine according to a characteristic of a control object
US10739862B2 (en) 2013-01-15 2020-08-11 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US9702977B2 (en) 2013-03-15 2017-07-11 Leap Motion, Inc. Determining positional information of an object in space
US11693115B2 (en) 2013-03-15 2023-07-04 Ultrahaptics IP Two Limited Determining positional information of an object in space
US10585193B2 (en) 2013-03-15 2020-03-10 Ultrahaptics IP Two Limited Determining positional information of an object in space
US9916009B2 (en) 2013-04-26 2018-03-13 Leap Motion, Inc. Non-tactile interface systems and methods
US10452151B2 (en) 2013-04-26 2019-10-22 Ultrahaptics IP Two Limited Non-tactile interface systems and methods
US11099653B2 (en) 2013-04-26 2021-08-24 Ultrahaptics IP Two Limited Machine responsiveness to dynamic user movements and gestures
US11776208B2 (en) 2013-08-29 2023-10-03 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US11282273B2 (en) 2013-08-29 2022-03-22 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US10846942B1 (en) 2013-08-29 2020-11-24 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US11461966B1 (en) 2013-08-29 2022-10-04 Ultrahaptics IP Two Limited Determining spans and span lengths of a control object in a free space gesture control environment
US11775033B2 (en) 2013-10-03 2023-10-03 Ultrahaptics IP Two Limited Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation
EP2860582A1 (en) * 2013-10-14 2015-04-15 Photo-Me International Plc System for acquiring photographic portraits
US9366944B2 (en) 2013-10-14 2016-06-14 Photo-Me International Plc Installation for the acquisition of photographic portraits
US11868687B2 (en) 2013-10-31 2024-01-09 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US9613262B2 (en) 2014-01-15 2017-04-04 Leap Motion, Inc. Object detection and tracking for providing a virtual device experience
US11778159B2 (en) 2014-08-08 2023-10-03 Ultrahaptics IP Two Limited Augmented reality with motion sensing
EP4184456A1 (en) * 2021-11-23 2023-05-24 Bundesdruckerei GmbH Method and device for determining a digital biometric template for a security document and method for personalizing a security document

Also Published As

Publication number Publication date
AU6577194A (en) 1994-11-21

Similar Documents

Publication Publication Date Title
WO1994026057A1 (en) Background separation for still and moving images
US3778541A (en) System for analyzing multicolored scenes
US5923380A (en) Method for replacing the background of an image
US5335292A (en) Document processing system and method
US3835245A (en) Information modification in image analysis systems employing line scanning
US5369463A (en) Apparatus for recording position information of principal image and method of detecting principal image
US5050984A (en) Method for colorizing footage
US5767945A (en) Methods of changing the visibility of some characteristic or information to be included in a hard copy of a recorded image
EP0758515A1 (en) Improved chromakeying system
JPS62189456A (en) Main picture detection method and photographic printing exposure decision method employing said detection
JPS62189457A (en) Main picture detection method and photographic printing exposure decision method employing said detection
CA2409224C (en) Image recording for a document generation system
JPH0437383A (en) Method and apparatus for picture synthesis
AU709844B2 (en) Method for replacing the background of an image
JPH09212620A (en) Manufacture of face image
JP2007114233A (en) Photographing method and device
JPH05120417A (en) Color adjusting and picture synthesizing method and device for color picture
CA1332192C (en) Method for colorizing footage
GB2253319A (en) Photographic printing apparatus
JP2001197352A (en) Main object extracting method
JP2002218498A (en) Background separation system
JP2006059162A (en) Tooth image correction method and device
JPH04347778A (en) Video photograph printing device
WO2000079779A2 (en) System and method for differentiating between image foreground and background in an image based on an invisible keying signal
JPH0667320A (en) Method for extracting data of person's face and method for determining exposure

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AT AU BB BG BR BY CA CH CN CZ DE DK ES FI GB GE HU JP KG KP KR KZ LK LU LV MD MG MN MW NL NO NZ PL PT RO RU SD SE SK TJ TT UA US UZ VN

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA