CA2732767A1 - Interactive device and method for use - Google Patents
Interactive device and method for use Download PDFInfo
- Publication number
- CA2732767A1 CA2732767A1 CA2732767A CA2732767A CA2732767A1 CA 2732767 A1 CA2732767 A1 CA 2732767A1 CA 2732767 A CA2732767 A CA 2732767A CA 2732767 A CA2732767 A CA 2732767A CA 2732767 A1 CA2732767 A1 CA 2732767A1
- Authority
- CA
- Canada
- Prior art keywords
- infrared
- space
- images
- interaction space
- transparent panel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0428—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The interactive device comprises image capture means, at least one interaction space (3) and means for producing an infrared luminous beam (4), comprising at least one luminous source emitting in the near infrared, which means are oriented towards the interaction space (3). The capture means comprise at least two infrared cameras (IR1, IR2) covering said interaction space (3), a peripheral camera covering the interaction space (3) encompassed in an exterior environment (7).
The device furthermore comprises a transparent panel (6) delimiting on the one hand the interaction space (3) included in the exterior environment (7) and on the other hand an internal space (8) in which are disposed the luminous source and the capture means. It comprises at least one support element (10) bearing said luminous source and/or the infrared cameras (IR1, IR2) and at least one partly reflecting complementary element (11), the support element (10) and the complementary element (11) being separated by the transparent panel (6).
The device furthermore comprises a transparent panel (6) delimiting on the one hand the interaction space (3) included in the exterior environment (7) and on the other hand an internal space (8) in which are disposed the luminous source and the capture means. It comprises at least one support element (10) bearing said luminous source and/or the infrared cameras (IR1, IR2) and at least one partly reflecting complementary element (11), the support element (10) and the complementary element (11) being separated by the transparent panel (6).
Description
The invention f!c_Ci5ci to an , comprising aiin:3r 9e 'R. uEe ~1 it. Ace -~ ~'-means, at 02M =_7d c', Mac-d-_31, pad, (?c. !d:`.'"ii, for producing an infrared L
I ''.ti; .. one 'Sght beam directed r t~,~F,t3d tj the ~ ?f l -.:~Act.Par i i a:;,~~ at hat we e~ ~f ~7~t/ c. and >~~.~~~ i t .t ;iji,i ar_, .. ~rV,.sttigt in the f r igt.Yi,e, said t"';i.,.~t_ii, "i~
means comprising a.t 'asst "N f..' infrared ?..'i,. . ~ c er ng said in ? . .?c_ion ace, said capture. dlie xi.a being connected to a, i;) y sing circuit, said device r ~ f" =,tfdsj on 1-3t cm prising a transparent panel d:' :,i ~. a ti',~' 's. tai cfion space ins laded in an external envoon en't end on 'ii e other hand en ii 'l rnal ;(3^.(51 in ,hi+.. ~f"l 1 ! irl+r M ht source ;?s f f;3p af] d,,.~ "~3.d"i5 are ~`.i? is:;i ~!j t~,, s, -~ilA
tV~;
~ Y- m h s . friv~ a pi,d,,?S?eia.i t~_3 fa:~'~? for capturing napes r',ca;7t.?u`! means c.)~;fs.~ Y
(=.,"~. i . the visibl~ range.
eleipre ~..., '.j' Slt t i.ia of the e .. w .C __ r "~' i;~! a ;nvvi ;So ..ii.
no St. tit the J.-7:i..~l,y%
I ''.ti; .. one 'Sght beam directed r t~,~F,t3d tj the ~ ?f l -.:~Act.Par i i a:;,~~ at hat we e~ ~f ~7~t/ c. and >~~.~~~ i t .t ;iji,i ar_, .. ~rV,.sttigt in the f r igt.Yi,e, said t"';i.,.~t_ii, "i~
means comprising a.t 'asst "N f..' infrared ?..'i,. . ~ c er ng said in ? . .?c_ion ace, said capture. dlie xi.a being connected to a, i;) y sing circuit, said device r ~ f" =,tfdsj on 1-3t cm prising a transparent panel d:' :,i ~. a ti',~' 's. tai cfion space ins laded in an external envoon en't end on 'ii e other hand en ii 'l rnal ;(3^.(51 in ,hi+.. ~f"l 1 ! irl+r M ht source ;?s f f;3p af] d,,.~ "~3.d"i5 are ~`.i? is:;i ~!j t~,, s, -~ilA
tV~;
~ Y- m h s . friv~ a pi,d,,?S?eia.i t~_3 fa:~'~? for capturing napes r',ca;7t.?u`! means c.)~;fs.~ Y
(=.,"~. i . the visibl~ range.
eleipre ~..., '.j' Slt t i.ia of the e .. w .C __ r "~' i;~! a ;nvvi ;So ..ii.
no St. tit the J.-7:i..~l,y%
2 The document US-A-2006/0036944 * an. it i c~ The i~E?;~C,;-.).1;, a interactive ~: ~eIiCe, MUM st4~to in d~ i~ dg w cor,; 't"~~risid~l~, j at least t lvr~ ir~lra+.~r- re ; t;atnvrw..~ s f ;~-~I and d:2 i!~ ~ a ,.c q air (' to ll.7 ~d''7. t^l s a rear Ud..drd, c of ,. n interactive transparent film i actin, g as a screen onto which images are project d by means, a vide projector 2. A
user can interact with interactive film 1 by touching the later or by rocking movements at a ma31 distance i om I 'MG film. Although the (13-vice described can dstofmine the alt"lfi of a hand or {i fingors, if _.5_~1 rat fingers oricnds .~ i, i h `'''`
art; in L;CI. i li,,T? i2. ' s,- of able, t: dr:, " '3er the the nt .cGt =rit(: the ,; device ,a,Gc- ! e!iillr?~ 1~J!let.c:
fing is belong t{_. the same hand or ME n,h,,io '.' are contact i`tt h the sutfaco, Nor is the devil :e case to 4 i `1( i~ ? ri?+ co 1text, i.`'. to diaterr, line whether these two hands bohng to the same !mar or to several users and to adopt die inter =cction to T "; fist".f ce of f lt~c_. ie s ._ vlurnent de he t;
./~_i~ ! a.t3.:~~1JõtJ=3~5 J..~ .~s,.,U.,e i7 a pointing (.kõ ,vi icr' 11(3f an `i Y~; 3 ~ c ~i!.i. <.ccr~ a camera surface. The deice t;rtvri, c1 ', at each ' of it., t: G xo 'os -'s toy) edges. Ye]'`v. The r r, v+ ~T ' a _r:~(} (ii'l..a surface c, of the .. ~t~s~~ oy) ., e c=~. .1: Ca~!,v su r t10 eon forming the interactive _C!('.i e ?iiti are concocted to a processor ati!a hand or ~ a pen 7 or 3 the plane Tt)fi`( ,~t~ to hif;~.p~'s:1.:l,e the t e t:sd7}i~i':in'7 of a f?c:fiit., b .~y the +' irlt~lc:4~,i ~i~. e surface fro, 3s es c pturi~.~ by the ~ The hcat'3'?, eras.
'rif?e w~_i !.dl~ t ,e of the interactive surface :~ illuminated by situated .,10S, j to the A f tlry -e ~
Cc?! ~ i.fc v. F o optimize operation of t ! . i f) day" gi)l, the area is corresponding to the .. pl ,/ surface is surrounded by a strip reflecting inf, a aed rays. Aikcuign die device can p rc,)iva i ova rent of a hand at to, level of the interactive -i_iriac> in the case where fingers of hands J da.>...,,.:~r corresponding to seven-al users are in contact With this Jt.i 7c ce, J the }lC
JL, =.1:"i essX
is not able to d tetri-Jrie `a hethe. the ing` belong to several users or to one 20 and c - e !' n A '' õ ~!ri !
20 ca ti :] , ~..af,., [~c,::~~i, The +~3uJ; . e r.e!Cftrc; not ~C1~;t,!~., for large interactive tl ~ ;` far to be u, red Uy ? plt;, akty Persons.
~ t -h_ document 502006136696 A c: yc,f ._ s e an .. ei[wit?x MY ga !e bar I~OVb?;~ri~Ir'1C~j" ~I=~f]t g~
emitting diedes and cameras directed so as to cover an interaction space.
25 When such a bar A used in a show, win w, it has to be arranged outside the means that a hole has to be made in the show-window to connect ti e ' ar to computer pc ( 'ssing or $ e cnoams (p: vet Supply, Furthermore, h,., bar t.Ã Rl in x the t~h%t~,CJL, i de means that the latter can easily be vandaliz d.
3i None of the d :vices of the p!`L wt atebia th s in.ar zction to be adapted :s i + sta ice' '' sC and/or of the visual context in the is ord .y 1o the alul r of ii?t li _ ~~ i':a vicinity o; the surface.
S
The i.. object of the invention is to ,i~ provide a !device that is to ~ ..ta3 il c.i easy inst an d ~ c{
t 's : e to be used or, tIlyf,, s ~~~ set or in a pub3lic area by y 31i=., more users is clC) .., tr _~
and i at is not liable to be Vand.,ali d or a i. r1.
by tr~~r. ,i~:,iit.p a- ~-;e r.,c, c~3~liiri,> '.rli~ in i:~c31`titJ.a= by the fact This object is achieved a-' i that the chvice comprises at least ore po t element supporting said light source, and or the infrared carp eras and at least one partially reflecting a5 t:o!f'aie1f?5 titaiy e e3i-i"lE'=!'t, supp;t.rt and Co ,p!ei;i.,:li lr,f a.ffent being sear _itf l by the t ransparerlt pans..-e!.
_'..''le i i`i rlti ri also relates to a ii t,;rla for using the devi `' comprising d repetitive cycle i ~ s iv ly compri;s?rlg:
- an acqui ition step of infrared images by h a infrared cameras and of im ages irl the visiv e r ai'i g `A i ph ei c.
- processing of the acquired images, - mnmgintg of the infrared and 'J siblo images to g ner"ale an image representative of the e aierrlal e lvironment, - backing of the users situated in the eater ?al environment, r 1, w U d `t;mot t; the 30 Other advantages and features, + wiii Deco no more clearly apparent from the f oilowing description of particular embodiments of the invention given for non-ms rict3 i onampie purposes rte`, fit and Pipmented in the appended drawings, in WIN
F i i~p+.!. t; 1 ., l ,rater i,L!-J., Ua`õt... _.+., õi (= - to the prior out.
! i -! 1 re 2 qtr es an ~t -! to , ~, .:f.l!
t:3,i1,( vi i +Ll.r.o.l!'..,.: an t.r_,Y(_, )C U ca +,:.it c"i embot71,'3 eni Cif the invention.
ii iJ' 4 *) _end 4 iili,_t ,:.,., an interactive Cõ , ce according io a second z pa.rticufar ..-I: odimen. .j in front iew an 1 in, top view.
user can interact with interactive film 1 by touching the later or by rocking movements at a ma31 distance i om I 'MG film. Although the (13-vice described can dstofmine the alt"lfi of a hand or {i fingors, if _.5_~1 rat fingers oricnds .~ i, i h `'''`
art; in L;CI. i li,,T? i2. ' s,- of able, t: dr:, " '3er the the nt .cGt =rit(: the ,; device ,a,Gc- ! e!iillr?~ 1~J!let.c:
fing is belong t{_. the same hand or ME n,h,,io '.' are contact i`tt h the sutfaco, Nor is the devil :e case to 4 i `1( i~ ? ri?+ co 1text, i.`'. to diaterr, line whether these two hands bohng to the same !mar or to several users and to adopt die inter =cction to T "; fist".f ce of f lt~c_. ie s ._ vlurnent de he t;
./~_i~ ! a.t3.:~~1JõtJ=3~5 J..~ .~s,.,U.,e i7 a pointing (.kõ ,vi icr' 11(3f an `i Y~; 3 ~ c ~i!.i. <.ccr~ a camera surface. The deice t;rtvri, c1 ', at each ' of it., t: G xo 'os -'s toy) edges. Ye]'`v. The r r, v+ ~T ' a _r:~(} (ii'l..a surface c, of the .. ~t~s~~ oy) ., e c=~. .1: Ca~!,v su r t10 eon forming the interactive _C!('.i e ?iiti are concocted to a processor ati!a hand or ~ a pen 7 or 3 the plane Tt)fi`( ,~t~ to hif;~.p~'s:1.:l,e the t e t:sd7}i~i':in'7 of a f?c:fiit., b .~y the +' irlt~lc:4~,i ~i~. e surface fro, 3s es c pturi~.~ by the ~ The hcat'3'?, eras.
'rif?e w~_i !.dl~ t ,e of the interactive surface :~ illuminated by situated .,10S, j to the A f tlry -e ~
Cc?! ~ i.fc v. F o optimize operation of t ! . i f) day" gi)l, the area is corresponding to the .. pl ,/ surface is surrounded by a strip reflecting inf, a aed rays. Aikcuign die device can p rc,)iva i ova rent of a hand at to, level of the interactive -i_iriac> in the case where fingers of hands J da.>...,,.:~r corresponding to seven-al users are in contact With this Jt.i 7c ce, J the }lC
JL, =.1:"i essX
is not able to d tetri-Jrie `a hethe. the ing` belong to several users or to one 20 and c - e !' n A '' õ ~!ri !
20 ca ti :] , ~..af,., [~c,::~~i, The +~3uJ; . e r.e!Cftrc; not ~C1~;t,!~., for large interactive tl ~ ;` far to be u, red Uy ? plt;, akty Persons.
~ t -h_ document 502006136696 A c: yc,f ._ s e an .. ei[wit?x MY ga !e bar I~OVb?;~ri~Ir'1C~j" ~I=~f]t g~
emitting diedes and cameras directed so as to cover an interaction space.
25 When such a bar A used in a show, win w, it has to be arranged outside the means that a hole has to be made in the show-window to connect ti e ' ar to computer pc ( 'ssing or $ e cnoams (p: vet Supply, Furthermore, h,., bar t.Ã Rl in x the t~h%t~,CJL, i de means that the latter can easily be vandaliz d.
3i None of the d :vices of the p!`L wt atebia th s in.ar zction to be adapted :s i + sta ice' '' sC and/or of the visual context in the is ord .y 1o the alul r of ii?t li _ ~~ i':a vicinity o; the surface.
S
The i.. object of the invention is to ,i~ provide a !device that is to ~ ..ta3 il c.i easy inst an d ~ c{
t 's : e to be used or, tIlyf,, s ~~~ set or in a pub3lic area by y 31i=., more users is clC) .., tr _~
and i at is not liable to be Vand.,ali d or a i. r1.
by tr~~r. ,i~:,iit.p a- ~-;e r.,c, c~3~liiri,> '.rli~ in i:~c31`titJ.a= by the fact This object is achieved a-' i that the chvice comprises at least ore po t element supporting said light source, and or the infrared carp eras and at least one partially reflecting a5 t:o!f'aie1f?5 titaiy e e3i-i"lE'=!'t, supp;t.rt and Co ,p!ei;i.,:li lr,f a.ffent being sear _itf l by the t ransparerlt pans..-e!.
_'..''le i i`i rlti ri also relates to a ii t,;rla for using the devi `' comprising d repetitive cycle i ~ s iv ly compri;s?rlg:
- an acqui ition step of infrared images by h a infrared cameras and of im ages irl the visiv e r ai'i g `A i ph ei c.
- processing of the acquired images, - mnmgintg of the infrared and 'J siblo images to g ner"ale an image representative of the e aierrlal e lvironment, - backing of the users situated in the eater ?al environment, r 1, w U d `t;mot t; the 30 Other advantages and features, + wiii Deco no more clearly apparent from the f oilowing description of particular embodiments of the invention given for non-ms rict3 i onampie purposes rte`, fit and Pipmented in the appended drawings, in WIN
F i i~p+.!. t; 1 ., l ,rater i,L!-J., Ua`õt... _.+., õi (= - to the prior out.
! i -! 1 re 2 qtr es an ~t -! to , ~, .:f.l!
t:3,i1,( vi i +Ll.r.o.l!'..,.: an t.r_,Y(_, )C U ca +,:.it c"i embot71,'3 eni Cif the invention.
ii iJ' 4 *) _end 4 iili,_t ,:.,., an interactive Cõ , ce according io a second z pa.rticufar ..-I: odimen. .j in front iew an 1 in, top view.
3"I,Ju.'o 5 idus'zr its a c . . 'wi't bar used in We device 3i.. -.;f t inC to figures 3 and 4 in g ea=~ev det il, in, front via""v.
l-.', ui o, ] f ep .;::7 rats a c,[.4:7mecib+l_li , iew - ion j the in A-,-1 of iii.) drjvica -9 Qi.)is 4.
-w a 7 an !(s 7 l.i"iii of use 0f _. 7 J
/ y 1s according to ttry 1 iava !don.
7 u;-1ur1es 8 and 9 1 ,;-i a F e fJ.C,'a.:: ssin 3( F4 of the -f'1'< ges of the aigoi itifm of iii ju( 7 in greater s~l we i , iiiustratsa the for- _r iii) /E_iri f~~`.,~~ii ~ if3~ ~~f lf1,_jf-Lc+_tion stop _i9 of 2 7"igur I 1 i .,scars a s~1?.,t: ({.)f_IIIC:,~i ~~~~iJ9f'1_1.1)Ca seg nv131.ation i ,earning 0t' ori"1i`i-Y1.
1-7 C, .. 12 ifiusti ~1 jft imetr .?t7 of the 'ilk i=thm I figure 7 in greater dstail.
!i_jf;. i e i,3 idust- at s the, Pr= .3P"flo slTj/ ;~ the ..,' at he of ()g i v r'.1~.~.. -"af7) ~u 7 in i Cli; c`ter `: teii.
O ..= 3 psioe of i is d X1 en , )die, 4. f) According to a IN { embodiment illustrated in figure 2, thee interactive device.
1Ji er .n display s_ fei`~f)k.' ~i for excifi ,~.ii by 3 +i_l a ( sv ~ ~i"'=~e IT1eai i~ -~ii 1~~+'? .i hilt or ~ 11 li-.e .a~r ar _par< t i _d+ d ing ,. m 1 ?ding and J(,a'+~ ;a 's . + 'C. d'al .r directed towards film rm 1 and ovarm meto rin yi .3~9~'fC,~;i,1-~ i (:l"0 1i i7i. tin;ce c ii.,ll sc:,t',s at iJ. :'ca. .;J aC;? 3 ?iluminate d by f 0i' producing directed lo'' artds b.
this S `A Nat is iT ' t a vos it ~..~, , J, f?1c~t_.t:~s=io~ ~,J aG ~c is ~ .ll~~;` ,"ti which a user ii can i'''te /act. The ce sefoi jl~t_ u irlij t',c' i i t beam co;impri.sr:
at least one light source 4 /m ith g in ,.ho nna in framd reaps, for a ample with between ON i and 1GODow t,. ac Vf, aIvi+;t, also o f>;?I-(Jri Sari~ lst t .a by at t sw1:31 t t': o ijS~, `~ irfla t:,g.,3 Cot~~~.trr,drO sic Deli .Iftl~., .
in infrared 3 #"+i i and do ~) lt , Each the 3 cam } 1 '3 met. J 9I ~. infrared erw s is directed `h e ~ vOl ,d_d towards it . racoon space 3 so as to cover ii I' whole of the I se corresponding to this space car?;: to laetect obje . iS located' in this space.
in -a e ,. d1 ,s : _ are, '1 - n. and i 1JcGnr?c.c,ted i m a fl it .~t~ ark ~ ma ia;` yt;8~ic~Sl i~ir.ril.t J
Itself cor nectadiin the vide. to di play, for s ..a+ pie 15 when infrared cam eras H H! .. n if-e. rnovc mi1en of an object in WNW = space ._.
As in figure e.. "` :3, liar, interactive do ./ic,., t'.,rthr r a i?1??uti ru_L. Ci the ?:ranspar:;nt panel t.', delinoa; nee intela.. ion space 3 included in an external 20 environment 7 an .he one hand and an in emal q )ace 3 _ n lice other hand.
The display moan tr`ran i it rent film I and viddno projector 2), inf l ar ic:l light source 'r, 'lx?('d z1'11.11'e .'(?_3~=!ra3 ,,~s!fiir a infrared cameras aFRI
and and peripheral earners 9 are, all ,,.(rang d in all it l= n ni space 8.
Peripheral camera i; is d erI(i ed for r' c~. ea of ,9, l._,_.~ iii ?.: i,a r<..mlty : ~.
le and Ta directed . >~ aute~re 25 in such a w y to cover a 4oRnn rap escn.c d.a vsi environment , e Ciarri `i ~ 1 7 (. r r_Lken lino in ,gu. a 2), this per lpi sei al c amei -a 9 is l s connected to [h..-) disphy means he de's ice Ather t . a ~sd<;ment 10 supporting the i'm_dr dt source and/or Hawed _am ra_s i f3 1, 012. Ws is support element 1 is designed to .JA 1i,,- d near c ar` n ' i-.a it panel 6 in internal f-, en space S. tSuppi. rt alremm;nt -10 is prefea~" l; t resin J on ra 1 par enttt pane. 6.
lid configuration is rendered optimal by J t ha, use G A at least one partially Ylp't=r`sl`'(3ia(`'~ Ie(?l'rti 11 (not shov'i' in, f, + Y 1 2), +rl a...,~ ~
i `olemeni af. and support ekemer 10 then being s.__ ,,.t!ated by ttl t(I^
~I_ii.
panel 6. The rCflecting part of the (mot?,r. i 9 '~i.'st in-1 <IUt h y vii ,m" ~rit -f'~~(,',.,' Ie. ; llC;,,t source 4 and/or ;n l+ õd t_c:.(.-3.- t .(-- ' ct I 'r e._r ys 11`11 , ?~. ._... n+.J_..~+7 Wit) as to 1..t~...
.., inter_ ctio space 3.
'~~l1;~~.1c.. .1,' . fi~ i?``_l in rl. l +'l ..c9 ~ r, i(i~ .+ ! ' ..1(rt'.(~!?~ Wer ~ spaco . :j is prerably located An immediate proximi y to pane] 6 or :von stuck directly on the Mr.
1l .3 !c",i'riCTit.l`ls;JciGti:f'~ +~ .'1(irl~:',5 a ~1LY..r;f: in ',j/II:;~1 the user can inter-ac! tfjlt(1 a:l;~v t itplay perfor mei_1 by W; display .a _ It is t 7 ', eby/ b possible I s s;f i s r I 7_ r1 a, 1 OCjX tilt, display by means of ones hands, fingers i ;r any 1 , l ~ c r; _el r!~ object e ~,Ci (~~ rolled-up rl',Aspaper for x:. mp+l) in toe same way as P is to _ . e do 16 cu ,v. rltioe of computer oaeen by mans of a r1iCJuse. Interaction L--pace tit robv act's as user inter uc , the i1 oveimler i s of 'tile user in this space being delt dad by in m;. -d 3 H711 and !-R2 and then interpreted by processing circuit 5 to re ?; _ .rite a user feedback on the di play t.
eans according to the movement rnMe Thus, when a user st_ nd1 in rant of interaction space 3 at a personci rote .... on deist fake de ermined by adjustment o'if the infrared r g to t1 he `
di nfc't`; :1i iti iii, apt I of the ir'il fr.;i 'rJ
spaces, the osit.cn of s i. /her ;,awdis, or of the object tie/she is hobling is eArnate l cy dote stroll, onabJ `ng Ium; ar to 3 ,JV nlar'a't vf}ih :~ .
interaction space 3 s.Ut i+ yin ei=i~
'_".- is and/or h by ~'31r~f~i he m i)V ~,nit:~behavior of ih.isOier hany.-Is or fingers.
/idea projector 2 of device' of figure 2 i;>> preferably equipped 'x ith a l_-and-Stop filter ,il the infrared fs.l li(ii-ing disturbances of an s ,I {_, -, .1 - (" t' t- a{ r captured hy the infrared tc::amera. .
f It is pref l t.b.Ir' o? trC i 7f w`.i ii. Wn: i and U...+ sparest pansi 6 to be My transparent to the in!!r cried "='d ation a elen"gth used by ight source 4 and by ~C'_n ca(-ii,Ya<; ia~`t Pea i i i:::? al fat;" ra 9 is g rate a_- l v pieced at a distance from panel 3 o as to cc .j r a 4.iiiy e x1. )n .,e a... __,rts.al a ni ni Pi a c_'nt_ mode embodiment is:u_t'ea.ted in figures 3 to 6, the Q jay vn ans compose a, ~ v'" I'S placed in inter rte.-l space 8. E,u _=ii a screen is )t>? for ea?, ple a cathode ray t..(i ? e di )ia.', _.>'r, a piasrna opa1,ijU, scree l may imply on he location Of iriiialet_d cam ras Nil and 1R2 and 's of l fi$ 1..,i!?'f o r r,I?ItiiC?r in the near-in ralcd in internal ,:;pace B.
It is war =, i _j. e advantageous for i' _ ht source `; ann/c r it?tr: ar _;l i aI i o a i 1F31 and 1112 to i ; "-'t. spotted by at one sup _)rt e!sn1 ;rit 10 ted i-in inter is, :S ' e %.), for e , "le above Opaque screen 1 5. )tt last '= i s flail y , liei't 1 ;~j cOir1Ji 11.;.n, t=' situ ex#_ar?
t? lef..,'.7,=?i.1 {;- fi is ~~.~.L:; in L)~fl a -onviroa,in- iEt , i 1 is L signed to ii?iral i:ght bears corOng from he igh sf,urc in I?lt i:a ,t.:;i! spat.., 3 and 'to {_ii, ::ct .
t he field o 'f ' `+, 01. an in' l1 = "+ ;" l 3.
As ii ustta. 'i in Howes 4 and 6, iii! rt) merit 10 can be formed by a _ e -_I a.i~;: ~ 1~~. hem ~_ifa .s_ sp ~' {~
_,t T_.i,_p-Yt bar la,. tt 'd to b e posing 1 ai .! the surface of transparent p.,., ~
.":'l r that is towards 'rit.: ri7 cjl space & the ,o!-(ica t,.i.ll be in the 25 form of a ir,i,_.)d strip 12 formed tor example by a u:alit' of ligilh.-orni.ting diod' ,`.i EM Y) 12 is array itj ~'~.! along t()-@; of the support liar P1 transparent , 6. 1 ? .efer .' ly pl; ..:{; at the bottom of an en lo. -ii, in t avity 17 formed in the support bar. Strip 12 is thus not of rang"ed salient viol , p ...i. to th support bar, loihi{ h would `~ pryt~i l/'.i+)}} l .7 t.)~l~ yl.l bar it I~~ 1X4}r1 ,'_l.
:]~) i~ll f.r \Ji-n f ~ ir~
cameras a!"-! i and 77'3: 122 .PL iv ii`~>.d3 set~~ d in at and, rJr{,~e c:'f'~r~ lIf the riJ~i~l~[=. bar, e _. ~() d, of lighted strip i 2.
As illustrated in ii'lui 6; ,.., 37 ple =, .r.._ eisr:ie nl,. -11 can e in, _f rn o .. complementary bar comprising an inci and surf =aced 13 +.aire I.C':'.,1 both l(J~,% rds ti - -_ 6 On ? in . l e C~:iis.t,(;t'~rl - strip 1{?r ata.r ra' ~zd~st~t ri 4 ~ a:: - f il~:,>,-te ,fa 12 2 c"31,~:,d 1 ..<i:_. ,i is ,C
cYdmera (31 and 1 i2, . as ,,._ c:.. towards act ~~ 3 when t7 c ,rdvsti,,..I;.ery bar f; 1(,,)d c,. ,` e external _.,irf ce of f~"nel 6 directed e.,,, i <~;r r !e r is ,i towards C;t7..:rrlal 7. For .,: rc=i1a~i~ i-33"~ii~~3.,ses " in ;rl}ie 6, ~:=.,;~i 6 being vertical, elements 10 and i i on the .. 1' part of he pan`_l and internal space 3 situated on the r) hi of panel 6, SUrISSCC 13 is =dnciined downwards and makes an angle of about 45 with the panel. Inclined surface 13 i comprises re ;3, lecting r7}oan:sI , for ~ex,r~ ,lt)le a r r~;77~;r'C I ;tisg 3 .3f:rfiC:3 . a(tlag as õ> ~, a mirror, to propagate the infrared HQ A to interaction space 3 and/or to direct 15 the ii" Ira; of vision of inn area. cam eras 19M, , i22 in ti its same direct ors so as to cover thie whole of =. it I action space 3=
I lfa support bar and complementary bar %1r.r can a i be .>>;,_ k` t facing ti~
~ one ti~riOt~y =c,l ("ii each Slave: of transparent panel 6 by means of (1==f c. `Ya nt ~f1( magnets (no 20 shown) situated for a.1 of le at each end of each bar, s .ndwidhing transparent panel 3x or more imply b,y n +celon.
He de corn Name. complementary bar c terably co nprkes a protection plate -14 t rc nsparter t to the infrared rad ation consider !, I =;te;t onto a botr i surface .f J of the . orllple.,ne!aõ'ry bar. i when illust ate in figure 3 upoert bar anal ciersrIh!y bar ^~ le of t.rG. ' =p,l~v~~r~,13~ y = panel on r i d 6, an +_I protection pl ate 1 `i = li ...s r ece .,, I ! d..: lin ea, 'rncl rieLi, sur ace 13 and n P { ri-e,ra +,~ ~l of pa(it~! 6. in -' i way rr.~'i r l~. c can Ws and 1(d_, iage i; ~-~el!
a yJ J this 'J ,~li,l'ilL.i i-~
in this r.cess and di tL b Correct operation of the interactive d' ice. in, .30 an !alion 1,vitihdouI r tt tion , l '(~ 14, ! e ' I
~ d 1 have if'iC,li;c.,(",s,~fr~?C_, 13 1, '~(~ ai I3.7'!u to be Si and ler~r.:flirl.. / would be e {~Iai,Cl p,.iat on E~zctõ? -.,L;='laf t of l ha d c',c-tl~~~r !.- ~Liar,y :c,t; Ult,if}'; positioning of incfned _stlur oc Its in tsie race, --is, whereas o o'iectioi`l I t ? i =t can be cleaned easily by ,ply using, a rag. Protecon ate 14, is Preferably inclined 15 W h respect to the i orizontai, this ncii tlt enabling mukance reflections in the fi;-;;d of vi io'n of infrared cameras M1 and TO to b eliminated.
(~ lei P y iy )! Y ^~ in '11113- use, ~~ the complementary bar vo llif~J tl 1~~.~111 i~~ to t~ I I
iai~: LS a ~~~J:'i tll?
transparent d' il 6 to !m ? 1 alas for example to .1r(" {iO5>~i[1t; (i L,uii f.
5, the electronic elements heinq s I 'i d in in"ernal space 8.
Fran 3 tar nt panel 6 can for exatnp he formed by a windmov pan,(.' of commercial commercial premises, a glass t~.'=, sheet "' % bin ' op, ora sof glass placed on the I
a 3'J if1 t_shind which a to chnical enclosure is located delineating the internal space of the device.
The embodiments described above present the advantage of protecting t e elements sen.siti` e to theft rui dam ?pia, such as cameras, screen, video tr l i ~1 1'ectei , +,..etc. By transferring their locai ~i. `!1 to (.w SI tt.17 lae.,l I !te'! space, ', they i e . v ! in fact no longer access.bie from a public am.
In generaal 1il~.t ';it, ~ prf~-C5" ie a1v l d C~iTi~.,e 1R and , ii2 J ., er, the c~ritt,l~~..i1t of ~ lyislf;:i; s`~ ~.1 -i:.
and of peripheral camera 9 in into na l pace-- 8 has, littl importance so long as the infrared cameras are directed in such a way as to cover inkracdon f space 3 and peripheral cam em cover' external environment 1 Direction {ll y r.
23 ~
i7ltr.ai'ad 1[ti, H12 arC/oI 'i'9(1% source 4 is performed by r:{1CC ii;g means able to be based on mirrors formir g the, roflecting part of a;i-nent 1 l Peripheral {;. ;era J r.;:'iOctini a ti t? ON ; dAti4 fz vvt'3 e Cat i in 'he ate visible range makes it nossiNe to ;r1 wy 3itCi' vision and to ans:ly>7O
external enviroment 7. Peripheral camera 9 ii. ':lily completes and enriches t e data horn the in ars[,i -Jir _ji ,13 can sz:, di?f ensioi, .l ;l; 1; }3t~1+fhnrj ,U '.I r1 li'1.(1. ,,.:i( 7. I he ':.,hree_ scam r'e o ..I -d by ip. it possible to A I set , al Wars tiny ,, .im r.g 1:.+; o .~;, cC ion space _ en of t ifl p(. vE>re s +~ Il.a ~!E(~: '~~i by 'ift3 ' i }fr z: _..Y,3~!1 a of i.r;` ,(ErõE',s to the õ.
~ J
~JE);~"~~.~ for uXti.i ir~irt. to ,.>.. - an ':E ~ of interaction :p-,.lue v-]'~
given user this area ~ then the ? cGfi ~. `~ .ftisEt a ln`t~ i to r J : ., of sr ~t the a ' ms - the +U n [,imr:in r Ii tt-u s .
Ac/? ordin to a t.l develop dent, `:,. a a' I S '( l camera, 9 enable s Mead eilvlt=,^jm,n.,r-)t 7 to be dvidena r:iro several sub volumes to classify the persons detected fr the p' 'r.aJ(E,1a ipheral . { .,, in d ~3. if "t l31., i 1 +tegof en,;v ai. =.a ccordii~~~E `'o a.t..a E C~ i 1 f ~1) 1 osha ;n in c-:C r ral eiiv'rC nrn,i-_,nr I. it is in porhoulai . {iss bl to distinguish the -J,iovvinci categories W ;, rs d r v, '')y an id 1~ r . A _' at r i is a f si'il oassi1 li-) in a4 P of tli 3 . i , at a f+,. i a; n? 1 i1 he latter and not pt", a. i g to show 3,, an or parson near the interactive Tice, f.e.
to {/t-:sualisl displayed by the display or placed l.i-.,7 airfa panel 6, A Hs,,s,i is :t dasi,e to iS rr t ;11Ph the interactiv i, 'd,t, Jv i .:Vnoi ( fi7 :.l fi r, io3 i(1 by l phAg his/heer tinge s in For piurposes the voii3if;:' can 1j_',r divided :nitJ , Jii.l'v.ltii i'ds ikaccd -~;,- at a ..iare or ;.-..._)7 large ttis-.,,. iCa t)af.,, .3, can cO(3stuu(eO by -_l (.)a ,r+a',ii. to '=l. Avis a fist v l u ns farthest a-,,;,waj from transparent ... aana ... con s( E..i,ris to an arm for _ .. . r.t i j, aJ~.-~r,.l s fby. if there ?:7 no person present i the vokm newer to panel of the surro!_ -.d gs , it ; l-?.yad. 1 ~._.; v,v, do no especially attract the alts Lion of p sse:i -by pris...ssin 3 in root of the panel, as the alter are too far a" u, A second volume, { +: s r to the indu-iv is a sociaied with close j passe s'.)Y. the, presence of a los.. I a., _, r-by is detected in Wks - oc } tng AM u7 r ! .7 can - 44 , _1+.,1} t~ 4.ity{ _ ,'itr ~
...; l,tSrld7 ~{.liii -'~ r ce7..n:
~?, ~~, t~.., ti. ..sir 9 ..,:.4.13.. t. : t ~ d.,i the or !i! or for axaIn IS to MUS6 a re 7 via a loudspeaker to i..._t_! '.E 4c attention ,i, dl?", ara. s;~:~ vsr. ..,, ~sr c3,;}1,., _. ,~.
,'~.i.~%1! in a third volume, &;en to trr nsp_{f .panel 6 than the vol(!i-ne, leads p roJ essir g circuit 5 to c n ides persons .,. tent!on be-e,) captured and that r.a/cui , can potentially inter'1ct i ;a õivy f ,f',,rl 3. Prt.csing i,ir( aIt 5 can Won ill?idj! d 'I`3 di lay to '39 ii. _j the r= i=õ aril 'io ;
,rrie on closer ., and f''eCUii"'= a i! <;r. A itJt~rlh volume c[ iit:`s?C;;ds to cliv previous-,!3/ ly'yT;'i~ Q
inter Mn space ft. The person hen becomes a us r, i.?. A person 'caving shown a AM? to interact with t! screen by his/her behaviur and whose hands, fingers or a hold object a( -a located in interaction spat': 3.
{A p~'' se By rye ans of peripheral camera 9, all the ele {`Ient,~ of the d: evict can _~r'C7~ t3,~c, `'r' I.I ~ y 3.1 f .1xt - ' s rs .. riche 1r d~t.i ...?.'LIiJ r' JI.)Itr di to ci., f~1~i,..i, and the ~~, ' ea ->i.. v can become r'tiuitbuser 'J' hil , at th same time rr aotinq We services o ovi dad to the it ivo1V'.,- ent aj' the person in .: iit ' (. iC rt.
isol ,a~
Ac '+,orf{,r'tC"s ti di'i' lop?ri,'r?t, i. 1:, dates not corn .,,prise it can thus be used in 'r Iliir t?';l t t!,I:,'ri.3;lr."7 for example objects, rind th _ re-. uitind interaction space 3 õt,rr J{7ri{j;3 ?I r7l (,) a v'olu,kme rr .?la !acirfe all the r4'Ljot. ..' 4lc 4iri: is a .ac .. , q11,`,, ~r,,1 ., all the _, r' t~ 3. l , ~ 3c in ;3i 171~i: sr manner to e device comprising display Y'i`id ens ac dl Can be analyzed J the c rocs .sing- circuit to provi d'' the, fa `r, for of Th i t 'r`=,r llil .' 4'i J` ith nit'rmat _ n t9.,; --I,ir... to t1. ,' interest shown by the ~(,!.,. the iff e t + !
-t ! s present iW 3 . a show ; n ,o'wc'. The r :atuiall f also t d mpri.. a miniature screen to enable ton ._ii ch _,t in i :e shop-window il; hen a { ur :point at he Obi- Ct ,~3i ss.;.erned i -rith his/her finger, This ~: J(h,4 ~ 4 e`' ;,,~p .9~ } ,an i.,.E,, or i _ d.~< =~ _ ,' -i. !..yi ~r;. . , rii :"J?!` t i.,l.
ay means, dlescrtU. d iu t,.' foregoing.
The invention is i limited to the . rtic iai ,move, but coot, guierai 'j ends 1O CO Or any ., ij :-ra wive rJOVIC comprising i display means or not, Wage t pft'r : n;' l =_'t, i _ ?st one interaction pace and means for +mdut ing an in-rar a _: Iq t _ ea `i dire.-,-A ad to wwaitds interaction r.. and Cl/ off.11 at least -3 jr _= ti 1.
3 spaue 3 ci~Jti;il(?g y at S.,,i i't~ ' ar'iii.(`o tj in the :v a.n 1'c~>'-infa,r~e ~d. Ti; ~,.~a?.iae t,,. rz, f..,.~,,,~ jeans a ., .,r`,~;f _ 1 mer- j ii,i':;r,s1 ~ at has,,' ii`t~lr are~i r~a;iit ~ ~~ ;~i and di i2 ,ovi;dnq interaction and s ace 3 1 I a , ~{ er t~ circuit 5 I, to ~ =~
col Ios ted to the ..'SY means `1 a ras 1 its ~.=1 a...J~~igro !i pC nel 6 deli tie. tes or, the one hand I.nisrz;io 3 iSij~I i environment 7, and c3. i ;i ~;,~:~ ,l' e am ,.:~..; . ~ i ~~
Hi on the other hand in ernal space t) in v l ii:.; i ight sour ;e 4, capture means and display means, if any, are e t ' i i?i capture, ~capture, ^ iTi~.+,'~..,~>
ns LiYt f,<~. er comprise a peripheral camera 9 for capturing images in the visible range reoresf native of , tterrial ' nvironment f .
? 8 ii '~_ 7trn ;i'it. with two , ` m and i : Wants o" ,hn L uI V
Yl i nt3 can i Is can ~J u the tfa.li, [pe of display I(1;, :j'<~itl5 ~.~t.,l screesl _ ns i ~I t tilafal` ~ and e ' n he c=' `e ''^ lJ: (f ca. ;,>7fC;: t v c,i"1 in i, ~,d.j., where them ar no display meaan's.
We of the de':/':C{., (-:.13;t'.,ises at , -:tst tf' to Steeps:
t.e infrared ..
30 rarl ~.,: yiti,a~? vs=~~ of r-2 by iil,ts:3i infr . yt,~ t.;e-I>^,1k:i'ms !
i l and li 2. al._ of images in :he xdoible range P3 by can r'a 9, of the i quired :-, 3e3.7, of the i ]rarei and Osk.- r... nge i,t ones to generate an image n es_nta ve of Mama! en` ironment 7 interaction space ;j, 26 tracking tai parsons situated in tai.: :' X.-''i nal ;flia Eil the i case a,J 1 ht: re the dance U iCil ot_a~'i'~!%_;aa - ~õ it comprises t.'~ means, 1`ii iCail of the d ,splay ec1 i<Iiig to tl, of erson , considered as users, at the anal of i, .,' ,tiden a e 3 or of tii:. ; el-nal'C"nVironlliont.
As the ;i . p es in real Me, Nose steps are repeated c Ciicaly and no are processed by t! is processing circuit.
-i!?~ ;w+4 Gt', ,. _.3 .s+~ 1] iii~;fl~~(., L;~d fli ~<., ,. ~~! a :t_.4?it ~
=+il lids ;r lirdi~~.:7';( i,.. ~{~ .3.11 l,~ ~,ii--..~I~(lf t1._..(i~1-.~.-5 ,_a.,~.x_,1..~ G;., ,~?~+lt~,.._ .ii .7...
,....1,,,..i tia _. _ _~.,~{=: 31 .. cai h ~e i 1of . j`J =` 1 ,t);ay y ;i'=,t s oat..t.,,..s r, ti. i, ;:3 3'i00ae Jinq i ircuit 5 tl=+õJ w. 1 1 ,;zas ais i i +sj.... r 1..~
=;1,:.,.,, bal ~ ~r,1.7i ... if-1 i, ~, 3.C;
_',1111 ~nd coi.tro!s the di pia, if,_:liY_II~G .i) ..1 :_i_(:d. `. :t si l e 3 3 i~r=.f mv~roni. m. 11+. ~j.',l h. ! ~,N ~a, >> . ~ "ii 7 ..~~` . r .w' 1 t ~.)~. t , at to give l 4: ne i., Comprise ~O'11,IskAn :. J _., 7 u-id IOli 1!, _.;: `i in'ia955 c0 ,=11'I i 1(01(1 inn aced came as 13 7 ld !R.2 and 'n acquisition ,tr p F3 o ail image if i he . ' c~ -I.'~ .i i he r f t a i.e..1 r ,f I i.
Ii) Vi31i~1'3 ~aiiij'~` i~(a~ii ~r?11is ~'~.~ ..~~i., s(:a ~. , i"~~;
._j!s<<=tc;t [ ~filu(;,l ;;~ 13t,.. ,.1 _, .Ca are then proces 'd iii an image p iace3sing step ._ -. to recti y the i f ag hnd 'then dettte mine Iii#' position of the handdi fingers p rsons et. close to interaction ~pac~; 3. From th ,-'suits of th' image p'!'oc ssing tep, an -ifi'1m.. 1 J Step `-.5 de, e ties t fi a ent p ' es o1 eca. e - s nt ....4õ!1t~ti'' a.r~ t_ cI ~t~i i i~il vc,=~s ! 1 ?y, t,~i; _.I . ); ~'L, tl,a,~a .. r:, f'); ~.,': ~`?i i ~ )I'r'ate .~1 i in Cite,' field o viõion of Sri ~hamI caul ra .. I or example purposes, the r C i. ": 1 r~. 'yr e 1 1 3.. f x g '1 r g a ,. r_'~ = i } 1..
(; t~.~ , ..~ i t.l ~. ,ec 1 ~ 3 5i",. 1:11 i5 aõ , _, ., ail 1 ,~`7.._ ~
~,~C;if:~ 131 t.tt, ,.C,11 ;;i i ,ategory, kiss)term'ained a., oxwnpi : ccording tr.3 ~i.>13~-,i 1 ~'s ~)bal ,_t~~~ ..11 _.1 ce.
_ t.,. the - s R s i = ' a. .1 r a - - e =e. 4 - '_ ;~1 ~ ail ITI,~ITa tli~, 1~.,.a7~~1..3 le lli~:3.~ ~`(:~G,.,.3.`silit~
.di:.~~_ T~ .~i'f~ 3,~ .,t.'>~ av.t: (~~3 .., 3:;
~. ;
:~iii"~+, `.:1. sY{i_. ,t_.3 4.{`!t_.l '._li ti"''~ 1 , '~.~.~,s õl,;! ,l"' _ õI 5;,,,... '; _. ii~~=', .,,l,~s.:!a.`?:;
2i t~ f r or ? f ..:( f+% 4 to i(_ ii' user, ' V (,.i l?13':11 Cl~~e 1111 ajos !'1 (it l i in r el ~+_.~ (_,Gli 1 .a. -",'? ?, i Ina 1 2 Ind t o i..' e ii+ or ~ a..l.-ac os r/, and1 r,,._:::{`~ t e t.. 1. ~uon 1~ i' =r): _ 1;`':, r (t };;9i`l'li'/ to l .'.'.mil ,-;c C??I::' :-1 -~.il .heir prnvi!-_i,:: oceitlon (at a ti?I , i .or' ex`?7i-+f.Sl.,'} -a3r_t3 ..~
_.a.~ in wh ch +i crev ous ,. ~_ 1 ;_i ,e,.. 4i z=. e u ~'d ?ted i. . ', ` . . i dat " th e 1 ~ _.._ a~r~ ! a... 37 sir _a,...~ lli~J V-J , i, ~~7. i3 .:~
1'~.ia h -1:- 1 - to e n ct i1 .} f.Y.). ,~, r o 1 .. f. 1 ._.11L<~, - i~: lhU+,-a 1~~~, .,~õ ._.. ., ... 1{) (! i~ .,~.-I__ii1'.:~ _i ., ;i', proc ssina ,i3cuit 5 is at, . 1, _ .,, o . i .l .... kki 1-.-t of ;he u r s ti/' 3'i 4; its i t g a , ".
al~C 3{~õ _ .~ o;;~ T lx?Ja~41h )~f~E,'i,-r.s ~1 ,,,.1.,~=f ,, a,..~l:
~.'la;l~ I :iTeC, i., .ai`., ?~
upd to the 13 pl jt.. or ilild 1 1 . rail ttvr ;;'3 ooa5 t( i -r~ .~ ~ _ . {~ ,t,,:] I it - ~(' i ~ ~ c L~ ~_J, in ~~i~ _,tt<I,~ 9,C. ~-) ~-~1 is{:_-_ .~._~, '.i i~;~~ .? i ... u,1 .> 11, =.1.x,:.7 i_a.>+.. ~:.~,~ ls~ -t .. ,ila` ~~'~
yl.l 11:jt,::., Oi i3~~~~~a_'t:7 '.;il ,;ci,t.,',il-:.tC 3 ;.fi. ,t:~l', 'f 'i,- _;:;C CJ i1,~' ~ `1d,3C)rl Ll:.t3 it'i:`,i';:' 1fG;i " y A. ,.hSet YY .. nIy J t/' `//e c i /^ a ~ r .`.t.y:~~-.~ .) +:~.I S{. i~~ (. l]i:_+l...t V't 91...1 r4.;1 1-~1.)~,.41 tl lis J'~> ~,=t~,:J S':1, 1111.1tf1.7 ~~1i~'~!{~``~ ~~i C;iS awiriea(c, ra~,r.~.i_:ili utit ot fal~ '9 ~ i 1;~i3ar,si for _9~ ..
~,i?~~;lay, The proximity i t~
index is represent_iiive of h `-, J I tl i i re ` ct 3 -p ce l~1 irlt i'?.,ai )il 3 '~..==~
and used 7 for .il l l'v} ~ to atto I li?1 to attract t.9 ; t'on'-ion of persons ace ding to iiyl i! i3 ii -r st for the di plat I or ( to 4, it he aosen of parsons in Not of the lie-clay ;. reen, t3 :rebj "_,voiding false detections of I_- `_ier,, if no is in It ,Sct>>.t t..t~1~11 zpcz"4_,. 3.
in processing step E, the lils,~red images from each in rared camara !H'! and l3s". are each rs,ctLl. fie toi9y (Maps ` S off ~. and 9), as illustrated by .~ ~a~3<'tir rrsiv L~U
i;
the diagram figure 81 to to e ) s': of the viewing angle of cameras and i32. Rectification of the images provided by camera; 131 and 1732 c .fl them by be performed by applying a 4x4 projection matrix to each pixel. 1 e i"e3L.!lt- age, to a detection area a Ot" .~'tc'i ri~Cj iGrreL~U(?i1r~~~, for each h relied ir`. i !!' parallel to panel 6, corresponding to interaction space 3 and able to be of 153 Substantially equal : ije tot e display Surface which can be arranged facing intorn.Ction space 3.
i i?e Projection matrix is preferably {hailed by t: i's: rating the device. A
first calibration e si - J e "?e sc ' :~l`:i1 consists i5fin determining ,~.~r.~(tlcJr. areas close 'o s~creeri, 2, in L)c9. _ _ r -'a !`_i,..i.c:. W ,_~.~1 ,. , iC,v .Cltk.ica..,sLil s ... ..~p c' 11 Gq,i11r ci.~Lri is a-i <f,iUirri '.f by placing an infrared .; - size .:oai õ:~t 1r_an s lareent panes l i, fat,l,, ntg ea,( "h tic e,imi iit~er i~ ,~ small .~ ~` i _ the four edges of the display ,surfai, of the display mean`>, and by activating the W or so that it is detected by infra. ,d camel as i[ti and ;32. F he 1 as,itioin in t-v' o dii"( ens?ons t'r' of the cori`..,~~ onding signals in the two c ri :~ponding i , 25 images ~ is d,t e3s:.i:.. r y binizint~ -~ the i sia.~ cr ire? by infrared c.~ar m1 , i d by ~õ 4~,'ge" ." ~.~=_...t.ffiz,::9 eras 131 4-i1( it s~? JV' ,,: rri the ~ infrared e;. IsIt,~r l5 ?A3!%S1 a rani, thod (,of to al or global t f .), and by analyzing tiros' . 1 ages in connected components. Once the four ,iositious (x,y) corresponding to the four cornier s, (? ..}s,: e be 11 obtai. ?..:.1, a Mume t~,rming th a etec..ion area (interaction pace) ii frare mem.
Wit? in he ailfiramd range ;s, t e m' ned by calculation for each c For each camera, the davice will ignore data c a~hi;LlL.irt;ed outside the tti;;
CC(r spo `i ng iJolu e. The t -3u3 Col ,a s are e } M caiCula to the 4 I
projection fl ia.i.,sõ nabiinq the Wac o acquired by, !h.. infrared cary,,sD
as .J be rectified ucf orcung to theft posi`io 1.
A second step coi ci in Pointing ' succession of v, les displayed on the display surface (or scr -_ en 1 ) o a ced behind (film trans transparent , t_ _.C ion .( 3 s iiillJl-I. L i1ah'i circ!es _ ro displayed in areas c ose to the col ;,,ors of the display 7! ll i c and are used to t aicutate a horn gi apf y matrix. 1 h ,' t ii i =1 circles F e used to calculate parameters of a quadratic correction able to I a r 'o sod ,le a ~,, ~,d by a second degree polynomial on x and y.
After ca lbration, the parameters of the two projection matrices (one for each infrared Came a ) of the htiarnagraphy matrix and of the quadratic correction polynomial are stored in a cadiiora,05 n d t- bases 9 (figs}re 8) and are used to redly the infrared images from ;_,:,!!!C i 1 ~ l I i and iii-} in stops E8 and E9.
The ' advantage of this ~'zxii.'~i'.`.?tii)(1 3~i.~'a, =Ci,i is to eitis iJle the device to be calibrated simply U',==ilhoi_,'t knowing the location the carneras when -k. ?!};>Caic'xlir() ili _h8 ds 'J' i's is pic.'rlCJiafled, for v,t,,.:}pi,l:,? in : sf{v.) wii`idi(}.rj so) long as intei rn ctioi ~ "~Jc,!.,e 7 3 5 is s c+õJ- ?re.
.f it both by cameras I,"1 and 1ii2 and by light source Ws calibration 1tlha enables ass time to be pent in plant', hen the device, as calibration no lon . f has to be per ormed. T hi method 1 eth; r enables an device on site to be easily r"acali`)ratrst .
After rcCi! ssczti) pr1 of li.t.., ifil is'~3aL 'images .a y', i'~ , cr;~l_a e<~, the ~, different -~
are synchronized in a video flux ,yncr io, lisaiion stars E i 0. -f -he imam .r souring -l , from the t_iif eron infrared ca;?ncras are then assembled in a singl Wage called CI.Jfn ~osi, imago _nt the rest of t ho u,rJai., ~J e:3 .:lr=i g is carried .d out ~..', . ,fi;.si 30 Composite image.
The cofli;)nOW i7i gO 07 W n Wed a, _ to , ai.i,,, the iikYa. se_ .v;~ ~ n =
the Noll of vision of the ,alneras ;',! th of !;'lanes pay.?d J to :_ nel J
(;: ,_!J F--11) to "1'Sii se, I_ i al i if1 i _ i A; each r): aII a fwallo, a "~-^-3 . ,a N f.3I ind -"age i' ,".o1,~ ''! the f; ; ar -r y to a i.I8 l s,i (.i-.e ~. .s~3c.y~,. .... J'; .ai. .? _. .a' the iuaaffei!~ i a'? end of flits pai ne are lower than 5~.. lath u{.Edrag a given i.?i f _{/`~ with the .}t; l ai:t 3i i ,llel plõ,"s l ~] ail PF 3,a~ .I'+f1 3-f - f i i. .~ tin a co i i t_i r, {1 if^~mn , r r's 1 /\ d-' '?th Wage is tih.=e i"1 J )sr:;(ui~~.t"tA _(step i_' 12) by a.as roconsiruction by grouping the intersections with the obtained planes and applying ,~ic: U3i,t~~~i~, 1 i r11c1~"J 1 aim õ!.. ," er..,7I11~. i,1.3 .,.~ 4 ~f~[~l Wage Cj~ 'tiF-.'r3t !~i"1 :.,iv,;? tr_ (EA
i2l pr -: 9 Drably uses the image provided by peripheral camera 9 and analyzes the i~a .~~j!"t's{_n~f inter as's,"t of this ii.[.~ti, 1 -e _ "ff.~'.. ~ dint to We ~>; i ?h ~ ( ` ev?~?..1:i 1 1i } a~~. c? '`1. es_ t .C Y eiij1E'.c'naZ
fi f; , ~C`3~f a i 15 wrong niet c?hons in the Apt image.
-.i he depth image is then s u N a c ed to a ti3iesho id g ap t 3'' iii /hih each plane of the f: e th An age i ; WNW by i:hramshold'i lg of glob".' l or local _y :e, dkpC nli 6ni'~ On t3 aim, light r ~(Jn`a tE..`iiJ for each _ ea{.ai Plia Fs? Of T7 image or by detection t`! movements with a ioirm filter. Analysis of .f the i;imag acquired by r eni /,;, mi came a lj?riai 3 pros s in i.1 !, )I
adjusted and he t e day to , t,.aiken id a acc JI a subsequently enabling a hoiel of Ire regions of i ite est.
ti l! esi iol ing st.,. p __ is 'the ni.,1 .es of , f?e ?.final ,zed C.. ~pth Ii f age are analyzed in cons . _.ct ~`.d ..n? i iponan( = e ~. 3 i known mnan I f r fia y.sis in l,i ary Sconnect.e ,cfi3t,onents on bl s i cons to b_ c, .;aced by :jr ;i rnnll pixels having yinAl_.3 pro iei tic , r d enables a set of regions of r si;~' than a fixed ti?m..,3`to, H ~-Md_;i>? pr'fiic=u!ari,;, all lila regions of ne We t,''af~1 the re i as eii ._ _:1 l fiir.xe '4d i;i,irlJi{~t, ~-{ t.õt1g 1 e rati,en,arltiva if i er 'J1 itncl: is in. rrilaion _oeco 3 In y c once mv'i a ..i..i. s of IS ;. ii, ;tyi Ilid A A) f on ten , S wHa NMI dii ..,+?ni, +i4,3 _ _.:f I ~ I f .! I _.9G c I iL
areas . ,_9 5PorIi0c" i0" 1,?{ to h by Jr J9 o Yhr of [37 _. U., i3 .. ,~i7 3._~.,. 'ii it to .t,~ :' !"i'ti11.i ..,J '.f' .
_ r a h nd or ~ ~ a '-7 1i,!,-~
._ ,:,,'. {>Y ~_ r ~~ y.:xl..: __ ~ :I is , into: ed by (:oia'a ar'i- g the t .- '., , if ' the fti=eo. =~ +~ ' !nn _ .) f9a~ size t3"i t(6_ region is ,.ea.,l'.;i` H); t1 fi/,aigiC?,1 'x;/91, be labeled as being a hand (step Ft 15), and if We size of t ho refi;o l is s rvialke than the fixed tf esi h.t3lCif_he !on C is l9a u f~~ - ' ed as -,aing a finger (ris_ap i . i air. , a.~ f=:, i G), Vi 10 thresholds spoC3(:~ (C) ( example for a Ci Aida to the ICl'c?aCl size of a hand, and for a finger to the mean size of a "(0gef .
I5 He coord..na c,, e:~ ~. r f'iu ,> ~. i2i; _!lli:~ to each i e entative of a han(~ or ., each ._j~a~; ~ representative Y a li iYJr are ;r~.9i~,.'~ralt: for :~.':~7 infrared' ~.. ~,>a911(3i". C!~a'; the ~ rõ ti ~a +`.. , initrv;, i.'ni ion of The region and associate it AM a i ocRa r .! o the display õo !i"i_.c:;, ,9 dn;9 _oriit with As co?osctmon is ,,pp ed "I roI n i e c ord'n_ar os A We regions in the - 3.- .', o 3 images (Mae' of ,I ,.., ~,z,, ~~ ?aC~ ~,.>'._, at i; (i : r?xai 9 i;.r."1 Steps El, :5 an."! _.. ;., its ^ny fl - i af9d ,`t's 7L '-1.... r3 for 13 of lA!t.. Vii.v e~.~
- ."'..3~~ and .
eve iiis are then analyzed ',.-,.y Si/hiI^;f i ~. ua;l it ion ' 'I.h the ,Jf,.,vl i "!a s position and ~s i. >. (ia,li ~Jheth r upcaa,_tinct of the Wf a has to be petl`o 9,ied, !.a. .'!h ...er a 9_._: `'ti _ Lion 'has i';een L`'.etC,cted.
I'; iõ f di),'I l ,1fa?:~(aif~ 3(viii~>>ib.'t(ii.~t~ii:11 -i_ii~i,..d]d ds111) qi adi't3.i!: i;iirj't?t,t9(ji7 ..,IIc.sJiJe:i iil red t.: ;. > ,51 and 512 to he paced without {,~,.1 Ili .heir /;'.. ,= in i Was 3 '~ :~i= 't`ail of !l'e '-, 3~?11ii:o ~?clillj st9i14(~1 ~( This ,71 {i atio of die de v i - 'af f { ..,y.
6 ri Ely Q. ~ - .) the ; ire ' i co ?y i !ii. ,tli(; of ~ ~~`.. ., ...~, _ r ._ S,ajlf"_ is ._' tirigu _.h i fifers (iv.3i51 ii, f'3 or 501 " .,. in t ' I i s L _o 1 , d>r.,l s ii g t ,i_ it 5 is r i'0 ye, t -1 J,. CJI t_:vt..i )t i3 sii vd Wfi.cii W rent U. rs ti?.._:G pointers + c1! J to. 'h, .i li ; 'is, &D r I d F Jri ii .. ! por:,.fir-.i_.
ri camera 9 ON thoort , o+c: [,ei of the ,nii a, od mores 3 . p Et f. As liiilvdi teid in fi'iur'e 9, processing of the image fro, i cot iphar camera 9 first of all comprises a spherical +.t rep do stop 1117, A
particular when the peripheral camera comprises a wide ans~ la lens. !ti's choice of equipping the perip erc.i camera with a lens i s in fact judicious as the wide an"j e enables a larger external environment to be covered. However, this type of lens causes a par sp.,ctive effect tending to i s make different planes of th se. ine imzy eai i~3f 'ihet a !: 7P) tiil one e .-; 3.~ _, another than they really are, tokssco,,lc which rather tend to Squeeos the . u jects cloy.., to one - i othe( in one ed:'_~ he gem Plana, !
his spherical d.: formation is preferably eciili eC, d i deformation in known manner by a second polynomial, 'r hich takes the distance 20 bet een ti current point and the center of the inat ge on input each pl"
of t the i3 ~: tee, t ld which sends beck the ...?..)i. _c e between the t ' of t i imago `'r' and _i. s current POW. The c).,< d1i.'-d i a`dgo _. rin is Then recorded in circuit J
i ~
;, e ~, r I ~I ,.~, Ws o The .z ; {,.)I iet,t t-tif, .,' imri btain ..e in ws WY 43 then also used to p-~,.i~l"ter iii a segme d.,ceI Map 'L-- i >; This -} i bi ice e corrected mace i,a step, E-17 so as to di crim ina`t bebvl ,e n th,-) background ~ln,d the for +.) t_,_nd. i Il., ii t egiou ld cconspond to a pan of ~...,~
>i environment 7 in '+ lhich the f.'.. :,cred 'correspond., jr o users ,or ,,, [ .a .Sel"s lbyl, }iv h' :i _:xas is -i r prc sc;ra itiG'n of ft3 7 .1 #
n (;~ i .i t.. ~
1C;, i pout of a background :fsFe ~ ~` ~'_t.t{i ~1:`'=, etc. A
,hi_CJ . ~~ the T,."3 r orn, i1.19t cdaafir ild.;t.; the I`;ein~'ants jr) !fie t.-,zit- of arc considered 1 n,, !co,, - jr ovr r ...i. an auhnnobde Midi passe.., M rough and when leav s .fa field of QK', it 1ios_;bÃ.;
ii"it:ii`7 of Mset. c e ry ,s., _ ili ,i ,..i OR for r presuntId ir1 ;l i< 1. ern of - 3iipsCei.
in On corrlpietion of segrnerrtai.nn skip 19, I? a change of light conditions is i tnv i i {~ i i l ri to E13 vu, the ;knobs, or is c.l .fen rat: dlli g _iL rll in thresz of ing ~ is preferabi;J updated.
Aft- segmentation step l9, processing of the image from the ri `hera~
camera r C ~~fo,i.r`, of ms_.~s,; t t= "_ _r~~i, c, 15 ccomprises an up i.~t; .C l f ret~ior1:~ of itii--.r, 1-he c r Vii. ates (carver, size, of ien aVofn) legions of i! ffer ..t co to eponding in [he cur rent in a r are a w ed in (da o.b ase L--21). By ,C,rri ~ Ii 1.rg~ =i ' t(. i4.. i - f `' irnrngq ` ges (C.?-.tar., -:_Y?i) with the ; courant ittage, A is the reby to pe rt,~iil tracking of parsons (step E722 by s_lotcc',ion of I law persons can , e. fot'f f,eu fig step E22 l~Y ep yif'tj a zero c.,r der r': ?ii ' =n niter on e 3t. ii of By cc"f n 3t ::o. f 4'1,+.i1 t iz pr, VIOU of the , ~ -dam ,,.
pre" :'rea the now 0 0 din :tf s in tt ; current idf ge.
JiCõ"fi [fh:,' by track g and of >"i"~,:si,s, trle position ~,._.. , and u 'f 'hen of _ _'d E24 of each person in the refoxi iffy of Mier, 3 t Ofl space J can b teri,i ncd. The need of the r. ;r,. Ins in !r'. r .rox j tf'I of .ncerat tit rl space 3 is obtained by r,i.: tcu :.ling the iberv1n t. 10 the .~l'o ,lir at "s of 0 -'.) gil..'+ns of inn'õ _ et at the currant r~l s-in !il with to tf Previous 1oenf;i. The f i: on of tine. parsons in the ?. roxi ni t't y of is dei~,-}} no:.<3 To ~3~...I d by the I arv':.c 1. of for ef`./=,. 1-trr,1~,J.le is i,..'..~ Ilti ~.:a\ on ~ '... a on the Jr ii o[15 ?"'_;sao53, W o speed of move at and U e bis lat.. sd im gc ,) o btain`ed in seMn,Mon :jet} E!9. A enti ier is aSSOciotod An each region of interest -natANg rxi o . is precise region to he, nar gol Ilia(l.
= of I i,t, c)f i l.-.'+.qe._ aid during .-f ei' '-_ ramping stop 1`--6 and actiiii`v'ri y [ ,.9 .~_~: ..ice be p ii. 1 ned.
i?1 in background/foreground z gmentut!ofl W p, _. 9 ea pixcel of the 1.=' e is defined (P25) by its color components. An element corresponding to a ;loud of points in -a color space (R,GB or AN) to determine whether a pixel belongs to an element, the color components of this pixel are compared vjith those of a nearby elen)t.'nt, La. the rninit-n i n. distance of which with the pixel i is smaller than a pradefirÃed threshold. The el- are then in a 3Ioiff1 of a cylinder and can 1. i 1 tf = s ex be ' E~1~,t~ct"~ in _~li~u - ways, for foreground, background and non-pert 3 -,.rye nt backgrou>`i+.t.
1 ...it; ~~tl i.ii k~ ' r it t "3 ,r nt tion s+i i7Yi a~ The ~.` s' ><~ti t'.sr ~L ~J IJ
. is illustrated in figure 10. MA , for each pi,Ci of the corr-.ctded iind,,g from peripheral carer 9, a. fir P26) will ifl .,, roga._ a t : t abase of th x its?,"'dn b stc; cirooulnd to r or n M As pi,-,el is, pall of an e'i-..,ne: it of the i.5 if this pix ,i is part of an el f7 ent Of the .'.. WG"KG JMU,'Id (yes t.,1 tput of step E26), then the database comprising ing t 'he characteristics of the f)adkgroui d is updated (step P27). if not (no ou put vi step E26), the pixel i-s studied to chock wheMar its col Jr c oaipo;ients are close to an a: ,mieni b longing to the nof' pe nta.,nenIt background (`tel) ENS). if the pixel is considered as being dil eleil.=tt . of f t¾. tl)t, ~ non-p- e,:a j =~. } -.1 g fo n r (y 1[6~i% i of then }h ,l.,nt=.eIi'iT'.;,ll.:;il.. rt,c..~r c~._.L1l~;t.f \~~'~ c.~t{b s' ott:+~~ [-28), th,il the d isappsarance time of this ~:itnent is (Step !. 29). If the di sappe ra ~l_;
``}.
time is greater than or equal to _ rife i. l ems' t.innt (Y-',-'S ou!~P-'-"!
Of step ofis.;, i~31_ in E2% a too t is _lme rl.in is e - t iron' of The non -:1 nanent back gid~i_in,t_l ~a sit. grow .+_ \;i11 is prosent (yes Wput of stop O) s -= 'S. t '-, Way If not (no output of Edo), 'n We > element is present in the p ' e of the eon ve naa .' t alein-e; l., the r"on.
, ~'nwom(33 clement is . 1 erased Kai .asp.l the l -per manX,17t ~ - .-~tiLri~,..~:!
t;l l.jt{.t lltl (Step ":'3C 3).
if on ti`l:` other hand the disappearance time is riot greater than the rejection 1ii1-1..,e (no output t is made to ta. eYiili( ?e of Map J P~,r,'.~ :~',, a test l.~ de whether the occurrence interval is greater than a predefined threshold (step E31).
occurrence interval represents the maximum time interval between two occur ences of an element versus time in a binary presence-absence i succession. Thus, for a fixed' :lem nt, an aiutornobile passing '/'Jill cause -:1 disappearance of the object followed by a rapid r`r appearanc?, and this element will preferably not b a taken into account by the device. According to enp e, a ~ - r r, and s 'tacrj t_, `+U)ii' c, ::di~~~ an 31.,c,ifit,a~3f;~le 1)~,(f re~,+~1 for a õ ~~ :;1?rl ti3'iic tf(:a another ., ... ,.,( <ir=..~1{~., ei .
away becomes a r Ji- ile object the oc'i e 'e interval of df which ' icl 4y C'Jilies 7 e ~ i. c:".
0 : rge rvloverneiif the leaves i f e will a small s ,o.. .,1_3t r;l ~o l` of a .t"
it 1terva , etc.
if th; occurrence interval is sithan a CsHbu, _lhrr, (?o!ra (no output of _.; t ), then the pixel is ;oi i sider'e d as Wang pat of a non p reran-ent 25 background clement and till, is i_i dated (Step 31a) Wing account of than oioces d pixel. if not (~ s outtput stop Ed 1)i the pixel is considered as for ming part of a foreground'. element and the foreground is updated (seep? E309 taking account of the processed pixel. If the fi rerjs" o1,!i l fi;.,. nt do s not ;i ist, a {i ' 1 ,'Iron t eve i. ;t 30 eater' (step Ed1c ,,_l st3 .' :' if _j i,... t_ .!.,~j I_-..:,i cloa not mm pan W the f,,.,;1 ,oimaTl":'iii i)crr . ~i r.iri(i I( 1 itcut of is to -, QEP :J m W._.n .i.r {Ing o :(? n.+ ,i c . (Map 102Y it no fe round alsment SAW (m) ouiput of "a is J Ã,st.api Oft io). in Ilie case 11 Cm No 10of lto I " s to ..,(I
o,= pros .d e,e,. en (yen o0y!u i< ter Irlli lr ine ;vl~,i!c:i ,-põ'3,_:..;e of (i?!-, .:,,:i.,1,1 is l+1'3õ!> than ar., i ~, ~, IJi ai ce -.ra a :iai (r k3.)I. ii 1, i,., (t C~~.t' 'cy is t11a n or qu 1 to th a ,G +s17t'4;v' dma Nos ':lip of step E331 the i .,, considered as -in forming pout of a non-p.,tm%ane element and 'the Y
ai-p arri:nent background is updated (step EASY if not, the frequency being lover than the acceptance (no output of step L-.33), the pixel is considered as forming pa' of in existing foreground eletl ent and the for e jrou,'id is i_. pdakd j,vith the ti,.Isata of this pi: of (step 03,1 b) This al jor khro, executed far e.xaf ole at each image ca= ture thy processing circuit 5, makes it possible to r~iatiogr_it it the cli'h"-Oreot ~. ;rri. i!fG
in the course {J tai i 12) ., ., .d to a.7sti+s,ai e Him wit .hair c4 w, a:oi h;il 1g ,(Ji :..l..ia A h{%il ground) rJ~lria :dl r 14 Ss cad _~Iti llf lt~ ;rEU` I ( I ,:I s It '::,~ thus rlr~it '., (v;i?, :;so, u(y as ve ~
r be ,t_ a ir-sJ't:_r 20 merllant before being considered ,., '.'!hat it . ?taUY is, i.e. 21 iioli i ...rmar.6r:>.
ba{ I<,,trrl_Il d o:N nont, if its 1r' ue cf of ocomence is 410-1.
The + I ,I =trg ~f,~l. y. ~ rr - e'I.f~~r r S~ a' yiy+ fy._If limited to r V
..r ~.-~.,y3 tom'fl.. l is s '. rSLaI ~ = u Y.~.i.~d ,r J Vie al, jerilhrn illustrated in rigui- Iii but .;.<fr be by a ++ known type c-4 r 'e pct, < js'( 1.4 :LI~siJ iUiaia s, eg bier Ita In s ,:s 'or a to 1'f':r r in the ' _a.,~l . r,..- `Il~i=.~ C ~~ a'- Jsr i. _i i docuil._ n "Real time loragi >>7nii..b cke!roun(s i, l'! _:t'Gil using model by Kim tai al= puNish ad in " Real W o mnLi.r-ic c!ui.l... i i, pages 17,21 to 185 in. une 2006.
A a i 11 G r /t.~. ,r 1,.,I J e,-. i,)i ~~l.i. $l..i segmentation process as) i._ =:tl I li g process ca 'ti Iated cy, ~ li I r. 1 his process he one 1 1 enables the 'o:9 pei r. m ..,-`..j y P '_;i s the ,~ v..~ir ii of !. i a- ete i.a ei? i"lJi r +...11. Jp'' hus, as !l _,..:?t. 3ted r f {}a lre 11, for =. 3. p0 d .:?r apea r- M F':
Naga _. _aile1:', it is .,, .. ..=._ d 1=..,_..w. 1ii na a pal of ,-,I
' -. 1t:, .~t .. n J_ ;_1ltt, ;i`11Vra ~ si_,.`i z.. r., ,3 :I .,. ...i or of s Q 934) the o1 y nd,i :.l ba ' go and t -ment is l.. Aihed (st ~J .ti35). d~ = .~ l 7<_ , of Pao of i:.., ~iarricn (no a step E35 or 936, the I ccuL-' 1Oi;CS A larval of the , lament as;t;c,at-ed '+/ ith the piS tested (.., 7t~~). if , . Us interval i3 i .. 5 " ies'n(?il yes ~1~G'1(step _f~.f~iE?1' than Kw ~.~!t~ ~iis _iil~.- a C.
output of step E37), the element is incl1} ~d in the background h ea,J~a (Steil?
E-33). !i on the other hand the interval is greater th::'.I the threshold i (n'`~; ' o;st ..l y- i.;ii.~
l} f step E37 , t :i4 ~e lvi{ra ii is , -i T 3 9).
A'st~~f4 r 7) `
7PJ' *~l~Z~t.,- ."7'~9)I':g step ~. F has been ~,..-,1 {~3 i'~,'jY1..7 (tigure 7), S.r ',a images horn ` it I ?7 '.~ cat lem 9 can i be used JJ t + ii?fi ire )rope: tle's with a person. By anal /_ng tl !)c:; i?i I a .:C':'. cai f i 1C.l ? lolo d C:. rig circuit can thus at ,:,- t approxim ta'iy ': syr r!l+ hi ;i`i r _> eta' ", ,d o Vession al cats Joiy in di... to display matching this ~St r :i ~o l~.
20 This aln_tiysis col, espofds to din r it, '= "i` _5 ihuotrated in gmaWr detail in figure 1,2. uses TIfr r iiv'J3 ri fi Ind:, e is st. >:J t._.. i3 J of 9 an r.J. ..+
y '"
d~i.;;~..;t}i ?,rf the persons :d -." n'- -i; r3,.~ oYnn CO;CU:OtiOfl _( .. 'sot' spondences _'(;.j to ..,.-~ ect f.!}'~ bode, of the ( ii" r nt persons (stop 940), iheil for each ~ilit.,i it l',rJ
es body (ste J [/4 1 ). From l ti ti. and al t., eir ass ociat+ion .:Ith their .~
:tf t-1:-.:;+ { ti, v ,4-if., ..
.S yam( y~n.: 1, ms s C-r:t{ i for "'ho t "+'sit~~; , ' i age (' s ? orte.,.,-.;i 1 P.._j r :;*. ~ MY, t_f~l '' E43) 3E43) ~ and -~,o: ~t; .. ,ifl ~i ",a Magog (S PQ ~T{ if 'h;
.
persons (step 91.3 -.#) . n J create a t ecto! i t g ~ :. erit~. ti e of t e tll tre , o the oersons (step E:"';5) in t.. Person By the t.l Property vo õ}i, of $ it is t-'get c nten'i tliSit in more likely to in,-,rest hii-iliher.
of ;h reovent areas zones u; the 6w) fore , ~ 3 ., f;sr~Jrriri:.< t 1) t:., 1P.' S the i{ ) s .,,i;"BC: C}
Tt~i~~rJu~.~ ~n i , can ~. t ~`..,~r3 .ti.,~ ._ n, .1:_ .~,r~
ii t;!c~~,liri ,,f . _. ({ `t .t !t .
!1i~".;aj ~ I in ' ,. !r f'',v!f, 'v,; M -a and don, associate an area &Nac'6,-.n a i{ an , _ a of the dis pay eru a \. qh each parson . Ti-Js i during ,'t rgin l .tap EEO of Qum) 're !y. From t e p s ion data of hands (E15) and Agars (AM, this .. aYa+Jl:..,' i lacking of toe hand and Ii era to be ind' 3;orc'iat'e3 lh na3;f_!s finicers with a identified ivv peripheral corners (823). Y. ;;v,ral t,- ' r.-..t f i a s! an!
TSvr1 t, 311 ti,u::~ in.,fi.(~l in s~~?r`.1is" r,faf. ii >t1 _ ~.~,~} 3 mss, ~ :'~
"'v ` m! en , of their taand`/fingert-, can be processed by processirng circuit 5.
Tracking of the r, ovfrer i:ents of l:=_= hands a11d or fingers =enables it to be d, terrnined %a heat the user is doing in interaction space 3, for example towards W at q'at t e/she is pointing War finger an object, at bj`.~ct, and, ;
eI~C:J area 3=_.. ~-I Ies v nirn/her to be provided wab data associated ;'rutty tia'~7i at l= ,Crone is looking at on r, display. s,~,ochdon of (ar Q fin,s or .c with ut lisor can performed by measuring coordinates of the hands! fingora/objt cts, %:,A 11h.
each new image, sa ; h nd/ in jet/objet. t then being a" sociated with the use( 1 h e coordinates are is;se =Y to the measured coo -di!^ii tes or the , :
20 hand Of /f ir!gt~~i-- C`bjit,t_= in ii;- ;c.ct-dli! ,._.
The image- ac ;-!.red. by peripheral 9 be ., ._ !!rvi ?t t.i by pia :ing ra -all . ltit'( _1 l in the field of vision of came a _S in This enables the ;
n:.:st pC.isl\:vf! t.,,st. ,lue, spatial t.C ~,r_.{i;c 5.1.;, 2..~ " etc.) of 3} ai; !:with . _;sp ,ct to interactrJi'1 space _ to r.i,<,. !
o);dn .'' li (,r.:y : ci' ~ u _ r 'each a_cquiroll (rl.'3E"i=~.
Proximity step E7 of 7 enables each person detected to be di irug_ k/h:d k-'y classifying him/her in "he user or passer-by category (step ~ f'i;; ~in~ to l b- i1[~o,c, r' s the 5+ 8 F146) . C r li C,? :,i -r3~,c 'itilt'r~l respect to ~ i!~' ~ tCe .~i~:.l!u{, tiOn ~:r~a(>: 3. a. i !t distance i~etwe en the ; 'rsod and interaction sp-acs 3 Or Panel 6 is smaller toi i . .i s k7._ I r; i ;{s n ..7 da .i': as a user, it not on al i l~ (yo., miii ii of ,K ~) F_&I We er C.5Ai,.a_ of M"'s 'Hie ;f ,~ fi). rt,ri by is fi. _s_õ at the asses We tAVp n . if no passer hy is l s li 10) 30 '_!.i ....L' 24d), ti siõ .e..,; C (., iJ ) a .i ... :I jy .+
( ascot is i ltJ_ .~~ >y z~ e ..
_ -,.'g CAN .>. q it ._. !'i m"v n 4 r s detected (Y_~,` oJ :-u ut of .'..'.! ,~)~ iõ itr~f il[ts > ..
"~ fi,t P); Was .~ ;c' t;t9 ndlllait s of pfi. S p,. s 'u`,' i.)otectiten of a now, uuser or of a new pas s eNby pij?es rho to updating (sop 49) of a . roxi wRy index (coordinates and We of appearance) by i":o' ail -f...;`~31i itl Circuit S. ~ A ,i3.-~1ly , .,14 ..=~ ~~ ,.. ~.1.; ti-Js ili,i~ ~ t i .;
~_ - 3r- ~: ,{ , -~ ei.+? .t~,-,7,`~ it its {'`',' 15 whethor a p sser-b yi or a um is maAng am my or m vingi n c nearer ., , , _i7f' =,il ..", to his/her r v s: us position.
ft'~t;ii,mi s is rl t, .; c: .g in the " i e `na! i'; l a ii ol, i cant and can wart eau, o _ it i . ian an e.mrd when aveds 20 movement of fi_iv rllce; It 1 0or bJtit =vvi 'o .c~{.7 -, ., and n i i I 7, :( !. r,:.n -.?.~,.'5.,?ii i' _ ..
b .inabhs an _hs fi':..{a tai ' AsiOn a ill .tI I~ ca1n,'a .tobetiifi., i IN i I
.. ~,. Nu m movements repealed vv: fl"
t~
ii. all tune iii erv! such i min-g, fa ''õa _ .. at he =,?!':-'!j,
l-.', ui o, ] f ep .;::7 rats a c,[.4:7mecib+l_li , iew - ion j the in A-,-1 of iii.) drjvica -9 Qi.)is 4.
-w a 7 an !(s 7 l.i"iii of use 0f _. 7 J
/ y 1s according to ttry 1 iava !don.
7 u;-1ur1es 8 and 9 1 ,;-i a F e fJ.C,'a.:: ssin 3( F4 of the -f'1'< ges of the aigoi itifm of iii ju( 7 in greater s~l we i , iiiustratsa the for- _r iii) /E_iri f~~`.,~~ii ~ if3~ ~~f lf1,_jf-Lc+_tion stop _i9 of 2 7"igur I 1 i .,scars a s~1?.,t: ({.)f_IIIC:,~i ~~~~iJ9f'1_1.1)Ca seg nv131.ation i ,earning 0t' ori"1i`i-Y1.
1-7 C, .. 12 ifiusti ~1 jft imetr .?t7 of the 'ilk i=thm I figure 7 in greater dstail.
!i_jf;. i e i,3 idust- at s the, Pr= .3P"flo slTj/ ;~ the ..,' at he of ()g i v r'.1~.~.. -"af7) ~u 7 in i Cli; c`ter `: teii.
O ..= 3 psioe of i is d X1 en , )die, 4. f) According to a IN { embodiment illustrated in figure 2, thee interactive device.
1Ji er .n display s_ fei`~f)k.' ~i for excifi ,~.ii by 3 +i_l a ( sv ~ ~i"'=~e IT1eai i~ -~ii 1~~+'? .i hilt or ~ 11 li-.e .a~r ar _par< t i _d+ d ing ,. m 1 ?ding and J(,a'+~ ;a 's . + 'C. d'al .r directed towards film rm 1 and ovarm meto rin yi .3~9~'fC,~;i,1-~ i (:l"0 1i i7i. tin;ce c ii.,ll sc:,t',s at iJ. :'ca. .;J aC;? 3 ?iluminate d by f 0i' producing directed lo'' artds b.
this S `A Nat is iT ' t a vos it ~..~, , J, f?1c~t_.t:~s=io~ ~,J aG ~c is ~ .ll~~;` ,"ti which a user ii can i'''te /act. The ce sefoi jl~t_ u irlij t',c' i i t beam co;impri.sr:
at least one light source 4 /m ith g in ,.ho nna in framd reaps, for a ample with between ON i and 1GODow t,. ac Vf, aIvi+;t, also o f>;?I-(Jri Sari~ lst t .a by at t sw1:31 t t': o ijS~, `~ irfla t:,g.,3 Cot~~~.trr,drO sic Deli .Iftl~., .
in infrared 3 #"+i i and do ~) lt , Each the 3 cam } 1 '3 met. J 9I ~. infrared erw s is directed `h e ~ vOl ,d_d towards it . racoon space 3 so as to cover ii I' whole of the I se corresponding to this space car?;: to laetect obje . iS located' in this space.
in -a e ,. d1 ,s : _ are, '1 - n. and i 1JcGnr?c.c,ted i m a fl it .~t~ ark ~ ma ia;` yt;8~ic~Sl i~ir.ril.t J
Itself cor nectadiin the vide. to di play, for s ..a+ pie 15 when infrared cam eras H H! .. n if-e. rnovc mi1en of an object in WNW = space ._.
As in figure e.. "` :3, liar, interactive do ./ic,., t'.,rthr r a i?1??uti ru_L. Ci the ?:ranspar:;nt panel t.', delinoa; nee intela.. ion space 3 included in an external 20 environment 7 an .he one hand and an in emal q )ace 3 _ n lice other hand.
The display moan tr`ran i it rent film I and viddno projector 2), inf l ar ic:l light source 'r, 'lx?('d z1'11.11'e .'(?_3~=!ra3 ,,~s!fiir a infrared cameras aFRI
and and peripheral earners 9 are, all ,,.(rang d in all it l= n ni space 8.
Peripheral camera i; is d erI(i ed for r' c~. ea of ,9, l._,_.~ iii ?.: i,a r<..mlty : ~.
le and Ta directed . >~ aute~re 25 in such a w y to cover a 4oRnn rap escn.c d.a vsi environment , e Ciarri `i ~ 1 7 (. r r_Lken lino in ,gu. a 2), this per lpi sei al c amei -a 9 is l s connected to [h..-) disphy means he de's ice Ather t . a ~sd<;ment 10 supporting the i'm_dr dt source and/or Hawed _am ra_s i f3 1, 012. Ws is support element 1 is designed to .JA 1i,,- d near c ar` n ' i-.a it panel 6 in internal f-, en space S. tSuppi. rt alremm;nt -10 is prefea~" l; t resin J on ra 1 par enttt pane. 6.
lid configuration is rendered optimal by J t ha, use G A at least one partially Ylp't=r`sl`'(3ia(`'~ Ie(?l'rti 11 (not shov'i' in, f, + Y 1 2), +rl a...,~ ~
i `olemeni af. and support ekemer 10 then being s.__ ,,.t!ated by ttl t(I^
~I_ii.
panel 6. The rCflecting part of the (mot?,r. i 9 '~i.'st in-1 <IUt h y vii ,m" ~rit -f'~~(,',.,' Ie. ; llC;,,t source 4 and/or ;n l+ õd t_c:.(.-3.- t .(-- ' ct I 'r e._r ys 11`11 , ?~. ._... n+.J_..~+7 Wit) as to 1..t~...
.., inter_ ctio space 3.
'~~l1;~~.1c.. .1,' . fi~ i?``_l in rl. l +'l ..c9 ~ r, i(i~ .+ ! ' ..1(rt'.(~!?~ Wer ~ spaco . :j is prerably located An immediate proximi y to pane] 6 or :von stuck directly on the Mr.
1l .3 !c",i'riCTit.l`ls;JciGti:f'~ +~ .'1(irl~:',5 a ~1LY..r;f: in ',j/II:;~1 the user can inter-ac! tfjlt(1 a:l;~v t itplay perfor mei_1 by W; display .a _ It is t 7 ', eby/ b possible I s s;f i s r I 7_ r1 a, 1 OCjX tilt, display by means of ones hands, fingers i ;r any 1 , l ~ c r; _el r!~ object e ~,Ci (~~ rolled-up rl',Aspaper for x:. mp+l) in toe same way as P is to _ . e do 16 cu ,v. rltioe of computer oaeen by mans of a r1iCJuse. Interaction L--pace tit robv act's as user inter uc , the i1 oveimler i s of 'tile user in this space being delt dad by in m;. -d 3 H711 and !-R2 and then interpreted by processing circuit 5 to re ?; _ .rite a user feedback on the di play t.
eans according to the movement rnMe Thus, when a user st_ nd1 in rant of interaction space 3 at a personci rote .... on deist fake de ermined by adjustment o'if the infrared r g to t1 he `
di nfc't`; :1i iti iii, apt I of the ir'il fr.;i 'rJ
spaces, the osit.cn of s i. /her ;,awdis, or of the object tie/she is hobling is eArnate l cy dote stroll, onabJ `ng Ium; ar to 3 ,JV nlar'a't vf}ih :~ .
interaction space 3 s.Ut i+ yin ei=i~
'_".- is and/or h by ~'31r~f~i he m i)V ~,nit:~behavior of ih.isOier hany.-Is or fingers.
/idea projector 2 of device' of figure 2 i;>> preferably equipped 'x ith a l_-and-Stop filter ,il the infrared fs.l li(ii-ing disturbances of an s ,I {_, -, .1 - (" t' t- a{ r captured hy the infrared tc::amera. .
f It is pref l t.b.Ir' o? trC i 7f w`.i ii. Wn: i and U...+ sparest pansi 6 to be My transparent to the in!!r cried "='d ation a elen"gth used by ight source 4 and by ~C'_n ca(-ii,Ya<; ia~`t Pea i i i:::? al fat;" ra 9 is g rate a_- l v pieced at a distance from panel 3 o as to cc .j r a 4.iiiy e x1. )n .,e a... __,rts.al a ni ni Pi a c_'nt_ mode embodiment is:u_t'ea.ted in figures 3 to 6, the Q jay vn ans compose a, ~ v'" I'S placed in inter rte.-l space 8. E,u _=ii a screen is )t>? for ea?, ple a cathode ray t..(i ? e di )ia.', _.>'r, a piasrna opa1,ijU, scree l may imply on he location Of iriiialet_d cam ras Nil and 1R2 and 's of l fi$ 1..,i!?'f o r r,I?ItiiC?r in the near-in ralcd in internal ,:;pace B.
It is war =, i _j. e advantageous for i' _ ht source `; ann/c r it?tr: ar _;l i aI i o a i 1F31 and 1112 to i ; "-'t. spotted by at one sup _)rt e!sn1 ;rit 10 ted i-in inter is, :S ' e %.), for e , "le above Opaque screen 1 5. )tt last '= i s flail y , liei't 1 ;~j cOir1Ji 11.;.n, t=' situ ex#_ar?
t? lef..,'.7,=?i.1 {;- fi is ~~.~.L:; in L)~fl a -onviroa,in- iEt , i 1 is L signed to ii?iral i:ght bears corOng from he igh sf,urc in I?lt i:a ,t.:;i! spat.., 3 and 'to {_ii, ::ct .
t he field o 'f ' `+, 01. an in' l1 = "+ ;" l 3.
As ii ustta. 'i in Howes 4 and 6, iii! rt) merit 10 can be formed by a _ e -_I a.i~;: ~ 1~~. hem ~_ifa .s_ sp ~' {~
_,t T_.i,_p-Yt bar la,. tt 'd to b e posing 1 ai .! the surface of transparent p.,., ~
.":'l r that is towards 'rit.: ri7 cjl space & the ,o!-(ica t,.i.ll be in the 25 form of a ir,i,_.)d strip 12 formed tor example by a u:alit' of ligilh.-orni.ting diod' ,`.i EM Y) 12 is array itj ~'~.! along t()-@; of the support liar P1 transparent , 6. 1 ? .efer .' ly pl; ..:{; at the bottom of an en lo. -ii, in t avity 17 formed in the support bar. Strip 12 is thus not of rang"ed salient viol , p ...i. to th support bar, loihi{ h would `~ pryt~i l/'.i+)}} l .7 t.)~l~ yl.l bar it I~~ 1X4}r1 ,'_l.
:]~) i~ll f.r \Ji-n f ~ ir~
cameras a!"-! i and 77'3: 122 .PL iv ii`~>.d3 set~~ d in at and, rJr{,~e c:'f'~r~ lIf the riJ~i~l~[=. bar, e _. ~() d, of lighted strip i 2.
As illustrated in ii'lui 6; ,.., 37 ple =, .r.._ eisr:ie nl,. -11 can e in, _f rn o .. complementary bar comprising an inci and surf =aced 13 +.aire I.C':'.,1 both l(J~,% rds ti - -_ 6 On ? in . l e C~:iis.t,(;t'~rl - strip 1{?r ata.r ra' ~zd~st~t ri 4 ~ a:: - f il~:,>,-te ,fa 12 2 c"31,~:,d 1 ..<i:_. ,i is ,C
cYdmera (31 and 1 i2, . as ,,._ c:.. towards act ~~ 3 when t7 c ,rdvsti,,..I;.ery bar f; 1(,,)d c,. ,` e external _.,irf ce of f~"nel 6 directed e.,,, i <~;r r !e r is ,i towards C;t7..:rrlal 7. For .,: rc=i1a~i~ i-33"~ii~~3.,ses " in ;rl}ie 6, ~:=.,;~i 6 being vertical, elements 10 and i i on the .. 1' part of he pan`_l and internal space 3 situated on the r) hi of panel 6, SUrISSCC 13 is =dnciined downwards and makes an angle of about 45 with the panel. Inclined surface 13 i comprises re ;3, lecting r7}oan:sI , for ~ex,r~ ,lt)le a r r~;77~;r'C I ;tisg 3 .3f:rfiC:3 . a(tlag as õ> ~, a mirror, to propagate the infrared HQ A to interaction space 3 and/or to direct 15 the ii" Ira; of vision of inn area. cam eras 19M, , i22 in ti its same direct ors so as to cover thie whole of =. it I action space 3=
I lfa support bar and complementary bar %1r.r can a i be .>>;,_ k` t facing ti~
~ one ti~riOt~y =c,l ("ii each Slave: of transparent panel 6 by means of (1==f c. `Ya nt ~f1( magnets (no 20 shown) situated for a.1 of le at each end of each bar, s .ndwidhing transparent panel 3x or more imply b,y n +celon.
He de corn Name. complementary bar c terably co nprkes a protection plate -14 t rc nsparter t to the infrared rad ation consider !, I =;te;t onto a botr i surface .f J of the . orllple.,ne!aõ'ry bar. i when illust ate in figure 3 upoert bar anal ciersrIh!y bar ^~ le of t.rG. ' =p,l~v~~r~,13~ y = panel on r i d 6, an +_I protection pl ate 1 `i = li ...s r ece .,, I ! d..: lin ea, 'rncl rieLi, sur ace 13 and n P { ri-e,ra +,~ ~l of pa(it~! 6. in -' i way rr.~'i r l~. c can Ws and 1(d_, iage i; ~-~el!
a yJ J this 'J ,~li,l'ilL.i i-~
in this r.cess and di tL b Correct operation of the interactive d' ice. in, .30 an !alion 1,vitihdouI r tt tion , l '(~ 14, ! e ' I
~ d 1 have if'iC,li;c.,(",s,~fr~?C_, 13 1, '~(~ ai I3.7'!u to be Si and ler~r.:flirl.. / would be e {~Iai,Cl p,.iat on E~zctõ? -.,L;='laf t of l ha d c',c-tl~~~r !.- ~Liar,y :c,t; Ult,if}'; positioning of incfned _stlur oc Its in tsie race, --is, whereas o o'iectioi`l I t ? i =t can be cleaned easily by ,ply using, a rag. Protecon ate 14, is Preferably inclined 15 W h respect to the i orizontai, this ncii tlt enabling mukance reflections in the fi;-;;d of vi io'n of infrared cameras M1 and TO to b eliminated.
(~ lei P y iy )! Y ^~ in '11113- use, ~~ the complementary bar vo llif~J tl 1~~.~111 i~~ to t~ I I
iai~: LS a ~~~J:'i tll?
transparent d' il 6 to !m ? 1 alas for example to .1r(" {iO5>~i[1t; (i L,uii f.
5, the electronic elements heinq s I 'i d in in"ernal space 8.
Fran 3 tar nt panel 6 can for exatnp he formed by a windmov pan,(.' of commercial commercial premises, a glass t~.'=, sheet "' % bin ' op, ora sof glass placed on the I
a 3'J if1 t_shind which a to chnical enclosure is located delineating the internal space of the device.
The embodiments described above present the advantage of protecting t e elements sen.siti` e to theft rui dam ?pia, such as cameras, screen, video tr l i ~1 1'ectei , +,..etc. By transferring their locai ~i. `!1 to (.w SI tt.17 lae.,l I !te'! space, ', they i e . v ! in fact no longer access.bie from a public am.
In generaal 1il~.t ';it, ~ prf~-C5" ie a1v l d C~iTi~.,e 1R and , ii2 J ., er, the c~ritt,l~~..i1t of ~ lyislf;:i; s`~ ~.1 -i:.
and of peripheral camera 9 in into na l pace-- 8 has, littl importance so long as the infrared cameras are directed in such a way as to cover inkracdon f space 3 and peripheral cam em cover' external environment 1 Direction {ll y r.
23 ~
i7ltr.ai'ad 1[ti, H12 arC/oI 'i'9(1% source 4 is performed by r:{1CC ii;g means able to be based on mirrors formir g the, roflecting part of a;i-nent 1 l Peripheral {;. ;era J r.;:'iOctini a ti t? ON ; dAti4 fz vvt'3 e Cat i in 'he ate visible range makes it nossiNe to ;r1 wy 3itCi' vision and to ans:ly>7O
external enviroment 7. Peripheral camera 9 ii. ':lily completes and enriches t e data horn the in ars[,i -Jir _ji ,13 can sz:, di?f ensioi, .l ;l; 1; }3t~1+fhnrj ,U '.I r1 li'1.(1. ,,.:i( 7. I he ':.,hree_ scam r'e o ..I -d by ip. it possible to A I set , al Wars tiny ,, .im r.g 1:.+; o .~;, cC ion space _ en of t ifl p(. vE>re s +~ Il.a ~!E(~: '~~i by 'ift3 ' i }fr z: _..Y,3~!1 a of i.r;` ,(ErõE',s to the õ.
~ J
~JE);~"~~.~ for uXti.i ir~irt. to ,.>.. - an ':E ~ of interaction :p-,.lue v-]'~
given user this area ~ then the ? cGfi ~. `~ .ftisEt a ln`t~ i to r J : ., of sr ~t the a ' ms - the +U n [,imr:in r Ii tt-u s .
Ac/? ordin to a t.l develop dent, `:,. a a' I S '( l camera, 9 enable s Mead eilvlt=,^jm,n.,r-)t 7 to be dvidena r:iro several sub volumes to classify the persons detected fr the p' 'r.aJ(E,1a ipheral . { .,, in d ~3. if "t l31., i 1 +tegof en,;v ai. =.a ccordii~~~E `'o a.t..a E C~ i 1 f ~1) 1 osha ;n in c-:C r ral eiiv'rC nrn,i-_,nr I. it is in porhoulai . {iss bl to distinguish the -J,iovvinci categories W ;, rs d r v, '')y an id 1~ r . A _' at r i is a f si'il oassi1 li-) in a4 P of tli 3 . i , at a f+,. i a; n? 1 i1 he latter and not pt", a. i g to show 3,, an or parson near the interactive Tice, f.e.
to {/t-:sualisl displayed by the display or placed l.i-.,7 airfa panel 6, A Hs,,s,i is :t dasi,e to iS rr t ;11Ph the interactiv i, 'd,t, Jv i .:Vnoi ( fi7 :.l fi r, io3 i(1 by l phAg his/heer tinge s in For piurposes the voii3if;:' can 1j_',r divided :nitJ , Jii.l'v.ltii i'ds ikaccd -~;,- at a ..iare or ;.-..._)7 large ttis-.,,. iCa t)af.,, .3, can cO(3stuu(eO by -_l (.)a ,r+a',ii. to '=l. Avis a fist v l u ns farthest a-,,;,waj from transparent ... aana ... con s( E..i,ris to an arm for _ .. . r.t i j, aJ~.-~r,.l s fby. if there ?:7 no person present i the vokm newer to panel of the surro!_ -.d gs , it ; l-?.yad. 1 ~._.; v,v, do no especially attract the alts Lion of p sse:i -by pris...ssin 3 in root of the panel, as the alter are too far a" u, A second volume, { +: s r to the indu-iv is a sociaied with close j passe s'.)Y. the, presence of a los.. I a., _, r-by is detected in Wks - oc } tng AM u7 r ! .7 can - 44 , _1+.,1} t~ 4.ity{ _ ,'itr ~
...; l,tSrld7 ~{.liii -'~ r ce7..n:
~?, ~~, t~.., ti. ..sir 9 ..,:.4.13.. t. : t ~ d.,i the or !i! or for axaIn IS to MUS6 a re 7 via a loudspeaker to i..._t_! '.E 4c attention ,i, dl?", ara. s;~:~ vsr. ..,, ~sr c3,;}1,., _. ,~.
,'~.i.~%1! in a third volume, &;en to trr nsp_{f .panel 6 than the vol(!i-ne, leads p roJ essir g circuit 5 to c n ides persons .,. tent!on be-e,) captured and that r.a/cui , can potentially inter'1ct i ;a õivy f ,f',,rl 3. Prt.csing i,ir( aIt 5 can Won ill?idj! d 'I`3 di lay to '39 ii. _j the r= i=õ aril 'io ;
,rrie on closer ., and f''eCUii"'= a i! <;r. A itJt~rlh volume c[ iit:`s?C;;ds to cliv previous-,!3/ ly'yT;'i~ Q
inter Mn space ft. The person hen becomes a us r, i.?. A person 'caving shown a AM? to interact with t! screen by his/her behaviur and whose hands, fingers or a hold object a( -a located in interaction spat': 3.
{A p~'' se By rye ans of peripheral camera 9, all the ele {`Ient,~ of the d: evict can _~r'C7~ t3,~c, `'r' I.I ~ y 3.1 f .1xt - ' s rs .. riche 1r d~t.i ...?.'LIiJ r' JI.)Itr di to ci., f~1~i,..i, and the ~~, ' ea ->i.. v can become r'tiuitbuser 'J' hil , at th same time rr aotinq We services o ovi dad to the it ivo1V'.,- ent aj' the person in .: iit ' (. iC rt.
isol ,a~
Ac '+,orf{,r'tC"s ti di'i' lop?ri,'r?t, i. 1:, dates not corn .,,prise it can thus be used in 'r Iliir t?';l t t!,I:,'ri.3;lr."7 for example objects, rind th _ re-. uitind interaction space 3 õt,rr J{7ri{j;3 ?I r7l (,) a v'olu,kme rr .?la !acirfe all the r4'Ljot. ..' 4lc 4iri: is a .ac .. , q11,`,, ~r,,1 ., all the _, r' t~ 3. l , ~ 3c in ;3i 171~i: sr manner to e device comprising display Y'i`id ens ac dl Can be analyzed J the c rocs .sing- circuit to provi d'' the, fa `r, for of Th i t 'r`=,r llil .' 4'i J` ith nit'rmat _ n t9.,; --I,ir... to t1. ,' interest shown by the ~(,!.,. the iff e t + !
-t ! s present iW 3 . a show ; n ,o'wc'. The r :atuiall f also t d mpri.. a miniature screen to enable ton ._ii ch _,t in i :e shop-window il; hen a { ur :point at he Obi- Ct ,~3i ss.;.erned i -rith his/her finger, This ~: J(h,4 ~ 4 e`' ;,,~p .9~ } ,an i.,.E,, or i _ d.~< =~ _ ,' -i. !..yi ~r;. . , rii :"J?!` t i.,l.
ay means, dlescrtU. d iu t,.' foregoing.
The invention is i limited to the . rtic iai ,move, but coot, guierai 'j ends 1O CO Or any ., ij :-ra wive rJOVIC comprising i display means or not, Wage t pft'r : n;' l =_'t, i _ ?st one interaction pace and means for +mdut ing an in-rar a _: Iq t _ ea `i dire.-,-A ad to wwaitds interaction r.. and Cl/ off.11 at least -3 jr _= ti 1.
3 spaue 3 ci~Jti;il(?g y at S.,,i i't~ ' ar'iii.(`o tj in the :v a.n 1'c~>'-infa,r~e ~d. Ti; ~,.~a?.iae t,,. rz, f..,.~,,,~ jeans a ., .,r`,~;f _ 1 mer- j ii,i':;r,s1 ~ at has,,' ii`t~lr are~i r~a;iit ~ ~~ ;~i and di i2 ,ovi;dnq interaction and s ace 3 1 I a , ~{ er t~ circuit 5 I, to ~ =~
col Ios ted to the ..'SY means `1 a ras 1 its ~.=1 a...J~~igro !i pC nel 6 deli tie. tes or, the one hand I.nisrz;io 3 iSij~I i environment 7, and c3. i ;i ~;,~:~ ,l' e am ,.:~..; . ~ i ~~
Hi on the other hand in ernal space t) in v l ii:.; i ight sour ;e 4, capture means and display means, if any, are e t ' i i?i capture, ~capture, ^ iTi~.+,'~..,~>
ns LiYt f,<~. er comprise a peripheral camera 9 for capturing images in the visible range reoresf native of , tterrial ' nvironment f .
? 8 ii '~_ 7trn ;i'it. with two , ` m and i : Wants o" ,hn L uI V
Yl i nt3 can i Is can ~J u the tfa.li, [pe of display I(1;, :j'<~itl5 ~.~t.,l screesl _ ns i ~I t tilafal` ~ and e ' n he c=' `e ''^ lJ: (f ca. ;,>7fC;: t v c,i"1 in i, ~,d.j., where them ar no display meaan's.
We of the de':/':C{., (-:.13;t'.,ises at , -:tst tf' to Steeps:
t.e infrared ..
30 rarl ~.,: yiti,a~? vs=~~ of r-2 by iil,ts:3i infr . yt,~ t.;e-I>^,1k:i'ms !
i l and li 2. al._ of images in :he xdoible range P3 by can r'a 9, of the i quired :-, 3e3.7, of the i ]rarei and Osk.- r... nge i,t ones to generate an image n es_nta ve of Mama! en` ironment 7 interaction space ;j, 26 tracking tai parsons situated in tai.: :' X.-''i nal ;flia Eil the i case a,J 1 ht: re the dance U iCil ot_a~'i'~!%_;aa - ~õ it comprises t.'~ means, 1`ii iCail of the d ,splay ec1 i<Iiig to tl, of erson , considered as users, at the anal of i, .,' ,tiden a e 3 or of tii:. ; el-nal'C"nVironlliont.
As the ;i . p es in real Me, Nose steps are repeated c Ciicaly and no are processed by t! is processing circuit.
-i!?~ ;w+4 Gt', ,. _.3 .s+~ 1] iii~;fl~~(., L;~d fli ~<., ,. ~~! a :t_.4?it ~
=+il lids ;r lirdi~~.:7';( i,.. ~{~ .3.11 l,~ ~,ii--..~I~(lf t1._..(i~1-.~.-5 ,_a.,~.x_,1..~ G;., ,~?~+lt~,.._ .ii .7...
,....1,,,..i tia _. _ _~.,~{=: 31 .. cai h ~e i 1of . j`J =` 1 ,t);ay y ;i'=,t s oat..t.,,..s r, ti. i, ;:3 3'i00ae Jinq i ircuit 5 tl=+õJ w. 1 1 ,;zas ais i i +sj.... r 1..~
=;1,:.,.,, bal ~ ~r,1.7i ... if-1 i, ~, 3.C;
_',1111 ~nd coi.tro!s the di pia, if,_:liY_II~G .i) ..1 :_i_(:d. `. :t si l e 3 3 i~r=.f mv~roni. m. 11+. ~j.',l h. ! ~,N ~a, >> . ~ "ii 7 ..~~` . r .w' 1 t ~.)~. t , at to give l 4: ne i., Comprise ~O'11,IskAn :. J _., 7 u-id IOli 1!, _.;: `i in'ia955 c0 ,=11'I i 1(01(1 inn aced came as 13 7 ld !R.2 and 'n acquisition ,tr p F3 o ail image if i he . ' c~ -I.'~ .i i he r f t a i.e..1 r ,f I i.
Ii) Vi31i~1'3 ~aiiij'~` i~(a~ii ~r?11is ~'~.~ ..~~i., s(:a ~. , i"~~;
._j!s<<=tc;t [ ~filu(;,l ;;~ 13t,.. ,.1 _, .Ca are then proces 'd iii an image p iace3sing step ._ -. to recti y the i f ag hnd 'then dettte mine Iii#' position of the handdi fingers p rsons et. close to interaction ~pac~; 3. From th ,-'suits of th' image p'!'oc ssing tep, an -ifi'1m.. 1 J Step `-.5 de, e ties t fi a ent p ' es o1 eca. e - s nt ....4õ!1t~ti'' a.r~ t_ cI ~t~i i i~il vc,=~s ! 1 ?y, t,~i; _.I . ); ~'L, tl,a,~a .. r:, f'); ~.,': ~`?i i ~ )I'r'ate .~1 i in Cite,' field o viõion of Sri ~hamI caul ra .. I or example purposes, the r C i. ": 1 r~. 'yr e 1 1 3.. f x g '1 r g a ,. r_'~ = i } 1..
(; t~.~ , ..~ i t.l ~. ,ec 1 ~ 3 5i",. 1:11 i5 aõ , _, ., ail 1 ,~`7.._ ~
~,~C;if:~ 131 t.tt, ,.C,11 ;;i i ,ategory, kiss)term'ained a., oxwnpi : ccording tr.3 ~i.>13~-,i 1 ~'s ~)bal ,_t~~~ ..11 _.1 ce.
_ t.,. the - s R s i = ' a. .1 r a - - e =e. 4 - '_ ;~1 ~ ail ITI,~ITa tli~, 1~.,.a7~~1..3 le lli~:3.~ ~`(:~G,.,.3.`silit~
.di:.~~_ T~ .~i'f~ 3,~ .,t.'>~ av.t: (~~3 .., 3:;
~. ;
:~iii"~+, `.:1. sY{i_. ,t_.3 4.{`!t_.l '._li ti"''~ 1 , '~.~.~,s õl,;! ,l"' _ õI 5;,,,... '; _. ii~~=', .,,l,~s.:!a.`?:;
2i t~ f r or ? f ..:( f+% 4 to i(_ ii' user, ' V (,.i l?13':11 Cl~~e 1111 ajos !'1 (it l i in r el ~+_.~ (_,Gli 1 .a. -",'? ?, i Ina 1 2 Ind t o i..' e ii+ or ~ a..l.-ac os r/, and1 r,,._:::{`~ t e t.. 1. ~uon 1~ i' =r): _ 1;`':, r (t };;9i`l'li'/ to l .'.'.mil ,-;c C??I::' :-1 -~.il .heir prnvi!-_i,:: oceitlon (at a ti?I , i .or' ex`?7i-+f.Sl.,'} -a3r_t3 ..~
_.a.~ in wh ch +i crev ous ,. ~_ 1 ;_i ,e,.. 4i z=. e u ~'d ?ted i. . ', ` . . i dat " th e 1 ~ _.._ a~r~ ! a... 37 sir _a,...~ lli~J V-J , i, ~~7. i3 .:~
1'~.ia h -1:- 1 - to e n ct i1 .} f.Y.). ,~, r o 1 .. f. 1 ._.11L<~, - i~: lhU+,-a 1~~~, .,~õ ._.. ., ... 1{) (! i~ .,~.-I__ii1'.:~ _i ., ;i', proc ssina ,i3cuit 5 is at, . 1, _ .,, o . i .l .... kki 1-.-t of ;he u r s ti/' 3'i 4; its i t g a , ".
al~C 3{~õ _ .~ o;;~ T lx?Ja~41h )~f~E,'i,-r.s ~1 ,,,.1.,~=f ,, a,..~l:
~.'la;l~ I :iTeC, i., .ai`., ?~
upd to the 13 pl jt.. or ilild 1 1 . rail ttvr ;;'3 ooa5 t( i -r~ .~ ~ _ . {~ ,t,,:] I it - ~(' i ~ ~ c L~ ~_J, in ~~i~ _,tt<I,~ 9,C. ~-) ~-~1 is{:_-_ .~._~, '.i i~;~~ .? i ... u,1 .> 11, =.1.x,:.7 i_a.>+.. ~:.~,~ ls~ -t .. ,ila` ~~'~
yl.l 11:jt,::., Oi i3~~~~~a_'t:7 '.;il ,;ci,t.,',il-:.tC 3 ;.fi. ,t:~l', 'f 'i,- _;:;C CJ i1,~' ~ `1d,3C)rl Ll:.t3 it'i:`,i';:' 1fG;i " y A. ,.hSet YY .. nIy J t/' `//e c i /^ a ~ r .`.t.y:~~-.~ .) +:~.I S{. i~~ (. l]i:_+l...t V't 91...1 r4.;1 1-~1.)~,.41 tl lis J'~> ~,=t~,:J S':1, 1111.1tf1.7 ~~1i~'~!{~``~ ~~i C;iS awiriea(c, ra~,r.~.i_:ili utit ot fal~ '9 ~ i 1;~i3ar,si for _9~ ..
~,i?~~;lay, The proximity i t~
index is represent_iiive of h `-, J I tl i i re ` ct 3 -p ce l~1 irlt i'?.,ai )il 3 '~..==~
and used 7 for .il l l'v} ~ to atto I li?1 to attract t.9 ; t'on'-ion of persons ace ding to iiyl i! i3 ii -r st for the di plat I or ( to 4, it he aosen of parsons in Not of the lie-clay ;. reen, t3 :rebj "_,voiding false detections of I_- `_ier,, if no is in It ,Sct>>.t t..t~1~11 zpcz"4_,. 3.
in processing step E, the lils,~red images from each in rared camara !H'! and l3s". are each rs,ctLl. fie toi9y (Maps ` S off ~. and 9), as illustrated by .~ ~a~3<'tir rrsiv L~U
i;
the diagram figure 81 to to e ) s': of the viewing angle of cameras and i32. Rectification of the images provided by camera; 131 and 1732 c .fl them by be performed by applying a 4x4 projection matrix to each pixel. 1 e i"e3L.!lt- age, to a detection area a Ot" .~'tc'i ri~Cj iGrreL~U(?i1r~~~, for each h relied ir`. i !!' parallel to panel 6, corresponding to interaction space 3 and able to be of 153 Substantially equal : ije tot e display Surface which can be arranged facing intorn.Ction space 3.
i i?e Projection matrix is preferably {hailed by t: i's: rating the device. A
first calibration e si - J e "?e sc ' :~l`:i1 consists i5fin determining ,~.~r.~(tlcJr. areas close 'o s~creeri, 2, in L)c9. _ _ r -'a !`_i,..i.c:. W ,_~.~1 ,. , iC,v .Cltk.ica..,sLil s ... ..~p c' 11 Gq,i11r ci.~Lri is a-i <f,iUirri '.f by placing an infrared .; - size .:oai õ:~t 1r_an s lareent panes l i, fat,l,, ntg ea,( "h tic e,imi iit~er i~ ,~ small .~ ~` i _ the four edges of the display ,surfai, of the display mean`>, and by activating the W or so that it is detected by infra. ,d camel as i[ti and ;32. F he 1 as,itioin in t-v' o dii"( ens?ons t'r' of the cori`..,~~ onding signals in the two c ri :~ponding i , 25 images ~ is d,t e3s:.i:.. r y binizint~ -~ the i sia.~ cr ire? by infrared c.~ar m1 , i d by ~õ 4~,'ge" ." ~.~=_...t.ffiz,::9 eras 131 4-i1( it s~? JV' ,,: rri the ~ infrared e;. IsIt,~r l5 ?A3!%S1 a rani, thod (,of to al or global t f .), and by analyzing tiros' . 1 ages in connected components. Once the four ,iositious (x,y) corresponding to the four cornier s, (? ..}s,: e be 11 obtai. ?..:.1, a Mume t~,rming th a etec..ion area (interaction pace) ii frare mem.
Wit? in he ailfiramd range ;s, t e m' ned by calculation for each c For each camera, the davice will ignore data c a~hi;LlL.irt;ed outside the tti;;
CC(r spo `i ng iJolu e. The t -3u3 Col ,a s are e } M caiCula to the 4 I
projection fl ia.i.,sõ nabiinq the Wac o acquired by, !h.. infrared cary,,sD
as .J be rectified ucf orcung to theft posi`io 1.
A second step coi ci in Pointing ' succession of v, les displayed on the display surface (or scr -_ en 1 ) o a ced behind (film trans transparent , t_ _.C ion .( 3 s iiillJl-I. L i1ah'i circ!es _ ro displayed in areas c ose to the col ;,,ors of the display 7! ll i c and are used to t aicutate a horn gi apf y matrix. 1 h ,' t ii i =1 circles F e used to calculate parameters of a quadratic correction able to I a r 'o sod ,le a ~,, ~,d by a second degree polynomial on x and y.
After ca lbration, the parameters of the two projection matrices (one for each infrared Came a ) of the htiarnagraphy matrix and of the quadratic correction polynomial are stored in a cadiiora,05 n d t- bases 9 (figs}re 8) and are used to redly the infrared images from ;_,:,!!!C i 1 ~ l I i and iii-} in stops E8 and E9.
The ' advantage of this ~'zxii.'~i'.`.?tii)(1 3~i.~'a, =Ci,i is to eitis iJle the device to be calibrated simply U',==ilhoi_,'t knowing the location the carneras when -k. ?!};>Caic'xlir() ili _h8 ds 'J' i's is pic.'rlCJiafled, for v,t,,.:}pi,l:,? in : sf{v.) wii`idi(}.rj so) long as intei rn ctioi ~ "~Jc,!.,e 7 3 5 is s c+õJ- ?re.
.f it both by cameras I,"1 and 1ii2 and by light source Ws calibration 1tlha enables ass time to be pent in plant', hen the device, as calibration no lon . f has to be per ormed. T hi method 1 eth; r enables an device on site to be easily r"acali`)ratrst .
After rcCi! ssczti) pr1 of li.t.., ifil is'~3aL 'images .a y', i'~ , cr;~l_a e<~, the ~, different -~
are synchronized in a video flux ,yncr io, lisaiion stars E i 0. -f -he imam .r souring -l , from the t_iif eron infrared ca;?ncras are then assembled in a singl Wage called CI.Jfn ~osi, imago _nt the rest of t ho u,rJai., ~J e:3 .:lr=i g is carried .d out ~..', . ,fi;.si 30 Composite image.
The cofli;)nOW i7i gO 07 W n Wed a, _ to , ai.i,,, the iikYa. se_ .v;~ ~ n =
the Noll of vision of the ,alneras ;',! th of !;'lanes pay.?d J to :_ nel J
(;: ,_!J F--11) to "1'Sii se, I_ i al i if1 i _ i A; each r): aII a fwallo, a "~-^-3 . ,a N f.3I ind -"age i' ,".o1,~ ''! the f; ; ar -r y to a i.I8 l s,i (.i-.e ~. .s~3c.y~,. .... J'; .ai. .? _. .a' the iuaaffei!~ i a'? end of flits pai ne are lower than 5~.. lath u{.Edrag a given i.?i f _{/`~ with the .}t; l ai:t 3i i ,llel plõ,"s l ~] ail PF 3,a~ .I'+f1 3-f - f i i. .~ tin a co i i t_i r, {1 if^~mn , r r's 1 /\ d-' '?th Wage is tih.=e i"1 J )sr:;(ui~~.t"tA _(step i_' 12) by a.as roconsiruction by grouping the intersections with the obtained planes and applying ,~ic: U3i,t~~~i~, 1 i r11c1~"J 1 aim õ!.. ," er..,7I11~. i,1.3 .,.~ 4 ~f~[~l Wage Cj~ 'tiF-.'r3t !~i"1 :.,iv,;? tr_ (EA
i2l pr -: 9 Drably uses the image provided by peripheral camera 9 and analyzes the i~a .~~j!"t's{_n~f inter as's,"t of this ii.[.~ti, 1 -e _ "ff.~'.. ~ dint to We ~>; i ?h ~ ( ` ev?~?..1:i 1 1i } a~~. c? '`1. es_ t .C Y eiij1E'.c'naZ
fi f; , ~C`3~f a i 15 wrong niet c?hons in the Apt image.
-.i he depth image is then s u N a c ed to a ti3iesho id g ap t 3'' iii /hih each plane of the f: e th An age i ; WNW by i:hramshold'i lg of glob".' l or local _y :e, dkpC nli 6ni'~ On t3 aim, light r ~(Jn`a tE..`iiJ for each _ ea{.ai Plia Fs? Of T7 image or by detection t`! movements with a ioirm filter. Analysis of .f the i;imag acquired by r eni /,;, mi came a lj?riai 3 pros s in i.1 !, )I
adjusted and he t e day to , t,.aiken id a acc JI a subsequently enabling a hoiel of Ire regions of i ite est.
ti l! esi iol ing st.,. p __ is 'the ni.,1 .es of , f?e ?.final ,zed C.. ~pth Ii f age are analyzed in cons . _.ct ~`.d ..n? i iponan( = e ~. 3 i known mnan I f r fia y.sis in l,i ary Sconnect.e ,cfi3t,onents on bl s i cons to b_ c, .;aced by :jr ;i rnnll pixels having yinAl_.3 pro iei tic , r d enables a set of regions of r si;~' than a fixed ti?m..,3`to, H ~-Md_;i>? pr'fiic=u!ari,;, all lila regions of ne We t,''af~1 the re i as eii ._ _:1 l fiir.xe '4d i;i,irlJi{~t, ~-{ t.õt1g 1 e rati,en,arltiva if i er 'J1 itncl: is in. rrilaion _oeco 3 In y c once mv'i a ..i..i. s of IS ;. ii, ;tyi Ilid A A) f on ten , S wHa NMI dii ..,+?ni, +i4,3 _ _.:f I ~ I f .! I _.9G c I iL
areas . ,_9 5PorIi0c" i0" 1,?{ to h by Jr J9 o Yhr of [37 _. U., i3 .. ,~i7 3._~.,. 'ii it to .t,~ :' !"i'ti11.i ..,J '.f' .
_ r a h nd or ~ ~ a '-7 1i,!,-~
._ ,:,,'. {>Y ~_ r ~~ y.:xl..: __ ~ :I is , into: ed by (:oia'a ar'i- g the t .- '., , if ' the fti=eo. =~ +~ ' !nn _ .) f9a~ size t3"i t(6_ region is ,.ea.,l'.;i` H); t1 fi/,aigiC?,1 'x;/91, be labeled as being a hand (step Ft 15), and if We size of t ho refi;o l is s rvialke than the fixed tf esi h.t3lCif_he !on C is l9a u f~~ - ' ed as -,aing a finger (ris_ap i . i air. , a.~ f=:, i G), Vi 10 thresholds spoC3(:~ (C) ( example for a Ci Aida to the ICl'c?aCl size of a hand, and for a finger to the mean size of a "(0gef .
I5 He coord..na c,, e:~ ~. r f'iu ,> ~. i2i; _!lli:~ to each i e entative of a han(~ or ., each ._j~a~; ~ representative Y a li iYJr are ;r~.9i~,.'~ralt: for :~.':~7 infrared' ~.. ~,>a911(3i". C!~a'; the ~ rõ ti ~a +`.. , initrv;, i.'ni ion of The region and associate it AM a i ocRa r .! o the display õo !i"i_.c:;, ,9 dn;9 _oriit with As co?osctmon is ,,pp ed "I roI n i e c ord'n_ar os A We regions in the - 3.- .', o 3 images (Mae' of ,I ,.., ~,z,, ~~ ?aC~ ~,.>'._, at i; (i : r?xai 9 i;.r."1 Steps El, :5 an."! _.. ;., its ^ny fl - i af9d ,`t's 7L '-1.... r3 for 13 of lA!t.. Vii.v e~.~
- ."'..3~~ and .
eve iiis are then analyzed ',.-,.y Si/hiI^;f i ~. ua;l it ion ' 'I.h the ,Jf,.,vl i "!a s position and ~s i. >. (ia,li ~Jheth r upcaa,_tinct of the Wf a has to be petl`o 9,ied, !.a. .'!h ...er a 9_._: `'ti _ Lion 'has i';een L`'.etC,cted.
I'; iõ f di),'I l ,1fa?:~(aif~ 3(viii~>>ib.'t(ii.~t~ii:11 -i_ii~i,..d]d ds111) qi adi't3.i!: i;iirj't?t,t9(ji7 ..,IIc.sJiJe:i iil red t.: ;. > ,51 and 512 to he paced without {,~,.1 Ili .heir /;'.. ,= in i Was 3 '~ :~i= 't`ail of !l'e '-, 3~?11ii:o ~?clillj st9i14(~1 ~( This ,71 {i atio of die de v i - 'af f { ..,y.
6 ri Ely Q. ~ - .) the ; ire ' i co ?y i !ii. ,tli(; of ~ ~~`.. ., ...~, _ r ._ S,ajlf"_ is ._' tirigu _.h i fifers (iv.3i51 ii, f'3 or 501 " .,. in t ' I i s L _o 1 , d>r.,l s ii g t ,i_ it 5 is r i'0 ye, t -1 J,. CJI t_:vt..i )t i3 sii vd Wfi.cii W rent U. rs ti?.._:G pointers + c1! J to. 'h, .i li ; 'is, &D r I d F Jri ii .. ! por:,.fir-.i_.
ri camera 9 ON thoort , o+c: [,ei of the ,nii a, od mores 3 . p Et f. As liiilvdi teid in fi'iur'e 9, processing of the image fro, i cot iphar camera 9 first of all comprises a spherical +.t rep do stop 1117, A
particular when the peripheral camera comprises a wide ans~ la lens. !ti's choice of equipping the perip erc.i camera with a lens i s in fact judicious as the wide an"j e enables a larger external environment to be covered. However, this type of lens causes a par sp.,ctive effect tending to i s make different planes of th se. ine imzy eai i~3f 'ihet a !: 7P) tiil one e .-; 3.~ _, another than they really are, tokssco,,lc which rather tend to Squeeos the . u jects cloy.., to one - i othe( in one ed:'_~ he gem Plana, !
his spherical d.: formation is preferably eciili eC, d i deformation in known manner by a second polynomial, 'r hich takes the distance 20 bet een ti current point and the center of the inat ge on input each pl"
of t the i3 ~: tee, t ld which sends beck the ...?..)i. _c e between the t ' of t i imago `'r' and _i. s current POW. The c).,< d1i.'-d i a`dgo _. rin is Then recorded in circuit J
i ~
;, e ~, r I ~I ,.~, Ws o The .z ; {,.)I iet,t t-tif, .,' imri btain ..e in ws WY 43 then also used to p-~,.i~l"ter iii a segme d.,ceI Map 'L-- i >; This -} i bi ice e corrected mace i,a step, E-17 so as to di crim ina`t bebvl ,e n th,-) background ~ln,d the for +.) t_,_nd. i Il., ii t egiou ld cconspond to a pan of ~...,~
>i environment 7 in '+ lhich the f.'.. :,cred 'correspond., jr o users ,or ,,, [ .a .Sel"s lbyl, }iv h' :i _:xas is -i r prc sc;ra itiG'n of ft3 7 .1 #
n (;~ i .i t.. ~
1C;, i pout of a background :fsFe ~ ~` ~'_t.t{i ~1:`'=, etc. A
,hi_CJ . ~~ the T,."3 r orn, i1.19t cdaafir ild.;t.; the I`;ein~'ants jr) !fie t.-,zit- of arc considered 1 n,, !co,, - jr ovr r ...i. an auhnnobde Midi passe.., M rough and when leav s .fa field of QK', it 1ios_;bÃ.;
ii"it:ii`7 of Mset. c e ry ,s., _ ili ,i ,..i OR for r presuntId ir1 ;l i< 1. ern of - 3iipsCei.
in On corrlpietion of segrnerrtai.nn skip 19, I? a change of light conditions is i tnv i i {~ i i l ri to E13 vu, the ;knobs, or is c.l .fen rat: dlli g _iL rll in thresz of ing ~ is preferabi;J updated.
Aft- segmentation step l9, processing of the image from the ri `hera~
camera r C ~~fo,i.r`, of ms_.~s,; t t= "_ _r~~i, c, 15 ccomprises an up i.~t; .C l f ret~ior1:~ of itii--.r, 1-he c r Vii. ates (carver, size, of ien aVofn) legions of i! ffer ..t co to eponding in [he cur rent in a r are a w ed in (da o.b ase L--21). By ,C,rri ~ Ii 1.rg~ =i ' t(. i4.. i - f `' irnrngq ` ges (C.?-.tar., -:_Y?i) with the ; courant ittage, A is the reby to pe rt,~iil tracking of parsons (step E722 by s_lotcc',ion of I law persons can , e. fot'f f,eu fig step E22 l~Y ep yif'tj a zero c.,r der r': ?ii ' =n niter on e 3t. ii of By cc"f n 3t ::o. f 4'1,+.i1 t iz pr, VIOU of the , ~ -dam ,,.
pre" :'rea the now 0 0 din :tf s in tt ; current idf ge.
JiCõ"fi [fh:,' by track g and of >"i"~,:si,s, trle position ~,._.. , and u 'f 'hen of _ _'d E24 of each person in the refoxi iffy of Mier, 3 t Ofl space J can b teri,i ncd. The need of the r. ;r,. Ins in !r'. r .rox j tf'I of .ncerat tit rl space 3 is obtained by r,i.: tcu :.ling the iberv1n t. 10 the .~l'o ,lir at "s of 0 -'.) gil..'+ns of inn'õ _ et at the currant r~l s-in !il with to tf Previous 1oenf;i. The f i: on of tine. parsons in the ?. roxi ni t't y of is dei~,-}} no:.<3 To ~3~...I d by the I arv':.c 1. of for ef`./=,. 1-trr,1~,J.le is i,..'..~ Ilti ~.:a\ on ~ '... a on the Jr ii o[15 ?"'_;sao53, W o speed of move at and U e bis lat.. sd im gc ,) o btain`ed in seMn,Mon :jet} E!9. A enti ier is aSSOciotod An each region of interest -natANg rxi o . is precise region to he, nar gol Ilia(l.
= of I i,t, c)f i l.-.'+.qe._ aid during .-f ei' '-_ ramping stop 1`--6 and actiiii`v'ri y [ ,.9 .~_~: ..ice be p ii. 1 ned.
i?1 in background/foreground z gmentut!ofl W p, _. 9 ea pixcel of the 1.=' e is defined (P25) by its color components. An element corresponding to a ;loud of points in -a color space (R,GB or AN) to determine whether a pixel belongs to an element, the color components of this pixel are compared vjith those of a nearby elen)t.'nt, La. the rninit-n i n. distance of which with the pixel i is smaller than a pradefirÃed threshold. The el- are then in a 3Ioiff1 of a cylinder and can 1. i 1 tf = s ex be ' E~1~,t~ct"~ in _~li~u - ways, for foreground, background and non-pert 3 -,.rye nt backgrou>`i+.t.
1 ...it; ~~tl i.ii k~ ' r it t "3 ,r nt tion s+i i7Yi a~ The ~.` s' ><~ti t'.sr ~L ~J IJ
. is illustrated in figure 10. MA , for each pi,Ci of the corr-.ctded iind,,g from peripheral carer 9, a. fir P26) will ifl .,, roga._ a t : t abase of th x its?,"'dn b stc; cirooulnd to r or n M As pi,-,el is, pall of an e'i-..,ne: it of the i.5 if this pix ,i is part of an el f7 ent Of the .'.. WG"KG JMU,'Id (yes t.,1 tput of step E26), then the database comprising ing t 'he characteristics of the f)adkgroui d is updated (step P27). if not (no ou put vi step E26), the pixel i-s studied to chock wheMar its col Jr c oaipo;ients are close to an a: ,mieni b longing to the nof' pe nta.,nenIt background (`tel) ENS). if the pixel is considered as being dil eleil.=tt . of f t¾. tl)t, ~ non-p- e,:a j =~. } -.1 g fo n r (y 1[6~i% i of then }h ,l.,nt=.eIi'iT'.;,ll.:;il.. rt,c..~r c~._.L1l~;t.f \~~'~ c.~t{b s' ott:+~~ [-28), th,il the d isappsarance time of this ~:itnent is (Step !. 29). If the di sappe ra ~l_;
``}.
time is greater than or equal to _ rife i. l ems' t.innt (Y-',-'S ou!~P-'-"!
Of step ofis.;, i~31_ in E2% a too t is _lme rl.in is e - t iron' of The non -:1 nanent back gid~i_in,t_l ~a sit. grow .+_ \;i11 is prosent (yes Wput of stop O) s -= 'S. t '-, Way If not (no output of Edo), 'n We > element is present in the p ' e of the eon ve naa .' t alein-e; l., the r"on.
, ~'nwom(33 clement is . 1 erased Kai .asp.l the l -per manX,17t ~ - .-~tiLri~,..~:!
t;l l.jt{.t lltl (Step ":'3C 3).
if on ti`l:` other hand the disappearance time is riot greater than the rejection 1ii1-1..,e (no output t is made to ta. eYiili( ?e of Map J P~,r,'.~ :~',, a test l.~ de whether the occurrence interval is greater than a predefined threshold (step E31).
occurrence interval represents the maximum time interval between two occur ences of an element versus time in a binary presence-absence i succession. Thus, for a fixed' :lem nt, an aiutornobile passing '/'Jill cause -:1 disappearance of the object followed by a rapid r`r appearanc?, and this element will preferably not b a taken into account by the device. According to enp e, a ~ - r r, and s 'tacrj t_, `+U)ii' c, ::di~~~ an 31.,c,ifit,a~3f;~le 1)~,(f re~,+~1 for a õ ~~ :;1?rl ti3'iic tf(:a another ., ... ,.,( <ir=..~1{~., ei .
away becomes a r Ji- ile object the oc'i e 'e interval of df which ' icl 4y C'Jilies 7 e ~ i. c:".
0 : rge rvloverneiif the leaves i f e will a small s ,o.. .,1_3t r;l ~o l` of a .t"
it 1terva , etc.
if th; occurrence interval is sithan a CsHbu, _lhrr, (?o!ra (no output of _.; t ), then the pixel is ;oi i sider'e d as Wang pat of a non p reran-ent 25 background clement and till, is i_i dated (Step 31a) Wing account of than oioces d pixel. if not (~ s outtput stop Ed 1)i the pixel is considered as for ming part of a foreground'. element and the foreground is updated (seep? E309 taking account of the processed pixel. If the fi rerjs" o1,!i l fi;.,. nt do s not ;i ist, a {i ' 1 ,'Iron t eve i. ;t 30 eater' (step Ed1c ,,_l st3 .' :' if _j i,... t_ .!.,~j I_-..:,i cloa not mm pan W the f,,.,;1 ,oimaTl":'iii i)crr . ~i r.iri(i I( 1 itcut of is to -, QEP :J m W._.n .i.r {Ing o :(? n.+ ,i c . (Map 102Y it no fe round alsment SAW (m) ouiput of "a is J Ã,st.api Oft io). in Ilie case 11 Cm No 10of lto I " s to ..,(I
o,= pros .d e,e,. en (yen o0y!u i< ter Irlli lr ine ;vl~,i!c:i ,-põ'3,_:..;e of (i?!-, .:,,:i.,1,1 is l+1'3õ!> than ar., i ~, ~, IJi ai ce -.ra a :iai (r k3.)I. ii 1, i,., (t C~~.t' 'cy is t11a n or qu 1 to th a ,G +s17t'4;v' dma Nos ':lip of step E331 the i .,, considered as -in forming pout of a non-p.,tm%ane element and 'the Y
ai-p arri:nent background is updated (step EASY if not, the frequency being lover than the acceptance (no output of step L-.33), the pixel is considered as forming pa' of in existing foreground eletl ent and the for e jrou,'id is i_. pdakd j,vith the ti,.Isata of this pi: of (step 03,1 b) This al jor khro, executed far e.xaf ole at each image ca= ture thy processing circuit 5, makes it possible to r~iatiogr_it it the cli'h"-Oreot ~. ;rri. i!fG
in the course {J tai i 12) ., ., .d to a.7sti+s,ai e Him wit .hair c4 w, a:oi h;il 1g ,(Ji :..l..ia A h{%il ground) rJ~lria :dl r 14 Ss cad _~Iti llf lt~ ;rEU` I ( I ,:I s It '::,~ thus rlr~it '., (v;i?, :;so, u(y as ve ~
r be ,t_ a ir-sJ't:_r 20 merllant before being considered ,., '.'!hat it . ?taUY is, i.e. 21 iioli i ...rmar.6r:>.
ba{ I<,,trrl_Il d o:N nont, if its 1r' ue cf of ocomence is 410-1.
The + I ,I =trg ~f,~l. y. ~ rr - e'I.f~~r r S~ a' yiy+ fy._If limited to r V
..r ~.-~.,y3 tom'fl.. l is s '. rSLaI ~ = u Y.~.i.~d ,r J Vie al, jerilhrn illustrated in rigui- Iii but .;.<fr be by a ++ known type c-4 r 'e pct, < js'( 1.4 :LI~siJ iUiaia s, eg bier Ita In s ,:s 'or a to 1'f':r r in the ' _a.,~l . r,..- `Il~i=.~ C ~~ a'- Jsr i. _i i docuil._ n "Real time loragi >>7nii..b cke!roun(s i, l'! _:t'Gil using model by Kim tai al= puNish ad in " Real W o mnLi.r-ic c!ui.l... i i, pages 17,21 to 185 in. une 2006.
A a i 11 G r /t.~. ,r 1,.,I J e,-. i,)i ~~l.i. $l..i segmentation process as) i._ =:tl I li g process ca 'ti Iated cy, ~ li I r. 1 his process he one 1 1 enables the 'o:9 pei r. m ..,-`..j y P '_;i s the ,~ v..~ir ii of !. i a- ete i.a ei? i"lJi r +...11. Jp'' hus, as !l _,..:?t. 3ted r f {}a lre 11, for =. 3. p0 d .:?r apea r- M F':
Naga _. _aile1:', it is .,, .. ..=._ d 1=..,_..w. 1ii na a pal of ,-,I
' -. 1t:, .~t .. n J_ ;_1ltt, ;i`11Vra ~ si_,.`i z.. r., ,3 :I .,. ...i or of s Q 934) the o1 y nd,i :.l ba ' go and t -ment is l.. Aihed (st ~J .ti35). d~ = .~ l 7<_ , of Pao of i:.., ~iarricn (no a step E35 or 936, the I ccuL-' 1Oi;CS A larval of the , lament as;t;c,at-ed '+/ ith the piS tested (.., 7t~~). if , . Us interval i3 i .. 5 " ies'n(?il yes ~1~G'1(step _f~.f~iE?1' than Kw ~.~!t~ ~iis _iil~.- a C.
output of step E37), the element is incl1} ~d in the background h ea,J~a (Steil?
E-33). !i on the other hand the interval is greater th::'.I the threshold i (n'`~; ' o;st ..l y- i.;ii.~
l} f step E37 , t :i4 ~e lvi{ra ii is , -i T 3 9).
A'st~~f4 r 7) `
7PJ' *~l~Z~t.,- ."7'~9)I':g step ~. F has been ~,..-,1 {~3 i'~,'jY1..7 (tigure 7), S.r ',a images horn ` it I ?7 '.~ cat lem 9 can i be used JJ t + ii?fi ire )rope: tle's with a person. By anal /_ng tl !)c:; i?i I a .:C':'. cai f i 1C.l ? lolo d C:. rig circuit can thus at ,:,- t approxim ta'iy ': syr r!l+ hi ;i`i r _> eta' ", ,d o Vession al cats Joiy in di... to display matching this ~St r :i ~o l~.
20 This aln_tiysis col, espofds to din r it, '= "i` _5 ihuotrated in gmaWr detail in figure 1,2. uses TIfr r iiv'J3 ri fi Ind:, e is st. >:J t._.. i3 J of 9 an r.J. ..+
y '"
d~i.;;~..;t}i ?,rf the persons :d -." n'- -i; r3,.~ oYnn CO;CU:OtiOfl _( .. 'sot' spondences _'(;.j to ..,.-~ ect f.!}'~ bode, of the ( ii" r nt persons (stop 940), iheil for each ~ilit.,i it l',rJ
es body (ste J [/4 1 ). From l ti ti. and al t., eir ass ociat+ion .:Ith their .~
:tf t-1:-.:;+ { ti, v ,4-if., ..
.S yam( y~n.: 1, ms s C-r:t{ i for "'ho t "+'sit~~; , ' i age (' s ? orte.,.,-.;i 1 P.._j r :;*. ~ MY, t_f~l '' E43) 3E43) ~ and -~,o: ~t; .. ,ifl ~i ",a Magog (S PQ ~T{ if 'h;
.
persons (step 91.3 -.#) . n J create a t ecto! i t g ~ :. erit~. ti e of t e tll tre , o the oersons (step E:"';5) in t.. Person By the t.l Property vo õ}i, of $ it is t-'get c nten'i tliSit in more likely to in,-,rest hii-iliher.
of ;h reovent areas zones u; the 6w) fore , ~ 3 ., f;sr~Jrriri:.< t 1) t:., 1P.' S the i{ ) s .,,i;"BC: C}
Tt~i~~rJu~.~ ~n i , can ~. t ~`..,~r3 .ti.,~ ._ n, .1:_ .~,r~
ii t;!c~~,liri ,,f . _. ({ `t .t !t .
!1i~".;aj ~ I in ' ,. !r f'',v!f, 'v,; M -a and don, associate an area &Nac'6,-.n a i{ an , _ a of the dis pay eru a \. qh each parson . Ti-Js i during ,'t rgin l .tap EEO of Qum) 're !y. From t e p s ion data of hands (E15) and Agars (AM, this .. aYa+Jl:..,' i lacking of toe hand and Ii era to be ind' 3;orc'iat'e3 lh na3;f_!s finicers with a identified ivv peripheral corners (823). Y. ;;v,ral t,- ' r.-..t f i a s! an!
TSvr1 t, 311 ti,u::~ in.,fi.(~l in s~~?r`.1is" r,faf. ii >t1 _ ~.~,~} 3 mss, ~ :'~
"'v ` m! en , of their taand`/fingert-, can be processed by processirng circuit 5.
Tracking of the r, ovfrer i:ents of l:=_= hands a11d or fingers =enables it to be d, terrnined %a heat the user is doing in interaction space 3, for example towards W at q'at t e/she is pointing War finger an object, at bj`.~ct, and, ;
eI~C:J area 3=_.. ~-I Ies v nirn/her to be provided wab data associated ;'rutty tia'~7i at l= ,Crone is looking at on r, display. s,~,ochdon of (ar Q fin,s or .c with ut lisor can performed by measuring coordinates of the hands! fingora/objt cts, %:,A 11h.
each new image, sa ; h nd/ in jet/objet. t then being a" sociated with the use( 1 h e coordinates are is;se =Y to the measured coo -di!^ii tes or the , :
20 hand Of /f ir!gt~~i-- C`bjit,t_= in ii;- ;c.ct-dli! ,._.
The image- ac ;-!.red. by peripheral 9 be ., ._ !!rvi ?t t.i by pia :ing ra -all . ltit'( _1 l in the field of vision of came a _S in This enables the ;
n:.:st pC.isl\:vf! t.,,st. ,lue, spatial t.C ~,r_.{i;c 5.1.;, 2..~ " etc.) of 3} ai; !:with . _;sp ,ct to interactrJi'1 space _ to r.i,<,. !
o);dn .'' li (,r.:y : ci' ~ u _ r 'each a_cquiroll (rl.'3E"i=~.
Proximity step E7 of 7 enables each person detected to be di irug_ k/h:d k-'y classifying him/her in "he user or passer-by category (step ~ f'i;; ~in~ to l b- i1[~o,c, r' s the 5+ 8 F146) . C r li C,? :,i -r3~,c 'itilt'r~l respect to ~ i!~' ~ tCe .~i~:.l!u{, tiOn ~:r~a(>: 3. a. i !t distance i~etwe en the ; 'rsod and interaction sp-acs 3 Or Panel 6 is smaller toi i . .i s k7._ I r; i ;{s n ..7 da .i': as a user, it not on al i l~ (yo., miii ii of ,K ~) F_&I We er C.5Ai,.a_ of M"'s 'Hie ;f ,~ fi). rt,ri by is fi. _s_õ at the asses We tAVp n . if no passer hy is l s li 10) 30 '_!.i ....L' 24d), ti siõ .e..,; C (., iJ ) a .i ... :I jy .+
( ascot is i ltJ_ .~~ >y z~ e ..
_ -,.'g CAN .>. q it ._. !'i m"v n 4 r s detected (Y_~,` oJ :-u ut of .'..'.! ,~)~ iõ itr~f il[ts > ..
"~ fi,t P); Was .~ ;c' t;t9 ndlllait s of pfi. S p,. s 'u`,' i.)otectiten of a now, uuser or of a new pas s eNby pij?es rho to updating (sop 49) of a . roxi wRy index (coordinates and We of appearance) by i":o' ail -f...;`~31i itl Circuit S. ~ A ,i3.-~1ly , .,14 ..=~ ~~ ,.. ~.1.; ti-Js ili,i~ ~ t i .;
~_ - 3r- ~: ,{ , -~ ei.+? .t~,-,7,`~ it its {'`',' 15 whethor a p sser-b yi or a um is maAng am my or m vingi n c nearer ., , , _i7f' =,il ..", to his/her r v s: us position.
ft'~t;ii,mi s is rl t, .; c: .g in the " i e `na! i'; l a ii ol, i cant and can wart eau, o _ it i . ian an e.mrd when aveds 20 movement of fi_iv rllce; It 1 0or bJtit =vvi 'o .c~{.7 -, ., and n i i I 7, :( !. r,:.n -.?.~,.'5.,?ii i' _ ..
b .inabhs an _hs fi':..{a tai ' AsiOn a ill .tI I~ ca1n,'a .tobetiifi., i IN i I
.. ~,. Nu m movements repealed vv: fl"
t~
ii. all tune iii erv! such i min-g, fa ''õa _ .. at he =,?!':-'!j,
Claims (14)
1. An interactive device comprising image capture means, at least one interaction space (3) and means for producing an infrared light beam directed towards the interaction space (3) and comprising at least one light source (4) emitting in the near-infrared range, said capture means comprising at least infrared two cameras (1R1, 1R2) covering interaction space (3), said capture means being connected to a processing circuit (5), said device comprising a transparent panel (6) delineating on the one hand the interaction space (3) included in an external environment (7) and on the other hand an internal space (8) in which the light source (4) and capture means are a arranged, said capture means comprising a peripheral camera (9) for capturing images representative of the external environment (7) in the visible range, said device being characterized in that it comprises at least one support element (10) supporting said light source and/or the infrared cameras (1R1, 1R2) and at least one partially reflecting complementary element (11), the support element (10) end the complementary element (11) being separated by the transparent panel (6).
2. The device according to claim 1, characterized in that it comprises display means arranged in the internal space (8), said processing circuit (5) being connected to the display means (1, 2; 15).
3. The device according to claim 2, characterized in that the display means comprise a diffusing and transparent film (1) arranged in the internal space (8), in immediate proximity to the transparent panel (6), and a video projector (2) arranged in the internal space (8) and directed towards the transparent film (1).
4. The device according to claim 3, characterized in that the video projector (2) is equiped with a band-stop filter in the infrared range.
5. The device according to claim 2, characterized in that the display means comprise an opaque screen (15).
6. The device according to any one of claims 1 to 5, characterized in that the support element (10) supporting the light source and/or the infrared cameras (IR1, IR2) is a support bar pressing against the transparent panel (6).
7. The device according to any one of claims 1 to 6, characterized in that the complementary element (11) is a complementary bar comprising an inclined surface (13) directed both towards the transparent panel (6) and towards the action space (3).
8. The device according to claims 6 and 7, characterized in that the bars each comprise complementary magnets sandwiching the transparent panel (6).
9. A method for using the device according to any one of claims 1 to 8, characterized in that it comprises a repetitive cycle successively comprising:
- an acquisition step of infrared images (E1, E2, E3) by the infrared cameras (IR1, IR2) and of images in the invisible range by the peripheral camera (9), - processing of the acquired images, - merging of the infrared and visible images to generate an image representative of the external environment (7), - tracking of persons situated in the external environment.
- an acquisition step of infrared images (E1, E2, E3) by the infrared cameras (IR1, IR2) and of images in the invisible range by the peripheral camera (9), - processing of the acquired images, - merging of the infrared and visible images to generate an image representative of the external environment (7), - tracking of persons situated in the external environment.
10. The method according to claim 9, characterized in that, the device comprising display means, a modification step of the display according to the movements of the persons at the level of the interaction space (3) is performed after the person tracking step.
11. The method according to one of claims 9 to 10, characterized in that, the external environment being divided into several sub-volumes, the processing circuit (5) distinguishes the persons according to their positioning in the different sub-volumes and modifies the display accordingly.
12. The method according to one of claims 9 to 11, characterized in that, after the image processing step, it comprises an actimetry step performed on a corrected image of the peripheral camera.
13. The method according to one of claims 9 to 12, characterized in that the image processing step performs a foreground/background segmentation from the images from the peripheral camera (9).
14. The method according to any of claims 9 to 13, characterized in that the merging step comprises association of hands, fingers or an object detected by the infrared cameras IR1 and IR2, in the interaction space (3), with a corresponding user detected by the peripheral camera (9) in the external environment (7).
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR0804387A FR2934741B1 (en) | 2008-08-01 | 2008-08-01 | INTERACTIVE DEVICE AND METHOD OF USE |
| FR0804387 | 2008-08-01 | ||
| PCT/FR2009/000952 WO2010012905A2 (en) | 2008-08-01 | 2009-07-29 | Interactive device and method of use |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2732767A1 true CA2732767A1 (en) | 2010-02-04 |
Family
ID=40589721
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2732767A Abandoned CA2732767A1 (en) | 2008-08-01 | 2009-07-29 | Interactive device and method for use |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20110128386A1 (en) |
| EP (1) | EP2307948B1 (en) |
| BR (1) | BRPI0916606A2 (en) |
| CA (1) | CA2732767A1 (en) |
| FR (1) | FR2934741B1 (en) |
| WO (1) | WO2010012905A2 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9621823B2 (en) * | 2010-09-16 | 2017-04-11 | Honeywell International Inc. | Thermal camera calibration |
| US9123316B2 (en) * | 2010-12-27 | 2015-09-01 | Microsoft Technology Licensing, Llc | Interactive content creation |
| US9635305B1 (en) | 2012-11-03 | 2017-04-25 | Iontank, Ltd. | Display apparatus including a transparent electronic monitor |
| JP2015082753A (en) * | 2013-10-23 | 2015-04-27 | キヤノン株式会社 | Information processing system, imaging device, and control method therefor, and program |
| US20150124091A1 (en) * | 2013-11-05 | 2015-05-07 | Mark Stahl | Door viewing system and apparatus |
| EP2966548A1 (en) * | 2014-07-07 | 2016-01-13 | ETT S.p.A. | Multimedia device |
| US11039118B2 (en) * | 2019-04-17 | 2021-06-15 | XRSpace CO., LTD. | Interactive image processing system using infrared cameras |
| EP3985490A1 (en) * | 2020-10-14 | 2022-04-20 | Aksor | Contactless interactive control terminal |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3968477B2 (en) * | 1997-07-07 | 2007-08-29 | ソニー株式会社 | Information input device and information input method |
| US6383051B1 (en) * | 1999-10-01 | 2002-05-07 | Richard B. Crossman | System and method for displaying magnetic devices |
| US8035612B2 (en) * | 2002-05-28 | 2011-10-11 | Intellectual Ventures Holding 67 Llc | Self-contained interactive video display system |
| JP3920067B2 (en) * | 2001-10-09 | 2007-05-30 | 株式会社イーアイティー | Coordinate input device |
| US7042444B2 (en) * | 2003-01-17 | 2006-05-09 | Eastman Kodak Company | OLED display and touch screen |
| US7538759B2 (en) * | 2004-05-07 | 2009-05-26 | Next Holdings Limited | Touch panel display system with illumination and detection provided from a single edge |
| US8560972B2 (en) * | 2004-08-10 | 2013-10-15 | Microsoft Corporation | Surface UI for gesture-based interaction |
| US7679610B2 (en) * | 2006-09-28 | 2010-03-16 | Honeywell International Inc. | LCD touchscreen panel with external optical path |
-
2008
- 2008-08-01 FR FR0804387A patent/FR2934741B1/en not_active Expired - Fee Related
-
2009
- 2009-07-29 BR BRPI0916606A patent/BRPI0916606A2/en not_active IP Right Cessation
- 2009-07-29 EP EP09784320A patent/EP2307948B1/en not_active Not-in-force
- 2009-07-29 US US13/056,067 patent/US20110128386A1/en not_active Abandoned
- 2009-07-29 WO PCT/FR2009/000952 patent/WO2010012905A2/en active Application Filing
- 2009-07-29 CA CA2732767A patent/CA2732767A1/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010012905A3 (en) | 2010-08-12 |
| BRPI0916606A2 (en) | 2015-11-10 |
| FR2934741B1 (en) | 2011-04-01 |
| EP2307948A2 (en) | 2011-04-13 |
| US20110128386A1 (en) | 2011-06-02 |
| EP2307948B1 (en) | 2012-10-03 |
| WO2010012905A2 (en) | 2010-02-04 |
| FR2934741A1 (en) | 2010-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2732767A1 (en) | Interactive device and method for use | |
| US9251397B2 (en) | Fingerprint image capturing device and fingerprint image capturing module thereof | |
| CN108431702B (en) | Commissioning of sensor system | |
| WO2012134069A2 (en) | Apparatus and method for tracking augmented reality content using a mobile sensor | |
| CN104049792B (en) | Operation detection means and operation detection method | |
| US20150135144A1 (en) | Apparatus for obtaining virtual 3d object information without requiring pointer | |
| CN102369498A (en) | Touch pointers disambiguation by active display feedback | |
| KR20120072009A (en) | Interaction recognition apparatus for multiple user and method thereof | |
| KR102209745B1 (en) | An information display device of a mirror display for advertisement and shopping by recognizing the reflected images on the mirror and method thereof | |
| BR112012023787B1 (en) | SYSTEM FOR TRACKING THE LOOKING POINT OF AN OBJECT WATCHING AN OBJECT AND METHOD FOR TRACKING THE LOOKING POINT OF AN OBJECT WATCHING AN OBJECT | |
| CN102799318A (en) | Human-machine interaction method and system based on binocular stereoscopic vision | |
| CN109388233A (en) | Transparent display device and control method thereof | |
| KR20170001223A (en) | Information extracting system, information extracting apparatus, information extracting method of thereof and non-transitory computer readable medium | |
| TWI413925B (en) | Optical touch system, apparatus and method for calculating the position of an object | |
| TWI521410B (en) | Apparatus and method for acquiring object image of a pointer | |
| JP6262610B2 (en) | Information registration device, information continuation registration device, method and program | |
| CN106895826B (en) | A kind of improved Machine Vision Inspecting System and its detection method | |
| KR20200008227A (en) | System and method for controlling gesture based light dimming effect using natural user interface | |
| WO2015072977A1 (en) | Augmented reality marker | |
| WO2020211486A1 (en) | Self-service checkout | |
| US20200302643A1 (en) | Systems and methods for tracking | |
| Herter | Augmented reality supported order picking using projected user interfaces | |
| US20150331543A1 (en) | Optical touch module | |
| KR101371869B1 (en) | Realtime people presence and counting device using stereo camera and that method | |
| KR20230093342A (en) | Housing structures and input-output devices for electronic devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued |
Effective date: 20150729 |