WO2014122341A1 - System and method for the identification and control of objects in a defined space and use thereof in the creation of hybrid video games - Google Patents

System and method for the identification and control of objects in a defined space and use thereof in the creation of hybrid video games Download PDF

Info

Publication number
WO2014122341A1
WO2014122341A1 PCT/ES2014/000016 ES2014000016W WO2014122341A1 WO 2014122341 A1 WO2014122341 A1 WO 2014122341A1 ES 2014000016 W ES2014000016 W ES 2014000016W WO 2014122341 A1 WO2014122341 A1 WO 2014122341A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared
objects
spectrum
emitters
led
Prior art date
Application number
PCT/ES2014/000016
Other languages
Spanish (es)
French (fr)
Inventor
Javier MARCO RUBIO
Eva Mónica CEREZO BAGDASARI
Sandra Silvia BALDASSARRI
Original Assignee
Universidad De Zaragoza
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universidad De Zaragoza filed Critical Universidad De Zaragoza
Publication of WO2014122341A1 publication Critical patent/WO2014122341A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition

Definitions

  • the object of the present invention is a method or technique based on the visual detection of objects supported by at least one marker, of special application in the creation of hybrid video games for computer or game console and controlled by any objects, such as conventional toys of any type and that support both the detection of changes of state of the object by the user's own manipulation (which in the case of toys is usually a child), and the autonomous change of the state of the object by the own computer system that executes the invention .
  • hybrid video games computer games that are played in the same way as a game based on physical manipulation of objects, enriching it with digital content: image and sound
  • hybrid video games computer games that are played in the same way as a game based on physical manipulation of objects, enriching it with digital content: image and sound
  • RFID sensors RFID sensors
  • the interaction in the video game is limited to moving the toys on the playing surface.
  • the toys act, therefore, passively in the game are only manipulated by the player); also never change state, either because of the manipulations of children, either because of the computer system itself.
  • a method for controlling a robot is essentially described, wherein said robot includes detection means for detecting an object in a first zone of a series of predetermined zones, in relation to the robot; and to generate a detection signal of the identification of the first zone, and processing means for selecting and performing a predetermined action of a series of actions in response to said detection signal.
  • Document EP1033882B1 does not propose a technique to integrate any toy into a hybrid video game, but proposes a control itself (a magic wand), which detects the player's gestures with respect to a screen or monitor where the game is shown.
  • An infrared sensor (camera) connected to the system is used to know where the wand points with respect to the game image monitor, as if it were a gun.
  • document EP1937380B1 does not describe a technique to adapt any toy in a video game, although it does propose several different toys that are They can use as controls in video games.
  • each toy applies a different technique (based on infrared LEDs and visible light LEDs with different colors), and therefore not generally applicable for any passive interaction with toys as is our case.
  • the infrared sensor (camera) and infrared LEDs are used for the system to calculate the position of the toy in a three-dimensional volume in front of the monitor or game screen. Passive manipulations of the toys are transmitted to the system through colored LEDs, therefore, the camera must see in visible light, not infrared. Description of the invention
  • the technical problem that the present invention solves is a system and method that detects changes in the state of any object in a bidirectional way from the object to a computer control system (essentially a CPU) and from the computer system to the object.
  • a computer control system essentially a CPU
  • it is used for the creation of hybrid video games, that is, for the use of conventional toys (objects) within a computer system (the processor or CPU) and interacting between them.
  • the invention proposes the use of emitters and receivers (sensors / cameras) in the infrared spectrum in a robust and cheap way, since they are sensors and emitters of a much more affordable price than others used in the state of the art for location (position and orientation) of a practically unlimited number of objects without the need for additional electronic sensors, since it would only be enough to add a marker printed on conventional paper or plastic.
  • the system recommended here grants users the possibility of integrating conventional toys such as video game controllers, as well as the autonomous change of the state of the toy itself by the computer system that runs the video game (not only the detection of changes in the state of the toy by the manipulation of children) and the possibility of using large surfaces, such as the floor of an entire room, granting and providing ample play possibilities to increase the user experience.
  • an infrared identification device comprising infrared emitters and infrared sensors. and comprising a flat rectangular body that in turn contains a rectangular hollow space on one side, and an array of emitting LEDs in the infrared spectrum located on the front of said rectangular hollow space. All this in such a way that said LED array illuminates a visual marker housed in said rectangular space and where said visual marker is a flat element with a random combination of opaque and light-transparent areas in the infrared spectrum.
  • the system for the identification and control of objects in a horizontally delimited space comprising a horizontal space of variable and configurable area, on which a plurality of objects are arranged; a control unit with at least one processor (the CPU) and means configured to send and receive infrared signals comprising:
  • a plurality of emitters in the infrared spectrum Y
  • Each of said objects has an identifier device attached as described in such a way that a single device identifies a single object.
  • the identifying device is configured to identify the object with which it is associated, indicate the status of the object through infrared emitters and execute instructions from the processor received as pulses of infrared signal at a certain frequency.
  • the CPU is configured to analyze a video image captured by the infrared camera. Through this capture each object is identified independently through the image capture of a visual marker of the device associated with that object. Finally, the position and orientation in the area of each object is calculated independently by capturing the image of a visual marker of the device associated with said object and one or more programs stored in one or more memories for the control are executed.
  • control signals being emitted by pulses in the infrared spectrum.
  • FIG 1. Shows a first practical embodiment of the system presented here, where the playing area is a table.
  • FIG 2. Shows a second practical embodiment of the system, where the playing area in a part of the floor of a room.
  • FIG 3. Shows a third practical embodiment of the system, where the playing area is a room or an outdoor patio.
  • FIG 4. Shows a view of the device (100) as part of the system for creating hybrid video games.
  • FIG 5. Shows a view of a first mode of coupling the device (100) in the toy (6).
  • FIG 6. Shows a view of a second mode of coupling the device (100) in the toy (6).
  • FIG 7. Shows a first way of using the system recommended here.
  • FIG 8. Shows a second way of using the system presented here.
  • the present invention in its preferred non-limiting use It allows integrating one or more conventional toys (that is objects) and of any kind as control elements or controllers in a computer game or video game console. That is, a physical object becomes a peripheral configured to execute certain actions on a computer program.
  • a horizontally delimited area (1) such as a table (figure 1), a part of the floor (21) in the figure 2 or even an entire room or outdoor playground (31) in Figure 3.
  • At least one screen (2.22.32) or a video projector (3.23.33) will be placed, both devices being compatible with each other and can be used interchangeably depending on the needs and / or user tastes.
  • the function of these elements is to show a virtual environment (image and sound) related to the video game, such as virtual characters to guide during the game, or other virtual elements that complement the user experience while playing.
  • This screen (2,22,32) may be the monitor of a computer, or any conventional television.
  • the system will have an infrared sensor and transmitter both configured as a computer peripheral that can be connected via USB and consisting of two elements: an image sensor (4b, 24b, 34b) and an infrared transmitter (4a, 24a, 34a ).
  • the image sensor (4b, 24b, 34b) is composed of a conventional digital video camera to whose optics an infrared light filter is applied at 850 nm, to capture only the light at that frequency.
  • this camera has a set of interchangeable optics or variable focal optics, which allows to vary the field of vision to adjust it to the different configurations of previously proposed play area (1, 21, 31) which is variable and previously configurable by the user, the image sensor (4b, 24b, 34b) being the one that adapts to the area (1, 21, 31) and not vice versa.
  • the infrared emitter (4a, 24a, 34a) is a high intensity pulse LED emitter of infrared light at 780 nm, and where the emission of said pulses will be controlled through the USB interface by a processor (5, 25, 35 ) to which you are connected.
  • the system incorporates a processor (5,25,35) which consists of a preferred embodiment in a CPU or in a video game console, in which the input and / or output of the sensor (4b, 24b, 34b) and infrared emitter are connected (4th, 24th, 34th), the screen (2.22.32) and / or the projector (3.23.33). Its function is the analysis of the video captured by the sensor (4b, 24b, 34b) for the identification and monitoring of toys (6,26,36) in the area of the game (1, 21, 31), and the execution of the logic of the video game.
  • the system incorporates for its use and / or game, a plurality of objects, in this preferred embodiment conventional toys (6,26,36), which will be manipulated by users to evolve the video game.
  • said toys (6,26,36) incorporate an electronic device (100) in charge of visual communication with the computer processor and the detection and execution of changes in the state of the toy.
  • Said electronic device (100) allows the processor (5.25.35) to identify the toy (6.26.36); follow the position (in two dimensions) and the orientation (on an axis) of the toy on the playing area (1); Identify different states of the toy (6,26,36) caused by the use and / or manipulation of the toy by the user, and finally cause changes in its condition.
  • the electronic device (100) comprises at least one body (101) with a flat rectangular shape, and whose measurements will vary depending on the type of toy (6.26.36) to which it is adapted.
  • a slit (102) will be placed for the insertion therein of a visual marker (103), and in which a plurality or 850 nm infrared LED diode array (102a) for the correct backlight of the coupled marker.
  • the visual marker (103) is essentially a card materialized in various materials, such as paper, cardboard, acetate, or any other with similar characteristics and allowing infrared light to pass through at least one area or portion thereof, the rest being opaque, with a variable distribution of them, depending on the specific needs of the case.
  • the processor (5,25,35) has visual recognition algorithms to visually identify each marker (103), and thus identify each object or toy (6.26,36), and calculate its position and orientation with respect to the area of game (1, 21, 31).
  • the system can include a collection of these cards, or they can be generated by computer through specific software for this purpose and printed on any conventional printer, so that it is the players themselves who create their own hybrid video games through said software that can be installed in the processor itself (5,25,35).
  • the device (100) in turn incorporates an array or strip (104) of the toy state consisting of a strip or array of several infrared LEDs (850nm) aligned.
  • the number of LEDs in this array can vary between one and four depending on the size of the device (100).
  • the computer processor (5,25,35) can visually detect which of these diodes are on, which will be activated depending on the number of sensors connected in the array of sensor connectors (105) composed of a plurality of female electronic connectors ( positive and negative pins), each associated to an LED of the array of toy states (104).
  • an electronic sensor of a collection of devices can be connected: switches, Reed-switches, proximity sensors, pressure sensors, light sensors, etc.
  • switches Reed-switches
  • proximity sensors sensors
  • pressure sensors pressure sensors
  • light sensors etc.
  • the device (100) in turn incorporates an infrared sensor (106) composed of an infrared light sensor (780 nm), which detects the light pulses sent by the USB infrared emitter (4a, 24a, 34a) connected to the element processor (5.25.35). In this way, and by the frequency of the pulses detected, the computer system can send orders to a device (100).
  • an infrared sensor (106) composed of an infrared light sensor (780 nm), which detects the light pulses sent by the USB infrared emitter (4a, 24a, 34a) connected to the element processor (5.25.35).
  • Said commands activate an actuator connected in the array of connectors (107) of actuators comprising a variety of female electronic connectors to which an electronic device from a collection of actuators (for example, can be connected). motors, lights, speakers, vibrators, or any other), so that the actuator will be activated when the infrared sensor (106) detects a certain frequency of infrared pulses (780nm) sent by the processor (5,25,35) to through the infrared emitter (4th, 24th, 34th).
  • the device (100) can be attached to both the base (figure 5) and the top (figure 6) of the toys (6), depending on the configuration of the game environment.
  • FIG. 7 A first practical embodiment of the invention is shown in Figure 7, where the toy is used to make bread.
  • the user has to place a toy doll (71) inside the mill (70). Then, spin the blades blowing. When turning, loaves (72) appear as virtual elements projected on the surface, at the mill gate (70).
  • the mill-shaped toy (70) is coupled with a device (100) with marker (73) in its upper part for recognition in a game configuration as described above.
  • One of the sensor connector arrays (105) is connected to a switch embedded in the blades (74) of the mill, so that the infrared LED (104) associated with said connector turns on and off according to the blades (74) of the mill go around.
  • the doll (71) contains a magnet. Inside the mill (70) there is a reed-switch connected to one of the sensors array connectors (105) of the device (100). This causes the LED of the array of states associated with that connector to light up when the doll (71) is inside the mill (70).
  • the computer processor (5,25,35) identifies the mill (70) by its visual marker (103) and deduces its position and orientation in the playing area (1).
  • the computer processor (5,25,35) is able to know if the doll (71) is inside the mill (70) if it detects that the associated LED of the array of states (104) is on, and knows when to turn the blades ( 74) of the mill when the associated LED of the array of states (104) of the device is turned on and off. With this, the logic of the game knows that it has to project new virtual breads.
  • Figure 8 shows a second practical embodiment where the toy is a train (80) that is responsible for collecting the breads that are manufactured in the mill toy.
  • a device (100) with a visual marker (103) is placed at the top of the locomotive (81) .
  • a reed-switch embedded in the locomotive cabin (81) is connected.
  • the doll (82) contains a magnet that activates the reed-Switch, which turns on the corresponding LED of the array of status LEDs (104).
  • the motor (84) of the locomotive (81) is connected to one of the actuator connectors (107), and to the other actuator connector it is connected to the loader (85) of the locomotive.
  • the infrared sensor (106) detects pulses emitted by the infrared emitter (4th, 24th, 34th) USB connected to the computer processor (5,25,35). Depending on the frequency of these pulses, connect the engine (84) of the locomotive, or blow the whistle (85). In this way, when the computer processor (5.25.35) detects the status LED (104) corresponding to the doll (82) placed in the cabin, it sends infrared pulses through the LED emitter (4th, 24th, 34th) to activate the engine (84) of the locomotive.

Abstract

The invention relates to a system and a method for the identification and control of objects (6,26,36) in a horizontally defined space (1,21,31), comprising : a horizontal space (1,21,31) having a variable and configurable area on which a plurality of objects (6,26,36) is arranged; a control unit comprising at least one processor (5,25,35); and means designed so as to send and receive infrared signals, comprising a plurality of infrared emitters (4a, 24a, 34a) and an infrared vision chamber (4b,24b,34b); where each of said objects (6,26,36) has an identifying device (100) adhered thereto, such that a single device (100) identifies a single object (6,26,36).

Description

SISTEMA Y MÉTODO PARA LA IDENTIFICACIÓN Y CONTROL DE OBJETOS EN UN ESPACIO DELIMITADO Y USO EN LA CREACIÓN DE VIDEOJUEGOS HÍBRIDOS  SYSTEM AND METHOD FOR THE IDENTIFICATION AND CONTROL OF OBJECTS IN A DEFINED SPACE AND USE IN THE CREATION OF HYBRID VIDEO GAMES
El objeto de la presente invención es un método o técnica basada en la detección visual de objetos soportada por al menos un marcador, de especial aplicación en la creación de videojuegos híbridos para ordenador o videoconsola y controlados mediante unos objetos cualesquiera, como juguetes convencionales de cualquier tipo y que soportan tanto la detección de cambios de estado del objeto por la propia manipulación del usuario (que en el caso de los juguetes suele ser un niño), como el cambio autónomo del estado del objeto por el propio sistema informático que ejecuta la invención. The object of the present invention is a method or technique based on the visual detection of objects supported by at least one marker, of special application in the creation of hybrid video games for computer or game console and controlled by any objects, such as conventional toys of any type and that support both the detection of changes of state of the object by the user's own manipulation (which in the case of toys is usually a child), and the autonomous change of the state of the object by the own computer system that executes the invention .
Estado de la técnica State of the art
Tradicionalmente los niños juegan, solos o en grupo, manipulando físicamente juguetes en el suelo o en una mesa. Asimismo, los niños también encuentran atractivos los juegos de ordenador, y su flexibilidad les hace muy útiles en aplicaciones educativas. Juntar ambos mundos (en adelante videojuegos híbridos: juegos de ordenador que se jueguen de la misma forma que un juego basado en manipulación física de objetos, enriqueciéndolo con contenido digital: imagen y sonido), es aunar los beneficios pedagógicos de ambas formas de juego. Traditionally children play, alone or in groups, physically manipulating toys on the floor or at a table. Likewise, children also find computer games attractive, and their flexibility makes them very useful in educational applications. Bringing together both worlds (hereinafter hybrid video games: computer games that are played in the same way as a game based on physical manipulation of objects, enriching it with digital content: image and sound), is to combine the pedagogical benefits of both forms of play.
Actualmente existen diversos métodos para combinar juguetes físicos y videojuegos en videojuegos híbridos. Algunos de ellos se basan en embeber dispositivos electrónicos en el juguete (p.ej. chips RFID) que pueden ser detectados e identificados por un sensor conectado al sistema informático (sensores RFID): http://www.skylanders.com There are currently various methods to combine physical toys and video games in hybrid video games. Some of them are based on embedding electronic devices in the toy (eg RFID chips) that can be detected and identified by a sensor connected to the computer system (RFID sensors): http://www.skylanders.com
http://www. piernot.com/proi/zowie/ Estos sistemas solo permiten la identificación del juguete cuando éste está próximo (a muy pocos centímetros) de un sensor. Aunque un chip RFID tiene muy bajo coste, los sensores no lo son tanto, por lo que identificar el juguete en distintas posiciones requiere la conexión de múltiples sensores al sistema informático, elevando su coste y complejidad del juguete. Otras soluciones embeben en el juguete diversos actuadores y sensores electrónicos comunicados con el sistema informático que ejecuta el videojuego a través de tecnologías inalámbricas (BLUETOOTH o WIFI). http: // www. piernot.com/proi/zowie/ These systems only allow identification of the toy when it is near (a few centimeters) from a sensor. Although an RFID chip has very low cost, the sensors are not so low, so identifying the toy in different positions requires the connection of multiple sensors to the computer system, raising its cost and complexity of the toy. Other solutions include various electronic actuators and sensors in the toy communicated with the computer system that runs the video game through wireless technologies (BLUETOOTH or WIFI).
Wappy Dog® de Nintendo®: Nintendo® Wappy Dog®:
http://www.voutube.com/watch?v=cfWerkDHC2A http://www.voutube.com/watch?v=cfWerkDHC2A
Lego Mindstorms® de LEGO®: Lego Mindstorms® by LEGO®:
http://mindstorms.lego.com/en-us/Default.aspx Este sistema permite interacciones más complejas con el juguete (tanto como complejos sean los sensores embebidos en el juguete capaces de detectar las manipulaciones de los niños), y además permite que el propio sistema informático cambie el estado del juguete (embebiendo actuadores electrónico: motores, luces, sonido). Sin embargo, dichos sensores y actuadores miniaturizados son costosos y frágiles, al igual que el control inalámbrico del juguete. Además, resulta muy complejo y costoso adaptar un juguete convencional no tecnológico para ser usado en este sistema. http://mindstorms.lego.com/en-us/Default.aspx This system allows more complex interactions with the toy (as complex as the sensors embedded in the toy can detect the manipulations of children), and also allows that the computer system itself changes the state of the toy (embedding electronic actuators: motors, lights, sound). However, such miniaturized sensors and actuators are expensive and fragile, as is the wireless control of the toy. In addition, it is very complex and expensive to adapt a conventional non-technological toy for use in this system.
Otros se basan en el uso de un sensor visual (cámara digital) conectado al sistema informático que ejecuta el videojuego, y de algoritmos ejecutados en el procesador del sistema que identifican visualmente cada juguete (generalmente facilitado por la inclusión de marcadores impresos en el juguete): Others are based on the use of a visual sensor (digital camera) connected to the computer system that executes the video game, and algorithms executed in the system processor that visually identify each toy (usually facilitated by the inclusion of markers printed on the toy) :
http://es.playstation.com/evepet/ http://es.playstation.com/evepet/
Este sistema es de muy bajo coste, solo requiere una cámara digital convencional. Los marcadores pueden ser impresos en papel convencional. Actualmente estas técnicas se están utilizando para controlar aplicaciones informáticas mediante la colocación y movimiento de objetos sobre una superficie horizontal (mesa o tabletop): This system is very low cost, it only requires a conventional digital camera. Markers can be printed on conventional paper. These techniques are currently being used to control computer applications by placing and moving objects on a horizontal surface (table or tabletop):
www.reactable.com Este sistema permite la creación de videojuegos híbridos con muy bajo coste: www.reactable.com This system allows the creation of hybrid video games with very low cost:
http://webdiis.unizar.es/~imarco/7paqe id=10&lang=es http://webdiis.unizar.es/~imarco/7paqe id = 10 & lang = en
Sin embargo, la interacción en el videojuego se limita a mover los juguetes en la superficie de juego. Los juguetes actúan, por tanto, de forma pasiva en el juego solo son manipulados por el jugador); además nunca cambian de estado, bien por efecto de las manipulaciones de los niños, bien por efecto del propio sistema informático. However, the interaction in the video game is limited to moving the toys on the playing surface. The toys act, therefore, passively in the game are only manipulated by the player); also never change state, either because of the manipulations of children, either because of the computer system itself.
En la solicitud WO02095517 se describe esencialmente un método para controlar un robot, en donde dicho robot incluye medios de detección para detectar un objeto en una primera zona de una serie de zonas predeterminadas, en relación con el robot; y para generar una señal de detección de la identificación de la primera zona, y medios de procesamiento para seleccionar y realizar una acción predeterminada de una serie de acciones en respuesta a dicha señal de detección. Este documento es el más próximo conceptualmente al objeto de la invención, ya que permite detectar cambios de estado en el robot, por manipulaciones o colisiones con el entorno y ejecutar cambios desde el sistema, como cambiar de dirección, pero todo muy orientado a la robótica, y sobre todo a la comunicación de un robot con otro para poder coordinar "equipos de robots". Menciona técnicas como la radiofrecuencia para conocer distancias entre robot, y giroscopios y sensores magnéticos para conocer su orientación. La principal diferencia respecto a la invención radica en la adición de un sensor de imagen infrarroja (cámara), para solucionar de forma robusta y barata la localización (posición y orientación) de un número prácticamente ilimitado de objetos, sin necesidad de sensores electrónicos adicionales, ya que sólo es necesario añadir un marcador impreso en papel o plástico convencional. El documento JP 2003-019344 si que emplea sensores y emisores en el espectro infrarrojo para el control de juguetes, pero siempre sobre una máquina. No obstante, la diferenciación entre distintos juguetes se hace por la forma geométrica del emisor infrarrojo (cuadrado, triangulo, circulo), limita la identificación y la hace poco fiable. Por otro lado, no se detecta la orientación. La propuesta japonesa solo habla de posición, para nada de cambios de estado en el juguete. Además tampoco permite o indica cómo combinar el empleo de dicha comunicación IR con otros sistemas, por ejemplo, el de la patente WO02095517. In WO02095517, a method for controlling a robot is essentially described, wherein said robot includes detection means for detecting an object in a first zone of a series of predetermined zones, in relation to the robot; and to generate a detection signal of the identification of the first zone, and processing means for selecting and performing a predetermined action of a series of actions in response to said detection signal. This document is the closest conceptually to the object of the invention, since it allows to detect changes of state in the robot, by manipulations or collisions with the environment and execute changes from the system, such as changing direction, but everything very oriented to robotics , and especially to the communication of a robot with another to be able to coordinate "robot teams". He mentions techniques such as radiofrequency to know distances between robots, and gyroscopes and magnetic sensors to know their orientation. The main difference with respect to the invention lies in the addition of an infrared image sensor (camera), to robustly and cheaply solve the location (position and orientation) of a practically unlimited number of objects, without the need for additional electronic sensors, since it is only necessary to add a marker printed on conventional paper or plastic. JP 2003-019344 document if it uses sensors and emitters in the infrared spectrum for the control of toys, but always on a machine. However, the differentiation between different toys is made by the geometric shape of the infrared emitter (square, triangle, circle), limits the identification and makes it unreliable. On the other hand, orientation is not detected. The Japanese proposal only speaks of position, not at all of changes of state in the toy. It also does not allow or indicate how to combine the use of said IR communication with other systems, for example, that of WO02095517.
El documento EP1033882B1 no propone una técnica para integrar cualquier juguete en un videojuego híbrido, si no que propone un control en sí (una varita mágica), que detecta los gestos del jugador con respecto a una pantalla o monitor donde se muestra el juego. Se utiliza un sensor infrarrojo (cámara) conectado al sistema para saber donde apunta la varita con respecto al monitor de imagen del juego, como si fuera una pistola. Document EP1033882B1 does not propose a technique to integrate any toy into a hybrid video game, but proposes a control itself (a magic wand), which detects the player's gestures with respect to a screen or monitor where the game is shown. An infrared sensor (camera) connected to the system is used to know where the wand points with respect to the game image monitor, as if it were a gun.
Finalmente, el documento EP1937380B1 tampoco describe una técnica para adaptar cualquier juguete en un videojuego, aunque sí propone varios juguetes distintos que se pueden usar como controles en videojuegos. Eso sí, cada juguete aplica una técnica distinta (basada en LEDs infrarrojos y LEDs de luz visible con distintos colores), y por tanto no general aplicable para cualquier interacción pasiva con los juguetes como es nuestro caso. Tampoco propone técnicas para juguetes activos. El sensor (cámara) infrarrojo y los LEDs infrarrojos se utilizan para que el sistema calcule la posición del juguete en un volumen tridimensional en frente del monitor o pantalla de juego. Las manipulaciones pasivas de los juguetes se transmiten al sistema mediantes LEDs de colores, por tanto, la cámara debe ver en luz visible, no infrarroja. Descripción de la invención Finally, document EP1937380B1 does not describe a technique to adapt any toy in a video game, although it does propose several different toys that are They can use as controls in video games. Of course, each toy applies a different technique (based on infrared LEDs and visible light LEDs with different colors), and therefore not generally applicable for any passive interaction with toys as is our case. Nor does it propose techniques for active toys. The infrared sensor (camera) and infrared LEDs are used for the system to calculate the position of the toy in a three-dimensional volume in front of the monitor or game screen. Passive manipulations of the toys are transmitted to the system through colored LEDs, therefore, the camera must see in visible light, not infrared. Description of the invention
El problema técnico que resuelve la presente invención es un sistema y método que detecte los cambios de estado de un objeto cualquiera de forma bidireccional desde el objeto a un sistema informático de control (esencialmente una CPU) y del sistema informático al objeto. En un uso preferido de la invención ésta se emplea para la creación de videojuegos híbridos, es decir, para el empleo de juguetes convencionales (los objetos) dentro de un sistema informático (el procesador o CPU) e interaccionar entre ambos. The technical problem that the present invention solves is a system and method that detects changes in the state of any object in a bidirectional way from the object to a computer control system (essentially a CPU) and from the computer system to the object. In a preferred use of the invention it is used for the creation of hybrid video games, that is, for the use of conventional toys (objects) within a computer system (the processor or CPU) and interacting between them.
La invención propone el uso de emisores y receptores (sensores/cámaras) en el espectro infrarrojo de forma robusta y barata, ya que son sensores y emisores de un precio mucho más asequible que otros utilizados en el estado de la técnica para la localización (posición y orientación) de un número prácticamente ilimitado de objetos sin necesidad de sensores electrónicos adicionales, ya que bastaría solamente con añadir un marcador impreso en papel o plástico convencional. The invention proposes the use of emitters and receivers (sensors / cameras) in the infrared spectrum in a robust and cheap way, since they are sensors and emitters of a much more affordable price than others used in the state of the art for location (position and orientation) of a practically unlimited number of objects without the need for additional electronic sensors, since it would only be enough to add a marker printed on conventional paper or plastic.
Gracias a su especial diseño e implementación, el sistema aquí preconizado otorga la posibilidad a los usuarios de integrar juguetes convencionales como controladores de videojuegos, así mismo el cambio autónomo del estado del propio juguete por el propio sistema informático que ejecuta el videojuego (no sólo la detección de cambios de estado del juguete por la manipulación de los niños) y la posibilidad de usar amplias superficies, como por ejemplo, el suelo de toda una habitación, otorgando y proporcionando amplias posibilidades de juego para aumentar la experiencia del usuario. Thanks to its special design and implementation, the system recommended here grants users the possibility of integrating conventional toys such as video game controllers, as well as the autonomous change of the state of the toy itself by the computer system that runs the video game (not only the detection of changes in the state of the toy by the manipulation of children) and the possibility of using large surfaces, such as the floor of an entire room, granting and providing ample play possibilities to increase the user experience.
Más concretamente, en un primera aspecto de la invención, se reivindica un dispositivo identificador infrarrojo que comprende unos emisores infrarrojos y unos sensores infrarrojos y que comprende un cuerpo rectangular plano que a su vez contiene en uno de sus lados un espacio hueco rectangular, y un array de LED emisores en el espectro infrarrojo situados en los frontales de dicho espacio hueco rectangular. Todo ello de tal forma que dicho array de LED retroilumina un marcador visual alojado en dicho espacio rectangular y donde dicho marcador visual es un elemento plano con una combinación aleatoria de áreas opacas y transparentes a la luz en el espectro infrarrojo. More specifically, in a first aspect of the invention, an infrared identification device comprising infrared emitters and infrared sensors is claimed. and comprising a flat rectangular body that in turn contains a rectangular hollow space on one side, and an array of emitting LEDs in the infrared spectrum located on the front of said rectangular hollow space. All this in such a way that said LED array illuminates a visual marker housed in said rectangular space and where said visual marker is a flat element with a random combination of opaque and light-transparent areas in the infrared spectrum.
En un segundo aspecto de la invención el sistema para la identificación y control de objetos en un espacio delimitado horizontalmente que comprende un espacio horizontal de área variable y configurable, sobre la que quedan dispuestos una pluralidad de objetos; una unidad de control con al menos un procesador (la CPU) y medios configurados para enviar y recibir señales infrarrojas que comprenden: In a second aspect of the invention the system for the identification and control of objects in a horizontally delimited space comprising a horizontal space of variable and configurable area, on which a plurality of objects are arranged; a control unit with at least one processor (the CPU) and means configured to send and receive infrared signals comprising:
Una pluralidad de emisores en el espectro infrarrojo; y A plurality of emitters in the infrared spectrum; Y
- Una cámara de visión infrarroja.  - An infrared vision camera.
Cada uno de dichos objetos lleva adherido un dispositivo identificador como el descrito de tal forma que un único dispositivo identifica a un único objeto. El dispositivo identificador está configurado para identificar el objeto con el que está asociado, indicar el estado del objeto a través de unos emisores infrarrojos y ejecutar las instrucciones procedentes del procesador recibidas como pulsos de señal infrarroja a una frecuencia determinada. Por otro lado, la CPU está configurada para analizar una imagen de video capturada por la cámara infrarroja. A través de esa captura se identifica cada objeto de forma independiente a través de la captura de la imagen de un marcador visual del dispositivo asociado con dicho objeto. Finalmente se calcula la posición y orientación en el área de cada objeto de forma independiente a través de la captura de la imagen de un marcador visual del dispositivo asociado con dicho objeto y se ejecutan uno o más programas almacenados en una o más memorias para el control de cada uno de los objetos a través del dispositivo asociado con dicho objeto, estando dichas señales de control emitidas mediante pulsos en el espectro infrarrojo. Finalmente, en un tercer aspecto de la invención se reivindica el método para identificar y controlar objetos en un espacio delimitado horizontalmente y el producto informático con el conjunto de instrucciones programables para llevar a cabo dicho método. Each of said objects has an identifier device attached as described in such a way that a single device identifies a single object. The identifying device is configured to identify the object with which it is associated, indicate the status of the object through infrared emitters and execute instructions from the processor received as pulses of infrared signal at a certain frequency. On the other hand, the CPU is configured to analyze a video image captured by the infrared camera. Through this capture each object is identified independently through the image capture of a visual marker of the device associated with that object. Finally, the position and orientation in the area of each object is calculated independently by capturing the image of a visual marker of the device associated with said object and one or more programs stored in one or more memories for the control are executed. of each of the objects through the device associated with said object, said control signals being emitted by pulses in the infrared spectrum. Finally, in a third aspect of the invention the method for identifying and control objects in a horizontally delimited space and the computer product with the set of programmable instructions to carry out said method.
A lo largo de la descripción y las reivindicaciones la palabra "comprende" y sus variantes no pretenden excluir otras características técnicas, aditivos, componentes o pasos. Para los expertos en la materia, otros objetos, ventajas y características de la invención se desprenderán en parte de la descripción y en parte de la práctica de la invención. Los siguientes ejemplos y dibujos se proporcionan a modo de ilustración, y no se pretende que restrinjan la presente invención. Además, la presente invención cubre todas las posibles combinaciones de realizaciones particulares y preferidas aquí indicadas. Throughout the description and the claims the word "comprises" and its variants are not intended to exclude other technical characteristics, additives, components or steps. For those skilled in the art, other objects, advantages and features of the invention will be derived partly from the description and partly from the practice of the invention. The following examples and drawings are provided by way of illustration, and are not intended to restrict the present invention. In addition, the present invention covers all possible combinations of particular and preferred embodiments indicated herein.
Breve descripción de las figuras Brief description of the figures
A continuación se pasa a describir de manera muy breve una serie de dibujos que ayudan a comprender mejor la invención y que se relacionan expresamente con una realización de dicha invención que se presenta como un ejemplo no limitativo de ésta. A series of drawings that help to better understand the invention and that expressly relate to an embodiment of said invention which is presented as a non-limiting example thereof is described very briefly below.
FIG 1. Muestra una primera realización práctica del sistema aquí presentado, donde el área de juego es una mesa. FIG 1. Shows a first practical embodiment of the system presented here, where the playing area is a table.
FIG 2. Muestra una segunda realización práctica del sistema, donde el área de juego en una parte del suelo de una habitación.  FIG 2. Shows a second practical embodiment of the system, where the playing area in a part of the floor of a room.
FIG 3. Muestra una tercera realización práctica del sistema, donde el área de juego es una habitación o un patio exterior. FIG 3. Shows a third practical embodiment of the system, where the playing area is a room or an outdoor patio.
FIG 4. Muestra una vista del dispositivo (100) como parte del sistema para la creación de videojuegos híbridos. FIG 4. Shows a view of the device (100) as part of the system for creating hybrid video games.
FIG 5. Muestra una vista de un primer modo de acople del dispositivo (100) en el juguete (6).  FIG 5. Shows a view of a first mode of coupling the device (100) in the toy (6).
FIG 6. Muestra una vista de un segundo modo de acople del dispositivo (100) en el juguete (6).  FIG 6. Shows a view of a second mode of coupling the device (100) in the toy (6).
FIG 7. Muestra un primer modo de empleo del sistema aquí preconizado.  FIG 7. Shows a first way of using the system recommended here.
FIG 8. Muestra un segundo modo de empleo del sistema aquí presentado. FIG 8. Shows a second way of using the system presented here.
Realización preferente de la invención Como se ha indicado anteriormente la presente invención en su uso preferido no limitativo permite integrar uno o varios juguetes convencionales (esto es los objetos) y de cualquier tipo como elementos de control o controladores en un juego de ordenador o videoconsola. Esto es, un objeto físico pasa a convertirse en un periférico configurado para ejecutar acciones determinadas sobre un programa informático. PREFERRED EMBODIMENT OF THE INVENTION As indicated above the present invention in its preferred non-limiting use It allows integrating one or more conventional toys (that is objects) and of any kind as control elements or controllers in a computer game or video game console. That is, a physical object becomes a peripheral configured to execute certain actions on a computer program.
Tal y como se observa en las figuras 1 a 3 la interacción entre los juguetes y el sistema informático se realiza en un área delimitada horizontalmente (1), tal como una mesa (figura 1), una parte del suelo (21 ) en la figura 2 o incluso toda una habitación o patio exterior de juego (31 ) en la figura 3. As can be seen in figures 1 to 3, the interaction between toys and the computer system is carried out in a horizontally delimited area (1), such as a table (figure 1), a part of the floor (21) in the figure 2 or even an entire room or outdoor playground (31) in Figure 3.
Sobre dicha área (1 ,21 ,31 ) se situarán al menos una pantalla (2,22,32) o un proyector de vídeo (3,23,33) siendo compatibles entre sí ambos dispositivos y pudiéndose emplear indistintamente dependiendo de las necesidades y/o gustos del usuario. La función de estos elementos es mostrar un entorno virtual (imagen y sonido) relacionado con el videojuego, tales como personajes virtuales para guiar durante el juego, o bien otros elementos virtuales que complementen la experiencia del usuario mientras juega. On said area (1, 21, 31) at least one screen (2.22.32) or a video projector (3.23.33) will be placed, both devices being compatible with each other and can be used interchangeably depending on the needs and / or user tastes. The function of these elements is to show a virtual environment (image and sound) related to the video game, such as virtual characters to guide during the game, or other virtual elements that complement the user experience while playing.
Esta pantalla (2,22,32) podrá ser el monitor de un ordenador, o bien cualquier televisión convencional. This screen (2,22,32) may be the monitor of a computer, or any conventional television.
A su vez, el sistema contará con un sensor y emisor infrarrojo ambos configurados como periférico de ordenador conectable mediante USB y compuesto por dos elementos: un sensor de imagen (4b, 24b, 34b) y un emisor de infrarrojos (4a, 24a, 34a). El sensor de imagen (4b, 24b, 34b) está compuesto por una cámara digital de vídeo convencional a cuya óptica se le aplica un filtro de luz infrarroja a 850 nm, para captar sólo la luz en dicha frecuencia. Además, esta cámara dispone de un juego de ópticas intercambiables u óptica focal variable, lo que permite variar el campo de visión para ajustarlo a las diferentes configuraciones de área de juego previamente propuesta (1 ,21 ,31 ) la cual es variable y configurable previamente por parte del usuario, siendo el sensor de imagen (4b, 24b, 34b) el que se adapta al área (1 ,21 ,31 ) y no al revés. In turn, the system will have an infrared sensor and transmitter both configured as a computer peripheral that can be connected via USB and consisting of two elements: an image sensor (4b, 24b, 34b) and an infrared transmitter (4a, 24a, 34a ). The image sensor (4b, 24b, 34b) is composed of a conventional digital video camera to whose optics an infrared light filter is applied at 850 nm, to capture only the light at that frequency. In addition, this camera has a set of interchangeable optics or variable focal optics, which allows to vary the field of vision to adjust it to the different configurations of previously proposed play area (1, 21, 31) which is variable and previously configurable by the user, the image sensor (4b, 24b, 34b) being the one that adapts to the area (1, 21, 31) and not vice versa.
El emisor de infrarrojo (4a, 24a, 34a) es un emisor LED de pulsos de alta intensidad de luz infrarroja a 780 nm, y donde la emisión de dichos pulsos se controlará a través del interface USB por un procesador (5, 25, 35) al que está conectado. El sistema incorpora un procesador (5,25,35) que consiste en una realización preferida en una CPU o en una videoconsola, en el que se encuentran conectados la entrada y/o salida el sensor (4b, 24b, 34b) y emisor infrarrojo (4a, 24a, 34a), la pantalla (2,22,32) y/o el proyector (3,23,33). Su función es el análisis del video captado por el sensor (4b, 24b, 34b) para la identificación y seguimiento de los juguetes (6,26,36) en el área del juego (1 ,21 ,31), y de la ejecución de la lógica del videojuego. The infrared emitter (4a, 24a, 34a) is a high intensity pulse LED emitter of infrared light at 780 nm, and where the emission of said pulses will be controlled through the USB interface by a processor (5, 25, 35 ) to which you are connected. The system incorporates a processor (5,25,35) which consists of a preferred embodiment in a CPU or in a video game console, in which the input and / or output of the sensor (4b, 24b, 34b) and infrared emitter are connected (4th, 24th, 34th), the screen (2.22.32) and / or the projector (3.23.33). Its function is the analysis of the video captured by the sensor (4b, 24b, 34b) for the identification and monitoring of toys (6,26,36) in the area of the game (1, 21, 31), and the execution of the logic of the video game.
De forma análoga, el sistema incorpora para su uso y/o juego, una pluralidad de objetos, en esta realización preferida juguetes (6,26,36) de tipo convencional, que serán manipulados por los usuarios para hacer evolucionar el videojuego. Para ello, dichos juguetes (6,26,36) incorporan de forma imprescindible un dispositivo electrónico (100) encargado de la comunicación visual con el procesador informático y de la detección y ejecución de los cambios de estado en el juguete. Similarly, the system incorporates for its use and / or game, a plurality of objects, in this preferred embodiment conventional toys (6,26,36), which will be manipulated by users to evolve the video game. To do this, said toys (6,26,36) incorporate an electronic device (100) in charge of visual communication with the computer processor and the detection and execution of changes in the state of the toy.
Dicho dispositivo electrónico (100) permite que el procesador (5,25,35) identifique el juguete (6,26,36); siga la posición (en dos dimensiones) y la orientación (en un eje) del juguete sobre el área de juego (1); identifique diferentes estados del juguete (6,26,36) provocados por el uso y/o manipulación del mismo por parte del usuario, y finalmente provoque cambios de estado en el mismo. Said electronic device (100) allows the processor (5.25.35) to identify the toy (6.26.36); follow the position (in two dimensions) and the orientation (on an axis) of the toy on the playing area (1); Identify different states of the toy (6,26,36) caused by the use and / or manipulation of the toy by the user, and finally cause changes in its condition.
El dispositivo electrónico (100) comprende al menos un cuerpo (101) con forma rectangular plana, y cuyas medidas variarán dependiendo del tipo de juguete (6,26,36) al que adaptarse. Dentro de dicho cuerpo (101) en una de sus caras se situará una hendidura (102) para la inserción en la misma de un marcador visual (103), y en donde en los laterales de dicha hendidura (102) se incorporara una pluralidad o array de diodos LED (102a) infrarrojos de 850 nm para la correcta retroiluminación del marcador acoplado. El marcador visual (103) es esencialmente una tarjeta materializada en diversos materiales, como por ejemplo, papel, cartulina, acetato, o cualquier otro de similares características y que permitan el paso de luz infrarroja por al menos una zona o porción de la misma, siendo el resto opacas, con una distribución variable de las mismas, dependiendo de las necesidades específicas del caso. El procesador (5,25,35) posee algoritmos de reconocimiento visual para identificar visualmente cada marcador (103), y de este modo identificar cada objeto o juguete (6,26,36), y calcular su posición y orientación respecto al área de juego (1 ,21 ,31 ). El sistema puede incluir una colección de estas tarjetas, o bien pueden ser generadas por ordenador a través de un software específico para tal fin e impresos en cualquier impresora convencional, de manera que sean los propios jugadores los que creen sus propios videojuegos híbridos a través de dicho software que podrá ser instalado en el propio procesador (5,25,35). The electronic device (100) comprises at least one body (101) with a flat rectangular shape, and whose measurements will vary depending on the type of toy (6.26.36) to which it is adapted. Within said body (101) on one of its faces a slit (102) will be placed for the insertion therein of a visual marker (103), and in which a plurality or 850 nm infrared LED diode array (102a) for the correct backlight of the coupled marker. The visual marker (103) is essentially a card materialized in various materials, such as paper, cardboard, acetate, or any other with similar characteristics and allowing infrared light to pass through at least one area or portion thereof, the rest being opaque, with a variable distribution of them, depending on the specific needs of the case. The processor (5,25,35) has visual recognition algorithms to visually identify each marker (103), and thus identify each object or toy (6.26,36), and calculate its position and orientation with respect to the area of game (1, 21, 31). The system can include a collection of these cards, or they can be generated by computer through specific software for this purpose and printed on any conventional printer, so that it is the players themselves who create their own hybrid video games through said software that can be installed in the processor itself (5,25,35).
El dispositivo (100) incorpora a su vez un array o tira (104) de estado del juguete compuesto por una tira o array de varios LED infrarojos (850nm) alineados. El número de diodos LED en este array puede variar entre uno y cuatro dependiendo del tamaño del dispositivo (100). The device (100) in turn incorporates an array or strip (104) of the toy state consisting of a strip or array of several infrared LEDs (850nm) aligned. The number of LEDs in this array can vary between one and four depending on the size of the device (100).
Así el procesador informático (5,25,35) puede detectar visualmente cuales de estos diodos están encendidos, los cuales se activarán dependiendo del número de sensores conectados en el array de conectores de sensores (105) compuestos por una pluralidad de conectores electrónicos hembra (pines positivo y negativo), cada uno asociado a un LED del array de estados del juguete (104). Thus the computer processor (5,25,35) can visually detect which of these diodes are on, which will be activated depending on the number of sensors connected in the array of sensor connectors (105) composed of a plurality of female electronic connectors ( positive and negative pins), each associated to an LED of the array of toy states (104).
A cada conector hembra (105) se le puede conectar un sensor electrónico de una colección de dispositivos: interruptores, Reed-switches, sensores de proximidad, sensores de presión, sensores de luz, etc. Al conectar un sensor a un conector, cuando dicho sensor se activa, se enciende el LED de estado del juguete asociado a ese conector. To each female connector (105) an electronic sensor of a collection of devices can be connected: switches, Reed-switches, proximity sensors, pressure sensors, light sensors, etc. When a sensor is connected to a connector, when said sensor is activated, the toy status LED associated with that connector is lit.
El dispositivo (100) incorpora a su vez un sensor de infrarrojo (106) compuesto por un sensor de luz infrarroja (780 nm), que detecta los pulsos de luz enviados por el emisor infrarrojo USB (4a, 24a, 34a) conectado al elemento procesador (5,25,35). De esta forma, y mediante la frecuencia de los pulsos detectados, el sistema informático puede enviar órdenes a un dispositivo (100). The device (100) in turn incorporates an infrared sensor (106) composed of an infrared light sensor (780 nm), which detects the light pulses sent by the USB infrared emitter (4a, 24a, 34a) connected to the element processor (5.25.35). In this way, and by the frequency of the pulses detected, the computer system can send orders to a device (100).
Dichas órdenes activan un actuador conectado en el array de conectores (107) de actuadores que comprenden una variedad de conectores electrónicos hembra a los que se puede conectar un dispositivo electrónico de una colección de actuadores (por ejemplo. motores, luces, altavoces, vibradores, o cualquier otro), de tal forma que el actuador se activará cuando el sensor infrarrojo (106) detecta una determinada frecuencia de pulsos infrarrojos (780nm) enviada por el procesador (5,25,35) a través del emisor infrarrojo (4a,24a,34a). Said commands activate an actuator connected in the array of connectors (107) of actuators comprising a variety of female electronic connectors to which an electronic device from a collection of actuators (for example, can be connected). motors, lights, speakers, vibrators, or any other), so that the actuator will be activated when the infrared sensor (106) detects a certain frequency of infrared pulses (780nm) sent by the processor (5,25,35) to through the infrared emitter (4th, 24th, 34th).
El dispositivo (100) podrá acoplarse tanto a la base (figura 5) como a la parte superior (figura 6) de los juguetes (6), en función de la configuración del entorno del juego. The device (100) can be attached to both the base (figure 5) and the top (figure 6) of the toys (6), depending on the configuration of the game environment.
En la figura 7 se muestra una primera realización práctica de la invención en donde el juguete sirve para fabricar pan. El usuario tiene que colocar un muñeco de juguete (71 ) dentro del molino (70). Después, hace girar las aspas soplando. Al girar, van apareciendo panes (72) como elementos virtuales proyectados en la superficie, en la puerta del molino (70). Al juguete con forma de molino (70) se le acopla una dispositivo (100) con marcador (73) en su parte superior para su reconocimiento en una configuración de juego como la descrita anteriormente. A first practical embodiment of the invention is shown in Figure 7, where the toy is used to make bread. The user has to place a toy doll (71) inside the mill (70). Then, spin the blades blowing. When turning, loaves (72) appear as virtual elements projected on the surface, at the mill gate (70). The mill-shaped toy (70) is coupled with a device (100) with marker (73) in its upper part for recognition in a game configuration as described above.
Uno de los arrays de conectores de sensores (105) está conectado con un interruptor embebido en las aspas (74) del molino, de forma que el LED infrarrojo (104) asociado a dicho conector se enciende y se apaga conforme las aspas (74) del molino dan vueltas. One of the sensor connector arrays (105) is connected to a switch embedded in the blades (74) of the mill, so that the infrared LED (104) associated with said connector turns on and off according to the blades (74) of the mill go around.
El muñeco (71 ) contiene un imán. En el interior del molino (70) hay embebido un reed-switch conectado a uno de los conectores del array de sensores (105) del dispositivo (100). Esto provoca que el LED del array de estados asociado a ese conector se encienda cuando el muñeco (71 ) esté dentro del molino (70). The doll (71) contains a magnet. Inside the mill (70) there is a reed-switch connected to one of the sensors array connectors (105) of the device (100). This causes the LED of the array of states associated with that connector to light up when the doll (71) is inside the mill (70).
El procesador informático (5,25,35) identifica al molino (70) por su marcador visual (103) y deduce su posición y orientación en el área de juego (1 ). El procesador informático (5,25,35) es capaz de saber si el muñeco (71 ) está dentro del molino (70) si detecta que el LED asociado del array de estados (104) está encendido, y sabe cuándo girar las aspas (74) del molino cuando se enciende y se apaga el LED asociado del array de estados (104) del dispositivo. Con ello, la lógica del juego sabe que tiene que proyectar nuevos panes virtuales. La figura 8 muestra una segunda realización práctica donde el juguete es un tren (80) que se encarga de recoger los panes que se fabrican en el juguete del molino. Para ello, cuando en la cabina de la locomotora (81 ) se coloca un muñeco (82), se mueve por las vías. Cuando pasa cerca del molino, se para, carga los panes virtuales en el vagón (83), y se pone en marcha. Cuando llega al pueblo (casas de juguetes), descarga el pan y toca el silbato. The computer processor (5,25,35) identifies the mill (70) by its visual marker (103) and deduces its position and orientation in the playing area (1). The computer processor (5,25,35) is able to know if the doll (71) is inside the mill (70) if it detects that the associated LED of the array of states (104) is on, and knows when to turn the blades ( 74) of the mill when the associated LED of the array of states (104) of the device is turned on and off. With this, the logic of the game knows that it has to project new virtual breads. Figure 8 shows a second practical embodiment where the toy is a train (80) that is responsible for collecting the breads that are manufactured in the mill toy. To do this, when a doll (82) is placed in the locomotive cabin (81), it moves along the tracks. When it passes near the mill, it stops, loads the virtual loaves in the car (83), and starts up. When he reaches the town (toy houses), unload the bread and blow the whistle.
En la parte superior de la locomotora (81 ) se coloca un dispositivo (100) con un marcador visual (103). A uno de los conectores del array de conectores de sensores (105) se conecta un reed-switch embebido en la cabina de la locomotora (81 ). El muñeco (82) contiene un imán que activa el reed-Switch, lo cual enciende el LED correspondiente del array de LEds de estados (104). At the top of the locomotive (81) a device (100) with a visual marker (103) is placed. To one of the connectors of the sensor connector array (105) a reed-switch embedded in the locomotive cabin (81) is connected. The doll (82) contains a magnet that activates the reed-Switch, which turns on the corresponding LED of the array of status LEDs (104).
A uno de los conectores de actuadores (107) se conecta el motor (84) de la locomotora (81), y al otro conector de actuadores se conecta al silbador (85) de la locomotora. El sensor de infrarrojo (106) detecta pulsos emitidos por el emisor de infrarrojo (4a, 24a, 34a) USB conectado al procesador informático (5,25,35). Dependiendo de la frecuencia de estos pulsos, conecta el motor (84) de la locomotora, o hace sonar el silbato (85). De esta forma, cuando el procesador informático (5,25,35) detecta el LED de estado (104) correspondiente al muñeco (82) colocado en la cabina, manda pulsos infrarrojos por el emisor LED (4a, 24a, 34a) para activar el motor (84) de la locomotora. The motor (84) of the locomotive (81) is connected to one of the actuator connectors (107), and to the other actuator connector it is connected to the loader (85) of the locomotive. The infrared sensor (106) detects pulses emitted by the infrared emitter (4th, 24th, 34th) USB connected to the computer processor (5,25,35). Depending on the frequency of these pulses, connect the engine (84) of the locomotive, or blow the whistle (85). In this way, when the computer processor (5.25.35) detects the status LED (104) corresponding to the doll (82) placed in the cabin, it sends infrared pulses through the LED emitter (4th, 24th, 34th) to activate the engine (84) of the locomotive.
Deja de emitir dichos pulsos cuando el tren pasa cerca del molino (70), y hace moverse los panes virtuales proyectados al vagón del tren. Vuelve a dar orden de moverse al tren. Cuando pasa cerca de las casas del pueblo, deja de emitir los pulsos correspondientes al motor, y manda pulsos a la frecuencia correspondiente ai conector del silbato de la locomotora. Stop emitting these pulses when the train passes near the mill (70), and moves the projected virtual loaves to the train car. Give order to move to the train again. When it passes near the houses of the town, it stops emitting the corresponding pulses to the engine, and sends pulses at the frequency corresponding to the locomotive whistle connector.

Claims

REIVINDICACIONES
1 . Dispositivo (100) identificador infrarrojo que comprende one . Device (100) infrared identifier comprising
unos emisores infrarrojos (104);  infrared emitters (104);
unos sensores infrarrojos (106);  infrared sensors (106);
unos conectores para sensores (105); y  connectors for sensors (105); Y
unos conectores para actuadores (107);  connectors for actuators (107);
caracterizado por que comprende  characterized by comprising
un cuerpo rectangular plano (101) que a su vez contiene en uno de sus lados  a flat rectangular body (101) which in turn contains on one of its sides
- un espacio hueco rectangular (102)  - a rectangular hollow space (102)
un array de LED (102a) emisores en el espectro infrarrojo situados en los frontales de dicho espacio hueco rectangular (102);  an array of LED (102a) emitters in the infrared spectrum located on the front of said rectangular hollow space (102);
de tal forma que dicho array de LED (102a) retroilumina un marcador visual (103) alojado en dicho espacio rectangular (102) y donde dicho marcador visual (103) es un elemento plano con una combinación variable de áreas opacas y transparentes a la luz en el espectro infrarrojo.  such that said LED array (102a) backlights a visual marker (103) housed in said rectangular space (102) and wherein said visual marker (103) is a flat element with a variable combination of opaque and light-transparent areas in the infrared spectrum.
2. Dispositivo (100) de acuerdo con la reivindicación 1 donde los emisores infrarrojos comprenden un array de diodos LED infrarrojos (104) alineados y asociados con un array de conectores (105), al menos uno por LED y donde a su vez cada conector (105) está conectado con un sensor electrónico propio de un objeto (6,26,36) de tal forma que con un sensor electrónico activado se activa un LED infrarrojo (104). 2. Device (100) according to claim 1 wherein the infrared emitters comprise an array of infrared LED diodes (104) aligned and associated with an array of connectors (105), at least one per LED and where in turn each connector (105) is connected to an electronic sensor of an object (6.26.36) in such a way that an infrared LED (104) is activated with an activated electronic sensor.
3. Dispositivo (100) de acuerdo con la reivindicación 2 donde los LED emiten en el espectro de los 850 nm. 3. Device (100) according to claim 2 wherein the LEDs emit in the 850 nm spectrum.
4. Dispositivo (100) de acuerdo con la reivindicación 1 a 3 donde los sensores infrarrojos comprenden un sensor de luz infrarroja (106) configurado para detectar una pluralidad de pulsos de luz infrarroja. 4. Device (100) according to claim 1 to 3 wherein the infrared sensors comprise an infrared light sensor (106) configured to detect a plurality of pulses of infrared light.
5. Dispositivo (100) de acuerdo con las reivindicaciones 1 a 4 donde el sensor de luz infrarroja (106) detecta en el espectro de los 780 nm. 5. Device (100) according to claims 1 to 4 wherein the infrared light sensor (106) detects in the 780 nm spectrum.
6. Dispositivo (100) de acuerdo con las reivindicaciones 1 -5 que comprende un array de conectores (107) al menos un conector por actuador del objeto (6,26,36). 6. Device (100) according to claims 1-5 comprising an array of connectors (107) at least one connector per actuator of the object (6.26.36).
7. Un sistema para la identificación y control de objetos (6,26,36) en un espacio delimitado horizontalmente (1 ,21 ,31) que comprende 7. A system for the identification and control of objects (6,26,36) in a horizontally delimited space (1, 21, 31) comprising
un espacio horizontal (1 ,21 ,31) de área variable y configurable,  a horizontal space (1, 21, 31) of variable and configurable area,
sobre la que quedan dispuestos una pluralidad de objetos (6,26,36);  on which a plurality of objects are arranged (6,26,36);
una unidad de control con al menos un procesador (5,25,35);  a control unit with at least one processor (5.25.35);
medios configurados para enviar y recibir señales infrarrojas que comprende  means configured to send and receive infrared signals comprising
una pluralidad de emisores en el espectro infrarrojo (4a, 24a, 34a); y a plurality of emitters in the infrared spectrum (4a, 24a, 34a); Y
- una cámara de visión infrarroja (4b, 24b, 34b); - an infrared vision camera (4b, 24b, 34b);
y donde cada uno de dichos objetos (6,26,36) lleva adherido un dispositivo (100) de acuerdo con cualquiera de las reivindicaciones 1-6, de tal forma que un único dispositivo (100) identifica a un único objeto (6,26,36);  and wherein each of said objects (6,26,36) has attached a device (100) according to any one of claims 1-6, such that a single device (100) identifies a single object (6, 26.36);
caracterizado por que  characterized by that
el dispositivo (100) está configurado para  the device (100) is configured to
- identificar el objeto (6,26,36) con el que está asociado;  - identify the object (6,26,36) with which it is associated;
indicar el estado del objeto (6,26,36) a través de unos emisores infrarrojos (104);  indicate the state of the object (6.26.36) through infrared emitters (104);
- ejecutar las instrucciones procedentes del procesador (5,25,35) y recibidas como pulsos de señal infrarroja a una frecuencia determinada a través del sensor de infrarrojos (106);  - execute the instructions from the processor (5,25,35) and received as infrared signal pulses at a certain frequency through the infrared sensor (106);
y donde dicho procesador (5,25,35) está configurado para  and where said processor (5,25,35) is configured to
- analizar una imagen de video capturada por la cámara infrarroja (4b,24b,34b);  - analyze a video image captured by the infrared camera (4b, 24b, 34b);
- identificar a cada objeto (6,26,36) de forma independiente a través de la captura de la imagen de un marcador visual (103) del dispositivo (100) asociado con dicho objeto;  - identify each object (6.26,36) independently by capturing the image of a visual marker (103) of the device (100) associated with said object;
- calcular la posición, orientación y estado dentro del área (1 ,21 ,31) de cada objeto (6,26,36) de forma independiente a través de la captura de la imagen de un marcador visual (103) del dispositivo (100) asociado con dicho objeto; y  - calculate the position, orientation and status within the area (1, 21, 31) of each object (6,26,36) independently by capturing the image of a visual marker (103) of the device (100 ) associated with said object; Y
- ejecutar uno o más programas almacenados en una o más memorias para el control de cada uno de los objetos (6,26,36) a través del dispositivo (100) asociado con dicho objeto a través de la captura de la imagen de la señal de los emisores (104) que representan el estado del objeto (6,26,36), estando dichas señales de control emitidas mediante pulsos en el espectro infrarrojo (4a, 24a, 34a). - execute one or more programs stored in one or more memories for the control of each of the objects (6,26,36) through the device (100) associated with said object through the capture of the signal image of the emitters (104) representing the state of the object (6.26.36), said control signals being emitted by pulses in the infrared spectrum (4th, 24th, 34th).
8. Sistema de acuerdo con la reivindicación 7 donde los emisores en el espectro infrarrojo (4a, 24a, 34a) son emisores LED de pulsos de alta intensidad de luz infrarroja en el espectro de los 780 nm. 8. System according to claim 7 wherein the emitters in the infrared spectrum (4a, 24a, 34a) are high intensity pulse LED emitters of infrared light in the 780 nm spectrum.
9. Sistema de acuerdo con las reivindicaciones 7 y 8 donde la cámara de visión infrarroja (4b, 24b, 34b) es una cámara de video con un filtro de luz infrarroja en el espectro de los 850 nm, donde dicha cámara además es de óptica intercambiable y/o de óptica focal variable y adaptable al área (1 ,21 ,31) de tal forma que su ángulo de visión cubra dicho área (1 ,21 ,31) completamente. 9. System according to claims 7 and 8 wherein the infrared vision camera (4b, 24b, 34b) is a video camera with an infrared light filter in the 850 nm spectrum, wherein said camera is also optical interchangeable and / or of variable focal optics and adaptable to the area (1, 21, 31) so that its viewing angle covers said area (1, 21, 31) completely.
10. Método para la identificación y control de objetos (6,26,36) en un espacio delimitado horizontalmente (1 ,21 ,31 ) implementado en el sistema de acuerdo con cualquiera de las reivindicaciones 7 a 9 que comprende las etapas de 10. Method for the identification and control of objects (6,26,36) in a horizontally delimited space (1, 21, 31) implemented in the system according to any of claims 7 to 9 comprising the steps of
proporcionar un marcador visual (103) único en el espectro infrarrojo a un dispositivo identificador (100);  providing a unique visual marker (103) in the infrared spectrum to an identifying device (100);
unir un dispositivo identificador (100) a un único objeto cualquiera (6,26,36) dentro de un espacio horizontal (1 ,21 ,31 ) de área variable y configurable;  joining an identifier device (100) to a single object (6.26.36) within a horizontal space (1, 21, 31) of variable and configurable area;
capturar una imagen de video por la cámara infrarroja (4b,24b,34b) e identificar a cada objeto (6,26,36) de forma independiente a través de la captura de la imagen de un marcador visual (103) del dispositivo (100) asociado con dicho objeto;  capture a video image by the infrared camera (4b, 24b, 34b) and identify each object (6.26,36) independently by capturing the image of a visual marker (103) of the device (100 ) associated with said object;
calcular la posición y orientación en el área (1 ,21 ,31 ) de cada objeto (6,26,36) de forma independiente a través de la captura de la imagen de un marcador visual (103) del dispositivo (100) asociado con dicho objeto; y  calculate the position and orientation in the area (1, 21, 31) of each object (6,26,36) independently by capturing the image of a visual marker (103) of the device (100) associated with said object; Y
ejecutar uno o más programas almacenados en una o más memorias para el control de cada uno de los objetos (6,26,36) a través del dispositivo (100) asociado con dicho objeto, estando dichas señales de control emitidas mediante pulsos en el espectro infrarrojo (4a,24a,34a).  execute one or more programs stored in one or more memories for the control of each of the objects (6,26,36) through the device (100) associated with said object, said control signals being emitted by pulses in the spectrum infrared (4th, 24th, 34th).
1 1. Un producto de programa informático con instrucciones configuradas para su ejecución por un procesador (5,25,35) que, cuando son ejecutadas por un sistema de acuerdo con las reivindicaciones 7 a 9 hacen que éste lleve a cabo el procedimiento según la reivindicación 10. 1 1. A computer program product with instructions configured for execution by a processor (5,25,35) which, when executed by a system according to claims 7 to 9 causes the latter to carry out the procedure according to the claim 10
12. Uso del sistema según cualquiera de las reivindicaciones 7 a 9 para la creación de videojuegos híbridos. 12. Use of the system according to any of claims 7 to 9 for the creation of hybrid video games.
PCT/ES2014/000016 2013-02-08 2014-02-05 System and method for the identification and control of objects in a defined space and use thereof in the creation of hybrid video games WO2014122341A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ESP201330154 2013-02-08
ES201330154A ES2492165B1 (en) 2013-02-08 2013-02-08 SYSTEM AND METHOD FOR THE IDENTIFICATION AND CONTROL OF OBJECTS IN A DEFINED SPACE AND USE IN THE CREATION OF HYBRID VIDEO GAMES

Publications (1)

Publication Number Publication Date
WO2014122341A1 true WO2014122341A1 (en) 2014-08-14

Family

ID=51299254

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/ES2014/000016 WO2014122341A1 (en) 2013-02-08 2014-02-05 System and method for the identification and control of objects in a defined space and use thereof in the creation of hybrid video games

Country Status (2)

Country Link
ES (1) ES2492165B1 (en)
WO (1) WO2014122341A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060277571A1 (en) * 2002-07-27 2006-12-07 Sony Computer Entertainment Inc. Computer image and audio processing of intensity and input devices for interfacing with a computer program
US20080070684A1 (en) * 2006-09-14 2008-03-20 Mark Haigh-Hutchinson Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting
US20080080789A1 (en) * 2006-09-28 2008-04-03 Sony Computer Entertainment Inc. Object detection using video input combined with tilt angle information
US20110169737A1 (en) * 2010-01-12 2011-07-14 Nintendo Co., Ltd. Storage medium having information processing program stored therein, information processing apparatus, and information processing system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060277571A1 (en) * 2002-07-27 2006-12-07 Sony Computer Entertainment Inc. Computer image and audio processing of intensity and input devices for interfacing with a computer program
US20080070684A1 (en) * 2006-09-14 2008-03-20 Mark Haigh-Hutchinson Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting
US20080080789A1 (en) * 2006-09-28 2008-04-03 Sony Computer Entertainment Inc. Object detection using video input combined with tilt angle information
US20110169737A1 (en) * 2010-01-12 2011-07-14 Nintendo Co., Ltd. Storage medium having information processing program stored therein, information processing apparatus, and information processing system

Also Published As

Publication number Publication date
ES2492165B1 (en) 2015-04-07
ES2492165A1 (en) 2014-09-08

Similar Documents

Publication Publication Date Title
US11911709B2 (en) Toy construction system for augmented reality
US8632376B2 (en) Robotic game systems and methods
JP7322122B2 (en) Information processing device, information processing method, and information medium
KR102435699B1 (en) Game system
US10004997B2 (en) Smart phone controllable construction brick vehicle
US10258888B2 (en) Method and system for integrated real and virtual game play for multiple remotely-controlled aircraft
US7756297B2 (en) Camera based sensing in handheld, mobile, gaming, or other devices
KR20140133496A (en) Baseplate assembly for use with toy pieces
US11458385B2 (en) Storage medium storing information processing program, information processing system, information processing apparatus and information processing method
US10185296B2 (en) Interactive application platform for a motorized toy entity and display
KR20180013487A (en) ROBOT SYSTEM for SOFTWARE EDUCATION
US20170056783A1 (en) System for Obtaining Authentic Reflection of a Real-Time Playing Scene of a Connected Toy Device and Method of Use
US9550129B2 (en) Multiplayer game platform for toys fleet controlled by mobile electronic device
US10751605B2 (en) Toys that respond to projections
WO2014122341A1 (en) System and method for the identification and control of objects in a defined space and use thereof in the creation of hybrid video games
US20130231029A1 (en) Interactive Toy
JP2019522219A (en) Object tracking system and method
EP3814866B1 (en) Self-moving educational toy
TWM454233U (en) Toy system and image display unit thereof
US20230338865A1 (en) User configurable interactive toy
KR101537350B1 (en) Game apparatus using magnetism

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14749623

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14749623

Country of ref document: EP

Kind code of ref document: A1