WO2015135592A1 - Modular touchless control devices - Google Patents
Modular touchless control devices Download PDFInfo
- Publication number
- WO2015135592A1 WO2015135592A1 PCT/EP2014/055149 EP2014055149W WO2015135592A1 WO 2015135592 A1 WO2015135592 A1 WO 2015135592A1 EP 2014055149 W EP2014055149 W EP 2014055149W WO 2015135592 A1 WO2015135592 A1 WO 2015135592A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interface device
- human interface
- input data
- sensor element
- emulation unit
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Definitions
- the present disclosure relates to a device for touchless controlling of a computer system, for example to a modular touchless virtual keyboard and/or mouse device.
- Touchless pointing device a touchless pointing device is described for controlling a computer emulating a mouse by means of gestures over a plane.
- the pointing device can be used touchless to control a third party computer, it can be only used with the kind of sensors described in the application.
- the invention described in this application requires drivers and/or software to be installed in the third party computer.
- this kind of devices have to be used connected to a computer system, which is able to run its drivers with the compatible operating system and with a hardware complying with the minimum requirements.
- This approach makes it impossible to use this kind of devices in computer systems that do not comply with all the requirements.
- it implies installing software in the computer system (SDK, drivers, etc.), which is not possible in many B2B use cases (for example, in the medical field, third party workstations do not allow installing any software from other companies.
- they have specially prepared operating system that is not compatible with the previously mentioned kind of sensors).
- an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element may comprise a first interfacing module for connecting the touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to the human interface device emulation unit; a processing module comprising a processor and a memory, embodying instructions stored in the memory and executable by the processor, the instructions being adapted to execute a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element described later; an operating system stored in the memory; at least one driver associated to the touchless sensor element and to the operating system, the driver being stored in the memory.
- This apparatus allows for providing a device for touchless controlling of a computer system as described later.
- the apparatus is able to run all the software required for the touchless sensor element (all the software and drivers required for the touchless sensor element to work is installed in this apparatus) and, in combination with the touchless sensor element and the human interface device emulation unit, it is able to touchless control any type of computer system, no matter what hardware and software they have inside. That is, the apparatus is able to control any type of computer system independently of the operating system, microprocessor architecture or characteristics, as long as the computer system supports predefined or standard human interface devices such as standard mouse or keyboard devices. Because all the required drivers and software are installed in the apparatus, no software is required to be installed in the computer system to be controlled by the apparatus.
- The(se) device(s) may cover any type of device(s) with data processing capabilities, such as e.g. computers, mobile phones (smartphones), tablets, etc.
- The(se) device(s) may comprise any type of hardware and software components, such as e.g. input, output and storage components which may stand alone or be connected in a network or other similar device(s).
- The(se) device(s) may also include computer data storage devices or media.
- driver may refer to the software that allows the operating system to interact with the touchless sensor element. This way, the driver of each touchless sensor element allows the operating system for knowing the state of the touchless sensor element (i.e. if the touchless sensor element is on or off, etc.). Each driver may be provided, for example, by the manufacturer of the touchless sensor element or the manufacturer of the operating system.
- this software may be structured in layers, this structure in layers ensuring an easy replacement of any layer without affecting the rest.
- this modularity allows the apparatus being compatible with any touchless sensor element present or future.
- the apparatus, in combination with the touchless sensor element and the human interface device emulation unit, is able to control any type of computer system.
- the first layer may comprise the instructions for controlling the touchless sensor element, so if a new touchless sensor element needs to be supported it is sufficient to replace this layer (or a part of it).
- the second layer may be the main one, the one that may comprise the instructions for converting the received commands from the first layer (gestures, voice commands, eye movements, etc.) into human interface device input data, for example mouse movements or keyboard shortcuts.
- the piece of software for this second layer may be implemented according to an SDK (Software Development Kit) associated to the touchless sensor element (it may be provided by the manufacturer of the touchless sensor element or the manufacturer of the operating system) and according to the standard mouse/keyboard protocols.
- SDK Software Development Kit
- an open hand moved to the right by means of the SDK and assign the determined type of the command to an input data (for example, mouse or keyboard input data) according to the standard mouse/keyboard protocols (for example, input data relating to a movement of the cursor to the right). Consequently, for example, an open hand moved to the right determined by the piece of software (based in the cited SDK) may suppose a movement of the cursor to the right in the computer system.
- the third layer may comprise the instructions for packing the human interface device input data (e.g. the mouse movements or the keyboard shortcuts) into the corresponding signals which the computer system to be controlled may see as predefined human interface device input data signals (e.g. standard mouse or keyboard signals).
- predefined human interface device input data signals e.g. standard mouse or keyboard signals.
- Another advantage of the modularity of the software comprised in the apparatus is that it allows easy interchanging of the touchless sensor element such that it allows the user to control the computer system by means of voice commands, gestures, eye-tracking, etc.
- this apparatus could be replaced by a compatible one.
- an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element may comprise a first interfacing module for connecting a touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to a human interface device emulation unit; computer/electronic means for receiving the at least one command from the touchless sensor element; computer/electronic means for determining the type of command received from the touchless sensor element; computer/electronic means for converting the received command into human interface device input data according to the determined type of the received command; computer/electronic means for packing the human interface device input data into corresponding predefined human interface device input data signals; computer/electronic means for making available the corresponding predefined human interface device input data signals to the human interface device emulation unit; a memory for storing an operating system and at least one driver associated to the touchless sensor element and to
- the electronic/computer means may be used interchangeably, that is, a part of the described means may be electronic means and the other part may be computer means, or all described means may be electronic means or all described means may be computer means.
- Examples of an apparatus comprising only electronic means may be a CPLD, a FPGA or an ASIC.
- the apparatus may comprise a third interfacing module for connecting the apparatus to a communication network, for example a global communication network such as Internet.
- a communication network for example a global communication network such as Internet.
- This third interfacing module for connecting the apparatus to a communication network may comprise a wired/wireless communication interface, for example, it may be any standard interface such as Bluetooth, Wi-Fi or Ethernet but it is not limited to them.
- the first interfacing module for connecting the touchless sensor element to the apparatus may comprise a wired/wireless communication interface, for example, it may be any standard interface such as USB, IR or Bluetooth but it is not limited to them.
- the second interfacing module for connecting the apparatus to the human interface device emulation unit may comprise a wired/wireless communication interface, for example, it may be any standard interface such as USB, IR or Bluetooth but it is not limited to them.
- a method of generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element is provided.
- the method may comprise:
- converting the received command into human interface device input data according to the determined type of the received command may comprise:
- packing the human interface device input data into corresponding predefined human interface device input data signals recognizable by a computer system may comprise:
- making available the corresponding predefined human interface device input data signals to the human interface device emulation unit may comprise:
- a computer program product may comprise program instructions for causing a computer system to perform a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element as described above.
- the computer program product may be embodied on a storage medium (for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory) or carried on a carrier signal (for example, on an electrical or optical carrier signal).
- a storage medium for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory
- a carrier signal for example, on an electrical or optical carrier signal
- the computer program may be in the form of source code, object code, a code intermediate source and object code such as in partially compiled form, or in any other form suitable for use in the implementation of the processes according to the invention.
- the carrier may be any entity or device capable of carrying the computer program.
- the carrier may comprise a storage medium, such as a ROM, for example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a floppy disc or hard disk.
- a storage medium such as a ROM, for example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a floppy disc or hard disk.
- the carrier may be a transmissible carrier such as an electrical or optical signal, which may be conveyed via electrical or optical cable or by radio or other means.
- the carrier may be constituted by such cable or other device or means.
- the carrier may be an integrated circuit in which the computer program is embedded, the integrated circuit being adapted for performing, or for use in the performance of, the relevant methods.
- a device for touchless controlling of a computer system may comprise an apparatus as described above; the touchless sensor element connected to the apparatus through the first interfacing module; the human interface device emulation unit connected to the apparatus through the second interfacing module, this human interface device emulation unit comprising a fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled; wherein, in operation, the human interface device emulation unit provides, through the fourth interfacing module, the corresponding predefined human interface device input data signals to the computer system, such that the signals received by the computer system are recognizable human interface device signals.
- the touchless sensor element Because all the drivers and software required are installed in the device (more specifically in the apparatus), no software is required in the computer system to be controlled by the touchless sensor element (i.e. it is not required installing anything in the computer system).
- the device is able to control any kind of computer system (no matter what the operating system, hardware or software in it may be) and it is sufficient that the computer system has the standard mouse/keyboard drivers. For this reason, it is possible to control the computer system with several types of touchless sensor elements. Furthermore, the touchless sensor element does not need to be embedded in the computer system or be connected to it.
- the provision of the human interface device emulation unit allows for performing the emulation of the human interface device and allows for performing the connection to (through the fourth module) and control of the computer system. More specifically, the human interface device emulation unit is able to get or receive the packed movements (that is, the corresponding predefined human interface device input data signals) and communicate them to the computer system to be controlled in a way that the computer system may interpret them as coming from a standard keyboard or mouse (or any other standard human interface device). This way, from the point of view of the computer system, the device for touchless controlling of the computer system is seen as a standard mouse or keyboard. Therefore, as this kind of computer systems are already prepared for being controlled by a mouse or keyboard, no drivers or extra software is required to be installed.
- the touchless sensor element may be a gesture controlled element or a voice controlled element.
- the touchless sensor element may be any gesture, eye-tracking or voice controlled elements, such as a Microsoft Kinect, a LEAP Motion unit, a MYO from Thamic Labs or a Google Glass, but it is not limited to them. It may be a long, medium or short range sensor based on, for example, IR, computer vision, wearable sensor or any other sensor able to be connected to a computer system through standard ports such as IR, Bluetooth or USB, but it is not limited to them.
- the fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled may comprise a wired/wireless communication interface.
- a wired/wireless communication interface may be any standard interface such as USB, IR or Bluetooth, but it is not limited to them.
- the human interface device emulation unit may comprise a unit for emulating a human interface device selected from a mouse or a keyboard.
- the term "human interface device” may refer to any type of computer device that interacts directly with humans such as a mouse or a keyboard. These human interface devices may use standard protocols, which may be implemented for any computer system.
- the touchless sensor element may be connected to the apparatus and the drivers and its software associated may be installed in the apparatus. Consequently, it is not necessary to replace neither the apparatus nor the human interface device emulation unit.
- the apparatus may be replaced by another compatible one, without replacing the touchless sensor element nor the human interface device emulation unit.
- the human interface device emulation unit allows the device for touchless controlling of a computer system to be seen as a USB or Bluetooth mouse or keyboard by the computer system to be controlled. In case the computer system has to be accessed by another type of interface (IR, WiFi, etc.) only the human interface device emulation unit needs to be replaced (neither the touchless sensor element nor the apparatus have to be replaced).
- a method of touchless controlling of a computer system is also provided. This method may comprise:
- making available the corresponding predefined human interface device input data signals to the human interface device emulation unit may comprise sending the corresponding predefined human interface device input data signals to the human interface device emulation unit.
- the method may comprise the human interface device emulation unit obtaining the corresponding predefined human interface device input data signals made available.
- This computer program product may comprise program instructions for causing a computer system to perform a method of touchless controlling of a computer system as described above.
- This computer program product may be embodied on a storage medium (for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory) or carried on a carrier signal (for example, on an electrical or optical carrier signal).
- a storage medium for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory
- a carrier signal for example, on an electrical or optical carrier signal
- Fig. 1 shows a schematic representation of an apparatus according to some embodiments
- Fig. 2 shows a schematic representation of a device for touchless controlling of a computer system according to some embodiments
- Fig. 3 is a flow chart illustrating a method of touchless controlling of a computer system according to some embodiments.
- Figure 1 is a schematic representation of an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element according to some embodiments.
- the apparatus 1 may comprise a first interfacing module 2 for connecting a touchless sensor element to the apparatus 1 ; a second interfacing module 3 for connecting the apparatus 1 to a human interface device emulation unit; a third interfacing module 4 for connecting the apparatus 1 to a communication network such as the Internet; and a processing module 5.
- the processing module 5 may comprise a processor 6 and a memory 7, embodying instructions 8 stored in the memory 7 and executable by the processor 6, the instructions 8 being adapted to execute a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element described later.
- the memory 7 may also store an operating system 9 and a driver 10 associated to each touchless sensor element supported by the apparatus 1 (more specifically, by the operating system running on the apparatus 1 ).
- the first interfacing module 2 for connecting the touchless sensor element to the apparatus 1 may comprise a wired communication interface, for example, it may be any standard interface such as USB, but it could be another wired or wireless communication interface such as IR or Bluetooth. Obviously, it is not limited to them;
- the second interfacing module 3 for connecting the apparatus to the human interface device emulation unit may comprise a wired communication interface, for example, it may be any standard interface such as USB, but it could be another wired or wireless communication interface such as IR or Bluetooth. Obviously, it is not limited to them;
- the third interfacing module 4 for connecting the apparatus to a communication network may comprise a wireless communication interface, for example, it may be any standard interface such as Wi-Fi, but it could be another wired or wireless communication interface such as Ethernet, IR or Bluetooth. Obviously, it is not limited to them. It is possible to connect the apparatus 1 to a communication network, for example, for updating the software stored in the memory 6 of the apparatus 1 (or a part or a layer of it) or for uploading new software such as drivers for new touchless sensor elements unsupported by the apparatus;
- the processing module 5 may be any computer, for example an embedded computer, such as an electrician Leonardo or a Raspberry Pi;
- the operating system 9 may be Windows XP or higher but it could be another operating system such as Linux or Mac OS; -
- the driver 10 of each touchless sensor element must be compatible with the described operating system.
- Figure 2 illustrates a schematic representation of a device 20 for touchless controlling of a computer system.
- the device may comprise an apparatus 1 as described above (see Figure 1 ); a touchless sensor element 21 connected to the apparatus 1 through the first interfacing module 2; and a human interface device emulation unit 22 connected to the apparatus through the second interfacing module 3.
- the human interface device emulation unit 22 may comprise a fourth interfacing module 23 for connecting this emulation unit 21 (that is, the device 20) to a computer system 24.
- the touchless sensor element 21 may be a gesture controlled element or a voice controlled element.
- the touchless sensor element may be any of the existing or future gesture, eye-tracking or voice controlled elements, such as a Microsoft Kinect, a LEAP Motion unit, a MYO from Thamic Labs or a Google Glass, but it is not limited to them. It may be long, medium or short range based on, for example, IR, computer vision, wearable sensor or any other sensor able to be connected to a computer system through standard ports such as IR, Bluetooth or USB, but it is not limited to them;
- the human interface device emulation unit 22 may be a mouse/keyboard emulation unit
- the fourth interfacing module 23 may be a wired communication interface such as USB, but it could be another wired or wireless communication interface such as Wi-Fi, IR or Bluetooth. However, it is not limited to them;
- the computer system 24 may be, for example, a medical device. This way, because all the drivers and software required are installed in the device 20 (more specifically in the apparatus 1 ), no software is required in the computer system 24 to be controlled by the touchless sensor element 21 (i.e. it is not required to install anything in the computer system).
- the device 20 is able to control any kind of computer system (no matter what the operating system, hardware or software in it may be) and it is sufficient that the computer system 24 has the standard mouse/keyboard drivers.
- the human interface device emulation unit 22 allows for performing the emulation of the human interface device and allows for performing the connection to (through the fourth module) and control of the computer system 24. More specifically, the human interface device emulation unit 22 is able to get or receive the packed movements (that is, the corresponding predefined human interface device input data signals) and communicate them to the computer system 24 to be controlled in a way this computer system understands or interprets them as coming from a standard keyboard or mouse (or any other standard human interface device). This way, from the point of view of the computer system 24, the device 20 for touchless controlling of the computer system is shown as a standard mouse or keyboard. Therefore, as this kind of computer systems are already prepared for being controlled by a mouse or keyboard, no drivers or extra software is required to be installed in them.
- the touchless sensor element 21 when the touchless sensor element 21 detects a gesture (or a voice command or eye movements, etc.) of a user 30 it may generate a command associated to this detected gesture and send it to the device 20 (more specifically, to the apparatus 1 ) through the first interfacing module 2. Then, when the apparatus 1 receives, in a step A, the command it may determine, in a step B, the type of the command received from the touchless sensor element 21 . Depending on the determined type of the command, the apparatus 1 may convert, in a step C, the received command into human interface device input data, that is, for example, into mouse movements or keyboard shortcuts.
- the apparatus 1 may pack, in a step, D the human interface device input data (that is, for example, the mouse movements or keyboard shortcuts) into corresponding predefined human interface device input data signals, that is, for example, into standard mouse/keyboard signals.
- D the human interface device input data that is, for example, the mouse movements or keyboard shortcuts
- predefined human interface device input data signals that is, for example, into standard mouse/keyboard signals.
- Said corresponding predefined human interface device input data signals may be made available, in a step E, to the human interface device emulation unit 22 (for example a mouse/keyboard emulation unit) by the apparatus 1 through the second interfacing module 3.
- the expression "made available” may imply that the human interface device input data signals may be sent by the apparatus 1 to the human interface device emulation unit 22 or that the human interface device emulation unit 22 may obtain the corresponding predefined human interface device input data signals from the apparatus 1 .
- the human interface device emulation unit 22 e.g. the mouse/keyboard emulation unit
- the emulation unit 22 may send them to the computer system 24 through the fourth interfacing module 23 for touchless controlling of it.
- the computer system 24 may comprise the standard mouse/keyboard drivers, it may understand the standard mouse/keyboard signals as coming from a standard keyboard or mouse.
- a gesture for example, an open hand moved to the right
- a standard mouse/keyboard signal representing a movement of the cursor in the display of the computer system 24 (for example, a movement of the cursor to the right).
- a gesture representing closing a hand may be converted by the device 20 into a standard mouse/keyboard signal representing a click on a button of the mouse.
- the described method may be implemented by a computer program or a plurality of computer programs running on the processing module 5.
- the software may comprise a plurality of computer programs (one for each layer).
- the method may be implemented by electronic means or a combination of electronic and computer means.
- the method (or a part of it) may be implemented by logic gates in combination with computer programs.
Abstract
An apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element, the apparatus comprising a first interfacing module for connecting the touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to the human interface device emulation unit; a processing module comprising a processor and a memory, embodying instructions stored in the memory and executable by the processor, the instructions being adapted to execute a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element; an operating system stored in the memory; at least one driver associated to the touchless sensor element and to the operating system.
Description
Modular touchless control devices
The present disclosure relates to a device for touchless controlling of a computer system, for example to a modular touchless virtual keyboard and/or mouse device.
BACKGROUND ART
Nowadays, touchless control devices are known.
For example, in the US patent application US20100188337 ("Computer mouse providing a touchless input interface") a mouse providing a touchless interface is described. Even though this mouse is able to be controlled touchless, it can only be done using the sensors included in the mouse and cannot be used with some other gesture/voice sensors. Moreover, sensors are included in the body of the device.
In the European patent application EP2315103 ("Touchless pointing device") a touchless pointing device is described for controlling a computer emulating a mouse by means of gestures over a plane. Although the pointing device can be used touchless to control a third party computer, it can be only used with the kind of sensors described in the application. Moreover, the invention described in this application requires drivers and/or software to be installed in the third party computer.
Many other touchless interface patents have been applied for. However, all of them follow the same approach: they use one kind of sensor to identify, process and translate gestures into commands in the computer. However, none of them is able to interchange different sensors. Moreover, their work depends on the computer to be controlled to comply with system requirements (drivers and software dependences).
Furthermore, there have been several publications and even products oriented to touchless control of different kind of systems. These systems are, however, oriented to use a single kind of sensor technology and/or require drivers and/or extra software to control the third party system, as well as some specific hardware and software requirements on the side of this third party system.
In summary, this kind of devices have to be used connected to a computer system, which is able to run its drivers with the compatible operating system and with a hardware complying with the minimum requirements. This approach makes it impossible to use this kind of devices in computer systems that do not comply with all the requirements. Moreover, it implies installing software in the computer system (SDK, drivers, etc.), which is not possible in many B2B use cases (for example, in the medical field, third party workstations do not allow installing any software from other companies. Moreover, they have specially prepared operating system that is not compatible with the previously mentioned kind of sensors).
SUMMARY OF THE INVENTION
It is an object of this disclosure to provide an apparatus and a method that at least partially solves the above mentioned problems.
In a first aspect an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element is disclosed. The apparatus may comprise a first interfacing module for connecting the touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to the human interface device emulation unit; a processing module comprising a processor and a memory, embodying instructions stored in the memory and executable by the processor, the instructions being adapted to execute a
method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element described later; an operating system stored in the memory; at least one driver associated to the touchless sensor element and to the operating system, the driver being stored in the memory.
This apparatus allows for providing a device for touchless controlling of a computer system as described later.
Basically, the apparatus is able to run all the software required for the touchless sensor element (all the software and drivers required for the touchless sensor element to work is installed in this apparatus) and, in combination with the touchless sensor element and the human interface device emulation unit, it is able to touchless control any type of computer system, no matter what hardware and software they have inside. That is, the apparatus is able to control any type of computer system independently of the operating system, microprocessor architecture or characteristics, as long as the computer system supports predefined or standard human interface devices such as standard mouse or keyboard devices. Because all the required drivers and software are installed in the apparatus, no software is required to be installed in the computer system to be controlled by the apparatus.
At this point it is important to highlight that the expression "computer system" may refer to any device or group of interconnected or related devices, one or more of which, pursuant to a computer program, may perform automated processing of data. The(se) device(s) may cover any type of device(s) with data processing capabilities, such as e.g. computers, mobile phones (smartphones), tablets, etc. The(se) device(s) may comprise any type of hardware and software components, such as e.g. input, output and storage components which may stand alone or be connected in a network or other
similar device(s). The(se) device(s) may also include computer data storage devices or media.
On the other hand, the expression "driver" may refer to the software that allows the operating system to interact with the touchless sensor element. This way, the driver of each touchless sensor element allows the operating system for knowing the state of the touchless sensor element (i.e. if the touchless sensor element is on or off, etc.). Each driver may be provided, for example, by the manufacturer of the touchless sensor element or the manufacturer of the operating system.
Furthermore, it is important to highlight the modularity of the software comprised in the apparatus, that is, this software may be structured in layers, this structure in layers ensuring an easy replacement of any layer without affecting the rest. Basically, this modularity allows the apparatus being compatible with any touchless sensor element present or future. Also, the apparatus, in combination with the touchless sensor element and the human interface device emulation unit, is able to control any type of computer system.
Basically, the first layer may comprise the instructions for controlling the touchless sensor element, so if a new touchless sensor element needs to be supported it is sufficient to replace this layer (or a part of it).
The second layer may be the main one, the one that may comprise the instructions for converting the received commands from the first layer (gestures, voice commands, eye movements, etc.) into human interface device input data, for example mouse movements or keyboard shortcuts. Basically, the piece of software for this second layer may be implemented according to an SDK (Software Development Kit) associated to the touchless sensor element (it may be provided by the manufacturer of the touchless sensor element or the manufacturer of the operating system) and according to the standard mouse/keyboard protocols. This way, it may be possible to
deternnine the type of the command received from the touchless sensor element (for example, an open hand moved to the right) by means of the SDK and assign the determined type of the command to an input data (for example, mouse or keyboard input data) according to the standard mouse/keyboard protocols (for example, input data relating to a movement of the cursor to the right). Consequently, for example, an open hand moved to the right determined by the piece of software (based in the cited SDK) may suppose a movement of the cursor to the right in the computer system.
Finally, the third layer may comprise the instructions for packing the human interface device input data (e.g. the mouse movements or the keyboard shortcuts) into the corresponding signals which the computer system to be controlled may see as predefined human interface device input data signals (e.g. standard mouse or keyboard signals). In case, for example, in the future another standard is used for mice or keyboards, only this layer should be modified, but not the other two.
Another advantage of the modularity of the software comprised in the apparatus is that it allows easy interchanging of the touchless sensor element such that it allows the user to control the computer system by means of voice commands, gestures, eye-tracking, etc.
In case in the future another touchless sensor element is required and it is not compatible with the apparatus, this apparatus could be replaced by a compatible one.
In another aspect, an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element is disclosed. This apparatus may comprise a first interfacing module for connecting a touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to a
human interface device emulation unit; computer/electronic means for receiving the at least one command from the touchless sensor element; computer/electronic means for determining the type of command received from the touchless sensor element; computer/electronic means for converting the received command into human interface device input data according to the determined type of the received command; computer/electronic means for packing the human interface device input data into corresponding predefined human interface device input data signals; computer/electronic means for making available the corresponding predefined human interface device input data signals to the human interface device emulation unit; a memory for storing an operating system and at least one driver associated to the touchless sensor element and to the operating system.
This way, the electronic/computer means may be used interchangeably, that is, a part of the described means may be electronic means and the other part may be computer means, or all described means may be electronic means or all described means may be computer means. Examples of an apparatus comprising only electronic means may be a CPLD, a FPGA or an ASIC.
In some embodiments, the apparatus may comprise a third interfacing module for connecting the apparatus to a communication network, for example a global communication network such as Internet. This way, it is possible to connect the apparatus to a communication network, for example, for updating the software comprised in the apparatus (or a part or a layer of it) or for uploading new software (e.g. the software comprised in a layer as described before) such as drivers for new touchless sensor elements unsupported by the apparatus.
This third interfacing module for connecting the apparatus to a communication network may comprise a wired/wireless communication interface, for example, it may be any standard interface such as Bluetooth, Wi-Fi or Ethernet but it is not limited to them.
In some embodiments, the first interfacing module for connecting the touchless sensor element to the apparatus may comprise a wired/wireless communication interface, for example, it may be any standard interface such as USB, IR or Bluetooth but it is not limited to them.
In some embodiments, the second interfacing module for connecting the apparatus to the human interface device emulation unit may comprise a wired/wireless communication interface, for example, it may be any standard interface such as USB, IR or Bluetooth but it is not limited to them.
According to another aspect, a method of generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element is provided. The method may comprise:
- receiving the at least one command from the touchless sensor element;
- determining the type of command received from the touchless sensor element;
- converting the received command into human interface device input data according to the determined type of the received command;
- packing the human interface device input data into corresponding predefined human interface device input data signals;
- making available the corresponding predefined human interface device input data signals to the human interface device emulation unit.
In some embodiments, converting the received command into human interface device input data according to the determined type of the received command may comprise:
- converting the received command into mouse or keyboard input data according to the determined type of the received command.
Furthermore, packing the human interface device input data into corresponding predefined human interface device input data signals recognizable by a computer system may comprise:
- packing the mouse or keyboard input data into corresponding predefined or standard mouse or keyboard input data signals recognizable by a computer system.
Furthermore, making available the corresponding predefined human interface device input data signals to the human interface device emulation unit may comprise:
- making available the corresponding standard mouse or keyboard input data signals to the human interface device emulation unit.
According to another aspect, a computer program product is provided. The computer program product may comprise program instructions for causing a computer system to perform a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element as described above.
On the other hand, the computer program product may be embodied on a storage medium (for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory) or carried on a carrier signal (for example, on an electrical or optical carrier signal).
The computer program may be in the form of source code, object code, a code intermediate source and object code such as in partially compiled form, or in any other form suitable for use in the implementation of the processes according to the invention. The carrier may be any entity or device capable of carrying the computer program.
For example, the carrier may comprise a storage medium, such as a ROM, for
example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a floppy disc or hard disk. Further, the carrier may be a transmissible carrier such as an electrical or optical signal, which may be conveyed via electrical or optical cable or by radio or other means.
When the computer program is embodied in a signal that may be conveyed directly by a cable or other device or means, the carrier may be constituted by such cable or other device or means.
Alternatively, the carrier may be an integrated circuit in which the computer program is embedded, the integrated circuit being adapted for performing, or for use in the performance of, the relevant methods.
A device for touchless controlling of a computer system is also provided. This device may comprise an apparatus as described above; the touchless sensor element connected to the apparatus through the first interfacing module; the human interface device emulation unit connected to the apparatus through the second interfacing module, this human interface device emulation unit comprising a fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled; wherein, in operation, the human interface device emulation unit provides, through the fourth interfacing module, the corresponding predefined human interface device input data signals to the computer system, such that the signals received by the computer system are recognizable human interface device signals.
Because all the drivers and software required are installed in the device (more specifically in the apparatus), no software is required in the computer system to be controlled by the touchless sensor element (i.e. it is not required installing anything in the computer system). The device is able to control any kind of computer system (no matter what the operating system, hardware or software in it may be) and it is sufficient that the computer system has the
standard mouse/keyboard drivers. For this reason, it is possible to control the computer system with several types of touchless sensor elements. Furthermore, the touchless sensor element does not need to be embedded in the computer system or be connected to it.
The provision of the human interface device emulation unit allows for performing the emulation of the human interface device and allows for performing the connection to (through the fourth module) and control of the computer system. More specifically, the human interface device emulation unit is able to get or receive the packed movements (that is, the corresponding predefined human interface device input data signals) and communicate them to the computer system to be controlled in a way that the computer system may interpret them as coming from a standard keyboard or mouse (or any other standard human interface device). This way, from the point of view of the computer system, the device for touchless controlling of the computer system is seen as a standard mouse or keyboard. Therefore, as this kind of computer systems are already prepared for being controlled by a mouse or keyboard, no drivers or extra software is required to be installed.
In some embodiments, the touchless sensor element may be a gesture controlled element or a voice controlled element. Basically, the touchless sensor element may be any gesture, eye-tracking or voice controlled elements, such as a Microsoft Kinect, a LEAP Motion unit, a MYO from Thamic Labs or a Google Glass, but it is not limited to them. It may be a long, medium or short range sensor based on, for example, IR, computer vision, wearable sensor or any other sensor able to be connected to a computer system through standard ports such as IR, Bluetooth or USB, but it is not limited to them.
In some embodiments, the fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled may comprise a wired/wireless communication interface. Thus, for example, it may
be any standard interface such as USB, IR or Bluetooth, but it is not limited to them.
In some embodiments, the human interface device emulation unit may comprise a unit for emulating a human interface device selected from a mouse or a keyboard. The term "human interface device" may refer to any type of computer device that interacts directly with humans such as a mouse or a keyboard. These human interface devices may use standard protocols, which may be implemented for any computer system.
In summary, if it is required to control a computer system by means of a particular touchless sensor element, the touchless sensor element may be connected to the apparatus and the drivers and its software associated may be installed in the apparatus. Consequently, it is not necessary to replace neither the apparatus nor the human interface device emulation unit.
If the touchless sensor element is not compatible with the apparatus then the apparatus may be replaced by another compatible one, without replacing the touchless sensor element nor the human interface device emulation unit.
The human interface device emulation unit allows the device for touchless controlling of a computer system to be seen as a USB or Bluetooth mouse or keyboard by the computer system to be controlled. In case the computer system has to be accessed by another type of interface (IR, WiFi, etc.) only the human interface device emulation unit needs to be replaced (neither the touchless sensor element nor the apparatus have to be replaced).
Consequently, the apparatus may be fully compatible with any touchless sensor element and the device for touchless controlling of a computer system may be fully compatible with any computer system. Furthermore, it is not necessary to install any type of software in the computer system.
A method of touchless controlling of a computer system is also provided. This method may comprise:
- Executing the method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element describe above;
- Sending the predefined human interface device input data signals from the human interface device emulation unit to the computer system to be controlled;
such that the signals received by the computer system are recognizable human interface device signals.
In some embodiments, making available the corresponding predefined human interface device input data signals to the human interface device emulation unit may comprise sending the corresponding predefined human interface device input data signals to the human interface device emulation unit.
In other embodiments, the method may comprise the human interface device emulation unit obtaining the corresponding predefined human interface device input data signals made available.
Associated to this method, a computer program product is provided. This computer program product may comprise program instructions for causing a computer system to perform a method of touchless controlling of a computer system as described above.
This computer program product may be embodied on a storage medium (for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory) or carried on a carrier signal (for example, on an electrical or optical carrier signal).
BRIEF DESCRIPTION OF THE DRAWINGS
Non-limiting examples of the present disclosure will be described in the following, with reference to the appended drawings, in which:
Fig. 1 shows a schematic representation of an apparatus according to some embodiments;
Fig. 2 shows a schematic representation of a device for touchless controlling of a computer system according to some embodiments;
Fig. 3 is a flow chart illustrating a method of touchless controlling of a computer system according to some embodiments.
DETAILED DESCRIPTION OF EMBODIMENTS
Figure 1 is a schematic representation of an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element according to some embodiments.
As can be see in this figure, the apparatus 1 may comprise a first interfacing module 2 for connecting a touchless sensor element to the apparatus 1 ; a second interfacing module 3 for connecting the apparatus 1 to a human interface device emulation unit; a third interfacing module 4 for connecting the apparatus 1 to a communication network such as the Internet; and a processing module 5.
The processing module 5 may comprise a processor 6 and a memory 7, embodying instructions 8 stored in the memory 7 and executable by the processor 6, the instructions 8 being adapted to execute a method of generating predefined human interface device input data signals to be used by
a human interface device emulation unit from at least one command generated by a touchless sensor element described later. The memory 7 may also store an operating system 9 and a driver 10 associated to each touchless sensor element supported by the apparatus 1 (more specifically, by the operating system running on the apparatus 1 ).
In the present embodiments,
- The first interfacing module 2 for connecting the touchless sensor element to the apparatus 1 may comprise a wired communication interface, for example, it may be any standard interface such as USB, but it could be another wired or wireless communication interface such as IR or Bluetooth. Obviously, it is not limited to them;
- The second interfacing module 3 for connecting the apparatus to the human interface device emulation unit may comprise a wired communication interface, for example, it may be any standard interface such as USB, but it could be another wired or wireless communication interface such as IR or Bluetooth. Obviously, it is not limited to them;
- The third interfacing module 4 for connecting the apparatus to a communication network may comprise a wireless communication interface, for example, it may be any standard interface such as Wi-Fi, but it could be another wired or wireless communication interface such as Ethernet, IR or Bluetooth. Obviously, it is not limited to them. It is possible to connect the apparatus 1 to a communication network, for example, for updating the software stored in the memory 6 of the apparatus 1 (or a part or a layer of it) or for uploading new software such as drivers for new touchless sensor elements unsupported by the apparatus;
- The processing module 5 may be any computer, for example an embedded computer, such as an Arduino Leonardo or a Raspberry Pi;
- The operating system 9 may be Windows XP or higher but it could be another operating system such as Linux or Mac OS;
- The driver 10 of each touchless sensor element must be compatible with the described operating system.
Figure 2 illustrates a schematic representation of a device 20 for touchless controlling of a computer system. As can be seen in the figure, the device may comprise an apparatus 1 as described above (see Figure 1 ); a touchless sensor element 21 connected to the apparatus 1 through the first interfacing module 2; and a human interface device emulation unit 22 connected to the apparatus through the second interfacing module 3. Furthermore, the human interface device emulation unit 22 may comprise a fourth interfacing module 23 for connecting this emulation unit 21 (that is, the device 20) to a computer system 24.
In the present embodiments,
- the touchless sensor element 21 may be a gesture controlled element or a voice controlled element. Basically, the touchless sensor element may be any of the existing or future gesture, eye-tracking or voice controlled elements, such as a Microsoft Kinect, a LEAP Motion unit, a MYO from Thamic Labs or a Google Glass, but it is not limited to them. It may be long, medium or short range based on, for example, IR, computer vision, wearable sensor or any other sensor able to be connected to a computer system through standard ports such as IR, Bluetooth or USB, but it is not limited to them;
- the human interface device emulation unit 22 may be a mouse/keyboard emulation unit;
- the fourth interfacing module 23 may be a wired communication interface such as USB, but it could be another wired or wireless communication interface such as Wi-Fi, IR or Bluetooth. However, it is not limited to them;
- the computer system 24 may be, for example, a medical device.
This way, because all the drivers and software required are installed in the device 20 (more specifically in the apparatus 1 ), no software is required in the computer system 24 to be controlled by the touchless sensor element 21 (i.e. it is not required to install anything in the computer system). The device 20 is able to control any kind of computer system (no matter what the operating system, hardware or software in it may be) and it is sufficient that the computer system 24 has the standard mouse/keyboard drivers.
On the other hand, the human interface device emulation unit 22 allows for performing the emulation of the human interface device and allows for performing the connection to (through the fourth module) and control of the computer system 24. More specifically, the human interface device emulation unit 22 is able to get or receive the packed movements (that is, the corresponding predefined human interface device input data signals) and communicate them to the computer system 24 to be controlled in a way this computer system understands or interprets them as coming from a standard keyboard or mouse (or any other standard human interface device). This way, from the point of view of the computer system 24, the device 20 for touchless controlling of the computer system is shown as a standard mouse or keyboard. Therefore, as this kind of computer systems are already prepared for being controlled by a mouse or keyboard, no drivers or extra software is required to be installed in them.
Following, based on Figure 3, a description of some embodiments of a method of touchless controlling of a computer system 24 executed on the device 20 will be described.
Basically, when the touchless sensor element 21 detects a gesture (or a voice command or eye movements, etc.) of a user 30 it may generate a command associated to this detected gesture and send it to the device 20 (more specifically, to the apparatus 1 ) through the first interfacing module 2.
Then, when the apparatus 1 receives, in a step A, the command it may determine, in a step B, the type of the command received from the touchless sensor element 21 . Depending on the determined type of the command, the apparatus 1 may convert, in a step C, the received command into human interface device input data, that is, for example, into mouse movements or keyboard shortcuts.
Next, the apparatus 1 may pack, in a step, D the human interface device input data (that is, for example, the mouse movements or keyboard shortcuts) into corresponding predefined human interface device input data signals, that is, for example, into standard mouse/keyboard signals.
Said corresponding predefined human interface device input data signals (e.g. standard mouse/keyboard signals) may be made available, in a step E, to the human interface device emulation unit 22 (for example a mouse/keyboard emulation unit) by the apparatus 1 through the second interfacing module 3. The expression "made available" may imply that the human interface device input data signals may be sent by the apparatus 1 to the human interface device emulation unit 22 or that the human interface device emulation unit 22 may obtain the corresponding predefined human interface device input data signals from the apparatus 1 .
In any case, when the human interface device emulation unit 22 (e.g. the mouse/keyboard emulation unit) acquires the corresponding predefined human interface device input data signals (e.g. standard mouse/keyboard signals), the emulation unit 22 may send them to the computer system 24 through the fourth interfacing module 23 for touchless controlling of it.
Because the computer system 24 may comprise the standard mouse/keyboard drivers, it may understand the standard mouse/keyboard signals as coming from a standard keyboard or mouse.
This way, a gesture (for example, an open hand moved to the right) may be converted by the device 20 into a standard mouse/keyboard signal representing a movement of the cursor in the display of the computer system 24 (for example, a movement of the cursor to the right). In the same way, a gesture representing closing a hand may be converted by the device 20 into a standard mouse/keyboard signal representing a click on a button of the mouse.
It is important to highlight that the described method may be implemented by a computer program or a plurality of computer programs running on the processing module 5. Thus, if, as described above, a modularity of the software is required, the software may comprise a plurality of computer programs (one for each layer).
Alternatively, the method may be implemented by electronic means or a combination of electronic and computer means. For example, the method (or a part of it) may be implemented by logic gates in combination with computer programs.
Although only a number of examples have been disclosed herein, other alternatives, modifications, uses and/or equivalents thereof are possible. Furthermore, all possible combinations of the described examples are also covered. Thus, the scope of the present disclosure should not be limited by particular examples, but should be determined only by a fair reading of the claims that follow.
Although the embodiments described with reference to the drawings comprise computer apparatus and processes performed in computer apparatus, it also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the embodiments into practice.
Claims
1 . A method of generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element, the method comprising:
- receiving the at least one command from the touchless sensor element;
- determining the type of command received from the touchless sensor element;
- converting the received command into human interface device input data according to the determined type of the received command;
- packing the human interface device input data into corresponding predefined human interface device input data signals;
- making available the corresponding predefined human interface device input data signals to the human interface device emulation unit.
2. A method according to claim 1 , wherein converting the received command into human interface device input data according to the determined type of the received command comprises:
- converting the received command into mouse or keyboard input data according to the determined type of the received command;
wherein packing the human interface device input data into corresponding predefined human interface device input data signals recognizable by a computer system comprises:
- packing the mouse or keyboard input data into corresponding standard mouse or keyboard input data signals recognizable by a computer system;
and wherein making available the corresponding predefined human interface device input data signals to the human interface device emulation unit comprises:
- making available the corresponding standard mouse or keyboard input data signals to the human interface device emulation unit.
3. A computer program product comprising program instructions for causing a computer system to perform a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element according to any of claims 1 or 2.
4. A computer program product according to claim 3, embodied on a storage medium.
5. A computer program product according to any of claims 3 or 4, carried on a carrier signal.
6. An apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element, the apparatus comprising:
- a first interfacing module for connecting the touchless sensor element to the apparatus;
- a second interfacing module for connecting the apparatus to the human interface device emulation unit;
- a processing module comprising a processor and a memory, embodying instructions stored in the memory and executable by the processor, the instructions being adapted to execute a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element according to any of claims 1 or 2;
- an operating system stored in the memory;
- at least one driver associated to the touchless sensor element and to the operating system, the driver being stored in the memory.
7. An apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element, the apparatus comprising:
- a first interfacing module for connecting a touchless sensor element to the apparatus;
- a second interfacing module for connecting the apparatus to a human interface device emulation unit;
- computer/electronic means for receiving the at least one command from the touchless sensor element;
- computer/electronic means for determining the type of command received from the touchless sensor element;
- computer/electronic means for converting the received command into human interface device input data according to the determined type of the received command;
- computer/electronic means for packing the human interface device input data into corresponding predefined human interface device input data signals;
- computer/electronic means for making available the corresponding predefined human interface device input data signals to the human interface device emulation unit;
- a memory for storing an operating system and at least one driver associated to the touchless sensor element and to the operating system.
8. An apparatus according to any of claims 6 or 7, further comprising a third interfacing module for connecting the apparatus to a communication network.
9. An apparatus according to any of claims 6 to 8, wherein the first interfacing module for connecting the touchless sensor element to the apparatus comprises a wired/wireless communication interface.
10. An apparatus according to any of claims 6 to 9, wherein the second interfacing module for connecting the apparatus to the human interface device emulation unit comprises a wired/wireless communication interface.
1 1 . A method of touchless controlling of a computer system, the method comprising:
- executing the method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element according to any of claims 1 or 2;
- sending the predefined human interface device input data signals from the human interface device emulation unit to the computer system to be controlled;
such that the signals received by the computer system are recognizable human interface device signals.
12. A method according to claim 1 1 , wherein making available the corresponding predefined human interface device input data signals to the human interface device emulation unit comprises:
- sending the corresponding predefined human interface device input data signals to the human interface device emulation unit.
13. A method according to claim 1 1 , further comprising:
- the human interface device emulation unit obtaining the corresponding predefined human interface device input data signals made available.
14. A computer program product comprising program instructions for causing a computer system to perform a method of touchless controlling of a computer system according to any of claims 1 1 to 13.
15. A device for touchless controlling of a computer system, the device comprising:
- an apparatus according to any of claims 6 to 10;
- the touchless sensor element connected to the apparatus through the first interfacing module;
- the human interface device emulation unit connected to the apparatus through the second interfacing module, and further comprising a fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled;
wherein, in operation, the human interface device emulation unit provides, through the fourth interfacing module, the corresponding predefined human interface device input data signals to the computer system, such that the signals received by the computer system are recognizable human interface device signals.
16. A device according to claim 15, wherein the fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled comprises a wired or wireless communication interface.
17. A device according to any of claims 15 or 16, wherein the touchless sensor element is a gesture controlled element.
18. A device according to any of claims 15 or 16, wherein the touchless sensor element is a voice controlled element.
19. A device according to any of claims 15 to 18, wherein the human interface device emulation unit comprises a unit for emulating at least a human interface device selected from:
- a mouse;
- a keyboard.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2014/055149 WO2015135592A1 (en) | 2014-03-14 | 2014-03-14 | Modular touchless control devices |
| ES201690042A ES2601928B1 (en) | 2014-03-14 | 2014-03-14 | MODULAR CONTACT-FREE CONTROL DEVICES |
| EP14714610.4A EP3117289A1 (en) | 2014-03-14 | 2014-03-14 | Modular touchless control devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2014/055149 WO2015135592A1 (en) | 2014-03-14 | 2014-03-14 | Modular touchless control devices |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015135592A1 true WO2015135592A1 (en) | 2015-09-17 |
Family
ID=50424194
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2014/055149 WO2015135592A1 (en) | 2014-03-14 | 2014-03-14 | Modular touchless control devices |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP3117289A1 (en) |
| WO (1) | WO2015135592A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ITUB20161095A1 (en) * | 2016-02-29 | 2017-08-29 | Fox Bit Srl | MULTIFUNCTIONAL TACTICAL CONSOLE IN COMPOSITE MATERIAL |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020064382A1 (en) * | 2000-10-03 | 2002-05-30 | Evan Hildreth | Multiple camera control system |
| US20070061126A1 (en) * | 2005-09-01 | 2007-03-15 | Anthony Russo | System for and method of emulating electronic input devices |
| US20080284736A1 (en) * | 2007-05-14 | 2008-11-20 | Synaptics Incorporated | Proximity sensor device and method with keyboard emulation |
| EP2315103A2 (en) * | 2009-10-20 | 2011-04-27 | Qualstar Corporation | Touchless pointing device |
-
2014
- 2014-03-14 EP EP14714610.4A patent/EP3117289A1/en not_active Withdrawn
- 2014-03-14 WO PCT/EP2014/055149 patent/WO2015135592A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020064382A1 (en) * | 2000-10-03 | 2002-05-30 | Evan Hildreth | Multiple camera control system |
| US20070061126A1 (en) * | 2005-09-01 | 2007-03-15 | Anthony Russo | System for and method of emulating electronic input devices |
| US20080284736A1 (en) * | 2007-05-14 | 2008-11-20 | Synaptics Incorporated | Proximity sensor device and method with keyboard emulation |
| EP2315103A2 (en) * | 2009-10-20 | 2011-04-27 | Qualstar Corporation | Touchless pointing device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ITUB20161095A1 (en) * | 2016-02-29 | 2017-08-29 | Fox Bit Srl | MULTIFUNCTIONAL TACTICAL CONSOLE IN COMPOSITE MATERIAL |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3117289A1 (en) | 2017-01-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2915028B1 (en) | Input location correction tables for input panels | |
| TWI471802B (en) | Conversion methods of applications of mobile devices and mobile devices and systems capable of converting applications of mobile devices | |
| US10620792B2 (en) | Computing device with an appropriate adaptable user hardware interface | |
| EP2741207A1 (en) | Method and system for providing information based on context, and computer-readable recording medium thereof | |
| WO2012135373A2 (en) | A dedicated user interface controller for feedback responses | |
| US20160170779A1 (en) | Device emulator | |
| CN104536563A (en) | Electronic equipment control method and system | |
| CN106462514B (en) | System and method for unifying device interface and host interface | |
| WO2019070774A1 (en) | Multifinger touch keyboard | |
| JP6250842B2 (en) | Sharing non-USB sensor with another device using USB over IP | |
| EP3080767A1 (en) | Multi-modal content consumption model | |
| JP2015158908A (en) | Providing single-action multi-mode interface | |
| WO2015135592A1 (en) | Modular touchless control devices | |
| CN108139851B (en) | Personalized launch status for software applications | |
| KR20220031764A (en) | Vendor-specific peripheral device class identifiers | |
| CN104820489A (en) | System and method in managing low-latency direct control feedback | |
| ES2601928B1 (en) | MODULAR CONTACT-FREE CONTROL DEVICES | |
| US9547515B2 (en) | Convert a gesture | |
| JP2008117270A (en) | Information processing system, information processor, information processing method, and program | |
| CN103019967A (en) | Electronic device control system and control method | |
| Tapparo et al. | Leveraging Android Phones to Democratize Low-level Audio Programming | |
| WO2023072404A1 (en) | Ergonomic based reconfiguration of virtual input device | |
| US10235890B1 (en) | System for navigating an aircraft display with a mobile device | |
| JP6158743B2 (en) | User interface component control apparatus and user interface component control program | |
| KR20150020361A (en) | Multipurpose input apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14714610 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: P201690042 Country of ref document: ES |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| REEP | Request for entry into the european phase |
Ref document number: 2014714610 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2014714610 Country of ref document: EP |