US20090093307A1 - Enhanced game controller - Google Patents

Enhanced game controller Download PDF

Info

Publication number
US20090093307A1
US20090093307A1 US12/246,373 US24637308A US2009093307A1 US 20090093307 A1 US20090093307 A1 US 20090093307A1 US 24637308 A US24637308 A US 24637308A US 2009093307 A1 US2009093307 A1 US 2009093307A1
Authority
US
United States
Prior art keywords
game
players
support structure
user
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/246,373
Inventor
Ken Miyaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment America LLC
Original Assignee
Sony Computer Entertainment America LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment America LLC filed Critical Sony Computer Entertainment America LLC
Priority to US12/246,373 priority Critical patent/US20090093307A1/en
Assigned to SONY COMPUTER ENTERTAINMENT AMERICA INC. reassignment SONY COMPUTER ENTERTAINMENT AMERICA INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MIYAKI, KEN
Publication of US20090093307A1 publication Critical patent/US20090093307A1/en
Assigned to SONY COMPUTER ENTERTAINMENT AMERICA LLC reassignment SONY COMPUTER ENTERTAINMENT AMERICA LLC MERGER (SEE DOCUMENT FOR DETAILS). Assignors: SONY COMPUTER ENTERTAINMENT AMERICA INC.
Assigned to SONY INTERACTIVE ENTERTAINMENT AMERICA LLC reassignment SONY INTERACTIVE ENTERTAINMENT AMERICA LLC CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • A63F13/06
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/24Constructional details thereof, e.g. game controllers with detachable joystick handles
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/105Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals using inertial sensors, e.g. accelerometers, gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/6045Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands

Definitions

  • the present invention relates to human-computer interfacing, and more specifically to processing multi-channel controller input.
  • Computer entertainment game systems and gaming technology have advanced over the years from the simple games such as Pong® and Tetris® to very complex shooter and sports games that have high speed, high resolution graphics and can be played in a multi-player environment.
  • game controllers or human input devices have also advanced.
  • a game controller will include joy sticks or buttons on the controller that a user will manipulate to control characters or actions within the game.
  • controllers have been developed that include motion sensors that can detect the user's movement of the game controller that can also be used as an input to the game action. While game controller technology has evolved it still limits a users input to the game. For example, some movements of the game controller by the user may be so small or subtle that it is difficult for the game controller to detect. Therefore there is a need to improve the responsiveness of game controllers.
  • an enhanced game controller includes: a plurality of sensor modules; a support structure attached to the plurality of sensor modules, structural constraints of the support structure are combined with data from the plurality of sensor modules to map a user's gestures.
  • a method of mapping gestures of a user includes: receiving information about structural constraints of a support structure; receiving data from sensors attached to the support structure; and combining the data from the sensors with the information about structural constraints of a support structure to map the gestures of a user.
  • a computer-implemented method of dynamically adjusting game parameters based on performance levels of players in a multi-player game environment includes: receiving profiles of players in the multi-player game environment; adjusting game options of the players based upon the respective profiles of the players; monitoring relative performance of the players; determining if the relative performance of the players is within a desired range of performance; and adjusting game parameters of the players if the relative performance of the players is outside the desired range.
  • FIG. 1 is a block diagram illustrating a system that operates in accordance with an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating an embodiment of an enhanced game controller.
  • FIG. 3 is a block diagram of another embodiment of an enhanced game controller.
  • FIG. 4 is a block diagram of yet another embodiment of an enhanced game controller.
  • FIG. 5 is a block diagram of another embodiment of an enhanced game controller.
  • FIG. 6 is a block diagram of still another embodiment of an enhanced game controller.
  • FIG. 7 is a block diagram of yet another example of an enhanced game controller.
  • FIG. 8 is a block diagram of an embodiment of a three-sensor module enhanced game controller.
  • FIG. 9 is a block diagram of another embodiment of a three-sensor module enhanced game controller.
  • FIG. 10 is a block diagram of another embodiment of an enhanced game controller.
  • FIG. 11 is a flow chart illustrating a technique for processing signals from a enhanced game controller.
  • FIG. 12 is a block diagram of a gaming system that may be used to implement various embodiments described herein.
  • the enhanced game controller can include six axis motion sensing modules.
  • a sensor module such as a game controller can include accelerometers to detect motion in the x, y, and z planes.
  • the sensor module can also include gyro detecting circuitry that can detect rotation about the three axes in pitch yaw and roll.
  • the enhanced game controller or a game console can covert raw sensor data into gesture data input to the game. In this way the user can interact with the game by making gestures with the game controller.
  • FIG. 1 is a block diagram illustrating a system that operates in accordance with an embodiment of the present invention.
  • a computer, or game, entertainment console 102 may be coupled to a video display 104 such as a television or other type of visual display.
  • a game or other simulations may be stored on a storage media 106 such as a DVD, a CD, flash memory, USB memory or other type of memory media.
  • the storage media 106 can be inserted to the console 102 where it is read.
  • the console can then read program instructions stored on the storage media and present a game interface to the user.
  • a user or player manipulates multiple sensor modules or game controllers 110 a and 10 b to control and interact with the video game or other simulation.
  • the game controllers 110 a and 10 b may include conventional controls, for example, control input devices such as joysticks, buttons and the like.
  • the game controllers 110 a and 10 b can include an internal sensor, for example an accelerometer, that produces signals in response to the position motion orientation or change in orientation of the game controller 110 .
  • the user can use the game controllers 110 a and 10 b to interact with the game.
  • the game controllers 10 a and 10 b may be attached to a framework 108 to derive extra degrees of freedom in an enhanced game controller or peripheral.
  • FIG. 1 shows two controllers 10 a and 10 b there can be any desired number of controllers attached to a framework
  • FIG. 2 is a block diagram illustrating an embodiment of an enhanced game controller 200 .
  • the enhanced game controller 200 includes two sensor modules 202 and 204 that are connected to a supporting structure 206 .
  • the sensors 202 and 204 are conventional game controllers for example six axis game controllers, such as Sony PlayStation® game controllers.
  • the supporting structure 206 is a rigid body framework and can be used to drive extra degrees of freedom in a game peripheral device.
  • two six axis game controllers 202 and 204 can be mounted on the supporting structure 206 which is a rod that intersects the controllers parallel to the top plate of the controllers 202 and 204 .
  • a new genre of gaming becomes possible, including things like “Marching Band Baton Competition” and “Virtual Boxing.”
  • the player could leverage a pair of game controllers 202 and 204 rigidly connected to the support structure 206 , such as a holding harness or stick where each game controller 202 and 204 are attached to opposite ends of the stick (with one controller 202 sitting in parallel with the support structure 206 which is also parallel to the second controller 204 in a lengthwise manner).
  • game play could consist of a series of competition events where the player acting as a band leader might raise, lower, twirl, or swing the device in response to music and an on-screen character.
  • the enhanced game controller 200 can also be fitted with a ring 208 .
  • a player could use the enhanced game controller 110 to simulate a steering wheel or other type of control in the game.
  • FIG. 3 is a block diagram of another embodiment of an enhanced game controller 300 .
  • two game controllers 202 and 204 are mounted to a support structure 306 .
  • the support structure 306 connects to the two game controllers 202 and 204 normal to the base plate of the sensors.
  • a user can grasp the support structure 306 between the two game controllers 202 and 204 and their gestures used as input to a game.
  • a user can grasp the support structure 306 and use this device in a punching motion such as in a boxing game so that the rotations and jabs from the user can be felt in a more natural way.
  • output from the sensor modules can be integrated and used in conjunction with one another to allow the player to control and have enhanced input to a game.
  • the support structure allows a player to hold the enhanced game controller with a single hand, whereas it is common for game controllers to require the user to hold them with two hands.
  • integrating multiple sensor modules, such as six axis game controllers can be used in conjunction with one another to allow the player to control a game character, such as a virtual boxing character. In this way the players' actions may be more natural than with a single controller held in both hands.
  • FIG. 4 is a block diagram of yet another embodiment of an enhanced game controller 400 .
  • the two game controllers, 202 and 204 are attached with the support structure 406 .
  • the axis of sensitivity of the two sensor modules 202 and 204 are rotated relative to one another.
  • one game controller 202 has its top plate rotated by 90-degree from the orientation of the top plate of the other game controller 204 .
  • the relative axis of orientation of the game controllers 202 and 204 can be in any relationship to each other.
  • one of the game controllers can have its top plate normal to the support structure and the other game controller can have its top plate parallel to the support structure.
  • FIG. 5 is a block diagram of another embodiment of an enhanced game controller 500 .
  • two multi-axis sensor modules 502 and 504 are connected by a supporting structure 506 .
  • the sensor modules 504 and 506 are 6-axis sensors.
  • the sensor modules 502 and 504 can be different number of axis of sensitivity.
  • sensor module 502 can be a single-axis sensor while sensor module 504 is a multi-axis sensor, such as a 6-axis sensor.
  • the orientation of sensor modules 502 and 504 can be in any relationship relative to one another.
  • FIG. 6 is a block diagram of still another embodiment of an enhanced game controller 600 .
  • two multi-axis sensor modules 602 and 604 are connected by a supporting structure 606 .
  • the supporting structure 606 is flexible, being able to be deformed.
  • the amount of deformation 610 of the support structure 606 can be detected. In this way a user's gestures can be better mimicked in the game played by the user.
  • FIG. 7 is a block diagram of yet another embodiment of an enhanced game controller 700 .
  • a single sensor module 702 can be rigidly mounted or held to a supporting surface 704 .
  • a flexible structure 706 is attached to the sensor 702 .
  • the flexible structure 706 can be moved by the user and released. If the user moves, or bends, and releases the flexible structure 706 , there can be a resonance associated with the structure 706 that can be detected by the sensor module 702 and converted into game inputs, movements or actions.
  • a structure can be coupled to any desired number of sensor modules.
  • the structure connecting the multiple controllers can be used to mimic player's actions.
  • the structure attaching the multiple controllers can be manipulated by the user and the manipulation can cause movements and vibrations that are sensed by the controllers and converted into game inputs, events or actions.
  • FIG. 8 is a block diagram of an embodiment of a three-sensor module enhanced game controller 800 .
  • three sensor modules 802 , 804 and 806 are attached by structural members 810 , 812 and 814 .
  • the structural members 810 , 812 and 814 can be rigid, or can be flexible and be capable of being deflected by the user.
  • structural members 810 , 812 and 814 can have a resonance associated with them that can be detected and used as a game input.
  • the structural members 810 , 812 and 814 can be a combination of rigid, flexible and resonant structures in combination.
  • FIG. 9 is a block diagram of another embodiment of a three-sensor module enhanced game controller 900 .
  • three sensor modules 902 , 904 and 906 are connected by structural members 910 , 912 and 914 .
  • structural members 910 , 912 and 914 can be rigid, flexible, resonant, or any combination of the same.
  • the orientation of the three sensor modules 902 , 904 and 906 have been rotated relative to one another. Any combination of rotation of the sensors relative to one another is envisioned.
  • a multi-sensor module controller allows a user's input to map to gestures in the game. For example, a distance between two sensors can be used in a digital signal processor (DSP) along with how the sensor modules move, to improve mapping a user's gesture and to convert that gesture into an input for a game movement.
  • DSP digital signal processor
  • Using multiple sensors in an enhanced game controller provides many advantages. For example, using DSP techniques, the input from the multiple sensors can be combined subtractively, additively, by averaging, or other combination to enhance the signal level as well as better detect the user's gestures. In other words, multiple sensors provide multiple forms of data from the user's gesture, and these multiple forms of data can be combined so as to produce a better signal to mimic the user's gestures.
  • two sensor modules can be coupled using a support structure such that the two sensor modules are at a known off-set distance from one another, and the movement of the sensor modules relative to each other is bound by the constraints of the coupling of the support structure.
  • the input signals from the two sensors and the known constraints of the support structure for example, a rigid support structure or flexible support structure or resonant support structure, can be used to better detect signals from the sensors and map user's gestures.
  • FIG. 10 is a block diagram of another embodiment of an enhanced game controller 1000 .
  • a sensor 1002 can be attached to a user, for example, to a user's hand 1004 by an attachment mechanism such as a strap 1006 .
  • the user's hand motions and gestures can be detected and input to a game as game movements or gestures.
  • the sensor 1002 is a 6-axis sensor and is strapped to a user's hand, then in a game such as a boxing game, the motion as well as the rotation of the user's hand can be detected and input into the game to better mimic the user's actual motion.
  • sensors can be mounted on other locations of a user's body.
  • sensors can be mounted on a user's arms, feet, knees, etc, to better detect user's gestures and motion and use the sensor data as input to a game to better mimic the user's motion in the game.
  • the sensor modules or controllers can be wired or wireless.
  • the sensors are wireless and thereby, communicate to the game console without the need of a physical wire connection. Eliminating a physical connection can be beneficial so that the sensors can be moved about without the restriction or encumbrance of having wires attached to the sensors.
  • the input from these sensors can be communicated by radio frequencies using techniques such as Bluetooth, ZigBee, or 802.11x, and the like, or they could use optical techniques and infrared techniques
  • FIG. 11 is a flow chart illustrating a technique for processing signals from an enhanced controller.
  • Flow begins in block 1102 where information is received about constraints of a structure that supports sensor modules.
  • Flow continues to block 1104 where data from the sensor modules is received.
  • Flow continues to block 1106 where the sensor data is combined with information about the constraints of the support structure to map a user's gestures.
  • the sensor data and constraints can be combined by a DSP, or other computing device, to map the user's gestures.
  • FIG. 12 is a block diagram of a gaming system 1200 that may be used to implement various embodiments described herein.
  • the gaming system 1200 may include a processor module 1201 and a memory module 1202 .
  • memory module 1202 may be RAM, DRAM, ROM and the like.
  • the gaming system 1200 may have multiple processor modules 1201 if parallel processing is to be implemented.
  • the processor module 1201 can include a central processing unit 1203 .
  • the processor module 1201 can include local storage or a cache 1205 to store executable programs.
  • the memory module 1202 can include game program storage 1204 .
  • the memory module 1202 can include signal data storage 1206 , for example, signal data acquired from game controller operated by a user.
  • the memory module 1202 can also include player data 1208 such as player profile data as well as game statistics that may be provided.
  • the system 1200 may also include well-known support function module 1210 such as input/output elements 1211 , power supplies 1212 , a clock 1213 , and cache memory 1214 .
  • the input/output elements 1211 may be controlled by a controller 1230 .
  • the system 1200 may also optionally include mass storage module 1215 such as a disc drive, CD ROM drive, DVD drive, tape drive or the like to store programs and/or data.
  • the system 1200 may also optionally include a display module 1216 as well as a user interface module 1218 to facilitate interaction between the system 1200 and the user.
  • Display module 1216 may be in the form of a cathode ray tube, a flat panel screen or any other display module.
  • the user interface module 1218 may include a keyboard, mouse, joystick, write pen or other device such as a microphone, video camera or other user input device.
  • the processor, memory, and other components within the system 1200 may exchange signals such as code instructions and data with each other via a system bus 1220 .
  • the gaming system 1200 is implemented as a computer-implemented program stored in the local storage or a cache 1205 of the processor module 1201 .
  • the program may include a computer-implemented method of dynamically adjusting game parameters based on performance levels of players in a multi-player game environment.
  • the method includes: receiving profiles of players in the multi-player game environment; adjusting game options of the players based upon the respective profiles of the players; monitoring relative performance of the players; determining if the relative performance of the players is within a desired range of performance; and adjusting game parameters of the players if the relative performance of the players is outside the desired range.
  • adjusting game parameters comprises limiting game options available to at least one of the players.
  • adjusting game parameters includes enhancing game options available to at least one of the players.
  • monitoring the relative performance of the players includes detecting the players' reaction to audio stimuli.
  • monitoring the relative performance of the players includes detecting the players' reaction to visual stimuli.
  • a hardware implementation may include using, for example, components such as application specific integrated circuits (“ASICs”), or field programmable gate arrays (“FPGAs”).
  • ASICs application specific integrated circuits
  • FPGAs field programmable gate arrays
  • module means, but is not limited to a software or hardware component, such as an FPGA or an ASIC, which performs certain tasks.
  • a module may advantageously be configured to reside on an addressable storage medium and configured to execute on one or more network enabled devices or processors.
  • a module may include, by way of example, components, processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, variables, and the like.
  • the functionality provided for in the components and modules may be combined into fewer components and modules or further separated into additional components and modules. Additionally, the components and modules may advantageously be implemented to execute on one or more network enabled devices or computers.
  • DSP digital signal processor
  • a general-purpose processor can be a microprocessor, but in the alternative, the processor can be any processor, controller, microcontroller, or state machine.
  • a processor can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • a software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium including a network storage medium.
  • An exemplary storage medium can be coupled to the processor such the processor can read information from, and write information to, the storage medium.
  • the storage medium can be integral to the processor.
  • the processor and the storage medium can also reside in an ASIC.

Abstract

Enhancing a game controller including: a plurality of sensor modules; a support structure attached to the plurality of sensor modules, structural constraints of the support structure are combined with data from the plurality of sensor modules to map a user's gestures.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of priority of co-pending U.S. Provisional Patent Application No. 60/978,301, filed Oct. 8, 2007, entitled “Enhanced Game Controller.” The disclosure of the above-referenced provisional application is incorporated herein by reference.
  • BACKGROUND
  • 1. Field of the Invention
  • The present invention relates to human-computer interfacing, and more specifically to processing multi-channel controller input.
  • 2. Background
  • Computer entertainment game systems and gaming technology have advanced over the years from the simple games such as Pong® and Tetris® to very complex shooter and sports games that have high speed, high resolution graphics and can be played in a multi-player environment. Along with the increase in game sophistication, game controllers or human input devices have also advanced. Typically a game controller will include joy sticks or buttons on the controller that a user will manipulate to control characters or actions within the game.
  • More recently controllers have been developed that include motion sensors that can detect the user's movement of the game controller that can also be used as an input to the game action. While game controller technology has evolved it still limits a users input to the game. For example, some movements of the game controller by the user may be so small or subtle that it is difficult for the game controller to detect. Therefore there is a need to improve the responsiveness of game controllers.
  • SUMMARY
  • In one aspect, an enhanced game controller is disclosed. The enhanced game controller includes: a plurality of sensor modules; a support structure attached to the plurality of sensor modules, structural constraints of the support structure are combined with data from the plurality of sensor modules to map a user's gestures.
  • In another aspect, a method of mapping gestures of a user is disclosed. The method includes: receiving information about structural constraints of a support structure; receiving data from sensors attached to the support structure; and combining the data from the sensors with the information about structural constraints of a support structure to map the gestures of a user.
  • In another aspect, a computer-implemented method of dynamically adjusting game parameters based on performance levels of players in a multi-player game environment is disclosed. The method includes: receiving profiles of players in the multi-player game environment; adjusting game options of the players based upon the respective profiles of the players; monitoring relative performance of the players; determining if the relative performance of the players is within a desired range of performance; and adjusting game parameters of the players if the relative performance of the players is outside the desired range.
  • Other features and advantages of the present invention will become more readily apparent to those of ordinary skill in the art after reviewing the following detailed description and accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram illustrating a system that operates in accordance with an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating an embodiment of an enhanced game controller.
  • FIG. 3 is a block diagram of another embodiment of an enhanced game controller.
  • FIG. 4 is a block diagram of yet another embodiment of an enhanced game controller.
  • FIG. 5 is a block diagram of another embodiment of an enhanced game controller.
  • FIG. 6 is a block diagram of still another embodiment of an enhanced game controller.
  • FIG. 7 is a block diagram of yet another example of an enhanced game controller.
  • FIG. 8 is a block diagram of an embodiment of a three-sensor module enhanced game controller.
  • FIG. 9 is a block diagram of another embodiment of a three-sensor module enhanced game controller.
  • FIG. 10 is a block diagram of another embodiment of an enhanced game controller.
  • FIG. 11 is a flow chart illustrating a technique for processing signals from a enhanced game controller.
  • FIG. 12 is a block diagram of a gaming system that may be used to implement various embodiments described herein.
  • DETAILED DESCRIPTION
  • After reading the following description it would become apparent to one skilled in the art how to implement the invention in various alternative embodiments and alternative applications. However, although various embodiments of the present invention will be described herein, it is to be understood that these embodiments are presented by way of example only, and not limitations. As such, this detailed description of various embodiments should not be construed to limit the scope or breadth of the present invention.
  • Various embodiments of the methods, apparatus, techniques, programs, and systems described herein provide for enhanced game controllers. Methods, apparatus, techniques, programs and systems described herein provide for the enhancement of game controllers to better detect and improve a user's input to the game. In one embodiment, the enhanced game controller can include six axis motion sensing modules. For example, a sensor module such as a game controller can include accelerometers to detect motion in the x, y, and z planes. The sensor module can also include gyro detecting circuitry that can detect rotation about the three axes in pitch yaw and roll. The enhanced game controller or a game console can covert raw sensor data into gesture data input to the game. In this way the user can interact with the game by making gestures with the game controller.
  • FIG. 1 is a block diagram illustrating a system that operates in accordance with an embodiment of the present invention. As illustrated in FIG. 1, a computer, or game, entertainment console 102 may be coupled to a video display 104 such as a television or other type of visual display. A game or other simulations may be stored on a storage media 106 such as a DVD, a CD, flash memory, USB memory or other type of memory media. The storage media 106 can be inserted to the console 102 where it is read. The console can then read program instructions stored on the storage media and present a game interface to the user.
  • As illustrated in FIG. 1, a user or player manipulates multiple sensor modules or game controllers 110 a and 10 b to control and interact with the video game or other simulation. The game controllers 110 a and 10 b may include conventional controls, for example, control input devices such as joysticks, buttons and the like. In addition, the game controllers 110 a and 10 b can include an internal sensor, for example an accelerometer, that produces signals in response to the position motion orientation or change in orientation of the game controller 110.
  • During operation of the console 102 when the user is playing a game, the user can use the game controllers 110 a and 10 b to interact with the game. As described further below, the game controllers 10 a and 10 b may be attached to a framework 108 to derive extra degrees of freedom in an enhanced game controller or peripheral. Although the example illustrated in FIG. 1 shows two controllers 10 a and 10 b there can be any desired number of controllers attached to a framework
  • FIG. 2 is a block diagram illustrating an embodiment of an enhanced game controller 200. As shown in FIG. 2 the enhanced game controller 200 includes two sensor modules 202 and 204 that are connected to a supporting structure 206. In the embodiment of FIG. 2, the sensors 202 and 204 are conventional game controllers for example six axis game controllers, such as Sony PlayStation® game controllers. In the example shown in FIG. 2, the supporting structure 206 is a rigid body framework and can be used to drive extra degrees of freedom in a game peripheral device. For example, two six axis game controllers 202 and 204 can be mounted on the supporting structure 206 which is a rod that intersects the controllers parallel to the top plate of the controllers 202 and 204. In this example a new genre of gaming becomes possible, including things like “Marching Band Baton Competition” and “Virtual Boxing.”
  • In the marching band baton competition example, the player could leverage a pair of game controllers 202 and 204 rigidly connected to the support structure 206, such as a holding harness or stick where each game controller 202 and 204 are attached to opposite ends of the stick (with one controller 202 sitting in parallel with the support structure 206 which is also parallel to the second controller 204 in a lengthwise manner). In the marching band example, game play could consist of a series of competition events where the player acting as a band leader might raise, lower, twirl, or swing the device in response to music and an on-screen character.
  • In another embodiment, the enhanced game controller 200 can also be fitted with a ring 208. When configured with a ring 208, a player could use the enhanced game controller 110 to simulate a steering wheel or other type of control in the game.
  • FIG. 3 is a block diagram of another embodiment of an enhanced game controller 300. As shown in FIG. 3, two game controllers 202 and 204 are mounted to a support structure 306. In the embodiment of FIG. 3, the support structure 306 connects to the two game controllers 202 and 204 normal to the base plate of the sensors. In this embodiment a user can grasp the support structure 306 between the two game controllers 202 and 204 and their gestures used as input to a game. For example, a user can grasp the support structure 306 and use this device in a punching motion such as in a boxing game so that the rotations and jabs from the user can be felt in a more natural way.
  • In the examples of FIGS. 2 and 3, as well as the other examples that follow, output from the sensor modules can be integrated and used in conjunction with one another to allow the player to control and have enhanced input to a game. In addition the support structure allows a player to hold the enhanced game controller with a single hand, whereas it is common for game controllers to require the user to hold them with two hands. For example, integrating multiple sensor modules, such as six axis game controllers, can be used in conjunction with one another to allow the player to control a game character, such as a virtual boxing character. In this way the players' actions may be more natural than with a single controller held in both hands.
  • FIG. 4 is a block diagram of yet another embodiment of an enhanced game controller 400. In the example of FIG. 4, the two game controllers, 202 and 204 are attached with the support structure 406. In this embodiment the axis of sensitivity of the two sensor modules 202 and 204 are rotated relative to one another. As show in FIG. 4, one game controller 202 has its top plate rotated by 90-degree from the orientation of the top plate of the other game controller 204. Alternatively, the relative axis of orientation of the game controllers 202 and 204 can be in any relationship to each other. For example, one of the game controllers can have its top plate normal to the support structure and the other game controller can have its top plate parallel to the support structure.
  • FIG. 5 is a block diagram of another embodiment of an enhanced game controller 500. As show in FIG. 5, two multi-axis sensor modules 502 and 504 are connected by a supporting structure 506. In one embodiment, the sensor modules 504 and 506 are 6-axis sensors. In another embodiment, the sensor modules 502 and 504 can be different number of axis of sensitivity. For example, sensor module 502 can be a single-axis sensor while sensor module 504 is a multi-axis sensor, such as a 6-axis sensor. In addition, the orientation of sensor modules 502 and 504 can be in any relationship relative to one another.
  • FIG. 6 is a block diagram of still another embodiment of an enhanced game controller 600. As shown in FIG. 6, two multi-axis sensor modules 602 and 604 are connected by a supporting structure 606. In the example of FIG. 6, the supporting structure 606 is flexible, being able to be deformed. Using two multi-axis sensor modules 602 and 604, the amount of deformation 610 of the support structure 606 can be detected. In this way a user's gestures can be better mimicked in the game played by the user.
  • FIG. 7 is a block diagram of yet another embodiment of an enhanced game controller 700. In the embodiment of FIG. 7, a single sensor module 702 can be rigidly mounted or held to a supporting surface 704. A flexible structure 706 is attached to the sensor 702. The flexible structure 706 can be moved by the user and released. If the user moves, or bends, and releases the flexible structure 706, there can be a resonance associated with the structure 706 that can be detected by the sensor module 702 and converted into game inputs, movements or actions.
  • Although the preceding embodiments described have generally been directed to two sensor modules or game controllers, it is also possible that a structure can be coupled to any desired number of sensor modules. The structure connecting the multiple controllers can be used to mimic player's actions. In addition, the structure attaching the multiple controllers can be manipulated by the user and the manipulation can cause movements and vibrations that are sensed by the controllers and converted into game inputs, events or actions.
  • FIG. 8 is a block diagram of an embodiment of a three-sensor module enhanced game controller 800. As shown in the example of FIG. 8, three sensor modules 802, 804 and 806 are attached by structural members 810, 812 and 814. The structural members 810, 812 and 814 can be rigid, or can be flexible and be capable of being deflected by the user. In addition, structural members 810, 812 and 814 can have a resonance associated with them that can be detected and used as a game input. Also, the structural members 810, 812 and 814 can be a combination of rigid, flexible and resonant structures in combination.
  • FIG. 9 is a block diagram of another embodiment of a three-sensor module enhanced game controller 900. In the embodiment of FIG. 9 three sensor modules 902, 904 and 906 are connected by structural members 910, 912 and 914. As discussed in FIG. 8, structural members 910, 912 and 914 can be rigid, flexible, resonant, or any combination of the same. In the example of FIG. 9 the orientation of the three sensor modules 902, 904 and 906 have been rotated relative to one another. Any combination of rotation of the sensors relative to one another is envisioned.
  • Using a multi-sensor module controller allows a user's input to map to gestures in the game. For example, a distance between two sensors can be used in a digital signal processor (DSP) along with how the sensor modules move, to improve mapping a user's gesture and to convert that gesture into an input for a game movement. Using multiple sensors in an enhanced game controller provides many advantages. For example, using DSP techniques, the input from the multiple sensors can be combined subtractively, additively, by averaging, or other combination to enhance the signal level as well as better detect the user's gestures. In other words, multiple sensors provide multiple forms of data from the user's gesture, and these multiple forms of data can be combined so as to produce a better signal to mimic the user's gestures.
  • Use of multiple sensors along with the knowledge of the structural coupling between the sensors can improve gesture mapping of a user's motion. For example, two sensor modules can be coupled using a support structure such that the two sensor modules are at a known off-set distance from one another, and the movement of the sensor modules relative to each other is bound by the constraints of the coupling of the support structure. The input signals from the two sensors and the known constraints of the support structure, for example, a rigid support structure or flexible support structure or resonant support structure, can be used to better detect signals from the sensors and map user's gestures.
  • FIG. 10 is a block diagram of another embodiment of an enhanced game controller 1000. As shown in FIG. 10, a sensor 1002 can be attached to a user, for example, to a user's hand 1004 by an attachment mechanism such as a strap 1006. In the embodiment shown in FIG. 10, the user's hand motions and gestures can be detected and input to a game as game movements or gestures. For example, if the sensor 1002 is a 6-axis sensor and is strapped to a user's hand, then in a game such as a boxing game, the motion as well as the rotation of the user's hand can be detected and input into the game to better mimic the user's actual motion.
  • In other embodiments of FIG. 10, sensors can be mounted on other locations of a user's body. For example, sensors can be mounted on a user's arms, feet, knees, etc, to better detect user's gestures and motion and use the sensor data as input to a game to better mimic the user's motion in the game.
  • In the embodiments described above, the sensor modules or controllers can be wired or wireless. In one embodiment, the sensors are wireless and thereby, communicate to the game console without the need of a physical wire connection. Eliminating a physical connection can be beneficial so that the sensors can be moved about without the restriction or encumbrance of having wires attached to the sensors. For example, the input from these sensors can be communicated by radio frequencies using techniques such as Bluetooth, ZigBee, or 802.11x, and the like, or they could use optical techniques and infrared techniques
  • FIG. 11 is a flow chart illustrating a technique for processing signals from an enhanced controller. Flow begins in block 1102 where information is received about constraints of a structure that supports sensor modules. Flow continues to block 1104 where data from the sensor modules is received. Flow continues to block 1106 where the sensor data is combined with information about the constraints of the support structure to map a user's gestures. For example, the sensor data and constraints can be combined by a DSP, or other computing device, to map the user's gestures.
  • FIG. 12 is a block diagram of a gaming system 1200 that may be used to implement various embodiments described herein. As shown in FIG. 12, the gaming system 1200 may include a processor module 1201 and a memory module 1202. In one embodiment, memory module 1202 may be RAM, DRAM, ROM and the like. In addition, the gaming system 1200 may have multiple processor modules 1201 if parallel processing is to be implemented. The processor module 1201 can include a central processing unit 1203. In addition, the processor module 1201 can include local storage or a cache 1205 to store executable programs. The memory module 1202 can include game program storage 1204. In addition, the memory module 1202 can include signal data storage 1206, for example, signal data acquired from game controller operated by a user. The memory module 1202 can also include player data 1208 such as player profile data as well as game statistics that may be provided. The system 1200 may also include well-known support function module 1210 such as input/output elements 1211, power supplies 1212, a clock 1213, and cache memory 1214. The input/output elements 1211 may be controlled by a controller 1230. The system 1200 may also optionally include mass storage module 1215 such as a disc drive, CD ROM drive, DVD drive, tape drive or the like to store programs and/or data. The system 1200 may also optionally include a display module 1216 as well as a user interface module 1218 to facilitate interaction between the system 1200 and the user. Display module 1216 may be in the form of a cathode ray tube, a flat panel screen or any other display module. The user interface module 1218 may include a keyboard, mouse, joystick, write pen or other device such as a microphone, video camera or other user input device. The processor, memory, and other components within the system 1200 may exchange signals such as code instructions and data with each other via a system bus 1220.
  • In one embodiment, the gaming system 1200 is implemented as a computer-implemented program stored in the local storage or a cache 1205 of the processor module 1201. The program may include a computer-implemented method of dynamically adjusting game parameters based on performance levels of players in a multi-player game environment. The method includes: receiving profiles of players in the multi-player game environment; adjusting game options of the players based upon the respective profiles of the players; monitoring relative performance of the players; determining if the relative performance of the players is within a desired range of performance; and adjusting game parameters of the players if the relative performance of the players is outside the desired range. In one implementation, adjusting game parameters comprises limiting game options available to at least one of the players. In another implementation, adjusting game parameters includes enhancing game options available to at least one of the players. In another implementation, monitoring the relative performance of the players includes detecting the players' reaction to audio stimuli. In yet another implementation, monitoring the relative performance of the players includes detecting the players' reaction to visual stimuli.
  • Various embodiments described may be implemented primarily in hardware, or software, or a combination of hardware and software. For example, a hardware implementation may include using, for example, components such as application specific integrated circuits (“ASICs”), or field programmable gate arrays (“FPGAs”). Implementation of a hardware state machine capable of performing the functions described herein will also be apparent to those skilled in the relevant art.
  • The term “module” as used herein means, but is not limited to a software or hardware component, such as an FPGA or an ASIC, which performs certain tasks. A module may advantageously be configured to reside on an addressable storage medium and configured to execute on one or more network enabled devices or processors. Thus, a module may include, by way of example, components, processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, variables, and the like. The functionality provided for in the components and modules may be combined into fewer components and modules or further separated into additional components and modules. Additionally, the components and modules may advantageously be implemented to execute on one or more network enabled devices or computers.
  • Furthermore, those of skill in the art will appreciate that the various illustrative logical blocks, modules, circuits, and method steps described in connection with the above described figures and the embodiments disclosed herein can often be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled persons can implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the invention. In addition, the grouping of functions within a module, block, circuit or step is for ease of description. Specific functions or steps can be moved from one module, block or circuit to another without departing from the invention.
  • Moreover, the various illustrative logical blocks, modules, and methods described in connection with the embodiments disclosed herein can be implemented or performed with a general purpose processor, a digital signal processor (“DSP”), an ASIC, FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor can be a microprocessor, but in the alternative, the processor can be any processor, controller, microcontroller, or state machine. A processor can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • Additionally, the steps of a method or algorithm described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium including a network storage medium. An exemplary storage medium can be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium can be integral to the processor. The processor and the storage medium can also reside in an ASIC.
  • While the above is a complete description of the preferred embodiment of the present invention, it is possible to use various alternatives, modifications and equivalents. Therefore, the scope of the present invention should be determined not with reference to the above description but should, instead, be determined with reference to the appended claims, along with their full scope of equivalents. Any feature described herein, whether preferred or not, may be combined with any other feature described herein, whether preferred or not. Thus, the invention is not intended to be limited to the embodiment shown herein but is to be accorded the widest scope consistent with the principal and novel features disclosed herein.

Claims (15)

1. An enhanced game controller comprising:
a plurality of sensor modules;
a support structure attached to the plurality of sensor modules, structural constraints of the support structure are combined with data from the plurality of sensor modules to map a user's gestures.
2. The controller of claim 1, wherein the plurality of sensor modules comprise six axis sensors.
3. The controller of claim 1, wherein the plurality of sensor modules comprise game controllers.
4. The controller of claim 1, wherein the support structure is rigid.
5. The controller of claim 1, wherein the support structure is flexible.
6. The controller of claim 1, wherein the support structure comprises a resonant structure.
7. A method of mapping gestures of a user, the method comprising:
receiving information about structural constraints of a support structure;
receiving data from sensors attached to the support structure; and
combining the data from the sensors with the information about structural constraints of a support structure to map the gestures of a user.
8. The method of claim 7, wherein the map of the user's gestures is used as an input to a game system.
9. The method of claim 7, wherein receiving data from sensors comprises receiving data from game controllers.
10. The method of claim 7, wherein receiving information about structural constraints of a support structure comprises
receiving information about flexibility of the support structure.
11. A computer-implemented method of dynamically adjusting game parameters based on performance levels of players in a multi-player game environment, the method comprising:
receiving profiles of players in the multi-player game environment;
adjusting game options of the players based upon the respective profiles of the players;
monitoring relative performance of the players;
determining if the relative performance of the players is within a desired range of performance; and
adjusting game parameters of the players if the relative performance of the players is outside the desired range.
12. The method of claim 11, wherein adjusting game parameters comprises limiting game options available to at least one of the players.
13. The method of claim 11, wherein adjusting game parameters comprises enhancing game options available to at least one of the players.
14. The method of claim 11, wherein monitoring the relative performance of the players comprises detecting the players' reaction to audio stimuli.
15. The method of claim 11, wherein monitoring the relative performance of the players comprises detecting the players' reaction to visual stimuli.
US12/246,373 2007-10-08 2008-10-06 Enhanced game controller Abandoned US20090093307A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/246,373 US20090093307A1 (en) 2007-10-08 2008-10-06 Enhanced game controller

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US97830107P 2007-10-08 2007-10-08
US12/246,373 US20090093307A1 (en) 2007-10-08 2008-10-06 Enhanced game controller

Publications (1)

Publication Number Publication Date
US20090093307A1 true US20090093307A1 (en) 2009-04-09

Family

ID=40523736

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/246,373 Abandoned US20090093307A1 (en) 2007-10-08 2008-10-06 Enhanced game controller

Country Status (1)

Country Link
US (1) US20090093307A1 (en)

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100184379A1 (en) * 2009-01-16 2010-07-22 Masaru Shimomura Information processing system, information processing apparatus, and information processing program
US20120122578A1 (en) * 2010-11-12 2012-05-17 Song Byung-Youn Game controller, game machine, and game system using the game controller
US20150031422A1 (en) * 2013-07-23 2015-01-29 Yoheha Innovation Limited Game weapon device
US20150265926A1 (en) * 2007-04-26 2015-09-24 Sony Computer Entertainment America Llc Method and apparatus for adjustment of game parameters based on measurement of user performance
WO2015155530A1 (en) * 2014-04-08 2015-10-15 China Industries Limited Interactive combat gaming system
US9285893B2 (en) 2012-11-08 2016-03-15 Leap Motion, Inc. Object detection and tracking with variable-field illumination devices
US9436998B2 (en) 2012-01-17 2016-09-06 Leap Motion, Inc. Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections
US9465461B2 (en) 2013-01-08 2016-10-11 Leap Motion, Inc. Object detection and tracking with audio and optical signals
US9495613B2 (en) 2012-01-17 2016-11-15 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging using formed difference images
US20160346694A1 (en) * 2013-08-09 2016-12-01 Legacy Game Systems Llc System, apparatus, and method of monitoring interactions
EP3103530A1 (en) * 2015-06-12 2016-12-14 Nintendo Co., Ltd. Accessory
US9613262B2 (en) 2014-01-15 2017-04-04 Leap Motion, Inc. Object detection and tracking for providing a virtual device experience
US9679215B2 (en) 2012-01-17 2017-06-13 Leap Motion, Inc. Systems and methods for machine control
US20170189800A1 (en) * 2015-12-31 2017-07-06 The Bearded Bear, LLC Handheld Controller Grip Attachment
US9724601B2 (en) 2015-06-12 2017-08-08 Nintendo Co., Ltd. Game controller
US20170348598A1 (en) * 2016-06-07 2017-12-07 Nintendo Co., Ltd. Game apparatus, storage medium having game program stored thereon, game system, and game processing method
US9895606B1 (en) 2017-01-11 2018-02-20 Nintendo Co., Ltd. Accessory device
US9996638B1 (en) 2013-10-31 2018-06-12 Leap Motion, Inc. Predictive information for free space gesture control and communication
US10092829B2 (en) 2016-10-06 2018-10-09 Nintendo Co., Ltd. Attachment
US10328339B2 (en) * 2017-07-11 2019-06-25 Specular Theory, Inc. Input controller and corresponding game mechanics for virtual reality systems
US10328350B2 (en) 2016-10-06 2019-06-25 Nintendo Co., Ltd. Attachment and control system
US10585193B2 (en) 2013-03-15 2020-03-10 Ultrahaptics IP Two Limited Determining positional information of an object in space
US10609285B2 (en) 2013-01-07 2020-03-31 Ultrahaptics IP Two Limited Power consumption in motion-capture systems
US10691219B2 (en) 2012-01-17 2020-06-23 Ultrahaptics IP Two Limited Systems and methods for machine control
US10846942B1 (en) 2013-08-29 2020-11-24 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US11099653B2 (en) 2013-04-26 2021-08-24 Ultrahaptics IP Two Limited Machine responsiveness to dynamic user movements and gestures
US11185767B2 (en) * 2019-04-09 2021-11-30 Compal Electronics, Inc. Gaming device and gaming controller
US11353962B2 (en) 2013-01-15 2022-06-07 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US11567578B2 (en) 2013-08-09 2023-01-31 Ultrahaptics IP Two Limited Systems and methods of free-space gestural interaction
US11720180B2 (en) 2012-01-17 2023-08-08 Ultrahaptics IP Two Limited Systems and methods for machine control
US11740705B2 (en) 2013-01-15 2023-08-29 Ultrahaptics IP Two Limited Method and system for controlling a machine according to a characteristic of a control object
US11775033B2 (en) 2013-10-03 2023-10-03 Ultrahaptics IP Two Limited Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation
US11778159B2 (en) 2014-08-08 2023-10-03 Ultrahaptics IP Two Limited Augmented reality with motion sensing

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5128671A (en) * 1990-04-12 1992-07-07 Ltv Aerospace And Defense Company Control device having multiple degrees of freedom
WO2006090197A1 (en) * 2005-02-24 2006-08-31 Nokia Corporation Motion-input device for a computing terminal and method of its operation
WO2007042758A1 (en) * 2005-10-14 2007-04-19 New Concept Gaming Limited Controller
US20080015031A1 (en) * 2006-05-01 2008-01-17 Nintendo Co., Ltd., Game program and game apparatus
US20080076567A1 (en) * 2006-09-13 2008-03-27 Nintendo Co., Ltd. Game device and storage medium storing game program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5128671A (en) * 1990-04-12 1992-07-07 Ltv Aerospace And Defense Company Control device having multiple degrees of freedom
WO2006090197A1 (en) * 2005-02-24 2006-08-31 Nokia Corporation Motion-input device for a computing terminal and method of its operation
US20080174550A1 (en) * 2005-02-24 2008-07-24 Kari Laurila Motion-Input Device For a Computing Terminal and Method of its Operation
WO2007042758A1 (en) * 2005-10-14 2007-04-19 New Concept Gaming Limited Controller
US20080015031A1 (en) * 2006-05-01 2008-01-17 Nintendo Co., Ltd., Game program and game apparatus
US20080076567A1 (en) * 2006-09-13 2008-03-27 Nintendo Co., Ltd. Game device and storage medium storing game program

Cited By (87)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150265926A1 (en) * 2007-04-26 2015-09-24 Sony Computer Entertainment America Llc Method and apparatus for adjustment of game parameters based on measurement of user performance
US9433866B2 (en) * 2007-04-26 2016-09-06 Sony Interactive Entertainment America Llc Method and apparatus for adjustment of game parameters based on measurement of user performance
US8213866B2 (en) * 2009-01-16 2012-07-03 Nintendo Co., Ltd. Information processing system, information processing apparatus, and information processing program
US20100184379A1 (en) * 2009-01-16 2010-07-22 Masaru Shimomura Information processing system, information processing apparatus, and information processing program
US20120122578A1 (en) * 2010-11-12 2012-05-17 Song Byung-Youn Game controller, game machine, and game system using the game controller
CN102462961A (en) * 2010-11-12 2012-05-23 东芝三星存储技术韩国株式会社 Game controller, game machine, and game system using the game controller
US9056255B2 (en) * 2010-11-12 2015-06-16 Toshiba Samsung Storage Technology Korea Corporation Game controller, game machine, and game system using the game controller
US9934580B2 (en) 2012-01-17 2018-04-03 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9652668B2 (en) 2012-01-17 2017-05-16 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US11308711B2 (en) 2012-01-17 2022-04-19 Ultrahaptics IP Two Limited Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9436998B2 (en) 2012-01-17 2016-09-06 Leap Motion, Inc. Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections
US10410411B2 (en) 2012-01-17 2019-09-10 Leap Motion, Inc. Systems and methods of object shape and position determination in three-dimensional (3D) space
US9778752B2 (en) 2012-01-17 2017-10-03 Leap Motion, Inc. Systems and methods for machine control
US9495613B2 (en) 2012-01-17 2016-11-15 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging using formed difference images
US10366308B2 (en) 2012-01-17 2019-07-30 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US10565784B2 (en) 2012-01-17 2020-02-18 Ultrahaptics IP Two Limited Systems and methods for authenticating a user according to a hand of the user moving in a three-dimensional (3D) space
US10691219B2 (en) 2012-01-17 2020-06-23 Ultrahaptics IP Two Limited Systems and methods for machine control
US10699155B2 (en) 2012-01-17 2020-06-30 Ultrahaptics IP Two Limited Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9767345B2 (en) 2012-01-17 2017-09-19 Leap Motion, Inc. Systems and methods of constructing three-dimensional (3D) model of an object using image cross-sections
US9626591B2 (en) 2012-01-17 2017-04-18 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging
US11720180B2 (en) 2012-01-17 2023-08-08 Ultrahaptics IP Two Limited Systems and methods for machine control
US9672441B2 (en) 2012-01-17 2017-06-06 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US9679215B2 (en) 2012-01-17 2017-06-13 Leap Motion, Inc. Systems and methods for machine control
US9697643B2 (en) 2012-01-17 2017-07-04 Leap Motion, Inc. Systems and methods of object shape and position determination in three-dimensional (3D) space
US9741136B2 (en) 2012-01-17 2017-08-22 Leap Motion, Inc. Systems and methods of object shape and position determination in three-dimensional (3D) space
US9285893B2 (en) 2012-11-08 2016-03-15 Leap Motion, Inc. Object detection and tracking with variable-field illumination devices
US10609285B2 (en) 2013-01-07 2020-03-31 Ultrahaptics IP Two Limited Power consumption in motion-capture systems
US10097754B2 (en) 2013-01-08 2018-10-09 Leap Motion, Inc. Power consumption in motion-capture systems with audio and optical signals
US9626015B2 (en) 2013-01-08 2017-04-18 Leap Motion, Inc. Power consumption in motion-capture systems with audio and optical signals
US9465461B2 (en) 2013-01-08 2016-10-11 Leap Motion, Inc. Object detection and tracking with audio and optical signals
US11740705B2 (en) 2013-01-15 2023-08-29 Ultrahaptics IP Two Limited Method and system for controlling a machine according to a characteristic of a control object
US11353962B2 (en) 2013-01-15 2022-06-07 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US11874970B2 (en) 2013-01-15 2024-01-16 Ultrahaptics IP Two Limited Free-space user interface and control using virtual constructs
US11693115B2 (en) 2013-03-15 2023-07-04 Ultrahaptics IP Two Limited Determining positional information of an object in space
US10585193B2 (en) 2013-03-15 2020-03-10 Ultrahaptics IP Two Limited Determining positional information of an object in space
US11099653B2 (en) 2013-04-26 2021-08-24 Ultrahaptics IP Two Limited Machine responsiveness to dynamic user movements and gestures
US20150031422A1 (en) * 2013-07-23 2015-01-29 Yoheha Innovation Limited Game weapon device
CN104338319A (en) * 2013-07-23 2015-02-11 友喜哈创新有限公司 Game weapon equipment
US9901825B2 (en) * 2013-08-09 2018-02-27 Legacy Game Systems Llc System, apparatus, and method of monitoring interactions
US11567578B2 (en) 2013-08-09 2023-01-31 Ultrahaptics IP Two Limited Systems and methods of free-space gestural interaction
US20160346694A1 (en) * 2013-08-09 2016-12-01 Legacy Game Systems Llc System, apparatus, and method of monitoring interactions
US11776208B2 (en) 2013-08-29 2023-10-03 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US10846942B1 (en) 2013-08-29 2020-11-24 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US11461966B1 (en) 2013-08-29 2022-10-04 Ultrahaptics IP Two Limited Determining spans and span lengths of a control object in a free space gesture control environment
US11282273B2 (en) 2013-08-29 2022-03-22 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US11775033B2 (en) 2013-10-03 2023-10-03 Ultrahaptics IP Two Limited Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation
US11010512B2 (en) 2013-10-31 2021-05-18 Ultrahaptics IP Two Limited Improving predictive information for free space gesture control and communication
US11868687B2 (en) 2013-10-31 2024-01-09 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US9996638B1 (en) 2013-10-31 2018-06-12 Leap Motion, Inc. Predictive information for free space gesture control and communication
US11568105B2 (en) 2013-10-31 2023-01-31 Ultrahaptics IP Two Limited Predictive information for free space gesture control and communication
US9613262B2 (en) 2014-01-15 2017-04-04 Leap Motion, Inc. Object detection and tracking for providing a virtual device experience
US10888775B2 (en) 2014-04-08 2021-01-12 China Industries Limited Interactive combat gaming system
WO2015155530A1 (en) * 2014-04-08 2015-10-15 China Industries Limited Interactive combat gaming system
US11778159B2 (en) 2014-08-08 2023-10-03 Ultrahaptics IP Two Limited Augmented reality with motion sensing
US11141654B2 (en) 2015-06-12 2021-10-12 Nintendo Co., Ltd. Game controller
US20170072304A1 (en) 2015-06-12 2017-03-16 Nintendo Co., Ltd. Information processing system, information processing device, controller device and accessory
US11724178B2 (en) 2015-06-12 2023-08-15 Nintendo Co., Ltd. Game controller
EP3103530A1 (en) * 2015-06-12 2016-12-14 Nintendo Co., Ltd. Accessory
US10610776B2 (en) 2015-06-12 2020-04-07 Nintendo Co., Ltd. Supporting device, charging device and controller system
US10661160B2 (en) 2015-06-12 2020-05-26 Nintendo Co., Ltd. Game controller
US10258879B2 (en) 2015-06-12 2019-04-16 Nintendo Co., Ltd. Supporting device, charging device and controller system
US10010789B2 (en) 2015-06-12 2018-07-03 Nintendo Co., Ltd. Information processing system, information processing device, controller device and accessory
US10118093B2 (en) 2015-06-12 2018-11-06 Nintendo Co., Ltd. Information processing system, information processing device, controller device and accessory
US9751008B2 (en) 2015-06-12 2017-09-05 Nintendo Co., Ltd. Game controller
US9757647B2 (en) 2015-06-12 2017-09-12 Nintendo Co., Ltd. Game controller
US9776081B2 (en) 2015-06-12 2017-10-03 Nintendo Co., Ltd. Game controller
US9776082B2 (en) 2015-06-12 2017-10-03 Nintendo Co., Ltd. Supporting device, charging device and controller system
US9724601B2 (en) 2015-06-12 2017-08-08 Nintendo Co., Ltd. Game controller
US10543423B2 (en) 2015-06-12 2020-01-28 Nintendo Co., Ltd. Information processing system, information processing device, controller device and accessory
US9782671B2 (en) 2015-06-12 2017-10-10 Nintendo Co., Ltd. Game controller
US10583356B2 (en) 2015-06-12 2020-03-10 Nintendo Co., Ltd. Information processing system, information processing device, controller device and accessory
US11110344B2 (en) 2015-06-12 2021-09-07 Nintendo Co., Ltd. Information processing system, information processing device, controller device and accessory
US20170189800A1 (en) * 2015-12-31 2017-07-06 The Bearded Bear, LLC Handheld Controller Grip Attachment
US11154772B2 (en) * 2015-12-31 2021-10-26 The Bearded Bear, LLC Handheld controller grip attachment
US20170348598A1 (en) * 2016-06-07 2017-12-07 Nintendo Co., Ltd. Game apparatus, storage medium having game program stored thereon, game system, and game processing method
US10058779B2 (en) * 2016-06-07 2018-08-28 Nintendo Co., Ltd. Game apparatus, storage medium having game program stored thereon, game system, and game processing method
US10080962B2 (en) * 2016-06-07 2018-09-25 Nintendo Co., Ltd. Game apparatus, storage medium having game program stored thereon, game system, and game processing method
US10092829B2 (en) 2016-10-06 2018-10-09 Nintendo Co., Ltd. Attachment
US10328350B2 (en) 2016-10-06 2019-06-25 Nintendo Co., Ltd. Attachment and control system
US10596454B2 (en) 2016-10-06 2020-03-24 Nintendo Co., Ltd. Attachment
US10881952B2 (en) 2017-01-11 2021-01-05 Nintendo Co., Ltd. Accessory device
US10220309B2 (en) 2017-01-11 2019-03-05 Nintendo Co., Ltd. Accessory device
US9895606B1 (en) 2017-01-11 2018-02-20 Nintendo Co., Ltd. Accessory device
US11771980B2 (en) 2017-01-11 2023-10-03 Nintendo Co., Ltd. Accessory device
US10328339B2 (en) * 2017-07-11 2019-06-25 Specular Theory, Inc. Input controller and corresponding game mechanics for virtual reality systems
US20190299090A1 (en) * 2017-07-11 2019-10-03 Specular Theory, Inc. Input controller and corresponding game mechanics for virtual reality systems
US11185767B2 (en) * 2019-04-09 2021-11-30 Compal Electronics, Inc. Gaming device and gaming controller

Similar Documents

Publication Publication Date Title
US20090093307A1 (en) Enhanced game controller
US8839279B2 (en) Gesture cataloging and recognition
US10086282B2 (en) Tracking device for use in obtaining information for controlling game program execution
US9682320B2 (en) Inertially trackable hand-held controller
US8686939B2 (en) System, method, and apparatus for three-dimensional input control
US7737944B2 (en) Method and system for adding a new player to a game in response to controller activity
US7850526B2 (en) System for tracking user manipulations within an environment
US20070265075A1 (en) Attachable structure for use with hand-held controller having tracking ability
JP2009535173A (en) Three-dimensional input control system, method, and apparatus
JP5301429B2 (en) A method for detecting and tracking user operations on the main body of the game controller and converting the movement into input and game commands
JP7081921B2 (en) Programs and game equipment
EP2012891B1 (en) Method and apparatus for use in determining lack of user activity, determining an activity level of a user, and/or adding a new player in relation to a system
JP5638592B2 (en) System and method for analyzing game control input data
KR101020510B1 (en) Multi-input game control mixer
EP2013864A2 (en) System, method, and apparatus for three-dimensional input control

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT AMERICA INC., CALIFORN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MIYAKI, KEN;REEL/FRAME:021812/0195

Effective date: 20081030

AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT AMERICA LLC, CALIFORNI

Free format text: MERGER;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA INC.;REEL/FRAME:025403/0659

Effective date: 20100401

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC, CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA LLC;REEL/FRAME:038626/0637

Effective date: 20160331

Owner name: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC, CALIFO

Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA LLC;REEL/FRAME:038626/0637

Effective date: 20160331