US20100279772A1 - Methods and apparatus for stringed controllers and/or instruments - Google Patents

Methods and apparatus for stringed controllers and/or instruments Download PDF

Info

Publication number
US20100279772A1
US20100279772A1 US12/838,969 US83896910A US2010279772A1 US 20100279772 A1 US20100279772 A1 US 20100279772A1 US 83896910 A US83896910 A US 83896910A US 2010279772 A1 US2010279772 A1 US 2010279772A1
Authority
US
United States
Prior art keywords
strings
controller
stringed
striking
fingering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/838,969
Inventor
Bernard Chiu
Mark Izen
Stephen Paul Webster
Jack Daniel Davis
Craig Small
Wendy Lynn Mittelstadt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
745 LLC
Original Assignee
745 LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 745 LLC filed Critical 745 LLC
Priority to US12/838,969 priority Critical patent/US20100279772A1/en
Publication of US20100279772A1 publication Critical patent/US20100279772A1/en
Assigned to 745 LLC reassignment 745 LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IZEN, MARK, CHIU, BERNARD, FIRST ACT CANADA INC., FIRST ACT INC., WEBSTER, STEPHEN PAUL, DAVIS, JACK DANIEL, SMALL, CRAIG, MITTELSTADT, WENDY LYNN
Assigned to FIRST ACT INC. reassignment FIRST ACT INC. SECURITY AGREEMENT Assignors: 745 LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/24Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A63F13/245Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/24Constructional details thereof, e.g. game controllers with detachable joystick handles
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1043Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being characterized by constructional details
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1062Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to a type of game, e.g. steering wheel
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/135Musical aspects of games or videogames; Musical instrument-shaped game input interfaces

Definitions

  • the technology described herein relates to stringed controllers and/or instruments.
  • Some popular computer gaming applications such as the Guitar Hero® games, employ a special controller that has some similarities to an instrument (e.g., is generally guitar-shaped), but which differs significantly from an actual instrument.
  • the controller for use with Guitar Hero® has no strings and instead has colored fret buttons and a strum bar.
  • the controller provides two types of information to the gaming software, referred to herein as selection information and timing information.
  • the selection information is provided by depressing the fret buttons, and the timing information is provided by toggling the strum bar.
  • a series of icons, each corresponding to a color and position of one of the fret buttons, is displayed on the game screen as music is played. The player's goal is to hold down the fret button corresponding to the icon shown and toggle the strum bar at the same time that a note passes a marked area on the game screen.
  • a game controller comprises a body comprising a fingerboard, a plurality of strings extending along the fingerboard, at least one first sensor adapted to detect fingering of the fingerboard by a user of the game controller, at least one second sensor adapted to detect striking of at least one of the plurality of strings by the user of the game controller, and at least one control module that is coupled to the at least one first sensor and the at least one second sensor and that provides at least one electrical signal indicating the fingering of the fingerboard by the user and indicating the striking of at least one of the plurality of strings by the user.
  • a method comprises (A) generating control signals for a computer game based on user interactions with a controller that comprises a body comprising a fingerboard, a plurality of strings extending along the fingerboard, at least one first sensor adapted to detect fingering of the fingerboard by a user of the game controller, and at least one second sensor adapted to detect striking of at least one of the plurality of strings by the user of the game controller.
  • Generating the control signals comprises evaluating at least first and second distinct pieces of information relating to the user interactions, the first piece of information being indicative of fingering of the fingerboard by the user, and the second piece of information being indicative of the striking of at least one of the plurality of strings by the user.
  • an adapter for adapting a musical instrument to enable the musical instrument to be used as a game controller.
  • the musical instrument comprises a body comprising a fingerboard and a plurality of strings extending along the fingerboard.
  • the adapter comprises at least one first sensor adapted to detect fingering of the fingerboard by a user of the game controller, at least one second sensor adapted to detect striking of at least one of the plurality of strings by the user of the game controller, and at least one control module that is coupled to the at least one first sensor and the at least one second sensor and that provides at least one electrical signal indicating the fingering of the fingerboard by the user and indicating the striking of at least one of the plurality of strings by the user.
  • a method of adapting a musical instrument to enable the musical instrument to be used as a game controller comprises a body comprising a fingerboard and a plurality of strings extending along the fingerboard.
  • the method comprises: (A) positioning at least one first sensor on the fingerboard to detect fingering of the fingerboard by a user of the game controller; (B) providing at least one second sensor to detect striking of at least one of the plurality of strings by the user of the game controller; and (C) providing at least one electrical signal to a game, the at least one electrical signal indicating the fingering of the fingerboard by the user and indicating the striking of at least one of the plurality of strings by the user.
  • a method for use with a stringed game controller that comprises a body, a plurality of strings extending along at least a portion of the body, and at least one sensor adapted to detect movement of the strings.
  • the method comprises acts of: (A) in response to a strike of at least one of the plurality of strings by a user of the game controller that causes vibration of the at least one of the plurality of strings, dampening the vibration to facilitate detection of a subsequent strike of the at least one of the plurality of strings; and (B) producing at least one game control signal based on the strike of the at least one of the plurality of strings.
  • a stringed game controller comprises a body, a plurality of strings extending along at least a portion of the body, at least one sensor adapted to detect movement of at least one of the plurality of strings that results from a strike of the at least one of the plurality of strings by a user of the game controller that causes vibration of the at least one of the plurality of strings, and a dampener that dampens the vibration of the at least one of the plurality of strings to facilitate detection of a subsequent strike of at least one of the plurality of strings.
  • the stringed game controller further comprises at least one control module that is coupled to the at least one sensor and that provides at least one electrical signal indicating the striking of at least one of the plurality of strings by the user.
  • an apparatus comprises a body comprising a fingerboard, and a plurality of strings suspended between a first contact point and a second contact point and each having at least a portion extending along at least a portion of the fingerboard, wherein the portion of each of the plurality of strings extending between the first and second contact points vibrates when the string is struck while no portion thereof is in contact with the fingerboard, and wherein the portion of each of the plurality of strings extending along the at least a portion of the fingerboard is displaceable to bring the string into contact with the fingerboard and thereby adjust a length of the portion of the string that vibrates when the string is struck.
  • the apparatus further comprises a brace coupled to the body and configured to resist forces exerted on the body by the plurality of strings and to maintain the first contact point and second contact point in a substantially fixed relationship to each other
  • FIG. 1 shows an apparatus that may operate as both a game controller and an instrument, according to one embodiment of the present invention.
  • FIG. 2 shows one embodiment of a vibration dampening arrangement, according to one embodiment of the invention.
  • FIG. 3 shows another embodiment of a vibration dampener.
  • FIGS. 4 A-C show various aspects of fret detection arrangements according to embodiments of the present invention.
  • FIG. 5 shows details related to use of a brace according to an embodiment of the present invention.
  • FIGS. 6 A-C show structural details of a non-adjustable bridge for the apparatus of FIG. 1 , according to one embodiment of the invention.
  • FIG. 7 shows a controller output module according to one embodiment of the present invention.
  • FIGS. 8 A-B show color and number coding of the neck frets on the apparatus of FIG. 1 , according to one embodiment of the invention.
  • FIG. 9 shows the state arrangement of a strum detector module, according to one embodiment of the invention.
  • FIG. 10 shows an example of a filtered signal envelope estimate over time for use in a strum detector, according to some embodiments.
  • FIG. 11 shows an interactive visual display according to one embodiment of the present invention.
  • FIGS. 12 A-D show an interactive visual display according to another embodiment of the present invention.
  • FIG. 13 shows an interactive visual display according to yet another embodiment of the present invention.
  • FIGS. 14 A-D show an interactive visual display according to a further embodiment of the present invention.
  • FIGS. 15 A-C show an interactive visual display according to another embodiment of the present invention.
  • FIGS. 16 A-B show an interactive visual display according to a further embodiment of the present invention.
  • FIG. 17 shows various logical steps in a game flow according to one embodiment of the present invention.
  • FIGS. 18 A-B illustrate various strumming and picking aspects of embodiments of the present invention.
  • FIG. 19 shows an interactive visual display according to another embodiment of the present invention.
  • FIG. 20 illustrates an example of a configuration which may be used to provide electromechanical damping of strings, according to one embodiment.
  • FIG. 21 illustrates an example of a circuit which may be used to alter the decay time of a signal representing a string vibration, to facilitate detection of discrete strum events, according to one embodiment.
  • FIG. 22 illustrates a stringed game controller coupled to a processor for operating a gaming application, according to one embodiment.
  • FIG. 23 illustrates an embodiment of the invention directed to an adapter that may be used to employ a stringed instrument as a stringed game controller.
  • a stringed controller for games such as video games
  • the stringed controller resembles a guitar, but the aspects of the present invention described herein are not limited in this respect, and can be used with other fretted (e.g., a bass guitar) or unfretted (e.g., a violin or cello) instruments.
  • the stringed controller can be used for any type of gaming application, as the aspects of the invention described herein are not limited in this respect.
  • the stringed controller can be used with a play-along game, similar to Guitar Hero®, but provide a more realistic user/player experience.
  • the stringed controller can be used to control action in any type of game, and replace any existing controller, so that playing games can give the player experience with the instrument (e.g., in fingering the frets and strumming the strings of a guitar).
  • the stringed controller can be used to control a game specifically designed to teach the player how to play the instrument.
  • the controller may be configured to provide output signals to a game (i.e., to a gaming application executing on a computer or gaming console), allowing a user to interact with the game.
  • the output signals produced by the controller may represent any suitable information for interacting with the gaming application, such as indicating placement of a user's hands on the controller (e.g., fret placement on a fretted controller) as well as the timing at which one or more of the strings of the controller is played.
  • the controller in some embodiments may further optionally include one or more components, such as user inputs (e.g., knobs, buttons, dials, or any other inputs), making it compatible with any of a variety of gaming systems (e.g., personal computers or a module for any gaming platform), as the various aspects relating to a stringed controller are not limited in this respect.
  • user inputs e.g., knobs, buttons, dials, or any other inputs
  • gaming systems e.g., personal computers or a module for any gaming platform
  • a stringed game controller may produce one or more output signals derived from different parts of the controller, or derived from different user interactions with the controller.
  • vibration of the strings of the stringed controller may be used to produce an output signal representing timing information (e.g., the time at which each string is initially played), or any other suitable timing information.
  • a second type of information such as information indicative of the positioning of a user's hand on the stringed controller (e.g., the fret position on a fretted controller), may be derived irrespective of whether the string is vibrating.
  • Other types of information may also be provided, as the various aspects described herein are not limited to stringed controllers producing any particular types of output signals.
  • a multi-mode apparatus which may function both as a stringed instrument (e.g., a guitar, a bass guitar, a violin, or any other stringed instrument) and as a game controller for a gaming application, such as a computer gaming application.
  • a stringed instrument e.g., a guitar, a bass guitar, a violin, or any other stringed instrument
  • a game controller for a gaming application, such as a computer gaming application.
  • the apparatus may by played to produce musical notes, for example by plucking the strings and depressing a fret of a fretted instrument.
  • the instrument may function in a conventional manner so that the output signal of the apparatus may be caused by the vibration of the string(s), which may be directly audible (for example, as with an acoustic instrument) or processed and amplified (e.g., as with an electric guitar), which output signal may therefore include tonal components reflecting movement of the strings and the length of the vibrating portion of the strings, i.e., pitch information.
  • the apparatus may be connected to a dedicated amplifier or to a computer or gaming system which may operate as an amplifier (e.g., a virtual amplifier), or may be directly played without connection to any external components, for example as in the case of an acoustic instrument.
  • the various aspects described herein are not limited in this respect, as in the instrument mode the instrument may be used in any suitable manner, including in any of the ways instruments are conventionally employed.
  • the game application may derive any desired information from the user's interaction with the strings, but in some embodiments may not use any information about pitch or tone from the strings.
  • separate information can be provided indicative of the positioning of the user's fingers on the fingerboard (e.g., fret position on a fretted device, which may be indicative of string length) and timing information from striking, or playing, a string (e.g., plucking, picking, or otherwise playing).
  • the strings may be damped, for example to reduce or prevent vibration.
  • a pickup may be used to detect movement of one or more strings of the apparatus, for example when struck by the user, and may generate a corresponding timing index component of a gaming input signal provided to the gaming software.
  • the apparatus may be fretted (e.g., a guitar), and one or more fret sensors may be used to detect contact of the strings with a fret.
  • the fret sensor(s) may generate one or more components of a gaming input signal.
  • the positioning of a user's hand may be determined using input buttons positioned on the instrument (e.g., on the fingerboard of the guitar), a pressure responsive material, or in any other suitable manner, as the aspects described herein are not limited in this respect.
  • outputs of the controller may be generated that do not require detection of any string vibration tonal components. According to such embodiments, this may reduce or eliminate any need for the stringed controller to be in tune to properly function as a game controller. Rather, the strings of the apparatus may be used to derive timing information only, and the position of a user's hand may be determined by fret sensors, buttons, or in any other suitable manner. In some embodiments, the tonal components of the instrument/controller may be ignored entirely. However, all aspects of the invention are not limited in this respect, as the tonal output of the instrument/controller may optionally be used in some embodiments to provide an additional, or alternative, input.
  • the apparatus may include a controller output module, which may process signals from the apparatus to determine one or more types of information from the user's interaction (e.g., timing information, hand positioning information, or any other type of information), and may then generate one or more controller output signals to be provided to the gaming application in any format recognized by the gaming application.
  • a controller output module may process signals from the apparatus to determine one or more types of information from the user's interaction (e.g., timing information, hand positioning information, or any other type of information), and may then generate one or more controller output signals to be provided to the gaming application in any format recognized by the gaming application.
  • raw signals indicative of the user's actions e.g., representing timing and positioning information
  • Other manners of signal processing are also possible, as the various aspects described herein relating to a game controller are not limited in this respect.
  • a stringed controller may be a dedicated stringed controller, and may not be an actual instrument.
  • a stringed instrument and/or instrument-shaped stringed controller may include a brace.
  • the instrument and/or controller may be formed of one of more components, such as a body, a neck, a fingerboard, or any other suitable components, one or more of which may be formed of material(s) unable to withstand the loading forces imposed by strings.
  • the instrument, or instrument-shaped controller may be formed of multiple pieces fastened together, or of a single piece of material.
  • a brace may be provided to enable the instrument and/or controller to withstand the loading force of the strings, and may be made of any material suitable for bracing the instrument or instrument-shaped controller against the loading force of the strings.
  • the brace may be made of metal, wood, plastic, or any other suitable bracing material, as the braces described herein are not limited to being formed of any particular material.
  • the brace may prevent the stringed apparatus (e.g., instrument, or instrument-shaped controller) from breaking.
  • the brace may facilitate keeping the apparatus in tune with little or no adjustment.
  • FIG. 1 shows an apparatus 100 according to one embodiment, which apparatus may be used as a game controller for interfacing with a game, such as, but not limited to, a video game. While the apparatus 100 resembles a guitar, it should be appreciated that such a shape and structure is non-limiting, as stringed game controllers implementing one or more of the features described herein may be shaped similarly to bass guitars, violins, cellos, or any other stringed instruments.
  • the apparatus 100 comprises one or more strings 120 extending from the head 122 over the nut 123 , along the neck 124 and fingerboard 125 , over one or more pickups 140 , to the bridge 126 on the guitar body 128 .
  • the strings 120 produce electromagnetically detectable signals, and therefore may be made of an electrically conductive material, such as being steel guitar strings, nickel-wound strings, or may be formed of any other suitable string material, including materials not conventionally employed for guitar strings.
  • the strings 120 may be light gauge strings, heavy gauge strings, or have any suitable gauge, as the stringed apparatus described herein are not limited to use with any particular string gauge.
  • the string 120 may vibrate with a harmonic tonal component corresponding to a musical note. Pushing a string 120 down onto one of the fingerboard frets 130 on the neck 124 changes its vibrational length, thereby changing the corresponding musical note associated with the string.
  • the apparatus 100 includes a guitar body 128 with at least one guitar pickup 140 .
  • the guitar pickup 140 may detect movement of one or more of the strings 120 , and may generate an electrical signal, such as a voltage, in response to detecting such movement.
  • the pickup 140 may be a magnet surrounded by wires that detects movement of the strings 120 and produces a corresponding voltage output signal, but the aspects of the invention described herein are not limited in this respect, as the pickup 140 may be anything capable of detecting movement of the strings 120 .
  • the guitar pickup 140 may be a double coil pickup assembly from a guitar pickup vendor having a plastic ring and shell cover, Humbucker bobbin, ceramic magnet, and pole piece assembly, or any other suitable structure.
  • the guitar pickup 140 may be inserted from above and secured with screws to the guitar body 128 , or may be connected to the apparatus 100 in any other suitable manner.
  • the apparatus 100 may be a dedicated stringed game controller, i.e., that is not used in any mode as an instrument.
  • the apparatus 100 may be a multi-mode apparatus operable both as a computer gaming input device (i.e., a game controller) and as an instrument (e.g., an electric guitar in the embodiment of FIG. 1 ).
  • the guitar body 128 may include a standard quarter-inch stereo audio jack 150 for communicating the output signal from the guitar pickup 140 to an external audio amplifier (e.g., via an audio cable), or to any other suitable device.
  • the audio amplifier may be a designated amplifier, such as a conventional guitar amplifier, a computer, or a gaming system operable as a virtual amplifier, or may be any other suitable amplifier, as the type of amplifier is non-limiting.
  • the output signal from the guitar pickup 140 may be a conventional electric guitar output signal which contains string vibration tonal components representative of harmonic vibration of the strings 120 , and the output signal may be adjusted by a volume control 152 and a tone control 154 .
  • the apparatus 100 may comprise one or more components and/or signal processing circuitry facilitating its operation as a game controller.
  • the apparatus 100 may provide one or more output signals (or one or more components of a single output signal) when operating as a game controller, which output signal(s) may provide one or more types of information for interacting with a gaming application.
  • the apparatus may therefore include one or more components and/or signal processing circuitry suitable to produce such output signals.
  • one type of signal produced by the apparatus 100 when operated as a game controller may represent the positioning of a user's hand, finger, or fingers, on the fingerboard 125 .
  • the apparatus 100 may be a fretted apparatus, as shown in FIG. 1
  • one type of signal produced by the apparatus when used as a game controller may indicate a fret position of a user's hand, although similar signals may be generated for non-fretted controllers.
  • Such a signal indicating the position of a user's hand on the game controller may be generated in any suitable manner, as the various aspects relating to stringed game controllers are not limited in this respect.
  • a signal indicative of a user's hand positioning on the game controller is merely one non-limiting example of a type of signal which may be generated.
  • the controller includes one or more fret sensors for detecting contact between the frets and one or more of the strings 120 to generate signals indicative of finger position that may be provided as an output signal (or portion thereof) which may serve as an input signal to a gaming application.
  • FIGS. 4A-4C described below, provide one non-limiting example of how fret position of the apparatus 100 may be detected. It should, however, be appreciated that any suitable technique for detecting fret position may be used, as the technology described herein is not limited to use with any particular technique of fret detection.
  • fret positioning detection is only one non-limiting example of an output signal which may be produced by a stringed game controller.
  • some stringed game controllers may not have frets (e.g., a game controller shaped as a violin), and the position of a user's hand on the controller may be detected using a pressure sensitive material, a resistive material on a fingerboard of the stringed game controller, or using any other suitable technique.
  • a second type of signal (or component of a signal) produced by the apparatus 100 and provided as a gaming input to a gaming application may be a signal conveying timing information.
  • striking one or more of the strings 120 e.g., plucking, picking, strumming, or otherwise striking
  • the game controller may generate a separate output for each string. In other embodiments, only one output may be generated when any string is struck, however not all embodiments are limited in this respect.
  • determining the timing at which one or more of the strings 120 is played may be facilitated by damping the strings 120 , to reduce or prevent extended vibration of the strings (irrespective of whether the damping alters the pitch or tone of the string), thereby facilitating determination of when string movement is caused by a new strike as opposed to extended vibration. Therefore, according to one non-limiting embodiment, the strings 120 may be damped when the apparatus 100 is used as a game controller.
  • the apparatus 100 includes a mechanical vibration dampener 170 having an engagement surface for damping the strings 120 .
  • the engagement surface of the dampener 170 may partially contact the strings 120 , encapsulate the strings 120 , or have any other suitable relationship to the strings 120 for damping them.
  • the vibration dampener 170 may be retractable or removable in any suitable manner (e.g., may be recessed into the guitar body 128 ) when the apparatus 100 is being used as an instrument, e.g., an electric guitar.
  • the vibration dampener 170 may be positioned (e.g., raised up from the guitar body 128 ) so that the engagement surface contacts (e.g., encapsulates) the strings 120 to reduce or prevent their harmonic vibration.
  • the output signals from the guitar pickup 140 may then lack string vibration tonal components representative of harmonic vibration and instead may be used to represent one or more timing index components of one or more input signals to a gaming application (i.e., the time at which the strings 120 are moved).
  • a gaming application i.e., the time at which the strings 120 are moved.
  • dampener 170 described is only one non-limiting example, and that other structures and techniques for damping the strings 120 may be used.
  • Other examples of mechanical dampeners are described below in connection with FIGS. 2 and 3 .
  • dampening may be performed by signal processing, either alone or working together with some type of mechanical and/or electromechanical dampener, as described below.
  • a game controller may produce one or more output signals representing timing information and positioning (e.g., fret positioning) information from the user's interaction with the strings of the stringed game controller.
  • the strings are used solely for generating timing information, and no pitch information is detected.
  • processing of an output signal generated by striking one or more of the strings may not entail analyzing frequency information from the string vibration (e.g., pitch information), but rather may simply analyze whether a particular string is vibrating or not (i.e., whether a string has been struck). Thus, latencies associated with pitch analysis may be avoided in the signal processing stages.
  • the strings of the stringed game controller need not be in tune to use the game controller, which may facilitate use of the apparatus as a game controller by users who are unable to tune the strings with sufficient precision to generate the proper pitch.
  • the fret or finger positioning information may be generated separately from any vibration of the string(s), for example by detecting contact of a string with a fingerboard, with a fret, or in any other suitable manner.
  • the pitch of a string may be detected and analyzed.
  • the apparatus 100 may further comprise a controller output module for processing received signals (e.g., one or more signals including the finger position component from the fret sensors or otherwise, and one or more timing index components from the guitar pickup 140 , according to one non-limiting embodiment) independently of any string vibration tonal component to generate one or more corresponding controller output signals to provide to the computer gaming application.
  • the controller output module may be within the guitar body 128 , as in FIG. 1 (which is why the controller is not visible in FIG. 1 ), may be part of a module distinct from the apparatus 100 , may be disposed partially within and partially outside of the apparatus 100 , or may be implemented in any other suitable manner.
  • the controller output module may have any suitable structure for processing the gaming input signals, one non-limiting example of which is shown and described below in connection with FIG.
  • the controller output signal in gaming mode may be output through the audio jack 150 , or there may be one or more special game controller output ports such as a USB port 160 , a wireless communications link through an antenna (e.g., using a protocol such as Bluetooth and a 2.4 GHz RF module or other wireless technology), or any other suitable arrangement.
  • a wireless communications link When configured with a wireless communications link, it may operate up to a 30 ft. range and still meet a 40 hour battery life specification, or may have any other suitable operating range and battery life, as the aspects described herein as relating to game controllers are not limited in this respect.
  • the strings of a stringed game controller may be damped to reduce or eliminate their vibration after being struck (e.g., plucked, picked, strummed, or otherwise struck).
  • the damping of the string vibration signal can be accomplished by applying mechanical and/or electro-mechanical damping directly to the strings, by signal processing of the electrical signal from the pickup, by some combination of these techniques, or in any other suitable manner.
  • the damping may be performed to facilitate use of the strings to provide a timing signal.
  • any vibration of the strings be damped by a sufficient amount to facilitate detection of distinct strikes on the strings generated by a user.
  • a user typically may play, or strike, the strings in the frequency range of 1-5 Hertz (Hz) (e.g., 1-5 strums per second) when playing a song, and the aspects of the invention described herein can be used with applications in which the user may strike the strings at that pace, a slower pace, or even faster.
  • the vibrations may be damped to exhibit a suitable amount of decay (also referred to as attenuation) to facilitate detection of distinct string strikes in a time less than the expected period between string strikes.
  • the strings of a stringed game controller may be damped to ensure that any vibration of the strings is sufficiently attenuated in less than approximately one second to distinguish between ongoing vibration of the string from the initial strike and a subsequent string strike.
  • a sufficient amount of attenuation may be on the order of 50% or more attenuation of the initial string vibration, approximately 60% attenuation, approximately 70% attenuation, approximately 80% attenuation, approximately 88% attenuation, approximately 90% attenuation, or approximately 95% attenuation.
  • the various aspects relating to damping described herein are not limited to providing any particular amount of attenuation.
  • an expected play rate is one strum/strike per second
  • play rates may also be used, for example, as mentioned play rates of 1-5 Hz may be expected, or any other suitable play rate.
  • a sufficient amount of damping may be applied to distinguish between distinct string strikes in a time of less than approximately one second to less than approximately two tenths of a second (i.e., the time between strikes for play rates of 1-5 Hz).
  • a sufficient amount of damping may be applied to attenuate the vibration of a string by a sufficient amount (e.g., any of those amounts previously listed) in less than approximately half of the time period between expected string strikes (i.e., in less than approximately 0.1 seconds for a play rate of 5 Hz), in less than approximately one third of the time period between expected string strikes (i.e., in less than approximately 0.07 seconds for a play rate of 5 Hz), in less than approximately one quarter of the time between expected string strikes (i.e., in less than approximately 0.05 seconds for a play rate of approximately 5 Hz), or in less than any other suitable time.
  • a sufficient amount e.g., any of those amounts previously listed
  • the strings of a stringed controller are damped to reduce any initial vibrations therein by approximately 90% or more (e.g., by approximately 98% in some embodiments) in approximately 25 milliseconds or less (e.g., one quarter of the time period between expected string strikes at a rate of approximately 10 Hz), however it should be appreciated that not all embodiments are limited in this respect.
  • FIG. 2 shows specific details of one specific embodiment of a mechanical vibration dampener 200 which may be used to damp strings on a stringed game controller, such as the apparatus 100 .
  • a mechanical vibration dampener 200 which may be used to damp strings on a stringed game controller, such as the apparatus 100 .
  • the operation of the dampener 200 will be described in connection with the apparatus 100 of FIG. 1 .
  • the dampener 200 (or one like it but modified, e.g., to handle a different number of strings) may be applicable to other stringed game controllers.
  • the dampener 200 includes an engagement surface 201 that may encapsulate the strings 120 to reduce or prevent harmonic vibration, for example to reduce or eliminate vibration from a strike in any of the time periods listed above (e.g., in less than approximately 1 second, less than approximately 0.1 seconds, less than approximately 25 milliseconds, or within any other suitable time).
  • the engagement surface 201 has six string slots 202 which each receive one of the strings 120 when the vibration dampener 200 is raised into operating position for gaming mode.
  • the engagement surface 201 may be a foam piece (e.g., Poron®, or any other suitable material for providing a desired amount of damping within a desired time.
  • the length, L, of the engagement surface slot 202 may be long enough to ensure sufficient dampening of the strings 120 .
  • the slot may be one inch or more in length in the direction along the strings 120 , or may have any suitable length.
  • the decay time constant of string vibration corresponds to the amount of time it takes for the string vibrations to dissipate and the vibration dampener 200 may reduce the decay time constant relative to an undampened string to as close to zero as practical (given mechanical and other constraints), to any of the other time periods listed above, or to any other suitable time period.
  • a foam piece with a slot at least an inch long may dampen the decay time constant of string vibration to less than 25 milliseconds.
  • a dampener may be employed that dampens less efficiently but is still effective to facilitate the detection of distinct string strikes.
  • the engagement surface 201 may be easily replaceable and may be friction fit into an outer shell 204 (which may be formed of plastic or some other materials).
  • an outer shell 204 which may be formed of plastic or some other materials.
  • a user may select one of various options of materials for the engagement surface 201 , where the different options have different characteristics (e.g., stiffness), and may switch between materials by removing one type and friction fitting a replacement into the outer shell 204 .
  • the engagement surface may be not be fit into any outer shell in some embodiments, but rather may be formed and mounted in any suitable manner to perform its damping function
  • the vibration dampener 200 may include a dampening control mechanism, allowing it to be raised and lowered around the strings 120 .
  • the dampener 200 may be raised around the strings 120 when the apparatus is used in game mode (i.e., as a game controller), and may be lowered from the strings 120 if, and when, the apparatus 100 is used in a guitar mode (i.e., as an instrument).
  • the dampener 200 may be raised and lowered by squeezing two control ends 203 with thumb and forefinger, and may include a locking mechanism to secure it in correct position in accordance with one embodiment, but other arrangements are possible.
  • FIG. 3 shows another non-limiting embodiment of a vibration dampener 300 .
  • the dampener 300 includes a neck strap arrangement, in that it includes a flexible strap 320 made of a material, such as cotton, rubber, plastic, or any other suitable material, which stretches in a longitudinal direction, and which may wrap around the guitar neck 124 to mechanically couple a vibration dampening material, described below, around the neck.
  • Flexible strap 320 may include a fastening material 330 (such as Velcro® or other fastening material) on the ends to facilitate fastening, or may include any other suitable fastening mechanism.
  • Engagement surface 310 which may be coupled to the flexible strap 320 in any suitable removable or fixed manner (e.g., by gluing, sewing, or in any other suitable manner) may engage the strings 120 from above, and may be made of any suitable material (e.g., felt, rubber, or any other suitable material) for providing a desired amount of damping within a desired time (e.g., 70%, 80%, 85%, 90%, 95% or more attenuation in approximately 25 milliseconds or less or some other desired timeframe, depending on the rate at which users are expected to strike the strings). Additionally, in some embodiments, the engagement surface 310 may be formed of an electrically non-conductive material.
  • the vibration dampener 300 may be applied in any manner suitable for damping the strings 120 by the desired amount and within the desired time, but in some embodiments is not attached so tightly as to cause the strings 120 to contact the frets 130 .
  • a neck attaching vibration dampener 300 may be adapted to fit between the guitar strings 120 and the fingerboard 125 to engage the guitar strings 120 from below.
  • the dampener may include a piece of foam which is positioned between the fingerboard and the strings of the game controller, although other configurations are also possible.
  • the stiffness of the engagement surface 310 may be selected, for example from a plurality of options, to reduce the decay time constant of the string vibrations of the guitar strings 120 .
  • the engagement surface 310 may be formed of a material removable from the flexible strap 320 , so that a user may select one of various options of materials to use for the engagement surface 310 , where the various options have differing degrees of stiffness.
  • the vibration dampener 300 may be removed from the guitar neck 124 of apparatus 100 if the apparatus 100 is to be used as an instrument, e.g. as a guitar.
  • FIGS. 2 and 3 illustrate two examples of dampeners which may be used with a stringed game controller to dampen the strings
  • damping of the strings 120 may be performed electromechanically and/or though signal processing, or through any combination of the damping techniques described herein, as the various aspects relating to damping of strings of a game controller are not limited to use with any particular type of damping.
  • dampening may not be employed in embodiments in which the expected play rate (i.e., the expected frequency of string strikes) is sufficiently low that the vibrations of the strings would naturally attenuate by a sufficient amount to allow detection of distinct strikes, or in embodiments in which the processing of signals from the strings is sufficiently fast and/or accurate to distinguish between distinct string strikes without dampening.
  • the expected play rate i.e., the expected frequency of string strikes
  • the processing of signals from the strings is sufficiently fast and/or accurate to distinguish between distinct string strikes without dampening.
  • FIG. 20 illustrates an example of a circuit which may apply electromechanical damping to one or more of the strings of a stringed game controller.
  • the string 120 may be positioned proximate a pickup transducer 2002 and a force transducer 2004 , each of which may be connected to ground (GND).
  • the pickup transducer 2002 and force transducer 2004 may be coupled to each other via a negative feedback amplifier 2006 , having a suitable gain of ⁇ A. Vibration of the string 120 may induce a voltage in the pickup transducer 2002 , which is then amplified by the negative feedback amplifier 2006 , and then applied to the force transducer 2004 .
  • the force transducer 2004 may then apply a restorative electromagnetic force to the string 120 , damping the vibration of the string 120 .
  • FIG. 21 illustrates an alternative damping technique, in which vibration of the string is not itself damped, but a signal produced in a pickup is.
  • an envelope 2102 of a signal generated by a vibrating string e.g., a signal output by pickup 140 of FIG. 1
  • the output 2108 of the envelope follower 2106 therefore follows the envelope 2102 of the input signal and functions as a gain control voltage for controlling the gain of the voltage controlled amplifier 2104 .
  • the output envelope 2110 of the voltage controlled amplifier may exhibit a shorter decay period than that of the envelope 2102 , even though the vibration of the string itself may not be damped.
  • the output envelope 2110 may therefore be used to detect strikes occurring closer together in time than could the envelope 2102 . It should be appreciated that other methods of processing output signals from a pickup may also be used to shorten the decay time of the signal, and that the aspects described herein relating to damping string vibrations are not limited to using any particular method of damping.
  • one type of output signal generated by a stringed game controller which may be provided as an input to a gaming application, is a signal indicative of one or more fret positions of the user's fingers on the game controller.
  • the fret position information may be detected in any suitable way.
  • a signal may be developed by making the frets 130 and the strings 120 of electrically conductive material, and connecting such electrically conductive frets 130 to a fret wiring ribbon 400 that runs under (or along, or within) the fingerboard 125 .
  • Such frets 130 may be made of any suitable electrically conductive material, such as steel (for example, 18% Nickel-Silver fret wire) or any other material with suitable electrical and mechanical properties.
  • the frets 130 are made of a material that resists coloration and rust, although the various aspects relating to game controllers described herein are not limited in this respect.
  • the frets 130 may be securely attached to the fingerboard 125 by any suitable means such as individually by ultrasonic welding, and may be trimmed for size using snips or in any other manner.
  • the fret wiring ribbon 400 may be, for example, a 20 gauge 6-position ribbon cable terminated in a PCB connector 402 that connects to the controller output module of a stringed controller or may be any other suitable connector. As shown in FIG. 4 C, from the fret wiring ribbon 400 an individual wire may be crimped to a vertical fret connector 401 (e.g., 0.1 pitch) for each of the first several frets, for example for the first five frets, or for any other number of frets.
  • the fret wiring ribbon 400 may run within the guitar neck 124 alongside any internal structural components, such as a brace discussed below, or may be positioned in any other suitable manner, such as along the outside of the neck 124 , or in any other suitable manner.
  • a gaming input signal representation of finger position along the neck of the controller is generated by detecting the contact of a string 120 to a fret 130
  • other techniques may be employed for detecting finger position along the neck of the controller.
  • part or all of the fingerboard 125 may be formed of a pressure sensitive material, such that an electrical signal may be generated when a particular area of the fingerboard is pressed by a string or a user's hand.
  • the pressure sensitive material may comprise one or more sections, for example corresponding to frets or to each of the strings.
  • a resistive material may be formed to define a single area or many areas (for example to correspond to frets) on the fingerboard 125 , from which an electrical signal is generated when a string or finger is contacted to the fingerboard 125 .
  • fretted or non-fretted controllers can be used for fretted or non-fretted controllers.
  • stringed game controllers such as the apparatus 100 in FIG. 1
  • the apparatus may therefore comprise one or more features making it compatible with the gaming application.
  • the apparatus 100 may include control features specifically for interaction with a computer (such as a personal computer or a Mac® from Apple®, Inc.), a gaming console (e.g., an Xbox 360® from Microsoft® Corporation, Playstation® from Sony®, PS3® from Sony®, a Wii® from Nintendo® or any other gaming console), or any other type of device with which the apparatus may want to communicate, either for gaming purposes, sound processing purposes, amplification purposes, learning purposes, or any other purpose.
  • a computer such as a personal computer or a Mac® from Apple®, Inc.
  • a gaming console e.g., an Xbox 360® from Microsoft® Corporation, Playstation® from Sony®, PS3® from Sony®, a Wii® from Nintendo® or any other gaming console
  • any other type of device with which the apparatus may want to communicate, either for gaming purposes, sound processing purposes, amplification purposes, learning
  • the apparatus 100 comprises an analog joystick 185 that may be used in the normal manner of a computer game joystick (and which in some embodiments may alternatively be a digital joystick), and a sync button 186 for wireless synchronizing of the apparatus 100 to a game console (for example for multi-player games, or for any other purpose).
  • a sync button 186 for wireless synchronizing of the apparatus 100 to a game console (for example for multi-player games, or for any other purpose).
  • player indicator LEDs within the sync button 186 light up to indicate which player number the controller has been assigned (Player 1, Player 2, Player 3, or Player 4).
  • joystick and a sync button are two non-limiting examples of the types of features which may be added to, or adapted on, a device to facilitate compatibility of the device with a gaming system
  • other types of features such as dials, knobs, and direction buttons (e.g., 4 direction keypads and 8 direction keypads) may also be used, or any other suitable features.
  • the volume control 152 and tone control 154 may both be multi-function potentiometers with a center detent position or may be implemented in other ways. Their functionality may be specific to whether the apparatus 100 is in game mode (i.e., being used as a game controller) or guitar mode (i.e., being used as an instrument), which modes may in some embodiments be selected by a user from menu options of a gaming application visual display, or in any other suitable manner.
  • game mode the volume control 152 may act as a select/back button that the player presses, for example, to highlight different menu options or to move backwards in a game menu system. Twisting the volume control 152 in game mode may have no effect.
  • the volume control 152 may be turned to act as a conventional volume control for the output signal from the guitar pickup 140 , and pressing it may have no effect.
  • the tone control 154 similarly controls the tone of the pickup output signal in guitar mode.
  • the tone control 154 may act as a pressable start switch to activate a game function, and turning the control has no effect.
  • Stringed game controllers may have any number and type of features (e.g., buttons, knobs, dials, ports, joysticks or any other features) making them compatible with any particular gaming application.
  • the number, type, and functionality of such features may depend on the gaming application itself, e.g., the types of input signals the gaming application receives from a user to operate.
  • the various aspects of stringed game controllers described herein are not limited to including any particular number, type, or function of features to be compatible with a gaming application.
  • conventional instruments such as guitars
  • guitars are typically assembled from various wooden or composite material components which are connected together.
  • Each component piece is individually strong and rigid.
  • Various features of such a conventional guitar are adjustable so that the surfaces and angles of the neck, fretboard, frets, and pickup can be adjusted to be in correct relationship to the strings over time (e.g., as the materials expand or contract due to temperature and/or humidity, or other reasons).
  • this is based on an adjustable bridge arrangement at the base of the guitar body where the strings terminate. By raising, lowering and tilting the different sections of the adjustable bridge, the strings can be correctly positioned over the other components.
  • a brace (alternatively referred to herein as a stringer or support) may also or alternatively be used to support an instrument and/or an instrument-shaped game controller made of material(s) (e.g., lightweight plastics or other materials) that would not otherwise be sufficiently strong to withstand the loading force of strings.
  • the brace structure may be in the form of a stiff metal bar structural member, or any other suitable bracing structure, that provides structural support for the device, for example as the backbone provides structural support in a human.
  • a stringed instrument (which may optionally serve as a game controller) may be constructed as a substantially adjustment-free device which may be provided to the customer with the strings already correctly positioned and ready to use without the need for adjustments, such as bridge adjustments.
  • a stringed device comprises a brace connected between the two ends at which the strings of the device are fixed, to support the structure in withstanding the force of the strings and/or to minimize or eliminate alterations in the relationship between the ends of the strings.
  • the strings are typically fixed between the head or nut and the bridge. Therefore, according to one embodiment, a brace may be provided to support the guitar from the head or nut to the bridge, for example to maintain the strings in a proper position.
  • one end of the brace is connected to the nut, or the head of a guitar-shaped device, and a second end of the brace is connected to the bridge.
  • the brace may be formed of any suitable bracing material for withstanding a loading force applied on the stringed device by strings, which, for example, may be approximately 150 pounds to 200 pounds for light gauge guitar strings, but which may vary depending on the string characteristics.
  • the brace may be formed of metal, wood, plastic, or any other sufficiently strong material, and may take any suitable shape that, together with the material, provides the desired level of support.
  • the desired level of support may vary depending on the application. For example, when the apparatus is to be used solely as a game controller and is not intended to be used as an instrument, the level of support may be one to simply prevent the device from deforming or breaking, as keeping the device properly tuned may not be an issue when it is not intended to be played as an instrument.
  • the apparatus is intended to be usable as an instrument, while desirable to provide a level of support to make the instrument adjustment-free, it is not necessary in all embodiments.
  • FIG. 5 shows one specific example of a brace 500 in the specific form of a solid bent steel bar which runs from the head end of a stringed device, such as guitar-shaped apparatus 100 of FIG. 1 , down through the guitar body, and which provides structural support for the device.
  • the brace 500 may provide the structural strength to withstand the loading force of the guitar strings, which may be around 250 pounds in some embodiments. While steel is used as the material for the brace 500 in one embodiment due to its combination of strength, availability, and low cost, it should be appreciated that any suitable bracing material may be used.
  • the neck head 501 is a separate steel stamping that is welded onto the neck end of the brace 500
  • the neck 502 is a plastic part that is placed onto the brace 500 which allows the finger board 503 to snap in.
  • the aspect of the invention relating to a brace is not limited to such a configuration, and it should be appreciated that the braces described herein for supporting stringed devices are not limited to any particular shapes, materials, methods of fabrication, or methods of attachment.
  • an adjustment-free stringed device such as a guitar or guitar-shaped game controller
  • a guitar or guitar-shaped game controller may be provided.
  • the device may include a non-adjustable bridge.
  • the non-adjustable bridge may be implemented in any suitable manner, an example of which is the non-adjustable bridge 600 shown in FIGS. 6A-6C .
  • the non-adjustable bridge may facilitate maintaining a non-adjustable correct relationship between the fingerboard and the strings.
  • the non-adjustable bridge 600 may terminate the body end of the strings 120 after they have passed over the guitar pickup 140 .
  • the bridge 600 which may be made of steel or any other suitable material, secures the ends of the strings 120 in anchor holes 601 .
  • the bridge 600 includes mounting holes 603 for connecting the bridge 600 to the guitar body 128 .
  • the non-adjustable string slots 602 elevate the strings 120 to a desired or optimum height above the guitar pickup 140 and frets 130 Because of the unvarying rigid structure imparted to the instrument and/or controller (e.g., the apparatus 100 ) in this non-limiting embodiment by the brace 500 , little or no user adjustments may be needed to the bridge 600 , or any other components, to achieve satisfactory string placement. Thus, the device may be immediately ready for use when purchased and not require tuning by the user.
  • a stringed game controller in accordance with some embodiments may include a controller output module for processing signals based on user interactions (e.g., signals generated when strings 120 contact the frets, signals from the pickup 140 based on string strikes, etc.) and providing such signals to a gaming application.
  • FIG. 7 is a circuit diagram of one non-limiting example of a controller output module 710 , which may be implemented, for example, by a digital processor running firmware, and/or any other suitable combination of hardware, firmware, and software, as the embodiments described herein relating to game controllers are not limited to use with any particular type of controller output module.
  • the controller output module 710 may include any suitable processing device, such as a microcontroller and/or programmable logic (e.g., a field programmable gate array (FPGA)), or any other suitable processing device.
  • a microcontroller and/or programmable logic e.g., a field programmable gate array (FPGA)
  • the output module may be within the stringed controller (e.g., within the guitar body 128 of apparatus 100 ), or in any other suitable location.
  • each of input pins 702 a - 702 f of the controller output module 710 is electrically connected to the respective frets 130 of the apparatus 100 , and generates an input signal indicating that a fret is contacted by a string 120 .
  • the electrical connection may be direct as shown, or it may be via intermediary electronic devices, such as resistors, capacitors, transistors, or the like, or via non-wired media.
  • the strings 120 are electrically connected to the ground pin 704 of the controller output module 710 . When a string 120 contacts a guitar fret 130 , a circuit to ground is closed and a small current (e.g., 5 mA or any other suitable current) runs to ground 704 through the string 120 .
  • a small current e.g., 5 mA or any other suitable current
  • the corresponding input pin 702 a - 702 f connected to the fret 130 contacting the string 120 is therefore connected to ground, and the voltage on that input pin may therefore drop.
  • the drop in voltage on the input pin may be detected by the controller output module 710 , which may therefore generate a signal directly or indirectly resulting in a gaming input signal, which information may then be relayed to an external processor and/or external gaming application.
  • the gaming input signal may be relayed through the USB port 160 (which in the non-limiting example of FIG. 7 is illustrated as having four signal lines, corresponding to a power supply line (VDD), a ground line (GND), a serial input line (SI), and a serial output line (SO)) or in any other suitable way.
  • USB port 160 the form of USB port 160 shown is not limiting, and that signals from the controller output module 710 may also or alternatively be provided to an external device, such as a computer or gaming console, in ways other than using a USB port (e.g., using a PS/2 connector or in any other suitable manner).
  • FIG. 7 illustrates one circuit configuration by which connection of a string 120 to a fret 130 may be detected, it should be appreciated that other configurations are possible, and that the various features described herein relating to stringed game controllers are not limited in this respect. Also, in some embodiments, multiple signals can be generated for each fret (e.g. with one signal per string contacting a fret or one signal representing contact by any contribution of two or more strings).
  • Embodiments of the stringed game controller may incorporate a suitable scheme for providing indicia to the user for use in developing the component of the gaming input signal indicative of a user's hand position or fret position.
  • a visual clue may be provided (such as a color coding scheme, a number coding scheme, a symbolic coding scheme, an icon coding scheme, etc.), a tactile scheme may be employed, any combination thereof, or any other suitable type of scheme may be employed.
  • the elements of the scheme e.g.
  • FIGS. 8A-B show that there may be color coding and/or numbering along the neck 124 and/or on the face of the fingerboard 125 .
  • a user interface for the gaming application may use corresponding indicia (e.g., colors/numbers that directly match the indicia on the apparatus or are correlated in some manner) to communicate the inputs the user should be performing (e.g., strum timing and direction, string fingering, etc.).
  • corresponding indicia e.g., colors/numbers that directly match the indicia on the apparatus or are correlated in some manner
  • the gaming input signal(s) from the apparatus 100 may be updated to reflect user interaction in any suitable manner
  • one of the gaming input signals (or one of the components of a gaming input signal) reflects whether a string is contacting a fret)
  • different monitoring schemes may be employed.
  • the strings 120 are all connected to ground simultaneously and each fret 130 is connected to a corresponding input pin of the controller output module (e.g., input pins 702 a - 702 f of the controller output module 710 ), so that whenever a string contacts a fret, a signal is generated on the corresponding input pin of the output module.
  • one or more of the strings 120 are alternately grounded (i.e., alternately connected to ground 704 ) so that a signal is generated on the corresponding input pin of controller output module 710 only if a string is contacting a fret at the same time that the string is electrically grounded, effectively meaning the strings are individually monitored at different times.
  • which string 120 is connected to ground may be alternated rapidly, or at any suitable rate, either sequentially or in any suitable order to poll the strings individually for signals thereon.
  • the two monitoring schemes described above for monitoring signals generated when a string contacts a fret are non-limiting, and that other monitoring schemes may be employed.
  • one or more of the frets 130 may be sub-divided into a number of (e.g. six) spaced electrically isolated segments each corresponding to one of the strings 120 .
  • each segment of the frets 130 may be configured to allow separate detection of when it is contacted by a string (as opposed to the fret generating a single signal when contacted by any string), for example by modifying the electrical connection scheme of FIGS. 4A-4C to add connections for each of the six segments of the frets of interest (e.g. by adding additional wiring ribbons), or in any other suitable manner.
  • contact of specific individual strings with each fret 130 may be determined, which may be desirable in some applications where it is desired to increase the number of possible inputs from the user and/or to challenge the user to interact with the stringed controller in a manner more realistic to playing the corresponding instrument by detecting precisely which string contacts a fret.
  • not all embodiments are limited in this respect and others need not differentiate between which strings contact a fret or are otherwise fingered by the user.
  • a stringed game controller may include interfaces or controls in addition to the strings for interfacing with a gaming application.
  • interfaces or controls may include an analog joystick 185 and sync button 186 shown in FIG. 1 , or any other suitable features (e.g., directional keypads, knobs, dials, or any other features).
  • the signals produced by the additional interfaces or controls may be processed by the same output control module that processes signals from the strings, but the embodiments of the invention described herein are not limited in this respect.
  • the signals from any additional controls can be detected and processed in any suitable manner, as the aspects of the invention described herein are not limited in this respect.
  • additional computer gaming application controls for example in the form of a button (e.g. sync button 186 ) and a joystick (e.g., joystick 185 ), may be connected to the controller output module (e.g., controller output module 710 ).
  • the sync button 186 is represented by a switch, and may be connected between ground and an input pin 706 b of the controller output module so that when activated the controller output module 710 detects a drop in voltage at input pin 706 b and relays information indicating that the control has been activated to an external processing device or external gaming application in any suitable manner (e.g. through the USB port 160 ).
  • the three additional input pins 706 a , 706 c and 706 d are shown as being connected to switches 708 a , 708 b , and 708 c , which switches may correspond to additional controls on the game controller (e.g., apparatus 100 ) not shown in FIG. 1 , but which may be included in some embodiments.
  • the joystick 185 has been described as an analog joystick, and therefore may be implemented using two potentiometer tracks 712 a and 712 b , which may be connected to ADC input channels 714 a and 714 b of the controller output module 710 , respectively.
  • the joystick 185 may be implemented in any suitable manner, and may alternatively be a digital joystick suitably implemented.
  • other configurations for the computer gaming application controls are also possible, as any number (including zero) of additional interfaces or controls may be provided on a stringed controller according to some embodiments.
  • a stringed game controller may generate an output signal, or a component of an output signal (it should be appreciated that for purposes of this application separate components of a single signal may be considered to be separate signals, and vice versa), indicative of the timing at which strings are struck, which may be provided as a gaming input signal to a gaming application.
  • This timing information can be generated based on user interaction with the stringed controller in any suitable manner. For example, according to one embodiment for use with the output module of FIG. 7 and the guitar shaped controller 100 of FIG. 1 , to develop this timing index component of the gaming input signal, the controller output module 710 of FIG.
  • the guitar pickup 140 may include an internal analog to digital converter (ADC) module having an input pin 720 that is connected to sample the voltage across the guitar pickup 140 .
  • the ADC module may operate at a sampling rate of about 5 to 6 KHz, or at any other suitable sampling rate.
  • the guitar pickup 140 may be a transducer that converts movement and vibrations in the strings 120 into a voltage signal across its terminals.
  • the pickup 140 may include one or more permanent magnets wrapped in one or more wire coils which possess an associated magnetic field. When the strings 120 move relative to the magnets of the pickup 140 , they may change the magnetic field, which induces electric currents in the coil and a corresponding voltage across the terminals of the pickup 140 , which may be sampled by the ADC module.
  • the output signal of the ADC module may then be processed in any suitable manner, one example of which is described below in connection with a strum detector, to determine whether a string has been struck and thereby derive a signal indicative of the timing of string strikes.
  • a stringed game controller may include a dampener to dampen vibrations of the strings 120 .
  • the vibration dampener When engaged, the vibration dampener may remove some or all of the frequency tonal components of the string vibrations and may greatly reduce the time constant of decay for those vibrations, thereby making it easier to detect string strikes.
  • the timing index component of the gaming input signal may be developed in other manners (including from string controllers other than the guitar-shaped controller 100 of FIG. 1 and using a different output module from that shown in FIG. 7 ), and that the example described above is non-limiting.
  • the guitar pickup 140 is also connected to circuitry to enable the apparatus 100 to operate in a mode where it can be played as an instrument. This may be achieved in any suitable manner and the aspect of the invention that enables the stringed controller to also operate as an instrument is not limited in this respect.
  • the guitar pickup is connected in parallel with a tone control circuit 770 and a volume control circuit 780 when the output jack 150 , which may be a standard 1 ⁇ 4 inch phone jack or any other suitable connection, is connected to an external guitar amplifier.
  • the volume control circuit 780 may be an adjustable voltage divider implemented with a potentiometer that may be manually adjusted by turning the volume control 152 .
  • Tone control circuit 770 may include a capacitor in series with a potentiometer with one terminal shorted to the middle terminal, allowing it to function as an adjustable resistor.
  • the tone control circuit 770 may be in parallel with the volume control circuit 780 and may provide an alternate path to ground with an impedance that decreases with increasing frequency due to the capacitor, thereby operating as a low-pass filter by attenuating high frequency voltage signals from the guitar pickup 140 relative to low frequency signals.
  • the cutoff frequency of this low-pass filter may be adjusted manually by turning the potentiometer, via tone control 154 , to change the resistance in series with the capacitor, or may be adjusted in any other suitable manner.
  • the aspects of the invention are not limited to use with any particular type of volume control or tone control circuit, or even to use with a device that includes volume or tone controls.
  • input pin 720 presents a high input impedance, so that current flowing on the pin is small relative to current that flows through the tone control circuit 770 and volume control circuit 780 when the output jack 150 is connected.
  • the tone control circuit 770 and volume control circuit 780 are open circuits, in which case the only electrical loading on the guitar pickup 140 is the input impedance of the ADC module.
  • the controller output module 710 includes an ADC module which receives an analog signal from pickup 140 and converts it to a digital signal. The controller output module 710 may then filter a resulting digital signal from the ADC module to detect user strikes of the controller strings (e.g., strings 120 in FIG. 1 ) as discrete events independently of string vibration tonal components. The digital signals from the ADC module may be low pass filtered to obtain an estimate of the envelope of the signal from the pickup 140 .
  • the output of the ADC module may be rectified by a full-wave rectifier and then filtered by a peak detection filter to create the envelope of the signal from the pickup 140 .
  • This envelope estimate may then be compared to different thresholds based on the current state of a strum detector module implemented in the controller output module 710 , with different thresholds being used to determine when a strum has occurred.
  • a vibration dampener examples of which were previously described, may facilitate detection of such string movements as discrete timing index events, since reducing the decay time constant for string vibrations may facilitate resolving individual string strikes.
  • the specific processing discussed above to detect string strikes is provided only as one non-limiting example, as other manners of identifying discrete string strikes and timing index events are also possible, and the embodiments of the invention described herein are not limited to using any particular technique.
  • a single pickup (e.g., pickup 140 ) may be used to detect string vibration from any of the strings of a stringed controller or instrument (e.g., strings 120 of apparatus 100 ).
  • the pickup may have a single output signal, such as shown in FIG. 7 , and a single ADC channel may be used.
  • the sampling rate of the ADC channel may be chosen to be higher than the highest expected string vibration frequency, or any other suitable value.
  • a pickup may be used to detect vibrations of individual strings, as opposed to detecting the vibration of any of the strings of the device.
  • a 6-way pickup (referred to as a “hex” pickup) may be employed, such that detection of vibrations may be individually detected from any of the six strings 120 shown.
  • the controller output module e.g., controller output module 710
  • the controller output module may include an ADC channel for each of the pickup channels (i.e., six ADC channels in the example in which a 6-way pickup is used).
  • the multiple channels may be realized by multiple dedicated ADC hardware channels, by a single ADC with a multiplexer having an input for each output of the pickup (i.e., a multiplexer with six inputs in the example in which the pickup is a 6-way pickup), or in any other suitable manner, as the various aspects are not limited in this respect.
  • Other types of pickups are also possible, and the various aspects relating to detecting vibrations of the strings of a stringed device are not limited to use with any particular pickup configuration.
  • a strum module may be employed to analyze the envelope of the output signal from the pickup, the envelope being created by filtering the output signal of the pickup, or in any other suitable manner.
  • the strum module may include two or more states which may be used to identify when a strum is initiated, and when the vibrations from the strum are sufficiently attenuated to conclude that subsequent vibrations of the strings are due to a subsequent strum.
  • strum is used in this context, the applicability of the methodologies described is not limited to scenarios in which multiple strings of the instrument are played in a single upward or downward stroke, but rather may apply equally well to detecting strikes of individual strings.
  • strum and “strike” may be used interchangeably in this context.
  • FIG. 9 illustrates a non-limiting example of the different states of a strum detector module (e.g., implemented in the controller output module 710 ) according to one embodiment of the invention.
  • a strum detector module has three states, including a strum high state, a strum low state, and a no strum state.
  • the strum detector module outputs a logic low signal (e.g., a logic “0”), and repeatedly compares the current estimate of the signal envelope of interest to a strum start threshold (SST).
  • a logic low signal e.g., a logic “0”
  • the signal of interest may be the signal from pickup 140
  • the estimate of the signal envelope may be generated by low pass filtering the digital version of the signal from pickup 140 , which digital version may be provided by the ADC module of the controller output module 710 .
  • the envelope abbreviated as “env” in FIG. 9
  • the strum detector transitions to the strum high state 930 , and outputs a logic high signal (e.g., a logic “1”). Otherwise, the strum detector remains in the no strum state 920 .
  • the strum detector module In the strum high state 930 , the strum detector module repeatedly compares the estimate of the signal envelope to a strum end threshold (SET). If the envelope is greater than the SET, the strum detector module remains in the strum high state, and continues to output the logic high signal. Otherwise, the strum detector module transitions to a strum low state 940 and starts a counter (abbreviated as “ctr” in FIG. 9 ) to measure time elapsed in the strum low state 940 . The strum module continues to output the logic high signal while in the strum low state.
  • SET strum end threshold
  • the strum detector module While in the strum low state 940 , the strum detector module repeatedly compares the estimate of the signal envelope to the SET. If the envelope is greater than the SET, the strum detector module transitions to the strum high state 930 , and continues to output the logic high signal. Otherwise, the strum detector module compares the value stored in the counter to the strum hold time (SHT). If the counter value is greater than the SHT, the strum detector module transitions to the no strum state 920 , and outputs a logic low signal. Otherwise, the strum detector module remains in the strum low state 940 .
  • SHT strum hold time
  • strum detector state information may be sent in response to a state transition.
  • strum detector state information may be sent periodically to an external device or application.
  • FIG. 9 merely provides one non-limiting example.
  • the number of strum states, and their significance e.g., the significance of a transition between states
  • FIG. 10 shows an example of the application of the strum detector of FIG. 9 to a filtered signal envelope estimate 1002 , for example as might be obtained by low pass filtering the output signal of the ADC module of controller output module 710 .
  • the output of the strum module is represented by logic output signal 1004 .
  • the strum module may begin in its no strum state, prior to time t o . In this state, the logic output signal 1004 of the strum module is low, and the strum module may compare the value of the envelope estimate to the SST.
  • the strum is first detected at time t o when the envelope estimate 1002 first exceeds the SST, in response to which the strum module transitions to the strum high state, and its logic output signal 1004 goes high.
  • the strum module compares the value of the envelope estimate 1002 to the SET.
  • the envelope estimate 1002 is less than the SET, and the strum module transitions to its strum low state, during which the logic output signal 1004 remains high.
  • the counter is begun, and the end of the strum is detected at time t 2 when the envelope estimate 1002 next remains below the SET for a duration longer than the SHT.
  • the strum module transitions to its no strum state and its logic output signal 1004 goes low.
  • the strum detection module may determine the timing index component of the gaming input signal as described above independently of the operation of any sensors (e.g., finger position or fret sensors) that determine one or more other components (e.g., fret position components) of the gaming input signal.
  • the determination of both components of the gaming input signals may be related.
  • a fret sensor circuit may be configured to only send an update of the fret sensor state to an external processing device or application when a strum event is detected by the strum detector. This provides output signals that more realistically reflect the way a corresponding instrument operates, but not all embodiments are limited in this respect.
  • the strum detector may be configured to adjust the SST, SET, or SHT in response to a detected change in the fret sensor state.
  • software running on an external processing device may generate visual and/or audio signals based at least in part upon the user's interaction with the stringed controller (e.g., based at least partially on the strikes of the strings and the fingering of the strings).
  • This system may be used for any number of purposes including for entertainment such as for computer gaming, for education such as to facilitate training of the user in the use of the stringed instrument (e.g., in the use of a guitar in the example of FIG. 1 ) or in any other way, as aspects of the invention are not limited in any respect by the manner in which a software program (e.g., a game) responds to input from a stringed controller. Examples of software applications for use with a stringed controller are described below, but it should be appreciated that the various aspects described herein are not limited to use with any particular software applications.
  • one aspect of the technology described herein relates to the use of stringed game controllers, for example in the shape of a guitar, bass guitar, violin, or other stringed instrument.
  • Such game controllers may be configured to be coupled to an external device including a processor (e.g., a personal computer, a gaming console, or any other device including a processor) operating a gaming application or other software application that responds to inputs from the stringed controller.
  • a processor e.g., a personal computer, a gaming console, or any other device including a processor
  • an external device 2202 which may be a computer, a gaming console, or any other type of device including one or more processors, runs a computer gaming application or other software application that responds to the input signals generated by the stringed game controller (e.g., the apparatus 100 of FIG. 1 ) in response to user actions.
  • the external device 2202 may be coupled to the apparatus 100 by a communication link 2204 that may include a wired connector through a communication port, such as USB port 160 in FIG. 1 , a wireless link or in any other suitable manner.
  • the computer gaming (or other software) application may interact with the user via a visual display (e.g., on a screen 2206 ) and/or audio output through, for example, gaming system or computer speakers 2208 , a television, or in any other suitable manner
  • the gaming application may be configured to produce Musical Instrument Digital Interface (MIDI) sounds (for example, via speakers 2208 ) corresponding to a plurality of instruments.
  • MIDI Musical Instrument Digital Interface
  • the user may be able to select the types of sounds produced from a MIDI instrument selector (e.g., guitar, tuba, trumpet, or any other instruments).
  • MIDI instrument selector e.g., guitar, tuba, trumpet, or any other instruments.
  • different MIDI instruments may be assigned (by a user or otherwise) to different frets of a fretted game controller, such that touching a string to a particular fret may result in the gaming application producing a sound corresponding to the instrument assigned to that fret.
  • sound effects may be assigned to frets (by user selection or otherwise) in some embodiments, such as reverb, delay, vibrato, pitch bending, or any other sound effect.
  • the gaming application may allow the user to assign particular chords to the frets, so that contacting a string to a particular fret may result in the gaming application sounding the chord assigned to that fret.
  • effects e.g., instrument type, note, sound effect, etc.
  • various effects may be selected by a user (or otherwise assigned), and that the various aspects described herein are not limited in this respect.
  • FIG. 11 shows an embodiment of an interactive visual display 1100 that provides user input directions to tell the user how and when to produce a gaming input signal.
  • the interactive visual display 1100 which may be used in connection with a stringed game controller such as apparatus 100 , communicates indications related to strum timing, fret fingering, and strum direction (e.g., up or down).
  • a strum indicator 1101 (shown as an arrow in FIG. 11 but other visual cues can be used) indicates to the user when to strike the strings of the game controller with either an upward or downward stroke (e.g., by using a guitar pick or the user's fingers).
  • the strum indicator 1101 changes to a “hit” color (e.g., changes from black to blue) to indicate correct performance.
  • a “miss” color e.g., changes from black to red
  • the strum indicator 1101 is black it indicates a strum that has not been played yet.
  • the interactive visual display 1100 also includes a tempo indicator 1102 which moves horizontally from left to right giving a visual indication of the tempo.
  • the placement of the tempo indicator 1102 directly over a strum indicator 1101 indicates the user is to strum while depressing the correct fret.
  • the tempo indicator 1102 may take any suitable form, such as a bouncing ball, a moving bar, or any other suitable form.
  • Below the strum indicators 1101 is a rhythm count 1103 in the specific form of a number to help the user keep the proper rhythm count. It should be appreciated that the rhythm count 1103 may take any suitable form.
  • a fret indicator 1104 may be used to indicate the correct finger placement (e.g., the correct fret number to depress). For example a “1” may indicate to the user to press on the first fret of the game controller (e.g., a guitar-shaped game controller), a “2” the second fret, and so on.
  • the fret indicator 1104 on the interactive visual display 1100 may be have a visual cue (e.g., color and/or number coded) that matches corresponding visual indicators 800 on the neck 124 of the apparatus 100 , as shown for example in FIG. 8A , or may be coded in any suitable manner.
  • the interactive visual display 1100 which again is one non-limiting example of a suitable interactive display, also includes a score indicator 1105 that provides the user with feedback about how well the user did in correctly performing the visual cues illustrated on the display.
  • Such feedback can be provided in any suitable way. For example, a user may get a point for each strum correctly executed, lose one or more points for incorrect or missed strums, receive bonus points for long, consecutive strings of successful strums without mistakes, etc.
  • Other feedback mechanisms are also possible (e.g., separately noting correct and incorrect strums) and the aspects of the invention described herein are not limited in this respect.
  • interactive visual display 1100 is merely one non-limiting example of an interactive visual display, and that many variations and modifications of the interactive visual display 1100 are possible.
  • the game or software application may require (or have a selectable mode of operation that requires) only correctly timed strumming, regardless of whether a correct fret is depressed by the user.
  • the fret indicator 1104 may not appear on the interactive visual display 1100 , and/or correct fingering may not be tracked and the user may only be required to strum the correct rhythm with open (non-fretted) or any fretted strings.
  • a chord-progression may be pre-programmed to automatically change the chords at the correct time with no extra input needed by the user so a user can play along with a song simply by properly striking the strings.
  • a similar approach may also be used for single-note melodies (solos, leads).
  • some embodiments may require only proper fingering, without string striking. In such a case, the strum indicators 1101 might not appear, might appear as simple lines without a directional up or down arrowhead, or might optionally appear with a direction indicator. To produce sound, the user would only need to finger the frets or strings with the correct timing. It should be appreciated that other ways of interacting with the user are also possible.
  • FIGS. 12 A-D show an example of another interactive display interface 1200 , which communicates strum timing.
  • a graphical representation of the strum area 1201 of the apparatus 100 is depicted.
  • the strum area 1201 includes the bridge, pickups, bottom of the neck and guitar strings, however it should be appreciated that any suitable area may be displayed.
  • Such an interactive display interface 1200 may be displayed all the time, or only when the concept of strumming is pertinent to game play. Therefore, fret fingering is not accounted for in this particular interactive display interface 1200 .
  • such an interactive display interface 1200 may be used for unfretted open strumming of the strings.
  • the interactive display interface 1200 may indicate that a user is supposed to strum when a falling pick icon 1202 passes over the strum area 1201 . It should be appreciated that FIGS. 12A-D are merely examples, and that other ways of indicating strum timing are possible.
  • FIG. 13 shows another non-limiting example of an interactive display interface 1300 similar to the one shown in FIG. 12 , but which communicates both strum timing and fret fingering information.
  • the pick icons 1302 may be coded to indicate fingering information, for example by adding color and/or number coding to the pick icons 1302 , or by using any other suitable indicator of fingering information.
  • a falling pick icon 1302 passing over the strum area 1301 may indicate that the user is to strum while simultaneously pressing the correct fret number.
  • FIGS. 14 A-D show another embodiment of an interactive display interface 1400 that communicates strum timing and fingering information.
  • a representation of the headstock and first several frets on the neck of the apparatus 100 are depicted on the display interface 1400 .
  • the fret tracks 1401 and/or the target frets 1403 may be coded using color and/or number coding, as shown, or using any other suitable type of coding (e.g., symbol coding, or any other suitable type of coding).
  • the pick icons 1402 travel along the fret tracks 1401 towards the target frets 1403 .
  • When a pick icon 1402 intersects with a target fret 1403 the user is supposed to strum while simultaneously pressing the correct corresponding fret on the neck of the guitar-type controller 100 .
  • FIGS. 15 A-C show another non-limiting example of an interactive display interface 1500 , which includes a time target area 1501 and a pick icon 1502 .
  • the user is supposed to strum the strings of the game controller when a sliding pick icon 1502 passes over the time target area 1501 .
  • the direction of the sliding pick icons 1502 may be left to right, right to left, top to bottom, bottom to top, or any other suitable direction.
  • Such an interactive display interface 1500 might be used all the time or only when the concept of strumming is pertinent to game play, and fingering is not accounted for in this particular interactive display interface 1500 .
  • such an interactive display interface 1500 may be used for unfretted open strumming of the strings of the game controller.
  • FIGS. 16 A-B show another non-limiting example of an interactive display interface 1600 similar to the one shown in FIG. 15 , but which communicates both strum timing and fingering information by adding color and/or number coding to the pick icons 1602 to communicate fretting information. It should, however, be appreciated that any type of coding may be used to convey fingering information, as color and number coding are but two non-limiting examples.
  • a sliding pick icon 1602 passes over the time target area 1601 , the user is to strum while simultaneously pressing the correct fret number.
  • the embodiments in FIGS. 16A-B show two different methods for the coding of the pick icons to convey fret information.
  • FIG. 16 A shows pick icons 1602 that are individually color and/or number coded.
  • 16 B shows the use of groups of like pick icons 1602 that are color and/or number coded together. It should be appreciated that other manners of coding the pick icons are also possible, and that the display interfaces described herein are not limited to use with any particular type of coding.
  • FIG. 17 shows one non-limiting example of various logical steps in the flow of a game that can be controlled using a stringed controller according to any of the embodiments described herein. It should be appreciated that the steps may vary depending on the game, and that the various aspects described herein relating to playing of a game are not limited to any particular type(s) of steps, number, or order of steps.
  • FIG. 17 is a flowchart illustrating an example of the order of steps of game play flow of a game which may be played using a stringed controller according to any of the embodiments described herein.
  • the game flow begins at the main menu, step 1701 , which may allow a user, at 1702 , to choose a mode of play or to alter game options.
  • the user is taken to a selection screen, step 1703 , where he or she may choose, at 1704 , a level (e.g., impacting degree of difficulty), location, music selection, or any other selection information.
  • a level e.g., impacting degree of difficulty
  • the game interface produces a series of rhythm events, step 1706 , such as the correct timing of a strum and/or fret press. Many of these events in a row constitute the beat matching play of an entire song. For each event, the game tests whether or not the user accurately strummed and/or fretted for that event, step 1707 . If so, a score is awarded and the instrument audio track remains audible. If not, the user is awarded no score, or there may be a score penalty, and the guitar audio track may continue or become inaudible for the duration of that event.
  • step 1708 When all events are finished (i.e., when the song is over), the final score is displayed, step 1708 , and a story scene, or cinematic, may occur, in the form of one or more transitional visual sequences which advances the game's story.
  • the user is then returned to the location/level/music selection screen, step 1709 , where they are prompted to choose another location, level and music selection for the next section of the game.
  • the types, number and order of steps illustrated in FIG. 17 are merely a non-limiting example, and that other possibilities for the flow of a game or program are also possible.
  • a stringed game controller such as those discussed above, may be useful for other types of game play applications besides beat matching.
  • an application may employ specific defined melodic patterns (e.g., guitar licks) to control the game.
  • fretting and strumming fret “1” followed by fretting and strumming fret “2” is a melodic pattern that may be defined as “1, 2.”
  • a gaming application may require specific melodic patterns that have a specific utilization and application according to the rules of the game. For example, the user may be taught the melodic pattern “1, 2, 3,” and then be informed that providing this melodic pattern in front of a closed door in the game will open that door.
  • any sound such as a specific musical note or a sound effect, may be played for each performed note of the pattern.
  • the melodic pattern may or may not need to be played with a specific rhythm and timing depending on the game play context and application of this concept.
  • Melodic patterns may contain two or more inputs, for example: “1, 2”; “3, 2, 3, 4, 1, 2, 5, 3, 2, 1, 2, 3”, etc.
  • melodic patterns e.g., licks
  • melodic patterns may be given specific identifiers or names in the game play context to identify them and distinguish them to the user.
  • the door opener pattern described above may be named “Open Sesame” in the context of the game.
  • the user interactions that can control a gaming application are not limited to playing melodic patterns, and can include any desired manipulation of the strings on the controller.
  • some gaming applications may require specific manipulations of the stringed controller to cause specific actions in a game.
  • a specific manipulation may be any specific input or series of inputs that can be performed on the stringed controller and be detected by the gaming application. That is, there may be specific inputs or series of inputs that have a specific utilization and application according to the rules of the game. For example, the user may be taught that pressing any two frets simultaneously in front of a closed door in the game will open that door.
  • a gaming application may require fast, repeated strumming of the game controller's strings to fulfill a game objective.
  • the user may satisfy game play objectives by sustained, rapid strumming of the stringed controller.
  • the user's progress may be depicted by a bar or meter that fills as the user strums, until the goal is reached.
  • the bar or meter may decay (deplete) at a specific rate, so that to fill the meter the user must consistently strum more quickly than the decay rate until the goal is achieved.
  • a gaming application may also, or alternatively, require open unfretted strumming to produce a defined chord progression, as shown in FIG. 18 A.
  • the predetermined chord progression progresses by one beat, during which a chord progression may be aurally produced via software, as shown.
  • some gaming applications may require open picking in response to a defined melody, as shown in FIG. 18 B.
  • the predetermined melody progresses by one beat, during which the melody is produced aurally via software.
  • the stringed controller may be used to control games that do not have a musical instrument play along theme.
  • a stringed controller can be used to control any type of game and be adapted to work with or replace controllers conventionally used to control such games. If the game requires the player to simulate proper musical instrument operation (e.g., play chords) to control game operation, the user experience in playing the game may simultaneously provide valuable practice time in the playing of the instrument.
  • the stringed controller may be used to simulate musical improvisation.
  • specific notes and/or chords may be related to each finger position or fret, so that when the strings are fingered and/or struck by the user, the specific note and/or chord is produced aurally by the software.
  • the user can then be placed into a free mode of game play in which he or she is free to finger and strike/strum as desired with little or no game play rules or structure. The result is a simulation of musical improvisation, with or without background accompaniment music for the improvisation.
  • a stringed game controller such as apparatus 100 when used as a game controller, may be used to control a gaming avatar in two-dimensional or three-dimensional space.
  • fingering the strings (e.g., pressing a specific fret) of the game controller in particular ways may cause the avatar to walk forward, walk backwards, left, or right.
  • Other fingerings or strikes may cause the avatar to perform other actions, such as jumping, running, or any other action that makes sense in the context of the game play.
  • the controller also may be used to control a game camera view.
  • a specific fingering may cause the game camera to pan, zoom, rotate, pitch, yaw, swivel, or otherwise alter its state.
  • Other functions within the gaming application may also, or alternatively, be controlled by the game controller, as those listed are merely non-limiting examples.
  • the gaming or software application is configured to detect true chord fingerings (e.g., on the frets or otherwise) of the stringed controller. For example, a software application may ask the user to fret a D major chord and show the correct fingering. Then when frets number “2” and “3” are activated simultaneously, positive feedback may be given to the user in any suitable manner, e.g., audibly and/or visually, such as via the large check mark in FIG. 19 .
  • any suitable manner e.g., audibly and/or visually, such as via the large check mark in FIG. 19 .
  • various embodiments described herein may include producing timing and/or finger positioning signals using a stringed game controller.
  • information about the pitch of a string played is not produced, or is not sent to or detected by the gaming application.
  • a real-time pitch detection algorithm may be included in the application software, and may be used to determine a pitch produced by the stringed controller. Any suitable pitch detection algorithm may be used, as the embodiments described herein that employ pitch detection are not limited in this respect.
  • the pitch produced by the stringed controller may then be compared to a target pitch in the context of a game or other application. For example, pitch detection may be used in the context of beat matching game play or other type of game play, or in any other suitable application.
  • Embodiments of the present invention may also include a computer software application having an instrument (e.g., a guitar) training mode that trains the user to play a song or portion of a song on an instrument, using audio and visual feedback including an interactive display interface which may be similar to those discussed above.
  • an instrument e.g., a guitar
  • operation may optionally start by only requiring strumming without a “play-by-numbers fret indicator” appearing on the interactive display interface, and the player would only be required to strum the correct rhythm with open (non-fretted) strings.
  • a chord progression may be pre-programmed into the computer software application so that the chord sounds would indeed be changing, but with no extra input needed by the user.
  • the same method may also be used for single-note melodies such as solos and leads.
  • a training mode of operation could start by only requiring fret fingering with the strum indicators appearing as lines with no directional up or down arrow.
  • some embodiments of the present invention are directed to a stringed game controller having a controller output module for detecting, processing, and outputting signals from the game controller either directly or indirectly (e.g., via any other suitable device) to a computer or gaming console executing a software application to be controlled by the controller.
  • the controller output module need not be integrated into the same apparatus as the strings and supporting body of the stringed game controller.
  • a stringed game controller 100 a may be provided that includes a controller output housed separately from the strings and their supporting body and coupled in any way (e.g., wired and/or wireless connection).
  • the controller output module may be housed in a box 2302 separate from the guitar body and strings, and may include any of the functionality discussed above in connection with the controller output module (e.g., as discussed in connection with the controller output module 710 in FIG. 7 ).
  • additional controls e.g., a joystick 185 , sync button 186 , etc.
  • the box 2302 may be detachably mounted to the guitar body 128 , or may be a distinct box. Outputs from the strings 120 can be provided to the controller output module in the box 2302 in any suitable way, including using any of the techniques discussed above.
  • output signals from pickup 140 may be provided to the box 2302 by a suitable connection 2304 (wired or wireless), such as an output cable, or any other suitable connection.
  • a suitable connection 2304 wireless or wireless
  • one or more of the frets 130 may be electrically connected to the box 2302 by a suitable connection 2306 , which may be configured to send a signal to the box 2302 when a string 120 contacts a fret 130 . It should be appreciated that these are non-limiting examples of ways in which the box 2302 may be coupled to the guitar-shaped structure of FIG. 23 to receive output signals from which one or more gaming input signals may be derived, and that other coupling configurations and types are possible.
  • the box 2302 can be formed as part of a kit or adapter that can adapt or retrofit any musical instrument (e.g., any guitar) into a stringed game controller so that the owner of an instrument may obtain an adapter and use his/her instrument as a game controller.
  • any musical instrument e.g., any guitar
  • an acoustic-electric instrument e.g., an acoustic-electric guitar
  • the pickup of the acoustic-electric instrument may be coupled to the box 2302 in the manner shown by connection 2304 of FIG.
  • one or more of the frets of the instrument may be coupled to the box 2302 to detect when one or more of the strings 120 contact the fret(s), using a suitable connection (e.g., connection 2306 , or any other suitable connection).
  • a suitable connection e.g., connection 2306 , or any other suitable connection.
  • an alternate technique for detecting finger position may be employed (examples of which are discussed above).
  • a suitable pickup may be added to the instrument (e.g., an off-the-shelf pickup as part of a converter kit including the box 2302 , or otherwise), and then the output of the pickup connected to box 2302 , by a connection such as 2304 .
  • a connection such as 2304 .
  • Other configurations are also possible.
  • various features of the technology described are application to electric instruments, acoustic-electric instruments, acoustic instruments, and non-instruments (e.g., dedicated game controllers), and are not limited in this respect.
  • fret sensors may be detachable from the frets 130 , and may be connected to box 2302 as part of an adapter kit for adapting a stringed instrument to work as a game controller.
  • Other configurations for fret sensors are also possible.
  • other techniques can also be employed for detecting finger positions on the neck of a fretted or non-fretted instrument, and any of those techniques may be made removable to allow an instrument to be adapted to function as a game controller.
  • the above-described embodiments of the present invention can be implemented in any of numerous ways.
  • the embodiments may be implemented using hardware, software or a combination thereof.
  • the software code can be executed on any suitable processor or collection of processors, whether provided in a single computer or distributed among multiple computers.
  • any component or collection of components that perform the functions described above can be generically considered as one or more controllers that control the above-discussed functions.
  • the one or more controllers can be implemented in numerous ways, such as with dedicated hardware, or with general purpose hardware (e.g., one or more processors) that is programmed using microcode or software to perform the functions recited above.
  • one implementation of the embodiments of the present invention comprises at least one computer-readable storage medium (e.g., a computer memory, a floppy disk, a compact disk, a tape, etc.) encoded with a computer program (i.e., a plurality of instructions), which, when executed on a processor, performs the above-discussed functions of the embodiments of the present invention.
  • the computer-readable storage medium can be transportable such that the program stored thereon can be loaded onto any computer resource to implement the aspects of the present invention discussed herein.
  • the reference to a computer program which, when executed, performs the above-discussed functions is not limited to an application program running on a host computer. Rather, the term computer program is used herein in a generic sense to reference any type of computer code (e.g., software or microcode) that can be employed to program a processor to implement the above-discussed aspects of the present invention.

Abstract

Stringed instruments, game controllers, and related structures and methods are described. A game controller having one or more strings is described for a computer gaming application. Output signals may be sent from the controller to the gaming application indicative of fingering of the game controller and the time at which the strings of the game controller are struck. Multi-mode apparatus are also described. A stringed apparatus may be used as both a game controller and an instrument. Bracing structures and methods are also described for bracing stringed apparatus, such as stringed game controllers and instruments.

Description

  • This application claims the benefit as a continuation under 35 U.S.C. §120 of U.S. patent application Ser. No. 12/359,237, filed on Jan. 23, 2009 under Attorney Docket No. S1705.70000US01 and entitled “Methods and Apparatus For Stringed Controllers and/or Instruments”, which in turn claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application Ser. No. 61/023,285, filed Jan. 24, 2008, and entitled “Guitar Controller,” both of which applications are incorporated herein by reference in their entireties.
  • This application also claims the benefit as a continuation under 35 U.S.C. §120 of U.S. patent application Ser. No. 12/359,242, filed on Jan. 23, 2009 under Attorney Docket No. 51705.70000US02 and entitled “Methods and Apparatus For Stringed Controllers and/or Instruments”, which in turn claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application Ser. No. 61/023,285, filed Jan. 24, 2008, and entitled “Guitar Controller,” both of which applications are incorporated herein by reference in their entireties.
  • FIELD
  • The technology described herein relates to stringed controllers and/or instruments.
  • BACKGROUND ART
  • Some popular computer gaming applications, such as the Guitar Hero® games, employ a special controller that has some similarities to an instrument (e.g., is generally guitar-shaped), but which differs significantly from an actual instrument. The controller for use with Guitar Hero® has no strings and instead has colored fret buttons and a strum bar. The controller provides two types of information to the gaming software, referred to herein as selection information and timing information. The selection information is provided by depressing the fret buttons, and the timing information is provided by toggling the strum bar. A series of icons, each corresponding to a color and position of one of the fret buttons, is displayed on the game screen as music is played. The player's goal is to hold down the fret button corresponding to the icon shown and toggle the strum bar at the same time that a note passes a marked area on the game screen.
  • SUMMARY
  • According to one aspect, a game controller comprises a body comprising a fingerboard, a plurality of strings extending along the fingerboard, at least one first sensor adapted to detect fingering of the fingerboard by a user of the game controller, at least one second sensor adapted to detect striking of at least one of the plurality of strings by the user of the game controller, and at least one control module that is coupled to the at least one first sensor and the at least one second sensor and that provides at least one electrical signal indicating the fingering of the fingerboard by the user and indicating the striking of at least one of the plurality of strings by the user.
  • According to another aspect, a method is provided. The method comprises (A) generating control signals for a computer game based on user interactions with a controller that comprises a body comprising a fingerboard, a plurality of strings extending along the fingerboard, at least one first sensor adapted to detect fingering of the fingerboard by a user of the game controller, and at least one second sensor adapted to detect striking of at least one of the plurality of strings by the user of the game controller. Generating the control signals comprises evaluating at least first and second distinct pieces of information relating to the user interactions, the first piece of information being indicative of fingering of the fingerboard by the user, and the second piece of information being indicative of the striking of at least one of the plurality of strings by the user.
  • According to another aspect, an adapter for adapting a musical instrument to enable the musical instrument to be used as a game controller is provided. The musical instrument comprises a body comprising a fingerboard and a plurality of strings extending along the fingerboard. The adapter comprises at least one first sensor adapted to detect fingering of the fingerboard by a user of the game controller, at least one second sensor adapted to detect striking of at least one of the plurality of strings by the user of the game controller, and at least one control module that is coupled to the at least one first sensor and the at least one second sensor and that provides at least one electrical signal indicating the fingering of the fingerboard by the user and indicating the striking of at least one of the plurality of strings by the user.
  • According to another aspect, a method of adapting a musical instrument to enable the musical instrument to be used as a game controller is provided. The musical instrument comprises a body comprising a fingerboard and a plurality of strings extending along the fingerboard. The method comprises: (A) positioning at least one first sensor on the fingerboard to detect fingering of the fingerboard by a user of the game controller; (B) providing at least one second sensor to detect striking of at least one of the plurality of strings by the user of the game controller; and (C) providing at least one electrical signal to a game, the at least one electrical signal indicating the fingering of the fingerboard by the user and indicating the striking of at least one of the plurality of strings by the user.
  • According to another aspect, a method for use with a stringed game controller that comprises a body, a plurality of strings extending along at least a portion of the body, and at least one sensor adapted to detect movement of the strings is provided. The method comprises acts of: (A) in response to a strike of at least one of the plurality of strings by a user of the game controller that causes vibration of the at least one of the plurality of strings, dampening the vibration to facilitate detection of a subsequent strike of the at least one of the plurality of strings; and (B) producing at least one game control signal based on the strike of the at least one of the plurality of strings.
  • According to another aspect, a stringed game controller comprises a body, a plurality of strings extending along at least a portion of the body, at least one sensor adapted to detect movement of at least one of the plurality of strings that results from a strike of the at least one of the plurality of strings by a user of the game controller that causes vibration of the at least one of the plurality of strings, and a dampener that dampens the vibration of the at least one of the plurality of strings to facilitate detection of a subsequent strike of at least one of the plurality of strings. The stringed game controller further comprises at least one control module that is coupled to the at least one sensor and that provides at least one electrical signal indicating the striking of at least one of the plurality of strings by the user.
  • According to another aspect, an apparatus comprises a body comprising a fingerboard, and a plurality of strings suspended between a first contact point and a second contact point and each having at least a portion extending along at least a portion of the fingerboard, wherein the portion of each of the plurality of strings extending between the first and second contact points vibrates when the string is struck while no portion thereof is in contact with the fingerboard, and wherein the portion of each of the plurality of strings extending along the at least a portion of the fingerboard is displaceable to bring the string into contact with the fingerboard and thereby adjust a length of the portion of the string that vibrates when the string is struck. The apparatus further comprises a brace coupled to the body and configured to resist forces exerted on the body by the plurality of strings and to maintain the first contact point and second contact point in a substantially fixed relationship to each other
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows an apparatus that may operate as both a game controller and an instrument, according to one embodiment of the present invention.
  • FIG. 2 shows one embodiment of a vibration dampening arrangement, according to one embodiment of the invention.
  • FIG. 3 shows another embodiment of a vibration dampener.
  • FIGS. 4 A-C show various aspects of fret detection arrangements according to embodiments of the present invention.
  • FIG. 5 shows details related to use of a brace according to an embodiment of the present invention.
  • FIGS. 6 A-C show structural details of a non-adjustable bridge for the apparatus of FIG. 1, according to one embodiment of the invention.
  • FIG. 7 shows a controller output module according to one embodiment of the present invention.
  • FIGS. 8 A-B show color and number coding of the neck frets on the apparatus of FIG. 1, according to one embodiment of the invention.
  • FIG. 9 shows the state arrangement of a strum detector module, according to one embodiment of the invention.
  • FIG. 10 shows an example of a filtered signal envelope estimate over time for use in a strum detector, according to some embodiments.
  • FIG. 11 shows an interactive visual display according to one embodiment of the present invention.
  • FIGS. 12 A-D show an interactive visual display according to another embodiment of the present invention.
  • FIG. 13 shows an interactive visual display according to yet another embodiment of the present invention.
  • FIGS. 14 A-D show an interactive visual display according to a further embodiment of the present invention.
  • FIGS. 15 A-C show an interactive visual display according to another embodiment of the present invention.
  • FIGS. 16 A-B show an interactive visual display according to a further embodiment of the present invention.
  • FIG. 17 shows various logical steps in a game flow according to one embodiment of the present invention.
  • FIGS. 18 A-B illustrate various strumming and picking aspects of embodiments of the present invention.
  • FIG. 19 shows an interactive visual display according to another embodiment of the present invention.
  • FIG. 20 illustrates an example of a configuration which may be used to provide electromechanical damping of strings, according to one embodiment.
  • FIG. 21 illustrates an example of a circuit which may be used to alter the decay time of a signal representing a string vibration, to facilitate detection of discrete strum events, according to one embodiment.
  • FIG. 22 illustrates a stringed game controller coupled to a processor for operating a gaming application, according to one embodiment.
  • FIG. 23 illustrates an embodiment of the invention directed to an adapter that may be used to employ a stringed instrument as a stringed game controller.
  • DETAILED DESCRIPTION
  • Applicants have appreciated that conventional guitar-shaped game controllers, such as those described above, differ from actual guitars in many ways, including in their lack of strings. Thus, such conventional game controllers do not provide the user with a realistic experience of playing an instrument.
  • According to one aspect of the technology described herein, a stringed controller for games, such as video games, is provided. In some detailed embodiments described below, the stringed controller resembles a guitar, but the aspects of the present invention described herein are not limited in this respect, and can be used with other fretted (e.g., a bass guitar) or unfretted (e.g., a violin or cello) instruments.
  • The stringed controller can be used for any type of gaming application, as the aspects of the invention described herein are not limited in this respect. In some embodiments, the stringed controller can be used with a play-along game, similar to Guitar Hero®, but provide a more realistic user/player experience. In other embodiments, the stringed controller can be used to control action in any type of game, and replace any existing controller, so that playing games can give the player experience with the instrument (e.g., in fingering the frets and strumming the strings of a guitar). In yet further embodiments, the stringed controller can be used to control a game specifically designed to teach the player how to play the instrument.
  • In some embodiments, the controller may be configured to provide output signals to a game (i.e., to a gaming application executing on a computer or gaming console), allowing a user to interact with the game. The output signals produced by the controller may represent any suitable information for interacting with the gaming application, such as indicating placement of a user's hands on the controller (e.g., fret placement on a fretted controller) as well as the timing at which one or more of the strings of the controller is played. The controller in some embodiments may further optionally include one or more components, such as user inputs (e.g., knobs, buttons, dials, or any other inputs), making it compatible with any of a variety of gaming systems (e.g., personal computers or a module for any gaming platform), as the various aspects relating to a stringed controller are not limited in this respect.
  • According to some aspects of the technology described herein, a stringed game controller may produce one or more output signals derived from different parts of the controller, or derived from different user interactions with the controller. For example, vibration of the strings of the stringed controller may be used to produce an output signal representing timing information (e.g., the time at which each string is initially played), or any other suitable timing information. A second type of information, such as information indicative of the positioning of a user's hand on the stringed controller (e.g., the fret position on a fretted controller), may be derived irrespective of whether the string is vibrating. Other types of information may also be provided, as the various aspects described herein are not limited to stringed controllers producing any particular types of output signals.
  • According to another aspect, a multi-mode apparatus is provided, which may function both as a stringed instrument (e.g., a guitar, a bass guitar, a violin, or any other stringed instrument) and as a game controller for a gaming application, such as a computer gaming application. When acting as an instrument, the apparatus may by played to produce musical notes, for example by plucking the strings and depressing a fret of a fretted instrument. In such a mode, the instrument may function in a conventional manner so that the output signal of the apparatus may be caused by the vibration of the string(s), which may be directly audible (for example, as with an acoustic instrument) or processed and amplified (e.g., as with an electric guitar), which output signal may therefore include tonal components reflecting movement of the strings and the length of the vibrating portion of the strings, i.e., pitch information. In this mode, the apparatus may be connected to a dedicated amplifier or to a computer or gaming system which may operate as an amplifier (e.g., a virtual amplifier), or may be directly played without connection to any external components, for example as in the case of an acoustic instrument. However, the various aspects described herein are not limited in this respect, as in the instrument mode the instrument may be used in any suitable manner, including in any of the ways instruments are conventionally employed.
  • When the multi-mode apparatus is operated as a game controller, the game application may derive any desired information from the user's interaction with the strings, but in some embodiments may not use any information about pitch or tone from the strings. As discussed above, in one embodiment separate information can be provided indicative of the positioning of the user's fingers on the fingerboard (e.g., fret position on a fretted device, which may be indicative of string length) and timing information from striking, or playing, a string (e.g., plucking, picking, or otherwise playing). To facilitate use of the strings for determining timing but not pitch information, the strings may be damped, for example to reduce or prevent vibration. A pickup may be used to detect movement of one or more strings of the apparatus, for example when struck by the user, and may generate a corresponding timing index component of a gaming input signal provided to the gaming software.
  • When the multi-mode apparatus is operated as a game controller, in some embodiments information about a user's hand positioning on the controller may be provided to the game in a manner other than by assessing tonal components of vibrations of the strings, i.e., other than by assessing the pitch of any vibrating string. For example, the apparatus may be fretted (e.g., a guitar), and one or more fret sensors may be used to detect contact of the strings with a fret. The fret sensor(s) may generate one or more components of a gaming input signal. Alternatively, the positioning of a user's hand may be determined using input buttons positioned on the instrument (e.g., on the fingerboard of the guitar), a pressure responsive material, or in any other suitable manner, as the aspects described herein are not limited in this respect.
  • As should be appreciated from the foregoing, according to one non-limiting embodiment, when the multi-mode apparatus is operated as a game controller, outputs of the controller may be generated that do not require detection of any string vibration tonal components. According to such embodiments, this may reduce or eliminate any need for the stringed controller to be in tune to properly function as a game controller. Rather, the strings of the apparatus may be used to derive timing information only, and the position of a user's hand may be determined by fret sensors, buttons, or in any other suitable manner. In some embodiments, the tonal components of the instrument/controller may be ignored entirely. However, all aspects of the invention are not limited in this respect, as the tonal output of the instrument/controller may optionally be used in some embodiments to provide an additional, or alternative, input.
  • According to one non-limiting embodiment, the apparatus may include a controller output module, which may process signals from the apparatus to determine one or more types of information from the user's interaction (e.g., timing information, hand positioning information, or any other type of information), and may then generate one or more controller output signals to be provided to the gaming application in any format recognized by the gaming application. Alternatively, raw signals indicative of the user's actions (e.g., representing timing and positioning information) may be provided to the gaming application, which may process the raw signals to determine desired types of information, such as timing and/or positioning information, or any other desired types of information. Other manners of signal processing are also possible, as the various aspects described herein relating to a game controller are not limited in this respect.
  • It should be appreciated that while some embodiments described herein relate to a multi-mode device, not all embodiments are limited in this respect. Rather, according to some embodiments, a stringed controller may be a dedicated stringed controller, and may not be an actual instrument.
  • Applicants have further appreciated that it may be desirable to provide a game controller and/or instrument from materials (e.g., plastic or other materials) which can not withstand the loading force imposed by strings (e.g., the devices may bend or break when subjected to the loading force of the strings, or may be unable to hold tune to a satisfactory degree). Thus, according to one aspect of the technology described herein, a stringed instrument and/or instrument-shaped stringed controller may include a brace. The instrument and/or controller may be formed of one of more components, such as a body, a neck, a fingerboard, or any other suitable components, one or more of which may be formed of material(s) unable to withstand the loading forces imposed by strings. The instrument, or instrument-shaped controller, may be formed of multiple pieces fastened together, or of a single piece of material. A brace may be provided to enable the instrument and/or controller to withstand the loading force of the strings, and may be made of any material suitable for bracing the instrument or instrument-shaped controller against the loading force of the strings. The brace may be made of metal, wood, plastic, or any other suitable bracing material, as the braces described herein are not limited to being formed of any particular material. The brace may prevent the stringed apparatus (e.g., instrument, or instrument-shaped controller) from breaking. In addition, in accordance with some embodiments discussed below, the brace may facilitate keeping the apparatus in tune with little or no adjustment.
  • The aspects mentioned above, as well as further aspects of the technology, are now described in further detail. It should be appreciated that the aspects of the technology described above and below may be used individually, all together, or in any combination of two or more, as the technology described is not limited in this respect.
  • As mentioned, according to one aspect of the technology described herein, a stringed game controller is provided. FIG. 1 shows an apparatus 100 according to one embodiment, which apparatus may be used as a game controller for interfacing with a game, such as, but not limited to, a video game. While the apparatus 100 resembles a guitar, it should be appreciated that such a shape and structure is non-limiting, as stringed game controllers implementing one or more of the features described herein may be shaped similarly to bass guitars, violins, cellos, or any other stringed instruments.
  • The apparatus 100 comprises one or more strings 120 extending from the head 122 over the nut 123, along the neck 124 and fingerboard 125, over one or more pickups 140, to the bridge 126 on the guitar body 128. In one embodiment, there are six strings 120, but not all embodiments are limited in this respect, as any number of strings can be employed. According to some embodiments, the strings 120 produce electromagnetically detectable signals, and therefore may be made of an electrically conductive material, such as being steel guitar strings, nickel-wound strings, or may be formed of any other suitable string material, including materials not conventionally employed for guitar strings. The strings 120 may be light gauge strings, heavy gauge strings, or have any suitable gauge, as the stringed apparatus described herein are not limited to use with any particular string gauge. Depending on the length, diameter and mass of a given string 120, when it is struck (e.g., picked, plucked, strummed, or otherwise struck), the string 120 may vibrate with a harmonic tonal component corresponding to a musical note. Pushing a string 120 down onto one of the fingerboard frets 130 on the neck 124 changes its vibrational length, thereby changing the corresponding musical note associated with the string.
  • According to one embodiment, the apparatus 100 includes a guitar body 128 with at least one guitar pickup 140. The guitar pickup 140 may detect movement of one or more of the strings 120, and may generate an electrical signal, such as a voltage, in response to detecting such movement. In one embodiment, the pickup 140 may be a magnet surrounded by wires that detects movement of the strings 120 and produces a corresponding voltage output signal, but the aspects of the invention described herein are not limited in this respect, as the pickup 140 may be anything capable of detecting movement of the strings 120. For example, the guitar pickup 140 may be a double coil pickup assembly from a guitar pickup vendor having a plastic ring and shell cover, Humbucker bobbin, ceramic magnet, and pole piece assembly, or any other suitable structure. The guitar pickup 140 may be inserted from above and secured with screws to the guitar body 128, or may be connected to the apparatus 100 in any other suitable manner.
  • As described, in some embodiments the apparatus 100 may be a dedicated stringed game controller, i.e., that is not used in any mode as an instrument. According to other embodiments, the apparatus 100 may be a multi-mode apparatus operable both as a computer gaming input device (i.e., a game controller) and as an instrument (e.g., an electric guitar in the embodiment of FIG. 1). For use as an electric guitar, the guitar body 128 may include a standard quarter-inch stereo audio jack 150 for communicating the output signal from the guitar pickup 140 to an external audio amplifier (e.g., via an audio cable), or to any other suitable device. The audio amplifier may be a designated amplifier, such as a conventional guitar amplifier, a computer, or a gaming system operable as a virtual amplifier, or may be any other suitable amplifier, as the type of amplifier is non-limiting. When the apparatus 100 is operated as an instrument, the output signal from the guitar pickup 140 may be a conventional electric guitar output signal which contains string vibration tonal components representative of harmonic vibration of the strings 120, and the output signal may be adjusted by a volume control 152 and a tone control 154.
  • Whether the apparatus 100 is a dedicated game controller or a multi-mode apparatus capable of operating as a game controller, it may comprise one or more components and/or signal processing circuitry facilitating its operation as a game controller. For example, according to one embodiment, the apparatus 100 may provide one or more output signals (or one or more components of a single output signal) when operating as a game controller, which output signal(s) may provide one or more types of information for interacting with a gaming application. The apparatus may therefore include one or more components and/or signal processing circuitry suitable to produce such output signals.
  • With regard to the non-limiting example of FIG. 1, one type of signal produced by the apparatus 100 when operated as a game controller may represent the positioning of a user's hand, finger, or fingers, on the fingerboard 125. For example, the apparatus 100 may be a fretted apparatus, as shown in FIG. 1, and one type of signal produced by the apparatus when used as a game controller may indicate a fret position of a user's hand, although similar signals may be generated for non-fretted controllers. Such a signal indicating the position of a user's hand on the game controller may be generated in any suitable manner, as the various aspects relating to stringed game controllers are not limited in this respect. In addition, it should be appreciated that a signal indicative of a user's hand positioning on the game controller is merely one non-limiting example of a type of signal which may be generated.
  • One manner in which a signal indicative of fret position may be determined is now described. However, it should be understood that other manners of such determination are possible, and that the following example is merely provided for purposes of illustration. For example, according to one non-limiting embodiment, the controller includes one or more fret sensors for detecting contact between the frets and one or more of the strings 120 to generate signals indicative of finger position that may be provided as an output signal (or portion thereof) which may serve as an input signal to a gaming application. FIGS. 4A-4C, described below, provide one non-limiting example of how fret position of the apparatus 100 may be detected. It should, however, be appreciated that any suitable technique for detecting fret position may be used, as the technology described herein is not limited to use with any particular technique of fret detection. Moreover, fret positioning detection is only one non-limiting example of an output signal which may be produced by a stringed game controller. For example, some stringed game controllers may not have frets (e.g., a game controller shaped as a violin), and the position of a user's hand on the controller may be detected using a pressure sensitive material, a resistive material on a fingerboard of the stringed game controller, or using any other suitable technique.
  • With regard to FIG. 1, a second type of signal (or component of a signal) produced by the apparatus 100 and provided as a gaming input to a gaming application may be a signal conveying timing information. For example, when the apparatus 100 is operated as a game controller, striking one or more of the strings 120 (e.g., plucking, picking, strumming, or otherwise striking) may generate a signal representing timing information. In some embodiments, the game controller may generate a separate output for each string. In other embodiments, only one output may be generated when any string is struck, however not all embodiments are limited in this respect.
  • Applicants have appreciated that determining the timing at which one or more of the strings 120 is played may be facilitated by damping the strings 120, to reduce or prevent extended vibration of the strings (irrespective of whether the damping alters the pitch or tone of the string), thereby facilitating determination of when string movement is caused by a new strike as opposed to extended vibration. Therefore, according to one non-limiting embodiment, the strings 120 may be damped when the apparatus 100 is used as a game controller.
  • If the strings 120 are to be damped, any suitable manner of doing so may be used, as the technology described herein is not limited to damping the strings 120 in any particular manner. For example, according to the non-limiting embodiment of FIG. 1, the apparatus 100 includes a mechanical vibration dampener 170 having an engagement surface for damping the strings 120. For example, the engagement surface of the dampener 170 may partially contact the strings 120, encapsulate the strings 120, or have any other suitable relationship to the strings 120 for damping them. According to one embodiment for use with a controller that can also operate as an instrument, the vibration dampener 170 may be retractable or removable in any suitable manner (e.g., may be recessed into the guitar body 128) when the apparatus 100 is being used as an instrument, e.g., an electric guitar. When the apparatus 100 is operated in a gaming mode, the vibration dampener 170 may be positioned (e.g., raised up from the guitar body 128) so that the engagement surface contacts (e.g., encapsulates) the strings 120 to reduce or prevent their harmonic vibration. The output signals from the guitar pickup 140 may then lack string vibration tonal components representative of harmonic vibration and instead may be used to represent one or more timing index components of one or more input signals to a gaming application (i.e., the time at which the strings 120 are moved). It should be appreciated that the positioning and type of dampener 170 described is only one non-limiting example, and that other structures and techniques for damping the strings 120 may be used. Other examples of mechanical dampeners are described below in connection with FIGS. 2 and 3. In addition, in some embodiments, dampening may be performed by signal processing, either alone or working together with some type of mechanical and/or electromechanical dampener, as described below.
  • It should thus be appreciated from the above discussion that, according to one embodiment, a game controller may produce one or more output signals representing timing information and positioning (e.g., fret positioning) information from the user's interaction with the strings of the stringed game controller. In some embodiments, the strings are used solely for generating timing information, and no pitch information is detected. Thus, according to this embodiment, processing of an output signal generated by striking one or more of the strings may not entail analyzing frequency information from the string vibration (e.g., pitch information), but rather may simply analyze whether a particular string is vibrating or not (i.e., whether a string has been struck). Thus, latencies associated with pitch analysis may be avoided in the signal processing stages. Also, according to this non-limiting embodiment, because the vibration of strings is not analyzed for pitch information, the strings of the stringed game controller need not be in tune to use the game controller, which may facilitate use of the apparatus as a game controller by users who are unable to tune the strings with sufficient precision to generate the proper pitch. In this embodiment, the fret or finger positioning information may be generated separately from any vibration of the string(s), for example by detecting contact of a string with a fingerboard, with a fret, or in any other suitable manner. Alternatively, in some embodiments, the pitch of a string may be detected and analyzed.
  • The apparatus 100 may further comprise a controller output module for processing received signals (e.g., one or more signals including the finger position component from the fret sensors or otherwise, and one or more timing index components from the guitar pickup 140, according to one non-limiting embodiment) independently of any string vibration tonal component to generate one or more corresponding controller output signals to provide to the computer gaming application. The controller output module may be within the guitar body 128, as in FIG. 1 (which is why the controller is not visible in FIG. 1), may be part of a module distinct from the apparatus 100, may be disposed partially within and partially outside of the apparatus 100, or may be implemented in any other suitable manner. The controller output module may have any suitable structure for processing the gaming input signals, one non-limiting example of which is shown and described below in connection with FIG. 7. The controller output signal in gaming mode may be output through the audio jack 150, or there may be one or more special game controller output ports such as a USB port 160, a wireless communications link through an antenna (e.g., using a protocol such as Bluetooth and a 2.4 GHz RF module or other wireless technology), or any other suitable arrangement. When configured with a wireless communications link, it may operate up to a 30 ft. range and still meet a 40 hour battery life specification, or may have any other suitable operating range and battery life, as the aspects described herein as relating to game controllers are not limited in this respect.
  • As mentioned, according to one aspect of the technology described herein, the strings of a stringed game controller may be damped to reduce or eliminate their vibration after being struck (e.g., plucked, picked, strummed, or otherwise struck). The damping of the string vibration signal can be accomplished by applying mechanical and/or electro-mechanical damping directly to the strings, by signal processing of the electrical signal from the pickup, by some combination of these techniques, or in any other suitable manner. According to one embodiment, the damping may be performed to facilitate use of the strings to provide a timing signal.
  • When mechanical damping alone is used, it may be desirable that any vibration of the strings be damped by a sufficient amount to facilitate detection of distinct strikes on the strings generated by a user. A user typically may play, or strike, the strings in the frequency range of 1-5 Hertz (Hz) (e.g., 1-5 strums per second) when playing a song, and the aspects of the invention described herein can be used with applications in which the user may strike the strings at that pace, a slower pace, or even faster. In some embodiments, the vibrations may be damped to exhibit a suitable amount of decay (also referred to as attenuation) to facilitate detection of distinct string strikes in a time less than the expected period between string strikes. For example, for some gaming applications it may be expected that a user will strum the strings of a stringed controller at a rate of approximately one strum per second (i.e., 1 Hz). Thus, according to some embodiments, the strings of a stringed game controller may be damped to ensure that any vibration of the strings is sufficiently attenuated in less than approximately one second to distinguish between ongoing vibration of the string from the initial strike and a subsequent string strike. According to some embodiments, a sufficient amount of attenuation may be on the order of 50% or more attenuation of the initial string vibration, approximately 60% attenuation, approximately 70% attenuation, approximately 80% attenuation, approximately 88% attenuation, approximately 90% attenuation, or approximately 95% attenuation. However, it should be appreciated that the various aspects relating to damping described herein are not limited to providing any particular amount of attenuation.
  • Furthermore, while a non-limiting example of an expected play rate is one strum/strike per second, it should be appreciated that other play rates may also be used, for example, as mentioned play rates of 1-5 Hz may be expected, or any other suitable play rate. Thus, according to some embodiments, a sufficient amount of damping (so as to achieve any of the amounts of attenuation listed above, or any other suitable amount) may be applied to distinguish between distinct string strikes in a time of less than approximately one second to less than approximately two tenths of a second (i.e., the time between strikes for play rates of 1-5 Hz). Moreover, according to some embodiments, a sufficient amount of damping may be applied to attenuate the vibration of a string by a sufficient amount (e.g., any of those amounts previously listed) in less than approximately half of the time period between expected string strikes (i.e., in less than approximately 0.1 seconds for a play rate of 5 Hz), in less than approximately one third of the time period between expected string strikes (i.e., in less than approximately 0.07 seconds for a play rate of 5 Hz), in less than approximately one quarter of the time between expected string strikes (i.e., in less than approximately 0.05 seconds for a play rate of approximately 5 Hz), or in less than any other suitable time. According to some embodiments, the strings of a stringed controller are damped to reduce any initial vibrations therein by approximately 90% or more (e.g., by approximately 98% in some embodiments) in approximately 25 milliseconds or less (e.g., one quarter of the time period between expected string strikes at a rate of approximately 10 Hz), however it should be appreciated that not all embodiments are limited in this respect.
  • FIG. 2 shows specific details of one specific embodiment of a mechanical vibration dampener 200 which may be used to damp strings on a stringed game controller, such as the apparatus 100. For purposes of explanation, the operation of the dampener 200 will be described in connection with the apparatus 100 of FIG. 1. However, it should be appreciated that the dampener 200 (or one like it but modified, e.g., to handle a different number of strings) may be applicable to other stringed game controllers.
  • The dampener 200 includes an engagement surface 201 that may encapsulate the strings 120 to reduce or prevent harmonic vibration, for example to reduce or eliminate vibration from a strike in any of the time periods listed above (e.g., in less than approximately 1 second, less than approximately 0.1 seconds, less than approximately 25 milliseconds, or within any other suitable time). In the example shown, the engagement surface 201 has six string slots 202 which each receive one of the strings 120 when the vibration dampener 200 is raised into operating position for gaming mode. The engagement surface 201 may be a foam piece (e.g., Poron®, or any other suitable material for providing a desired amount of damping within a desired time. The length, L, of the engagement surface slot 202 may be long enough to ensure sufficient dampening of the strings 120. For example, the slot may be one inch or more in length in the direction along the strings 120, or may have any suitable length. The decay time constant of string vibration corresponds to the amount of time it takes for the string vibrations to dissipate and the vibration dampener 200 may reduce the decay time constant relative to an undampened string to as close to zero as practical (given mechanical and other constraints), to any of the other time periods listed above, or to any other suitable time period. For example, a foam piece with a slot at least an inch long may dampen the decay time constant of string vibration to less than 25 milliseconds. However, in other embodiments, a dampener may be employed that dampens less efficiently but is still effective to facilitate the detection of distinct string strikes.
  • In one embodiment, the engagement surface 201 may be easily replaceable and may be friction fit into an outer shell 204 (which may be formed of plastic or some other materials). Thus, according to one embodiment a user may select one of various options of materials for the engagement surface 201, where the different options have different characteristics (e.g., stiffness), and may switch between materials by removing one type and friction fitting a replacement into the outer shell 204. However, other constructions are possible. For example, the engagement surface may be not be fit into any outer shell in some embodiments, but rather may be formed and mounted in any suitable manner to perform its damping function In some embodiments, the vibration dampener 200 may include a dampening control mechanism, allowing it to be raised and lowered around the strings 120. For example, the dampener 200 may be raised around the strings 120 when the apparatus is used in game mode (i.e., as a game controller), and may be lowered from the strings 120 if, and when, the apparatus 100 is used in a guitar mode (i.e., as an instrument). The dampener 200 may be raised and lowered by squeezing two control ends 203 with thumb and forefinger, and may include a locking mechanism to secure it in correct position in accordance with one embodiment, but other arrangements are possible.
  • FIG. 3 shows another non-limiting embodiment of a vibration dampener 300. The dampener 300 includes a neck strap arrangement, in that it includes a flexible strap 320 made of a material, such as cotton, rubber, plastic, or any other suitable material, which stretches in a longitudinal direction, and which may wrap around the guitar neck 124 to mechanically couple a vibration dampening material, described below, around the neck. Flexible strap 320 may include a fastening material 330 (such as Velcro® or other fastening material) on the ends to facilitate fastening, or may include any other suitable fastening mechanism. Engagement surface 310, which may be coupled to the flexible strap 320 in any suitable removable or fixed manner (e.g., by gluing, sewing, or in any other suitable manner) may engage the strings 120 from above, and may be made of any suitable material (e.g., felt, rubber, or any other suitable material) for providing a desired amount of damping within a desired time (e.g., 70%, 80%, 85%, 90%, 95% or more attenuation in approximately 25 milliseconds or less or some other desired timeframe, depending on the rate at which users are expected to strike the strings). Additionally, in some embodiments, the engagement surface 310 may be formed of an electrically non-conductive material.
  • The vibration dampener 300 may be applied in any manner suitable for damping the strings 120 by the desired amount and within the desired time, but in some embodiments is not attached so tightly as to cause the strings 120 to contact the frets 130. Alternatively, a neck attaching vibration dampener 300 may be adapted to fit between the guitar strings 120 and the fingerboard 125 to engage the guitar strings 120 from below. For example, according to one embodiment, the dampener may include a piece of foam which is positioned between the fingerboard and the strings of the game controller, although other configurations are also possible. In some embodiments, the stiffness of the engagement surface 310 may be selected, for example from a plurality of options, to reduce the decay time constant of the string vibrations of the guitar strings 120. For example, the engagement surface 310 may be formed of a material removable from the flexible strap 320, so that a user may select one of various options of materials to use for the engagement surface 310, where the various options have differing degrees of stiffness. The vibration dampener 300 may be removed from the guitar neck 124 of apparatus 100 if the apparatus 100 is to be used as an instrument, e.g. as a guitar.
  • While FIGS. 2 and 3 illustrate two examples of dampeners which may be used with a stringed game controller to dampen the strings, it should be appreciated that other types and forms of dampeners may be used. For example, damping of the strings 120 may be performed electromechanically and/or though signal processing, or through any combination of the damping techniques described herein, as the various aspects relating to damping of strings of a game controller are not limited to use with any particular type of damping. Also, it should be appreciated that dampening may not be employed in embodiments in which the expected play rate (i.e., the expected frequency of string strikes) is sufficiently low that the vibrations of the strings would naturally attenuate by a sufficient amount to allow detection of distinct strikes, or in embodiments in which the processing of signals from the strings is sufficiently fast and/or accurate to distinguish between distinct string strikes without dampening.
  • FIG. 20 illustrates an example of a circuit which may apply electromechanical damping to one or more of the strings of a stringed game controller. The string 120 may be positioned proximate a pickup transducer 2002 and a force transducer 2004, each of which may be connected to ground (GND). The pickup transducer 2002 and force transducer 2004 may be coupled to each other via a negative feedback amplifier 2006, having a suitable gain of −A. Vibration of the string 120 may induce a voltage in the pickup transducer 2002, which is then amplified by the negative feedback amplifier 2006, and then applied to the force transducer 2004. The force transducer 2004 may then apply a restorative electromagnetic force to the string 120, damping the vibration of the string 120.
  • FIG. 21 illustrates an alternative damping technique, in which vibration of the string is not itself damped, but a signal produced in a pickup is. As shown, an envelope 2102 of a signal generated by a vibrating string (e.g., a signal output by pickup 140 of FIG. 1) is input to both a voltage controlled amplifier 2104 and an envelope follower 2106. The output 2108 of the envelope follower 2106 therefore follows the envelope 2102 of the input signal and functions as a gain control voltage for controlling the gain of the voltage controlled amplifier 2104. The output envelope 2110 of the voltage controlled amplifier may exhibit a shorter decay period than that of the envelope 2102, even though the vibration of the string itself may not be damped. The output envelope 2110 may therefore be used to detect strikes occurring closer together in time than could the envelope 2102. It should be appreciated that other methods of processing output signals from a pickup may also be used to shorten the decay time of the signal, and that the aspects described herein relating to damping string vibrations are not limited to using any particular method of damping.
  • As explained above, according to one embodiment, one type of output signal generated by a stringed game controller, which may be provided as an input to a gaming application, is a signal indicative of one or more fret positions of the user's fingers on the game controller. The fret position information may be detected in any suitable way. For example, referring to FIGS. 4A-C, a signal may be developed by making the frets 130 and the strings 120 of electrically conductive material, and connecting such electrically conductive frets 130 to a fret wiring ribbon 400 that runs under (or along, or within) the fingerboard 125. Such frets 130 may be made of any suitable electrically conductive material, such as steel (for example, 18% Nickel-Silver fret wire) or any other material with suitable electrical and mechanical properties. According to some embodiments, the frets 130 are made of a material that resists coloration and rust, although the various aspects relating to game controllers described herein are not limited in this respect.
  • The frets 130 may be securely attached to the fingerboard 125 by any suitable means such as individually by ultrasonic welding, and may be trimmed for size using snips or in any other manner. The fret wiring ribbon 400 may be, for example, a 20 gauge 6-position ribbon cable terminated in a PCB connector 402 that connects to the controller output module of a stringed controller or may be any other suitable connector. As shown in FIG. 4 C, from the fret wiring ribbon 400 an individual wire may be crimped to a vertical fret connector 401 (e.g., 0.1 pitch) for each of the first several frets, for example for the first five frets, or for any other number of frets. The fret wiring ribbon 400 may run within the guitar neck 124 alongside any internal structural components, such as a brace discussed below, or may be positioned in any other suitable manner, such as along the outside of the neck 124, or in any other suitable manner.
  • While one example of a gaming input signal representation of finger position along the neck of the controller is generated by detecting the contact of a string 120 to a fret 130, it should be appreciated that other techniques may be employed for detecting finger position along the neck of the controller. For example, part or all of the fingerboard 125 may be formed of a pressure sensitive material, such that an electrical signal may be generated when a particular area of the fingerboard is pressed by a string or a user's hand. The pressure sensitive material may comprise one or more sections, for example corresponding to frets or to each of the strings. Alternatively, a resistive material may be formed to define a single area or many areas (for example to correspond to frets) on the fingerboard 125, from which an electrical signal is generated when a string or finger is contacted to the fingerboard 125. These alternate techniques can be used for fretted or non-fretted controllers. Thus, it should be appreciated that the various aspects relating to stringed game controllers are not limited to generating an indication of a user's hand position in any particular manner, or for that matter to even generating an indication of a user's hand position.
  • As discussed above, stringed game controllers, such as the apparatus 100 in FIG. 1, may be used to provide inputs to a gaming application. The apparatus may therefore comprise one or more features making it compatible with the gaming application. For example, the apparatus 100 may include control features specifically for interaction with a computer (such as a personal computer or a Mac® from Apple®, Inc.), a gaming console (e.g., an Xbox 360® from Microsoft® Corporation, Playstation® from Sony®, PS3® from Sony®, a Wii® from Nintendo® or any other gaming console), or any other type of device with which the apparatus may want to communicate, either for gaming purposes, sound processing purposes, amplification purposes, learning purposes, or any other purpose.
  • In the non-limiting example of FIG. 1, the apparatus 100 comprises an analog joystick 185 that may be used in the normal manner of a computer game joystick (and which in some embodiments may alternatively be a digital joystick), and a sync button 186 for wireless synchronizing of the apparatus 100 to a game console (for example for multi-player games, or for any other purpose). According to one embodiment for use with multi-player applications, player indicator LEDs within the sync button 186 light up to indicate which player number the controller has been assigned (Player 1, Player 2, Player 3, or Player 4). While a joystick and a sync button are two non-limiting examples of the types of features which may be added to, or adapted on, a device to facilitate compatibility of the device with a gaming system, it should be appreciated that other types of features, such as dials, knobs, and direction buttons (e.g., 4 direction keypads and 8 direction keypads) may also be used, or any other suitable features.
  • The volume control 152 and tone control 154 may both be multi-function potentiometers with a center detent position or may be implemented in other ways. Their functionality may be specific to whether the apparatus 100 is in game mode (i.e., being used as a game controller) or guitar mode (i.e., being used as an instrument), which modes may in some embodiments be selected by a user from menu options of a gaming application visual display, or in any other suitable manner. In game mode, the volume control 152 may act as a select/back button that the player presses, for example, to highlight different menu options or to move backwards in a game menu system. Twisting the volume control 152 in game mode may have no effect. In guitar mode, the volume control 152 may be turned to act as a conventional volume control for the output signal from the guitar pickup 140, and pressing it may have no effect. The tone control 154 similarly controls the tone of the pickup output signal in guitar mode. In game mode, the tone control 154 may act as a pressable start switch to activate a game function, and turning the control has no effect.
  • The ways in which the instrument controls (e.g., the volume and tone knobs) can be adapted to control a game discussed above are just an example, as the instrument controls can be adapted to control a game in any suitable manner In addition, while some examples of features making apparatus 100 compatible with gaming applications have been described, it should be appreciated that such examples are non-limiting. Stringed game controllers according to aspects of the technology described herein may have any number and type of features (e.g., buttons, knobs, dials, ports, joysticks or any other features) making them compatible with any particular gaming application. The number, type, and functionality of such features may depend on the gaming application itself, e.g., the types of input signals the gaming application receives from a user to operate. Thus, the various aspects of stringed game controllers described herein are not limited to including any particular number, type, or function of features to be compatible with a gaming application.
  • As mentioned above, conventional instruments, such as guitars, are typically assembled from various wooden or composite material components which are connected together. Each component piece is individually strong and rigid. Various features of such a conventional guitar are adjustable so that the surfaces and angles of the neck, fretboard, frets, and pickup can be adjusted to be in correct relationship to the strings over time (e.g., as the materials expand or contract due to temperature and/or humidity, or other reasons). Typically, this is based on an adjustable bridge arrangement at the base of the guitar body where the strings terminate. By raising, lowering and tilting the different sections of the adjustable bridge, the strings can be correctly positioned over the other components.
  • As discussed above, Applicants have appreciated that it may be desirable to create instrument-shaped controllers out of material which cannot withstand the loading forces imposed by strings without bending to an unsatisfactory degree or breaking. For embodiments wherein the controller is a dual use device capable of use as an instrument, such devices, if they did not break entirely, may require frequent tuning or adjustment, and be unable to hold tune with sufficient precision to enable it to be used as an instrument. Applicants have appreciated that a brace (alternatively referred to herein as a stringer or support) may also or alternatively be used to support an instrument and/or an instrument-shaped game controller made of material(s) (e.g., lightweight plastics or other materials) that would not otherwise be sufficiently strong to withstand the loading force of strings. The brace structure may be in the form of a stiff metal bar structural member, or any other suitable bracing structure, that provides structural support for the device, for example as the backbone provides structural support in a human.
  • Applicants have appreciated that the amount of adjustment of a stringed instrument needed to maintain the instrument in tune and/or to maintain the strings at a proper positioning relative to the other components of the instrument may be reduced or eliminated by use of a brace. Thus, according to some embodiments of the technology described herein, a stringed instrument (which may optionally serve as a game controller) may be constructed as a substantially adjustment-free device which may be provided to the customer with the strings already correctly positioned and ready to use without the need for adjustments, such as bridge adjustments.
  • As should be appreciated from the foregoing, according to one aspect of the technology described herein, a stringed device comprises a brace connected between the two ends at which the strings of the device are fixed, to support the structure in withstanding the force of the strings and/or to minimize or eliminate alterations in the relationship between the ends of the strings. For example, in a guitar, the strings are typically fixed between the head or nut and the bridge. Therefore, according to one embodiment, a brace may be provided to support the guitar from the head or nut to the bridge, for example to maintain the strings in a proper position. In some embodiments, one end of the brace is connected to the nut, or the head of a guitar-shaped device, and a second end of the brace is connected to the bridge. The brace may be formed of any suitable bracing material for withstanding a loading force applied on the stringed device by strings, which, for example, may be approximately 150 pounds to 200 pounds for light gauge guitar strings, but which may vary depending on the string characteristics. The brace may be formed of metal, wood, plastic, or any other sufficiently strong material, and may take any suitable shape that, together with the material, provides the desired level of support. In this respect, the desired level of support may vary depending on the application. For example, when the apparatus is to be used solely as a game controller and is not intended to be used as an instrument, the level of support may be one to simply prevent the device from deforming or breaking, as keeping the device properly tuned may not be an issue when it is not intended to be played as an instrument. In addition, for embodiments wherein the apparatus is intended to be usable as an instrument, while desirable to provide a level of support to make the instrument adjustment-free, it is not necessary in all embodiments.
  • FIG. 5 shows one specific example of a brace 500 in the specific form of a solid bent steel bar which runs from the head end of a stringed device, such as guitar-shaped apparatus 100 of FIG. 1, down through the guitar body, and which provides structural support for the device. The brace 500 may provide the structural strength to withstand the loading force of the guitar strings, which may be around 250 pounds in some embodiments. While steel is used as the material for the brace 500 in one embodiment due to its combination of strength, availability, and low cost, it should be appreciated that any suitable bracing material may be used. In the embodiment shown, the neck head 501 is a separate steel stamping that is welded onto the neck end of the brace 500, and the neck 502 is a plastic part that is placed onto the brace 500 which allows the finger board 503 to snap in. However, the aspect of the invention relating to a brace is not limited to such a configuration, and it should be appreciated that the braces described herein for supporting stringed devices are not limited to any particular shapes, materials, methods of fabrication, or methods of attachment.
  • As discussed above, in some embodiments, with the use of a brace, such as brace 500 above, an adjustment-free stringed device, such as a guitar or guitar-shaped game controller, may be provided. For purposes of illustration, such a device is described in relation to a guitar, such as apparatus 100 in FIG. 1, though it should be appreciated that the concept of a substantially adjustment-free stringed device may apply to other types of stringed instruments, and/or instrument-shaped controllers. According to one embodiment, the device may include a non-adjustable bridge. The non-adjustable bridge may be implemented in any suitable manner, an example of which is the non-adjustable bridge 600 shown in FIGS. 6A-6C. The non-adjustable bridge may facilitate maintaining a non-adjustable correct relationship between the fingerboard and the strings. For example, the non-adjustable bridge 600 may terminate the body end of the strings 120 after they have passed over the guitar pickup 140. In this non-limiting embodiment, the bridge 600, which may be made of steel or any other suitable material, secures the ends of the strings 120 in anchor holes 601. In this embodiment, the bridge 600 includes mounting holes 603 for connecting the bridge 600 to the guitar body 128. The non-adjustable string slots 602 elevate the strings 120 to a desired or optimum height above the guitar pickup 140 and frets 130 Because of the unvarying rigid structure imparted to the instrument and/or controller (e.g., the apparatus 100) in this non-limiting embodiment by the brace 500, little or no user adjustments may be needed to the bridge 600, or any other components, to achieve satisfactory string placement. Thus, the device may be immediately ready for use when purchased and not require tuning by the user.
  • While some embodiments of the technology discussed herein related to an adjustment-free device can be used in connection with a dual mode instrument and game controller, it should be appreciated that these aspects of the technology described herein can be used with instruments that do not have any of the techniques described herein that enable their use as a game controller, and can be used with a dedicated instrument and/or with a dedicated game controller.
  • As mentioned above, a stringed game controller in accordance with some embodiments may include a controller output module for processing signals based on user interactions (e.g., signals generated when strings 120 contact the frets, signals from the pickup 140 based on string strikes, etc.) and providing such signals to a gaming application. FIG. 7 is a circuit diagram of one non-limiting example of a controller output module 710, which may be implemented, for example, by a digital processor running firmware, and/or any other suitable combination of hardware, firmware, and software, as the embodiments described herein relating to game controllers are not limited to use with any particular type of controller output module. According to some embodiments, the controller output module 710 may include any suitable processing device, such as a microcontroller and/or programmable logic (e.g., a field programmable gate array (FPGA)), or any other suitable processing device. As mentioned previously, the output module may be within the stringed controller (e.g., within the guitar body 128 of apparatus 100), or in any other suitable location.
  • In the embodiment shown in FIG. 7, each of input pins 702 a-702 f of the controller output module 710 is electrically connected to the respective frets 130 of the apparatus 100, and generates an input signal indicating that a fret is contacted by a string 120. The electrical connection may be direct as shown, or it may be via intermediary electronic devices, such as resistors, capacitors, transistors, or the like, or via non-wired media. The strings 120 are electrically connected to the ground pin 704 of the controller output module 710. When a string 120 contacts a guitar fret 130, a circuit to ground is closed and a small current (e.g., 5 mA or any other suitable current) runs to ground 704 through the string 120. The corresponding input pin 702 a-702 f connected to the fret 130 contacting the string 120 is therefore connected to ground, and the voltage on that input pin may therefore drop. The drop in voltage on the input pin may be detected by the controller output module 710, which may therefore generate a signal directly or indirectly resulting in a gaming input signal, which information may then be relayed to an external processor and/or external gaming application. As discussed above, the gaming input signal may be relayed through the USB port 160 (which in the non-limiting example of FIG. 7 is illustrated as having four signal lines, corresponding to a power supply line (VDD), a ground line (GND), a serial input line (SI), and a serial output line (SO)) or in any other suitable way. It should be appreciated that the form of USB port 160 shown is not limiting, and that signals from the controller output module 710 may also or alternatively be provided to an external device, such as a computer or gaming console, in ways other than using a USB port (e.g., using a PS/2 connector or in any other suitable manner). While FIG. 7 illustrates one circuit configuration by which connection of a string 120 to a fret 130 may be detected, it should be appreciated that other configurations are possible, and that the various features described herein relating to stringed game controllers are not limited in this respect. Also, in some embodiments, multiple signals can be generated for each fret (e.g. with one signal per string contacting a fret or one signal representing contact by any contribution of two or more strings).
  • Embodiments of the stringed game controller (e.g., apparatus 100 in FIG. 1) may incorporate a suitable scheme for providing indicia to the user for use in developing the component of the gaming input signal indicative of a user's hand position or fret position. For example, a visual clue may be provided (such as a color coding scheme, a number coding scheme, a symbolic coding scheme, an icon coding scheme, etc.), a tactile scheme may be employed, any combination thereof, or any other suitable type of scheme may be employed. The elements of the scheme (e.g. the numbers in a number coding scheme) may be positioned on, or incorporated with, any suitable part of the apparatus 100, such as on the frets 130, the fingerboard 125, the neck 124, or any other suitable part of the apparatus. For example, FIGS. 8A-B show that there may be color coding and/or numbering along the neck 124 and/or on the face of the fingerboard 125. In some embodiments, together with such a coding scheme, a user interface for the gaming application (e.g., a visual display screen) may use corresponding indicia (e.g., colors/numbers that directly match the indicia on the apparatus or are correlated in some manner) to communicate the inputs the user should be performing (e.g., strum timing and direction, string fingering, etc.).
  • The gaming input signal(s) from the apparatus 100, (e.g., from the frets 130, string strikes, etc.) may be updated to reflect user interaction in any suitable manner For example, in those embodiments in which one of the gaming input signals (or one of the components of a gaming input signal) reflects whether a string is contacting a fret, different monitoring schemes may be employed. For example, in one embodiment, the strings 120 are all connected to ground simultaneously and each fret 130 is connected to a corresponding input pin of the controller output module (e.g., input pins 702 a-702 f of the controller output module 710), so that whenever a string contacts a fret, a signal is generated on the corresponding input pin of the output module. In an alternative embodiment, one or more of the strings 120 are alternately grounded (i.e., alternately connected to ground 704) so that a signal is generated on the corresponding input pin of controller output module 710 only if a string is contacting a fret at the same time that the string is electrically grounded, effectively meaning the strings are individually monitored at different times. In this latter monitoring scenario, which string 120 is connected to ground may be alternated rapidly, or at any suitable rate, either sequentially or in any suitable order to poll the strings individually for signals thereon. It should also be appreciated that the two monitoring schemes described above for monitoring signals generated when a string contacts a fret are non-limiting, and that other monitoring schemes may be employed.
  • In another embodiment, one or more of the frets 130 may be sub-divided into a number of (e.g. six) spaced electrically isolated segments each corresponding to one of the strings 120. In such a configuration, each segment of the frets 130 may be configured to allow separate detection of when it is contacted by a string (as opposed to the fret generating a single signal when contacted by any string), for example by modifying the electrical connection scheme of FIGS. 4A-4C to add connections for each of the six segments of the frets of interest (e.g. by adding additional wiring ribbons), or in any other suitable manner. It should be appreciated that in this embodiment contact of specific individual strings with each fret 130 may be determined, which may be desirable in some applications where it is desired to increase the number of possible inputs from the user and/or to challenge the user to interact with the stringed controller in a manner more realistic to playing the corresponding instrument by detecting precisely which string contacts a fret. However, as discussed above, not all embodiments are limited in this respect and others need not differentiate between which strings contact a fret or are otherwise fingered by the user.
  • As mentioned above, in some embodiments, a stringed game controller may include interfaces or controls in addition to the strings for interfacing with a gaming application. As discussed above, examples of such interfaces or controls may include an analog joystick 185 and sync button 186 shown in FIG. 1, or any other suitable features (e.g., directional keypads, knobs, dials, or any other features). In some embodiments, the signals produced by the additional interfaces or controls may be processed by the same output control module that processes signals from the strings, but the embodiments of the invention described herein are not limited in this respect. The signals from any additional controls can be detected and processed in any suitable manner, as the aspects of the invention described herein are not limited in this respect.
  • As one example, as shown in FIG. 7, additional computer gaming application controls, for example in the form of a button (e.g. sync button 186) and a joystick (e.g., joystick 185), may be connected to the controller output module (e.g., controller output module 710). The sync button 186 is represented by a switch, and may be connected between ground and an input pin 706 b of the controller output module so that when activated the controller output module 710 detects a drop in voltage at input pin 706 b and relays information indicating that the control has been activated to an external processing device or external gaming application in any suitable manner (e.g. through the USB port 160). It should be appreciated that the three additional input pins 706 a, 706 c and 706 d are shown as being connected to switches 708 a, 708 b, and 708 c, which switches may correspond to additional controls on the game controller (e.g., apparatus 100) not shown in FIG. 1, but which may be included in some embodiments. The joystick 185 has been described as an analog joystick, and therefore may be implemented using two potentiometer tracks 712 a and 712 b, which may be connected to ADC input channels 714 a and 714 b of the controller output module 710, respectively. However, it should be appreciated that the joystick 185 may be implemented in any suitable manner, and may alternatively be a digital joystick suitably implemented. It should also be appreciated that other configurations for the computer gaming application controls are also possible, as any number (including zero) of additional interfaces or controls may be provided on a stringed controller according to some embodiments.
  • As previously explained, according to one embodiment, a stringed game controller (e.g., apparatus 100 in FIG. 1) may generate an output signal, or a component of an output signal (it should be appreciated that for purposes of this application separate components of a single signal may be considered to be separate signals, and vice versa), indicative of the timing at which strings are struck, which may be provided as a gaming input signal to a gaming application. This timing information can be generated based on user interaction with the stringed controller in any suitable manner. For example, according to one embodiment for use with the output module of FIG. 7 and the guitar shaped controller 100 of FIG. 1, to develop this timing index component of the gaming input signal, the controller output module 710 of FIG. 7 may include an internal analog to digital converter (ADC) module having an input pin 720 that is connected to sample the voltage across the guitar pickup 140. The ADC module may operate at a sampling rate of about 5 to 6 KHz, or at any other suitable sampling rate. The guitar pickup 140 may be a transducer that converts movement and vibrations in the strings 120 into a voltage signal across its terminals. For example, the pickup 140 may include one or more permanent magnets wrapped in one or more wire coils which possess an associated magnetic field. When the strings 120 move relative to the magnets of the pickup 140, they may change the magnetic field, which induces electric currents in the coil and a corresponding voltage across the terminals of the pickup 140, which may be sampled by the ADC module. The output signal of the ADC module may then be processed in any suitable manner, one example of which is described below in connection with a strum detector, to determine whether a string has been struck and thereby derive a signal indicative of the timing of string strikes.
  • As mentioned, some embodiments of a stringed game controller may include a dampener to dampen vibrations of the strings 120. When engaged, the vibration dampener may remove some or all of the frequency tonal components of the string vibrations and may greatly reduce the time constant of decay for those vibrations, thereby making it easier to detect string strikes. It should be appreciated that the timing index component of the gaming input signal may be developed in other manners (including from string controllers other than the guitar-shaped controller 100 of FIG. 1 and using a different output module from that shown in FIG. 7), and that the example described above is non-limiting.
  • In the non-limiting example of FIG. 7, the guitar pickup 140 is also connected to circuitry to enable the apparatus 100 to operate in a mode where it can be played as an instrument. This may be achieved in any suitable manner and the aspect of the invention that enables the stringed controller to also operate as an instrument is not limited in this respect. In one non-limiting example, the guitar pickup is connected in parallel with a tone control circuit 770 and a volume control circuit 780 when the output jack 150, which may be a standard ¼ inch phone jack or any other suitable connection, is connected to an external guitar amplifier. The volume control circuit 780 may be an adjustable voltage divider implemented with a potentiometer that may be manually adjusted by turning the volume control 152. Tone control circuit 770 may include a capacitor in series with a potentiometer with one terminal shorted to the middle terminal, allowing it to function as an adjustable resistor. The tone control circuit 770 may be in parallel with the volume control circuit 780 and may provide an alternate path to ground with an impedance that decreases with increasing frequency due to the capacitor, thereby operating as a low-pass filter by attenuating high frequency voltage signals from the guitar pickup 140 relative to low frequency signals. The cutoff frequency of this low-pass filter may be adjusted manually by turning the potentiometer, via tone control 154, to change the resistance in series with the capacitor, or may be adjusted in any other suitable manner. As mentioned above, the aspects of the invention are not limited to use with any particular type of volume control or tone control circuit, or even to use with a device that includes volume or tone controls.
  • It should be appreciated that input pin 720 presents a high input impedance, so that current flowing on the pin is small relative to current that flows through the tone control circuit 770 and volume control circuit 780 when the output jack 150 is connected. When the output jack 150 is disconnected, the tone control circuit 770 and volume control circuit 780 are open circuits, in which case the only electrical loading on the guitar pickup 140 is the input impedance of the ADC module.
  • As discussed above, according to some embodiments, user strikes of the strings 120 are detected via any suitable combination of hardware, software and/or firmware (e.g., via the controller output module 710). For example, according to one embodiment, the controller output module 710 includes an ADC module which receives an analog signal from pickup 140 and converts it to a digital signal. The controller output module 710 may then filter a resulting digital signal from the ADC module to detect user strikes of the controller strings (e.g., strings 120 in FIG. 1) as discrete events independently of string vibration tonal components. The digital signals from the ADC module may be low pass filtered to obtain an estimate of the envelope of the signal from the pickup 140. According to another embodiment, the output of the ADC module may be rectified by a full-wave rectifier and then filtered by a peak detection filter to create the envelope of the signal from the pickup 140. This envelope estimate may then be compared to different thresholds based on the current state of a strum detector module implemented in the controller output module 710, with different thresholds being used to determine when a strum has occurred. A vibration dampener, examples of which were previously described, may facilitate detection of such string movements as discrete timing index events, since reducing the decay time constant for string vibrations may facilitate resolving individual string strikes. The specific processing discussed above to detect string strikes is provided only as one non-limiting example, as other manners of identifying discrete string strikes and timing index events are also possible, and the embodiments of the invention described herein are not limited to using any particular technique.
  • Furthermore, it should be appreciated that various pickup scenarios may be employed. For example, a single pickup (e.g., pickup 140) may be used to detect string vibration from any of the strings of a stringed controller or instrument (e.g., strings 120 of apparatus 100). In such a scenario, the pickup may have a single output signal, such as shown in FIG. 7, and a single ADC channel may be used. The sampling rate of the ADC channel may be chosen to be higher than the highest expected string vibration frequency, or any other suitable value.
  • However, according to another embodiment, a pickup may be used to detect vibrations of individual strings, as opposed to detecting the vibration of any of the strings of the device. For example, referring to the apparatus 100 of FIG. 1, a 6-way pickup (referred to as a “hex” pickup) may be employed, such that detection of vibrations may be individually detected from any of the six strings 120 shown. In such a scenario, the controller output module (e.g., controller output module 710) may include an ADC channel for each of the pickup channels (i.e., six ADC channels in the example in which a 6-way pickup is used). In those embodiments in which multiple ADC channels are used, the multiple channels may be realized by multiple dedicated ADC hardware channels, by a single ADC with a multiplexer having an input for each output of the pickup (i.e., a multiplexer with six inputs in the example in which the pickup is a 6-way pickup), or in any other suitable manner, as the various aspects are not limited in this respect. Other types of pickups are also possible, and the various aspects relating to detecting vibrations of the strings of a stringed device are not limited to use with any particular pickup configuration.
  • The processing of signals from the pickup of a stringed game controller or instrument to detect discrete strikes of the strings may be accomplished in any suitable manner. According to some embodiments, a strum module may be employed to analyze the envelope of the output signal from the pickup, the envelope being created by filtering the output signal of the pickup, or in any other suitable manner. The strum module may include two or more states which may be used to identify when a strum is initiated, and when the vibrations from the strum are sufficiently attenuated to conclude that subsequent vibrations of the strings are due to a subsequent strum. It should be appreciated that while the term “strum” is used in this context, the applicability of the methodologies described is not limited to scenarios in which multiple strings of the instrument are played in a single upward or downward stroke, but rather may apply equally well to detecting strikes of individual strings. Thus, the terms “strum” and “strike” may be used interchangeably in this context.
  • FIG. 9 illustrates a non-limiting example of the different states of a strum detector module (e.g., implemented in the controller output module 710) according to one embodiment of the invention. In the embodiment of FIG. 9, a strum detector module has three states, including a strum high state, a strum low state, and a no strum state. In the no strum state 920, the strum detector module outputs a logic low signal (e.g., a logic “0”), and repeatedly compares the current estimate of the signal envelope of interest to a strum start threshold (SST). As described above, the signal of interest may be the signal from pickup 140, and the estimate of the signal envelope may be generated by low pass filtering the digital version of the signal from pickup 140, which digital version may be provided by the ADC module of the controller output module 710. However, other methods of developing the envelope are possible, and in some embodiments no envelope may be generated, as any suitable signal representing the output of the pickup 140 may be used. If the envelope (abbreviated as “env” in FIG. 9) is greater than the SST, the strum detector transitions to the strum high state 930, and outputs a logic high signal (e.g., a logic “1”). Otherwise, the strum detector remains in the no strum state 920. In the strum high state 930, the strum detector module repeatedly compares the estimate of the signal envelope to a strum end threshold (SET). If the envelope is greater than the SET, the strum detector module remains in the strum high state, and continues to output the logic high signal. Otherwise, the strum detector module transitions to a strum low state 940 and starts a counter (abbreviated as “ctr” in FIG. 9) to measure time elapsed in the strum low state 940. The strum module continues to output the logic high signal while in the strum low state.
  • While in the strum low state 940, the strum detector module repeatedly compares the estimate of the signal envelope to the SET. If the envelope is greater than the SET, the strum detector module transitions to the strum high state 930, and continues to output the logic high signal. Otherwise, the strum detector module compares the value stored in the counter to the strum hold time (SHT). If the counter value is greater than the SHT, the strum detector module transitions to the no strum state 920, and outputs a logic low signal. Otherwise, the strum detector module remains in the strum low state 940.
  • Information about the current state of the strum detector module may be transmitted to an external device or application via the communications port 160 at various times, or via any other suitable technique. For example, strum detector state information may be sent in response to a state transition. Alternatively or additionally strum detector state information may be sent periodically to an external device or application. Also, it should be appreciated that other manners of strum detection are possible, and that FIG. 9 merely provides one non-limiting example. For example, the number of strum states, and their significance (e.g., the significance of a transition between states) may be varied, as the embodiments described herein relating to detection of distinct strum/strike events is not limited to using any particular detection algorithm.
  • FIG. 10 shows an example of the application of the strum detector of FIG. 9 to a filtered signal envelope estimate 1002, for example as might be obtained by low pass filtering the output signal of the ADC module of controller output module 710. The output of the strum module is represented by logic output signal 1004. As shown, the strum module may begin in its no strum state, prior to time to. In this state, the logic output signal 1004 of the strum module is low, and the strum module may compare the value of the envelope estimate to the SST. The strum is first detected at time to when the envelope estimate 1002 first exceeds the SST, in response to which the strum module transitions to the strum high state, and its logic output signal 1004 goes high. In the strum high state, the strum module compares the value of the envelope estimate 1002 to the SET.
  • At time t1, the envelope estimate 1002 is less than the SET, and the strum module transitions to its strum low state, during which the logic output signal 1004 remains high. The counter is begun, and the end of the strum is detected at time t2 when the envelope estimate 1002 next remains below the SET for a duration longer than the SHT. Thus, at time t2 the strum module transitions to its no strum state and its logic output signal 1004 goes low.
  • As mentioned above, it should be appreciated that various algorithms may be used to detect the beginning and end of a strum/strike, and that the examples of FIGS. 9-10 are not limiting. Other algorithms may be employed.
  • According to one embodiment, the strum detection module may determine the timing index component of the gaming input signal as described above independently of the operation of any sensors (e.g., finger position or fret sensors) that determine one or more other components (e.g., fret position components) of the gaming input signal. Alternatively, the determination of both components of the gaming input signals may be related. For example, a fret sensor circuit may be configured to only send an update of the fret sensor state to an external processing device or application when a strum event is detected by the strum detector. This provides output signals that more realistically reflect the way a corresponding instrument operates, but not all embodiments are limited in this respect. In another example, the strum detector may be configured to adjust the SST, SET, or SHT in response to a detected change in the fret sensor state.
  • According to some embodiments, software running on an external processing device (e.g., a gaming console, a computer, etc.) may generate visual and/or audio signals based at least in part upon the user's interaction with the stringed controller (e.g., based at least partially on the strikes of the strings and the fingering of the strings). This system may be used for any number of purposes including for entertainment such as for computer gaming, for education such as to facilitate training of the user in the use of the stringed instrument (e.g., in the use of a guitar in the example of FIG. 1) or in any other way, as aspects of the invention are not limited in any respect by the manner in which a software program (e.g., a game) responds to input from a stringed controller. Examples of software applications for use with a stringed controller are described below, but it should be appreciated that the various aspects described herein are not limited to use with any particular software applications.
  • As has been mentioned, one aspect of the technology described herein relates to the use of stringed game controllers, for example in the shape of a guitar, bass guitar, violin, or other stringed instrument. Such game controllers may be configured to be coupled to an external device including a processor (e.g., a personal computer, a gaming console, or any other device including a processor) operating a gaming application or other software application that responds to inputs from the stringed controller. For example, referring to the non-limiting embodiment of FIG. 22, an external device 2202, which may be a computer, a gaming console, or any other type of device including one or more processors, runs a computer gaming application or other software application that responds to the input signals generated by the stringed game controller (e.g., the apparatus 100 of FIG. 1) in response to user actions. The external device 2202 may be coupled to the apparatus 100 by a communication link 2204 that may include a wired connector through a communication port, such as USB port 160 in FIG. 1, a wireless link or in any other suitable manner. The computer gaming (or other software) application may interact with the user via a visual display (e.g., on a screen 2206) and/or audio output through, for example, gaming system or computer speakers 2208, a television, or in any other suitable manner
  • According to some embodiments, the gaming application may be configured to produce Musical Instrument Digital Interface (MIDI) sounds (for example, via speakers 2208) corresponding to a plurality of instruments. In some embodiments, the user may be able to select the types of sounds produced from a MIDI instrument selector (e.g., guitar, tuba, trumpet, or any other instruments). Moreover, different MIDI instruments may be assigned (by a user or otherwise) to different frets of a fretted game controller, such that touching a string to a particular fret may result in the gaming application producing a sound corresponding to the instrument assigned to that fret. Similarly, sound effects may be assigned to frets (by user selection or otherwise) in some embodiments, such as reverb, delay, vibrato, pitch bending, or any other sound effect. Similarly, the gaming application may allow the user to assign particular chords to the frets, so that contacting a string to a particular fret may result in the gaming application sounding the chord assigned to that fret. It should thus be appreciated that according to various embodiments various effects (e.g., instrument type, note, sound effect, etc.) may be selected by a user (or otherwise assigned), and that the various aspects described herein are not limited in this respect.
  • Various examples of interfaces that a game or other software application may employ to interact with a user of a stringed controller will now be described. It should be appreciated that these examples are non-limiting, as the various aspects described herein relating to stringed game controllers are not limited to use with games or other software applications that use any particular type of user interfaces. For example, it should be appreciated that the stringed game controllers according to some aspects described herein may be compatible with any existing gaming applications, such as the Guitar Hero® games and others.
  • FIG. 11 shows an embodiment of an interactive visual display 1100 that provides user input directions to tell the user how and when to produce a gaming input signal. The interactive visual display 1100, which may be used in connection with a stringed game controller such as apparatus 100, communicates indications related to strum timing, fret fingering, and strum direction (e.g., up or down). A strum indicator 1101 (shown as an arrow in FIG. 11 but other visual cues can be used) indicates to the user when to strike the strings of the game controller with either an upward or downward stroke (e.g., by using a guitar pick or the user's fingers). When the user successfully strums at the correct time while pressing the correct fret (indicated by fret indicator 1104), a visual cue is provided to indicate this success to the user. This can be done in any suitable way. In one non-limiting example, the strum indicator 1101 changes to a “hit” color (e.g., changes from black to blue) to indicate correct performance. When the user strums at an incorrect time, strums while not pressing the correct fret, or fails to strum at all at the correct time, the strum indicator 1101 changes to a “miss” color (e.g., changes from black to red) to indicate a failed performance. When the strum indicator 1101 is black it indicates a strum that has not been played yet.
  • The interactive visual display 1100 also includes a tempo indicator 1102 which moves horizontally from left to right giving a visual indication of the tempo. The placement of the tempo indicator 1102 directly over a strum indicator 1101 indicates the user is to strum while depressing the correct fret. The tempo indicator 1102 may take any suitable form, such as a bouncing ball, a moving bar, or any other suitable form. Below the strum indicators 1101 is a rhythm count 1103 in the specific form of a number to help the user keep the proper rhythm count. It should be appreciated that the rhythm count 1103 may take any suitable form.
  • A fret indicator 1104 may be used to indicate the correct finger placement (e.g., the correct fret number to depress). For example a “1” may indicate to the user to press on the first fret of the game controller (e.g., a guitar-shaped game controller), a “2” the second fret, and so on. The fret indicator 1104 on the interactive visual display 1100 may be have a visual cue (e.g., color and/or number coded) that matches corresponding visual indicators 800 on the neck 124 of the apparatus 100, as shown for example in FIG. 8A, or may be coded in any suitable manner.
  • The interactive visual display 1100, which again is one non-limiting example of a suitable interactive display, also includes a score indicator 1105 that provides the user with feedback about how well the user did in correctly performing the visual cues illustrated on the display. Such feedback can be provided in any suitable way. For example, a user may get a point for each strum correctly executed, lose one or more points for incorrect or missed strums, receive bonus points for long, consecutive strings of successful strums without mistakes, etc. Other feedback mechanisms are also possible (e.g., separately noting correct and incorrect strums) and the aspects of the invention described herein are not limited in this respect.
  • It should be appreciated that interactive visual display 1100 is merely one non-limiting example of an interactive visual display, and that many variations and modifications of the interactive visual display 1100 are possible. For example, according to some specific embodiments, the game or software application may require (or have a selectable mode of operation that requires) only correctly timed strumming, regardless of whether a correct fret is depressed by the user. In such a case, the fret indicator 1104 may not appear on the interactive visual display 1100, and/or correct fingering may not be tracked and the user may only be required to strum the correct rhythm with open (non-fretted) or any fretted strings. In some such embodiments, a chord-progression may be pre-programmed to automatically change the chords at the correct time with no extra input needed by the user so a user can play along with a song simply by properly striking the strings. A similar approach may also be used for single-note melodies (solos, leads). Alternatively, some embodiments may require only proper fingering, without string striking. In such a case, the strum indicators 1101 might not appear, might appear as simple lines without a directional up or down arrowhead, or might optionally appear with a direction indicator. To produce sound, the user would only need to finger the frets or strings with the correct timing. It should be appreciated that other ways of interacting with the user are also possible.
  • FIGS. 12 A-D show an example of another interactive display interface 1200, which communicates strum timing. In this embodiment, a graphical representation of the strum area 1201 of the apparatus 100 is depicted. In the specific example shown, the strum area 1201 includes the bridge, pickups, bottom of the neck and guitar strings, however it should be appreciated that any suitable area may be displayed. Such an interactive display interface 1200 may be displayed all the time, or only when the concept of strumming is pertinent to game play. Therefore, fret fingering is not accounted for in this particular interactive display interface 1200. For example, such an interactive display interface 1200 may be used for unfretted open strumming of the strings. The interactive display interface 1200 may indicate that a user is supposed to strum when a falling pick icon 1202 passes over the strum area 1201. It should be appreciated that FIGS. 12A-D are merely examples, and that other ways of indicating strum timing are possible.
  • FIG. 13 shows another non-limiting example of an interactive display interface 1300 similar to the one shown in FIG. 12, but which communicates both strum timing and fret fingering information. In this non-limiting example, the pick icons 1302 may be coded to indicate fingering information, for example by adding color and/or number coding to the pick icons 1302, or by using any other suitable indicator of fingering information. A falling pick icon 1302 passing over the strum area 1301 may indicate that the user is to strum while simultaneously pressing the correct fret number.
  • FIGS. 14 A-D show another embodiment of an interactive display interface 1400 that communicates strum timing and fingering information. In this embodiment, a representation of the headstock and first several frets on the neck of the apparatus 100 are depicted on the display interface 1400. There are five fret tracks 1401 that pick icons 1402 slide on, with each fret track 1401 corresponding to a target fret 1403. The fret tracks 1401 and/or the target frets 1403 may be coded using color and/or number coding, as shown, or using any other suitable type of coding (e.g., symbol coding, or any other suitable type of coding). The pick icons 1402 travel along the fret tracks 1401 towards the target frets 1403. When a pick icon 1402 intersects with a target fret 1403, the user is supposed to strum while simultaneously pressing the correct corresponding fret on the neck of the guitar-type controller 100.
  • FIGS. 15 A-C show another non-limiting example of an interactive display interface 1500, which includes a time target area 1501 and a pick icon 1502. The user is supposed to strum the strings of the game controller when a sliding pick icon 1502 passes over the time target area 1501. In this interactive display interface 1500, the direction of the sliding pick icons 1502 may be left to right, right to left, top to bottom, bottom to top, or any other suitable direction. Such an interactive display interface 1500 might be used all the time or only when the concept of strumming is pertinent to game play, and fingering is not accounted for in this particular interactive display interface 1500. For example, such an interactive display interface 1500 may be used for unfretted open strumming of the strings of the game controller.
  • FIGS. 16 A-B show another non-limiting example of an interactive display interface 1600 similar to the one shown in FIG. 15, but which communicates both strum timing and fingering information by adding color and/or number coding to the pick icons 1602 to communicate fretting information. It should, however, be appreciated that any type of coding may be used to convey fingering information, as color and number coding are but two non-limiting examples. When a sliding pick icon 1602 passes over the time target area 1601, the user is to strum while simultaneously pressing the correct fret number. The embodiments in FIGS. 16A-B show two different methods for the coding of the pick icons to convey fret information. FIG. 16 A shows pick icons 1602 that are individually color and/or number coded. FIG. 16 B shows the use of groups of like pick icons 1602 that are color and/or number coded together. It should be appreciated that other manners of coding the pick icons are also possible, and that the display interfaces described herein are not limited to use with any particular type of coding.
  • FIG. 17 shows one non-limiting example of various logical steps in the flow of a game that can be controlled using a stringed controller according to any of the embodiments described herein. It should be appreciated that the steps may vary depending on the game, and that the various aspects described herein relating to playing of a game are not limited to any particular type(s) of steps, number, or order of steps.
  • As mentioned, FIG. 17 is a flowchart illustrating an example of the order of steps of game play flow of a game which may be played using a stringed controller according to any of the embodiments described herein. The game flow begins at the main menu, step 1701, which may allow a user, at 1702, to choose a mode of play or to alter game options. Upon choosing the game mode, the user is taken to a selection screen, step 1703, where he or she may choose, at 1704, a level (e.g., impacting degree of difficulty), location, music selection, or any other selection information. In this non-limiting example, once the chosen level/location/music is loaded a beat matching game play begins, step 1705.
  • The game interface produces a series of rhythm events, step 1706, such as the correct timing of a strum and/or fret press. Many of these events in a row constitute the beat matching play of an entire song. For each event, the game tests whether or not the user accurately strummed and/or fretted for that event, step 1707. If so, a score is awarded and the instrument audio track remains audible. If not, the user is awarded no score, or there may be a score penalty, and the guitar audio track may continue or become inaudible for the duration of that event. When all events are finished (i.e., when the song is over), the final score is displayed, step 1708, and a story scene, or cinematic, may occur, in the form of one or more transitional visual sequences which advances the game's story. The user is then returned to the location/level/music selection screen, step 1709, where they are prompted to choose another location, level and music selection for the next section of the game. Again, it should be appreciated that the types, number and order of steps illustrated in FIG. 17 are merely a non-limiting example, and that other possibilities for the flow of a game or program are also possible.
  • A stringed game controller, such as those discussed above, may be useful for other types of game play applications besides beat matching. For example, an application may employ specific defined melodic patterns (e.g., guitar licks) to control the game. For example, fretting and strumming fret “1” followed by fretting and strumming fret “2” is a melodic pattern that may be defined as “1, 2.” A gaming application may require specific melodic patterns that have a specific utilization and application according to the rules of the game. For example, the user may be taught the melodic pattern “1, 2, 3,” and then be informed that providing this melodic pattern in front of a closed door in the game will open that door. From that point forward, whenever the user encounters a closed door, he or she may, and in some embodiments must, perform the melodic pattern “1, 2, 3” to open the door. It should be appreciated that this is only one example, and that other melodic patterns may be used in other embodiments.
  • According to one embodiment, when a melodic pattern is performed, any sound, such as a specific musical note or a sound effect, may be played for each performed note of the pattern. The melodic pattern may or may not need to be played with a specific rhythm and timing depending on the game play context and application of this concept. Melodic patterns may contain two or more inputs, for example: “1, 2”; “3, 2, 3, 4, 1, 2, 5, 3, 2, 1, 2, 3”, etc. According to one embodiment, melodic patterns (e.g., licks) may be given specific identifiers or names in the game play context to identify them and distinguish them to the user. For example, the door opener pattern described above may be named “Open Sesame” in the context of the game.
  • The user interactions that can control a gaming application (e.g., by opening a door, causing a character to run or take another action, etc.) are not limited to playing melodic patterns, and can include any desired manipulation of the strings on the controller. For example, some gaming applications may require specific manipulations of the stringed controller to cause specific actions in a game. A specific manipulation may be any specific input or series of inputs that can be performed on the stringed controller and be detected by the gaming application. That is, there may be specific inputs or series of inputs that have a specific utilization and application according to the rules of the game. For example, the user may be taught that pressing any two frets simultaneously in front of a closed door in the game will open that door. From that point forward, whenever the user encounters a closed door, he or she may press any two frets simultaneously to open the door. Examples of specific manipulations include, but are not limited to: pressing two or more specific frets simultaneously, pressing any two or more frets simultaneously, hammer-on either once or in rapid succession, pull-off either once or in rapid succession, strumming, strumming softly, strumming rigorously, strumming very slowly, strumming very quickly, playing any particular note or chord, any combination of the above, or any other suitable manipulations.
  • According to some embodiments, a gaming application may require fast, repeated strumming of the game controller's strings to fulfill a game objective. Thus the user may satisfy game play objectives by sustained, rapid strumming of the stringed controller. For example, the user's progress may be depicted by a bar or meter that fills as the user strums, until the goal is reached. The bar or meter may decay (deplete) at a specific rate, so that to fill the meter the user must consistently strum more quickly than the decay rate until the goal is achieved.
  • According to another embodiment, a gaming application may also, or alternatively, require open unfretted strumming to produce a defined chord progression, as shown in FIG. 18 A. Each time the user open strums, the predetermined chord progression progresses by one beat, during which a chord progression may be aurally produced via software, as shown. Similarly, some gaming applications may require open picking in response to a defined melody, as shown in FIG. 18 B. Each time the user open-picks a string, the predetermined melody progresses by one beat, during which the melody is produced aurally via software. These are two non-limiting examples, and it should be appreciated that other types of user interaction are also possible.
  • As should be appreciated from the foregoing, in some applications, the stringed controller may be used to control games that do not have a musical instrument play along theme. For example, a stringed controller can be used to control any type of game and be adapted to work with or replace controllers conventionally used to control such games. If the game requires the player to simulate proper musical instrument operation (e.g., play chords) to control game operation, the user experience in playing the game may simultaneously provide valuable practice time in the playing of the instrument.
  • In some specific gaming applications, the stringed controller may be used to simulate musical improvisation. For example, specific notes and/or chords may be related to each finger position or fret, so that when the strings are fingered and/or struck by the user, the specific note and/or chord is produced aurally by the software. The user can then be placed into a free mode of game play in which he or she is free to finger and strike/strum as desired with little or no game play rules or structure. The result is a simulation of musical improvisation, with or without background accompaniment music for the improvisation.
  • In some embodiments, a stringed game controller, such as apparatus 100 when used as a game controller, may be used to control a gaming avatar in two-dimensional or three-dimensional space. For example fingering the strings (e.g., pressing a specific fret) of the game controller in particular ways may cause the avatar to walk forward, walk backwards, left, or right. Other fingerings or strikes may cause the avatar to perform other actions, such as jumping, running, or any other action that makes sense in the context of the game play. Similarly, the controller also may be used to control a game camera view. For example, a specific fingering may cause the game camera to pan, zoom, rotate, pitch, yaw, swivel, or otherwise alter its state. Other functions within the gaming application may also, or alternatively, be controlled by the game controller, as those listed are merely non-limiting examples.
  • In some embodiments, the gaming or software application is configured to detect true chord fingerings (e.g., on the frets or otherwise) of the stringed controller. For example, a software application may ask the user to fret a D major chord and show the correct fingering. Then when frets number “2” and “3” are activated simultaneously, positive feedback may be given to the user in any suitable manner, e.g., audibly and/or visually, such as via the large check mark in FIG. 19. Thus, it should be appreciated that various aspects of the technology described herein may be used as an educational, or teaching aid.
  • As has been explained, various embodiments described herein may include producing timing and/or finger positioning signals using a stringed game controller. In some embodiments, information about the pitch of a string played is not produced, or is not sent to or detected by the gaming application. Alternatively, according to one embodiment, a real-time pitch detection algorithm may be included in the application software, and may be used to determine a pitch produced by the stringed controller. Any suitable pitch detection algorithm may be used, as the embodiments described herein that employ pitch detection are not limited in this respect. The pitch produced by the stringed controller may then be compared to a target pitch in the context of a game or other application. For example, pitch detection may be used in the context of beat matching game play or other type of game play, or in any other suitable application.
  • Embodiments of the present invention may also include a computer software application having an instrument (e.g., a guitar) training mode that trains the user to play a song or portion of a song on an instrument, using audio and visual feedback including an interactive display interface which may be similar to those discussed above. For example, in training mode, operation may optionally start by only requiring strumming without a “play-by-numbers fret indicator” appearing on the interactive display interface, and the player would only be required to strum the correct rhythm with open (non-fretted) strings. A chord progression may be pre-programmed into the computer software application so that the chord sounds would indeed be changing, but with no extra input needed by the user. The same method may also be used for single-note melodies such as solos and leads. Alternatively, a training mode of operation could start by only requiring fret fingering with the strum indicators appearing as lines with no directional up or down arrow.
  • As described above, some embodiments of the present invention are directed to a stringed game controller having a controller output module for detecting, processing, and outputting signals from the game controller either directly or indirectly (e.g., via any other suitable device) to a computer or gaming console executing a software application to be controlled by the controller. It should be appreciated that in some embodiments of the present invention, the controller output module need not be integrated into the same apparatus as the strings and supporting body of the stringed game controller. For example, as illustrated in FIG. 23, according to one embodiment a stringed game controller 100 a may be provided that includes a controller output housed separately from the strings and their supporting body and coupled in any way (e.g., wired and/or wireless connection). For example, the controller output module may be housed in a box 2302 separate from the guitar body and strings, and may include any of the functionality discussed above in connection with the controller output module (e.g., as discussed in connection with the controller output module 710 in FIG. 7). For embodiments where additional controls are provided in addition to the strings (e.g., a joystick 185, sync button 186, etc.), they may be provided on the separate box 2302 as shown in FIG. 23. In some embodiments, the box 2302 may be detachably mounted to the guitar body 128, or may be a distinct box. Outputs from the strings 120 can be provided to the controller output module in the box 2302 in any suitable way, including using any of the techniques discussed above. For example, according to some embodiments output signals from pickup 140 may be provided to the box 2302 by a suitable connection 2304 (wired or wireless), such as an output cable, or any other suitable connection. According to some embodiments, one or more of the frets 130 may be electrically connected to the box 2302 by a suitable connection 2306, which may be configured to send a signal to the box 2302 when a string 120 contacts a fret 130. It should be appreciated that these are non-limiting examples of ways in which the box 2302 may be coupled to the guitar-shaped structure of FIG. 23 to receive output signals from which one or more gaming input signals may be derived, and that other coupling configurations and types are possible.
  • In addition, in accordance with one embodiment, the box 2302 can be formed as part of a kit or adapter that can adapt or retrofit any musical instrument (e.g., any guitar) into a stringed game controller so that the owner of an instrument may obtain an adapter and use his/her instrument as a game controller. For example, in some embodiments an acoustic-electric instrument (e.g., an acoustic-electric guitar) may be used as a game controller by employing an adapter kit including the box 2302. The pickup of the acoustic-electric instrument may be coupled to the box 2302 in the manner shown by connection 2304 of FIG. 23, and one or more of the frets of the instrument may be coupled to the box 2302 to detect when one or more of the strings 120 contact the fret(s), using a suitable connection (e.g., connection 2306, or any other suitable connection). For adapting a fretted instrument that does not have conductive strings, an alternate technique for detecting finger position may be employed (examples of which are discussed above).
  • Moreover, for instruments that do not have a pickup built in, such as some acoustic instruments (e.g., an acoustic guitar), a suitable pickup may be added to the instrument (e.g., an off-the-shelf pickup as part of a converter kit including the box 2302, or otherwise), and then the output of the pickup connected to box 2302, by a connection such as 2304. Other configurations are also possible. Thus, it should be appreciated that various features of the technology described are application to electric instruments, acoustic-electric instruments, acoustic instruments, and non-instruments (e.g., dedicated game controllers), and are not limited in this respect.
  • Similarly, while some detectors (e.g., conductive fret sensors for the frets 130 in FIG. 1) have been described as being integrated into the stringed controller, it should be appreciated that other configurations are possible. For example, according to some embodiments, fret sensors may be detachable from the frets 130, and may be connected to box 2302 as part of an adapter kit for adapting a stringed instrument to work as a game controller. Other configurations for fret sensors are also possible. In addition, as discussed above, other techniques can also be employed for detecting finger positions on the neck of a fretted or non-fretted instrument, and any of those techniques may be made removable to allow an instrument to be adapted to function as a game controller.
  • The above-described embodiments of the present invention can be implemented in any of numerous ways. For example, the embodiments may be implemented using hardware, software or a combination thereof. When implemented in software, the software code can be executed on any suitable processor or collection of processors, whether provided in a single computer or distributed among multiple computers. It should be appreciated that any component or collection of components that perform the functions described above can be generically considered as one or more controllers that control the above-discussed functions. The one or more controllers can be implemented in numerous ways, such as with dedicated hardware, or with general purpose hardware (e.g., one or more processors) that is programmed using microcode or software to perform the functions recited above.
  • In this respect, it should be appreciated that one implementation of the embodiments of the present invention comprises at least one computer-readable storage medium (e.g., a computer memory, a floppy disk, a compact disk, a tape, etc.) encoded with a computer program (i.e., a plurality of instructions), which, when executed on a processor, performs the above-discussed functions of the embodiments of the present invention. The computer-readable storage medium can be transportable such that the program stored thereon can be loaded onto any computer resource to implement the aspects of the present invention discussed herein. In addition, it should be appreciated that the reference to a computer program which, when executed, performs the above-discussed functions, is not limited to an application program running on a host computer. Rather, the term computer program is used herein in a generic sense to reference any type of computer code (e.g., software or microcode) that can be employed to program a processor to implement the above-discussed aspects of the present invention.
  • The phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” “having,” “containing”, “involving”, and variations thereof, is meant to encompass the items listed thereafter and additional items.
  • Having described several embodiments of the invention in detail, various modifications and improvements will readily occur to those skilled in the art. Such modifications and improvements are intended to be within the spirit and scope of the invention. Accordingly, the foregoing description is by way of example only, and is not intended as limiting. The invention is limited only as defined by the following claims and the equivalents thereto.

Claims (20)

1. A method for use with a system comprising at least one processor, a user interface comprising a visual display and a stringed controller that comprises a plurality of strings, the method comprising:
displaying, on the visual display, a first indication comprising directions instructing a user on desired fingering and striking of the plurality of strings;
receiving at least one input signal from the stringed controller that identifies actual fingering and striking of the plurality of strings by the user;
determining, by the at least one processor processing the at least one input signal, whether the actual fingering and striking of the plurality of strings matches the desired fingering and striking; and
outputting a second indication, via the user interface, of whether the actual fingering and striking of the plurality of strings matches the desired fingering and striking.
2. The method of claim 1, wherein the outputting a second indication comprises outputting a visual indication via the visual display.
3. The method of claim 1, wherein the system further comprises at least one speaker, and wherein the outputting a second indication comprises outputting an audible indication via the at least one speaker.
4. The method of claim 1, wherein the stringed controller resembles a musical instrument, and wherein the desired fingering and striking of the plurality of strings corresponds to playing at least one musical note on the musical instrument.
5. The method of claim 1, wherein the stringed controller resembles a musical instrument, and wherein the desired fingering and striking of the plurality of strings corresponds to playing at least one musical chord on the musical instrument.
6. The method of claim 5, wherein outputting the second indication comprises displaying on the user interface whether the actual fingering exactly matches the musical chord.
7. The method of claim 5, wherein outputting the second indication comprises displaying on the user interface information indicating portions of the actual fingering that do not match the musical chord.
8. The method of claim 1, wherein the directions comprise an indication of a root note of a chord.
9. The method of claim 1, wherein the stringed controller comprises a plurality of frets.
10. The method of claim 1, further comprising displaying, on the visual display, multiple additional indications beyond the first indication and the second indication, the multiple additional indications comprising directions instructing the user on multiple additional desired fingerings and striking of the plurality of strings, wherein the first desired fingering and striking and the multiple additional desired fingerings and striking of the plurality of strings together instruct the user on playing a song.
11. The method of claim 1, wherein the directions comprise timing information, wherein the method further comprises:
determining a time when the at least one input signal is received; and
wherein the second indication indicates whether the time when the at least one input signal is received corresponds to the timing information.
12. A computer-readable storage medium encoded with a plurality of instructions that, when executed by at least one processor, cause the at least one processor to control a system comprising the at least one processor and a user interface comprising a visual display to perform a method comprising:
displaying, on the visual display, a first indication comprising directions instruction a user on desired fingering and striking of a plurality of string of a stringed controller;
receiving at least one input signal from the stringed controller that identifies actual fingering and striking of the plurality of strings by the user;
determining, by the at least one processor processing the at least one input signal, whether the actual fingering and striking of the plurality of strings matches the desired fingering and striking; and
outputting a second indication, via the user interface, or whether the actual fingering and striking of the plurality of strings matches the desired fingering and striking.
13. The computer-readable storage medium of claim 12, wherein the stringed controller resembles a musical instrument, and wherein the desired fingering and striking of the plurality of strings corresponds to playing at least one musical note on the musical instrument.
14. The computer-readable storage medium of claim 12, wherein the stringed controller resembles a musical instrument, and wherein the desired fingering and striking of the plurality of strings corresponds to playing at least one musical chord on the musical instrument.
15. The computer-readable storage medium of claim 12, wherein the directions comprise timing information, wherein the method further comprises:
determining a time when the at least one input signal is received; and
wherein the second indication indicates whether the time when the at least one input signal is received corresponds to the timing information.
16. A computer system comprising:
at least one storage device configured to store a plurality of instructions; and
at least one processor coupled to the at least one storage device and configured to receive and execute the plurality of instructions to cause a system comprising the at least one processor and a user interface comprising a visual display to perform a method comprising:
displaying, on the visual display, a first indication comprising directions instructing a user on desired fingering and striking of a plurality of strings of a stringed controller;
receiving at least one input signal from the stringed controller that identifies actual fingering and striking of the plurality of strings by the user;
determining, by the at least one processor processing the at least one input signal, whether the actual fingering and striking of the plurality of strings matches the desired fingering and striking; and
outputting a second indication, via the user interface, of whether the actual fingering and striking of the plurality of strings matches the desired fingering and striking.
17. The computer system of claim 16, further comprising the stringed controller.
18. The computer system of claim 16, further comprising at least one speaker, and wherein outputting the second indication comprises outputting an audible indication via the at least one speaker.
19. The computer system of claim 16, wherein the stringed controller resembles a musical instrument, and wherein the desired fingering and striking of the plurality of strings corresponds to playing at least one musical note on the musical instrument.
20. The computer system of claim 16, wherein the directions comprise timing information,
wherein the method further comprises:
determining a time when the at least one input signal is received; and
wherein the second indication indicates whether the time when the at least one input signal is received corresponds to the timing information.
US12/838,969 2008-01-24 2010-07-19 Methods and apparatus for stringed controllers and/or instruments Abandoned US20100279772A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/838,969 US20100279772A1 (en) 2008-01-24 2010-07-19 Methods and apparatus for stringed controllers and/or instruments

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US2328508P 2008-01-24 2008-01-24
US12/359,237 US8246461B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments
US12/359,242 US8017857B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments
US12/838,969 US20100279772A1 (en) 2008-01-24 2010-07-19 Methods and apparatus for stringed controllers and/or instruments

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/359,237 Continuation US8246461B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments

Publications (1)

Publication Number Publication Date
US20100279772A1 true US20100279772A1 (en) 2010-11-04

Family

ID=40591889

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/359,242 Expired - Fee Related US8017857B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments
US12/359,237 Expired - Fee Related US8246461B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments
US12/838,969 Abandoned US20100279772A1 (en) 2008-01-24 2010-07-19 Methods and apparatus for stringed controllers and/or instruments

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US12/359,242 Expired - Fee Related US8017857B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments
US12/359,237 Expired - Fee Related US8246461B2 (en) 2008-01-24 2009-01-23 Methods and apparatus for stringed controllers and/or instruments

Country Status (7)

Country Link
US (3) US8017857B2 (en)
EP (1) EP2244796A1 (en)
JP (1) JP2011509800A (en)
CN (1) CN101977663A (en)
AU (1) AU2009206663A1 (en)
CA (1) CA2712082A1 (en)
WO (1) WO2009094180A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8017857B2 (en) 2008-01-24 2011-09-13 745 Llc Methods and apparatus for stringed controllers and/or instruments
US8618402B2 (en) * 2006-10-02 2013-12-31 Harman International Industries Canada Limited Musical harmony generation from polyphonic audio signals

Families Citing this family (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7459624B2 (en) 2006-03-29 2008-12-02 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US20080200224A1 (en) 2007-02-20 2008-08-21 Gametank Inc. Instrument Game System and Method
US8907193B2 (en) 2007-02-20 2014-12-09 Ubisoft Entertainment Instrument game system and method
US8678896B2 (en) 2007-06-14 2014-03-25 Harmonix Music Systems, Inc. Systems and methods for asynchronous band interaction in a rhythm action game
US20090075711A1 (en) 2007-06-14 2009-03-19 Eric Brosius Systems and methods for providing a vocal experience for a player of a rhythm action game
WO2009052032A1 (en) * 2007-10-19 2009-04-23 Sony Computer Entertainment America Inc. Scheme for providing audio effects for a musical instrument and for controlling images with same
JP2011514986A (en) * 2008-03-11 2011-05-12 ミーサ デジタル ピーティーワイ リミテッド Digital musical instruments
US20090264199A1 (en) * 2008-04-16 2009-10-22 Macedon Productions, Inc. Using a Musical Instrument as a Video Game Controller
US8663013B2 (en) 2008-07-08 2014-03-04 Harmonix Music Systems, Inc. Systems and methods for simulating a rock band experience
US9061205B2 (en) 2008-07-14 2015-06-23 Activision Publishing, Inc. Music video game with user directed sound generation
EP2321019B1 (en) * 2008-08-11 2019-04-10 Immersion Corporation A haptic enabled gaming peripheral for a musical game
WO2010059994A2 (en) 2008-11-21 2010-05-27 Poptank Studios, Inc. Interactive guitar game designed for learning to play the guitar
US8198526B2 (en) 2009-04-13 2012-06-12 745 Llc Methods and apparatus for input devices for instruments and/or game controllers
US8465366B2 (en) 2009-05-29 2013-06-18 Harmonix Music Systems, Inc. Biasing a musical performance input to a part
US8449360B2 (en) 2009-05-29 2013-05-28 Harmonix Music Systems, Inc. Displaying song lyrics and vocal cues
US20130005470A1 (en) * 2009-07-03 2013-01-03 Starplayit Pty Ltd Method of obtaining a user selection
US9218747B2 (en) * 2009-07-17 2015-12-22 James BARTOS Self-teaching and entertainment guitar systems
US20110028218A1 (en) * 2009-08-03 2011-02-03 Realta Entertainment Group Systems and Methods for Wireless Connectivity of a Musical Instrument
US9492756B2 (en) * 2009-09-14 2016-11-15 Joytunes Ltd. System and method for analyzing a digitalized musical performance
US7977566B2 (en) * 2009-09-17 2011-07-12 Waleed Sami Haddad Optical instrument pickup
JP5437003B2 (en) * 2009-09-28 2014-03-12 株式会社コナミデジタルエンタテインメント Game machine and computer program thereof
US20110086704A1 (en) * 2009-10-14 2011-04-14 Jack Daniel Davis Music game system and method of providing same
WO2011056657A2 (en) 2009-10-27 2011-05-12 Harmonix Music Systems, Inc. Gesture-based user interface
US9981193B2 (en) 2009-10-27 2018-05-29 Harmonix Music Systems, Inc. Movement based recognition and evaluation
WO2011071552A1 (en) * 2009-12-09 2011-06-16 Bernard Chiu Methods and apparatus for stringed controllers and instruments
KR20120124413A (en) * 2009-12-21 2012-11-13 미소 미디어 인코포레이티드 Educational string instrument touchscreen simulation
EP2372696B1 (en) * 2010-03-04 2013-09-11 Goodbuy Corporation S.A. Control unit for a games console and method for controlling a games console
US8636572B2 (en) 2010-03-16 2014-01-28 Harmonix Music Systems, Inc. Simulating musical instruments
US8562403B2 (en) 2010-06-11 2013-10-22 Harmonix Music Systems, Inc. Prompting a player of a dance game
EP2579955B1 (en) 2010-06-11 2020-07-08 Harmonix Music Systems, Inc. Dance game and tutorial
US9358456B1 (en) 2010-06-11 2016-06-07 Harmonix Music Systems, Inc. Dance competition game
USD757320S1 (en) 2010-07-15 2016-05-24 James BARTOS Illuminated fret board
US9117376B2 (en) * 2010-07-22 2015-08-25 Incident Technologies, Inc. System and methods for sensing finger position in digital musical instruments
US9024166B2 (en) 2010-09-09 2015-05-05 Harmonix Music Systems, Inc. Preventing subtractive track separation
US20120064498A1 (en) * 2010-09-13 2012-03-15 John Swain Interactive system and method for musical instrument instruction
US20120240751A1 (en) * 2011-03-23 2012-09-27 Ayako Yonetani Hybrid stringed instrument
US20120285310A1 (en) * 2011-05-15 2012-11-15 Michael Miltimore Acoustic String Guitar
CN103198733A (en) * 2012-01-06 2013-07-10 张秉钧 Electronic display finger plate used for string instrument
US8872013B2 (en) * 2012-03-14 2014-10-28 Orange Music Electronic Company Limited Audiovisual teaching apparatus
US8901409B2 (en) * 2012-03-22 2014-12-02 Marcus Gustaf Helgesson Stringed musical instrument with string activated light emitting members
US20150107444A1 (en) * 2012-04-16 2015-04-23 Cornell Center for Technology, Enterprise & Commercialization Digitally controlled musical instrument
US9047851B2 (en) 2012-09-19 2015-06-02 Light4Sound Optoelectronic pickup for musical instruments
US8975501B2 (en) 2013-03-14 2015-03-10 FretLabs LLC Handheld musical practice device
KR20160019432A (en) * 2013-06-10 2016-02-19 고바야시 쇼지 Device for vibrating a stringed instrument
USD755843S1 (en) 2013-06-10 2016-05-10 Apple Inc. Display screen or portion thereof with graphical user interface
GB2516634A (en) * 2013-07-26 2015-02-04 Sony Corp A Method, Device and Software
USD745558S1 (en) * 2013-10-22 2015-12-15 Apple Inc. Display screen or portion thereof with icon
CN104681018A (en) * 2013-11-29 2015-06-03 北京怡生飞扬科技发展有限公司 Acoustic guitar pickup
USD723098S1 (en) 2014-03-14 2015-02-24 FretLabs LLC Handheld musical practice device
US9311907B2 (en) 2014-03-17 2016-04-12 Incident Technologies, Inc. Musical input device and dynamic thresholding
CN104064171A (en) * 2014-04-25 2014-09-24 张嵩 Controller for changing and optimizing tone of electroacoustic musical instrument
CN104200801A (en) * 2014-09-18 2014-12-10 王择儒 Violin instrument
CN104575159B (en) * 2014-12-22 2017-10-13 惠州市天音乐器有限公司 Plucked instrument fingering automatic identification tutoring system
US9842577B2 (en) * 2015-05-19 2017-12-12 Harmonix Music Systems, Inc. Improvised guitar simulation
US9773486B2 (en) 2015-09-28 2017-09-26 Harmonix Music Systems, Inc. Vocal improvisation
US9711121B1 (en) * 2015-12-28 2017-07-18 Berggram Development Oy Latency enhanced note recognition method in gaming
CN105575220A (en) * 2016-03-22 2016-05-11 深圳视感文化科技有限公司 Interactive stringed instrument teaching system
US9747882B1 (en) * 2017-04-14 2017-08-29 Petr Micek Switched reversing configuration control for string instruments and boost circuit therefor
WO2018229746A1 (en) * 2017-06-15 2018-12-20 Digital Instruments Ltd Musical instrument
CN109326273B (en) * 2018-06-04 2023-05-05 程建铜 Audio output method and device for plucked instrument and plucked instrument
KR102324026B1 (en) * 2019-11-26 2021-11-09 주식회사 프리미어에듀케이션 Music learning tool and music learning method using the same
JP7270008B2 (en) * 2020-09-08 2023-05-09 カムツス コーポレーション Game providing method, computer program, computer-readable recording medium, and computer device

Citations (94)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3015247A (en) * 1960-04-20 1962-01-02 Gibson Inc Mute means for string musical instruments
US4263520A (en) * 1978-04-19 1981-04-21 Nippon Gakki Seizo Kabushiki Kaisha Signal detecting circuit for electronic musical instrument
US4372187A (en) * 1981-05-01 1983-02-08 Ab Laboratories, A Limited Partnership Novel guitar-like electronic musical instrument
US4580479A (en) * 1983-02-28 1986-04-08 Octave-Plateau Electronics Inc. Guitar controller
US4653376A (en) * 1984-09-21 1987-03-31 David Allured Electronic sensing system for a stringed and fretted musical instrument
US4730530A (en) * 1986-02-28 1988-03-15 Cfj Systems, Inc. Guitar controller pickup and method for generating trigger signals for a guitar controlled synthesizer
US4748887A (en) * 1986-09-03 1988-06-07 Marshall Steven C Electric musical string instruments and frets therefor
US4823667A (en) * 1987-06-22 1989-04-25 Kawai Musical Instruments Mfg. Co., Ltd. Guitar controlled electronic musical instrument
US4919031A (en) * 1987-03-24 1990-04-24 Casio Computer Co., Ltd. Electronic stringed instrument of the type for controlling musical tones in response to string vibration
US4939471A (en) * 1989-05-05 1990-07-03 Aphex Systems Ltd. Impulse detection circuit
US4986157A (en) * 1988-12-28 1991-01-22 Casio Computer Co., Ltd. Electronic musical instrument with a fret-split function
US5001960A (en) * 1988-06-10 1991-03-26 Casio Computer Co., Ltd. Apparatus for controlling reproduction on pitch variation of an input waveform signal
US5010800A (en) * 1988-09-20 1991-04-30 Casio Computer Co., Ltd. Electronic musical instrument capable of selecting between fret and fretless modes
US5014588A (en) * 1988-06-03 1991-05-14 Casio Computer Co., Ltd. Electronic stringed musical instrument with a string vibration detecting apparatus
US5024134A (en) * 1988-05-02 1991-06-18 Casio Computer Co., Ltd. Pitch control device for electronic stringed instrument
US5025703A (en) * 1987-10-07 1991-06-25 Casio Computer Co., Ltd. Electronic stringed instrument
US5085120A (en) * 1988-12-26 1992-02-04 Casio Computer Co., Ltd. Electronic stringed musical instrument with parameter selecting function
US5206446A (en) * 1989-01-18 1993-04-27 Casio Computer Co., Ltd. Electronic musical instrument having a plurality of tone generation modes
US5223659A (en) * 1988-04-25 1993-06-29 Casio Computer Co., Ltd. Electronic musical instrument with automatic accompaniment based on fingerboard fingering
US5300730A (en) * 1992-12-07 1994-04-05 Ekhaus Ira B Device for controlling musical effects on a guitar
US5305674A (en) * 1989-05-15 1994-04-26 Korg/Fishpark Associates Stringed musical instrument with visual images
US5308916A (en) * 1989-12-20 1994-05-03 Casio Computer Co., Ltd. Electronic stringed instrument with digital sampling function
US5393926A (en) * 1993-06-07 1995-02-28 Ahead, Inc. Virtual music system
US5398585A (en) * 1991-12-27 1995-03-21 Starr; Harvey Fingerboard for musical instrument
US5488196A (en) * 1994-01-19 1996-01-30 Zimmerman; Thomas G. Electronic musical re-performance and editing system
US5491297A (en) * 1993-06-07 1996-02-13 Ahead, Inc. Music instrument which generates a rhythm EKG
US5602356A (en) * 1994-04-05 1997-02-11 Franklin N. Eventoff Electronic musical instrument with sampling and comparison of performance data
US5627331A (en) * 1996-03-05 1997-05-06 Devitrysmith; T. John Guitar having improved accessibility for string attachment
US5710387A (en) * 1995-01-12 1998-01-20 Yamaha Corporation Method for recognition of the start of a note in the case of percussion or plucked musical instruments
US5717155A (en) * 1995-06-16 1998-02-10 Yamaha Corporation Synthesizer detecting pitch and plucking point of stringed instrument to generate tones
US5726372A (en) * 1993-04-09 1998-03-10 Franklin N. Eventoff Note assisted musical instrument system and method of operation
US5728960A (en) * 1996-07-10 1998-03-17 Sitrick; David H. Multi-dimensional transformation systems and display communication architecture for musical compositions
US5739457A (en) * 1996-09-26 1998-04-14 Devecka; John R. Method and apparatus for simulating a jam session and instructing a user in how to play the drums
US5744744A (en) * 1993-10-28 1998-04-28 Kabushiki Kaisha Kawai Gakki Seisakusho Electric stringed instrument having automated accompaniment system
US5746605A (en) * 1994-06-06 1998-05-05 Red Ant, Inc. Method and system for music training
US5773742A (en) * 1994-01-05 1998-06-30 Eventoff; Franklin Note assisted musical instrument system and method of operation
US5777251A (en) * 1995-12-07 1998-07-07 Yamaha Corporation Electronic musical instrument with musical performance assisting system that controls performance progression timing, tone generation and tone muting
US5786541A (en) * 1996-05-18 1998-07-28 Yamaha Corporation Musical tone synthesizing apparatus
US5864083A (en) * 1997-12-18 1999-01-26 Caren; Michael P. Musical effect controller and system for an electric guitar
US5902949A (en) * 1993-04-09 1999-05-11 Franklin N. Eventoff Musical instrument system with note anticipation
US5925843A (en) * 1997-02-12 1999-07-20 Virtual Music Entertainment, Inc. Song identification and synchronization
US6010403A (en) * 1997-12-05 2000-01-04 Lbe Technologies, Inc. System and method for displaying an interactive event
US6049034A (en) * 1999-01-19 2000-04-11 Interval Research Corporation Music synthesis controller and method
US6075194A (en) * 1997-07-08 2000-06-13 Gibson Guitar Corp. Component mount and components for musical instruments
US6091013A (en) * 1998-12-21 2000-07-18 Waller, Jr.; James K. Attack transient detection for a musical instrument signal
US6175070B1 (en) * 2000-02-17 2001-01-16 Musicplayground Inc. System and method for variable music notation
US6177623B1 (en) * 1999-02-26 2001-01-23 Konami Co., Ltd. Music reproducing system, rhythm analyzing method and storage medium
US6191350B1 (en) * 1999-02-02 2001-02-20 The Guitron Corporation Electronic stringed musical instrument
US6225547B1 (en) * 1998-10-30 2001-05-01 Konami Co., Ltd. Rhythm game apparatus, rhythm game method, computer-readable storage medium and instrumental device
US6252153B1 (en) * 1999-09-03 2001-06-26 Konami Corporation Song accompaniment system
US6342665B1 (en) * 1999-02-16 2002-01-29 Konami Co., Ltd. Music game system, staging instructions synchronizing control method for same, and readable recording medium recorded with staging instructions synchronizing control program for same
US6347998B1 (en) * 1999-06-30 2002-02-19 Konami Co., Ltd. Game system and computer-readable recording medium
US6353165B1 (en) * 2000-03-10 2002-03-05 First Act, Inc. String instrument with protective string cap
US6379244B1 (en) * 1997-09-17 2002-04-30 Konami Co., Ltd. Music action game machine, performance operation instructing system for music action game and storage device readable by computer
US6390923B1 (en) * 1999-11-01 2002-05-21 Konami Corporation Music playing game apparatus, performance guiding image display method, and readable storage medium storing performance guiding image forming program
US6410835B2 (en) * 1998-07-24 2002-06-25 Konami Co., Ltd. Dance game apparatus and step-on base for dance game
US6425822B1 (en) * 1998-11-26 2002-07-30 Konami Co., Ltd. Music game machine with selectable controller inputs
US6452081B1 (en) * 2000-05-18 2002-09-17 Steven F. Ravagni Stringed instrument finger positioning guide and method for teaching students to read music
US6515211B2 (en) * 2001-03-23 2003-02-04 Yamaha Corporation Music performance assistance apparatus for indicating how to perform chord and computer program therefor
US6541692B2 (en) * 2000-07-07 2003-04-01 Allan Miller Dynamically adjustable network enabled method for playing along with music
US6541688B2 (en) * 2000-12-28 2003-04-01 Yamaha Corporation Electronic musical instrument with performance assistance function
US6554711B1 (en) * 1999-06-30 2003-04-29 Konami Co., Ltd. Music game machine with interactive second game device
US6686530B2 (en) * 1999-04-26 2004-02-03 Gibson Guitar Corp. Universal digital media communications and control system and method
US6738059B1 (en) * 1998-12-18 2004-05-18 Kabushiki Kaisha Sega Enterprises Apparatus and methods for image processing using mixed display objects
US6740803B2 (en) * 2001-11-21 2004-05-25 Line 6, Inc Computing device to allow for the selection and display of a multimedia presentation of an audio file and to allow a user to play a musical instrument in conjunction with the multimedia presentation
US6846980B2 (en) * 2001-01-31 2005-01-25 Paul D. Okulov Electronic-acoustic guitar with enhanced sound, chord and melody creation system
US6852919B2 (en) * 1998-05-15 2005-02-08 Lester F. Ludwig Extensions and generalizations of the pedal steel guitar
US6888057B2 (en) * 1999-04-26 2005-05-03 Gibson Guitar Corp. Digital guitar processing circuit
US6995310B1 (en) * 2001-07-18 2006-02-07 Emusicsystem Method and apparatus for sensing and displaying tablature associated with a stringed musical instrument
US7030311B2 (en) * 2001-11-21 2006-04-18 Line 6, Inc System and method for delivering a multimedia presentation to a user and to allow the user to play a musical instrument in conjunction with the multimedia presentation
US7030307B2 (en) * 2001-06-12 2006-04-18 Douglas Wedel Music teaching device and method
US20060107819A1 (en) * 2002-10-18 2006-05-25 Salter Hal C Game for playing and reading musical notation
US7164076B2 (en) * 2004-05-14 2007-01-16 Konami Digital Entertainment System and method for synchronizing a live musical performance with a reference performance
US7166794B2 (en) * 2003-01-09 2007-01-23 Gibson Guitar Corp. Hexaphonic pickup for digital guitar system
US7169996B2 (en) * 2002-11-12 2007-01-30 Medialab Solutions Llc Systems and methods for generating music using data/music data file transmitted/received via a network
US20070051224A1 (en) * 2005-09-02 2007-03-08 M.A.C.E. Music Inc. String dampener for a stringed musical instrument
US7220912B2 (en) * 1999-04-26 2007-05-22 Gibson Guitar Corp. Digital guitar system
US7220913B2 (en) * 2003-01-09 2007-05-22 Gibson Guitar Corp. Breakout box for digital guitar
US7220906B2 (en) * 2003-03-20 2007-05-22 Yamaha Corporation String-instrument type electronic musical instrument
US7223913B2 (en) * 2001-07-18 2007-05-29 Vmusicsystems, Inc. Method and apparatus for sensing and displaying tablature associated with a stringed musical instrument
US20070234885A1 (en) * 2006-03-29 2007-10-11 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US20070256540A1 (en) * 2006-04-19 2007-11-08 Allegro Multimedia, Inc System and Method of Instructing Musical Notation for a Stringed Instrument
US7320643B1 (en) * 2006-12-04 2008-01-22 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US20080028920A1 (en) * 2006-08-04 2008-02-07 Sullivan Daniel E Musical instrument
US20090064849A1 (en) * 2007-09-12 2009-03-12 Ronald Festejo Method and apparatus for self-instruction
US20090191932A1 (en) * 2008-01-24 2009-07-30 745 Llc Methods and apparatus for stringed controllers and/or instruments
US20100087254A1 (en) * 2008-10-07 2010-04-08 Zivix Llc Systems and methods for a digital stringed instrument
US20100234109A1 (en) * 2008-01-24 2010-09-16 745 Llc Fret and method of manufacturing frets for stringed controllers and instruments
US20110011248A1 (en) * 2007-09-29 2011-01-20 Elion Clifford S Electronic fingerboard for stringed instrument
US20110011241A1 (en) * 2009-07-17 2011-01-20 Bartos James Self-teaching and entertainment guitar systems
US8003872B2 (en) * 2006-03-29 2011-08-23 Harmonix Music Systems, Inc. Facilitating interaction with a music-based video game
US20110218022A1 (en) * 2008-01-24 2011-09-08 745 Llc Methods and apparatus for stringed controllers and instruments
US20120132057A1 (en) * 2009-06-12 2012-05-31 Ole Juul Kristensen Generative Audio Matching Game System
US20130036897A1 (en) * 2007-02-20 2013-02-14 Ubisoft Entertainment S.A. Instrument game system and method

Family Cites Families (70)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3797355A (en) * 1972-05-30 1974-03-19 C Law Banjo mute
US4630520A (en) 1984-11-08 1986-12-23 Carmine Bonanno Guitar controller for a music synthesizer
US4702141A (en) 1984-11-08 1987-10-27 Carmine Bonanno Guitar controller for a music synthesizer
SE451836B (en) * 1984-11-12 1987-11-02 Gustafsson Gert Ove PROCEDURE FOR MANUFACTURING CONCRETE Mass
US4858509A (en) * 1986-09-03 1989-08-22 Marshall Steven C Electric musical string instruments
US5040447A (en) * 1986-09-10 1991-08-20 Casio Computer Co., Ltd. Electronic stringed instrument with fingering operating data memory system and navigate display device
US5146833A (en) 1987-04-30 1992-09-15 Lui Philip Y F Computerized music data system and input/out devices using related rhythm coding
US4791848A (en) 1987-12-16 1988-12-20 Blum Jr Kenneth L System for facilitating instruction of musicians
US4951545A (en) * 1988-04-26 1990-08-28 Casio Computer Co., Ltd. Electronic musical instrument
US5065659A (en) 1988-05-23 1991-11-19 Casio Computer Co., Ltd. Apparatus for detecting the positions where strings are operated, and electronic musical instruments provided therewith
US5153364A (en) 1988-05-23 1992-10-06 Casio Computer Co., Ltd. Operated position detecting apparatus and electronic musical instruments provided therewith
JPH027096A (en) 1988-06-27 1990-01-11 Casio Comput Co Ltd Electronic musical instrument
US4960031A (en) 1988-09-19 1990-10-02 Wenger Corporation Method and apparatus for representing musical information
US5147970A (en) 1989-08-11 1992-09-15 Casio Computer Co., Ltd. Electronic musical instrument for generating musical tones on the basis of characteristics of input waveform signal
US5140890A (en) * 1990-01-19 1992-08-25 Gibson Guitar Corp. Guitar control system
US5074182A (en) 1990-01-23 1991-12-24 Noise Toys, Inc. Multiple key electronic instrument having background songs each associated with solo parts which are synchronized with and harmonious with the background song
US5270475A (en) 1991-03-04 1993-12-14 Lyrrus, Inc. Electronic music system
US5140887A (en) 1991-09-18 1992-08-25 Chapman Emmett H Stringless fingerboard synthesizer controller
US5135426A (en) 1991-12-23 1992-08-04 Lin Goang Wen Toy stringed instrument
US5557057A (en) 1991-12-27 1996-09-17 Starr; Harvey W. Electronic keyboard instrument
US5464946A (en) 1993-02-11 1995-11-07 Multimedia Systems Corporation System and apparatus for interactive multimedia entertainment
US5670729A (en) 1993-06-07 1997-09-23 Virtual Music Entertainment, Inc. Virtual music instrument with a novel input device
US5585583A (en) 1993-10-14 1996-12-17 Maestromedia, Inc. Interactive musical instrument instruction system
US5690496A (en) 1994-06-06 1997-11-25 Red Ant, Inc. Multimedia product for use in a computer for music instruction and use
WO1996004642A1 (en) * 1994-08-01 1996-02-15 Zeta Music Partners Timbral apparatus and method for musical sounds
JP3460408B2 (en) 1995-09-22 2003-10-27 ヤマハ株式会社 Music control device
DE19535712C1 (en) * 1995-09-26 1996-10-31 Fichtel & Sachs Ag Friction clutch in vehicle drive line, with housing fixed to combustion engine flywheel
US5792971A (en) 1995-09-29 1998-08-11 Opcode Systems, Inc. Method and system for editing digital audio information with music-like parameters
JP3153761B2 (en) 1996-03-06 2001-04-09 株式会社ナムコ Game screen display method and game device
JP2919389B2 (en) 1996-08-05 1999-07-12 パイオニア株式会社 Video dance game device and information recording medium
US6369313B2 (en) 2000-01-13 2002-04-09 John R. Devecka Method and apparatus for simulating a jam session and instructing a user in how to play the drums
JP4120017B2 (en) 1997-01-30 2008-07-16 株式会社セガ INPUT DEVICE, GAME PROCESSING DEVICE, AND METHOD THEREOF
US6015247A (en) * 1997-12-17 2000-01-18 Branaman; Vincent E. Article assembly and alignment machine and method
EP0982055B1 (en) * 1997-12-19 2005-11-16 Konami Co., Ltd. Method of controlling video game, video game device, and medium recording video game program
JPH11219443A (en) 1998-01-30 1999-08-10 Konami Co Ltd Method and device for controlling display of character image, and recording medium
JPH11300039A (en) * 1998-04-24 1999-11-02 Namco Ltd Game device and information storage medium
JP2951948B1 (en) 1998-07-01 1999-09-20 コナミ株式会社 Game system and computer-readable storage medium storing program for executing the game
US5990405A (en) 1998-07-08 1999-11-23 Gibson Guitar Corp. System and method for generating and controlling a simulated musical concert experience
JP2000237455A (en) 1999-02-16 2000-09-05 Konami Co Ltd Music production game device, music production game method, and readable recording medium
JP3261110B2 (en) 1999-02-16 2002-02-25 コナミ株式会社 Game system and computer-readable storage medium
JP3053090B1 (en) 1999-02-26 2000-06-19 コナミ株式会社 Music game system, game control method suitable for the game system, and computer-readable storage medium
DE60044794D1 (en) 1999-02-26 2010-09-23 Konami Digital Entertainment Turntable adapter for a game device
JP2001083965A (en) 1999-09-16 2001-03-30 Namco Ltd Plucked string type electronic instrument
US6162981A (en) 1999-12-09 2000-12-19 Visual Strings, Llc Finger placement sensor for stringed instruments
JP2001212369A (en) 2000-02-01 2001-08-07 Konami Co Ltd Amusement system with typing practice function, typing practice system, and computer-readable memory medium
US6429863B1 (en) 2000-02-22 2002-08-06 Harmonix Music Systems, Inc. Method and apparatus for displaying musical data in a three dimensional environment
JP2003536106A (en) * 2000-04-07 2003-12-02 サーディス・ディヴェロプメンツ・リミテッド Interactive multimedia device
JP2001344049A (en) * 2000-06-01 2001-12-14 Konami Co Ltd Operation instructing system and computer readable storage medium to be used for the same system
JP3547374B2 (en) 2000-06-23 2004-07-28 コナミ株式会社 GAME SYSTEM AND STORAGE MEDIUM USED FOR THE SAME
JP3351780B2 (en) 2000-07-10 2002-12-03 コナミ株式会社 Game consoles and recording media
JP3566195B2 (en) 2000-08-31 2004-09-15 コナミ株式会社 GAME DEVICE, GAME PROCESSING METHOD, AND INFORMATION STORAGE MEDIUM
JP2002066128A (en) 2000-08-31 2002-03-05 Konami Co Ltd Game device, game processing method, and information recording medium
US6482087B1 (en) 2001-05-14 2002-11-19 Harmonix Music Systems, Inc. Method and apparatus for facilitating group musical interaction over a network
US6822153B2 (en) 2001-05-15 2004-11-23 Nintendo Co., Ltd. Method and apparatus for interactive real time music composition
US6969797B2 (en) 2001-11-21 2005-11-29 Line 6, Inc Interface device to couple a musical instrument to a computing device to allow a user to play a musical instrument in conjunction with a multimedia presentation
US6777608B1 (en) 2002-01-12 2004-08-17 Travis Redding Integrated sound trigger musical instruments
JP3578273B2 (en) 2002-02-22 2004-10-20 コナミ株式会社 General-purpose keyboard setting program for keyboard game program
AU2003253229A1 (en) 2002-07-12 2004-02-02 Thurdis Developments Limited Digital musical instrument system
US6979767B2 (en) 2002-11-12 2005-12-27 Medialab Solutions Llc Systems and methods for creating, modifying, interacting with and playing musical compositions
JP3941707B2 (en) 2003-02-17 2007-07-04 ヤマハ株式会社 Electronic musical instruments
WO2004111992A2 (en) * 2003-06-09 2004-12-23 Ierymenko Paul F A player technique control system for a stringed instrument and method of playing the instrument
US7806759B2 (en) 2004-05-14 2010-10-05 Konami Digital Entertainment, Inc. In-game interface with performance feedback
WO2007054948A2 (en) * 2005-11-14 2007-05-18 Gil Kotton Method and system for reproducing sound and producing synthesizer control data from data collected by sensors coupled to a string instrument
US7304232B1 (en) 2006-02-11 2007-12-04 Postell Mood Nicholes Joystick gain control for dual independent audio signals
US20070209496A1 (en) * 2006-03-08 2007-09-13 Marco Antonio Lenzi Musical instrument string damper
EP2027577B1 (en) * 2006-03-29 2019-05-08 Harmonix Music Systems, Inc. Game controller simulating a guitar
US7304224B1 (en) 2006-10-05 2007-12-04 Bettis Linda P Exercise and training device for acoustic guitar players
US8072418B2 (en) 2007-05-31 2011-12-06 Disney Enterprises, Inc. Tactile feedback mechanism using magnets to provide trigger or release sensations
WO2009052032A1 (en) * 2007-10-19 2009-04-23 Sony Computer Entertainment America Inc. Scheme for providing audio effects for a musical instrument and for controlling images with same
US20090264199A1 (en) * 2008-04-16 2009-10-22 Macedon Productions, Inc. Using a Musical Instrument as a Video Game Controller

Patent Citations (110)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3015247A (en) * 1960-04-20 1962-01-02 Gibson Inc Mute means for string musical instruments
US4263520A (en) * 1978-04-19 1981-04-21 Nippon Gakki Seizo Kabushiki Kaisha Signal detecting circuit for electronic musical instrument
US4372187A (en) * 1981-05-01 1983-02-08 Ab Laboratories, A Limited Partnership Novel guitar-like electronic musical instrument
US4580479A (en) * 1983-02-28 1986-04-08 Octave-Plateau Electronics Inc. Guitar controller
US4653376A (en) * 1984-09-21 1987-03-31 David Allured Electronic sensing system for a stringed and fretted musical instrument
US4730530A (en) * 1986-02-28 1988-03-15 Cfj Systems, Inc. Guitar controller pickup and method for generating trigger signals for a guitar controlled synthesizer
US4748887A (en) * 1986-09-03 1988-06-07 Marshall Steven C Electric musical string instruments and frets therefor
US5113742A (en) * 1987-03-24 1992-05-19 Casio Computer Co., Ltd. Electronic stringed instrument
US4919031A (en) * 1987-03-24 1990-04-24 Casio Computer Co., Ltd. Electronic stringed instrument of the type for controlling musical tones in response to string vibration
US5094137A (en) * 1987-03-24 1992-03-10 Casio Computer Co., Ltd. Electronic stringed instrument with control of musical tones in response to a string vibration
US4823667A (en) * 1987-06-22 1989-04-25 Kawai Musical Instruments Mfg. Co., Ltd. Guitar controlled electronic musical instrument
US5121669A (en) * 1987-10-07 1992-06-16 Casio Computer Co., Ltd. Electronic stringed instrument
US5025703A (en) * 1987-10-07 1991-06-25 Casio Computer Co., Ltd. Electronic stringed instrument
US5223659A (en) * 1988-04-25 1993-06-29 Casio Computer Co., Ltd. Electronic musical instrument with automatic accompaniment based on fingerboard fingering
US5024134A (en) * 1988-05-02 1991-06-18 Casio Computer Co., Ltd. Pitch control device for electronic stringed instrument
US5014588A (en) * 1988-06-03 1991-05-14 Casio Computer Co., Ltd. Electronic stringed musical instrument with a string vibration detecting apparatus
US5001960A (en) * 1988-06-10 1991-03-26 Casio Computer Co., Ltd. Apparatus for controlling reproduction on pitch variation of an input waveform signal
US5010800A (en) * 1988-09-20 1991-04-30 Casio Computer Co., Ltd. Electronic musical instrument capable of selecting between fret and fretless modes
US5085120A (en) * 1988-12-26 1992-02-04 Casio Computer Co., Ltd. Electronic stringed musical instrument with parameter selecting function
US4986157A (en) * 1988-12-28 1991-01-22 Casio Computer Co., Ltd. Electronic musical instrument with a fret-split function
US5206446A (en) * 1989-01-18 1993-04-27 Casio Computer Co., Ltd. Electronic musical instrument having a plurality of tone generation modes
US4939471A (en) * 1989-05-05 1990-07-03 Aphex Systems Ltd. Impulse detection circuit
US5305674A (en) * 1989-05-15 1994-04-26 Korg/Fishpark Associates Stringed musical instrument with visual images
US5308916A (en) * 1989-12-20 1994-05-03 Casio Computer Co., Ltd. Electronic stringed instrument with digital sampling function
US5398585A (en) * 1991-12-27 1995-03-21 Starr; Harvey Fingerboard for musical instrument
US5300730A (en) * 1992-12-07 1994-04-05 Ekhaus Ira B Device for controlling musical effects on a guitar
US5902949A (en) * 1993-04-09 1999-05-11 Franklin N. Eventoff Musical instrument system with note anticipation
US5726372A (en) * 1993-04-09 1998-03-10 Franklin N. Eventoff Note assisted musical instrument system and method of operation
US5491297A (en) * 1993-06-07 1996-02-13 Ahead, Inc. Music instrument which generates a rhythm EKG
US5393926A (en) * 1993-06-07 1995-02-28 Ahead, Inc. Virtual music system
US5723802A (en) * 1993-06-07 1998-03-03 Virtual Music Entertainment, Inc. Music instrument which generates a rhythm EKG
US5744744A (en) * 1993-10-28 1998-04-28 Kabushiki Kaisha Kawai Gakki Seisakusho Electric stringed instrument having automated accompaniment system
US5773742A (en) * 1994-01-05 1998-06-30 Eventoff; Franklin Note assisted musical instrument system and method of operation
US5488196A (en) * 1994-01-19 1996-01-30 Zimmerman; Thomas G. Electronic musical re-performance and editing system
US5602356A (en) * 1994-04-05 1997-02-11 Franklin N. Eventoff Electronic musical instrument with sampling and comparison of performance data
US5746605A (en) * 1994-06-06 1998-05-05 Red Ant, Inc. Method and system for music training
US5710387A (en) * 1995-01-12 1998-01-20 Yamaha Corporation Method for recognition of the start of a note in the case of percussion or plucked musical instruments
US5717155A (en) * 1995-06-16 1998-02-10 Yamaha Corporation Synthesizer detecting pitch and plucking point of stringed instrument to generate tones
US5777251A (en) * 1995-12-07 1998-07-07 Yamaha Corporation Electronic musical instrument with musical performance assisting system that controls performance progression timing, tone generation and tone muting
US5627331A (en) * 1996-03-05 1997-05-06 Devitrysmith; T. John Guitar having improved accessibility for string attachment
US5786541A (en) * 1996-05-18 1998-07-28 Yamaha Corporation Musical tone synthesizing apparatus
US5728960A (en) * 1996-07-10 1998-03-17 Sitrick; David H. Multi-dimensional transformation systems and display communication architecture for musical compositions
US5739457A (en) * 1996-09-26 1998-04-14 Devecka; John R. Method and apparatus for simulating a jam session and instructing a user in how to play the drums
US6268557B1 (en) * 1996-09-26 2001-07-31 John R. Devecka Methods and apparatus for providing an interactive musical game
US5925843A (en) * 1997-02-12 1999-07-20 Virtual Music Entertainment, Inc. Song identification and synchronization
US6242682B1 (en) * 1997-07-08 2001-06-05 Gibson Guitar Corp. Component mount and components for musical instruments
US6075194A (en) * 1997-07-08 2000-06-13 Gibson Guitar Corp. Component mount and components for musical instruments
US6379244B1 (en) * 1997-09-17 2002-04-30 Konami Co., Ltd. Music action game machine, performance operation instructing system for music action game and storage device readable by computer
US6010403A (en) * 1997-12-05 2000-01-04 Lbe Technologies, Inc. System and method for displaying an interactive event
US5864083A (en) * 1997-12-18 1999-01-26 Caren; Michael P. Musical effect controller and system for an electric guitar
US7038123B2 (en) * 1998-05-15 2006-05-02 Ludwig Lester F Strumpad and string array processing for musical instruments
US6852919B2 (en) * 1998-05-15 2005-02-08 Lester F. Ludwig Extensions and generalizations of the pedal steel guitar
US6410835B2 (en) * 1998-07-24 2002-06-25 Konami Co., Ltd. Dance game apparatus and step-on base for dance game
US6225547B1 (en) * 1998-10-30 2001-05-01 Konami Co., Ltd. Rhythm game apparatus, rhythm game method, computer-readable storage medium and instrumental device
US6425822B1 (en) * 1998-11-26 2002-07-30 Konami Co., Ltd. Music game machine with selectable controller inputs
US6738059B1 (en) * 1998-12-18 2004-05-18 Kabushiki Kaisha Sega Enterprises Apparatus and methods for image processing using mixed display objects
US6091013A (en) * 1998-12-21 2000-07-18 Waller, Jr.; James K. Attack transient detection for a musical instrument signal
US6049034A (en) * 1999-01-19 2000-04-11 Interval Research Corporation Music synthesis controller and method
US6191350B1 (en) * 1999-02-02 2001-02-20 The Guitron Corporation Electronic stringed musical instrument
US6342665B1 (en) * 1999-02-16 2002-01-29 Konami Co., Ltd. Music game system, staging instructions synchronizing control method for same, and readable recording medium recorded with staging instructions synchronizing control program for same
US6177623B1 (en) * 1999-02-26 2001-01-23 Konami Co., Ltd. Music reproducing system, rhythm analyzing method and storage medium
US6888057B2 (en) * 1999-04-26 2005-05-03 Gibson Guitar Corp. Digital guitar processing circuit
US7220912B2 (en) * 1999-04-26 2007-05-22 Gibson Guitar Corp. Digital guitar system
US6686530B2 (en) * 1999-04-26 2004-02-03 Gibson Guitar Corp. Universal digital media communications and control system and method
US6347998B1 (en) * 1999-06-30 2002-02-19 Konami Co., Ltd. Game system and computer-readable recording medium
US6554711B1 (en) * 1999-06-30 2003-04-29 Konami Co., Ltd. Music game machine with interactive second game device
US6252153B1 (en) * 1999-09-03 2001-06-26 Konami Corporation Song accompaniment system
US6390923B1 (en) * 1999-11-01 2002-05-21 Konami Corporation Music playing game apparatus, performance guiding image display method, and readable storage medium storing performance guiding image forming program
US6175070B1 (en) * 2000-02-17 2001-01-16 Musicplayground Inc. System and method for variable music notation
US6353165B1 (en) * 2000-03-10 2002-03-05 First Act, Inc. String instrument with protective string cap
US6452081B1 (en) * 2000-05-18 2002-09-17 Steven F. Ravagni Stringed instrument finger positioning guide and method for teaching students to read music
US6541692B2 (en) * 2000-07-07 2003-04-01 Allan Miller Dynamically adjustable network enabled method for playing along with music
US6541688B2 (en) * 2000-12-28 2003-04-01 Yamaha Corporation Electronic musical instrument with performance assistance function
US6846980B2 (en) * 2001-01-31 2005-01-25 Paul D. Okulov Electronic-acoustic guitar with enhanced sound, chord and melody creation system
US6515211B2 (en) * 2001-03-23 2003-02-04 Yamaha Corporation Music performance assistance apparatus for indicating how to perform chord and computer program therefor
US7030307B2 (en) * 2001-06-12 2006-04-18 Douglas Wedel Music teaching device and method
US6995310B1 (en) * 2001-07-18 2006-02-07 Emusicsystem Method and apparatus for sensing and displaying tablature associated with a stringed musical instrument
US7223913B2 (en) * 2001-07-18 2007-05-29 Vmusicsystems, Inc. Method and apparatus for sensing and displaying tablature associated with a stringed musical instrument
US7174510B2 (en) * 2001-10-20 2007-02-06 Hal Christopher Salter Interactive game providing instruction in musical notation and in learning an instrument
US7030311B2 (en) * 2001-11-21 2006-04-18 Line 6, Inc System and method for delivering a multimedia presentation to a user and to allow the user to play a musical instrument in conjunction with the multimedia presentation
US6740803B2 (en) * 2001-11-21 2004-05-25 Line 6, Inc Computing device to allow for the selection and display of a multimedia presentation of an audio file and to allow a user to play a musical instrument in conjunction with the multimedia presentation
US20060107819A1 (en) * 2002-10-18 2006-05-25 Salter Hal C Game for playing and reading musical notation
US7169996B2 (en) * 2002-11-12 2007-01-30 Medialab Solutions Llc Systems and methods for generating music using data/music data file transmitted/received via a network
US7166794B2 (en) * 2003-01-09 2007-01-23 Gibson Guitar Corp. Hexaphonic pickup for digital guitar system
US7220913B2 (en) * 2003-01-09 2007-05-22 Gibson Guitar Corp. Breakout box for digital guitar
US7220906B2 (en) * 2003-03-20 2007-05-22 Yamaha Corporation String-instrument type electronic musical instrument
US7164076B2 (en) * 2004-05-14 2007-01-16 Konami Digital Entertainment System and method for synchronizing a live musical performance with a reference performance
US20070051224A1 (en) * 2005-09-02 2007-03-08 M.A.C.E. Music Inc. String dampener for a stringed musical instrument
US20070234885A1 (en) * 2006-03-29 2007-10-11 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US8003872B2 (en) * 2006-03-29 2011-08-23 Harmonix Music Systems, Inc. Facilitating interaction with a music-based video game
US7521619B2 (en) * 2006-04-19 2009-04-21 Allegro Multimedia, Inc. System and method of instructing musical notation for a stringed instrument
US20070256540A1 (en) * 2006-04-19 2007-11-08 Allegro Multimedia, Inc System and Method of Instructing Musical Notation for a Stringed Instrument
US20080028920A1 (en) * 2006-08-04 2008-02-07 Sullivan Daniel E Musical instrument
US7320643B1 (en) * 2006-12-04 2008-01-22 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US8079901B2 (en) * 2006-12-04 2011-12-20 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US20130036897A1 (en) * 2007-02-20 2013-02-14 Ubisoft Entertainment S.A. Instrument game system and method
US20090064849A1 (en) * 2007-09-12 2009-03-12 Ronald Festejo Method and apparatus for self-instruction
US7714220B2 (en) * 2007-09-12 2010-05-11 Sony Computer Entertainment America Inc. Method and apparatus for self-instruction
US20110011248A1 (en) * 2007-09-29 2011-01-20 Elion Clifford S Electronic fingerboard for stringed instrument
US8017857B2 (en) * 2008-01-24 2011-09-13 745 Llc Methods and apparatus for stringed controllers and/or instruments
US20100234109A1 (en) * 2008-01-24 2010-09-16 745 Llc Fret and method of manufacturing frets for stringed controllers and instruments
US20110218022A1 (en) * 2008-01-24 2011-09-08 745 Llc Methods and apparatus for stringed controllers and instruments
US20090188371A1 (en) * 2008-01-24 2009-07-30 745 Llc Methods and apparatus for stringed controllers and/or instruments
US8246461B2 (en) * 2008-01-24 2012-08-21 745 Llc Methods and apparatus for stringed controllers and/or instruments
US20090191932A1 (en) * 2008-01-24 2009-07-30 745 Llc Methods and apparatus for stringed controllers and/or instruments
US8454418B2 (en) * 2008-01-24 2013-06-04 745 Llc Methods and apparatus for stringed controllers and instruments
US8469812B2 (en) * 2008-01-24 2013-06-25 745 Llc Fret and method of manufacturing frets for stringed controllers and instruments
US20100087254A1 (en) * 2008-10-07 2010-04-08 Zivix Llc Systems and methods for a digital stringed instrument
US20120132057A1 (en) * 2009-06-12 2012-05-31 Ole Juul Kristensen Generative Audio Matching Game System
US20110011241A1 (en) * 2009-07-17 2011-01-20 Bartos James Self-teaching and entertainment guitar systems

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8618402B2 (en) * 2006-10-02 2013-12-31 Harman International Industries Canada Limited Musical harmony generation from polyphonic audio signals
US8017857B2 (en) 2008-01-24 2011-09-13 745 Llc Methods and apparatus for stringed controllers and/or instruments
US8246461B2 (en) 2008-01-24 2012-08-21 745 Llc Methods and apparatus for stringed controllers and/or instruments

Also Published As

Publication number Publication date
US8017857B2 (en) 2011-09-13
US20090191932A1 (en) 2009-07-30
US8246461B2 (en) 2012-08-21
EP2244796A1 (en) 2010-11-03
JP2011509800A (en) 2011-03-31
AU2009206663A1 (en) 2009-07-30
AU2009206663A2 (en) 2010-08-26
US20090188371A1 (en) 2009-07-30
CN101977663A (en) 2011-02-16
CA2712082A1 (en) 2009-07-30
WO2009094180A1 (en) 2009-07-30

Similar Documents

Publication Publication Date Title
US8017857B2 (en) Methods and apparatus for stringed controllers and/or instruments
US8454418B2 (en) Methods and apparatus for stringed controllers and instruments
US8469812B2 (en) Fret and method of manufacturing frets for stringed controllers and instruments
CN102159290B (en) Touch sensing gaming peripheral for musical game
US8777747B2 (en) System and method for playing a music video game with a drum system game controller
US8827806B2 (en) Music video game and guitar-like game controller
JP2000347657A (en) Virtual musical instrument with new input device
EP3788617A1 (en) An input device with a variable tensioned joystick with travel distance for operating a musical instrument, and a method of use thereof
WO2007135791A1 (en) Data computing unit for music game, data computing program for music game, and data computing method for music game
US20130190092A1 (en) Control device for a game console and a method for controlling a game console
US10002598B2 (en) Selective pitch emulator for electrical stringed instruments
WO2011071552A1 (en) Methods and apparatus for stringed controllers and instruments
KR20130108891A (en) Instrument playing system

Legal Events

Date Code Title Description
AS Assignment

Owner name: 745 LLC, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHIU, BERNARD;IZEN, MARK;WEBSTER, STEPHEN PAUL;AND OTHERS;SIGNING DATES FROM 20090130 TO 20090316;REEL/FRAME:025972/0294

AS Assignment

Owner name: FIRST ACT INC., MASSACHUSETTS

Free format text: SECURITY AGREEMENT;ASSIGNOR:745 LLC;REEL/FRAME:026047/0599

Effective date: 20110330

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION