US20110028218A1

US20110028218A1 - Systems and Methods for Wireless Connectivity of a Musical Instrument

Info

Publication number: US20110028218A1
Application number: US12/563,079
Authority: US
Inventors: Stephen Gomes; Greg Hunt; Peter Hunt; Ephraim Lindenbaum; Scot Apathy; Ross Relles
Original assignee: Realta Entertainment Group Inc
Current assignee: Realta Entertainment Group Inc
Priority date: 2009-08-03
Filing date: 2009-09-18
Publication date: 2011-02-03
Also published as: WO2011017717A1

Abstract

In various embodiments, one or more real musical instruments may be used to interact with a program (e.g., a game or learning application) on a digital device such as a game console. A method may comprise receiving a music signal from a port of a real musical instrument, formatting the music signal for transmission to a digital device, wherein the formatted music signal comprises an instrument identifier, and wirelessly transmitting the formatted music signal.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority of U.S. provisional patent application Ser. No. 61/230,894, filed on Aug. 3, 2009, by inventors Stephen Gomes, Greg Hunt, Peter Hunt, Ephraim Lindenbaum, Scot Apathy, and Ross Relles, the application entitled “Interactive Music System Wirelessly Connecting Musical Instruments that Generate Analog Tones to Video Game Consoles and other CPUs for Real-Time Manipulation, Storage and Transmission of Audio Information, Utilizing Stem formatting for Discrete Control of Individual Instrument Tracks” and U.S. provisional patent application Ser. No. 61/236,389, filed on Aug. 24, 2009, by inventors Stephen Gomes, Greg Hunt, Peter Hunt, Ephraim Lindenbaum, Scot Apathy, and Ross Relles, the application entitled “Wireless Musical Instrument Interface and Control Device Encompassing an Analog Input with Integrated A/D Converter, Digital ID Branding, Wireless Broadcast Digital Output, and UI Navigation Controls” which are both incorporated herein by reference in its entirety.

COPYRIGHT NOTICE

A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.

BACKGROUND

1. Field of the Invention
The present invention relates generally to musical instruments. More particularly, the invention relates to systems and methods for wireless connectivity of a musical instrument.
2. Description of Related Art
Games that allow users to play fake instruments to music are not uncommon. In these games, a user purchases a fake instrument that acts as a gaming interface that allows a user to interact with a game. In one example, the fake instrument may resemble a guitar generally but include colorful buttons rather than strings. The fake instrument or toy cannot be used apart from the game console to play music. The colorful buttons may be depressed in time to music based on instructions on a video game. As a player gets more proficient at the game, however, the player does not learn how to use or handle a real musical instrument.
Further, the fake instrument does not play actual music but may provide one or more signals based on the buttons that are pressed. These signals are received by the game console to determine if the correct button was pressed at the right time. Music is not played by the fake instrument and music (or a music signal) is not received by the game console. Although the game console may play music during the game, the music is typically prerecorded and does not generally stem from the fake instrument, but rather may be caused when the player hits one or more buttons on the fake instrument.
Further, games that allow a user to interact and play with the fake instrument in time to music do not instruct the user how to improve technique, instrument handling, chords, or the like. Rather, the games typically test the user's ability to hit buttons in time with prerecorded music. As a result, a proficient game player will not be able to take a real musical instrument decoupled from the game and play music (e.g., as a solo, at a concert, or as a part of an actual band).

SUMMARY

In various embodiments, one or more real musical instruments may be used to interact with a program (e.g., a game or learning application) on a digital device such as a game console. A method may comprise receiving a music signal from a port of a real musical instrument, formatting the music signal for transmission to a digital device, wherein the formatted music signal comprises an instrument identifier, and wirelessly transmitting the formatted music signal.
The method may further comprise receiving an instrument selection. The format of the music signal may be based, at least in part, on the instrument selection. Further, the instrument selection may be received from a keypad.
In some embodiments, the method may further comprise receiving a format selection and wherein the format of the music signal is based, at least in part, on the format selection. Receiving the music signal, formatting the music signal, and transmitting the formatted music signal may be performed by an instrument interface.
The method may further comprise receiving an activation command and activating an instrument interface. The method may also further comprise charging a battery and receiving power from the battery to power an instrument interface to receive the music signal, format the music signal, and transmit the formatted music signal. Transmitting the formatted wireless signal may occur via wireless USB.
In various embodiments, a system comprises an instrument module, a signal processing module, and an antenna. The instrument module may be configured to receive a music signal from a port of a real musical instrument. The signal processing module may be configured to format the music signal for transmission to a digital device, wherein the formatted music signal comprises an instrument identifier. The antenna may be configured to wirelessly transmit the formatted music signal.
An exemplary computer readable medium may comprise executable instructions. The instructions may be executable by a processor to perform a method. The method may comprise receiving a music signal from a port of a real musical instrument, formatting the music signal for transmission to a digital device, wherein the formatted music signal comprises an instrument identifier, and wirelessly transmitting the formatted music signal.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary environment of multiple instruments wirelessly coupled to a game console.

FIG. 2 is a general block diagram of an instrument interface in an embodiment.

FIG. 3 is a general block diagram of an instrument interface in another embodiment.

FIG. 4 is a technical block diagram of an instrument interface in an embodiment.

FIG. 5 is a technical block diagram of an instrument interface in another embodiment.

FIG. 6 is a module diagram of an instrument interface in an embodiment.

FIG. 7 is an exemplary method for wireless connectivity between an instrument interface and a digital device.

FIG. 8 a depicts a front and right side view of the instrument interface in an embodiment.

FIG. 8 b depicts a back side view of the instrument interface in an embodiment.

FIG. 9 is a general block diagram of a game console in an embodiment.

FIG. 10 is a block diagram of an exemplary digital device.

DETAILED DESCRIPTION OF THE INVENTION

In various embodiments, an instrument player may play a real musical instrument and interact with an executable program (e.g., an application) such as a learning environment or game via a digital device such as a game console. The real instrument may be any real musical instrument that may be detached from the digital device and used to play music (e.g., with a band, at a concert, or practice). In some embodiments, the real instrument is not modified or adapted to interact with the learning environment or game. Rather, in some embodiments, the real instrument is coupled with an instrument interface using a standard cable (e.g., an audio cable configured to attach to the real instrument and the instrument interface). In one example, a microphone (i.e., a pickup) may be placed within a real instrument (e.g., guitar or piano). The microphone provides signals to a port. The instrument interface may be coupled to the port on the real instrument over a standard cable or a cable with at least one standard end.
The instrument interface may receive the signal from the real instrument. The instrument interface may then provide the signal to the digital device (e.g., game console). In some embodiments, the instrument interface provides the signal wirelessly via an antenna. The instrument interface may alter, covert, update, modify, format, encode, and/or format the signal. In one example, the instrument interface may convert an analog signal received from the real instrument to transmit to the digital device. The instrument interface may also associate an instrument identifier with the signal and/or transmit the signal over a specific channel.
The digital device may then receive the signal from the instrument interface and allow the user to interact with the learning environment and/or a game (e.g., a program on the digital device). In some embodiments, the digital device executes a program that is an educational and recreational tool that may take users through an entire musical process from learning and practicing, through recording and sharing. The program may include features that support users of all skill levels, from the beginning musician to the accomplished artist.
As the user interacts with the program, the user may learn how to play the real instrument. In one example, the user may receive instruction on how to play the real instrument, be able to play along with songs, receive criticism, see areas of improvements, be tested, receive instruction on areas to be improved, track proficiency of playing, and/or the like
FIG. 1 illustrates an exemplary environment 100 of multiple real instruments 104 a and 104 b wirelessly coupled to a game console 108. The exemplary environment 100 comprises a real instrument 104 a coupled to an instrument interface 106 a and a real instrument 104 b coupled to an instrument interface 106 b. The real instrument 104 a and real instrument 104 b are wirelessly coupled to a game console 108 via the instrument interface 106 a and instrument interface 106 b, respectively. The game console 108 is further coupled to a display 110. In FIG. 1, an instrument player 102 a may play the real instrument 104 a and an instrument player 102 b may play the real instrument 104 b. The instrument players 102 a and 102 b may be any user who interacts with a program on the game console 108 with the real instrument.
The real instruments 104 a and 104 b may comprise any real musical instrument. A real musical instrument is any instrument that may be decoupled from the instrument interface 106 a and 106 b, respectively, decoupled from the game console 108, and used to play music (e.g., in a band, at a concert, or as a solo). The definition of music may differ based on geography, culture, ethnicity, genre, time period, etc. In some embodiments, the real instrument 104 a may be an electric guitar, acoustic guitar, bass guitar, drums, piano, keyboard, or any musical instrument. Although FIG. 1 depicts real instrument 104 a and real instrument 104 b as the same instrument, those skilled in the art will appreciate that the two instruments may be different (e.g., real instrument 104 a may be a keyboard and real instrument 104 b may be bass guitar). Further, although only two instruments are depicted in FIG. 1, there may be any number of real instruments in various embodiments. In another example, a single instrument player 102 a may play with a real instrument 104 a without another player or other real instrument 104 b.
The instrument interfaces 106 a and 106 b are devices that couple to the real instruments 104 a and 104 b, respectively, and communicate with the game console 108. In various embodiments, the instrument interface 106 a allows the real instrument 104 a to transmit signals to the game console 108. In one example, the instrument interface 106 a may be coupled to a port of the real instrument 104 a. The instrument interface 106 a may then receive signals from the real instrument 104 a via the port. The instrument interface 106 a may then provide the signal to the game console 108.
Although the instrument interfaces 106 a and 106 b depict a wireless connection with the game console 108, those skilled in the art will appreciate that the connection may be either by wire or wireless. In other embodiments, different instrument interfaces may provide signals to the game console in different ways. For example, the instrument interface 104 a may be wirelessly coupled with the game console 108 while the instrument interface 106 b may be coupled to the game console via a wire (e.g., Ethernet or USB cable).
Although the instrument interface 106 a is often discussed herein for practicality, those skilled in the art will appreciate that when instrument interface 106 a is referred in some embodiments, any instrument interface (e.g., instrument interface 106 b) may perform similar or the same functions.
In some embodiments, the instrument interface 106 a transmits to the game console 108 which comprises a multi-input wireless hardware receiver that supports multiple real instruments simultaneously. The game console 108 may operate with an integrated API/software encoding/encoding function to pair the game console 108 or CPU of the game console 108 and identify discrete data channels transmitted from the instrument interface 106 a which may enable discrete control of each audio source arriving at the game console 108.
The game console 108 is any digital device configured to receive signals from the instrument interface 106 a and/or instrument interface 106 b. The game console 108, for example, may comprise any digital device including, but not limited to, a Microsoft Xbox™ (e.g., Xbox 360), a Sony Playstation™ (e.g., Playstation 3), or Nintendo Wii™. The game console 108 may also comprise a computer such as an Apple Macintosh computer, personal computer, notebook, netbook, media tablet, smart phone, or the like.
Although FIG. 1 depicts the game console 108 coupled to a display 110, the game console 108 may comprise the display 110 or, in another embodiment, the display 110 may comprise the game console 108. Those skilled in the art will appreciate that the display 110 may comprise a processor and functionality that is configured to function as a game console (e.g., game console 108).
In some embodiments, the game console 108 is configured with a network adaptor or other hardware that is configured to receive wireless signals via the instrument interface 106 a. In other embodiments, the game console 108 may comprise an internal antenna configured to receive wireless signals via the instrument interface 106 a such that a network adaptor is unnecessary. Further, the game console 108 may be configured to be connected via a wire to the instrument interface 106 a.
The game console 108 may perform many functions. For example, the game console 108 may be configured to receive the wireless signal, route to an assigned channel, apply any attributes, synchronize with any sequential files, merge input data with an audio file stream (e.g., with all or some of a prerecorded song) and either store or output a merged audio stream.
The display 110 may comprise any display such as a television or computer screen. In some embodiments the display 110 is a flat panel display such as an LCD or plasma display. The display 110 may comprise a rear or forward projection display. Those skilled in the art will appreciate that the display 110 is any device that is configured to display images such as pictures, animation, broadcast television, and/or the like.
FIG. 2 is a general block diagram of an instrument interface 106 a in an embodiment. The instrument interface 106 a may comprise a mini USB port 202, a battery charge circuit 204, a battery and regulation module 206, an EEPROM 208, instructions 210, supporting circuitry 212, an analog input port 214, an ADC module 216, a wireless chip 218, and an onboard antenna 220.
The mini USB port 202 is any port that may be used to couple the instrument interface 106 a with a real instrument 104 a or digital device (e.g., game console 108). Although the port is described as a mini USB port, the mini USB port 202 may comprise any kind of port for any kind of wired topology including, but not limited to, USB, firewire, Ethernet, serial, or parallel. In another example, the mini USB port 202 may not be a mini USB port, but may comprise any connector for USB including but not limited to standard type A, standard type B, mini A, mini B, micro AB, and micro B. Further, although FIG. 2 depicts a single port, those skilled in the art will appreciate that there may be any number of ports including a combination of different types of ports.
The battery charge circuit 204 is any circuit that is configured to charge a battery and/or power the instrument interface 106 a. In one example, the battery charge circuit may charge a battery with power retrieved from the mini USB port 202. In some embodiments, the battery charge circuit 204 may comprise a separate port that receives power from a digital device (not depicted) or other power sources (e.g., from a wall outlet and/or a power adaptor). The battery charge circuit 204 may also be configured to step up, step down, or otherwise adapt received power such that the power is suitable to power the instrument interface 106 a directly and/or charge the battery. For example, the battery charge circuit may be configured to adapt power received from a country with different power standards or other sources such that the power may be used to charge the battery.
The battery and regulation module 206 is configured to power the instrument interface 106 a. In some embodiments, the battery and regulation module 206 comprises a battery including, but not limited to, a lithium (e.g., coin), alkaline, lithium ion, or nickel metal hydride battery. In various embodiments, the battery and regulation module 206 may comprise a capacitor or any device configured to store energy to power the instrument interface 106 a. The battery and regulation module 206 may also be configured to regulate the power and power the instrument interface 106 a. In one example, the battery and regulation module 206 is configured to step up power stored in a battery to power the instrument interface 106 a. The battery and regulation module 206 may also function as a surge protector and/or an EMI/RFI filter.
The EEPROM 208 may comprise Electrically Erasable Programmable Read-Only Memory (i.e., EEPROM) or any kind of nonvolatile memory (e.g., EPROM, PROM, ROM, flash, or hard drive). Instructions 210 may be loaded into the EEPROM 208. The instructions 210 may configure the instrument interface 106 a to receive one or more signals from the real instrument 104 a, process the signal(s), and provide the signal(s) to the game console 108 (e.g., via the onboard antenna 220 and/or the mini USB port 202). In some embodiments, the instructions 210 configure the instrument interface 106 a to associate an instrument identifier with the real instrument 104 a, one or more signals received from the analog input port 214, and/or one or more signals provided to the game console 108. The instructions 210 may also allow the selection of a channel to provide signals to the game console 108.
The supporting circuitry 212 may be any circuitry that processes the signal(s) received via the analog input port 214. In some embodiments, the supporting circuitry 212 may control the ADC module and/or the wireless chip 218. In various embodiments, the supporting circuitry 212 is configured by the instructions 210 to associate the instrument identifier with the real instrument 104 a, one or more signals received from the analog input port 214, and/or one or more signals provided to the game console 108.
The analog input port 214 is any port that is configured to be coupled with the real instrument 104 a. In some embodiments, the analog input port 214 is configured to receive an analog jack via a cable coupled to the real instrument 104 a. In various embodiments, the analog input port 214 may receive an analog signal from the real instrument 104 a and provide the signal to the ADC module 216. In one example, the analog input port 214 may be configured to receive a ¼″ jack. In various embodiments, the analog input port 214 may receive a MIDI or other digital signal from the real instrument and provide the signal directly to the wireless chip 218.
The ADC module 216 may comprise an analog to digital converter configured to convert an analog signal received from the real instrument 104 a via the analog input port 214 to a digital signal. The signal may also be processed by the supporting circuitry 212 to modify the signal (e.g., equalize, amplify, attenuate noise, and/or enhance sound quality) or adapt the signal (e.g., associate the digital signal with an instrument identifier, format the signal, or place the digital signal into a condition that may be received by the wireless chip, or prepare the signal to be provided via a channel). In one example, the ADC module 216 may sample 16 bit audio at a 44 KHz sampling rate.
The wireless chip 218 is any hardware or software that is configured to process the digital signal received from the ADC module 216 and prepare the signal to be transmitted via the onboard antenna 220. In some embodiments, the wireless chip 218 may be configured by the instructions 210 and/or the supporting circuitry 212 to adapt the digital signal so that it is suitable for one or more different game consoles 108, real instruments, or different antenna. In one example, the instrument player 102 a may configure the EEPROM 208 to identify the game console 108 as an XBOX 360 and/or identify the real instrument 104 a (e.g., as an acoustic guitar). The EEPROM 208 may configure to the supporting circuitry 212, the ADC module 216, and/or the wireless chip 218 to process signals received from the real instrument 104 a appropriately (e.g., process the signals such that they may be understood by the game console 108, identify the real instrument 104 a, and/or associate the signal with an instrument identifier that may be understood by the game console 108). The wireless chip 218 may provide data to be transmitted in one or more channels that are transmitted by the onboard antenna 220.
The onboard antenna 220 is any antenna configured to provide a signal to the game console 108 and/or any digital device. In some embodiments, the onboard antenna 220 is any antenna that is contained within the instrument interface 106 a. In various embodiments, the instrument interface 106 a may comprise a port which may be used to couple the instrument interface 106 a to an external antenna. In other embodiments, the instrument interface 106 a may not comprise or be coupled to an antenna and, rather, may be coupled to the game console 108 via a cable.
Although the instrument interface 106 a is depicted as comprising an onboard antenna 220, those skilled in the art will appreciate that, in some embodiments, the instrument interface 106 a may be coupled to any antenna. In some embodiments, the instrument interface 106 a may be coupled with a network adaptor that comprises an antenna. In one example, the mini USB port 202 may be coupled to a USB antenna that is configured to provide signals to the game console 108. In various embodiments, the instrument interface 106 a may both receive and provide signals with the game console 108, one or more real instruments, and/or one or more other instrument interfaces.
Although the instrument interface 106 a is depicted as comprising the analog input port 214, those skilled in the art will appreciate that the instrument interface 106 a may be coupled with the real instrument 104 a in any number of ways including different cables and/or wirelessly. In some embodiments, the onboard antenna 220 may be used to communicate with the real instrument 104 a as well as the game console 108. Further, in some embodiments, the input port may be a digital input port configured to receive a digital signal from the real instrument 104 a.
In some embodiments, the instrument interface 106 a does not associate a digital identifier but rather provides signals in a different channel than that of other instrument interfaces. In one example, the user may input a channel selection manually via an interface on the instrument interface 106 a or select a channel via the program on the game console 108. In another example, the user may input a channel selection into the instrument interface 106 a over a USB cable with a digital device. In some embodiments, the instrument interface 106 a may automatically try different channels until one is found that is unused or upon confirmation that the channel is assigned by the game console 108. Once each instrument interface 106 a provides signals in a different channel, the game console 108 may separate the signals and process the music and input from the different instrument interfaces separately. As a result, multiple users with multiple real instruments may interact with each other and the program on the game console 108. Those skilled in the art will appreciate that there are many ways in which users may provide their signals so as to interact with each other, the real instruments, and the program on the game console 108.
FIG. 3 is a general block diagram of an instrument interface 106 a in another embodiment. The instrument interface 106 a comprises an audio codec 302 as well as a keypad 312 and a power module 320. The audio codec 302 comprises an audio connection 304 and a general purpose input/output connection (GPIO) 306. The audio codec 302 may comprise any codec that is configured to receive signals from the real instrument 104 a and provide the signal to the game console 108 (see FIG. 1). In some embodiments, the audio codec 302 comprises any integrated chip configured to process audio signals.
The audio connector 304 may comprise a line out port 308 and a line in port 310. The line in port 310 may be configured to receive a cable from real instrument 104 a or any real musical instrument. The audio codec 302 may receive a signal from the real instrument 104 a via the line in port 310. In various embodiments, the real instrument 104 a may use any standard cable used with the real instrument 104 a to couple with the line in port 310.
The line out port 308 is any port that is configured to receive a signal from the audio codec 302. In some embodiments, the line out port 308 may be configured to output an analog signal from the real instrument 310 without processing by the audio codec 302 (e.g., which may, in turn, be received by an amplifier, speaker, or other device). In other embodiments, the line out port 308 may output a digital signal after an analog signal received by the line in port 310 is converted via an ADC. In some embodiments, the audio connector 304 may only comprise a line in port 310.
In various embodiments, the user may output a mixed signal from the instrument interface 106 a through the line out port 308. In one example, the instrument interface 106 a may provide a signal from the real instrument 104 a to the game console 108. The game console 108 may mix a song with the signal from the user (e.g., by removing a track from the song and combining the remaining tracks of the song with the user's playing of the real instrument 104 a) and provide the mixed result back to the instrument interface (e.g., via the wireless antenna 316). The instrument interface 106 a may output the mixed result via the line out port 308. The user may couple any device to the line out port 308 to receive the mixed result (e.g., speakers, headphones, amplifier, or other devices). Those skilled in the art will appreciate that the line out port 308 may be configured to output the sound from the real instrument 104 a, a song from the game console 108, audio from the game console 108, or any other signal.
The GPIO 306 is any port configured to be coupled with a keypad or other interface. In one example, the GPIO 306 is coupled with keypad 312. Although GPIO 306 is identified as a GPIO interface, those skilled in the art will appreciate that any interface configured to be coupled (either with a wire or wirelessly) with a user input device (e.g., a keyboard, keypad, game controller, joystick, or mouse).
Keypad 312 is any keypad configured to receive user input. In one example, the keypad 312 may be able to detect user input indicating a direction (e.g., up, down, left, and/or right) and an enter function. The keypad 312 may comprise, for example, keys (e.g., buttons), a joystick, switches, a touchscreen, or any combination of key, joystick, switch, and/or touchscreen. A keypad on an instrument interface 106 in some embodiments is depicted in FIG. 8 a.
The audio codec 302 may be coupled with a mini USB connector/USB connector 314. In various embodiments, the audio codec 302 comprises a port (e.g., mini USB port 202) configured to receive the mini USB connector/USB connector 314. In various embodiments, the mini USB connector/USB connector 314 may be a cable coupled with a game controller, digital device, game controller 108, or display 110. In some embodiments, the mini USB connector/USB connector 314 comprises a wireless adaptor (comprising the wireless antenna 316) with a USB connector. As discussed previously, the mini USB connector/USB connector 314 is not limited to USB and may be any connector. In some embodiments, the instrument interface 106 a does not comprise a USB port and may not be configured to be coupled to the mini USB connector/USB connector 314.
Wireless antenna 316 is any wireless antenna configured to provide and/or receive signals between the instrument interface 106 a and a game controller 108, display 110, and/or another instrument interface 106 a. In some embodiments, the wireless antenna 316 is external to the instrument interface 106 a. For example, the wireless antenna 316 may be coupled to the instrument interface 106 a via the mini USB connector/USB connector 314. In other embodiments, the instrument interface 106 a may be configured to only connect to a game controller 108, display 110, and/or another instrument interface 106 a via a wire.
The instrument interface may also comprise an optional LED indicator 318. The LED indicator 318 may be configured to display a light to indicate that the instrument interface 106 a is active (e.g., turned on). The LED indicator 318 may also indicate when the instrument interface 106 a is functioning, when the instrument interface 106 a is charged, or in need of being charged. The LED indicator 318 may also indicate when the instrument interface 106 a is being configured or if an error has occurred. In some examples, different lights, colors, or blinking may indicate different functions (e.g., blinking when the instrument interface 106 a may need to be charged or an error has occurred). Those skilled in the art will appreciate that the LED indicator 318 is not limited to an LED but may be any visual indicator including a display screen and/or may be any kind of light. In some embodiments, the instrument interface 106 a may comprise a speaker to make sounds in addition to or in place of the LED indicator 318.
The instrument interface 106 a also comprises a power module 320. The power module 320 is configured to power the instrument interface 106 a. In various embodiments, the power module 320 comprises a power supply 322, a charger 324, and a battery 326. The power supply 322 provides power to the various components of the instrument interface 106 a. In various embodiments, the power supply 322 steps up or down the voltage received from the charger 324 and/or from the battery 326. The charger 324 is any charger (e.g., AC adaptor) that is configured to receive power and provide the power to the power module 320. In some embodiments, the charger 324 receives power via the mini USB conn/USB conn 314 (e.g., from a digital device such as the game console 108). In various embodiments, the charger 326 may condition the power to be received by the power module 320 and provide surge protection and/or filtration.
The battery 326 may be any kind of battery configured to store power for later use by the instrument interface 106 a. In one example, the battery may be at 3.7 volts and be able to provide 2 milliamps of current per hour. The power module 320, power supply 322, charger 324, and battery 326 are further described previously in the discussion regarding the battery and regulation module 206 of FIG. 2.
The on/off button 328 is configured to activate or deactivate the instrument interface 106 a. In one example, the instrument player 102 a may switch the on/off button 328 to activate or deactivate the instrument interface 106 a. Those skilled in the art will appreciate that the instrument interface 106 a may be activated or deactivated in any number of ways including manually or automatically. In some examples, the instrument interface 106 a may be activated by the instrument player 102 a manually by a switch, button, slider, or any interface. The instrument interface 106 a may also be activated or deactivated automatically. In one example, the instrument interface 106 a may be configured to activate when coupled with a real instrument 104 a. The instrument interface 106 a may also always be active as long as there is power (e.g., the battery 326 maintains a charge).
The debug module 330 is a module configured to debug the instrument interface 106 a. In one example, the debug module 330 is configured to debug the audio codec 302. The debug module 330 may be used at the factory during the manufacture of the instrument interface 106 a as a part of quality assurance and/or may be used to correct defective units.
In various embodiments, the instrument interface 106 a may be configured to wirelessly communicate via wireless USB, Bluetooth, or any number of wireless standards (e.g., 802.11a/b/g/n, WiMax, LTE, or WiFi). In some embodiments, the instrument interface 106 a may be configured to communicate via wireless USB and the instrument interface 106 a is further modified to receive and convert the signal from another standard (e.g., Bluetooth). In one example, the instrument interface 106 a may comprise an antenna or be coupled to an antenna capable of receiving a Bluetooth signal and converting the signal into a format that may be understood by the instrument interface 106 a. Similarly, the instrument interface 106 a may provide a signal in one standard (e.g., wireless USB) which may then be converted to a standard that may be received by the game console 108.
The instrument interface 106 a may be configured to adjust a latency in order to compensate for timing issues created between varying distances between the instrument interface 106 a and the game console 108. In some embodiments, the instrument interface 106 a is configured to allow a user (e.g., the instrument player 102 a) the option to adjust a latency parameter that alters signal latency. The instrument interface 106 a may also be configured to determine signal latency automatically through communication with the game console 108. Further, the game console 108 may be configured to determine latency based on the communication with the instrument interface 106 a and transmit commands to the instrument interface 106 a to increase or decrease the latency parameter. Those skilled in the art will appreciate that there are many ways in which a latency parameter and/or signal latency between the instrument interface 106 a and the game console 108 may be controlled.
Those skilled in the art will appreciate that there may be more or less components of the instrument interface 106 a than that depicted in FIG. 3. FIGS. 4 and 5 are further embodiments of the instrument interface 106 a with more detail than FIG. 3.
FIG. 4 is a technical block diagram of an instrument interface 106 a in an embodiment. In various embodiments, the audio codec 302 described in FIG. 3 may comprise a UAC355xb 402. The UAC355xb 402 is a Micronas USB audio IC. UAC355xb 402 may comprise a high-performance stereo audio ADC/DAC, digital serial interfaces, and an additional DAC channel for the subwoofer signal. The UAC355xb 402 may offer a programmable 5-band parametric equalizer for correcting the frequency response of the applied speaker plus adjustable dynamic low-frequency processing for the subwoofer channel. Sampling rates for USB record and playback may be handled independently.
The UAC355xb 402 may comprise a USB interface 404, a digital to analog converter (DAC) 406, and an ADC 408 in communication with a digital signal processor (DSP). The UAC355xb 402 may also provide for programmable gain as well as a ROM. The USB interface 404 may comprise any interface that may be coupled with a device external to the instrument interface 106 a. In one example, a USB device 430 comprising an antenna USB module 432 (e.g., wireless network adaptor) may be coupled with the USB interface 404.
The EEPROM 412 is any nonvolatile memory (e.g., computer readable medium) that may be used to program the UAC355xb 402. In some examples, the EEPROM 412 may comprise instructions to program the UAC355xb 402 to process signals received by the line in port 426 (e.g., program gain), program a ROM or RAM in the UAC355xb 402, and/or control a DSP in the UAC355xb 402. In some embodiments, the EEPROM 412 may communicate with the UAC355xb 402 via an Inter-Integrated Circuit (I²C) bus. The I²C is a multi-master serial computer bus. Those skilled in the art will appreciate that the EEPROM 412 may communicate with the UAC355xb 402 via any interface and is not limited to an I²C bus.
The DAC 406 may be coupled to a line out port 414 which may be configured to couple the UAC355xb 402 to a headphone, amplifier, and/or subwoofer. In some embodiments, the line out port 414 may comprise multiple ports including an out port for a left speaker, a right speaker, and a subwoofer. Those skilled the art will appreciate that there may be any number of line out ports.
The line in port 416 is a port to receive a signal (e.g., from a real instrument 104 a). In some embodiments, the UAC355xb 402 may comprise a programmable gain to be applied to signals received via the line in 416 before being received by the ADC 408. The line in port 416 may comprise any number of ports. In one example, the line in port 416 may include a port for a left signal, a right signal, and a mic.
The UAC355xb 402 may also comprise a GPIO 410 that may be coupled with a keypad 418. The keypad 418, in some embodiments, comprises a left button 420, top button 422, bottom button 424, and a right button 426 as well as an enter button 428. In various embodiments, the keypad 418 may comprise a joystick which may be pushed left, top, bottom, or right to input similar functions as the buttons into the instrument interface 106 a. Further, the joystick may be compressed to enter an “enter” command. The keypad 418 may comprise any input/output interface and may be controlled by the instrument player 102 a.
The instrument interface 106 a may also comprise a power LED 450 configured to display a light when the instrument interface 106 a is activated and/or charged.
In various embodiments, the UAC355xb 402 may be coupled with the USB device 430 via the USB interface 404. The USB device 430 may comprise a wireless adaptor (e.g., the antenna USB module 432). Although the wireless adaptor is depicted as an antenna USB module (e.g., with a Wisair chip), the wireless adaptor may comprise any antenna. In some embodiments, the wireless adaptor may be internal to the instrument interface 106 a. The USB device 430 may also comprise a MINI USB connector 434 that may receive power (e.g., +5 volts) from a digital device such as a game console 108 or display 110 (see FIG. 1). In various embodiments, the USB interface 404 may be coupled with the digital device to charge a battery (e.g., battery 442).
The instrument interface 106 a may comprise a power module 436 which may comprise a buck/boost power supply 438, a charger 440, and a battery 442. Similar to the power module 320 discussed herein with respect to FIG. 3, the buck/boost power supply 438 may provide power from the charger 440 and/or the battery 442 to power the instrument interface 106 a. In some embodiments, the buck/boost power supply 438 may step up the power received from the battery to charge the instrument interface 106 a. In one example, the battery may provide 3.7 volts and the buck/boost power supply 438 may step up the voltage to +5 volts.
The charger 440 may receive power via the USB interface 404, a power adaptor, or other power source. The battery 442 may be any storage capable of storing energy to power the instrument interface 106 a. In one example, the battery 442 may provide 3.7 volts and 2 mAh. Those skilled in the art will appreciate that the battery 442 may provide any voltage at any current.
The debug module 444 may comprise a universal asynchronous receiver/transmitter (UART) port 446 and a Joint Test Action Group (JTAG) port 448. The debug module 444 may be used to debug the instrument interface 106 a during manufacture or to determine an error or other problem. The UART port 446 may translate data between parallel and serial forms and, as depicted in FIG. 4, may be used to communicate with the UAC355xb 402 via an RS232 interface. The JTAG port 448 is an IEEE 1149.1 standard entitled Standard Test Access Port and Boundary-Scan Architecture for test access ports used for testing printed circuit boards using boundary scan. JTAG may be used as an IC debug or probing port. Those skilled in the art will appreciate that the debug module 444 may use any number of ports and/or interfaces to debug the UAC355xb 402 and is not limited to those depicted in FIG. 4.
The instrument interface 106 a may also comprise an on/off button 452. As discussed herein, the instrument interface 106 a may comprise more or less components performing similar functionality.
FIG. 5 is a technical block diagram of an instrument interface 106 a in another embodiment. Instrument interface 106 a may comprise an embedded microprocessor (embedded uP) 502. The embedded uP 502 may comprise any processor configured to receive signals from a real instrument 104 a and provide the signals to the game console 108 or other digital device. In some examples, the embedded uP 502 may be an extensible processor (e.g., configurable) and/or an audio codec.
The embedded uP 502 may comprise RAM 504, Flash 506, debug port 508, a USB host 510, an I²C bus 512, a USB device port 514, a DAC 520, an ADC 522, and a GPIO 524. The RAM 504 may comprise any volatile memory. The flash 506 may comprise any nonvolatile memory (e.g., NAND or NOR flash memory). The RAM 504 and the flash 506 are computer readable media that may store instructions to configure a processor of the embedded uP 502 to perform a method (e.g., the method described in FIG. 7). In various embodiments, the embedded uP 502 may comprise only a single type of memory or many types of memory and not be limited to that depicted in FIG. 5.
The debug port 508 may be coupled with a debug module 558 that comprises a UART port 560 and/or a JTAG port 562. The USB host port 510 may be coupled with a USB device 516 such as a USB device 516 comprising an antenna USB module 518 for wireless communication between the instrument interface 106 a and a digital device such as a game console 108 and/or display 110. In some embodiments, the USB host port 510 may not exist and the antenna USB module 518 may be internal to the instrument interface 106 a. In some embodiments, a signal is receive from a real instrument 104 a via the line in port 528 further described herein. The embedded uP 502 may process the signal and provide the signal to the game console 108 (or other digital device) via the antenna USB module 518.
The EEPROM 546 may be coupled with the embedded uP 502 via the PC bus 512. The EEPROM 546 may be used to program the embedded uP 502 and/or one or more components of the embedded uP 502.
The USB device port 514 may be coupled to any digital device via a USB cable and may receive power via a mini USB connection 526. In one example, the mini USB connection 526 may provide +5 volts of power to the instrument interface 106 a (e.g., via the power module 548). In some embodiments, the instrument interface 106 a may be charged by periodically coupling the USB device port 514 with a digital device which charges a battery (e.g., the battery 554). The instrument interface 106 a may also be charged by a charger 552 such as a power adaptor.
The DAC 520 may be coupled to the line out port 528 to provide a signal received from the real instrument 104 a to an external device (e.g., a speaker, amplifier, or subwoofer). In some embodiments, the embedded uP 502 may provide the analog signal received by the real instrument 104 a directly to the line out port 528 without processing. In various embodiments, the embedded uP 502 receives an analog signal from the real instrument 104 a, provides gain, converts the analog signal to digital, performs further processing, converts the signal back to analog with the DAC 520 and then provides the signal to the line out port 528.
The ADC 522 may be coupled to the line in port 530 to receive a signal from the real instrument 104 a. In some embodiments, the signal received by the line in port 530 may already be digital and the ADC 522 is not used or is optional. In various embodiments, a programmable gain is applied to the analog signal received over the line in port 530 prior to conversion to a digital signal.
The GPIO 524 may be coupled with a keypad 532 which is configured to provide signals associated with a left button 534, a right button 536, a top button 538, and a bottom button 540. There may also be a separate enter button 542. Those skilled in the art will appreciate that the input from the instrument player 102 a is not limited to that depicted in FIG. 5 and that any sort of input from the instrument player 102 a may be received by the GPIO 524.
The power LED 544 may indicate when the instrument interface 106 is active and/or charged. The power module 548 may comprise a power supply 550, the charger 552 and a battery 554 configured to power the instrument interface 106 a, provide surge protection, and/or filter the power received from a power source (e.g., received via the mini USB connection 526 and/or the charger 552).
The optional on/off button 556 allows the instrument player 102 a to activate or deactivate the instrument interface 106 a. In various embodiments, there is no on/off button 556 but rather various keys or buttons on the keypad may be depressed or otherwise activated to activate or deactivate the power of the instrument interface 106 a.
Those skilled in the art will appreciate that there may by any number of circuits or modules performing similar functionality and still be within various embodiments as discussed herein.
FIG. 6 is a box diagram of an instrument interface 106 a in another embodiment. The instrument interface 106 a comprises an instrument module 602, a signal processing module 604, a wireless communication module 606, a user interface module 608, a digital device interface module 610, and a power module 612.
The instrument module 602 is configured to receive a signal from a real instrument 104 a. The signal may be received either via a wire or wirelessly (e.g., over an antenna). In some embodiments, the instrument module 602 may amplify the signal and/or convert the signal received from the real instrument 104 a from analog to a digital signal. In various embodiments, the instrument module 602 may apply a gain that is programmable. The gain applied by the instrument module 602 may be controlled by instructions contained within an EEPROM. In some examples, the gain may be programmed based on the type of instrument that provides the signal, the quality of the signal received, the type of digital device that is to receive the signal, the requirements of a game, or any number of other factors. In some examples, the instrument module 602 comprises a line in port and an ADC.
The signal processing module 604 processes the signal received from the instrument module 602. In some embodiments, the signal processing module 604 may comprise a DSP which may be configured by instructions (e.g., instructions within the EEPROM). The signal processing module 604 may format the signal to prepare the signal for transmission to a digital device. In some embodiments, the signal processing module 604 may equalize the signal, provide gain, filter, or shape the signal. In some examples, the signal processing module may comprise an audio codec, an embedded microprocessor, a digital signal processor, or the like.
Further, the signal processing module 604 may control transmission of signal to the digital device. In some embodiments, the signal processing module 604 monitors the communication between the wireless communication module 606 and the instrument interface 106 a. The signal processing module 604 may shape the channel, select a different wireless channel to communicate with the digital device, shape traffic on the channel, prioritize data from the signal, perform error correction, and encode the data from the signal to prepare for transmission.
In various embodiments, the signal processing module 604 associates an instrument identifier with the signal, the real instrument 104 a, and/or the instrument interface 106 a. In one example, each instrument interface 106 a may be associated with a unique instrument identifier that is associated with data from the signal and provided to the receiving digital device (e.g., game console 108). The receiving digital device may receive data from multiple instrument interfaces and separate the signals based on the instrument identifier to allow for multiple real instruments to interact with the digital device. In one example, a plurality of real instruments may compete in a game or perform in a virtual concert. The signals may be provided from the real instruments to the game console 108 via respective instrument interfaces. The game console 108 may receive the signals and organize the data based, at least in part, on the instrument identifier thereby allowing multiple real instruments to be recognized by the game console 108. As such, a game or virtual learning environment may allow multiple instrument players to play multiple real instruments together to teach each other, compete, play a game, record, and/or play music.
In some embodiments, each instrument interface 106 a comprises a single instrument identifier that is encoded with data from the signal of the real instrument 104 a. In other embodiments, the digital device (e.g., software on the game console) may communicate with one or more instrument interfaces and assign respective instrument identifiers. For example, each instrument interface 106 a may communicate with the game console 108 and receive a separate and distinct instrument identifier. The game console 108 may assign instrument identifiers dynamically or from a static set of identifiers. The instrument identifiers may be unique across all game consoles 108 or they comprise a similar or same set of instrument identifiers per game console 108. In some embodiments, the game console 108 assigns an instrument identifier every time the program (e.g., learning environment) is initiated.
A plurality of instrument interface 106 a may also communicate with each other to select an instrument identifier from a set of identifiers or generate an instrument identifier. In one example, the wireless communication module 606 may communicate between instrument interfaces to identify the number of instrument interfaces and confirm that the same instrument identifiers are not being used concurrently.
In some embodiments, each instrument interface 106 a is associated with at least one instrument identifier. In one example, a unique digital identifier may be embedded within each instrument interface 106 a. In various embodiments, the game controller 108 authenticates the instrument identifier which may allow the game controller 108 to pair with instrument interface associated with the instrument identifier. Based on the instrument identifier, the game controller 108 may also correlate signals from the associated instrument interface 106 a to a pre-identified track of prerecorded music.
Multiple instrument interfaces may each have an associated instrument identifier which may be used to pair simultaneously (or near simultaneously) with the game controller 108 (e.g., via a single point of reception or intermediate multichannel wireless receiver). In one example, the game console 108 comprises an intermediate multi-channel wireless receiver and software with an integrated API/software encoding/decoding function. The receiver and the integrated API/software encoding/decoding function may identify discrete data channels transmitted simultaneously from multiple interface devices and pair multiple instrument interfaces with the game console 108.
Those skilled in the art will appreciate that there are many ways in which an instrument identifier may be determined and/or generated. Further, those skilled in the art will appreciate that there are many ways in which signals may be associated with instrument identifiers such that a digital device will be able to separate received signals to allow multiple real instruments to interact.
The wireless communication module 606 may comprise any wireless antenna configured to provide data (e.g., data from the real instrument 104 a) to a digital device (e.g., game console 108, display 110, or one or more other instrument interfaces 106 b). In some examples, the wireless communication module 606 may encode, perform error correction, buffer, and/or associate the instrument identifier with data transmitted or received. The wireless communication module 606 may be, for example, an onboard antenna or an external antenna (e.g., the antenna USB module 518).
The user interface module 608 is configured to receive input from a user (e.g., instrument player 102 a). In some embodiments, the user interface module 608 comprises a joystick, keypad, display, touchpad, touch screen, buttons, switches, levers and/or the like. In one example, a user (e.g., instrument player 102 a) may activate the instrument interface 106 a via an on/off switch of the user interface module 608. The user may interact with a graphical user interface of a program on the digital device (e.g., game console) by inputting directions (e.g., up, down, left, or right) and entering a selection (e.g., an “enter” function). The user may also select the type of real instrument being played, the number of real instruments to be played, the number of players, and/or the type of game console. In some embodiments, one or more of these selections are made by the user interacting with a program or game on the digital device via the user interface module 608. In one example, the user interface module 608 may comprise a keypad 532.
The digital device interface module 610 is configured to couple the instrument interface 106 a with a digital device, including, but not limited to, a computer, game console 108, or display 110. In some embodiments, the digital device interface module 610 comprises a USB port (e.g., USB port 514). Those skilled in the art will appreciate that the digital device interface module 610 may comprise any type of port (e.g., USB, Ethernet, or firewire) or an antenna for wireless communication. In various embodiments, the instrument interface 106 a may be powered or charged from the digital device via the digital device interface module 610.
In various embodiments, the instrument interface 106 a may be updated, configured, and/or programmed via digital device over the digital device interface module 610. In one example, a user may couple the instrument interface 106 a with the digital device via cable over the instrument interface 106 a. A program (e.g., executable application) may be executed on the digital device thereby allowing the user to control the instrument interface 106 a. In some embodiments, the user may upgrade the firmware of the instrument interface 106 a, associate one or more real instruments with the instrument interface 106 a, select or generate an instrument identifier, select a game console 108, select a program (e.g., a learning application or a game) for the game console 108, and/or program the user interface of the instrument interface 106 a. In some embodiments, the user may also control the digital signal processing of one or more signals received from a real instrument 104 a such as gain, filtration, equalization, attenuation, and/or add audio effects, modifications or enhancements.
The power module 612 powers the instrument interface 106 a. In various embodiments, the power module 612 comprises a battery and/or a charger. The power module 612 may store energy to power the instrument interface 106 a and may indicate when power is low and the amount of time of battery power that is left. In various embodiments, the power module 612 may perform surge protection or filtration of the power. In some examples, the power module 612 comprises a power module 548.
It will be appreciated that a “module” may comprise software, hardware, firmware, and/or circuitry. In one example one or more software programs comprising instructions capable of being executable by a processor may perform one or more of the functions of the modules described herein. In another example, circuitry may perform the same or similar functions. Alternative embodiments may comprise more, less, or functionally equivalent modules and still be within the scope of present embodiments. For example, as previously discussed, the functions of the various modules may be combined or divided differently.
FIG. 7 is an exemplary method for wireless connectivity between an instrument interface 106 a and a digital device such as a game console 108. In optional step 702, a user may configure settings of the instrument interface 106 a or a program on the digital device to identify a real instrument 104 a. In some embodiments, a user may identify the real instrument 104 a as a guitar, drums, keyboard, or the like. In other embodiments, the instrument interface 106 a may be configured to determine when the instrument interface 106 a is coupled with a real instrument 104 a. In one example, the instrument interface 106 a does not specifically identify the real instrument 104 a but rather determines when the instrument interface 106 a is coupled with the real instrument 104 a (e.g., by receiving a signal from the real instrument 104 a).
In optional step 704, the instrument interface 106 a receives a format selection. In one example, when the instrument interface 106 a is configured to communicate with a game console 108, the instrument interface 106 a determines how to format data to be provided to the game console 108. In some embodiments, different game consoles 108 and/or different network adaptors require the data to be formatted differently. Once the instrument interface 106 a recognizes or is configured for the right game console 108 and/or wireless network, the instrument interface 106 a may determine or otherwise receive a format selection such that data can be received by the game console 108. In some embodiments, the signal processing module 604 of the instrument interface 106 a determines the format selection.
In step 706, the instrument module 602 of the instrument interface 106 a receives a real instrument 104 a signal. In some embodiments, the signal from the real instrument 104 a is an analog signal. The instrument module 602 and/or the signal processing module 604 may apply a gain, attenuate, filter, modify, or enhance the signal. Further, the signal may be converted to a digital signal by an ADC.
In step 708, the signal processing module 604 converts the real instrument signal to the selected format such that a receiving digital device (e.g., game console 108) may receive and process the signal. The selected format may be the format determined and/or identified in step 704.
In step 710, the signal processing module 604 processes the formatted signal to include an instrument identifier. As discussed herein, the instrument identifier may be static or dynamic. The instrument identifier may be previously assigned to the instrument interface 106 a or dynamically assigned by the instrument interface 106 a, by another instrument interface, game console 108, or any digital device.
In various embodiments, multiple real instruments are coupled with separate instrument interfaces. The signals from each instrument interface may be associated with a different instrument identifier. The signals may then be received by the game console 108 which may then separate the signals based on the instrument identifier. A game or other program on the game console 108 may then play back each signal such that the real instruments sound or appear like they are playing together. Further, the game console 108 may allow competition between instruments, provide separate instruction for each instrument, judge the quality and technical merit of the play of each instrument, and so on.
In step 712, the wireless communication module 606 wirelessly outputs the processed signal as a console signal to the digital device (e.g., game console 108).
FIG. 8 a depicts a front and right side view of the instrument interface 106 a in an embodiment. The instrument interface 106 a as depicted comprises a body 802, a cable interface 804, a selector 806, an enter button 808, an activation/deactivation switch 810, and an audio out port 812. In some embodiments, the body 802 is cylindrical in shape, approximately 48 mm long and 18 mm in diameter. Those skilled in the art will appreciate that the instrument interface 106 a may be any shape and may be of any length and/or diameter.
The cable interface 804 may be a line in port (e.g., analog input port 214 of FIG. 2, line in port 310 of FIG. 3, line in port 416 of FIG. 4, and/or line in port 526 of FIG. 5). In one example, a standard cable may be used to couple the real instrument 104 a to the cable interface 804. In some embodiments, the instrument module 602 (see FIG. 6) may receive a signal from the real instrument 104 a via the cable interface 804.
The selector 806 comprises any interface that a user may use to input selections into the instrument interface 106 a. In one example, the selector 806 is a joystick that may move up, down, left, or right. A user may wirelessly interact with the learning environment or other program on a game console 108 by inputting selections with the selector and/or pushing the enter key 808. The choices may be reflected in a graphical user interface of the game or program. For example, a game may require a selection between three different modes. The user may choose a mode by pushing the selector 806 upwards. The selection is then wirelessly transmitted from the instrument interface 106 a to the game console 108 which may then receive the signal and highlight the desired mode. The user may then depress the enter key 808 to activate the selection.
The activation/deactivation switch 810 activates and/or deactivates the instrument interface 106 a. The audio out port 812 may be configured to output a signal from a real instrument 104 a, output from the game console 108, and/or a mixed signal from both the real instrument 104 a and the game console 108.
FIG. 8 b depicts a bottom view 814 of the instrument interface 106 a in an embodiment. The bottom view 814 of the instrument interface 106 a may comprise a USB port 816 and an LED 818. The body of the instrument interface 106 a may also allow for a battery to be placed in the bottom of the instrument interface 106 a (e.g., an alkaline, lithium, and/or rechargeable battery).
The USB port 816 may be any port configured to be coupled with a digital device. In some embodiments, the instrument interface 106 a may be configured and/or charged via the USB port 816. The LED 818 may be configured to indicate when the instrument interface 106 a is activated, powered (e.g., charged), and or functioning.
In some embodiments, the game console 108 executes a program to teach a user to learn and play a real instrument 104 a. For example, for rhythm guitar, the program may display guitar tabs synchronized with the audio playback and live (user generated) guitar track. The streaming audio from the user's guitar may be delivered via USB to the game console 108 and synchronized with the game audio playback. The user's guitar tone may be modified through amp/effect modeling (e.g., by the game console 108 and or the instrument interface 106 a) to duplicate that of the original recording.
FIG. 9 is a general block diagram of a game console 108 in an embodiment. The game console 108 comprises a receiving module 902, a multiple instrument module 904, a user interaction module 906, a music player module 908, a teaching module 910, a synchronization module 912, a recordation module 914, and a communication module 916. The game console 108, as discussed herein, may be any game console such as a Microsoft Xbox or any digital device. The receiving module 902 receives a signal from the instrument interface 106 a. The some examples, the signal may comprise music, output from the real instrument 104 a, an instrument identifier, and/or selections from the instrument interface 106 a. The receiving module 902 may comprise an antenna configured to receive data wirelessly from the instrument interface 106 a and/or may comprise a port configured to receive data from the instrument interface 106 a via a wire (e.g., game pad port, USB port, or the like). In some embodiments, the receiving module 902 may decode, decrypt, and/or perform error correction on the signal(s) received from the instrument interface(s).
The multiple instrument module 904 is configured to separate signals received via the receiving module 902 from separate real instruments. In some embodiments, separate channels may be used for each signal associated with a different instrument identifier. In some embodiments, the multiple instrument module 904 may detect one or more different instrument interfaces and assign a separate instrument identifier to each one. The respective instrument identifier may be provided to a instrument interface 106 a via the communication module 916. The instrument interface 106 a may receive the instrument identifier and then associate all signals provided to the game console 108 with the assigned instrument identifier.
The user interaction module 906 may retrieve user selections (e.g., via a keypad or buttons on the instrument interface 106 a) from the signals received via the receiving module 902. The user interaction module 906 may also display (or control the display of) a graphical user interface and allow the user of the instrument interface 106 a to interact with the graphical user interface based on the retrieved user selections.
In various embodiments, the user interaction module 906 may display options for the user to select via the instrument interface 106 a including learn, play, record, or share. When learn is selected, instruction on how to play the real instrument 104 a may be provided. When play is selected, the user may have the option to play along with songs on the game console 108 and practice. The user may also have the option to download more songs from a network via the communication module 916. When record is selected, the output from the real instrument 104 a and/or background music (e.g., selected songs) may be recorded for playback later. When share is selected, the recorded music or music that is currently being played may be shared with others (e.g., over a network).
In some embodiments, the user interaction module 906 may display images and sounds to assist the user in playing the real instrument 104 a. In one example, the user interaction module 906 generates synchronized displays of music notation, tablature, lyrics, and other visual and/or audio representations of playing methods for a given song or track(s) in real-time (or near real-time) along with the song. One or more of the different displays and/or sounds may be based upon user preference.
The user interaction module 906 may also be configured to generate a synchronized metronome. The metronome may have timing calculated to match a song that is playing (e.g., a song selected by the user). The metronome may be audio, video, or both. The user interaction module 906 may comprise an option to allow a user to activate or deactivate the metronome. In some examples, the user may deactivate the display of the metronome but may continue to hear the metronome. Alternately, the user may deactivate the audio portion of the metronome and continue to see a display of a metronome on the display 110. Further, the user may deactivate both the audio and visual portions of the metronome.
The music player module 908 may play music received from one or more of the real instruments. In some embodiments, the user interaction module 906 may provide instructions on how to play the real instrument, a game for learning, a game for competition, or any program that allows user interaction with the real instrument. The music player module 908 may play back music received via the receiving module 902 as well as provide instructions for notes to be played. In one example, the music player module 908 may display the strings of a guitar to be played as well as the position of the fingers on the neck of the guitar in time with music.
The music player module 908 may also receive a music selection from the user via the user interaction module 906 and play back the music selection allowing the user to play along with the selection. In some embodiments, the music player module 908 may remove one or more parts of the music thereby allowing the user to play the real instrument 104 a in place of the missing part. For example, the music player module 908 may remove a lead guitar portion of a selected song thereby allowing the user to play the real instrument 104 a in place of the lead guitar portion. Those skilled in the art will appreciate that any portion of the music may be removed or modified to allow one or more user to play real instrument(s) in conjunction with one or more songs.
The teaching module 910 may provide instructions, suggestions, and/or corrections to the user. In some embodiments, signals received from a real instrument 104 a are analyzed and compared against a standard. In one example, the user plays a portion of a song with a real instrument 104 a. The signals are received by the receiving module 902 and the teaching module 910 compares the received signals against a standard song or expectation. The teaching module 910 may provide instructions for improvement, provide practice drills, test certain techniques, and/or select music to emphasize learning. In some embodiments, the user may select a practice mode (e.g., easy, middle, and hard). The teaching module 910 may then rate the user's performance more strictly or easily based on the mode. The teaching module 910 and/or the music player module 908 may reward good playing. In some examples, the user may be rewarded by a change in the display (e.g., fireworks), sound, and/or a performance by an expert and/or famous musician. The teaching module 910 may also rank or rate the performance.
The synchronization module 912 may synchronize the playing by the user of the real instrument. In one example, the synchronization module 912 receives a signal from the instrument interface 106 a via the receiving module 902. The synchronization module 912 may then synchronize the signal with a song selection or enhance music played by the real instrument 104 a. In some embodiments, the synchronization module 912 synchronizes the signals received from multiple instrument interfaces. The synchronization module 912 may also synchronize signals received from multiple instrument interfaces with one or more songs.
In some embodiments, when a real instrument 104 a is played over an existing song, the program or the instrument interface 106 a may perform a variety of emulations (e.g., instrument/amp/cabinet emulation) to simulate the sound of the original recording. In some embodiments, the user has the ability to mute or replace selected tracks from a prerecorded music library supplied on the game or downloaded through an online portal. The songs may be pre-mixed into “stems” representing key instruments used in the song (e.g., lead guitar, rhythm guitar, lead vocal, backup vocal, bass guitar, and a consolidated mix of the remaining sounds an instruments: percussion, keyboard, accordion, or special effects).
The synchronization module 912 may be configured to allow a user to re-master a selected song while replacing an original music track with another created by the user. In one example, the user selects a song and an instrument (e.g., lead guitar). The game console 108 may play the selected song without the lead guitar track. The game console 108 may record the user playing the lead guitar track with the real instrument 104 a and re-master the song with the user's track. In some embodiments, the synchronization module 912 and/or the recordation module 914 may be configured to apply sound emulation algorithms to the user-generated tracks to emulate a tone and signal processing of the original track.
The recordation module 914 may record one or more signals from the receiving module 902. In some embodiments, the recordation module 914 records the play and/or performance from the real instrument 104 a. Multiple performances may be recorded. In some embodiments, the recordation module 914 records the music from some but not all of the real instrument 104 a that provide signals to the game console 108 at one time. The recordings may be played back so that a user may learn from the performance and/or enjoy the music. The recordation may also be shared over a network. In some embodiments, the recordation module 914 records the performance(s) on a hard drive or other computer readable medium.
The communication module 916 communicates with one or more digital devices via a network. In some embodiments, the game console 106 is coupled to a network such as the Internet via the communication module 916. Recordations may be shared by the communication module 916. Further, players at different locations may interact, play, compete, and/or learn from each other.
In some embodiments, a signal from a real instrument 104 a may be received via a receiving module 902 and another signal may be received via the communication module 916. The two signals may be separated based on distinct instrument identifiers by the multiple instrument module 904. The music player module 908 and/or the teaching module 910 may interact with both signals allowing a local and a remote user to play together. Those skilled in the art will appreciate that there are many ways multiple users (remote, local, or both) may play, compete, and/or learn from each other and interact with the program.
In various embodiments, the game console 108 may be configured to identify an instrument interface 106 a and an associated real instrument 104 a. The game console 108 may then identify one or more tracks of a song and give the user the option to play the real instrument 106 a in place of one of the tracks. In one example, the game console 108 identifies an instrument interface 106 a (e.g., via the instrument identifier) and identifies a real instrument 104 a associated with the instrument interface 106 a. In some embodiments, game console 108 may identify the real instrument 104 a automatically based on the signal from the instrument interface 106 a or through an indication from the user (e.g., via the navigation controls on the keypad of the instrument interface 106 a). The game console 108 may then give the option to the user to play an associated track of a song. For example, if the game console 108 identifies the real instrument 104 a as a guitar, the game console 108 may provide the player of the guitar the option to play in place of a lead guitar track or a rhythm guitar track. Those skilled in the art will appreciate that there are many ways in which the game console 108 may provide players the option to play the real instrument in place of one or more tracks of a song.
Alternative embodiments may comprise more, less, or functionally equivalent modules and still be within the scope of present embodiments. For example, as previously discussed, the functions of the various modules may be combined or divided differently
FIG. 10 is a block diagram of an exemplary digital device 1000. Any of the instrument interfaces, game console 108, or display 110 may be an instance of the digital device 1000. The digital device 1000 comprises a processor 1002, memory system 1004, storage system 1006, a communication interface 1008, an input/output interface 1010, and a display interface 1012 communicatively coupled to a bus 1014. The processor 1002 is configured to execute executable instructions (e.g., programs). In some embodiments, the processor 1002 comprises circuitry or any processor capable of processing the executable instructions.
The memory system 1004 stores data. Some examples of memory system 1004 include storage devices, such as RAM, ROM, RAM cache, virtual memory, etc. In various embodiments, working data is stored within the memory system 1004. The data within the memory system 1004 may be cleared or ultimately transferred to the storage system 1006.
The storage system 1006 includes any storage configured to retrieve and store data. Some examples of the storage system 1006 include flash drives, hard drives, optical drives, and/or magnetic tape. Each of the memory system 1004 and the storage system 1006 comprises a computer-readable medium, which stores instructions or programs executable by processor 1002.
The communication interface (com. interface) 1008 may be coupled to a network (e.g., bus 1014) via the link 1016. The communication interface 1008 may support communication over an Ethernet connection, a serial connection, a parallel connection, and/or an ATA connection. The communication interface 1008 may also support wireless communication (e.g., 802.11a/b/g/n, WiMax, LTE, WiFi, wireless USB). It will be apparent to those skilled in the art that the communication interface 1008 can support many wired and wireless standards.
The optional input/output interface 1010 is any device that inputs data (e.g., mouse, keyboard, keypad, or joystick). The optional display interface 1012 outputs data (e.g., to a display). In one example, the display interface 1012 may comprise a graphic processor or card.
It will be appreciated by those skilled in the art that the hardware elements of the digital device 1000 are not limited to those depicted in FIG. 10. A digital device 1000 may comprise more or less hardware, software and/or firmware components than those depicted (e.g., drivers, operating systems, or touch screens). Further, hardware elements may share functionality and still be within various embodiments described herein. In one example, encoding and/or decoding may be performed by the processor 1002 and/or a co-processor located on a GPU (i.e., Nvidia).
The above-described functions and components can comprise instructions that are stored on a storage medium such as a computer readable medium. Some examples of instructions include software, program code, and firmware. The instructions can be retrieved and executed by a processor in many ways.
The present invention is described above with reference to exemplary embodiments. It will be apparent to those skilled in the art that various modifications may be made and other embodiments can be used without departing from the broader scope of the present invention. Therefore, these and other variations upon the exemplary embodiments are intended to be covered by the present invention.

Claims

1. A method comprising:

receiving a music signal from a port of a real musical instrument;

formatting the music signal for transmission to a digital device, wherein the formatted music signal comprises an instrument identifier; and

wirelessly transmitting the formatted music signal.

2. The method of claim 1, further comprising receiving an instrument selection.

3. The method of claim 1, wherein the format of the music signal is based, at least in part, on the instrument selection.

4. The method of claim 2, wherein the instrument selection is received from a keypad.

5. The method of claim 1, further comprising receiving a format selection and wherein the format of the music signal is based, at least in part, on the format selection.

6. The method of claim 1, wherein receiving the music signal, formatting the music signal, and transmitting the formatted music signal is performed by an instrument interface.

7. The method of claim 1, further comprising receiving an activation command and activating an instrument interface.

8. The method of claim 1, further comprising charging a battery and receiving power from the battery to power an instrument interface to receive the music signal, format the music signal, and transmit the formatted music signal.

9. The method of claim 1, wherein transmitting the formatted wireless signal occurs via wireless USB.

10. A system comprising:

an instrument module configured to receive a music signal from a port of a real musical instrument;

a signal processing module configured to format the music signal for transmission to a digital device, wherein the formatted music signal comprises an instrument identifier; and

an antenna configured to wirelessly transmit the formatted music signal.

11. The system of claim 10, wherein the instrument module is further configured to receive an instrument selection from a user.

12. The system of claim 10, wherein the format of the music signal is based, at least in part, on the instrument selection.

13. The system of claim 12, wherein the instrument selection is received from a digital device interface.

14. The system of claim 10, further comprising a signal processing module configured to receive a format selection and wherein the format of the music signal is based, at least in part, on the format selection.

15. The system of claim 10, wherein the system comprises an instrument interface.

16. The system of claim 10, further comprising an activation/deactivation interface configured to activate or deactivate the system.

17. The system of claim 10, further comprising a power module configured to charge a battery and receive power from the battery to power the system to receive the music signal, format the music signal, and transmit the formatted music signal.

18. The system of claim 10, wherein antenna transmits the formatted wireless signal via wireless USB.

19. A computer readable medium comprising executable instructions, the instructions executable by a processor to perform a method, the method comprising:

receiving a music signal from a port of a real musical instrument;

wirelessly transmitting the formatted music signal.