US20020169014A1 - Method and apparatus for facilitating group musical interaction over a network - Google Patents
Method and apparatus for facilitating group musical interaction over a network Download PDFInfo
- Publication number
- US20020169014A1 US20020169014A1 US09/858,179 US85817901A US2002169014A1 US 20020169014 A1 US20020169014 A1 US 20020169014A1 US 85817901 A US85817901 A US 85817901A US 2002169014 A1 US2002169014 A1 US 2002169014A1
- Authority
- US
- United States
- Prior art keywords
- emulation data
- player
- local
- musical
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/814—Musical performances, e.g. by evaluating the player's ability to follow a notation
-
- A63F13/12—
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/44—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment involving timing of operations, e.g. performing an action within a time slot
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0008—Associated control or indicating means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
- G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
- G10H1/0058—Transmission between separate instruments or between individual components of a musical system
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
- A63F2300/303—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device for displaying additional data, e.g. simulating a Head Up Display
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/63—Methods for processing data by generating or executing the game program for controlling the execution of the game in time
- A63F2300/638—Methods for processing data by generating or executing the game program for controlling the execution of the game in time according to the timing of operation or a time limit
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8047—Music games
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/135—Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
- G10H2220/141—Games on or about music, i.e. based on musical knowledge, e.g. musical multimedia quizzes
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/135—Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
- G10H2220/145—Multiplayer musical games, e.g. karaoke-like multiplayer videogames
Definitions
- This invention relates to electronic music systems and, more particularly, to an electronic music system by which game players interact musically with one another in real-time over a network.
- rhythm-action One form of musical interaction popular among non-musicians is provided by a video game genre known as “rhythm-action,” which requires a player to perform phrases from a pre-recorded musical composition using the video game's input device to simulate a musical instrument.
- BEATMANIA An example of the game environment provided by BEATMANIA is shown in FIG. 1.
- the notes in musical phrases are graphically displayed to the player as a series of visual markers 104 spaced along one or more timelines 110 , 120 , 130 , 140 ; each marker 104 corresponds to one note in the phrase.
- the visual markers move from the top of the display to the bottom of the display.
- the player must simultaneously press a button on the input device corresponding to the correct timeline to play the sound of the corresponding note at the correct time. If the player performs this action successfully for a sufficient percentage of the notes, he scores well and wins the game. If the player fails to perform this action successfully for a sufficient percentage of the notes, he scores poorly and loses the game.
- Two or more players may compete against each other, typically by each one attempting to play back different, parallel musical phrases from the same song simultaneously (shown in FIG. 1). The player who plays the highest percentage of notes correctly achieves the highest score and wins.
- Multiplayer gaming increasingly incorporates various networking technologies that allow multiple players to compete against each other from remote physical locations via networks, and networked multiplayer gaming has become extremely popular.
- data signals are often subject to large and unpredictable transmission delays. These transmission delays do not significantly impact turn-based games (such as chess) or other game genres in which timing sensitivity is not critical to gameplay.
- turn-based games such as chess
- timing sensitivity is not critical to gameplay.
- action games and other “real-time” games gameplay is extremely sensitive to the timing of various events, and transmission delays inherently result in inconsistencies continually forming between the local game states of the various players of a networked game. Consequently, developers of timing-sensitive networked games have had to invent various methods for gracefully performing “conflict resolution” to resolve divergent local game states.
- the rhythm-action genre has a unique attribute, however, that makes traditional conflict resolution methods inapplicable.
- the core activity of multiplayer rhythm-action involves simultaneous music-making, which is highly timing sensitive, by two or more players. If these two players are separated by a network, the data representing musical notes played by one player will incur transmission delays when being sent to the other player. If note data were simply transmitted to a receiving machine it would trigger corresponding audio that would sound “out of sync” to the receiving player, resulting in cacophony.
- One solution to this problem would be to mute the audio from remote players on the local player's machine. However, this would significantly degrade the entertainment value of the game experience by destroying musical communication between the players.
- FIG. 1 shows a prior art rhythm-action game environment as it appears to players of the game
- FIG. 2 depicts an improved rhythm-action game environment as it appears to players of the game.
- FIG. 3 is a block diagram of a system for providing a rhythm-action game
- FIG. 4 is a block diagram of a networked rhythm-action game system.
- the tunnel 200 graphically represents the musical composition with which the player interacts, i.e., the walls of the tunnel 200 are the active play surface.
- the tunnel has eight walls, each of which corresponds to an instrumental track in the musical composition.
- the track occupying the bottom position is the active track, i.e., the track with which the player interacts.
- the active track is the track containing the drum portion of the musical composition.
- the player can use a provided input device to rotate any track to the bottom, i.e., make any track the active track.
- the tunnel 200 may have any number of walls. Further, it is not necessary that the walls form a closed shape.
- the sides may form a road, trough, or some other complex shape that does not have its ends connected to form a closed shape.
- the player continuously moves through the tunnel 200 , and the player's position in the tunnel 200 is represented by a graphical cursor 210 .
- the graphical cursor 210 may be a bar that appears to move along the active track of the tunnel 200 . In other embodiments, the cursor is a ring that moves along the tunnel at a fixed distance in front of the player.
- the walls of the tunnel are transparent, and the “outer world” beyond the tunnel 200 is used to provide ambiance during the game; for example, the environment may provide various textures and colors to enhance the player's experiences.
- Video clips associated with a musical composition may be played on “billboards” (not shown) that the player passes while traveling through the tunnel 200 .
- Ambience may also be provided by a “background” track that plays during active gameplay. It should be understood that reference to the environment includes such non-visual elements.
- the video clips, or other elements of the environment beyond the tunnel 200 may be displayed asynchronously of the game player's actions.
- FIG. 2 shows a number of markers on the drum track.
- the cursor 210 scrolls across one or more markers 220 that the player must “perform” by providing input, such as pressing a button, as the graphical cursor 210 passes over the marker 220 . If a player provides input as the cursor 210 crosses an event marker 220 , the event 220 is “caught.” When the player “catches” an event, a sound represented by the event is played and the player's score is affected in a positive manner. If the player provides input when the cursor 210 is not passing over the marker 220 , the player has “missed.” A “miss” affects the player's score in a negative manner. In one embodiment, the “miss” causes an error sound to be played.
- a “miss” causes the game to perform the musical event closest to the cursor 210 when the miss occurs. If the player does not provide input as the cursor 210 scrolls over an event 220 , the player has “passed” that marker 220 . A pass also has a negative effect on game score, but no sound is played. By successfully catching a series of events 220 , a player can better his performance during game play. Also, a player successfully catching sequences of events is rewarded by the reconstruction of the musical phrases corresponding to the events.
- the hardware station on which the described rhythm-action game executes includes a display 302 , a central processing unit 304 , audio output device 306 , and an input device 308 .
- the display 302 may be a separate display device, such as a computer monitor or television.
- the display 302 may be a unitary part of a larger unit that includes the other elements of the hardware.
- the central processing unit 304 may be provided as general purpose hardware, such as a 286 -based, 386 -based, 486 -based, Pentium-based, XEON-based, or Power PC-based personal computers.
- the central processing unit may be a network device or personal digital assistant.
- the central processing unit 304 is a dedicated game system, such as: PLAYSTATION2, manufactured by Sony Corporation; DREAMCAST, manufactured by Sega Corp.; or XBOX, manufactured by Microsoft Corp.
- the central processing unit 304 is specialized, single-purpose hardware.
- Audio device 306 may be provided as speakers, an amplifier, a digital-to-audio converter, a synthesizer, or other such device. In some embodiments, the audio device 306 may be a unitary part of a larger unit that includes the other elements of the hardware. In one particular embodiment, the audio device 306 has a portion that is external to the central processing unit 304 and a portion that is internal to the central processing unit 304 .
- Input device 308 may be provided as an alphanumeric keyboard, a mouse, a joystick, a game pad (also called a joy pad), musical keyboard, a conventional musical instrument (e.g., a guitar, a MIDI instrument, etc.), or a “fake” musical instrument.
- a conventional musical instrument e.g., a guitar, a MIDI instrument, etc.
- a “fake” musical instrument e.g., a guitar, a MIDI instrument, etc.
- the central processing unit 304 includes a memory element 320 , an event monitor 330 , a timer 340 , a display system 350 , an input system 360 , and an audio system 370 .
- the individual elements of the central processing unit 304 may be provided as hardware, software, or some combination of hardware and software.
- the audio system 370 , input system 360 and display system 350 are dedicated hardware or mixed hardware/firmware units that are a unitary part of the central processing unit 304
- the event monitor 330 , memory element 320 and timer 340 are software or, alternatively, firmware embodied on a removable device such as a game cartridge or COMPACTFLASH card.
- the memory element 320 stores data related to the musical events for the musical composition in the game.
- memory element 320 stores at least two pieces of data for each musical event: (1) the time during the musical composition at which the musical event should occur; and (2) the actual musical content of the event, such as pitch or rhythm related data.
- the memory element 320 also stores for each musical event and identification of which button must be pressed on the input device 308 to catch the musical event.
- the memory element 320 may be provided as any element such as RAM, DRAM, SDRAM, DDR-DRAM, PROM, EPROM, or EEPROM.
- the musical event data from the memory 320 is provided to both the display system 350 and the event monitor 330 .
- the display system 350 also receives input from the timer 340 .
- the display system 350 combines the timer values 340 and the musical event data from the memory element 320 to create the game environment, an embodiment of which is shown in FIG. 2.
- the display system 350 may include any visualization engine capable of creating three-dimensional environments, such as Realimation, manufactured by Realimation Ltd. of the United Kingdom or the Unreal Engine, manufactured by Epic Games.
- the input system 360 receives input from the input device 308 and transmits it to the event monitor 330 .
- the event monitor 330 receives musical event data from the memory element 320 , timer values from the timer 340 , and the input related information from the input system 360 .
- the event monitor 330 compares the musical event data with the timing of input from the user to detect whether the user has caught an event, missed an event or passed on an event.
- the event monitor 330 determines that a player has caught or missed an event, it immediately sends instructions to the audio system to trigger a sound.
- the audio system 370 receives those instructions and causes the audio devices 306 to produce sound.
- a second input system receives input from a second input device (shown in phantom view as 308 ′).
- the memory element 320 stores two sets of musical event data, one for the first player and one for the second player.
- the event monitor 330 compares the input received for the first player from input system 360 against musical event data for the first player received from the memory element 320 and compares input from the second player received from input system 360 ′ against musical event data from the second player received from the memory element 320 ′.
- an instruction is sent to the audio system 370 and audio system 370 instruct the audio device to produce the appropriate sound. Since both players are local to the hardware station, each player hears the audio for both players simultaneously.
- an embodiment of a networked rhythm-action game systems depicts two hardware stations 300 , 300 ′.
- players engage in competition over a network 400 .
- the network 400 can be any kind of network, such as a local area network (LAN), a wide area network (WAN), or the Internet.
- the hardware stations 300 connect to the network 22 through one of a variety of connections including standard telephone lines, LAN or WAN links (e.g., T 1 , T 3 , 56 kb, X.25), broadband connections (e.g., ISDN, Frame Relay, ATM), and wireless connections. Transmission delays over the network 400 will ensure that musical events performed by one player will not be heard simultaneously by the other player. This problem is solved by the system 400 as described below.
- a networked multiplayer game session begins at the direction of one of the players, that player's hardware station (the “host” hardware station) transmits a “start” instruction to all other machines, and the game begins on all systems: each player's timer starts counting, each player's note data is displayed on his screen and each player begins attempting to play notes by pressing the button on his input device as his cursor scrolls over markers.
- Gameplay on hardware station 300 is independent from game play on hardware station 300 ′, except that each player's hardware station contains a local copy of the musical event data for all other players.
- the timers on the various systems communicate with each other via the network 400 to maintain approximate synchrony using any number of the conventional means known in the art to maintain synchrony.
- the systems also continually transmit game score data to each other (not shown in figure), so that each system (and player) remains aware of the game score of all other systems (and players). Similarly, this is accomplished by any number of means known in the art. Note that this data is not particularly timing sensitive, because if there is momentary disagreement between any two systems regarding the score (or similar game-related parameters), the consequences to gameplay are negligible.
- Emulation data may include any number of parameters that describe how well the player is performing. Some examples of these parameters include:
- Each hardware station's analyzer module 420 continually transmits the emulation data it extracts over the network 400 to the other hardware station 300 ′ using transceiver 440 ; each hardware station's event monitor 330 , 330 ′ continually receives the other hardware station's emulation data over the network 400 .
- the emulation data essentially contains a statistical description of a player's performance in the recent past.
- the event monitor 330 uses received emulation data to create a statistical approximation of the remote player's performance.
- an incoming emulation parameter from a remote player indicates that the most recent remote event was a catch.
- the local event monitor 330 When the local event monitor 330 reaches the next note in the local copy of the remote player's note data, it will respond accordingly by “faking” a successful catch event, triggering the appropriate sound. That is, the local event monitor 330 will perform the next musical event from the other players' musical event data, even though that event was not necessarily actually performed by the other player's event monitor 330 ′. (If instead the emulation parameter had indicated that the most recent remote event was a miss, no sound would be triggered.)
- an incoming emulation parameter from a remote player indicates that during the last 8 beats, 75% of events were catches and 25% were passes.
- the local event monitor 330 reaches the next note in the local copy of the remote player's note data, it will respond accordingly by randomly choosing a catch or pass event according to the specified 75:25 distribution.
- an incoming emulation parameter from a remote player indicates that during the last 4 beats, 2 miss events occurred, with an average timing error of 50 “ticks.”
- the local event monitor 330 will respond accordingly by randomly generating miss events at a rate of 0.5 misses-per-beat, displacing them in time from nearby notes by the specified average timing error.
- delays in the transmission of the emulation data over the network do not have the intolerable side effect of causing cacophonous asynchronicity between the note streams triggering sounds on each player's local system.
- a real-time music creation system is one with which a non-musician can produce melodic, creative music without knowledge of music theory or the ability to play an instrument or keep time.
- These creation systems also allow the user to create and play improvisational solos over a prerecorded background or accompaniment track without the need to strike actuators in time or otherwise physically establish and maintain the timing of the notes of the solo.
- Real-time music creation engines are described in U.S. Pat. Nos. 5,763,804, 5,627,335, and 6,011,212, the entire contents of which are incorporated herein by reference.
- the real-time music creation engine generates signals representative of audible music by manipulating an input device. For example, an embodiments that provide a joystick as the input device, pulling the handle of the joystick back indicates that the user wants to play fewer notes over time in the given time signature, and pushing it forward is an indication that the user desires to play more notes over time. Similarly, pushing the handle of the joystick to the left indicates that the user wants to play notes of a lower pitch, and pushing it in the right direction is an indication that the user wants to play higher pitched notes.
- the input values are fed to a real-time music creation engine which includes at least a rhythm generator and a pitch generator. The rhythm generator and the pitch generator combine to form a series of notes that are rhythmically and melodically consonant with the background track.
- an analyzer module 420 extracts musical parameters from the input and transmits them over a network 400 to a remote hardware station.
- the analyzer module 420 may simply transmit the input stream over a network 400 or it may extract the information into a more abstract form, such as “faster” or “lower.”
- the remote hardware station receives the transmitted emulation data and creates an approximation of the improvisation performed by the remote user by using the local real-time music creation system.
- the audio created by the local real-time music creation system is necessarily an approximation of the solo played by the remote player because the local real-time creation system is using the emulation data at a different point in time than the actual solo occurred. Even though this is the case, the local user hears a improvisational solo that has the same musical parameters (e.g. pitch and rhythm) as the solo created by the remote user at the remote hardware station [though delayed by the network latency].
- the present invention may be provided as one or more computer-readable programs embodied on or in one or more articles of manufacture.
- the article of manufacture may be a floppy disk, a hard disk, a CD-ROM, a flash memory card, a PROM, a RAM, a ROM, or a magnetic tape.
- the computer-readable programs may be implemented in any programming language, LISP, PERL, C, C++, PROLOG, or any byte code language such as JAVA.
- the software programs may be stored on or in one or more articles of manufacture as object code.
Abstract
Description
- This invention relates to electronic music systems and, more particularly, to an electronic music system by which game players interact musically with one another in real-time over a network.
- Music is a temporal medium, the organization of sound in time. Accordingly, music making is highly timing sensitive. When a musician presses a key on a piano, the musician expects the result to be immediately audible. Any delay in hearing the sound, even as brief as few milliseconds, produces a perceived sluggishness that impedes the ability of the musician to use the instrument.
- Music making is also often a collaborative effort among many musicians who interact with each other. One form of musical interaction popular among non-musicians is provided by a video game genre known as “rhythm-action,” which requires a player to perform phrases from a pre-recorded musical composition using the video game's input device to simulate a musical instrument. The best-known example of this genre is the BEATMANIA series of games published by Konami Co., Ltd. of Japan. An example of the game environment provided by BEATMANIA is shown in FIG. 1. In this series of games the notes in musical phrases are graphically displayed to the player as a series of
visual markers 104 spaced along one ormore timelines marker 104 corresponds to one note in the phrase. In the environment shown in FIG. 1 the visual markers move from the top of the display to the bottom of the display. As eachmarker 104 on the scrolling timelines passes agraphical cursor 108 displayed along this timeline, the player must simultaneously press a button on the input device corresponding to the correct timeline to play the sound of the corresponding note at the correct time. If the player performs this action successfully for a sufficient percentage of the notes, he scores well and wins the game. If the player fails to perform this action successfully for a sufficient percentage of the notes, he scores poorly and loses the game. Two or more players may compete against each other, typically by each one attempting to play back different, parallel musical phrases from the same song simultaneously (shown in FIG. 1). The player who plays the highest percentage of notes correctly achieves the highest score and wins. - Multiplayer gaming increasingly incorporates various networking technologies that allow multiple players to compete against each other from remote physical locations via networks, and networked multiplayer gaming has become extremely popular. Unfortunately, however, the latency inherent in networked communication imposes a significant engineering and design burden on video game developers: data signals are often subject to large and unpredictable transmission delays. These transmission delays do not significantly impact turn-based games (such as chess) or other game genres in which timing sensitivity is not critical to gameplay. In action games and other “real-time” games, however, gameplay is extremely sensitive to the timing of various events, and transmission delays inherently result in inconsistencies continually forming between the local game states of the various players of a networked game. Consequently, developers of timing-sensitive networked games have had to invent various methods for gracefully performing “conflict resolution” to resolve divergent local game states.
- The rhythm-action genre has a unique attribute, however, that makes traditional conflict resolution methods inapplicable. Specifically, the core activity of multiplayer rhythm-action involves simultaneous music-making, which is highly timing sensitive, by two or more players. If these two players are separated by a network, the data representing musical notes played by one player will incur transmission delays when being sent to the other player. If note data were simply transmitted to a receiving machine it would trigger corresponding audio that would sound “out of sync” to the receiving player, resulting in cacophony. One solution to this problem would be to mute the audio from remote players on the local player's machine. However, this would significantly degrade the entertainment value of the game experience by destroying musical communication between the players.
- Therefore, a need exists for a system and method that enable musicians to achieve the experience of real-time musical interaction over a high-latency network, such as the Internet.
- It is an object of the invention to provide a system and method that a group individuals connected to a network can use to compete with one another in real time in a rhythm-action game.
- The invention is pointed out with particularity in the appended claims. The advantages of the invention described above, as well as further advantages of the invention, may be better understood by reference to the following description taken in conjunction with the accompanying drawings, in which:
- FIG. 1 shows a prior art rhythm-action game environment as it appears to players of the game;
- FIG. 2 depicts an improved rhythm-action game environment as it appears to players of the game; and
- FIG. 3 is a block diagram of a system for providing a rhythm-action game; and
- FIG. 4 is a block diagram of a networked rhythm-action game system.
- Referring now to FIG. 2, one embodiment of an improved rhythm-action game environment is shown. The
tunnel 200 graphically represents the musical composition with which the player interacts, i.e., the walls of thetunnel 200 are the active play surface. In the game environment shown in FIG. 2, the tunnel has eight walls, each of which corresponds to an instrumental track in the musical composition. The track occupying the bottom position is the active track, i.e., the track with which the player interacts. In FIG. 2, the active track is the track containing the drum portion of the musical composition. The player can use a provided input device to rotate any track to the bottom, i.e., make any track the active track. Although the game environment shown in FIG. 2 has anoctagonal tunnel 200, thetunnel 200 may have any number of walls. Further, it is not necessary that the walls form a closed shape. The sides may form a road, trough, or some other complex shape that does not have its ends connected to form a closed shape. - The player continuously moves through the
tunnel 200, and the player's position in thetunnel 200 is represented by agraphical cursor 210. Thegraphical cursor 210 may be a bar that appears to move along the active track of thetunnel 200. In other embodiments, the cursor is a ring that moves along the tunnel at a fixed distance in front of the player. - In one embodiment, the walls of the tunnel are transparent, and the “outer world” beyond the
tunnel 200 is used to provide ambiance during the game; for example, the environment may provide various textures and colors to enhance the player's experiences. Video clips associated with a musical composition may be played on “billboards” (not shown) that the player passes while traveling through thetunnel 200. Ambience may also be provided by a “background” track that plays during active gameplay. It should be understood that reference to the environment includes such non-visual elements. The video clips, or other elements of the environment beyond thetunnel 200, may be displayed asynchronously of the game player's actions. - Musical events in the game environment that the player must perform are represented as
graphical markers 220 spaced along the walls of thetunnel 200. FIG. 2 shows a number of markers on the drum track. - As the player moves through the
tunnel 200 along the active track, thecursor 210 scrolls across one ormore markers 220 that the player must “perform” by providing input, such as pressing a button, as thegraphical cursor 210 passes over themarker 220. If a player provides input as thecursor 210 crosses anevent marker 220, theevent 220 is “caught.” When the player “catches” an event, a sound represented by the event is played and the player's score is affected in a positive manner. If the player provides input when thecursor 210 is not passing over themarker 220, the player has “missed.” A “miss” affects the player's score in a negative manner. In one embodiment, the “miss” causes an error sound to be played. In another embodiment, a “miss” causes the game to perform the musical event closest to thecursor 210 when the miss occurs. If the player does not provide input as thecursor 210 scrolls over anevent 220, the player has “passed” thatmarker 220. A pass also has a negative effect on game score, but no sound is played. By successfully catching a series ofevents 220, a player can better his performance during game play. Also, a player successfully catching sequences of events is rewarded by the reconstruction of the musical phrases corresponding to the events. - Referring to FIG. 3, the hardware station on which the described rhythm-action game executes includes a
display 302, acentral processing unit 304,audio output device 306, and aninput device 308. - The
display 302 may be a separate display device, such as a computer monitor or television. Alternatively, thedisplay 302 may be a unitary part of a larger unit that includes the other elements of the hardware. - The
central processing unit 304 may be provided as general purpose hardware, such as a 286-based, 386-based, 486-based, Pentium-based, XEON-based, or Power PC-based personal computers. Alternatively, the central processing unit may be a network device or personal digital assistant. In one particular embodiment, thecentral processing unit 304 is a dedicated game system, such as: PLAYSTATION2, manufactured by Sony Corporation; DREAMCAST, manufactured by Sega Corp.; or XBOX, manufactured by Microsoft Corp. In still other embodiments thecentral processing unit 304 is specialized, single-purpose hardware. -
Audio device 306 may be provided as speakers, an amplifier, a digital-to-audio converter, a synthesizer, or other such device. In some embodiments, theaudio device 306 may be a unitary part of a larger unit that includes the other elements of the hardware. In one particular embodiment, theaudio device 306 has a portion that is external to thecentral processing unit 304 and a portion that is internal to thecentral processing unit 304. -
Input device 308 may be provided as an alphanumeric keyboard, a mouse, a joystick, a game pad (also called a joy pad), musical keyboard, a conventional musical instrument (e.g., a guitar, a MIDI instrument, etc.), or a “fake” musical instrument. - Still referring to FIG. 3, and in brief overview, the
central processing unit 304 includes amemory element 320, anevent monitor 330, atimer 340, adisplay system 350, aninput system 360, and anaudio system 370. It should be understood that the individual elements of thecentral processing unit 304 may be provided as hardware, software, or some combination of hardware and software. For example, in some embodiments theaudio system 370,input system 360 anddisplay system 350 are dedicated hardware or mixed hardware/firmware units that are a unitary part of thecentral processing unit 304, while theevent monitor 330,memory element 320 andtimer 340 are software or, alternatively, firmware embodied on a removable device such as a game cartridge or COMPACTFLASH card. - The
memory element 320 stores data related to the musical events for the musical composition in the game. In one embodiment,memory element 320 stores at least two pieces of data for each musical event: (1) the time during the musical composition at which the musical event should occur; and (2) the actual musical content of the event, such as pitch or rhythm related data. For embodiments in which theinput device 308 includes several buttons and a particular button on theinput device 308 must be pressed to catch a musical event, thememory element 320 also stores for each musical event and identification of which button must be pressed on theinput device 308 to catch the musical event. Thememory element 320 may be provided as any element such as RAM, DRAM, SDRAM, DDR-DRAM, PROM, EPROM, or EEPROM. - The musical event data from the
memory 320 is provided to both thedisplay system 350 and theevent monitor 330. Thedisplay system 350 also receives input from thetimer 340. Thedisplay system 350 combines the timer values 340 and the musical event data from thememory element 320 to create the game environment, an embodiment of which is shown in FIG. 2. Thedisplay system 350 may include any visualization engine capable of creating three-dimensional environments, such as Realimation, manufactured by Realimation Ltd. of the United Kingdom or the Unreal Engine, manufactured by Epic Games. - The
input system 360 receives input from theinput device 308 and transmits it to theevent monitor 330. The event monitor 330 receives musical event data from thememory element 320, timer values from thetimer 340, and the input related information from theinput system 360. The event monitor 330 compares the musical event data with the timing of input from the user to detect whether the user has caught an event, missed an event or passed on an event. When theevent monitor 330 determines that a player has caught or missed an event, it immediately sends instructions to the audio system to trigger a sound. Theaudio system 370 receives those instructions and causes theaudio devices 306 to produce sound. - For multiplayer games in which only one hardware station is used, a second input system (shown in phantom view as360′) receives input from a second input device (shown in phantom view as 308′). In this embodiment, the
memory element 320 stores two sets of musical event data, one for the first player and one for the second player. Similarly, theevent monitor 330 compares the input received for the first player frominput system 360 against musical event data for the first player received from thememory element 320 and compares input from the second player received frominput system 360′ against musical event data from the second player received from thememory element 320′. In this embodiment, whenever either player catches or misses an event, an instruction is sent to theaudio system 370 andaudio system 370 instruct the audio device to produce the appropriate sound. Since both players are local to the hardware station, each player hears the audio for both players simultaneously. - Referring now to FIG. 4, an embodiment of a networked rhythm-action game systems depicts two
hardware stations network 400. Thenetwork 400 can be any kind of network, such as a local area network (LAN), a wide area network (WAN), or the Internet. Thehardware stations 300 connect to the network 22 through one of a variety of connections including standard telephone lines, LAN or WAN links (e.g., T1, T3, 56 kb, X.25), broadband connections (e.g., ISDN, Frame Relay, ATM), and wireless connections. Transmission delays over thenetwork 400 will ensure that musical events performed by one player will not be heard simultaneously by the other player. This problem is solved by thesystem 400 as described below. - When a networked multiplayer game session begins at the direction of one of the players, that player's hardware station (the “host” hardware station) transmits a “start” instruction to all other machines, and the game begins on all systems: each player's timer starts counting, each player's note data is displayed on his screen and each player begins attempting to play notes by pressing the button on his input device as his cursor scrolls over markers.
- Gameplay on
hardware station 300 is independent from game play onhardware station 300′, except that each player's hardware station contains a local copy of the musical event data for all other players. - The timers on the various systems communicate with each other via the
network 400 to maintain approximate synchrony using any number of the conventional means known in the art to maintain synchrony. - The systems also continually transmit game score data to each other (not shown in figure), so that each system (and player) remains aware of the game score of all other systems (and players). Similarly, this is accomplished by any number of means known in the art. Note that this data is not particularly timing sensitive, because if there is momentary disagreement between any two systems regarding the score (or similar game-related parameters), the consequences to gameplay are negligible.
- As each player plays the game at their respective location, an
analyzer module 420 on that player's local hardware station 30 continually extracts data from the event monitor 330 regarding the local player's performance, referred to hereafter as “emulation data”. Emulation data may include any number of parameters that describe how well the player is performing. Some examples of these parameters include: - whether or not the most recent event type was a catch, miss, or pass;
- a moving average of the distribution of event types (i.e. the recent ratio of catch-to-pass-to-miss); or
- a moving average of timing errors of miss events.
- Each hardware station's
analyzer module 420 continually transmits the emulation data it extracts over thenetwork 400 to theother hardware station 300′ usingtransceiver 440; each hardware station'sevent monitor network 400. - The emulation data essentially contains a statistical description of a player's performance in the recent past. The event monitor330 uses received emulation data to create a statistical approximation of the remote player's performance.
- In one particular example, an incoming emulation parameter from a remote player indicates that the most recent remote event was a catch. When the
local event monitor 330 reaches the next note in the local copy of the remote player's note data, it will respond accordingly by “faking” a successful catch event, triggering the appropriate sound. That is, the local event monitor 330 will perform the next musical event from the other players' musical event data, even though that event was not necessarily actually performed by the other player's event monitor 330′. (If instead the emulation parameter had indicated that the most recent remote event was a miss, no sound would be triggered.) - In another particular example, an incoming emulation parameter from a remote player indicates that during the last8 beats, 75% of events were catches and 25% were passes. When the
local event monitor 330 reaches the next note in the local copy of the remote player's note data, it will respond accordingly by randomly choosing a catch or pass event according to the specified 75:25 distribution. - In another particular example, an incoming emulation parameter from a remote player indicates that during the last 4 beats, 2 miss events occurred, with an average timing error of 50 “ticks.” The local event monitor330 will respond accordingly by randomly generating miss events at a rate of 0.5 misses-per-beat, displacing them in time from nearby notes by the specified average timing error.
- The above three cases are merely examples of the many types of emulation parameters that may be used. These particular parameters are not the essence of the invention, however. Rather, the essence of the invention is that remote player performances are only emulated (rather than exactly reproduced) on each local machine.
- One unusual side effect of this invention, of course, is that each local player does not hear an exact reproduction of the remote players' performances; he only hears a statistical approximation. However, these statistical approximations have two countervailing positive attributes:
- 1. Because they are synchronized to the local player's timer and the local copy of the remote players' note data, they are synchronous with the local player's performance.
- 2. While not exact reproductions, they are “close enough” to effectively communicate to the local player the essence of how well the remote players are performing musically.
- In this model, delays in the transmission of the emulation data over the network do not have the intolerable side effect of causing cacophonous asynchronicity between the note streams triggering sounds on each player's local system.
- In another particular example the method described above may be used with a real-time music creation system executing on the hardware station. A real-time music creation system is one with which a non-musician can produce melodic, creative music without knowledge of music theory or the ability to play an instrument or keep time. These creation systems also allow the user to create and play improvisational solos over a prerecorded background or accompaniment track without the need to strike actuators in time or otherwise physically establish and maintain the timing of the notes of the solo. Real-time music creation engines are described in U.S. Pat. Nos. 5,763,804, 5,627,335, and 6,011,212, the entire contents of which are incorporated herein by reference.
- The real-time music creation engine generates signals representative of audible music by manipulating an input device. For example, an embodiments that provide a joystick as the input device, pulling the handle of the joystick back indicates that the user wants to play fewer notes over time in the given time signature, and pushing it forward is an indication that the user desires to play more notes over time. Similarly, pushing the handle of the joystick to the left indicates that the user wants to play notes of a lower pitch, and pushing it in the right direction is an indication that the user wants to play higher pitched notes. In a single-user embodiment, the input values are fed to a real-time music creation engine which includes at least a rhythm generator and a pitch generator. The rhythm generator and the pitch generator combine to form a series of notes that are rhythmically and melodically consonant with the background track.
- When used in the context of the present invention, an
analyzer module 420 extracts musical parameters from the input and transmits them over anetwork 400 to a remote hardware station. For example, theanalyzer module 420 may simply transmit the input stream over anetwork 400 or it may extract the information into a more abstract form, such as “faster” or “lower.” - The remote hardware station receives the transmitted emulation data and creates an approximation of the improvisation performed by the remote user by using the local real-time music creation system. The audio created by the local real-time music creation system is necessarily an approximation of the solo played by the remote player because the local real-time creation system is using the emulation data at a different point in time than the actual solo occurred. Even though this is the case, the local user hears a improvisational solo that has the same musical parameters (e.g. pitch and rhythm) as the solo created by the remote user at the remote hardware station [though delayed by the network latency].
- Although the present invention has been described in the context of a two-player game, no limitation of the principles of the invention is intended, and the invention may be used with any number of players.
- The present invention (including without limitation, the
timer 340, and the event monitor 320) may be provided as one or more computer-readable programs embodied on or in one or more articles of manufacture. The article of manufacture may be a floppy disk, a hard disk, a CD-ROM, a flash memory card, a PROM, a RAM, a ROM, or a magnetic tape. In general, the computer-readable programs may be implemented in any programming language, LISP, PERL, C, C++, PROLOG, or any byte code language such as JAVA. The software programs may be stored on or in one or more articles of manufacture as object code. - Having described certain embodiments of the invention, it will now become apparent to one of skill in the art that other embodiments incorporating the concepts of the invention may be used. Although the described embodiments relate to the field of rhythm-action games, the principles of the invention can extend to other areas that involve musical collaboration or competition by two or more users connected to a network. Therefore, the invention should not be limited to certain embodiments, but rather should be limited only by the spirit and scope of the following claims.
Claims (10)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/858,179 US6482087B1 (en) | 2001-05-14 | 2001-05-14 | Method and apparatus for facilitating group musical interaction over a network |
PCT/US2002/014558 WO2002093864A2 (en) | 2001-05-14 | 2002-05-09 | Method and apparatus for facilitating group musical interaction over a network |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/858,179 US6482087B1 (en) | 2001-05-14 | 2001-05-14 | Method and apparatus for facilitating group musical interaction over a network |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020169014A1 true US20020169014A1 (en) | 2002-11-14 |
US6482087B1 US6482087B1 (en) | 2002-11-19 |
Family
ID=25327675
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/858,179 Expired - Lifetime US6482087B1 (en) | 2001-05-14 | 2001-05-14 | Method and apparatus for facilitating group musical interaction over a network |
Country Status (2)
Country | Link |
---|---|
US (1) | US6482087B1 (en) |
WO (1) | WO2002093864A2 (en) |
Cited By (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040132526A1 (en) * | 2002-12-23 | 2004-07-08 | Yu-Chen Liu | Computer interactive and game playing system |
US20070083820A1 (en) * | 2005-10-06 | 2007-04-12 | Blythe Michael M | Input association |
WO2007115299A2 (en) * | 2006-04-04 | 2007-10-11 | Harmonix Music Systems, Inc. | A method and apparatus for providing a simulated band experience including online interaction |
US20070243915A1 (en) * | 2006-04-14 | 2007-10-18 | Eran Egozy | A Method and Apparatus For Providing A Simulated Band Experience Including Online Interaction and Downloaded Content |
US20070245881A1 (en) * | 2006-04-04 | 2007-10-25 | Eran Egozy | Method and apparatus for providing a simulated band experience including online interaction |
US7320643B1 (en) * | 2006-12-04 | 2008-01-22 | Harmonix Music Systems, Inc. | Game controller simulating a musical instrument |
US20080092047A1 (en) * | 2006-10-12 | 2008-04-17 | Rideo, Inc. | Interactive multimedia system and method for audio dubbing of video |
US20080113797A1 (en) * | 2006-11-15 | 2008-05-15 | Harmonix Music Systems, Inc. | Method and apparatus for facilitating group musical interaction over a network |
WO2008091642A2 (en) * | 2007-01-23 | 2008-07-31 | I A Studios, Llc | Methods, systems, and computer program products for determining an integrity measure of a game user using dynamically generated data events |
US20080299906A1 (en) * | 2007-06-04 | 2008-12-04 | Topway Electrical Appliance Company | Emulating playing apparatus of simulating games |
US20090088247A1 (en) * | 2007-09-28 | 2009-04-02 | Oberg Gregory Keith | Handheld device wireless music streaming for gameplay |
US20090172659A1 (en) * | 2007-12-31 | 2009-07-02 | Oberg Gregory Keith | Video game forward compatibility including software patching |
US20100009750A1 (en) * | 2008-07-08 | 2010-01-14 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US20100300270A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Displaying an input at multiple octaves |
US20100300264A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music System, Inc. | Practice Mode for Multiple Musical Parts |
US20100300269A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Scoring a Musical Performance After a Period of Ambiguity |
US20100300265A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music System, Inc. | Dynamic musical part determination |
US20100300267A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Selectively displaying song lyrics |
US20100300268A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Preventing an unintentional deploy of a bonus in a video game |
US20100304810A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Displaying A Harmonically Relevant Pitch Guide |
US20100304811A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Scoring a Musical Performance Involving Multiple Parts |
US7935880B2 (en) | 2009-05-29 | 2011-05-03 | Harmonix Music Systems, Inc. | Dynamically displaying a pitch range |
US8439733B2 (en) | 2007-06-14 | 2013-05-14 | Harmonix Music Systems, Inc. | Systems and methods for reinstating a player within a rhythm-action game |
US8444464B2 (en) | 2010-06-11 | 2013-05-21 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8449360B2 (en) | 2009-05-29 | 2013-05-28 | Harmonix Music Systems, Inc. | Displaying song lyrics and vocal cues |
US8465366B2 (en) | 2009-05-29 | 2013-06-18 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US8550908B2 (en) | 2010-03-16 | 2013-10-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8678896B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US8686269B2 (en) | 2006-03-29 | 2014-04-01 | Harmonix Music Systems, Inc. | Providing realistic interaction to a player of a music-based video game |
US8702485B2 (en) | 2010-06-11 | 2014-04-22 | Harmonix Music Systems, Inc. | Dance game and tutorial |
JP2014167519A (en) * | 2013-02-28 | 2014-09-11 | Daiichikosho Co Ltd | Communication karaoke system allowing continuation of duet singing during communication failure |
JP2014167520A (en) * | 2013-02-28 | 2014-09-11 | Daiichikosho Co Ltd | Communication karaoke system allowing continuation of duet singing during communication failure |
US20140301574A1 (en) * | 2009-04-24 | 2014-10-09 | Shindig, Inc. | Networks of portable electronic devices that collectively generate sound |
US20150120308A1 (en) * | 2012-03-29 | 2015-04-30 | Smule, Inc. | Computationally-Assisted Musical Sequencing and/or Composition Techniques for Social Music Challenge or Competition |
US9024166B2 (en) | 2010-09-09 | 2015-05-05 | Harmonix Music Systems, Inc. | Preventing subtractive track separation |
US9358456B1 (en) | 2010-06-11 | 2016-06-07 | Harmonix Music Systems, Inc. | Dance competition game |
CN105813700A (en) * | 2013-12-11 | 2016-07-27 | 科乐美数码娱乐株式会社 | Game program, game system, and game method |
US9711181B2 (en) | 2014-07-25 | 2017-07-18 | Shindig. Inc. | Systems and methods for creating, editing and publishing recorded videos |
US9712579B2 (en) | 2009-04-01 | 2017-07-18 | Shindig. Inc. | Systems and methods for creating and publishing customizable images from within online events |
US9734410B2 (en) | 2015-01-23 | 2017-08-15 | Shindig, Inc. | Systems and methods for analyzing facial expressions within an online classroom to gauge participant attentiveness |
US9773486B2 (en) | 2015-09-28 | 2017-09-26 | Harmonix Music Systems, Inc. | Vocal improvisation |
US9799314B2 (en) | 2015-09-28 | 2017-10-24 | Harmonix Music Systems, Inc. | Dynamic improvisational fill feature |
US9842577B2 (en) | 2015-05-19 | 2017-12-12 | Harmonix Music Systems, Inc. | Improvised guitar simulation |
US20180084304A1 (en) * | 2011-05-31 | 2018-03-22 | Rovi Guides, Inc. | Systems and methods for transmitting media associated with a measure of quality based on level of game play in an interactive video gaming environment |
US9981193B2 (en) | 2009-10-27 | 2018-05-29 | Harmonix Music Systems, Inc. | Movement based recognition and evaluation |
US20180174596A1 (en) * | 2010-04-12 | 2018-06-21 | Smule, Inc. | Coordinating and mixing vocals captured from geographically distributed performers |
US10133916B2 (en) | 2016-09-07 | 2018-11-20 | Steven M. Gottlieb | Image and identity validation in video chat events |
WO2018235544A1 (en) * | 2017-06-20 | 2018-12-27 | 株式会社コナミアミューズメント | Game system and computer program used for same |
US10271010B2 (en) | 2013-10-31 | 2019-04-23 | Shindig, Inc. | Systems and methods for controlling the display of content |
US10357714B2 (en) | 2009-10-27 | 2019-07-23 | Harmonix Music Systems, Inc. | Gesture-based user interface for navigating a menu |
US10542237B2 (en) | 2008-11-24 | 2020-01-21 | Shindig, Inc. | Systems and methods for facilitating communications amongst multiple users |
Families Citing this family (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2599357B2 (en) * | 1985-09-11 | 1997-04-09 | カシオ計算機株式会社 | Waveform reading device |
US9818386B2 (en) | 1999-10-19 | 2017-11-14 | Medialab Solutions Corp. | Interactive digital music recorder and player |
US7176372B2 (en) | 1999-10-19 | 2007-02-13 | Medialab Solutions Llc | Interactive digital music recorder and player |
US6740803B2 (en) * | 2001-11-21 | 2004-05-25 | Line 6, Inc | Computing device to allow for the selection and display of a multimedia presentation of an audio file and to allow a user to play a musical instrument in conjunction with the multimedia presentation |
US6969797B2 (en) * | 2001-11-21 | 2005-11-29 | Line 6, Inc | Interface device to couple a musical instrument to a computing device to allow a user to play a musical instrument in conjunction with a multimedia presentation |
EP1326228B1 (en) | 2002-01-04 | 2016-03-23 | MediaLab Solutions LLC | Systems and methods for creating, modifying, interacting with and playing musical compositions |
US6653545B2 (en) * | 2002-03-01 | 2003-11-25 | Ejamming, Inc. | Method and apparatus for remote real time collaborative music performance |
JP3903821B2 (en) * | 2002-03-25 | 2007-04-11 | ヤマハ株式会社 | Performance sound providing system |
US7169996B2 (en) * | 2002-11-12 | 2007-01-30 | Medialab Solutions Llc | Systems and methods for generating music using data/music data file transmitted/received via a network |
US7828657B2 (en) * | 2003-05-20 | 2010-11-09 | Turbine, Inc. | System and method for enhancing the experience of participant in a massively multiplayer game |
GB2403662B (en) | 2003-07-09 | 2008-01-16 | Sony Comp Entertainment Europe | Game processing |
US9144737B2 (en) * | 2003-08-01 | 2015-09-29 | Turbine, Inc. | Securing goal-activated game content |
US7702723B2 (en) * | 2003-08-01 | 2010-04-20 | Turbine, Inc. | Efficient method for providing game content to a client |
US20060080702A1 (en) * | 2004-05-20 | 2006-04-13 | Turner Broadcasting System, Inc. | Systems and methods for delivering content over a network |
US7465231B2 (en) * | 2004-05-20 | 2008-12-16 | Gametap Llc | Systems and methods for delivering content over a network |
US9635312B2 (en) | 2004-09-27 | 2017-04-25 | Soundstreak, Llc | Method and apparatus for remote voice-over or music production and management |
BRPI0516010A (en) * | 2004-09-27 | 2008-08-19 | Soundstreak Inc | method and apparatus for managing and producing music or remote voice-over |
US20120057842A1 (en) * | 2004-09-27 | 2012-03-08 | Dan Caligor | Method and Apparatus for Remote Voice-Over or Music Production and Management |
US10726822B2 (en) | 2004-09-27 | 2020-07-28 | Soundstreak, Llc | Method and apparatus for remote digital content monitoring and management |
JP3950142B2 (en) * | 2005-01-14 | 2007-07-25 | 株式会社コナミデジタルエンタテインメント | GAME DEVICE, GAME CONTROL METHOD, AND PROGRAM |
JP2006340744A (en) * | 2005-06-07 | 2006-12-21 | Nintendo Co Ltd | Game program and game device |
US7563975B2 (en) | 2005-09-14 | 2009-07-21 | Mattel, Inc. | Music production system |
JP4591308B2 (en) * | 2005-10-25 | 2010-12-01 | ヤマハ株式会社 | Music session system, server for music session system, and program for realizing control method for controlling server |
US20070163428A1 (en) * | 2006-01-13 | 2007-07-19 | Salter Hal C | System and method for network communication of music data |
US20080092062A1 (en) * | 2006-05-15 | 2008-04-17 | Krystina Motsinger | Online performance venue system and method |
EP2115732B1 (en) | 2007-02-01 | 2015-03-25 | Museami, Inc. | Music transcription |
WO2008101130A2 (en) * | 2007-02-14 | 2008-08-21 | Museami, Inc. | Music-based search engine |
US20080200224A1 (en) | 2007-02-20 | 2008-08-21 | Gametank Inc. | Instrument Game System and Method |
US8907193B2 (en) | 2007-02-20 | 2014-12-09 | Ubisoft Entertainment | Instrument game system and method |
US7772480B2 (en) * | 2007-08-10 | 2010-08-10 | Sonicjam, Inc. | Interactive music training and entertainment system and multimedia role playing game platform |
US8138409B2 (en) * | 2007-08-10 | 2012-03-20 | Sonicjam, Inc. | Interactive music training and entertainment system |
EP2244796A1 (en) | 2008-01-24 | 2010-11-03 | 745 Llc | Method and apparatus for stringed controllers and/or instruments |
US8494257B2 (en) | 2008-02-13 | 2013-07-23 | Museami, Inc. | Music score deconstruction |
CN102037486A (en) | 2008-02-20 | 2011-04-27 | Oem有限责任公司 | System for learning and mixing music |
US8317614B2 (en) | 2008-04-15 | 2012-11-27 | Activision Publishing, Inc. | System and method for playing a music video game with a drum system game controller |
US8380127B2 (en) * | 2008-10-29 | 2013-02-19 | National Semiconductor Corporation | Plurality of mobile communication devices for performing locally collaborative operations |
US8092288B2 (en) * | 2008-10-31 | 2012-01-10 | International Business Machines Corporation | Managing multi-player video game input |
US9120016B2 (en) | 2008-11-21 | 2015-09-01 | Ubisoft Entertainment | Interactive guitar game designed for learning to play the guitar |
US8158873B2 (en) * | 2009-08-03 | 2012-04-17 | William Ivanich | Systems and methods for generating a game device music track from music |
US9492756B2 (en) | 2009-09-14 | 2016-11-15 | Joytunes Ltd. | System and method for analyzing a digitalized musical performance |
US8653349B1 (en) * | 2010-02-22 | 2014-02-18 | Podscape Holdings Limited | System and method for musical collaboration in virtual space |
US8371940B1 (en) | 2010-05-05 | 2013-02-12 | Activision Publishing, Inc. | Multi-player music game |
WO2012051605A2 (en) | 2010-10-15 | 2012-04-19 | Jammit Inc. | Dynamic point referencing of an audiovisual performance for an accurate and precise selection and controlled cycling of portions of the performance |
JP5742217B2 (en) * | 2010-12-28 | 2015-07-01 | ヤマハ株式会社 | Program and electronic music apparatus for realizing control method for controlling electronic terminal |
JP6151527B2 (en) * | 2013-02-07 | 2017-06-21 | 任天堂株式会社 | Music game program, game device, game device control method, and game system |
WO2014137311A1 (en) | 2013-03-04 | 2014-09-12 | Empire Technology Development Llc | Virtual instrument playing scheme |
US9857934B2 (en) | 2013-06-16 | 2018-01-02 | Jammit, Inc. | Synchronized display and performance mapping of musical performances submitted from remote locations |
US11110355B2 (en) * | 2015-06-19 | 2021-09-07 | Activision Publishing, Inc. | Videogame peripheral security system and method |
KR101922894B1 (en) * | 2016-04-11 | 2018-11-28 | 주식회사 네오위즈 | A music game device and computer-readable medium for recording program therefor |
US10182093B1 (en) * | 2017-09-12 | 2019-01-15 | Yousician Oy | Computer implemented method for providing real-time interaction between first player and second player to collaborate for musical performance over network |
US10504498B2 (en) * | 2017-11-22 | 2019-12-10 | Yousician Oy | Real-time jamming assistance for groups of musicians |
US10218747B1 (en) * | 2018-03-07 | 2019-02-26 | Microsoft Technology Licensing, Llc | Leveraging geographically proximate devices to reduce network traffic generated by digital collaboration |
CN108711415B (en) * | 2018-06-11 | 2021-10-08 | 广州酷狗计算机科技有限公司 | Method, apparatus and storage medium for correcting time delay between accompaniment and dry sound |
DE102018211133A1 (en) * | 2018-07-05 | 2020-01-09 | Bayerische Motoren Werke Aktiengesellschaft | Audio device for a vehicle and method for operating an audio device for a vehicle |
JP7141093B2 (en) * | 2018-07-17 | 2022-09-22 | 株式会社アルファコード | TIMING GAME DEVICE AND TIMING GAME PROGRAM |
US10748515B2 (en) * | 2018-12-21 | 2020-08-18 | Electronic Arts Inc. | Enhanced real-time audio generation via cloud-based virtualized orchestra |
US10790919B1 (en) | 2019-03-26 | 2020-09-29 | Electronic Arts Inc. | Personalized real-time audio generation based on user physiological response |
US10799795B1 (en) | 2019-03-26 | 2020-10-13 | Electronic Arts Inc. | Real-time audio generation for electronic games based on personalized music preferences |
US10657934B1 (en) | 2019-03-27 | 2020-05-19 | Electronic Arts Inc. | Enhancements for musical composition applications |
US10643593B1 (en) * | 2019-06-04 | 2020-05-05 | Electronic Arts Inc. | Prediction-based communication latency elimination in a distributed virtualized orchestra |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5054360A (en) * | 1990-11-01 | 1991-10-08 | International Business Machines Corporation | Method and apparatus for simultaneous output of digital audio and midi synthesized music |
US5117726A (en) * | 1990-11-01 | 1992-06-02 | International Business Machines Corporation | Method and apparatus for dynamic midi synthesizer filter control |
US5393926A (en) * | 1993-06-07 | 1995-02-28 | Ahead, Inc. | Virtual music system |
US5689641A (en) * | 1993-10-01 | 1997-11-18 | Vicor, Inc. | Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal |
US5521324A (en) * | 1994-07-20 | 1996-05-28 | Carnegie Mellon University | Automated musical accompaniment with multiple input sensors |
KR0144223B1 (en) * | 1995-03-31 | 1998-08-17 | 배순훈 | Scoring method for karaoke |
US5916302A (en) * | 1996-12-06 | 1999-06-29 | International Business Machines Corporation | Multimedia conferencing using parallel networks |
US5852251A (en) * | 1997-06-25 | 1998-12-22 | Industrial Technology Research Institute | Method and apparatus for real-time dynamic midi control |
JP3277875B2 (en) * | 1998-01-29 | 2002-04-22 | ヤマハ株式会社 | Performance device, server device, performance method, and performance control method |
JP3017986B1 (en) * | 1998-11-26 | 2000-03-13 | コナミ株式会社 | Game system and computer-readable storage medium |
AU7455400A (en) * | 1999-09-16 | 2001-04-17 | Hanseulsoft Co., Ltd. | Method and apparatus for playing musical instruments based on a digital music file |
US6598074B1 (en) * | 1999-09-23 | 2003-07-22 | Rocket Network, Inc. | System and method for enabling multimedia production collaboration over a network |
-
2001
- 2001-05-14 US US09/858,179 patent/US6482087B1/en not_active Expired - Lifetime
-
2002
- 2002-05-09 WO PCT/US2002/014558 patent/WO2002093864A2/en not_active Application Discontinuation
Cited By (86)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040132526A1 (en) * | 2002-12-23 | 2004-07-08 | Yu-Chen Liu | Computer interactive and game playing system |
US9389702B2 (en) * | 2005-10-06 | 2016-07-12 | Hewlett-Packard Development Company, L.P. | Input association |
US20070083820A1 (en) * | 2005-10-06 | 2007-04-12 | Blythe Michael M | Input association |
US8686269B2 (en) | 2006-03-29 | 2014-04-01 | Harmonix Music Systems, Inc. | Providing realistic interaction to a player of a music-based video game |
WO2007115299A2 (en) * | 2006-04-04 | 2007-10-11 | Harmonix Music Systems, Inc. | A method and apparatus for providing a simulated band experience including online interaction |
US20070245881A1 (en) * | 2006-04-04 | 2007-10-25 | Eran Egozy | Method and apparatus for providing a simulated band experience including online interaction |
WO2007115299A3 (en) * | 2006-04-04 | 2008-02-21 | Harmonix Music Systems Inc | A method and apparatus for providing a simulated band experience including online interaction |
US20100087240A1 (en) * | 2006-04-04 | 2010-04-08 | Harmonix Music Systems, Inc. | Method and apparatus for providing a simulated band experience including online interaction |
US20070243915A1 (en) * | 2006-04-14 | 2007-10-18 | Eran Egozy | A Method and Apparatus For Providing A Simulated Band Experience Including Online Interaction and Downloaded Content |
US20080092047A1 (en) * | 2006-10-12 | 2008-04-17 | Rideo, Inc. | Interactive multimedia system and method for audio dubbing of video |
WO2008061169A3 (en) * | 2006-11-15 | 2008-07-24 | Harmonix Music Systems Inc | Method and apparatus for facilitating group musical interaction over a network |
US7758427B2 (en) * | 2006-11-15 | 2010-07-20 | Harmonix Music Systems, Inc. | Facilitating group musical interaction over a network |
US8079907B2 (en) | 2006-11-15 | 2011-12-20 | Harmonix Music Systems, Inc. | Method and apparatus for facilitating group musical interaction over a network |
WO2008061169A2 (en) * | 2006-11-15 | 2008-05-22 | Harmonix Music Systems, Inc. | Method and apparatus for facilitating group musical interaction over a network |
US20080113797A1 (en) * | 2006-11-15 | 2008-05-15 | Harmonix Music Systems, Inc. | Method and apparatus for facilitating group musical interaction over a network |
US7320643B1 (en) * | 2006-12-04 | 2008-01-22 | Harmonix Music Systems, Inc. | Game controller simulating a musical instrument |
WO2008091642A2 (en) * | 2007-01-23 | 2008-07-31 | I A Studios, Llc | Methods, systems, and computer program products for determining an integrity measure of a game user using dynamically generated data events |
WO2008091642A3 (en) * | 2007-01-23 | 2008-10-09 | I A Studios Llc | Methods, systems, and computer program products for determining an integrity measure of a game user using dynamically generated data events |
US8419531B2 (en) | 2007-01-23 | 2013-04-16 | MFV.com, Inc. | Methods, systems, and computer program products for determining an integrity measure of a game user using dynamically generated data events |
US20080299906A1 (en) * | 2007-06-04 | 2008-12-04 | Topway Electrical Appliance Company | Emulating playing apparatus of simulating games |
US8678895B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for online band matching in a rhythm action game |
US8439733B2 (en) | 2007-06-14 | 2013-05-14 | Harmonix Music Systems, Inc. | Systems and methods for reinstating a player within a rhythm-action game |
US8444486B2 (en) | 2007-06-14 | 2013-05-21 | Harmonix Music Systems, Inc. | Systems and methods for indicating input actions in a rhythm-action game |
US8690670B2 (en) | 2007-06-14 | 2014-04-08 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US8678896B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US8409006B2 (en) | 2007-09-28 | 2013-04-02 | Activision Publishing, Inc. | Handheld device wireless music streaming for gameplay |
US20090088247A1 (en) * | 2007-09-28 | 2009-04-02 | Oberg Gregory Keith | Handheld device wireless music streaming for gameplay |
US9384747B2 (en) | 2007-09-28 | 2016-07-05 | Activision Publishing, Inc. | Handheld device wireless music streaming for gameplay |
US8943488B2 (en) | 2007-12-31 | 2015-01-27 | Activision Publishing, Inc. | Video game forward compatibility including software patching |
US20090172659A1 (en) * | 2007-12-31 | 2009-07-02 | Oberg Gregory Keith | Video game forward compatibility including software patching |
US8663013B2 (en) * | 2008-07-08 | 2014-03-04 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US20100009750A1 (en) * | 2008-07-08 | 2010-01-14 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US10542237B2 (en) | 2008-11-24 | 2020-01-21 | Shindig, Inc. | Systems and methods for facilitating communications amongst multiple users |
US9712579B2 (en) | 2009-04-01 | 2017-07-18 | Shindig. Inc. | Systems and methods for creating and publishing customizable images from within online events |
US9401132B2 (en) * | 2009-04-24 | 2016-07-26 | Steven M. Gottlieb | Networks of portable electronic devices that collectively generate sound |
US20140301574A1 (en) * | 2009-04-24 | 2014-10-09 | Shindig, Inc. | Networks of portable electronic devices that collectively generate sound |
US7923620B2 (en) | 2009-05-29 | 2011-04-12 | Harmonix Music Systems, Inc. | Practice mode for multiple musical parts |
US7982114B2 (en) | 2009-05-29 | 2011-07-19 | Harmonix Music Systems, Inc. | Displaying an input at multiple octaves |
US8076564B2 (en) | 2009-05-29 | 2011-12-13 | Harmonix Music Systems, Inc. | Scoring a musical performance after a period of ambiguity |
US8026435B2 (en) | 2009-05-29 | 2011-09-27 | Harmonix Music Systems, Inc. | Selectively displaying song lyrics |
US8449360B2 (en) | 2009-05-29 | 2013-05-28 | Harmonix Music Systems, Inc. | Displaying song lyrics and vocal cues |
US8465366B2 (en) | 2009-05-29 | 2013-06-18 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US8017854B2 (en) * | 2009-05-29 | 2011-09-13 | Harmonix Music Systems, Inc. | Dynamic musical part determination |
US20100300270A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Displaying an input at multiple octaves |
US20100300264A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music System, Inc. | Practice Mode for Multiple Musical Parts |
US8080722B2 (en) | 2009-05-29 | 2011-12-20 | Harmonix Music Systems, Inc. | Preventing an unintentional deploy of a bonus in a video game |
US7935880B2 (en) | 2009-05-29 | 2011-05-03 | Harmonix Music Systems, Inc. | Dynamically displaying a pitch range |
US20100304811A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Scoring a Musical Performance Involving Multiple Parts |
US20100304810A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Displaying A Harmonically Relevant Pitch Guide |
US20100300268A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Preventing an unintentional deploy of a bonus in a video game |
US20100300269A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Scoring a Musical Performance After a Period of Ambiguity |
US20100300267A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Selectively displaying song lyrics |
US20100300265A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music System, Inc. | Dynamic musical part determination |
US9981193B2 (en) | 2009-10-27 | 2018-05-29 | Harmonix Music Systems, Inc. | Movement based recognition and evaluation |
US10357714B2 (en) | 2009-10-27 | 2019-07-23 | Harmonix Music Systems, Inc. | Gesture-based user interface for navigating a menu |
US10421013B2 (en) | 2009-10-27 | 2019-09-24 | Harmonix Music Systems, Inc. | Gesture-based user interface |
US8550908B2 (en) | 2010-03-16 | 2013-10-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US9278286B2 (en) | 2010-03-16 | 2016-03-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8874243B2 (en) | 2010-03-16 | 2014-10-28 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8568234B2 (en) | 2010-03-16 | 2013-10-29 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US10395666B2 (en) * | 2010-04-12 | 2019-08-27 | Smule, Inc. | Coordinating and mixing vocals captured from geographically distributed performers |
US20180174596A1 (en) * | 2010-04-12 | 2018-06-21 | Smule, Inc. | Coordinating and mixing vocals captured from geographically distributed performers |
US11074923B2 (en) | 2010-04-12 | 2021-07-27 | Smule, Inc. | Coordinating and mixing vocals captured from geographically distributed performers |
US8562403B2 (en) | 2010-06-11 | 2013-10-22 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8444464B2 (en) | 2010-06-11 | 2013-05-21 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US9358456B1 (en) | 2010-06-11 | 2016-06-07 | Harmonix Music Systems, Inc. | Dance competition game |
US8702485B2 (en) | 2010-06-11 | 2014-04-22 | Harmonix Music Systems, Inc. | Dance game and tutorial |
US9024166B2 (en) | 2010-09-09 | 2015-05-05 | Harmonix Music Systems, Inc. | Preventing subtractive track separation |
US20180084304A1 (en) * | 2011-05-31 | 2018-03-22 | Rovi Guides, Inc. | Systems and methods for transmitting media associated with a measure of quality based on level of game play in an interactive video gaming environment |
US9992543B2 (en) * | 2011-05-31 | 2018-06-05 | Rovi Guides, Inc. | Systems and methods for transmitting media associated with a measure of quality based on level of game play in an interactive video gaming environment |
US10262644B2 (en) * | 2012-03-29 | 2019-04-16 | Smule, Inc. | Computationally-assisted musical sequencing and/or composition techniques for social music challenge or competition |
US20150120308A1 (en) * | 2012-03-29 | 2015-04-30 | Smule, Inc. | Computationally-Assisted Musical Sequencing and/or Composition Techniques for Social Music Challenge or Competition |
JP2014167520A (en) * | 2013-02-28 | 2014-09-11 | Daiichikosho Co Ltd | Communication karaoke system allowing continuation of duet singing during communication failure |
JP2014167519A (en) * | 2013-02-28 | 2014-09-11 | Daiichikosho Co Ltd | Communication karaoke system allowing continuation of duet singing during communication failure |
US10271010B2 (en) | 2013-10-31 | 2019-04-23 | Shindig, Inc. | Systems and methods for controlling the display of content |
CN105813700A (en) * | 2013-12-11 | 2016-07-27 | 科乐美数码娱乐株式会社 | Game program, game system, and game method |
US20160279519A1 (en) * | 2013-12-11 | 2016-09-29 | Konami Digital Entertainment Co., Ltd. | Game program, game system, and game method |
US10322345B2 (en) * | 2013-12-11 | 2019-06-18 | Konami Digital Entertainment Co., Ltd. | Game program, game system, and game method |
US9711181B2 (en) | 2014-07-25 | 2017-07-18 | Shindig. Inc. | Systems and methods for creating, editing and publishing recorded videos |
US9734410B2 (en) | 2015-01-23 | 2017-08-15 | Shindig, Inc. | Systems and methods for analyzing facial expressions within an online classroom to gauge participant attentiveness |
US9842577B2 (en) | 2015-05-19 | 2017-12-12 | Harmonix Music Systems, Inc. | Improvised guitar simulation |
US9773486B2 (en) | 2015-09-28 | 2017-09-26 | Harmonix Music Systems, Inc. | Vocal improvisation |
US9799314B2 (en) | 2015-09-28 | 2017-10-24 | Harmonix Music Systems, Inc. | Dynamic improvisational fill feature |
US10133916B2 (en) | 2016-09-07 | 2018-11-20 | Steven M. Gottlieb | Image and identity validation in video chat events |
JP2019004931A (en) * | 2017-06-20 | 2019-01-17 | 株式会社コナミアミューズメント | Game system and computer program used for the same |
WO2018235544A1 (en) * | 2017-06-20 | 2018-12-27 | 株式会社コナミアミューズメント | Game system and computer program used for same |
Also Published As
Publication number | Publication date |
---|---|
WO2002093864A3 (en) | 2003-01-16 |
WO2002093864A2 (en) | 2002-11-21 |
US6482087B1 (en) | 2002-11-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6482087B1 (en) | Method and apparatus for facilitating group musical interaction over a network | |
US7758427B2 (en) | Facilitating group musical interaction over a network | |
US20100087240A1 (en) | Method and apparatus for providing a simulated band experience including online interaction | |
US20070243915A1 (en) | A Method and Apparatus For Providing A Simulated Band Experience Including Online Interaction and Downloaded Content | |
WO2007115299A2 (en) | A method and apparatus for providing a simulated band experience including online interaction | |
Collins | Game sound: an introduction to the history, theory, and practice of video game music and sound design | |
JP4220340B2 (en) | GAME SYSTEM, PROGRAM, AND INFORMATION STORAGE MEDIUM | |
KR100955465B1 (en) | Game result evaluating method, game result evaluating device, and computer readable medium on which game result evaluating program is recorded | |
US20100304865A1 (en) | Simulated Guitar Controller with Split Strum Bar | |
US9842577B2 (en) | Improvised guitar simulation | |
JP3760027B2 (en) | Information storage medium and game device | |
KR20070106551A (en) | Game system, game system control method and information storage medium | |
JP3746875B2 (en) | Information storage medium and game device | |
JP6870143B1 (en) | Support support system and support method | |
JP3863545B2 (en) | Information storage medium and game device | |
JP2006095331A (en) | Information storage medium and game device | |
KR20070106550A (en) | Game system, game system control method and information storage medium | |
JP7093642B2 (en) | Computer system, program and timing game execution control method | |
JP3404594B2 (en) | Recording medium and music game apparatus | |
JP3502898B2 (en) | Recording medium having recorded program for processing live situation, live voice output method, and game apparatus | |
JP2022157561A (en) | game system and program | |
Smith | The musical parameters of immersion and flow: involving the player, emotionally and physically, in a video-game | |
Grimshaw-Aagaard | Sound | |
JP2022124619A (en) | Game system, computer program used for the same, and control method | |
KR200191678Y1 (en) | Storage media of music game using music and its music |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: HARMONIX MUSIC SYSTEMS, INC., MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:EGOZY, ERAN;SCHMIDT, DAN;RIGOPULOS, ALEXANDER;REEL/FRAME:012195/0593 Effective date: 20010913 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
AS | Assignment |
Owner name: COLBECK PARTNERS II, LLC, AS ADMINISTRATIVE AGENT, Free format text: SECURITY AGREEMENT;ASSIGNORS:HARMONIX MUSIC SYSTEMS, INC.;HARMONIX PROMOTIONS & EVENTS INC.;HARMONIX MARKETING INC.;REEL/FRAME:025764/0656 Effective date: 20110104 |
|
FPAY | Fee payment |
Year of fee payment: 12 |
|
AS | Assignment |
Owner name: HARMONIX MARKETING INC., MASSACHUSETTS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:COLBECK PARTNERS II, LLC, AS ADMINISTRATIVE AGENT;REEL/FRAME:057984/0087 Effective date: 20110406 Owner name: HARMONIX PROMOTIONS & EVENTS INC., MASSACHUSETTS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:COLBECK PARTNERS II, LLC, AS ADMINISTRATIVE AGENT;REEL/FRAME:057984/0087 Effective date: 20110406 Owner name: HARMONIX MUSIC SYSTEMS, INC., MASSACHUSETTS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:COLBECK PARTNERS II, LLC, AS ADMINISTRATIVE AGENT;REEL/FRAME:057984/0087 Effective date: 20110406 |