US20100279822A1 - Systems and methods for optimizing one or more audio tracks to a video stream - Google Patents

Systems and methods for optimizing one or more audio tracks to a video stream Download PDF

Info

Publication number
US20100279822A1
US20100279822A1 US12/609,438 US60943809A US2010279822A1 US 20100279822 A1 US20100279822 A1 US 20100279822A1 US 60943809 A US60943809 A US 60943809A US 2010279822 A1 US2010279822 A1 US 2010279822A1
Authority
US
United States
Prior art keywords
rate
video
audio
user
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/609,438
Inventor
John Hajime FORD
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
VIRTUAL ACTIVE Inc
Original Assignee
VIRTUAL ACTIVE Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by VIRTUAL ACTIVE Inc filed Critical VIRTUAL ACTIVE Inc
Priority to US12/609,438 priority Critical patent/US20100279822A1/en
Assigned to VIRTUAL ACTIVE, INC. reassignment VIRTUAL ACTIVE, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FORD, JOHN HAJIME
Publication of US20100279822A1 publication Critical patent/US20100279822A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A63B2071/0625Emitting sound, noise or music
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A63B2071/0638Displaying moving images of recorded environment, e.g. virtual environment
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/20Miscellaneous features of sport apparatus, devices or equipment with means for remote communication, e.g. internet or the like
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/50Wireless data transmission, e.g. by radio transmitters or telemetry
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/04Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • A63B2230/06Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0686Timers, rhythm indicators or pacing apparatus using electric or electronic means

Definitions

  • a solution is needed to provide a mechanism for people working out alone to attain a training benefit of working out with a work-out partner.
  • An aspect of the invention provides a system that detects the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience.
  • the system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.
  • An aspect of the invention is directed to an exercise system.
  • the exercise system comprises: a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmitting the input to the central processing unit; a prerecorded video frame sequence encoded onto a storage medium in communication with and playable on the video playing device; a video monitor in communication with the video playing device for displaying the prerecorded video frame sequence reproduced by the video playing device; a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the monitor in response to the one or more inputs from the user wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed; two or more
  • the video frame rate controller is adapted and configured to comprise a computer program stored on a storage medium with the prerecorded video frame sequence.
  • the program is operable, for example, with the central processing unit in the video playing device when the prerecorded video sequence is played to modify the frame display rate in response to the signal from the user interface rate detector.
  • the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. Suitable exercise devices include, for example, a bicycle, a stair stepper, and an elliptical trainer.
  • the apparatus comprises a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor; a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmitting a signal proportional to the rate of exercise; a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed; and one or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played.
  • Suitable exercise devices include, for example, a bicycle, a stair stepper and an elliptical trainer.
  • the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector.
  • the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
  • Still other aspects of the invention are directed to a method of controlling a video frame sequence display rate of a prerecorded video playback sequence in a device in response to an external signal, in which each video frame has a unique frame time stamp and a duration time stamp indicating the time between successive frames.
  • the method typically comprises the steps of: a) accessing the duration time stamp for a current video frame; b) determining from the external signal an adjustment value for changing the display rate; c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp; d) displaying the next frame when the modified duration time has passed; e) accessing the duration time stamp for a current audio data packet; f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet; g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; h) playing the next audio data packet when the modified duration time has passed; and i) repeating steps a through d for each subsequent video frame and steps e through h for each subsequent audio data packet.
  • the accessing step can further comprise the steps of: i) setting a time offset to current clock time; ii) displaying a current video frame; and iii) accessing a frame time stamp and a duration time stamp for the current video frame.
  • the step of determining can further comprise the step of comparing the external signal to predetermined criteria to determine the adjustment value.
  • the external signal is a user variable exercise rate signal.
  • the step of displaying further comprises the steps of: i) adding the modified duration value to the time offset to obtain a next frame time; and ii) displaying the next frame when clock time exceeds the next frame time.
  • FIG. 1A-C are overviews of a system having a server, a CPU, a monitor, storage media, input devices, etc. which can be used by a user;
  • FIG. 2 is block diagram of the apparatus in accordance with the invention shown FIG. 1 b;
  • FIG. 3 is a flow diagram of the video frame rate control program encoded on the video disk
  • FIG. 4 is a flow diagram of a adjustment factor subroutine
  • FIGS. 5A-B are is flow diagrams of adjustment factor subroutines.
  • FIGS. 6A-B are logic flow diagrams of an embedded processor in an interface unit.
  • An aspect of the invention provides a video stream that has one or more audio tracks associated with the video stream, one of which correlates to the sounds of, for example footfalls and which is variable in response to input and which can be used, for example, as a training guide to encourage people to increase their exertion rate as they perceive competing against another person.
  • a second audio track is provided that can correspond to normal ambient-type noise that might be heard by a user in the environment represented by the video stream, music or whatever background noise a user selects. Changes to the video rate correlated audio can be in response to user input or in response to a sensing of a user parameter.
  • a variety of components are required: computer systems, components and networks; exercise devices; and software which transforms input from the exercise device and/or computer system into a video and audio output which is delivered to a user.
  • FIG. 1A is a block diagram showing a representative example logic device through which reviewing, manipulating, or analyzing information relating to the present invention can be achieved.
  • Such data can be in relation to exercise, one or more physiological parameters, exertion, or any other suitable parameter desired to be measured of a subject.
  • a computer system (or digital device) 100 that may be understood as a logical apparatus that can read instructions from media 111 and/or network port 105 , which can optionally be connected to server 109 having fixed media 112 .
  • the computer system 100 can also be connected to the Internet or an intranet.
  • the system includes CPU 101 , disk drives 103 , optional input devices, illustrated as keyboard 115 and/or mouse 116 and optional monitor 107 .
  • Data communication can be achieved through the indicated communication medium to a server 109 at a local or a remote location.
  • the communication medium can include any means of transmitting and/or receiving data.
  • the communication medium can be a network connection, a wireless connection or an internet connection. It is envisioned that data relating to the present invention can be transmitted over such networks or connections.
  • the computer system can be adapted to communicate with an participant parameter monitor and/or an apparatus on which a participant is engaged in exercise. Additionally, the components of these logic devices can be incorporated, wholly or partially, into an exercise device, as will be appreciated
  • a user or participant 122 can optionally also be connected to a variety of monitoring devices, as described below.
  • the monitoring devices can further be adapted and configured to interact with the system.
  • the computer system, or digital device, 100 can be any suitable device.
  • Other suitable devices capable of being adapted for use in the system described herein include, for example, video iPod (Apple Corp., Cupertino Calif.), or a portable DVD player or DVD Walkman® (Sony Corporation). Such devices would be suitable in a variety of situations.
  • a computer-readable medium includes a medium suitable for storing, analyzing and transmitting target information of interest, such as that information discussed in more detail below.
  • the medium can include a result regarding a disease condition or state of a subject, wherein such a result is derived using the methods described herein.
  • FIG. 1B depicts another exemplary computing system 100 .
  • the computing system 100 is capable of executing a variety of computing applications 138 , including computing applications, a computing applet, a computing program, or other instructions for operating on computing system 100 to perform at least one function, operation, and/or procedure.
  • Computing system 100 may be controlled by computer readable instructions, which may be in the form of software.
  • the computer readable instructions can contain instructions for computing system 100 for storing and accessing the computer readable instructions themselves.
  • Such software may be executed within CPU 102 to cause the computing system 100 to perform desired functions.
  • CPU 102 is implemented by micro-electronic chips CPUs called microprocessors.
  • a co-processor distinct from the main CPU 102 , can be provided that performs additional functions or assists the CPU 102 .
  • the CPU 102 may be connected to co-processor through an interconnect.
  • One common type of coprocessor is the floating-point coprocessor, also called a numeric or math coprocessor, which is designed to perform numeric calculations faster and better than the general-purpose CPU 102 .
  • the CPU 102 fetches, decodes, and executes instructions, and transfers information to and from other resources via the computer's main data-transfer path, system bus 140 .
  • a system bus connects the components in the computing system 100 and defines the medium for data exchange.
  • Memory devices coupled to the system bus 140 include random access memory (RAM) 124 and read only memory (ROM) 126 .
  • RAM random access memory
  • ROM read only memory
  • Such memories include circuitry that allows information to be stored and retrieved.
  • the ROMs 126 generally contain stored data that cannot be modified. Data stored in the RAM 124 can be read or changed by CPU 102 or other hardware devices. Access to the RAM 124 and/or ROM 126 may be controlled by memory controller 120 .
  • the memory controller 120 may provide an address translation function that translates virtual addresses into physical addresses as instructions are executed.
  • the computing system 100 can contain peripherals controller 128 responsible for communicating instructions from the CPU 102 to peripherals, such as, printer 142 , keyboard 118 , mouse 116 , and data storage drive 143 .
  • Display 108 which is controlled by a display controller 134 , is used to display visual output generated by the computing system 100 . Such visual output may include text, graphics, animated graphics, and video.
  • the display controller 134 includes electronic components required to generate a video signal that is sent to display 108 .
  • the computing system 100 can contain network adaptor 136 which may be used to connect the computing system 100 to an external communications network 132 .
  • FIG. 1C illustrates an exemplary illustrative networked computing environment 100 , with a server in communication with client computers via a communications network 150 . As shown in FIG.
  • server 110 may be interconnected via a communications network 150 (which may be either of, or a combination of a fixed-wire or wireless LAN, WAN, intranet, extranet, peer-to-peer network, virtual private network, the Internet, or other communications network) with a number of client computing environments such as tablet personal computer 102 , mobile telephone 104 , telephone 106 , personal digital assistant 108 , and a personal computer 112 . Additionally, an exercise input device 12 is provided in communication with the network environment.
  • a communications network 150 which may be either of, or a combination of a fixed-wire or wireless LAN, WAN, intranet, extranet, peer-to-peer network, virtual private network, the Internet, or other communications network
  • client computing environments such as tablet personal computer 102 , mobile telephone 104 , telephone 106 , personal digital assistant 108 , and a personal computer 112 .
  • an exercise input device 12 is provided in communication with the network environment.
  • server 110 can be dedicated computing environment servers operable to process and communicate data to and from client computing environments via any of a number of known protocols, such as, hypertext transfer protocol (HTTP), file transfer protocol (FTP), simple object access protocol (SOAP), or wireless application protocol (WAP).
  • HTTP hypertext transfer protocol
  • FTP file transfer protocol
  • SOAP simple object access protocol
  • WAP wireless application protocol
  • networked computing environment 100 can utilize various data security protocols such as secured socket layer (SSL) or pretty good privacy (PGP).
  • SSL secured socket layer
  • PGP pretty good privacy
  • Each client computing environment can be equipped with operating system 138 operable to support one or more computing applications, such as a web browser (not shown), or other graphical user interface (not shown), or a mobile desktop environment (not shown) to gain access to server computing environment 100 .
  • An exercise device 12 is in communication with one or more devices shown in the network 150 .
  • the exercise device 12 can be a treadmill (as illustrated), or any other suitable device.
  • a user may interact with a computing application running on a client computing environment to obtain desired data and/or computing applications as the user is exercising using the exercise device 12 adapted and configured to communicate with the computing application and/or interact with a biological parameter measurer 144 adapted and configured to communicate with the computing application via, for example, an interface unit 142 .
  • the data and/or computing applications may be stored on server computing environment 100 and communicated to cooperating users through client computing environments over exemplary communications network 150 .
  • a participating user may request access to specific data and applications housed in whole or in part on server computing environment 100 . These data may be communicated between client computing environments and server computing environments for processing and storage.
  • Server computing environment 100 may host computing applications, processes and applets for the generation, authentication, encryption, and communication data and applications and may cooperate with other server computing environments (not shown), third party service providers (not shown), network attached storage (NAS) and storage area networks (SAN) to realize application/data transactions.
  • server computing environments not shown
  • third party service providers not shown
  • NAS network attached storage
  • SAN storage area networks
  • Biological parameter measurement devices 144 include, for example, devices capable of measuring a biologic function, such as heart rate, blood pressure, blood sugar or glucose levels, body temperature, tissue oxygenation, volume of O 2 (VO2), pulse oximeter measurement (Sp O 2 ), electroencephalogram measurement (EEG), O 2 saturation, or any other measurement that can be obtained from the participant as would be appreciated by those skilled in the art. See, for example, U.S. Patent Publications U.S. 2005/0166373 entitled Case Structure for Sensor Structure Attachable to and Detachable From a Shoe (Saasko et al.), U.S. 2005/0135039 entitled Electric Circuit and Transmission Method for Telemetric Transmission (Klemetti), U.S.
  • a biologic function such as heart rate, blood pressure, blood sugar or glucose levels, body temperature, tissue oxygenation, volume of O 2 (VO2), pulse oximeter measurement (Sp O 2 ), electroencephalogram measurement (EEG), O 2 saturation, or any other measurement that can be obtained from the participant as would be appreciated by
  • Parameter measurement devices also include, for example, a participant monitoring their pulse manually by placing a finger, for example, on the carotid artery or near the wrist to determine the number of beats per minute. See also, U.S. Pat. No. 5,170,780 to Rosenfeld for Method of Credibility Assessment Based on Feedback-Elicited P3 Responses of Brain and European Patent Publication EP 1510175 A1 to Kostucki for Exercise Manager Program.
  • the systems and methods disclosed herein can be achieved using a variety of exercise devices which are modified to provide information to one or more computer systems, components and networks on which software is provided which is adapted and configured to transform one or more inputs, e.g., from an exercise device, parameter sensor, and/or computer system into a video and audio output which is delivered to a user.
  • footfalls or movement of a user can be sensed in a variety of ways.
  • the mechanism for sensing footfalls or movement of a user will vary by machine type.
  • machine type For the three major types of fitness machines, treadmills, elliptical machines, and stair steppers, there may not necessarily be an actual footfall (as in the case with elliptical machines).
  • hybrid machines which are a mix of these three main types of machines.
  • the elliptical machines and stair steppers do not have a real footfall to sense, as the user's motion in reality is a fluid elliptical pattern in the case of elliptical machines, and a repetitive vertical (but fluid with no actual foot impact) motion on a stepper.
  • Treadmills One mechanism that can be used would be to sense the user via, for example, the extra force exerted downward on the treadmill, or certain treadmill components, by the footfall of the user.
  • a force sensor may be a piezoelectric device that converts force directly into a voltage differential, which in turn can be correlated to a controller to provide a mechanism for providing sensory feedback for the user.
  • Other force sensors that produce electric signals as an output would be possible, including for example capacitative force sensors, optical-electric strain gauges, and others.
  • Another mechanism for sensing footfalls with a treadmill includes, for example, one or more of: providing ammeters to detect increased load on the treadmill motor, tension sensors (electromagnetic or even piezoelectric) to detect sudden changes in belt tension, providing acoustic pickup to sense the sound of the footfall (a simple condenser microphone, electret microphone, dynamic or inductance type microphone), providing user-worn sensors such as accelerometers to detect the motion of the users feet or body (and which can communicate—wired or wirelessly—with the system), providing optical sensors to detect the position of the users' body—either with an imaging system or through beam-interruption detection (for example, with infrared lasers and photoelectric sensors, or with a passive imaging system that can recognize the user's body position), providing a sensor worn by the user that is a foot/leg position sensor such as the that used in gaming systems such as the Nintendo Wii®, providing a charge sensor that detects contact by a user (similar to touchscreen technology), providing a sensor that detects variances in the speed
  • Treadmills are described more fully in, for example, U.S. Pat. Nos. 7,575,537 entitled Dual Direction Exercise Treadmill for Simulating a Dragging or Pulling Action with a User Adjustable Constant Static Weight Resistance; 7,563,203 entitled Treadmill with Cushion Assembly; and 7,367,926 entitled Treadmill with Moveable Console.
  • the elliptical could be configured to enable a “virtual footfall” to be sensed on the elliptical, or the moment at which a footfall sound would create the most effective representation of running or walking, is a position sensor that triggers when, for example, an elliptical pad is at its forward-most point in its elliptical movement pattern, on its down stroke, or reaches its lowest point.
  • speed sensors could determine when the forward motion of a stride reaches zero, which would also correspond to the furthest forward part of the stride but would accommodate inconsistent stride lengths.
  • Elliptical trainers are described more fully in, for example, U.S. Pat. Nos. 6,436,007 entitled Elliptical Exercise Machine with Adjustment; 6,361,476 entitled Variable Stride Elliptical Exercise Apparatus; and 6,077,196 entitled Adjustable Elliptical Exercise Apparatus.
  • Variants could include a differential position sensor, sensing the point at which the pads are furthest apart, which is the same as the point at which either pad is furthest forward.
  • Other ways to determine footfall on an elliptical include, for example, one or more of providing a speed sensor that senses when the elliptical pad's horizontal speed is zero (it is exactly at the moment in the elliptical movement pattern in which it is moving neither forward nor back).
  • Speed sensor could also detect when the foot pad's vertical acceleration is highest; providing a weight/force/pressure sensor that detects the moment at which the greatest weight/force/pressure is being applied to the elliptical pad, which will correspond with the beginning of downward motion on the front most pad and thus the virtual footfall; providing a wireless/wired worn-sensor methods as mentioned above; providing optical/audio/infrared/etc sensors as mentioned above in treadmill section; or using the above systems to detect speed as it approaches zero.
  • Stair Stepper Exercise Devices One mechanism to detect footfall or an equivalent of footfall on a stepper would be, for example, a position sensor that detects the point at which one of the step pads/levers is at or begins descending from its highest point. Steppers frequently have traditional step counters built-in and these could also be piggybacked upon. All of the methods mentioned above for ellipticals could be adjusted to work with steppers with a vertical fluid motion rather than an elliptical motion, including methods that detect the pad's speed approaching zero.
  • the trigger point for the footfall would be the point at which either footpad begins to descend from its highest point. This is also the point at which the most force/pressure/weight is on the footpad and when the footpad begins downward acceleration.
  • Stair stepping devices are described more fully in, for example, U.S. Pat. Nos. 7,153,238 entitled Stairclimber Apparatus Pedal Mechanism; and 5,399,134 entitled Stair Climbing Exercise Apparatus.
  • Hybrid Exercise Devices Combinations or variants of the methods above could be used on hybrid machines to equal effect.
  • playback of one or more audio media files is triggered by one or more of the sensors described above.
  • a signal generated by the sensor is detected by the media playing device, which then plays an appropriate media file.
  • visual signals and/or media files might be generated to correspond to the audio playback (for example a graphical shoe that blinks on the bottom portion of the screen each time the footfall is sensed).
  • Latency or lag between the time at which a footfall is sensed and the time at which the audio file playback is initiated, can greatly diminish the effectiveness/enjoyment/motivation of the experience. Latency, even measured in amounts as small as tens of milliseconds, can alter the illusion created by the product of a user's actual footfalls.
  • One method of addressing latency is to use software/system elements to make the playback of audio files predictive, rather than timed to correspond with specific occurrences of actual footfalls.
  • One variant of this method would be to: characterize the system latency through product testing, determine how much latency exists for each machine through testing and then, during the exercise session, determine the cadence of the user, such as by using the sensors sensing the time between a plurality of footfalls and using this information to create an average footfall timing pattern. Thereafter begin playing the footfall audio files in accordance with the rolling average time between steps generated by the above.
  • Another variant of this method would be to not predict the moment associated with the actual footfall, but to use any number of the sensor methods above to sense a moment that precedes the moment of actual footfall by a fixed or predictable amount of time.
  • the signal to play the footfall audio file would be generated in advance, and taking known system latency into account, as in the first variant, the playback could be timed to match the actual moment of footfall.
  • Another variant of this method might be to “cover up” the latency to some extent by playing an audio file that “fades up” or increases in volume throughout playback. This could lead the user to believe that the audio file is timed correctly, but just happens to be initially inaudible because of the nature of the sound.
  • the audio files played back by the footfall triggers could be configured to match the sounds of real footfalls pre-recorded on terrain similar to that shown in a video media presentation on the machine's display.
  • the footfall audio files could thus vary throughout the course of a virtual exercise experience based on the various types of terrain being displayed.
  • the characteristics of the audio file playback could be altered to enhance the experience in several ways:
  • the volume of the footfall audio file playback could be adjusted interactively based on movement speed or other exercise parameters, such as to represent louder footsteps when running faster.
  • the length or amount of the total footfall audio actually played back could be interactively adjusted based on movement speed or other exercise parameters, such as to represent quicker, lighter steps when running faster. This could occur by either cutting off playback (or combining cut-off with a fade-out of volume) or by speeding up playback beyond the files original speed to achieve shorter playback of the entire audio file.
  • Standard stereo audio playback functionality could be used to pan footfall audio playback to the right or left speakers in the audio system alternately to more accurately represent the virtual experience by representing the right or left footstep.
  • the specific audio file played could be varied based on an exercise parameter, such as speed, incline, or resistance.
  • the sound of an actual footfall will be different depending on whether the person generating that footfall is moving fast or slow, or over flat or steep terrain, for example.
  • footfalls pre-recorded on the same type of terrain might be played with different characteristics to adjust for this as noted above, and/OR different pre-recorded footfalls might be played that more accurately represent the exercisers parameters over the same terrain. For example, there could be a sound for fast movement over gravel, another file for slow movement over gravel, and yet another for movement over steep gravel.
  • pre-recorded footfalls with varying characteristics to represent varying terrain or exercise parameters as described above could be played independently of the activity of the exerciser, in a pre-determined pattern which is known to support the motivation of the exerciser.
  • Timing of these footfalls could be adjusted by the user themselves, or by the program, based on the program itself or the program in conjunction with information input by or detected from the user (such as desired difficulty level, height, age, heart rate, or other parameters).
  • the timing of the footfalls could be manually adjustable by the user through standard input devices such as buttons, touch screen elements, etc.
  • FIG. 2 is a block diagram of an apparatus in accordance with the invention shown in FIG. 1 .
  • the apparatus 210 includes the exercise machine 12 connected to an interface unit 236 which is in turn connects to the CPU 202 of a player.
  • a prerecorded data storage medium 248 such as a compact laser disc (CD)
  • CD contains media data including a set of digitized video frames and audio data packets and an encoded program which modifies the player control program 250 .
  • the pre-recorded data is contained on a storage medium which is streamed to a local device via the Internet or an intranet.
  • the CPU 202 includes a control program 250 , a content buffer 252 which decodes and decompresses the data stream read from, for example, the CD 248 , a dashboard display overlay generator 254 , and a set of two or more display buffers 256 and 258 .
  • the player 220 also optionally includes inputs for signals receivable from, for example, a remote system CPUs 260 .
  • Each CD can be configured to include a program which manipulates the control program 250 to manipulate the rates at which the audio visual are displayed.
  • Additional displays such as real time, or near real time, exercise inputs from an interface unit 232 such as speed, cadence, total distance traveled, lap distance, calories burned, time elapsed, time remaining, and the like can be provided. Moreover, these parameters can be calculated and displayed on, for example, a ‘dashboard’ overlay on the visual monitor 218 . Such parameters can be generated in overlay block 254 and fed to the display buffers 256 and 258 . The overall control of the video sequences, and the start/stop of the exercise overlay program can be manipulated via a suitable user input, such as keypad 236 mounted on an interface unit 232 .
  • a suitable user input such as keypad 236 mounted on an interface unit 232 .
  • the rate at which the video is displayed and one or more audio sequences are played in accordance with the present invention is controllable by a program shown in block diagram form in FIG. 3 .
  • the program can be encoded on a CD and operated on the operating control program 250 in the CPU of the player 220 .
  • the program can be stored on a remote network location that is accessible locally.
  • the present invention is adapted and configured to utilize one or more of each video and audio recorded sequences.
  • Suitable sequences include those which can be recorded using a POV (Point of View) videotape camera mounted on an athlete's head or vehicle such as a bicycle.
  • Each video frame recorded is assigned and has recorded with it a unique frame time stamp value and a duration stamp value for accessing the next frame packet of data upon playback.
  • the duration stamp is a constant value, for example, about 8 milliseconds.
  • These frame stamp and duration values function to allow a playback apparatus to sequence and time the reproduced display.
  • the audio may be interlaced with the video or may be a separate track recording.
  • the recorded sequence of video and audio are then digitized and recorded on a video CD along with the control program described below and shown in the Figures herein.
  • the basic effect of the control program of the present invention is to control the rate at which the video frame is played and to correlate the playback to the exercise rate of the user on the exercise device 12 that is in communication with the system. Therefore as the exercise rate increases, the frame rate of display increases. This creates the experience for a user that the scenery changes at a rate equivalent, or near equivalent, to the rate at which the scenery would change if the user were, for example, cycling or running at that rate where the video display was captured. Similarly, as the exercise rate of a user decreases, the video displays scenery at a slower and slower rate, until the user stops and the scene displayed stops also. Thus the user achieves a visual sensation similar to that of actually traveling through the scenery shown in the video.
  • the process flow begins operation 300 , for example, when the user begins pedaling the bicycle or walking on the treadmill. Thereafter, the program can set, in operation 302 , a cumulative time offset (T os ) to the current clock time of the CPU. This time offset tracks the total difference in time that the program modifies the video sequence due to the exercise rate of the user.
  • T os cumulative time offset
  • the program next queries, in operation 304 , whether a stop video stream flag is set. However, if the Stop Video Flag is set, as when the user stops pedaling to rest for a period of time or stops running on the treadmill, a control passes to a wait operation 306 . Wait operation 306 can, for example, be a process delay on the order of 10 milliseconds, after which the query in operation 304 would then be repeated. If the Stop Video Stream flag is not set, control passes to operation 308 .
  • the current frame time stamp value (T f ) is retrieved and the current frame duration value (T d ) is retrieved from the decompressed stream data in content buffer 452 .
  • the Adjustment value (T adj ) is obtained, in operation 110 , from the program sequence shown in FIG. 4 .
  • the variable T next is set equal to T f +T d +T adj +T os . This is the clock time at which the next frame should be decompressed into the decompression buffer 452 .
  • the query is made as to whether the current CPU clock time is equal to or greater than T next . If the clock time is not greater to T next , then the system continues to wait 306 . If the clock time is greater than T next , then the next video frame is decompressed and added to the decompression buffer 316 in the content buffer block 252 of the player CPU 202 . At this point, the content of the decompression buffer is copied to a frame buffer, which in this case is either frame buffer A or frame buffer B 320 , whichever is pointed to by a pointer. The pointer is adapted and configured to alternate between the two frame buffers.
  • control is passed to operation 320 , where display objects such as the optional dashboard indicating the current heart rate, pulse icon and exercise status parameters, are overlaid into the buffer indicated by the pointer.
  • display objects such as the optional dashboard indicating the current heart rate, pulse icon and exercise status parameters
  • the frame buffer pointer is switched to the other buffer.
  • the contents of T adj are added to the T os register so as to keep track of total adjustments to the sequence.
  • Control then passes to operation 328 where the program queries whether there are any more video frames in the sequence. If there are none, the program ends in operation 330 . If there are additional frames, control passes again to the wait operation 306 and the above steps are repeated as many times as necessary to achieve the desired output.
  • Video reproduction rate thus is modifiable by adding time or subtracting time from a prerecorded video frame duration stamp value.
  • the value of T adj changes and thus modifies the effect of T d .
  • FIG. 4 describes an example of how T adj can be modified.
  • the sequence of operations in FIG. 4 occurs continuously to provide a value of T adj corresponding to a user's exercise rate.
  • the manner of corresponding the video stream to a user's exercise rate can be accomplished in a variety of ways and from a plurality of inputs, including a biological parameter measurement device 144 (as shown in FIG. 1B ), or from the rate at which the exercise device is operated by the user, or from a rate at which a user is moving as detected by the device.
  • a sequence begins in operation 432 where, for example, the wheel speed input signal from the wheel pickup is fed through the interface unit 142 into the CPU 102 through an input such as keypad 118 .
  • the current speed corresponding to miles per hour or kilometers per hour, can be obtained from the raw signal in operation 434 . So, for example, the current speed can be continually updated as long as there is a wheel speed thread from the interface unit 142 .
  • validity checks are performed in this operation to ensure that the signal is, in fact, a correct wheel speed signal.
  • Control then shifts to operation 444 where Last Speed is set equal to New Speed and control again transfer to operation 432 where another signal from the wheel sensor is awaited. If the Current Speed is equal to zero in operation 438 , control transfer to operation 446 where the Stop Video Stream flag is set and current clock time is saved.
  • the Stop Video Stream flag may also be required in operation 304 to cover the situation where the user stops to rest after beginning a sequence. In that instance, the current clock time when this flag is set must be saved because, after the start, in operation 300 , clock time is continuously running. Therefore, if the user stops momentarily, requiring the video sequence to freeze, the duration of the stopped period must be added to the time offset in order to keep the sequence operating properly based on current clock time.
  • the sequence illustrated in FIG. 4 is continuous and proceeds whenever there is a signal from the wheel speed monitor input thread from the interface unit 142 . Therefore this program sequence is constantly updating during the exercise activity. In contrast, the sequence illustrated in FIG. 3 operates during the time that a video frame is available to be displayed.
  • FIGS. 5 a and 5 b flow diagrams are provided illustrating two versions of an audio portion of a prerecorded sequence.
  • the audio data chunks may be in a separate file from the video file or the audio data chunks may be interleaved with the video frame data chunks in the same file.
  • the FIG. 5 b flow diagram is for processing audio data chunks which are stored in a separate audio data file on the CD.
  • FIG. 5 a provides a flow diagram for play of audio data chunks which are interleaved with the video frame data in the same file. Either case may be used dependent upon variables such as buffer space and storage medium drive speed.
  • the audio program code is encoded on the CD as is the video program code described above with reference to FIGS. 3 and 4 .
  • the audio stream starts in operation 500 .
  • a digital pointer is set to one of at least two audio buffers in operation 502 and control passes to operation 504 where an audio data chunk is retrieved from the decompression content buffer 252 .
  • the audio data chunk is then loaded into the buffer pointed to by the audio pointer in operation 506 .
  • operation control is passed to operation 510 where the query is made whether the audio stream is complete. If so, control passes to operation 512 and the audio play stream stops.
  • This process repeats until there are no more audio data chunks signifying that the audio stream is complete. In the case just described, the audio continues to play, even when the video slows in response to the actions of the user on the exercise device 12 .
  • the audio stream control begins in operation 520 .
  • a pointer is set to one of at least two audio buffers in operation 522 .
  • Control then passes to operation 524 where an audio data chunk associated with the current video frame is retrieved from the decompression content buffer 252 .
  • This data chunk is then loaded into the audio buffer pointed to in operation 526 and play of this audio chunk immediately begins in operation 528 .
  • control shifts to operation 530 where the stream is queried to determine if the audio stream is complete. If not, the query is made, in operation 532 , whether the next audio data chunk is available.
  • the query in operation 532 is whether the next video frame has been called for display. This becomes important when the user is slowing down the video display by reducing his or her exercise rate, e.g. pedaling slower. If the next video frame has not been called, the next audio data chunk will not be available. In this case, operation 532 transfers control back to operation 528 and the current audio data chunk is replayed. Where the audio is wind noise, sounds of the road, or natural background noise in the country, the user will not likely be able to distinguish that the audio is being “looped back”.
  • the query in operation 532 will transfer control to operation 534 where the pointer is set to another buffer. Control then transfers back to operation 524 to get another audio data chunk and operations 526 , 528 , 530 , and 532 are repeated until the last of the audio stream is processed. In this case, control is transferred to operation 536 where the audio play is stopped.
  • the audio buffers provide a smooth sequencing of audio chunk play.
  • a plurality of audio can be played with the video. For example, a first audio can be played at a constant rate independent of the video frame, while a second audio is played at a rate which corresponds to the rate at which the video is played. This facilitates a first audio pitch and tempo remaining a pleasing audio signal, as would be perceived at the location while a second audio pitch changes to correspond to the pace at which footfalls, for example, would occur at the rate of exercise perceived by the user, while a third audio can occur at a rate intended to mimic a training pace or quickening pace of a training partner in response to a differential input by a user or calculated based on user parameters such as age, health and training objectives.
  • the audio volume could be made to increase or decrease as the user increases or decreases speed respectively. Therefore looping these audio chunks of wind and road noise back during slow exercise periods as described in FIG. 5 b maintains the perceptive effect of the audio being independent of the video rate of display, yet tying the audio content to the video frames being displayed.
  • the audio of, for example, the sounds of footfalls can further be divided into individual sound packets that are played in bursts at a tempo or pace corresponding to the desired pace without altering the rate or speed of audio.
  • an audio of a series of, for example, footfalls which includes a footfall followed by an interval of silence before a subsequent footfall (and so on) can be alternately speeded up during the intervals of silence only.
  • the prerecorded video may include coded data for setting the exercise device to predetermined resistance values.
  • the program would include a control thread which accesses the control data associated with the video frame which sets the resistance. This data would then be translated into setting values which would be transmitted to the servomotor or stepper motor connected to the resistance control such as resistance wheel on the exercise stand.
  • the interface unit 132 can be adapted and configured to include a battery, a programmable interrupt controller (PIC) or processor, a biological parameter measurer 144 , such as a heart rate receiver tuned to the transmission frequency of the heart rate transmitter, a series of shift registers, a 10 MegaHertz clock, wheel speed input terminals which mate with the contacts on the exercise machine 12 , and a nine pin output connector which connects the interface unit 132 to a controller keypad 118 .
  • the PIC processor can, for example, be an 8 bit device, which processes the incoming tics, or beats from the wheel speed sensor and the ticks from the output of the heart rate receiver.
  • the shift registers in the interface unit convert the data from the PIC Processor to 32 bit words for compatibility of communication with a player.
  • the interface unit 32 is adapted and configured to collect data from the heart rate and wheel speed inputs and transmits the heart rate and wheel speed data to the player when queried by the main program. Provision may also be included in the interface unit for providing a signal to a stepper motor or servomotor on the exercise device to vary the resistance provided by the resistance roller.
  • FIG. 6 a A logic flow diagram of the embedded program in the PIC processor is shown in FIG. 6 a .
  • the interface unit processor starts in operation 600 .
  • a run time crystal clock (RTCC) is used to run the processor and to measure time durations between input pulses in the PIC processor. This RTCC runs at 10 MHz and counts between zero and 255. The output rolls over at 255. This equates to a rollover time of about a maximum of 2 milliseconds.
  • Operation 602 initializes several flags and registers to zero. Specifically, a load pulse flag, a heart beat flag, a heart tic flag, a wheel rotation flag and a wheel tic flag are set to zero.
  • a heart count register, a heart store register, a wheel count register, and a wheel store register are set to zero.
  • the heart count registers and wheel count registers are used to accumulate time tics between input pulses from the heart rate receiver and the wheel rotation reed switch as will become more apparent below.
  • This flag will be set if the program is ready to receive input from the interface unit 32 .
  • control transfers to operation 614 where the interface unit 32 output registers are loaded with the contents of the heart store and wheel store registers. These output registers are then immediately read by the operating system through the connection through a user input interface, such as keypad 118 .
  • control passes to operation 616 where the query is made whether a heartbeat flag has been set, i.e. a beat has been received by the heart rate receiver. If a beat has been received, control passes to operation 618 where the heart count register contents are transferred to the heart store register. Then, in operation 620 , the heart count register is reset to zero and the heart beat flag is reset in order to sense another heartbeat. Control then proceeds from operation 620 to operation 622 . If no heartbeat has been received in the heart rate receiver, and thus the heart beat flag is not set, operation 616 transfers directly to operation 622 .
  • a query is made whether the wheel rotate flag has been set by passage of a wheel magnet past a reed switch. If not, control passes to operation 624 . If the wheel rotate flag is set, control passes to operation 626 where the contents of the wheel count register are moved to the wheel store register. Control then transfers to operation 628 , where the wheel count register is set to zero and the wheel rotate flag is reset in order to sense receipt of another wheel rotation.
  • Operation 624 queries whether the heart tic flag is set. If so, control transfers to operation 632 where the heart count register is incremented and the heart tic flag is reset. Control then transfers to operation 630 . If the heart tic flag is not set, operation 624 transfers control directly to operation 630 .
  • Operation 630 queries whether the wheel tic flag is set. If so, control transfers to operation 634 where the wheel count register is incremented and the wheel tic flag is reset. Control then passes back to operation 606 . If the wheel tic flag is not set, operation 630 passes directly back to operation 606 .
  • the sequence of operations described in FIG. 6 b is continuous.
  • the net effect of the sequence is to constantly update the heart count, wheel count, heart store, and wheel store registers as wheel rotations and heart beats are received. This information is passed into the output registers for transmission to the control system whenever the control program requests input which is about 60 times per second. It is to be understood that the above description is exemplary of one embodiment only.
  • the pace of the video stream changes with the pace of the footsteps which corresponds to the rate at which a user is exercising as described above.
  • the rate of the correlated audio can be set-up to increase as a user increases the speed at which the user performs.
  • the pace of the video i.e., the rate at which the video is streamed to the screen, correlates to the pace of, for example, the footsteps or the rate at which a user is cycling on a stationary bike. It has been observed that, for example, runners may find the urge to synchronize their steps to a strong musical beat or to a repetitive sound, such as a footfall. Similarly, cyclists may be urged to press down on the pedal at a rate corresponding to a repetitive sound.
  • This urge may motivate the exerciser to perform at the video correlated pace as the speed of the video and the correlated audio increases to correspond to the rate at which the viewing would change if, for example, a runner were running at a particular pace and his or her footfalls were at a particular pace.
  • the rate of change of each of the audio tracks is accomplished such that the sounds continue to sound natural but achieves the effect of a Foley artist in making the various audio tracks to correspond to a video.
  • the pace of exercise interactively changes with the pace of the footsteps.
  • the pace of the video i.e., the rate at which the video is streamed, can change in response to a measured biological parameter.
  • a measured parameter may be used to provide feedback that a user should increase his or her speed or decrease his or her speed (e.g., if heart rates are above or below desired levels, the correlated audio can be increased, along with the speed of the machine to increase the heart rate to a desired or target level).
  • a user could select a difficulty level and/or or other parameters that would result in a certain speed of footsteps being played. This could be a combination of several parameters, such as in the case where a person might enter their height and a difficulty level of “5”. The program might know that “5” for a tall person is a different foot pace then “5” for a short person.
  • a user can select a competition rate wherein, for example, the user performs at a base rate to establish his or her normal training rate. Then, the user can select a pre-defined competitor profile, or a rate of performance improvement, e.g., 10%. In this scenario, the correlated sound will occur at the rate of the competitor profile or the rate of performance improvement while the video can stream at the rate at which the user is actually performing or at the rate of the chosen competitor profile or performance rate improvement.
  • a competition rate wherein, for example, the user performs at a base rate to establish his or her normal training rate. Then, the user can select a pre-defined competitor profile, or a rate of performance improvement, e.g., 10%.
  • the correlated sound will occur at the rate of the competitor profile or the rate of performance improvement while the video can stream at the rate at which the user is actually performing or at the rate of the chosen competitor profile or performance rate improvement.
  • a data processing system for administering course material comprising a computer or server as shown in FIG. 1B .
  • the computer can, if desired, be connected to a network of remote stations as shown in FIG. 1C .
  • the remote stations could then serve as the data entry points for information to be gathered, for example at a remote class site or by a participant registering for a class on-line.
  • Information gathered includes, for example, information about the materials to be presented, the participant, the environment, etc.
  • the remote stations can also serve as access points through which people transmit inquiries concerning the materials presented or exercise programs and for responding to those inquiries. Additionally, each station can store a record of each participant's details, including performance information for each class, and periodically send this information to the central computer for processing.
  • the system and method can be adapted to work in conjunction with the invention disclosed in U.S. Pat. No. 6,142,913 for “Dynamic Real Time Exercise Video Apparatus and Method” (Ewert).
  • the system can be adapted to incorporate varying video playback rate adjusts the frame rate of motion video content being replayed on a display device based on the intensity at which a participant exerts themselves.
  • This system supports the illusion that the participant is actually traveling through the terrain being displayed.
  • a result of the use of this system is that a participant who exercises at a higher intensity will view more footage than will a participant who exercises at a lower intensity, as the frame rate speed will be higher and more frames of the footage will be viewed.

Abstract

Disclosed are systems and methods for detecting the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience. The system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.

Description

    CROSS-REFERENCE
  • This application claims the benefit of U.S. Provisional Patent Application No. 61/110,559, filed Nov. 1, 2008, entitled “System and Method for Optimizing One or More Audio Tracks to a Video Stream,” by John Hajime Ford, and U.S. Provisional Patent Application No. 61/248,151 filed Oct. 2, 2009, entitled “System and Method for Optimizing One or More Audio Tracks to a Video Stream,” by John Hajime Ford, which applications are incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • The results from the 1999-2002 National Health and Nutrition Examination Survey (NHANES), using measured heights and weights, indicate that an estimated 65 percent of U.S. adults are either overweight or obese. The breakdown indicates that an estimated 30% are obese (which is defined as a Body Mass Index of 30 or higher), while 35% are overweight. Body Mass Index (“BMI”) is calculated by dividing a person's body weight in kilograms by their height in meters squared. In addition to these statistics for adults, an estimated 15.5 percent of adolescents (ages 12 to 19) and 15.3 percent of children (ages 6 to 11) are estimated to be obese in the United States.
  • Although it seems counterintuitive, perhaps as a result of these alarming statistics, the United States is currently experiencing a boom in the health club industry. The number of health clubs in the US has climbed to 26,830 from just 15,372 in the year 2000—a 75% increase. An estimated 41 million Americans belong to health clubs and that number is expected to increase to over 50 million by the year 2010. The 2004 US health club industry comprised a 14.8 billion dollar market, more than double the 7.3 billion dollar market seen just one decade prior. These market changes can be correlated to the American obesity crisis, an appearance focused culture, and the increasing health awareness of the population, and are not expected to slow or stop in the foreseeable future.
  • As reported by the Centers for Disease Control and Prevention (www.cdc.gov), physical activity can bring many health benefits. In fact, it has been found that people who enjoy participating in moderate intensity or vigorous intensity physical activity on a regular basis lower their risk of developing coronary heart disease, stroke, non-insulin dependent (type 2) diabetes mellitus, high blood pressure, and colon cancer by 30-60% (US DHHS, 1996). Additionally, active people have lower premature death rates than people who are the least active. Even among frail and older people, mobility can be improved through physical activity. Butler, R N, et al., “Physical Fitness: Benefits of Exercising for the Older Patient” Geriatrics 53(10): 46-52 (1998). Researchers have even found a correlation between walking and a lower incidence of Alzheimers.
  • One trend has been the development of dozens of completely new types of group fitness that emerge each year. These fitness classes are typically designed to combine two popular forms of fitness or activities into one class. For example, YogaSpin, a combination of Yoga and group stationary cycling, Extreme Boot Camp, Cheerleading School, Cycling Karaoke, and countless variations based on the popular Cardio Kickboxing and Pilates exercise platforms.
  • Another trend that has been noted in the industry is that when people work out with another person, their effort level tends to increase as they try to match the effort of their work-out partner. That benefit is not realized by persons working out alone, for example, on a treadmill.
  • SUMMARY OF THE INVENTION
  • A solution is needed to provide a mechanism for people working out alone to attain a training benefit of working out with a work-out partner.
  • An aspect of the invention provides a system that detects the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience. The system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.
  • An aspect of the invention is directed to an exercise system. The exercise system comprises: a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmitting the input to the central processing unit; a prerecorded video frame sequence encoded onto a storage medium in communication with and playable on the video playing device; a video monitor in communication with the video playing device for displaying the prerecorded video frame sequence reproduced by the video playing device; a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the monitor in response to the one or more inputs from the user wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed; two or more audio rate controllers configured to vary a rate of delivery of two or more audio files in response to a signal from user interface rate detector wherein the rate of delivery of the two or more audio files are delivered asynchronous to each other; and an exercise device. In some aspects, the video frame rate controller is adapted and configured to comprise a computer program stored on a storage medium with the prerecorded video frame sequence. In such configurations, the program is operable, for example, with the central processing unit in the video playing device when the prerecorded video sequence is played to modify the frame display rate in response to the signal from the user interface rate detector. Additionally, the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. Suitable exercise devices include, for example, a bicycle, a stair stepper, and an elliptical trainer.
  • Another aspect of the invention is directed to an apparatus for engaging a user of an exercise device interactively in viewing a video frame sequence of an activity on a video monitor. The apparatus comprises a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor; a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmitting a signal proportional to the rate of exercise; a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed; and one or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played. Suitable exercise devices include, for example, a bicycle, a stair stepper and an elliptical trainer. Moreover, in some configurations, the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. Additionally, the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
  • Still other aspects of the invention are directed to a method of controlling a video frame sequence display rate of a prerecorded video playback sequence in a device in response to an external signal, in which each video frame has a unique frame time stamp and a duration time stamp indicating the time between successive frames. The method typically comprises the steps of: a) accessing the duration time stamp for a current video frame; b) determining from the external signal an adjustment value for changing the display rate; c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp; d) displaying the next frame when the modified duration time has passed; e) accessing the duration time stamp for a current audio data packet; f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet; g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; h) playing the next audio data packet when the modified duration time has passed; and i) repeating steps a through d for each subsequent video frame and steps e through h for each subsequent audio data packet. The accessing step can further comprise the steps of: i) setting a time offset to current clock time; ii) displaying a current video frame; and iii) accessing a frame time stamp and a duration time stamp for the current video frame. Moreover, the step of determining can further comprise the step of comparing the external signal to predetermined criteria to determine the adjustment value. Additionally, as will be appreciated by those skilled in the art, the external signal is a user variable exercise rate signal. In other embodiments, the step of displaying further comprises the steps of: i) adding the modified duration value to the time offset to obtain a next frame time; and ii) displaying the next frame when clock time exceeds the next frame time.
  • INCORPORATION BY REFERENCE
  • All publications, patents and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent or patent application was specifically and individually indicated to be incorporated by reference.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The novel features of the invention are set forth with particularity in the appended claims. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which:
  • FIG. 1A-C are overviews of a system having a server, a CPU, a monitor, storage media, input devices, etc. which can be used by a user;
  • FIG. 2 is block diagram of the apparatus in accordance with the invention shown FIG. 1 b;
  • FIG. 3 is a flow diagram of the video frame rate control program encoded on the video disk;
  • FIG. 4 is a flow diagram of a adjustment factor subroutine;
  • FIGS. 5A-B are is flow diagrams of adjustment factor subroutines; and
  • FIGS. 6A-B are logic flow diagrams of an embedded processor in an interface unit.
  • DETAILED DESCRIPTION OF THE INVENTION
  • An aspect of the invention provides a video stream that has one or more audio tracks associated with the video stream, one of which correlates to the sounds of, for example footfalls and which is variable in response to input and which can be used, for example, as a training guide to encourage people to increase their exertion rate as they perceive competing against another person. A second audio track is provided that can correspond to normal ambient-type noise that might be heard by a user in the environment represented by the video stream, music or whatever background noise a user selects. Changes to the video rate correlated audio can be in response to user input or in response to a sensing of a user parameter. In order to achieve the objectives of the invention a variety of components are required: computer systems, components and networks; exercise devices; and software which transforms input from the exercise device and/or computer system into a video and audio output which is delivered to a user.
  • I. Computer Systems, Components and Networks
  • The systems and methods disclosed herein can be achieved using a variety of computer systems, components and networks which are either incorporated into the exercise devices described below or are in communication with the devices.
  • FIG. 1A is a block diagram showing a representative example logic device through which reviewing, manipulating, or analyzing information relating to the present invention can be achieved. Such data can be in relation to exercise, one or more physiological parameters, exertion, or any other suitable parameter desired to be measured of a subject.
  • A computer system (or digital device) 100 that may be understood as a logical apparatus that can read instructions from media 111 and/or network port 105, which can optionally be connected to server 109 having fixed media 112. The computer system 100 can also be connected to the Internet or an intranet. The system includes CPU 101, disk drives 103, optional input devices, illustrated as keyboard 115 and/or mouse 116 and optional monitor 107. Data communication can be achieved through the indicated communication medium to a server 109 at a local or a remote location. The communication medium can include any means of transmitting and/or receiving data. For example, the communication medium can be a network connection, a wireless connection or an internet connection. It is envisioned that data relating to the present invention can be transmitted over such networks or connections. The computer system can be adapted to communicate with an participant parameter monitor and/or an apparatus on which a participant is engaged in exercise. Additionally, the components of these logic devices can be incorporated, wholly or partially, into an exercise device, as will be appreciated by those skilled in the art.
  • A user or participant 122 can optionally also be connected to a variety of monitoring devices, as described below. The monitoring devices can further be adapted and configured to interact with the system. As will be appreciated by those skilled in the art, the computer system, or digital device, 100 can be any suitable device. Other suitable devices capable of being adapted for use in the system described herein include, for example, video iPod (Apple Corp., Cupertino Calif.), or a portable DVD player or DVD Walkman® (Sony Corporation). Such devices would be suitable in a variety of situations.
  • In an embodiment, a computer-readable medium includes a medium suitable for storing, analyzing and transmitting target information of interest, such as that information discussed in more detail below. The medium can include a result regarding a disease condition or state of a subject, wherein such a result is derived using the methods described herein.
  • FIG. 1B depicts another exemplary computing system 100. The computing system 100 is capable of executing a variety of computing applications 138, including computing applications, a computing applet, a computing program, or other instructions for operating on computing system 100 to perform at least one function, operation, and/or procedure. Computing system 100 may be controlled by computer readable instructions, which may be in the form of software. The computer readable instructions can contain instructions for computing system 100 for storing and accessing the computer readable instructions themselves. Such software may be executed within CPU 102 to cause the computing system 100 to perform desired functions. In many known computer servers, workstations and personal computers CPU 102 is implemented by micro-electronic chips CPUs called microprocessors. Optionally, a co-processor, distinct from the main CPU 102, can be provided that performs additional functions or assists the CPU 102. The CPU 102 may be connected to co-processor through an interconnect. One common type of coprocessor is the floating-point coprocessor, also called a numeric or math coprocessor, which is designed to perform numeric calculations faster and better than the general-purpose CPU 102.
  • In operation, the CPU 102 fetches, decodes, and executes instructions, and transfers information to and from other resources via the computer's main data-transfer path, system bus 140. Such a system bus connects the components in the computing system 100 and defines the medium for data exchange. Memory devices coupled to the system bus 140 include random access memory (RAM) 124 and read only memory (ROM) 126. Such memories include circuitry that allows information to be stored and retrieved. The ROMs 126 generally contain stored data that cannot be modified. Data stored in the RAM 124 can be read or changed by CPU 102 or other hardware devices. Access to the RAM 124 and/or ROM 126 may be controlled by memory controller 120. The memory controller 120 may provide an address translation function that translates virtual addresses into physical addresses as instructions are executed.
  • In addition, the computing system 100 can contain peripherals controller 128 responsible for communicating instructions from the CPU 102 to peripherals, such as, printer 142, keyboard 118, mouse 116, and data storage drive 143. Display 108, which is controlled by a display controller 134, is used to display visual output generated by the computing system 100. Such visual output may include text, graphics, animated graphics, and video. The display controller 134 includes electronic components required to generate a video signal that is sent to display 108. Further, the computing system 100 can contain network adaptor 136 which may be used to connect the computing system 100 to an external communications network 132.
  • Computing system 100, described above, can be deployed as part of a computer network 150 or can be wholly or partially incorporated into a suitable exercise device, such as those described below. In general, the above description for computing environments applies to both server computers and client computers deployed in a network environment. FIG. 1C illustrates an exemplary illustrative networked computing environment 100, with a server in communication with client computers via a communications network 150. As shown in FIG. 1B, server 110 may be interconnected via a communications network 150 (which may be either of, or a combination of a fixed-wire or wireless LAN, WAN, intranet, extranet, peer-to-peer network, virtual private network, the Internet, or other communications network) with a number of client computing environments such as tablet personal computer 102, mobile telephone 104, telephone 106, personal digital assistant 108, and a personal computer 112. Additionally, an exercise input device 12 is provided in communication with the network environment. In a network environment in which the communications network 150 is the Internet, for example, server 110 can be dedicated computing environment servers operable to process and communicate data to and from client computing environments via any of a number of known protocols, such as, hypertext transfer protocol (HTTP), file transfer protocol (FTP), simple object access protocol (SOAP), or wireless application protocol (WAP). Additionally, networked computing environment 100 can utilize various data security protocols such as secured socket layer (SSL) or pretty good privacy (PGP). Each client computing environment can be equipped with operating system 138 operable to support one or more computing applications, such as a web browser (not shown), or other graphical user interface (not shown), or a mobile desktop environment (not shown) to gain access to server computing environment 100. An exercise device 12 is in communication with one or more devices shown in the network 150. The exercise device 12 can be a treadmill (as illustrated), or any other suitable device.
  • In operation, a user (not shown) may interact with a computing application running on a client computing environment to obtain desired data and/or computing applications as the user is exercising using the exercise device 12 adapted and configured to communicate with the computing application and/or interact with a biological parameter measurer 144 adapted and configured to communicate with the computing application via, for example, an interface unit 142. The data and/or computing applications may be stored on server computing environment 100 and communicated to cooperating users through client computing environments over exemplary communications network 150. A participating user may request access to specific data and applications housed in whole or in part on server computing environment 100. These data may be communicated between client computing environments and server computing environments for processing and storage. Server computing environment 100 may host computing applications, processes and applets for the generation, authentication, encryption, and communication data and applications and may cooperate with other server computing environments (not shown), third party service providers (not shown), network attached storage (NAS) and storage area networks (SAN) to realize application/data transactions.
  • Biological parameter measurement devices 144 include, for example, devices capable of measuring a biologic function, such as heart rate, blood pressure, blood sugar or glucose levels, body temperature, tissue oxygenation, volume of O2 (VO2), pulse oximeter measurement (Sp O2), electroencephalogram measurement (EEG), O2 saturation, or any other measurement that can be obtained from the participant as would be appreciated by those skilled in the art. See, for example, U.S. Patent Publications U.S. 2005/0166373 entitled Case Structure for Sensor Structure Attachable to and Detachable From a Shoe (Saasko et al.), U.S. 2005/0135039 entitled Electric Circuit and Transmission Method for Telemetric Transmission (Klemetti), U.S. 2005/0130802 entitled Arrangement, Method and Computer Program for Determining Physical Activity Level of Human Beings (Kinnunen), U.S. 2005/0111307 entitled Electronic Wrist Device (Saaski et al.), U.S. 2005/0111306 entitled Portable Wrist-Worn Personal Electronic Device (Saaski et al.), U.S. 2005/0017850 entitled Mechanical Measuring Device and a Measuring Method (Nissala), U.S. 2005/0004436 entitled Method and Device for Weight Management of Humans (Nissala), U.S. 2004/0220738 entitled Portable Personal Data Processing Device (Nissala), and U.S. 2004/0220485 entitled Method and Device for Measuring Heart Rate, and for Manufacturing the Device (Rytky). U.S. Pat. Nos. 6,832,109 entitled Wrist-Worn Device for Displaying and Setting Heart Rate Parameters (Nissala); 6,754,517 entitled Apparatus for Measuring Electrocardiograph Signal (Nissila); 6,714,812 entitled Method of Performing Operating Settings in Heart Rate Measurement Arrangement, and Heart Rate Measurement Arrangement (Karjalainen); 6,687,535 entitled Controlling of Fitness Exercise (Hautala et al.); 6,605,044 entitled Caloric Exercise Monitor (Bimbaum); 6,584,344 entitled Method and Apparatus for Measuring Heart Rate (Hannula); 6,554,773 entitled Method and Arrangement for Blood Pressure Measurement (Nissila); 6,553,247 entitled Electrode Belt of Heart Rate Monitor (Rytky); 6,540,686 entitled Measurement Relating to Human Body (Heikkila et al.); 6,443,904 entitled Determination of Stress Level of Fitness Exercise (Nissila); 6,954,661 entitled Blood Sugar Measuring Apparatus (Cho et al.); 6,746,415 entitled Method of Blood Constituent Monitoring Using Improved Disposable Eletrocorporeal Conduit (Steuer et al.); 5,251,632 entitled Tissue Oxygen Measuring System (Delpy); 4,368,740 entitled Physiologic Analyzer (Binder); 6,912,413 entitled Pulse Oximeter (Rantala et al.); 6,879,850 entitled Pulse Oximeter with Motion Detector (Kimball); 6,829,496 entitled Blood Component Measurement Apparatus (Nagai et al.); 6,950,697 entitled Electroencephalagram Acquisition Method and System (Jordan); 6,829,502 entitled Brain Response Monitoring Apparatus and Method (Hong et al.); 6,510,340 entitled Method and Apparatus for Encephalography (Jordan); 6,909,912 entitled Non-Invasive Perfusion Monitor and System, Specially Configured Oximeter Probes, Methods of Using Same, and Covers for Probes (Melker); and 6,850,789 entitled Combination SPO2/temperature Measuring Apparatus (Scheitzer Jr., et al.). Parameter measurement devices also include, for example, a participant monitoring their pulse manually by placing a finger, for example, on the carotid artery or near the wrist to determine the number of beats per minute. See also, U.S. Pat. No. 5,170,780 to Rosenfeld for Method of Credibility Assessment Based on Feedback-Elicited P3 Responses of Brain and European Patent Publication EP 1510175 A1 to Kostucki for Exercise Manager Program.
  • II. Exercise Devices
  • The systems and methods disclosed herein can be achieved using a variety of exercise devices which are modified to provide information to one or more computer systems, components and networks on which software is provided which is adapted and configured to transform one or more inputs, e.g., from an exercise device, parameter sensor, and/or computer system into a video and audio output which is delivered to a user.
  • As will be appreciated by those skilled in the art, footfalls or movement of a user can be sensed in a variety of ways. The mechanism for sensing footfalls or movement of a user will vary by machine type. For the three major types of fitness machines, treadmills, elliptical machines, and stair steppers, there may not necessarily be an actual footfall (as in the case with elliptical machines). Additionally, there are also various hybrid machines which are a mix of these three main types of machines. The elliptical machines and stair steppers do not have a real footfall to sense, as the user's motion in reality is a fluid elliptical pattern in the case of elliptical machines, and a repetitive vertical (but fluid with no actual foot impact) motion on a stepper.
  • Treadmills: One mechanism that can be used would be to sense the user via, for example, the extra force exerted downward on the treadmill, or certain treadmill components, by the footfall of the user. A force sensor may be a piezoelectric device that converts force directly into a voltage differential, which in turn can be correlated to a controller to provide a mechanism for providing sensory feedback for the user. Other force sensors that produce electric signals as an output would be possible, including for example capacitative force sensors, optical-electric strain gauges, and others. Another mechanism for sensing footfalls with a treadmill includes, for example, one or more of: providing ammeters to detect increased load on the treadmill motor, tension sensors (electromagnetic or even piezoelectric) to detect sudden changes in belt tension, providing acoustic pickup to sense the sound of the footfall (a simple condenser microphone, electret microphone, dynamic or inductance type microphone), providing user-worn sensors such as accelerometers to detect the motion of the users feet or body (and which can communicate—wired or wirelessly—with the system), providing optical sensors to detect the position of the users' body—either with an imaging system or through beam-interruption detection (for example, with infrared lasers and photoelectric sensors, or with a passive imaging system that can recognize the user's body position), providing a sensor worn by the user that is a foot/leg position sensor such as the that used in gaming systems such as the Nintendo Wii®, providing a charge sensor that detects contact by a user (similar to touchscreen technology), providing a sensor that detects variances in the speed of the treadmill belt (which will slow slightly on foot impact). See, for example, U.S. Pat. No. 7,507,187 to Dyer et al. for Parameter Sensing System for an Exercise Device; and U.S. Pat. No. 6,336,891 to Fedrigon et al. for Interactive Exercise Pad and System. Treadmills are described more fully in, for example, U.S. Pat. Nos. 7,575,537 entitled Dual Direction Exercise Treadmill for Simulating a Dragging or Pulling Action with a User Adjustable Constant Static Weight Resistance; 7,563,203 entitled Treadmill with Cushion Assembly; and 7,367,926 entitled Treadmill with Moveable Console.
  • Elliptical Trainers: In one aspect, the elliptical could be configured to enable a “virtual footfall” to be sensed on the elliptical, or the moment at which a footfall sound would create the most effective representation of running or walking, is a position sensor that triggers when, for example, an elliptical pad is at its forward-most point in its elliptical movement pattern, on its down stroke, or reaches its lowest point. Alternately, speed sensors could determine when the forward motion of a stride reaches zero, which would also correspond to the furthest forward part of the stride but would accommodate inconsistent stride lengths. Elliptical trainers are described more fully in, for example, U.S. Pat. Nos. 6,436,007 entitled Elliptical Exercise Machine with Adjustment; 6,361,476 entitled Variable Stride Elliptical Exercise Apparatus; and 6,077,196 entitled Adjustable Elliptical Exercise Apparatus.
  • Variants could include a differential position sensor, sensing the point at which the pads are furthest apart, which is the same as the point at which either pad is furthest forward. Other ways to determine footfall on an elliptical include, for example, one or more of providing a speed sensor that senses when the elliptical pad's horizontal speed is zero (it is exactly at the moment in the elliptical movement pattern in which it is moving neither forward nor back). Speed sensor could also detect when the foot pad's vertical acceleration is highest; providing a weight/force/pressure sensor that detects the moment at which the greatest weight/force/pressure is being applied to the elliptical pad, which will correspond with the beginning of downward motion on the front most pad and thus the virtual footfall; providing a wireless/wired worn-sensor methods as mentioned above; providing optical/audio/infrared/etc sensors as mentioned above in treadmill section; or using the above systems to detect speed as it approaches zero.
  • Stair Stepper Exercise Devices: One mechanism to detect footfall or an equivalent of footfall on a stepper would be, for example, a position sensor that detects the point at which one of the step pads/levers is at or begins descending from its highest point. Steppers frequently have traditional step counters built-in and these could also be piggybacked upon. All of the methods mentioned above for ellipticals could be adjusted to work with steppers with a vertical fluid motion rather than an elliptical motion, including methods that detect the pad's speed approaching zero. The trigger point for the footfall would be the point at which either footpad begins to descend from its highest point. This is also the point at which the most force/pressure/weight is on the footpad and when the footpad begins downward acceleration. Stair stepping devices are described more fully in, for example, U.S. Pat. Nos. 7,153,238 entitled Stairclimber Apparatus Pedal Mechanism; and 5,399,134 entitled Stair Climbing Exercise Apparatus.
  • Hybrid Exercise Devices: Combinations or variants of the methods above could be used on hybrid machines to equal effect.
  • III. Apparatus Configured to Correlate Audio and Visual Signals
  • In this system, playback of one or more audio media files is triggered by one or more of the sensors described above. A signal generated by the sensor is detected by the media playing device, which then plays an appropriate media file. In addition to audio media files, visual signals and/or media files might be generated to correspond to the audio playback (for example a graphical shoe that blinks on the bottom portion of the screen each time the footfall is sensed).
  • Latency, or lag between the time at which a footfall is sensed and the time at which the audio file playback is initiated, can greatly diminish the effectiveness/enjoyment/motivation of the experience. Latency, even measured in amounts as small as tens of milliseconds, can alter the illusion created by the product of a user's actual footfalls. One method of addressing latency is to use software/system elements to make the playback of audio files predictive, rather than timed to correspond with specific occurrences of actual footfalls. One variant of this method would be to: characterize the system latency through product testing, determine how much latency exists for each machine through testing and then, during the exercise session, determine the cadence of the user, such as by using the sensors sensing the time between a plurality of footfalls and using this information to create an average footfall timing pattern. Thereafter begin playing the footfall audio files in accordance with the rolling average time between steps generated by the above.
  • Apply the known system latency determined through step 1 of the method described above to advance the timing of the audio file playback by an amount equal to the system latency. Then allow the user to use any number of possible input devices, such as buttons, levers, touch screen elements, etc, to adjust the timing of the predictive audio playback up or down by small increments to adjust the latency correction as needed.
  • Another variant of this method would be to not predict the moment associated with the actual footfall, but to use any number of the sensor methods above to sense a moment that precedes the moment of actual footfall by a fixed or predictable amount of time. Thus the signal to play the footfall audio file would be generated in advance, and taking known system latency into account, as in the first variant, the playback could be timed to match the actual moment of footfall.
  • Another variant of this method might be to “cover up” the latency to some extent by playing an audio file that “fades up” or increases in volume throughout playback. This could lead the user to believe that the audio file is timed correctly, but just happens to be initially inaudible because of the nature of the sound.
  • To create an effective virtual experience, the audio files played back by the footfall triggers could be configured to match the sounds of real footfalls pre-recorded on terrain similar to that shown in a video media presentation on the machine's display. The footfall audio files could thus vary throughout the course of a virtual exercise experience based on the various types of terrain being displayed. The characteristics of the audio file playback could be altered to enhance the experience in several ways:
  • The volume of the footfall audio file playback, or some portion of it, could be adjusted interactively based on movement speed or other exercise parameters, such as to represent louder footsteps when running faster.
  • The length or amount of the total footfall audio actually played back could be interactively adjusted based on movement speed or other exercise parameters, such as to represent quicker, lighter steps when running faster. This could occur by either cutting off playback (or combining cut-off with a fade-out of volume) or by speeding up playback beyond the files original speed to achieve shorter playback of the entire audio file.
  • Standard stereo audio playback functionality could be used to pan footfall audio playback to the right or left speakers in the audio system alternately to more accurately represent the virtual experience by representing the right or left footstep.
  • This raises issues of sensing the left/right footstep, rather than footsteps in general. In the case of steppers and ellipticals, this is a simple task, as the footpads are independent of one another and any of the discussed sensing methods can easily be adjusted to sense the footfall of either the left or right pad. In the case of the treadmill, the belt is a solid single element, and sensing either the left or right is more challenging. There are however methods that could do so, such as via multiple pressure/weight/force sensors that are positioned on different sides of the belt, differential tension/drag sensor that is capable of detecting greater tension on one side of the belt, other possible methods.
  • The specific audio file played could be varied based on an exercise parameter, such as speed, incline, or resistance. The sound of an actual footfall will be different depending on whether the person generating that footfall is moving fast or slow, or over flat or steep terrain, for example. Thus footfalls pre-recorded on the same type of terrain might be played with different characteristics to adjust for this as noted above, and/OR different pre-recorded footfalls might be played that more accurately represent the exercisers parameters over the same terrain. For example, there could be a sound for fast movement over gravel, another file for slow movement over gravel, and yet another for movement over steep gravel.
  • Alternatively, when a series of audio footfalls are played back to exercisers, many exercisers experience an instinctual motivation to match the sounds of these footfalls with their actual steps. Thus a motivational/coaching system using the audio techniques described herein could be greatly enhanced through the use of programmed footfall patterns.
  • In one implementation of this system, pre-recorded footfalls with varying characteristics to represent varying terrain or exercise parameters as described above, could be played independently of the activity of the exerciser, in a pre-determined pattern which is known to support the motivation of the exerciser.
  • The timing of these footfalls could be adjusted by the user themselves, or by the program, based on the program itself or the program in conjunction with information input by or detected from the user (such as desired difficulty level, height, age, heart rate, or other parameters).
  • The timing of the footfalls could be manually adjustable by the user through standard input devices such as buttons, touch screen elements, etc.
  • FIG. 2 is a block diagram of an apparatus in accordance with the invention shown in FIG. 1. The apparatus 210 includes the exercise machine 12 connected to an interface unit 236 which is in turn connects to the CPU 202 of a player. In one configuration a prerecorded data storage medium 248, such as a compact laser disc (CD), is inserted into a player 220. This CD contains media data including a set of digitized video frames and audio data packets and an encoded program which modifies the player control program 250. In other configurations, the pre-recorded data is contained on a storage medium which is streamed to a local device via the Internet or an intranet.
  • For purposes of illustrates, it will be appreciated that the CPU 202 includes a control program 250, a content buffer 252 which decodes and decompresses the data stream read from, for example, the CD 248, a dashboard display overlay generator 254, and a set of two or more display buffers 256 and 258. The player 220 also optionally includes inputs for signals receivable from, for example, a remote system CPUs 260.
  • Each CD can be configured to include a program which manipulates the control program 250 to manipulate the rates at which the audio visual are displayed.
  • Additional displays, such as real time, or near real time, exercise inputs from an interface unit 232 such as speed, cadence, total distance traveled, lap distance, calories burned, time elapsed, time remaining, and the like can be provided. Moreover, these parameters can be calculated and displayed on, for example, a ‘dashboard’ overlay on the visual monitor 218. Such parameters can be generated in overlay block 254 and fed to the display buffers 256 and 258. The overall control of the video sequences, and the start/stop of the exercise overlay program can be manipulated via a suitable user input, such as keypad 236 mounted on an interface unit 232.
  • The rate at which the video is displayed and one or more audio sequences are played in accordance with the present invention is controllable by a program shown in block diagram form in FIG. 3. As will be appreciated by those skilled in the art, the program can be encoded on a CD and operated on the operating control program 250 in the CPU of the player 220. Alternatively, the program can be stored on a remote network location that is accessible locally.
  • The present invention is adapted and configured to utilize one or more of each video and audio recorded sequences. Suitable sequences include those which can be recorded using a POV (Point of View) videotape camera mounted on an athlete's head or vehicle such as a bicycle. Each video frame recorded is assigned and has recorded with it a unique frame time stamp value and a duration stamp value for accessing the next frame packet of data upon playback. Typically, in real time recording, the duration stamp is a constant value, for example, about 8 milliseconds. These frame stamp and duration values function to allow a playback apparatus to sequence and time the reproduced display. The audio may be interlaced with the video or may be a separate track recording. The recorded sequence of video and audio are then digitized and recorded on a video CD along with the control program described below and shown in the Figures herein.
  • The basic effect of the control program of the present invention is to control the rate at which the video frame is played and to correlate the playback to the exercise rate of the user on the exercise device 12 that is in communication with the system. Therefore as the exercise rate increases, the frame rate of display increases. This creates the experience for a user that the scenery changes at a rate equivalent, or near equivalent, to the rate at which the scenery would change if the user were, for example, cycling or running at that rate where the video display was captured. Similarly, as the exercise rate of a user decreases, the video displays scenery at a slower and slower rate, until the user stops and the scene displayed stops also. Thus the user achieves a visual sensation similar to that of actually traveling through the scenery shown in the video.
  • The process flow begins operation 300, for example, when the user begins pedaling the bicycle or walking on the treadmill. Thereafter, the program can set, in operation 302, a cumulative time offset (Tos) to the current clock time of the CPU. This time offset tracks the total difference in time that the program modifies the video sequence due to the exercise rate of the user.
  • The program next queries, in operation 304, whether a stop video stream flag is set. However, if the Stop Video Flag is set, as when the user stops pedaling to rest for a period of time or stops running on the treadmill, a control passes to a wait operation 306. Wait operation 306 can, for example, be a process delay on the order of 10 milliseconds, after which the query in operation 304 would then be repeated. If the Stop Video Stream flag is not set, control passes to operation 308.
  • In operation 308, the current frame time stamp value (Tf) is retrieved and the current frame duration value (Td) is retrieved from the decompressed stream data in content buffer 452. Then the Adjustment value (Tadj) is obtained, in operation 110, from the program sequence shown in FIG. 4. In operation 312, the variable Tnext is set equal to Tf+Td+Tadj+Tos. This is the clock time at which the next frame should be decompressed into the decompression buffer 452.
  • In operation 314, the query is made as to whether the current CPU clock time is equal to or greater than Tnext. If the clock time is not greater to Tnext, then the system continues to wait 306. If the clock time is greater than Tnext, then the next video frame is decompressed and added to the decompression buffer 316 in the content buffer block 252 of the player CPU 202. At this point, the content of the decompression buffer is copied to a frame buffer, which in this case is either frame buffer A or frame buffer B 320, whichever is pointed to by a pointer. The pointer is adapted and configured to alternate between the two frame buffers.
  • As soon as the decompression buffer is copied to the pointed to frame buffer 318, control is passed to operation 320, where display objects such as the optional dashboard indicating the current heart rate, pulse icon and exercise status parameters, are overlaid into the buffer indicated by the pointer. Once the frame buffer contents are overlaid, control shifts to operation 322 and the contents of the frame buffer pointed to is sent to the video display or television set.
  • In operation 324, the frame buffer pointer is switched to the other buffer. In operation 326, the contents of Tadj are added to the Tos register so as to keep track of total adjustments to the sequence. Control then passes to operation 328 where the program queries whether there are any more video frames in the sequence. If there are none, the program ends in operation 330. If there are additional frames, control passes again to the wait operation 306 and the above steps are repeated as many times as necessary to achieve the desired output.
  • Video reproduction rate thus is modifiable by adding time or subtracting time from a prerecorded video frame duration stamp value. In other words, the value of Tadj changes and thus modifies the effect of Td. FIG. 4 describes an example of how Tadj can be modified. For example, the sequence of operations in FIG. 4 occurs continuously to provide a value of Tadj corresponding to a user's exercise rate. As will be appreciated from the examples below, the manner of corresponding the video stream to a user's exercise rate can be accomplished in a variety of ways and from a plurality of inputs, including a biological parameter measurement device 144 (as shown in FIG. 1B), or from the rate at which the exercise device is operated by the user, or from a rate at which a user is moving as detected by the device.
  • By way of an illustrative example, a sequence begins in operation 432 where, for example, the wheel speed input signal from the wheel pickup is fed through the interface unit 142 into the CPU 102 through an input such as keypad 118. The current speed, corresponding to miles per hour or kilometers per hour, can be obtained from the raw signal in operation 434. So, for example, the current speed can be continually updated as long as there is a wheel speed thread from the interface unit 142. In addition, validity checks are performed in this operation to ensure that the signal is, in fact, a correct wheel speed signal.
  • Control then shifts to operation 436 where a query is made whether current speed equals the last speed. If so, control returns to operation 432 for another input from wheel speed. If not, the query is made in operation 438 whether current speed is equal to zero. If not, control transfers to operation 440 where the query is made whether the Stop Video Flag is set. If this flag is not set, then control passes to operation 442 where the video adjust factor, Tadj is set to a table value corresponding to the current speed. Values can be empirically determined to give the appearance to the user of smooth transitions between frames and may be different for different operating systems and different video player machine speeds.
  • Control then shifts to operation 444 where Last Speed is set equal to New Speed and control again transfer to operation 432 where another signal from the wheel sensor is awaited. If the Current Speed is equal to zero in operation 438, control transfer to operation 446 where the Stop Video Stream flag is set and current clock time is saved. The Stop Video Stream flag may also be required in operation 304 to cover the situation where the user stops to rest after beginning a sequence. In that instance, the current clock time when this flag is set must be saved because, after the start, in operation 300, clock time is continuously running. Therefore, if the user stops momentarily, requiring the video sequence to freeze, the duration of the stopped period must be added to the time offset in order to keep the sequence operating properly based on current clock time.
  • When the user again using the device by, for example, pedaling, a signal will be produced in operation 432. Control then sequences through operations 434 and 436 with “no” answers. In operations 440, the answer is “yes” to the query whether the Stop Video Flag is set Control then transfer to operation 448 resets the Stop Video Flag and adds to Tos the elapsed time between the current clock time at flag reset and the clock time saved when the Stop Video Stream flag was previously set. This addition to Tos accounts for the lapse while the user was idle. Control then transfers again to operation 442 where the video adjust factor T.sub.adj is appropriately set as described above.
  • The sequence illustrated in FIG. 4 is continuous and proceeds whenever there is a signal from the wheel speed monitor input thread from the interface unit 142. Therefore this program sequence is constantly updating during the exercise activity. In contrast, the sequence illustrated in FIG. 3 operates during the time that a video frame is available to be displayed.
  • Turning now to FIGS. 5 a and 5 b, flow diagrams are provided illustrating two versions of an audio portion of a prerecorded sequence. There are basically two ways in which the audio data is encoded on the video compact disc. The audio data chunks may be in a separate file from the video file or the audio data chunks may be interleaved with the video frame data chunks in the same file. The FIG. 5 b flow diagram is for processing audio data chunks which are stored in a separate audio data file on the CD. FIG. 5 a provides a flow diagram for play of audio data chunks which are interleaved with the video frame data in the same file. Either case may be used dependent upon variables such as buffer space and storage medium drive speed. The audio program code is encoded on the CD as is the video program code described above with reference to FIGS. 3 and 4.
  • Referring now to FIG. 5 a, when the video stream starts, the audio stream starts in operation 500. A digital pointer is set to one of at least two audio buffers in operation 502 and control passes to operation 504 where an audio data chunk is retrieved from the decompression content buffer 252. The audio data chunk is then loaded into the buffer pointed to by the audio pointer in operation 506. As soon as the audio chunk is loaded into this buffer, contents of the buffer begin to play in operation 508. Meanwhile, operation control is passed to operation 510 where the query is made whether the audio stream is complete. If so, control passes to operation 512 and the audio play stream stops. If the audio stream is not complete, control passes to operation 514 where the pointer is shifted to the next buffer and control is passed back to operation 504. This process repeats until there are no more audio data chunks signifying that the audio stream is complete. In the case just described, the audio continues to play, even when the video slows in response to the actions of the user on the exercise device 12.
  • Referring now to the interleaved audio flow diagram in FIG. 5 b, when the first video frame is decompressed and loaded into the display buffer as described above with reference to FIGS. 3 and 4, the audio stream control begins in operation 520. First, a pointer is set to one of at least two audio buffers in operation 522. Control then passes to operation 524 where an audio data chunk associated with the current video frame is retrieved from the decompression content buffer 252. This data chunk is then loaded into the audio buffer pointed to in operation 526 and play of this audio chunk immediately begins in operation 528. At the same time, control shifts to operation 530 where the stream is queried to determine if the audio stream is complete. If not, the query is made, in operation 532, whether the next audio data chunk is available.
  • Thus, the query in operation 532 is whether the next video frame has been called for display. This becomes important when the user is slowing down the video display by reducing his or her exercise rate, e.g. pedaling slower. If the next video frame has not been called, the next audio data chunk will not be available. In this case, operation 532 transfers control back to operation 528 and the current audio data chunk is replayed. Where the audio is wind noise, sounds of the road, or natural background noise in the country, the user will not likely be able to distinguish that the audio is being “looped back”. Once the next video frame is called, the query in operation 532 will transfer control to operation 534 where the pointer is set to another buffer. Control then transfers back to operation 524 to get another audio data chunk and operations 526, 528, 530, and 532 are repeated until the last of the audio stream is processed. In this case, control is transferred to operation 536 where the audio play is stopped.
  • The audio buffers provide a smooth sequencing of audio chunk play. In the present invention, a plurality of audio can be played with the video. For example, a first audio can be played at a constant rate independent of the video frame, while a second audio is played at a rate which corresponds to the rate at which the video is played. This facilitates a first audio pitch and tempo remaining a pleasing audio signal, as would be perceived at the location while a second audio pitch changes to correspond to the pace at which footfalls, for example, would occur at the rate of exercise perceived by the user, while a third audio can occur at a rate intended to mimic a training pace or quickening pace of a training partner in response to a differential input by a user or calculated based on user parameters such as age, health and training objectives. Also, as the user slows down, the on-location sounds would not change appreciably. However, the audio volume could be made to increase or decrease as the user increases or decreases speed respectively. Therefore looping these audio chunks of wind and road noise back during slow exercise periods as described in FIG. 5 b maintains the perceptive effect of the audio being independent of the video rate of display, yet tying the audio content to the video frames being displayed.
  • Additionally, the audio of, for example, the sounds of footfalls can further be divided into individual sound packets that are played in bursts at a tempo or pace corresponding to the desired pace without altering the rate or speed of audio. Alternatively, an audio of a series of, for example, footfalls which includes a footfall followed by an interval of silence before a subsequent footfall (and so on) can be alternately speeded up during the intervals of silence only.
  • Another variation, shown in FIGS. 1 a-c, is the output connection of a control signal to the exercise device 12. The prerecorded video may include coded data for setting the exercise device to predetermined resistance values. In this case, the program would include a control thread which accesses the control data associated with the video frame which sets the resistance. This data would then be translated into setting values which would be transmitted to the servomotor or stepper motor connected to the resistance control such as resistance wheel on the exercise stand.
  • The interface unit 132 can be adapted and configured to include a battery, a programmable interrupt controller (PIC) or processor, a biological parameter measurer 144, such as a heart rate receiver tuned to the transmission frequency of the heart rate transmitter, a series of shift registers, a 10 MegaHertz clock, wheel speed input terminals which mate with the contacts on the exercise machine 12, and a nine pin output connector which connects the interface unit 132 to a controller keypad 118. The PIC processor can, for example, be an 8 bit device, which processes the incoming tics, or beats from the wheel speed sensor and the ticks from the output of the heart rate receiver. The shift registers in the interface unit convert the data from the PIC Processor to 32 bit words for compatibility of communication with a player. The interface unit 32 is adapted and configured to collect data from the heart rate and wheel speed inputs and transmits the heart rate and wheel speed data to the player when queried by the main program. Provision may also be included in the interface unit for providing a signal to a stepper motor or servomotor on the exercise device to vary the resistance provided by the resistance roller.
  • A logic flow diagram of the embedded program in the PIC processor is shown in FIG. 6 a. When the user turns on the player activates the playing of a video, the interface unit processor starts in operation 600. A run time crystal clock (RTCC) is used to run the processor and to measure time durations between input pulses in the PIC processor. This RTCC runs at 10 MHz and counts between zero and 255. The output rolls over at 255. This equates to a rollover time of about a maximum of 2 milliseconds. Operation 602 initializes several flags and registers to zero. Specifically, a load pulse flag, a heart beat flag, a heart tic flag, a wheel rotation flag and a wheel tic flag are set to zero. Also, a heart count register, a heart store register, a wheel count register, and a wheel store register are set to zero. The heart count registers and wheel count registers are used to accumulate time tics between input pulses from the heart rate receiver and the wheel rotation reed switch as will become more apparent below.
  • Control then transfers to operation 604 where the run time crystal clock is set to 99. This clock then counts up to 255 and then rolls over to zero and continues counting to 255, rolling over, and repeating. This works out to about 2 milliseconds between rollovers. Control then shifts to operation 606 where the query is made whether the RTCC has rolled over. The actual query is whether the RTCC is less than 90. If yes, the RTCC is reset to 99 in operation 608 and the heart tic and wheel tic flags are set in operation 610. Control then proceeds to operation 612. If the RTCC has not yet rolled over, control passes directly to operation 612 without passing through operations 608 and 610. Operation 612 queries whether a load pulse flag has been set by the control program. This flag will be set if the program is ready to receive input from the interface unit 32. In this case, control transfers to operation 614 where the interface unit 32 output registers are loaded with the contents of the heart store and wheel store registers. These output registers are then immediately read by the operating system through the connection through a user input interface, such as keypad 118.
  • Whether or not the load pulse flag is set by the player, control then passes to operation 616 where the query is made whether a heartbeat flag has been set, i.e. a beat has been received by the heart rate receiver. If a beat has been received, control passes to operation 618 where the heart count register contents are transferred to the heart store register. Then, in operation 620, the heart count register is reset to zero and the heart beat flag is reset in order to sense another heartbeat. Control then proceeds from operation 620 to operation 622. If no heartbeat has been received in the heart rate receiver, and thus the heart beat flag is not set, operation 616 transfers directly to operation 622.
  • In operation 622 using a bicycle, for example, as exercise device 12, a query is made whether the wheel rotate flag has been set by passage of a wheel magnet past a reed switch. If not, control passes to operation 624. If the wheel rotate flag is set, control passes to operation 626 where the contents of the wheel count register are moved to the wheel store register. Control then transfers to operation 628, where the wheel count register is set to zero and the wheel rotate flag is reset in order to sense receipt of another wheel rotation.
  • Operation 624 queries whether the heart tic flag is set. If so, control transfers to operation 632 where the heart count register is incremented and the heart tic flag is reset. Control then transfers to operation 630. If the heart tic flag is not set, operation 624 transfers control directly to operation 630.
  • Operation 630 queries whether the wheel tic flag is set. If so, control transfers to operation 634 where the wheel count register is incremented and the wheel tic flag is reset. Control then passes back to operation 606. If the wheel tic flag is not set, operation 630 passes directly back to operation 606.
  • The sequence of operations described in FIG. 6 b is continuous. The net effect of the sequence is to constantly update the heart count, wheel count, heart store, and wheel store registers as wheel rotations and heart beats are received. This information is passed into the output registers for transmission to the control system whenever the control program requests input which is about 60 times per second. It is to be understood that the above description is exemplary of one embodiment only.
  • As will be appreciated by this disclosure similar logic can be applied to other exercise devices to achieve similar results.
  • Other programmed method variations and equivalents for providing the above exercise device and user input to the playing device will become readily apparent to those skilled in the art. In addition, other playing devices may be utilized in place of the system. For example, an MPEG-2 compatible player coupled to a personal computer may be used, or another CD player using a different operating system such as a Sony video game CD player. In these cases, the hardware in the interface unit may have to be modified to achieve bit compatibility with the particular player input devices. However, the basic logic flow of the example described above could still apply.
  • Many of the above methods related to type and characteristic of the audio footfall file played back also apply in this type of implementation.
  • IV. Examples
  • Example 1
  • In one example, the pace of the video stream changes with the pace of the footsteps which corresponds to the rate at which a user is exercising as described above. The rate of the correlated audio can be set-up to increase as a user increases the speed at which the user performs. Thus, the pace of the video, i.e., the rate at which the video is streamed to the screen, correlates to the pace of, for example, the footsteps or the rate at which a user is cycling on a stationary bike. It has been observed that, for example, runners may find the urge to synchronize their steps to a strong musical beat or to a repetitive sound, such as a footfall. Similarly, cyclists may be urged to press down on the pedal at a rate corresponding to a repetitive sound. This urge may motivate the exerciser to perform at the video correlated pace as the speed of the video and the correlated audio increases to correspond to the rate at which the viewing would change if, for example, a runner were running at a particular pace and his or her footfalls were at a particular pace. The rate of change of each of the audio tracks is accomplished such that the sounds continue to sound natural but achieves the effect of a Foley artist in making the various audio tracks to correspond to a video.
  • Example 2
  • In another example, the pace of exercise interactively changes with the pace of the footsteps. The pace of the video, i.e., the rate at which the video is streamed, can change in response to a measured biological parameter. A measured parameter may be used to provide feedback that a user should increase his or her speed or decrease his or her speed (e.g., if heart rates are above or below desired levels, the correlated audio can be increased, along with the speed of the machine to increase the heart rate to a desired or target level).
  • Example 3
  • In another example, a user could select a difficulty level and/or or other parameters that would result in a certain speed of footsteps being played. This could be a combination of several parameters, such as in the case where a person might enter their height and a difficulty level of “5”. The program might know that “5” for a tall person is a different foot pace then “5” for a short person.
  • Example 4
  • In another example, to the extent that there was ambient noise (e.g., water running, leaves falling, wind blowing) or music that audio would remain at a natural rate (e.g., the rate that it would be heard by the user in nature at) regardless of speed of video or the correlated audio, but the sound for footfalls or any other video correlated sound that corresponds to a user's actual activity would change with the pace of video scenery.
  • Example 5
  • In another example, a user can select a competition rate wherein, for example, the user performs at a base rate to establish his or her normal training rate. Then, the user can select a pre-defined competitor profile, or a rate of performance improvement, e.g., 10%. In this scenario, the correlated sound will occur at the rate of the competitor profile or the rate of performance improvement while the video can stream at the rate at which the user is actually performing or at the rate of the chosen competitor profile or performance rate improvement.
  • Example 6
  • In another example of a deployment system for the methods of the invention, a data processing system for administering course material is provided comprising a computer or server as shown in FIG. 1B. The computer can, if desired, be connected to a network of remote stations as shown in FIG. 1C. In operation, the remote stations could then serve as the data entry points for information to be gathered, for example at a remote class site or by a participant registering for a class on-line. Information gathered includes, for example, information about the materials to be presented, the participant, the environment, etc. The remote stations can also serve as access points through which people transmit inquiries concerning the materials presented or exercise programs and for responding to those inquiries. Additionally, each station can store a record of each participant's details, including performance information for each class, and periodically send this information to the central computer for processing.
  • Additionally, it will be appreciated that the exercise can be administered in the form of interval training As will be appreciated by those skilled in the art, the ordering of these steps, or any steps described herein, can occur as illustrated in the various figures, or can occur in any other order that achieves the objectives of the invention without departing from the scope of the invention.
  • In another embodiment of the invention, the system and method can be adapted to work in conjunction with the invention disclosed in U.S. Pat. No. 6,142,913 for “Dynamic Real Time Exercise Video Apparatus and Method” (Ewert). Thus the system can be adapted to incorporate varying video playback rate adjusts the frame rate of motion video content being replayed on a display device based on the intensity at which a participant exerts themselves. This system supports the illusion that the participant is actually traveling through the terrain being displayed. A result of the use of this system is that a participant who exercises at a higher intensity will view more footage than will a participant who exercises at a lower intensity, as the frame rate speed will be higher and more frames of the footage will be viewed.
  • An additional benefit of the systems and methods disclosed herein is the modularity of the systems and methods.
  • While preferred embodiments of the present invention are shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Numerous variations, changes, and substitutions will now occur to those skilled in the art without departing from the invention. It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention. It is intended that the claims following the description define the scope of the invention and that methods and structures within the scope of these claims and equivalents are covered thereby.

Claims (27)

1. An exercise system comprising:
a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmit the one or more inputs to the central processing unit;
a video frame sequence encoded onto a storage medium in communication with and playable on the video playing device;
a video monitor in communication with the video playing device for displaying the video frame sequence reproduced by the video playing device;
a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the video monitor in response to the one or more inputs from the user;
one or more audio rate controllers configured to vary a rate of delivery of two or more audio files on an audio playing device in response to the one or more inputs from the user; and
an exercise device.
2. The system of claim 1 wherein the video frame rate controller comprises a computer program stored on a storage medium with the prerecorded video frame sequence, the program being operable with the central processing unit in the video playing device when the video sequence is played to modify the frame display rate in response to the signal from a user interface rate detector.
3. The system of claim 2 wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device operation detector.
4. The system of claim 3 wherein the user interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user controlling the rate at which the video is displayed on the video monitor.
5. The system of claim 1 wherein the audio rate controller comprises a computer program stored on a storage medium with an audio sequence, the program being operable with the central processing unit in the audio playing device when the audio sequence is played to modify the audio delivery rate in response to the signal from the user interface rate detector.
6. The system of claim 5 wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device operation detector.
7. The system of claim 6 wherein the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
8. The system of claim 1 wherein the user input is one or more of each of manual input and automatic input.
9. The system of claim 8 wherein the manual input is one or more of height, weight, age, difficulty level, target training rate, target heart rate, and target activity level.
10. The system of claim 8 wherein the automatic input is a signal from one or more of a biological parameter measurer, and an exercise device operation detector.
11. The system of claim 1 wherein the exercise device is selected from the group comprising a bicycle, a stair stepper, and an elliptical trainer.
12. The system of claim 1 wherein the rate of delivery of the two or more audio files are delivered asynchronous to each other.
13. The system of claim 1 wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed.
13. An apparatus for engaging a user of an exercise device interactively in viewing a video frame sequence of an activity on a video monitor comprising:
a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor;
a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmit a signal proportional to the rate of exercise;
a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed;
two or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played.
14. The apparatus according to claim 13 wherein the exercise device is selected from the group comprising a bicycle, a stair stepper and an elliptical trainer.
15. The apparatus according to claim 13 wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector.
16. The apparatus according to claim 15 wherein the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
17. A method of controlling a video frame sequence display rate of a video playback sequence in a device in response to an external signal comprising the steps of:
(a) accessing a duration time stamp for a current video frame;
(b) determining from the external signal an adjustment value for changing the display rate (c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp;
(d) displaying the next frame when the modified duration time has passed;
(e) accessing a duration time stamp for a current audio data packet;
(f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet;
(g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; and
(h) playing the next audio data packet when the modified duration time has passed.
18. The method of claim 17 further comprising the step of repeating steps (a) through (d) for each subsequent video frame and steps (e) through (h) for each subsequent audio data packet.
19. The method of claim 17 wherein the accessing step (a) further comprises the steps of:
i) setting a time offset to current clock time;
ii) displaying a current video frame; and
iii) accessing a frame time stamp and a duration time stamp for the current video frame.
20. The method of claim 19 wherein the step of determining further comprises the step of comparing the external signal to predetermined criteria to determine the adjustment value.
21. The method of claim 20 wherein the external signal is a user variable exercise rate signal.
22. The method of claim 20 wherein the step of displaying (d) further comprises the steps of:
i) adding the modified duration value to the time offset to obtain a next frame time; and
ii) displaying the next frame when clock time exceeds the next frame time.
23. The method of claim 17 wherein the accessing step (e) further comprises the steps of:
i) setting a time offset to current clock time;
ii) playing a current audio data packet; and
iii) accessing a frame time stamp and a duration time stamp for the current audio data packet.
24. The method of claim 23 wherein the step of determining (f) further comprises the step of comparing the external signal to predetermined criteria to determine the adjustment value.
25. The method of claim 24 wherein the external signal is a user variable exercise rate signal.
26. The method of claim 23 wherein the step of playing (h) further comprises the steps of:
i) adding the modified duration value to the time offset to obtain a next audio data packet time; and
ii) playing the next audio data packet when clock time exceeds the next frame time.
US12/609,438 2008-11-01 2009-10-30 Systems and methods for optimizing one or more audio tracks to a video stream Abandoned US20100279822A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/609,438 US20100279822A1 (en) 2008-11-01 2009-10-30 Systems and methods for optimizing one or more audio tracks to a video stream

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11055908P 2008-11-01 2008-11-01
US24815109P 2009-10-02 2009-10-02
US12/609,438 US20100279822A1 (en) 2008-11-01 2009-10-30 Systems and methods for optimizing one or more audio tracks to a video stream

Publications (1)

Publication Number Publication Date
US20100279822A1 true US20100279822A1 (en) 2010-11-04

Family

ID=43030817

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/609,438 Abandoned US20100279822A1 (en) 2008-11-01 2009-10-30 Systems and methods for optimizing one or more audio tracks to a video stream

Country Status (1)

Country Link
US (1) US20100279822A1 (en)

Cited By (68)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110237399A1 (en) * 2010-03-26 2011-09-29 Paul Toback Exercise apparatus
US20120028762A1 (en) * 2009-05-18 2012-02-02 Adidas Ag Methods and Computer Program Products For Providing Audio Performance Feedback to a User During an Athletic Activity
US20120245721A1 (en) * 2011-03-23 2012-09-27 Story Jr Guy A Managing playback of synchronized content
US20130003623A1 (en) * 2011-01-21 2013-01-03 Qualcomm Incorporated User input back channel for wireless displays
US20130267385A1 (en) * 2012-04-04 2013-10-10 Icon Health & Fitness, Inc. Systems, Methods, and Devices for Gathering and Transmitting Exercise Related Data
WO2013157848A1 (en) * 2012-04-20 2013-10-24 Samsung Electronics Co., Ltd. Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same
US8855797B2 (en) 2011-03-23 2014-10-07 Audible, Inc. Managing playback of synchronized content
WO2014163976A1 (en) * 2013-03-11 2014-10-09 Smith Kelly Ann Equipment, system and method for improving exercise efficiency in a cardio-fitness machine
US8972265B1 (en) 2012-06-18 2015-03-03 Audible, Inc. Multiple voices in audio content
US9075760B2 (en) 2012-05-07 2015-07-07 Audible, Inc. Narration settings distribution for content customization
US9099089B2 (en) 2012-08-02 2015-08-04 Audible, Inc. Identifying corresponding regions of content
US9141257B1 (en) 2012-06-18 2015-09-22 Audible, Inc. Selecting and conveying supplemental content
US9186567B2 (en) * 2008-12-05 2015-11-17 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US20150362993A1 (en) * 2014-06-16 2015-12-17 Immersion Corporation Systems and Methods for Foley-Style Haptic Content Creation
US9223830B1 (en) 2012-10-26 2015-12-29 Audible, Inc. Content presentation analysis
US9280906B2 (en) 2013-02-04 2016-03-08 Audible. Inc. Prompting a user for input during a synchronous presentation of audio content and textual content
US9317500B2 (en) 2012-05-30 2016-04-19 Audible, Inc. Synchronizing translated digital content
US9317486B1 (en) 2013-06-07 2016-04-19 Audible, Inc. Synchronizing playback of digital content with captured physical content
US9367196B1 (en) 2012-09-26 2016-06-14 Audible, Inc. Conveying branched content
US9409053B1 (en) * 2015-07-13 2016-08-09 Bml Productions, Inc. Exercise data collection system
US9413803B2 (en) 2011-01-21 2016-08-09 Qualcomm Incorporated User input back channel for wireless displays
US9472113B1 (en) 2013-02-05 2016-10-18 Audible, Inc. Synchronizing playback of digital content with physical content
US9489360B2 (en) 2013-09-05 2016-11-08 Audible, Inc. Identifying extra material in companion content
US9519750B2 (en) 2008-12-05 2016-12-13 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9536439B1 (en) 2012-06-27 2017-01-03 Audible, Inc. Conveying questions with content
US9570059B2 (en) * 2015-05-19 2017-02-14 Spotify Ab Cadence-based selection, playback, and transition between song versions
US9582239B2 (en) 2011-01-21 2017-02-28 Qualcomm Incorporated User input back channel for wireless displays
US9632647B1 (en) 2012-10-09 2017-04-25 Audible, Inc. Selecting presentation positions in dynamic content
US9679608B2 (en) 2012-06-28 2017-06-13 Audible, Inc. Pacing content
US9706247B2 (en) 2011-03-23 2017-07-11 Audible, Inc. Synchronized digital content samples
US9703781B2 (en) 2011-03-23 2017-07-11 Audible, Inc. Managing related digital content
US9734153B2 (en) 2011-03-23 2017-08-15 Audible, Inc. Managing related digital content
US9757619B2 (en) 2010-11-10 2017-09-12 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US9787725B2 (en) 2011-01-21 2017-10-10 Qualcomm Incorporated User input back channel for wireless displays
WO2018129407A1 (en) * 2017-01-09 2018-07-12 Inmusic Brands, Inc. Systems and methods for providing audio-file loop-playback functionality
US10031720B2 (en) 2015-08-12 2018-07-24 International Business Machines Corporation Controlling audio tempo based on a target heart rate
CN108399777A (en) * 2018-04-13 2018-08-14 京东方科技集团股份有限公司 A kind of auxiliary driving method, device and electronic equipment
KR20180119816A (en) * 2017-04-26 2018-11-05 주식회사 디엔제이휴먼케어 A method for providing health care services
US10123583B2 (en) 2008-12-05 2018-11-13 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US10179263B2 (en) 2011-02-17 2019-01-15 Nike, Inc. Selecting and correlating physical activity data with image data
US10188890B2 (en) 2013-12-26 2019-01-29 Icon Health & Fitness, Inc. Magnetic resistance mechanism in a cable machine
US10207148B2 (en) 2016-10-12 2019-02-19 Icon Health & Fitness, Inc. Systems and methods for reducing runaway resistance on an exercise device
US10226396B2 (en) 2014-06-20 2019-03-12 Icon Health & Fitness, Inc. Post workout massage device
US10252109B2 (en) 2016-05-13 2019-04-09 Icon Health & Fitness, Inc. Weight platform treadmill
US10272317B2 (en) 2016-03-18 2019-04-30 Icon Health & Fitness, Inc. Lighted pace feature in a treadmill
US10279212B2 (en) 2013-03-14 2019-05-07 Icon Health & Fitness, Inc. Strength training apparatus with flywheel and related methods
US10293211B2 (en) 2016-03-18 2019-05-21 Icon Health & Fitness, Inc. Coordinated weight selection
US10343017B2 (en) 2016-11-01 2019-07-09 Icon Health & Fitness, Inc. Distance sensor for console positioning
US10376736B2 (en) 2016-10-12 2019-08-13 Icon Health & Fitness, Inc. Cooling an exercise device during a dive motor runway condition
US10391361B2 (en) 2015-02-27 2019-08-27 Icon Health & Fitness, Inc. Simulating real-world terrain on an exercise device
US10426989B2 (en) 2014-06-09 2019-10-01 Icon Health & Fitness, Inc. Cable system incorporated into a treadmill
US10433612B2 (en) 2014-03-10 2019-10-08 Icon Health & Fitness, Inc. Pressure sensor to quantify work
US10441844B2 (en) 2016-07-01 2019-10-15 Icon Health & Fitness, Inc. Cooling systems and methods for exercise equipment
US10471299B2 (en) 2016-07-01 2019-11-12 Icon Health & Fitness, Inc. Systems and methods for cooling internal exercise equipment components
US10493349B2 (en) 2016-03-18 2019-12-03 Icon Health & Fitness, Inc. Display on exercise device
US10500473B2 (en) 2016-10-10 2019-12-10 Icon Health & Fitness, Inc. Console positioning
US10518163B2 (en) 2010-07-14 2019-12-31 Adidas Ag Location-aware fitness monitoring methods, systems, and program products, and applications thereof
US10543395B2 (en) 2016-12-05 2020-01-28 Icon Health & Fitness, Inc. Offsetting treadmill deck weight during operation
US10560504B2 (en) * 2009-09-17 2020-02-11 Adobe Inc. Stream duration management
US10561894B2 (en) 2016-03-18 2020-02-18 Icon Health & Fitness, Inc. Treadmill with removable supports
US10625114B2 (en) 2016-11-01 2020-04-21 Icon Health & Fitness, Inc. Elliptical and stationary bicycle apparatus including row functionality
US10625137B2 (en) 2016-03-18 2020-04-21 Icon Health & Fitness, Inc. Coordinated displays in an exercise device
US10661114B2 (en) 2016-11-01 2020-05-26 Icon Health & Fitness, Inc. Body weight lift mechanism on treadmill
US10671705B2 (en) 2016-09-28 2020-06-02 Icon Health & Fitness, Inc. Customizing recipe recommendations
US10729965B2 (en) 2017-12-22 2020-08-04 Icon Health & Fitness, Inc. Audible belt guide in a treadmill
US10953305B2 (en) 2015-08-26 2021-03-23 Icon Health & Fitness, Inc. Strength exercise mechanisms
US11451108B2 (en) 2017-08-16 2022-09-20 Ifit Inc. Systems and methods for axial impact resistance in electric motors
CN116248811A (en) * 2022-12-09 2023-06-09 北京生数科技有限公司 Video processing method, device and storage medium

Citations (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4368740A (en) * 1980-11-03 1983-01-18 Binder Andy S Physiologic analyzer
US4828257A (en) * 1986-05-20 1989-05-09 Powercise International Corporation Electronically controlled exercise system
US4925189A (en) * 1989-01-13 1990-05-15 Braeunig Thomas F Body-mounted video game exercise device
US5002491A (en) * 1989-04-28 1991-03-26 Comtek Electronic classroom system enabling interactive self-paced learning
US5049079A (en) * 1988-12-19 1991-09-17 John H. Peterson Closed loop ski simulation and instructional system
US5170780A (en) * 1991-05-30 1992-12-15 Rosenfeld J Peter Method of credibility assessment based on feedback-elicited P3 responses of brain
US5246411A (en) * 1991-01-04 1993-09-21 Rackman Michael I Exercise machine system
US5251632A (en) * 1991-03-07 1993-10-12 Hamamatsu Photonics K.K. Tissue oxygen measuring system
US5267865A (en) * 1992-02-11 1993-12-07 John R. Lee Interactive computer aided natural learning method and apparatus
US5339134A (en) * 1992-03-31 1994-08-16 Kabushiki Kaisha Toshiba Automatic document feeder for image forming apparatus
US5362069A (en) * 1992-12-03 1994-11-08 Heartbeat Corporation Combination exercise device/video game
US5527239A (en) * 1993-02-04 1996-06-18 Abbondanza; James M. Pulse rate controlled exercise system
US5577981A (en) * 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
US5888172A (en) * 1993-04-26 1999-03-30 Brunswick Corporation Physical exercise video system
US6004243A (en) * 1995-10-11 1999-12-21 Ewert; Bruce Dynamic real time exercise video apparatus and method
US6077196A (en) * 1999-10-01 2000-06-20 Eschenbach; Paul William Adjustable elliptical exercise apparatus
US6142913A (en) * 1995-10-11 2000-11-07 Ewert; Bruce Dynamic real time exercise video apparatus and method
US6179746B1 (en) * 1999-06-17 2001-01-30 David Harris Delman Activity controlled audio-visual system
US6336891B1 (en) * 1997-12-08 2002-01-08 Real Vision Corporation Interactive exercise pad system
US6361476B1 (en) * 1999-07-27 2002-03-26 Paul William Eschenbach Variable stride elliptical exercise apparatus
US6436007B1 (en) * 1996-09-09 2002-08-20 Paul William Eschenbach Elliptical exercise machine with adjustment
US6443904B2 (en) * 2000-03-17 2002-09-03 Polar Electro Oy Determination of stress level of fitness exercise
US6510340B1 (en) * 2000-01-10 2003-01-21 Jordan Neuroscience, Inc. Method and apparatus for electroencephalography
US6540686B2 (en) * 2000-02-23 2003-04-01 Polar Electro Oy Measurement relating to human body
US6553247B1 (en) * 1999-10-04 2003-04-22 Polar Electro Oy Electrode belt of heart rate monitor
US6554773B1 (en) * 1997-09-12 2003-04-29 Polar Electro Oy Method and arrangement for blood pressure measurement
US6584344B2 (en) * 2001-02-22 2003-06-24 Polar Electro Oy Method and apparatus for measuring heart rate
US6605044B2 (en) * 2001-06-28 2003-08-12 Polar Electro Oy Caloric exercise monitor
US6687535B2 (en) * 2000-02-23 2004-02-03 Polar Electro Oy Controlling of fitness exercise
US6714812B1 (en) * 1999-11-22 2004-03-30 Polar Electro Oy Method of performing operating settings in heart rate measurement arrangement, and heart rate measurement arrangement
US6746415B1 (en) * 1996-10-23 2004-06-08 Hema Metrics, Inc. Method of blood constituent monitoring using improved disposable extracorporeal conduit
US6749432B2 (en) * 1999-10-20 2004-06-15 Impulse Technology Ltd Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function
US6754517B2 (en) * 2000-08-30 2004-06-22 Polar Electro Oy Apparatus for measuring an electrocardiograph signal
US20040220738A1 (en) * 2003-04-17 2004-11-04 Polar Electro Oy. Portable personal data processing device
US20040220485A1 (en) * 2003-04-17 2004-11-04 Polar Electro Oy Method and device for measuring heart rate, and method for manufacturing the device
US6829496B2 (en) * 2001-11-20 2004-12-07 Minolta Co., Ltd. Blood component measurement apparatus
US6829502B2 (en) * 2002-05-30 2004-12-07 Motorola, Inc. Brain response monitoring apparatus and method
US6832109B2 (en) * 2000-10-06 2004-12-14 Polar Electro Oy Wrist-worn device for displaying and setting heart rate parameters
US20050004436A1 (en) * 2003-04-29 2005-01-06 Polar Electro Oy Method and device for weight management of humans
US20050004789A1 (en) * 1998-07-31 2005-01-06 Summers Gary J. Management training simulation method and system
US20050017850A1 (en) * 2003-07-04 2005-01-27 Polar Electro Oy. Mechanical measuring device and a measuring method
US6850789B2 (en) * 2002-07-29 2005-02-01 Welch Allyn, Inc. Combination SPO2/temperature measuring apparatus
US6879850B2 (en) * 2002-08-16 2005-04-12 Optical Sensors Incorporated Pulse oximeter with motion detection
US20050111307A1 (en) * 2003-11-20 2005-05-26 Polar Electro Oy. Electronic wrist device
US20050111306A1 (en) * 2003-11-20 2005-05-26 Polar Electro Oy Portable wrist-worn personal electronic device
US20050130802A1 (en) * 2003-11-21 2005-06-16 Polar Electro Oy Arrangement, method and computer program for determining physical activity level of human being
US6909912B2 (en) * 2002-06-20 2005-06-21 University Of Florida Non-invasive perfusion monitor and system, specially configured oximeter probes, methods of using same, and covers for probes
US20050135039A1 (en) * 2003-12-16 2005-06-23 Polar Electro Oy Electric circuit and transmission method for telemetric transmission
US6912413B2 (en) * 2002-09-13 2005-06-28 Ge Healthcare Finland Oy Pulse oximeter
US20050166373A1 (en) * 2004-01-30 2005-08-04 Polar Electro Oy Case structure for sensor structure attachable to and detachable from a shoe
US6930673B2 (en) * 2000-11-13 2005-08-16 Gtco Calcomp Collaborative input system
US6954661B2 (en) * 2003-06-23 2005-10-11 Hitachi, Ltd. Blood sugar level measuring apparatus
US7022048B1 (en) * 2004-07-26 2006-04-04 John Fernandez Video fitness machine
US7153238B2 (en) * 2001-07-12 2006-12-26 Brunswick Corporation Stairclimber apparatus pedal mechanism
US7217224B2 (en) * 2003-08-14 2007-05-15 Tom Thomas Virtual exercise system and method
US20070117081A1 (en) * 2005-10-31 2007-05-24 Ford John H System and Method for Delivering Information to Optimize Information Retention
US7367926B2 (en) * 2005-08-01 2008-05-06 Fitness Quest Inc. Exercise treadmill
US7507187B2 (en) * 2004-04-06 2009-03-24 Precor Incorporated Parameter sensing system for an exercise device
US7563203B2 (en) * 1998-09-25 2009-07-21 Icon Ip, Inc. Treadmill with adjustable cushioning members
US7575537B2 (en) * 2007-11-06 2009-08-18 Fitness Tools, Llc Dual direction exercise treadmill for simulating a dragging or pulling action with a user adjustable constant static weight resistance

Patent Citations (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4368740A (en) * 1980-11-03 1983-01-18 Binder Andy S Physiologic analyzer
US4828257A (en) * 1986-05-20 1989-05-09 Powercise International Corporation Electronically controlled exercise system
US5049079A (en) * 1988-12-19 1991-09-17 John H. Peterson Closed loop ski simulation and instructional system
US4925189A (en) * 1989-01-13 1990-05-15 Braeunig Thomas F Body-mounted video game exercise device
US5002491A (en) * 1989-04-28 1991-03-26 Comtek Electronic classroom system enabling interactive self-paced learning
US5246411A (en) * 1991-01-04 1993-09-21 Rackman Michael I Exercise machine system
US5251632A (en) * 1991-03-07 1993-10-12 Hamamatsu Photonics K.K. Tissue oxygen measuring system
US5170780A (en) * 1991-05-30 1992-12-15 Rosenfeld J Peter Method of credibility assessment based on feedback-elicited P3 responses of brain
US5267865A (en) * 1992-02-11 1993-12-07 John R. Lee Interactive computer aided natural learning method and apparatus
US5339134A (en) * 1992-03-31 1994-08-16 Kabushiki Kaisha Toshiba Automatic document feeder for image forming apparatus
US5362069A (en) * 1992-12-03 1994-11-08 Heartbeat Corporation Combination exercise device/video game
US5527239A (en) * 1993-02-04 1996-06-18 Abbondanza; James M. Pulse rate controlled exercise system
US5888172A (en) * 1993-04-26 1999-03-30 Brunswick Corporation Physical exercise video system
US5577981A (en) * 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
US6004243A (en) * 1995-10-11 1999-12-21 Ewert; Bruce Dynamic real time exercise video apparatus and method
US6142913A (en) * 1995-10-11 2000-11-07 Ewert; Bruce Dynamic real time exercise video apparatus and method
US6436007B1 (en) * 1996-09-09 2002-08-20 Paul William Eschenbach Elliptical exercise machine with adjustment
US6746415B1 (en) * 1996-10-23 2004-06-08 Hema Metrics, Inc. Method of blood constituent monitoring using improved disposable extracorporeal conduit
US6554773B1 (en) * 1997-09-12 2003-04-29 Polar Electro Oy Method and arrangement for blood pressure measurement
US6336891B1 (en) * 1997-12-08 2002-01-08 Real Vision Corporation Interactive exercise pad system
US20050004789A1 (en) * 1998-07-31 2005-01-06 Summers Gary J. Management training simulation method and system
US7563203B2 (en) * 1998-09-25 2009-07-21 Icon Ip, Inc. Treadmill with adjustable cushioning members
US6179746B1 (en) * 1999-06-17 2001-01-30 David Harris Delman Activity controlled audio-visual system
US6361476B1 (en) * 1999-07-27 2002-03-26 Paul William Eschenbach Variable stride elliptical exercise apparatus
US6077196A (en) * 1999-10-01 2000-06-20 Eschenbach; Paul William Adjustable elliptical exercise apparatus
US6553247B1 (en) * 1999-10-04 2003-04-22 Polar Electro Oy Electrode belt of heart rate monitor
US6749432B2 (en) * 1999-10-20 2004-06-15 Impulse Technology Ltd Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function
US6714812B1 (en) * 1999-11-22 2004-03-30 Polar Electro Oy Method of performing operating settings in heart rate measurement arrangement, and heart rate measurement arrangement
US6510340B1 (en) * 2000-01-10 2003-01-21 Jordan Neuroscience, Inc. Method and apparatus for electroencephalography
US6950697B2 (en) * 2000-01-10 2005-09-27 Jordan Neuroscience, Inc. Electroencephalogram acquisition unit and system
US6687535B2 (en) * 2000-02-23 2004-02-03 Polar Electro Oy Controlling of fitness exercise
US6540686B2 (en) * 2000-02-23 2003-04-01 Polar Electro Oy Measurement relating to human body
US6443904B2 (en) * 2000-03-17 2002-09-03 Polar Electro Oy Determination of stress level of fitness exercise
US6754517B2 (en) * 2000-08-30 2004-06-22 Polar Electro Oy Apparatus for measuring an electrocardiograph signal
US6832109B2 (en) * 2000-10-06 2004-12-14 Polar Electro Oy Wrist-worn device for displaying and setting heart rate parameters
US6930673B2 (en) * 2000-11-13 2005-08-16 Gtco Calcomp Collaborative input system
US6584344B2 (en) * 2001-02-22 2003-06-24 Polar Electro Oy Method and apparatus for measuring heart rate
US6605044B2 (en) * 2001-06-28 2003-08-12 Polar Electro Oy Caloric exercise monitor
US7153238B2 (en) * 2001-07-12 2006-12-26 Brunswick Corporation Stairclimber apparatus pedal mechanism
US6829496B2 (en) * 2001-11-20 2004-12-07 Minolta Co., Ltd. Blood component measurement apparatus
US6829502B2 (en) * 2002-05-30 2004-12-07 Motorola, Inc. Brain response monitoring apparatus and method
US6909912B2 (en) * 2002-06-20 2005-06-21 University Of Florida Non-invasive perfusion monitor and system, specially configured oximeter probes, methods of using same, and covers for probes
US6850789B2 (en) * 2002-07-29 2005-02-01 Welch Allyn, Inc. Combination SPO2/temperature measuring apparatus
US6879850B2 (en) * 2002-08-16 2005-04-12 Optical Sensors Incorporated Pulse oximeter with motion detection
US6912413B2 (en) * 2002-09-13 2005-06-28 Ge Healthcare Finland Oy Pulse oximeter
US20040220738A1 (en) * 2003-04-17 2004-11-04 Polar Electro Oy. Portable personal data processing device
US20040220485A1 (en) * 2003-04-17 2004-11-04 Polar Electro Oy Method and device for measuring heart rate, and method for manufacturing the device
US20050004436A1 (en) * 2003-04-29 2005-01-06 Polar Electro Oy Method and device for weight management of humans
US6954661B2 (en) * 2003-06-23 2005-10-11 Hitachi, Ltd. Blood sugar level measuring apparatus
US20050017850A1 (en) * 2003-07-04 2005-01-27 Polar Electro Oy. Mechanical measuring device and a measuring method
US7217224B2 (en) * 2003-08-14 2007-05-15 Tom Thomas Virtual exercise system and method
US20050111306A1 (en) * 2003-11-20 2005-05-26 Polar Electro Oy Portable wrist-worn personal electronic device
US20050111307A1 (en) * 2003-11-20 2005-05-26 Polar Electro Oy. Electronic wrist device
US20050130802A1 (en) * 2003-11-21 2005-06-16 Polar Electro Oy Arrangement, method and computer program for determining physical activity level of human being
US20050135039A1 (en) * 2003-12-16 2005-06-23 Polar Electro Oy Electric circuit and transmission method for telemetric transmission
US20050166373A1 (en) * 2004-01-30 2005-08-04 Polar Electro Oy Case structure for sensor structure attachable to and detachable from a shoe
US7507187B2 (en) * 2004-04-06 2009-03-24 Precor Incorporated Parameter sensing system for an exercise device
US7022048B1 (en) * 2004-07-26 2006-04-04 John Fernandez Video fitness machine
US7367926B2 (en) * 2005-08-01 2008-05-06 Fitness Quest Inc. Exercise treadmill
US20070117081A1 (en) * 2005-10-31 2007-05-24 Ford John H System and Method for Delivering Information to Optimize Information Retention
US7575537B2 (en) * 2007-11-06 2009-08-18 Fitness Tools, Llc Dual direction exercise treadmill for simulating a dragging or pulling action with a user adjustable constant static weight resistance

Cited By (109)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9403060B2 (en) 2008-12-05 2016-08-02 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US10173101B2 (en) 2008-12-05 2019-01-08 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9192815B2 (en) * 2008-12-05 2015-11-24 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9519750B2 (en) 2008-12-05 2016-12-13 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9186567B2 (en) * 2008-12-05 2015-11-17 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US10123583B2 (en) 2008-12-05 2018-11-13 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9511260B2 (en) * 2008-12-05 2016-12-06 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US10213647B2 (en) 2008-12-05 2019-02-26 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US11541296B2 (en) 2008-12-05 2023-01-03 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9248343B2 (en) * 2008-12-05 2016-02-02 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9452319B2 (en) 2008-12-05 2016-09-27 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9427624B2 (en) 2008-12-05 2016-08-30 Nike, Inc. Athletic performance monitoring systems and methods in a team sports environment
US9077465B2 (en) * 2009-05-18 2015-07-07 Adidas Ag Portable fitness monitoring methods
US11673023B2 (en) 2009-05-18 2023-06-13 Adidas Ag Portable fitness monitoring methods
US11376468B2 (en) 2009-05-18 2022-07-05 Adidas Ag Portable fitness monitoring methods
US10363454B2 (en) 2009-05-18 2019-07-30 Adidas Ag Portable fitness monitoring methods
US20140270236A1 (en) * 2009-05-18 2014-09-18 Adidas Ag Portable Fitness Monitoring Methods
US8715139B2 (en) 2009-05-18 2014-05-06 Adidas Ag Portable fitness monitoring systems, and applications thereof
US9675842B2 (en) 2009-05-18 2017-06-13 Adidas Ag Portable fitness monitoring methods
US8241184B2 (en) * 2009-05-18 2012-08-14 Adidas Ag Methods and computer program products for providing audio performance feedback to a user during an athletic activity
US20120028762A1 (en) * 2009-05-18 2012-02-02 Adidas Ag Methods and Computer Program Products For Providing Audio Performance Feedback to a User During an Athletic Activity
US10560504B2 (en) * 2009-09-17 2020-02-11 Adobe Inc. Stream duration management
US20110237399A1 (en) * 2010-03-26 2011-09-29 Paul Toback Exercise apparatus
US8979709B2 (en) * 2010-03-26 2015-03-17 Sproing Fitness LLC Exercise apparatus
US10518163B2 (en) 2010-07-14 2019-12-31 Adidas Ag Location-aware fitness monitoring methods, systems, and program products, and applications thereof
US11817198B2 (en) 2010-11-10 2023-11-14 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US11600371B2 (en) 2010-11-10 2023-03-07 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US10293209B2 (en) 2010-11-10 2019-05-21 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US10632343B2 (en) 2010-11-10 2020-04-28 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US9757619B2 (en) 2010-11-10 2017-09-12 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US11568977B2 (en) 2010-11-10 2023-01-31 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US9582239B2 (en) 2011-01-21 2017-02-28 Qualcomm Incorporated User input back channel for wireless displays
US10911498B2 (en) 2011-01-21 2021-02-02 Qualcomm Incorporated User input back channel for wireless displays
US10135900B2 (en) * 2011-01-21 2018-11-20 Qualcomm Incorporated User input back channel for wireless displays
US9413803B2 (en) 2011-01-21 2016-08-09 Qualcomm Incorporated User input back channel for wireless displays
US9787725B2 (en) 2011-01-21 2017-10-10 Qualcomm Incorporated User input back channel for wireless displays
US10382494B2 (en) 2011-01-21 2019-08-13 Qualcomm Incorporated User input back channel for wireless displays
US20130003623A1 (en) * 2011-01-21 2013-01-03 Qualcomm Incorporated User input back channel for wireless displays
US10179263B2 (en) 2011-02-17 2019-01-15 Nike, Inc. Selecting and correlating physical activity data with image data
US20120245721A1 (en) * 2011-03-23 2012-09-27 Story Jr Guy A Managing playback of synchronized content
US8948892B2 (en) * 2011-03-23 2015-02-03 Audible, Inc. Managing playback of synchronized content
US9706247B2 (en) 2011-03-23 2017-07-11 Audible, Inc. Synchronized digital content samples
US9703781B2 (en) 2011-03-23 2017-07-11 Audible, Inc. Managing related digital content
US9734153B2 (en) 2011-03-23 2017-08-15 Audible, Inc. Managing related digital content
US8855797B2 (en) 2011-03-23 2014-10-07 Audible, Inc. Managing playback of synchronized content
US9792027B2 (en) 2011-03-23 2017-10-17 Audible, Inc. Managing playback of synchronized content
US9186549B2 (en) * 2012-04-04 2015-11-17 Icon Health & Fitness, Inc. Systems, methods, and devices for gathering and transmitting exercise related data
US20130267385A1 (en) * 2012-04-04 2013-10-10 Icon Health & Fitness, Inc. Systems, Methods, and Devices for Gathering and Transmitting Exercise Related Data
WO2013157848A1 (en) * 2012-04-20 2013-10-24 Samsung Electronics Co., Ltd. Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same
US9517383B2 (en) 2012-04-20 2016-12-13 Samsung Electronics Co., Ltd. Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same
US9075760B2 (en) 2012-05-07 2015-07-07 Audible, Inc. Narration settings distribution for content customization
US9317500B2 (en) 2012-05-30 2016-04-19 Audible, Inc. Synchronizing translated digital content
US9141257B1 (en) 2012-06-18 2015-09-22 Audible, Inc. Selecting and conveying supplemental content
US8972265B1 (en) 2012-06-18 2015-03-03 Audible, Inc. Multiple voices in audio content
US9536439B1 (en) 2012-06-27 2017-01-03 Audible, Inc. Conveying questions with content
US9679608B2 (en) 2012-06-28 2017-06-13 Audible, Inc. Pacing content
US10109278B2 (en) 2012-08-02 2018-10-23 Audible, Inc. Aligning body matter across content formats
US9099089B2 (en) 2012-08-02 2015-08-04 Audible, Inc. Identifying corresponding regions of content
US9799336B2 (en) 2012-08-02 2017-10-24 Audible, Inc. Identifying corresponding regions of content
US9367196B1 (en) 2012-09-26 2016-06-14 Audible, Inc. Conveying branched content
US9632647B1 (en) 2012-10-09 2017-04-25 Audible, Inc. Selecting presentation positions in dynamic content
US9223830B1 (en) 2012-10-26 2015-12-29 Audible, Inc. Content presentation analysis
US9280906B2 (en) 2013-02-04 2016-03-08 Audible. Inc. Prompting a user for input during a synchronous presentation of audio content and textual content
US9472113B1 (en) 2013-02-05 2016-10-18 Audible, Inc. Synchronizing playback of digital content with physical content
WO2014163976A1 (en) * 2013-03-11 2014-10-09 Smith Kelly Ann Equipment, system and method for improving exercise efficiency in a cardio-fitness machine
US10279212B2 (en) 2013-03-14 2019-05-07 Icon Health & Fitness, Inc. Strength training apparatus with flywheel and related methods
US9317486B1 (en) 2013-06-07 2016-04-19 Audible, Inc. Synchronizing playback of digital content with captured physical content
US9489360B2 (en) 2013-09-05 2016-11-08 Audible, Inc. Identifying extra material in companion content
US10188890B2 (en) 2013-12-26 2019-01-29 Icon Health & Fitness, Inc. Magnetic resistance mechanism in a cable machine
US10433612B2 (en) 2014-03-10 2019-10-08 Icon Health & Fitness, Inc. Pressure sensor to quantify work
US10426989B2 (en) 2014-06-09 2019-10-01 Icon Health & Fitness, Inc. Cable system incorporated into a treadmill
US10139907B2 (en) * 2014-06-16 2018-11-27 Immersion Corporation Systems and methods for foley-style haptic content creation
US10503263B2 (en) 2014-06-16 2019-12-10 Immersion Corporation Systems and methods for Foley-style haptic content creation
US20150362993A1 (en) * 2014-06-16 2015-12-17 Immersion Corporation Systems and Methods for Foley-Style Haptic Content Creation
US10226396B2 (en) 2014-06-20 2019-03-12 Icon Health & Fitness, Inc. Post workout massage device
US10391361B2 (en) 2015-02-27 2019-08-27 Icon Health & Fitness, Inc. Simulating real-world terrain on an exercise device
US11182119B2 (en) 2015-05-19 2021-11-23 Spotify Ab Cadence-based selection, playback, and transition between song versions
US10255036B2 (en) 2015-05-19 2019-04-09 Spotify Ab Cadence-based selection, playback, and transition between song versions
US10572219B2 (en) 2015-05-19 2020-02-25 Spotify Ab Cadence-based selection, playback, and transition between song versions
US9570059B2 (en) * 2015-05-19 2017-02-14 Spotify Ab Cadence-based selection, playback, and transition between song versions
US9933993B2 (en) 2015-05-19 2018-04-03 Spotify Ab Cadence-based selection, playback, and transition between song versions
US9409053B1 (en) * 2015-07-13 2016-08-09 Bml Productions, Inc. Exercise data collection system
US10031720B2 (en) 2015-08-12 2018-07-24 International Business Machines Corporation Controlling audio tempo based on a target heart rate
US10953305B2 (en) 2015-08-26 2021-03-23 Icon Health & Fitness, Inc. Strength exercise mechanisms
US10272317B2 (en) 2016-03-18 2019-04-30 Icon Health & Fitness, Inc. Lighted pace feature in a treadmill
US10625137B2 (en) 2016-03-18 2020-04-21 Icon Health & Fitness, Inc. Coordinated displays in an exercise device
US10493349B2 (en) 2016-03-18 2019-12-03 Icon Health & Fitness, Inc. Display on exercise device
US10293211B2 (en) 2016-03-18 2019-05-21 Icon Health & Fitness, Inc. Coordinated weight selection
US10561894B2 (en) 2016-03-18 2020-02-18 Icon Health & Fitness, Inc. Treadmill with removable supports
US10252109B2 (en) 2016-05-13 2019-04-09 Icon Health & Fitness, Inc. Weight platform treadmill
US10441844B2 (en) 2016-07-01 2019-10-15 Icon Health & Fitness, Inc. Cooling systems and methods for exercise equipment
US10471299B2 (en) 2016-07-01 2019-11-12 Icon Health & Fitness, Inc. Systems and methods for cooling internal exercise equipment components
US10671705B2 (en) 2016-09-28 2020-06-02 Icon Health & Fitness, Inc. Customizing recipe recommendations
US10500473B2 (en) 2016-10-10 2019-12-10 Icon Health & Fitness, Inc. Console positioning
US10376736B2 (en) 2016-10-12 2019-08-13 Icon Health & Fitness, Inc. Cooling an exercise device during a dive motor runway condition
US10207148B2 (en) 2016-10-12 2019-02-19 Icon Health & Fitness, Inc. Systems and methods for reducing runaway resistance on an exercise device
US10661114B2 (en) 2016-11-01 2020-05-26 Icon Health & Fitness, Inc. Body weight lift mechanism on treadmill
US10625114B2 (en) 2016-11-01 2020-04-21 Icon Health & Fitness, Inc. Elliptical and stationary bicycle apparatus including row functionality
US10343017B2 (en) 2016-11-01 2019-07-09 Icon Health & Fitness, Inc. Distance sensor for console positioning
US10543395B2 (en) 2016-12-05 2020-01-28 Icon Health & Fitness, Inc. Offsetting treadmill deck weight during operation
US11907037B2 (en) * 2017-01-09 2024-02-20 Inmusic Brands, Inc. Systems and methods for providing audio-file loop-playback functionality
WO2018129407A1 (en) * 2017-01-09 2018-07-12 Inmusic Brands, Inc. Systems and methods for providing audio-file loop-playback functionality
US20210407484A1 (en) * 2017-01-09 2021-12-30 Inmusic Brands, Inc. Systems and methods for providing audio-file loop-playback functionality
KR101947900B1 (en) * 2017-04-26 2019-03-11 주식회사 디엔제이휴먼케어 A method for providing health care services
KR20180119816A (en) * 2017-04-26 2018-11-05 주식회사 디엔제이휴먼케어 A method for providing health care services
US11451108B2 (en) 2017-08-16 2022-09-20 Ifit Inc. Systems and methods for axial impact resistance in electric motors
US10729965B2 (en) 2017-12-22 2020-08-04 Icon Health & Fitness, Inc. Audible belt guide in a treadmill
CN108399777A (en) * 2018-04-13 2018-08-14 京东方科技集团股份有限公司 A kind of auxiliary driving method, device and electronic equipment
CN116248811A (en) * 2022-12-09 2023-06-09 北京生数科技有限公司 Video processing method, device and storage medium

Similar Documents

Publication Publication Date Title
US20100279822A1 (en) Systems and methods for optimizing one or more audio tracks to a video stream
JP6586144B2 (en) Athletic monitoring system with automatic pause of media content
CA2428812C (en) Methods and systems for controlling an exercise apparatus using a portable remote device
JP6093333B2 (en) Athletic performance sensing and / or tracking system and method
US8758201B2 (en) Portable physical activity sensing system
US7874957B2 (en) Apparatus for measuring exercise performance
US7837595B2 (en) Controller for an exercise bicycle
CA2403752C (en) Improvements relating to games controllers
US8717254B1 (en) Portable motion sensor and video glasses system for displaying a real time video display to a user while exercising
US20150238817A1 (en) Exercise system
US20050075213A1 (en) Exercise device independent, variable display rate visual exercise system
WO2002015985A1 (en) Systems and methods for interaction with exercise device
CN109908551A (en) A kind of bicycle exercise method and device
JP2002272890A (en) System and method for universal exercise
Berezan et al. SoundRunner: Out of the Starting Blocks
Chander et al. A virtual reality based system for a more engaging indoor exercise biking experience
Tian The Practice of Physical Training Based on Virtual Trainer Concept
Saito et al. Enhancing Intrinsic Motivation for Walking Exercises with a Virtual Reality System
TW201023941A (en) Device for controlling the progression of at least one environmental data sequence, corresponding method and computer program product
WO2002015988A1 (en) Computer systems and methods for interaction with exercise device

Legal Events

Date Code Title Description
AS Assignment

Owner name: VIRTUAL ACTIVE, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FORD, JOHN HAJIME;REEL/FRAME:023749/0593

Effective date: 20091217

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION