US20100279822A1 - Systems and methods for optimizing one or more audio tracks to a video stream - Google Patents
Systems and methods for optimizing one or more audio tracks to a video stream Download PDFInfo
- Publication number
- US20100279822A1 US20100279822A1 US12/609,438 US60943809A US2010279822A1 US 20100279822 A1 US20100279822 A1 US 20100279822A1 US 60943809 A US60943809 A US 60943809A US 2010279822 A1 US2010279822 A1 US 2010279822A1
- Authority
- US
- United States
- Prior art keywords
- rate
- video
- audio
- user
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
- A63B2071/0625—Emitting sound, noise or music
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
- A63B2071/0638—Displaying moving images of recorded environment, e.g. virtual environment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
- A63B2225/20—Miscellaneous features of sport apparatus, devices or equipment with means for remote communication, e.g. internet or the like
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
- A63B2225/50—Wireless data transmission, e.g. by radio transmitters or telemetry
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2230/00—Measuring physiological parameters of the user
- A63B2230/04—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
- A63B2230/06—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0686—Timers, rhythm indicators or pacing apparatus using electric or electronic means
Definitions
- a solution is needed to provide a mechanism for people working out alone to attain a training benefit of working out with a work-out partner.
- An aspect of the invention provides a system that detects the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience.
- the system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.
- An aspect of the invention is directed to an exercise system.
- the exercise system comprises: a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmitting the input to the central processing unit; a prerecorded video frame sequence encoded onto a storage medium in communication with and playable on the video playing device; a video monitor in communication with the video playing device for displaying the prerecorded video frame sequence reproduced by the video playing device; a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the monitor in response to the one or more inputs from the user wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed; two or more
- the video frame rate controller is adapted and configured to comprise a computer program stored on a storage medium with the prerecorded video frame sequence.
- the program is operable, for example, with the central processing unit in the video playing device when the prerecorded video sequence is played to modify the frame display rate in response to the signal from the user interface rate detector.
- the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. Suitable exercise devices include, for example, a bicycle, a stair stepper, and an elliptical trainer.
- the apparatus comprises a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor; a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmitting a signal proportional to the rate of exercise; a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed; and one or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played.
- Suitable exercise devices include, for example, a bicycle, a stair stepper and an elliptical trainer.
- the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector.
- the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
- Still other aspects of the invention are directed to a method of controlling a video frame sequence display rate of a prerecorded video playback sequence in a device in response to an external signal, in which each video frame has a unique frame time stamp and a duration time stamp indicating the time between successive frames.
- the method typically comprises the steps of: a) accessing the duration time stamp for a current video frame; b) determining from the external signal an adjustment value for changing the display rate; c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp; d) displaying the next frame when the modified duration time has passed; e) accessing the duration time stamp for a current audio data packet; f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet; g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; h) playing the next audio data packet when the modified duration time has passed; and i) repeating steps a through d for each subsequent video frame and steps e through h for each subsequent audio data packet.
- the accessing step can further comprise the steps of: i) setting a time offset to current clock time; ii) displaying a current video frame; and iii) accessing a frame time stamp and a duration time stamp for the current video frame.
- the step of determining can further comprise the step of comparing the external signal to predetermined criteria to determine the adjustment value.
- the external signal is a user variable exercise rate signal.
- the step of displaying further comprises the steps of: i) adding the modified duration value to the time offset to obtain a next frame time; and ii) displaying the next frame when clock time exceeds the next frame time.
- FIG. 1A-C are overviews of a system having a server, a CPU, a monitor, storage media, input devices, etc. which can be used by a user;
- FIG. 2 is block diagram of the apparatus in accordance with the invention shown FIG. 1 b;
- FIG. 3 is a flow diagram of the video frame rate control program encoded on the video disk
- FIG. 4 is a flow diagram of a adjustment factor subroutine
- FIGS. 5A-B are is flow diagrams of adjustment factor subroutines.
- FIGS. 6A-B are logic flow diagrams of an embedded processor in an interface unit.
- An aspect of the invention provides a video stream that has one or more audio tracks associated with the video stream, one of which correlates to the sounds of, for example footfalls and which is variable in response to input and which can be used, for example, as a training guide to encourage people to increase their exertion rate as they perceive competing against another person.
- a second audio track is provided that can correspond to normal ambient-type noise that might be heard by a user in the environment represented by the video stream, music or whatever background noise a user selects. Changes to the video rate correlated audio can be in response to user input or in response to a sensing of a user parameter.
- a variety of components are required: computer systems, components and networks; exercise devices; and software which transforms input from the exercise device and/or computer system into a video and audio output which is delivered to a user.
- FIG. 1A is a block diagram showing a representative example logic device through which reviewing, manipulating, or analyzing information relating to the present invention can be achieved.
- Such data can be in relation to exercise, one or more physiological parameters, exertion, or any other suitable parameter desired to be measured of a subject.
- a computer system (or digital device) 100 that may be understood as a logical apparatus that can read instructions from media 111 and/or network port 105 , which can optionally be connected to server 109 having fixed media 112 .
- the computer system 100 can also be connected to the Internet or an intranet.
- the system includes CPU 101 , disk drives 103 , optional input devices, illustrated as keyboard 115 and/or mouse 116 and optional monitor 107 .
- Data communication can be achieved through the indicated communication medium to a server 109 at a local or a remote location.
- the communication medium can include any means of transmitting and/or receiving data.
- the communication medium can be a network connection, a wireless connection or an internet connection. It is envisioned that data relating to the present invention can be transmitted over such networks or connections.
- the computer system can be adapted to communicate with an participant parameter monitor and/or an apparatus on which a participant is engaged in exercise. Additionally, the components of these logic devices can be incorporated, wholly or partially, into an exercise device, as will be appreciated
- a user or participant 122 can optionally also be connected to a variety of monitoring devices, as described below.
- the monitoring devices can further be adapted and configured to interact with the system.
- the computer system, or digital device, 100 can be any suitable device.
- Other suitable devices capable of being adapted for use in the system described herein include, for example, video iPod (Apple Corp., Cupertino Calif.), or a portable DVD player or DVD Walkman® (Sony Corporation). Such devices would be suitable in a variety of situations.
- a computer-readable medium includes a medium suitable for storing, analyzing and transmitting target information of interest, such as that information discussed in more detail below.
- the medium can include a result regarding a disease condition or state of a subject, wherein such a result is derived using the methods described herein.
- FIG. 1B depicts another exemplary computing system 100 .
- the computing system 100 is capable of executing a variety of computing applications 138 , including computing applications, a computing applet, a computing program, or other instructions for operating on computing system 100 to perform at least one function, operation, and/or procedure.
- Computing system 100 may be controlled by computer readable instructions, which may be in the form of software.
- the computer readable instructions can contain instructions for computing system 100 for storing and accessing the computer readable instructions themselves.
- Such software may be executed within CPU 102 to cause the computing system 100 to perform desired functions.
- CPU 102 is implemented by micro-electronic chips CPUs called microprocessors.
- a co-processor distinct from the main CPU 102 , can be provided that performs additional functions or assists the CPU 102 .
- the CPU 102 may be connected to co-processor through an interconnect.
- One common type of coprocessor is the floating-point coprocessor, also called a numeric or math coprocessor, which is designed to perform numeric calculations faster and better than the general-purpose CPU 102 .
- the CPU 102 fetches, decodes, and executes instructions, and transfers information to and from other resources via the computer's main data-transfer path, system bus 140 .
- a system bus connects the components in the computing system 100 and defines the medium for data exchange.
- Memory devices coupled to the system bus 140 include random access memory (RAM) 124 and read only memory (ROM) 126 .
- RAM random access memory
- ROM read only memory
- Such memories include circuitry that allows information to be stored and retrieved.
- the ROMs 126 generally contain stored data that cannot be modified. Data stored in the RAM 124 can be read or changed by CPU 102 or other hardware devices. Access to the RAM 124 and/or ROM 126 may be controlled by memory controller 120 .
- the memory controller 120 may provide an address translation function that translates virtual addresses into physical addresses as instructions are executed.
- the computing system 100 can contain peripherals controller 128 responsible for communicating instructions from the CPU 102 to peripherals, such as, printer 142 , keyboard 118 , mouse 116 , and data storage drive 143 .
- Display 108 which is controlled by a display controller 134 , is used to display visual output generated by the computing system 100 . Such visual output may include text, graphics, animated graphics, and video.
- the display controller 134 includes electronic components required to generate a video signal that is sent to display 108 .
- the computing system 100 can contain network adaptor 136 which may be used to connect the computing system 100 to an external communications network 132 .
- FIG. 1C illustrates an exemplary illustrative networked computing environment 100 , with a server in communication with client computers via a communications network 150 . As shown in FIG.
- server 110 may be interconnected via a communications network 150 (which may be either of, or a combination of a fixed-wire or wireless LAN, WAN, intranet, extranet, peer-to-peer network, virtual private network, the Internet, or other communications network) with a number of client computing environments such as tablet personal computer 102 , mobile telephone 104 , telephone 106 , personal digital assistant 108 , and a personal computer 112 . Additionally, an exercise input device 12 is provided in communication with the network environment.
- a communications network 150 which may be either of, or a combination of a fixed-wire or wireless LAN, WAN, intranet, extranet, peer-to-peer network, virtual private network, the Internet, or other communications network
- client computing environments such as tablet personal computer 102 , mobile telephone 104 , telephone 106 , personal digital assistant 108 , and a personal computer 112 .
- an exercise input device 12 is provided in communication with the network environment.
- server 110 can be dedicated computing environment servers operable to process and communicate data to and from client computing environments via any of a number of known protocols, such as, hypertext transfer protocol (HTTP), file transfer protocol (FTP), simple object access protocol (SOAP), or wireless application protocol (WAP).
- HTTP hypertext transfer protocol
- FTP file transfer protocol
- SOAP simple object access protocol
- WAP wireless application protocol
- networked computing environment 100 can utilize various data security protocols such as secured socket layer (SSL) or pretty good privacy (PGP).
- SSL secured socket layer
- PGP pretty good privacy
- Each client computing environment can be equipped with operating system 138 operable to support one or more computing applications, such as a web browser (not shown), or other graphical user interface (not shown), or a mobile desktop environment (not shown) to gain access to server computing environment 100 .
- An exercise device 12 is in communication with one or more devices shown in the network 150 .
- the exercise device 12 can be a treadmill (as illustrated), or any other suitable device.
- a user may interact with a computing application running on a client computing environment to obtain desired data and/or computing applications as the user is exercising using the exercise device 12 adapted and configured to communicate with the computing application and/or interact with a biological parameter measurer 144 adapted and configured to communicate with the computing application via, for example, an interface unit 142 .
- the data and/or computing applications may be stored on server computing environment 100 and communicated to cooperating users through client computing environments over exemplary communications network 150 .
- a participating user may request access to specific data and applications housed in whole or in part on server computing environment 100 . These data may be communicated between client computing environments and server computing environments for processing and storage.
- Server computing environment 100 may host computing applications, processes and applets for the generation, authentication, encryption, and communication data and applications and may cooperate with other server computing environments (not shown), third party service providers (not shown), network attached storage (NAS) and storage area networks (SAN) to realize application/data transactions.
- server computing environments not shown
- third party service providers not shown
- NAS network attached storage
- SAN storage area networks
- Biological parameter measurement devices 144 include, for example, devices capable of measuring a biologic function, such as heart rate, blood pressure, blood sugar or glucose levels, body temperature, tissue oxygenation, volume of O 2 (VO2), pulse oximeter measurement (Sp O 2 ), electroencephalogram measurement (EEG), O 2 saturation, or any other measurement that can be obtained from the participant as would be appreciated by those skilled in the art. See, for example, U.S. Patent Publications U.S. 2005/0166373 entitled Case Structure for Sensor Structure Attachable to and Detachable From a Shoe (Saasko et al.), U.S. 2005/0135039 entitled Electric Circuit and Transmission Method for Telemetric Transmission (Klemetti), U.S.
- a biologic function such as heart rate, blood pressure, blood sugar or glucose levels, body temperature, tissue oxygenation, volume of O 2 (VO2), pulse oximeter measurement (Sp O 2 ), electroencephalogram measurement (EEG), O 2 saturation, or any other measurement that can be obtained from the participant as would be appreciated by
- Parameter measurement devices also include, for example, a participant monitoring their pulse manually by placing a finger, for example, on the carotid artery or near the wrist to determine the number of beats per minute. See also, U.S. Pat. No. 5,170,780 to Rosenfeld for Method of Credibility Assessment Based on Feedback-Elicited P3 Responses of Brain and European Patent Publication EP 1510175 A1 to Kostucki for Exercise Manager Program.
- the systems and methods disclosed herein can be achieved using a variety of exercise devices which are modified to provide information to one or more computer systems, components and networks on which software is provided which is adapted and configured to transform one or more inputs, e.g., from an exercise device, parameter sensor, and/or computer system into a video and audio output which is delivered to a user.
- footfalls or movement of a user can be sensed in a variety of ways.
- the mechanism for sensing footfalls or movement of a user will vary by machine type.
- machine type For the three major types of fitness machines, treadmills, elliptical machines, and stair steppers, there may not necessarily be an actual footfall (as in the case with elliptical machines).
- hybrid machines which are a mix of these three main types of machines.
- the elliptical machines and stair steppers do not have a real footfall to sense, as the user's motion in reality is a fluid elliptical pattern in the case of elliptical machines, and a repetitive vertical (but fluid with no actual foot impact) motion on a stepper.
- Treadmills One mechanism that can be used would be to sense the user via, for example, the extra force exerted downward on the treadmill, or certain treadmill components, by the footfall of the user.
- a force sensor may be a piezoelectric device that converts force directly into a voltage differential, which in turn can be correlated to a controller to provide a mechanism for providing sensory feedback for the user.
- Other force sensors that produce electric signals as an output would be possible, including for example capacitative force sensors, optical-electric strain gauges, and others.
- Another mechanism for sensing footfalls with a treadmill includes, for example, one or more of: providing ammeters to detect increased load on the treadmill motor, tension sensors (electromagnetic or even piezoelectric) to detect sudden changes in belt tension, providing acoustic pickup to sense the sound of the footfall (a simple condenser microphone, electret microphone, dynamic or inductance type microphone), providing user-worn sensors such as accelerometers to detect the motion of the users feet or body (and which can communicate—wired or wirelessly—with the system), providing optical sensors to detect the position of the users' body—either with an imaging system or through beam-interruption detection (for example, with infrared lasers and photoelectric sensors, or with a passive imaging system that can recognize the user's body position), providing a sensor worn by the user that is a foot/leg position sensor such as the that used in gaming systems such as the Nintendo Wii®, providing a charge sensor that detects contact by a user (similar to touchscreen technology), providing a sensor that detects variances in the speed
- Treadmills are described more fully in, for example, U.S. Pat. Nos. 7,575,537 entitled Dual Direction Exercise Treadmill for Simulating a Dragging or Pulling Action with a User Adjustable Constant Static Weight Resistance; 7,563,203 entitled Treadmill with Cushion Assembly; and 7,367,926 entitled Treadmill with Moveable Console.
- the elliptical could be configured to enable a “virtual footfall” to be sensed on the elliptical, or the moment at which a footfall sound would create the most effective representation of running or walking, is a position sensor that triggers when, for example, an elliptical pad is at its forward-most point in its elliptical movement pattern, on its down stroke, or reaches its lowest point.
- speed sensors could determine when the forward motion of a stride reaches zero, which would also correspond to the furthest forward part of the stride but would accommodate inconsistent stride lengths.
- Elliptical trainers are described more fully in, for example, U.S. Pat. Nos. 6,436,007 entitled Elliptical Exercise Machine with Adjustment; 6,361,476 entitled Variable Stride Elliptical Exercise Apparatus; and 6,077,196 entitled Adjustable Elliptical Exercise Apparatus.
- Variants could include a differential position sensor, sensing the point at which the pads are furthest apart, which is the same as the point at which either pad is furthest forward.
- Other ways to determine footfall on an elliptical include, for example, one or more of providing a speed sensor that senses when the elliptical pad's horizontal speed is zero (it is exactly at the moment in the elliptical movement pattern in which it is moving neither forward nor back).
- Speed sensor could also detect when the foot pad's vertical acceleration is highest; providing a weight/force/pressure sensor that detects the moment at which the greatest weight/force/pressure is being applied to the elliptical pad, which will correspond with the beginning of downward motion on the front most pad and thus the virtual footfall; providing a wireless/wired worn-sensor methods as mentioned above; providing optical/audio/infrared/etc sensors as mentioned above in treadmill section; or using the above systems to detect speed as it approaches zero.
- Stair Stepper Exercise Devices One mechanism to detect footfall or an equivalent of footfall on a stepper would be, for example, a position sensor that detects the point at which one of the step pads/levers is at or begins descending from its highest point. Steppers frequently have traditional step counters built-in and these could also be piggybacked upon. All of the methods mentioned above for ellipticals could be adjusted to work with steppers with a vertical fluid motion rather than an elliptical motion, including methods that detect the pad's speed approaching zero.
- the trigger point for the footfall would be the point at which either footpad begins to descend from its highest point. This is also the point at which the most force/pressure/weight is on the footpad and when the footpad begins downward acceleration.
- Stair stepping devices are described more fully in, for example, U.S. Pat. Nos. 7,153,238 entitled Stairclimber Apparatus Pedal Mechanism; and 5,399,134 entitled Stair Climbing Exercise Apparatus.
- Hybrid Exercise Devices Combinations or variants of the methods above could be used on hybrid machines to equal effect.
- playback of one or more audio media files is triggered by one or more of the sensors described above.
- a signal generated by the sensor is detected by the media playing device, which then plays an appropriate media file.
- visual signals and/or media files might be generated to correspond to the audio playback (for example a graphical shoe that blinks on the bottom portion of the screen each time the footfall is sensed).
- Latency or lag between the time at which a footfall is sensed and the time at which the audio file playback is initiated, can greatly diminish the effectiveness/enjoyment/motivation of the experience. Latency, even measured in amounts as small as tens of milliseconds, can alter the illusion created by the product of a user's actual footfalls.
- One method of addressing latency is to use software/system elements to make the playback of audio files predictive, rather than timed to correspond with specific occurrences of actual footfalls.
- One variant of this method would be to: characterize the system latency through product testing, determine how much latency exists for each machine through testing and then, during the exercise session, determine the cadence of the user, such as by using the sensors sensing the time between a plurality of footfalls and using this information to create an average footfall timing pattern. Thereafter begin playing the footfall audio files in accordance with the rolling average time between steps generated by the above.
- Another variant of this method would be to not predict the moment associated with the actual footfall, but to use any number of the sensor methods above to sense a moment that precedes the moment of actual footfall by a fixed or predictable amount of time.
- the signal to play the footfall audio file would be generated in advance, and taking known system latency into account, as in the first variant, the playback could be timed to match the actual moment of footfall.
- Another variant of this method might be to “cover up” the latency to some extent by playing an audio file that “fades up” or increases in volume throughout playback. This could lead the user to believe that the audio file is timed correctly, but just happens to be initially inaudible because of the nature of the sound.
- the audio files played back by the footfall triggers could be configured to match the sounds of real footfalls pre-recorded on terrain similar to that shown in a video media presentation on the machine's display.
- the footfall audio files could thus vary throughout the course of a virtual exercise experience based on the various types of terrain being displayed.
- the characteristics of the audio file playback could be altered to enhance the experience in several ways:
- the volume of the footfall audio file playback could be adjusted interactively based on movement speed or other exercise parameters, such as to represent louder footsteps when running faster.
- the length or amount of the total footfall audio actually played back could be interactively adjusted based on movement speed or other exercise parameters, such as to represent quicker, lighter steps when running faster. This could occur by either cutting off playback (or combining cut-off with a fade-out of volume) or by speeding up playback beyond the files original speed to achieve shorter playback of the entire audio file.
- Standard stereo audio playback functionality could be used to pan footfall audio playback to the right or left speakers in the audio system alternately to more accurately represent the virtual experience by representing the right or left footstep.
- the specific audio file played could be varied based on an exercise parameter, such as speed, incline, or resistance.
- the sound of an actual footfall will be different depending on whether the person generating that footfall is moving fast or slow, or over flat or steep terrain, for example.
- footfalls pre-recorded on the same type of terrain might be played with different characteristics to adjust for this as noted above, and/OR different pre-recorded footfalls might be played that more accurately represent the exercisers parameters over the same terrain. For example, there could be a sound for fast movement over gravel, another file for slow movement over gravel, and yet another for movement over steep gravel.
- pre-recorded footfalls with varying characteristics to represent varying terrain or exercise parameters as described above could be played independently of the activity of the exerciser, in a pre-determined pattern which is known to support the motivation of the exerciser.
- Timing of these footfalls could be adjusted by the user themselves, or by the program, based on the program itself or the program in conjunction with information input by or detected from the user (such as desired difficulty level, height, age, heart rate, or other parameters).
- the timing of the footfalls could be manually adjustable by the user through standard input devices such as buttons, touch screen elements, etc.
- FIG. 2 is a block diagram of an apparatus in accordance with the invention shown in FIG. 1 .
- the apparatus 210 includes the exercise machine 12 connected to an interface unit 236 which is in turn connects to the CPU 202 of a player.
- a prerecorded data storage medium 248 such as a compact laser disc (CD)
- CD contains media data including a set of digitized video frames and audio data packets and an encoded program which modifies the player control program 250 .
- the pre-recorded data is contained on a storage medium which is streamed to a local device via the Internet or an intranet.
- the CPU 202 includes a control program 250 , a content buffer 252 which decodes and decompresses the data stream read from, for example, the CD 248 , a dashboard display overlay generator 254 , and a set of two or more display buffers 256 and 258 .
- the player 220 also optionally includes inputs for signals receivable from, for example, a remote system CPUs 260 .
- Each CD can be configured to include a program which manipulates the control program 250 to manipulate the rates at which the audio visual are displayed.
- Additional displays such as real time, or near real time, exercise inputs from an interface unit 232 such as speed, cadence, total distance traveled, lap distance, calories burned, time elapsed, time remaining, and the like can be provided. Moreover, these parameters can be calculated and displayed on, for example, a ‘dashboard’ overlay on the visual monitor 218 . Such parameters can be generated in overlay block 254 and fed to the display buffers 256 and 258 . The overall control of the video sequences, and the start/stop of the exercise overlay program can be manipulated via a suitable user input, such as keypad 236 mounted on an interface unit 232 .
- a suitable user input such as keypad 236 mounted on an interface unit 232 .
- the rate at which the video is displayed and one or more audio sequences are played in accordance with the present invention is controllable by a program shown in block diagram form in FIG. 3 .
- the program can be encoded on a CD and operated on the operating control program 250 in the CPU of the player 220 .
- the program can be stored on a remote network location that is accessible locally.
- the present invention is adapted and configured to utilize one or more of each video and audio recorded sequences.
- Suitable sequences include those which can be recorded using a POV (Point of View) videotape camera mounted on an athlete's head or vehicle such as a bicycle.
- Each video frame recorded is assigned and has recorded with it a unique frame time stamp value and a duration stamp value for accessing the next frame packet of data upon playback.
- the duration stamp is a constant value, for example, about 8 milliseconds.
- These frame stamp and duration values function to allow a playback apparatus to sequence and time the reproduced display.
- the audio may be interlaced with the video or may be a separate track recording.
- the recorded sequence of video and audio are then digitized and recorded on a video CD along with the control program described below and shown in the Figures herein.
- the basic effect of the control program of the present invention is to control the rate at which the video frame is played and to correlate the playback to the exercise rate of the user on the exercise device 12 that is in communication with the system. Therefore as the exercise rate increases, the frame rate of display increases. This creates the experience for a user that the scenery changes at a rate equivalent, or near equivalent, to the rate at which the scenery would change if the user were, for example, cycling or running at that rate where the video display was captured. Similarly, as the exercise rate of a user decreases, the video displays scenery at a slower and slower rate, until the user stops and the scene displayed stops also. Thus the user achieves a visual sensation similar to that of actually traveling through the scenery shown in the video.
- the process flow begins operation 300 , for example, when the user begins pedaling the bicycle or walking on the treadmill. Thereafter, the program can set, in operation 302 , a cumulative time offset (T os ) to the current clock time of the CPU. This time offset tracks the total difference in time that the program modifies the video sequence due to the exercise rate of the user.
- T os cumulative time offset
- the program next queries, in operation 304 , whether a stop video stream flag is set. However, if the Stop Video Flag is set, as when the user stops pedaling to rest for a period of time or stops running on the treadmill, a control passes to a wait operation 306 . Wait operation 306 can, for example, be a process delay on the order of 10 milliseconds, after which the query in operation 304 would then be repeated. If the Stop Video Stream flag is not set, control passes to operation 308 .
- the current frame time stamp value (T f ) is retrieved and the current frame duration value (T d ) is retrieved from the decompressed stream data in content buffer 452 .
- the Adjustment value (T adj ) is obtained, in operation 110 , from the program sequence shown in FIG. 4 .
- the variable T next is set equal to T f +T d +T adj +T os . This is the clock time at which the next frame should be decompressed into the decompression buffer 452 .
- the query is made as to whether the current CPU clock time is equal to or greater than T next . If the clock time is not greater to T next , then the system continues to wait 306 . If the clock time is greater than T next , then the next video frame is decompressed and added to the decompression buffer 316 in the content buffer block 252 of the player CPU 202 . At this point, the content of the decompression buffer is copied to a frame buffer, which in this case is either frame buffer A or frame buffer B 320 , whichever is pointed to by a pointer. The pointer is adapted and configured to alternate between the two frame buffers.
- control is passed to operation 320 , where display objects such as the optional dashboard indicating the current heart rate, pulse icon and exercise status parameters, are overlaid into the buffer indicated by the pointer.
- display objects such as the optional dashboard indicating the current heart rate, pulse icon and exercise status parameters
- the frame buffer pointer is switched to the other buffer.
- the contents of T adj are added to the T os register so as to keep track of total adjustments to the sequence.
- Control then passes to operation 328 where the program queries whether there are any more video frames in the sequence. If there are none, the program ends in operation 330 . If there are additional frames, control passes again to the wait operation 306 and the above steps are repeated as many times as necessary to achieve the desired output.
- Video reproduction rate thus is modifiable by adding time or subtracting time from a prerecorded video frame duration stamp value.
- the value of T adj changes and thus modifies the effect of T d .
- FIG. 4 describes an example of how T adj can be modified.
- the sequence of operations in FIG. 4 occurs continuously to provide a value of T adj corresponding to a user's exercise rate.
- the manner of corresponding the video stream to a user's exercise rate can be accomplished in a variety of ways and from a plurality of inputs, including a biological parameter measurement device 144 (as shown in FIG. 1B ), or from the rate at which the exercise device is operated by the user, or from a rate at which a user is moving as detected by the device.
- a sequence begins in operation 432 where, for example, the wheel speed input signal from the wheel pickup is fed through the interface unit 142 into the CPU 102 through an input such as keypad 118 .
- the current speed corresponding to miles per hour or kilometers per hour, can be obtained from the raw signal in operation 434 . So, for example, the current speed can be continually updated as long as there is a wheel speed thread from the interface unit 142 .
- validity checks are performed in this operation to ensure that the signal is, in fact, a correct wheel speed signal.
- Control then shifts to operation 444 where Last Speed is set equal to New Speed and control again transfer to operation 432 where another signal from the wheel sensor is awaited. If the Current Speed is equal to zero in operation 438 , control transfer to operation 446 where the Stop Video Stream flag is set and current clock time is saved.
- the Stop Video Stream flag may also be required in operation 304 to cover the situation where the user stops to rest after beginning a sequence. In that instance, the current clock time when this flag is set must be saved because, after the start, in operation 300 , clock time is continuously running. Therefore, if the user stops momentarily, requiring the video sequence to freeze, the duration of the stopped period must be added to the time offset in order to keep the sequence operating properly based on current clock time.
- the sequence illustrated in FIG. 4 is continuous and proceeds whenever there is a signal from the wheel speed monitor input thread from the interface unit 142 . Therefore this program sequence is constantly updating during the exercise activity. In contrast, the sequence illustrated in FIG. 3 operates during the time that a video frame is available to be displayed.
- FIGS. 5 a and 5 b flow diagrams are provided illustrating two versions of an audio portion of a prerecorded sequence.
- the audio data chunks may be in a separate file from the video file or the audio data chunks may be interleaved with the video frame data chunks in the same file.
- the FIG. 5 b flow diagram is for processing audio data chunks which are stored in a separate audio data file on the CD.
- FIG. 5 a provides a flow diagram for play of audio data chunks which are interleaved with the video frame data in the same file. Either case may be used dependent upon variables such as buffer space and storage medium drive speed.
- the audio program code is encoded on the CD as is the video program code described above with reference to FIGS. 3 and 4 .
- the audio stream starts in operation 500 .
- a digital pointer is set to one of at least two audio buffers in operation 502 and control passes to operation 504 where an audio data chunk is retrieved from the decompression content buffer 252 .
- the audio data chunk is then loaded into the buffer pointed to by the audio pointer in operation 506 .
- operation control is passed to operation 510 where the query is made whether the audio stream is complete. If so, control passes to operation 512 and the audio play stream stops.
- This process repeats until there are no more audio data chunks signifying that the audio stream is complete. In the case just described, the audio continues to play, even when the video slows in response to the actions of the user on the exercise device 12 .
- the audio stream control begins in operation 520 .
- a pointer is set to one of at least two audio buffers in operation 522 .
- Control then passes to operation 524 where an audio data chunk associated with the current video frame is retrieved from the decompression content buffer 252 .
- This data chunk is then loaded into the audio buffer pointed to in operation 526 and play of this audio chunk immediately begins in operation 528 .
- control shifts to operation 530 where the stream is queried to determine if the audio stream is complete. If not, the query is made, in operation 532 , whether the next audio data chunk is available.
- the query in operation 532 is whether the next video frame has been called for display. This becomes important when the user is slowing down the video display by reducing his or her exercise rate, e.g. pedaling slower. If the next video frame has not been called, the next audio data chunk will not be available. In this case, operation 532 transfers control back to operation 528 and the current audio data chunk is replayed. Where the audio is wind noise, sounds of the road, or natural background noise in the country, the user will not likely be able to distinguish that the audio is being “looped back”.
- the query in operation 532 will transfer control to operation 534 where the pointer is set to another buffer. Control then transfers back to operation 524 to get another audio data chunk and operations 526 , 528 , 530 , and 532 are repeated until the last of the audio stream is processed. In this case, control is transferred to operation 536 where the audio play is stopped.
- the audio buffers provide a smooth sequencing of audio chunk play.
- a plurality of audio can be played with the video. For example, a first audio can be played at a constant rate independent of the video frame, while a second audio is played at a rate which corresponds to the rate at which the video is played. This facilitates a first audio pitch and tempo remaining a pleasing audio signal, as would be perceived at the location while a second audio pitch changes to correspond to the pace at which footfalls, for example, would occur at the rate of exercise perceived by the user, while a third audio can occur at a rate intended to mimic a training pace or quickening pace of a training partner in response to a differential input by a user or calculated based on user parameters such as age, health and training objectives.
- the audio volume could be made to increase or decrease as the user increases or decreases speed respectively. Therefore looping these audio chunks of wind and road noise back during slow exercise periods as described in FIG. 5 b maintains the perceptive effect of the audio being independent of the video rate of display, yet tying the audio content to the video frames being displayed.
- the audio of, for example, the sounds of footfalls can further be divided into individual sound packets that are played in bursts at a tempo or pace corresponding to the desired pace without altering the rate or speed of audio.
- an audio of a series of, for example, footfalls which includes a footfall followed by an interval of silence before a subsequent footfall (and so on) can be alternately speeded up during the intervals of silence only.
- the prerecorded video may include coded data for setting the exercise device to predetermined resistance values.
- the program would include a control thread which accesses the control data associated with the video frame which sets the resistance. This data would then be translated into setting values which would be transmitted to the servomotor or stepper motor connected to the resistance control such as resistance wheel on the exercise stand.
- the interface unit 132 can be adapted and configured to include a battery, a programmable interrupt controller (PIC) or processor, a biological parameter measurer 144 , such as a heart rate receiver tuned to the transmission frequency of the heart rate transmitter, a series of shift registers, a 10 MegaHertz clock, wheel speed input terminals which mate with the contacts on the exercise machine 12 , and a nine pin output connector which connects the interface unit 132 to a controller keypad 118 .
- the PIC processor can, for example, be an 8 bit device, which processes the incoming tics, or beats from the wheel speed sensor and the ticks from the output of the heart rate receiver.
- the shift registers in the interface unit convert the data from the PIC Processor to 32 bit words for compatibility of communication with a player.
- the interface unit 32 is adapted and configured to collect data from the heart rate and wheel speed inputs and transmits the heart rate and wheel speed data to the player when queried by the main program. Provision may also be included in the interface unit for providing a signal to a stepper motor or servomotor on the exercise device to vary the resistance provided by the resistance roller.
- FIG. 6 a A logic flow diagram of the embedded program in the PIC processor is shown in FIG. 6 a .
- the interface unit processor starts in operation 600 .
- a run time crystal clock (RTCC) is used to run the processor and to measure time durations between input pulses in the PIC processor. This RTCC runs at 10 MHz and counts between zero and 255. The output rolls over at 255. This equates to a rollover time of about a maximum of 2 milliseconds.
- Operation 602 initializes several flags and registers to zero. Specifically, a load pulse flag, a heart beat flag, a heart tic flag, a wheel rotation flag and a wheel tic flag are set to zero.
- a heart count register, a heart store register, a wheel count register, and a wheel store register are set to zero.
- the heart count registers and wheel count registers are used to accumulate time tics between input pulses from the heart rate receiver and the wheel rotation reed switch as will become more apparent below.
- This flag will be set if the program is ready to receive input from the interface unit 32 .
- control transfers to operation 614 where the interface unit 32 output registers are loaded with the contents of the heart store and wheel store registers. These output registers are then immediately read by the operating system through the connection through a user input interface, such as keypad 118 .
- control passes to operation 616 where the query is made whether a heartbeat flag has been set, i.e. a beat has been received by the heart rate receiver. If a beat has been received, control passes to operation 618 where the heart count register contents are transferred to the heart store register. Then, in operation 620 , the heart count register is reset to zero and the heart beat flag is reset in order to sense another heartbeat. Control then proceeds from operation 620 to operation 622 . If no heartbeat has been received in the heart rate receiver, and thus the heart beat flag is not set, operation 616 transfers directly to operation 622 .
- a query is made whether the wheel rotate flag has been set by passage of a wheel magnet past a reed switch. If not, control passes to operation 624 . If the wheel rotate flag is set, control passes to operation 626 where the contents of the wheel count register are moved to the wheel store register. Control then transfers to operation 628 , where the wheel count register is set to zero and the wheel rotate flag is reset in order to sense receipt of another wheel rotation.
- Operation 624 queries whether the heart tic flag is set. If so, control transfers to operation 632 where the heart count register is incremented and the heart tic flag is reset. Control then transfers to operation 630 . If the heart tic flag is not set, operation 624 transfers control directly to operation 630 .
- Operation 630 queries whether the wheel tic flag is set. If so, control transfers to operation 634 where the wheel count register is incremented and the wheel tic flag is reset. Control then passes back to operation 606 . If the wheel tic flag is not set, operation 630 passes directly back to operation 606 .
- the sequence of operations described in FIG. 6 b is continuous.
- the net effect of the sequence is to constantly update the heart count, wheel count, heart store, and wheel store registers as wheel rotations and heart beats are received. This information is passed into the output registers for transmission to the control system whenever the control program requests input which is about 60 times per second. It is to be understood that the above description is exemplary of one embodiment only.
- the pace of the video stream changes with the pace of the footsteps which corresponds to the rate at which a user is exercising as described above.
- the rate of the correlated audio can be set-up to increase as a user increases the speed at which the user performs.
- the pace of the video i.e., the rate at which the video is streamed to the screen, correlates to the pace of, for example, the footsteps or the rate at which a user is cycling on a stationary bike. It has been observed that, for example, runners may find the urge to synchronize their steps to a strong musical beat or to a repetitive sound, such as a footfall. Similarly, cyclists may be urged to press down on the pedal at a rate corresponding to a repetitive sound.
- This urge may motivate the exerciser to perform at the video correlated pace as the speed of the video and the correlated audio increases to correspond to the rate at which the viewing would change if, for example, a runner were running at a particular pace and his or her footfalls were at a particular pace.
- the rate of change of each of the audio tracks is accomplished such that the sounds continue to sound natural but achieves the effect of a Foley artist in making the various audio tracks to correspond to a video.
- the pace of exercise interactively changes with the pace of the footsteps.
- the pace of the video i.e., the rate at which the video is streamed, can change in response to a measured biological parameter.
- a measured parameter may be used to provide feedback that a user should increase his or her speed or decrease his or her speed (e.g., if heart rates are above or below desired levels, the correlated audio can be increased, along with the speed of the machine to increase the heart rate to a desired or target level).
- a user could select a difficulty level and/or or other parameters that would result in a certain speed of footsteps being played. This could be a combination of several parameters, such as in the case where a person might enter their height and a difficulty level of “5”. The program might know that “5” for a tall person is a different foot pace then “5” for a short person.
- a user can select a competition rate wherein, for example, the user performs at a base rate to establish his or her normal training rate. Then, the user can select a pre-defined competitor profile, or a rate of performance improvement, e.g., 10%. In this scenario, the correlated sound will occur at the rate of the competitor profile or the rate of performance improvement while the video can stream at the rate at which the user is actually performing or at the rate of the chosen competitor profile or performance rate improvement.
- a competition rate wherein, for example, the user performs at a base rate to establish his or her normal training rate. Then, the user can select a pre-defined competitor profile, or a rate of performance improvement, e.g., 10%.
- the correlated sound will occur at the rate of the competitor profile or the rate of performance improvement while the video can stream at the rate at which the user is actually performing or at the rate of the chosen competitor profile or performance rate improvement.
- a data processing system for administering course material comprising a computer or server as shown in FIG. 1B .
- the computer can, if desired, be connected to a network of remote stations as shown in FIG. 1C .
- the remote stations could then serve as the data entry points for information to be gathered, for example at a remote class site or by a participant registering for a class on-line.
- Information gathered includes, for example, information about the materials to be presented, the participant, the environment, etc.
- the remote stations can also serve as access points through which people transmit inquiries concerning the materials presented or exercise programs and for responding to those inquiries. Additionally, each station can store a record of each participant's details, including performance information for each class, and periodically send this information to the central computer for processing.
- the system and method can be adapted to work in conjunction with the invention disclosed in U.S. Pat. No. 6,142,913 for “Dynamic Real Time Exercise Video Apparatus and Method” (Ewert).
- the system can be adapted to incorporate varying video playback rate adjusts the frame rate of motion video content being replayed on a display device based on the intensity at which a participant exerts themselves.
- This system supports the illusion that the participant is actually traveling through the terrain being displayed.
- a result of the use of this system is that a participant who exercises at a higher intensity will view more footage than will a participant who exercises at a lower intensity, as the frame rate speed will be higher and more frames of the footage will be viewed.
Abstract
Disclosed are systems and methods for detecting the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience. The system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.
Description
- This application claims the benefit of U.S. Provisional Patent Application No. 61/110,559, filed Nov. 1, 2008, entitled “System and Method for Optimizing One or More Audio Tracks to a Video Stream,” by John Hajime Ford, and U.S. Provisional Patent Application No. 61/248,151 filed Oct. 2, 2009, entitled “System and Method for Optimizing One or More Audio Tracks to a Video Stream,” by John Hajime Ford, which applications are incorporated herein by reference.
- The results from the 1999-2002 National Health and Nutrition Examination Survey (NHANES), using measured heights and weights, indicate that an estimated 65 percent of U.S. adults are either overweight or obese. The breakdown indicates that an estimated 30% are obese (which is defined as a Body Mass Index of 30 or higher), while 35% are overweight. Body Mass Index (“BMI”) is calculated by dividing a person's body weight in kilograms by their height in meters squared. In addition to these statistics for adults, an estimated 15.5 percent of adolescents (
ages 12 to 19) and 15.3 percent of children (ages 6 to 11) are estimated to be obese in the United States. - Although it seems counterintuitive, perhaps as a result of these alarming statistics, the United States is currently experiencing a boom in the health club industry. The number of health clubs in the US has climbed to 26,830 from just 15,372 in the year 2000—a 75% increase. An estimated 41 million Americans belong to health clubs and that number is expected to increase to over 50 million by the year 2010. The 2004 US health club industry comprised a 14.8 billion dollar market, more than double the 7.3 billion dollar market seen just one decade prior. These market changes can be correlated to the American obesity crisis, an appearance focused culture, and the increasing health awareness of the population, and are not expected to slow or stop in the foreseeable future.
- As reported by the Centers for Disease Control and Prevention (www.cdc.gov), physical activity can bring many health benefits. In fact, it has been found that people who enjoy participating in moderate intensity or vigorous intensity physical activity on a regular basis lower their risk of developing coronary heart disease, stroke, non-insulin dependent (type 2) diabetes mellitus, high blood pressure, and colon cancer by 30-60% (US DHHS, 1996). Additionally, active people have lower premature death rates than people who are the least active. Even among frail and older people, mobility can be improved through physical activity. Butler, R N, et al., “Physical Fitness: Benefits of Exercising for the Older Patient” Geriatrics 53(10): 46-52 (1998). Researchers have even found a correlation between walking and a lower incidence of Alzheimers.
- One trend has been the development of dozens of completely new types of group fitness that emerge each year. These fitness classes are typically designed to combine two popular forms of fitness or activities into one class. For example, YogaSpin, a combination of Yoga and group stationary cycling, Extreme Boot Camp, Cheerleading School, Cycling Karaoke, and countless variations based on the popular Cardio Kickboxing and Pilates exercise platforms.
- Another trend that has been noted in the industry is that when people work out with another person, their effort level tends to increase as they try to match the effort of their work-out partner. That benefit is not realized by persons working out alone, for example, on a treadmill.
- A solution is needed to provide a mechanism for people working out alone to attain a training benefit of working out with a work-out partner.
- An aspect of the invention provides a system that detects the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience. The system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.
- An aspect of the invention is directed to an exercise system. The exercise system comprises: a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmitting the input to the central processing unit; a prerecorded video frame sequence encoded onto a storage medium in communication with and playable on the video playing device; a video monitor in communication with the video playing device for displaying the prerecorded video frame sequence reproduced by the video playing device; a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the monitor in response to the one or more inputs from the user wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed; two or more audio rate controllers configured to vary a rate of delivery of two or more audio files in response to a signal from user interface rate detector wherein the rate of delivery of the two or more audio files are delivered asynchronous to each other; and an exercise device. In some aspects, the video frame rate controller is adapted and configured to comprise a computer program stored on a storage medium with the prerecorded video frame sequence. In such configurations, the program is operable, for example, with the central processing unit in the video playing device when the prerecorded video sequence is played to modify the frame display rate in response to the signal from the user interface rate detector. Additionally, the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. Suitable exercise devices include, for example, a bicycle, a stair stepper, and an elliptical trainer.
- Another aspect of the invention is directed to an apparatus for engaging a user of an exercise device interactively in viewing a video frame sequence of an activity on a video monitor. The apparatus comprises a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor; a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmitting a signal proportional to the rate of exercise; a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed; and one or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played. Suitable exercise devices include, for example, a bicycle, a stair stepper and an elliptical trainer. Moreover, in some configurations, the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. Additionally, the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
- Still other aspects of the invention are directed to a method of controlling a video frame sequence display rate of a prerecorded video playback sequence in a device in response to an external signal, in which each video frame has a unique frame time stamp and a duration time stamp indicating the time between successive frames. The method typically comprises the steps of: a) accessing the duration time stamp for a current video frame; b) determining from the external signal an adjustment value for changing the display rate; c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp; d) displaying the next frame when the modified duration time has passed; e) accessing the duration time stamp for a current audio data packet; f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet; g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; h) playing the next audio data packet when the modified duration time has passed; and i) repeating steps a through d for each subsequent video frame and steps e through h for each subsequent audio data packet. The accessing step can further comprise the steps of: i) setting a time offset to current clock time; ii) displaying a current video frame; and iii) accessing a frame time stamp and a duration time stamp for the current video frame. Moreover, the step of determining can further comprise the step of comparing the external signal to predetermined criteria to determine the adjustment value. Additionally, as will be appreciated by those skilled in the art, the external signal is a user variable exercise rate signal. In other embodiments, the step of displaying further comprises the steps of: i) adding the modified duration value to the time offset to obtain a next frame time; and ii) displaying the next frame when clock time exceeds the next frame time.
- All publications, patents and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent or patent application was specifically and individually indicated to be incorporated by reference.
- The novel features of the invention are set forth with particularity in the appended claims. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which:
-
FIG. 1A-C are overviews of a system having a server, a CPU, a monitor, storage media, input devices, etc. which can be used by a user; -
FIG. 2 is block diagram of the apparatus in accordance with the invention shownFIG. 1 b; -
FIG. 3 is a flow diagram of the video frame rate control program encoded on the video disk; -
FIG. 4 is a flow diagram of a adjustment factor subroutine; -
FIGS. 5A-B are is flow diagrams of adjustment factor subroutines; and -
FIGS. 6A-B are logic flow diagrams of an embedded processor in an interface unit. - An aspect of the invention provides a video stream that has one or more audio tracks associated with the video stream, one of which correlates to the sounds of, for example footfalls and which is variable in response to input and which can be used, for example, as a training guide to encourage people to increase their exertion rate as they perceive competing against another person. A second audio track is provided that can correspond to normal ambient-type noise that might be heard by a user in the environment represented by the video stream, music or whatever background noise a user selects. Changes to the video rate correlated audio can be in response to user input or in response to a sensing of a user parameter. In order to achieve the objectives of the invention a variety of components are required: computer systems, components and networks; exercise devices; and software which transforms input from the exercise device and/or computer system into a video and audio output which is delivered to a user.
- The systems and methods disclosed herein can be achieved using a variety of computer systems, components and networks which are either incorporated into the exercise devices described below or are in communication with the devices.
-
FIG. 1A is a block diagram showing a representative example logic device through which reviewing, manipulating, or analyzing information relating to the present invention can be achieved. Such data can be in relation to exercise, one or more physiological parameters, exertion, or any other suitable parameter desired to be measured of a subject. - A computer system (or digital device) 100 that may be understood as a logical apparatus that can read instructions from
media 111 and/ornetwork port 105, which can optionally be connected toserver 109 having fixedmedia 112. Thecomputer system 100 can also be connected to the Internet or an intranet. The system includesCPU 101, disk drives 103, optional input devices, illustrated askeyboard 115 and/ormouse 116 andoptional monitor 107. Data communication can be achieved through the indicated communication medium to aserver 109 at a local or a remote location. The communication medium can include any means of transmitting and/or receiving data. For example, the communication medium can be a network connection, a wireless connection or an internet connection. It is envisioned that data relating to the present invention can be transmitted over such networks or connections. The computer system can be adapted to communicate with an participant parameter monitor and/or an apparatus on which a participant is engaged in exercise. Additionally, the components of these logic devices can be incorporated, wholly or partially, into an exercise device, as will be appreciated by those skilled in the art. - A user or
participant 122 can optionally also be connected to a variety of monitoring devices, as described below. The monitoring devices can further be adapted and configured to interact with the system. As will be appreciated by those skilled in the art, the computer system, or digital device, 100 can be any suitable device. Other suitable devices capable of being adapted for use in the system described herein include, for example, video iPod (Apple Corp., Cupertino Calif.), or a portable DVD player or DVD Walkman® (Sony Corporation). Such devices would be suitable in a variety of situations. - In an embodiment, a computer-readable medium includes a medium suitable for storing, analyzing and transmitting target information of interest, such as that information discussed in more detail below. The medium can include a result regarding a disease condition or state of a subject, wherein such a result is derived using the methods described herein.
-
FIG. 1B depicts anotherexemplary computing system 100. Thecomputing system 100 is capable of executing a variety ofcomputing applications 138, including computing applications, a computing applet, a computing program, or other instructions for operating oncomputing system 100 to perform at least one function, operation, and/or procedure.Computing system 100 may be controlled by computer readable instructions, which may be in the form of software. The computer readable instructions can contain instructions forcomputing system 100 for storing and accessing the computer readable instructions themselves. Such software may be executed withinCPU 102 to cause thecomputing system 100 to perform desired functions. In many known computer servers, workstations andpersonal computers CPU 102 is implemented by micro-electronic chips CPUs called microprocessors. Optionally, a co-processor, distinct from themain CPU 102, can be provided that performs additional functions or assists theCPU 102. TheCPU 102 may be connected to co-processor through an interconnect. One common type of coprocessor is the floating-point coprocessor, also called a numeric or math coprocessor, which is designed to perform numeric calculations faster and better than the general-purpose CPU 102. - In operation, the
CPU 102 fetches, decodes, and executes instructions, and transfers information to and from other resources via the computer's main data-transfer path,system bus 140. Such a system bus connects the components in thecomputing system 100 and defines the medium for data exchange. Memory devices coupled to thesystem bus 140 include random access memory (RAM) 124 and read only memory (ROM) 126. Such memories include circuitry that allows information to be stored and retrieved. TheROMs 126 generally contain stored data that cannot be modified. Data stored in theRAM 124 can be read or changed byCPU 102 or other hardware devices. Access to theRAM 124 and/orROM 126 may be controlled bymemory controller 120. Thememory controller 120 may provide an address translation function that translates virtual addresses into physical addresses as instructions are executed. - In addition, the
computing system 100 can contain peripherals controller 128 responsible for communicating instructions from theCPU 102 to peripherals, such as,printer 142,keyboard 118,mouse 116, anddata storage drive 143.Display 108, which is controlled by adisplay controller 134, is used to display visual output generated by thecomputing system 100. Such visual output may include text, graphics, animated graphics, and video. Thedisplay controller 134 includes electronic components required to generate a video signal that is sent to display 108. Further, thecomputing system 100 can contain network adaptor 136 which may be used to connect thecomputing system 100 to anexternal communications network 132. -
Computing system 100, described above, can be deployed as part of acomputer network 150 or can be wholly or partially incorporated into a suitable exercise device, such as those described below. In general, the above description for computing environments applies to both server computers and client computers deployed in a network environment.FIG. 1C illustrates an exemplary illustrativenetworked computing environment 100, with a server in communication with client computers via acommunications network 150. As shown inFIG. 1B ,server 110 may be interconnected via a communications network 150 (which may be either of, or a combination of a fixed-wire or wireless LAN, WAN, intranet, extranet, peer-to-peer network, virtual private network, the Internet, or other communications network) with a number of client computing environments such as tabletpersonal computer 102,mobile telephone 104,telephone 106, personaldigital assistant 108, and apersonal computer 112. Additionally, anexercise input device 12 is provided in communication with the network environment. In a network environment in which thecommunications network 150 is the Internet, for example,server 110 can be dedicated computing environment servers operable to process and communicate data to and from client computing environments via any of a number of known protocols, such as, hypertext transfer protocol (HTTP), file transfer protocol (FTP), simple object access protocol (SOAP), or wireless application protocol (WAP). Additionally,networked computing environment 100 can utilize various data security protocols such as secured socket layer (SSL) or pretty good privacy (PGP). Each client computing environment can be equipped withoperating system 138 operable to support one or more computing applications, such as a web browser (not shown), or other graphical user interface (not shown), or a mobile desktop environment (not shown) to gain access toserver computing environment 100. Anexercise device 12 is in communication with one or more devices shown in thenetwork 150. Theexercise device 12 can be a treadmill (as illustrated), or any other suitable device. - In operation, a user (not shown) may interact with a computing application running on a client computing environment to obtain desired data and/or computing applications as the user is exercising using the
exercise device 12 adapted and configured to communicate with the computing application and/or interact with abiological parameter measurer 144 adapted and configured to communicate with the computing application via, for example, aninterface unit 142. The data and/or computing applications may be stored onserver computing environment 100 and communicated to cooperating users through client computing environments overexemplary communications network 150. A participating user may request access to specific data and applications housed in whole or in part onserver computing environment 100. These data may be communicated between client computing environments and server computing environments for processing and storage.Server computing environment 100 may host computing applications, processes and applets for the generation, authentication, encryption, and communication data and applications and may cooperate with other server computing environments (not shown), third party service providers (not shown), network attached storage (NAS) and storage area networks (SAN) to realize application/data transactions. - Biological
parameter measurement devices 144 include, for example, devices capable of measuring a biologic function, such as heart rate, blood pressure, blood sugar or glucose levels, body temperature, tissue oxygenation, volume of O2 (VO2), pulse oximeter measurement (Sp O2), electroencephalogram measurement (EEG), O2 saturation, or any other measurement that can be obtained from the participant as would be appreciated by those skilled in the art. See, for example, U.S. Patent Publications U.S. 2005/0166373 entitled Case Structure for Sensor Structure Attachable to and Detachable From a Shoe (Saasko et al.), U.S. 2005/0135039 entitled Electric Circuit and Transmission Method for Telemetric Transmission (Klemetti), U.S. 2005/0130802 entitled Arrangement, Method and Computer Program for Determining Physical Activity Level of Human Beings (Kinnunen), U.S. 2005/0111307 entitled Electronic Wrist Device (Saaski et al.), U.S. 2005/0111306 entitled Portable Wrist-Worn Personal Electronic Device (Saaski et al.), U.S. 2005/0017850 entitled Mechanical Measuring Device and a Measuring Method (Nissala), U.S. 2005/0004436 entitled Method and Device for Weight Management of Humans (Nissala), U.S. 2004/0220738 entitled Portable Personal Data Processing Device (Nissala), and U.S. 2004/0220485 entitled Method and Device for Measuring Heart Rate, and for Manufacturing the Device (Rytky). U.S. Pat. Nos. 6,832,109 entitled Wrist-Worn Device for Displaying and Setting Heart Rate Parameters (Nissala); 6,754,517 entitled Apparatus for Measuring Electrocardiograph Signal (Nissila); 6,714,812 entitled Method of Performing Operating Settings in Heart Rate Measurement Arrangement, and Heart Rate Measurement Arrangement (Karjalainen); 6,687,535 entitled Controlling of Fitness Exercise (Hautala et al.); 6,605,044 entitled Caloric Exercise Monitor (Bimbaum); 6,584,344 entitled Method and Apparatus for Measuring Heart Rate (Hannula); 6,554,773 entitled Method and Arrangement for Blood Pressure Measurement (Nissila); 6,553,247 entitled Electrode Belt of Heart Rate Monitor (Rytky); 6,540,686 entitled Measurement Relating to Human Body (Heikkila et al.); 6,443,904 entitled Determination of Stress Level of Fitness Exercise (Nissila); 6,954,661 entitled Blood Sugar Measuring Apparatus (Cho et al.); 6,746,415 entitled Method of Blood Constituent Monitoring Using Improved Disposable Eletrocorporeal Conduit (Steuer et al.); 5,251,632 entitled Tissue Oxygen Measuring System (Delpy); 4,368,740 entitled Physiologic Analyzer (Binder); 6,912,413 entitled Pulse Oximeter (Rantala et al.); 6,879,850 entitled Pulse Oximeter with Motion Detector (Kimball); 6,829,496 entitled Blood Component Measurement Apparatus (Nagai et al.); 6,950,697 entitled Electroencephalagram Acquisition Method and System (Jordan); 6,829,502 entitled Brain Response Monitoring Apparatus and Method (Hong et al.); 6,510,340 entitled Method and Apparatus for Encephalography (Jordan); 6,909,912 entitled Non-Invasive Perfusion Monitor and System, Specially Configured Oximeter Probes, Methods of Using Same, and Covers for Probes (Melker); and 6,850,789 entitled Combination SPO2/temperature Measuring Apparatus (Scheitzer Jr., et al.). Parameter measurement devices also include, for example, a participant monitoring their pulse manually by placing a finger, for example, on the carotid artery or near the wrist to determine the number of beats per minute. See also, U.S. Pat. No. 5,170,780 to Rosenfeld for Method of Credibility Assessment Based on Feedback-Elicited P3 Responses of Brain and European Patent Publication EP 1510175 A1 to Kostucki for Exercise Manager Program. - The systems and methods disclosed herein can be achieved using a variety of exercise devices which are modified to provide information to one or more computer systems, components and networks on which software is provided which is adapted and configured to transform one or more inputs, e.g., from an exercise device, parameter sensor, and/or computer system into a video and audio output which is delivered to a user.
- As will be appreciated by those skilled in the art, footfalls or movement of a user can be sensed in a variety of ways. The mechanism for sensing footfalls or movement of a user will vary by machine type. For the three major types of fitness machines, treadmills, elliptical machines, and stair steppers, there may not necessarily be an actual footfall (as in the case with elliptical machines). Additionally, there are also various hybrid machines which are a mix of these three main types of machines. The elliptical machines and stair steppers do not have a real footfall to sense, as the user's motion in reality is a fluid elliptical pattern in the case of elliptical machines, and a repetitive vertical (but fluid with no actual foot impact) motion on a stepper.
- Treadmills: One mechanism that can be used would be to sense the user via, for example, the extra force exerted downward on the treadmill, or certain treadmill components, by the footfall of the user. A force sensor may be a piezoelectric device that converts force directly into a voltage differential, which in turn can be correlated to a controller to provide a mechanism for providing sensory feedback for the user. Other force sensors that produce electric signals as an output would be possible, including for example capacitative force sensors, optical-electric strain gauges, and others. Another mechanism for sensing footfalls with a treadmill includes, for example, one or more of: providing ammeters to detect increased load on the treadmill motor, tension sensors (electromagnetic or even piezoelectric) to detect sudden changes in belt tension, providing acoustic pickup to sense the sound of the footfall (a simple condenser microphone, electret microphone, dynamic or inductance type microphone), providing user-worn sensors such as accelerometers to detect the motion of the users feet or body (and which can communicate—wired or wirelessly—with the system), providing optical sensors to detect the position of the users' body—either with an imaging system or through beam-interruption detection (for example, with infrared lasers and photoelectric sensors, or with a passive imaging system that can recognize the user's body position), providing a sensor worn by the user that is a foot/leg position sensor such as the that used in gaming systems such as the Nintendo Wii®, providing a charge sensor that detects contact by a user (similar to touchscreen technology), providing a sensor that detects variances in the speed of the treadmill belt (which will slow slightly on foot impact). See, for example, U.S. Pat. No. 7,507,187 to Dyer et al. for Parameter Sensing System for an Exercise Device; and U.S. Pat. No. 6,336,891 to Fedrigon et al. for Interactive Exercise Pad and System. Treadmills are described more fully in, for example, U.S. Pat. Nos. 7,575,537 entitled Dual Direction Exercise Treadmill for Simulating a Dragging or Pulling Action with a User Adjustable Constant Static Weight Resistance; 7,563,203 entitled Treadmill with Cushion Assembly; and 7,367,926 entitled Treadmill with Moveable Console.
- Elliptical Trainers: In one aspect, the elliptical could be configured to enable a “virtual footfall” to be sensed on the elliptical, or the moment at which a footfall sound would create the most effective representation of running or walking, is a position sensor that triggers when, for example, an elliptical pad is at its forward-most point in its elliptical movement pattern, on its down stroke, or reaches its lowest point. Alternately, speed sensors could determine when the forward motion of a stride reaches zero, which would also correspond to the furthest forward part of the stride but would accommodate inconsistent stride lengths. Elliptical trainers are described more fully in, for example, U.S. Pat. Nos. 6,436,007 entitled Elliptical Exercise Machine with Adjustment; 6,361,476 entitled Variable Stride Elliptical Exercise Apparatus; and 6,077,196 entitled Adjustable Elliptical Exercise Apparatus.
- Variants could include a differential position sensor, sensing the point at which the pads are furthest apart, which is the same as the point at which either pad is furthest forward. Other ways to determine footfall on an elliptical include, for example, one or more of providing a speed sensor that senses when the elliptical pad's horizontal speed is zero (it is exactly at the moment in the elliptical movement pattern in which it is moving neither forward nor back). Speed sensor could also detect when the foot pad's vertical acceleration is highest; providing a weight/force/pressure sensor that detects the moment at which the greatest weight/force/pressure is being applied to the elliptical pad, which will correspond with the beginning of downward motion on the front most pad and thus the virtual footfall; providing a wireless/wired worn-sensor methods as mentioned above; providing optical/audio/infrared/etc sensors as mentioned above in treadmill section; or using the above systems to detect speed as it approaches zero.
- Stair Stepper Exercise Devices: One mechanism to detect footfall or an equivalent of footfall on a stepper would be, for example, a position sensor that detects the point at which one of the step pads/levers is at or begins descending from its highest point. Steppers frequently have traditional step counters built-in and these could also be piggybacked upon. All of the methods mentioned above for ellipticals could be adjusted to work with steppers with a vertical fluid motion rather than an elliptical motion, including methods that detect the pad's speed approaching zero. The trigger point for the footfall would be the point at which either footpad begins to descend from its highest point. This is also the point at which the most force/pressure/weight is on the footpad and when the footpad begins downward acceleration. Stair stepping devices are described more fully in, for example, U.S. Pat. Nos. 7,153,238 entitled Stairclimber Apparatus Pedal Mechanism; and 5,399,134 entitled Stair Climbing Exercise Apparatus.
- Hybrid Exercise Devices: Combinations or variants of the methods above could be used on hybrid machines to equal effect.
- In this system, playback of one or more audio media files is triggered by one or more of the sensors described above. A signal generated by the sensor is detected by the media playing device, which then plays an appropriate media file. In addition to audio media files, visual signals and/or media files might be generated to correspond to the audio playback (for example a graphical shoe that blinks on the bottom portion of the screen each time the footfall is sensed).
- Latency, or lag between the time at which a footfall is sensed and the time at which the audio file playback is initiated, can greatly diminish the effectiveness/enjoyment/motivation of the experience. Latency, even measured in amounts as small as tens of milliseconds, can alter the illusion created by the product of a user's actual footfalls. One method of addressing latency is to use software/system elements to make the playback of audio files predictive, rather than timed to correspond with specific occurrences of actual footfalls. One variant of this method would be to: characterize the system latency through product testing, determine how much latency exists for each machine through testing and then, during the exercise session, determine the cadence of the user, such as by using the sensors sensing the time between a plurality of footfalls and using this information to create an average footfall timing pattern. Thereafter begin playing the footfall audio files in accordance with the rolling average time between steps generated by the above.
- Apply the known system latency determined through
step 1 of the method described above to advance the timing of the audio file playback by an amount equal to the system latency. Then allow the user to use any number of possible input devices, such as buttons, levers, touch screen elements, etc, to adjust the timing of the predictive audio playback up or down by small increments to adjust the latency correction as needed. - Another variant of this method would be to not predict the moment associated with the actual footfall, but to use any number of the sensor methods above to sense a moment that precedes the moment of actual footfall by a fixed or predictable amount of time. Thus the signal to play the footfall audio file would be generated in advance, and taking known system latency into account, as in the first variant, the playback could be timed to match the actual moment of footfall.
- Another variant of this method might be to “cover up” the latency to some extent by playing an audio file that “fades up” or increases in volume throughout playback. This could lead the user to believe that the audio file is timed correctly, but just happens to be initially inaudible because of the nature of the sound.
- To create an effective virtual experience, the audio files played back by the footfall triggers could be configured to match the sounds of real footfalls pre-recorded on terrain similar to that shown in a video media presentation on the machine's display. The footfall audio files could thus vary throughout the course of a virtual exercise experience based on the various types of terrain being displayed. The characteristics of the audio file playback could be altered to enhance the experience in several ways:
- The volume of the footfall audio file playback, or some portion of it, could be adjusted interactively based on movement speed or other exercise parameters, such as to represent louder footsteps when running faster.
- The length or amount of the total footfall audio actually played back could be interactively adjusted based on movement speed or other exercise parameters, such as to represent quicker, lighter steps when running faster. This could occur by either cutting off playback (or combining cut-off with a fade-out of volume) or by speeding up playback beyond the files original speed to achieve shorter playback of the entire audio file.
- Standard stereo audio playback functionality could be used to pan footfall audio playback to the right or left speakers in the audio system alternately to more accurately represent the virtual experience by representing the right or left footstep.
- This raises issues of sensing the left/right footstep, rather than footsteps in general. In the case of steppers and ellipticals, this is a simple task, as the footpads are independent of one another and any of the discussed sensing methods can easily be adjusted to sense the footfall of either the left or right pad. In the case of the treadmill, the belt is a solid single element, and sensing either the left or right is more challenging. There are however methods that could do so, such as via multiple pressure/weight/force sensors that are positioned on different sides of the belt, differential tension/drag sensor that is capable of detecting greater tension on one side of the belt, other possible methods.
- The specific audio file played could be varied based on an exercise parameter, such as speed, incline, or resistance. The sound of an actual footfall will be different depending on whether the person generating that footfall is moving fast or slow, or over flat or steep terrain, for example. Thus footfalls pre-recorded on the same type of terrain might be played with different characteristics to adjust for this as noted above, and/OR different pre-recorded footfalls might be played that more accurately represent the exercisers parameters over the same terrain. For example, there could be a sound for fast movement over gravel, another file for slow movement over gravel, and yet another for movement over steep gravel.
- Alternatively, when a series of audio footfalls are played back to exercisers, many exercisers experience an instinctual motivation to match the sounds of these footfalls with their actual steps. Thus a motivational/coaching system using the audio techniques described herein could be greatly enhanced through the use of programmed footfall patterns.
- In one implementation of this system, pre-recorded footfalls with varying characteristics to represent varying terrain or exercise parameters as described above, could be played independently of the activity of the exerciser, in a pre-determined pattern which is known to support the motivation of the exerciser.
- The timing of these footfalls could be adjusted by the user themselves, or by the program, based on the program itself or the program in conjunction with information input by or detected from the user (such as desired difficulty level, height, age, heart rate, or other parameters).
- The timing of the footfalls could be manually adjustable by the user through standard input devices such as buttons, touch screen elements, etc.
-
FIG. 2 is a block diagram of an apparatus in accordance with the invention shown inFIG. 1 . Theapparatus 210 includes theexercise machine 12 connected to aninterface unit 236 which is in turn connects to theCPU 202 of a player. In one configuration a prerecordeddata storage medium 248, such as a compact laser disc (CD), is inserted into aplayer 220. This CD contains media data including a set of digitized video frames and audio data packets and an encoded program which modifies theplayer control program 250. In other configurations, the pre-recorded data is contained on a storage medium which is streamed to a local device via the Internet or an intranet. - For purposes of illustrates, it will be appreciated that the
CPU 202 includes acontrol program 250, acontent buffer 252 which decodes and decompresses the data stream read from, for example, theCD 248, a dashboarddisplay overlay generator 254, and a set of two ormore display buffers player 220 also optionally includes inputs for signals receivable from, for example, aremote system CPUs 260. - Each CD can be configured to include a program which manipulates the
control program 250 to manipulate the rates at which the audio visual are displayed. - Additional displays, such as real time, or near real time, exercise inputs from an
interface unit 232 such as speed, cadence, total distance traveled, lap distance, calories burned, time elapsed, time remaining, and the like can be provided. Moreover, these parameters can be calculated and displayed on, for example, a ‘dashboard’ overlay on thevisual monitor 218. Such parameters can be generated inoverlay block 254 and fed to the display buffers 256 and 258. The overall control of the video sequences, and the start/stop of the exercise overlay program can be manipulated via a suitable user input, such askeypad 236 mounted on aninterface unit 232. - The rate at which the video is displayed and one or more audio sequences are played in accordance with the present invention is controllable by a program shown in block diagram form in
FIG. 3 . As will be appreciated by those skilled in the art, the program can be encoded on a CD and operated on theoperating control program 250 in the CPU of theplayer 220. Alternatively, the program can be stored on a remote network location that is accessible locally. - The present invention is adapted and configured to utilize one or more of each video and audio recorded sequences. Suitable sequences include those which can be recorded using a POV (Point of View) videotape camera mounted on an athlete's head or vehicle such as a bicycle. Each video frame recorded is assigned and has recorded with it a unique frame time stamp value and a duration stamp value for accessing the next frame packet of data upon playback. Typically, in real time recording, the duration stamp is a constant value, for example, about 8 milliseconds. These frame stamp and duration values function to allow a playback apparatus to sequence and time the reproduced display. The audio may be interlaced with the video or may be a separate track recording. The recorded sequence of video and audio are then digitized and recorded on a video CD along with the control program described below and shown in the Figures herein.
- The basic effect of the control program of the present invention is to control the rate at which the video frame is played and to correlate the playback to the exercise rate of the user on the
exercise device 12 that is in communication with the system. Therefore as the exercise rate increases, the frame rate of display increases. This creates the experience for a user that the scenery changes at a rate equivalent, or near equivalent, to the rate at which the scenery would change if the user were, for example, cycling or running at that rate where the video display was captured. Similarly, as the exercise rate of a user decreases, the video displays scenery at a slower and slower rate, until the user stops and the scene displayed stops also. Thus the user achieves a visual sensation similar to that of actually traveling through the scenery shown in the video. - The process flow begins
operation 300, for example, when the user begins pedaling the bicycle or walking on the treadmill. Thereafter, the program can set, inoperation 302, a cumulative time offset (Tos) to the current clock time of the CPU. This time offset tracks the total difference in time that the program modifies the video sequence due to the exercise rate of the user. - The program next queries, in
operation 304, whether a stop video stream flag is set. However, if the Stop Video Flag is set, as when the user stops pedaling to rest for a period of time or stops running on the treadmill, a control passes to await operation 306. Waitoperation 306 can, for example, be a process delay on the order of 10 milliseconds, after which the query inoperation 304 would then be repeated. If the Stop Video Stream flag is not set, control passes tooperation 308. - In
operation 308, the current frame time stamp value (Tf) is retrieved and the current frame duration value (Td) is retrieved from the decompressed stream data in content buffer 452. Then the Adjustment value (Tadj) is obtained, inoperation 110, from the program sequence shown inFIG. 4 . Inoperation 312, the variable Tnext is set equal to Tf+Td+Tadj+Tos. This is the clock time at which the next frame should be decompressed into the decompression buffer 452. - In operation 314, the query is made as to whether the current CPU clock time is equal to or greater than Tnext. If the clock time is not greater to Tnext, then the system continues to wait 306. If the clock time is greater than Tnext, then the next video frame is decompressed and added to the
decompression buffer 316 in the content buffer block 252 of theplayer CPU 202. At this point, the content of the decompression buffer is copied to a frame buffer, which in this case is either frame buffer A orframe buffer B 320, whichever is pointed to by a pointer. The pointer is adapted and configured to alternate between the two frame buffers. - As soon as the decompression buffer is copied to the pointed to
frame buffer 318, control is passed tooperation 320, where display objects such as the optional dashboard indicating the current heart rate, pulse icon and exercise status parameters, are overlaid into the buffer indicated by the pointer. Once the frame buffer contents are overlaid, control shifts tooperation 322 and the contents of the frame buffer pointed to is sent to the video display or television set. - In
operation 324, the frame buffer pointer is switched to the other buffer. Inoperation 326, the contents of Tadj are added to the Tos register so as to keep track of total adjustments to the sequence. Control then passes tooperation 328 where the program queries whether there are any more video frames in the sequence. If there are none, the program ends inoperation 330. If there are additional frames, control passes again to thewait operation 306 and the above steps are repeated as many times as necessary to achieve the desired output. - Video reproduction rate thus is modifiable by adding time or subtracting time from a prerecorded video frame duration stamp value. In other words, the value of Tadj changes and thus modifies the effect of Td.
FIG. 4 describes an example of how Tadj can be modified. For example, the sequence of operations inFIG. 4 occurs continuously to provide a value of Tadj corresponding to a user's exercise rate. As will be appreciated from the examples below, the manner of corresponding the video stream to a user's exercise rate can be accomplished in a variety of ways and from a plurality of inputs, including a biological parameter measurement device 144 (as shown inFIG. 1B ), or from the rate at which the exercise device is operated by the user, or from a rate at which a user is moving as detected by the device. - By way of an illustrative example, a sequence begins in
operation 432 where, for example, the wheel speed input signal from the wheel pickup is fed through theinterface unit 142 into theCPU 102 through an input such askeypad 118. The current speed, corresponding to miles per hour or kilometers per hour, can be obtained from the raw signal inoperation 434. So, for example, the current speed can be continually updated as long as there is a wheel speed thread from theinterface unit 142. In addition, validity checks are performed in this operation to ensure that the signal is, in fact, a correct wheel speed signal. - Control then shifts to
operation 436 where a query is made whether current speed equals the last speed. If so, control returns tooperation 432 for another input from wheel speed. If not, the query is made inoperation 438 whether current speed is equal to zero. If not, control transfers tooperation 440 where the query is made whether the Stop Video Flag is set. If this flag is not set, then control passes tooperation 442 where the video adjust factor, Tadj is set to a table value corresponding to the current speed. Values can be empirically determined to give the appearance to the user of smooth transitions between frames and may be different for different operating systems and different video player machine speeds. - Control then shifts to
operation 444 where Last Speed is set equal to New Speed and control again transfer tooperation 432 where another signal from the wheel sensor is awaited. If the Current Speed is equal to zero inoperation 438, control transfer tooperation 446 where the Stop Video Stream flag is set and current clock time is saved. The Stop Video Stream flag may also be required inoperation 304 to cover the situation where the user stops to rest after beginning a sequence. In that instance, the current clock time when this flag is set must be saved because, after the start, inoperation 300, clock time is continuously running. Therefore, if the user stops momentarily, requiring the video sequence to freeze, the duration of the stopped period must be added to the time offset in order to keep the sequence operating properly based on current clock time. - When the user again using the device by, for example, pedaling, a signal will be produced in
operation 432. Control then sequences throughoperations operations 440, the answer is “yes” to the query whether the Stop Video Flag is set Control then transfer tooperation 448 resets the Stop Video Flag and adds to Tos the elapsed time between the current clock time at flag reset and the clock time saved when the Stop Video Stream flag was previously set. This addition to Tos accounts for the lapse while the user was idle. Control then transfers again tooperation 442 where the video adjust factor T.sub.adj is appropriately set as described above. - The sequence illustrated in
FIG. 4 is continuous and proceeds whenever there is a signal from the wheel speed monitor input thread from theinterface unit 142. Therefore this program sequence is constantly updating during the exercise activity. In contrast, the sequence illustrated inFIG. 3 operates during the time that a video frame is available to be displayed. - Turning now to
FIGS. 5 a and 5 b, flow diagrams are provided illustrating two versions of an audio portion of a prerecorded sequence. There are basically two ways in which the audio data is encoded on the video compact disc. The audio data chunks may be in a separate file from the video file or the audio data chunks may be interleaved with the video frame data chunks in the same file. TheFIG. 5 b flow diagram is for processing audio data chunks which are stored in a separate audio data file on the CD.FIG. 5 a provides a flow diagram for play of audio data chunks which are interleaved with the video frame data in the same file. Either case may be used dependent upon variables such as buffer space and storage medium drive speed. The audio program code is encoded on the CD as is the video program code described above with reference toFIGS. 3 and 4 . - Referring now to
FIG. 5 a, when the video stream starts, the audio stream starts inoperation 500. A digital pointer is set to one of at least two audio buffers inoperation 502 and control passes tooperation 504 where an audio data chunk is retrieved from thedecompression content buffer 252. The audio data chunk is then loaded into the buffer pointed to by the audio pointer inoperation 506. As soon as the audio chunk is loaded into this buffer, contents of the buffer begin to play inoperation 508. Meanwhile, operation control is passed tooperation 510 where the query is made whether the audio stream is complete. If so, control passes tooperation 512 and the audio play stream stops. If the audio stream is not complete, control passes tooperation 514 where the pointer is shifted to the next buffer and control is passed back tooperation 504. This process repeats until there are no more audio data chunks signifying that the audio stream is complete. In the case just described, the audio continues to play, even when the video slows in response to the actions of the user on theexercise device 12. - Referring now to the interleaved audio flow diagram in
FIG. 5 b, when the first video frame is decompressed and loaded into the display buffer as described above with reference toFIGS. 3 and 4 , the audio stream control begins inoperation 520. First, a pointer is set to one of at least two audio buffers inoperation 522. Control then passes tooperation 524 where an audio data chunk associated with the current video frame is retrieved from thedecompression content buffer 252. This data chunk is then loaded into the audio buffer pointed to inoperation 526 and play of this audio chunk immediately begins inoperation 528. At the same time, control shifts tooperation 530 where the stream is queried to determine if the audio stream is complete. If not, the query is made, inoperation 532, whether the next audio data chunk is available. - Thus, the query in
operation 532 is whether the next video frame has been called for display. This becomes important when the user is slowing down the video display by reducing his or her exercise rate, e.g. pedaling slower. If the next video frame has not been called, the next audio data chunk will not be available. In this case,operation 532 transfers control back tooperation 528 and the current audio data chunk is replayed. Where the audio is wind noise, sounds of the road, or natural background noise in the country, the user will not likely be able to distinguish that the audio is being “looped back”. Once the next video frame is called, the query inoperation 532 will transfer control to operation 534 where the pointer is set to another buffer. Control then transfers back tooperation 524 to get another audio data chunk andoperations operation 536 where the audio play is stopped. - The audio buffers provide a smooth sequencing of audio chunk play. In the present invention, a plurality of audio can be played with the video. For example, a first audio can be played at a constant rate independent of the video frame, while a second audio is played at a rate which corresponds to the rate at which the video is played. This facilitates a first audio pitch and tempo remaining a pleasing audio signal, as would be perceived at the location while a second audio pitch changes to correspond to the pace at which footfalls, for example, would occur at the rate of exercise perceived by the user, while a third audio can occur at a rate intended to mimic a training pace or quickening pace of a training partner in response to a differential input by a user or calculated based on user parameters such as age, health and training objectives. Also, as the user slows down, the on-location sounds would not change appreciably. However, the audio volume could be made to increase or decrease as the user increases or decreases speed respectively. Therefore looping these audio chunks of wind and road noise back during slow exercise periods as described in
FIG. 5 b maintains the perceptive effect of the audio being independent of the video rate of display, yet tying the audio content to the video frames being displayed. - Additionally, the audio of, for example, the sounds of footfalls can further be divided into individual sound packets that are played in bursts at a tempo or pace corresponding to the desired pace without altering the rate or speed of audio. Alternatively, an audio of a series of, for example, footfalls which includes a footfall followed by an interval of silence before a subsequent footfall (and so on) can be alternately speeded up during the intervals of silence only.
- Another variation, shown in
FIGS. 1 a-c, is the output connection of a control signal to theexercise device 12. The prerecorded video may include coded data for setting the exercise device to predetermined resistance values. In this case, the program would include a control thread which accesses the control data associated with the video frame which sets the resistance. This data would then be translated into setting values which would be transmitted to the servomotor or stepper motor connected to the resistance control such as resistance wheel on the exercise stand. - The
interface unit 132 can be adapted and configured to include a battery, a programmable interrupt controller (PIC) or processor, abiological parameter measurer 144, such as a heart rate receiver tuned to the transmission frequency of the heart rate transmitter, a series of shift registers, a 10 MegaHertz clock, wheel speed input terminals which mate with the contacts on theexercise machine 12, and a nine pin output connector which connects theinterface unit 132 to acontroller keypad 118. The PIC processor can, for example, be an 8 bit device, which processes the incoming tics, or beats from the wheel speed sensor and the ticks from the output of the heart rate receiver. The shift registers in the interface unit convert the data from the PIC Processor to 32 bit words for compatibility of communication with a player. The interface unit 32 is adapted and configured to collect data from the heart rate and wheel speed inputs and transmits the heart rate and wheel speed data to the player when queried by the main program. Provision may also be included in the interface unit for providing a signal to a stepper motor or servomotor on the exercise device to vary the resistance provided by the resistance roller. - A logic flow diagram of the embedded program in the PIC processor is shown in
FIG. 6 a. When the user turns on the player activates the playing of a video, the interface unit processor starts inoperation 600. A run time crystal clock (RTCC) is used to run the processor and to measure time durations between input pulses in the PIC processor. This RTCC runs at 10 MHz and counts between zero and 255. The output rolls over at 255. This equates to a rollover time of about a maximum of 2 milliseconds.Operation 602 initializes several flags and registers to zero. Specifically, a load pulse flag, a heart beat flag, a heart tic flag, a wheel rotation flag and a wheel tic flag are set to zero. Also, a heart count register, a heart store register, a wheel count register, and a wheel store register are set to zero. The heart count registers and wheel count registers are used to accumulate time tics between input pulses from the heart rate receiver and the wheel rotation reed switch as will become more apparent below. - Control then transfers to
operation 604 where the run time crystal clock is set to 99. This clock then counts up to 255 and then rolls over to zero and continues counting to 255, rolling over, and repeating. This works out to about 2 milliseconds between rollovers. Control then shifts tooperation 606 where the query is made whether the RTCC has rolled over. The actual query is whether the RTCC is less than 90. If yes, the RTCC is reset to 99 inoperation 608 and the heart tic and wheel tic flags are set inoperation 610. Control then proceeds tooperation 612. If the RTCC has not yet rolled over, control passes directly tooperation 612 without passing throughoperations Operation 612 queries whether a load pulse flag has been set by the control program. This flag will be set if the program is ready to receive input from the interface unit 32. In this case, control transfers tooperation 614 where the interface unit 32 output registers are loaded with the contents of the heart store and wheel store registers. These output registers are then immediately read by the operating system through the connection through a user input interface, such askeypad 118. - Whether or not the load pulse flag is set by the player, control then passes to
operation 616 where the query is made whether a heartbeat flag has been set, i.e. a beat has been received by the heart rate receiver. If a beat has been received, control passes tooperation 618 where the heart count register contents are transferred to the heart store register. Then, inoperation 620, the heart count register is reset to zero and the heart beat flag is reset in order to sense another heartbeat. Control then proceeds fromoperation 620 tooperation 622. If no heartbeat has been received in the heart rate receiver, and thus the heart beat flag is not set,operation 616 transfers directly tooperation 622. - In
operation 622 using a bicycle, for example, asexercise device 12, a query is made whether the wheel rotate flag has been set by passage of a wheel magnet past a reed switch. If not, control passes tooperation 624. If the wheel rotate flag is set, control passes tooperation 626 where the contents of the wheel count register are moved to the wheel store register. Control then transfers tooperation 628, where the wheel count register is set to zero and the wheel rotate flag is reset in order to sense receipt of another wheel rotation. -
Operation 624 queries whether the heart tic flag is set. If so, control transfers tooperation 632 where the heart count register is incremented and the heart tic flag is reset. Control then transfers tooperation 630. If the heart tic flag is not set,operation 624 transfers control directly tooperation 630. -
Operation 630 queries whether the wheel tic flag is set. If so, control transfers tooperation 634 where the wheel count register is incremented and the wheel tic flag is reset. Control then passes back tooperation 606. If the wheel tic flag is not set,operation 630 passes directly back tooperation 606. - The sequence of operations described in
FIG. 6 b is continuous. The net effect of the sequence is to constantly update the heart count, wheel count, heart store, and wheel store registers as wheel rotations and heart beats are received. This information is passed into the output registers for transmission to the control system whenever the control program requests input which is about 60 times per second. It is to be understood that the above description is exemplary of one embodiment only. - As will be appreciated by this disclosure similar logic can be applied to other exercise devices to achieve similar results.
- Other programmed method variations and equivalents for providing the above exercise device and user input to the playing device will become readily apparent to those skilled in the art. In addition, other playing devices may be utilized in place of the system. For example, an MPEG-2 compatible player coupled to a personal computer may be used, or another CD player using a different operating system such as a Sony video game CD player. In these cases, the hardware in the interface unit may have to be modified to achieve bit compatibility with the particular player input devices. However, the basic logic flow of the example described above could still apply.
- Many of the above methods related to type and characteristic of the audio footfall file played back also apply in this type of implementation.
- Example 1
- In one example, the pace of the video stream changes with the pace of the footsteps which corresponds to the rate at which a user is exercising as described above. The rate of the correlated audio can be set-up to increase as a user increases the speed at which the user performs. Thus, the pace of the video, i.e., the rate at which the video is streamed to the screen, correlates to the pace of, for example, the footsteps or the rate at which a user is cycling on a stationary bike. It has been observed that, for example, runners may find the urge to synchronize their steps to a strong musical beat or to a repetitive sound, such as a footfall. Similarly, cyclists may be urged to press down on the pedal at a rate corresponding to a repetitive sound. This urge may motivate the exerciser to perform at the video correlated pace as the speed of the video and the correlated audio increases to correspond to the rate at which the viewing would change if, for example, a runner were running at a particular pace and his or her footfalls were at a particular pace. The rate of change of each of the audio tracks is accomplished such that the sounds continue to sound natural but achieves the effect of a Foley artist in making the various audio tracks to correspond to a video.
- Example 2
- In another example, the pace of exercise interactively changes with the pace of the footsteps. The pace of the video, i.e., the rate at which the video is streamed, can change in response to a measured biological parameter. A measured parameter may be used to provide feedback that a user should increase his or her speed or decrease his or her speed (e.g., if heart rates are above or below desired levels, the correlated audio can be increased, along with the speed of the machine to increase the heart rate to a desired or target level).
- Example 3
- In another example, a user could select a difficulty level and/or or other parameters that would result in a certain speed of footsteps being played. This could be a combination of several parameters, such as in the case where a person might enter their height and a difficulty level of “5”. The program might know that “5” for a tall person is a different foot pace then “5” for a short person.
- Example 4
- In another example, to the extent that there was ambient noise (e.g., water running, leaves falling, wind blowing) or music that audio would remain at a natural rate (e.g., the rate that it would be heard by the user in nature at) regardless of speed of video or the correlated audio, but the sound for footfalls or any other video correlated sound that corresponds to a user's actual activity would change with the pace of video scenery.
- Example 5
- In another example, a user can select a competition rate wherein, for example, the user performs at a base rate to establish his or her normal training rate. Then, the user can select a pre-defined competitor profile, or a rate of performance improvement, e.g., 10%. In this scenario, the correlated sound will occur at the rate of the competitor profile or the rate of performance improvement while the video can stream at the rate at which the user is actually performing or at the rate of the chosen competitor profile or performance rate improvement.
- Example 6
- In another example of a deployment system for the methods of the invention, a data processing system for administering course material is provided comprising a computer or server as shown in
FIG. 1B . The computer can, if desired, be connected to a network of remote stations as shown inFIG. 1C . In operation, the remote stations could then serve as the data entry points for information to be gathered, for example at a remote class site or by a participant registering for a class on-line. Information gathered includes, for example, information about the materials to be presented, the participant, the environment, etc. The remote stations can also serve as access points through which people transmit inquiries concerning the materials presented or exercise programs and for responding to those inquiries. Additionally, each station can store a record of each participant's details, including performance information for each class, and periodically send this information to the central computer for processing. - Additionally, it will be appreciated that the exercise can be administered in the form of interval training As will be appreciated by those skilled in the art, the ordering of these steps, or any steps described herein, can occur as illustrated in the various figures, or can occur in any other order that achieves the objectives of the invention without departing from the scope of the invention.
- In another embodiment of the invention, the system and method can be adapted to work in conjunction with the invention disclosed in U.S. Pat. No. 6,142,913 for “Dynamic Real Time Exercise Video Apparatus and Method” (Ewert). Thus the system can be adapted to incorporate varying video playback rate adjusts the frame rate of motion video content being replayed on a display device based on the intensity at which a participant exerts themselves. This system supports the illusion that the participant is actually traveling through the terrain being displayed. A result of the use of this system is that a participant who exercises at a higher intensity will view more footage than will a participant who exercises at a lower intensity, as the frame rate speed will be higher and more frames of the footage will be viewed.
- An additional benefit of the systems and methods disclosed herein is the modularity of the systems and methods.
- While preferred embodiments of the present invention are shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Numerous variations, changes, and substitutions will now occur to those skilled in the art without departing from the invention. It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention. It is intended that the claims following the description define the scope of the invention and that methods and structures within the scope of these claims and equivalents are covered thereby.
Claims (27)
1. An exercise system comprising:
a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmit the one or more inputs to the central processing unit;
a video frame sequence encoded onto a storage medium in communication with and playable on the video playing device;
a video monitor in communication with the video playing device for displaying the video frame sequence reproduced by the video playing device;
a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the video monitor in response to the one or more inputs from the user;
one or more audio rate controllers configured to vary a rate of delivery of two or more audio files on an audio playing device in response to the one or more inputs from the user; and
an exercise device.
2. The system of claim 1 wherein the video frame rate controller comprises a computer program stored on a storage medium with the prerecorded video frame sequence, the program being operable with the central processing unit in the video playing device when the video sequence is played to modify the frame display rate in response to the signal from a user interface rate detector.
3. The system of claim 2 wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device operation detector.
4. The system of claim 3 wherein the user interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user controlling the rate at which the video is displayed on the video monitor.
5. The system of claim 1 wherein the audio rate controller comprises a computer program stored on a storage medium with an audio sequence, the program being operable with the central processing unit in the audio playing device when the audio sequence is played to modify the audio delivery rate in response to the signal from the user interface rate detector.
6. The system of claim 5 wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device operation detector.
7. The system of claim 6 wherein the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
8. The system of claim 1 wherein the user input is one or more of each of manual input and automatic input.
9. The system of claim 8 wherein the manual input is one or more of height, weight, age, difficulty level, target training rate, target heart rate, and target activity level.
10. The system of claim 8 wherein the automatic input is a signal from one or more of a biological parameter measurer, and an exercise device operation detector.
11. The system of claim 1 wherein the exercise device is selected from the group comprising a bicycle, a stair stepper, and an elliptical trainer.
12. The system of claim 1 wherein the rate of delivery of the two or more audio files are delivered asynchronous to each other.
13. The system of claim 1 wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed.
13. An apparatus for engaging a user of an exercise device interactively in viewing a video frame sequence of an activity on a video monitor comprising:
a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor;
a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmit a signal proportional to the rate of exercise;
a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed;
two or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played.
14. The apparatus according to claim 13 wherein the exercise device is selected from the group comprising a bicycle, a stair stepper and an elliptical trainer.
15. The apparatus according to claim 13 wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector.
16. The apparatus according to claim 15 wherein the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display.
17. A method of controlling a video frame sequence display rate of a video playback sequence in a device in response to an external signal comprising the steps of:
(a) accessing a duration time stamp for a current video frame;
(b) determining from the external signal an adjustment value for changing the display rate (c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp;
(d) displaying the next frame when the modified duration time has passed;
(e) accessing a duration time stamp for a current audio data packet;
(f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet;
(g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; and
(h) playing the next audio data packet when the modified duration time has passed.
18. The method of claim 17 further comprising the step of repeating steps (a) through (d) for each subsequent video frame and steps (e) through (h) for each subsequent audio data packet.
19. The method of claim 17 wherein the accessing step (a) further comprises the steps of:
i) setting a time offset to current clock time;
ii) displaying a current video frame; and
iii) accessing a frame time stamp and a duration time stamp for the current video frame.
20. The method of claim 19 wherein the step of determining further comprises the step of comparing the external signal to predetermined criteria to determine the adjustment value.
21. The method of claim 20 wherein the external signal is a user variable exercise rate signal.
22. The method of claim 20 wherein the step of displaying (d) further comprises the steps of:
i) adding the modified duration value to the time offset to obtain a next frame time; and
ii) displaying the next frame when clock time exceeds the next frame time.
23. The method of claim 17 wherein the accessing step (e) further comprises the steps of:
i) setting a time offset to current clock time;
ii) playing a current audio data packet; and
iii) accessing a frame time stamp and a duration time stamp for the current audio data packet.
24. The method of claim 23 wherein the step of determining (f) further comprises the step of comparing the external signal to predetermined criteria to determine the adjustment value.
25. The method of claim 24 wherein the external signal is a user variable exercise rate signal.
26. The method of claim 23 wherein the step of playing (h) further comprises the steps of:
i) adding the modified duration value to the time offset to obtain a next audio data packet time; and
ii) playing the next audio data packet when clock time exceeds the next frame time.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/609,438 US20100279822A1 (en) | 2008-11-01 | 2009-10-30 | Systems and methods for optimizing one or more audio tracks to a video stream |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11055908P | 2008-11-01 | 2008-11-01 | |
US24815109P | 2009-10-02 | 2009-10-02 | |
US12/609,438 US20100279822A1 (en) | 2008-11-01 | 2009-10-30 | Systems and methods for optimizing one or more audio tracks to a video stream |
Publications (1)
Publication Number | Publication Date |
---|---|
US20100279822A1 true US20100279822A1 (en) | 2010-11-04 |
Family
ID=43030817
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/609,438 Abandoned US20100279822A1 (en) | 2008-11-01 | 2009-10-30 | Systems and methods for optimizing one or more audio tracks to a video stream |
Country Status (1)
Country | Link |
---|---|
US (1) | US20100279822A1 (en) |
Cited By (68)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110237399A1 (en) * | 2010-03-26 | 2011-09-29 | Paul Toback | Exercise apparatus |
US20120028762A1 (en) * | 2009-05-18 | 2012-02-02 | Adidas Ag | Methods and Computer Program Products For Providing Audio Performance Feedback to a User During an Athletic Activity |
US20120245721A1 (en) * | 2011-03-23 | 2012-09-27 | Story Jr Guy A | Managing playback of synchronized content |
US20130003623A1 (en) * | 2011-01-21 | 2013-01-03 | Qualcomm Incorporated | User input back channel for wireless displays |
US20130267385A1 (en) * | 2012-04-04 | 2013-10-10 | Icon Health & Fitness, Inc. | Systems, Methods, and Devices for Gathering and Transmitting Exercise Related Data |
WO2013157848A1 (en) * | 2012-04-20 | 2013-10-24 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
US8855797B2 (en) | 2011-03-23 | 2014-10-07 | Audible, Inc. | Managing playback of synchronized content |
WO2014163976A1 (en) * | 2013-03-11 | 2014-10-09 | Smith Kelly Ann | Equipment, system and method for improving exercise efficiency in a cardio-fitness machine |
US8972265B1 (en) | 2012-06-18 | 2015-03-03 | Audible, Inc. | Multiple voices in audio content |
US9075760B2 (en) | 2012-05-07 | 2015-07-07 | Audible, Inc. | Narration settings distribution for content customization |
US9099089B2 (en) | 2012-08-02 | 2015-08-04 | Audible, Inc. | Identifying corresponding regions of content |
US9141257B1 (en) | 2012-06-18 | 2015-09-22 | Audible, Inc. | Selecting and conveying supplemental content |
US9186567B2 (en) * | 2008-12-05 | 2015-11-17 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US20150362993A1 (en) * | 2014-06-16 | 2015-12-17 | Immersion Corporation | Systems and Methods for Foley-Style Haptic Content Creation |
US9223830B1 (en) | 2012-10-26 | 2015-12-29 | Audible, Inc. | Content presentation analysis |
US9280906B2 (en) | 2013-02-04 | 2016-03-08 | Audible. Inc. | Prompting a user for input during a synchronous presentation of audio content and textual content |
US9317500B2 (en) | 2012-05-30 | 2016-04-19 | Audible, Inc. | Synchronizing translated digital content |
US9317486B1 (en) | 2013-06-07 | 2016-04-19 | Audible, Inc. | Synchronizing playback of digital content with captured physical content |
US9367196B1 (en) | 2012-09-26 | 2016-06-14 | Audible, Inc. | Conveying branched content |
US9409053B1 (en) * | 2015-07-13 | 2016-08-09 | Bml Productions, Inc. | Exercise data collection system |
US9413803B2 (en) | 2011-01-21 | 2016-08-09 | Qualcomm Incorporated | User input back channel for wireless displays |
US9472113B1 (en) | 2013-02-05 | 2016-10-18 | Audible, Inc. | Synchronizing playback of digital content with physical content |
US9489360B2 (en) | 2013-09-05 | 2016-11-08 | Audible, Inc. | Identifying extra material in companion content |
US9519750B2 (en) | 2008-12-05 | 2016-12-13 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9536439B1 (en) | 2012-06-27 | 2017-01-03 | Audible, Inc. | Conveying questions with content |
US9570059B2 (en) * | 2015-05-19 | 2017-02-14 | Spotify Ab | Cadence-based selection, playback, and transition between song versions |
US9582239B2 (en) | 2011-01-21 | 2017-02-28 | Qualcomm Incorporated | User input back channel for wireless displays |
US9632647B1 (en) | 2012-10-09 | 2017-04-25 | Audible, Inc. | Selecting presentation positions in dynamic content |
US9679608B2 (en) | 2012-06-28 | 2017-06-13 | Audible, Inc. | Pacing content |
US9706247B2 (en) | 2011-03-23 | 2017-07-11 | Audible, Inc. | Synchronized digital content samples |
US9703781B2 (en) | 2011-03-23 | 2017-07-11 | Audible, Inc. | Managing related digital content |
US9734153B2 (en) | 2011-03-23 | 2017-08-15 | Audible, Inc. | Managing related digital content |
US9757619B2 (en) | 2010-11-10 | 2017-09-12 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US9787725B2 (en) | 2011-01-21 | 2017-10-10 | Qualcomm Incorporated | User input back channel for wireless displays |
WO2018129407A1 (en) * | 2017-01-09 | 2018-07-12 | Inmusic Brands, Inc. | Systems and methods for providing audio-file loop-playback functionality |
US10031720B2 (en) | 2015-08-12 | 2018-07-24 | International Business Machines Corporation | Controlling audio tempo based on a target heart rate |
CN108399777A (en) * | 2018-04-13 | 2018-08-14 | 京东方科技集团股份有限公司 | A kind of auxiliary driving method, device and electronic equipment |
KR20180119816A (en) * | 2017-04-26 | 2018-11-05 | 주식회사 디엔제이휴먼케어 | A method for providing health care services |
US10123583B2 (en) | 2008-12-05 | 2018-11-13 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US10179263B2 (en) | 2011-02-17 | 2019-01-15 | Nike, Inc. | Selecting and correlating physical activity data with image data |
US10188890B2 (en) | 2013-12-26 | 2019-01-29 | Icon Health & Fitness, Inc. | Magnetic resistance mechanism in a cable machine |
US10207148B2 (en) | 2016-10-12 | 2019-02-19 | Icon Health & Fitness, Inc. | Systems and methods for reducing runaway resistance on an exercise device |
US10226396B2 (en) | 2014-06-20 | 2019-03-12 | Icon Health & Fitness, Inc. | Post workout massage device |
US10252109B2 (en) | 2016-05-13 | 2019-04-09 | Icon Health & Fitness, Inc. | Weight platform treadmill |
US10272317B2 (en) | 2016-03-18 | 2019-04-30 | Icon Health & Fitness, Inc. | Lighted pace feature in a treadmill |
US10279212B2 (en) | 2013-03-14 | 2019-05-07 | Icon Health & Fitness, Inc. | Strength training apparatus with flywheel and related methods |
US10293211B2 (en) | 2016-03-18 | 2019-05-21 | Icon Health & Fitness, Inc. | Coordinated weight selection |
US10343017B2 (en) | 2016-11-01 | 2019-07-09 | Icon Health & Fitness, Inc. | Distance sensor for console positioning |
US10376736B2 (en) | 2016-10-12 | 2019-08-13 | Icon Health & Fitness, Inc. | Cooling an exercise device during a dive motor runway condition |
US10391361B2 (en) | 2015-02-27 | 2019-08-27 | Icon Health & Fitness, Inc. | Simulating real-world terrain on an exercise device |
US10426989B2 (en) | 2014-06-09 | 2019-10-01 | Icon Health & Fitness, Inc. | Cable system incorporated into a treadmill |
US10433612B2 (en) | 2014-03-10 | 2019-10-08 | Icon Health & Fitness, Inc. | Pressure sensor to quantify work |
US10441844B2 (en) | 2016-07-01 | 2019-10-15 | Icon Health & Fitness, Inc. | Cooling systems and methods for exercise equipment |
US10471299B2 (en) | 2016-07-01 | 2019-11-12 | Icon Health & Fitness, Inc. | Systems and methods for cooling internal exercise equipment components |
US10493349B2 (en) | 2016-03-18 | 2019-12-03 | Icon Health & Fitness, Inc. | Display on exercise device |
US10500473B2 (en) | 2016-10-10 | 2019-12-10 | Icon Health & Fitness, Inc. | Console positioning |
US10518163B2 (en) | 2010-07-14 | 2019-12-31 | Adidas Ag | Location-aware fitness monitoring methods, systems, and program products, and applications thereof |
US10543395B2 (en) | 2016-12-05 | 2020-01-28 | Icon Health & Fitness, Inc. | Offsetting treadmill deck weight during operation |
US10560504B2 (en) * | 2009-09-17 | 2020-02-11 | Adobe Inc. | Stream duration management |
US10561894B2 (en) | 2016-03-18 | 2020-02-18 | Icon Health & Fitness, Inc. | Treadmill with removable supports |
US10625114B2 (en) | 2016-11-01 | 2020-04-21 | Icon Health & Fitness, Inc. | Elliptical and stationary bicycle apparatus including row functionality |
US10625137B2 (en) | 2016-03-18 | 2020-04-21 | Icon Health & Fitness, Inc. | Coordinated displays in an exercise device |
US10661114B2 (en) | 2016-11-01 | 2020-05-26 | Icon Health & Fitness, Inc. | Body weight lift mechanism on treadmill |
US10671705B2 (en) | 2016-09-28 | 2020-06-02 | Icon Health & Fitness, Inc. | Customizing recipe recommendations |
US10729965B2 (en) | 2017-12-22 | 2020-08-04 | Icon Health & Fitness, Inc. | Audible belt guide in a treadmill |
US10953305B2 (en) | 2015-08-26 | 2021-03-23 | Icon Health & Fitness, Inc. | Strength exercise mechanisms |
US11451108B2 (en) | 2017-08-16 | 2022-09-20 | Ifit Inc. | Systems and methods for axial impact resistance in electric motors |
CN116248811A (en) * | 2022-12-09 | 2023-06-09 | 北京生数科技有限公司 | Video processing method, device and storage medium |
Citations (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4368740A (en) * | 1980-11-03 | 1983-01-18 | Binder Andy S | Physiologic analyzer |
US4828257A (en) * | 1986-05-20 | 1989-05-09 | Powercise International Corporation | Electronically controlled exercise system |
US4925189A (en) * | 1989-01-13 | 1990-05-15 | Braeunig Thomas F | Body-mounted video game exercise device |
US5002491A (en) * | 1989-04-28 | 1991-03-26 | Comtek | Electronic classroom system enabling interactive self-paced learning |
US5049079A (en) * | 1988-12-19 | 1991-09-17 | John H. Peterson | Closed loop ski simulation and instructional system |
US5170780A (en) * | 1991-05-30 | 1992-12-15 | Rosenfeld J Peter | Method of credibility assessment based on feedback-elicited P3 responses of brain |
US5246411A (en) * | 1991-01-04 | 1993-09-21 | Rackman Michael I | Exercise machine system |
US5251632A (en) * | 1991-03-07 | 1993-10-12 | Hamamatsu Photonics K.K. | Tissue oxygen measuring system |
US5267865A (en) * | 1992-02-11 | 1993-12-07 | John R. Lee | Interactive computer aided natural learning method and apparatus |
US5339134A (en) * | 1992-03-31 | 1994-08-16 | Kabushiki Kaisha Toshiba | Automatic document feeder for image forming apparatus |
US5362069A (en) * | 1992-12-03 | 1994-11-08 | Heartbeat Corporation | Combination exercise device/video game |
US5527239A (en) * | 1993-02-04 | 1996-06-18 | Abbondanza; James M. | Pulse rate controlled exercise system |
US5577981A (en) * | 1994-01-19 | 1996-11-26 | Jarvik; Robert | Virtual reality exercise machine and computer controlled video system |
US5888172A (en) * | 1993-04-26 | 1999-03-30 | Brunswick Corporation | Physical exercise video system |
US6004243A (en) * | 1995-10-11 | 1999-12-21 | Ewert; Bruce | Dynamic real time exercise video apparatus and method |
US6077196A (en) * | 1999-10-01 | 2000-06-20 | Eschenbach; Paul William | Adjustable elliptical exercise apparatus |
US6142913A (en) * | 1995-10-11 | 2000-11-07 | Ewert; Bruce | Dynamic real time exercise video apparatus and method |
US6179746B1 (en) * | 1999-06-17 | 2001-01-30 | David Harris Delman | Activity controlled audio-visual system |
US6336891B1 (en) * | 1997-12-08 | 2002-01-08 | Real Vision Corporation | Interactive exercise pad system |
US6361476B1 (en) * | 1999-07-27 | 2002-03-26 | Paul William Eschenbach | Variable stride elliptical exercise apparatus |
US6436007B1 (en) * | 1996-09-09 | 2002-08-20 | Paul William Eschenbach | Elliptical exercise machine with adjustment |
US6443904B2 (en) * | 2000-03-17 | 2002-09-03 | Polar Electro Oy | Determination of stress level of fitness exercise |
US6510340B1 (en) * | 2000-01-10 | 2003-01-21 | Jordan Neuroscience, Inc. | Method and apparatus for electroencephalography |
US6540686B2 (en) * | 2000-02-23 | 2003-04-01 | Polar Electro Oy | Measurement relating to human body |
US6553247B1 (en) * | 1999-10-04 | 2003-04-22 | Polar Electro Oy | Electrode belt of heart rate monitor |
US6554773B1 (en) * | 1997-09-12 | 2003-04-29 | Polar Electro Oy | Method and arrangement for blood pressure measurement |
US6584344B2 (en) * | 2001-02-22 | 2003-06-24 | Polar Electro Oy | Method and apparatus for measuring heart rate |
US6605044B2 (en) * | 2001-06-28 | 2003-08-12 | Polar Electro Oy | Caloric exercise monitor |
US6687535B2 (en) * | 2000-02-23 | 2004-02-03 | Polar Electro Oy | Controlling of fitness exercise |
US6714812B1 (en) * | 1999-11-22 | 2004-03-30 | Polar Electro Oy | Method of performing operating settings in heart rate measurement arrangement, and heart rate measurement arrangement |
US6746415B1 (en) * | 1996-10-23 | 2004-06-08 | Hema Metrics, Inc. | Method of blood constituent monitoring using improved disposable extracorporeal conduit |
US6749432B2 (en) * | 1999-10-20 | 2004-06-15 | Impulse Technology Ltd | Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function |
US6754517B2 (en) * | 2000-08-30 | 2004-06-22 | Polar Electro Oy | Apparatus for measuring an electrocardiograph signal |
US20040220738A1 (en) * | 2003-04-17 | 2004-11-04 | Polar Electro Oy. | Portable personal data processing device |
US20040220485A1 (en) * | 2003-04-17 | 2004-11-04 | Polar Electro Oy | Method and device for measuring heart rate, and method for manufacturing the device |
US6829496B2 (en) * | 2001-11-20 | 2004-12-07 | Minolta Co., Ltd. | Blood component measurement apparatus |
US6829502B2 (en) * | 2002-05-30 | 2004-12-07 | Motorola, Inc. | Brain response monitoring apparatus and method |
US6832109B2 (en) * | 2000-10-06 | 2004-12-14 | Polar Electro Oy | Wrist-worn device for displaying and setting heart rate parameters |
US20050004436A1 (en) * | 2003-04-29 | 2005-01-06 | Polar Electro Oy | Method and device for weight management of humans |
US20050004789A1 (en) * | 1998-07-31 | 2005-01-06 | Summers Gary J. | Management training simulation method and system |
US20050017850A1 (en) * | 2003-07-04 | 2005-01-27 | Polar Electro Oy. | Mechanical measuring device and a measuring method |
US6850789B2 (en) * | 2002-07-29 | 2005-02-01 | Welch Allyn, Inc. | Combination SPO2/temperature measuring apparatus |
US6879850B2 (en) * | 2002-08-16 | 2005-04-12 | Optical Sensors Incorporated | Pulse oximeter with motion detection |
US20050111307A1 (en) * | 2003-11-20 | 2005-05-26 | Polar Electro Oy. | Electronic wrist device |
US20050111306A1 (en) * | 2003-11-20 | 2005-05-26 | Polar Electro Oy | Portable wrist-worn personal electronic device |
US20050130802A1 (en) * | 2003-11-21 | 2005-06-16 | Polar Electro Oy | Arrangement, method and computer program for determining physical activity level of human being |
US6909912B2 (en) * | 2002-06-20 | 2005-06-21 | University Of Florida | Non-invasive perfusion monitor and system, specially configured oximeter probes, methods of using same, and covers for probes |
US20050135039A1 (en) * | 2003-12-16 | 2005-06-23 | Polar Electro Oy | Electric circuit and transmission method for telemetric transmission |
US6912413B2 (en) * | 2002-09-13 | 2005-06-28 | Ge Healthcare Finland Oy | Pulse oximeter |
US20050166373A1 (en) * | 2004-01-30 | 2005-08-04 | Polar Electro Oy | Case structure for sensor structure attachable to and detachable from a shoe |
US6930673B2 (en) * | 2000-11-13 | 2005-08-16 | Gtco Calcomp | Collaborative input system |
US6954661B2 (en) * | 2003-06-23 | 2005-10-11 | Hitachi, Ltd. | Blood sugar level measuring apparatus |
US7022048B1 (en) * | 2004-07-26 | 2006-04-04 | John Fernandez | Video fitness machine |
US7153238B2 (en) * | 2001-07-12 | 2006-12-26 | Brunswick Corporation | Stairclimber apparatus pedal mechanism |
US7217224B2 (en) * | 2003-08-14 | 2007-05-15 | Tom Thomas | Virtual exercise system and method |
US20070117081A1 (en) * | 2005-10-31 | 2007-05-24 | Ford John H | System and Method for Delivering Information to Optimize Information Retention |
US7367926B2 (en) * | 2005-08-01 | 2008-05-06 | Fitness Quest Inc. | Exercise treadmill |
US7507187B2 (en) * | 2004-04-06 | 2009-03-24 | Precor Incorporated | Parameter sensing system for an exercise device |
US7563203B2 (en) * | 1998-09-25 | 2009-07-21 | Icon Ip, Inc. | Treadmill with adjustable cushioning members |
US7575537B2 (en) * | 2007-11-06 | 2009-08-18 | Fitness Tools, Llc | Dual direction exercise treadmill for simulating a dragging or pulling action with a user adjustable constant static weight resistance |
-
2009
- 2009-10-30 US US12/609,438 patent/US20100279822A1/en not_active Abandoned
Patent Citations (61)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4368740A (en) * | 1980-11-03 | 1983-01-18 | Binder Andy S | Physiologic analyzer |
US4828257A (en) * | 1986-05-20 | 1989-05-09 | Powercise International Corporation | Electronically controlled exercise system |
US5049079A (en) * | 1988-12-19 | 1991-09-17 | John H. Peterson | Closed loop ski simulation and instructional system |
US4925189A (en) * | 1989-01-13 | 1990-05-15 | Braeunig Thomas F | Body-mounted video game exercise device |
US5002491A (en) * | 1989-04-28 | 1991-03-26 | Comtek | Electronic classroom system enabling interactive self-paced learning |
US5246411A (en) * | 1991-01-04 | 1993-09-21 | Rackman Michael I | Exercise machine system |
US5251632A (en) * | 1991-03-07 | 1993-10-12 | Hamamatsu Photonics K.K. | Tissue oxygen measuring system |
US5170780A (en) * | 1991-05-30 | 1992-12-15 | Rosenfeld J Peter | Method of credibility assessment based on feedback-elicited P3 responses of brain |
US5267865A (en) * | 1992-02-11 | 1993-12-07 | John R. Lee | Interactive computer aided natural learning method and apparatus |
US5339134A (en) * | 1992-03-31 | 1994-08-16 | Kabushiki Kaisha Toshiba | Automatic document feeder for image forming apparatus |
US5362069A (en) * | 1992-12-03 | 1994-11-08 | Heartbeat Corporation | Combination exercise device/video game |
US5527239A (en) * | 1993-02-04 | 1996-06-18 | Abbondanza; James M. | Pulse rate controlled exercise system |
US5888172A (en) * | 1993-04-26 | 1999-03-30 | Brunswick Corporation | Physical exercise video system |
US5577981A (en) * | 1994-01-19 | 1996-11-26 | Jarvik; Robert | Virtual reality exercise machine and computer controlled video system |
US6004243A (en) * | 1995-10-11 | 1999-12-21 | Ewert; Bruce | Dynamic real time exercise video apparatus and method |
US6142913A (en) * | 1995-10-11 | 2000-11-07 | Ewert; Bruce | Dynamic real time exercise video apparatus and method |
US6436007B1 (en) * | 1996-09-09 | 2002-08-20 | Paul William Eschenbach | Elliptical exercise machine with adjustment |
US6746415B1 (en) * | 1996-10-23 | 2004-06-08 | Hema Metrics, Inc. | Method of blood constituent monitoring using improved disposable extracorporeal conduit |
US6554773B1 (en) * | 1997-09-12 | 2003-04-29 | Polar Electro Oy | Method and arrangement for blood pressure measurement |
US6336891B1 (en) * | 1997-12-08 | 2002-01-08 | Real Vision Corporation | Interactive exercise pad system |
US20050004789A1 (en) * | 1998-07-31 | 2005-01-06 | Summers Gary J. | Management training simulation method and system |
US7563203B2 (en) * | 1998-09-25 | 2009-07-21 | Icon Ip, Inc. | Treadmill with adjustable cushioning members |
US6179746B1 (en) * | 1999-06-17 | 2001-01-30 | David Harris Delman | Activity controlled audio-visual system |
US6361476B1 (en) * | 1999-07-27 | 2002-03-26 | Paul William Eschenbach | Variable stride elliptical exercise apparatus |
US6077196A (en) * | 1999-10-01 | 2000-06-20 | Eschenbach; Paul William | Adjustable elliptical exercise apparatus |
US6553247B1 (en) * | 1999-10-04 | 2003-04-22 | Polar Electro Oy | Electrode belt of heart rate monitor |
US6749432B2 (en) * | 1999-10-20 | 2004-06-15 | Impulse Technology Ltd | Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function |
US6714812B1 (en) * | 1999-11-22 | 2004-03-30 | Polar Electro Oy | Method of performing operating settings in heart rate measurement arrangement, and heart rate measurement arrangement |
US6510340B1 (en) * | 2000-01-10 | 2003-01-21 | Jordan Neuroscience, Inc. | Method and apparatus for electroencephalography |
US6950697B2 (en) * | 2000-01-10 | 2005-09-27 | Jordan Neuroscience, Inc. | Electroencephalogram acquisition unit and system |
US6687535B2 (en) * | 2000-02-23 | 2004-02-03 | Polar Electro Oy | Controlling of fitness exercise |
US6540686B2 (en) * | 2000-02-23 | 2003-04-01 | Polar Electro Oy | Measurement relating to human body |
US6443904B2 (en) * | 2000-03-17 | 2002-09-03 | Polar Electro Oy | Determination of stress level of fitness exercise |
US6754517B2 (en) * | 2000-08-30 | 2004-06-22 | Polar Electro Oy | Apparatus for measuring an electrocardiograph signal |
US6832109B2 (en) * | 2000-10-06 | 2004-12-14 | Polar Electro Oy | Wrist-worn device for displaying and setting heart rate parameters |
US6930673B2 (en) * | 2000-11-13 | 2005-08-16 | Gtco Calcomp | Collaborative input system |
US6584344B2 (en) * | 2001-02-22 | 2003-06-24 | Polar Electro Oy | Method and apparatus for measuring heart rate |
US6605044B2 (en) * | 2001-06-28 | 2003-08-12 | Polar Electro Oy | Caloric exercise monitor |
US7153238B2 (en) * | 2001-07-12 | 2006-12-26 | Brunswick Corporation | Stairclimber apparatus pedal mechanism |
US6829496B2 (en) * | 2001-11-20 | 2004-12-07 | Minolta Co., Ltd. | Blood component measurement apparatus |
US6829502B2 (en) * | 2002-05-30 | 2004-12-07 | Motorola, Inc. | Brain response monitoring apparatus and method |
US6909912B2 (en) * | 2002-06-20 | 2005-06-21 | University Of Florida | Non-invasive perfusion monitor and system, specially configured oximeter probes, methods of using same, and covers for probes |
US6850789B2 (en) * | 2002-07-29 | 2005-02-01 | Welch Allyn, Inc. | Combination SPO2/temperature measuring apparatus |
US6879850B2 (en) * | 2002-08-16 | 2005-04-12 | Optical Sensors Incorporated | Pulse oximeter with motion detection |
US6912413B2 (en) * | 2002-09-13 | 2005-06-28 | Ge Healthcare Finland Oy | Pulse oximeter |
US20040220738A1 (en) * | 2003-04-17 | 2004-11-04 | Polar Electro Oy. | Portable personal data processing device |
US20040220485A1 (en) * | 2003-04-17 | 2004-11-04 | Polar Electro Oy | Method and device for measuring heart rate, and method for manufacturing the device |
US20050004436A1 (en) * | 2003-04-29 | 2005-01-06 | Polar Electro Oy | Method and device for weight management of humans |
US6954661B2 (en) * | 2003-06-23 | 2005-10-11 | Hitachi, Ltd. | Blood sugar level measuring apparatus |
US20050017850A1 (en) * | 2003-07-04 | 2005-01-27 | Polar Electro Oy. | Mechanical measuring device and a measuring method |
US7217224B2 (en) * | 2003-08-14 | 2007-05-15 | Tom Thomas | Virtual exercise system and method |
US20050111306A1 (en) * | 2003-11-20 | 2005-05-26 | Polar Electro Oy | Portable wrist-worn personal electronic device |
US20050111307A1 (en) * | 2003-11-20 | 2005-05-26 | Polar Electro Oy. | Electronic wrist device |
US20050130802A1 (en) * | 2003-11-21 | 2005-06-16 | Polar Electro Oy | Arrangement, method and computer program for determining physical activity level of human being |
US20050135039A1 (en) * | 2003-12-16 | 2005-06-23 | Polar Electro Oy | Electric circuit and transmission method for telemetric transmission |
US20050166373A1 (en) * | 2004-01-30 | 2005-08-04 | Polar Electro Oy | Case structure for sensor structure attachable to and detachable from a shoe |
US7507187B2 (en) * | 2004-04-06 | 2009-03-24 | Precor Incorporated | Parameter sensing system for an exercise device |
US7022048B1 (en) * | 2004-07-26 | 2006-04-04 | John Fernandez | Video fitness machine |
US7367926B2 (en) * | 2005-08-01 | 2008-05-06 | Fitness Quest Inc. | Exercise treadmill |
US20070117081A1 (en) * | 2005-10-31 | 2007-05-24 | Ford John H | System and Method for Delivering Information to Optimize Information Retention |
US7575537B2 (en) * | 2007-11-06 | 2009-08-18 | Fitness Tools, Llc | Dual direction exercise treadmill for simulating a dragging or pulling action with a user adjustable constant static weight resistance |
Cited By (109)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9403060B2 (en) | 2008-12-05 | 2016-08-02 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US10173101B2 (en) | 2008-12-05 | 2019-01-08 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9192815B2 (en) * | 2008-12-05 | 2015-11-24 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9519750B2 (en) | 2008-12-05 | 2016-12-13 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9186567B2 (en) * | 2008-12-05 | 2015-11-17 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US10123583B2 (en) | 2008-12-05 | 2018-11-13 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9511260B2 (en) * | 2008-12-05 | 2016-12-06 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US10213647B2 (en) | 2008-12-05 | 2019-02-26 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US11541296B2 (en) | 2008-12-05 | 2023-01-03 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9248343B2 (en) * | 2008-12-05 | 2016-02-02 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9452319B2 (en) | 2008-12-05 | 2016-09-27 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9427624B2 (en) | 2008-12-05 | 2016-08-30 | Nike, Inc. | Athletic performance monitoring systems and methods in a team sports environment |
US9077465B2 (en) * | 2009-05-18 | 2015-07-07 | Adidas Ag | Portable fitness monitoring methods |
US11673023B2 (en) | 2009-05-18 | 2023-06-13 | Adidas Ag | Portable fitness monitoring methods |
US11376468B2 (en) | 2009-05-18 | 2022-07-05 | Adidas Ag | Portable fitness monitoring methods |
US10363454B2 (en) | 2009-05-18 | 2019-07-30 | Adidas Ag | Portable fitness monitoring methods |
US20140270236A1 (en) * | 2009-05-18 | 2014-09-18 | Adidas Ag | Portable Fitness Monitoring Methods |
US8715139B2 (en) | 2009-05-18 | 2014-05-06 | Adidas Ag | Portable fitness monitoring systems, and applications thereof |
US9675842B2 (en) | 2009-05-18 | 2017-06-13 | Adidas Ag | Portable fitness monitoring methods |
US8241184B2 (en) * | 2009-05-18 | 2012-08-14 | Adidas Ag | Methods and computer program products for providing audio performance feedback to a user during an athletic activity |
US20120028762A1 (en) * | 2009-05-18 | 2012-02-02 | Adidas Ag | Methods and Computer Program Products For Providing Audio Performance Feedback to a User During an Athletic Activity |
US10560504B2 (en) * | 2009-09-17 | 2020-02-11 | Adobe Inc. | Stream duration management |
US20110237399A1 (en) * | 2010-03-26 | 2011-09-29 | Paul Toback | Exercise apparatus |
US8979709B2 (en) * | 2010-03-26 | 2015-03-17 | Sproing Fitness LLC | Exercise apparatus |
US10518163B2 (en) | 2010-07-14 | 2019-12-31 | Adidas Ag | Location-aware fitness monitoring methods, systems, and program products, and applications thereof |
US11817198B2 (en) | 2010-11-10 | 2023-11-14 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US11600371B2 (en) | 2010-11-10 | 2023-03-07 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US10293209B2 (en) | 2010-11-10 | 2019-05-21 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US10632343B2 (en) | 2010-11-10 | 2020-04-28 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US9757619B2 (en) | 2010-11-10 | 2017-09-12 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US11568977B2 (en) | 2010-11-10 | 2023-01-31 | Nike, Inc. | Systems and methods for time-based athletic activity measurement and display |
US9582239B2 (en) | 2011-01-21 | 2017-02-28 | Qualcomm Incorporated | User input back channel for wireless displays |
US10911498B2 (en) | 2011-01-21 | 2021-02-02 | Qualcomm Incorporated | User input back channel for wireless displays |
US10135900B2 (en) * | 2011-01-21 | 2018-11-20 | Qualcomm Incorporated | User input back channel for wireless displays |
US9413803B2 (en) | 2011-01-21 | 2016-08-09 | Qualcomm Incorporated | User input back channel for wireless displays |
US9787725B2 (en) | 2011-01-21 | 2017-10-10 | Qualcomm Incorporated | User input back channel for wireless displays |
US10382494B2 (en) | 2011-01-21 | 2019-08-13 | Qualcomm Incorporated | User input back channel for wireless displays |
US20130003623A1 (en) * | 2011-01-21 | 2013-01-03 | Qualcomm Incorporated | User input back channel for wireless displays |
US10179263B2 (en) | 2011-02-17 | 2019-01-15 | Nike, Inc. | Selecting and correlating physical activity data with image data |
US20120245721A1 (en) * | 2011-03-23 | 2012-09-27 | Story Jr Guy A | Managing playback of synchronized content |
US8948892B2 (en) * | 2011-03-23 | 2015-02-03 | Audible, Inc. | Managing playback of synchronized content |
US9706247B2 (en) | 2011-03-23 | 2017-07-11 | Audible, Inc. | Synchronized digital content samples |
US9703781B2 (en) | 2011-03-23 | 2017-07-11 | Audible, Inc. | Managing related digital content |
US9734153B2 (en) | 2011-03-23 | 2017-08-15 | Audible, Inc. | Managing related digital content |
US8855797B2 (en) | 2011-03-23 | 2014-10-07 | Audible, Inc. | Managing playback of synchronized content |
US9792027B2 (en) | 2011-03-23 | 2017-10-17 | Audible, Inc. | Managing playback of synchronized content |
US9186549B2 (en) * | 2012-04-04 | 2015-11-17 | Icon Health & Fitness, Inc. | Systems, methods, and devices for gathering and transmitting exercise related data |
US20130267385A1 (en) * | 2012-04-04 | 2013-10-10 | Icon Health & Fitness, Inc. | Systems, Methods, and Devices for Gathering and Transmitting Exercise Related Data |
WO2013157848A1 (en) * | 2012-04-20 | 2013-10-24 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
US9517383B2 (en) | 2012-04-20 | 2016-12-13 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
US9075760B2 (en) | 2012-05-07 | 2015-07-07 | Audible, Inc. | Narration settings distribution for content customization |
US9317500B2 (en) | 2012-05-30 | 2016-04-19 | Audible, Inc. | Synchronizing translated digital content |
US9141257B1 (en) | 2012-06-18 | 2015-09-22 | Audible, Inc. | Selecting and conveying supplemental content |
US8972265B1 (en) | 2012-06-18 | 2015-03-03 | Audible, Inc. | Multiple voices in audio content |
US9536439B1 (en) | 2012-06-27 | 2017-01-03 | Audible, Inc. | Conveying questions with content |
US9679608B2 (en) | 2012-06-28 | 2017-06-13 | Audible, Inc. | Pacing content |
US10109278B2 (en) | 2012-08-02 | 2018-10-23 | Audible, Inc. | Aligning body matter across content formats |
US9099089B2 (en) | 2012-08-02 | 2015-08-04 | Audible, Inc. | Identifying corresponding regions of content |
US9799336B2 (en) | 2012-08-02 | 2017-10-24 | Audible, Inc. | Identifying corresponding regions of content |
US9367196B1 (en) | 2012-09-26 | 2016-06-14 | Audible, Inc. | Conveying branched content |
US9632647B1 (en) | 2012-10-09 | 2017-04-25 | Audible, Inc. | Selecting presentation positions in dynamic content |
US9223830B1 (en) | 2012-10-26 | 2015-12-29 | Audible, Inc. | Content presentation analysis |
US9280906B2 (en) | 2013-02-04 | 2016-03-08 | Audible. Inc. | Prompting a user for input during a synchronous presentation of audio content and textual content |
US9472113B1 (en) | 2013-02-05 | 2016-10-18 | Audible, Inc. | Synchronizing playback of digital content with physical content |
WO2014163976A1 (en) * | 2013-03-11 | 2014-10-09 | Smith Kelly Ann | Equipment, system and method for improving exercise efficiency in a cardio-fitness machine |
US10279212B2 (en) | 2013-03-14 | 2019-05-07 | Icon Health & Fitness, Inc. | Strength training apparatus with flywheel and related methods |
US9317486B1 (en) | 2013-06-07 | 2016-04-19 | Audible, Inc. | Synchronizing playback of digital content with captured physical content |
US9489360B2 (en) | 2013-09-05 | 2016-11-08 | Audible, Inc. | Identifying extra material in companion content |
US10188890B2 (en) | 2013-12-26 | 2019-01-29 | Icon Health & Fitness, Inc. | Magnetic resistance mechanism in a cable machine |
US10433612B2 (en) | 2014-03-10 | 2019-10-08 | Icon Health & Fitness, Inc. | Pressure sensor to quantify work |
US10426989B2 (en) | 2014-06-09 | 2019-10-01 | Icon Health & Fitness, Inc. | Cable system incorporated into a treadmill |
US10139907B2 (en) * | 2014-06-16 | 2018-11-27 | Immersion Corporation | Systems and methods for foley-style haptic content creation |
US10503263B2 (en) | 2014-06-16 | 2019-12-10 | Immersion Corporation | Systems and methods for Foley-style haptic content creation |
US20150362993A1 (en) * | 2014-06-16 | 2015-12-17 | Immersion Corporation | Systems and Methods for Foley-Style Haptic Content Creation |
US10226396B2 (en) | 2014-06-20 | 2019-03-12 | Icon Health & Fitness, Inc. | Post workout massage device |
US10391361B2 (en) | 2015-02-27 | 2019-08-27 | Icon Health & Fitness, Inc. | Simulating real-world terrain on an exercise device |
US11182119B2 (en) | 2015-05-19 | 2021-11-23 | Spotify Ab | Cadence-based selection, playback, and transition between song versions |
US10255036B2 (en) | 2015-05-19 | 2019-04-09 | Spotify Ab | Cadence-based selection, playback, and transition between song versions |
US10572219B2 (en) | 2015-05-19 | 2020-02-25 | Spotify Ab | Cadence-based selection, playback, and transition between song versions |
US9570059B2 (en) * | 2015-05-19 | 2017-02-14 | Spotify Ab | Cadence-based selection, playback, and transition between song versions |
US9933993B2 (en) | 2015-05-19 | 2018-04-03 | Spotify Ab | Cadence-based selection, playback, and transition between song versions |
US9409053B1 (en) * | 2015-07-13 | 2016-08-09 | Bml Productions, Inc. | Exercise data collection system |
US10031720B2 (en) | 2015-08-12 | 2018-07-24 | International Business Machines Corporation | Controlling audio tempo based on a target heart rate |
US10953305B2 (en) | 2015-08-26 | 2021-03-23 | Icon Health & Fitness, Inc. | Strength exercise mechanisms |
US10272317B2 (en) | 2016-03-18 | 2019-04-30 | Icon Health & Fitness, Inc. | Lighted pace feature in a treadmill |
US10625137B2 (en) | 2016-03-18 | 2020-04-21 | Icon Health & Fitness, Inc. | Coordinated displays in an exercise device |
US10493349B2 (en) | 2016-03-18 | 2019-12-03 | Icon Health & Fitness, Inc. | Display on exercise device |
US10293211B2 (en) | 2016-03-18 | 2019-05-21 | Icon Health & Fitness, Inc. | Coordinated weight selection |
US10561894B2 (en) | 2016-03-18 | 2020-02-18 | Icon Health & Fitness, Inc. | Treadmill with removable supports |
US10252109B2 (en) | 2016-05-13 | 2019-04-09 | Icon Health & Fitness, Inc. | Weight platform treadmill |
US10441844B2 (en) | 2016-07-01 | 2019-10-15 | Icon Health & Fitness, Inc. | Cooling systems and methods for exercise equipment |
US10471299B2 (en) | 2016-07-01 | 2019-11-12 | Icon Health & Fitness, Inc. | Systems and methods for cooling internal exercise equipment components |
US10671705B2 (en) | 2016-09-28 | 2020-06-02 | Icon Health & Fitness, Inc. | Customizing recipe recommendations |
US10500473B2 (en) | 2016-10-10 | 2019-12-10 | Icon Health & Fitness, Inc. | Console positioning |
US10376736B2 (en) | 2016-10-12 | 2019-08-13 | Icon Health & Fitness, Inc. | Cooling an exercise device during a dive motor runway condition |
US10207148B2 (en) | 2016-10-12 | 2019-02-19 | Icon Health & Fitness, Inc. | Systems and methods for reducing runaway resistance on an exercise device |
US10661114B2 (en) | 2016-11-01 | 2020-05-26 | Icon Health & Fitness, Inc. | Body weight lift mechanism on treadmill |
US10625114B2 (en) | 2016-11-01 | 2020-04-21 | Icon Health & Fitness, Inc. | Elliptical and stationary bicycle apparatus including row functionality |
US10343017B2 (en) | 2016-11-01 | 2019-07-09 | Icon Health & Fitness, Inc. | Distance sensor for console positioning |
US10543395B2 (en) | 2016-12-05 | 2020-01-28 | Icon Health & Fitness, Inc. | Offsetting treadmill deck weight during operation |
US11907037B2 (en) * | 2017-01-09 | 2024-02-20 | Inmusic Brands, Inc. | Systems and methods for providing audio-file loop-playback functionality |
WO2018129407A1 (en) * | 2017-01-09 | 2018-07-12 | Inmusic Brands, Inc. | Systems and methods for providing audio-file loop-playback functionality |
US20210407484A1 (en) * | 2017-01-09 | 2021-12-30 | Inmusic Brands, Inc. | Systems and methods for providing audio-file loop-playback functionality |
KR101947900B1 (en) * | 2017-04-26 | 2019-03-11 | 주식회사 디엔제이휴먼케어 | A method for providing health care services |
KR20180119816A (en) * | 2017-04-26 | 2018-11-05 | 주식회사 디엔제이휴먼케어 | A method for providing health care services |
US11451108B2 (en) | 2017-08-16 | 2022-09-20 | Ifit Inc. | Systems and methods for axial impact resistance in electric motors |
US10729965B2 (en) | 2017-12-22 | 2020-08-04 | Icon Health & Fitness, Inc. | Audible belt guide in a treadmill |
CN108399777A (en) * | 2018-04-13 | 2018-08-14 | 京东方科技集团股份有限公司 | A kind of auxiliary driving method, device and electronic equipment |
CN116248811A (en) * | 2022-12-09 | 2023-06-09 | 北京生数科技有限公司 | Video processing method, device and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20100279822A1 (en) | Systems and methods for optimizing one or more audio tracks to a video stream | |
JP6586144B2 (en) | Athletic monitoring system with automatic pause of media content | |
CA2428812C (en) | Methods and systems for controlling an exercise apparatus using a portable remote device | |
JP6093333B2 (en) | Athletic performance sensing and / or tracking system and method | |
US8758201B2 (en) | Portable physical activity sensing system | |
US7874957B2 (en) | Apparatus for measuring exercise performance | |
US7837595B2 (en) | Controller for an exercise bicycle | |
CA2403752C (en) | Improvements relating to games controllers | |
US8717254B1 (en) | Portable motion sensor and video glasses system for displaying a real time video display to a user while exercising | |
US20150238817A1 (en) | Exercise system | |
US20050075213A1 (en) | Exercise device independent, variable display rate visual exercise system | |
WO2002015985A1 (en) | Systems and methods for interaction with exercise device | |
CN109908551A (en) | A kind of bicycle exercise method and device | |
JP2002272890A (en) | System and method for universal exercise | |
Berezan et al. | SoundRunner: Out of the Starting Blocks | |
Chander et al. | A virtual reality based system for a more engaging indoor exercise biking experience | |
Tian | The Practice of Physical Training Based on Virtual Trainer Concept | |
Saito et al. | Enhancing Intrinsic Motivation for Walking Exercises with a Virtual Reality System | |
TW201023941A (en) | Device for controlling the progression of at least one environmental data sequence, corresponding method and computer program product | |
WO2002015988A1 (en) | Computer systems and methods for interaction with exercise device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: VIRTUAL ACTIVE, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FORD, JOHN HAJIME;REEL/FRAME:023749/0593 Effective date: 20091217 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |