CN1598767A - Method and system for synchronous playing audio-video at BREW platform - Google Patents

Method and system for synchronous playing audio-video at BREW platform Download PDF

Info

Publication number
CN1598767A
CN1598767A CN 200410009566 CN200410009566A CN1598767A CN 1598767 A CN1598767 A CN 1598767A CN 200410009566 CN200410009566 CN 200410009566 CN 200410009566 A CN200410009566 A CN 200410009566A CN 1598767 A CN1598767 A CN 1598767A
Authority
CN
China
Prior art keywords
data
video
audio
playing
time stamp
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200410009566
Other languages
Chinese (zh)
Other versions
CN1292345C (en
Inventor
黄小鹏
丁力
萧学文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN 200410009566 priority Critical patent/CN1292345C/en
Publication of CN1598767A publication Critical patent/CN1598767A/en
Application granted granted Critical
Publication of CN1292345C publication Critical patent/CN1292345C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to an approach of synchronous playing audio and video in BREW platform. It includes: setting a data receiving module to connect with network; setting triggering incident of data receiving to receive data from network and storage into data zone; setting an audio playing module to check data in audio data zone, playing audio data and update time stamp of audio playing by using periodic incident to trigger in process of playing audio data; setting a video playing module to check data in video data zone, decode video data, convert video data format to local format, adjust video and audio synchronization, display video data, and what's more, to adjust interval among video frames to realize synchronistically play audio and video data and guarantee its fluency and timely responsibility.

Description

The method and system of synchronously playing audio frequency video on binary runtime environment for wireless
Technical field
The present invention relates to the multi-media communication technical field, relate in particular to the method that on the binary runtime environment for wireless mobile phone, realizes the synchronously playing audio frequency video.
Background technology
BREW is the abbreviation of Binary Runtime Environment for Wireless, is the general-purpose platform that provides for wireless data application program development and execution.
The BREW runtime environment is thin software interface layer, is positioned on the wireless device between chip system software and application program, makes the final user can the wireless downloading program and move enabling on the equipment of BREW.BREW has higher flash memory and RAM service efficiency (that is, its shared flash memory is less), and when application program is moved dynamic assignment RAM.BREW provides efficient, low-cost, as can to expand and a be familiar with application execution environment (AEE), one highly integrated chipset function, system software of cover and the plug-in unit that is used to realize senior Internet function and multimedia function, the application program that exploitation can any actual handheld device of seamless implantation emphatically.The function environment that BREW provides is just as the operating system on the PC, can use by application program or recreation that the service provider downloads specified type.Simultaneously, by the BREW interface function, supplier may be provided in cover complete information, commercial affairs, amusement function.BREW is mainly used in moving communicating field, the free PC operating system of the similar opening of BREW, and manufacturer can design every application on this platform.
Because the BREW environment is not supported the singularity of multithreading and platform own, the mode that realizes multimedia audio video data synchronous playing under windows or Linux environment can't realize in the BREW environment, in order to realize multimedia synchronous playing, must use incident technology.
Summary of the invention
Technical matters to be solved by this invention be to provide a kind of on binary runtime environment for wireless the method and system of synchronously playing audio frequency video, be implemented in and realize the synchronously playing audio frequency video data in the BREW environment, and guarantee its fluency and timely response.
To achieve these goals, the invention provides a kind of method that on binary runtime environment for wireless, realizes the synchronously playing audio frequency video, comprising:
One data reception module is set, is used for connecting, the Data Receiving trigger event is set, receive the data of automatic network, and store the data field into network;
One audio playing module is set, is used to check the data of audio data region, playing audio-fequency data, and in the process of playing audio-fequency data, utilize recurrent event to trigger the timestamp that regularly upgrades voice playing;
One video playback module is set, be used to check the video data district data, decode video data, with the format conversion of video data be native format, regulate video and audio frequency synchronously, display video data.
The described setting in the audio playing module, when checking audio zone, when finding that voice data is play inadequately, system forwards to and waits for triggering.
The mode that described wait triggers is that Event triggered or timer trigger.
Incident in the described Event triggered is the Data Receiving trigger event in the data stream receiver module.
The step that described timer triggers comprises:
The audio frequency waiting timer is set;
The audio frequency waiting timer time arrives.
The step of described voice playing comprises:
Whether step 61, inspection voice data are enough play; When voice data is enough, just forward step 63 to;
Step 61, the condition that wait for to trigger is set, when trigger condition satisfies, returns step 61;
Step 63, playing audio-fequency data, and when playing audio-fequency data, recurrent event triggers upgrades the voice playing timestamp.
Step 64, voice playing are finished and are returned step 61.
Described voice playing step comprises that also in the recurrent event triggering that begins to be provided with the voice playing time of voice playing part, in the process of playing audio-fequency data, recurrent event triggers the timestamp that regularly upgrades voice playing.
Described video playback step comprises:
Whether step 801, inspection receive frame complete video data; When receiving frame complete video data, forward step 803 to;
Step 802, the condition that wait for to trigger is set, when condition satisfies, forwards step 801 to;
The video data that step 803, decoding receive;
Step 804, the complete BITMAP form bitmap of formation;
Step 805, bitmap-converted become the form of mobile phone this locality;
The difference of step 806, comparison video time stamp and audio time stamp is if difference in allowed band, forwards step 810 to;
In advance whether step 807, comparison video time stamp audio time stamp, if forward step 809 to;
Step 808, return step 801;
Step 809, the leading timer of video is set, timer time is to forwarding step 806 to;
Step 810, show this frame data, return step 801.
In scope, can also further regulate the frame period of video data in the difference of step 806 video time stamp and audio time stamp.
The step of the frame period of described adjusting video data comprises:
Step 101, relatively accurate reproduction time of video and current time, ask when video is accurately play after, execution in step 102, the accurate reproduction time of video jumps to step 104 preceding;
Step 102, the difference timer is set;
Step 103, difference timer time arrive;
Step 104, frame period are regulated and are finished.
Including synchronously of described adjusting video and audio frequency:
The difference of video time stamp and audio time stamp within the range of permission, adjusting is finished;
The difference of video time stamp and audio time stamp is regulated the frame period of video data within the range of permission, and adjusting is finished;
The difference of video time stamp and audio time stamp not within the range of permission, and the leading audio time stamp of video time stamp is provided with the leading timer of video, timer time arrives, adjusting is finished;
The difference of video time stamp and audio time stamp not within the range of permission, and video time stamp falls behind audio time stamp, adjusting is finished;
After described step 803, described step 804, step 805, step 806, can increase timer in short-term, timer time in short-term to after carry out next step again.
The mode that the described wait of step 802 triggers is that Event triggered or timer trigger.
The invention also discloses a kind of system that realizes the synchronously playing audio frequency video on binary runtime environment for wireless, described system comprises data reception module, audio playing module and video playback module; Wherein:
Data reception module is used for realizing connecting with network, and the Data Receiving trigger event is set, and receives the data of automatic network, and stores the data field into;
Audio playing module is used to realize checking the data of audio data region, and playing audio-fequency data in the process of playing audio-fequency data, utilizes recurrent event to trigger the timestamp that regularly upgrades voice playing;
The video playback module, be used to realize checking data, decode video data, the converting video frequency data in video data district form, regulate video and audio frequency synchronously and display video data.
Described trigger condition comprises that Event triggered or timer trigger.
The present invention is implemented in and realizes the synchronously playing audio frequency video data in the BREW environment, and guarantees its fluency and timely response.
Description of drawings
Figure 1 shows that the process flow diagram that network data receives trigger event is set;
Figure 2 shows that the process flow diagram that data stream receives;
Figure 3 shows that the process flow diagram that voice data is play;
Figure 4 shows that the process flow diagram that the audio frequency timer triggers;
Figure 5 shows that the process flow diagram that video data is play;
Figure 6 shows that the process flow diagram that the video timer triggers;
Figure 7 shows that and regulate video display frame process flow diagram at interval.
Embodiment
Describe the present invention below in conjunction with the drawings and specific embodiments, but not as a limitation of the invention.
Because binary runtime environment for wireless do not support multithreading, to realize that at binary runtime environment for wireless the synchronism of audio frequency and video will use the technology based on incident and Time Triggered, be achieved as follows the function of three big modules: data stream receiver module, audio playing module and video playback module.
The data stream receiver module, the main data of being responsible for receiving automatic network.Its function comprises: network data is set receives trigger event; With after having data to arrive, system produces the Data Receiving trigger event, begins to receive data subsequently.
Fig. 1 is provided with the process flow diagram that network data receives trigger event for the data stream receiver module.
In step S101, be connected with server by binary runtime environment for wireless.
In step S102, the Data Receiving trigger event is set.This can be provided with by call function ISOCKET_Readable.
Fig. 2 is after having data to arrive binary runtime environment for wireless, the process flow diagram of receiving data stream.
In step S201, there are data to arrive binary runtime environment for wireless.
In step S202, system produces the Data Receiving trigger event.
In step S203, begin from network receiving stream media data.
In step S204, the voice data in the data stream that receives is put in the audio data region, video data is put in the video data district.
Step S205 is the starting point of voice playing and video playback.
When new data arrived, binary runtime environment for wireless can produce new Data Receiving trigger event automatically, repeats Data Receiving step as shown in Figure 2.
Audio playing module is responsible for playing audio-fequency data.
The process flow diagram that Fig. 3 plays for voice data.
Step S301 in process flow diagram shown in Figure 3, promptly the starting point of voice data playing flow can be the position A of Data Receiving flow chart step S205 shown in Figure 2.
In step S302, check whether the data of audio data region are enough play.The condition of whether enough playing is how many voice datas in audio data district has, or how long the data of audio data region can be play.This value user can set up on their own, as enough playing for 3 seconds.If the voice data of audio data region is play inadequately, jump to step S303 so; If enough playing, data jump to step S304.
In step S303, the arrival of system wait trigger event.After trigger condition satisfies, jump to step S302, continue to check whether the data of audio data region are enough play.The condition that triggers can be an Event triggered, as the Data Receiving trigger event in the data stream receiver module, also can be that timer triggers.Figure 4 shows that the process flow diagram that the audio frequency timer triggers.
In step S304, upgrade audio time stamp.
In step S306, playing audio-fequency data.
In step S307, play voice data after, jump to step S302 and continue to check whether voice data is enough play.
In the starting position of Fig. 3 voice playing process flow diagram, the recurrent event that the voice playing time can be set triggers, and in the process of playing audio-fequency data, the periodic triggers incident satisfies back (S305) in trigger condition, upgrades the timestamp (S304) of voice playing.This timestamp is by the reference of video playback module as reproduction time.The voice data that 500 milliseconds of every broadcasts in the voice playing for example can be set just triggers an incident.Trigger if the recurrent event of voice playing time is set, then the voice data of 1000 milliseconds of every broadcasts of system default just triggers an incident.In the process of voice playing, the timestamp of voice playing since periodic Event triggered by regular renewal.For example, the current time stamp is 1000 milliseconds, and the voice data of crossing 500 milliseconds just triggers an incident, and update of time stamp is 1500 milliseconds after the Event triggered.
The process flow diagram that Fig. 4 triggers for the audio frequency timer.In Fig. 4, audio frequency waiting timer (S401) is set, after the audio frequency waiting timer time arrives (S402), go again to check whether enough data (S302) are arranged in the audio data region.
The video playback module is responsible for playing video data.
The process flow diagram that Fig. 5 plays for video data.
Step S501 in process flow diagram shown in Figure 5, promptly the starting point of video data playing flow can be the position A of Data Receiving flow chart step S205 shown in Figure 2.
At step S502, check whether the data in video data district reach the complete video data of a frame, if the complete video data of the not enough frame of the data of video area jumps to step S503 and waits for triggering; If the enough complete video data of a frame of the data of video area, execution in step S504.
At step S503, the arrival of system wait trigger event.After trigger condition satisfies, forward S502 to and continue to check whether the data in video data district reach the complete video data of a frame.The condition that triggers in step S503 can be an Event triggered, as the Data Receiving trigger event in the data stream receiver module, also can be that timer triggers.Be illustrated in figure 6 as the process flow diagram that the video timer triggers.
In step S504, the enough complete video datas of a frame of the data in video data district, this frame video data of decoding.
In step S505, the data that decoding is come out form a complete BITMAP form bitmap.
In step S506, the BITMAP form bitmap that forms among the step S505 is converted to the form of mobile phone this locality.
In step S507, calculate the difference of video time stamp and audio time stamp, judge audio frequency current playing time stamp and this frame of video timestamp difference (also deserving to be called and stating difference is synchronous error) whether in allowed limits.For example the allowed band of video time stamp and audio time stamp difference can be set between positive and negative 100 milliseconds.
When the difference of video time stamp and audio time stamp not in allowed limits the time, forward step S508 to, judge whether leading audio time stamp of video time stamp.During the leading audio time stamp of video time stamp, according to the difference of video time stamp and audio time stamp the leading timer of video (S509) is set, the leading timer time of video is (S510) then, thereby guarantees synchronous error in allowed limits; When video time stamp falls behind audio time stamp, show that this frame video data is nonsensical, abandon this video data, forward S502 then to and continue to check whether the video data district has the complete video data of a frame.
When the difference of video time stamp and audio time stamp in allowed limits the time, show that this frame video data (S511) forwards step S502 then to and continues to check whether video area has the complete video data of a frame.
In as Fig. 6, video waiting timer (S601) at first is set, after the video waiting timer time arrives (S602), check in the video data district whether the complete video data of a frame (S502) is arranged.
After step S504, step S505, step S506, step S507, can increase timer in short-term, the step below after timer time arrives in short-term, carrying out again.For example, behind this frame video of promptly decoding, 10 milliseconds timer in short-term is set at step S504,10 milliseconds of times to after again execution in step S505 form complete BITMAP form bitmap.Can make mobile phone button request of relative users in time still etc. in the displaying video audio stream like this.
In order to make video playback smooth more, the synchronous error that not only requires voice data and video data also requires the time interval basically identical between any two frame videos in allowed limits.In order to achieve the above object, when synchronous error is in allowed band, can also further regulates frame period and show this frame video data.
Under the situation of audio video synchronization, the time that the time that video accurately shows equals the previous frame demonstration adds the frame period time.The frame period time equals the inverse of frame per second.For example per second shows 5 frame video datas, and the frame period time is 200 milliseconds.In actual play, be good at cannot say for sure between demonstrate,proving two frames shows the mistiming absolutely accurate equal the frame period time, therefore, can set frame of video error interval time (being called the frame period error) allowed band.When the frame period error between two frames in allowed limits the time, think time interval basically identical between the two frame videos, i.e. the broadcast of two frame videos is smooth.It is ± 10% that frame period error allowed band for example is set, and promptly when mistiming that two frames show during at 200 milliseconds, the error range of permission is positive and negative 20 milliseconds.
Fig. 7 is for regulating video display frame process flow diagram at interval.
In Fig. 7, the difference of video time stamp and audio time stamp (S701) in allowed band at first; Judge whether the current time be ahead of the accurate reproduction time of video (S702), the current time directly shows this frame video data (S705) when lagging behind the accurate reproduction time of video; During the accurate reproduction time of leading video of current time, difference timer (S703) is set, the difference timer time shows this frame video data (S705) to (S704).After showing this frame video data (S705), recording played timestamp (S706).In Fig. 7, step S702, S703, S704, S705, the common configuration frame of S706 be adjustment module B at interval.
The difference of the difference timer that is provided with in step S703 satisfies following two conditions:
Condition one, synchronous error are in allowed band; With
Condition two, frame period error are in allowed band.
Condition one can guarantee that video data and voice data are synchronous; Condition two can guarantee video data frame period basically identical, thereby obtains smooth video effect.
In the process of video playback, if select to regulate frame period, can use the step S511 among the frame period adjustment module B replacement Fig. 5 among Fig. 7 so, and when video time stamp falls behind audio time stamp, forward to before the step S706, the recording of video reproduction time stabs, thereby realizes the synchronously playing audio frequency video data in the BREW environment.
Be below on mobile phone, use another embodiment of method audio plays of the present invention and video based on binary runtime environment for wireless.
At first mobile phone is connected with server, and the calling system function is provided with network data and receives trigger event then.
When flow to the BREW terminal that reaches mobile phone from data in server after, system can produce the Data Receiving trigger event, begins to receive data subsequently.Two data fields of system assignment, one is audio data region, one is the video data district.The data stream that arrives the BREW terminal is analyzed, the data of video are put into the video data district, voice data is put into audio data region.
The condition that enough broadcasts for example are set is that the data of audio data region can be play for 5 seconds continuously.Check whether the data of audio data region are enough play.The data of check result discovery audio data region only can play for 3 seconds, and it was 2 seconds that the audio frequency waiting timer is set.After 2 seconds, the audio frequency timer time arrived, check once more whether the data of audio data region are enough.The data of check result audio data region can be play 5 seconds.
The data in playing audio-fequency data district.Finish playing, continue then to check whether audio data region has enough voice datas.
In the recurrent event triggering that begins to be provided with the voice playing time of voice playing, the voice data that for example every broadcast is 500 milliseconds just triggers an incident.In the process of playing audio-fequency data, the timestamp of voice playing since periodic Event triggered by regular renewal, as stabbing now is 1000, just trigger an incident through 500 milliseconds voice datas, after the triggering, update of time stamp is 1500, and after 500 milliseconds, update of time stamp is 2000.
During video playback, check earlier whether the data in video data district reach the complete video data of a frame,, wait for and triggering if not enough.Trigger condition selects for use timer to trigger at this.1 second of video waiting timer for example is set.After 1 second, go again to check whether data are enough.
Behind the data in the video data district video data that enough a frame is complete, just call this frame video of decoder decode.The data that decoding is come out become the color space of RGB24 position by color space transformation, in complete BITMAP form bitmap content of memory field tissue formation, are the form of mobile phone this locality again with this bitmap-converted.
Whether within the range of permission to compare synchronous error subsequently.For example the allowed band of synchronous error is set in positive and negative 100 milliseconds.If the timestamp of audio frequency is 2000, the timestamp of video is 2050, so just can directly show this frame video data.
If whether in advance synchronous error not in allowed limits, will judge video time stamp audio time stamp.When the leading audio time stamp of video time stamp, for example, the timestamp of audio frequency is 2000, the timestamp of video is 2150, and promptly leading (2150-2000)=150 of video millisecond are provided with 150 milliseconds timer this moment, after this timer time arrives, show this frame video again.
When video time stamp fell behind audio time stamp, for example, the timestamp of audio frequency was 2000, and the timestamp of video is 1850, in this case, shows that this frame video data is nonsensical, therefore abandoned this frame data.
In order to make video playback smoothness more, need further to regulate frame period.
For example, per second 5 frame video images are set on the BREW terminal, the frame period time is 200 milliseconds, sets frame period error range ± 10%, and the mistiming that promptly allows the demonstration of two frames is between 200 milliseconds positive and negative 20 milliseconds.
When the time of N frame video playback is 2050, and then the accurate reproduction time of (N+1) frame video should be 2250.If the timestamp of current video is 2230, frame of video is leading 20 milliseconds so, and therefore the frame period error can directly show the video data of present frame within the scope (± 20 milliseconds) that error allows.Or the timestamp of current video is 2220, and frame of video is leading 30 milliseconds so, and the frame period error has surpassed the scope that error allows, and the value that then needs to be provided with the difference timer is 30 milliseconds, regulating frame period, thereby guarantees the video image smoothness play.After the difference timer time arrives, show this frame video.If the timestamp of current video is 2260, expression has lagged behind the accurate demonstration time, then directly shows this frame video.After having shown this frame video data, the value of recording of video timestamp.
At this frame video of decoding, form complete BITMAP form bitmap, with bitmap-converted be the form of mobile phone this locality and show these four steps of this frame video after increase by 10 milliseconds timer, after 10 milliseconds are arrived, continue the step below the execution again.Can make mobile phone in the displaying video audio stream, still can in time respond button request of user etc. like this.
After handling frame data, continue to check the situation in video data district.
Certainly; the present invention also can have other various embodiments; under the situation that does not deviate from spirit of the present invention and essence thereof; those of ordinary skill in the art work as can make various corresponding changes and distortion according to the present invention, but these corresponding changes and distortion all should belong to the protection domain of the appended claim of the present invention.

Claims (15)

1. method that realizes the synchronously playing audio frequency video on binary runtime environment for wireless is characterized in that described method comprises:
One data reception module is set, is used for connecting, the Data Receiving trigger event is set, receive the data of automatic network, and store the data field into network;
One audio playing module is set, is used to check the data of audio data region, playing audio-fequency data, and in the process of playing audio-fequency data, utilize recurrent event to trigger the timestamp that regularly upgrades voice playing;
One video playback module is set, be used to check the video data district data, decode video data, with the format conversion of video data be native format, regulate video and audio frequency synchronously, display video data.
2. the method that realizes the synchronously playing audio frequency video on binary runtime environment for wireless according to claim 1 is characterized in that, the described setting in the audio playing module, and when checking audio zone, when finding that voice data is play inadequately, system forwards to and waits for triggering.
3. the method that realizes the synchronously playing audio frequency video on binary runtime environment for wireless according to claim 2 is characterized in that, the mode that described wait triggers is that Event triggered or timer trigger.
4. the method that realizes the synchronously playing audio frequency video on binary runtime environment for wireless according to claim 3 is characterized in that the incident in the described Event triggered is the Data Receiving trigger event in the data stream receiver module.
5. the method that realizes the synchronously playing audio frequency video on binary runtime environment for wireless according to claim 3 is characterized in that, the step that described timer triggers comprises:
The audio frequency waiting timer is set;
The audio frequency waiting timer time arrives.
6. method according to claim 1 is characterized in that, the step of described voice playing comprises:
Whether step 61, inspection voice data are enough play; When voice data is enough, just forward step 63 to;
Step 62, the condition that wait for to trigger is set, when trigger condition satisfies, returns step 61;
Step 63, playing audio-fequency data, and when playing audio-fequency data, recurrent event triggers upgrades the voice playing timestamp.
Step 64, voice playing are finished and are returned step 61.
7. method according to claim 6, it is characterized in that described voice playing step also comprises, in the recurrent event triggering that begins to be provided with the voice playing time of voice playing part, in the process of playing audio-fequency data, recurrent event triggers the timestamp that regularly upgrades voice playing.
8. method according to claim 1 is characterized in that, described video playback step comprises:
Whether step 801, inspection receive frame complete video data; When receiving frame complete video data, forward step 803 to;
Step 802, the condition that wait for to trigger is set, when condition satisfies, forwards step 801 to;
The video data that step 803, decoding receive;
Step 804, the complete BITMAP form bitmap of formation;
Step 805, bitmap-converted become the form of mobile phone this locality;
The difference of step 806, comparison video time stamp and audio time stamp is if difference in allowed band, forwards step 810 to;
In advance whether step 807, comparison video time stamp audio time stamp, if forward step 809 to;
Step 808, return step 801;
Step 809, the leading timer of video is set, timer time is to forwarding step 806 to;
Step 810, show this frame data, return step 801.
9. method according to claim 8 is characterized in that, in scope, can also further regulate the frame period of video data in the difference of step 806 video time stamp and audio time stamp.
10. method according to claim 9 is characterized in that, the step of the frame period of described adjusting video data comprises:
Step 101, relatively accurate reproduction time of video and current time, the accurate reproduction time of video after, execution in step 102, the accurate reproduction time of video jumps to step 104 preceding;
Step 102, the difference timer is set;
Step 103, difference timer time arrive;
Step 104, frame period are regulated and are finished.
11. method according to claim 1 is characterized in that, the including synchronously of described adjusting video and audio frequency:
The difference of video time stamp and audio time stamp within the range of permission, adjusting is finished;
The difference of video time stamp and audio time stamp is regulated the frame period of video data within the range of permission, and adjusting is finished;
The difference of video time stamp and audio time stamp not within the range of permission, and the leading audio time stamp of video time stamp is provided with the leading timer of video, timer time arrives, adjusting is finished;
The difference of video time stamp and audio time stamp not within the range of permission, and video time stamp falls behind audio time stamp, adjusting is finished;
12. method according to claim 8 is characterized in that, can increase timer in short-term after described step 803, described step 804, step 805, step 806, timer time in short-term to after carry out next step again.
13. method according to claim 8 is characterized in that, the mode that the described wait of step 802 triggers is that Event triggered or timer trigger.
14. a system that realizes the synchronously playing audio frequency video on binary runtime environment for wireless is characterized in that described system comprises data reception module, audio playing module and video playback module; Wherein:
Data reception module is used for realizing connecting with network, and the Data Receiving trigger event is set, and receives the data of automatic network, and stores the data field into;
Audio playing module is used to realize checking the data of audio data region, and playing audio-fequency data in the process of playing audio-fequency data, utilizes recurrent event to trigger the timestamp that regularly upgrades voice playing;
The video playback module, be used to realize checking data, decode video data, the converting video frequency data in video data district form, regulate video and audio frequency synchronously and display video data.
15. the system that realizes the synchronously playing audio frequency video on binary runtime environment for wireless according to claim 14 is characterized in that, described trigger condition comprises that Event triggered or timer trigger.
CN 200410009566 2004-09-15 2004-09-15 Method and system for synchronous playing audio-video at BREW platform Expired - Fee Related CN1292345C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200410009566 CN1292345C (en) 2004-09-15 2004-09-15 Method and system for synchronous playing audio-video at BREW platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200410009566 CN1292345C (en) 2004-09-15 2004-09-15 Method and system for synchronous playing audio-video at BREW platform

Publications (2)

Publication Number Publication Date
CN1598767A true CN1598767A (en) 2005-03-23
CN1292345C CN1292345C (en) 2006-12-27

Family

ID=34662534

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200410009566 Expired - Fee Related CN1292345C (en) 2004-09-15 2004-09-15 Method and system for synchronous playing audio-video at BREW platform

Country Status (1)

Country Link
CN (1) CN1292345C (en)

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100499823C (en) * 2006-02-15 2009-06-10 中国科学院声学研究所 Method for realizing MXF video file and PCM audio file synchronous broadcasting
CN101964903A (en) * 2010-10-11 2011-02-02 陕西赛瑞德科技发展有限责任公司 Method for synchronously playing audio and video streaming media in wireless environment
CN102413335A (en) * 2010-09-20 2012-04-11 深圳Tcl新技术有限公司 Manual adjustment device and method for program audio and video synchronization
CN102420840A (en) * 2010-09-27 2012-04-18 西安龙飞软件有限公司 Method for realizing brew-based Http (Hyper Text Transport Protocol) progressive video player
CN101118776B (en) * 2007-08-21 2012-09-05 中国科学院计算技术研究所 Method, system and device for realizing audio and video data synchronizing
CN105187688A (en) * 2015-09-01 2015-12-23 福建富士通信息软件有限公司 Method and system for carrying out synchronization on real-time video and audio collected by mobile phone
US9544707B2 (en) 2014-02-06 2017-01-10 Sonos, Inc. Audio output balancing
US9549258B2 (en) 2014-02-06 2017-01-17 Sonos, Inc. Audio output balancing
US9658820B2 (en) 2003-07-28 2017-05-23 Sonos, Inc. Resuming synchronous playback of content
US9681223B2 (en) 2011-04-18 2017-06-13 Sonos, Inc. Smart line-in processing in a group
US9729115B2 (en) 2012-04-27 2017-08-08 Sonos, Inc. Intelligently increasing the sound level of player
US9734242B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices that independently source digital data
US9748646B2 (en) 2011-07-19 2017-08-29 Sonos, Inc. Configuration based on speaker orientation
US9749760B2 (en) 2006-09-12 2017-08-29 Sonos, Inc. Updating zone configuration in a multi-zone media system
US9756424B2 (en) 2006-09-12 2017-09-05 Sonos, Inc. Multi-channel pairing in a media system
US9766853B2 (en) 2006-09-12 2017-09-19 Sonos, Inc. Pair volume control
US9787550B2 (en) 2004-06-05 2017-10-10 Sonos, Inc. Establishing a secure wireless network with a minimum human intervention
US9977561B2 (en) 2004-04-01 2018-05-22 Sonos, Inc. Systems, methods, apparatus, and articles of manufacture to provide guest access
US10031716B2 (en) 2013-09-30 2018-07-24 Sonos, Inc. Enabling components of a playback device
US10061379B2 (en) 2004-05-15 2018-08-28 Sonos, Inc. Power increase based on packet type
US10134314B2 (en) 2011-11-30 2018-11-20 Intel Corporation Reducing power for 3D workloads
US10306364B2 (en) 2012-09-28 2019-05-28 Sonos, Inc. Audio processing adjustments for playback devices based on determined characteristics of audio content
US10359987B2 (en) 2003-07-28 2019-07-23 Sonos, Inc. Adjusting volume levels
US10613817B2 (en) 2003-07-28 2020-04-07 Sonos, Inc. Method and apparatus for displaying a list of tracks scheduled for playback by a synchrony group
US11106424B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11106425B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US11294618B2 (en) 2003-07-28 2022-04-05 Sonos, Inc. Media player system
US11403062B2 (en) 2015-06-11 2022-08-02 Sonos, Inc. Multiple groupings in a playback system
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
US11481182B2 (en) 2016-10-17 2022-10-25 Sonos, Inc. Room association based on name
US11650784B2 (en) 2003-07-28 2023-05-16 Sonos, Inc. Adjusting volume levels
US11894975B2 (en) 2004-06-05 2024-02-06 Sonos, Inc. Playback device connection

Cited By (137)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10209953B2 (en) 2003-07-28 2019-02-19 Sonos, Inc. Playback device
US11650784B2 (en) 2003-07-28 2023-05-16 Sonos, Inc. Adjusting volume levels
US11635935B2 (en) 2003-07-28 2023-04-25 Sonos, Inc. Adjusting volume levels
US11625221B2 (en) 2003-07-28 2023-04-11 Sonos, Inc Synchronizing playback by media playback devices
US11556305B2 (en) 2003-07-28 2023-01-17 Sonos, Inc. Synchronizing playback by media playback devices
US11550536B2 (en) 2003-07-28 2023-01-10 Sonos, Inc. Adjusting volume levels
US11550539B2 (en) 2003-07-28 2023-01-10 Sonos, Inc. Playback device
US11301207B1 (en) 2003-07-28 2022-04-12 Sonos, Inc. Playback device
US9658820B2 (en) 2003-07-28 2017-05-23 Sonos, Inc. Resuming synchronous playback of content
US11294618B2 (en) 2003-07-28 2022-04-05 Sonos, Inc. Media player system
US11200025B2 (en) 2003-07-28 2021-12-14 Sonos, Inc. Playback device
US9727302B2 (en) 2003-07-28 2017-08-08 Sonos, Inc. Obtaining content from remote source for playback
US11132170B2 (en) 2003-07-28 2021-09-28 Sonos, Inc. Adjusting volume levels
US9727303B2 (en) 2003-07-28 2017-08-08 Sonos, Inc. Resuming synchronous playback of content
US9727304B2 (en) 2003-07-28 2017-08-08 Sonos, Inc. Obtaining content from direct source and other source
US9733891B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Obtaining content from local and remote sources for playback
US9733892B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Obtaining content based on control by multiple controllers
US9733893B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Obtaining and transmitting audio
US9734242B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices that independently source digital data
US9740453B2 (en) 2003-07-28 2017-08-22 Sonos, Inc. Obtaining content from multiple remote sources for playback
US11106425B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11106424B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11080001B2 (en) 2003-07-28 2021-08-03 Sonos, Inc. Concurrent transmission and playback of audio information
US10970034B2 (en) 2003-07-28 2021-04-06 Sonos, Inc. Audio distributor selection
US10963215B2 (en) 2003-07-28 2021-03-30 Sonos, Inc. Media playback device and system
US9778897B2 (en) 2003-07-28 2017-10-03 Sonos, Inc. Ceasing playback among a plurality of playback devices
US9778900B2 (en) 2003-07-28 2017-10-03 Sonos, Inc. Causing a device to join a synchrony group
US9778898B2 (en) 2003-07-28 2017-10-03 Sonos, Inc. Resynchronization of playback devices
US10956119B2 (en) 2003-07-28 2021-03-23 Sonos, Inc. Playback device
US10949163B2 (en) 2003-07-28 2021-03-16 Sonos, Inc. Playback device
US10754613B2 (en) 2003-07-28 2020-08-25 Sonos, Inc. Audio master selection
US10754612B2 (en) 2003-07-28 2020-08-25 Sonos, Inc. Playback device volume control
US10747496B2 (en) 2003-07-28 2020-08-18 Sonos, Inc. Playback device
US10613817B2 (en) 2003-07-28 2020-04-07 Sonos, Inc. Method and apparatus for displaying a list of tracks scheduled for playback by a synchrony group
US10545723B2 (en) 2003-07-28 2020-01-28 Sonos, Inc. Playback device
US10445054B2 (en) 2003-07-28 2019-10-15 Sonos, Inc. Method and apparatus for switching between a directly connected and a networked audio source
US10387102B2 (en) 2003-07-28 2019-08-20 Sonos, Inc. Playback device grouping
US10365884B2 (en) 2003-07-28 2019-07-30 Sonos, Inc. Group volume control
US10359987B2 (en) 2003-07-28 2019-07-23 Sonos, Inc. Adjusting volume levels
US10031715B2 (en) 2003-07-28 2018-07-24 Sonos, Inc. Method and apparatus for dynamic master device switching in a synchrony group
US10324684B2 (en) 2003-07-28 2019-06-18 Sonos, Inc. Playback device synchrony group states
US10303431B2 (en) 2003-07-28 2019-05-28 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US10303432B2 (en) 2003-07-28 2019-05-28 Sonos, Inc Playback device
US10296283B2 (en) 2003-07-28 2019-05-21 Sonos, Inc. Directing synchronous playback between zone players
US10289380B2 (en) 2003-07-28 2019-05-14 Sonos, Inc. Playback device
US10120638B2 (en) 2003-07-28 2018-11-06 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US10282164B2 (en) 2003-07-28 2019-05-07 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US10133536B2 (en) 2003-07-28 2018-11-20 Sonos, Inc. Method and apparatus for adjusting volume in a synchrony group
US10228902B2 (en) 2003-07-28 2019-03-12 Sonos, Inc. Playback device
US10216473B2 (en) 2003-07-28 2019-02-26 Sonos, Inc. Playback device synchrony group states
US10140085B2 (en) 2003-07-28 2018-11-27 Sonos, Inc. Playback device operating states
US10146498B2 (en) 2003-07-28 2018-12-04 Sonos, Inc. Disengaging and engaging zone players
US10157035B2 (en) 2003-07-28 2018-12-18 Sonos, Inc. Switching between a directly connected and a networked audio source
US10157034B2 (en) 2003-07-28 2018-12-18 Sonos, Inc. Clock rate adjustment in a multi-zone system
US10157033B2 (en) 2003-07-28 2018-12-18 Sonos, Inc. Method and apparatus for switching between a directly connected and a networked audio source
US10175930B2 (en) 2003-07-28 2019-01-08 Sonos, Inc. Method and apparatus for playback by a synchrony group
US10175932B2 (en) 2003-07-28 2019-01-08 Sonos, Inc. Obtaining content from direct source and remote source
US10185540B2 (en) 2003-07-28 2019-01-22 Sonos, Inc. Playback device
US10185541B2 (en) 2003-07-28 2019-01-22 Sonos, Inc. Playback device
US10983750B2 (en) 2004-04-01 2021-04-20 Sonos, Inc. Guest access to a media playback system
US11467799B2 (en) 2004-04-01 2022-10-11 Sonos, Inc. Guest access to a media playback system
US11907610B2 (en) 2004-04-01 2024-02-20 Sonos, Inc. Guess access to a media playback system
US9977561B2 (en) 2004-04-01 2018-05-22 Sonos, Inc. Systems, methods, apparatus, and articles of manufacture to provide guest access
US10372200B2 (en) 2004-05-15 2019-08-06 Sonos, Inc. Power decrease based on packet type
US10228754B2 (en) 2004-05-15 2019-03-12 Sonos, Inc. Power decrease based on packet type
US10254822B2 (en) 2004-05-15 2019-04-09 Sonos, Inc. Power decrease and increase based on packet type
US10126811B2 (en) 2004-05-15 2018-11-13 Sonos, Inc. Power increase based on packet type
US11733768B2 (en) 2004-05-15 2023-08-22 Sonos, Inc. Power control based on packet type
US11157069B2 (en) 2004-05-15 2021-10-26 Sonos, Inc. Power control based on packet type
US10303240B2 (en) 2004-05-15 2019-05-28 Sonos, Inc. Power decrease based on packet type
US10061379B2 (en) 2004-05-15 2018-08-28 Sonos, Inc. Power increase based on packet type
US11456928B2 (en) 2004-06-05 2022-09-27 Sonos, Inc. Playback device connection
US9866447B2 (en) 2004-06-05 2018-01-09 Sonos, Inc. Indicator on a network device
US10097423B2 (en) 2004-06-05 2018-10-09 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
US11025509B2 (en) 2004-06-05 2021-06-01 Sonos, Inc. Playback device connection
US11894975B2 (en) 2004-06-05 2024-02-06 Sonos, Inc. Playback device connection
US11909588B2 (en) 2004-06-05 2024-02-20 Sonos, Inc. Wireless device connection
US9960969B2 (en) 2004-06-05 2018-05-01 Sonos, Inc. Playback device connection
US10439896B2 (en) 2004-06-05 2019-10-08 Sonos, Inc. Playback device connection
US10979310B2 (en) 2004-06-05 2021-04-13 Sonos, Inc. Playback device connection
US10965545B2 (en) 2004-06-05 2021-03-30 Sonos, Inc. Playback device connection
US9787550B2 (en) 2004-06-05 2017-10-10 Sonos, Inc. Establishing a secure wireless network with a minimum human intervention
US10541883B2 (en) 2004-06-05 2020-01-21 Sonos, Inc. Playback device connection
CN100499823C (en) * 2006-02-15 2009-06-10 中国科学院声学研究所 Method for realizing MXF video file and PCM audio file synchronous broadcasting
US10966025B2 (en) 2006-09-12 2021-03-30 Sonos, Inc. Playback device pairing
US9766853B2 (en) 2006-09-12 2017-09-19 Sonos, Inc. Pair volume control
US10228898B2 (en) 2006-09-12 2019-03-12 Sonos, Inc. Identification of playback device and stereo pair names
US11385858B2 (en) 2006-09-12 2022-07-12 Sonos, Inc. Predefined multi-channel listening environment
US9860657B2 (en) 2006-09-12 2018-01-02 Sonos, Inc. Zone configurations maintained by playback device
US9813827B2 (en) 2006-09-12 2017-11-07 Sonos, Inc. Zone configuration based on playback selections
US11388532B2 (en) 2006-09-12 2022-07-12 Sonos, Inc. Zone scene activation
US10848885B2 (en) 2006-09-12 2020-11-24 Sonos, Inc. Zone scene management
US9749760B2 (en) 2006-09-12 2017-08-29 Sonos, Inc. Updating zone configuration in a multi-zone media system
US11082770B2 (en) 2006-09-12 2021-08-03 Sonos, Inc. Multi-channel pairing in a media system
US10897679B2 (en) 2006-09-12 2021-01-19 Sonos, Inc. Zone scene management
US10469966B2 (en) 2006-09-12 2019-11-05 Sonos, Inc. Zone scene management
US10306365B2 (en) 2006-09-12 2019-05-28 Sonos, Inc. Playback device pairing
US10555082B2 (en) 2006-09-12 2020-02-04 Sonos, Inc. Playback device pairing
US11540050B2 (en) 2006-09-12 2022-12-27 Sonos, Inc. Playback device pairing
US10136218B2 (en) 2006-09-12 2018-11-20 Sonos, Inc. Playback device pairing
US9928026B2 (en) 2006-09-12 2018-03-27 Sonos, Inc. Making and indicating a stereo pair
US9756424B2 (en) 2006-09-12 2017-09-05 Sonos, Inc. Multi-channel pairing in a media system
US10448159B2 (en) 2006-09-12 2019-10-15 Sonos, Inc. Playback device pairing
US10028056B2 (en) 2006-09-12 2018-07-17 Sonos, Inc. Multi-channel pairing in a media system
CN101118776B (en) * 2007-08-21 2012-09-05 中国科学院计算技术研究所 Method, system and device for realizing audio and video data synchronizing
CN102413335A (en) * 2010-09-20 2012-04-11 深圳Tcl新技术有限公司 Manual adjustment device and method for program audio and video synchronization
CN102420840A (en) * 2010-09-27 2012-04-18 西安龙飞软件有限公司 Method for realizing brew-based Http (Hyper Text Transport Protocol) progressive video player
CN101964903A (en) * 2010-10-11 2011-02-02 陕西赛瑞德科技发展有限责任公司 Method for synchronously playing audio and video streaming media in wireless environment
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
US11758327B2 (en) 2011-01-25 2023-09-12 Sonos, Inc. Playback device pairing
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US9686606B2 (en) 2011-04-18 2017-06-20 Sonos, Inc. Smart-line in processing
US11531517B2 (en) 2011-04-18 2022-12-20 Sonos, Inc. Networked playback device
US9681223B2 (en) 2011-04-18 2017-06-13 Sonos, Inc. Smart line-in processing in a group
US10108393B2 (en) 2011-04-18 2018-10-23 Sonos, Inc. Leaving group and smart line-in processing
US10853023B2 (en) 2011-04-18 2020-12-01 Sonos, Inc. Networked playback device
US10965024B2 (en) 2011-07-19 2021-03-30 Sonos, Inc. Frequency routing based on orientation
US9748647B2 (en) 2011-07-19 2017-08-29 Sonos, Inc. Frequency routing based on orientation
US11444375B2 (en) 2011-07-19 2022-09-13 Sonos, Inc. Frequency routing based on orientation
US9748646B2 (en) 2011-07-19 2017-08-29 Sonos, Inc. Configuration based on speaker orientation
US10256536B2 (en) 2011-07-19 2019-04-09 Sonos, Inc. Frequency routing based on orientation
US10134314B2 (en) 2011-11-30 2018-11-20 Intel Corporation Reducing power for 3D workloads
US9729115B2 (en) 2012-04-27 2017-08-08 Sonos, Inc. Intelligently increasing the sound level of player
US10063202B2 (en) 2012-04-27 2018-08-28 Sonos, Inc. Intelligently modifying the gain parameter of a playback device
US10720896B2 (en) 2012-04-27 2020-07-21 Sonos, Inc. Intelligently modifying the gain parameter of a playback device
US10306364B2 (en) 2012-09-28 2019-05-28 Sonos, Inc. Audio processing adjustments for playback devices based on determined characteristics of audio content
US10031716B2 (en) 2013-09-30 2018-07-24 Sonos, Inc. Enabling components of a playback device
US11816390B2 (en) 2013-09-30 2023-11-14 Sonos, Inc. Playback device using standby in a media playback system
US10871938B2 (en) 2013-09-30 2020-12-22 Sonos, Inc. Playback device using standby mode in a media playback system
US9781513B2 (en) 2014-02-06 2017-10-03 Sonos, Inc. Audio output balancing
US9794707B2 (en) 2014-02-06 2017-10-17 Sonos, Inc. Audio output balancing
US9549258B2 (en) 2014-02-06 2017-01-17 Sonos, Inc. Audio output balancing
US9544707B2 (en) 2014-02-06 2017-01-10 Sonos, Inc. Audio output balancing
US11403062B2 (en) 2015-06-11 2022-08-02 Sonos, Inc. Multiple groupings in a playback system
CN105187688A (en) * 2015-09-01 2015-12-23 福建富士通信息软件有限公司 Method and system for carrying out synchronization on real-time video and audio collected by mobile phone
CN105187688B (en) * 2015-09-01 2018-03-23 福建富士通信息软件有限公司 The method and system that a kind of real-time video and audio to mobile phone collection synchronizes
US11481182B2 (en) 2016-10-17 2022-10-25 Sonos, Inc. Room association based on name

Also Published As

Publication number Publication date
CN1292345C (en) 2006-12-27

Similar Documents

Publication Publication Date Title
CN1292345C (en) Method and system for synchronous playing audio-video at BREW platform
CN1969560A (en) Method and apparatus for programming blackout and retune
CN1262988C (en) Audio video conversion apparatus and method, and audio video conversion program
CN1976431A (en) Control device and method for interacting between media source, amusement system and the same
CN1993927A (en) Multiple services within a channel-identification in a device
CN1242352C (en) Search method for audio-visual programmes or contents on an audio-visual flux containing tables of events distributed by a database
CN1574719A (en) Time-aware best-effort hole-filling retry method and system for network communications
CN1791199A (en) Apparatus and method for combining images in a terminal device
CN1681324A (en) Fast channel change
CN1976443A (en) Phone interactive with television system
CN1694379A (en) Mobile communication system and MBMS service relevant information transfer method for use therewith
CN1697412A (en) Method for sharing audio/video content over network, and structures of sink device, source device, and message
CN1757244A (en) Method and apparatus for switching between shared and individual channels to provide broadcast content services in a wireless telephone network
CN1265639C (en) Mobile phone for TV. teleconference
CN1969478A (en) Communicating control messages for point-to-multipoint service in wireless communication system
CN1783133A (en) Portable-type communication terminal device, distribution server and contents supply system and method
CN1192652C (en) Method for communicating information, receiver, transmitter and system for performing method
CN1627819A (en) Television receiver and network information communication system
CN1729650A (en) Bluetooth broadcast data stream to multiple bluetooth mobile terminals
CN1946162A (en) Method for obtaining EPG and IPTV service system
CN1842192A (en) Method for determining operational setting and its device
CN1956518A (en) Display control apparatus and method, recording medium, and program therefor
CN1416648A (en) Methods and appts. for banner information digital TV service and receivers therefor
CN1859526A (en) Method for realizing stream media aualogue live telecast
CN1901666A (en) Mobile communication terminal and method of video communications thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20061227

Termination date: 20120915