CN104822008A

CN104822008A - Video synchronizing method and device

Info

Publication number: CN104822008A
Application number: CN201410171896.XA
Authority: CN
Inventors: 李大龙
Original assignee: Tencent Technology Beijing Co Ltd
Current assignee: Tencent Technology Beijing Co Ltd
Priority date: 2014-04-25
Filing date: 2014-04-25
Publication date: 2015-08-05
Anticipated expiration: 2034-04-25
Also published as: CN104822008B

Abstract

The invention discloses a video synchronizing method and a device. The method comprises the steps of acquiring current system time when decoding of a current video data frame is finished, and preset play time when the current video data frame is played; according to the difference value of the current system time and the play time, updating global synchronization parameters, so as to obtain updated global synchronization parameters; acquiring synchronization operation corresponding to the updated global synchronization parameters; and performing synchronization operation on hind video data frame behind the current video data frame, so as to reduce the difference value between the current system time when decoding of the hind video data frame is finished and the preset play time when the hind video data frame is played. The method solves the technical problem of seriously unsmooth play of the video in the prior art.

Description

Video synchronization method and device

Technical field

The present invention relates to MultiMedia Field, in particular to a kind of video synchronization method and device.

Background technology

In media file format agreement ripe in the market, all contain some temporal informations to define player with which kind of speed and when put and show corresponding Voice & Video information.Specifically, the interval of display speed or consecutive frame is defined respectively by the signal sampling rate of audio frequency, the image frame per second of video.Certainly, if it is obviously inadequate for carrying out synchronized audio/video simply by the mode of frame number and frame per second.So as a supplement, DTS (DecodingTime-Stamp is contained in audio-video code stream, decoded time stamp) and PTS (Presentation Time-Stamp, Presentation Time Stamp) mechanism, wherein, DTS defines the decode time point of these frame data, and PTS defines the play time of these frame data.Consider that current major video coding all have employed hybrid encoding frame, and often make use of bi-directional predictive coding technology to improve compression efficiency, therefore the coded sequence of cine-oriented image and decoding order are different.Namely what DTS mechanism solved is the inconsistent problem (there is not this problem to audio stream) of this encoding and decoding order, PTS then exactly defines the play time of data, thus the problem of holding and realizing picture or sound continuity can play, and implicitly establish the logic corresponding relation of audio, video data simultaneously.

Audio-visual synchronization, namely waits for or drop policy by implementing certain audio, video data, it is shown according to the speed preset and time point.Otherwise, when not according to the speed preset or time point display, be just called step-out (or claiming, lock-out).The picture and the sound that now typically show as synchronization appearance in film do not meet logic corresponding relation.Traditional audio-visual synchronization is divided into two parts: 1) after display one two field picture or sound, starts a program timer, stops timing, show this two field picture or sound simultaneously when its timing reaches the PTS of next frame image or sound; 2) according to after DTS completes decoding in media file, find that present system time has exceeded the PTS of this two field picture or sound, then carry out discard processing.

The commercial operation system (as: Windows of Microsoft, the Mac OSX of apple and the Linux/Unix/Android etc. increased income) of current main-stream is all the multi-task parallel operating system based on timeslice/priority scheduling, user may run multiple program or service, so even if also can may differ totally different for the computational resource of media player in the course of the twinkling of an eye in section at one time.The time point of such audio, video data after having decoded, the difference between audio & video and between itself and system time may also can change greatly in time.Additionally, for online streaming media service, the factors such as nondeterministic network shake, time delay and packet loss also can aggravate gap between real time point and the PTS of definition.Especially, rapidly, the custom of viewing film is extended by PC desktop or has been transformed on mobile device by a lot of user in smart mobile phone and mobile Internet development in recent years.And the asynchronous risk of mobile device limited computational resource when more can aggravate audio and video playing.Based on this, the strategy that namely non-black that traditional audio and video synchronization method uses i.e. white, non-camp abandons occurs greatly reducing the phenomenon that serious card is disconnected user and play experience changing can easily cause during video playback under system environments faster.

For above-mentioned problem, at present effective solution is not yet proposed.

Summary of the invention

Embodiments provide a kind of video synchronization method and device, during at least to solve displaying video in prior art, there is the technical problem of the phenomenon that comparatively serious card breaks.

According to an aspect of the embodiment of the present invention, provide a kind of video synchronization method, comprising: the reproduction time obtaining present system time when decoding completes to current video data frame and default broadcasting current video data frame; Upgrade global synchronization parameter according to the difference between present system time and reproduction time, obtain the global synchronization parameter after upgrading; Obtain the simultaneous operation corresponding with the global synchronization parameter after renewal; To after current video data frame rear video Frame perform simultaneous operation, to reduce the difference between the reproduction time of rear video Frame to the present system time when rear video Frame completes decoding and default broadcasting.

Alternatively, obtain the simultaneous operation corresponding with the global synchronization parameter after renewal to comprise: if the step-out degree that the global synchronization parameter after upgrading indicates is greater than the step-out degree that the global synchronization parameter before renewal indicates, then obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, perform simultaneous operation reduce to the time of decoding at rear video Frame be greater than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Alternatively, obtain the simultaneous operation corresponding with the global synchronization parameter after renewal to comprise: if the step-out degree that the global synchronization parameter after upgrading indicates is less than the step-out degree that the global synchronization parameter before renewal indicates, then obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, perform simultaneous operation reduce to the time of decoding at rear video Frame be less than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Alternatively, it is characterized in that, to perform at rear video Frame simultaneous operation comprise following one of at least: skip the broadcasting to current video data frame; Skip the decoding to the B frame in rear video Frame; Skip the loop filtering operation in the video decoding operation carried out at rear video Frame; Skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame.

Alternatively, comprise one of following to performing simultaneous operation at rear video Frame: when being more than or equal to first threshold when global synchronization parameter and being less than Second Threshold, skip the decoding to the B frame in rear video Frame; When global synchronization parameter is more than or equal to Second Threshold and is less than the 3rd threshold value, skip the decoding to the B frame in rear video Frame and the broadcasting of skipping current video data frame; When global synchronization parameter is more than or equal to the 3rd threshold value and is less than the 4th threshold value, skip the decoding to the B frame in rear video Frame, skip the loop filtering operation in the video decoding operation carried out at rear video Frame and the broadcasting of skipping current video data frame; When global synchronization parameter is more than or equal to the 4th threshold value, skips the broadcasting of current video data frame and skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame; Wherein, the step-out degree of the value of global synchronization parameter larger expression global synchronization parameter instruction is larger.

Alternatively, upgrade global synchronization parameter according to the difference between present system time and reproduction time and comprise: if difference is more than or equal to the 5th threshold value, then the value of the global synchronization parameter before renewal is increased; If difference is less than the 5th threshold value, then the value of the global synchronization parameter before renewal is reduced.

Alternatively, if the difference of difference and the 5th threshold value is larger, then the numerical value increased the value of global synchronization parameter before upgrading is larger.

According to the another aspect of the embodiment of the present invention, additionally provide a kind of video synchronization device, comprising: the first acquiring unit, for obtaining the reproduction time of present system time when completing decoding to current video data frame and default broadcasting current video data frame; Updating block, for upgrading global synchronization parameter according to the difference between present system time and reproduction time, obtains the global synchronization parameter after upgrading; Second acquisition unit, for obtain with upgrade after simultaneous operation corresponding to global synchronization parameter; Lock unit, for after current video data frame rear video Frame perform simultaneous operation, to reduce the difference between the reproduction time of rear video Frame to the present system time when rear video Frame completes decoding and default broadcasting.

Alternatively, second acquisition unit comprises: the first acquisition module, when step-out degree for global synchronization parameter instruction is in the updated greater than the step-out degree of the instruction of the global synchronization parameter before renewal, obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, perform simultaneous operation reduce to the time of decoding at rear video Frame be greater than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Alternatively, second acquisition unit comprises: the second acquisition module, when step-out degree for global synchronization parameter instruction is in the updated less than the step-out degree of the instruction of the global synchronization parameter before renewal, obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, perform simultaneous operation reduce to the time of decoding at rear video Frame be less than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Alternatively, lock unit comprises skips module, skips module for performing the operation of following at least one: skip the broadcasting to current video data frame; Skip the decoding to the B frame in rear video Frame; Skip the loop filtering operation in the video decoding operation carried out at rear video Frame; Skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame.

Alternatively, skipping module comprises one of following: first skips submodule, for when global synchronization parameter is more than or equal to first threshold and is less than Second Threshold, skips the decoding to the B frame in rear video Frame; Second skips submodule, during for being more than or equal to Second Threshold when global synchronization parameter and being less than the 3rd threshold value, skips the decoding to the B frame in rear video Frame and the broadcasting of skipping current video data frame; 3rd skips submodule, during for being more than or equal to the 3rd threshold value when global synchronization parameter and being less than the 4th threshold value, skip the decoding to the B frame in rear video Frame, skip the loop filtering operation in the video decoding operation carried out at rear video Frame and the broadcasting of skipping current video data frame; Submodule is crossed in the forth jump, for when global synchronization parameter is more than or equal to the 4th threshold value, skips the broadcasting of current video data frame and skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame; Wherein, the step-out degree of the value of global synchronization parameter larger expression global synchronization parameter instruction is larger.

Alternatively, updating block comprises: the first update module, during for being more than or equal to the 5th threshold value in difference, increases the value of the global synchronization parameter before renewal; Second update module, during for being less than the 5th threshold value in difference, reduces the value of the global synchronization parameter before renewal.

In the video synchronization method provided in the embodiment of the present invention and device, current audio video synchronization or step-out is weighed whether and the order of severity by difference between the system time of decoded video data frame and reproduction time PTS, and dynamic conditioning is implemented on the policy grounds of simple " namely non-camp abandons ", abandoned by single, frame-skipping process changes corresponding simultaneous operation into, such as, skip decoding B frame, skip loop filtering operation, skip in the current GOP frame set to current video data frame place the decoding at rear video Frame after being positioned at current video data frame, to realize stepped, damage the target of service, thus " ground of trying one's best " ensure that video frame rate under the prerequisite ensureing audio video synchronization, improve the video breaking phenomenon because the factors such as system resource cause, and then when solving displaying video in prior art, there is the technical problem of the phenomenon that comparatively serious card breaks.

Accompanying drawing explanation

Accompanying drawing described herein is used to provide a further understanding of the present invention, and form a application's part, schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:

Fig. 1 is the flow chart of the method for a kind of optional audio video synchronization according to the embodiment of the present invention;

Fig. 2 is the schematic diagram of the method for a kind of optional audio video synchronization according to the embodiment of the present invention;

Fig. 3 is the schematic diagram of the method according to the optional audio video synchronization of the another kind of the embodiment of the present invention;

Fig. 4 is the schematic diagram of the method for another optional audio video synchronization according to the embodiment of the present invention;

Fig. 5 is the schematic diagram of the method for another optional audio video synchronization according to the embodiment of the present invention;

Fig. 6 is the schematic diagram of the device of a kind of optional audio video synchronization according to the embodiment of the present invention; And

Fig. 7 is the schematic diagram of the device of a kind of optional audio video synchronization according to the embodiment of the present invention.

Embodiment

The present invention program is understood better in order to make those skilled in the art person, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the embodiment of a part of the present invention, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, should belong to the scope of protection of the invention.

It should be noted that, term " first ", " second " etc. in specification of the present invention and claims and above-mentioned accompanying drawing are for distinguishing similar object, and need not be used for describing specific order or precedence.Should be appreciated that the data used like this can be exchanged in the appropriate case, so as embodiments of the invention described herein can with except here diagram or describe those except order implement.In addition, term " comprises " and " having " and their any distortion, intention is to cover not exclusive comprising, such as, contain those steps or unit that the process of series of steps or unit, method, system, product or equipment is not necessarily limited to clearly list, but can comprise clearly do not list or for intrinsic other step of these processes, method, product or equipment or unit.

Embodiment 1

According to the embodiment of the present invention, provide a kind of video synchronization method, as shown in Figure 1, the method comprises:

S102, obtains the reproduction time of present system time when completing decoding to current video data frame and default broadcasting current video data frame;

Alternatively, in the present embodiment, above-mentioned video synchronization method can be applied in media player, alternatively, video synchronization method in the present embodiment also can be applied to audio sync, or the audio synchronization method in the present embodiment can adopt synchronization scenario of the prior art, and the application does not limit this.

Alternatively, in the present embodiment, video data frame includes but not limited to: B frame, wherein multiple video data frames of the above-mentioned B of comprising frame constitute a GOP (Group Of Pictures, image collection) frame set, wherein, the set of GOP frame refers in video data frame sequence from all frame set a key frame (or also claiming I frame) to next key frame.Further, B frame is bi-directional predicted frames, and bi-directional predicted frames is exactly both with reference to the former frame on this frame time, also with reference to the rear frame on this frame time.Alternatively, a frame in the present embodiment can represent piece image.

For example, Fig. 2 shows multiple continuous video data frame F1, F2, F3, F4, F5, F6, F7, F8 in media player, and wherein, F1, F2, F3, F4 belong to a GOP frame set, F5, F6, F7, F8 belong to the 2nd GOP frame set, and F2, F4, F8 are B frame.Suppose that F1 is current video data frame, then F2, F3, F4 be positioned at current video data frame F1 in a GOP frame set after at rear video Frame, F2-F8 be F1 after at rear video Frame, by that analogy, the present embodiment does not repeat them here other situations.

S104, upgrades global synchronization parameter according to the difference between present system time and reproduction time, obtains the global synchronization parameter after upgrading;

Alternatively, difference between present system time in the present embodiment and reproduction time is with positive and negative attribute, if above-mentioned difference is positive number, then represent present system time T0 and lagged behind default reproduction time PTS, need to take to abandon, the strategy such as frame-skipping to be to avoid showing the video data frame of " out-of-date "; Otherwise, then represent present system time leading or equal the reproduction time PTS of default broadcasting current video data frame, need to wait for until this video data frame can be shown after reaching reproduction time PTS.

Alternatively, global synchronization parameter in the present embodiment can be, but not limited to by mark mark, and above-mentioned mark can have a span, and such as, minimum value is 0, maximum is 30.Object is in such a way, total score is 0, then represent that current media player is without the need to using any abandoning or frame-skipping strategy, waits for until reach the reproduction time PTS of default broadcasting current video data frame.And owing to necessarily needing to wait for (otherwise video data can be demonstrated early than PTS, is equally also nonsynchronous performance), so logically global synchronization parameter is that negative is without any meaning.Accordingly, when above-mentioned mark forward value is to maximum, then can represents that current video has seriously lost synchronously, need to carry out the process such as frame-skipping immediately.That is, in the present embodiment, the step-out degree of the larger expression of the value of global synchronization parameter described global synchronization parameter instruction is larger.It should be noted that, corresponding relation between the step-out degree that the value of above-mentioned global synchronization parameter and global synchronization parameter indicate is only a kind of example, the application can also represent above-mentioned relation by other means, such as, the step-out degree of the less expression of the value described global synchronization parameter instruction of global synchronization parameter is larger, and the application does not limit this.

Alternatively, in the present embodiment, the renewal threshold value of corresponding global synchronization parameter can be set according to the difference between present system time with reproduction time, such as, table 1 shows a kind of corresponding relation of the renewal threshold value of difference between present system time and reproduction time and global synchronization parameter, wherein, time difference (1 second=1000000 microsecond) in units of microsecond.Be understandable that, corresponding relation shown in table 1 is a kind of example, also arranges other corresponding relation according to the actual requirements, such as, can arrange the size of the time difference scope different from table 1 and the renewal threshold value corresponding to different difference range, the application does not limit this.

Table 1

(Delta=TO-PTS) time difference	The renewal threshold value of global synchronization parameter
		Delta>＝200000	+20
2000000>Delta>＝1000000	+15
		100000O＞Delta＞＝500000	+5
50000O＞Delta＞＝-500000	0
		-500000>Delta	-5

Alternatively, based on the corresponding relation shown in above-mentioned table 1, after calculating the difference between present system time and reproduction time, the renewal threshold value corresponding according to this difference upgrades global synchronization parameter, obtains the global synchronization parameter after upgrading.

Alternatively, in the present embodiment, the simultaneous operation of the video data frame that global synchronization parameter is corresponding can be, but not limited to indicate with the controling parameters collection shown in following table 2, wherein, the parameter that above-mentioned controling parameters is concentrated includes but not limited to: the controling parameters (SKIP_GOP) being used to indicate in the present image set GOP skipped current video data frame place the decoding at rear video Frame after being positioned at current video data frame, be used to indicate the controling parameters (SKIP_B_FRAME) skipped the decoding of the B frame in rear video Frame, be used to indicate the controling parameters (SKIP_DEBLOCKING) skipped the loop filtering operation in the video decoding operation carried out at rear video Frame, be used to indicate the controling parameters (SKIP_FRAME) of the broadcasting of skipping current video data frame.

As shown in table 2, the global synchronization parameter S in table 1 identifies, and the step-out degree L of global synchronization parameter instruction identifies, and for representing the step-out degree of current video, the numerical value losing synchronous L is larger, and it is larger that expression loses synchronous degree.

Table 2

Be understandable that, the corresponding relation shown in table 2 is a kind of example, also arranges other corresponding relation according to the actual requirements, such as, can arrange the global synchronization parameter area different from table 2

And the selection of the different step-out degree corresponding to global synchronization parameter area and controling parameters, the application does not limit this.

S106, obtains the simultaneous operation corresponding with the global synchronization parameter after renewal;

Alternatively, simultaneous operation in the present embodiment comprise following one of at least: skip the broadcasting to current video data frame; The decoding of the B frame in rear video Frame after skipping current video data frame; Skip the loop filtering operation in the video decoding operation carried out at rear video Frame; Skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame; Skip current video data frame.

Such as, shown in associative list 1-table 2, suppose that the initial value of global synchronization parameter is 0, difference between present system time T0 when current video data frame completes decoding and the reproduction time PTS of default broadcasting current video data frame is 500000 microseconds, then as shown in Table 1, the renewal threshold value of corresponding global synchronization parameter is+5, namely, the value of global synchronization parameter is updated to 5, further, as shown in Table 2, the step-out degree that current video data frame is corresponding is 2, then corresponding simultaneous operation be skip current video data frame after the decoding of the B frame in rear video Frame.

S108, to after current video data frame rear video Frame perform simultaneous operation.

Alternatively, simultaneous operation is in the present embodiment for reducing described present system time when rear video Frame completes decoding and the difference of default broadcasting between the reproduction time of rear video Frame.

Such as, still in conjunction with above-mentioned example, when upgrading global synchronization parameter S according to the difference between present system time T0 and reproduction time PTS, knowing that the step-out degree that current video data frame is corresponding is 2 according to global synchronization parameter S, needing to carry out frame-skipping.Further, as shown in Table 2, when step-out degree is 2, the simultaneous operation of skipping the decoding of B frame in the execution of rear video Frame after should performing current video data frame.

By the embodiment that the application provides, by the difference between the reproduction time that obtains present system time when completing decoding to current video data frame and default broadcasting current video data frame, obtain the global synchronization parameter after upgrading, wherein, whether and the order of severity global synchronization parameter for weighing current synchronous or step-out (or claiming lock-out), and utilize upgrade after global synchronization parameter to after current video data frame rear video Frame perform simultaneous operation, to reduce to the present system time when rear video Frame completes decoding and default broadcasting the difference between the reproduction time of rear video Frame, thus video frame rate is ensure that with trying one's best under the prerequisite ensureing audio video synchronization, improve the video breaking phenomenon because the factors such as system resource cause.

As the optional scheme of one, step S106, obtains the simultaneous operation corresponding with the global synchronization parameter after renewal and comprises:

S1, if the step-out degree of the global synchronization parameter instruction after upgrading is greater than the step-out degree of the global synchronization parameter instruction before renewal, then obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, the simultaneous operation of above-mentioned acquisition meets the following conditions: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be greater than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Such as, as shown in Figure 2, the multiple continuous video data frames in media player are F1, F2, F3, F4, F5, F6, F7, F8, wherein, F1, F2, F3, F4 belong to a GOP frame set, and F5, F6, F7, F8 belong to the 2nd GOP frame set, and F2, F4, F8 are B frame; Suppose that F1 is current video data frame, then F2, F3, F4 be positioned at current video data frame F1 in a GOP frame set after at rear video Frame, F2-F8 be F1 after at rear video Frame, by that analogy, the present embodiment does not repeat them here other situations.

Suppose, when playing to video data frame F1, according to the difference between present system time T1 and reproduction time PTS1, the value of global synchronization parameter S is updated to 5, corresponding step-out degree is 2, then perform and perform the simultaneous operation of skipping B frame to the posterior video data frame of current video data frame F1.Such as, as shown in Figure 3, the decoding of the B frame F2 after then needing to skip to video data frame F1, alternatively, for B frame F4, then need to determine whether skip again after judging the step-out degree of video data frame F3, alternatively, for B frame F8, then need to determine whether skip again after judging the step-out degree of video data frame F7.

Suppose, when playing to video data frame F3, according to the difference between present system time T3 and reproduction time PTS3, the value of global synchronization parameter S is updated to 12, corresponding step-out degree is 3, the step-out degree 3 that global synchronization parameter S after then upgrading indicates is greater than the step-out degree 2 that the global synchronization parameter S before renewal indicates, the step-out of such expression video is more serious, needs minimizing further in the decode time of rear video Frame and/or the broadcasting of skipping current video data frame.That is, the meeting the following conditions with simultaneous operation corresponding to global synchronization parameter after upgrading of acquisition: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be greater than performs with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.Such as, as shown in Table 2, the decoding of skipping the B frame in rear video Frame should be performed and the broadcasting of skipping current video data frame.Such as, as shown in Figure 4, the video data frame F4 after video data frame F3 is also B frame, then skip the decoding to B frame F4, and skips the broadcasting to current video data frame F3.

By the embodiment that the application provides, the step-out degree of the instruction of the global synchronization parameter before renewal is greater than by the step-out degree comparing the instruction of the global synchronization parameter after learning renewal, known step-out degree strengthens, and then performs corresponding simultaneous operation to video data frame.Like this, by judging the variation tendency of step-out degree, corresponding simultaneous operation is performed to video data frame.

S1, if the step-out degree of the global synchronization parameter instruction after upgrading is less than the step-out degree of the global synchronization parameter instruction before renewal, then obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, the simultaneous operation of above-mentioned acquisition meets the following conditions: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be less than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Suppose, as shown in Figure 2, the multiple continuous video data frames in media player are F1, F2, F3, F4, F5, F6, F7, F8, wherein, F1, F2, F3, F4 belong to a GOP frame set, and F5, F6, F7, F8 belong to the 2nd GOP frame set, and F2, F4, F8 are B frame.Suppose that F1 is current video data frame, then F2, F3, F4 be positioned at current video data frame F1 in a GOP frame set after at rear video Frame, F2-F8 be F1 after at rear video Frame, by that analogy, the present embodiment does not repeat them here other situations.

Based on above-mentioned example, suppose after playing video data frame F1, F3, when playing to video data frame F5, the value of global synchronization parameter S is updated to 6 by the difference between present system time T5 when completing decoding according to video data frame F5 and reproduction time PTS5, corresponding step-out degree is 2, then perform and perform the simultaneous operation of skipping B frame to the posterior video data frame of current video data frame F5.The step-out degree 2 of the global synchronization parameter S instruction after upgrading compared to video data frame F5 is less than the step-out degree 3 of the instruction of the global synchronization parameter S before renewal, the step-out then representing video comparatively before make moderate progress, the simultaneous operation corresponding with the global synchronization parameter after upgrading obtained like this can meet the following conditions: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be less than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.Such as, as shown in table 2, the simultaneous operation of execution changes the simultaneous operation of " perform and perform the decoding of skipping B frame to the posterior video data frame of current video data frame F5 " into from " execution skips decoding to the B frame rear video Frame and the broadcasting of skipping current video data frame ".Further, suppose when playing to video data frame F6, the step-out degree that global synchronization parameter S after renewal indicates is less than the step-out degree upgrading global synchronization parameter S corresponding to front video data frame F5 and indicate, then also can cancel performing the simultaneous operation of skipping B frame to the posterior video data frame of current video data frame F6, namely no longer carrying out the simultaneous operation of skipping decoding or skipping broadcasting.

By the embodiment that the application provides, be less than the step-out degree of the instruction of the global synchronization parameter before renewal by the step-out degree comparing the instruction of the global synchronization parameter after renewal, known step-out degree reduces, and then performs corresponding simultaneous operation to video data frame.Like this, by judging the variation tendency of step-out degree, corresponding simultaneous operation being performed to video data frame, substantially improving user and playing experience.

As the optional scheme of one, to perform at rear video Frame simultaneous operation comprise following one of at least:

S1, skips the decoding to the B frame in rear video Frame;

Alternatively, the decoding of skipping the B frame in rear video Frame in the present embodiment, its objective is: B frame is used for bi-directional predicted, skip decoding B frame can not only save time, output time for follow-up video data is caught up with PTS and is provided possibility, and can not bring impact to the decoding of other video data frames.

S2, skips the loop filtering operation in the video decoding operation carried out at rear video Frame;

Alternatively, in the present embodiment to the loop filtering operation in the video decoding operation carried out at rear video Frame, its objective is: the loop filtering link skipped in video decoding process can realize saving decode time equally, and provides possibility for the output time of subsequent video data frame catches up with PTS.

S3, skips in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame.

Alternatively, in the present embodiment to the decoding at rear video Frame after being positioned at current video data frame in the present image set GOP at current video data frame place.Its objective is: abandon remaining data in GOP, like this, a large amount of decode times can be saved, and provide possibility for the output time of next synchronous point (i.e. the I frame that starts of next GOP or key frame) data catches up with PTS.

Alternatively, the decoding at rear video Frame of skipping in the set of GOP frame after current video data frame is directly performed in the present embodiment in the set of GOP frame, and without the need to judging whether to perform the decoding of skipping the B frame in rear video Frame again, or skip the loop filtering operation in the video decoding operation carried out at rear video Frame.In other words, as long as be included in this GOP set, and be positioned at the video data frame after current video data frame, all will perform the operation of skipping decoding.

Such as, suppose, as shown in Figure 5, the set of present image set the 2nd GOP frame comprises video data frame F5, F6, F7, F8, wherein video data frame F5 is current video data frame, if the step-out degree indicated by global synchronization parameter S satisfies condition, then perform in the present image set GOP skipped current video data frame F5 place the decoding at rear video Frame be positioned at after current video data frame F5, be namely to skip video data frame F6, F7, the F8 in present image set GOP.

Alternatively, also can comprise in the present embodiment and skip current video data frame, its objective is: the data having abandoned already " out-of-date ", prevent image from losing due logic corresponding relation.In addition, system time that image rendering needs can be saved, provide possibility for follow-up audio-visual synchronization of improving.

By the embodiment that the application provides, the policy grounds of simple " namely non-camp abandons " implements dynamic conditioning, by single abandoning, frame-skipping process changes into and skips decoding B frame, skips loop filtering, skips current video data frame until to skip in the set of current GOP frame remaining frame to realize stepped, to damage service target, thus ensure that video frame rate with trying one's best under the prerequisite ensureing audio video synchronization.

As the optional scheme of one, comprise one of following to performing simultaneous operation at rear video Frame:

S1, when global synchronization parameter is more than or equal to first threshold and is less than Second Threshold, skips the decoding to the B frame in rear video Frame;

Alternatively, the step-out degree of the value larger expression global synchronization parameter instruction of global synchronization parameter is in the present embodiment larger.

Such as, shown in associative list 2, suppose that the first threshold of global synchronization parameter is 5, Second Threshold is 10, be then 6 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly be more than or equal to first threshold 5 and be less than Second Threshold 10, then perform the decoding of skipping the B frame in rear video Frame.

S2, when global synchronization parameter is more than or equal to Second Threshold and is less than the 3rd threshold value, skips the decoding to the B frame in rear video Frame and the broadcasting of skipping current video data frame;

Such as, shown in associative list 2, suppose that the Second Threshold of global synchronization parameter is 10,3rd threshold value is 15, be then 12 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly be more than or equal to Second Threshold 10 and be less than the 3rd threshold value 15, then perform the decoding of skipping the B frame in rear video Frame and the broadcasting of skipping current video data frame.

S3, when global synchronization parameter is more than or equal to the 3rd threshold value and is less than the 4th threshold value, skip the decoding to the B frame in rear video Frame, skip the loop filtering operation in the video decoding operation carried out at rear video Frame and the broadcasting of skipping current video data frame;

Such as, shown in associative list 2, the 3rd threshold value supposing global synchronization parameter is 15,4th threshold value is 20, be then 18 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly be more than or equal to the 3rd threshold value 15 and be less than the 4th threshold value 20, then perform skip the B frame in rear video Frame decoding, skip the loop filtering operation in the video decoding operation carried out at rear video Frame and the broadcasting of skipping current video data frame.

S4, when global synchronization parameter is more than or equal to the 4th threshold value, skips the broadcasting of current video data frame and skips in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame;

Such as, shown in associative list 2, the 4th threshold value supposing global synchronization parameter is 20, be then 25 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly to be more than or equal to the 4th threshold value, then perform and skip the broadcasting of current video data frame and skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame.

As the optional scheme of one, upgrade global synchronization parameter according to the difference between present system time and reproduction time and comprise:

S1, if difference is more than or equal to the 5th threshold value, then increases the value of the global synchronization parameter before renewal;

S2, if difference is less than the 5th threshold value, then reduces the value of the global synchronization parameter before renewal.

Alternatively, if the difference of difference and the 5th threshold value is larger in the present embodiment, then the numerical value increased the value of global synchronization parameter before upgrading is larger.

Alternatively, in the present embodiment to the control mode of value of the global synchronization parameter before upgrading can comprise following one of at least: the value directly changing global synchronization parameter; Global synchronization parameter is successively reduced by half operation, until no longer there is the phenomenon of lock-out.

Such as, shown in associative list 1, suppose that the 5th threshold value is-50000 microseconds, then when being that 100000 microseconds are greater than-50000 microseconds according to the difference between present system time and reproduction time, then the value of the global synchronization parameter before renewal is increased, like this, represent that current video data frame lock-out degree is serious, in order to realize saving decode time, and providing possibility for the output time of subsequent video data frame catches up with PTS, needing the degree of execution frame-skipping also will increase.Concrete example explanation, such as, the value of the global synchronization parameter before renewal is 2, increase this value to 4, then need the simultaneous operation performed to be revised as the decoding and the broadcasting of skipping current video data frame of skipping the B frame in rear video Frame by skipping to the decoding of the B frame in rear video Frame.Otherwise, if difference is less than the 5th threshold value-50000 microsecond, then the value of the global synchronization parameter before renewal is reduced.Concrete example explanation, such as, the value of the global synchronization parameter before renewal is 4, reduce this value to 2, then need the simultaneous operation performed to be revised as the decoding of skipping the B frame in rear video Frame by skipping the decoding of the B frame in rear video Frame and skipping to the broadcasting of current video data frame.

By the embodiment that the application provides, by judging the variation tendency of step-out degree, corresponding simultaneous operation being performed to video data frame, substantially improving user and playing experience.

It should be noted that, for aforesaid each embodiment of the method, in order to simple description, therefore it is all expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not by the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in specification all belongs to preferred embodiment, and involved action and module might not be that the present invention is necessary.

Through the above description of the embodiments, those skilled in the art can be well understood to the mode that can add required general hardware platform by software according to the method for above-described embodiment and realize, hardware can certainly be passed through, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computer, server, or the network equipment etc.) perform method described in each embodiment of the present invention.

Embodiment 2

According to the embodiment of the present invention, additionally provide a kind of video synchronization device for implementing above-mentioned video synchronization method, as shown in Figure 6, this device comprises:

(1) first acquiring unit 602, for obtaining the reproduction time of present system time when completing decoding to current video data frame and default broadcasting current video data frame;

(2) updating block 604, for upgrading global synchronization parameter according to the difference between present system time and reproduction time, obtains the global synchronization parameter after upgrading;

Alternatively, difference between present system time in the present embodiment and reproduction time is with positive and negative attribute, if above-mentioned difference is positive number, then represent present system time T0 and lagged behind default reproduction time PTS, need to take to abandon, the strategy such as frame-skipping to be to avoid showing the video data frame of " out-of-date "; Otherwise, then represent present system time leading or equal the broadcasting of default broadcasting current video data frame time PTS, need to wait for until this video data frame can be shown after reaching reproduction time PTS.

Alternatively, in the present embodiment, can arrange the renewal threshold value of corresponding global synchronization parameter according to the difference between present system time with reproduction time, such as, table 3 shows a kind of corresponding relation of the renewal threshold value of difference between present system time and reproduction time and global synchronization parameter.Wherein, time difference (1 second=1000000 microsecond) in units of microsecond.Be understandable that, corresponding relation shown in table 3 is a kind of example, also arranges other corresponding relation according to the actual requirements, such as, can arrange the size of the time difference scope different from table 3 and the renewal threshold value corresponding to different difference range, the application does not limit this.

Table 3

(Delta=T0-PTS) time difference	The renewal threshold value of global synchronization parameter
		Delta>＝200000	+20
2000000>Delta>＝1000000	+15
		1000000>Delta>＝500000	+5
500000>Delta>＝-500000	0
		-500000>Delta	-5

Alternatively, based on the corresponding relation shown in above-mentioned table 3, after calculating the difference between present system time and reproduction time, the renewal threshold value corresponding according to this difference upgrades global synchronization parameter, obtains the global synchronization parameter after upgrading.

Alternatively, in the present embodiment, the simultaneous operation of the video data frame that global synchronization parameter is corresponding can be, but not limited to indicate with the controling parameters collection shown in following table 4, wherein, the parameter that above-mentioned controling parameters is concentrated includes but not limited to: the controling parameters (SKIP_GOP) being used to indicate in the present image set GOP skipped current video data frame place the decoding at rear video Frame after being positioned at current video data frame, be used to indicate the controling parameters (SKIP_B_FRAME) skipped the decoding of the B frame in rear video Frame, be used to indicate the controling parameters (SKIP_DEBLOCKING) skipped the loop filtering operation in the video decoding operation carried out at rear video Frame, be used to indicate the controling parameters (SKIP_FRAME) of the broadcasting of skipping current video data frame.

As shown in table 4, the global synchronization parameter S in table 3 identifies, and the step-out degree L of global synchronization parameter instruction identifies, and for representing the step-out degree of current video, the numerical value losing synchronous L is larger, and it is larger that expression loses synchronous degree.

Table 4

Be understandable that, corresponding relation shown in table 4 is a kind of example, other corresponding relation is also set according to the actual requirements, such as, can arrange the selection of the global synchronization parameter area different from table 4 and the different step-out degree corresponding to global synchronization parameter area and controling parameters, the application does not limit this.

(3) second acquisition unit 606, for obtain with upgrade after simultaneous operation corresponding to global synchronization parameter;

Such as, shown in associative list 3-table 4, suppose that the initial value of global synchronization parameter is 0, difference between present system time T0 when current video data frame completes decoding and the reproduction time PTS of default broadcasting current video data frame is 500000 microseconds, then as shown in Table 3, the renewal threshold value of corresponding global synchronization parameter is+5, namely, the value of global synchronization parameter is updated to 5, further, as shown in Table 4, the step-out degree that current video data frame is corresponding is 2, then corresponding simultaneous operation be skip current video data frame after the decoding of the B frame in rear video Frame.

(4) lock unit 608, for to after current video data frame rear video Frame perform simultaneous operation, to reduce the difference between the reproduction time of rear video Frame to the present system time when rear video Frame completes decoding and default broadcasting.

Such as, still in conjunction with above-mentioned example, when upgrading global synchronization parameter S according to the difference between present system time T0 and reproduction time PTS, knowing that the step-out degree that current video data frame is corresponding is 2 according to global synchronization parameter S, needing to carry out frame-skipping.Further, as shown in Table 4, when step-out degree is 2, the simultaneous operation of skipping the decoding of B frame in the execution of rear video Frame after should performing current video data frame.

As the optional scheme of one, as shown in Figure 7, second acquisition unit 606 comprises:

(1) first acquisition module 702, when step-out degree for global synchronization parameter instruction is in the updated greater than the step-out degree of the instruction of the global synchronization parameter before renewal, obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, the simultaneous operation of above-mentioned acquisition meets the following conditions: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be greater than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Suppose, when playing to video data frame F1, according to the difference between present system time T1 and reproduction time PTS1, the value of global synchronization parameter S is upgraded 5, corresponding step-out degree is 2, then perform and perform the simultaneous operation of skipping B frame to the posterior video data frame of current video data frame F1.Such as, as shown in Figure 3, the decoding of the B frame F2 after then needing to skip to video data frame F1, alternatively, for B frame F4, then need to determine whether skip again after judging the step-out degree of video data frame F3, alternatively, for B frame F8, then need to determine whether skip again after judging the step-out degree of video data frame F7.

Suppose, when playing to video data frame F3, value according to the known global synchronization parameter S of the difference between present system time T3 and reproduction time PTS3 upgrades 12, corresponding step-out degree is 3, the step-out degree 3 that global synchronization parameter S after then upgrading indicates is greater than the step-out degree 2 that the global synchronization parameter S before renewal indicates, the step-out of such expression video is more serious, needs minimizing further in the decode time of rear video Frame and/or the broadcasting of skipping current video data frame.That is, the meeting the following conditions with simultaneous operation corresponding to global synchronization parameter after upgrading of acquisition: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be greater than performs with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.Such as, as shown in Table 4, the decoding of skipping the B frame in rear video Frame should be performed and the broadcasting of skipping current video data frame.Such as, as shown in Figure 4, the video data frame F4 after video data frame F3 is also B frame, then skip the decoding to B frame F4, and skips the broadcasting to current video data frame F3.

By the embodiment that the application provides, the step-out degree of the instruction of the global synchronization parameter before renewal is greater than by the step-out degree comparing the instruction of the global synchronization parameter after learning renewal, known step-out degree strengthens, and then performs corresponding simultaneous operation to video data frame.Like this, by judging the variation tendency of step-out degree, corresponding simultaneous operation being performed to video data frame, substantially improving user and playing experience.

As the optional scheme of one, as shown in Figure 7, second acquisition unit 606 also comprises:

(1) second acquisition module 704, when step-out degree for global synchronization parameter instruction is in the updated less than the step-out degree of the instruction of the global synchronization parameter before renewal, obtain the simultaneous operation corresponding with the global synchronization parameter after renewal, wherein, the simultaneous operation of above-mentioned acquisition meets the following conditions: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be less than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.

Based on above-mentioned example, suppose after playing video data frame F1, F3, when playing to video data frame F5, the value of global synchronization parameter S is updated to 6 by the difference between present system time T5 when completing decoding according to video data frame F5 and reproduction time PTS5, corresponding step-out degree is 2, then perform and perform the simultaneous operation of skipping B frame to the posterior video data frame of current video data frame F5.The step-out degree 2 of the global synchronization parameter S instruction after upgrading compared to video data frame F5 is less than the step-out degree 3 of the instruction of the global synchronization parameter S before renewal, the step-out then representing video comparatively before make moderate progress, the simultaneous operation corresponding with the global synchronization parameter after upgrading obtained like this can meet the following conditions: the simultaneous operation performing above-mentioned acquisition reduce to the time of decoding at rear video Frame be less than perform with renewal before global synchronization parameter corresponding first simultaneous operation reduce to the time of decoding at rear video Frame.Such as, as shown in table 4, the simultaneous operation performed, from " execution skips decoding to the B frame rear video Frame and the broadcasting of skipping current video data frame ", changes " perform perform skip the decoding of B frame to current video data frame F5 posterior video data frame " simultaneous operation into.Further, suppose when playing to video data frame F6, the step-out degree that global synchronization parameter S after renewal indicates is less than the step-out degree upgrading global synchronization parameter S corresponding to front video data frame F5 and indicate, then also can cancel performing the simultaneous operation of skipping B frame to the posterior video data frame of current video data frame F6, namely no longer carrying out the simultaneous operation of skipping decoding or skipping broadcasting.

As the optional scheme of one, lock unit 608 comprises skips module, skips module for performing the operation of following at least one:

(1) decoding to the B frame in rear video Frame is skipped;

(2) skip the loop filtering operation in the video decoding operation carried out at rear video Frame;

(3) decoding at rear video Frame after being positioned at current video data frame is skipped in the present image set GOP to current video data frame place.

As the optional scheme of one, skip module and comprise one of following:

(1) first skips submodule, for when global synchronization parameter is more than or equal to first threshold and is less than Second Threshold, skips the decoding to the B frame in rear video Frame;

Such as, shown in associative list 4, suppose that the first threshold of global synchronization parameter is 5, Second Threshold is 10, be then 6 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly be more than or equal to first threshold 5 and be less than Second Threshold 10, then perform the decoding of skipping the B frame in rear video Frame.

(2) second skip submodule, during for being more than or equal to Second Threshold when global synchronization parameter and being less than the 3rd threshold value, skip the decoding to the B frame in rear video Frame and the broadcasting of skipping current video data frame;

Such as, shown in associative list 4, suppose that the Second Threshold of global synchronization parameter is 10,3rd threshold value is 15, be then 12 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly be more than or equal to Second Threshold 10 and be less than the 3rd threshold value 15, then perform the decoding of skipping the B frame in rear video Frame and the broadcasting of skipping current video data frame.

(3) the 3rd skip submodule, during for being more than or equal to the 3rd threshold value when global synchronization parameter and being less than the 4th threshold value, skip the decoding to the B frame in rear video Frame, skip the loop filtering operation in the video decoding operation carried out at rear video Frame and the broadcasting of skipping current video data frame;

Such as, shown in associative list 4, the 3rd threshold value supposing global synchronization parameter is 15,4th threshold value is 20, be then 18 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly be more than or equal to the 3rd threshold value 15 and be less than the 4th threshold value 20, then perform skip the B frame in rear video Frame decoding, skip the loop filtering operation in the video decoding operation carried out at rear video Frame and the broadcasting of skipping current video data frame.

(4) submodule is crossed in the forth jump, for when global synchronization parameter is more than or equal to the 4th threshold value, skips the broadcasting of current video data frame and skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame;

Such as, shown in associative list 4, the 4th threshold value supposing global synchronization parameter is 20, be then 25 by current video data frame according to the known corresponding global synchronization parameter S of the difference between present system time with reproduction time, judge knownly to be more than or equal to the 4th threshold value, then perform and skip the broadcasting of current video data frame and skip in the present image set GOP to current video data frame place the decoding at rear video Frame after being positioned at current video data frame.

As the optional scheme of one, updating block 604 comprises:

(1) first update module, during for being more than or equal to the 5th threshold value in difference, increases the value of the global synchronization parameter before renewal;

(2) second update module, during for being less than the 5th threshold value in difference, reduce the value of the global synchronization parameter before renewal.

Alternatively, in the present embodiment can to the control mode of value of the global synchronization parameter before upgrading comprise following one of at least: the value directly changing global synchronization parameter; Global synchronization parameter is successively reduced by half operation, until no longer there is the phenomenon of lock-out.

Such as, shown in associative list 3, suppose that the 5th threshold value is-50000 microseconds, then when being that 100000 microseconds are greater than-50000 microseconds according to the difference between present system time and reproduction time, then the value of the global synchronization parameter before renewal is increased, like this, represent that current video data frame lock-out degree is serious, in order to realize saving decode time, and providing possibility for the output time of subsequent video data frame catches up with PTS, needing the degree of execution frame-skipping also will increase.Concrete example explanation, such as, the value of the global synchronization parameter before renewal is 2, increase this value to 4, then need the simultaneous operation performed to be revised as the decoding and the broadcasting of skipping current video data frame of skipping the B frame in rear video Frame by skipping to the decoding of the B frame in rear video Frame.Otherwise, if difference is less than the 5th threshold value-50000 microsecond, then the value of the global synchronization parameter before renewal is reduced.Concrete example explanation, such as, the value of the global synchronization parameter before renewal is 4, reduce this value to 2, then need the simultaneous operation performed to be revised as the decoding of skipping the B frame in rear video Frame by skipping the decoding of the B frame in rear video Frame and skipping to the broadcasting of current video data frame.

The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.

In the above embodiment of the present invention, the description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.

In several embodiments that the application provides, should be understood that, disclosed client, the mode by other realizes.Wherein, device embodiment described above is only schematic, the such as division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of unit or module or communication connection can be electrical or other form.

The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.

If described integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprises all or part of step of some instructions in order to make a computer equipment (can be personal computer, server or the network equipment etc.) perform method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), portable hard drive, magnetic disc or CD etc. various can be program code stored medium.

The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.

Claims

1. a video synchronization method, is characterized in that, comprising:

Obtain the reproduction time of present system time when decoding completes to current video data frame and the described current video data frame of default broadcasting;

Upgrade global synchronization parameter according to the difference between described present system time and described reproduction time, obtain the global synchronization parameter after upgrading;

Obtain the simultaneous operation corresponding with the global synchronization parameter after described renewal;

To performing described simultaneous operation at rear video Frame after described current video data frame, to reduce the difference described in described present system time when rear video Frame completes decoding and default broadcasting between the reproduction time of rear video Frame.

2. method according to claim 1, is characterized in that, the described acquisition simultaneous operation corresponding with the global synchronization parameter after described renewal comprises:

If the step-out degree of the global synchronization parameter instruction after described renewal is greater than the step-out degree of the global synchronization parameter instruction before renewal, then obtain the described simultaneous operation corresponding with the global synchronization parameter after described renewal, wherein, perform that described simultaneous operation reduces to the described time of decoding at rear video Frame be greater than perform corresponding with the global synchronization parameter before described renewal first simultaneous operation reduce to the described time of decoding at rear video Frame.

3. method according to claim 1, is characterized in that, the described acquisition simultaneous operation corresponding with the global synchronization parameter after described renewal comprises:

If the step-out degree of the global synchronization parameter instruction after described renewal is less than the step-out degree of the global synchronization parameter instruction before renewal, then obtain the described simultaneous operation corresponding with the global synchronization parameter after described renewal, wherein, perform that described simultaneous operation reduces to the described time of decoding at rear video Frame be less than perform corresponding with the global synchronization parameter before described renewal first simultaneous operation reduce to the described time of decoding at rear video Frame.

4. according to the method in any one of claims 1 to 3, it is characterized in that, described to described rear video Frame perform described simultaneous operation comprise following one of at least:

Skip the broadcasting to described current video data frame;

Skip the decoding to described B frame in rear video Frame;

Skip the loop filtering operation in the described video decoding operation carried out at rear video Frame;

Skip in the present image set GOP to described current video data frame place the decoding at rear video Frame described in after being positioned at current video data frame.

5. method according to claim 4, is characterized in that, describedly performs described simultaneous operation at rear video Frame comprise one of following to described:

When described global synchronization parameter is more than or equal to first threshold and is less than Second Threshold, skip the decoding to described B frame in rear video Frame;

When described global synchronization parameter is more than or equal to described Second Threshold and is less than the 3rd threshold value, skip the decoding to described B frame in rear video Frame and the broadcasting of skipping described current video data frame;

When described global synchronization parameter is more than or equal to described 3rd threshold value and is less than the 4th threshold value, skip the decoding to described B frame in rear video Frame, skip the loop filtering operation in the described video decoding operation carried out at rear video Frame and the broadcasting of skipping described current video data frame;

When described global synchronization parameter is more than or equal to described 4th threshold value, skip the broadcasting of described current video data frame and skip in the present image set GOP to described current video data frame place be positioned at current video data frame after described in the decoding of rear video Frame;

Wherein, the step-out degree of the larger expression of the value described global synchronization parameter instruction of described global synchronization parameter is larger.

6. method according to claim 4, is characterized in that, describedly upgrades global synchronization parameter according to the difference between described present system time and described reproduction time and comprises:

If described difference is more than or equal to the 5th threshold value, then the value of the global synchronization parameter before renewal is increased;

If described difference is less than described 5th threshold value, then the value of the global synchronization parameter before renewal is reduced.

7. method according to claim 6, is characterized in that, if the difference of described difference and described 5th threshold value is larger, then the numerical value increased the value of the global synchronization parameter before described renewal is larger.

8. a video synchronization device, is characterized in that, comprising:

First acquiring unit, for obtaining the reproduction time of present system time when completing decoding to current video data frame and the described current video data frame of default broadcasting;

Updating block, for upgrading global synchronization parameter according to the difference between described present system time and described reproduction time, obtains the global synchronization parameter after upgrading;

Second acquisition unit, for obtaining the simultaneous operation corresponding with the global synchronization parameter after described renewal;

Lock unit, for to performing described simultaneous operation at rear video Frame after described current video data frame, to reduce the difference described in described present system time when rear video Frame completes decoding and default broadcasting between the reproduction time of rear video Frame.

9. device according to claim 8, is characterized in that, described second acquisition unit comprises:

First acquisition module, for after described renewal global synchronization parameter instruction step-out degree be greater than renewal before global synchronization parameter instruction step-out degree time, obtain the described simultaneous operation corresponding with the global synchronization parameter after described renewal, wherein, perform that described simultaneous operation reduces to the described time of decoding at rear video Frame be greater than perform corresponding with the global synchronization parameter before described renewal first simultaneous operation reduce to the described time of decoding at rear video Frame.

10. device according to claim 8, is characterized in that, described second acquisition unit comprises:

Second acquisition module, for after described renewal global synchronization parameter instruction step-out degree be less than renewal before global synchronization parameter instruction step-out degree time, obtain the described simultaneous operation corresponding with the global synchronization parameter after described renewal, wherein, perform that described simultaneous operation reduces to the described time of decoding at rear video Frame be less than perform corresponding with the global synchronization parameter before described renewal first simultaneous operation reduce to the described time of decoding at rear video Frame.

Device according to any one of 11. according to Claim 8 to 10, is characterized in that, described lock unit comprises skips module, described in skip module for perform following at least one operation:

Skip the broadcasting to described current video data frame;

Skip the decoding to described B frame in rear video Frame;

12. devices according to claim 11, is characterized in that, described in skip module and comprise one of following:

First skips submodule, for when described global synchronization parameter is more than or equal to first threshold and is less than Second Threshold, skips the decoding to described B frame in rear video Frame;

Second skips submodule, for when described global synchronization parameter is more than or equal to described Second Threshold and is less than the 3rd threshold value, skips the decoding to described B frame in rear video Frame and the broadcasting of skipping described current video data frame;

3rd skips submodule, during for being more than or equal to described 3rd threshold value when described global synchronization parameter and being less than the 4th threshold value, skip the decoding to described B frame in rear video Frame, skip the loop filtering operation in the described video decoding operation carried out at rear video Frame and the broadcasting of skipping described current video data frame;

Submodule is crossed in the forth jump, for when described global synchronization parameter is more than or equal to described 4th threshold value, skip the broadcasting of described current video data frame and skip in the present image set GOP to described current video data frame place be positioned at current video data frame after described in the decoding of rear video Frame;

13. devices according to claim 11, is characterized in that, described updating block comprises:

First update module, for when described difference is more than or equal to the 5th threshold value, increases the value of the global synchronization parameter before renewal;

Second update module, for when described difference is less than described 5th threshold value, reduces the value of the global synchronization parameter before renewal.