CN101170704B - Labial synchronization testing method and device - Google Patents
Labial synchronization testing method and device Download PDFInfo
- Publication number
- CN101170704B CN101170704B CN2007101779465A CN200710177946A CN101170704B CN 101170704 B CN101170704 B CN 101170704B CN 2007101779465 A CN2007101779465 A CN 2007101779465A CN 200710177946 A CN200710177946 A CN 200710177946A CN 101170704 B CN101170704 B CN 101170704B
- Authority
- CN
- China
- Prior art keywords
- clock
- transmission delay
- delay amount
- sound
- grabgraf
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The invention discloses a synchronous test method for labial sound, belong to the field of labial sound synchronous test technique, which solves the inaccurate problem in the prior art. The inventive technical proposal is that: the sound and image in the test source are synchronous and the image contains displayable clock. The method comprises the following steps: A, initiating an image grabbing instruction when receiving a sound test end hint, grabbing images of the current test; and B, determining the delay of transmission between image and the sound according to the clock information in the grabbed image. The invention also discloses a device for implementing the above method. The inventive method and device has highly-accurate test result and is particularly helpful for the synchronous test of labial sound in system.
Description
Technical field
The present invention relates to the labial simultaneous techniques, relate in particular to synchronous method of testing of a kind of labial and device.
Background technology
At present, multimedia technology has obtained tremendous development, and VCD, DVD, video conference, game on line etc. all relate to multimedia technology.Merged sound and picture signal in the multi-medium data, strict synchronized relation has been arranged between them.Yet, because the coding techniques of sound and picture signal is different, generally need transmit respectively, adopt simultaneous techniques to make it to keep synchronously during transmission.Below sketch its transmission course:
When the Voice ﹠ Video packet left transmitting terminal, packets of audio data was a matched pair with corresponding video packets of data.But by ip router the time, various formation algorithms can carry out different processing with video packets of data to packets of audio data.This will upset the corresponding relation of packets of audio data and corresponding video packets of data, and this has just caused the step-out of labial.Router is congested, and the step-out phenomenon is serious more.
Synchronous in order to guarantee labial, use real time transport protocol (RTP, Real-timeTransport Protocol) the time stamp information in the packet to correct this problem at present.Utilize the RTP time stamp, receiving terminal can determine which packets of audio data with which video packets of data is matched mutually.The corresponding packet that further aligns again will guarantee the synchronous of labial.Even adopted above-mentioned simultaneous techniques, because factors such as processing terminal and transmission channel still can cause the labial asynchrony phenomenon.Labial is a very important index synchronously, directly influences the subjective feeling of user to communication apparatus, system is carried out the synchronous test of labial also just become extremely important.
Present labial synchronous detecting method is generally: in two end of transmitting-receiving, and each stand a tester A and B, wherein, tester A is responsible for the input of test signal, and tester B is responsible for the observation test result.Before tester A is placed on testing lens with hand, allow tester B can see the hand of A; Then, with the finger signal, tester B observes labial synchronous effect, the line item of going forward side by side at far-end simultaneously for tester A from one to ten count off, count off.
Though preceding method is simple, also less demanding without any need for aid to tester's professional skill, there is following shortcoming:
Test result tested person person's subjective factor influence is too big, can't quantize test result, even same tester also is being lack of consistency in the different tests with product, this is unfavorable for the improvement of product very much, can not realize labial synchronism detection accurately.
Summary of the invention
In view of this, main purpose of the present invention is to provide synchronous method of testing of a kind of labial and device, can guarantee that labial synchronism detection result is accurate, and then is beneficial to the improvement of institute's test macro.
For achieving the above object, technical scheme of the present invention is achieved in that
The method of testing that a kind of labial is synchronous, sound in the standard signal source and image synchronization contain displayable clock in the image, and this method may further comprise the steps:
A, startup grabgraf instruction when receiving the prompting of sound EOT are carried out grabgraf to current test pattern;
B, determine transmission delay amount between image and the sound according to the clock information in institute's grabgraf picture.
Wherein, the cycle period of described clock is the cycle signal duration in the standard signal source.
Wherein, determine the transmission delay amount between image and the sound among the step B, be specially:
If the clock indicated value in institute's grabgraf picture is near the clock cycle period, then picture delay is in sound, and the transmission delay amount is the difference of clock cycle period and clock indicated value;
If the clock indicated value in institute's grabgraf picture is zero or much smaller than the clock cycle period, then sound delay time is in image, the transmission delay amount is the clock indicated value in the image.
Wherein, also comprise after the step B:
Repeating step A, step B average to determined transmission delay, with the transmission delay amount of average as the test gained.
The testing apparatus that a kind of labial is synchronous, sound in the standard signal source and image synchronization contain displayable clock in the image, and this device comprises:
The grabgraf unit is used for being activated when receiving the prompting of sound EOT, and current test pattern is carried out grabgraf; And
Transmission delay amount determining unit is determined transmission delay amount between image and the sound according to the clock information in the described grabgraf unit institute grabgraf picture.
Wherein, the cycle period of described clock is the cycle signal duration in the standard signal source.
Wherein, described transmission delay amount determining unit comprises:
Clock indicated value judge module, be used for triggering the first transmission delay amount determination module during near the clock cycle period, be zero or trigger the second transmission delay amount determination module during much smaller than the clock cycle period in the clock indicated value in the clock indicated value of determining institute's grabgraf picture;
The first transmission delay amount determination module be used for the difference of clock cycle period and clock indicated value is defined as the transmission delay amount, and picture delay is in sound; And
The second transmission delay amount determination module be used for the clock indicated value is defined as the transmission delay amount, and sound delay time is in image.
Wherein, this device also comprises:
Transmission delay amount average determining unit is used for the described grabgraf of repeated trigger unit, transmission delay amount determining unit, the determined transmission delay of described transmission delay amount determining unit is averaged, with the transmission delay amount of average as the test gained.
The present invention is by inserting displayable clock in the image of labial test source, standard signal source is made up of the loop test signal, the clock cycle period equals loop test signal duration, when receiving the auditory tone cues of EOT, start the grabgraf instruction current test pattern is carried out grabgraf, owing to comprise clock information in institute's grabgraf picture, utilize clock information and clock cycle period in the present image to compare to determine the transmission delay amount between image and the sound.The present invention uses the test source of standard, and test pattern is carried out grabgraf, and the transmission delay amount that is obtained is not influenced by human factor substantially, and test result is quite accurate, and this will be very beneficial for the synchronous debugging of system to labial.
Description of drawings
Fig. 1 is the flow chart of the synchronous method of testing of labial of the present invention;
Fig. 2 is the composition structural representation of the synchronous testing apparatus of labial of the present invention;
Fig. 3 is the composition structural representation of transmission delay amount determining unit of the present invention.
Embodiment
Core concept of the present invention is: it is excessive that existing labial method of testing is influenced by human factor, and test result is widely different and do not have quantitative criteria, and this is unfavorable for the labial synchronous debugging of system very much.At this problem, the present invention is by inserting displayable clock in the image of labial test source, and the clock cycle period is set equals cycle signal duration in the standard signal source, when receiving the auditory tone cues of EOT, start the grabgraf instruction current test pattern is carried out grabgraf, owing to comprise clock information in institute's grabgraf picture, utilize clock information and clock cycle period in the present image to compare to determine the transmission delay amount between image and the sound.Labial test result of the present invention is quite accurate, and this will be very beneficial for the synchronous debugging of system to labial.Describe the present invention below in conjunction with accompanying drawing.
Fig. 1 is the flow chart of the synchronous method of testing of labial of the present invention, and as shown in Figure 1, the synchronous method of testing of labial of the present invention may further comprise the steps:
Step 101: sound in the standard signal source and image synchronization, contain displayable clock in the image.Test signal of the present invention is the labial test signal of standard, comprising voice signal and picture signal, image and voice signal are any signal, as voice signal is " toot " sound that per second sends, 10 test tones that are spaced apart 1 second are set, promptly 9 " toot " sounds and 1 finish the sound sound that " ticks ", and voice signal is continued to form by aforementioned 10 voice circulation.Include displayable clock in the image, the clock cycle period of this clock equaled the voice circulating continuancing time promptly 10 seconds.As preferred embodiment, test pattern of the present invention only is displayable clock, and circulation continues the composing images signal.Need to prove that the displayable image clock is the Millisecond clock, the accuracy of clock has directly determined labial synchro measure result's accuracy.
Step 102: start the grabgraf instruction when receiving the prompting of sound EOT, current test pattern is carried out grabgraf.After the test beginning, the user is in the reception situation of receiving terminal place monitoring test signal, and the test terminal is equipped with grabgraf software, at any time test pattern is carried out grabgraf.It will be appreciated by those skilled in the art that grabgraf software of the present invention can be existing any grabgraf software, carries out grabgraf as long as can realize to images.When hearing the end sound of test sound, the user starts grabgraf software immediately test pattern is carried out grabgraf.
Step 103: determine transmission delay amount between image and the sound according to the clock information in the step 102 grabgraf picture.The user checks the indication information of clock in institute's grabgraf picture, determines the transmission delay amount between voice signal and the picture signal according to this.If the clock indicated value is 9980 milliseconds in institute's grabgraf picture, approached the clock cycle period 10 seconds, then picture delay is in sound, and the transmission delay amount is 20 milliseconds.If the clock indicated value in institute's grabgraf picture is 25 milliseconds, much smaller than 10 seconds, then sound delay time was in image, and the transmission delay amount is 25 milliseconds.If the clock indicated value in institute's grabgraf picture is 0, then is perfect condition, illustrate between voice signal and the picture signal not postpone.
Step 104: repeating step 102, step 103 many times, determined transmission delay is averaged, with the transmission delay amount of average as the test gained.Here, described average is arithmetic mean or mean square deviation.It will be appreciated by those skilled in the art that step 104 is an optimization step, is optional step.
Fig. 2 is the composition structural representation of the synchronous testing apparatus of labial of the present invention, as shown in Figure 2, the synchronous testing apparatus of labial of the present invention comprises grabgraf unit 20, transmission delay amount determining unit 21 and transmission delay amount average determining unit 22, grabgraf unit 20 is used for being activated when receiving the prompting of sound EOT, and current test pattern is carried out grabgraf.Transmission delay amount determining unit 21 is determined transmission delay amount between image and the sound according to the clock information in 20 the grabgraf pictures in grabgraf unit.Transmission delay amount average determining unit 22 repeated trigger grabgraf unit 20, transmission delay amount determining unit 21 are averaged to transmission delay amount determining unit 21 determined transmission delays, with the transmission delay amount of average as the test gained.
Need to prove that sound and image synchronization in the synchronous employed test source of testing apparatus of labial of the present invention contain displayable clock in the image, equal the cycle signal duration in the standard signal source time-count cycle of clock.Based on same goal of the invention and same technological means, the setting of clock can be referring to the step 101 in the synchronous method of testing of labial of the present invention in picture signal, voice signal and the picture signal.
Fig. 3 is the composition structural representation of transmission delay amount determining unit of the present invention, as shown in Figure 3, transmission delay amount determining unit 21 of the present invention comprises clock indicated value judge module 210, the first transmission delay amount determination module 211 and the second transmission delay amount determination module 212, wherein, trigger the first transmission delay amount determination module 211 during time-count cycle that the clock indicated value of clock indicated value judge module 210 in determining institute's grabgraf picture approaches clock, be 0 or trigger the second transmission delay amount determination module 212 during much smaller than the time-count cycle of clock in the clock indicated value.With the time-count cycle of aforesaid clock be 10 seconds and image clock accuracy to be 1 millisecond be example, if 9980 milliseconds of clock indicated values, then picture delay is in sound, if the clock indicated value in institute's grabgraf picture is 25 milliseconds, then sound delay time is in image.The first transmission delay amount determination module 211 is used for the time-count cycle of clock and the difference of clock indicated value are defined as the transmission delay amount, and picture delay is in sound.The second transmission delay amount determination module 212 is used for the clock indicated value is defined as the transmission delay amount, and sound delay time is in image.
It will be appreciated by those skilled in the art that transmission delay amount average determining unit 22 of the present invention is optional unit.Based on same goal of the invention and identical technological means, the function of each unit of the present invention and module can be with reference to the associated description in the synchronous method of testing of aforementioned labial.Each above-mentioned unit and module can realize by corresponding software or circuit.
The above is preferred embodiment of the present invention only, is not to be used to limit protection scope of the present invention.
Claims (6)
1. method of testing that labial is synchronous, it is characterized in that, standard signal source comprises voice signal and picture signal, sound and image synchronization, contain displayable clock in the image, the cycle period of described clock equals the cycle signal duration in the standard signal source, and this method may further comprise the steps:
Start the grabgraf instruction when A, the end sound in hearing voice signal, current test pattern is carried out grabgraf;
B, determine transmission delay amount between image and the sound according to the clock information in institute's grabgraf picture.
2. the synchronous method of testing of labial according to claim 1 is characterized in that, determines the transmission delay amount between image and the sound among the step B, is specially:
If the clock indicated value in institute's grabgraf picture is near the clock cycle period, then picture delay is in sound, and the transmission delay amount is the difference of clock cycle period and clock indicated value;
If the clock indicated value in institute's grabgraf picture is much smaller than the clock cycle period, then sound delay time is in image, and the transmission delay amount is the clock indicated value;
If the clock indicated value in institute's grabgraf picture is zero, then do not postpone between sound and the image.
3. the synchronous method of testing of labial according to claim 2 is characterized in that, also comprises after the step B:
Repeating step A, step B average to determined transmission delay, with the transmission delay amount of average as the test gained.
4. the testing apparatus that labial is synchronous is characterized in that, standard signal source comprises voice signal and picture signal, sound and image synchronization, contain displayable clock in the image, the cycle period of described clock equals the cycle signal duration in the standard signal source, and this device comprises:
The grabgraf unit is used for being activated when hearing the end sound of voice signal, and current test pattern is carried out grabgraf; And
Transmission delay amount determining unit is determined transmission delay amount between image and the sound according to the clock information in the described grabgraf unit institute grabgraf picture.
5. the synchronous testing apparatus of labial according to claim 4 is characterized in that, described transmission delay amount determining unit comprises:
Clock indicated value judge module is used for triggering the first transmission delay amount determination module during near the clock cycle period in the clock indicated value of determining institute's grabgraf picture, triggers the second transmission delay amount determination module during much smaller than the clock cycle period in the clock indicated value;
The first transmission delay amount determination module be used for the difference of clock cycle period and clock indicated value is defined as the transmission delay amount, and picture delay is in sound; And
The second transmission delay amount determination module be used for the clock indicated value is defined as the transmission delay amount, and sound delay time is in image.
6. the synchronous testing apparatus of labial according to claim 5 is characterized in that this device also comprises:
Transmission delay amount average determining unit is used for the described grabgraf of repeated trigger unit, transmission delay amount determining unit, the determined transmission delay of described transmission delay amount determining unit is averaged, with the transmission delay amount of average as the test gained.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007101779465A CN101170704B (en) | 2007-11-22 | 2007-11-22 | Labial synchronization testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007101779465A CN101170704B (en) | 2007-11-22 | 2007-11-22 | Labial synchronization testing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101170704A CN101170704A (en) | 2008-04-30 |
| CN101170704B true CN101170704B (en) | 2011-06-22 |
Family
ID=39391139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101779465A Expired - Fee Related CN101170704B (en) | 2007-11-22 | 2007-11-22 | Labial synchronization testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101170704B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9749674B2 (en) | 2015-08-17 | 2017-08-29 | Hon Hai Precision Industry Co., Ltd. | Audio and video synchronization method and terminal device using the same |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102169664B (en) * | 2011-01-28 | 2013-08-21 | 北京视博云科技有限公司 | Time delay detecting method and device of display device |
| CN102655585B (en) * | 2012-04-16 | 2015-07-15 | 中国联合网络通信集团有限公司 | Video conference system and time delay testing method, device and system thereof |
| CN107968942B (en) * | 2017-11-24 | 2021-06-04 | 网易（杭州）网络有限公司 | Method and system for measuring audio and video time difference of live broadcast platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2282929A (en) * | 1993-10-13 | 1995-04-19 | British Broadcasting Corp | Electronic clapperboard for television sound-vision synchronisation |
| CN1436005A (en) * | 2002-01-30 | 2003-08-13 | 华邦电子股份有限公司 | Method and system for measuring accuracy of video/audio output synchronization, and analysis means |
| US7020894B1 (en) * | 1998-07-24 | 2006-03-28 | Leeds Technologies Limited | Video and audio synchronization |
| CN101022560A (en) * | 2007-03-09 | 2007-08-22 | 北京牡丹视源电子有限责任公司 | Digital TV video and audio synchronous testing signal and measuring method thereof |
-
2007
- 2007-11-22 CN CN2007101779465A patent/CN101170704B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2282929A (en) * | 1993-10-13 | 1995-04-19 | British Broadcasting Corp | Electronic clapperboard for television sound-vision synchronisation |
| US7020894B1 (en) * | 1998-07-24 | 2006-03-28 | Leeds Technologies Limited | Video and audio synchronization |
| CN1436005A (en) * | 2002-01-30 | 2003-08-13 | 华邦电子股份有限公司 | Method and system for measuring accuracy of video/audio output synchronization, and analysis means |
| CN101022560A (en) * | 2007-03-09 | 2007-08-22 | 北京牡丹视源电子有限责任公司 | Digital TV video and audio synchronous testing signal and measuring method thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9749674B2 (en) | 2015-08-17 | 2017-08-29 | Hon Hai Precision Industry Co., Ltd. | Audio and video synchronization method and terminal device using the same |
| TWI625059B (en) * | 2015-08-17 | 2018-05-21 | 新加坡商雲網科技新加坡有限公司 | Terminal device and method for audio video synchronization |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101170704A (en) | 2008-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109309831B (en) | Method and device for testing video delay in video conference | |
| CN104115432B (en) | Method and apparatus for the tramsfer time information between temporal cognition equipment | |
| CN101170704B (en) | Labial synchronization testing method and device | |
| TWI489293B (en) | Collaborative image control | |
| US7864695B2 (en) | Traffic load density measuring system, traffic load density measuring method, transmitter, receiver, and recording medium | |
| US8111327B2 (en) | Method and apparatus for audio/video synchronization | |
| CN102158881B (en) | Method and device for completely evaluating 3G visual telephone quality | |
| US8830290B2 (en) | Video conference apparatus and method for audio-video synchronization | |
| JP2018510567A (en) | Wireless synchronization based on beacons | |
| US20160295293A1 (en) | System and Method for Synchronization of Audio and Closed Captioning | |
| CN105744334A (en) | Method and equipment for audio and video synchronization and synchronous playing | |
| JP2004297803A (en) | Method for evaluating sound quality in network | |
| EP3301896A1 (en) | Streamed communication | |
| CN113207009A (en) | Method, device and system for testing audio-video interaction system with out-of-step sound and picture | |
| CN106331820B (en) | Audio and video synchronization processing method and device | |
| US9264665B2 (en) | Teleconferencing system and non-transitory computer readable medium storing program | |
| EP3301895A1 (en) | Streamed communication | |
| CN109246664B (en) | Voice test method and device | |
| WO2018040856A1 (en) | Method and system for detecting synchronisation of outputs of video processing units of multi-screen display apparatus | |
| CN109640141A (en) | A kind of bearing calibration of audio time stamp, means for correcting and audio-video terminal | |
| CN103517044A (en) | Video conference apparatus and lip synchronization method | |
| JP2010112947A (en) | Testing measuring apparatus, measuring system and method | |
| CN110602521B (en) | Method, system, computer readable medium and device for measuring mixed drawing time delay | |
| WO2017178371A1 (en) | Slave requested audio synchronization | |
| CN110475144A (en) | The extracting method of 16 channel audios in a kind of 12G-SDI data flow based on FPGA |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110622 Termination date: 20171122 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |