CN104284135A - Video transmission method and device - Google Patents
Video transmission method and device Download PDFInfo
- Publication number
- CN104284135A CN104284135A CN201310275059.7A CN201310275059A CN104284135A CN 104284135 A CN104284135 A CN 104284135A CN 201310275059 A CN201310275059 A CN 201310275059A CN 104284135 A CN104284135 A CN 104284135A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- packets
- frame
- video packets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/637—Control signals issued by the client directed to the server or network components
- H04N21/6375—Control signals issued by the client directed to the server or network components for requesting retransmission, e.g. of data packets lost or corrupted during transmission from server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
- H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
- H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
- H04L1/1867—Arrangements specially adapted for the transmitter end
- H04L1/1874—Buffer management
- H04L1/1877—Buffer management for semi-reliable protocols, e.g. for less sensitive applications like streaming video
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
Abstract
The invention discloses a video transmission method and device and relates to the technical field of network communication. According to the video transmission method, whether video data need to be retransmitted or not is judged through the steps of judging whether a video data packet is lost or not, judging the video service type request sent by a user, judging the type of the video data packet, judging whether a network reaches a congestion threshold value or not and the like. According to the video transmission method and device, selective retransmission is carried out on videos according to the video service type, the type of the video data packet and the network conditions, the network load is lightened, and the accuracy of the video data is guaranteed to the maximum extent on the premise that it is guaranteed that the video is smoothly played.
Description
Technical field
The present invention relates to network communication technology field, be particularly applied to video transmission method and the equipment of network video monitor and control system.
Background technology
Network video monitor and control system comprises client, video monitoring platform and video monitoring front-end, and front-end collection video issues video monitoring platform, and client is from video monitoring platform request video flowing.Video monitoring front-end develops into numeral by simulation, develops into high definition by SD.
In existing major video supervisory control system, all need the video camera supporting that definition is more and more higher, as the video camera of 720P, 1080P.So just bring the requirement of the network bandwidth more and more higher.Common problem has:
It is smooth not to there are card, short interruption etc. in the video of client;
Client Video Key information clear not (as characters on license plate, face head portrait);
For user when watching real-time video, user is not it is of concern that smoothness is interrupted, and the mosaic that non-critical areas is little can't have an impact to integral monitoring effect.
For user when watching video or playing the video downloaded, it is of concern that whether video is clear, unclear video needs when downloading to retransmit to meet the requirement of user to definition, otherwise can cause the erroneous judgement to critical event when using video.
Use being used for of video from user, the video that field of video monitoring uses can be divided into two types:
Real-time video---need to do in real time process to produce real-time alarm to user to video, to improve promptness and the validity of event handling, thisly require that video real-time is better.As: the behavioural analysis in video conference, intellectual analysis;
Video---needing to do things reprocessing to judge foundation to there is event to video, thisly requiring that the quality of video is higher.If public security industry is to the detection of a certain case, need to do multiple process to the video under a certain scene.
In field of video monitoring, the agreement of transmitting video-frequency flow has reliable transmission control protocol TCP (Transmission Control Protocol) agreement and insecure user datagram protocol UDP (User Datagram Protocol) agreement.
In order to ensure the advantage that can use two agreements when transmitting video-frequency flow, use at present comparatively widely mode is: in udp protocol, introduce HARQ ARQ(Automatic Repeat Request) mechanism.Udp protocol is a connectionless protocol, and before transmission data, source and terminal do not need to connect, and just captures data from source, and as much as possible packet is thrown away on network when needs transmit data.ARQ asks transmit leg to retransmit the data of makeing mistakes by recipient to recover data message of makeing mistakes.So just can ensure transmission quality while guarantee transmission speed.
Prior art needs to do following thing at coding side:
1. read HARQ information and data information units;
2. be sent to decoding end by after the video flowing packing in data information units, and calculate bag importance;
3. add up the distribution function of bag importance;
4. calculate and retransmit threshold value, according to the packet rate that transmission rate, packet loss, network can carry etc. because usually calculating;
5. judge whether to retransmit packet loss, if the bag importance values of packet loss is greater than re-transmission threshold value, then retransmits, otherwise do not retransmit;
Need to do following thing in decoding end:
1. detect whether have packet loss, if do not receive bag in time delay range, then think that this bag is lost, otherwise think there is no packet loss, carry out decoding encapsulation and video decode;
If 2. judge this packet loss, then the bag sequence number of packet loss is sent to coding side as repeat requests
The shortcoming of prior art is as follows:
1. need to realize statistics bag importance at coding side, retransmit threshold value, judge whether the functions such as re-transmission, the performance requirement for coding side is very high, also result in cost high
2. be greater than for employing bag importance and retransmit threshold value to judge that packet loss is the need of re-transmission, only bag importance aspect is considered, more unilateral;
3. for creating packet loss but retransmitting the grouping of re-transmission that not have that threshold value causes and directly ignore because bag importance is less than and certain frame can be caused to decode or occur mosaic situation after the decoding.
Summary of the invention
Embodiments provide video transmission method and system, with solve existing video transmission technologies exist cannot provide video, equipment cost high deficiency according to the video requirement of user.
In order to solve the problems of the technologies described above, the embodiment of the invention discloses following technical scheme:
First aspect, provide a kind of video transmission method, it is characterized in that, the method comprises the following steps:
Whether video monitoring equipment detects the video packets of data received and loses;
The video traffic type requests that video monitoring equipment is sent the inquiry under condition user of video data packet loss; If video traffic type requests is video recording type, then send the request of the video packets of data of retransmission of lost to video source device;
The type of the video packets of data that the inquiry under condition that video monitoring equipment is real time type in video traffic type requests is lost; If the type of video packets of data is I frame data, then video monitoring equipment sends the request of the video packets of data of retransmission of lost to video source device;
Whether the inquiry under condition network that video monitoring equipment is not I frame data in the type of video packets of data reaches congestion threshold; If network does not reach congestion threshold, then send the request of the video packets of data of retransmission of lost to video source device;
Video monitoring equipment calculates the video packets of data of loss when network reaches congestion threshold, and sends video playback notice to video playback unit.
In the first possible implementation of first aspect, described video traffic type requests comprises: displaying live view, real-time recording, video recording download or playing back videos.
In the implementation that the second of first aspect is possible, the computing formula of the video packets of data of described loss is:
X
i=avg(X
1+…+X
i-1+X
i+1+…X
n)
Wherein:
X
ifor i-th video packets of data of the X frame of loss, n is the sum of the video packets of data of X frame;
Avg is operation of averaging.
Second aspect, provide a kind of video transmission method, it is characterized in that, the method comprises the following steps:
Video source device is encoded frame by frame to video source, obtains frame of video;
Video source device carries out subpackage to described frame of video, obtains video packets of data;
Described video packets of data is sent to video monitoring equipment by video source device, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent.
In the first possible implementation of second aspect, described video source device is encoded frame by frame to video source, obtains frame of video and is specially:
Video source device is decomposed into independently frame of video to by video source, to independently frame of video in chronological sequence order encode, obtain frame of video.
In the implementation that the second of second aspect is possible, described video source device carries out subpackage to described frame of video, obtains video packets of data and is specially:
Frame of video is divided into video packets of data by default size by video source device, and encodes to the video packets of data belonging to same frame of video.
In the third possible implementation of second aspect, described video packets of data is sent to video monitoring equipment by described video source device, and is specially according to the video packets of data that the repeat requests that described video monitoring equipment is sent sends repeat requests corresponding:
Video source is sent to video monitoring equipment with the form of video packets of data by video source device; Video monitoring equipment sends to video source device by needing the information of video packets of data retransmitted, and the video packets of data of correspondence or frame of video corresponding to this video packets of data, according to the information of video packets of data, are sent to video monitoring equipment by video source device.
The third aspect, provides a kind of video transmission equipment, it is characterized in that, this equipment comprises:
Whether loss detection unit, lose for the video packets of data detecting reception;
Video traffic type queries unit, for the video traffic type requests sent the inquiry under condition user of video data packet loss; If video traffic type requests is video recording type, then send the request of the video packets of data of retransmission of lost to video source device;
Video packets of data query unit, in video traffic type requests being the type of the video packets of data that the inquiry under condition of real time type is lost; If the type of video packets of data is I frame data, then video monitoring equipment sends the request of the video packets of data of retransmission of lost to video source device;
Network inquiry unit, for the type in video packets of data not for whether the inquiry under condition network of I frame data reaches congestion threshold; If network does not reach congestion threshold, then send the request of the video packets of data of retransmission of lost to video source device;
Video packets of data computing unit, for calculating the video packets of data of loss when network reaches congestion threshold, and sends video playback notice to video playback unit.
In the first possible implementation of the third aspect, described loss detection unit also comprises:
Counter, for counting the video packets of data of losing.
In the implementation that the second of the third aspect is possible, described network inquiry unit also comprises:
Alarm, sends alarm signal when reaching congestion threshold for network.
Fourth aspect, provides a kind of video transmission equipment, it is characterized in that, this equipment comprises:
Coding unit, for encoding frame by frame to video source, obtains frame of video;
Packetized units, for carrying out subpackage to described frame of video, obtains video packets of data;
Video packets of data transmitting element, for described video packets of data is sent to video monitoring equipment, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent.
In the first possible implementation of fourth aspect, described coding unit comprises:
Splitter, for being decomposed into independently frame of video by video source.
In the implementation that the second of fourth aspect is possible, described coding unit comprises:
Encoder, in chronological sequence sequentially encoding to described independently frame of video.
In the embodiment of the present invention, the video type request of being sent by inquiring user, has known clearly that the video of user is selected;
The type selecting of the video packets of being lost by inquiry retransmits important video packets, both simplifies step, in turn ensure that the smoothness display of real-time video, enhances Consumer's Experience;
Whether reach congestion threshold by requester network, selectivity retransmits video packets, reduces network load, improves the fluency of video playback.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the flow chart of the first video transmission method of the present invention;
Fig. 2 is the flow chart of the second video transmission method of the present invention;
Fig. 3 is the structural representation of the first video transmission equipment of the present invention;
Fig. 4 is the structural representation of the second video transmission equipment of the present invention;
Fig. 5 is the structure chart of the embodiment of the present invention.
Embodiment
For making the object of the embodiment of the present invention, technical scheme and advantage clearly, below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly described, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
In order to solve existing video transmission technologies exist cannot provide video, equipment cost high deficiency according to the video requirement of user.The present invention proposes video transmission method and equipment.
The flow chart of a kind of video transmission method of the present invention as shown in Figure 1, comprises the following steps:
Whether video monitoring equipment detects the video packets of data received and loses, if video packets of data is not lost, then sends video playback notice to video playback unit; Wherein, whether whether detection video packets of data is lost and is specially: detect video packets of data one by one by the coding of video packets of data and lose, if find, the video packets of data disappearance of corresponding coding or described coded sequence cause confusion, be then considered as video packets of data and lose;
Otherwise, if video packets of data goes out active, video traffic type (that is, comprise the real time type of displaying live view and real-time recording and comprise video recording download and the playing back videos video recording type) request that video monitoring equipment inquiring user is sent; If video traffic type requests is video recording type, then send the request of the video packets of data of retransmission of lost to video source device;
Otherwise video traffic type requests is Real time request, the type of the video packets of data that video monitoring equipment inquiry is lost; If the type of video packets of data is I frame data, then video monitoring equipment sends the request of the video packets of data of retransmission of lost to video source device;
Otherwise the type of video packets of data is not I frame data, video monitoring equipment inquiry video data Packet type is not for whether network during I frame data reaches congestion threshold; If network does not reach congestion threshold, then send the request of the video packets of data of retransmission of lost to video source device;
Otherwise network reaches congestion threshold, video monitoring equipment calculates the video packets of data of losing, and sends video playback notice to video playback unit.
Wherein, the computing formula of the video packets of data of loss is:
X
i=avg(X
1+…+X
i-1+X
i+1+…X
n)
Wherein:
X
ifor i-th video packets of data of the X frame of loss, n is the video counts of X frame
According to the sum of bag;
Avg is operation of averaging.
As shown in Figure 3, this equipment comprises the structural representation of corresponding video transmission equipment:
Whether loss detection unit 1, lose for the video packets of data detecting reception, if video packets of data is not lost, then sends video playback notice to video playback unit; Wherein, whether whether detection video packets of data is lost and is specially: detect video packets of data one by one by the coding of video packets of data and lose, if find, the video packets of data disappearance of corresponding coding or described coded sequence cause confusion, be then considered as video packets of data and lose; Loss detection unit 1 comprises counter, for counting the video packets of data of losing.
Video traffic type queries unit 2, for the video traffic type requests sent the inquiry under condition user of video data packet loss; If video traffic type requests is video recording type, then send the request of the video packets of data of retransmission of lost to video source device;
Video packets of data query unit 3, in video traffic type requests being the type of the video packets of data that the inquiry under condition of real time type is lost; If the type of video packets of data is I frame data, then video monitoring equipment sends the request of the video packets of data of retransmission of lost to video source device;
Network inquiry unit 4, for the type in video packets of data not for whether the inquiry under condition network of I frame data reaches congestion threshold; If network does not reach congestion threshold, then send the request of the video packets of data of retransmission of lost to video source device; Network inquiry unit 4 also comprises alarm, sends alarm signal when reaching congestion threshold for network.
Video packets of data computing unit 5, for calculating the video packets of data of loss when network reaches congestion threshold, and sends video playback notice to video playback unit.
Another kind of video transmission method of the present invention, it is characterized in that, the method comprises the following steps:
Video source device is encoded frame by frame to video source, obtains frame of video; Be specially:
Video source device is decomposed into independently frame of video to by video source, to independently frame of video in chronological sequence order encode, obtain frame of video.
Video source device carries out subpackage to described frame of video, obtains video packets of data; Be specially:
Frame of video is divided into video packets of data by default size by video source device, and encodes to the video packets of data belonging to same frame of video.
Described video packets of data is sent to video monitoring equipment by video source device, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent.Be specially:
Video source is sent to video monitoring equipment with the form of video packets of data by video source device; Video monitoring equipment sends to video source device by needing the information of video packets of data retransmitted, and the video packets of data of correspondence or frame of video corresponding to this video packets of data, according to the information of video packets of data, are sent to video monitoring equipment by video source device.
As shown in Figure 4, this equipment comprises the structural representation of corresponding video transmission equipment:
Coding unit 6, for encoding frame by frame to video source, obtains frame of video; Described coding unit 6 comprises: splitter, for video source is decomposed into independently frame of video; Encoder, in chronological sequence sequentially encoding to described independently frame of video.
Packetized units 7, for carrying out subpackage to described frame of video, obtains video packets of data;
Video packets of data transmitting element 8, for described video packets of data is sent to video monitoring equipment, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent;
Described coding unit 6 is connected with packetized units 7; Packetized units 7 is connected with video packets of data transmitting element 8.
Below by way of an embodiment, the present invention will be described:
Video monitoring system is by video source device, video monitoring equipment (comprising storage), and client composition: video source device comprises web camera, analog video camera, encoder, digital video recorder DVR(Digital Video Recorder) etc. equipment, be responsible for image scene compressed encoding is become Media Stream so that Internet Transmission.Video monitoring equipment comprises management server, media server, platform software and disk array etc.Client device is responsible for running client software, after being connected to server, can select different business, such as: fact is browsed, real-time recording, video recording download, playing back videos etc.
Video source device needs the thing done as follows:
1. pair video source is encoded, and carries out subpackage to each frame coded data;
2., within a certain period of time, when receiving the repeat requests that video monitoring equipment sends, the video packets retransmitted by the needs in buffer memory retransmits;
Video monitoring platform needs to do following thing:
1. detect the video packets of data received and whether have packet drop, if there is no packet loss, then perform step 7, if there is packet loss, then perform step 2;
2. detect the video traffic type requests that client sends, belong to real-time video type or video type, if real-time video type, then perform step 3, if video, then perform step 5;
3. detect video packets of data and belong to I frame data or P frame data, if I frame data, then perform step 5, if not I frame data, then perform step 4;
4. whether Sampling network congestion situation reaches default congestion threshold, if do not reach congestion threshold, then performs step 5, if reach congestion threshold, then performs step 6;
5. request retransmission packet loss data;
6. use the video packets of buffer memory to calculate the video packets of loss;
7. data cached, displaying video;
Suppose X to represent frame data, and these frame data are divided into n video packets of data, use X
irepresent X frame i-th packet (1≤i≤n), use K
jrepresent the network congestion in j moment, the threshold value of network congestion uses A to represent, P frame data uses P to represent, I frame data use I to represent.
Need the condition retransmitted to see formula (1), do not need the condition retransmitted to see formula (2), the packet loss data calculated when not retransmitting are formula (3).
X∈I OR K
j≤A (1)
Formula (1) illustrates: X frame data belong to I frame data or current time network congestion is less than or equal to threshold value.
X∈P OR K
j>A (2)
Formula (2) illustrates: X frame data belong to P frame data or current time network congestion is greater than threshold value.
X
i=avg(X
1+…+X
i-1+X
i+1+…X
n)X∈P(3)
Formula (3) illustrates: the X frame data mean value calculation packet loss data X using buffer memory
i.
Be exemplified below:
One, user selects video business in client, and video monitoring platform gets video flowing from front end, is sent to client for user's viewing.In viewing process, detection of platform has arrived video data packet drop, and given threshold A is 80, as follows:
1. lost the 8th video packets of data in the 5th frame data, and these frame data belong to I frame data, divided in order to 200 video packets of data by coding altogether, network congestion K
5swing in 50-60 interval;
2. the 7th frame data lost the 10th and the 15th video packets of data, and this frame belongs to P frame data, be divide into 50 video packets of data, K altogether by coding
7swing in 80-90 interval;
3. the 17th frame data lost the 13rd and the 18 two video packets of data, and this frame belongs to P frame data, are divided into 45 video packets of data, K altogether by coding
17swing in 40-50 interval;
4. the 34th frame data lost three video packets of data such as the 14th, the 23rd, the 33rd, and this frame belongs to I frame data, be divide into 280 video packets of data altogether by coding, K
34swing in 80-90 interval;
Processing policy is as follows:
1. the 8th video packets request video source device of the 5th frame retransmits;
2. the 10th and the 15th video packets of the 7th frame does not need to retransmit, and
3. the 13rd and the 18 two video packets request video source device of the 17th frame retransmit;
4. the 14th, the 23rd, the 33 3 video packets of the 34th frame needs to retransmit;
Two, user selects real-time video traffic in client, and video monitoring platform gets video flowing from front end, is sent to platform and records a video.In video process, detection of platform has arrived video packets packet drop, and given threshold A is 80, as follows:
1. lost the 8th video packets of data in the 5th frame data, and these frame data belong to I frame data, divided in order to 200 video packets of data by coding altogether, network congestion K
5swing in 50-60 interval;
2. the 7th frame data lost the 10th and the 15th video packets of data, and this frame belongs to P frame data, be divide into 50 video packets of data, K altogether by coding
7swing in 80-90 interval;
3. the 17th frame data lost the 13rd and the 18 two video packets of data, and this frame belongs to P frame data, are divided into 45 video packets of data, K altogether by coding
17swing in 40-50 interval;
4. the 34th frame data lost three video packets such as the 14th, the 23rd, the 33rd, and this frame belongs to I frame data, be divide into 280 video packets of data altogether by coding, K
34swing in 80-90 interval;
Processing policy is as follows:
1. the 8th video packets request video source device of the 5th frame retransmits;
2. the 10th and the 15th video packets of the 7th frame needs to retransmit;
3. the 13rd and the 18 two video packets request video source device of the 17th frame retransmit;
4. the 14th, the 23rd, the 33 3 video packets of the 34th frame needs to retransmit;
Such processing policy considers bag importance, network congestion and customer service scene.
The composition annexation of corresponding apparatus of the present invention is as follows:
Video source device comprises coding unit 6, packetized units 7 and video packets of data transmitting element 8.Described coding unit 6 is connected with packetized units 7; Packetized units 7 is connected with video packets of data transmitting element 8.
Client comprises control unit 9 and video playback unit 10.
Video monitoring equipment comprises loss detection unit 1, video traffic type queries unit 2, video packets of data query unit 3, network inquiry unit 4 and video packets of data computing unit 5.Loss detection unit 1 is connected with video traffic type queries unit 2, video packets of data transmitting element 8 and video playback unit 10 respectively; Video traffic type queries unit 2 is connected with video packets of data query unit 3, video packets of data transmitting element 8 and control unit 9 respectively; Video packets of data query unit 3 is connected with network inquiry unit 4 and video packets of data transmitting element 8 respectively; Network inquiry unit 4 is connected with video packets of data transmitting element 8 and video packets of data computing unit 5 respectively; Video packets of data computing unit 5 is connected with video playback unit 10.
First, video source device for encoding frame by frame to video source, obtains frame of video by coding unit 6; Packetized units 7 carries out subpackage to described frame of video, obtains video packets of data; Described video packets of data is sent to video monitoring equipment by video packets of data transmitting element 8, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent;
Then, whether the video packets of data that the loss detection unit 1 of video monitoring equipment detects from video packets transmitting element 8 loses, if video packets of data is not lost, then the video playback unit 10 to client sends video playback notice; If video data is surrounded by loss situation, then by video traffic type requests that the control unit 9 of video traffic type queries unit 2 inquiring client terminal is sent; If video traffic type requests is video recording type, then send the request of the video packets of retransmission of lost to video packets of data transmitting element 8, corresponding video packets of data resends to loss detection unit 1 according to request by video packets of data transmitting element 8; If video traffic type requests is real time type, then inquired about the type of the video packets of data of losing by video packets of data query unit 3; If the type of video packets of data is I frame data, then send the request of the video packets of data of retransmission of lost to video packets of data transmitting element 8, otherwise video packets of data query unit 3 sends network status query request to network inquiry unit 4; Whether network inquiry unit 4 requester network reaches congestion threshold, if do not reach congestion threshold, the request of the video packets of data of retransmission of lost is then sent to video packets of data transmitting element 8, otherwise, network inquiry unit 4 calculates the request of video packets of data to being sent by video packets of data computing unit 5, video packets of data computing unit 5 calculates the video packets of data of losing according to other video packets of data, and is play by video playback unit 10.
The present invention, for the different service types of user, has different processing modes, more meets the demand of user to video quality; For I frame important in video, retransmit the authenticity of guarantee video, the authenticity demand of user to video could be met; For the P frame in video, when network condition is bad, the mode that mistake in covers can alleviate network congestion situation, and can ensure not lose important information in video flowing.
One of ordinary skill in the art will appreciate that the possible implementation of various aspects of the present invention or various aspects can be embodied as system, method or computer program.Therefore, the possible implementation of each aspect of the present invention or various aspects can adopt complete hardware embodiment, completely software implementation (comprising firmware, resident software etc.), or the form of the embodiment of integration software and hardware aspect, is all referred to as " circuit ", " module " or " system " here.In addition, the possible implementation of each aspect of the present invention or various aspects can adopt the form of computer program, and computer program refers to the computer readable program code be stored in computer-readable medium.
Computer-readable medium can be computer-readable signal media or computer-readable recording medium.Computer-readable recording medium is including but not limited to electronics, magnetic, optics, electromagnetism, infrared or semiconductor system, equipment or device, or aforesaid appropriately combined arbitrarily, as random access memory (RAM), read-only memory (ROM), Erasable Programmable Read Only Memory EPROM (EPROM or flash memory), optical fiber, portable read-only memory (CD-ROM).
Processor in computer reads the computer readable program code be stored in computer-readable medium, makes processor can perform the function action specified in the combination of each step or each step in flow charts; Generate the device implementing the function action specified in the combination of each block of block diagram or each piece.
Computer readable program code can perform completely on the computer of user, part performs on the computer of user, as independent software kit, part on the computer of user and part on the remote computer, or to perform on remote computer or server completely.Also it should be noted that in some alternate embodiment, in flow charts in each step or block diagram each piece the function that indicates may not according to occurring in sequence of indicating in figure.Such as, depend on involved function, in fact two steps illustrated in succession or two blocks may be executed substantially concurrently, or these blocks sometimes may be performed by with reverse order.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (13)
1. a video transmission method, is characterized in that, the method comprises the following steps:
Whether video monitoring equipment detects the video packets of data received and loses;
The video traffic type requests that video monitoring equipment is sent the inquiry under condition user of video data packet loss; If video traffic type requests is video recording type, then send the request of the video packets of data of retransmission of lost to video source device;
The type of the video packets of data that the inquiry under condition that video monitoring equipment is real time type in video traffic type requests is lost; If the type of video packets of data is I frame data, then video monitoring equipment sends the request of the video packets of data of retransmission of lost to video source device;
Whether the inquiry under condition network that video monitoring equipment is not I frame data in the type of video packets of data reaches congestion threshold; If network does not reach congestion threshold, then send the request of the video packets of data of retransmission of lost to video source device;
Video monitoring equipment calculates the video packets of data of loss when network reaches congestion threshold, and sends video playback notice to video playback unit.
2. the method for claim 1, is characterized in that, described video traffic type requests comprises: displaying live view, real-time recording, video recording download or playing back videos.
3. the method for claim 1, is characterized in that, the computing formula of the video packets of data of described loss is:
X
i=avg(X
1+…+X
i-1+X
i+1+…X
n)
Wherein:
X
ifor i-th video packets of data of the X frame of loss, n is the sum of the video packets of data of X frame;
Avg is operation of averaging.
4. a video transmission method, is characterized in that, the method comprises the following steps:
Video source device is encoded frame by frame to video source, obtains frame of video;
Video source device carries out subpackage to described frame of video, obtains video packets of data;
Described video packets of data is sent to video monitoring equipment by video source device, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent.
5. the method as shown in claim 4, is characterized in that, described video source device is encoded frame by frame to video source, obtains frame of video and is specially:
Video source device is decomposed into independently frame of video to by video source, to independently frame of video in chronological sequence order encode, obtain frame of video.
6. the method as shown in claim 4, is characterized in that, described video source device carries out subpackage to described frame of video, obtains video packets of data and is specially:
Frame of video is divided into video packets of data by default size by video source device, and encodes to the video packets of data belonging to same frame of video.
7. the method as shown in claim 6, is characterized in that, described video packets of data is sent to video monitoring equipment by described video source device, and is specially according to the video packets of data that the repeat requests that described video monitoring equipment is sent sends repeat requests corresponding:
Video source is sent to video monitoring equipment with the form of video packets of data by video source device; Video monitoring equipment sends to video source device by needing the information of video packets of data retransmitted, and the video packets of data of correspondence or frame of video corresponding to this video packets of data, according to the information of video packets of data, are sent to video monitoring equipment by video source device.
8. a video transmission equipment, is characterized in that, this equipment comprises:
Whether loss detection unit, lose for the video packets of data detecting reception;
Video traffic type queries unit, for the video traffic type requests sent the inquiry under condition user of video data packet loss; If video traffic type requests is video recording type, then send the request of the video packets of data of retransmission of lost to video source device;
Video packets of data query unit, in video traffic type requests being the type of the video packets of data that the inquiry under condition of real time type is lost; If the type of video packets of data is I frame data, then video monitoring equipment sends the request of the video packets of data of retransmission of lost to video source device;
Network inquiry unit, for the type in video packets of data not for whether the inquiry under condition network of I frame data reaches congestion threshold; If network does not reach congestion threshold, then send the request of the video packets of data of retransmission of lost to video source device;
Video packets of data computing unit, for calculating the video packets of data of loss when network reaches congestion threshold, and sends video playback notice to video playback unit.
9. equipment as claimed in claim 8, it is characterized in that, described loss detection unit also comprises:
Counter, for counting the video packets of data of losing.
10. equipment as claimed in claim 8, it is characterized in that, described network inquiry unit also comprises:
Alarm, sends alarm signal when reaching congestion threshold for network.
11. 1 kinds of video transmission equipments, is characterized in that, this equipment comprises:
Coding unit, for encoding frame by frame to video source, obtains frame of video;
Packetized units, for carrying out subpackage to described frame of video, obtains video packets of data;
Video packets of data transmitting element, for described video packets of data is sent to video monitoring equipment, and sends video packets of data corresponding to repeat requests according to the repeat requests that described video monitoring equipment is sent.
12. equipment as claimed in claim 11, it is characterized in that, described coding unit comprises:
Splitter, for being decomposed into independently frame of video by video source.
13. equipment as claimed in claim 12, it is characterized in that, described coding unit comprises:
Encoder, in chronological sequence sequentially encoding to described independently frame of video.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310275059.7A CN104284135B (en) | 2013-07-02 | 2013-07-02 | Video transmission method and equipment |
| PCT/CN2014/077164 WO2015000337A1 (en) | 2013-07-02 | 2014-05-09 | Video transmission method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310275059.7A CN104284135B (en) | 2013-07-02 | 2013-07-02 | Video transmission method and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104284135A true CN104284135A (en) | 2015-01-14 |
| CN104284135B CN104284135B (en) | 2017-11-24 |
Family
ID=52143081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310275059.7A Active CN104284135B (en) | 2013-07-02 | 2013-07-02 | Video transmission method and equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104284135B (en) |
| WO (1) | WO2015000337A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105187909A (en) * | 2015-09-09 | 2015-12-23 | 深圳Tcl数字技术有限公司 | Method and device used for detecting loss of audio and video recorded at terminal |
| CN106059718A (en) * | 2016-05-05 | 2016-10-26 | 浙江宇视科技有限公司 | Data retransmission method and device |
| WO2016202032A1 (en) * | 2015-06-15 | 2016-12-22 | 中兴通讯股份有限公司 | Picture refreshment method and apparatus |
| CN109155934A (en) * | 2016-05-13 | 2019-01-04 | 富士通株式会社 | Communication device, wireless communication system and wireless communications method |
| CN109361935A (en) * | 2018-12-24 | 2019-02-19 | 广州微算互联信息技术有限公司 | Picture stream video transmission method and system |
| CN110149515A (en) * | 2019-04-01 | 2019-08-20 | 西安万像电子科技有限公司 | Data transmission method and device |
| CN110769380A (en) * | 2019-10-31 | 2020-02-07 | 联想(北京)有限公司 | Video distribution method and device |
| CN113014501A (en) * | 2021-03-02 | 2021-06-22 | 中国联合网络通信集团有限公司 | Data transmission method, system, encoder and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1917639A (en) * | 2006-09-01 | 2007-02-21 | 北京天地互连信息技术有限公司 | Method of enhancing vedio signal by discarding packets and using retransmission |
| US20080062990A1 (en) * | 2006-09-11 | 2008-03-13 | Cisco Technology, Inc. | Retransmission-based stream repair and stream join |
| CN101656747A (en) * | 2009-09-25 | 2010-02-24 | 深圳创维数字技术股份有限公司 | Method and system for transmitting streaming media data |
| CN102006476A (en) * | 2010-11-19 | 2011-04-06 | 厦门雅迅网络股份有限公司 | Optimal processing method for transmitting and receiving real-time video data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI459768B (en) * | 2011-12-30 | 2014-11-01 | Ind Tech Res Inst | Communication system and method for assisting transmission of tcp packets |
-
2013
- 2013-07-02 CN CN201310275059.7A patent/CN104284135B/en active Active
-
2014
- 2014-05-09 WO PCT/CN2014/077164 patent/WO2015000337A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1917639A (en) * | 2006-09-01 | 2007-02-21 | 北京天地互连信息技术有限公司 | Method of enhancing vedio signal by discarding packets and using retransmission |
| US20080062990A1 (en) * | 2006-09-11 | 2008-03-13 | Cisco Technology, Inc. | Retransmission-based stream repair and stream join |
| CN101656747A (en) * | 2009-09-25 | 2010-02-24 | 深圳创维数字技术股份有限公司 | Method and system for transmitting streaming media data |
| CN102006476A (en) * | 2010-11-19 | 2011-04-06 | 厦门雅迅网络股份有限公司 | Optimal processing method for transmitting and receiving real-time video data |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016202032A1 (en) * | 2015-06-15 | 2016-12-22 | 中兴通讯股份有限公司 | Picture refreshment method and apparatus |
| CN105187909B (en) * | 2015-09-09 | 2019-05-14 | 深圳Tcl数字技术有限公司 | Terminal detects the method and device that recording audio/video is lost |
| WO2017041547A1 (en) * | 2015-09-09 | 2017-03-16 | 深圳Tcl数字技术有限公司 | Method and device for terminal to detect recorded audio and video loss |
| CN105187909A (en) * | 2015-09-09 | 2015-12-23 | 深圳Tcl数字技术有限公司 | Method and device used for detecting loss of audio and video recorded at terminal |
| CN106059718A (en) * | 2016-05-05 | 2016-10-26 | 浙江宇视科技有限公司 | Data retransmission method and device |
| CN106059718B (en) * | 2016-05-05 | 2019-06-11 | 浙江宇视科技有限公司 | A kind of data repeating method and device |
| CN109155934A (en) * | 2016-05-13 | 2019-01-04 | 富士通株式会社 | Communication device, wireless communication system and wireless communications method |
| CN109155934B (en) * | 2016-05-13 | 2022-02-25 | 富士通株式会社 | Communication device, wireless communication system, and wireless communication method |
| CN109361935A (en) * | 2018-12-24 | 2019-02-19 | 广州微算互联信息技术有限公司 | Picture stream video transmission method and system |
| CN110149515A (en) * | 2019-04-01 | 2019-08-20 | 西安万像电子科技有限公司 | Data transmission method and device |
| CN110149515B (en) * | 2019-04-01 | 2021-06-04 | 西安万像电子科技有限公司 | Data transmission method and device |
| CN110769380A (en) * | 2019-10-31 | 2020-02-07 | 联想(北京)有限公司 | Video distribution method and device |
| CN113014501A (en) * | 2021-03-02 | 2021-06-22 | 中国联合网络通信集团有限公司 | Data transmission method, system, encoder and computer readable storage medium |
| CN113014501B (en) * | 2021-03-02 | 2022-12-16 | 中国联合网络通信集团有限公司 | Data transmission method, system, encoder and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104284135B (en) | 2017-11-24 |
| WO2015000337A1 (en) | 2015-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104284135A (en) | Video transmission method and device | |
| US10542064B2 (en) | Method, server side and system for computing bandwidth of network transmission of streaming media | |
| CN110248256B (en) | Data processing method and device, storage medium and electronic device | |
| US7386872B2 (en) | Network storage type video camera system | |
| US11363346B2 (en) | Video service quality assessment method and apparatus | |
| CN108809893B (en) | Video quality evaluation method and device | |
| CN103650431B (en) | Method of transmitting video data and device | |
| US10069746B2 (en) | Reduction of network congestion | |
| JPH11331839A (en) | Device and method for re-transmitting video in video transmission | |
| JPH0955776A (en) | Packet communication device | |
| CN107404646A (en) | The method, apparatus and headend of video quality assessment | |
| WO2024056032A1 (en) | Decoding method and apparatus, data transmission method and apparatus, terminal, and server | |
| KR101484933B1 (en) | A method, a system, a server, a device, a computer program and a computer program product for transmitting data in a computer network | |
| CN109688425A (en) | Live data plug-flow method | |
| EP1298926A1 (en) | Information presentation device and method | |
| CN113726817B (en) | Streaming media data transmission method, device and medium | |
| JP5682292B2 (en) | Video distribution apparatus and video distribution method | |
| CN109922307B (en) | Multimedia data transmission method and camera | |
| JP2004254195A (en) | Moving image encoding apparatus and moving image encoding method, and moving image transmission system and moving image encoding program | |
| Park et al. | Short-term reliable protocol for low latency video transmission | |
| CN113542685B (en) | Real-time ultra-high definition video transmission method based on reliable UDP | |
| CN115842919A (en) | Hardware acceleration-based low-delay video transmission method | |
| CN117896548A (en) | Data frame transmission method, device, electronic equipment and readable storage medium | |
| CN116634187A (en) | Video stream processing method, device, equipment and medium based on confluence sending mechanism | |
| CN115696439A (en) | Data transmission method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |