US20040091068A1

US20040091068A1 - Method and apparatus for controlling encoding of a digital video signal according to monitored parameters of a radio frequency communication signal

Info

Publication number: US20040091068A1
Application number: US10/606,522
Authority: US
Inventors: Matti Jokimies; Markus Hakaste; Vesa Lunden; Petri Jarvinen; Marko Luomi
Original assignee: Individual
Current assignee: Individual
Priority date: 1998-08-07
Filing date: 2003-06-26
Publication date: 2004-05-13
Also published as: GB9817292D0; EP1103143B8; DE69907689D1; JP2002522984A; WO2000008861A1; CN1162009C; CN1313009A; DE69907689T2; EP1103143B1; GB9918671D0; US7764927B2; AU5512199A; EP1103143A1; GB2341064A; ES2198942T3; US6611674B1; US20070120950A1; ATE240023T1

Abstract

Method and apparatus for controlling the operation of a video codec designed for encoding video data suitable for radio transmission between a network and a mobile station. The invention is particularly applicable where the transmission errors are unpredictable, and entails monitoring one or more parameters of the received or transmitted signal and providing a feedback signal based on the monitored signal, the feedback signal controlling the encoding parameters in the algorithm of the video codec.

Description

BACKGROUND OF THE INVENTION

The present invention relates to a method and apparatus for digital video coding, and more particularly to digital video coding for wireless communication.

Digital video offers a great many advantages over traditional analogue systems, supporting services such as video telephony and multi-media applications. However, a key problem of digital video when compared to analogue systems is the demand it places on communications and storage resources. For example, a bandwidth of approximately 160 Mbps is required in order to transmit a broadcast quality video, which compares with a bandwidth of approximately 5 MHz for comparable quality analogue video. Thus, to be able to use digital video the digital signal requires reduction of the quantity of data.

Data reduction is achieved by using compression techniques to remove redundant data while still retaining sufficient information to allow the original image to be reproduced with an acceptable quality. There are two types of redundancy in video signals: spatial and temporal. For the coding of images, techniques which exploit spatial redundancy only are termed intra-frame (i.e. they treat each frame separately), while those used to exploit temporal redundancy are termed inter-frame (i.e. they exploit similarities between frames), the latter invariably also exploit spatial redundancy.

Several coding techniques have been developed for redundancy removal, these include run length coding, conditional replenishment, transform coding, Huffman coding and differential phase code modulation (DPCM). Many of these are utilised in key standards such as JPEG, MPEG-1 and MPEG-2, and H.261/H.263. JPEG defines the form of compressed data streams for still images; MPEG/MPEG2 are for compression of moving pictures; H.261/H.263 have primarily been defined for video telephony applications employing low bit rate communications links (of the order of tens of kbit/s).

Video compression and expansion systems are often referred to as ‘video codecs’ inferring the ability to both encode and/or decode images. Current video telephony systems have primarily been designed for use in PSTN or packet networks, and are governed by ITU-T recommendations H.324, which covers low bit rate multimedia communication, and H.323, which covers video conferencing over traditional shared media local area networks. The video coding parameters of the algorithm controlling encoding in the video codec are normally selected on the basis of the relatively error free transmission channels these systems can provide. However, the video coding algorithms of video codecs are flexible in that they can allow selection of the coding parameters. This is particularly beneficial for transmission on channels which are prone to error. In such conditions the coding parameters can be modified so as to attempt to minimise the affect of transmission errors on the picture quality. Where errors have occurred in transmission, it has been found that the decoded video normally produces additional blockiness, annoying green and pink squares, temporal jerkiness and sometimes chequered patterns.

In existing systems, two parameters which are typically adjusted in encoding are the amount of intra-refresh information and frequency of start codes. In PSTN networks, the video codec starts the coding with a full intra-frame. Intra-frame pictures are coded without reference to other pictures which means that they contain all the information necessary for their reconstruction by the decoder and for this reason they are an essential entry point for access to a video sequence. Because the resolution of intra-frames is high, the compression rate is relatively low and therefore a full intra-frame places huge demands on the number of data bits required to define the picture. As a result, the transmission of a full intra on small bandwidth lines, and even using small buffers to minimise delays, takes large periods of time, to the extent that the decoder must freeze the previous picture on the screen for a while, in effect to allow the following picture to catch up. Thus, as an alternative approach, in succeeding frames, intra-frame information is updated (or refreshed) on sequential portions of the picture frames, rather than the whole picture frame typically on a block-by-block basis of 16×16 pixels, hence the picture is said to be intra-refreshed. If the rates at which the blocks are refreshed is slow (which it usually is in PSTN) transmission error artefacts on the image can live very long, and will vanish only when the erroneous block is intra-refreshed. In error prone networks, it is therefore necessary to increase the number of intra-refresh macro blocks in each frame, or the rate at which full intra frames are sent.

Another technique used to minimise the impact of transmission errors is to reduce the size of effected areas. Since the coded bit stream contains variable length coding (VLC) code words, an error in the bit stream in most cases causes the decoder to lose synchronisation with VLC code words. The decoder can only continue decoding after receiving a fixed length distinct code word called a start code. Typically, start codes are found at the beginning of coded picture frames, however most video coding standards also allow start codes to be inserted elsewhere in a picture, for instance at the beginning of each row of macro blocks or even more often. Thus in order to reduce the size of the areas affected by transmission errors, start codes can be introduced in the picture at more frequent locations. The density of these start codes is a compromise between reduced picture quality owing to an increased number of header bits, and the size of the area which is affected by transmission errors. In error prone environments it is advantageous to sacrifice some visual image quality in order to reduce the image area affected by transmission errors.

The overall current approach is to pre-program intra-refresh information and start code parameters into the algorithm controlling the video codec depending on the anticipated level of transmission errors. Since these parameters can be varied in an encoder, if for example there is a high probability of losing a significant amount of information in a transmission then the intra-refresh information and start code parameters are sent more often. However with high C/I (carrier to interference) or C/N (carrier to noise ratio) levels relatively less intra-refresh or start code information is required, thus allowing for better image quality.

Insertion of additional intra-refresh data and start codes is reasonably effective for mitigating the effects of predictable transmissions errors, but these approaches are not without certain shortcomings. Principally, these shortcomings stem from the fact that actual transmission errors are not always predictable, and in situations where there is a wide margin between the predicted transmission error and the actual transmission error, the intra-refresh and start code parameters will not be consistent with the required level for these encoding parameters. For example, on one hand if the transmission errors are less than anticipated then the level of intra-refresh or start code information will be in excess of that required, and the excess will thus be redundant. On the other hand, if the transmission errors are much worse than those predicted, then the intra-refresh and start code information will be insufficient, and spread so widely both temporally and spatially in the decoded pictures that the result will be poor image quality. Coding parameters are thus set at an intermediate rate, but of course in this case image quality is compromised and thus not at an optimum.

Against this background, the present invention aims to address the problems arising from transmission errors on video coded signals.

SUMMARY OF THE INVENTION

Accordingly, and in a first aspect, the present invention provides a method of operating a digital video codec for providing encoded video data for radio communication between a portable radio communication apparatus and a radio communication network, the method comprising monitoring at least one criterion of the radio communication signal and providing a signal responsive to said at least one monitored criterion for controlling at least one output parameter of the digital video codec.

In an alternate expression of the invention, the signal provided responsive to said at least one monitored criterion controls at least one coding parameter of the algorithm for encoding the video data in the digital video codec.

By means of the invention, the coding parameters of the video coded signal and hence the quality of the received image can be optimised for any given condition of a transmission channel. In for example a good channel connection the image quality is enhanced because less intra-refresh information and other overhead information is required. On the other hand where the channel connection is poor, better image quality can be assured because more intra-refresh information can be provided and less enduring and wide spreading errors occur in the image. Furthermore, by providing signals for optimal selection of video coding parameters based on radio channel measurements the use of radio resources is more efficient.

In preferred embodiments of the invention, the at least one monitored criteria can be the received signal quality and/or received signal strength, and/or the transmission power.

Advantageously, the signal responsive to said at least one monitored criteria is a feedback signal providing using H.245 control protocol.

It is preferred that during transmission of the radio communication signal by the radio communication network, the portable radio communication apparatus monitors received signal quality and/or received signal strength.

Advantageously, during transmission from the portable radio communication apparatus, the portable radio communication apparatus monitors transmission power.

In preferred embodiments of the invention, the at least one output parameters comprise intra-refresh data and/or start codes.

In a second aspect of the present invention there is provided apparatus for performing the method hereinbefore defined.

The invention extends to a digital video codec arranged to provide encoded video data for radio communication between a portable radio communication apparatus and a radio communication network, the video codec being operable to modify at least one coding parameter of the algorithm for encoding the video data in response to feedback signals associated with at least one monitored criterion of the radio communication signal.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will now be described by way of example with reference to the accompanying drawings in which: [0021]
FIG. 1 is a schematic representation of the system according to at least a preferred embodiment of the present invention; and [0022]
FIG. 2 is block diagram of one embodiment of the present invention.[0023]

DETAILED DESCRIPTION OF THE DRAWINGS

In the block diagram cellular telephone system shown in FIG. 1, a [0024] mobile station 10 is linked to operate in a cellular network 12, transferring data and digitised signals in a two way radio communication link. The cellular network 12 typically comprises an array of base stations which are linked together either directly or indirectly via mobile switching centres, and which enable information to be routed between mobile stations as well as landline telephones.
The [0025] mobile station 10 is equipped with the standard features associated with a mobile communication device: a keypad for dialling numbers, accepting and terminating a call, storing telephone numbers, and so on; a microphone and a loudspeaker; an antenna for radiating electromagnetic waves at transmission frequencies during transmission, and during reception for converting received electromagnetic waves at reception frequencies into electrical signals, and an RF block 14 comprising a receiver 16, synthesizers 18 and a transmitter 20. The mobile station 10 is further provided with a video codec 22 which, as explained above, can perform video compression (encode) and/or expansion (decode) for transmission and reception of video images. A video telephony system having full functionality also contains other related blocks such as audio codec, and mulitplexer/demultiplexer which take care of combining the coded video and audio into a single bitstream and so on.
An alternative arrangement is shown in dashed lines in FIG. 1, in which the [0026] video codec 22′ is remote from the mobile station 10. In such a situation, the video codec communicates (remotely) with the mobile station through the cellular or some other network.
Alternatively, it is envisaged that the mobile station may be a radio card and that the video codec is provided in a computer (e.g. portable computer) to which the radio card can be connected via, for example, a PCMCIA connection. In this case, instructions from a [0027] mobile station 10 may be sent to he video codec 22′ over AT commands and the data transfer between the video codec and the mobile station may be performed over a V.80 conncetion.
It will be apparent that the transfer of video signals between a mobile station and a cellular network can occur in two directions: in one direction, the network transmits whilst the mobile station receives, this is known as the down-link direction; in the other direction, the mobile station transmits whilst the network receives, and this is known as the up-link direction. End-to end use refers to the situation in which two mobile stations are in communication with one another through the telecommunication network. [0028]
A first embodiment of the present invention operating in the down-link direction will be described with reference to FIG. 2. [0029]
In down-link mode, the [0030] mobile station 10 receives data transmitted by the network 12 and continuously monitors at 24, in the preferred embodiment, the received signal quality and signal strength. In GSM these requirements are defined in GSM 05.08 and are used for example for handover decisions. The received signal quality and signal strength provides an indication of C/I (carrier to interference) and C/N (carrier to noise ratio).
In GSM 05.08 the received signal strength (or received signal level) of the serving base station is denoted by the two parameters: RXLEV_FULL SERVING_CELL and RXLEV_SUB_SERVING_CELL. The received signal strength is referred to in this text as RXLEV, which may be RXLEV_FULL_SERVING_CELL or RXLEV_SUB_SERVING_CELL, depending on the use of discontinuous transmission (DTX) during the call. [0031]
Similarly in GSM 05.08 the received signal quality is denoted by RXQUAL_FULL_SERVING_CELL and RXQUAL_SUB_SERVING_CELL, depending on the use of DTX, and in this text is referred to by the term RXQUAL. [0032]
The signal power is measured by the receiver, and it is mapped to RXLEV values as presented in GSM 05.08. Whilst RXLEV may not always correlate with C/N, a low RXLEV value indicates low signal strength, hence low C/N on the radio path. High RXLEV does not necessarily indicate high C/N, because high RXLEV may be generated by high interference levels as well. [0033]
RXQUAL is an estimate of bit error rate (BER) in the received signal before channel decoding. Mapping between BER and RXQUAL is described in GSM 05.08. High BER values are caused either by low C/N or by low C/l, while lower BER values coincide with either higher C/N or high C/l. [0034]
In the GSM system, RXLEV is usually compared to signal strengths of the neighbouring base stations and used as the criterion for inter-cell handover. RXQUAL is typically used as the criterion for intra-cell channel changes. [0035]
In the presented invention, it is possible to detect low C/I and low C/N from RXQUAL alone, but RXLEV information could also be utilised to improve accuracy. [0036]
The output value of the monitored signal, ie. a value indicative of the received signal's quality and strength, is fed to a [0037] control system 26. It should be noted that the control system 26 can be part of the mobile station 10, or alternatively it can be located in the network 12, in which case the monitored signal is transmitted by the mobile station 10.
The [0038] control system 26 comprises a comparator 28, memory means 30 associated with the comparator 28, and a controller 32 downstream of the comparator 28. The output value of the monitored signal is fed into the comparator 28 which compares this value with values for signal quality and strength taken from the memory means 30. The memory means 30 contains a store of values for signal quality and strength correlated to acceptable images when decoded. The store of values includes upper limits and lower limits of operation, thereby defining preferred operating ranges. These would normally be factory set but could be user defined. The comparison made in the comparator 28 provides information as to whether the monitored values of the received signal are within the preferred operating ranges, above them or below them. For example, if transmission errors are high then the received signal would be relatively weak and the comparator 28, comparing this against stored values, would output a result reflecting this.
The output from the [0039] comparator 28 is fed into the controller 32. On the basis of the result of the comparator 28, the controller 32 decides whether or not to change the coding parameters of the transmitting video codec. If the result from the comparator 28 is that the monitored received signal is within its preferred operating range then the controller 32 directs no changes in the coding parameters. On the other hand, if the monitored signal is outside its preferred operating range then the controller 32 commands a change in the operation of the video codec. For example, in the case of high transmission error the controller 32 commands the encoding video codec to produce a more robust bit stream with more intra-refresh information and/or start codes. Hence, the quality of the image generated by the decoding video codec will be much improved. In this way, in down-link mode, the mobile station has adaptive control of the encoding parameters of the transmitting video codec.
The transmitting video codec may be located in the network itself, or, in an end-to-end communication would be located in the transmitting mobile station. One possible means for the receiving mobile station to command a change in operating performance of the transmitting video codec in another mobile station is to use H.245 Control Protocol specification for Multimedia Communication. [0040]
In the latter instance, the command to change the operating performance of the transmitting video codec are sent from the receiving mobile station to the network, and this command is then fed by the network to the remote transmitting mobile station. Accordingly, it is possible for a first mobile station to affect the video coding parameters of a second mobile station by monitoring the condition of the radio link on its side of the network and providing feedback information thereon. [0041]
In the up-link direction in which the mobile station transmits and the cellular network receives, a similar process may be employed whereby the signal received at the base station is used as an indication of the quality of the link, and which is monitored and then fed back to the mobile station for modifying the operation of the video codec. [0042]
However, currently in GSM it is not possible for the mobile station directly to obtain information about the receive quality levels measured at the base station. Nor is this information delivered from the cellular network to the mobile station. Thus in order to obtain a measure of the quality of the up-link connection, use is made of the up-link power level. In GSM this is defined in GSM 05.08. The up-link power level is a parameter that is commanded by the network. So at times when the signal level and quality of the up-link transmission deteriorates, the network commands the transmission power of the mobile station to be increased. This request for higher transmission power is discerned by the mobile station which in turn triggers an increase in the intra-refresh and start code parameters of the video codec, provided that the change in power level is deemed to be high enough. In this regard, the mobile station is provided with look-up tables stored in the memory means which contain information on the correlation between transmission power levels and the appropriate density of coding parameters in a coding algorithm. [0043]
Returning to FIG. 1, TXPWR refers to the regularly transmitted network request to increase or decrease transmitter power. This is defined in GSM 05.08 as parameter MS_TXPWR_REQUEST. Alternatively or in addition, use could also be made of other power level related information sent by the network, such as power level commands in connection with handover. [0044]
The box in FIG. 1 labelled ‘other network’ can also be an ascending network ISDN, PSTN or even the same network where the mobile station with the video codec is connected. As mentioned above, it will be appreciated that received signal quality and received signal strength could also be used in the network side with a link between the network and video codec in the mobile station. In principle, it is possible to store the intra-frames in a dedicated memory unit in the network for example in the base station. Stored frames could then be retransmitted whenever the radio interface parameters indicated that the C/I or C/N ratio is low. [0045]
Whilst the invention has been described in the context of circuit switched transparent mode, the invention can be applied also in packet switched unacknowledged mode. The invention as such can be used in packet switched acknowledged and circuit switched non transparent mode. Of course in these cases there is the general penalty of harmful retransmission in a real time service. However in principal the invention itself is applicable irrespective of the way the radio interface is implemented. In addition to RXQUAL and RXLEV other parameters also can be used to determine the quality of the connection. These may include retransmission of signalling frames, number of lost frames, number of retransmissions of data frames on RLC layer in GPRS acknowledged mode. In GPRS the variance of the signal level (BL VAR SIGN_VAR) could be one of the parameters to be measured. In addition, a further parameter which may be monitored may be that of the video signal itself. For example bit error rate in the received video stream as monitored by a demulitplexer in a multi-media terminal performing a cyclic redundancy check may be used as an indication for controlling the transmitting video codec. [0046]
Optionally, when an intra-frame is being transmitted by a mobile station and hand over takes place, the intra-frame can be retransmitted because the first one may be lost due to the hand over. The same also applies to other changes in the channel mode for example between GMSK and EDGE modulations. In down-link, the mobile station may request an extra intra-frame after every hand over or channel mode change because an intra-frame may have been lost in the down link direction. [0047]
It is envisaged that the present invention will be particularly beneficial in cases where the variation in the radio parameters becomes large. For example this happens in GSM with EDGE (Enhanced Data rates for GSM Evolution), because in EDGE the data quality may vary significantly. Also very frequent channel coding or modulation changes characteristic of EDGE destroy frames, thus it is advantageous to increase the rate of intra-refresh and/or start code information when required. [0048]
The present invention may be embodied in other specific forms without departing from its essential attributes. Accordingly reference should be made to the appended claims and other general statement's herein rather than to the foregoing specific description as indicating the scope of invention. [0049]
Furthermore, each feature disclosed in this specification (which term includes the claims) and/or shown in the drawings may be incorporated in the invention independently of other disclosed and/or illustrated features. In this regard, the invention includes any novel feature or combination of features disclosed herein either explicitly or any generalisation thereof irrespective of whether or not it relates to the claimed invention or mitigates any or all of the problems addressed. [0050]
The appended abstract as filed herewith is included in the specification by reference.[0051]

Claims

What is claimed is:

1. A method of operating a digital video codec for providing encoded video data for radio communication between a portable radio communication apparatus and a radio communication network, the method comprising monitoring at least one criterion of the radio communication signal and providing a signal responsive to said at least one monitored criterion for controlling at least one output parameter of the digital video codec.

2. A method according to claim 1, wherein one of said at least one monitored criteria is received signal quality.

3. A method according to claim 1, wherein one of said at least one monitored criteria is received signal strength.

4. A method according to claim 1, wherein one of said at least one monitored criteria is transmission power.

5. A method according to claim 1, wherein the portable radio communication apparatus monitors the at least one monitored criterion.

6. A method according to claim 1, wherein during transmission of the radio communication signal by the radio communication network, the portable radio communication apparatus monitors received signal quality and/or received signal strength.

7. A method according to claim 1, wherein during transmission of the radio communication signal by the portable radio communication apparatus, the portable radio communication apparatus monitors transmission power.

8. A method according to claim 1, wherein one of the at least one output parameters is intra-refresh data.

9. A method according to claim 1, wherein one of the at least one output parameters is start codes.

10. A method according to claim 1, wherein the signal responsive to said at least one monitored criteria is a feedback signal provided using H.245 control protocol.

11. Apparatus for controlling the operation of a digital video codec arranged to provide encoded video data for radio communication between a portable radio communication apparatus and a radio communication network, the apparatus comprising means for monitoring at least one criterion of the radio communication signal and feedback means for providing a signal responsive to said at least one monitored criterion for controlling at least one output parameter of the digital video codec.

12. Apparatus according to claim 11, wherein one of said at least one monitored criteria is received signal quality.

13. Apparatus according to claims 11, wherein one of said at least one monitored criteria is received signal strength.

14. Apparatus according to claim 11, wherein one of said at least one monitored criteria is transmission power.

15. Apparatus according to claim 11, wherein the monitoring means is included in the portable radio communication apparatus.

16. Apparatus according to claim 11, wherein during transmission of the radio communication signal by the radio communication network, the portable radio communication apparatus monitors received signal quality and/or received signal strength.

17. Apparatus according to claim 11, wherein during transmission of the radio communication signal by the portable radio communication apparatus, the portable radio communication apparatus monitors transmission power.

18. Apparatus according to claim 11, wherein one of the at least one output parameters is intra-refresh data.

19. Apparatus according to claim 11, wherein one of the at least one output parameters is start codes.

20. A digital video codec arranged to provide encoded video data for radio communication between a portable radio communication apparatus and a radio communication network, the video codec being operable to modify at least one coding parameter of the algorithm for encoding the video data in response to feedback signals associated with at least one monitored criterion of the radio communication signal.

21. Apparatus according to claim 11, wherein the signal responsive to said at least one monitored criteria is a feedback signal provided using H.245 control protocol.