DE102006002061B4 - Method for receiving, for transmitting and for transmitting, transmitting and receiving arrangement and system of transmitting and receiving arrangement - Google Patents

Abstract

Method for receiving a) - a first data stream (E) generated from a first useful signal with a plurality of successive subsections, b) - a second data stream (P) generated from a second useful signal with a plurality of successive subsections, the comprises a useful component (W) reproducing the second useful signal and identification features (V) which are each assigned to exactly one different one of the subsections of the second useful signal and are derived from and identify the corresponding subsection of the first useful signal, with corresponding subsections of the first and the second useful signals are assigned to one another, comprising the steps of: c) - receiving the first and second data streams (E, P); d) - determining the identification features (U) from the received second data stream (D); e) - Retrieving the subsections of the second useful signal from the useful component (W); f) - recovering the subsections of the first useful signal from the first data stream (E); g) - renewed derivation ...

Description

The invention relates to a method for receiving a first data stream and a second data stream. The invention also relates to a method for transmitting and to a method for transmitting a first and second data stream from a transmitter to a receiver. The invention further relates to a transmitting arrangement, a receiving arrangement and a system comprising a transmitting and a receiving arrangement.

Modern communication links, for example, for the transmission of voice and audio signals often use protocols in networks that connect the respective transmitting or receiving station via different network nodes. Such a connection is also referred to as a circuit switched connection. Data or signal transmission takes place via the network nodes, it being possible for different types of data transmission to be provided, depending on the protocol and network used. In a circuit-switched connection, the transmission path is generally predetermined and kept clear for all signals and signal components. As a result, a substantially constant delay time between the transmitter and the receiver occurs with such a communication connection. The duration of the delay is determined inter alia by the switching times of the different components of the various nodes over which the communication link is established.

The transmission formats are often designed such that useful signals without time information contained therein are transported over the medium. A typical example is an ordinary, z. B. analog, telephone connection between a transmitter and a receiver, are received in the voice or audio signals transmitter side of a microphone and sent via the communication link to the receiver. Once available at the receiver, they will be output through a speaker without additional delay. In digital communication links, the audio signals are often divided into sections of certain lengths, coded, and then sent to the receiver. Even digitally encoded audio signals usually contain no additional time information. In general, audio signals in an end-to-end communication link using circuit switched technology can be expected to have no additional time information.

In addition, it is possible to transmit user data of different types or media, for example voice and image, in a synchronized manner between sender and receiver. Such synchronized transmission of a combination of two or more media signals or data streams is also referred to as English. "Session". A typical example of this is the so-called video conference, in which in addition to a pure audio signal or audio data stream and video or video signals are transmitted. There are various possibilities for the synchronization between audio and video signals. In a circuit-switched approach, audio and video signals are combined into a circuit-switched data stream, typically referred to as "multiplexing", so that one and the same transmission path is used for both streams or signals and thus the synchronization is conveniently provided by appropriate arrangement in the data stream Signals are played immediately after their decoding In another z. B. packet-switched approach different media or every single packet of each medium can be transmitted in principle via different transmission paths. In this case, for correct playout and synchronization, additional information in the form of time stamps, eg. B. in each media package provided.

This is how the US-American publication describes US 6,836,295 B1 a method of measuring, obtaining, and correcting for synchronization of signals experiencing various delays during shared transmission or processing. Prior to said processing step, a video signal is marked at a time when a particular event, such as a characteristic frequency spectrum, occurs in an associated audio signal. The marker is connected to the video signal, preferably it is embedded as a watermark in the active image information of the video signal and, after said processing step, used to generate a first delayed marker which relates to the video signal processed video signal relates. In addition, a second delayed marker is generated which represents the delay of the processed audio signal. This is followed by a measurement of the relative delay between the processed audio and video signal. The relative delay can be used to synchronize the signals, but also to measure system quality or as a feedback signal to the encoder or decoder.

The US-American publication US 6,602,299 B1 describes a method and system by which a data stream synchronization method comprising text and animations and transmitted together over a channel is flexibly co-ordinated (slave, transmitter-driven) only on the basis of timestamps integrated into the data streams, on a finer synchronization (local synchronization mode) that uses both timestamps as well as codewords or pointers can switch. A change between both synchronization mechanisms takes place when a value of a measured delay exceeds a previously defined threshold value. Alternatively, a third mode can be activated in which both modes jointly provide synchronization. The code words or pointers of the fine synchronization in one of the two data streams either comprise a specific section of the other data stream or a pointer to this section. This determines the section of the other data stream with which the first data stream is to be synchronized. In a further step, the text data is synchronized with the animation data based on a comparison of the time stamp information in the individual. Data streams.

Another example is the US document US Pat. No. 6,493,872 B1 It describes a system for the synchronization of data streams, preferably video and annotations, on a terminal, wherein the data streams have been transmitted to the terminal via different networks, for example via broadcasting and a wide area network. For synchronization, markers, for example VBI or HBI markers, are inserted there before the transmission in one of the data streams, where synchronization with the other data stream is to take place. In addition, the same data stream is provided with a number of one frame of the other data stream to be output simultaneously with the marked location of the first data stream. In addition, the data streams can also be provided with time stamps. Upon receipt, both data streams are directed to a buffer. Then, the timestamp information, the frame numbers and / or the flags added to one data stream are compared with the same information of the other data stream and a delay of the data streams is determined. The buffering ensures a synchronous combination of the data of the two data streams as a function of the delay.

However, there may be a need to add additional second user data to an already existing communication connection, wherein the existing communication connection is continued in the process. This is the case, for example, if in addition to video or audio signal transmission video signals are to be transmitted. The question of a common output arises, inter alia, when the initially mentioned "circuit switched" technique is used for the first connection.

A simple possibility is to transmit the second media signal, in the present case the video signal via an additional communication link. In such a case, it is quite possible that the second communication connection uses other areas of the communication network. If both media signals or user data are output on the receiver side, the established session is not synchronized and there is generally a time offset between the different media signals or data streams.

One way to prevent mismatched output would be to terminate the first communication connection and rebuild a completely new "session" including the additional second media signal. Synchronization can then take place by the simultaneous transmission of the two media signals or data streams over the same connection. Alternatively, a further media signal, for example a video conference, can be provided for the connection. In this solution, however, the already existing communication connection is terminated, an operation that is not desired by a user as a rule. In addition, even if one of the two data streams is changed, the existing connection must be terminated. A flexible addition of an additional media signal or data stream with, for example, different bit rate or content to an already existing communication connection is not possible in this embodiment.

The object of the invention is to provide methods which, in the case of a transmission of first and second data streams, guarantee a coordinated temporal output of the two data streams. Another object of the invention is to provide a transmitting or receiving arrangement which enables a synchronous data transmission of multiple data streams in a simple manner.

These objects are achieved with the objects according to the independent claims. Embodiments and further aspects of the invention are specified in the subclaims.

According to the principle of the invention, it is provided to provide additional identification features in the second data stream which are derived from the first data stream and thus allow a coordinated output of the first and second data streams. As a result, an already existing communication connection with a transmission of the first data stream can be continued.

The term data stream means any kind of signal that is suitable for the transmission of information. The data stream can therefore contain a useful signal, but also represent the useful signal itself. Likewise, it may be an analog or a digital signal or include such.

According to the proposed principle, a second communication connection for the transmission of the second data stream is established for the first communication connection for a transmission of the first data stream. The second data stream contains identification features which enable an assignment of sections of the second data stream to corresponding sections of the first data stream. Likewise, identification features may be contained in the second data stream, which allow an assignment of sections of a useful signal contained in the second data stream to corresponding sections of the first data stream or to corresponding sections of a useful signal in the first data stream. On the receiver side, a coordinated output of the first data stream and of the second data stream can thus take place.

Expediently, the identification features in the second data stream are derived from the first data stream or from payload data in the first data stream. It is even possible that the identification features comprise essential parts of the first data stream or the payload of the first data stream.

For example, the first data stream may contain audio signals or audio data in at least two of temporally successive subsections. The term audio signal or audio data is understood to mean any form of audible signals, ie speech, sounds, or even music. An identification feature is extracted from each of the subsections, which enables identification of the respective subsection of the first data stream. This identification feature is assigned to a subsection of a second data stream so that a later coordinated or even synchronous output of the respective subsections is possible. A synchronous output is understood to mean a balanced playing, in order to have the best possible synchronicity under other conditions. It is expedient if the features used for the identification of the subsections are particularly robust against artifacts or disturbances during the data transmission of the first data stream. For example, perturbations or signal variations may arise from the encoding and compression of signals due to irrelevance reduction and quantization or from distortion or noise during transmission or any other effects. In this way, a synchronous output of the first and second data stream can take place on the receiver side even after one or more of these disturbances during the data transmission.

In one aspect of the invention, the method comprises the steps of receiving and delaying the first data stream having a plurality of consecutive subsections. Likewise, a second data stream is received. From this, at least one first identification feature is determined, which is derived from at least a first subsection of the successive subsections of the first data stream. In addition, the method comprises the step of analyzing the first delayed data stream or the individual subsections in the first data stream. A first subsection of the first data stream is determined as a function of the at least one first identification feature, and subsequently this first subsection is output together with the second data stream.

For delaying the first data stream, it is sufficient if this is temporarily stored. Measures can also be provided for the processing of the first data stream, which temporally delay an output of the subsections of the first data stream, so that sufficient time remains for the further method steps. A time offset between corresponding portions of the first and second data streams can be corrected.

For a coordinated output of the first and second data stream, it is therefore expedient, in addition to the extraction of the first identification feature in the second data stream, to determine a corresponding identification feature in the first data stream. For this purpose, the subsections of the first data stream are analyzed and an identification feature is derived from each subsection. This should be of the same nature as the first identification feature, so that after a comparison, a decision can be made as to whether the first identification feature contained in the second data stream matches or is at least sufficiently similar to the derived identification features of the first data stream.

In the present invention, an additional second data stream can thus be added to an already existing communication connection with a data transmission without having to interrupt the already existing communication connection. It is only necessary to cache the first data stream prior to output to complete the steps of determining Identify features and the subsequent synchronization.

In one embodiment of the invention, a first useful signal is provided for generating the first data stream, which comprises a plurality of successive subsections. The first payload signal may be any type of signal that includes audio data. From the individual subsections of the useful signal identification features are derived, which identify the respective subsection with a high probability. As a result, an assignment to the respective subsection can be determined with a high degree of probability on the basis of the identification feature. The derived identification features may be used to generate a second data stream by associating subsections in the second data stream intended for concurrent output with the corresponding subsections of the first data stream.

Conveniently, the derived identification features are particularly robust against artifacts in signal processing, compression or interference during data transmission. For example, the identification features can be formed from LTP (Long Term Prediction) coefficients of a subsection. Alternatively, the identification feature can be generated by analyzing frequency information of a content of the respective subsection of the first data stream or of the first useful signal. It is also possible to determine various sequence information, for example HASH sequences or checksums from subsections. The latter is useful if the first useful signal contains coded information according to a coding method. But it is also possible that the identification features encoded portions of the first data stream or the first useful signal.

In another embodiment of the invention, the method additionally comprises the steps of providing a first and second useful signal, which each have a plurality of temporally successive subsections. Corresponding subsections are assigned to each other for a later coordinated output. Identification features are determined from subsections of the first useful signal and assigned to the corresponding subsections of the second user signal. Subsequently, first and second useful signals are further processed and transmitted as the first or second data stream. After a reception, the two data streams are buffered. The identification features present in the second data stream are extracted. At the same time, the subsections of the first useful signal are obtained from the first data stream and identification features are determined therefrom. These are compared with the identification features present in the second data stream. If there is a match, the corresponding sections are output so that a coordinated output is ensured.

It is additionally possible to discard or issue unused sections after a certain period of time. This can be useful, in particular, if parts have been lost during the data transmission of the first or second data stream or can not be reconstructed due to errors during the data transmission.

• – Analoge Audiosignale bzw. Audiodaten;
• – GSM kodierte Audiosignale;
• – G.711 kodierte Audiosignale;
• – PCM kodierte Audiosignale;
• – AMR oder AMR-WB kodierte Audiosignale;
• – nach einem der G.72x Verfahren des ITU-T Standards kodierte Audiosignale, z. B. G.723.1, G.727, G.729.

The first data stream may contain at least one of the following useful signals or be formed as such:

• - analog audio signals or audio data;
• - GSM encoded audio signals;
• G.711 encoded audio signals;
• - PCM encoded audio signals;
• AMR or AMR-WB encoded audio signals;
• - According to one of the G.72x method of the ITU-T standard encoded audio signals, eg. BG723.1, G.727, G.729.

Identification features for subsections can be determined from each of the mentioned audio signals, which with high probability enable identification of the respective subsection. It may be appropriate to use identification features that are generated anyway during a signal processing or encoding of the audio signal or the first useful signal. This reduces the complexity within a transmission arrangement. By using existing coding or communication standards, the existing technologies and transmission methods can continue to be used.

With the method according to the invention, it is possible to add any additional data stream to the already existing data stream without interrupting it. For example, the additional data stream may contain video data, in particular in MPG, MPG2 or H.26X format. Likewise, additional image data, in particular in the JPG format or even data for a computer-assisted slide show can be transmitted. Another possibility is the parallel transmission of further voice or audio signals or audio data, for example for the transmission of a stereo signal. Likewise, text can be transmitted as a useful signal in the second data stream tuned to the first data stream. Basically, any type of information is suitable, the synchronization to the first data stream or needed on the existing in the first data stream user data.

A transmission of the first or the second data stream can be done in part by transmitting signals according to a mobile communication standard or for example by an Internet connection between at least two different nodes. It is likewise possible to carry out a transmission at least partially through a wired communication connection.

Accordingly, a transmission arrangement comprises a first device for detecting a first useful signal and a second device for detecting a second useful signal. Furthermore, an analysis device is provided, which is designed to determine at least one identification feature for an identification of the first subsection from a first subsection of the first useful signal. The analysis device is connected to a coding device which assigns the identification feature provided by the analysis device to a first subsection of the second useful signal. The transmission arrangement also comprises a first transmission stage, which is coupled to the first device for transmission of the first useful signal. A second transmission stage for a transmission of the second useful signal is connected to the coding device.

With the transmission arrangement, a first and a second useful signal can be detected. While the first useful signal is transmitted by the first transmission stage, the transmission arrangement comprises different means for further processing of the second useful signal. It is provided to assign the second useful signal identification features that allow synchronization with the first useful signal. For this purpose, the transmission arrangement according to the invention contains an analysis device for an analysis of subsections of the first useful signal.

The analysis device can be designed to determine from these signals identification features that are both robust against interference of any kind in the voice or audio signal and on the other hand allow identification of the respective subsection of the signal. In addition to the use of purely analog signals, the identification features can also be determined from coded digital useful signals. Likewise, the identification features may include portions of the audio signal or encoded audio data.

In one embodiment, therefore, the first device is designed for detecting the first useful signal for coding according to a coding type. For example, this is a μ-law coding, a GSM coding, a PCM coding, an AMR or AMR-WB coding a G.711 coding or a G.72x coding, whereby x can assume different values. The latter encodings refer to various methods of the ITU-T standard for voice compression. The various coding methods are particularly suitable for the coding of speech or audio signals.

For a coordinated output of the first and second useful signals, it may be expedient if the coding device additionally comprises a synchronization device. This is suitable for assigning an identification feature of a subsection of the first useful signal to a subsection of the second wanted signal, this assignment corresponding to a predetermined time ratio of the subsection of the second wanted signal to the subsection of the first useful signal. In addition, the coding device can be designed for the generation of so-called time stamps. Thus, the identification features and the subsections can be applied in the second useful signal, whereby an assignment is determined.

In another embodiment, the first transmission stage is designed for transmission on a first transmission channel and the second transmission stage for transmission onto a second transmission channel. These can each represent different transmission channels but also the same transmission channel. It is also possible that the first and second transmission stage form a common transmission stage and transmit first and second user data in a common transmission channel.

Another aspect of the invention relates to a receiving arrangement for a coordinated playback of payloads of a first and second data stream. This may include a first buffer for storing a first useful signal or a delay unit. An analysis device in the second receiving arrangement is coupled to the first intermediate memory or the delay unit and designed to determine and provide at least one identification feature for the identification of at least one first subsection of the first useful signal from the first useful signal.

The receiving arrangement contains a synchronizer for a concerted output of the first and second useful signal based on a comparison of stored in the second payload identification features with the at least one provided by the analysis device identification feature.

The processing of the first data stream and the extraction of identification features eliminates the need to terminate an already existing communication connection and transmission of the first useful signal. Rather, it is possible to set up a new communication connection for a transmission of a second data stream, to receive this and to determine a second useful signal and the identification features, which are provided for a synchronization of the second useful signal with the first useful signal. As a result, existing communication standards or technologies can continue to be used.

In one aspect of the invention, the receiving arrangement includes a comparison device configured to output a control signal in response to a comparison of the identification features stored in the second data stream with the identification features provided by the analyzer. This control signal is used to tune the output of the first and second useful signal.

The comparison device is embodied in one aspect of the invention for analyzing a similarity between the deposited identification features and the at least one provided identification feature. By analyzing a similarity, it becomes possible to enable identification and assignment for a synchronous output even during a slight disturbance of the first or second useful signal during a data transmission.

In another aspect of the invention, the comparison device is designed with a generation of the first useful signal from the identification features. This is useful, for example, if the identification features in the second data stream represent an encoded form of the first useful signal. In this embodiment, it is possible to make a decision as to which first useful signal is to be output, which is determined from the first data stream or generated from the identification features contained in the second data stream.

In general, because the transmitted signals are encoded to the receiving device in accordance with a communications standard, in one aspect of the invention, the receiving device comprises a first decoder. The decoder device is designed to generate the first useful signal from a first signal received by the receiving device. Furthermore, a second decoding device may be provided which is designed to generate the second useful signal from a second received signal. It is possible that the receiving arrangement is designed for receiving the first and the second signal in a common transmission channel or in different transmission channels.

In the system according to the invention is a transmitting device, which is designed for the delivery of a first and a second signal, wherein the second signal comprises identification features, which are derived from the first signal or from information contained therein. The receiving arrangement is designed to determine identification features from the first signal and includes means for a coordinated, in particular to a synchronous output derived from the first and second signals. The output is dependent on a comparison of the determined identification features with the identification feature contained in the second signal. Thereby, the output of any content of a second signal can be timed to an output of the first signal. The second signal may include, for example, audio signals, video signals or computer-aided slide shows.

In the following the invention will be explained with reference to various embodiments with the aid of the drawing in detail. Show it:

1 a first form of representation of a system with a transmitter and a receiver according to the inventive principle,

2 a second representation of a system for a synchronous transmission between a transmitter and a receiver according to the principle of the invention,

3 a third representation of a system for a synchronous transmission between a transmitter and a receiver according to the inventive principle,

4 a schematic representation with first and second useful signal,

5 a first embodiment of the method according to the invention,

6 a second embodiment of the method,

7 a third embodiment of the method.

As a rule, a system for communication comprises the following components. On the one hand a transmitter is provided which detects the payload data to be transmitted and after one Communication standard processed. The processed and possibly processed data are passed on to a communication network. As a rule, this contains several individual nodes which pass on the useful signal. Depending on the selected communication connection, it may happen that the useful signal is processed again or converted into another data format. At the end of the system, the network is in turn coupled to the receiving unit, which converts the transmitted data back into the payload.

A typical example of this is a connection of a mobile communication device in a fixed network and, for example, to an ISDN telephone line. In this case, the useful signals to be transmitted in the form of voice or audio signals are converted by the transmitter, the mobile communication device into signals according to a communication standard and transmitted to a base station. The base station forms part of the network and further processes the received signals. For example, it extracts the useful signal in the form of the speech signal. This is coded according to the PCM coding method and transmitted to the receiver via a landline line. It may well happen that depending on the distance between the transmitting device and receiving device within the network several different nodes are provided, which reprocess the signal during data transmission or otherwise process.

For the data transmission in the present case, an end-to-end connection is used. Here, the communication link between the communication device and the telephone is established, and the line remains independent of a voice transmission. The connection is interrupted only after a complete termination. This results in the transmission of the language to a substantially constant delay time that does not change the individual nodes of the communication link. In general, such a communication connection also becomes a circuit-switched or "circuit-switched" connection. designated.

In contrast, in the case of a packet-oriented transmission, the individual packets can be transmitted to the recipient via different routes. Consequently, it can also come to different terms here. A typical example of such a packet-oriented communication connection is in Internet-based transmissions.

1 shows a system of a transmitting unit 1 , a receiving unit 3 and a network in between 2 for a communication between transmitting unit 1 and receiving unit 3 ,

The transmitting unit is designed in the present case as a mobile communication device. It contains a microphone 131 for recording an analog voice or audio signal, for example from a user. This is done by a coding device 13 converted into a mobile data compliant data stream B. The coding device contains this 13 For example, a signal processor that converts the analog audio signals into digital signals. These are filtered low-pass, and coded according to a method provided for the mobile radio standard. Subsequently, the thus encoded and processed analog audio signals as data stream B via an antenna 19 to a communication network 23 issued. The term data stream is to be understood in the following as a generic term for all types of signals for the transmission of information.

In the present case, the communication network includes 23 a base station and other landline connections with multiple landline nodes. Since a transmission according to a mobile standard between the landline nodes is usually not provided, the base station generates in the network 23 from the data stream B another signal. For example, this can now take place in the form of a PCM-coded variant of the analog audio signal A present in the data stream B.

Finally, a data stream C, which in the ideal case contains the same user data (ie the audio signal A) as the stream B to the base station 24 issued. This generates the signal D according to a predetermined mobile radio standard and sends it to the receiving unit 3 ,

From the receiving unit 3 the signal D is received and decoded. The decoding includes, for example, the conversion and extraction of the encoded audio data. These are used as data stream E in the audio decoder 31 fed, which converts them into the digital audio signal F. On the output side is the audio decoder with a loudspeaker 37 coupled to the output of the audio signal.

According to the invention, it is provided to establish a further communication connection to an already existing communication connection for a transmission of voice or audio signals. With the second connection video signals to the receiving unit 3 be transmitted.

The transmitter unit contains this 1 another entrance 132 For example, to a video camera 15 for detecting video signals I is connected. The analog image information I is from the video camera 15 converted into a digital video signal J and sent to the video encoder 11 transmitted. For example, the digital video signal J may YUV encoded image information at a frame rate of 30 frames per second included. The video encoder 11 generates from it a compressed digital video signal M. A compression is particularly useful if only a limited bandwidth is available for the data transmission of the video signal. For example, digital video information can be very well compressed and encoded using the MPEG or MPEG2 method. A compression and coding with the video encoder 11 also has the advantage that the video encoder 11 additionally time stamp or general time information K in the compressed video signal M can store. For example, the time information can be transmitted by means of RTP timestamps.

The total signal N is a data stream over the interface 18 to a second network 22 transmitted. In the present case, this represents the Internet, which forms a packet-oriented network. For transmission of packets of the data stream N, for example, a UDP / IP protocol can be used. The individual packets are distributed over several nodes within the Internet 22 finally as data stream O to the base station 24 transmitted to the receiving unit as a signal D using a mobile communication standard 3 transmitted.

The transmitted signal D is decoded and the video information therein in the form of the signal R to a video decoder 33 passed on. This decodes the video information contained in the signal R and gives it optionally via a buffer 35 to a screen 38 from.

Because of the network 22 used UDP / IP protocol may lead to a faulty data transmission of the video information or the data stream N and O respectively. For example, individual packets may be lost. It is also possible that the different packets of the stream N at different times at the base station 24 and thus in the receiver 3 arrive. Another problem is that there is no direct temporal relationship between the first communication connection for the transmission of the audio signals A in the first data stream D and the second communication connection for the transmission of the video signals I. As a result, image or audio signals can be output at different times. A synchronization between sound and picture is no longer guaranteed.

For a coordinated output of the signals A and I in the receiver is an analysis device in the transmission arrangement according to the invention 12 and an encoder 11a intended. The analyzer 12 is in the present example with the input 131 for the audio signals A coupled. It generates from the detected audio signal A identification features L, with the help of which sections or areas of the audio signal can be identified. The identification features may be associated with the coded video signal M so as to establish which portions of the audio signal belong to portions of the video signal. For this purpose, the analysis device decomposes in the exemplary embodiment 12 the audio signal in sections of the same length.

Each subsection of the audio signal is selected so that its output takes place in a temporally defined relationship to a representation of one or more images of the detected video signal. The analyzer 12 extracts from each subsection an identification feature L, a so-called fingerprint. This identifies the respective subsection of the audio signal A uniquely. The uniqueness is through the synchronization device 17 ensures that adds a time stamp K both the identification feature L and the corresponding section of the video signal. In other words, the identification feature L with the help of the synchronization device 17 a portion of the video signal J in the video encoder 11 assigned.

The identification feature is chosen so that on the one hand it is particularly robust against possible interference during data transmission. On the other hand, it is also robust against artifacts that occur due to signal processing or compression during the transmission of the first data stream B. These artifacts can affect the useful signal in the first data stream B.

The compressed video signal M and the identification feature are in the encoder 11a summarized to the data stream N.

4 shows a schematic representation to illustrate this assignment. The audio signal A is divided into different sections TA1, TA2, TA3 each of equal length. In the embodiment, the length of each subsection TA1 to TA3 is correlated with the digital image information VB1 to VB3 of the video signal J. In the present case, subdividing the audio signal A into subsections to each second video image VB1, VB2 and VB3 of the digital video signal J. Da Video signal consists essentially of a number of temporally successive frames, it is easily possible to achieve a synchronization in that a particular section of the audio signal A is played back to a video image.

For each of the subsections TA1, TA2 and TA3 now a fingerprint, a unique identification feature FP1, FP2 or FP3 determined. This fingerprint may be determined, for example, by LTP or LPC coefficients. Such coefficients are generated when encoding the speech signal A and thus can be easily used without additional effort. Another possibility is to determine particularly robust frequency information for each subsection. After generation of the respective identification features, these are assigned to the corresponding video image of the digital video signal.

For an assignment, the video images VB1 to VB3 as well as the generated identification features FP1 to FP3 are now provided with a time stamp K on the one hand. This time stamp K allows the assignment of the identification features L to the coded video signal M with the coded video images.

In the coding device 11a to 1 the identification features L and the coded video signal M are then combined. This can be done, for example, by multiplexing the two data streams L and M. The data stream N generated by multiplexing in the present example is designed as a packet-oriented data stream whose packets contain sections of the coded video signal M and the associated identification feature. Each packet contains the subsection VB1 to VB3 of the video signal J which is assigned to the corresponding identification feature FP1 to FP3.

Because of the time stamps K contained in the identification features L and the coded video data stream M, an allocation is ensured even if a different package form is selected. Thus, video data stream M and the identification features L can also be transmitted in different packets or even different data streams.

Another possibility is, within the encoded video data stream M, the identification features L as additional information, engl. "Supplementary enhancement information". One video standard that allows this is the H.264 / AVC standard. An additional multiplexing can then be omitted, the coded and provided with the features L video stream M forms in such a case the data stream N. Basically, only an association between the identification features in the stream L and the video signal J should be guaranteed.

Present includes 4 a packet of the multiplexed data stream N a header portion RTP, are stored in the header information for each data format and time stamp. Connected to it is a second portion in which the identification feature FP1 is stored. The video information part DVB1 contains the image information of the digital video signal J starting from the video image VB1 to the video image VB2. In a corresponding manner, the coding device multiplexes 11 Likewise, it adds the identification features FP2, FP3 from the feature stream L accordingly.

The thus prepared second data stream N is again through the second communication link via the network 22 to the recipient 3 transfer. The received data stream P comprises not only the coded video signal R but also the additional identification features Q.

The feature stream Q becomes the device 36 fed. This again determines the identification features and the timestamps that have been supplied to the identification features on the transmission side. In addition, the receiver contains 3 a synchronizer 34 , the input side to the output of the audio decoder 31 for supplying the decoded speech or audio signal F is connected. In addition, he is at the facility 36 connected to the signal U, which includes the identification features. The synchronizer 34 serves to, from the sections of the speech signal F of the audio decoder 31 To generate identification features. That from the synchronizer 34 The method used for generating the identification features essentially corresponds to the analysis apparatus 12 within the transmission arrangement 1 , The generated features will then match those of the facility 36 compared transmitted characteristics. If there is a match or a high similarity, it is assumed that a corresponding section of the video signal is present for the subsection of the speech signal F.

To ensure a concerted output is the audio decoder 31 in addition to a buffer device 23 connected for buffering the audio signals. Another buffer device 35 is used for buffering the decoded video signal W. They are used to correct a corresponding time offset due to different transmission times or due to the different signal processing. Both buffer devices 23 and 35 be from the synchronizer 34 controlled by the control signals V and X. Depending on the drive, the buffers supply the sub-sections G, Y of the speech signal F and the video signal W selected by the control signal to the output devices 37 and 38 from.

The synchronizer is with the video decoder 33 and the facility 36 for supplying the time stamp information S, T coupled. Together with the comparison of the determined by him Identification features with the identification features of the device 36 and the timestamp information is generated by the synchronizer 34 the control signals V and X. It is useful, in addition to the audio buffer 23 also the video buffer 35 in the event that the video signal before the corresponding audio signal, the receiver arrangement 3 reached or the signal processing in the synchronizer takes longer than a decoding of the video stream R.

The additional buffering also makes it possible, in the case of lost data, to emit the corresponding signals of the respective other data stream. For example, areas of the audio signal F can also be output if the video signal W corresponding thereto is lost or not reconstructable during the transmission. Due to different delays in the two networks 22 . 23 it is expedient to choose a suitable buffer size. In addition, it may be useful, if the identifiers in the first or second data stream match, to not immediately output the corresponding sections, but to buffer them again instead. This has the advantage that later output can be largely continuous without any later delays due to longer signal propagation times in the network 2 ,

A buffering or delay of an output of the speech signal can also be effected by a special processing of the speech signal. Instead of the buffer, a signal processor may be provided, which performs a time-based modification of the speech signal. So the speech signal could be dynamically distorted, eg. For example, vocal sounds may be dynamically lengthened or shortened at the output, thereby achieving a delay. This "time scale modification" method is particularly suitable, since a continuous output of the speech signal without interruptions made, but still time for the processing of the second data stream and the vote of an output is obtained.

During the transmission of the first data stream in the network 23 and the second data stream in the network 22 it can lead to signal interference or signal changes. So in the first network 23 the encoded audio signals are otherwise processed. This changes the frequency spectrum, z. B. phase information, the first data stream B and its timing. It is therefore appropriate to choose identification features that are particularly robust against such interference. For example, the so-called LTP or LPC coefficients for the speech signal (Long-Term Prediction, Linear Predictive Coding).

2 shows a further embodiment of a system according to the invention with a transmission arrangement 1 , a receiving arrangement 3 and a network connected in between 2 , The transmitter 1 has a first detection device 130 for detecting the first useful signal, for example of speech signals. Another arrangement 150 serves here for generating and displaying a computer-aided presentation J '. The presentation J 'may include audio and additional video data as well as still pictures.

The first device 130 encodes the detected first useful signal and generates from the encoded first useful signal identification features L, which allow identification of subsections of the first useful signal. The identification features L are a coding device 110 transmitted. The coding device 110 is also on the second device 150 connected. It generates the second data stream N ', in which the identification features L are combined with the information about the computer-assisted slide show J'.

The second data stream is sent to the second network 220 while the encoded audio signals are transmitted through an antenna 190 to the first network 230 be sent. Both networks 220 . 230 are each with a base station 240 . 250 for a mobile communication link with the receiving device 3 coupled.

In the present case, the transmission of the first data stream, ie the voice signal and the second data stream, takes place via two different transmission channels. For example, the encoded audio data D in the form of a GSM signal to the receiver arrangement 3 be sent. The second data stream, on the other hand, is sent to the receiving arrangement via a second transmission channel D1 3 transmitted. The receiving arrangement 3 includes two receiver stages 310 . 330 which process the two signals in the different transmission channels. They contain a decoder for decoding the audio signal or the screen presentations. In the synchronizer 340 An allocation of subsections of the decoded audio signal to the corresponding sections of the computer-aided screen presentation using the identification features.

Illustrates another aspect of the invention 3 , Elements of the transmitter 1 or the network 2 with the same function or effect as elements in the design 1 bear the same reference numbers. In the illustrated embodiment, the analysis device for generating coded and provided with time stamps K audio signals L is executed. These serve as identification features and are combined with the coded and time stamped video stream M to the second data stream N. About the first network 23 Furthermore, the first data stream B is transmitted, which contains a coded speech signal. About the second network 22 the transmission of the data stream N. the receiving arrangement 3 ' is configured to decompose the received second data stream P back into the current Q and the current R. Furthermore, it contains the device 36 , which is embodied here for decoding the feature stream Q into speech signals U and time stamps S. Together with the existing time stamps S and T, which were added on the transmitter side as a time stamp K, a time-matched outputting of the speech signal U and the signal W is possible.

The synchronizer 34a is designed to, on the one hand, determine the voice quality and, in the case of an erroneous reception of the second data stream P, to switch over to the still existing first communication connection for the output of the voice signal F. This is useful, for example, in a transmission of the first and second data stream with different mobile radio standards. If, for example, the first data stream is transmitted as a GSM mobile radio signal and the second data stream is transmitted using the standard UMTS, a continuation of the circuit-switched communication connection is possible even if the second data stream fails.

With the elements of the illustrated systems according to the invention, in the case of an existing communication connection for transmitting a first data stream, a second communication connection can be added for transmitting a second data stream without interrupting the first communication connection.

It is likewise possible to set up a new communication connection for transmitting the first and the second data stream. A timed output is provided by the identification features added to the second data stream derived from the first data stream. The additional identification features in the second data stream are added on the transmission side. This is possible, for example, in the form of a fingerprint or additional information within the transmission protocol used for the second data stream. In addition, further information can be transmitted, for example, timestamps. By using a suitable transmission protocol, such as the Real Time Protocol, the addition of timestamps to data or identification features is still formalized and their use for synchronization simplified.

In addition, it is possible to transmit the same identification features by a further transmission channel to the receiver. It merely has to be ensured that the identification features in the further transmission channel can be assigned to the individual sections of the second data stream.

5 shows an embodiment of the method according to the invention. In a first step S1, a receiving arrangement receives a first data stream in the form of a first signal. The data stream is processed and the useful signal contained therein is buffered in a buffer. Parallel or substantially simultaneously for this purpose, a second data stream is received in step S2. In addition to second payload data, this also contains identification features which are suitable for assignment to the payload signal in the first data stream. The identification features are derived from the first useful signal.

In step S3, the identification features contained in the second data stream are extracted. Subsections of the useful signal in the second data stream and the identification features of the subsections of the first data stream assigned to the subsections are then temporarily stored in step S4. During steps S3 and S4, that is to say the determination of the identification features in the second data stream, it is possible to analyze the subsections of the buffered useful signal. This process takes place in step S5. In this case, identification features are determined from the individual subsections, which correspond in type and structure to the identification features of the second data stream. If, for example, the identification features in the second data stream represent LTP coefficients (Long Term Prediction), the LTP coefficients are also determined in step S5 from the individual subsections of the stored first data stream.

In step S6, the identification features determined from the subsections of the useful signal are compared with the identification feature (s) of the second data stream. For example, each identification feature of the subsections of the useful signal in the first data stream can be compared with each of the identification features determined from the second data stream. For this purpose, different comparison methods and methods are available in step S7. The comparison can be designed such that a positive result is produced only if there is an exact match of an identification feature of a subsection of the first data stream with an identification feature of the second data stream.

However, since errors may have occurred within the two data streams during a transmission or through signal processing or Compression distortions or other changes may have occurred, the identification features may differ slightly. Therefore, it may be appropriate to provide for some freedom of choice when making a decision. The match is thus determined only with a probability. If this exceeds a predetermined value, then a match is accepted. Another possibility would be to perform a correlation analysis for the identification features of the first and second data streams.

If the comparison process in steps S6 and S7 reveals that the identification features of the subsections of the first data stream do not match the identification feature (s) in the second data stream, the comparison is repeated with new identification features of the first or second data stream. In the case of a match, on the other hand, in step S8, the subsections of the first and second data streams assigned to the two identification features are loaded from the buffer. In step S9, the sections are finally output timed to each other.

The buffering of the first data stream and the buffering of the second data stream allow it to correct a time delay during a receive operation of the first or second data stream. By analyzing the useful signals in the first data stream and determining the identification features, there is no need to insert timestamps in both data streams in advance for later output.

Rather, any desired signals may be provided in subsections in the second data stream, each of the subsections being assigned identification features if these are to be output synchronously to the subsections of the useful signal in the first data stream. A special choice of the second useful signal is not necessary. For example, by the presented method, a video signal as a useful signal of the second data stream can be synchronized with the aid of the identification features to an already existing transmission of a speech signal. It is not necessary to transmit the first and second data streams over the same transmission channel to a receiver.

6 shows an extension of the inventive method, which is taken into account when parts of the first or second data stream are lost or damaged during transmission. In this embodiment, it is assumed that the first data stream forms an analog or digital telephone signal for the transmission of audio signals. This is delivered from the transmitter to the receiver via several nodes.

To the already existing communication connection, a second data stream is now to be added, which contains a second useful signal, which is synchronized to the telephone signal. For this purpose, in step S10, the first and the second data stream are received substantially simultaneously via a common transmission channel. This transmission channel can represent a mobile connection according to the UMTS standard, for example. Another possibility would be to receive, for example, the first data stream via a telephone connection and the second data stream packet-oriented over a DSL connection. In such a case, the transmission of the two data streams takes place via the same physical line.

In step S11, the common received signal is decoded or separated into the first and the second data stream. The first data stream as a telephone signal is divided into different sections of equal length in step S12. However, these sections are not arbitrary, but follow a predefined pattern that results from the first data stream. In step S16, these sections are cached for later processing.

For processing the first data stream in steps S12 and S16, the second data stream with the second useful signal is also processed. The second useful signal also includes a plurality of subsections, which are separated in step S13. Certain subsections are each assigned an identification feature that is extracted from the second data stream and stored in a memory.

Although the reception of the first and second data streams is generally simultaneous, this does not mean that the corresponding sections of the first and second data signals have a specific temporal relationship to one another. For example, due to different transmission paths between the transmitter and the receiver, a time offset between corresponding subsections of the first data stream and subsections of the useful signal in the second data stream occur. In other words, subsections of the first data stream may arrive earlier or later at the receiver than the corresponding subsections of the second useful signal. If this time offset now exceeds a predetermined value, it is no longer expedient to buffer late arriving partial sections. This is especially meaningless if, for example, previously arrived sections the first data stream further processed and possibly already been issued.

In the present case, it is assumed that the second useful signal is delayed with respect to the telephone signal. In step S15, it is therefore checked whether the identification features assigned to the subsections of the second data stream have already been output. This can be done by a brief comparison of the extracted identification features of the subsections of the second useful signal with identification features of already output subsections of the first data stream. Another possibility for such a check is when individual subsections of the second useful signal in the second data stream are assigned time stamp information. Thus, all the subsections can be discarded, which include a timestamp, which are before the last time stamp issued a subsection of the second useful signal.

If such a comparison of a match is shown in step S18, the corresponding subsection of the second payload signal is discarded in step S19 since the subsection of the first data stream to be output synchronously to this subsection has already been output. If necessary, the subsection of the second useful signal and the associated identification feature are stored in step S20.

In step S17, an analysis and determination of the identification features of the subsections of the first data stream is undertaken.

In step S21, the identification features of the subsections of the first data stream are compared with the identification features from the second data stream. If such a comparison results in a match in step S22, this essentially means that the subsections of the first and second data streams are to be output in a coordinated manner. These are loaded from the respective buffer in step S23 and output synchronously in step S24.

If, on the other hand, a subsection of the second useful signal to the corresponding subsections of the first data stream has not yet been received and processed, the comparison procedure in steps S21 and S22 results in no match. In such a case, it is assumed that the corresponding subsection has not yet been received in the second data stream. Therefore, a counter is incremented in step S25. The counter indicates whether the subsection in the telephone signal should be output in the second useful signal despite the missing subsection. For this purpose, the counter is compared in step S26 with a predetermined value. If the counter is smaller than this value, the method is continued with the further analysis of newly received subsections of the first data stream.

Otherwise, if the counter is greater than the predetermined value in step S25, the portion of the telephone signal to be next issued is determined in step S27 and output in step S28. The identification feature belonging to the output subsection is now marked as already issued and serves to identify a subsection of the second useful signal with the same assigned identification feature. Since the associated subsection has already been output in the first data stream, the subsection in the second data stream can be discarded.

In the embodiment of the method, it is expedient to take into account both a delay of the subsections of the first data stream relative to the subsections of the second data stream and the reverse possibility.

7 shows a further embodiment of the method according to the proposed principle. In this exemplary embodiment, besides the method steps for receiving the first and second data streams, the method steps during the transmission process are also shown.

In step S30, a communication link for transmitting a first useful signal or a first data stream is set up between a transmitter and a receiver. The structure is circuit-switched and remains until the end. The first data stream contains the useful signal, for example a voice signal. During a period of time that follows, in step 31 a continuous communication. Voice is transmitted from the sender to the receiver via the circuit-switched connection.

This communication is also continued in step S32 over the already existing connection. In addition, a second communication connection should now be established to the already existing first communication connection, via which a second data stream is transmitted. The useful signal of the first and second data stream should be synchronized with each other. For this purpose, the first and the second useful signal are each divided into subsections.

During the continuation of the first communication connection and the transmission of the first user data in step S32, a second communication connection is set up via a further transmission channel in step S33. This transmission channel can be compared to the Transmission channel for the first communication connection to be structured differently. For example, while the first transmission channel for the first communication connection comprises a fixed network connection, the second transmission channel includes a packet-oriented Internet connection.

In step S34, a voice or audio signal in the form of several subsections is now detected as the first useful signal. Essentially at the same time and synchronously, a corresponding video signal is detected in step S35, which likewise has several subsections. In step S36, identification features are determined from the detected audio signal. These features can be determined both from the detected analog audio signal, as well as from a digital audio signal or an already coded audio signal. The term encoded audio signal is understood to mean processed audio signals that have been encoded according to a method. Examples of such coding methods are the AMR or the AMR-WB coding method, the GSM EFR coding method, G.72x coding method of the ITU-T standard for speech compression or combinations thereof. These are particularly suitable for speech coding.

The identification features, which were determined in step S36, allow a unique identification of the respective subsection of the speech signal. In a coding according to one of the above-mentioned methods, it is also conceivable to use features which are generated during the coding as identification features. Thus, the LPC coefficients generated in the AMR coding can also serve as identification features. In addition, the generated identification features should be particularly robust against disturbances or artifacts occurring during the transmission of the first data stream.

The identification features determined in step S36 are added to the second data stream during the encoding of the subsections of the video signal in step S37. This is done such that an identification feature of a subsection of the speech signal is assigned to a subsection of the video signal that is synchronous with the corresponding subsection of the speech signal. This is achieved by timestamps or a suitable combination of the video signal and the identification features.

After coding the video signal in step S37, the second data stream and the first data stream are transmitted in steps S38 and S39. The transmission may include various transmission channels as well as a common transmission channel. By a common transmission channel is meant a transmission channel on the same frequency, using the same communication standard or using the same network nodes. During steps S38 and S39, however, a time shift or a time delay of the first and second data streams may occur. This results in a reception of the first data stream in step S40 and a reception of the second data stream in step S41 at different times.

In step S42, the received first data stream is decoded and the speech or audio signal contained therein is extracted. This is subdivided into several subsections, each of which analyzes and generates an identification feature. In parallel, in step S43, the received second data stream is further processed. The identification features added in the second data stream of the subsections of the video signal are extracted. These identification features are then compared in step S44 with the generated identification features of the subsections of the buffered audio signal. If the comparison gives a match in step S46, the respective subsections of the audio signal and the video signal are loaded in step S45 and output synchronously in step S47. Otherwise, in step S48, the audio signal may be output without a corresponding video signal.

Since the sequence of the subsections of the audio signal is detected, it is thus also possible to output subsections of the audio signal that are temporally ahead of a subsection of the audio signal to which a corresponding subsection of a video signal was found. As a result, a continuous output of the audio signal can be ensured, especially in the case of error-prone transmission of the second data stream.

The illustrated method has the advantage that it can be applied in a simple manner to already existing mobile radio standards or communication connections. In particular, it is possible to continue an already existing communication connection without much additional effort. It merely has to be ensured that the received first circuit-switched useful signal is buffered so that synchronization with a possibly later received second data stream is ensured. It is not necessary that each subsection of the first useful signal is analyzed. This is rather dependent on the requirements of the second data stream. For example, if video signals are transmitted at thirty frames per second, it may be convenient to break the voice or audio signal into 1/30 second increments and extract a corresponding identifier from each of these subsections. However, it is also possible to associate only every xth image of the video signal with an identification feature of a corresponding subsection of the audio signal. It is conceivable in the method according to the invention that the receiver does not know the exact assignment. Nevertheless, a synchronous output can be made if the subsections of the audio signal to which no subsection of the video signal is assigned are also output continuously.

In addition to the synchronization of a video signal to a corresponding audio signal, he can use the method according to the invention as well as the arrangements for all data streams which contain temporally mutually tunable user data. For example, it is also possible to transmit a common video signal over a plurality of transmission channels and multiple data streams to a receiver. It is also conceivable a voice or audio transmission in multiple streams (or signals), for example, to allow a stereo signal. A synchronization of the data streams can be done as indicated. Also, the method and the arrangement is not limited to the synchronization of two data streams, but can be extended to multiple streams, provided that the respective user data to be synchronized allow the generation of unique identifiable identification features.

LIST OF REFERENCE NUMBERS

1

transmitter

2

network

3

receiver

11

video encoder

11a

coding

12

analyzer

15

Device, camera

22, 23

network

23, 35

Buffering device, storage

24, 240, 250

base station

31

Audio decoder

33

video decoder

34

synchronizer

36

Facility

37, 38

output device

131

Input, microphone

151

Entrance, video camera

Claims (52)

Method for receiving a) a first data stream (E) generated from a first useful signal having a multiplicity of successive subsections, b) a second data stream (P) generated from a second useful signal having a multiplicity of successive subsections a Nutzanteil (W) and identification features (V) reproducing the second useful signal, each of which is assigned to exactly one different one of the subsections of the second wanted signal and are derived from and identify the corresponding subsection of the first wanted signal, wherein respective corresponding subsections of the first and the second payload signals are associated with each other, comprising the steps of: c) - receiving the first and second data streams (E, P); d) - determining the identification features (U) from the received second data stream (D); e) - recovering the sections of the second useful signal from the useful portion (W); f) - recovering the sections of the first useful signal from the first data stream (E); g) - again deriving identification features for the recovered subsections of the first useful signal from the retrieved subsections of the first useful signal; h) - comparing the identification features (U) determined in step d) and the identification features derived in step g), subsections of the first useful signal and subsections of the second useful signal having matching or at least sufficiently similar identification features being associated with one another; and i) outputting the subsections with matching identification features in a timed manner, wherein the subsections of the first useful signal are output with a delay; characterized in that the identification features derived in step g) are respectively formed by: Long term prediction coefficients of the assigned recovered section of the first useful signal, or Linear Predictive Coding coefficients of the associated recovered section of the first useful signal, or one of the associated recovered subsection of the first useful signal generated HASH sequence. The method of claim 1, wherein the steps of receiving the first data stream and the second data stream comprise at least one of the following steps: - receiving a speech signal; - receiving an audio signal; - receiving a video signal; - receiving a computerized slide show; - Receive current text. The method of claim 1 or 2, wherein the step of receiving the first data stream comprises the steps of: - Providing a first useful signal comprising at least two consecutive subsections; - Deriving the identification features (L) from the successive sections, each of which can be used for an identification of the corresponding subsection of the successive subsections; - generating the first data stream from the first useful signal; Transmission of the first data stream over a network ( 23 . 24 ); Receiving the first data stream from the network ( 23 . 24 ). Method according to one of Claims 1 to 3, in which the step of receiving the second data stream (P) comprises the steps: - Providing the second useful signal with a plurality of successive sections; - Providing the identification features; - generating the second data stream by assigning the identification features to the subsections of the second useful signal; - Transferring the second data stream. The method of claim 4, wherein the step of providing the second useful signal comprises a decomposition of the second useful signal in its successive sections and in the step of generating the second data stream, the identification features (V) are assigned to the subsections of the second useful signal. Method according to one of Claims 1 to 5, in which the first data stream comprises at least one of the following useful signals: - analog audio signals; - digital audio data or digital audio signals - encoded audio signals; - μ-law encoded audio data or μ-law encoded audio signals - GSM EFR encoded audio data or GSM EFR encoded audio signals; PCM encoded audio data or PCM encoded audio signals; AMR encoded audio data or AMR encoded audio signals; - AMR-WB encoded audio data or AMR encoded audio signals; G.729 encoded audio data or G.729 encoded audio signals; - encoded audio data or encoded audio signals according to one of the G.72x methods of the ITU-T standard for voice compression. Method according to one of claims 1 to 6, wherein the step of outputting the second data stream comprises the step of converting the second data stream into a speech signal and / or a video signal. Method according to one of Claims 1 to 7, in which the second data stream (P) comprises at least one of the following useful signals: A video signal, especially in MPEG, MPEG2, H.26x format - images or image data, especially in jpeg format; - data for a computer-assisted slide show; - audio data or audio signals; - time-based text, scrolling text. Method according to one of Claims 1 to 8, in which transmission of the first and / or second data stream takes place at least partially in at least one of the following ways: - By transmitting signals according to a mobile communication standard, - By an Internet connection ( 22 ) between at least two nodes, - by a wired communication link ( 22 ), and - via a circuit-switched communication connection ( 23 ). Method of sending A first useful signal comprising a plurality of successive sections, - A second useful signal comprising a plurality of successive sections, each corresponding subsections of the first and the second payload signals are associated with each other, comprising the following steps: a) - deriving identification features in each case from a subsection of the first useful signal, wherein the identification features identify the respective subsection; b) - assigning the identification features in each case to the corresponding subsections of the second useful signal; c) generating a first data stream from the first useful signal; d) generating a second useful portion reproducing the second useful signal and the data stream comprising the identification features from the second useful signal; and e) - transmitting the first data stream and the second data stream, characterized in that the derived in step a) identification features are each formed by Long term prediction coefficients of the assigned subsection of the first useful signal, or Linear Predictive Coding Coefficients of the associated subsection of the first useful signal, or - A generated from the associated subsection of the first useful signal HASH sequence. The method of claim 10, wherein the steps of receiving the first data stream and the second data stream comprise at least one of the steps of: receiving a speech signal; - receiving an audio signal; - receiving a video signal; - receiving a computerized slide show; - Receive current text. The method of claim 10 or 11, wherein the step of receiving the first data stream comprises the steps of: - providing a first payload signal comprising at least two consecutive subsections; Deriving an identification feature from at least one of the successive subsections, which is usable for an identification of the at least one subsection of the successive subsections; - generating the first data stream from the first useful signal; Transmission of the first data stream over a network ( 23 . 24 ); Receiving the first data stream from the network ( 23 . 24 ). The method of any one of claims 10 to 12, wherein the step of receiving the second data stream comprises the steps of: - Providing the second useful signal with a plurality of successive sections; - Providing the identification features; - generating the second data stream by assigning the identification features to the subsections of the second useful signal; - Transferring the second data stream. The method of claim 13, wherein the step of providing the second useful signal includes a decomposition of the second payload signal into its successive subsections and in the step of generating the second data stream the identification features are assigned to the subsections of the second payload signal (J, M). Method according to one of Claims 10 to 14, in which the first data stream comprises at least one of the following useful signals: - analog audio signals; - digital audio data or digital audio signals - encoded audio signals; - μ-law encoded audio data or μ-law encoded audio signals - GSM EFR encoded audio data or GSM EFR encoded audio signals; PCM encoded audio data or PCM encoded audio signals; AMR encoded audio data or AMR encoded audio signals; - AMR-WB encoded audio data or AMR encoded audio signals; G.729 encoded audio data or G.729 encoded audio signals; - encoded audio data or encoded audio signals according to one of the G.72x methods of the ITU-T standard for voice compression. The method of any one of claims 10 to 15, wherein the step of outputting the second data stream comprises the step of converting the second data stream into a speech signal and / or a video signal, respectively. Method according to one of Claims 10 to 16, in which the second data stream comprises at least one of the following useful signals: A video signal, especially in MPEG, MPEG2, H.26x format - images or image data, especially in jpeg format; - data for a computer-assisted slide show; - audio data or audio signals; - time-based text, scrolling text. Method according to one of claims 10 to 17, in which a transmission of the first and / or second data stream takes place at least partially in at least one of the following ways: - by transmission of signals according to a mobile communication standard, - by an Internet connection ( 22 ) between at least two nodes, - by a wired communication link ( 22 ), and - via a circuit-switched communication connection ( 23 ). A method for transmitting from a transmitter to a receiver - a first useful signal comprising a plurality of successive sections, - a second useful signal comprising a plurality of successive sections, wherein corresponding sections of the first and the second payload signals are associated with each other , comprising the following steps: a) deriving identification features from a subsection of the first useful signal, wherein the identification features identify the respective subsection; b) - assigning the identification features in each case to the corresponding subsections of the second useful signal; c) generating a first data stream from the first useful signal; d) - generating a second, a second useful signal reproducing useful portion and the Identification features comprising data stream from the second useful signal; e) establishing a first communication link between the transmitter and the receiver for transmitting the first data stream; f) - establishing a second communication link between the transmitter and the receiver for transmission of the second data stream; g) - transmitting the first and second data streams from the transmitter via the communication links to the receiver; h) - receiving the first and second data streams; i) - determining the identification features from the received second data stream; j) - recovering the sections of the second useful signal from the useful portion; k) - recovering the subsections of the first payload signal from the first data stream; l) - again deriving identification features for the recovered sections of the first useful signal from the recovered sections of the first useful signal; m) - comparing the identification features determined in step i) and the identification features derived in step 1), partial sections of the first useful signal and partial sections of the second useful signal having matching or at least sufficiently similar identification features being assigned to one another; and n) outputting the subsections with matching identification features in a timed manner, wherein the subsections of the first useful signal are output with a delay; characterized in that the identification features derived in step a) are respectively formed by: - long term prediction coefficients of the assigned subsection of the first useful signal, or - Linear Predictive Coding coefficients of the associated subsection of the first useful signal, or - one of the associated subsection of the first useful signal generated HASH sequence, and in step 1) derived identification features are each formed by - long term prediction coefficients of the associated recovered portion of the first useful signal, or - Linear Predictive Coding coefficients of the associated recovered portion of the first useful signal, or - one the associated recovered recovered portion of the first useful signal generated HASH sequence. The method of claim 19, wherein the step of transmitting the first data stream comprises the step of: - detecting the first useful signal; - decomposing the first useful signal into subsections and determining the identification features for identifying the subsections of the first useful signal; and - Generating the first data stream from the subsections. The method of claim 20, wherein the step of generating the first data stream or the step of detecting the first useful signal comprises the step of encoding according to at least one of the following methods: - GSM EFR; - AMR; - AMR-WB; - G.729; G.72x according to the ITU-T standard; - μ-law. The method of any one of claims 19 to 21, wherein the step of generating a second data stream comprises the steps of: - detecting the second useful signal having a plurality of subsections; Generating the second data stream from the second useful signal and the identification features derived from the first data stream, wherein each subsection of the second data stream is assigned one of the identification features derived from the first data stream for a later timed output. The method of any one of claims 19 to 22, wherein the step of receiving the first data stream comprises the step of buffering the first data stream. The method of any one of claims 19 to 23, wherein in the steps of transmitting, the first communication link and the second communication link at least partially comprise a shared signal path. The method of any of claims 19 to 24, wherein the step of establishing a communication connection further comprises the step of transmitting a third data stream for communication between the transmitter and receiver prior to transmitting the first data stream. Method according to one of claims 19 to 25, wherein the first data stream comprises at least one of the following useful signals: - analog audio data or audio signals; - μ-law encoded audio data or audio signals - GSM EFR encoded audio data or audio signals; AMR or AMR-WB encoded audio data or audio signals; G.729 encoded audio data or audio signals; - encoded audio data or audio signals according to one of the G.72x methods of the ITU-T standard for voice compression; - Fax data. The method of claim 26, wherein the identification feature in the second data stream comprises the useful signal of the first data stream. The method of any one of claims 19 to 27, wherein the step of outputting the second data stream comprises the step of converting the second data stream to audio signals and / or video signals. Method according to one of Claims 19 to 28, in which the second data stream comprises at least one of the following useful signals: - Video data, especially in MPEG, MPEG2, H.26x format - image data, in particular in jpeg format; - data for a computer-assisted slide show; - audio data or audio signals. Method according to one of claims 19 to 29, wherein a transmission of the first and / or second data stream at least partially by A transmission of signals according to a mobile communication standard; - an internet connection between at least two nodes or - A wired communication connection takes place. Transmission device comprising: - a first device ( 151 ) for detecting a first payload signal comprising a plurality of successive sections, the first device for coding the first payload signal being adapted to generate a first data stream; A second device ( 15 . 151 ) for detecting a second useful signal, which comprises a plurality of successive subsections, wherein respective respective subsections of the first and the second payload signals are associated with each other; An analysis device ( 12 . 12a . 110 ), which is designed to derive identification features in each case from a subsection of the first useful signal, wherein the identification features identify the respective subsection; A coding device ( 11 . 11a . 110 ), which is designed to assign the identification features in each case to the corresponding subsections of the second user signal and to generate a second, the second user signal reproducing useful portion and the identification features comprising data stream; A first transmission stage ( 13 ) for sending the first data stream; and - a second transmission stage for transmitting the second data stream, characterized in that the analysis device ( 12 . 12a . 110 ) is designed to form the identification features in each case by: Long Term Prediction coefficients of the assigned subsection of the first useful signal, or Linear Predictive Coding coefficients of the assigned subsection of the first useful signal, or a HASH sequence generated from the assigned subsection of the first useful signal. Transmission arrangement according to Claim 31, in which the coding device ( 11a ) a synchronization device ( 17 ) comprises for an assignment of the identification features to the corresponding subsection of the second useful signal, which has a predetermined temporal relationship to the associated subsection of the first useful signal, in particular to the associated sub-section is temporally synchronous. Transmission arrangement according to Claim 31 or 32, in which the first transmission stage is for transmission on a first transmission channel ( 23 ) and the second transmission stage for transmission on a second transmission channel ( 22 ) is executed. Transmission arrangement according to Claim 33, in which the first and the second transmission stage form the same transmission stage and / or the first transmission channel and the second transmission channel are the same transmission channel. Transmission arrangement according to one of Claims 31 to 34, in which the first device ( 13 . 131 ) for capturing audio data and / or audio signals. Transmission arrangement according to one of Claims 31 to 35, in which the first device ( 13 . 131 ) is carried out for coding the first useful signal with at least one of the following coding types: a coding according to μ-law of a speech or audio signal; A coding according to GSM EFR of a voice or audio signal; A coding according to AMR of a voice or audio signal; A coding according to PCM of a voice or audio signal; A coding according to AMR or AMR-WB of a voice or audio signal; A coding according to G.729 of a voice or audio signal; A G.72x coding according to the ITU-T standard for voice compression. Transmission arrangement according to 36, in which the synchronization device ( 17 ) is carried out for the provision of time stamps, each of which is assignable to one of the identification features and the subsection of the second useful signal for a determination of the temporal relationship. Transmission arrangement according to one of Claims 31 to 37, in which the second device ( 15 ) for detecting at least one of the following signals: - audio signals; - video signals; - data-based presentations; - Images; - text. Transmission arrangement according to one of Claims 31 to 38, in which the second device ( 15 ) or the coding device ( 11 . 11a ) for coding the first useful signal with at least one of the following coding types: H.26x coding of video signals; - MPEG or MPEG2 encoding of video signals. Receiving arrangement for the synchronization of a first data stream generated from a first useful signal with a multiplicity of successive subsections, a second data stream generated from a second useful signal with a multiplicity of successive subsections, comprising a useful component and identification features representing the second useful signal, which are each assigned to exactly one different one of the subsections of the second useful signal and are derived from and identify the corresponding subsection of the first wanted signal, wherein corresponding subsections of the first and second payload signals are associated with one another, comprising: a first decoding device 31 ) configured to decode the first data stream to recover the portions of the first useful signal from the first data stream; A second decoding device ( 33 ) configured to decode the second data stream to retrieve the portions of the first payload from the first data stream and to determine the identifiers from the second data stream; - An analysis device which is designed to derive again from the recovered sections of the first useful signal identification features for the recovered sections of the first useful signal; - a synchronizer ( 34 ) for synchronizing a time-coordinated output of the subsections with matching identification features based on a comparison of the second decoder ( 33 ) identified identification features and the again derived from the analysis device identification features and assignment of the subsections of the first payload signal and subsections of the second payload signal with matching or at least sufficiently similar identification features. A receiving arrangement according to claim 40, further comprising: - a second buffer memory ( 32 ) for storing the second useful signal. Receiving arrangement according to Claim 40 or 41, in which the first device ( 31 ) is executed at a time-scaled change of the first useful signal. Receiving arrangement according to one of Claims 40 to 42, in which the synchronizer ( 33 ) comprises a comparison device configured to deliver a control signal to a synchronization device in response to a comparison of the identification features stored in the second payload with the identification features provided by the analysis device, the synchronization device for controlling the delivery of the first payload signal to the first device ( 31 ) is coupled. Receiving arrangement according to claim 43, wherein the comparison device is designed to analyze a similarity or a correlation between the identification features stored in the second useful signal and identification features provided by the analyzing device. A receiving arrangement according to any one of claims 40 to 44, wherein the receiving arrangement is adapted to receive the first signal and the second signal in a common transmission channel. Receiving arrangement according to one of Claims 40 to 45, in which the second decoding device ( 33 ) is executed to a removal of the stored in the second payload identification features. A receive arrangement as claimed in any one of claims 40 to 46, wherein the portions of the first payload signal comprise at least one of the following: - an analog audio signal; A GSM EFR encoded audio signal; An AMR encoded audio signal; A PCM encoded audio signal; An AMR or AMR-WB encoded audio signal; A G.729 coded audio signal An encoded audio signal according to one of the G.72x methods of the ITU-T standard for voice compression; - μ-law coded audio signal. Receiving arrangement according to one of claims 40 to 47, wherein the analysis device is designed to provide the identification features, which has one of the following features of the subsections of the first useful signal: - Long term prediction coefficients; - coefficients derived from a linear predictive coding; A frequency information of a content of the first subsection; A HASH sequence; - a checksum of the first subsection. A system comprising a transmission arrangement according to any one of claims 31 to 39 and a reception arrangement according to any one of claims 40 to 48. The system of claim 49, wherein the transmission of the first and second useful signal is at least partially via a common transmission channel. System according to Claim 49 or 50, in which the transmission of one of the first and second payload signals is at least partially via a fixed network connection ( 23 ) or an internet connection ( 22 ) between at least two communication devices. A system according to any one of claims 49 to 51, wherein the receiving arrangement is adapted to a time-synchronous output of an audio signal and a video signal.

Images