US20120070007A1 - Apparatus and method for bandwidth extension for multi-channel audio - Google Patents
Apparatus and method for bandwidth extension for multi-channel audio Download PDFInfo
- Publication number
- US20120070007A1 US20120070007A1 US13/232,696 US201113232696A US2012070007A1 US 20120070007 A1 US20120070007 A1 US 20120070007A1 US 201113232696 A US201113232696 A US 201113232696A US 2012070007 A1 US2012070007 A1 US 2012070007A1
- Authority
- US
- United States
- Prior art keywords
- signal
- channel
- channel audio
- downmixed
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/03—Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/03—Application of parametric coding in stereophonic audio systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/07—Synergistic effects of band splitting and sub-band processing
Definitions
- the following description relates to a method of encoding and decoding a multi-channel audio, and more particularly, to a method and apparatus of encoding and decoding a high-frequency signal of the multi-channel audio.
- Multi-channel audio coding schemes may generally include a waveform multi-channel audio coding scheme and a parametric multi-channel audio coding scheme.
- the waveform multi-channel audio coding scheme may be classified as a moving picture expert group (MPEG)-2 multi channel extension (MC) audio coding scheme, an advanced audio coding (AAC) MC audio coding scheme, a bit sliced arithmetic coding/audio video standard MC (BSAC/AVS MC) audio coding scheme, and the like.
- MPEG moving picture expert group
- AAC advanced audio coding
- BSAC/AVS MC bit sliced arithmetic coding/audio video standard MC
- the parametric multi-channel audio coding scheme may include an MPEG surround scheme, and the MPEG surround scheme may restore a multi-channel audio signal using a downmixed signal and spatial information.
- the MPEG surround scheme may down-mix the multi-channel audio signal and parameterize the spatial information to compress the multi-channel audio signal, and may restore the multi-channel audio signal with only a small amount of information.
- the MPEG-surround scheme may be used together with a Spectral Band Replication (SBR) coding scheme to increase compression efficiency.
- SBR Spectral Band Replication
- a multi-channel audio signal encoding apparatus including a downmixer configured to downmix a multi-channel audio input signal, a channel decorrelator configured to expand a number of channels of the downmixed signal thereby providing an expanded channel signal, a parameter estimator configured to select at least one signal from among the expanded channel signal, and to extract a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal and a bitmuxer configured to encode the downmixed signal and the extracted parameter.
- the channel decorrelator may expand the number of channels of the downmixed signal through linear combination or decorrelation.
- the bitmuxer may encode the extracted parameter and a signal associated with a high frequency band signal of the multi-channel audio input signal from among the downmixed signal.
- the parameter estimator may select, from among the downmixed signal and the expanded channel signal, at least one signal having a maximal value when a match function is applied to the downmixed signal and the expanded channel signal with each input signal of the multi-channel audio input signal, and extracts a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal.
- a multi-channel audio signal decoding apparatus including a bitdemuxer configured to restore, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal, a parameter decoder configured to restore, from the input bit stream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal, and a channel decorrelator configured to expand a number of channels of the restored downmixed signal.
- the multi-channel audio decoding apparatus further includes a high-frequency signal synthesizer configured to select, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter and a spatial synthesizer configured to restore the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- a high-frequency signal synthesizer configured to select, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter
- a spatial synthesizer configured to restore the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- the channel decorrelator may expand the number of channels of the downmixed signal, through linear combination or decorrelation.
- a multi-channel audio signal encoding method of a transmitter including downmixing a multi-channel audio input signal, expanding a number of channels of the downmixed signal, selecting at least one signal from among the expanded channel signal, extracting a characteristic relation between the selected signal and the multi-channel audio input signal, and encoding the downmixed signal and the extracted parameter.
- the expanding may include expanding the number of channels of the downmixed signal through linear combination or decorrelation.
- the encoding may include encoding the extracted parameter and a signal associated with a high frequency band signal of the multi-channel audio input signal from among the downmixed signal.
- the selecting and extracting may include selecting, from among the downmixed signal and the expanded channel signal, at least one signal having a maximal value when a match function is applied to the downmixed signal and the expanded channel signal with each input signal of the multi-channel audio input signal and extracting a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal.
- a non-transitory computer readable storage medium may store a program to implement the multi-channel audio encoding method.
- a multi-channel audio signal decoding method of a receiver including restoring, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal, restoring, from the input bitstream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal, expanding a number of channels of the restored downmixed signal, selecting, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter, and restoring the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- the expanding may include expanding the number of channels of the downmixed signal through linear combination or decorrelation.
- a transmitter having a multi-channel audio signal encoding apparatus, the multi-channel audio signal encoding apparatus including a downmixer configured to downmix a multi-channel audio input signal received at the transmitter and a channel decorrelator configured to expand a number of channels of the downmixed signal thereby providing an expanded channel signal.
- the encoding apparatus further includes a parameter estimator configured to select at least one signal from among the expanded channel signal, and to extract a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal and a bitmuxer configured to encode the downmixed signal and the extracted parameter.
- the transmitter transmits the encoded downmixed signal and extracted parameter.
- a receiver having a multi-channel audio signal decoding apparatus, the multi-channel audio signal decoding apparatus including a bitdemuxer configured to restore, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal, a parameter decoder configured to restore, from the input bit stream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal, and a channel decorrelator configured to expand a number of channels of the restored downmixed signal.
- a bitdemuxer configured to restore, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal
- a parameter decoder configured to restore, from the input bit stream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal
- a channel decorrelator configured to expand a number of channels of the restored downmixed signal.
- the signal decoding apparatus further includes a high-frequency signal synthesizer configured to select, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter and a spatial synthesizer configured to restore the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- a high-frequency signal synthesizer configured to select, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter
- a spatial synthesizer configured to restore the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- FIG. 1 is a diagram illustrating an example of a multi-channel audio signal encoding apparatus.
- FIG. 2 is a diagram illustrating an example of a process that encodes a high-frequency signal in a multi-channel audio signal encoding apparatus.
- FIG. 3 is a diagram illustrating an example of a multi-channel audio signal decoding apparatus.
- FIG. 4 is a diagram illustrating an example of a process that generates a high-frequency signal by patching a signal from a downmixed signal.
- FIG. 1 illustrates an example of a multi-channel audio signal encoding apparatus 100 .
- the multi-channel audio signal encoding apparatus may be implemented in a transmitter.
- multi-channel signals y 1 , y 2 , . . . , y N are inputted to a downmixer 110 .
- the downmixer 110 down-mixes, based on a moving picture expert group (MPEG) surround scheme, the multi-channel signals into 2-channel signals x 1 and x 2 .
- MPEG moving picture expert group
- a spatial parameter extractor 120 expresses low frequency band signals of the multi-channel signals y 1 , y 2 , . . . , y N by spatial parameters indicating spatial correlations between channels.
- a channel decorrelator 140 generates additional signals x 3 , x 4 , and the like by expanding channels using high frequency band signals of the downmixed signals x 1 and x 2 , and may generate base signal sets.
- the parameter estimator 150 generates parameters corresponding to envelopes of the high frequency band signals, based on correlation between signals x 1 , x 2 , x 3 , x 4 , and the like corresponding to the base signal sets and high-frequency band signals of the inputted multi-channel signals y 1 , y 2 , . . . , y N .
- downmixed signals X 0 j and X 1 j may be calculated as expressed by Equation 1.
- Equation 1 the downmixed signals) X 0 j and X 1 j are calculated in the same manner as a downmixing process based on an MPEG surround scheme.
- the high frequency signals may be restored based on a conventional Spectral Band Replication (SBR) coding scheme.
- SBR Spectral Band Replication
- High-frequency signals X 2 j and X 3 j that are additionally generated based on the downmixed signals X 0 j and X 1 j are calculated as expressed by Equation 2.
- the additional high-frequency signals X 2 j and X 3 j may be generated by the channel decorrelator 140 .
- X 0 j Y 0 j + Y 1 j + Y 2 j
- X 1 j Y 3 j + Y 4 j - Y 2 j
- X 2 j Y 2 j + 0.5 ⁇ ( Y 0 j + Y 1 j - Y 3 j - Y 4 j )
- X 3 j Y 0 j + Y 1 j + Y 3 j + Y 4 j [ Equation ⁇ ⁇ 3 ]
- signals X 0 j , X 1 j , X 2 j and X 3 j are candidate values for an optimal signal to be used for extracting the parameters indicating a characteristic relation between the multi-channel audio input signals and a signal selected by the parameter estimator 150 .
- the high-frequency signals of the multi-channel signals may be restored by selecting a signal to be patched from signals X 0 j , X 1 j , X 2 j , and X 3 j , and in the same manner as selecting a signal to be patched from a low frequency signal during a bandwidth extension process.
- the high frequency signals of the multi-channel signals may be restored by selecting, from among the signals, a signal that is most similar to a high frequency signal of an original signal.
- the parameter estimator 150 selects an optimal signal from among the expanded channel signals.
- the optimal signal may be a channel signal having a maximal value among the downmixed signals and the expanded channel signals, when a match function is applied to the downmixed signals and the expanded channel signals with each input signal of the multi-channel signals.
- a characteristic of a signal may be dominant in a signal X 0 j or a signal X 3 j
- a characteristic of a signal (Y 3 j +Y 4 j ) may be dominant in a signal X 1 j or a signal X 3 j .
- a signal component Y 2 j may be represented by dominant in a signal X 2 j .
- An energy matching equation is applied to the candidate signals, and a signal having a maximal value is selected, from among the candidate signals, as a signal to be patched, that is, the optimal signal.
- FIG. 2 illustrates an example of a process that encodes a high-frequency signal in a multi-channel audio signal encoding apparatus.
- the multi-channel audio signal encoding apparatus 100 selects an optimal patching channel signal from among channel signals generated from the channel decorrelator 140 and extracts a parameter to be used for generating a high frequency signal.
- a match function calculator 220 receives the generated channel signals X 0 j , X 1 j , X 2 j , and X 3 j , and calculates a matching function value of each of the signals as expressed by Equation 4.
- R ⁇ ( Y s j , X k j ) ( ⁇ i ⁇ ⁇ log ⁇ ⁇ E ⁇ ( Y si j ) ⁇ log ⁇ ⁇ E ⁇ ( X ki j ) 2 ) ⁇ i ⁇ ⁇ log ⁇ ⁇ E ⁇ ( X ki j ) ⁇ log ⁇ ⁇ E ⁇ ( X ki j ) [ Equation ⁇ ⁇ 4 ]
- a signal having a maximal matching function value R(Y s j ,X k j ) is determined as an optimal channel signal.
- a base signal selector 210 selects a base signal based on Equation 5.
- a gain estimator 230 generates information associated with gain values corresponding to envelopes of an SBR coding scheme with respect to high-frequency band signals of multi-channel audio input signals.
- a gain value may be calculated based on an energy ratio of a signal to be patched with an original signal as expressed by Equation 6.
- a bitmuxer 160 encodes the downmixed signal and the extracted parameter to generate a bit stream.
- FIG. 3 illustrates an example of a multi-channel audio signal decoding apparatus.
- the multi-channel audio signal decoding apparatus may be implemented in a receiver.
- a multi-channel decoding process is performed in reverse order of the multi-channel encoding process described with reference to FIGS. 1 and 2 .
- a bitdemuxer 310 demuxes a transmitted bit stream.
- a waveform decoder 320 decodes the waveform of the demuxed bit stream received from the bitdemuxer 310 .
- multi-channel signals in a low frequency are restored using the transmitted downmixed signals and spatial parameters extracted by the spatial parameter extractor 120 .
- a spatial synthesizer 340 synthesizes multi-channel signals corresponding to a low frequency based on the downmixed signals and information associated with the spatial parameter.
- the channel decorrelator 330 generates additional signals from the downmixed signals in the same manner as the multi-channel audio signal encoding apparatus 100 of FIG. 1 , and may also generate base signal sets.
- the multi-channel encoding process proceeds using the spatial synthesizer 340 , the parameter decoder 350 , the high-frequency synthesizer 360 , and a multi-channel output voice signal that is similar to a multi-channel input voice signal. That is, an original signal may be generated.
- FIG. 4 illustrates an example of a process that generates a high-frequency signal by patching a signal from a downmixed signal.
- a downmixed signal 401 is inputted to a channel decorrelator 410 , and the channel decorrelator 410 generates an additional signal from a downmixed signal in the same manner as the multi-channel audio signal encoding apparatus 100 of FIG. 1 to generate a base signal set.
- a high-frequency generator 420 selects a target signal to be patched from the base signal set based on patching channel index information, and may generate a high-frequency band signal based on generated gain information.
- the multi-channel audio encoding apparatus may be implemented in a transmitter into which a multi-channel audio signal is input.
- various aspects of the multi-channel audio encoding apparatus described above for example, the downmixer, channel decorrelator, parameter estimator and bitmuxer, may be implemented in a transmitter as well.
- the multi-channel audio encoding apparatus generates a bit stream to be transmitted.
- the multi-channel audio decoding apparatus may be implemented in a receiver which receives a transmitted bit stream.
- various aspects of the multi-channel audio decoding apparatus described above for example, the bitdemuxer, parameter decoder, channel decorrelator, high-frequency signal synthesizer and spatial synthesizer, may be implemented in the receiver as well.
- the transmitted and receiver may be implemented in various electronic devices.
- the processes, functions, methods and/or software described herein may be recorded, stored, or fixed in one or more computer-readable storage media that includes program instructions to be implemented by a computer to cause a processor to execute or perform the program instructions.
- the media may also include, alone or in combination with the program instructions, data files, data structures, and the like.
- the media and program instructions may be those specially designed and constructed, or they may be of the kind well-known and available to those having skill in the computer software arts.
- Examples of computer-readable media include magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM disks and DVDs; magneto-optical media, such as optical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like.
- Examples of program instructions include machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.
- the described hardware devices may be configured to act as one or more software modules that are recorded, stored, or fixed in one or more computer-readable storage media, in order to perform the operations and methods described above, or vice versa.
- a computer-readable storage medium may be distributed among computer systems connected through a network and computer-readable codes or program instructions may be stored and executed in a decentralized manner.
Abstract
Description
- This application claims the benefit under 35 U.S.C. §119(a) of Korean Patent Application No. 10-2010-0091040, filed on Sep. 16, 2010, in the Korean Intellectual Property Office, the entire disclosure of which is incorporated herein by reference for all purposes.
- 1. Field
- The following description relates to a method of encoding and decoding a multi-channel audio, and more particularly, to a method and apparatus of encoding and decoding a high-frequency signal of the multi-channel audio.
- 2. Description of Related Art
- Multi-channel audio coding schemes may generally include a waveform multi-channel audio coding scheme and a parametric multi-channel audio coding scheme.
- The waveform multi-channel audio coding scheme may be classified as a moving picture expert group (MPEG)-2 multi channel extension (MC) audio coding scheme, an advanced audio coding (AAC) MC audio coding scheme, a bit sliced arithmetic coding/audio video standard MC (BSAC/AVS MC) audio coding scheme, and the like.
- The parametric multi-channel audio coding scheme may include an MPEG surround scheme, and the MPEG surround scheme may restore a multi-channel audio signal using a downmixed signal and spatial information.
- The MPEG surround scheme may down-mix the multi-channel audio signal and parameterize the spatial information to compress the multi-channel audio signal, and may restore the multi-channel audio signal with only a small amount of information. The MPEG-surround scheme may be used together with a Spectral Band Replication (SBR) coding scheme to increase compression efficiency.
- In one general aspect there is provided a multi-channel audio signal encoding apparatus including a downmixer configured to downmix a multi-channel audio input signal, a channel decorrelator configured to expand a number of channels of the downmixed signal thereby providing an expanded channel signal, a parameter estimator configured to select at least one signal from among the expanded channel signal, and to extract a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal and a bitmuxer configured to encode the downmixed signal and the extracted parameter.
- The channel decorrelator may expand the number of channels of the downmixed signal through linear combination or decorrelation.
- The bitmuxer may encode the extracted parameter and a signal associated with a high frequency band signal of the multi-channel audio input signal from among the downmixed signal.
- The parameter estimator may select, from among the downmixed signal and the expanded channel signal, at least one signal having a maximal value when a match function is applied to the downmixed signal and the expanded channel signal with each input signal of the multi-channel audio input signal, and extracts a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal.
- In another aspect, there is provided a multi-channel audio signal decoding apparatus including a bitdemuxer configured to restore, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal, a parameter decoder configured to restore, from the input bit stream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal, and a channel decorrelator configured to expand a number of channels of the restored downmixed signal. The multi-channel audio decoding apparatus further includes a high-frequency signal synthesizer configured to select, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter and a spatial synthesizer configured to restore the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- The channel decorrelator may expand the number of channels of the downmixed signal, through linear combination or decorrelation.
- In another aspect, there is provided a multi-channel audio signal encoding method of a transmitter including downmixing a multi-channel audio input signal, expanding a number of channels of the downmixed signal, selecting at least one signal from among the expanded channel signal, extracting a characteristic relation between the selected signal and the multi-channel audio input signal, and encoding the downmixed signal and the extracted parameter.
- The expanding may include expanding the number of channels of the downmixed signal through linear combination or decorrelation.
- The encoding may include encoding the extracted parameter and a signal associated with a high frequency band signal of the multi-channel audio input signal from among the downmixed signal.
- The selecting and extracting may include selecting, from among the downmixed signal and the expanded channel signal, at least one signal having a maximal value when a match function is applied to the downmixed signal and the expanded channel signal with each input signal of the multi-channel audio input signal and extracting a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal.
- A non-transitory computer readable storage medium may store a program to implement the multi-channel audio encoding method.
- In another aspect there is provided a multi-channel audio signal decoding method of a receiver including restoring, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal, restoring, from the input bitstream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal, expanding a number of channels of the restored downmixed signal, selecting, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter, and restoring the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- The expanding may include expanding the number of channels of the downmixed signal through linear combination or decorrelation.
- In still another general aspect, there is provided a transmitter having a multi-channel audio signal encoding apparatus, the multi-channel audio signal encoding apparatus including a downmixer configured to downmix a multi-channel audio input signal received at the transmitter and a channel decorrelator configured to expand a number of channels of the downmixed signal thereby providing an expanded channel signal. The encoding apparatus further includes a parameter estimator configured to select at least one signal from among the expanded channel signal, and to extract a parameter indicating a characteristic relation between the selected signal and the multi-channel audio input signal and a bitmuxer configured to encode the downmixed signal and the extracted parameter. The transmitter transmits the encoded downmixed signal and extracted parameter.
- In another general aspect, there is provided a receiver having a multi-channel audio signal decoding apparatus, the multi-channel audio signal decoding apparatus including a bitdemuxer configured to restore, from an input bitstream that is obtained by encoding a multi-channel audio signal, a downmixed signal of the multi-channel audio signal, a parameter decoder configured to restore, from the input bit stream, a parameter to be used for restoring a channel signal included in the multi-channel audio signal, and a channel decorrelator configured to expand a number of channels of the restored downmixed signal. The signal decoding apparatus further includes a high-frequency signal synthesizer configured to select, from the downmixed signal of which the number of channels is expanded, a channel signal to be patched using the restored parameter and a spatial synthesizer configured to restore the channel signal included in the multi-channel audio signal using the selected channel signal and the restored parameter information.
- Other features and aspects may be apparent from the following detailed description, the drawings, and the claims.
-
FIG. 1 is a diagram illustrating an example of a multi-channel audio signal encoding apparatus. -
FIG. 2 is a diagram illustrating an example of a process that encodes a high-frequency signal in a multi-channel audio signal encoding apparatus. -
FIG. 3 is a diagram illustrating an example of a multi-channel audio signal decoding apparatus. -
FIG. 4 is a diagram illustrating an example of a process that generates a high-frequency signal by patching a signal from a downmixed signal. - Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals should be understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated for clarity, illustration, and convenience.
- The following detailed description is provided to assist the reader in gaining a comprehensive understanding of the methods, apparatuses and/or systems described herein. Accordingly, various changes, modifications, and equivalents of the systems, apparatuses and/or methods described herein may be suggested to those of ordinary skill in the art. Also, descriptions of well-known functions and constructions may be omitted for increased clarity and conciseness.
-
FIG. 1 illustrates an example of a multi-channel audiosignal encoding apparatus 100. The multi-channel audio signal encoding apparatus may be implemented in a transmitter. - In this example, multi-channel signals y1, y2, . . . , yN are inputted to a
downmixer 110. - The
downmixer 110 down-mixes, based on a moving picture expert group (MPEG) surround scheme, the multi-channel signals into 2-channel signals x1 and x2. - A
spatial parameter extractor 120 expresses low frequency band signals of the multi-channel signals y1, y2, . . . , yN by spatial parameters indicating spatial correlations between channels. - A
channel decorrelator 140 generates additional signals x3, x4, and the like by expanding channels using high frequency band signals of the downmixed signals x1 and x2, and may generate base signal sets. - The
parameter estimator 150 generates parameters corresponding to envelopes of the high frequency band signals, based on correlation between signals x1, x2, x3, x4, and the like corresponding to the base signal sets and high-frequency band signals of the inputted multi-channel signals y1, y2, . . . , yN. - The above described process will be described with reference to the examples in
FIGS. 1 through 3 . - In the process, when high-frequency band signals corresponding to a jth subband of the inputted multi-channel signals y1, y2, . . . , yN is Y0 j, Y1 j, Y2 j, Y3 j, Y4 j, downmixed signals X0 j and X1 j may be calculated as expressed by Equation 1.
-
- In Equation 1, the downmixed signals) X0 j and X1 j are calculated in the same manner as a downmixing process based on an MPEG surround scheme.
- The high frequency signals may be restored based on a conventional Spectral Band Replication (SBR) coding scheme.
- High-frequency signals X2 j and X3 j that are additionally generated based on the downmixed signals X0 j and X1 j are calculated as expressed by Equation 2.
-
- In Equation 2, the additional high-frequency signals X2 j and X3 j may be generated by the
channel decorrelator 140. - The base signal sets that are generated after the additional high-frequency signals are generated are expressed below in Equation 3.
-
- In Equation 3, signals X0 j, X1 j, X2 j and X3 j are candidate values for an optimal signal to be used for extracting the parameters indicating a characteristic relation between the multi-channel audio input signals and a signal selected by the
parameter estimator 150. - The high-frequency signals of the multi-channel signals may be restored by selecting a signal to be patched from signals X0 j, X1 j, X2 j, and X3 j, and in the same manner as selecting a signal to be patched from a low frequency signal during a bandwidth extension process.
- The high frequency signals of the multi-channel signals may be restored by selecting, from among the signals, a signal that is most similar to a high frequency signal of an original signal.
- In this example, the
parameter estimator 150 selects an optimal signal from among the expanded channel signals. - The optimal signal may be a channel signal having a maximal value among the downmixed signals and the expanded channel signals, when a match function is applied to the downmixed signals and the expanded channel signals with each input signal of the multi-channel signals.
- As for and X0 j, X1 j, X2 j, and X3 j, a characteristic of a signal (Y0 j+Y1 j) may be dominant in a signal X0 j or a signal X3 j, and a characteristic of a signal (Y3 j+Y4 j) may be dominant in a signal X1 j or a signal X3 j.
- A signal component Y2 j may be represented by dominant in a signal X2 j.
- An energy matching equation is applied to the candidate signals, and a signal having a maximal value is selected, from among the candidate signals, as a signal to be patched, that is, the optimal signal.
- The process will be described with reference to the example in
FIG. 2 . -
FIG. 2 illustrates an example of a process that encodes a high-frequency signal in a multi-channel audio signal encoding apparatus. - Referring to
FIG. 2 , the multi-channel audiosignal encoding apparatus 100 selects an optimal patching channel signal from among channel signals generated from thechannel decorrelator 140 and extracts a parameter to be used for generating a high frequency signal. - A
match function calculator 220 receives the generated channel signals X0 j, X1 j, X2 j, and X3 j, and calculates a matching function value of each of the signals as expressed by Equation 4. -
- A signal having a maximal matching function value R(Ys j,Xk j) is determined as an optimal channel signal.
- A
base signal selector 210 selects a base signal based on Equation 5. -
- A
gain estimator 230 generates information associated with gain values corresponding to envelopes of an SBR coding scheme with respect to high-frequency band signals of multi-channel audio input signals. - As an example, a gain value may be calculated based on an energy ratio of a signal to be patched with an original signal as expressed by Equation 6.
-
- Referring again to
FIG. 1 , abitmuxer 160 encodes the downmixed signal and the extracted parameter to generate a bit stream. -
FIG. 3 illustrates an example of a multi-channel audio signal decoding apparatus. The multi-channel audio signal decoding apparatus may be implemented in a receiver. - Here, a multi-channel decoding process is performed in reverse order of the multi-channel encoding process described with reference to
FIGS. 1 and 2 . - First, a
bitdemuxer 310 demuxes a transmitted bit stream. - A
waveform decoder 320 decodes the waveform of the demuxed bit stream received from thebitdemuxer 310. - According to one example, multi-channel signals in a low frequency are restored using the transmitted downmixed signals and spatial parameters extracted by the
spatial parameter extractor 120. - A
spatial synthesizer 340 synthesizes multi-channel signals corresponding to a low frequency based on the downmixed signals and information associated with the spatial parameter. - The
channel decorrelator 330 generates additional signals from the downmixed signals in the same manner as the multi-channel audiosignal encoding apparatus 100 ofFIG. 1 , and may also generate base signal sets. - The multi-channel encoding process proceeds using the
spatial synthesizer 340, theparameter decoder 350, the high-frequency synthesizer 360, and a multi-channel output voice signal that is similar to a multi-channel input voice signal. That is, an original signal may be generated. -
FIG. 4 illustrates an example of a process that generates a high-frequency signal by patching a signal from a downmixed signal. - In this example, a
downmixed signal 401 is inputted to achannel decorrelator 410, and thechannel decorrelator 410 generates an additional signal from a downmixed signal in the same manner as the multi-channel audiosignal encoding apparatus 100 ofFIG. 1 to generate a base signal set. - A high-
frequency generator 420 selects a target signal to be patched from the base signal set based on patching channel index information, and may generate a high-frequency band signal based on generated gain information. - The multi-channel audio encoding apparatus may be implemented in a transmitter into which a multi-channel audio signal is input. As such, various aspects of the multi-channel audio encoding apparatus described above, for example, the downmixer, channel decorrelator, parameter estimator and bitmuxer, may be implemented in a transmitter as well. As noted above, and shown in
FIG. 1 , for example, the multi-channel audio encoding apparatus generates a bit stream to be transmitted. - The multi-channel audio decoding apparatus may be implemented in a receiver which receives a transmitted bit stream. As such, various aspects of the multi-channel audio decoding apparatus described above, for example, the bitdemuxer, parameter decoder, channel decorrelator, high-frequency signal synthesizer and spatial synthesizer, may be implemented in the receiver as well.
- The transmitted and receiver may be implemented in various electronic devices.
- The processes, functions, methods and/or software described herein may be recorded, stored, or fixed in one or more computer-readable storage media that includes program instructions to be implemented by a computer to cause a processor to execute or perform the program instructions. The media may also include, alone or in combination with the program instructions, data files, data structures, and the like. The media and program instructions may be those specially designed and constructed, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable media include magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM disks and DVDs; magneto-optical media, such as optical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like. Examples of program instructions include machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter. The described hardware devices may be configured to act as one or more software modules that are recorded, stored, or fixed in one or more computer-readable storage media, in order to perform the operations and methods described above, or vice versa. In addition, a computer-readable storage medium may be distributed among computer systems connected through a network and computer-readable codes or program instructions may be stored and executed in a decentralized manner.
- A number of examples have been described above. Nevertheless, it should be understood that various modifications may be made. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in a described system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components or their equivalents. Accordingly, other implementations are within the scope of the following claims.
Claims (13)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2010-0091040 | 2010-09-16 | ||
KR1020100091040A KR101697550B1 (en) | 2010-09-16 | 2010-09-16 | Apparatus and method for bandwidth extension for multi-channel audio |
Publications (2)
Publication Number | Publication Date |
---|---|
US20120070007A1 true US20120070007A1 (en) | 2012-03-22 |
US8976970B2 US8976970B2 (en) | 2015-03-10 |
Family
ID=45817789
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/232,696 Expired - Fee Related US8976970B2 (en) | 2010-09-16 | 2011-09-14 | Apparatus and method for bandwidth extension for multi-channel audio |
Country Status (2)
Country | Link |
---|---|
US (1) | US8976970B2 (en) |
KR (1) | KR101697550B1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2830052A1 (en) * | 2013-07-22 | 2015-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US9258428B2 (en) | 2012-12-18 | 2016-02-09 | Cisco Technology, Inc. | Audio bandwidth extension for conferencing |
US20160212561A1 (en) * | 2013-09-27 | 2016-07-21 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Concept for generating a downmix signal |
US10354661B2 (en) | 2013-07-22 | 2019-07-16 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a residual-signal-based adjustment of a contribution of a decorrelated signal |
US11322164B2 (en) * | 2018-01-18 | 2022-05-03 | Dolby Laboratories Licensing Corporation | Methods and devices for coding soundfield representation signals |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ES2549953T3 (en) * | 2012-08-27 | 2015-11-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for the reproduction of an audio signal, apparatus and method for the generation of an encoded audio signal, computer program and encoded audio signal |
KR102109972B1 (en) | 2018-10-05 | 2020-05-26 | 주식회사 플레이티지 | Heater jacket for semiconductor processing |
Citations (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060133618A1 (en) * | 2004-11-02 | 2006-06-22 | Lars Villemoes | Stereo compatible multi-channel audio coding |
US20070239442A1 (en) * | 2004-04-05 | 2007-10-11 | Koninklijke Philips Electronics, N.V. | Multi-Channel Encoder |
US20080033732A1 (en) * | 2005-06-03 | 2008-02-07 | Seefeldt Alan J | Channel reconfiguration with side information |
US20080077412A1 (en) * | 2006-09-22 | 2008-03-27 | Samsung Electronics Co., Ltd. | Method, medium, and system encoding and/or decoding audio signals by using bandwidth extension and stereo coding |
US20080120095A1 (en) * | 2006-11-17 | 2008-05-22 | Samsung Electronics Co., Ltd. | Method and apparatus to encode and/or decode audio and/or speech signal |
US20080205658A1 (en) * | 2005-09-13 | 2008-08-28 | Koninklijke Philips Electronics, N.V. | Audio Coding |
US20080253576A1 (en) * | 2007-04-16 | 2008-10-16 | Samsung Electronics Co., Ltd | Method and apparatus for encoding and decoding stereo signal and multi-channel signal |
US20080255859A1 (en) * | 2005-10-20 | 2008-10-16 | Lg Electronics, Inc. | Method for Encoding and Decoding Multi-Channel Audio Signal and Apparatus Thereof |
US20080270124A1 (en) * | 2007-04-24 | 2008-10-30 | Samsung Electronics Co., Ltd | Method and apparatus for encoding and decoding audio/speech signal |
US20090037180A1 (en) * | 2007-08-02 | 2009-02-05 | Samsung Electronics Co., Ltd | Transcoding method and apparatus |
US20090043591A1 (en) * | 2006-02-21 | 2009-02-12 | Koninklijke Philips Electronics N.V. | Audio encoding and decoding |
US20090110203A1 (en) * | 2006-03-28 | 2009-04-30 | Anisse Taleb | Method and arrangement for a decoder for multi-channel surround sound |
US20090157411A1 (en) * | 2006-09-29 | 2009-06-18 | Dong Soo Kim | Methods and apparatuses for encoding and decoding object-based audio signals |
US20090172060A1 (en) * | 2006-03-28 | 2009-07-02 | Anisse Taleb | Filter adaptive frequency resolution |
US20090210234A1 (en) * | 2008-02-19 | 2009-08-20 | Samsung Electronics Co., Ltd. | Apparatus and method of encoding and decoding signals |
WO2010070225A1 (en) * | 2008-12-15 | 2010-06-24 | France Telecom | Improved encoding of multichannel digital audio signals |
US20110002470A1 (en) * | 2004-04-16 | 2011-01-06 | Heiko Purnhagen | Method for Representing Multi-Channel Audio Signals |
US20110051935A1 (en) * | 2009-08-27 | 2011-03-03 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding and decoding stereo audio |
US20110173005A1 (en) * | 2008-07-11 | 2011-07-14 | Johannes Hilpert | Efficient Use of Phase Information in Audio Encoding and Decoding |
US8170882B2 (en) * | 2004-03-01 | 2012-05-01 | Dolby Laboratories Licensing Corporation | Multichannel audio coding |
US20130094654A1 (en) * | 2002-04-22 | 2013-04-18 | Koninklijke Philips Electronics N.V. | Spatial audio |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100923156B1 (en) | 2006-05-02 | 2009-10-23 | 한국전자통신연구원 | System and Method for Encoding and Decoding for multi-channel audio |
KR101435893B1 (en) | 2006-09-22 | 2014-09-02 | 삼성전자주식회사 | Method and apparatus for encoding and decoding audio signal using band width extension technique and stereo encoding technique |
KR20090004778A (en) * | 2007-07-05 | 2009-01-12 | 엘지전자 주식회사 | Method for processing an audio signal and apparatus for implementing the same |
AU2008326956B2 (en) | 2007-11-21 | 2011-02-17 | Lg Electronics Inc. | A method and an apparatus for processing a signal |
EP2144231A1 (en) | 2008-07-11 | 2010-01-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Low bitrate audio encoding/decoding scheme with common preprocessing |
WO2010036061A2 (en) | 2008-09-25 | 2010-04-01 | Lg Electronics Inc. | An apparatus for processing an audio signal and method thereof |
-
2010
- 2010-09-16 KR KR1020100091040A patent/KR101697550B1/en active IP Right Grant
-
2011
- 2011-09-14 US US13/232,696 patent/US8976970B2/en not_active Expired - Fee Related
Patent Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130094654A1 (en) * | 2002-04-22 | 2013-04-18 | Koninklijke Philips Electronics N.V. | Spatial audio |
US8170882B2 (en) * | 2004-03-01 | 2012-05-01 | Dolby Laboratories Licensing Corporation | Multichannel audio coding |
US20070239442A1 (en) * | 2004-04-05 | 2007-10-11 | Koninklijke Philips Electronics, N.V. | Multi-Channel Encoder |
US20110002470A1 (en) * | 2004-04-16 | 2011-01-06 | Heiko Purnhagen | Method for Representing Multi-Channel Audio Signals |
US20060133618A1 (en) * | 2004-11-02 | 2006-06-22 | Lars Villemoes | Stereo compatible multi-channel audio coding |
US20080033732A1 (en) * | 2005-06-03 | 2008-02-07 | Seefeldt Alan J | Channel reconfiguration with side information |
US20080205658A1 (en) * | 2005-09-13 | 2008-08-28 | Koninklijke Philips Electronics, N.V. | Audio Coding |
US20080255859A1 (en) * | 2005-10-20 | 2008-10-16 | Lg Electronics, Inc. | Method for Encoding and Decoding Multi-Channel Audio Signal and Apparatus Thereof |
US20090043591A1 (en) * | 2006-02-21 | 2009-02-12 | Koninklijke Philips Electronics N.V. | Audio encoding and decoding |
US20090172060A1 (en) * | 2006-03-28 | 2009-07-02 | Anisse Taleb | Filter adaptive frequency resolution |
US20090110203A1 (en) * | 2006-03-28 | 2009-04-30 | Anisse Taleb | Method and arrangement for a decoder for multi-channel surround sound |
US20080077412A1 (en) * | 2006-09-22 | 2008-03-27 | Samsung Electronics Co., Ltd. | Method, medium, and system encoding and/or decoding audio signals by using bandwidth extension and stereo coding |
US20090157411A1 (en) * | 2006-09-29 | 2009-06-18 | Dong Soo Kim | Methods and apparatuses for encoding and decoding object-based audio signals |
US20090164221A1 (en) * | 2006-09-29 | 2009-06-25 | Dong Soo Kim | Methods and apparatuses for encoding and decoding object-based audio signals |
US20090164222A1 (en) * | 2006-09-29 | 2009-06-25 | Dong Soo Kim | Methods and apparatuses for encoding and decoding object-based audio signals |
US20110196685A1 (en) * | 2006-09-29 | 2011-08-11 | Lg Electronics Inc. | Methods and apparatuses for encoding and decoding object-based audio signals |
US20080120095A1 (en) * | 2006-11-17 | 2008-05-22 | Samsung Electronics Co., Ltd. | Method and apparatus to encode and/or decode audio and/or speech signal |
US20080253576A1 (en) * | 2007-04-16 | 2008-10-16 | Samsung Electronics Co., Ltd | Method and apparatus for encoding and decoding stereo signal and multi-channel signal |
US20080270124A1 (en) * | 2007-04-24 | 2008-10-30 | Samsung Electronics Co., Ltd | Method and apparatus for encoding and decoding audio/speech signal |
US20090037180A1 (en) * | 2007-08-02 | 2009-02-05 | Samsung Electronics Co., Ltd | Transcoding method and apparatus |
US20090210234A1 (en) * | 2008-02-19 | 2009-08-20 | Samsung Electronics Co., Ltd. | Apparatus and method of encoding and decoding signals |
US20110173005A1 (en) * | 2008-07-11 | 2011-07-14 | Johannes Hilpert | Efficient Use of Phase Information in Audio Encoding and Decoding |
WO2010070225A1 (en) * | 2008-12-15 | 2010-06-24 | France Telecom | Improved encoding of multichannel digital audio signals |
US20110249821A1 (en) * | 2008-12-15 | 2011-10-13 | France Telecom | encoding of multichannel digital audio signals |
US20110051935A1 (en) * | 2009-08-27 | 2011-03-03 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding and decoding stereo audio |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9258428B2 (en) | 2012-12-18 | 2016-02-09 | Cisco Technology, Inc. | Audio bandwidth extension for conferencing |
RU2666230C2 (en) * | 2013-07-22 | 2018-09-06 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Audio decoder, audio encoder, encoded presentation based at least four channel audio signals provision method, at least four channel audio signals based encoded representation provision method and using the range extension computer software |
US10741188B2 (en) | 2013-07-22 | 2020-08-11 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio encoder, audio decoder, methods and computer program using jointly encoded residual signals |
US11488610B2 (en) * | 2013-07-22 | 2022-11-01 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US20160247508A1 (en) * | 2013-07-22 | 2016-08-25 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio Decoder, Audio Encoder, Method for Providing at Least Four Audio Channel Signals on the Basis of an Encoded Representation, Method for Providing an Encoded Representation on the Basis of at Least Four Audio Channel Signals and Computer Program Using a Bandwidth Extension |
AU2014295282B2 (en) * | 2013-07-22 | 2017-07-27 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US9940938B2 (en) | 2013-07-22 | 2018-04-10 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio encoder, audio decoder, methods and computer program using jointly encoded residual signals |
US9953656B2 (en) | 2013-07-22 | 2018-04-24 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio encoder, audio decoder, methods and computer program using jointly encoded residual signals |
US10147431B2 (en) * | 2013-07-22 | 2018-12-04 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US11657826B2 (en) | 2013-07-22 | 2023-05-23 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio encoder, audio decoder, methods and computer program using jointly encoded residual signals |
EP2830052A1 (en) * | 2013-07-22 | 2015-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US10839812B2 (en) | 2013-07-22 | 2020-11-17 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a residual-signal-based adjustment of a contribution of a decorrelated signal |
US10354661B2 (en) | 2013-07-22 | 2019-07-16 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a residual-signal-based adjustment of a contribution of a decorrelated signal |
US20190378522A1 (en) * | 2013-07-22 | 2019-12-12 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
WO2015010934A1 (en) * | 2013-07-22 | 2015-01-29 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US10755720B2 (en) | 2013-07-22 | 2020-08-25 | Fraunhofer-Gesellschaft Zur Foerderung Der Angwandten Forschung E.V. | Multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a residual-signal-based adjustment of a contribution of a decorrelated signal |
US10770080B2 (en) * | 2013-07-22 | 2020-09-08 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung, E.V. | Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension |
US10021501B2 (en) * | 2013-09-27 | 2018-07-10 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Concept for generating a downmix signal |
US20160212561A1 (en) * | 2013-09-27 | 2016-07-21 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Concept for generating a downmix signal |
RU2661310C2 (en) * | 2013-09-27 | 2018-07-13 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Concept of generation of reducing mixing signal |
US11322164B2 (en) * | 2018-01-18 | 2022-05-03 | Dolby Laboratories Licensing Corporation | Methods and devices for coding soundfield representation signals |
Also Published As
Publication number | Publication date |
---|---|
US8976970B2 (en) | 2015-03-10 |
KR101697550B1 (en) | 2017-02-02 |
KR20120029494A (en) | 2012-03-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8976970B2 (en) | Apparatus and method for bandwidth extension for multi-channel audio | |
US9257127B2 (en) | Apparatus and method for coding and decoding multi-object audio signal with various channel including information bitstream conversion | |
JP4601669B2 (en) | Apparatus and method for generating a multi-channel signal or parameter data set | |
KR100955361B1 (en) | Adaptive residual audio coding | |
CN101410889B (en) | Controlling spatial audio coding parameters as a function of auditory events | |
EP2476113B1 (en) | Method, apparatus and computer program product for audio coding | |
US7719445B2 (en) | Method and apparatus for encoding/decoding multi-channel audio signal | |
RU2645271C2 (en) | Stereophonic code and decoder of audio signals | |
US8718284B2 (en) | Method, medium, and system encoding/decoding multi-channel signal | |
US8494667B2 (en) | Apparatus for encoding and decoding audio signal and method thereof | |
US9384743B2 (en) | Apparatus and method for encoding/decoding multichannel signal | |
US8620673B2 (en) | Audio decoding method and audio decoder | |
US20100014679A1 (en) | Multi-channel encoding and decoding method and apparatus | |
US11004458B2 (en) | Coding mode determination method and apparatus, audio encoding method and apparatus, and audio decoding method and apparatus | |
US9280974B2 (en) | Audio decoding device, audio decoding method, audio decoding program, audio encoding device, audio encoding method, and audio encoding program | |
EP2815399B1 (en) | A method and apparatus for performing an adaptive down- and up-mixing of a multi-channel audio signal | |
US9293146B2 (en) | Intensity stereo coding in advanced audio coding | |
EP2169667B1 (en) | Parametric stereo audio decoding method and apparatus | |
EP2439736A1 (en) | Down-mixing device, encoder, and method therefor | |
US8447618B2 (en) | Method and apparatus for encoding and decoding residual signal | |
US8543231B2 (en) | Method and an apparatus for processing a signal | |
KR101500972B1 (en) | Method and Apparatus of Encoding/Decoding Multi-Channel Signal | |
US20150170656A1 (en) | Audio encoding device, audio coding method, and audio decoding device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, MI YOUNG;CHOO, KI HYUN;OH, EUN MI;AND OTHERS;REEL/FRAME:026912/0236 Effective date: 20110815 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20190310 |