CA2305534C - Frame-based audio coding with gain-control words - Google Patents
Frame-based audio coding with gain-control words Download PDFInfo
- Publication number
- CA2305534C CA2305534C CA002305534A CA2305534A CA2305534C CA 2305534 C CA2305534 C CA 2305534C CA 002305534 A CA002305534 A CA 002305534A CA 2305534 A CA2305534 A CA 2305534A CA 2305534 C CA2305534 C CA 2305534C
- Authority
- CA
- Canada
- Prior art keywords
- gain
- signal
- audio
- control words
- output signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 claims abstract description 41
- 230000005236 sound signal Effects 0.000 claims abstract description 11
- 238000003786 synthesis reaction Methods 0.000 claims description 30
- 230000015572 biosynthetic process Effects 0.000 claims description 27
- 230000004044 response Effects 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000004048 modification Effects 0.000 claims description 3
- 238000012986 modification Methods 0.000 claims description 3
- 230000003595 spectral effect Effects 0.000 abstract description 10
- OVOUKWFJRHALDD-UHFFFAOYSA-N 2-[2-(2-acetyloxyethoxy)ethoxy]ethyl acetate Chemical compound CC(=O)OCCOCCOCCOC(C)=O OVOUKWFJRHALDD-UHFFFAOYSA-N 0.000 abstract description 4
- 238000004458 analytical method Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 12
- 230000000694 effects Effects 0.000 description 9
- 230000008859 change Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000003491 array Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/032—Quantisation or dequantisation of spectral components
- G10L19/035—Scalar quantisation
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/038—Cross-faders therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/66—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission for reducing bandwidth of signals; for improving efficiency of transmission
- H04B1/667—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission for reducing bandwidth of signals; for improving efficiency of transmission using a division in frequency subbands
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
Abstract
Several audio signal processing techniques may be used in various combinations to improve the quality of audio represented by an information stream formed by splice editing two or more other information streams. The techniques are particularly useful in applications that bundle audio information with video information. In one technique, gain-control words conveyed with the audio information stream are used to interpolate playback sound levels across a splice. In another technique, special filterbanks or forms of TDAC transforms are used to suppress aliasing artifacts on either side of a splice. In yet another technique, special filterbanks or crossfade window functions are used to optimize the attenuation of spectral splatter created at a splice. In a further technique, audio sample rates are converted according to frame lengths and rates to allow audio information to be bundled with, for example, video information. In yet a further technique, audio blocks are dynamically aligned so that proper synchronization can be maintained across a splice. An example for 48 kHz audio with NTSC
video is discussed.
video is discussed.
Description
99/26836 WO EP '~'CT/USS8/21 X52 _1_ DESCRIPTION
Frame-Based Audio Coding With Gain-Control Words TECHNICAL FIELD
The present invention is related to audio signal processing in which audio information streams are arranged in frames of information. In particular, the present invention is related to improving the audio quality of audio information streams formed by splicing frame-based audio information streams.
BACKGROUND ART
The process of editing audio or video material is essentially one of splicing or butting together two segments of material. A simple editing paradigm is the process of cutting and splicing motion picture film. The two segments of material to be spliced may originate from different sources, e.g., different channels of audio information, or they may originate from the same source. In either case, the splice generally creates a discontinuity in the audio or video material that may or may not be perceptible.
Audio Coding Block Processing The growing use of digital audio has tended to make it more difficult to edit audio material without creating audible artifacts. This has occurred in part because digital audio is frequently processed or encoded in blocks of digital samples that must be processed as a block.
Many perceptual or psychoacoustic-based audio coding systems utilize filterbanks or transforms to convert blocks of signal samples into blocks of encoded subband signal samples or transform coefficients that must be synthesis filtered or inverse transformed as blocks to recover a replica of the original signal. At a minimum, an edit of the processed audio signal must be done at a block boundary; otherwise, audio information represented by the remaining partial block cannot be properly recovered.
Throughout the remainder of this discussion, terms such as "coding" and "coder" refer to various methods and devices for signal processing and other terms such as "encoded" refer to the results of such processing. None of these terms imply any particular form of processing such as those that reduce information irrelevancy or redundancy in a signal. For example, coding includes generating pulse code modulation (PCM) samples to represent a signal and arranging information into patterns or formats according to some specification. Terms such as "block" and "frame" as used in this disclosure refer to groups or intervals of information that may differ AMENDED SHEET
99/26836 WO EP i C ~_/US78/?1652 from what those same terms refer to elsewhere, such as in the ANSI 54.40-1992 standard, sometimes known as the AES-3/EBU digital audio standard. Terms such as "filter" and "filterbank" as used herein include essentially any form of recursive and non-recursive filtering such as quadrature mirror filters (QMF) and transforms, and "filtered"
information is the result of applying such filters. More particular mention is made of filterbanks implemented by transforms.
An additional limitation is imposed on editing by coding systems that use overlapping-block structures to process and encode program material. Because of the overlapping nature of the encoded blocks, an original signal cannot properly be recovered from even a complete block of encoded samples or coefficients.
This limitation is clearly illustrated by a commonly used overlapped-block transform, the modified discrete cosine transform (DCT), that is described in Princen, Johnson, and Bradley, "Subband/Transform Coding Using Filter Bank Designs Based on Time Domain Aliasing Cancellation," ICASSP 1987 Conf. Proc., May 1987, pp. 2161-64. This transform is the time-domain equivalent of an oddly-stacked critically sampled single-sideband analysis-synthesis system and is referred to herein as Oddly-Stacked Time-Domain Aliasing Cancellation (O-TDAC). The forward transform is applied to blocks of samples that overlap one another by one-half the block length and achieves critical sampling by decimating the transform coe~cients by two; however, the information lost by this decimation creates time-domain aliasing in the recovered signal. The synthesis process can cancel this aliasing by applying an inverse transform to the blocks of transform coefficients to generate blocks of synthesized samples, applying a suitably shaped synthesis window function to the blocks of synthesized samples, and overlapping and adding the windowed blocks. For example, if a TDAC coding system generates a sequence of blocks B1-B2, then the aliasing artifacts in the last half of block B1 and in the first half of block BZ will cancel one another.
If two encoded information streams from a TDAC coding system are spliced at a block boundary, the resulting sequence of blocks will not cancel each other's aliasing artifacts. For example, suppose one encoded information stream is cut so that it ends at a block boundary between blocks B1-BZ and another encoded information stream is cut so that it begins at a block boundary between blocks Al-A2. If these two encoded information streams are spliced so that block B1 immediately precedes block A2, then the aliasing artifacts in the last half of block B1 and the first half of block AZ will generally not cancel one another.
The methods and devices of the prior art have either ignored the problem or have provided unsatisfactory solutions. One solution reduces the audibility of the uncancelled aliasing AMENDED ~f-iEET
99/26836 WO EP FC'1'/US~S/2.1552 _3_ artifacts by recovering or decoding the original audio from each encoded audio stream, crossfading one audio stream into the other, and re-encoding the resultant crossfaded stream into a new encoded audio stream. Unfortunately, the decode/re-encode process degrades the resulting signal, the process incurs a cost that is unattractive, and the original signal immediately on either side of the splice cannot be independently recovered because the crossfade cannot be undone.
Spectral Splatter Splice edits create another problem that the prior art has failed to address.
This problem is particularly troublesome with split-band perceptual coding techniques.
Perceptual split-band encoding applies a filterbank to an input signal to generate subband signals or groups of transform coefficients having bandwidths that are commensurate with the critical bandwidths of the human auditory system. Ideally, each subband signal or group of transform coefficients is quantized or encoded with just enough bits to render the resultant quantizing noise inaudible by having the noise masked by spectral components in the original signal. Coding performance is affected significantly by the frequency response characteristics of the filterbank applied to the input signal to generate the subband signals or transform coefficients.
Generally, these characteristics are optimized by increasing the attenuation of frequencies in the filter stopband in exchange for a broader filter passband. For example, see U.S. patent 5,109,417.
Splice edits tend to generate significant spurious spectral components or "spectral splatter" within a range of frequencies that is usually within the filter passband or transition region between passband and stopband, and not within what is regarded as the filter stopband;
hence, filterbanks that are designed to optimize general coding performance do not provide enough attenuation of the spectral splatter created at splice edits. These artifacts are usually audible because they are usually too large to be masked by the original signal.
DISCLOSURE OF INVENTION
It is an object of the present invention to improve the quality of audio represented by an audio information stream formed by splicing two or more frame-based audio information streams by using gain-control words to control the gain profile of frames on either side of a splice.
According to the teachings of one aspect of the present invention, a method or device for signal processing receives an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels (102a, 102b), receives multiple control signals {103 a, 103b), each control signal associated with a respective one of said multiple audio channels, generates, in response to said control signals for a respective frame of said input ANIE~iL~ED S~I~E~
99/2683 6 WO EP FL T/USQ~/2 I S S2 signal, groups of gain-control words such that each group of gain-control words is associated with a respective one of said audio channels, and a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, and generates an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
According to the teachings of another aspect of the present invention, a method or device for signal processing receives a control signal, receives an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, wherein a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, modifies one or more of said gain-control words in response to said control signal such that the gain levels represented by a gain-control word before and after the modification, respectively, differ from one another, and, subsequently, generates an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
According to the teachings of yet another aspect of the present invention, a method or device for signal processing receives an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, obtains from a frame of said input signal encoded audio information for a respective audio channel and the associated group of gain-control words, and generates an output signal by decoding said encoded audio information, wherein the level of said output signal is effectively modulated according to a gain trajectory corresponding to an interpolation of a starting gain level and an ending gain level represented by said associated group of gain-control words.
The various features of the present invention and its preferred embodiments may be better understood by referring to the following discussion and the accompanying drawings in which like reference numerals refer to like elements in the several figures.
The drawings which illustrate various devices show major components that are helpful in understanding the present invention. For the sake of clarity, these drawings omit many other features that may be important in practical embodiments but are not important to understanding the concepts of the °~,i~~~~~~~~
99/26836 WO EP PCT/US4~/?.i~52 .
present invention. The signal processing required to practice the present invention may be accomplished in a wide variety of ways including programs executed by microprocessors, digital signal processors , logic arrays and other forms of computing circuitry. Signal filters may be accomplished in essentially any way including recursive, non-recursive and lattice digital filters. Digital and analog technology may be used in various combinations according to needs and characteristics of the application.
More particular mention is made of conditions pertaining to processing audio and video information streams; however, aspects of the present invention may be practiced in applications that do not include the processing of video information. The contents of the following discussion and the drawings are set forth as examples only and should not be understood to represent limitations upon the scope of the present invention.
BRIEF DESCRIPTION OF DRAWINGS
Figs. la and lb are schematic representations of video and audio information arranged in blocks, frames and superframes.
Figs. 2a to 2c are schematic representations of overlapping blocks modulated by window functions and the resulting gain profile for frames comprising the windowed blocks.
Fig. 3 illustrates signal and aliasing components generated by an aliasing cancellation transform.
Figs. 4a to 4c illustrate functional block diagrams of devices that create, change and respond to gain control words in an encoded information stream.
MODES FOR CARRYING OUT THE INVENTION
Signals and Processing Signal Blocks and Frames Fig. 1 a illustrates a stream of encoded audio information arranged in a sequence of audio blocks 10 through 18, and video information arranged in a sequence of video frames such as video frame 1. In some formats such as NTSC video, each video frame comprises two video fields that collectively define a single picture or image. Audio blocks 11 through 17 are grouped with video frame 1 into an encoded signal frame 21.
Some applications have video frames that do not divide the encoded audio into an integer number of samples, transform coefficients, or the like. This can be accommodated by arranging groups of encoded signal frames into respective superframes. An arrangement of five encoded signal frames 21 through 25 grouped into superframe 31 is illustrated in Fig. lb. This t':':'~~ ~~G~i~ S~-~~~ ~~
99/26836 WO EP Pr i ~t.TS9~~2~.~s2 particular arrangement may be used for applications using NTSC video and 48 k sample/sec.
PCM audio.
Processed Signal Blocks A sequence of blocks of encoded audio information may represent overlapping intervals of an audio signal. Some split-band perceptual coding systems, far example, process blocks of audio samples that overlap one another by half the block length. Typically, the samples in these overlapping blocks are modulated by an analysis window function.
Fig. 2a illustrates the modulation envelopes 61 through 67 of an analysis window function applied to each block in a sequence of overlapping audio blocks. The length of the overlap is equal to one half the block length. This overlap interval is commonly used by some signal analysis-synthesis systems such as the O-TDAC transform mentioned above.
Fig. 2b illustrates the resulting modulation envelope of a window function applied to a sequence of overlapping blocks for an encoded signal frame. As illustrated in Fig. 2b, the net effect or gain profile 81 of this modulation is the sum of the modulation envelopes 71 through 77 for adjacent blocks in the overlap intervals. Preferably, the net effect across each overlap should be unity gain.
Fig. 2c illustrates the overall effect ofwindow function modulation across adjacent encoded signal frames. As illustrated, gain profiles 80 through 82 overlap and add so that the net effect is unity gain.
In systems that use only analysis window functions, the net effect of all window function modulation is equivalent to the modulation effects of the analysis window function alone. The ideal gain profile can be achieved by ensuring that the modulation envelope of the analysis window function overlaps and adds to a constant.
In systems that use analysis and synthesis window functions, the net effect of all window function modulation is equivalent to that of a "product" window function formed from a product of the analysis window function and the synthesis window function. In such systems, the ideal gain profile can be achieved by having the modulation envelope of the product window function add to a constant in the overlap interval.
Throughout this disclosure, some mention is made of coding systems and methods that use both analysis and synthesis window functions. In this context, the gain profile resulting from overlapped analysis window functions will sometimes be said to equal a constant. Similarly, the gain profile resulting from overlapped synthesis window functions will sometimes be said to equal a constant. It should be understood that such descriptions are intended to refer to the net modulation effect of all windowing in the system.
AMENDED SHEET
99/26836 WO EP YCT/US98>'21552 Window Function The shape of the analysis window function not only affects the gain profile of the signal but it also affects the frequency response characteristic of a corresponding filterbank.
Spectral Splatter As mentioned above, many perceptual split-band coding systems use filterbanks having frequency response characteristics optimized for perceptual coding by increasing the attenuation of frequencies in the filter stopband in exchange for a broader filter passband. Unfortunately, splice edits tend to generate significant spectral artifacts or "spectral splatter" within a range of frequencies that is not within the what is regarded as the filter stopband.
Filterbanks that are designed to optimize general perceptual coding performance do not provide enough attenuation to render inaudible these spectral artifacts created at splice edits.
TDAC Transform Aliasing Cancellation With respect to the O-TDAC transform, the analysis window function, together with a synthesis window function that is applied after application of the synthesis transform, must also satisfy a number of constraints to allow cancellation of the time-domain aliasing artifacts.
The signal that is recovered from the synthesis transform can be conceptualized as a sum of the original signal and the time-domain aliasing components generated by the analysis transform. In Fig. 3, curves 91, 93 and 95 represent segments of the amplitude envelope of an input signal as recovered from the inverse or synthesis transform and modulated by analysis and synthesis window functions. Curves 92, 94 and 96 represent the time-domain aliasing components as recovered from the inverse or synthesis transform and modulated by analyses and synthesis window functions. As may be seen in the figure and will be explained below, the time-domain aliasing components are reflected replicas of the original input signal as modulated by the analysis and synthesis window functions.
The kernel functions of the analysis and synthesis 0-TDAC transforms are designed to generate time-domain abasing components that are end-for-end reflections of the windowed signal in each half of a block. As disclosed by Princen, et al., the O-TDAC
transform generates time-domain aliasing components in two different regions. In region 2, the time-domain aliasing component is an end-for-end windowed reflection of the original signal in that region. In region 1, the time-domain aliasing component is an end-for-end windowed reflection of the input signal within that region, but the amplitude of the reflection is inverted.
For example, abasing component 94a is an end-for-end windowed reflection of signal component 93a. Aliasing component 92b is also an end-for-end windowed reflection of signal component 91b except that the amplitude of the reflected component is inverted.
AME~VDEp SHEET
99/26836 WO EP YW'/US98;21552 By overlapping and adding adjacent blocks, the original signal is recovered and the aliasing components are cancelled. For example, signal components 91b and 93a are added to recover the signal without window function modulation effects, and aLiasing components 92b and 94a are added to cancel aliasing. Similarly, signal components 93b and 95a are added to S recover the signal and aliasing components 94b and 96a are added to cancel aliasing.
Time-domain aliasing artifacts on either side of a splice boundary will generally not be cancelled because the aliasing artifacts in the half block of synthesized audio samples immediately preceding the splice will not be the inverse of the aliasing artifacts in the half block of synthesized audio block immediately after the splice.
Similar considerations apply to other aliasing cancellation filterbanks such as one described in Princen and Bradley, "Analysis/Synthesis Filter Bank Design Based on Time Domain Aliasing Cancellation," IEEE Trans. on Acoust., Speech, Signal Proc., vol. AS SP-34, 1986, pp. 1153-1161. This filterbank system is the time-domain equivalent of an evenly-stacked critically sampled single-sideband analysis-synthesis system and is referred to herein as Evenly-Stacked Time-Domain Abasing Cancellation (E-TDAC).
Gain Control to Attenuate Artifacts at Splices A technique that may be used to reduce the audibility of artifacts created by a splice is to incorporate into an encoded audio signal a plurality of gain-control words that instruct a decoder or playback system to alter the amplitude of the playback signal. Simple embodiments of devices that use these gain-control words are discussed in the following paragraphs.
Fig. 4a illustrates a functional block diagram of device 100 in which format generates along path 112 an output signal arranged in frames comprising video information, encoded audio information representing multiple audio channels, and gain-control words.
Format 111 generates the output signal in response to a signal received from path 108 that is arranged in frames conveying video information and encoded audio information for the multiple audio channels, and in response to a signal received from path 110 that conveys gain-control words. Process 109 receives multiple control signals from paths 103a and 103b, each associated with one of the multiple audio channels, and in response to each control signal, generates along path 110 a pair of gain-control words for an associated audio channel that represent a starting gain and an ending gain within a respective frame. Only two control signals 103 and two associated audio channels 102 are shown in the figure for the sake of clarity.
This gain-control technique may be applied to more that two channels if desired.
In the embodiment shown, encode 105 generates along paths 106a and 106b encoded audio information for multiple audio channels in response to multiple audio channel signals AMENDED SHOE
99/26836 WO EP P~TlLTS9821552 received from paths 102a and 102b, and frame 107 generates the signal along 108 by arranging in frames video information received from path 101 and the encoded audio information received from paths 106a and 106b.
This gain-control technique may be used with input signals that are analogous to the S signal passed along path 108; therefore, neither encode 105 nor frame 107 are required. In embodiments that include encode 105, encoding may be applied to each audio channel independently or it may be applied jointly to multiple audio channels. For example, the AC-3 encoding technique may be applied jointly to two or more audio channels to lower total bandwidth requirements by removing or reducing redundancies between the channels.
Fig. 4c illustrates a functional block diagram of device 140 that generates output signals to reproduce or playback multiple audio channels according to gain-control words in an input signal. Deformat 142 receives from path 141 an input signal arranged in frames comprising video information, encoded audio information and gain-control words. Deformat 142 obtains from each frame of the input signal encoded audio information representing multiple audio channels and obtains a pair of gain-control words associated with each of the audio channels.
Process 148 receives the gain-control words from path 145 and in response generates gain control signals along paths 149a and 149b. Decode 146 receives the multiple channels of encoded audio information from paths 144a and 144b and in response generates an output signal for each audio channel such that the amplitude or level of each output signal is varied in response to an associated gain control signal.
A pair of gain-control words represents a starting gain and an ending gain for a respective audio channel within a particular frame. Process 148 generates gain control signals representing an interpolation of the pair of gain-control words. The interpolation may follow any desired trajectory such as linear, quadratic, logarithmic or exponential. With linear interpolation, for example, a gain control signal would represent a gain that changes linearly across a particular frame.
Decoding may be applied to each audio channel independently or it may be applied jointly to multiple audio channels. For example, decoding may be complementary to forms of encoding that remove or reduce redundancies between the channels. In split-band coding applications that use a synthesis filterbank and a synthesis window function, the output signal may be effectively modulated according to a gain control signal by modifying encoded audio prior to application of the synthesis filterbank, by modifying synthesized audio obtained from the synthesis filterbank prior to synthesis windowing, or by modifying the audio information obtained from the application of the synthesis window function.
~~~l~~liQ~D Si-!t~-~.
99/26836 WO EP ~ZrT/US981215v52 - lU -Fig. 4b illustrates a functional block diagram of device 120 that modifies existing gain-control words in a signal. Deformat 123 receives from path 121 an input signal arranged in frames comprising video information, encoded audio information representing multiple audio channels, and input gain-control words. Deformat 123 obtains from the input signal one or more input gain-control words associated with the encoded audio information for one of the multiple audio channels and passes the input gain control words along paths 124a and 124b. Process 126 generates one or more output gain-control words along path 127 by modifying one or more input gain-control words in response to a control signal received from path 122.
Format 128 generates along path 129 an output signal that is arranged in frames including the video information, the encoded audio information for the multiple audio channels, the output gain control words and the input gain-control words that do not correspond to the output gain-control words.
In an editing application, control signal 122 indicates a splice in input signal 121. In response, process 126 generates one or more output gain-control words that will cause a device such as device 140 to attenuate a playback signal immediately prior to the splice and to reverse the attenuation immediately after the splice. The change in gain may extend across several frames; however, in many applications the change is limited to one frame on either side of the splice. The gain-change interval may be determined by balancing the audibility of modulation products produced by the gain change with the audibility of the gain change itself. The gain-control word technique is not limited to editing applications.
AMEAIDED Si-'~EET
Frame-Based Audio Coding With Gain-Control Words TECHNICAL FIELD
The present invention is related to audio signal processing in which audio information streams are arranged in frames of information. In particular, the present invention is related to improving the audio quality of audio information streams formed by splicing frame-based audio information streams.
BACKGROUND ART
The process of editing audio or video material is essentially one of splicing or butting together two segments of material. A simple editing paradigm is the process of cutting and splicing motion picture film. The two segments of material to be spliced may originate from different sources, e.g., different channels of audio information, or they may originate from the same source. In either case, the splice generally creates a discontinuity in the audio or video material that may or may not be perceptible.
Audio Coding Block Processing The growing use of digital audio has tended to make it more difficult to edit audio material without creating audible artifacts. This has occurred in part because digital audio is frequently processed or encoded in blocks of digital samples that must be processed as a block.
Many perceptual or psychoacoustic-based audio coding systems utilize filterbanks or transforms to convert blocks of signal samples into blocks of encoded subband signal samples or transform coefficients that must be synthesis filtered or inverse transformed as blocks to recover a replica of the original signal. At a minimum, an edit of the processed audio signal must be done at a block boundary; otherwise, audio information represented by the remaining partial block cannot be properly recovered.
Throughout the remainder of this discussion, terms such as "coding" and "coder" refer to various methods and devices for signal processing and other terms such as "encoded" refer to the results of such processing. None of these terms imply any particular form of processing such as those that reduce information irrelevancy or redundancy in a signal. For example, coding includes generating pulse code modulation (PCM) samples to represent a signal and arranging information into patterns or formats according to some specification. Terms such as "block" and "frame" as used in this disclosure refer to groups or intervals of information that may differ AMENDED SHEET
99/26836 WO EP i C ~_/US78/?1652 from what those same terms refer to elsewhere, such as in the ANSI 54.40-1992 standard, sometimes known as the AES-3/EBU digital audio standard. Terms such as "filter" and "filterbank" as used herein include essentially any form of recursive and non-recursive filtering such as quadrature mirror filters (QMF) and transforms, and "filtered"
information is the result of applying such filters. More particular mention is made of filterbanks implemented by transforms.
An additional limitation is imposed on editing by coding systems that use overlapping-block structures to process and encode program material. Because of the overlapping nature of the encoded blocks, an original signal cannot properly be recovered from even a complete block of encoded samples or coefficients.
This limitation is clearly illustrated by a commonly used overlapped-block transform, the modified discrete cosine transform (DCT), that is described in Princen, Johnson, and Bradley, "Subband/Transform Coding Using Filter Bank Designs Based on Time Domain Aliasing Cancellation," ICASSP 1987 Conf. Proc., May 1987, pp. 2161-64. This transform is the time-domain equivalent of an oddly-stacked critically sampled single-sideband analysis-synthesis system and is referred to herein as Oddly-Stacked Time-Domain Aliasing Cancellation (O-TDAC). The forward transform is applied to blocks of samples that overlap one another by one-half the block length and achieves critical sampling by decimating the transform coe~cients by two; however, the information lost by this decimation creates time-domain aliasing in the recovered signal. The synthesis process can cancel this aliasing by applying an inverse transform to the blocks of transform coefficients to generate blocks of synthesized samples, applying a suitably shaped synthesis window function to the blocks of synthesized samples, and overlapping and adding the windowed blocks. For example, if a TDAC coding system generates a sequence of blocks B1-B2, then the aliasing artifacts in the last half of block B1 and in the first half of block BZ will cancel one another.
If two encoded information streams from a TDAC coding system are spliced at a block boundary, the resulting sequence of blocks will not cancel each other's aliasing artifacts. For example, suppose one encoded information stream is cut so that it ends at a block boundary between blocks B1-BZ and another encoded information stream is cut so that it begins at a block boundary between blocks Al-A2. If these two encoded information streams are spliced so that block B1 immediately precedes block A2, then the aliasing artifacts in the last half of block B1 and the first half of block AZ will generally not cancel one another.
The methods and devices of the prior art have either ignored the problem or have provided unsatisfactory solutions. One solution reduces the audibility of the uncancelled aliasing AMENDED ~f-iEET
99/26836 WO EP FC'1'/US~S/2.1552 _3_ artifacts by recovering or decoding the original audio from each encoded audio stream, crossfading one audio stream into the other, and re-encoding the resultant crossfaded stream into a new encoded audio stream. Unfortunately, the decode/re-encode process degrades the resulting signal, the process incurs a cost that is unattractive, and the original signal immediately on either side of the splice cannot be independently recovered because the crossfade cannot be undone.
Spectral Splatter Splice edits create another problem that the prior art has failed to address.
This problem is particularly troublesome with split-band perceptual coding techniques.
Perceptual split-band encoding applies a filterbank to an input signal to generate subband signals or groups of transform coefficients having bandwidths that are commensurate with the critical bandwidths of the human auditory system. Ideally, each subband signal or group of transform coefficients is quantized or encoded with just enough bits to render the resultant quantizing noise inaudible by having the noise masked by spectral components in the original signal. Coding performance is affected significantly by the frequency response characteristics of the filterbank applied to the input signal to generate the subband signals or transform coefficients.
Generally, these characteristics are optimized by increasing the attenuation of frequencies in the filter stopband in exchange for a broader filter passband. For example, see U.S. patent 5,109,417.
Splice edits tend to generate significant spurious spectral components or "spectral splatter" within a range of frequencies that is usually within the filter passband or transition region between passband and stopband, and not within what is regarded as the filter stopband;
hence, filterbanks that are designed to optimize general coding performance do not provide enough attenuation of the spectral splatter created at splice edits. These artifacts are usually audible because they are usually too large to be masked by the original signal.
DISCLOSURE OF INVENTION
It is an object of the present invention to improve the quality of audio represented by an audio information stream formed by splicing two or more frame-based audio information streams by using gain-control words to control the gain profile of frames on either side of a splice.
According to the teachings of one aspect of the present invention, a method or device for signal processing receives an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels (102a, 102b), receives multiple control signals {103 a, 103b), each control signal associated with a respective one of said multiple audio channels, generates, in response to said control signals for a respective frame of said input ANIE~iL~ED S~I~E~
99/2683 6 WO EP FL T/USQ~/2 I S S2 signal, groups of gain-control words such that each group of gain-control words is associated with a respective one of said audio channels, and a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, and generates an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
According to the teachings of another aspect of the present invention, a method or device for signal processing receives a control signal, receives an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, wherein a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, modifies one or more of said gain-control words in response to said control signal such that the gain levels represented by a gain-control word before and after the modification, respectively, differ from one another, and, subsequently, generates an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
According to the teachings of yet another aspect of the present invention, a method or device for signal processing receives an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, obtains from a frame of said input signal encoded audio information for a respective audio channel and the associated group of gain-control words, and generates an output signal by decoding said encoded audio information, wherein the level of said output signal is effectively modulated according to a gain trajectory corresponding to an interpolation of a starting gain level and an ending gain level represented by said associated group of gain-control words.
The various features of the present invention and its preferred embodiments may be better understood by referring to the following discussion and the accompanying drawings in which like reference numerals refer to like elements in the several figures.
The drawings which illustrate various devices show major components that are helpful in understanding the present invention. For the sake of clarity, these drawings omit many other features that may be important in practical embodiments but are not important to understanding the concepts of the °~,i~~~~~~~~
99/26836 WO EP PCT/US4~/?.i~52 .
present invention. The signal processing required to practice the present invention may be accomplished in a wide variety of ways including programs executed by microprocessors, digital signal processors , logic arrays and other forms of computing circuitry. Signal filters may be accomplished in essentially any way including recursive, non-recursive and lattice digital filters. Digital and analog technology may be used in various combinations according to needs and characteristics of the application.
More particular mention is made of conditions pertaining to processing audio and video information streams; however, aspects of the present invention may be practiced in applications that do not include the processing of video information. The contents of the following discussion and the drawings are set forth as examples only and should not be understood to represent limitations upon the scope of the present invention.
BRIEF DESCRIPTION OF DRAWINGS
Figs. la and lb are schematic representations of video and audio information arranged in blocks, frames and superframes.
Figs. 2a to 2c are schematic representations of overlapping blocks modulated by window functions and the resulting gain profile for frames comprising the windowed blocks.
Fig. 3 illustrates signal and aliasing components generated by an aliasing cancellation transform.
Figs. 4a to 4c illustrate functional block diagrams of devices that create, change and respond to gain control words in an encoded information stream.
MODES FOR CARRYING OUT THE INVENTION
Signals and Processing Signal Blocks and Frames Fig. 1 a illustrates a stream of encoded audio information arranged in a sequence of audio blocks 10 through 18, and video information arranged in a sequence of video frames such as video frame 1. In some formats such as NTSC video, each video frame comprises two video fields that collectively define a single picture or image. Audio blocks 11 through 17 are grouped with video frame 1 into an encoded signal frame 21.
Some applications have video frames that do not divide the encoded audio into an integer number of samples, transform coefficients, or the like. This can be accommodated by arranging groups of encoded signal frames into respective superframes. An arrangement of five encoded signal frames 21 through 25 grouped into superframe 31 is illustrated in Fig. lb. This t':':'~~ ~~G~i~ S~-~~~ ~~
99/26836 WO EP Pr i ~t.TS9~~2~.~s2 particular arrangement may be used for applications using NTSC video and 48 k sample/sec.
PCM audio.
Processed Signal Blocks A sequence of blocks of encoded audio information may represent overlapping intervals of an audio signal. Some split-band perceptual coding systems, far example, process blocks of audio samples that overlap one another by half the block length. Typically, the samples in these overlapping blocks are modulated by an analysis window function.
Fig. 2a illustrates the modulation envelopes 61 through 67 of an analysis window function applied to each block in a sequence of overlapping audio blocks. The length of the overlap is equal to one half the block length. This overlap interval is commonly used by some signal analysis-synthesis systems such as the O-TDAC transform mentioned above.
Fig. 2b illustrates the resulting modulation envelope of a window function applied to a sequence of overlapping blocks for an encoded signal frame. As illustrated in Fig. 2b, the net effect or gain profile 81 of this modulation is the sum of the modulation envelopes 71 through 77 for adjacent blocks in the overlap intervals. Preferably, the net effect across each overlap should be unity gain.
Fig. 2c illustrates the overall effect ofwindow function modulation across adjacent encoded signal frames. As illustrated, gain profiles 80 through 82 overlap and add so that the net effect is unity gain.
In systems that use only analysis window functions, the net effect of all window function modulation is equivalent to the modulation effects of the analysis window function alone. The ideal gain profile can be achieved by ensuring that the modulation envelope of the analysis window function overlaps and adds to a constant.
In systems that use analysis and synthesis window functions, the net effect of all window function modulation is equivalent to that of a "product" window function formed from a product of the analysis window function and the synthesis window function. In such systems, the ideal gain profile can be achieved by having the modulation envelope of the product window function add to a constant in the overlap interval.
Throughout this disclosure, some mention is made of coding systems and methods that use both analysis and synthesis window functions. In this context, the gain profile resulting from overlapped analysis window functions will sometimes be said to equal a constant. Similarly, the gain profile resulting from overlapped synthesis window functions will sometimes be said to equal a constant. It should be understood that such descriptions are intended to refer to the net modulation effect of all windowing in the system.
AMENDED SHEET
99/26836 WO EP YCT/US98>'21552 Window Function The shape of the analysis window function not only affects the gain profile of the signal but it also affects the frequency response characteristic of a corresponding filterbank.
Spectral Splatter As mentioned above, many perceptual split-band coding systems use filterbanks having frequency response characteristics optimized for perceptual coding by increasing the attenuation of frequencies in the filter stopband in exchange for a broader filter passband. Unfortunately, splice edits tend to generate significant spectral artifacts or "spectral splatter" within a range of frequencies that is not within the what is regarded as the filter stopband.
Filterbanks that are designed to optimize general perceptual coding performance do not provide enough attenuation to render inaudible these spectral artifacts created at splice edits.
TDAC Transform Aliasing Cancellation With respect to the O-TDAC transform, the analysis window function, together with a synthesis window function that is applied after application of the synthesis transform, must also satisfy a number of constraints to allow cancellation of the time-domain aliasing artifacts.
The signal that is recovered from the synthesis transform can be conceptualized as a sum of the original signal and the time-domain aliasing components generated by the analysis transform. In Fig. 3, curves 91, 93 and 95 represent segments of the amplitude envelope of an input signal as recovered from the inverse or synthesis transform and modulated by analysis and synthesis window functions. Curves 92, 94 and 96 represent the time-domain aliasing components as recovered from the inverse or synthesis transform and modulated by analyses and synthesis window functions. As may be seen in the figure and will be explained below, the time-domain aliasing components are reflected replicas of the original input signal as modulated by the analysis and synthesis window functions.
The kernel functions of the analysis and synthesis 0-TDAC transforms are designed to generate time-domain abasing components that are end-for-end reflections of the windowed signal in each half of a block. As disclosed by Princen, et al., the O-TDAC
transform generates time-domain aliasing components in two different regions. In region 2, the time-domain aliasing component is an end-for-end windowed reflection of the original signal in that region. In region 1, the time-domain aliasing component is an end-for-end windowed reflection of the input signal within that region, but the amplitude of the reflection is inverted.
For example, abasing component 94a is an end-for-end windowed reflection of signal component 93a. Aliasing component 92b is also an end-for-end windowed reflection of signal component 91b except that the amplitude of the reflected component is inverted.
AME~VDEp SHEET
99/26836 WO EP YW'/US98;21552 By overlapping and adding adjacent blocks, the original signal is recovered and the aliasing components are cancelled. For example, signal components 91b and 93a are added to recover the signal without window function modulation effects, and aLiasing components 92b and 94a are added to cancel aliasing. Similarly, signal components 93b and 95a are added to S recover the signal and aliasing components 94b and 96a are added to cancel aliasing.
Time-domain aliasing artifacts on either side of a splice boundary will generally not be cancelled because the aliasing artifacts in the half block of synthesized audio samples immediately preceding the splice will not be the inverse of the aliasing artifacts in the half block of synthesized audio block immediately after the splice.
Similar considerations apply to other aliasing cancellation filterbanks such as one described in Princen and Bradley, "Analysis/Synthesis Filter Bank Design Based on Time Domain Aliasing Cancellation," IEEE Trans. on Acoust., Speech, Signal Proc., vol. AS SP-34, 1986, pp. 1153-1161. This filterbank system is the time-domain equivalent of an evenly-stacked critically sampled single-sideband analysis-synthesis system and is referred to herein as Evenly-Stacked Time-Domain Abasing Cancellation (E-TDAC).
Gain Control to Attenuate Artifacts at Splices A technique that may be used to reduce the audibility of artifacts created by a splice is to incorporate into an encoded audio signal a plurality of gain-control words that instruct a decoder or playback system to alter the amplitude of the playback signal. Simple embodiments of devices that use these gain-control words are discussed in the following paragraphs.
Fig. 4a illustrates a functional block diagram of device 100 in which format generates along path 112 an output signal arranged in frames comprising video information, encoded audio information representing multiple audio channels, and gain-control words.
Format 111 generates the output signal in response to a signal received from path 108 that is arranged in frames conveying video information and encoded audio information for the multiple audio channels, and in response to a signal received from path 110 that conveys gain-control words. Process 109 receives multiple control signals from paths 103a and 103b, each associated with one of the multiple audio channels, and in response to each control signal, generates along path 110 a pair of gain-control words for an associated audio channel that represent a starting gain and an ending gain within a respective frame. Only two control signals 103 and two associated audio channels 102 are shown in the figure for the sake of clarity.
This gain-control technique may be applied to more that two channels if desired.
In the embodiment shown, encode 105 generates along paths 106a and 106b encoded audio information for multiple audio channels in response to multiple audio channel signals AMENDED SHOE
99/26836 WO EP P~TlLTS9821552 received from paths 102a and 102b, and frame 107 generates the signal along 108 by arranging in frames video information received from path 101 and the encoded audio information received from paths 106a and 106b.
This gain-control technique may be used with input signals that are analogous to the S signal passed along path 108; therefore, neither encode 105 nor frame 107 are required. In embodiments that include encode 105, encoding may be applied to each audio channel independently or it may be applied jointly to multiple audio channels. For example, the AC-3 encoding technique may be applied jointly to two or more audio channels to lower total bandwidth requirements by removing or reducing redundancies between the channels.
Fig. 4c illustrates a functional block diagram of device 140 that generates output signals to reproduce or playback multiple audio channels according to gain-control words in an input signal. Deformat 142 receives from path 141 an input signal arranged in frames comprising video information, encoded audio information and gain-control words. Deformat 142 obtains from each frame of the input signal encoded audio information representing multiple audio channels and obtains a pair of gain-control words associated with each of the audio channels.
Process 148 receives the gain-control words from path 145 and in response generates gain control signals along paths 149a and 149b. Decode 146 receives the multiple channels of encoded audio information from paths 144a and 144b and in response generates an output signal for each audio channel such that the amplitude or level of each output signal is varied in response to an associated gain control signal.
A pair of gain-control words represents a starting gain and an ending gain for a respective audio channel within a particular frame. Process 148 generates gain control signals representing an interpolation of the pair of gain-control words. The interpolation may follow any desired trajectory such as linear, quadratic, logarithmic or exponential. With linear interpolation, for example, a gain control signal would represent a gain that changes linearly across a particular frame.
Decoding may be applied to each audio channel independently or it may be applied jointly to multiple audio channels. For example, decoding may be complementary to forms of encoding that remove or reduce redundancies between the channels. In split-band coding applications that use a synthesis filterbank and a synthesis window function, the output signal may be effectively modulated according to a gain control signal by modifying encoded audio prior to application of the synthesis filterbank, by modifying synthesized audio obtained from the synthesis filterbank prior to synthesis windowing, or by modifying the audio information obtained from the application of the synthesis window function.
~~~l~~liQ~D Si-!t~-~.
99/26836 WO EP ~ZrT/US981215v52 - lU -Fig. 4b illustrates a functional block diagram of device 120 that modifies existing gain-control words in a signal. Deformat 123 receives from path 121 an input signal arranged in frames comprising video information, encoded audio information representing multiple audio channels, and input gain-control words. Deformat 123 obtains from the input signal one or more input gain-control words associated with the encoded audio information for one of the multiple audio channels and passes the input gain control words along paths 124a and 124b. Process 126 generates one or more output gain-control words along path 127 by modifying one or more input gain-control words in response to a control signal received from path 122.
Format 128 generates along path 129 an output signal that is arranged in frames including the video information, the encoded audio information for the multiple audio channels, the output gain control words and the input gain-control words that do not correspond to the output gain-control words.
In an editing application, control signal 122 indicates a splice in input signal 121. In response, process 126 generates one or more output gain-control words that will cause a device such as device 140 to attenuate a playback signal immediately prior to the splice and to reverse the attenuation immediately after the splice. The change in gain may extend across several frames; however, in many applications the change is limited to one frame on either side of the splice. The gain-change interval may be determined by balancing the audibility of modulation products produced by the gain change with the audibility of the gain change itself. The gain-control word technique is not limited to editing applications.
AMEAIDED Si-'~EET
Claims (20)
1. A method for signal processing comprising:
(a) receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels (102a, 102b), (b) receiving multiple control signals (103a, 103b), each control signal associated with a respective one of said multiple audio channels, (c) generating, in response to said control signals for a respective frame of said input signal, groups of gain-control words such that each group of gain-control words is associated with a respective one of said audio channels, and a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, and (d) generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
(a) receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels (102a, 102b), (b) receiving multiple control signals (103a, 103b), each control signal associated with a respective one of said multiple audio channels, (c) generating, in response to said control signals for a respective frame of said input signal, groups of gain-control words such that each group of gain-control words is associated with a respective one of said audio channels, and a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, and (d) generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
2. A method for signal processing comprising:
(e) receiving a control signal, (f) receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, wherein a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, (g) modifying one or more of said gain-control words in response to said control signal such that the gain levels represented by a gain-control word before and after the modification, respectively, differ from one another, and, subsequently, (h) generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
(e) receiving a control signal, (f) receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, wherein a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, (g) modifying one or more of said gain-control words in response to said control signal such that the gain levels represented by a gain-control word before and after the modification, respectively, differ from one another, and, subsequently, (h) generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
3. A method for signal processing comprising:
(i) receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, (j) obtaining from a frame of said input signal encoded audio information for a respective audio channel and the associated group of gain-control words, and (k) generating an output signal by decoding said encoded audio information, wherein the level of said output signal is effectively modulated according to a gain trajectory corresponding to an interpolation of a starting gain level and an ending gain level represented by said associated group of gain-control words.
(i) receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, (j) obtaining from a frame of said input signal encoded audio information for a respective audio channel and the associated group of gain-control words, and (k) generating an output signal by decoding said encoded audio information, wherein the level of said output signal is effectively modulated according to a gain trajectory corresponding to an interpolation of a starting gain level and an ending gain level represented by said associated group of gain-control words.
4. A method according to claim 3 wherein said frame of said input signal comprises encoded audio information arranged in two or more blocks and said generating an output signal includes applying one or more inverse block transforms and subsequently applying one or more synthesis window functions.
5. A method according to claim 4, wherein said output signal is effectively modulated by modifying said blocks of encoded information before application of said transforms.
6. A method according to claim 4, wherein said output signal is effectively modulated by modifying information available after application of said transforms but before application of said synthesis window functions.
7. A method according to claim 3 wherein said interpolation is substantially logarithmic.
8. A method for signal processing comprising steps (a) to (d) as defined in claim 1 and steps (e) to (h) as defined in claim 2, wherein step (f) receives as said input signal the output signal generated in step (d).
9. A method for signal processing comprising steps (a) to (d) as defined in claim 1 and steps (i) to (k) as defined in claim 3, wherein step (i) receives as said input signal the output signal generated in step (d).
10. A method for signal processing comprising steps (e) to (h) as defined in claim 2 and steps (i) to (k) as defined in claim 3, wherein step (i) receives as said input signal the output signal generated in step (k).
11. A device for signal processing comprising:
means for receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels (102a, 102b), means for receiving multiple control signals (103a, 103b), each control signal associated with a respective one of said multiple audio channels, means for generating, in response to said control signals for a respective frame of said input signal, groups of gain-control words such that each group of gain-control words is associated with a respective one of said audio channels, and a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, and means for generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
means for receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels (102a, 102b), means for receiving multiple control signals (103a, 103b), each control signal associated with a respective one of said multiple audio channels, means for generating, in response to said control signals for a respective frame of said input signal, groups of gain-control words such that each group of gain-control words is associated with a respective one of said audio channels, and a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, and means for generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
12. A device for signal processing comprising:
means for receiving a control signal, means for receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, wherein a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, means for modifying one or more of said gain-control words in response to said control signal such that the gain levels represented by a gain-control word before and after the modification, respectively, differ from one another, and means, responsive to said means for modifying, for generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
means for receiving a control signal, means for receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, wherein a respective group of gain-control words represents starting and ending gain levels for playback of an audio signal generated for the associated audio channel from the encoded audio information within said respective frame, means for modifying one or more of said gain-control words in response to said control signal such that the gain levels represented by a gain-control word before and after the modification, respectively, differ from one another, and means, responsive to said means for modifying, for generating an output signal arranged in frames, a respective frame comprising said encoded audio information for said multiple audio channels and the associated groups of gain-control words, wherein said output signal has a form suitable for transmission or storage.
13. A device for signal processing comprising:
means for receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, means for obtaining from a frame of said input signal encoded audio information for a respective audio channel and the associated group of gain-control words, and means for generating an output signal by decoding said encoded audio information, wherein the level of said output signal is effectively modulated according to a gain trajectory corresponding to an interpolation of a starting gain level and an ending gain level represented by said associated gain-control words.
means for receiving an input signal arranged in frames, a respective frame comprising encoded audio information for multiple audio channels and for each audio channel an associated group of gain-control words, means for obtaining from a frame of said input signal encoded audio information for a respective audio channel and the associated group of gain-control words, and means for generating an output signal by decoding said encoded audio information, wherein the level of said output signal is effectively modulated according to a gain trajectory corresponding to an interpolation of a starting gain level and an ending gain level represented by said associated gain-control words.
14. A device according to claim 13 wherein said frame of said input signal comprises encoded audio information arranged in two or more blocks and said generating an output signal includes applying one or more inverse block transforms and subsequently applying one or more synthesis window functions.
15. A device according to claim 14, wherein said output signal is effectively modulated by modifying said blocks of encoded information before application of said transforms.
16. A device according to claim 14, wherein said output signal is effectively modulated by modifying information available after application of said transforms but before application of said synthesis window functions.
17. A device according to claim 13 wherein said interpolation is substantially logarithmic.
18. A device for signal processing comprising the means of claim 11 and the means of claim 12, wherein said output signal is received as said input signal.
19. A device for signal processing comprising the means of claim 11 and the means of claim 13, wherein said output signal is received as said input signal.
20. A device for signal processing comprising the means of claim 12 and the means of claim 13, wherein said output signal is received as said input signal.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/953,324 US5899969A (en) | 1997-10-17 | 1997-10-17 | Frame-based audio coding with gain-control words |
| US08/953,324 | 1997-10-17 | ||
| PCT/US1998/021552 WO1999021371A1 (en) | 1997-10-17 | 1998-10-13 | Frame-based audio coding with gain-control words |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2305534A1 CA2305534A1 (en) | 1999-04-29 |
| CA2305534C true CA2305534C (en) | 2007-03-27 |
Family
ID=25493823
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002305534A Expired - Lifetime CA2305534C (en) | 1997-10-17 | 1998-10-13 | Frame-based audio coding with gain-control words |
Country Status (11)
| Country | Link |
|---|---|
| US (1) | US5899969A (en) |
| EP (1) | EP1023809B1 (en) |
| JP (1) | JP4229586B2 (en) |
| KR (1) | KR100591009B1 (en) |
| AT (1) | ATE200722T1 (en) |
| AU (1) | AU755358B2 (en) |
| CA (1) | CA2305534C (en) |
| DE (1) | DE69800717T2 (en) |
| DK (1) | DK1023809T3 (en) |
| ES (1) | ES2156034T3 (en) |
| WO (1) | WO1999021371A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10269362B2 (en) | 2002-03-28 | 2019-04-23 | Dolby Laboratories Licensing Corporation | Methods, apparatus and systems for determining reconstructed audio signal |
Families Citing this family (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4867076B2 (en) * | 2001-03-28 | 2012-02-01 | 日本電気株式会社 | Compression unit creation apparatus for speech synthesis, speech rule synthesis apparatus, and method used therefor |
| WO2002101725A1 (en) * | 2001-06-08 | 2002-12-19 | Koninklijke Philips Electronics N.V. | Editing of audio signals |
| US7941037B1 (en) * | 2002-08-27 | 2011-05-10 | Nvidia Corporation | Audio/video timescale compression system and method |
| CN100543731C (en) * | 2003-04-24 | 2009-09-23 | 皇家飞利浦电子股份有限公司 | Parameterized temporal feature analysis |
| WO2005093717A1 (en) * | 2004-03-12 | 2005-10-06 | Nokia Corporation | Synthesizing a mono audio signal based on an encoded miltichannel audio signal |
| US20060062407A1 (en) * | 2004-09-22 | 2006-03-23 | Kahan Joseph M | Sound card having feedback calibration loop |
| US8521314B2 (en) | 2006-11-01 | 2013-08-27 | Dolby Laboratories Licensing Corporation | Hierarchical control path with constraints for audio dynamics processing |
| CN101960866B (en) * | 2007-03-01 | 2013-09-25 | 杰里·马哈布比 | Audio spatialization and environment simulation |
| CN101952888B (en) * | 2007-12-21 | 2013-10-09 | 法国电信 | Method for transform-based coding/decoding, with adaptive windows |
| TWI484481B (en) | 2009-05-27 | 2015-05-11 | 杜比國際公司 | Systems and methods for generating a high frequency component of a signal from a low frequency component of the signal, a set-top box, a computer program product and storage medium thereof |
| US11657788B2 (en) | 2009-05-27 | 2023-05-23 | Dolby International Ab | Efficient combined harmonic transposition |
| US9338523B2 (en) * | 2009-12-21 | 2016-05-10 | Echostar Technologies L.L.C. | Audio splitting with codec-enforced frame sizes |
| MX356063B (en) | 2011-11-18 | 2018-05-14 | Sirius Xm Radio Inc | Systems and methods for implementing cross-fading, interstitials and other effects downstream. |
| US8712076B2 (en) | 2012-02-08 | 2014-04-29 | Dolby Laboratories Licensing Corporation | Post-processing including median filtering of noise suppression gains |
| US9173025B2 (en) | 2012-02-08 | 2015-10-27 | Dolby Laboratories Licensing Corporation | Combined suppression of noise, echo, and out-of-location signals |
| CA2866585C (en) * | 2012-03-06 | 2021-02-23 | Sirius Xm Radio Inc. | Systems and methods for audio attribute mapping |
| CA2870884C (en) | 2012-04-17 | 2022-06-21 | Sirius Xm Radio Inc. | Systems and methods for implementing efficient cross-fading between compressed audio streams |
| US20140046670A1 (en) * | 2012-06-04 | 2014-02-13 | Samsung Electronics Co., Ltd. | Audio encoding method and apparatus, audio decoding method and apparatus, and multimedia device employing the same |
| CN102739323B (en) * | 2012-06-16 | 2013-09-04 | 天地融科技股份有限公司 | Audio data transmission method |
| TWI557727B (en) * | 2013-04-05 | 2016-11-11 | 杜比國際公司 | An audio processing system, a multimedia processing system, a method of processing an audio bitstream and a computer program product |
| EP2996269A1 (en) * | 2014-09-09 | 2016-03-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio splicing concept |
| EP3198247B1 (en) | 2014-09-25 | 2021-03-17 | Sunhouse Technologies, Inc. | Device for capturing vibrations produced by an object and system for capturing vibrations produced by a drum. |
| US11308928B2 (en) | 2014-09-25 | 2022-04-19 | Sunhouse Technologies, Inc. | Systems and methods for capturing and interpreting audio |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4551688A (en) * | 1984-05-23 | 1985-11-05 | Rockwell International Corporation | Delay compensated automatic gain control |
| US4625240A (en) * | 1984-07-25 | 1986-11-25 | Eeco, Inc. | Adaptive automatic gain control |
| US5109417A (en) * | 1989-01-27 | 1992-04-28 | Dolby Laboratories Licensing Corporation | Low bit rate transform coder, decoder, and encoder/decoder for high-quality audio |
| US5479562A (en) * | 1989-01-27 | 1995-12-26 | Dolby Laboratories Licensing Corporation | Method and apparatus for encoding and decoding audio information |
| NL9000338A (en) * | 1989-06-02 | 1991-01-02 | Koninkl Philips Electronics Nv | DIGITAL TRANSMISSION SYSTEM, TRANSMITTER AND RECEIVER FOR USE IN THE TRANSMISSION SYSTEM AND RECORD CARRIED OUT WITH THE TRANSMITTER IN THE FORM OF A RECORDING DEVICE. |
| DE69210689T2 (en) * | 1991-01-08 | 1996-11-21 | Dolby Lab Licensing Corp | ENCODER / DECODER FOR MULTI-DIMENSIONAL SOUND FIELDS |
| US5394508A (en) * | 1992-01-17 | 1995-02-28 | Massachusetts Institute Of Technology | Method and apparatus for encoding decoding and compression of audio-type data |
| US5369724A (en) * | 1992-01-17 | 1994-11-29 | Massachusetts Institute Of Technology | Method and apparatus for encoding, decoding and compression of audio-type data using reference coefficients located within a band of coefficients |
| US5623577A (en) * | 1993-07-16 | 1997-04-22 | Dolby Laboratories Licensing Corporation | Computationally efficient adaptive bit allocation for encoding method and apparatus with allowance for decoder spectral distortions |
| US5451954A (en) * | 1993-08-04 | 1995-09-19 | Dolby Laboratories Licensing Corporation | Quantization noise suppression for encoder/decoder system |
| US5430485A (en) * | 1993-09-30 | 1995-07-04 | Thomson Consumer Electronics, Inc. | Audio/video synchronization in a digital transmission system |
| US5920842A (en) * | 1994-10-12 | 1999-07-06 | Pixel Instruments | Signal synchronization |
| JP3390013B2 (en) * | 1994-11-04 | 2003-03-24 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Encoding and decoding of wideband digital information signals |
| US5727119A (en) * | 1995-03-27 | 1998-03-10 | Dolby Laboratories Licensing Corporation | Method and apparatus for efficient implementation of single-sideband filter banks providing accurate measures of spectral magnitude and phase |
| WO1997035386A1 (en) * | 1996-03-19 | 1997-09-25 | Dolby Laboratories Licensing Corporation | Analysis/synthesis filtering system with efficient oddly-stacked single-sideband filter bank using time-domain aliasing cancellation |
-
1997
- 1997-10-17 US US08/953,324 patent/US5899969A/en not_active Expired - Lifetime
-
1998
- 1998-10-13 ES ES98952266T patent/ES2156034T3/en not_active Expired - Lifetime
- 1998-10-13 DK DK98952266T patent/DK1023809T3/en active
- 1998-10-13 JP JP2000517559A patent/JP4229586B2/en not_active Expired - Lifetime
- 1998-10-13 KR KR1020007003421A patent/KR100591009B1/en not_active IP Right Cessation
- 1998-10-13 AU AU98009/98A patent/AU755358B2/en not_active Expired
- 1998-10-13 EP EP98952266A patent/EP1023809B1/en not_active Expired - Lifetime
- 1998-10-13 AT AT98952266T patent/ATE200722T1/en active
- 1998-10-13 CA CA002305534A patent/CA2305534C/en not_active Expired - Lifetime
- 1998-10-13 WO PCT/US1998/021552 patent/WO1999021371A1/en active IP Right Grant
- 1998-10-13 DE DE69800717T patent/DE69800717T2/en not_active Expired - Lifetime
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10269362B2 (en) | 2002-03-28 | 2019-04-23 | Dolby Laboratories Licensing Corporation | Methods, apparatus and systems for determining reconstructed audio signal |
Also Published As
| Publication number | Publication date |
|---|---|
| AU755358B2 (en) | 2002-12-12 |
| DK1023809T3 (en) | 2001-05-07 |
| JP2001521347A (en) | 2001-11-06 |
| EP1023809B1 (en) | 2001-04-18 |
| AU9800998A (en) | 1999-05-10 |
| US5899969A (en) | 1999-05-04 |
| ATE200722T1 (en) | 2001-05-15 |
| KR100591009B1 (en) | 2006-06-22 |
| KR20010024342A (en) | 2001-03-26 |
| DE69800717T2 (en) | 2001-09-13 |
| JP4229586B2 (en) | 2009-02-25 |
| ES2156034T3 (en) | 2001-06-01 |
| EP1023809A1 (en) | 2000-08-02 |
| DE69800717D1 (en) | 2001-05-23 |
| CA2305534A1 (en) | 1999-04-29 |
| WO1999021371A1 (en) | 1999-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2305534C (en) | Frame-based audio coding with gain-control words | |
| US6124895A (en) | Frame-based audio coding with video/audio data synchronization by dynamic audio frame alignment | |
| EP1023727B1 (en) | Frame-based audio coding with additional filterbank to suppress aliasing artifacts at frame boundaries | |
| EP1023730B1 (en) | Frame-based audio coding with additional filterbank to attenuate spectral splatter at frame boundaries | |
| US5913190A (en) | Frame-based audio coding with video/audio data synchronization by audio sample rate conversion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKEX | Expiry |
Effective date: 20181015 |
|
| MKEX | Expiry |
Effective date: 20181015 |