WO2001088883A1 - Digital watermarking method and apparatus using a color image as a watermark - Google Patents
Digital watermarking method and apparatus using a color image as a watermark Download PDFInfo
- Publication number
- WO2001088883A1 WO2001088883A1 PCT/KR2000/000645 KR0000645W WO0188883A1 WO 2001088883 A1 WO2001088883 A1 WO 2001088883A1 KR 0000645 W KR0000645 W KR 0000645W WO 0188883 A1 WO0188883 A1 WO 0188883A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color image
- mode
- data
- audio data
- watermark
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09C—CIPHERING OR DECIPHERING APPARATUS FOR CRYPTOGRAPHIC OR OTHER PURPOSES INVOLVING THE NEED FOR SECRECY
- G09C5/00—Ciphering apparatus or methods not provided for in the preceding groups, e.g. involving the concealment or deformation of graphic data such as designs, written or printed messages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0052—Embedding of the watermark in the frequency domain
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/00884—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm
Abstract
A color image of relatively large size is inserted in audio signal data as a watermark. And yet the watermark embedded audio signal data can be played back with sound quality very close to that of original audio signal data. The original audio signal data are reshaped into a matrix form to correspond to that of a color image file before wavelet transformed while the color image file undergoes a format conversion before discrete cosine transformed. The coefficients of the transformed audio signal data and the reformatted color image are combined before inverse-matrix-reshaped and subsequently inverse-wavelet-transformed to finally generate an audio signal wherein a color-image watermark has been inserted.
Description
DIGITAL WATERMARKING METHOD AND APPARATUS USING A COLOR IMAGE AS A WATERMARK
TECHNICAL FIELD
The present invention relates to digital watermarking of data, including audio, video and multimedia data .
Specifically, the invention relates to embedding a watermark signal of relatively large data size , such as a color image, into digital audio data .
BACKGROUND ART
The proliferation of digitized media such as image, video and multimedia is creating a need for security systems that facilitate the identification of the source of the material. Particularly, the internet is increasingly used for transmitting recorded music in a digitized format. Content providers, i.e., owners of such recorded music in digital form, have a need to embed into multimedia data a predetermined mark, which can subsequently be detected by software and/or hardware devices for purposes of authenticating copyright ownership, control and management of the multimedia data. A digital watermarking method has been developed as a technique for embedding identifiable data into multimedia data.
Conventionally, watermark signals used for watermarking audio signal have been relatively simple signals such as a sequence of code symbols because, unlike inserting a watermark into image or video, inserting a large watermark signal would affect the perceptibility of an original audio. Moreover, the prior art watermarking techniques are susceptible to unauthorized removal of
watermarks, thereby making hard to trace the origin of a copyright protected material .
DISCLOSURE OF THE INVENTION
It is, therefore, a primary object of the present invention to imbed relatively large color image data in audio signal data without losing the quality of the audio signal when it is played back. The watermarking embedding method thus provides very high correlation between an original audio signal and its watermarked version. This object is achieved in part by reshaping audio data structure in a matrix to correspond to an image file to be inserted and performing frequency domain transformations.
In accordance with one aspect of the present invention, there is provided a method for inserting color image watermark data into audio data which comprises steps of: converting said color image watermark data from a first mode to a second mode; reshaping said audio data into a matrix to correspond to that of said color image watermark data in converted in said second mode; wavelet transforming said reshaped audio data in a frequency domain to generate first spectral coefficients; discrete cosine transforming said color image data of said second mode in a frequency domain to generate second spectral coefficients; combining said first and second spectral coefficients; and transforming said combined coefficients to generate color image embedded audio data . In accordance with another aspect of the present invention, there is provided a digital watermarking apparatus for inserting color image watermark data into audio data which comprises: a means for converting said color image watermark data from a first mode to a second mode; a means for reshaping said audio data into a matrix to
correspond to that of said color image watermark data in converted in said second mode; a means for wavelet transforming said reshaped audio data in a frequency domain to generate first coefficients; a means for discrete cosine transforming said color image data of said second mode in a frequency domain to generate second coefficients; a means for combining said first and second coefficients; and a means for transforming said combined coefficients to generate color image embedded audio data.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other objects and features of the present invention will become apparent from the following description of preferred embodiments given in conjunction with the accompanying drawings, in which:
Fig. 1 is a block diagram for inserting a watermark signal into audio signal data according to the present invention;
Fig. 2 illustrates a Fast Wavelet Transform (FWT);
Fig. 3 illustrates an inverse Fast Wavelet Transform (IFWT) ;
Fig. 4 shows a color image watermark used in an experiment;
Fig. 5 shows the spectrum of an original digital audio data;
Fig. 6 shows the spectrum of a watermark embedded digital audio data according to the present invention; Fig. 7 shows the color image watermark after it is extracted from the watermark embedded digital audio data; and
Fig. 8 illustrates a distribution mechanism for watermarked audio data according to the present invention.
MODE____OF CARRYING OUT THE INVENTION
Referring to Fig. 1, the present invention will be described in detail hereinafter. A matrix structure reshaping unit 10 is configured to reshape original audio data in a matrix format identical to that of a color image as a watermark to be inserted later on. The original audio data in a stream is broken into sections such that the size of each section becomes identical to that of an image file. The image file can be inserted into every section of the audio data although intermittent insertion is preferred. Meanwhile, a color image format converter 30 converts an original color watermark image file of a format such as BMP (bitmap) or JPEG (joint photographic coding expert group) format to a YIQ format, where Y represents luminescence and I and Q represent in-phase and quadrature components, respectively. The conversion makes possible a fast processing of a large color image in a later stage. In the present invention, only the Y component will be used. After this conversion, the scale, size, color information and bit structure of the converted image file are extracted by a color image information extracting unit 50 and provided to the matrix structure reshaping unit 10, which uses this information to reshape the original audio data as mentioned above.
The reshaped audio data and the YIQ converted image data are transformed in the frequency domain by a wavelet transform unit 20 and a discrete cosine transform unit 40, respectively. A Fourier transform has been used to convert a watermark in the frequency domain to conceal the content of the watermark. In case that an impulse type watermark is transformed, its spectral coefficients spread all across the spectrum, making it hard to remove it once it is inserted into a target data. However, coefficients of the Fourier transform are complex numbers so that they can not be easily
added to the target data. Therefore, a discrete cosine transformation (DCT) is preferred in the DCT unit 40 because, though similar to of the Fourier transform, particularly a fast Fourier transform, it results only in real coefficients in the transformed domain. Conventionally, a DCT has been used to encode signals. For example, it is used for compression of data in JPEG standard. Basically, it is defined as follows :
where s is the original value of N and t is the converted value of N. The coefficients c are further defined as follows :
c(0) = Vl/N,c( ) = V2/N for 1< k < Ν-l Eq. (2)
Using the two definitions above, a two-dimensional DCT is given by the following:
where N, s, t represent the same parameters as those in one- dimensional DCT and c (i ,j ) is defined as follows:
c(0, ) = l/n,c(i,0) = l/N,c(i,j) = 2/N for z≠O ≠O Eq. (4)
There is an inverse DCT, which is defined in one-dimension and two-dimension as follows, respectively.
;'=0 =0 J IN
To transform the reshaped audio data, a wavelet transformation is used in the wavelet transform unit 20. The Wavelet transform uses wavelets as its basic functions just as the Fourier transform uses sine and cosine functions as its basic functions. The Wavelet transform falls in two categories. One of them is continuous wavelet transform, which is defined similarly to the Fourier transform as follows:
W( ,τ) = [f(t)φ(s,t)dt Eq. (7)
where s is a scaling factor and τ is a transform coefficient. A compressed wavelet has a low scale and expresses high frequency components while enlarged wavelet expresses low frequency components at a high scale. Thus the scale and the frequency are inversely proportional . The number of the coefficients generated by continuous wavelet transform is infinity because they are a function of scaling and position displacement. Thus a discrete wavelet transform depending on a subset of scaling and position displacement is used. More effective algorithm is possible by determining scaling and • position displacement depending on dyadic. Nevertheless, still it requires a large volume of computations. In order to make up this drawback, a fast wavelet transform is suggested. This transform employs a conventional two-channel subband coding and a pyramid algorithm, and can be applied relatively simply with a so- called perfectly reconstructive quadrature mirror filter, an interconnection among filter banks for inverse transform. Fig. 2 and Fig. 3 represent a known fast wavelet transform and a known inverse fast wavelet transform, respectively.
After the transformations as described above, the
thus-generated coefficients of the transformed audio data and image are each modulated at a matrix coefficient modulator 60, for instance, by multiplying a scaling factor, in order to minimize the distortion of the original audio as the result of the watermark insertion. After the adjustment, the two sets of coefficients are added together. Next, the combined coefficients are rearranged at the inverse matrix structure reshaping unit 70 so that their structure is identical to that of the original audio data. Finally, the rearranged coefficients are inverse wavelet transformed at a inverse wavelet transform unit 80 to generate a color image embedded audio signal data.
Fig. 4 represents the spectrum of the original audio signal and Fig. 5 shows a color image that is to be inserted in the audio signal in an experiment. Fig.6 represents the spectrum of the audio signal with the color image embedded according to the present invention. As can be easily seen from the figures, the two spectrums are almost identical to each other with the implication that the original audio signal was not negatively affected. The correlation between the two signals was obtained with the following formula widely used in the art:
Experiments showed 98.5% correlation, which is well above the minimum correlation of 95% because the present invention can reduce distortion of the original audio signal even when a relatively large image file is inserted. Furthermore, the extracted watermark has over 75% correlation with the original watermark image. Fig. 7 shows the watermark of Fig. 5 after it was extracted from the watermark embedded signal. The extracted watermark is easily identifiable as that of the original watermark.
Fig. 8 illustrates one of environments in which the present invention is taken advantage of. The watermarked audio data, generated from a watermarking unit 100, as described above referring to Fig. 1, may be stored in a database 200 for on-line distribution/downloading to remote computers 600 by way of an on-demand server 400. For this, such an on-demand server is preferably connected a communication network formed by a high-speed communication network, for example, such as a B-ISDN or an ATM-LAN. To be concrete, the communication network is an open network represented by the internet 500, or a network using a private circuit of personal computer communication or the like. Thus access to the server, providing watermarked audio data stored in the database, by remote computers or terminals is possible. The watermark itself can be stored in another database 300 for downloading to authorized persons in order to verify the extracted watermark is genuine .
The present invention may be further used in the field of digital image verification and protection, including verifying and protecting the integrity of digital images stored in memory for authentication and security purposes, that has recently gained importance and wide recognition.
It involves determining whether a digital audio/image had been modified. In this technique, an information/watermark is "stamped" in an original audio/multi-media data. This stamping technique is unlikely to cause audio/visual artifacts in the original data.
While there has been described and illustrated methods and systems for inserting a color image watermark data by discrete cosine transforming the watermark signal and wavelet transforming an original audio data, it will be apparent to those skilled in the art that variations and modifications are possible without deviating from the broad principles and teachings of the present invention which
should be limited solely by the scope of the claims appended hereto.
Claims
1. A method for inserting color image watermark data into audio data, comprising steps of:
(a) converting said color image watermark data from a first mode to a second mode;
(b) reshaping said audio data into a matrix to correspond to that of said color image watermark data in converted in said second mode;
(c) wavelet transforming said reshaped audio data in a frequency domain to generate first spectral coefficients;
(d) discrete cosine transforming said color image data of said second mode in a frequency domain to generate second spectral coefficients;
(e) combining said first and second spectral coefficients; and
(f) transforming said combined coefficients to generate color image embedded audio data.
2. The method of claim 1, further comprising steps of:
(g) obtaining information about said color image watermark data; and (h) using said information in said step (b) .
3. The method of claim 2, wherein said information includes one or more of the image size, the number of colors in each pixel and bit array structure.
4. The method of claim 1, wherein said step (f) includes steps of: (fl) inverse reshaping said combined coefficients into an original data structure of said audio data; and
(f2) inverse wavelet transforming said reshaped combined coefficients to generate a watermark embedded audio data .
5. The method of claim 1, wherein said first mode is RGB mode and said second mode is YIQ mode, where R, G and B represent red, green and blue components of a pixel, respectively, and Y, I and Q represent luminescence, in- phase and quadrature components of a pixel, respectively.
6. A digital watermarking apparatus for inserting color image watermark data into audio data, comprising: a means for converting said color image watermark data from a first mode to a second mode; a means for reshaping said audio data into a matrix to correspond to that of said color image watermark data in converted in said second mode; a means for wavelet transforming said reshaped audio data in a frequency domain to generate first coefficients; a means for discrete cosine transforming said color image data of said second mode in a frequency domain to generate second coefficients; a means for combining said first and second coefficients; and a means for transforming said combined coefficients to generate color image embedded audio data.
7. The digital watermarking apparatus of claim 6, further comprising : a means for obtaining information about said color image watermark data; and a means for using said information in said means for reshaping .
8. The digital watermarking apparatus of claim 7, wherein said information includes one or more of the image size, the number of colors in each pixel and bit array structure.
9. The digital watermarking apparatus of claim 6, wherein said transforming means further includes: a means for inverse reshaping said combined coefficients into an original data structure of said audio data; and a means for inverse wavelet transforming said reshaped combined coefficients to generate watermark embedded audio data .
10. The digital watermarking apparatus of claim 6, wherein said first mode is RGB mode and said second mode is YIQ mode, where R, G and B represent red, green and blue components of a pixel, respectively, and Y, I and Q represent luminescence, in-phase and quadrature components of a pixel, respectively.
11. The digital watermarking apparatus of claim 6, further comprising a storage means for storing said watermark embedded audio data and said color image watermark.
12. The digital watermarking apparatus of claim 11, further comprising a server connected to a communication network for communicating said watermark embedded audio data stored in said storage means to remote terminals coupled to said communication network.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2000255739A AU2000255739A1 (en) | 2000-05-16 | 2000-06-19 | Digital watermarking method and apparatus using a color image as a watermark |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR2000/25952 | 2000-05-16 | ||
KR10-2000-0025952A KR100369306B1 (en) | 2000-05-16 | 2000-05-16 | Digital audio watermarking method and apparatus using a color image as a watermark |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2001088883A1 true WO2001088883A1 (en) | 2001-11-22 |
Family
ID=19668680
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2000/000645 WO2001088883A1 (en) | 2000-05-16 | 2000-06-19 | Digital watermarking method and apparatus using a color image as a watermark |
Country Status (3)
Country | Link |
---|---|
KR (1) | KR100369306B1 (en) |
AU (1) | AU2000255739A1 (en) |
WO (1) | WO2001088883A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7389420B2 (en) | 2000-11-08 | 2008-06-17 | Digimarc Corporation | Content authentication and recovery using digital watermarks |
US7991184B2 (en) | 1995-05-08 | 2011-08-02 | Digimarc Corporation | Apparatus to process images and video |
CN102456217A (en) * | 2012-01-06 | 2012-05-16 | 北京工业大学 | Digital watermarking method capable of resisting cropping attack |
US9117268B2 (en) | 2008-12-17 | 2015-08-25 | Digimarc Corporation | Out of phase digital watermarking in two chrominance directions |
US9179033B2 (en) | 2000-04-19 | 2015-11-03 | Digimarc Corporation | Digital watermarking in data representing color channels |
US9245308B2 (en) | 2008-12-17 | 2016-01-26 | Digimarc Corporation | Encoding in two chrominance directions |
WO2022048330A1 (en) * | 2020-09-01 | 2022-03-10 | 腾讯科技(深圳)有限公司 | Video watermark adding method and apparatus, video watermark extraction method and apparatus, device, and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0766468A2 (en) * | 1995-09-28 | 1997-04-02 | Nec Corporation | Method and system for inserting a spread spectrum watermark into multimedia data |
WO1999063443A1 (en) * | 1998-06-01 | 1999-12-09 | Datamark Technologies Pte Ltd. | Methods for embedding image, audio and video watermarks in digital data |
-
2000
- 2000-05-16 KR KR10-2000-0025952A patent/KR100369306B1/en not_active IP Right Cessation
- 2000-06-19 AU AU2000255739A patent/AU2000255739A1/en not_active Abandoned
- 2000-06-19 WO PCT/KR2000/000645 patent/WO2001088883A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0766468A2 (en) * | 1995-09-28 | 1997-04-02 | Nec Corporation | Method and system for inserting a spread spectrum watermark into multimedia data |
US5930369A (en) * | 1995-09-28 | 1999-07-27 | Nec Research Institute, Inc. | Secure spread spectrum watermarking for multimedia data |
WO1999063443A1 (en) * | 1998-06-01 | 1999-12-09 | Datamark Technologies Pte Ltd. | Methods for embedding image, audio and video watermarks in digital data |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7991184B2 (en) | 1995-05-08 | 2011-08-02 | Digimarc Corporation | Apparatus to process images and video |
US9179033B2 (en) | 2000-04-19 | 2015-11-03 | Digimarc Corporation | Digital watermarking in data representing color channels |
US9940685B2 (en) | 2000-04-19 | 2018-04-10 | Digimarc Corporation | Digital watermarking in data representing color channels |
US7389420B2 (en) | 2000-11-08 | 2008-06-17 | Digimarc Corporation | Content authentication and recovery using digital watermarks |
US8032758B2 (en) | 2000-11-08 | 2011-10-04 | Digimarc Corporation | Content authentication and recovery using digital watermarks |
US9117268B2 (en) | 2008-12-17 | 2015-08-25 | Digimarc Corporation | Out of phase digital watermarking in two chrominance directions |
US9245308B2 (en) | 2008-12-17 | 2016-01-26 | Digimarc Corporation | Encoding in two chrominance directions |
US9582844B2 (en) | 2008-12-17 | 2017-02-28 | Digimarc Corporation | Detection from two chrominance directions |
CN102456217A (en) * | 2012-01-06 | 2012-05-16 | 北京工业大学 | Digital watermarking method capable of resisting cropping attack |
WO2022048330A1 (en) * | 2020-09-01 | 2022-03-10 | 腾讯科技(深圳)有限公司 | Video watermark adding method and apparatus, video watermark extraction method and apparatus, device, and storage medium |
Also Published As
Publication number | Publication date |
---|---|
AU2000255739A1 (en) | 2001-11-26 |
KR100369306B1 (en) | 2003-02-26 |
KR20010104817A (en) | 2001-11-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Cox et al. | A secure, robust watermark for multimedia | |
Wolfgang et al. | A watermarking technique for digital imagery: further studies | |
De Vleeschouwer et al. | Invisibility and application functionalities in perceptual watermarking an overview | |
AU701639B2 (en) | Secure spread spectrum watermarking for multimedia data | |
US8050446B2 (en) | Method and system for digital watermarking of multimedia signals | |
Lin et al. | Semifragile watermarking for authenticating JPEG visual content | |
Barni et al. | Watermarking systems engineering: enabling digital assets security and other applications | |
US8037311B2 (en) | Digital watermark systems and methods | |
JP4767927B2 (en) | How to make digital signal protection easier | |
Paquet et al. | Wavelet-based digital watermarking for image authentication | |
US6975733B1 (en) | Watermarking of digital images using wavelet and discrete cosine transforms | |
Chandramouli et al. | Digital watermarking | |
Luo et al. | Fast and robust watermarking of JPEG files | |
KR20010079788A (en) | Watermarking of digital images using wavelet and discrete cosine transforms | |
WO2001088883A1 (en) | Digital watermarking method and apparatus using a color image as a watermark | |
Cacciaguerra et al. | Data hiding: steganography and copyright marking | |
KR100449303B1 (en) | Apparatus and method for inserting watermark using client system | |
Negrat et al. | Variable length encoding in multiple frequency domain steganography | |
Joshi et al. | Efficient dual domain watermarking scheme for secure images | |
Lee et al. | Reversible data embedding for tamper-proof watermarks | |
Helmy et al. | Authentication scheme based on principal component analysis for satellite images | |
Kazakevičiūtė et al. | Tamper‐Proof Image Watermarking, Based on Existing Public Key Infrastructure | |
ZEEBAREE et al. | COPYRIGHT PROTECTION SYSTEM BASED WATERMARKING | |
Rao et al. | Implementation of object oriented approach for copyright protection using Hadamard transforms | |
Basha et al. | VISIBLE VIDEO WATERMARKING USING ADAPTIVE TRANSFORMATION TECHNIQUE |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AL AM AU AZ BA BB BG BR BY CA CN CR CU CZ DM EE GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LV MA MD MG MK MN MW MX NO NZ PL RO RU SD SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: JP |