CN100563615C - System for guiding blind in exhibition - Google Patents

System for guiding blind in exhibition Download PDF

Info

Publication number
CN100563615C
CN100563615C CNB2007100396297A CN200710039629A CN100563615C CN 100563615 C CN100563615 C CN 100563615C CN B2007100396297 A CNB2007100396297 A CN B2007100396297A CN 200710039629 A CN200710039629 A CN 200710039629A CN 100563615 C CN100563615 C CN 100563615C
Authority
CN
China
Prior art keywords
blind person
blind
information
server
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2007100396297A
Other languages
Chinese (zh)
Other versions
CN101073531A (en
Inventor
童善保
谢青
朱湘君
闫静
杜嘉
朱贻盛
邱意弘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaotong University
Original Assignee
Shanghai Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiaotong University filed Critical Shanghai Jiaotong University
Priority to CNB2007100396297A priority Critical patent/CN100563615C/en
Publication of CN101073531A publication Critical patent/CN101073531A/en
Application granted granted Critical
Publication of CN100563615C publication Critical patent/CN100563615C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

A kind of system for guiding blind in exhibition comprises: server, client, camera monitoring system and localizer; Localizer is fixed on the blind person crown, client is carried by the blind person, the outfan of camera monitoring system is received the input of server, server only disposes one in public places, wherein: energy wireless telecommunications between server and the client, server is used to serve a plurality of blind persons, provides guidance information and showpiece recommended information to blind person's user; Localizer is used for the helping service device and obtains blind person's current location; Camera monitoring system is used for the helping service device and obtains museum's image everywhere; Client is used to receive the guidance information from server, and guidance information is informed the blind person.The present invention can be under the condition that does not change the place outward appearance, can in time guide the blind person to walk Visitor Route according to the position of blind person in museum, the barrier that in blind person's prompting is advanced, runs into, the prompting blind person is the position of each object on every side, transmits the recommended information of showpiece to the blind person.

Description

System for guiding blind in exhibition
Technical field
The present invention relates to a kind of aid system of communal facility technical field, specifically a kind of in the exhibition center, library, the guiding blind person visits the system for guiding blind in exhibition of showpiece in the communal facilitys such as museum.
Background technology
Along with improving constantly of blind person colony knowledge structure, blind person's range of activity no longer is confined to family or the working space of oneself being familiar with, blind persons can utilize existing communal facility, enlarge one's knowledge as library, museum, community center etc., enrich the life of oneself.Simultaneously, the accessibility of public place also is the sign of modern society's civilization degree, and modern public place begins to be equipped with books printed in braille reading function and phonetic accessing internet function as library, community center, also can provide certain service to the blind person.Because thing can not be looked by blind person colony, the guidance system of public place not only will provide the recommended information of venue showpiece, the information that will in time provide the blind person to need most also according to the position of residing place of blind person and the showpiece that he will go, also be necessary for the blind person simultaneously and plan course, the barrier that may run on the hint way is as metope etc.As in the museum, must be according to the residing position of blind person, in conjunction with the position that the location guide blind person of showpiece around the blind person walks certain showpiece that need visit to the blind person, introduce showpiece to the blind person then, for the blind person provides effective service.In brief, must there be the guiding blind person to use " the operable facility of blind person " in the museum (art work that can touch with traffic signal, blind person with computer, blind person as books printed in braille, blind person or the like).
For the public place, a system for guiding blind should be served a plurality of blind persons simultaneously, and the required venue that is independent of of guidance system, uses guidance system needn't change the outward appearance in place or the display mode of change place showpiece.
Blind man navigation problem at the public place, the typical thinking that solves has three kinds: the one, wait for passively that by sidewalk for visually impaired people and braille/fixation means such as sound direction board the blind person uses, the 2nd, employ the more work personnel and initiatively guide the blind person, three are to use portable electronic installation to help blind person's epistemic context.Use the system of sidewalk for visually impaired people and braille/sound direction board all to do certain transformation, though the outward appearance and the showpiece that often will change the place that be easy to implement arranged to each position in place.Though and the staff initiatively guides the blind person to visit to do the introduction that shoots the arrow at the target according to blind person's visit process, and is very big for staff's working strength.And use portable electron device needn't change existing place again to be provided with according to the physical location and needs the guidance information that blind person's needs in time are provided of blind person in the place, compare preceding two kinds of solutions and have remarkable advantages.
Through the retrieval of prior art is found, Chinese patent application numbers 200410066207.5, publication number CN1588480A, patent name: based on the system of single-chip microcomputer assisting blind crossing traffice cross.This technology has adopted the mentality of designing of main frame one slave, can assist any a plurality of blind crossing traffice cross simultaneously.But the main difficulty of prior art is, can only pass near the state (as the traffic lights signal) of the object of blind person, the position that can not accurately point out the blind person to arrive object (traffic lights at crossing or zebra crossing) more can't be according to blind person's location guide blind person action.In blind person's guiding task of indoor museum, visit (prompting course and barrier) and the information of relevant showpiece is provided according to the position guiding in real time blind person of blind person in museum, rely on prior art insurmountable.So far do not appear in the newspapers the system that does not change the public place outward appearance and can visit showpiece according to blind person's position guiding in real time blind person is arranged.
Summary of the invention
The present invention is directed to the deficiencies in the prior art and defective, provide a kind of and do not changing the public place outward appearance, can visit the system for guiding blind in exhibition of showpiece according to blind person's location guide blind person.Make it guide the blind person to walk correct route according to the position of blind person in museum, the barrier that prompting runs in advancing, the prompting blind person is the position of each object (comprising showpiece and metope) on every side, transmits the recommended information of showpiece to the blind person.The present invention can guide the blind person to use the operable communal facility of blind person (art work that can touch with traffic signal, blind person with computer, blind person as books printed in braille, blind person or the like).
The present invention is achieved by the following technical solutions, the present invention includes: server, client, camera monitoring system and localizer.Each blind person need dispose a client and a localizer during use, and localizer is fixed on the blind person crown, and client is carried by the blind person, and the outfan of camera monitoring system is received the input of server, and server only disposes one in public places.Needn't there be physics to be electrically connected between server, client and the localizer, but must wireless telecommunications between server and the client.Described server is used to serve a plurality of blind persons, provides guidance information and showpiece recommended information to blind person's user; Described localizer is used for the helping service device and obtains blind person's current location; Described camera monitoring system is used for the helping service device and obtains museum's image everywhere; Described client is used to receive the guidance information from server, and guidance information is informed the blind person.
Described camera monitoring system obtains in the museum image everywhere.When localizer appears at the monitoring range of camera monitoring system, contain the localizer imaging in the image that camera monitoring system obtains, the image that camera monitoring system obtains is sent to server and does further processing.
Described server comprises four parts: positioning unit, object information data base, computing unit and wireless transmission unit.Positioning unit is accepted the image from camera monitoring system, the outfan of positioning unit is connected to the input of computing unit, the object information data base accepts the inquiry from computing unit, object information data base outfan is connected to the input of computing unit, and the outfan of computing unit is connected to the unitary input of wireless transmission.Wherein: the localizer that positioning unit carries by blind person in the detected image is known blind person's latest position information in real time, comprises the direction that position during the blind person in public places and blind person face; The object information data base is responsible for providing each object in the communal facility, comprises the three dimensional local information of each showpiece and each metope, and the information in the object information data base is to import according to the practical situation in place in advance; The object information data base also is responsible for the recommended information of each showpiece of storage; Computing unit be responsible for according to blind person's positional information with from the object information data base, obtain being positioned at the blind person near the three dimensional local information of each object calculate the relative blind person of each object positional information, be the exhibit information of guidance information such as the routing information of blind person's target showpiece planning and blind person's environs; The wireless transmission unit is responsible for sending the relative blind person's of each object positional information to blind person.
Described client comprises three parts: radio receiving unit, user input unit and sensation substituting unit.Wireless receiving module is accepted from the unitary pilot signal of server wireless transmission by wireless signal, and the outfan of wireless signal is connected to the input of sensation substituting unit; The outfan of user input unit is connected to the input of sensation substituting unit; Pass to blind person's acoustic information by the sensation substituting unit.Radio receiving unit is responsible for accepting the guidance information from server, comprises the relative blind person's of each object positional information; User input unit is responsible for accepting from the state of user requirement; The sensation substituting unit is responsible for according to the state of user requirement, generates virtual sound source and the corresponding to stereo sound signal of positional information that each object comprises, and makes the blind person can intuitively recognize the meaning of object on every side and knows the position of object.
Among the present invention, the user can propose the state requirement by user input unit, the command system signal of sounding in a particular manner.Under " environment is browsed " state, system is various objects near the blind person provides the blind person, comprise the stereo sound of showpiece and metope, make the blind person can recognize each object in the surrounding as early as possible.Under " walking along the street guiding " state, the blind person that is input as that system at first accepts the blind person plans a path that arrives the target showpiece, provides sound according to the path for blind person's planning, guides the blind person to arrive the position of target showpiece along the path.When the blind person apart from barrier, during less than preset threshold in advance, point out the existence of barrier as the wall of museum to the blind person.System passes to the blind person with the recommended information of the showpiece of blind person's dead ahead under " showpiece introduction " state.
The present invention can be under the condition that does not change the place outward appearance, can be according to the position of blind person in museum, in time the guiding blind person walks Visitor Route, the barrier that in blind person's prompting is advanced, runs into, the prompting blind person is the position of each object (comprising showpiece and metope) on every side, transmits the recommended information of showpiece to the blind person.
Compared with prior art, the present invention guides blind person's characteristics to be: (1) makes full use of the monitoring camera-shooting network that modern museum generally adopts, only need configuration one station server in the place, dispose a localizer on one's body and a client can realize guiding, need not to change the outward appearance in place the blind person.(2) can provide in real time according to blind person's position around the blind person, particularly the blind person just towards the zone in object information, comprise the information of each showpiece and the information of each metope, the blind person is in the friendly environment of each object oneself's prompting at any time.(3) focus on blind person's positional information and the object space information in the place in the main frame, make things convenient for the software of elevator system, realize functions such as explanation in real time, path planning prompting easily.(4) can serve a plurality of blind persons simultaneously, reduce the wasting of resources.
Description of drawings
Fig. 1 is the block diagram of the relation between each module of the present invention.
The sketch map of the specific dot pattern on the localizer of Fig. 2 position embodiment of the invention.
The specific embodiment
Below in conjunction with accompanying drawing embodiments of the invention are elaborated: present embodiment has provided detailed embodiment and process being to implement under the prerequisite with the technical solution of the present invention, but protection scope of the present invention is not limited to following embodiment.
As shown in Figure 1, present embodiment comprises four parts: localizer 1, monitoring camera-shooting network 2, server and client side.Server comprises positioning unit 3, object information data base 4, computing unit 5 and wireless transmission unit 6.Client comprises radio receiving unit 7, user input unit 8 and sensation substituting unit 9.In the present embodiment, the localizer 1 that is positioned at blind person's head has dot pattern as shown in Figure 2, this dot pattern (X-axis as shown in the figure and Y-axis) on orthogonal two axis has the different point of quantity, two axis that make dot pattern have to be identified, and axis can be distinguished.When an axle (as Y-axis) that therefore preestablishes dot pattern overlaps with blind person's dead ahead, the camera monitoring system that dot pattern can be capped on museum photographs and detects the direction of dot pattern Y-axis by the image processing algorithm of positioning unit 3, thus the blind person in museum the position and the direction (can think the direction that the blind person is advancing) faced of blind person as can be known.Because photographic head has all passed through demarcation in advance, when detecting the localizer of blind person's head, the positioning unit 3 of server can be brought in constant renewal in blind person's position in museum and the direction that the blind person advances.
Object information in the object information data base 4 comprises that the positional information of metope in the positional information of each showpiece and the museum is to obtain by the method that existing map generates.The map generating algorithm is known technology in the robot navigation field.Utilize imageing sensor, sonac or laser range finder can both obtain pick off range image on every side, after obtaining the range image of each position in the place, can obtain the map in place by existing map generating algorithm (occupying algorithm) as occupy grid grid.By inquiry museum map, can know the position of barrier in the place, metope, provide foundation for the space structure of informing blind person's environment and for blind person's guide passage.Because the position of public resources such as showpiece in places such as library, museum almost is constant, so the position of showpiece can be input in the two-dimensional map in place the foundation as the guiding blind person in advance.Also store the recommended information of each showpiece among the object information data base.
Computing unit 5 is handled the three dimensional local information of the relative blind person of object around the blind person present position.Positional information by each metope, barrier and showpiece current position of the blind person who relatively obtains from positioning unit 3 and the map extracts the positional information apart from the metope in blind person's certain limit, barrier and the relative blind person of showpiece.Museum's map in the binding object information database, computing unit utilize path planning algorithm to generate the path that a guiding blind person visits.
The guidance information that wireless transmission unit 6 obtains computing unit 5 (comprising the positional information apart from the metope in blind person's certain limit, barrier and the relative blind person of showpiece, the recommended information of showpiece and routing information) is delivered to the radio receiving unit 7 on corresponding blind person's client.
The guidance information that the radio receiving unit 7 of client transmits from server wireless transmission unit 6.
User input unit 8 is accepted the state requirement of user input by button.Client can have some kinds of states, and every kind of state is corresponding with certain sound generating mode.Under the state of " environment is browsed ", the blind person can require near system's various objects he provides the blind person, comprises the stereo sound of showpiece and metope, makes the blind person can recognize each object in the surrounding as early as possible.Under " showpiece introduction " state, the blind person can require system that the recommended information of the showpiece of blind person's dead ahead is passed to the blind person.Under " walking along the street guiding " state, system provides stereo sound according to the visit path for blind person's planning, guide the blind person to arrive the position of target showpiece along the path, when the blind person apart from barrier, as the wall of museum during less than preset threshold in advance, the existence of barrier is pointed out according to the relative blind person's of wall position by system to the blind person.
Sensation substituting unit 9 be responsible for in the guidance information about the object information of (comprising each showpiece and each metope), the state requirement according to user input unit provides is converted to the corresponding virtual stereophonic signal one by one.The virtual source position of the virtual three-dimensional acoustical signal of an object overlaps with the position of object, makes the corresponding virtual solid sound to be that the position from object is sent.According to the state requirement that obtains from user input unit 8, with corresponding sound generating mode the virtual three-dimensional acoustical signal of each object by certain time shift after the sound of representing environment that obtains of stack.The blind person can experience the position of each object in blind person's surrounding intuitively like this.
The foregoing description as can be seen, can in time know the position (under " environment browse state ") of showpiece on every side by blind person of the present invention, can access the prompting (under " walking along the street guiding " state) of course and obstacle in the museum, can " visit " showpiece in the museum, obtain the introduction (under " showpiece introduction " state) of showpiece, under the system that is in from start to finish of visiting museum auxiliary; And the monitoring camera-shooting network that the present invention has utilized modern museum generally to adopt only needs configuration one station server in the place, disposes a localizer on one's body and a client can realize guiding the blind person, need not to change the outward appearance in place; Can serve a plurality of blind persons simultaneously, reduce the wasting of resources.

Claims (7)

1. a system for guiding blind in exhibition is characterized in that: comprising: server, client, camera monitoring system and localizer; Described localizer is fixed on the blind person crown, described client is carried by the blind person, the outfan of described camera monitoring system is received the input of server, described server only disposes one in public places, wherein: energy wireless telecommunications between server and the client, described server is used to serve a plurality of blind persons, provides guidance information and showpiece recommended information to blind person's user; Described localizer is used for the helping service device and obtains blind person's current location; Described camera monitoring system is used for the helping service device and obtains museum's image everywhere; Described client is used to receive the guidance information from server, and guidance information is informed the blind person;
The sensation substituting unit is responsible for the information with relevant object in the guidance information, and the state requirement according to user input unit provides is converted to the corresponding virtual stereophonic signal one by one; The virtual source position of the virtual three-dimensional acoustical signal of an object overlaps with the position of object, make the corresponding virtual stereophonic signal sound to be position to be sent from object, according to the state requirement that obtains from user input unit, with the sound generating mode of correspondence the virtual three-dimensional acoustical signal of each object by time shift after the sound of representing environment that obtains of stack, the blind person can experience the position of each object in blind person's surrounding intuitively like this.
2. system for guiding blind in exhibition as claimed in claim 1 is characterized in that, described server comprises: positioning unit, object information data base, computing unit and wireless transmission unit; Positioning unit is accepted the image from camera monitoring system, the outfan of positioning unit is connected to the input of computing unit, the object information data base accepts the inquiry from computing unit, object information data base outfan is connected to the input of computing unit, the outfan of computing unit is connected to the unitary input of wireless transmission, wherein: the localizer that positioning unit carries by blind person in the detected image is known blind person's latest position information in real time, comprises the direction that position during the blind person in public places and blind person face; The object information data base is responsible for providing each object in the communal facility, the three dimensional local information that comprises each showpiece and each metope, information in the object information data base is to import according to the practical situation in place in advance, and the object information data base also is responsible for the recommended information of each showpiece of storage; Computing unit be responsible for according to blind person's positional information with from the object information data base, obtain being positioned at the blind person near the three dimensional local information of each object calculate the relative blind person of each object positional information, be the routing information of blind person's target showpiece planning and the exhibit information of blind person's environs; The wireless transmission unit is responsible for sending the relative blind person's of each object positional information to blind person.
3. system for guiding blind in exhibition as claimed in claim 1 is characterized in that, described client comprises: radio receiving unit, user input unit and sensation substituting unit; Wireless receiving module is accepted from the unitary pilot signal of server wireless transmission by wireless signal, and the outfan of wireless signal is connected to the input of sensation substituting unit; The outfan of user input unit is connected to the input of sensation substituting unit; Pass to blind person's acoustic information by the sensation substituting unit, radio receiving unit is responsible for accepting the guidance information from server, comprises the relative blind person's of each object positional information; User input unit is responsible for accepting from the state of user requirement; The sensation substituting unit is responsible for according to the state of user requirement, generates virtual sound source and the corresponding to stereo sound signal of positional information that each object comprises, and makes the blind person can intuitively recognize the meaning of object on every side and knows the position of object.
4. as claim 1 or 3 described system for guiding blind in exhibition, it is characterized in that described client, under the state of " environment is browsed ", near the various objects blind person provides the blind person comprise the stereo sound of showpiece and metope, make the blind person can recognize each object in the surrounding as early as possible.
5. as claim 1 or 3 described system for guiding blind in exhibition, it is characterized in that described client under " showpiece introduction " state, passes to the blind person with the recommended information of the showpiece of blind person's dead ahead.
6. as claim 1 or 3 described system for guiding blind in exhibition, it is characterized in that, described client, under " walking along the street guiding " state, system provides stereo sound according to the visit path for blind person's planning, guides the blind person to arrive the position of target showpiece along the path.
7. system for guiding blind in exhibition as claimed in claim 1 is characterized in that, described localizer, have dot pattern, this dot pattern has the different point of quantity on orthogonal two axis, two axis that make dot pattern have to be identified, and axis can be distinguished; When an axle that preestablishes dot pattern overlaps with blind person's dead ahead, the camera monitoring system that dot pattern can be capped on museum photographs and detects the direction of dot pattern Y-axis by server, thereby knows position and the blind person direction faced of blind person in museum; Because photographic head has all passed through demarcation in advance, when detecting the localizer of blind person's head, server can be brought in constant renewal in blind person's position in museum and the direction that the blind person advances.
CNB2007100396297A 2007-04-19 2007-04-19 System for guiding blind in exhibition Expired - Fee Related CN100563615C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2007100396297A CN100563615C (en) 2007-04-19 2007-04-19 System for guiding blind in exhibition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2007100396297A CN100563615C (en) 2007-04-19 2007-04-19 System for guiding blind in exhibition

Publications (2)

Publication Number Publication Date
CN101073531A CN101073531A (en) 2007-11-21
CN100563615C true CN100563615C (en) 2009-12-02

Family

ID=38974914

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2007100396297A Expired - Fee Related CN100563615C (en) 2007-04-19 2007-04-19 System for guiding blind in exhibition

Country Status (1)

Country Link
CN (1) CN100563615C (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103916525A (en) * 2013-01-07 2014-07-09 黄继昌 Pilot system
CN103191006B (en) * 2013-03-26 2015-10-28 北京美尔斯通科技发展股份有限公司 The comprehensive positioning navigation system of a kind of indoor wireless
CN104182917A (en) * 2013-05-21 2014-12-03 上海滕维信息科技有限公司 Wireless guiding display system and use method thereof
CN105997449A (en) * 2016-05-12 2016-10-12 广东履安实业有限公司 Vision-assisting instrument for blind people
CN107328426B (en) * 2017-05-23 2019-05-07 深圳大学 A kind of indoor positioning navigation methods and systems suitable for people with visual impairment
CN109009902B (en) * 2017-06-12 2020-08-04 京东方科技集团股份有限公司 Blind guiding stick and blind guiding method
CN108095987B (en) * 2017-12-06 2020-10-16 英业达科技有限公司 Vision-impaired navigation system and method thereof
CN108320409A (en) * 2018-04-13 2018-07-24 卢雨欣 Voice lending system
CN108490948B (en) * 2018-04-19 2021-01-29 安徽省科普产品工程研究中心有限责任公司 Intelligent guide system for science and technology museum
CN112198810B (en) * 2020-11-06 2023-05-16 青岛海尔空调器有限总公司 Method and device for navigation control of intelligent household equipment and intelligent household equipment
CN114029966A (en) * 2021-09-28 2022-02-11 北京仙宇科技有限公司 Barrier-free communication action system for blind persons in area

Also Published As

Publication number Publication date
CN101073531A (en) 2007-11-21

Similar Documents

Publication Publication Date Title
CN100563615C (en) System for guiding blind in exhibition
Kuriakose et al. Tools and technologies for blind and visually impaired navigation support: a review
Fernandes et al. A review of assistive spatial orientation and navigation technologies for the visually impaired
Al-Khalifa et al. Ebsar: Indoor guidance for the visually impaired
Amemiya et al. Virtual leading blocks for the deaf-blind: A real-time way-finder by verbal-nonverbal hybrid interface and high-density RFID tag space
Legge et al. Indoor navigation by people with visual impairment using a digital sign system
CN106647745B (en) Diagnosis guiding robot autonomous navigation system and method based on Bluetooth positioning
Coughlan et al. Crosswatch: a system for providing guidance to visually impaired travelers at traffic intersection
Ahmetovic et al. Impact of expertise on interaction preferences for navigation assistance of visually impaired individuals
Angin et al. Real-time mobile-cloud computing for context-aware blind navigation
JP2004347459A (en) Guide information providing system
Kim et al. Mobile applications for assisting mobility for the visually impaired using IoT infrastructure
Paredes et al. Gathering the users’ needs in the development of assistive technology: a blind navigation system use case
KR101847764B1 (en) Information gathering system for the visually impaired
Isazade Advancement in navigation technologies and their potential for the visually impaired: a comprehensive review
CN206348660U (en) The robot autonomous navigation system of hospital guide positioned based on bluetooth
KR20130078128A (en) Stamp robot and system of exhibition
Dias et al. Future directions in indoor navigation technology for blind travelers
Watanabe et al. A proposal of landmark-conscious voice navigation
KR101695953B1 (en) Beacon speaker for guidance for blind person and method thereof
KR20160105134A (en) Method for forming and guiding mobile touch map and for providing information for the blind
Zhang et al. Navigation systems for individuals with visual impairment: A survey
JP2012221481A (en) Walking support device for vision-impaired person
KR20180075843A (en) Device for providing route guide using augmented reality and method using the same
JP3887650B2 (en) System and method for providing facility information to pedestrians

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091202

Termination date: 20120419