CN103065521B - Visual aid and intelligent marking method - Google Patents

Visual aid and intelligent marking method Download PDF

Info

Publication number
CN103065521B
CN103065521B CN201110319293.6A CN201110319293A CN103065521B CN 103065521 B CN103065521 B CN 103065521B CN 201110319293 A CN201110319293 A CN 201110319293A CN 103065521 B CN103065521 B CN 103065521B
Authority
CN
China
Prior art keywords
line
image
literal
mark
literal line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110319293.6A
Other languages
Chinese (zh)
Other versions
CN103065521A (en
Inventor
邓晓波
高铁塔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING AUMED GROUP CORP
Original Assignee
BEIJING AUMED GROUP CORP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING AUMED GROUP CORP filed Critical BEIJING AUMED GROUP CORP
Priority to CN201110319293.6A priority Critical patent/CN103065521B/en
Publication of CN103065521A publication Critical patent/CN103065521A/en
Application granted granted Critical
Publication of CN103065521B publication Critical patent/CN103065521B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention relates to a visual aid and an intelligent marking method. The visual aid comprises an image collecting device and a mark generator, wherein the image collecting device is used for collecting images containing texts, and the mark generator is used for distinguishing at least one text line in the images and generating marks which are used for marking the text lines. By using the visual aid and the intelligent marking method, position of the marks corresponding to the text lines can be arranged according to the images and the texts, and thereby person with poor vision can be helped to improve reading efficiency.

Description

Typoscope and smart tags method
Technical field
The application relates to a kind of typoscope and smart tags method.
Background technology
Cause for the crowd that eyesight is extremely low for high myopia person or other due to eye disease, the picture and text of normal size are read very difficult.
For this kind of crowd, existing a kind of typoscope, picture and text can amplify by it, and are shown on display.Because enlargement factor is comparatively large, and the limited width of display device, typoscope is difficult to the content of a certain full line in complete display picture and text, in reading, needs the continuous mobile picture and text of user, thus the content required for reading continuously.
Position continuous reading content in the reading process needing continuous mobile picture and text for the convenience of the users, existing typoscope is provided with a horizontal reference line at the middle part of its display.During reading, the row read can be placed in the top being close to reference line by user.So, when the mobile picture and text of needs, mobile operation can be made more accurate, avoid slipping a line, the situation such as serial occurs, and then improve reading efficiency.User can manually operate to move reference line position in the display in addition.
But existing typoscope exists following technological deficiency: typoscope can not identify literal line automatically, need manually to adjust the position of reference line in the display of typoscope by user, reference line just can be made to aim at the word needing reading.
Summary of the invention
For solving the above-mentioned technical matters existed in prior art, the invention provides a kind of typoscope and smart tags method, it can arrange mark over the display flexibly, thus person easy to use reads.
According to an aspect of the present invention, a kind of typoscope, comprises image collecting device and mark maker; Wherein, image collecting device is for gathering and amplifying the image comprising word; Mark maker for identifying the one or more literal lines in described image, and generates the mark for indicating described literal line.Mark maker is also by identifying that the movement of display image on the display apparatus judges whether line feed, and when judging line feed, mark is moved on to the adjacent literal line of current each literal line be labeled, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
Alternatively, maker is marked by identifying that the blank in described image identifies literal line.
Alternatively, maker is marked by identifying that the movement of the unique point in literal line identifies the movement of described display image on the display apparatus.
Alternatively, mark maker, when showing image on the display apparatus and first moving along the opposite direction of the reading direction of word in literal line, then moves along the reading direction of word in literal line, is judged as line feed.
Alternatively, typoscope also comprises input media, for from external reception line replace command, after described input media receives line replace command, this line replace command is sent to described mark maker, mark is moved on to the adjacent literal line of current each literal line be labeled by described mark maker, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
Alternatively, maker is marked by identifying that the image bar met the following conditions in described image identifies described blank: in this image bar, the ratio of the quantity and total pixel number amount with the pixel of same color is more than or equal to predetermined threshold.
Alternatively, typoscope also comprises display device, for showing image acquisition device and the mark of the described image amplified and the generation of mark maker.
According to a further aspect in the invention, a kind of smart tags method comprises the steps:
The image comprising word is also amplified with image acquisition device;
One or more literal lines in image described in the identification of mark maker, and generate the mark for indicating described literal line.Mark maker is also by identifying that the movement of described image judges whether line feed, and when judging line feed, mark is moved on to the adjacent literal line of current each literal line be labeled, or to be separated by the literal line of one or more literal line with current each literal line be labeled.。
Alternatively, in the step of the one or more literal lines in image described in mark maker identification, described mark maker identifies the literal line in described image by the blank identifying in described image.
Alternatively, maker is marked by identifying that the movement of the unique point in literal line identifies the movement of described image.
Alternatively, mark maker, when described image first moves along the opposite direction of the reading direction of word in literal line, then moves along the reading direction of word in literal line, judges line feed.
Alternatively, smart tags method also comprises with input media from external reception line replace command, after described input media receives line replace command, this line replace command is sent to described mark maker, mark is moved on to the adjacent literal line of current each literal line be labeled by described mark maker, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
Alternatively, maker is marked by identifying that the image bar met the following conditions in described image identifies described blank: in this image bar, the ratio of the quantity and total pixel number amount with the pixel of same color is more than or equal to predetermined threshold.
Alternatively, smart tags method also comprises: the described image that display device display image acquisition device also amplifies and the mark that mark maker generates.
Adopt typoscope of the present invention and smart tags method, mark can be set flexibly, follow the tracks of user current reading content, thus be user-friendly for and read and improve reading efficiency.
Accompanying drawing explanation
Below with reference to the accompanying drawings illustrate embodiments of the invention, above and other objects, features and advantages of the present invention can be understood more easily.Parts in accompanying drawing are just in order to illustrate principle of the present invention.In the accompanying drawings, same or similar technical characteristic or parts will adopt same or similar Reference numeral to represent.
Fig. 1 is the structural drawing of a kind of embodiment of typoscope of the present invention;
Fig. 2 is the process flow diagram of a kind of embodiment of smart tags method of the present invention;
Fig. 3 is mark maker in Fig. 1 process flow diagram to a kind of embodiment that the literal line in display image identifies.
Wherein,
1---image collecting device;
2---display device;
3---mark maker.
Embodiment
With reference to the accompanying drawings embodiments of the invention are described.The element described in an accompanying drawing of the present invention or a kind of embodiment and feature can combine with the element shown in other accompanying drawing one or more or embodiment and feature.It should be noted that for purposes of clarity, accompanying drawing and eliminate expression and the description of unrelated to the invention, parts known to persons of ordinary skill in the art and process in illustrating.
Shown in Figure 1 is the structural drawing of a kind of embodiment of typoscope of the present invention.This typoscope comprises image collecting device 1 and mark maker 3.Wherein, image collecting device 1 is for gathering and amplifying the image comprising word.Image collecting device 1 can adopt optical amplifier (such as adopting optical lens) and/or circuit to amplify the mode of (as adopted printed circuit board etc.), amplifies the gathered image comprising word.
Mark maker 3 for the one or more literal lines in recognition image, and generates the mark for indicating described literal line.When user moves picture and text (such as, book made of paper) needing to amplify display, mark still can be followed indicated literal line and be moved together, thus accurately can locate one or several current read literal line.The quantity of the literal line indicated can pre-set or can be arranged according to the hobby of oneself by user.
Owing to there is certain line space between adjacent two style of writing words, in the scope of this line space, without any displaying contents, in an example, mark maker 3 and can identify literal line by the blank represented in recognition image between two adjacent lines within the scope of line space.
In an example, mark maker 3 can be presented at the centre position of display device 2 or one or more literal lines of reference position in recognition image, and generates one or more mark for indicating one or more literal line described.In this example, labeling indicia, at one or more literal lines of centre position or reference position, in other instances, also can be indicated in the literal line of other position.
Mark maker 3 also judges whether line feed by the movement of recognition image, and when judging line feed, mark is moved on to the adjacent literal line of current each literal line be labeled, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
In an example, typoscope can comprise display device 2, is shown in display device 2, is also shown to together in display device 2 by the mark that mark maker 3 generates meanwhile image collecting device 1 to be gathered also enlarged image.
In an example, typoscope also can not comprise display device.When typoscope does not comprise display device, the equipment (as televisor, computer monitor etc.) that typoscope and other can be can be used in show is connected, and gathers and the mark of enlarged image and the generation of mark maker 3 with the image collecting device 1 that this equipment shows in typoscope.
In an example, maker 3 is marked by identifying that the movement of the unique point in word identifies the change of described image.Such as, extract multiple pixels in a literal line as unique point, record the position coordinates of each unique point and the feature of such as color, when image moves, each unique point also moves thereupon.Unique point can selected text capable in multiple continuous print pixel, also can selected text capable in multiple discrete pixel.In an example, when judging that the opposite direction of image along the reading direction of word in literal line moves, think user still at reading current line, mark maker 3 still marks current marked literal line.Such as, when literal line be horizontally-arranged and reading direction be from left to right time, when judging that image is moved to the left, mark maker 3 still current marked literal line is marked.
When image first moves along the opposite direction of the reading direction of word in literal line, then along when the reading direction of word moves in literal line, think that user completes the capable reading of current character, then read adjacent literal line.This tense marker maker 3 can regenerate new mark, to reach the object of following the tracks of user's reading content in adjacent literal line (or current each literal line be labeled be separated by the literal line of one or more literal line).
Because typoscope enlargement factor is larger, when the word in image is horizontal typesetting, generally cannot the content of complete display one full line, when user is when reading the latter half of a line, need text carrier to be moved to the left, so that the latter half content of a line is shown to display device 2 or external being used in the equipment shown.When the latter half that user completes current line is read then carries out the reading of next line, need text carrier to move right, so that the first half content of next line is shown to display device 2 or external being used in the equipment shown.Now, just need mark to move to next line to follow the tracks of the reading progress of user from current reading row.
Thus, in one embodiment, mark maker 3 and identify the line feed of user in reading by the movement that recognition image continuous print is first left and then right.As a kind of scheme, the method for the movement that mark maker 3 recognition image continuous print is first left and then right is divided into following step:
Step one: extract multiple pixels in a literal line as unique point;
Step 2: the relative position relation between the unique point of relatively more mobile rear image and the unique point of mobile front image judges the moving direction of image;
Step 3: if judge that the direction of this time movement is for left, so record this time moves, otherwise not record;
Step 4: the direction judging second time movement, if the direction of second time movement is for moving right, then mark maker 3 generates mark at next literal line, otherwise mark maker record this time moves and regenerates mark at current line.
Above mark maker 3 identify the method for line feed for the situation of to be text composition mode in picture and text be horizontal typesetting.The similar method text composition mode that can be applicable in picture and text is the situation of longitudinal typesetting, and the movement one on the other of mark maker 3 recognition image continuous print only need be made to identify that user changes row (column) in reading.
In one embodiment, image collecting device 1 can also comprise input media (not shown).When user reads the current literal line be labeled or other users think need when, line replace command can be inputted by input media, after input media receives line replace command, this line replace command is sent to mark maker 3, mark is moved on to the adjacent literal line of current each literal line be labeled by mark maker 3, or to be separated by the literal line of one or more literal line with current each literal line be labeled.Display device 2 upgrades the new mark of display.Input media can comprise button or upwards downwards.When user presses downward button, mark moves down, and when user presses button upwards, mark moves up.The line number of each mark movement can preset or arrange according to the hobby of oneself according to by user.
As a kind of embodiment, mark maker 3 identifies described blank by knowing the image bar with the pixel of same color stated in image.In truth, all there is noise in image, when the judgement of blank, can not accomplish that all pixel color of current line are all identical.When practical operation, the row that the ratio that the pixel meeting same color can be accounted for all pixels of current line is greater than this condition of setting value regards as blank line.Setting value can be such as 99%.
Shown in Figure 2 is the process flow diagram of a kind of embodiment of smart tags method of the present invention.In this embodiment, smart tags method is divided into following steps:
S1: also amplify the image comprising word with image acquisition device;
S2: the one or more literal lines in image described in the identification of mark maker, and generate the mark for indicating described literal line.
Below with word behavior horizontal direction, and be that example introduces an embodiment of the invention to the situation that the literal line of reference position indicates.It is shown in Figure 3 for mark maker is to the process flow diagram of a kind of embodiment that the literal line in display image identifies.This embodiment is divided into following step:
S21: mark maker is from the high order end that display device any level is capable, horizontal scanning is carried out to displaying contents, moves to next line after having scanned a line and continue scanning, until the pixel of at least two kinds of colors appears in current scan line, note current behavior the 0th row, i.e. N=0;
S22: horizontal scanning is carried out to N-th row;
S23: whether all pixels judging current line are the pixel with same color, if judged result is no, then automatically jump to next line, i.e. N=N+1, proceeds scanning;
S24: if all pixels of current line all have identical color, then determine that the top of current line is literal line and generates mark at current line.
Due in truth, all there is noise in image, when the judgement of blank, can not accomplish that all pixel color of current line are all identical.When reality performs S23, the row that the ratio that the pixel meeting same color can be accounted for all pixels of current line is greater than this condition of setting value regards as blank line.Setting value can be such as 99%.
More than for marking a kind of embodiment that maker 3 identifies display text.Those skilled in the art can carry out random variation to this embodiment as required, such as: after execution of step S24, can proceed to identify, until appearance second, the 3rd etc. meets the row of " lastrow there is the pixel of at least two kinds of colors and all pixel color of current line are identical " this condition, generate at current line and mark and show.In other words, between the often style of writing basis that mark maker 3 can be shown on the display apparatus, a mark is generated.
In addition, above-mentioned to the literal line in display image carry out knowing method for distinguishing for be the type-setting mode of literal line in picture and text be horizontal type-setting mode.When above method also can be applied to word behavior vertical row version mode similarly.When literal line tilts, utilize above method, likely cannot find, at this moment in the step s 21, the scanning at certain angle of inclination can be had to displaying contents, by the angle of inclination of adjustment scanning, finally can identify literal line.
Mark in embodiments of the invention can be reference line, such as, be arranged on the reference line below literal line, also can be the background color of such as literal line.Mark can be arranged to be convenient to arbitrarily user and identify and the color and style not affecting the content of display text own.
Adopt typoscope of the present invention and smart tags method, can arrange the position of mark according to the picture and text amplified, in reading process, mark can follow the tracks of the reading progress of user, thus play the effect of mark more fully, help the people of low vision to improve its reading efficiency.
In apparatus and method of the present invention, obviously, each parts or each step reconfigure after can decomposing, combine and/or decomposing.These decompose and/or reconfigure and should be considered as equivalents of the present invention.
Should emphasize, term " comprises/comprises " existence referring to feature, key element, step or assembly when using herein, but does not get rid of the existence or additional of one or more further feature, key element, step or assembly.
Although described the present invention and advantage thereof in detail, be to be understood that and can have carried out various change when not exceeding the spirit and scope of the present invention limited by appended claim, substituting and conversion.And the scope of the application is not limited only to the specific embodiment of process, equipment, means, method and step described by instructions.One of ordinary skilled in the art will readily appreciate that from disclosure of the present invention, can use perform the function substantially identical with corresponding embodiment described herein or obtain and its substantially identical result, existing and that will be developed in the future process, equipment, means, method or step according to the present invention.Therefore, appended claim is intended to comprise such process, equipment, means, method or step in their scope.

Claims (14)

1. a typoscope, comprises image collecting device, it is characterized in that: also comprise mark maker;
Wherein,
Described image collecting device is for gathering and amplifying the image comprising word;
Described mark maker for identifying the one or more literal lines in described image, and generates the mark for indicating described literal line;
Described mark maker is also by identifying that the movement of described image judges whether line feed, and when judging line feed, mark is moved on to the adjacent literal line of current each literal line be labeled, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
2. typoscope according to claim 1, is characterized in that: described mark maker is by identifying that the blank in described image identifies literal line.
3. typoscope according to claim 1, is characterized in that: described mark maker is by identifying that the movement of the unique point in literal line identifies the movement of described image.
4. the typoscope according to claim 1 or 3, is characterized in that: described mark maker first moves along the opposite direction of the reading direction of word in literal line at described image, then along when the reading direction of word moves in literal line, is judged as line feed.
5. the typoscope according to claim 1-3 any one, is characterized in that: also comprise input media, for from external reception line replace command; After described input media receives line replace command, this line replace command is sent to described mark maker, mark is moved on to the adjacent literal line of current each literal line be labeled by described mark maker, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
6. typoscope according to claim 2, it is characterized in that: described mark maker is by identifying that the image bar met the following conditions in described image identifies described blank: in this image bar, the ratio of the quantity and total pixel number amount with the pixel of same color is more than or equal to predetermined threshold.
7. typoscope according to claim 1, is characterized in that: also comprise display device, and described display device is for showing described image acquisition device and the mark of the described image amplified and the generation of described mark maker.
8. a smart tags method, is characterized in that: comprise the steps:
Image acquisition device also amplifies the image comprising word;
One or more literal lines in image described in the identification of mark maker, and generate the mark for indicating described literal line; Mark maker is also by identifying that the movement of described image judges whether line feed, and when judging line feed, mark is moved on to the adjacent literal line of current each literal line be labeled, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
9. smart tags method according to claim 8, it is characterized in that: in the step of the one or more literal lines in image described in the identification of described mark maker, described mark maker identifies the literal line in described image by the blank identifying in described image.
10. smart tags method according to claim 8, wherein, described mark maker is by identifying that the movement of the unique point in literal line identifies the movement of described image.
Smart tags method described in 11. according to Claim 8 or 10, wherein, described mark maker first moves along the opposite direction of the reading direction of word in literal line at described image, then along when the reading direction of word moves in literal line, is judged as line feed.
12. smart tags methods according to Claim 8 described in-10 any one, is characterized in that: also comprise, with input media from external reception line replace command; After described input media receives line replace command, this line replace command is sent to described mark maker, mark is moved on to the adjacent literal line of current each literal line be labeled by described mark maker, or to be separated by the literal line of one or more literal line with current each literal line be labeled.
13. smart tags methods according to claim 9, wherein, described mark maker is by identifying that the image bar met the following conditions in described image identifies described blank: in this image bar, the ratio of the quantity and total pixel number amount with the pixel of same color is more than or equal to predetermined threshold.
14. smart tags methods according to claim 8, is characterized in that, also comprise: display device shows described image acquisition device and the mark of the described image amplified and the generation of described mark maker.
CN201110319293.6A 2011-10-19 2011-10-19 Visual aid and intelligent marking method Expired - Fee Related CN103065521B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110319293.6A CN103065521B (en) 2011-10-19 2011-10-19 Visual aid and intelligent marking method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110319293.6A CN103065521B (en) 2011-10-19 2011-10-19 Visual aid and intelligent marking method

Publications (2)

Publication Number Publication Date
CN103065521A CN103065521A (en) 2013-04-24
CN103065521B true CN103065521B (en) 2015-03-18

Family

ID=48108132

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110319293.6A Expired - Fee Related CN103065521B (en) 2011-10-19 2011-10-19 Visual aid and intelligent marking method

Country Status (1)

Country Link
CN (1) CN103065521B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105637570B (en) * 2013-08-21 2019-07-02 依视路国际公司 Method for assisting the personal visual exploration with the retinal disorder for leading to dim spot
CN104778687B (en) * 2015-03-26 2019-04-26 北京奇虎科技有限公司 A kind of image matching method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4644339A (en) * 1983-03-02 1987-02-17 Ruder Donald J Low vision adapter for display terminals
US4817185A (en) * 1986-07-11 1989-03-28 Sumitomo Electric Industries, Ltd. Optical character reader
CN101916246A (en) * 2010-07-30 2010-12-15 汉王科技股份有限公司 Method and device for typesetting electronic document
CN102193904A (en) * 2011-04-27 2011-09-21 汉王科技股份有限公司 Electronic reader and information prompt method thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030014445A1 (en) * 2001-07-13 2003-01-16 Dave Formanek Document reflowing technique
DE102005000820B4 (en) * 2004-12-08 2007-07-05 Carl Zeiss Ag A method for improving the vision of a visually impaired person and visual aid

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4644339A (en) * 1983-03-02 1987-02-17 Ruder Donald J Low vision adapter for display terminals
US4817185A (en) * 1986-07-11 1989-03-28 Sumitomo Electric Industries, Ltd. Optical character reader
CN101916246A (en) * 2010-07-30 2010-12-15 汉王科技股份有限公司 Method and device for typesetting electronic document
CN102193904A (en) * 2011-04-27 2011-09-21 汉王科技股份有限公司 Electronic reader and information prompt method thereof

Also Published As

Publication number Publication date
CN103065521A (en) 2013-04-24

Similar Documents

Publication Publication Date Title
CN103576989B (en) Writing based human-computer interaction display system and method
CN103576935B (en) Based on the human-computer interaction auxiliary system and method write
CN102339275A (en) Comment processing method and device for electronic book
CN106156761A (en) The image form detection of facing moving terminal shooting and recognition methods
JP6008076B2 (en) Projector and image drawing method
US20030133164A1 (en) Method for producing indicators and processing apparatus and system utilizing the indicators
CN106781784A (en) A kind of intelligence correction system
CN110827596A (en) Question answering method based on intelligent pen
CN101907923B (en) Information extraction method, device and system
CN101246550B (en) Image character recognition method and device
US9478146B2 (en) Method and system for capturing reading assessment data
CN103577842B (en) Man-machine interaction system and method based on writing
US20120282587A1 (en) System and method for generating and implementing individualized educational practice worksheets
CN105989366A (en) Inclination angle correcting method of text image, page layout analysis method of text image, vision assistant device and vision assistant system
CN101123044A (en) Chinese writing and learning method
JP2008123265A (en) Idea extraction support system and method
CN101573684B (en) Method for visualizing a change caused by scrolling in a scrolling direction of a section of a text and/or graphic displayed on an optical display means
CN103065521B (en) Visual aid and intelligent marking method
CN103412677A (en) Method and device for hand-painted content recognition
JP2004252689A (en) Information processor and program therefor
JP2014052407A (en) Computer device, program, and information processing system
CN110796065A (en) Calligraphy practicing scoring method and system based on image recognition and computer readable medium
CN107958261B (en) Braille point detection method and system
JP4973132B2 (en) Message display system and program
CN109858383A (en) Stroke discrimination method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150318

Termination date: 20171019