US20110320206A1 - Electronic book reader and text to speech converting method - Google Patents

Electronic book reader and text to speech converting method Download PDF

Info

Publication number
US20110320206A1
US20110320206A1 US13/092,258 US201113092258A US2011320206A1 US 20110320206 A1 US20110320206 A1 US 20110320206A1 US 201113092258 A US201113092258 A US 201113092258A US 2011320206 A1 US2011320206 A1 US 2011320206A1
Authority
US
United States
Prior art keywords
text
module
speech
selected segment
highlighting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/092,258
Inventor
Chih-Hung Chen
Chia-Hung Chien
Chien-Chou Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hon Hai Precision Industry Co Ltd
Original Assignee
Hon Hai Precision Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hon Hai Precision Industry Co Ltd filed Critical Hon Hai Precision Industry Co Ltd
Assigned to HON HAI PRECISION INDUSTRY CO., LTD. reassignment HON HAI PRECISION INDUSTRY CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHEN, CHIEN-CHOU, CHEN, CHIH-HUNG, CHIEN, CHIA-HUNG
Publication of US20110320206A1 publication Critical patent/US20110320206A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/062Combinations of audio and printed presentations, e.g. magnetically striped cards, talking books, magnetic tapes with printed texts thereon
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Machine Translation (AREA)
  • Document Processing Apparatus (AREA)

Abstract

An electronic book reader includes a text obtaining module, a text highlighting module, a speech synthesis module, a player module, and a synchronization control module. The text obtaining module obtains a selected segment of a text. The text highlighting module highlights the selected segment. The speech synthesis module converts the selected segment into a speech. The player module plays the speech. The synchronization control module sends the selected segment to the text highlighting module and speech synthesis module synchronously.

Description

  • This application is related to co-pending U.S. patent application entitled “ELECTRONIC BOOK READER”, Attorney Docket No. US33481, US application number ______ filed on ______.
  • BACKGROUND
  • 1. Technical Field
  • The present disclosure relates to electronic book readers, and particularly to, an electronic book reader and a text to speech converting method.
  • 2. Description of Related Art
  • An electronic book (e-book) is a text file providing the digital media equivalent of a conventional printed book. E-books are usually read on personal computers or smart phones, or on dedicated hardware devices known as e-book readers. An e-book reader usually has a player to play the texts of the e-books. However, user may not know which part is being played due to inattention.
  • Therefore, there is room for improvement within the art.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Many aspects of the embodiments can be better understood with references to the following drawings. The components in the drawings are not necessarily drawn to scale, the emphasis instead being placed upon clearly illustrating the principles of the embodiments. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
  • FIG. 1 is a block diagram of an embodiment of the electronic book reader.
  • FIG. 2 is a flow chart in accordance with an embodiment of a text to speech converting method of the electronic book reader.
  • DETAILED DESCRIPTION
  • The disclosure is illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” embodiment in this disclosure are not necessarily to the same embodiment, and such references mean at least one.
  • In general, the word “module,” as used herein, refers to logic embodied in hardware or firmware, or to a collection of software instructions, written in a programming language, such as, for example, Java, C, or Assembly. One or more software instructions in the modules may be embedded in firmware, such as an EPROM. It will be appreciated that modules may comprise connected logic units, such as gates and flip-flops, and may comprise programmable units, such as programmable gate arrays or processors. The modules described herein may be implemented as either software and/or hardware modules and may be stored in any type of computer-readable medium or other computer storage device.
  • Referring to FIG. 1, an electronic book reader 10 is connected to text source 20, a display 30, and an audio output device 40. In one embodiment, the display 30 is cathode ray tube (CRT) display or liquid crystal display (LCD).
  • The electronic book reader 10 includes a text obtaining module 102, a synchronization control module 104, a text highlighting module 106, a speech synthesis module 108, and a player module 110. The text obtaining module 102 is connected to the synchronization control module 104. The synchronization control module 104 is connected to the text highlighting module 106 and the speech synthesis module 108. The speech synthesis module 108 is connected to the player module 110. The player module 110 is connected to the audio output device 40 and the synchronization control module 104. The text highlighting module 106 is connected to the display 30.
  • The display 30 is configured to display texts. The audio output device 40 is configured to output audio signals. In one embodiment, the audio output device 40 is a speaker or headphones. The text obtaining module 102 is configured to divide a text into a plurality of segments according to punctuations of the text, such as commas, periods, question marks, exclamation points, and obtain a selected segment of the text from the text source 20.
  • The synchronization control module 104 is configured to send the selected segment to the text highlighting module 106 and the speech synthesis module 108 at the same time. The synchronization control module 104 is further configured to receive a feedback message from the player module 110 and then send a revoking command for revoking the highlighting effect of the text to the text highlighting module 106. The speech synthesis module 108 is configured to convert the selected segment to speech and send the speech to the player module 110 to play. The player module 110 is configured to play the speech and a feedback message to the synchronization control module 104 after playing the speech. The feedback message indicates that the player module 110 finishes playing the speech.
  • Referring to FIG. 2, a text to speech converting method on the electronic book reader is shown. An embodiment of the method is as follows.
  • In step S52, the text obtaining module 102 obtains a selected segment of a text from the text source 20. In one embodiment, the selected segment is a sentence. The text includes a plurality of sentences. Two adjacent sentences of the text are separated by punctuation.
  • In step S54, the synchronization control module 104 sends the selected segment to the text highlighting module 106.
  • In step S56, the text highlighting module 106 highlights the selected segment and displays the segment on the display 30.
  • In step S58, the synchronization control module 104 sends the selected segment to the speech synthesis module 108, when the synchronization control module 104 sends the segment to the text highlighting module 106.
  • In step S60, the speech synthesis module 108 converts the selected segment to speech and sends the speech to the player module 110.
  • In step S62, the player module 110 plays the speech from the speech synthesis module 108 and then sends a feedback message to the synchronization control module 104.
  • In step S64, the synchronization control module 104 sends a revoking command for revoking the highlighting effect of the text to the text highlighting module 106, and the text highlighting module 106 revokes the highlighting effect of the segment.
  • In step S66, the synchronization control module 104 sends a message for reading the next segment of the text to the text obtaining module 102. The text obtaining module 102 judges if there is unread segment of the text. If so, turns to step S52, if not, the process is over.
  • It is to be understood, however, that even though numerous characteristics and advantages of the embodiments have been set forth in the foregoing description, together with details of the structure and function of the embodiments, the disclosure is illustrative only, and changes may be made in detail, especially in matters of shape, size, and arrangement of parts within the principles of the present disclosure to the full extent indicated by the broad general meaning of the terms in which the appended claims are expressed.
  • Depending on the embodiment, certain of the steps of methods described may be removed, others may be added, and the sequence of steps may be altered. It is also to be understood that the description and the claims drawn to a method may include some indication in reference to certain steps. However, the indication used is only to be viewed for identification purposes and not as a suggestion as to an order for the steps.

Claims (8)

1. An electronic book reader, comprising:
a text obtaining module, the text obtaining module configured to obtain a selected segment of a text;
a text highlighting module, the text highlighting module configured to highlight the selected segment and display the selected segment on a display;
a speech synthesis module, the speech synthesis module configured to convert the selected segment into speech;
a player module, the player module configured to play the speech; and
a synchronization control module, the synchronization control module configured to send the selected segment to the text highlighting module and the speech synthesis module contemporaneously.
2. The electronic book reader of claim 1, wherein the selected segment is a part of the text with a punctuation.
3. The electronic book reader of claim 1, wherein the player module is configured to send a feedback message to the synchronization control module after playing the speech, and the feedback message indicates that the player module finishes playing the speech.
4. The electronic book reader of claim 1, wherein the text highlighting module is configured to revoke highlight effect of the selected segment after the player module finishes playing the speech.
5. A text to speech converting method comprising:
obtaining a selected segment of text;
highlighting and displaying the selected segment, and converting the selected segment into speech synchronously; and
playing the speech.
6. The text to speech converting method of claim 5, further comprising revoking highlight effect of the selected segment after playing the speech.
7. The text to speech converting method of claim 5, wherein the selected segment is a sentence of the text.
8. A text to speech converting method comprising:
providing an electronic book reader, the electronic book reader comprising:
a text obtaining module, the text obtaining module configured to obtain a selected segment of text;
a text highlighting module, the text highlighting module configured to highlight the selected segment and display the selected segment on a display;
a speech synthesis module, the speech synthesis module configured to convert the selected segment into speech;
a player module, the player module configured to play the speech; and
a synchronization control module, the synchronization control module configured to send the selected segment to the text highlighting module and the speech synthesis module contemporaneously;
the text obtaining module obtaining the selected segment of text;
the text highlighting module highlighting and displaying the selected segment, and the speech synthesis module converting the selected segment into the speech contemporaneously; and
the player module playing the speech.
US13/092,258 2010-06-29 2011-04-22 Electronic book reader and text to speech converting method Abandoned US20110320206A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2010102124960A CN102314874A (en) 2010-06-29 2010-06-29 Text-to-voice conversion system and method
CN201010212496.0 2010-06-29

Publications (1)

Publication Number Publication Date
US20110320206A1 true US20110320206A1 (en) 2011-12-29

Family

ID=45353364

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/092,258 Abandoned US20110320206A1 (en) 2010-06-29 2011-04-22 Electronic book reader and text to speech converting method

Country Status (2)

Country Link
US (1) US20110320206A1 (en)
CN (1) CN102314874A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130063494A1 (en) * 2011-09-12 2013-03-14 Microsoft Corporation Assistive reading interface
US20140012583A1 (en) * 2012-07-06 2014-01-09 Samsung Electronics Co. Ltd. Method and apparatus for recording and playing user voice in mobile terminal
US11044282B1 (en) 2020-08-12 2021-06-22 Capital One Services, Llc System and method for augmented reality video conferencing
WO2021217433A1 (en) * 2020-04-28 2021-11-04 青岛海信传媒网络技术有限公司 Content-based voice playback method and display device

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103312853A (en) * 2013-05-09 2013-09-18 惠州市德赛工业发展有限公司 Menu output method for mobile communication equipment
CN103632236A (en) * 2013-12-05 2014-03-12 用友软件股份有限公司 Statement voice-reading device
CN105306420B (en) * 2014-06-27 2019-08-30 中兴通讯股份有限公司 Realize the method, apparatus played from Text To Speech cycle of business operations and server
US20170309269A1 (en) * 2014-11-25 2017-10-26 Mitsubishi Electric Corporation Information presentation system
CN104519403A (en) * 2014-12-25 2015-04-15 西安诺瓦电子科技有限公司 Audio control device and method
CN106033678A (en) * 2015-03-18 2016-10-19 珠海金山办公软件有限公司 Playing content display method and apparatus thereof
CN104810015A (en) * 2015-03-24 2015-07-29 深圳市创世达实业有限公司 Voice converting device, voice synthesis method and sound box using voice converting device and supporting text storage
CN109376776A (en) * 2018-10-15 2019-02-22 百度在线网络技术(北京)有限公司 Method and apparatus for playing music

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5875428A (en) * 1997-06-27 1999-02-23 Kurzweil Educational Systems, Inc. Reading system displaying scanned images with dual highlights
US5999903A (en) * 1997-06-27 1999-12-07 Kurzweil Educational Systems, Inc. Reading system having recursive dictionary and talking help menu
US6199042B1 (en) * 1998-06-19 2001-03-06 L&H Applications Usa, Inc. Reading system
US20030018663A1 (en) * 2001-05-30 2003-01-23 Cornette Ranjita K. Method and system for creating a multimedia electronic book
US6708152B2 (en) * 1999-12-30 2004-03-16 Nokia Mobile Phones Limited User interface for text to speech conversion
US20050021343A1 (en) * 2003-07-24 2005-01-27 Spencer Julian A.Q. Method and apparatus for highlighting during presentations
US20060271627A1 (en) * 2005-05-16 2006-11-30 Szczepanek Noah J Internet accessed text-to-speech reading assistant
US20070011012A1 (en) * 2005-07-11 2007-01-11 Steve Yurick Method, system, and apparatus for facilitating captioning of multi-media content
US20070271104A1 (en) * 2006-05-19 2007-11-22 Mckay Martin Streaming speech with synchronized highlighting generated by a server
US7346506B2 (en) * 2003-10-08 2008-03-18 Agfa Inc. System and method for synchronized text display and audio playback
US7353175B2 (en) * 2002-03-07 2008-04-01 Canon Kabushiki Kaisha Apparatus, method, and program for speech synthesis with capability of providing word meaning immediately upon request by a user
US20080189099A1 (en) * 2005-01-12 2008-08-07 Howard Friedman Customizable Delivery of Audio Information
US20090202226A1 (en) * 2005-06-06 2009-08-13 Texthelp Systems, Ltd. System and method for converting electronic text to a digital multimedia electronic book
US20100324905A1 (en) * 2009-01-15 2010-12-23 K-Nfb Reading Technology, Inc. Voice models for document narration
US20110184738A1 (en) * 2010-01-25 2011-07-28 Kalisky Dror Navigation and orientation tools for speech synthesis
US20110246175A1 (en) * 2010-03-30 2011-10-06 Young Hee Yi E-book reader language mapping system and method
US8239201B2 (en) * 2008-09-13 2012-08-07 At&T Intellectual Property I, L.P. System and method for audibly presenting selected text
US8380509B2 (en) * 2001-03-29 2013-02-19 Nuance Communications Austria Gmbh Synchronise an audio cursor and a text cursor during editing
US8504369B1 (en) * 2004-06-02 2013-08-06 Nuance Communications, Inc. Multi-cursor transcription editing

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1300018A (en) * 1999-10-05 2001-06-20 株式会社东芝 Book reading electronic machine, edition system, storage medium and information providing system
JP3953886B2 (en) * 2002-05-16 2007-08-08 セイコーエプソン株式会社 Subtitle extraction device
US20080027726A1 (en) * 2006-07-28 2008-01-31 Eric Louis Hansen Text to audio mapping, and animation of the text
JP5313466B2 (en) * 2007-06-28 2013-10-09 ニュアンス コミュニケーションズ,インコーポレイテッド Technology to display audio content in sync with audio playback

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5875428A (en) * 1997-06-27 1999-02-23 Kurzweil Educational Systems, Inc. Reading system displaying scanned images with dual highlights
US5999903A (en) * 1997-06-27 1999-12-07 Kurzweil Educational Systems, Inc. Reading system having recursive dictionary and talking help menu
US6173264B1 (en) * 1997-06-27 2001-01-09 Raymond C. Kurzweil Reading system displaying scanned images with dual highlighting
US6199042B1 (en) * 1998-06-19 2001-03-06 L&H Applications Usa, Inc. Reading system
US6708152B2 (en) * 1999-12-30 2004-03-16 Nokia Mobile Phones Limited User interface for text to speech conversion
US8380509B2 (en) * 2001-03-29 2013-02-19 Nuance Communications Austria Gmbh Synchronise an audio cursor and a text cursor during editing
US20030018663A1 (en) * 2001-05-30 2003-01-23 Cornette Ranjita K. Method and system for creating a multimedia electronic book
US7353175B2 (en) * 2002-03-07 2008-04-01 Canon Kabushiki Kaisha Apparatus, method, and program for speech synthesis with capability of providing word meaning immediately upon request by a user
US20050021343A1 (en) * 2003-07-24 2005-01-27 Spencer Julian A.Q. Method and apparatus for highlighting during presentations
US7346506B2 (en) * 2003-10-08 2008-03-18 Agfa Inc. System and method for synchronized text display and audio playback
US8504369B1 (en) * 2004-06-02 2013-08-06 Nuance Communications, Inc. Multi-cursor transcription editing
US20080189099A1 (en) * 2005-01-12 2008-08-07 Howard Friedman Customizable Delivery of Audio Information
US20060271627A1 (en) * 2005-05-16 2006-11-30 Szczepanek Noah J Internet accessed text-to-speech reading assistant
US20090202226A1 (en) * 2005-06-06 2009-08-13 Texthelp Systems, Ltd. System and method for converting electronic text to a digital multimedia electronic book
US20070011012A1 (en) * 2005-07-11 2007-01-11 Steve Yurick Method, system, and apparatus for facilitating captioning of multi-media content
US20070271104A1 (en) * 2006-05-19 2007-11-22 Mckay Martin Streaming speech with synchronized highlighting generated by a server
US8239201B2 (en) * 2008-09-13 2012-08-07 At&T Intellectual Property I, L.P. System and method for audibly presenting selected text
US20100324905A1 (en) * 2009-01-15 2010-12-23 K-Nfb Reading Technology, Inc. Voice models for document narration
US20110184738A1 (en) * 2010-01-25 2011-07-28 Kalisky Dror Navigation and orientation tools for speech synthesis
US20110246175A1 (en) * 2010-03-30 2011-10-06 Young Hee Yi E-book reader language mapping system and method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130063494A1 (en) * 2011-09-12 2013-03-14 Microsoft Corporation Assistive reading interface
US10339833B2 (en) 2011-09-12 2019-07-02 Microsoft Technology Licensing, Llc Assistive reading interface
US20140012583A1 (en) * 2012-07-06 2014-01-09 Samsung Electronics Co. Ltd. Method and apparatus for recording and playing user voice in mobile terminal
US9786267B2 (en) * 2012-07-06 2017-10-10 Samsung Electronics Co., Ltd. Method and apparatus for recording and playing user voice in mobile terminal by synchronizing with text
WO2021217433A1 (en) * 2020-04-28 2021-11-04 青岛海信传媒网络技术有限公司 Content-based voice playback method and display device
US11044282B1 (en) 2020-08-12 2021-06-22 Capital One Services, Llc System and method for augmented reality video conferencing
US11363078B2 (en) 2020-08-12 2022-06-14 Capital One Services, Llc System and method for augmented reality video conferencing
US11848968B2 (en) 2020-08-12 2023-12-19 Capital One Services, Llc System and method for augmented reality video conferencing

Also Published As

Publication number Publication date
CN102314874A (en) 2012-01-11

Similar Documents

Publication Publication Date Title
US20110320206A1 (en) Electronic book reader and text to speech converting method
US20110320205A1 (en) Electronic book reader
US10621972B2 (en) Method and device extracting acoustic feature based on convolution neural network and terminal device
US10043519B2 (en) Generation of text from an audio speech signal
US20190221200A1 (en) Assisted Media Presentation
US20130346076A1 (en) Visual confirmation of voice recognized text input
CN103544140A (en) Data processing method, display method and corresponding devices
KR20080031357A (en) Redictation 0f misrecognized words using a list of alternatives
CN106385628A (en) Apparatus and method for analyzing audio and video asynchronization
JP6460286B2 (en) Information presentation apparatus and information presentation method
CN106407176B (en) Method and apparatus for inserting characters in speech recognition
US9137483B2 (en) Video playback device, video playback method, non-transitory storage medium having stored thereon video playback program, video playback control device, video playback control method and non-transitory storage medium having stored thereon video playback control program
CN108491178B (en) Information browsing method, browser and server
US9424757B2 (en) Method of playing music based on chords and electronic device implementing the same
US10339955B2 (en) Information processing device and method for displaying subtitle information
CN104378692A (en) Method and device for processing video captions
KR101567449B1 (en) E-Book Apparatus Capable of Playing Animation on the Basis of Voice Recognition and Method thereof
CN109858005B (en) Method, device, equipment and storage medium for updating document based on voice recognition
US20150111189A1 (en) System and method for browsing multimedia file
KR20040094634A (en) Dynamic pronunciation support for japanese and chinese speech recognition training
Liu et al. Tonal mapping of Xi'an Mandarin and Standard Chinese
US9253436B2 (en) Video playback device, video playback method, non-transitory storage medium having stored thereon video playback program, video playback control device, video playback control method and non-transitory storage medium having stored thereon video playback control program
CN108682437B (en) Information processing method, device, medium and computing equipment
US20120173236A1 (en) Speech to text converting device and method
KR102656262B1 (en) Method and apparatus for providing associative chinese learning contents using images

Legal Events

Date Code Title Description
AS Assignment

Owner name: HON HAI PRECISION INDUSTRY CO., LTD., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHEN, CHIH-HUNG;CHIEN, CHIA-HUNG;CHEN, CHIEN-CHOU;REEL/FRAME:026168/0351

Effective date: 20110408

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION