US20100235732A1 - System and method for interacting with status information on a touch screen device - Google Patents

System and method for interacting with status information on a touch screen device Download PDF

Info

Publication number
US20100235732A1
US20100235732A1 US12/404,198 US40419809A US2010235732A1 US 20100235732 A1 US20100235732 A1 US 20100235732A1 US 40419809 A US40419809 A US 40419809A US 2010235732 A1 US2010235732 A1 US 2010235732A1
Authority
US
United States
Prior art keywords
mode
status
user
touch
icon
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/404,198
Other versions
US8286106B2 (en
Inventor
Eric D. Bergman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle America Inc
Original Assignee
Sun Microsystems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Microsystems Inc filed Critical Sun Microsystems Inc
Priority to US12/404,198 priority Critical patent/US8286106B2/en
Assigned to SUN MICROSYSTEMS, INC. reassignment SUN MICROSYSTEMS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BERGMAN, ERIC D.
Publication of US20100235732A1 publication Critical patent/US20100235732A1/en
Application granted granted Critical
Publication of US8286106B2 publication Critical patent/US8286106B2/en
Assigned to Oracle America, Inc. reassignment Oracle America, Inc. MERGER AND CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: Oracle America, Inc., ORACLE USA, INC., SUN MICROSYSTEMS, INC.
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • GUIs graphical user interfaces
  • many personal digital assistants, audio players, and mobile phones include touch screen GUIs.
  • touch screen GUIs include graphical elements (e.g., buttons, icons, etc.) that a user may select by touch input, thereby enabling the user to interact with the computing device.
  • selectable graphical elements are referred to herein as “command icons.”
  • a touch screen GUI may also include a status bar, i.e., a relatively thin horizontal area containing information describing the state of the computing device.
  • a status bar i.e., a relatively thin horizontal area containing information describing the state of the computing device.
  • the touch screen GUI of a mobile phone may have a status bar including icons describing various states of the mobile phone (e.g., signal strength, battery level, ringer status, alarm mode, network status, etc.).
  • Such icons included in the status bar are referred to herein as “status icons.”
  • the status bar occupies a relatively small portion of the touch screen GUI and is not an interactive part of the GUI.
  • the invention relates to a method for interacting with a computing device, including presenting a first mode of a touch interface, wherein the touch interface is configured as a user interface of the computing device, wherein the touch interface comprises a status display portion and a command portion, wherein the status display portion comprises at least one status icon arranged in a first arrangement, wherein the command portion comprises at least one command icon, wherein selecting a command icon initiates a corresponding command action within the computing device, and wherein in the first mode, the at least one status icon is not selectable by touch input and the at least one command icon is selectable by touch input, receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface, and in response to receiving the first input, presenting the user with the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input, and wherein the at least one status icon displays a corresponding status of the computing device
  • the invention relates to a portable communications device, including a processor, a capacitive touch screen, and a computer usable storage medium having computer readable program code embodied therein.
  • the computer readable program code is adapted to, when executed by the processor, implement a method for presenting a user interface, the method including displaying, on the capacitive touch screen, a first mode of a touch interface, wherein the touch interface is configured as a user interface of the portable communications device, wherein the touch interface comprises a status display portion and a command portion, wherein the status display portion comprises at least one status icon arranged in a first arrangement, wherein the command portion comprises at least one command icon, wherein selecting a command icon initiates a corresponding command action within the computing device, and wherein in the first mode, the at least one status icon is not selectable by touch input and the at least one command icon is selectable by touch input, receiving, from a user, a first touch input indicating a desire to switch from the first mode to a second mode of
  • the invention relates to a computer usable storage medium having computer readable program code embodied therein, the computer readable program code adapted to, when executed by the processor, implement a method for presenting a touch interface.
  • the method includes presenting a first mode of the touch interface, wherein the touch interface is configured as a user interface of a computing device, wherein the touch interface comprises at least one status icon and wherein in the first mode, the at least one status icon is not selectable by touch input, receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface, and in response to receiving the first input, presenting the user with the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input, wherein the at least one status icon displays a corresponding status of the computing device.
  • FIG. 1 shows a system in accordance with one or more embodiments of the invention.
  • FIGS. 2A-2C show a user interface in accordance with one or more embodiments of the invention.
  • FIGS. 3A-3D show flow charts in accordance with one or more embodiments of the invention.
  • embodiments of the invention relate to a method system for interacting with status information on a touch screen device. More specifically, embodiments of the invention relate to a method and system for interacting with the status icons in the status bar on a touch screen.
  • FIG. 1 shows a computing device in accordance with one or more embodiments of the invention.
  • the computing device ( 100 ) includes a touch screen ( 102 ), a processor ( 108 ), associated memory ( 110 ), an external communication device ( 116 ), and numerous other elements and functionalities typical of today's computing devices (not shown).
  • the computing device ( 100 ) may be a computer system, a laptop, a media player (i.e., a portable television, a MP3 player, etc), a gaming device, a mobile phone (including a smart phone), a personal digital assistant, or any other suitable wired or wireless computing device.
  • the touch screen ( 102 ) may be a display screen configured to detect the presence and location of a touch within the screen area. That is, the touch screen ( 102 ) may provide output means (i.e., a visual display) and input means (i.e., user control via touch input) for the computing device ( 100 ).
  • the touch screen ( 102 ) may utilize any suitable touch technology now known (e.g., electrical capacitance, electrical resistance, optical imaging, mechanical strain, etc.) or later developed.
  • the touch screen ( 102 ) may present a graphical user interface (GUI) for the computing device ( 100 ).
  • GUI graphical user interface
  • the computing device includes a processor ( 108 ) for executing applications and software instructions configured to perform various functionalities, and memory ( 110 ) for storing software instructions and application data.
  • Software instructions i.e., computer readable program code
  • adapted to perform embodiments of the invention may be stored on any tangible computer readable storage medium such as a compact disc (CD), a diskette, a tape, a memory stick such as a jump drive or a flash memory drive, or any other computer or machine readable storage device that can be read and executed by the processor ( 108 ) of the computing device.
  • the memory ( 110 ) may be flash memory, a hard disk drive (HDD), random access memory (RAM), read-only memory (ROM), any other type of suitable storage space, or any combination thereof.
  • the external communication interface ( 116 ) may be an antenna, a serial port, a parallel port, a Universal Serial Bus (USB) interface, or any type of network interface connection, such as Bluetooth® (Bluetooth is a registered trademark of Bluetooth SIG, Inc.), infrared signal, etc. Further, the external communication interface may also support Global System for Mobile (GSM) communications, and 3G and/or 4G standards for mobile phone communication.
  • the computing device ( 100 ) may be connected to a local area network (LAN) or a wide area network (e.g., the Internet) (not shown) via the external communication interface ( 116 ). Further, the external communication interface ( 116 ) may support both wired and wireless interfaces.
  • LAN local area network
  • a wide area network e.g., the Internet
  • the computing device ( 100 ) is typically associated with a user ( 118 ) using the computing device ( 100 ).
  • the user may be an individual, a company, an organization, a group of individuals, or another computing device.
  • the user ( 118 ) is an individual consumer that uses the computing device ( 100 ) as a personal electronic device.
  • FIGS. 2A-2C illustrate examples of a GUI ( 200 ) in accordance with one or more embodiments of the invention.
  • FIGS. 2A-2C represent examples of the GUI ( 200 ) as displayed on a touch screen (e.g., the touch screen ( 102 ) shown in FIG. 1 ) of a computing device (e.g., the computing device ( 100 ) shown in FIG. 1 ).
  • FIG. 2A illustrates a first mode of the GUI ( 200 ) in accordance with one or more embodiments of the invention.
  • the GUI ( 200 ) may include a status bar ( 210 ) and a command area ( 220 ).
  • the status bar ( 210 ) may be an area of the GUI ( 200 ) that is reserved for the display of status icons ( 215 ).
  • Each status icon ( 215 ) may be configured to display a corresponding status of the computing device.
  • status icons ( 215 ) may communicate a battery level, a current date and/or time, an antenna mode (e.g., enabled/disabled), a network signal level (e.g., no signal, weak signal, medium signal, strong signal), a volume level (e.g., very quiet, quiet, normal, above normal, loud), an alert, and/or any other suitable information associated with the status of the computing device.
  • FIG. 2A shows the status bar as being a horizontal bar located at the top of the GUI, the status bar may be displayed in any orientation (e.g., vertically) and may be located anywhere within the GUI.
  • the command area ( 220 ) may include command icons ( 225 ), each of which may be selected to initiate a corresponding command action.
  • each command icon ( 225 ) may be selectable by touch input (e.g., touching with a fingertip, with a stylus, etc.) on a touch screen.
  • touch input e.g., touching with a fingertip, with a stylus, etc.
  • the user ( 118 ) may touch a specific command icon ( 225 ) displayed on the touch screen with a fingertip, thereby initiating a corresponding command action within the computing device.
  • Such command actions may include, e.g., initiating a telephone call, opening a web browser, playing a song, viewing a calendar, and the like.
  • the GUI ( 200 ) may be presented in two different modes.
  • the GUI ( 200 ) may be configured to allow the user ( 118 ) to interact with the command area ( 220 ) but not with the status bar ( 210 ). That is, in the first mode, the command icons ( 225 ) may be individually selected by touch input, but the status icons ( 215 ) may not be individually selectable by touch input.
  • the command icons ( 225 ) may be configured (e.g., shaped and/or sized) to facilitate selection by touch input (e.g., may be approximately the same size as a human fingertip).
  • the status icons ( 215 ) may be substantially smaller relative to the command icons ( 225 ).
  • the status icons ( 215 ) may be substantially smaller than the command icons ( 225 ), thereby enabling the status bar ( 210 ) to occupy a small portion of the GUI ( 200 ) relative to the command area ( 220 ).
  • the GUI ( 200 ) may be selectively switched to a second mode (illustrated in FIG. 2C ), such that the user using the computing device may interact with the status bar ( 210 ). More specifically, in the second mode, the status icons ( 215 ) are selectable by touch input, thereby enabling the user to access functionality (i.e., actions) corresponding to the status icons ( 215 ). Such functionality may include, e.g., displaying detailed device status information, providing access to device configuration screens, initiating an application, and the like. For example, selecting a status icon ( 215 ) communicating a battery level may result in displaying a power consumption configuration screen within the GUI ( 200 ). In another example, selecting a status icon ( 215 ) communicating an antenna mode may result in displaying a wireless network configuration screen within the GUI ( 200 ).
  • the second mode of GUI ( 200 ) is described further below with reference to FIG. 2C .
  • FIG. 2B illustrates a situation in which the user enters a command to switch from the first mode to the second mode of the GUI ( 200 ), according to one or more embodiments of the invention. More specifically, the user has touched a portion of the status bar ( 210 ) to indicate a desire to switch the GUI ( 200 ) to the second mode.
  • the area of contact of the user's finger (or stylus) is represented by a touch region ( 230 ).
  • the touch region ( 230 ) may be located anywhere on the GUI ( 200 ). In one or more embodiments of the invention, the touch region ( 230 ) is completely within the status bar ( 210 ).
  • the touch region ( 230 ) may be partially within the status bar ( 210 ) and partially outside of the status bar ( 210 ) (i.e., the touch region ( 230 ) may overlap with the status bar ( 210 )). Further, the touch region ( 230 ) may be any shape, and is not limited to the circular shape that is shown in FIG. 2B . It should be noted that, because the GUI ( 200 ) is still in the first mode, any status icons ( 215 ) displayed within the touch region ( 230 ) are not selected by making contact with the touch region ( 230 ). In one or more embodiments, in response to the user's touch input within the touch region 230 , the GUI ( 200 ) may be switched to the second mode.
  • the switch to the second mode begins only after the user's touch input is maintained for a specified, pre-determined time period.
  • the specified, pre-determined time period may be set so as to prevent switching modes due to an accidental or unintended touch input within the status bar ( 210 ).
  • Such a specified time period may be a default manufacturer setting, or may be a user defined setting.
  • FIG. 2C illustrates the second mode of the GUI ( 200 ) in accordance with one or more embodiments of the invention.
  • the status bar ( 210 ) may include the same status icons ( 215 ) in the second mode as in the first mode.
  • the status icons ( 215 ) are selectable by the user ( 118 ).
  • the status icons ( 215 ) presented in the second mode may be configured to facilitate selection by touch input.
  • the status icons ( 215 ) displayed in the second mode may be sized and/or shaped to facilitate selection by touch input.
  • the status icons ( 215 ) may be larger than in the first mode.
  • the area of the GUI occupied by the status bar ( 210 ) may be larger in the second mode than the area occupied by the status bar ( 210 ) in the first mode, thereby accommodating the increased size of the status icons ( 215 ).
  • the size of the command area ( 220 ) may be decreased in the second mode, thereby providing space to accommodate the larger size of the status bar ( 210 ).
  • the positions of the status icons ( 215 ) in the second mode may be different than the positions of the same status icons ( 215 ) in the first mode.
  • the first mode e.g., FIG. 2A
  • all of the status icons ( 215 ) may be arranged in a single row within the status bar ( 210 ).
  • the second mode e.g., FIG. 2C
  • the status icons ( 215 ) may be arranged in multiple rows. Such changes in positions of the status icons ( 215 ) may be performed, e.g., in order to accommodate the larger sizes of the status icons ( 215 ) in the second mode.
  • the change of position of the status icons ( 215 ) may be animated during transitions between the first and second modes. That is, as the GUI ( 200 ) transitions from the first mode to the second mode (or vice-versa), each status icon ( 215 ) may be shown in animated motion, gradually changing in position and size. Such animation may be configured so as to enable the user to track the changing positions of the status icons ( 215 ).
  • the status icons ( 215 ) may also stay in motion for a specified period of time when the GUI ( 200 ) transitions from the first mode to the second mode (or vice versa). For example, the status icons ( 215 ) may “dance” in place during the GUI ( 200 ) transition.
  • one or more sounds may be associated with the status icons ( 215 ) while they are in motion during the GUI ( 200 ) transition.
  • the command icons ( 225 ) may not be selectable in the second mode of the GUI ( 200 ).
  • the command icons ( 225 ) are presented with a visual indicator communicating that they are not selectable.
  • the command icons ( 225 ) may be presented with a “grayed out” font.
  • other visual indicators may be used, such as a text label, a symbol, a color effect, and the like.
  • FIGS. 3A-3D show flow charts for methods in accordance with one or more embodiments of the invention.
  • one or more of the steps described below may be omitted, repeated, performed in parallel, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIGS. 3A-3D should not be construed as limiting the scope of the invention.
  • FIG. 3A shows a flow chart for a method of interacting with a computing device, in accordance with one or more embodiments of the invention.
  • a first mode of an interface is presented (ST 300 ).
  • the first mode of the interface is defined as the status bar icons being non-selectable and the command area icons being selectable.
  • a command to switch the interface to a second mode may be received.
  • the second mode of the interface may enable a user to access functionality that is not accessible in a first mode of the interface.
  • ST 310 is described in greater detail below with reference to FIG. 3B .
  • the interface may be switched to the second mode (ST 320 ).
  • ST 320 is described in greater detail below with reference to FIG. 3C .
  • a user interaction during the second mode of the interface is received.
  • the user interaction received at ST 330 may be a command requesting functionality that is not accessible in a first mode of the interface (e.g., touching a status icon).
  • the user interaction received at ST 330 may be a command requesting a return to the first mode of the GUI ( 200 ) (e.g., touching an area outside the status bar).
  • any action(s) required by the user interaction may be performed.
  • ST 330 and ST 340 may be repeated for any further user interactions with the second mode of the GUI ( 200 ).
  • ST 330 and ST 340 are described in greater detail below with reference to FIG. 3D .
  • FIG. 3B shows a flow chart for receiving a command to switch to a second mode of an interface, in accordance to one or more embodiments of the invention.
  • FIG. 3B illustrates an exemplary expansion of the steps involved in performing ST 310 (shown in FIG. 3A ) using a touch interface (e.g., the touch screen ( 102 ) shown in FIG. 1 ).
  • a touch interface e.g., the touch screen ( 102 ) shown in FIG. 1 .
  • a touch input may be received within a status bar of a GUI (ST 311 ).
  • a touch input may indicate a desire to switch to a second mode of the GUI.
  • the user may touch the status bar ( 210 ) of the GUI ( 200 ), thereby indicating a desire to switch to a second mode of the GUI ( 200 ).
  • the portion of the GUI ( 200 ) touched by the user is represented by the touch region ( 230 ).
  • the received touch input within a touch region may be an accidental and/or unintended touch on the touch region. Accordingly, before switching to the second mode of the GUI, additional steps may be performed to attempt to determine if the received touch input is valid or invalid.
  • the feedback may be configured to alert the user that a transition to the second mode is beginning.
  • the feedback may include, e.g., a visual indication (a color or animation effect, a text label, a symbol, etc.), a vibration, a sound indication, other like feedback, or any combination thereof.
  • a user may touch the status bar inadvertently (i.e., without intending to switch to the second mode of the GUI).
  • the feedback may enable the user to terminate the touch input in the touch region, thereby avoiding switching to the second mode of the GUI.
  • a time threshold for the touch input within the status bar may be predefined, such that accidental touching of the status bar does not result in an unintended switch to the second mode of the GUI.
  • the time threshold may be user defined or set as a default manufacturer setting.
  • the time threshold may be predefined to be two seconds. If the time threshold has not been reached, then the process returns to ST 313 . However, if the time threshold has been reached, then the process continues at ST 320 (shown in FIG. 3A ). That is, if the duration of the touch input within the status bar is at least as long as the time threshold, then the touch input is considered to be a valid user command to switch to the second mode of the GUI.
  • FIG. 3C shows a flow chart for switching to the second mode of the interface, in accordance to one or more embodiments of the invention.
  • FIG. 3C illustrates an exemplary expansion of the steps involved in performing ST 320 (shown in FIG. 3A ) using a GUI displayed on a touch screen (e.g., the GUI ( 200 ) shown in FIGS. 2A-2C ).
  • the process begins after receiving a command to switch to the second mode of the GUI (i.e., after ST 310 shown in FIG. 3A ).
  • the size of a status bar and status icons included in the GUI may be increased.
  • the status icons may be moved to new positions within the status bar.
  • the status bar ( 210 ) and status icons ( 215 ) shown in FIG. 2A may be increased in size, resulting in the larger status bar ( 210 ) and status icons ( 215 ) shown in FIG. 2C .
  • the status icons ( 215 ) may be moved to new positions within the status bar ( 210 ), so as to accommodate the larger sizes of the status icons ( 215 ).
  • the invention is not limited to indicating the second mode by a change in size and position of status icons.
  • the second mode of the GUI may also be indicated by a change in color or background of the status bar, while the size and positions of the status icons remain the same as in the first mode of the GUI.
  • command icons included in the GUI may be made not selectable by touch input.
  • the status icons included in the status bar may be made selectable by touch input. For example, as shown in FIG. 2C , the command icons ( 225 ) are “grayed-out,” indicating that they are not selectable by touch input in the second mode of the GUI ( 200 ). Further, the status icons ( 215 ) of the status bar ( 210 ) are made selectable by touch input. Alternatively, the second mode of the GUI may be defined by having both the command icons and the status icons selectable by touch input.
  • the process continues at ST 330 (shown in FIG. 3A ).
  • FIG. 3D shows a flow chart for receiving user interactions in the second mode of the interface, in accordance with one or more embodiments of the invention.
  • FIG. 3D illustrates an exemplary expansion of the steps involved in performing ST 330 and ST 340 (shown in FIG. 3A ) using a GUI displayed on a touch screen (e.g., the GUI ( 200 ) shown in FIGS. 2A-2C ).
  • the process begins after the GUI has switched to a second mode (i.e., after ST 320 shown in FIG. 3A ). Initially, it is determined whether a selection of a status icon has been received (ST 331 ). If so, then at ST 341 , at least one action corresponding to the selected status icon is performed. In one embodiment of the invention, performing the at least one action includes modifying at least one operating characteristic of the computer device. For example, referring to FIG. 2C , the user may select a status icon ( 215 ) communicating an antenna mode. In response, the GUI ( 200 ) may present a dialog screen to configure a wireless network connection (e.g., a connection using the external communications interface ( 116 ) of the computing device ( 100 ) shown in FIG. 1 ).
  • a wireless network connection e.g., a connection using the external communications interface ( 116 ) of the computing device ( 100 ) shown in FIG. 1 .
  • operating characteristics include, but are not limited to, an energy consumption mode (e.g., full power mode, energy conservation mode, etc.), a speaker level, an antenna mode, a ringer mode (e.g., silent, vibrate, normal, loud), and a security mode (e.g., locked, restricted, unlocked).
  • an energy consumption mode e.g., full power mode, energy conservation mode, etc.
  • a speaker level e.g., a speaker level
  • an antenna mode e.g., a ringer mode (e.g., silent, vibrate, normal, loud)
  • a security mode e.g., locked, restricted, unlocked.
  • the command to switch to the first mode may include touching the command area ( 220 ), performing a given touch gesture in the GUI ( 200 ), selecting a button or control of the computing device ( 100 ), or any other like command. If it is determined at ST 332 that a command to switch to the first mode of the GUI has been received, then at ST 342 , the size of the status bar and status icons may be decreased.
  • the status icons may be moved to their original positions within the status bar (i.e., the positions in the first mode of the GUI).
  • the status bar ( 210 ) and status icons ( 215 ) shown in FIG. 2C may be decreased in size, resulting in the smaller status bar ( 210 ) and status icons ( 215 ) shown in FIG. 2A .
  • the status icons ( 215 ) may be returned to their first mode positions within the status bar ( 210 ) (i.e., as shown in FIG. 2A ).
  • the status icons included in the status bar may be made non-selectable by touch input.
  • command icons included in the GUI may be made selectable by touch input.
  • the command icons ( 225 ) may be returned to the appearance shown in FIG. 2A (e.g., not “grayed-out”), indicating that they are again selectable by touch input.
  • the GUI ( 200 ) may be configured to remain in the second mode for a specified timeout period, thereby providing the user ( 118 ) with time to make a selection of a status icon ( 215 ). After the timeout period has elapsed, the GUI ( 200 ) may automatically return to the first mode (i.e., as shown in FIG. 2A ). Alternatively, the GUI may remain in the second mode until an affirmative command to switch to the first mode is received.
  • embodiments of the invention may also include any other suitable user interface displays (e.g., cathode ray displays, liquid crystal displays, plasma displays, virtual reality goggles, etc.) and controls (e.g., computer mouse, light pen, keyboard, button, voice command, gestures, etc.).
  • user interface is described herein as being part of a portable computing device, embodiments of the invention may also include user interfaces of any other device (e.g., computers, televisions, printers, entertainment devices, etc.).

Abstract

A method for interacting with a computing device, involving presenting a first mode of a touch interface, where the touch interface is configured as a user interface of the computing device, where the touch interface comprises at least one status icon, and where in the first mode, the status icon is not selectable by touch input. The method further includes receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface; and in response to receiving the first input, presenting the user with the second mode of the touch interface, where in the second mode, the status icon is selectable by touch input, and where the status icon displays a corresponding status of the computing device.

Description

    BACKGROUND
  • Many small, hand-held computing devices include graphical user interfaces (GUIs) presented on touch screens. For example, many personal digital assistants, audio players, and mobile phones include touch screen GUIs. Typically, such touch screen GUIs include graphical elements (e.g., buttons, icons, etc.) that a user may select by touch input, thereby enabling the user to interact with the computing device. Such selectable graphical elements are referred to herein as “command icons.”
  • Further, a touch screen GUI may also include a status bar, i.e., a relatively thin horizontal area containing information describing the state of the computing device. For example, the touch screen GUI of a mobile phone may have a status bar including icons describing various states of the mobile phone (e.g., signal strength, battery level, ringer status, alarm mode, network status, etc.). Such icons included in the status bar are referred to herein as “status icons.” Typically, the status bar occupies a relatively small portion of the touch screen GUI and is not an interactive part of the GUI.
  • SUMMARY
  • In general, in one aspect, the invention relates to a method for interacting with a computing device, including presenting a first mode of a touch interface, wherein the touch interface is configured as a user interface of the computing device, wherein the touch interface comprises a status display portion and a command portion, wherein the status display portion comprises at least one status icon arranged in a first arrangement, wherein the command portion comprises at least one command icon, wherein selecting a command icon initiates a corresponding command action within the computing device, and wherein in the first mode, the at least one status icon is not selectable by touch input and the at least one command icon is selectable by touch input, receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface, and in response to receiving the first input, presenting the user with the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input, and wherein the at least one status icon displays a corresponding status of the computing device.
  • In general, in one aspect, the invention relates to a portable communications device, including a processor, a capacitive touch screen, and a computer usable storage medium having computer readable program code embodied therein. The computer readable program code is adapted to, when executed by the processor, implement a method for presenting a user interface, the method including displaying, on the capacitive touch screen, a first mode of a touch interface, wherein the touch interface is configured as a user interface of the portable communications device, wherein the touch interface comprises a status display portion and a command portion, wherein the status display portion comprises at least one status icon arranged in a first arrangement, wherein the command portion comprises at least one command icon, wherein selecting a command icon initiates a corresponding command action within the computing device, and wherein in the first mode, the at least one status icon is not selectable by touch input and the at least one command icon is selectable by touch input, receiving, from a user, a first touch input indicating a desire to switch from the first mode to a second mode of the touch interface, and in response to receiving the first touch input, displaying, on the capacitive touch screen, the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input and the at least one command icon is not selectable by touch input, wherein the at least one status icon displays a corresponding status of the computing device.
  • In general, in one aspect, the invention relates to a computer usable storage medium having computer readable program code embodied therein, the computer readable program code adapted to, when executed by the processor, implement a method for presenting a touch interface. The method includes presenting a first mode of the touch interface, wherein the touch interface is configured as a user interface of a computing device, wherein the touch interface comprises at least one status icon and wherein in the first mode, the at least one status icon is not selectable by touch input, receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface, and in response to receiving the first input, presenting the user with the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input, wherein the at least one status icon displays a corresponding status of the computing device.
  • Other aspects of the invention will be apparent from the following description and the appended claims.
  • BRIEF DESCRIPTION OF DRAWINGS
  • FIG. 1 shows a system in accordance with one or more embodiments of the invention.
  • FIGS. 2A-2C show a user interface in accordance with one or more embodiments of the invention.
  • FIGS. 3A-3D show flow charts in accordance with one or more embodiments of the invention.
  • DETAILED DESCRIPTION
  • Specific embodiments of the invention will now be described in detail with reference to the accompanying Figs. Like elements in the various Figs. are denoted by like reference numerals for consistency.
  • In the following detailed description of embodiments of the invention, numerous specific details are set forth in order to provide a more thorough understanding of the invention. However, it will be apparent to one of ordinary skill in the art that the invention may be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.
  • In general, embodiments of the invention relate to a method system for interacting with status information on a touch screen device. More specifically, embodiments of the invention relate to a method and system for interacting with the status icons in the status bar on a touch screen.
  • FIG. 1 shows a computing device in accordance with one or more embodiments of the invention. As shown in FIG. 1, the computing device (100) includes a touch screen (102), a processor (108), associated memory (110), an external communication device (116), and numerous other elements and functionalities typical of today's computing devices (not shown). The computing device (100) may be a computer system, a laptop, a media player (i.e., a portable television, a MP3 player, etc), a gaming device, a mobile phone (including a smart phone), a personal digital assistant, or any other suitable wired or wireless computing device.
  • The touch screen (102) may be a display screen configured to detect the presence and location of a touch within the screen area. That is, the touch screen (102) may provide output means (i.e., a visual display) and input means (i.e., user control via touch input) for the computing device (100). The touch screen (102) may utilize any suitable touch technology now known (e.g., electrical capacitance, electrical resistance, optical imaging, mechanical strain, etc.) or later developed. In one embodiment, the touch screen (102) may present a graphical user interface (GUI) for the computing device (100). An example of such a GUI is discussed in greater detail below with reference to FIGS. 2A-2C.
  • The computing device includes a processor (108) for executing applications and software instructions configured to perform various functionalities, and memory (110) for storing software instructions and application data. Software instructions (i.e., computer readable program code) adapted to perform embodiments of the invention may be stored on any tangible computer readable storage medium such as a compact disc (CD), a diskette, a tape, a memory stick such as a jump drive or a flash memory drive, or any other computer or machine readable storage device that can be read and executed by the processor (108) of the computing device. The memory (110) may be flash memory, a hard disk drive (HDD), random access memory (RAM), read-only memory (ROM), any other type of suitable storage space, or any combination thereof.
  • The external communication interface (116) may be an antenna, a serial port, a parallel port, a Universal Serial Bus (USB) interface, or any type of network interface connection, such as Bluetooth® (Bluetooth is a registered trademark of Bluetooth SIG, Inc.), infrared signal, etc. Further, the external communication interface may also support Global System for Mobile (GSM) communications, and 3G and/or 4G standards for mobile phone communication. In one or more embodiments of the invention, the computing device (100) may be connected to a local area network (LAN) or a wide area network (e.g., the Internet) (not shown) via the external communication interface (116). Further, the external communication interface (116) may support both wired and wireless interfaces.
  • The computing device (100) is typically associated with a user (118) using the computing device (100). For example, the user may be an individual, a company, an organization, a group of individuals, or another computing device. In one or more embodiments of the invention, the user (118) is an individual consumer that uses the computing device (100) as a personal electronic device.
  • FIGS. 2A-2C illustrate examples of a GUI (200) in accordance with one or more embodiments of the invention. In particular, FIGS. 2A-2C represent examples of the GUI (200) as displayed on a touch screen (e.g., the touch screen (102) shown in FIG. 1) of a computing device (e.g., the computing device (100) shown in FIG. 1). FIG. 2A illustrates a first mode of the GUI (200) in accordance with one or more embodiments of the invention. As shown, the GUI (200) may include a status bar (210) and a command area (220). In one or more embodiments, the status bar (210) may be an area of the GUI (200) that is reserved for the display of status icons (215). Each status icon (215) may be configured to display a corresponding status of the computing device. For example, status icons (215) may communicate a battery level, a current date and/or time, an antenna mode (e.g., enabled/disabled), a network signal level (e.g., no signal, weak signal, medium signal, strong signal), a volume level (e.g., very quiet, quiet, normal, above normal, loud), an alert, and/or any other suitable information associated with the status of the computing device. Those skilled in the art will appreciate that while FIG. 2A shows the status bar as being a horizontal bar located at the top of the GUI, the status bar may be displayed in any orientation (e.g., vertically) and may be located anywhere within the GUI.
  • The command area (220) may include command icons (225), each of which may be selected to initiate a corresponding command action. In one or more embodiments, each command icon (225) may be selectable by touch input (e.g., touching with a fingertip, with a stylus, etc.) on a touch screen. For example, the user (118) (shown in FIG. 1) may touch a specific command icon (225) displayed on the touch screen with a fingertip, thereby initiating a corresponding command action within the computing device. Such command actions may include, e.g., initiating a telephone call, opening a web browser, playing a song, viewing a calendar, and the like.
  • In one or more embodiments, the GUI (200) may be presented in two different modes. In the first mode (illustrated in FIG. 2A), the GUI (200) may be configured to allow the user (118) to interact with the command area (220) but not with the status bar (210). That is, in the first mode, the command icons (225) may be individually selected by touch input, but the status icons (215) may not be individually selectable by touch input. Optionally, the command icons (225) may be configured (e.g., shaped and/or sized) to facilitate selection by touch input (e.g., may be approximately the same size as a human fingertip). Further, the status icons (215) may be substantially smaller relative to the command icons (225). For example, in the first mode, the status icons (215) may be substantially smaller than the command icons (225), thereby enabling the status bar (210) to occupy a small portion of the GUI (200) relative to the command area (220).
  • In one or more embodiments, the GUI (200) may be selectively switched to a second mode (illustrated in FIG. 2C), such that the user using the computing device may interact with the status bar (210). More specifically, in the second mode, the status icons (215) are selectable by touch input, thereby enabling the user to access functionality (i.e., actions) corresponding to the status icons (215). Such functionality may include, e.g., displaying detailed device status information, providing access to device configuration screens, initiating an application, and the like. For example, selecting a status icon (215) communicating a battery level may result in displaying a power consumption configuration screen within the GUI (200). In another example, selecting a status icon (215) communicating an antenna mode may result in displaying a wireless network configuration screen within the GUI (200). The second mode of GUI (200) is described further below with reference to FIG. 2C.
  • FIG. 2B illustrates a situation in which the user enters a command to switch from the first mode to the second mode of the GUI (200), according to one or more embodiments of the invention. More specifically, the user has touched a portion of the status bar (210) to indicate a desire to switch the GUI (200) to the second mode. The area of contact of the user's finger (or stylus) is represented by a touch region (230). The touch region (230) may be located anywhere on the GUI (200). In one or more embodiments of the invention, the touch region (230) is completely within the status bar (210). Alternatively, the touch region (230) may be partially within the status bar (210) and partially outside of the status bar (210) (i.e., the touch region (230) may overlap with the status bar (210)). Further, the touch region (230) may be any shape, and is not limited to the circular shape that is shown in FIG. 2B. It should be noted that, because the GUI (200) is still in the first mode, any status icons (215) displayed within the touch region (230) are not selected by making contact with the touch region (230). In one or more embodiments, in response to the user's touch input within the touch region 230, the GUI (200) may be switched to the second mode. Optionally, the switch to the second mode begins only after the user's touch input is maintained for a specified, pre-determined time period. The specified, pre-determined time period may be set so as to prevent switching modes due to an accidental or unintended touch input within the status bar (210). Such a specified time period may be a default manufacturer setting, or may be a user defined setting.
  • FIG. 2C illustrates the second mode of the GUI (200) in accordance with one or more embodiments of the invention. As shown, the status bar (210) may include the same status icons (215) in the second mode as in the first mode. In one or more embodiments of the invention, in the second mode, the status icons (215) are selectable by the user (118). Accordingly, the status icons (215) presented in the second mode may be configured to facilitate selection by touch input. More specifically, in one or more embodiments, the status icons (215) displayed in the second mode may be sized and/or shaped to facilitate selection by touch input. For example, in the second mode, the status icons (215) may be larger than in the first mode. Further, in one or more embodiments, the area of the GUI occupied by the status bar (210) may be larger in the second mode than the area occupied by the status bar (210) in the first mode, thereby accommodating the increased size of the status icons (215). Correspondingly, in one or more embodiments, the size of the command area (220) may be decreased in the second mode, thereby providing space to accommodate the larger size of the status bar (210).
  • In one or more embodiments, the positions of the status icons (215) in the second mode may be different than the positions of the same status icons (215) in the first mode. For example, in the first mode (e.g., FIG. 2A), all of the status icons (215) may be arranged in a single row within the status bar (210). However, in the second mode (e.g., FIG. 2C), the status icons (215) may be arranged in multiple rows. Such changes in positions of the status icons (215) may be performed, e.g., in order to accommodate the larger sizes of the status icons (215) in the second mode. Further, in one or more embodiments, the change of position of the status icons (215) may be animated during transitions between the first and second modes. That is, as the GUI (200) transitions from the first mode to the second mode (or vice-versa), each status icon (215) may be shown in animated motion, gradually changing in position and size. Such animation may be configured so as to enable the user to track the changing positions of the status icons (215). In one or more embodiments of the invention, the status icons (215) may also stay in motion for a specified period of time when the GUI (200) transitions from the first mode to the second mode (or vice versa). For example, the status icons (215) may “dance” in place during the GUI (200) transition. In addition, one or more sounds may be associated with the status icons (215) while they are in motion during the GUI (200) transition.
  • As mentioned above, the command icons (225) may not be selectable in the second mode of the GUI (200). Optionally, in one or more embodiments, the command icons (225) are presented with a visual indicator communicating that they are not selectable. For example, as shown in FIG. 2C, while the GUI (200) is in the second mode, the command icons (225) may be presented with a “grayed out” font. Of course, those skilled in the art will appreciate that other visual indicators may be used, such as a text label, a symbol, a color effect, and the like.
  • FIGS. 3A-3D show flow charts for methods in accordance with one or more embodiments of the invention. In one or more embodiments of the invention, one or more of the steps described below may be omitted, repeated, performed in parallel, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIGS. 3A-3D should not be construed as limiting the scope of the invention.
  • FIG. 3A shows a flow chart for a method of interacting with a computing device, in accordance with one or more embodiments of the invention. Initially, a first mode of an interface is presented (ST 300). As described above, the first mode of the interface is defined as the status bar icons being non-selectable and the command area icons being selectable. At ST 310, a command to switch the interface to a second mode may be received. In one or more embodiments, the second mode of the interface may enable a user to access functionality that is not accessible in a first mode of the interface. ST 310 is described in greater detail below with reference to FIG. 3B.
  • In response to the command received at ST 310, the interface may be switched to the second mode (ST 320). ST 320 is described in greater detail below with reference to FIG. 3C. At ST 330, a user interaction during the second mode of the interface is received. For example, the user interaction received at ST 330 may be a command requesting functionality that is not accessible in a first mode of the interface (e.g., touching a status icon). In another example, the user interaction received at ST 330 may be a command requesting a return to the first mode of the GUI (200) (e.g., touching an area outside the status bar). At ST 340, any action(s) required by the user interaction may be performed. Optionally, ST 330 and ST 340 may be repeated for any further user interactions with the second mode of the GUI (200). ST 330 and ST 340 are described in greater detail below with reference to FIG. 3D.
  • FIG. 3B shows a flow chart for receiving a command to switch to a second mode of an interface, in accordance to one or more embodiments of the invention. In particular, FIG. 3B illustrates an exemplary expansion of the steps involved in performing ST 310 (shown in FIG. 3A) using a touch interface (e.g., the touch screen (102) shown in FIG. 1).
  • Initially, a touch input may be received within a status bar of a GUI (ST 311). In one or more embodiments, such a touch input may indicate a desire to switch to a second mode of the GUI. For example, referring to FIG. 2B, the user may touch the status bar (210) of the GUI (200), thereby indicating a desire to switch to a second mode of the GUI (200). In the example illustrated in FIG. 2B, the portion of the GUI (200) touched by the user is represented by the touch region (230). However, those skilled in the art will appreciate that the received touch input within a touch region may be an accidental and/or unintended touch on the touch region. Accordingly, before switching to the second mode of the GUI, additional steps may be performed to attempt to determine if the received touch input is valid or invalid.
  • At ST 312, feedback to the touch input (received at ST 311) is provided to the user. The feedback may be configured to alert the user that a transition to the second mode is beginning. The feedback may include, e.g., a visual indication (a color or animation effect, a text label, a symbol, etc.), a vibration, a sound indication, other like feedback, or any combination thereof. For example, in some situations, a user may touch the status bar inadvertently (i.e., without intending to switch to the second mode of the GUI). In such situations, the feedback may enable the user to terminate the touch input in the touch region, thereby avoiding switching to the second mode of the GUI.
  • At ST 313, a determination is made as to whether the touch input within the status bar is continued. If not, the process ends (i.e., the interface remains in the first mode). However, if it is determined at ST 313 that the touch input is continued, then at ST 314, the intensity of the feedback may be increased. For example, a vibration alert may become faster, a sound alert may become louder, etc. Next, it may be determined whether a time threshold for the touch input within the status bar has been reached (ST 315). In one or more embodiments, the duration of the time threshold may be predefined, such that accidental touching of the status bar does not result in an unintended switch to the second mode of the GUI. The time threshold may be user defined or set as a default manufacturer setting. For example, the time threshold may be predefined to be two seconds. If the time threshold has not been reached, then the process returns to ST 313. However, if the time threshold has been reached, then the process continues at ST 320 (shown in FIG. 3A). That is, if the duration of the touch input within the status bar is at least as long as the time threshold, then the touch input is considered to be a valid user command to switch to the second mode of the GUI.
  • FIG. 3C shows a flow chart for switching to the second mode of the interface, in accordance to one or more embodiments of the invention. In particular, FIG. 3C illustrates an exemplary expansion of the steps involved in performing ST 320 (shown in FIG. 3A) using a GUI displayed on a touch screen (e.g., the GUI (200) shown in FIGS. 2A-2C).
  • The process begins after receiving a command to switch to the second mode of the GUI (i.e., after ST 310 shown in FIG. 3A). At ST 321, the size of a status bar and status icons included in the GUI may be increased. At ST 322, the status icons may be moved to new positions within the status bar. For example, the status bar (210) and status icons (215) shown in FIG. 2A may be increased in size, resulting in the larger status bar (210) and status icons (215) shown in FIG. 2C. Further, the status icons (215) may be moved to new positions within the status bar (210), so as to accommodate the larger sizes of the status icons (215). Those skilled in the art will appreciate that the invention is not limited to indicating the second mode by a change in size and position of status icons. For example, in one or more embodiments of the invention, the second mode of the GUI may also be indicated by a change in color or background of the status bar, while the size and positions of the status icons remain the same as in the first mode of the GUI.
  • At ST 323, command icons included in the GUI may be made not selectable by touch input. At ST 324, the status icons included in the status bar may be made selectable by touch input. For example, as shown in FIG. 2C, the command icons (225) are “grayed-out,” indicating that they are not selectable by touch input in the second mode of the GUI (200). Further, the status icons (215) of the status bar (210) are made selectable by touch input. Alternatively, the second mode of the GUI may be defined by having both the command icons and the status icons selectable by touch input. After ST 324, the process continues at ST 330 (shown in FIG. 3A).
  • FIG. 3D shows a flow chart for receiving user interactions in the second mode of the interface, in accordance with one or more embodiments of the invention. In particular, FIG. 3D illustrates an exemplary expansion of the steps involved in performing ST 330 and ST 340 (shown in FIG. 3A) using a GUI displayed on a touch screen (e.g., the GUI (200) shown in FIGS. 2A-2C).
  • The process begins after the GUI has switched to a second mode (i.e., after ST 320 shown in FIG. 3A). Initially, it is determined whether a selection of a status icon has been received (ST 331). If so, then at ST 341, at least one action corresponding to the selected status icon is performed. In one embodiment of the invention, performing the at least one action includes modifying at least one operating characteristic of the computer device. For example, referring to FIG. 2C, the user may select a status icon (215) communicating an antenna mode. In response, the GUI (200) may present a dialog screen to configure a wireless network connection (e.g., a connection using the external communications interface (116) of the computing device (100) shown in FIG. 1). Other examples of operating characteristics that may be modified include, but are not limited to, an energy consumption mode (e.g., full power mode, energy conservation mode, etc.), a speaker level, an antenna mode, a ringer mode (e.g., silent, vibrate, normal, loud), and a security mode (e.g., locked, restricted, unlocked). After performing the action at ST 341, the process returns to ST 331, where it is determined if the user has selected another status icon. Alternatively, after ST 341, the process may continue at ST 342, meaning the GUI may automatically return to the first mode after performing the selected action.
  • However, if it is determined at ST 331 that a selection of a status icon has not been received, then, at ST 332, it is determined whether a command to switch to the first mode of the GUI has been received. For example, referring to FIG. 2C, the command to switch to the first mode may include touching the command area (220), performing a given touch gesture in the GUI (200), selecting a button or control of the computing device (100), or any other like command. If it is determined at ST 332 that a command to switch to the first mode of the GUI has been received, then at ST 342, the size of the status bar and status icons may be decreased. At ST 343, the status icons may be moved to their original positions within the status bar (i.e., the positions in the first mode of the GUI). For example, the status bar (210) and status icons (215) shown in FIG. 2C may be decreased in size, resulting in the smaller status bar (210) and status icons (215) shown in FIG. 2A. Further, the status icons (215) may be returned to their first mode positions within the status bar (210) (i.e., as shown in FIG. 2A).
  • At ST 344, the status icons included in the status bar may be made non-selectable by touch input. At ST 345, command icons included in the GUI may be made selectable by touch input. For example, the command icons (225) may be returned to the appearance shown in FIG. 2A (e.g., not “grayed-out”), indicating that they are again selectable by touch input. After ST 345, the process ends.
  • However, if it is determined at ST 332 that a command to switch to the first mode of the GUI has not been received, then, at ST 333, it is determined whether a specified timeout period has elapsed. If the specified timeout period has not yet elapsed, the process returns to wait for a selection of a status icon at ST 331. However, if it is determined that the timeout period has elapsed, the process may continue at ST 342. That is, if the timeout period has elapsed, the GUI may switch back to the first mode automatically (i.e., by performing ST 342, ST 343, ST 344, and ST 345). For example, referring to FIG. 2C, the GUI (200) may be configured to remain in the second mode for a specified timeout period, thereby providing the user (118) with time to make a selection of a status icon (215). After the timeout period has elapsed, the GUI (200) may automatically return to the first mode (i.e., as shown in FIG. 2A). Alternatively, the GUI may remain in the second mode until an affirmative command to switch to the first mode is received.
  • One of skill in the art will appreciate that the examples described above are for illustrative purposes only, and are not intended to limit of the invention. For example, while the user interface is described herein in terms of a touch screen, embodiments of the invention may also include any other suitable user interface displays (e.g., cathode ray displays, liquid crystal displays, plasma displays, virtual reality goggles, etc.) and controls (e.g., computer mouse, light pen, keyboard, button, voice command, gestures, etc.). Further, while the user interface is described herein as being part of a portable computing device, embodiments of the invention may also include user interfaces of any other device (e.g., computers, televisions, printers, entertainment devices, etc.).
  • While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein. Accordingly, the scope of the invention should be limited only by the attached claims.

Claims (20)

1. A method for interacting with a computing device, comprising:
presenting a first mode of a touch interface, wherein the touch interface is configured as a user interface of the computing device, wherein the touch interface comprises a status display portion and a command portion, wherein the status display portion comprises at least one status icon arranged in a first arrangement, wherein the command portion comprises at least one command icon, wherein selecting a command icon initiates a corresponding command action within the computing device, and wherein in the first mode, the at least one status icon is not selectable by touch input and the at least one command icon is selectable by touch input;
receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface; and
in response to receiving the first input, presenting the user with the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input, and
wherein the at least one status icon displays a corresponding status of the computing device.
2. The method of claim 1, wherein the touch interface is a capacitive touch screen configured to detect a finger touch.
3. The method of claim 1, further comprising, prior to presenting the user with the second mode:
providing the user with a feedback indication of the first input.
4. The method of claim 3, wherein the feedback indication is at least one selected from a group consisting of an auditory indication, a tactile indication, and a visual indication.
5. The method of claim 1, further comprising, prior to presenting the user with the second mode:
determining that a time duration of the first input has reached a predefined threshold.
6. The method of claim 1, wherein, in the second mode, the at least one command icon is not selectable by touch input.
7. The method of claim 1, wherein presenting the user with the second mode comprises increasing the size of the status display portion.
8. The method of claim 7, wherein presenting the user with the second mode further comprises decreasing the size of the command portion.
9. The method of claim 1, wherein presenting the user with the second mode comprises increasing the size of the at least one status icon.
10. The method of claim 1, wherein presenting the user with the second mode comprises rearranging the at least one status icon to a second arrangement within the status display portion.
11. The method of claim 10, wherein rearranging the at least one status icon comprises displaying an animated movement of the at least one status icon from the first arrangement to the second arrangement.
12. The method of claim 1, wherein the computing device is selected from a group consisting of a personal digital assistant, a media player, a gaming device, and a mobile phone.
13. The method of claim 1, further comprising, after presenting the user with the second mode:
receiving a selection of that least one status icon; and
performing at least one action corresponding to the selected status icon.
14. The method of claim 13, wherein performing the at least one action comprises modifying at least one operating characteristic of the computing device.
15. The method of claim 14, wherein the at least one operating characteristic of the computing device is selected from a group consisting of an energy consumption mode, a speaker level, an antenna mode, a ringer mode, a network connection, and a security mode.
16. The method of claim 15, further comprising, after receiving the selection of the at least one status icon, presenting the user with the first mode, wherein presenting the user with the first mode comprises performing at least one selected from a group consisting of decreasing the size of the status display portion, increasing the size of the command portion, reducing the size of the at least one status icon, and returning the at least one status icon to the first arrangement within the status display portion.
17. A portable communications device, comprising:
a processor;
a capacitive touch screen; and
a computer usable storage medium having computer readable program code embodied therein, the computer readable program code adapted to, when executed by the processor, implement a method for presenting a user interface, the method comprising:
displaying, on the capacitive touch screen, a first mode of a touch interface, wherein the touch interface is configured as a user interface of the portable communications device, wherein the touch interface comprises a status display portion and a command portion, wherein the status display portion comprises at least one status icon arranged in a first arrangement, wherein the command portion comprises at least one command icon, wherein selecting a command icon initiates a corresponding command action within the computing device, and wherein in the first mode, the at least one status icon is not selectable by touch input and the at least one command icon is selectable by touch input;
receiving, from a user, a first touch input indicating a desire to switch from the first mode to a second mode of the touch interface; and
in response to receiving the first touch input, displaying, on the capacitive touch screen, the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input and the at least one command icon is not selectable by touch input,
wherein the at least one status icon displays a corresponding status of the computing device.
18. The portable communications device of claim 17, wherein the status display portion and the command portion are distinct two-dimensional areas of the touch interface.
19. A computer usable storage medium having computer readable program code embodied therein, the computer readable program code adapted to, when executed by the processor, implement a method for presenting a touch interface, the method comprising:
presenting a first mode of the touch interface, wherein the touch interface is configured as a user interface of a computing device, wherein the touch interface comprises at least one status icon and wherein in the first mode, the at least one status icon is not selectable by touch input;
receiving, from a user using the computing device, a first input indicating a desire to switch from the first mode to a second mode of the touch interface; and
in response to receiving the first input, presenting the user with the second mode of the touch interface, wherein in the second mode, the at least one status icon is selectable by touch input,
wherein the at least one status icon displays a corresponding status of the computing device.
20. The computer usable storage medium of claim 19, wherein the method further comprises, after presenting the user with the second mode:
receiving a selection of that least one status icon; and
performing at least one action corresponding to the selected status icon,
wherein performing the at least one action comprises modifying at least one operating characteristic of the computing device,
wherein the at least one operating characteristic of the computing device is selected from a group consisting of an energy consumption mode, a speaker level, an antenna mode, a ringer mode, a network connection, and a security mode.
US12/404,198 2009-03-13 2009-03-13 System and method for interacting with status information on a touch screen device Active 2030-06-15 US8286106B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/404,198 US8286106B2 (en) 2009-03-13 2009-03-13 System and method for interacting with status information on a touch screen device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/404,198 US8286106B2 (en) 2009-03-13 2009-03-13 System and method for interacting with status information on a touch screen device

Publications (2)

Publication Number Publication Date
US20100235732A1 true US20100235732A1 (en) 2010-09-16
US8286106B2 US8286106B2 (en) 2012-10-09

Family

ID=42731700

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/404,198 Active 2030-06-15 US8286106B2 (en) 2009-03-13 2009-03-13 System and method for interacting with status information on a touch screen device

Country Status (1)

Country Link
US (1) US8286106B2 (en)

Cited By (181)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070192509A1 (en) * 2006-02-14 2007-08-16 Casio Computer Co., Ltd. Server apparatuses, server control programs, and client apparatuses in a computer system
US20070211066A1 (en) * 2006-03-09 2007-09-13 Casio Computer Co., Ltd. Screen display control apparatus and program product
US20090083847A1 (en) * 2007-09-24 2009-03-26 Apple Inc. Embedded authentication systems in an electronic device
US20090241057A1 (en) * 2008-03-18 2009-09-24 Casio Computer Co., Ltd. Server unit, a client unit, and a recording medium in a computer system
US20090249247A1 (en) * 2008-01-30 2009-10-01 Erick Tseng Notification of Mobile Device Events
US20100250660A1 (en) * 2009-03-24 2010-09-30 Casio Computer Co., Ltd. Client apparatus, computer system, computer readable program storage medium and display method, each for detecting change of display contents in status bar area to display the change
US20100295797A1 (en) * 2009-05-21 2010-11-25 Sony Computer Entertainment America Inc. Continuous and dynamic scene decomposition for user interface
US20110151929A1 (en) * 2009-12-22 2011-06-23 At&T Intellectual Property I, L.P. Simplified control input to a mobile device
US20120023573A1 (en) * 2010-07-23 2012-01-26 Jianxiong Jason Shi Method, apparatus and system for access mode control of a device
US20120137253A1 (en) * 2010-11-29 2012-05-31 Samsung Electronics Co., Ltd. Portable device and method for providing user interface mode thereof
US20120146929A1 (en) * 2009-08-18 2012-06-14 Canon Kabushiki Kaisha Information processing apparatus, control method therefor, program, and recording medium
CN102750071A (en) * 2011-04-22 2012-10-24 上海三旗通信科技股份有限公司 Mobile touch screen terminal identification interactive way
US20130036377A1 (en) * 2011-08-05 2013-02-07 Nokia Corporation Controlling responsiveness to user inputs
CN103257781A (en) * 2012-02-16 2013-08-21 腾讯科技(深圳)有限公司 Setting method and setting system of equipment status
CN103440091A (en) * 2013-08-07 2013-12-11 广东明创软件科技有限公司 Method for realizing shortcut operation and mobile terminal
US20140006988A1 (en) * 2011-04-15 2014-01-02 Sharp Kabushiki Kaisha Content display device, content display method, program, and recording medium
US8626095B1 (en) * 2012-11-29 2014-01-07 Lg Electronics Inc. Mobile device and method for controlling the same
US8627237B2 (en) 2005-12-23 2014-01-07 Apple Inc. Unlocking a device by performing gestures on an unlock image
US20140028574A1 (en) * 2012-07-26 2014-01-30 Nvidia Corporation Techniques for latching input events to display flips
CN103577045A (en) * 2013-10-15 2014-02-12 广东欧珀移动通信有限公司 Method for self-defining status bar of mobile phone
CN103677535A (en) * 2013-12-04 2014-03-26 广东欧珀移动通信有限公司 Operating method and device of status bar of intelligent terminal
US20140245202A1 (en) * 2013-02-22 2014-08-28 Samsung Electronics Co., Ltd. Method and apparatus for providing user interface in portable terminal
US20140293340A1 (en) * 2013-03-28 2014-10-02 Kyocera Document Solutions Inc. Display operation device, display operation method, and non-transitory computer-readable recording medium capable of preventing operation error on panel
US20140292727A1 (en) * 2013-03-28 2014-10-02 Fujitsu Limited Terminal device and key entry method
US20140317027A1 (en) * 2011-03-25 2014-10-23 Microsoft Corporation Contextually-Appropriate Task Reminders
US20150056974A1 (en) * 2013-08-23 2015-02-26 Samsung Electronics Co., Ltd. Portable device and method for restricting use of portable device
US9092132B2 (en) 2011-01-24 2015-07-28 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
US9128614B2 (en) 2010-11-05 2015-09-08 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9146673B2 (en) 2010-11-05 2015-09-29 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US20150277654A1 (en) * 2014-03-26 2015-10-01 Kyocera Corporation Mobile terminal and method for controlling mobile terminal
US20150346944A1 (en) * 2012-12-04 2015-12-03 Zte Corporation Method and system for implementing suspending global button on interface of touch screen terminal
US20150348551A1 (en) * 2014-05-30 2015-12-03 Apple Inc. Multi-command single utterance input method
US9213822B2 (en) 2012-01-20 2015-12-15 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
US20150378590A1 (en) * 2014-06-25 2015-12-31 Lg Electronics Inc. Mobile terminal and controlling method thereof
US9342181B2 (en) 2012-01-09 2016-05-17 Nvidia Corporation Touch-screen input/output device touch sensing techniques
US20160173668A1 (en) * 2014-12-16 2016-06-16 Xiaomi Inc. Method and device for activating an operating state of a mobile terminal
US9507470B2 (en) 2013-12-16 2016-11-29 Nvidia Corporation Method and system for reduced power touch input detection on an electronic device using reduced scanning
US9525769B1 (en) 2007-11-09 2016-12-20 Google Inc. Providing interactive alert information
US9668024B2 (en) 2014-06-30 2017-05-30 Apple Inc. Intelligent automated assistant for TV user interactions
US20170185290A1 (en) * 2012-08-21 2017-06-29 Samsung Electronics Co., Ltd Method for changing display range and electronic device thereof
US9823728B2 (en) 2013-09-04 2017-11-21 Nvidia Corporation Method and system for reduced rate touch scanning on an electronic device
US9865248B2 (en) 2008-04-05 2018-01-09 Apple Inc. Intelligent text-to-speech conversion
US9881592B2 (en) 2013-10-08 2018-01-30 Nvidia Corporation Hardware overlay assignment
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9959027B1 (en) * 2017-07-03 2018-05-01 Essential Products, Inc. Displaying an image on an irregular screen
US9966060B2 (en) 2013-06-07 2018-05-08 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9971774B2 (en) 2012-09-19 2018-05-15 Apple Inc. Voice-based media searching
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US9986419B2 (en) 2014-09-30 2018-05-29 Apple Inc. Social reminders
US10009027B2 (en) 2013-06-04 2018-06-26 Nvidia Corporation Three state latch
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10049675B2 (en) 2010-02-25 2018-08-14 Apple Inc. User profiling for voice input processing
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10079014B2 (en) 2012-06-08 2018-09-18 Apple Inc. Name recognition system
US10083690B2 (en) 2014-05-30 2018-09-25 Apple Inc. Better resolution when referencing to concepts
CN108595074A (en) * 2018-04-28 2018-09-28 北京小米移动软件有限公司 Status bar operating method, device and computer readable storage medium
US10089072B2 (en) 2016-06-11 2018-10-02 Apple Inc. Intelligent device arbitration and control
US10108612B2 (en) 2008-07-31 2018-10-23 Apple Inc. Mobile device having human language translation capability with positional feedback
US10169329B2 (en) 2014-05-30 2019-01-01 Apple Inc. Exemplar-based natural language processing
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10235665B2 (en) * 2015-09-24 2019-03-19 Casio Computer Co., Ltd. Sales data processing apparatus and sales data processing method
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10269345B2 (en) 2016-06-11 2019-04-23 Apple Inc. Intelligent task discovery
US10283110B2 (en) 2009-07-02 2019-05-07 Apple Inc. Methods and apparatuses for automatic speech recognition
US10297253B2 (en) 2016-06-11 2019-05-21 Apple Inc. Application integration with a digital assistant
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10311871B2 (en) 2015-03-08 2019-06-04 Apple Inc. Competing devices responding to voice triggers
US10318871B2 (en) 2005-09-08 2019-06-11 Apple Inc. Method and apparatus for building an intelligent automated assistant
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10354011B2 (en) 2016-06-09 2019-07-16 Apple Inc. Intelligent automated assistant in a home environment
US10356243B2 (en) 2015-06-05 2019-07-16 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10381016B2 (en) 2008-01-03 2019-08-13 Apple Inc. Methods and apparatus for altering audio output signals
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
US10417405B2 (en) 2011-03-21 2019-09-17 Apple Inc. Device access using voice authentication
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10431204B2 (en) 2014-09-11 2019-10-01 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10438595B2 (en) 2014-09-30 2019-10-08 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10453443B2 (en) 2014-09-30 2019-10-22 Apple Inc. Providing an indication of the suitability of speech recognition
US10462345B2 (en) 2017-08-11 2019-10-29 Essential Products, Inc. Deformable structure that compensates for displacement of a camera module of a camera accessory
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10521466B2 (en) 2016-06-11 2019-12-31 Apple Inc. Data driven natural language event detection and classification
US10529332B2 (en) 2015-03-08 2020-01-07 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10643611B2 (en) 2008-10-02 2020-05-05 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10657961B2 (en) 2013-06-08 2020-05-19 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10684703B2 (en) 2018-06-01 2020-06-16 Apple Inc. Attention aware virtual assistant dismissal
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10699717B2 (en) 2014-05-30 2020-06-30 Apple Inc. Intelligent assistant for home automation
US10706841B2 (en) 2010-01-18 2020-07-07 Apple Inc. Task flow identification based on user intent
US10714117B2 (en) 2013-02-07 2020-07-14 Apple Inc. Voice trigger for a digital assistant
EP3664424A4 (en) * 2017-08-18 2020-07-15 Huawei Technologies Co., Ltd. Display method and terminal
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10733993B2 (en) 2016-06-10 2020-08-04 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10741185B2 (en) 2010-01-18 2020-08-11 Apple Inc. Intelligent automated assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10748546B2 (en) 2017-05-16 2020-08-18 Apple Inc. Digital assistant services based on device capabilities
US10755703B2 (en) 2017-05-11 2020-08-25 Apple Inc. Offline personal assistant
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
CN111596982A (en) * 2020-04-20 2020-08-28 维沃移动通信有限公司 Display method, display device and electronic equipment
US10769385B2 (en) 2013-06-09 2020-09-08 Apple Inc. System and method for inferring user intent from speech inputs
US10791176B2 (en) 2017-05-12 2020-09-29 Apple Inc. Synchronization and task delegation of a digital assistant
US10789945B2 (en) 2017-05-12 2020-09-29 Apple Inc. Low-latency intelligent automated assistant
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10795541B2 (en) 2009-06-05 2020-10-06 Apple Inc. Intelligent organization of tasks items
US10810274B2 (en) 2017-05-15 2020-10-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11010127B2 (en) 2015-06-29 2021-05-18 Apple Inc. Virtual assistant for media playback
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US11023513B2 (en) 2007-12-20 2021-06-01 Apple Inc. Method and apparatus for searching using an active ontology
US11048473B2 (en) 2013-06-09 2021-06-29 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US11069336B2 (en) 2012-03-02 2021-07-20 Apple Inc. Systems and methods for name pronunciation
US11080012B2 (en) 2009-06-05 2021-08-03 Apple Inc. Interface for a virtual digital assistant
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US11127397B2 (en) 2015-05-27 2021-09-21 Apple Inc. Device voice control
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11165963B2 (en) 2011-06-05 2021-11-02 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US11217251B2 (en) 2019-05-06 2022-01-04 Apple Inc. Spoken notifications
US11221734B2 (en) * 2019-10-30 2022-01-11 Beijing Xiaomi Mobile Software Co., Ltd. Punch-hole screen display method and apparatus
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US11231904B2 (en) 2015-03-06 2022-01-25 Apple Inc. Reducing response latency of intelligent automated assistants
US11237797B2 (en) 2019-05-31 2022-02-01 Apple Inc. User activity shortcut suggestions
US11269678B2 (en) 2012-05-15 2022-03-08 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11314370B2 (en) 2013-12-06 2022-04-26 Apple Inc. Method for extracting salient dialog usage from live data
US11340759B2 (en) * 2013-04-26 2022-05-24 Samsung Electronics Co., Ltd. User terminal device with pen and controlling method thereof
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11350253B2 (en) 2011-06-03 2022-05-31 Apple Inc. Active transport based notifications
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11468282B2 (en) 2015-05-15 2022-10-11 Apple Inc. Virtual assistant in a communication session
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11495218B2 (en) 2018-06-01 2022-11-08 Apple Inc. Virtual assistant operation in multi-device environments
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11532306B2 (en) 2017-05-16 2022-12-20 Apple Inc. Detecting a trigger of a digital assistant
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11657813B2 (en) 2019-05-31 2023-05-23 Apple Inc. Voice identification in digital assistant systems
US11747969B1 (en) * 2022-05-06 2023-09-05 Apple Inc. Devices, methods, and graphical user interfaces for updating a session region
US11798547B2 (en) 2013-03-15 2023-10-24 Apple Inc. Voice activated device for use with a voice-based digital assistant
US20230341958A1 (en) * 2017-07-18 2023-10-26 Apple Inc. Concealable input region for an electronic device
US11899925B2 (en) * 2017-05-16 2024-02-13 Apple Inc. Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
US11960615B2 (en) 2021-06-06 2024-04-16 Apple Inc. Methods and user interfaces for voice-based user profile management

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130142301A (en) * 2012-06-19 2013-12-30 삼성전자주식회사 Device and method for setting menu environment in terminal
CN104679392B (en) * 2013-11-27 2019-08-13 腾讯科技(上海)有限公司 Page display method and device based on status bar
CN104571806A (en) * 2014-02-01 2015-04-29 北京智膜科技有限公司 Interface level control method of intelligent information equipment
US10395426B2 (en) * 2015-12-23 2019-08-27 EMC IP Holding Company LLC Augmented reality system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6750803B2 (en) * 2001-02-23 2004-06-15 Interlink Electronics, Inc. Transformer remote control
US20050024341A1 (en) * 2001-05-16 2005-02-03 Synaptics, Inc. Touch screen with user interface enhancement
US20080104639A1 (en) * 2006-10-26 2008-05-01 Yoon Sang-Mi Method for displaying broadcast-related information in mobile terminal capable of broadcast reception and mobile terminal implementing the same
US20080158189A1 (en) * 2006-12-29 2008-07-03 Sang-Hoon Kim Display device and method of mobile terminal
US20080163082A1 (en) * 2006-12-29 2008-07-03 Nokia Corporation Transparent layer application
US7479949B2 (en) * 2006-09-06 2009-01-20 Apple Inc. Touch screen device, method, and graphical user interface for determining commands by applying heuristics

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6750803B2 (en) * 2001-02-23 2004-06-15 Interlink Electronics, Inc. Transformer remote control
US20050024341A1 (en) * 2001-05-16 2005-02-03 Synaptics, Inc. Touch screen with user interface enhancement
US7479949B2 (en) * 2006-09-06 2009-01-20 Apple Inc. Touch screen device, method, and graphical user interface for determining commands by applying heuristics
US20080104639A1 (en) * 2006-10-26 2008-05-01 Yoon Sang-Mi Method for displaying broadcast-related information in mobile terminal capable of broadcast reception and mobile terminal implementing the same
US20080158189A1 (en) * 2006-12-29 2008-07-03 Sang-Hoon Kim Display device and method of mobile terminal
US20080163082A1 (en) * 2006-12-29 2008-07-03 Nokia Corporation Transparent layer application

Cited By (288)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10318871B2 (en) 2005-09-08 2019-06-11 Apple Inc. Method and apparatus for building an intelligent automated assistant
US11928604B2 (en) 2005-09-08 2024-03-12 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8694923B2 (en) 2005-12-23 2014-04-08 Apple Inc. Unlocking a device by performing gestures on an unlock image
US10078439B2 (en) 2005-12-23 2018-09-18 Apple Inc. Unlocking a device by performing gestures on an unlock image
US11669238B2 (en) 2005-12-23 2023-06-06 Apple Inc. Unlocking a device by performing gestures on an unlock image
US8627237B2 (en) 2005-12-23 2014-01-07 Apple Inc. Unlocking a device by performing gestures on an unlock image
US11086507B2 (en) 2005-12-23 2021-08-10 Apple Inc. Unlocking a device by performing gestures on an unlock image
US10754538B2 (en) 2005-12-23 2020-08-25 Apple Inc. Unlocking a device by performing gestures on an unlock image
US8918450B2 (en) 2006-02-14 2014-12-23 Casio Computer Co., Ltd Server apparatuses, server control programs, and client apparatuses for a computer system in which created drawing data is transmitted to the client apparatuses
US20070192509A1 (en) * 2006-02-14 2007-08-16 Casio Computer Co., Ltd. Server apparatuses, server control programs, and client apparatuses in a computer system
US20070211066A1 (en) * 2006-03-09 2007-09-13 Casio Computer Co., Ltd. Screen display control apparatus and program product
US9329771B2 (en) 2007-09-24 2016-05-03 Apple Inc Embedded authentication systems in an electronic device
US9128601B2 (en) 2007-09-24 2015-09-08 Apple Inc. Embedded authentication systems in an electronic device
US9304624B2 (en) 2007-09-24 2016-04-05 Apple Inc. Embedded authentication systems in an electronic device
US9274647B2 (en) 2007-09-24 2016-03-01 Apple Inc. Embedded authentication systems in an electronic device
US9250795B2 (en) 2007-09-24 2016-02-02 Apple Inc. Embedded authentication systems in an electronic device
US11468155B2 (en) 2007-09-24 2022-10-11 Apple Inc. Embedded authentication systems in an electronic device
US9134896B2 (en) 2007-09-24 2015-09-15 Apple Inc. Embedded authentication systems in an electronic device
US9495531B2 (en) 2007-09-24 2016-11-15 Apple Inc. Embedded authentication systems in an electronic device
US9519771B2 (en) 2007-09-24 2016-12-13 Apple Inc. Embedded authentication systems in an electronic device
US10275585B2 (en) 2007-09-24 2019-04-30 Apple Inc. Embedded authentication systems in an electronic device
US9038167B2 (en) 2007-09-24 2015-05-19 Apple Inc. Embedded authentication systems in an electronic device
US10956550B2 (en) 2007-09-24 2021-03-23 Apple Inc. Embedded authentication systems in an electronic device
US8943580B2 (en) 2007-09-24 2015-01-27 Apple Inc. Embedded authentication systems in an electronic device
US9953152B2 (en) 2007-09-24 2018-04-24 Apple Inc. Embedded authentication systems in an electronic device
US20090083847A1 (en) * 2007-09-24 2009-03-26 Apple Inc. Embedded authentication systems in an electronic device
US8782775B2 (en) 2007-09-24 2014-07-15 Apple Inc. Embedded authentication systems in an electronic device
US10306049B1 (en) 2007-11-09 2019-05-28 Google Llc Providing interactive alert information
US9525769B1 (en) 2007-11-09 2016-12-20 Google Inc. Providing interactive alert information
US11023513B2 (en) 2007-12-20 2021-06-01 Apple Inc. Method and apparatus for searching using an active ontology
US10381016B2 (en) 2008-01-03 2019-08-13 Apple Inc. Methods and apparatus for altering audio output signals
US9191486B2 (en) 2008-01-30 2015-11-17 Google Inc. Notification of mobile device events
US9154606B2 (en) * 2008-01-30 2015-10-06 Google Inc. Notification of mobile device events
US11477317B2 (en) 2008-01-30 2022-10-18 Google Llc Notification of mobile device events
US10027793B2 (en) 2008-01-30 2018-07-17 Google Llc Notification of mobile device events
US10855830B2 (en) 2008-01-30 2020-12-01 Google Llc Notification of mobile device events
US20090249247A1 (en) * 2008-01-30 2009-10-01 Erick Tseng Notification of Mobile Device Events
US8683376B2 (en) 2008-03-18 2014-03-25 Casio Computer Co., Ltd Server unit, a client unit, and a recording medium in a computer system
US20090241057A1 (en) * 2008-03-18 2009-09-24 Casio Computer Co., Ltd. Server unit, a client unit, and a recording medium in a computer system
US9865248B2 (en) 2008-04-05 2018-01-09 Apple Inc. Intelligent text-to-speech conversion
US10108612B2 (en) 2008-07-31 2018-10-23 Apple Inc. Mobile device having human language translation capability with positional feedback
US11348582B2 (en) 2008-10-02 2022-05-31 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10643611B2 (en) 2008-10-02 2020-05-05 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US20100250660A1 (en) * 2009-03-24 2010-09-30 Casio Computer Co., Ltd. Client apparatus, computer system, computer readable program storage medium and display method, each for detecting change of display contents in status bar area to display the change
US8620997B2 (en) * 2009-03-24 2013-12-31 Casio Computer Co., Ltd Client apparatus, computer system, computer readable program storage medium and display method, each for detecting change of display contents in status bar area to display the change
US9927964B2 (en) 2009-05-21 2018-03-27 Sony Computer Entertainment Inc. Customization of GUI layout based on history of use
US20100295797A1 (en) * 2009-05-21 2010-11-25 Sony Computer Entertainment America Inc. Continuous and dynamic scene decomposition for user interface
US10705692B2 (en) * 2009-05-21 2020-07-07 Sony Interactive Entertainment Inc. Continuous and dynamic scene decomposition for user interface
US11080012B2 (en) 2009-06-05 2021-08-03 Apple Inc. Interface for a virtual digital assistant
US10795541B2 (en) 2009-06-05 2020-10-06 Apple Inc. Intelligent organization of tasks items
US10283110B2 (en) 2009-07-02 2019-05-07 Apple Inc. Methods and apparatuses for automatic speech recognition
US20120146929A1 (en) * 2009-08-18 2012-06-14 Canon Kabushiki Kaisha Information processing apparatus, control method therefor, program, and recording medium
US10168829B2 (en) * 2009-08-18 2019-01-01 Canon Kabushiki Kaisha Information processing apparatus, control method therefor, program, and recording medium
US20110151929A1 (en) * 2009-12-22 2011-06-23 At&T Intellectual Property I, L.P. Simplified control input to a mobile device
US9047052B2 (en) * 2009-12-22 2015-06-02 At&T Intellectual Property I, L.P. Simplified control input to a mobile device
US9762717B2 (en) 2009-12-22 2017-09-12 At&T Intellectual Property I, L.P. Simplified control input to a mobile device
US9992320B2 (en) 2009-12-22 2018-06-05 At&T Intellectual Property I, L.P. Simplified control input to a mobile device
US10741185B2 (en) 2010-01-18 2020-08-11 Apple Inc. Intelligent automated assistant
US10706841B2 (en) 2010-01-18 2020-07-07 Apple Inc. Task flow identification based on user intent
US11423886B2 (en) 2010-01-18 2022-08-23 Apple Inc. Task flow identification based on user intent
US10692504B2 (en) 2010-02-25 2020-06-23 Apple Inc. User profiling for voice input processing
US10049675B2 (en) 2010-02-25 2018-08-14 Apple Inc. User profiling for voice input processing
US8528072B2 (en) * 2010-07-23 2013-09-03 Apple Inc. Method, apparatus and system for access mode control of a device
US9740832B2 (en) 2010-07-23 2017-08-22 Apple Inc. Method, apparatus and system for access mode control of a device
US20120023573A1 (en) * 2010-07-23 2012-01-26 Jianxiong Jason Shi Method, apparatus and system for access mode control of a device
US9128614B2 (en) 2010-11-05 2015-09-08 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9146673B2 (en) 2010-11-05 2015-09-29 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US20120137253A1 (en) * 2010-11-29 2012-05-31 Samsung Electronics Co., Ltd. Portable device and method for providing user interface mode thereof
US9965168B2 (en) * 2010-11-29 2018-05-08 Samsung Electronics Co., Ltd Portable device and method for providing user interface mode thereof
US10956028B2 (en) 2010-11-29 2021-03-23 Samsung Electronics Co. , Ltd Portable device and method for providing user interface mode thereof
US9092132B2 (en) 2011-01-24 2015-07-28 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
US10417405B2 (en) 2011-03-21 2019-09-17 Apple Inc. Device access using voice authentication
US9111233B2 (en) * 2011-03-25 2015-08-18 Microsoft Technology Licensing, Llc Contextually-appropriate task reminders
US20140317027A1 (en) * 2011-03-25 2014-10-23 Microsoft Corporation Contextually-Appropriate Task Reminders
US20140006988A1 (en) * 2011-04-15 2014-01-02 Sharp Kabushiki Kaisha Content display device, content display method, program, and recording medium
CN102750071A (en) * 2011-04-22 2012-10-24 上海三旗通信科技股份有限公司 Mobile touch screen terminal identification interactive way
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US11350253B2 (en) 2011-06-03 2022-05-31 Apple Inc. Active transport based notifications
US11165963B2 (en) 2011-06-05 2021-11-02 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
CN102929522A (en) * 2011-08-05 2013-02-13 诺基亚公司 Controlling responsiveness to user inputs
US20130036377A1 (en) * 2011-08-05 2013-02-07 Nokia Corporation Controlling responsiveness to user inputs
US9746954B2 (en) 2012-01-09 2017-08-29 Nvidia Corporation Touch-screen input/output device touch sensing techniques
US9342181B2 (en) 2012-01-09 2016-05-17 Nvidia Corporation Touch-screen input/output device touch sensing techniques
US10007802B2 (en) 2012-01-20 2018-06-26 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
US9213822B2 (en) 2012-01-20 2015-12-15 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
US10867059B2 (en) 2012-01-20 2020-12-15 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
US9372978B2 (en) 2012-01-20 2016-06-21 Apple Inc. Device, method, and graphical user interface for accessing an application in a locked device
CN103257781A (en) * 2012-02-16 2013-08-21 腾讯科技(深圳)有限公司 Setting method and setting system of equipment status
US11069336B2 (en) 2012-03-02 2021-07-20 Apple Inc. Systems and methods for name pronunciation
US11269678B2 (en) 2012-05-15 2022-03-08 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US10079014B2 (en) 2012-06-08 2018-09-18 Apple Inc. Name recognition system
US9823935B2 (en) * 2012-07-26 2017-11-21 Nvidia Corporation Techniques for latching input events to display flips
US20140028574A1 (en) * 2012-07-26 2014-01-30 Nvidia Corporation Techniques for latching input events to display flips
US9851898B2 (en) * 2012-08-21 2017-12-26 Samsung Electronics Co., Ltd. Method for changing display range and electronic device thereof
US20170185290A1 (en) * 2012-08-21 2017-06-29 Samsung Electronics Co., Ltd Method for changing display range and electronic device thereof
US9971774B2 (en) 2012-09-19 2018-05-15 Apple Inc. Voice-based media searching
US9106765B2 (en) 2012-11-29 2015-08-11 Lg Electronics Inc. Mobile device and method for controlling the same
US9509834B2 (en) 2012-11-29 2016-11-29 Lg Electronics Inc. Mobile device and method for controlling the same
US8824985B2 (en) 2012-11-29 2014-09-02 Lg Electronics Inc. Mobile device and method for controlling the same
US8862079B2 (en) 2012-11-29 2014-10-14 Lg Electronics Inc. Mobile device and method for controlling the same
US8626095B1 (en) * 2012-11-29 2014-01-07 Lg Electronics Inc. Mobile device and method for controlling the same
US20150346944A1 (en) * 2012-12-04 2015-12-03 Zte Corporation Method and system for implementing suspending global button on interface of touch screen terminal
US10978090B2 (en) 2013-02-07 2021-04-13 Apple Inc. Voice trigger for a digital assistant
US10714117B2 (en) 2013-02-07 2020-07-14 Apple Inc. Voice trigger for a digital assistant
US20140245202A1 (en) * 2013-02-22 2014-08-28 Samsung Electronics Co., Ltd. Method and apparatus for providing user interface in portable terminal
US9645730B2 (en) * 2013-02-22 2017-05-09 Samsung Electronics Co., Ltd. Method and apparatus for providing user interface in portable terminal
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US11798547B2 (en) 2013-03-15 2023-10-24 Apple Inc. Voice activated device for use with a voice-based digital assistant
US20140293340A1 (en) * 2013-03-28 2014-10-02 Kyocera Document Solutions Inc. Display operation device, display operation method, and non-transitory computer-readable recording medium capable of preventing operation error on panel
US20140292727A1 (en) * 2013-03-28 2014-10-02 Fujitsu Limited Terminal device and key entry method
US9189103B2 (en) * 2013-03-28 2015-11-17 Fujitsu Limited Terminal device and key entry method for preventing erroneous entry in key entry
US11340759B2 (en) * 2013-04-26 2022-05-24 Samsung Electronics Co., Ltd. User terminal device with pen and controlling method thereof
US10009027B2 (en) 2013-06-04 2018-06-26 Nvidia Corporation Three state latch
US9966060B2 (en) 2013-06-07 2018-05-08 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US10657961B2 (en) 2013-06-08 2020-05-19 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US11727219B2 (en) 2013-06-09 2023-08-15 Apple Inc. System and method for inferring user intent from speech inputs
US11048473B2 (en) 2013-06-09 2021-06-29 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10769385B2 (en) 2013-06-09 2020-09-08 Apple Inc. System and method for inferring user intent from speech inputs
CN103440091A (en) * 2013-08-07 2013-12-11 广东明创软件科技有限公司 Method for realizing shortcut operation and mobile terminal
US20150056974A1 (en) * 2013-08-23 2015-02-26 Samsung Electronics Co., Ltd. Portable device and method for restricting use of portable device
US9948763B2 (en) * 2013-08-23 2018-04-17 Samsung Electronics Co., Ltd. Portable device and method for restricting use of portable device
US9823728B2 (en) 2013-09-04 2017-11-21 Nvidia Corporation Method and system for reduced rate touch scanning on an electronic device
US9881592B2 (en) 2013-10-08 2018-01-30 Nvidia Corporation Hardware overlay assignment
CN103577045A (en) * 2013-10-15 2014-02-12 广东欧珀移动通信有限公司 Method for self-defining status bar of mobile phone
CN103677535A (en) * 2013-12-04 2014-03-26 广东欧珀移动通信有限公司 Operating method and device of status bar of intelligent terminal
US11314370B2 (en) 2013-12-06 2022-04-26 Apple Inc. Method for extracting salient dialog usage from live data
US9507470B2 (en) 2013-12-16 2016-11-29 Nvidia Corporation Method and system for reduced power touch input detection on an electronic device using reduced scanning
US9910590B2 (en) * 2014-03-26 2018-03-06 Kyocera Corporation Mobile terminal and method for controlling mobile terminal
US20150277654A1 (en) * 2014-03-26 2015-10-01 Kyocera Corporation Mobile terminal and method for controlling mobile terminal
US10497365B2 (en) 2014-05-30 2019-12-03 Apple Inc. Multi-command single utterance input method
US20150348551A1 (en) * 2014-05-30 2015-12-03 Apple Inc. Multi-command single utterance input method
US10417344B2 (en) 2014-05-30 2019-09-17 Apple Inc. Exemplar-based natural language processing
US9966065B2 (en) * 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US10714095B2 (en) 2014-05-30 2020-07-14 Apple Inc. Intelligent assistant for home automation
US10878809B2 (en) 2014-05-30 2020-12-29 Apple Inc. Multi-command single utterance input method
US10657966B2 (en) 2014-05-30 2020-05-19 Apple Inc. Better resolution when referencing to concepts
US10083690B2 (en) 2014-05-30 2018-09-25 Apple Inc. Better resolution when referencing to concepts
US10699717B2 (en) 2014-05-30 2020-06-30 Apple Inc. Intelligent assistant for home automation
US10169329B2 (en) 2014-05-30 2019-01-01 Apple Inc. Exemplar-based natural language processing
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US11670289B2 (en) 2014-05-30 2023-06-06 Apple Inc. Multi-command single utterance input method
US11257504B2 (en) 2014-05-30 2022-02-22 Apple Inc. Intelligent assistant for home automation
US10642480B2 (en) * 2014-06-25 2020-05-05 Lg Electronics Inc. Mobile terminal displaying multiple running screens having a portion of content that is the same
US10983693B2 (en) 2014-06-25 2021-04-20 Lg Electronics Inc. Mobile terminal and controlling method thereof
US20150378590A1 (en) * 2014-06-25 2015-12-31 Lg Electronics Inc. Mobile terminal and controlling method thereof
US9668024B2 (en) 2014-06-30 2017-05-30 Apple Inc. Intelligent automated assistant for TV user interactions
US10904611B2 (en) 2014-06-30 2021-01-26 Apple Inc. Intelligent automated assistant for TV user interactions
US10431204B2 (en) 2014-09-11 2019-10-01 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10390213B2 (en) 2014-09-30 2019-08-20 Apple Inc. Social reminders
US10453443B2 (en) 2014-09-30 2019-10-22 Apple Inc. Providing an indication of the suitability of speech recognition
US10438595B2 (en) 2014-09-30 2019-10-08 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9986419B2 (en) 2014-09-30 2018-05-29 Apple Inc. Social reminders
US20160173668A1 (en) * 2014-12-16 2016-06-16 Xiaomi Inc. Method and device for activating an operating state of a mobile terminal
US11231904B2 (en) 2015-03-06 2022-01-25 Apple Inc. Reducing response latency of intelligent automated assistants
US11087759B2 (en) 2015-03-08 2021-08-10 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US10930282B2 (en) 2015-03-08 2021-02-23 Apple Inc. Competing devices responding to voice triggers
US10529332B2 (en) 2015-03-08 2020-01-07 Apple Inc. Virtual assistant activation
US10311871B2 (en) 2015-03-08 2019-06-04 Apple Inc. Competing devices responding to voice triggers
US11468282B2 (en) 2015-05-15 2022-10-11 Apple Inc. Virtual assistant in a communication session
US11127397B2 (en) 2015-05-27 2021-09-21 Apple Inc. Device voice control
US10356243B2 (en) 2015-06-05 2019-07-16 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10681212B2 (en) 2015-06-05 2020-06-09 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US11010127B2 (en) 2015-06-29 2021-05-18 Apple Inc. Virtual assistant for media playback
US11500672B2 (en) 2015-09-08 2022-11-15 Apple Inc. Distributed personal assistant
US11126400B2 (en) 2015-09-08 2021-09-21 Apple Inc. Zero latency digital assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10235665B2 (en) * 2015-09-24 2019-03-19 Casio Computer Co., Ltd. Sales data processing apparatus and sales data processing method
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US11526368B2 (en) 2015-11-06 2022-12-13 Apple Inc. Intelligent automated assistant in a messaging environment
US10354652B2 (en) 2015-12-02 2019-07-16 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10942703B2 (en) 2015-12-23 2021-03-09 Apple Inc. Proactive assistance based on dialog communication between devices
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US11069347B2 (en) 2016-06-08 2021-07-20 Apple Inc. Intelligent automated assistant for media exploration
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10354011B2 (en) 2016-06-09 2019-07-16 Apple Inc. Intelligent automated assistant in a home environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US11037565B2 (en) 2016-06-10 2021-06-15 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10733993B2 (en) 2016-06-10 2020-08-04 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10580409B2 (en) 2016-06-11 2020-03-03 Apple Inc. Application integration with a digital assistant
US10521466B2 (en) 2016-06-11 2019-12-31 Apple Inc. Data driven natural language event detection and classification
US11152002B2 (en) 2016-06-11 2021-10-19 Apple Inc. Application integration with a digital assistant
US10297253B2 (en) 2016-06-11 2019-05-21 Apple Inc. Application integration with a digital assistant
US10942702B2 (en) 2016-06-11 2021-03-09 Apple Inc. Intelligent device arbitration and control
US10269345B2 (en) 2016-06-11 2019-04-23 Apple Inc. Intelligent task discovery
US10089072B2 (en) 2016-06-11 2018-10-02 Apple Inc. Intelligent device arbitration and control
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10553215B2 (en) 2016-09-23 2020-02-04 Apple Inc. Intelligent automated assistant
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11656884B2 (en) 2017-01-09 2023-05-23 Apple Inc. Application integration with a digital assistant
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10741181B2 (en) 2017-05-09 2020-08-11 Apple Inc. User interface for correcting recognition errors
US10847142B2 (en) 2017-05-11 2020-11-24 Apple Inc. Maintaining privacy of personal information
US10755703B2 (en) 2017-05-11 2020-08-25 Apple Inc. Offline personal assistant
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US11599331B2 (en) 2017-05-11 2023-03-07 Apple Inc. Maintaining privacy of personal information
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
US10789945B2 (en) 2017-05-12 2020-09-29 Apple Inc. Low-latency intelligent automated assistant
US11405466B2 (en) 2017-05-12 2022-08-02 Apple Inc. Synchronization and task delegation of a digital assistant
US11380310B2 (en) 2017-05-12 2022-07-05 Apple Inc. Low-latency intelligent automated assistant
US10791176B2 (en) 2017-05-12 2020-09-29 Apple Inc. Synchronization and task delegation of a digital assistant
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10810274B2 (en) 2017-05-15 2020-10-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US11217255B2 (en) 2017-05-16 2022-01-04 Apple Inc. Far-field extension for digital assistant services
US11532306B2 (en) 2017-05-16 2022-12-20 Apple Inc. Detecting a trigger of a digital assistant
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US11899925B2 (en) * 2017-05-16 2024-02-13 Apple Inc. Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10748546B2 (en) 2017-05-16 2020-08-18 Apple Inc. Digital assistant services based on device capabilities
US10909171B2 (en) 2017-05-16 2021-02-02 Apple Inc. Intelligent automated assistant for media exploration
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US9959027B1 (en) * 2017-07-03 2018-05-01 Essential Products, Inc. Displaying an image on an irregular screen
US20230341958A1 (en) * 2017-07-18 2023-10-26 Apple Inc. Concealable input region for an electronic device
US10462345B2 (en) 2017-08-11 2019-10-29 Essential Products, Inc. Deformable structure that compensates for displacement of a camera module of a camera accessory
EP3664424A4 (en) * 2017-08-18 2020-07-15 Huawei Technologies Co., Ltd. Display method and terminal
US11115518B2 (en) 2017-08-18 2021-09-07 Huawei Technologies Co., Ltd. Display method and terminal
US11805197B2 (en) 2017-08-18 2023-10-31 Huawei Technologies Co., Ltd. Display method and terminal
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US11710482B2 (en) 2018-03-26 2023-07-25 Apple Inc. Natural assistant interaction
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
CN108595074A (en) * 2018-04-28 2018-09-28 北京小米移动软件有限公司 Status bar operating method, device and computer readable storage medium
US11854539B2 (en) 2018-05-07 2023-12-26 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11169616B2 (en) 2018-05-07 2021-11-09 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US11009970B2 (en) 2018-06-01 2021-05-18 Apple Inc. Attention aware virtual assistant dismissal
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US10684703B2 (en) 2018-06-01 2020-06-16 Apple Inc. Attention aware virtual assistant dismissal
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US11495218B2 (en) 2018-06-01 2022-11-08 Apple Inc. Virtual assistant operation in multi-device environments
US10720160B2 (en) 2018-06-01 2020-07-21 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11431642B2 (en) 2018-06-01 2022-08-30 Apple Inc. Variable latency device coordination
US10984798B2 (en) 2018-06-01 2021-04-20 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10944859B2 (en) 2018-06-03 2021-03-09 Apple Inc. Accelerated task performance
US10504518B1 (en) 2018-06-03 2019-12-10 Apple Inc. Accelerated task performance
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11217251B2 (en) 2019-05-06 2022-01-04 Apple Inc. Spoken notifications
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US11657813B2 (en) 2019-05-31 2023-05-23 Apple Inc. Voice identification in digital assistant systems
US11360739B2 (en) 2019-05-31 2022-06-14 Apple Inc. User activity shortcut suggestions
US11237797B2 (en) 2019-05-31 2022-02-01 Apple Inc. User activity shortcut suggestions
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11221734B2 (en) * 2019-10-30 2022-01-11 Beijing Xiaomi Mobile Software Co., Ltd. Punch-hole screen display method and apparatus
CN111596982A (en) * 2020-04-20 2020-08-28 维沃移动通信有限公司 Display method, display device and electronic equipment
US11960615B2 (en) 2021-06-06 2024-04-16 Apple Inc. Methods and user interfaces for voice-based user profile management
US11747969B1 (en) * 2022-05-06 2023-09-05 Apple Inc. Devices, methods, and graphical user interfaces for updating a session region

Also Published As

Publication number Publication date
US8286106B2 (en) 2012-10-09

Similar Documents

Publication Publication Date Title
US8286106B2 (en) System and method for interacting with status information on a touch screen device
JP7063878B2 (en) Systems and methods for viewing notifications received from multiple applications
JP6952173B2 (en) Devices, methods, and graphical user interfaces for providing feedback during interaction with intensity-sensitive buttons
US20240078006A1 (en) Unlocking a device by performing gestures on an unlock image
EP3436912B1 (en) Multifunction device control of another electronic device
US20100169813A1 (en) Method for displaying and operating user interface and electronic device
US10067666B2 (en) User terminal device and method for controlling the same
WO2007076211A1 (en) Indication of progress towards satisfaction of a user input condition
KR20170076357A (en) User terminal device, and mode conversion method and sound system for controlling volume of speaker thereof
EP2214174A2 (en) Apparatus and method for playing of multimedia item
KR20150012396A (en) Method for processing input and an electronic device thereof
JP2019208952A (en) Program, recording medium, and control method
JP2011018356A (en) Portable telephone set, information processing program and recording medium with information processing program recorded thereon
AU2011101193B4 (en) Unlocking a device by performing gestures on an unlock image
AU2011101192A4 (en) Unlocking a device by performing gestures on an unlock image
AU2008100419B4 (en) Unlocking a device by performing gestures on an unlock image
AU2012254900A1 (en) Unlocking a device by performing gestures on an unlock image

Legal Events

Date Code Title Description
AS Assignment

Owner name: SUN MICROSYSTEMS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BERGMAN, ERIC D.;REEL/FRAME:022395/0065

Effective date: 20090309

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: ORACLE AMERICA, INC., CALIFORNIA

Free format text: MERGER AND CHANGE OF NAME;ASSIGNORS:ORACLE USA, INC.;SUN MICROSYSTEMS, INC.;ORACLE AMERICA, INC.;REEL/FRAME:037311/0182

Effective date: 20100212

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12