US20140139431A1 - Method for displaying images of touch control device on external display device - Google Patents

Method for displaying images of touch control device on external display device Download PDF

Info

Publication number
US20140139431A1
US20140139431A1 US13/684,099 US201213684099A US2014139431A1 US 20140139431 A1 US20140139431 A1 US 20140139431A1 US 201213684099 A US201213684099 A US 201213684099A US 2014139431 A1 US2014139431 A1 US 2014139431A1
Authority
US
United States
Prior art keywords
touch
control device
external display
display device
touch control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/684,099
Inventor
Chieh-Chih Tseng
Jenn-Wein WU
Hsin-Ti Chueh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HTC Corp
Original Assignee
HTC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HTC Corp filed Critical HTC Corp
Priority to US13/684,099 priority Critical patent/US20140139431A1/en
Assigned to HTC CORPORATION reassignment HTC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHUEH, HSIN-TI, TSENG, CHIEH-CHIH, Wu, Jenn-Wein
Priority to TW102133623A priority patent/TW201421350A/en
Priority to CN201310472906.9A priority patent/CN103838505A/en
Publication of US20140139431A1 publication Critical patent/US20140139431A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0231—Cordless keyboards
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0384—Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas

Definitions

  • the invention relates to a method for displaying images of a touch control device on an external display device, and more particularly, to a method for controlling a graphical icon in the displayed images according to control input received from the touch control device.
  • a screen of a touch-controlled smart phone is generally small, such that when a user of the smart phone tries to demonstrate an image displayed on the smart phone to other people, the user may couple the smart phone to an external display device via a wireless network or a signal cable to transmit the image of the smart phone to the external display device.
  • the operation system of a smart phone normally supports touch control operations, such as scrolling, tapping, zoom-in, zoom-out and/or other gestures.
  • One embodiment of the invention discloses a method for displaying images of a touch control device on an external display device.
  • the method comprises providing a graphical icon on the image displayed on the external display device; providing a control interface for controlling the graphical icon on the touch control device; receiving a control signal from the control interface; and performing an operation corresponding to the control signal.
  • a touch control device comprising: a touch input interface unit, configured to receive a touch input; a processing unit, configured to process a control signal corresponding to the touch input; and an image processing unit, configured to provide an image displayed with a graphical icon; wherein the graphical icon is controlled according to the control signal.
  • Yet another embodiment of the invention discloses a method for displaying images of a touch control device on an external display device, comprising: detecting a connection of the touch control device to the external device; and switching from a first display mode to a second display mode for displaying an image on the external device in response to the connection being detected; wherein the second display mode provides additional graphics user interface not supported in the first display mode.
  • FIG. 1 is a functional block diagram showing a touch control device 100 of the present invention.
  • FIG. 2 illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention.
  • FIG. 3 illustrates an embodiment of display images in external display mode of the invention.
  • FIG. 4 illustrates an embodiment of controlling display images in external display mode.
  • FIG. 5 illustrates a block diagram of a touch control device according to an embodiment of the invention.
  • FIG. 6 illustrates another embodiment of display images in external display mode of the invention.
  • FIG. 7 illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention.
  • FIG. 8 depicts a method for displaying images of a touch control device on an external display device according to another embodiment of the invention.
  • the invention provides an intuitive way for controlling display contents of an external display device connected to a touch control device.
  • the user may use, for example a cursor, to browse or select particular content just as using a personal computer.
  • the touch screen may be configured as a touch pad for controlling the graphics control interface.
  • FIG. 1 is a functional block diagram showing a touch control device 100 of the present invention.
  • the touch control device 100 comprises, among others, a central processing unit 110 , a touch input interface unit 120 , an image processing unit 130 , a display unit 140 and a memory unit 160 .
  • the central processing unit 110 is configured to execute various programs/applications, including the operating system of the touch control device 100 .
  • the central processing unit 110 may also receive various events/signals from other components of the touch control device and perform corresponding operations.
  • the touch input interface unit 120 is coupled to the display unit 140 and configured to receive input signals from the display unit 140 and transmit to the central processing unit 110 for processing.
  • the touch screen unit 140 comprises at least a display module 142 and a touch panel 144 .
  • the display module 142 is configured to display images to the users and the touch panel unit 144 is configured to receive touch inputs from the users.
  • the user input may be a touch control signal corresponding to certain position of the touch screen unit 140 .
  • the touch screen unit 140 provides the coordinate of the touch input to the touch input interface unit 120 .
  • the touch input interface unit 120 receives the touch input signal and converts it into corresponding touch address event according to the touch coordinate.
  • the touch input interface unit 120 then transmits the touch address event to the central processing unit 110 .
  • the central processing unit 110 performs corresponding operation, such as refreshing the display images and others.
  • the image processing unit 130 is configured to process images to be displayed on the touch screen unit 140 .
  • the image processing unit 130 may retrieve source images from various sources, such as the memory unit 160 or from a remote entity via the connection interface unit 150 , and performs corresponding operations. For example, the image processing unit 130 may combine several source images to produce a final display image.
  • the image processing unit 130 also comprises a frame buffer 132 for providing display images to the touch screen unit 140 .
  • the frame buffer 132 may be configured as a ring buffer with limited size.
  • the touch control device 100 is connected to an external display device 200 via the connection interface unit 150 .
  • the connection interface unit 150 may support USB, HDMI, VGA, Wi-Fi, Bluetooth and/or other suitable connection protocol.
  • the connection interface unit 150 Upon connection to the external display device 200 , the connection interface unit 150 also provides information related to the external display device 200 to the central processing unit 110 , such as identity information, supported resolutions, supported formats and/or pothers. Display images in the frame buffer 132 may be transmitted to the external display device 200 via the connection interface unit 150 .
  • the touch control device 100 has two display modes for displaying images on the internal touch screen unit 140 or the external display device 200 .
  • the images processing unit 130 provides display images to the display module 142 of the touch screen unit 140
  • the central processing unit 110 receives touch control inputs via the touch panel 144 of the touch screen unit 140 .
  • the touch screen unit 140 functions as the main display interface and control interface to the users.
  • the touch control device 100 may operate in external display mode which images are displayed on the external display device 200 .
  • the image processing unit 130 provides display images to the external display device 200 via the connection interface unit 150 .
  • the image processing unit 130 may be configured to add a cursor or graphical icon, which is not appeared in the normal mode, on the display images.
  • the cursor or graphical icon may be stored in the memory unit 160 and be accessed in external display mode. Upon the external display mode is enabled, the image processing unit 130 accesses the cursor or graphical icon image from the memory unit 160 .
  • the cursor or graphical icon is added by overlaying the cursor image onto the original display image at a specific position, which may be designated by user input or predefined.
  • the touch control device 100 may disable the display module 142 of the touch screen unit 140 without providing the display images to the touch screen unit 140 .
  • the touch screen unit 140 may only serve to receive touch input from the touch panel 144 .
  • the touch panel 144 may receive touch input for controlling the cursor on the display image, for example, moving position of the cursor or selecting related content pointed by the cursor.
  • the touch control device 100 may first operate in normal display mode.
  • the connection interface unit 150 may send a signal, such as an interrupt, to notify the central processing unit 110 that an external display device is available for use.
  • the central processing unit 100 then switches from normal display mode to external display mode, and instructs the image processing unit 130 to provide display images with cursor or graphical icon to the external display device 200 .
  • the connection interface unit 150 also provides information related to the external display device 200 to the central processing unit 110 , for example, device identity, supported display resolutions and/or other information.
  • the central processing unit 110 may pass the information to the image processing unit 130 so that the image processing unit 130 can generate the display images in proper format and/or resolution.
  • the image processing unit 130 may apply the cursor icon or graphical icon onto the display images and adjust the size and/or resolution of the display images outputted to the external display device 200 accordingly. Furthermore, the image processing unit 130 may determine which icon to be applied according to the application corresponding to currently displayed images. For example, a cursor icon is added when the content of the display image is a webpage or text file, and a virtual keyboard may be added when the cursor icon moves to a text input field.
  • the touch panel 144 of the touch screen unit 140 may receive touch input from users, such as using fingertip or stylus.
  • the touch input is transmitted as an address signal indicating touch position of corresponding touch input.
  • the touch input interface 120 may constantly monitor the position of the touch input, and the image processing unit 130 then updates position of the cursor icon in the display image accordingly.
  • the image processing unit 130 may refresh the display images according to the operation corresponding to the touch input. For example, if user performs a tap on a link within the webpage, the central processing unit 110 may direct to another webpage of the link and loads its content, the image processing unit 130 may access the content, add the cursor on the new display image and refresh the frame buffer 132 with the new display image for output.
  • step S 210 the touch control device detects connection to an external display device.
  • the connection may be wired or wireless connection such as USB, HDMI, Wi-Fi, Bluetooth and/or others.
  • the touch control device switches from a first display mode to a second display mode in step S 220 .
  • display images are only provided to internal display unit, while in the second mode display images are provided to the connected external display device.
  • the internal display unit may be disabled for saving power consumption in the second display mode.
  • step S 230 a graphics user interface is provided to the display image in the second display mode.
  • the graphics user interface may be a cursor icon or other graphics icon.
  • the display image along with the cursor icon is displayed on the external display device.
  • a control signal corresponding to the graphics user interface is received from the touch panel of the touch control device.
  • the touch input on the touch panel is converted to corresponding control signal according to the touch position and application currently running. For example, the touch position may be mapped to an operation of the application.
  • the control signal the display image is refreshed and provided to the external display device in step S 250 .
  • FIG. 3 illustrates an embodiment of display images in external display mode of the invention.
  • a cursor icon 210 originally not provided in internal display mode is added on the display image of the external display device 200 .
  • the touch screen unit 140 of touch control device 100 is used as a control interface for controlling the cursor icon 210 .
  • the cursor 210 moves its position along with the movement of the finger.
  • FIG. 4 illustrates an embodiment of controlling display images in external display mode. Assume that the original position of the cursor icon 210 is at position 246 and the touch panel 144 receives a touch input at position 146 .
  • the position 146 of the touch panel 144 is mapped to the position 246 of the cursor icon 210 in the displayed image.
  • the touch panel 144 provides touch input signal to the touch input interface unit 120 .
  • the touch input signal may comprise information of the touch input position, such as absolute address.
  • the information is provided to the central processing unit 110 and the central processing unit 110 may calculate the address offset of touch input positions.
  • the address offset of touch input positions is then converted into display offset of cursor positions.
  • the central processing unit 110 may calculate the display offset of cursor positions according to the address offset of touch input positions and the resolution of the display images on the external display device 200 .
  • the display offset of cursor position is provided to the image processing unit 130 to refresh the display image.
  • the image processing unit 130 may refresh the display image by updating the position of the cursor image overlaying on the original image.
  • the touch input signal may be converted into a command for performing certain operation by the central processing unit 110 , and the image processing unit 130 may refresh the display image by loading new images corresponding to the command.
  • the cursor icon 210 may be removed in response to the cursor position corresponding to specific region of the display images, such as border of the display images, and be added back again in response to the cursor position is changed back to normal region of the display images.
  • the touch input position may be updated to the central processing unit 110 periodically so as to reduce the latency of cursor position update.
  • Address offsets of the touch input positions between two time points are calculated in x and y dimensions separately, denoted as ⁇ X1 and ⁇ Y1.
  • a ratio R is applied to the address offsets according to resolution of the display image or it may be predefined.
  • different ratios Rx, Ry may be used for x and y dimensions respectively.
  • the display offsets of cursor positions are then calculated by multiplying R (or Rx, Ry) with ⁇ X1 and ⁇ Y1 so as to obtain ⁇ X2 and ⁇ Y2.
  • the new position 248 can be thus determined by adding ⁇ X2 and ⁇ Y2 to position 246 , which means moves the cursor ⁇ X2 in x direction and ⁇ Y2 in y direction.
  • FIG. 5 illustrates a block diagram of a touch control device according to an embodiment of the invention.
  • the touch control device 500 comprises, among others, an event handler 510 , a touch screen driver 520 , a display driver 530 and a touch screen unit 540 .
  • the touch screen unit 540 is configured to display images to a user and receive touch input from the user.
  • the touch input signal which comprises an absolute address, is sent to the touch driver 520 . Consequently, the touch driver 520 converts the touch input into a touch address event, which also comprises the absolute address and sends the touch address event to the event handler 510 .
  • the event handler 510 is configured to convert the touch address event to a touch control event for performing certain operation corresponding to the content at the position of the touch input.
  • the touch control event would comprise a command for loading a video and playing back.
  • the operation of the touch control event is processed by the central processing unit 110 .
  • the event handler 510 would send to touch control event to related components to execute the command.
  • the event handler 510 may instruct a video processing unit to access the video file, decode the video file, and send decoded video file to the touch screen unit 540 .
  • the event handler 510 may also be configured to convert the absolute address to a cursor address and send to the display driver 530 so as to update the cursor position.
  • the touch driver 520 is configured to send the touch address event to the event handler 510 , and convert the absolute address into cursor address and provide to the display driver 530 .
  • the display driver 530 is configured to refresh display image and change the overlaying cursor image to designated cursor position according to the cursor address.
  • the cursor address can be calculated according to the embodiment of FIG. 4 .
  • the display driver 530 may add the cursor image by blending it with the original image with predefined transparency (from 1 to 0).
  • the event handler 510 is implemented in the central processing unit 110 of FIG.
  • the touch driver 520 is implemented in the touch input interface unit 120
  • the display driver 530 is implemented in the image processing unit 130 of FIG. 1 .
  • these units/components may be implemented in hardware, logic gates, software program code, or combination of above.
  • FIG. 6 illustrates another embodiment of display images in external display mode of the invention.
  • the display unit 140 of the touch control device 100 may be configured to display a virtual keyboard automatically.
  • the touch driver 520 converts the touch input into a touch address event comprising a command to launch a virtual keyboard on the touch screen unit 540 .
  • the event handler 510 instructs the display driver 530 to provide the virtual keyboard to the touch screen unit 540 meanwhile update the cursor position shown on the external display device 200 .
  • the touch driver 520 sends a touch address event of typing A to the event handler 510 .
  • the event hander 510 then instructs the display driver to update the display image with A in the text field by corresponding touch control event.
  • FIG. 7 illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention.
  • the method may be implemented in the touch control device 100 of FIG. 1 .
  • the touch control device detects whether the external display is connected. The detection may be performed by monitoring an interrupt from the connection interface unit is received, and the connection may be a hot-plug connection.
  • a cursor icon is provided on an image and the image with the cursor icon is displayed on the external display device in step S 720 . Meanwhile, the internal display unit of the touch control device may be disabled.
  • a control interface is provided for controlling the cursor displayed on the external display device.
  • the control interface may be the touch panel of the touch control device.
  • the internal display unit may be configured to provide graphics user interface for directing user to use the control interface.
  • the control interface is used to receive control signal inputted by a user in step S 740 .
  • user may use finger or stylus to input control signals for controlling the position of the cursor.
  • the touch control device performs operation according to the control signal.
  • the touch control device may update the cursor position according to the finger trace (control signals) received by the control interface.
  • FIG. 8 depicts a method for displaying images of a touch control device on an external display device according to another embodiment of the invention.
  • the touch control device may be connected to an external display device via wired or wireless connection and the connection may be built by hot-plug.
  • the method can be implemented in the touch control device of FIG. 5 .
  • a control signal is received from a control interface of the touch control device.
  • the control interface is a touch control interface such as a touch panel.
  • the control interface may receive control signals from various input tools, such as finger or stylus, and monitor the control signals periodically.
  • the control signals are sent to a touch input interface unit for converting into corresponding control events.
  • the displacement corresponding to the control signal is determined in step S 820 .
  • the displacement may correspond an address offset of the input tool at different time points, and be determined by the touch input interface unit or an event handler executed by the central processing unit of the touch control device.
  • the displacement may be calculated as a cursor offset according to the address offset and the resolution of the external display device.
  • the cursor offset may be multiplication result of the address offset and a ratio defined according to resolution.
  • the position of the cursor is updated by overlaying to cursor image with a new display image, for example loading a new webpage.
  • the cursor may be enabled or disabled depending on the application currently running. For example, if the touch control device switches to run a gaming application, the cursor may not appear even when external display device is connected.
  • the present invention provides a method for displaying images of the touch control device on the external display device.
  • the touch control device of the present invention can be converted to an input device when the image of the operation mode of the touch control device is displayed on the external display device, so as to increase convenience during use.

Abstract

The present invention provides a method for displaying images of a touch control device on an external display device. The method comprises providing a graphical icon on the image displayed on the external display device; providing a control interface for controlling the graphical icon on the touch control device; receiving a control signal from the control interface; and performing an operation corresponding to the control signal.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The invention relates to a method for displaying images of a touch control device on an external display device, and more particularly, to a method for controlling a graphical icon in the displayed images according to control input received from the touch control device.
  • 2. Description of the Prior Art
  • As related technology keeps improving, conventional feature phones are gradually replaced by touch-controlled smart phones embedded with various kinds of application programs. A screen of a touch-controlled smart phone is generally small, such that when a user of the smart phone tries to demonstrate an image displayed on the smart phone to other people, the user may couple the smart phone to an external display device via a wireless network or a signal cable to transmit the image of the smart phone to the external display device. The operation system of a smart phone normally supports touch control operations, such as scrolling, tapping, zoom-in, zoom-out and/or other gestures. In the condition that user wishes to perform operation on certain part of the displayed content, for example directing to another link on a website, user might need to scroll the webpage to proper position, zoom in the displayed image so that it would be easier to tap on the link. However, it often occurs that another nearby link may be selected instead of the intended link due to the touch screen wrongly identifies the position of the tap input. As a result, it causes inconvenience of controlling operation of the smart phone.
    • SUMMARY OF THE INVENTION
  • One embodiment of the invention discloses a method for displaying images of a touch control device on an external display device. The method comprises providing a graphical icon on the image displayed on the external display device; providing a control interface for controlling the graphical icon on the touch control device; receiving a control signal from the control interface; and performing an operation corresponding to the control signal.
  • Another embodiment of the invention discloses a touch control device comprising: a touch input interface unit, configured to receive a touch input; a processing unit, configured to process a control signal corresponding to the touch input; and an image processing unit, configured to provide an image displayed with a graphical icon; wherein the graphical icon is controlled according to the control signal.
  • Yet another embodiment of the invention discloses a method for displaying images of a touch control device on an external display device, comprising: detecting a connection of the touch control device to the external device; and switching from a first display mode to a second display mode for displaying an image on the external device in response to the connection being detected; wherein the second display mode provides additional graphics user interface not supported in the first display mode.
  • These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a functional block diagram showing a touch control device 100 of the present invention.
  • FIG. 2 illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention.
  • FIG. 3 illustrates an embodiment of display images in external display mode of the invention.
  • FIG. 4 illustrates an embodiment of controlling display images in external display mode.
  • FIG. 5 illustrates a block diagram of a touch control device according to an embodiment of the invention.
  • FIG. 6 illustrates another embodiment of display images in external display mode of the invention.
  • FIG. 7 illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention.
  • FIG. 8 depicts a method for displaying images of a touch control device on an external display device according to another embodiment of the invention.
    •  DETAILED DESCRIPTION
  • The invention provides an intuitive way for controlling display contents of an external display device connected to a touch control device. By adding additional graphics control interface to the original display image, the user may use, for example a cursor, to browse or select particular content just as using a personal computer. The touch screen may be configured as a touch pad for controlling the graphics control interface.
  • Please refer to FIG. 1. FIG. 1 is a functional block diagram showing a touch control device 100 of the present invention. The touch control device 100 comprises, among others, a central processing unit 110, a touch input interface unit 120, an image processing unit 130, a display unit 140 and a memory unit 160. The central processing unit 110 is configured to execute various programs/applications, including the operating system of the touch control device 100. The central processing unit 110 may also receive various events/signals from other components of the touch control device and perform corresponding operations. The touch input interface unit 120 is coupled to the display unit 140 and configured to receive input signals from the display unit 140 and transmit to the central processing unit 110 for processing. The touch screen unit 140 comprises at least a display module 142 and a touch panel 144. The display module 142 is configured to display images to the users and the touch panel unit 144 is configured to receive touch inputs from the users. The user input may be a touch control signal corresponding to certain position of the touch screen unit 140. The touch screen unit 140 provides the coordinate of the touch input to the touch input interface unit 120. The touch input interface unit 120 receives the touch input signal and converts it into corresponding touch address event according to the touch coordinate.
  • The touch input interface unit 120 then transmits the touch address event to the central processing unit 110. According to the touch address event, the central processing unit 110 performs corresponding operation, such as refreshing the display images and others. The image processing unit 130 is configured to process images to be displayed on the touch screen unit 140. The image processing unit 130 may retrieve source images from various sources, such as the memory unit 160 or from a remote entity via the connection interface unit 150, and performs corresponding operations. For example, the image processing unit 130 may combine several source images to produce a final display image. The image processing unit 130 also comprises a frame buffer 132 for providing display images to the touch screen unit 140. The frame buffer 132 may be configured as a ring buffer with limited size. The touch control device 100 is connected to an external display device 200 via the connection interface unit 150. The connection interface unit 150 may support USB, HDMI, VGA, Wi-Fi, Bluetooth and/or other suitable connection protocol. Upon connection to the external display device 200, the connection interface unit 150 also provides information related to the external display device 200 to the central processing unit 110, such as identity information, supported resolutions, supported formats and/or pothers. Display images in the frame buffer 132 may be transmitted to the external display device 200 via the connection interface unit 150.
  • In the present invention, the touch control device 100 has two display modes for displaying images on the internal touch screen unit 140 or the external display device 200. When the touch control device 100 operates in normal display mode, the images processing unit 130 provides display images to the display module 142 of the touch screen unit 140, and the central processing unit 110 receives touch control inputs via the touch panel 144 of the touch screen unit 140. In this mode, the touch screen unit 140 functions as the main display interface and control interface to the users. When the touch control device 100 is connected to the external display device 200, the touch control device 100 may operate in external display mode which images are displayed on the external display device 200. The image processing unit 130 provides display images to the external display device 200 via the connection interface unit 150. Furthermore, the image processing unit 130 may be configured to add a cursor or graphical icon, which is not appeared in the normal mode, on the display images. The cursor or graphical icon may be stored in the memory unit 160 and be accessed in external display mode. Upon the external display mode is enabled, the image processing unit 130 accesses the cursor or graphical icon image from the memory unit 160. The cursor or graphical icon is added by overlaying the cursor image onto the original display image at a specific position, which may be designated by user input or predefined. In this mode, the touch control device 100 may disable the display module 142 of the touch screen unit 140 without providing the display images to the touch screen unit 140. And the touch screen unit 140 may only serve to receive touch input from the touch panel 144. The touch panel 144 may receive touch input for controlling the cursor on the display image, for example, moving position of the cursor or selecting related content pointed by the cursor.
  • In one embodiment of the invention, the touch control device 100 may first operate in normal display mode. In response to the connection interface unit 150 detecting connection to the external display device 200, the connection interface unit 150 may send a signal, such as an interrupt, to notify the central processing unit 110 that an external display device is available for use. The central processing unit 100 then switches from normal display mode to external display mode, and instructs the image processing unit 130 to provide display images with cursor or graphical icon to the external display device 200. The connection interface unit 150 also provides information related to the external display device 200 to the central processing unit 110, for example, device identity, supported display resolutions and/or other information. The central processing unit 110 may pass the information to the image processing unit 130 so that the image processing unit 130 can generate the display images in proper format and/or resolution. The image processing unit 130 may apply the cursor icon or graphical icon onto the display images and adjust the size and/or resolution of the display images outputted to the external display device 200 accordingly. Furthermore, the image processing unit 130 may determine which icon to be applied according to the application corresponding to currently displayed images. For example, a cursor icon is added when the content of the display image is a webpage or text file, and a virtual keyboard may be added when the cursor icon moves to a text input field.
  • The touch panel 144 of the touch screen unit 140 may receive touch input from users, such as using fingertip or stylus. The touch input is transmitted as an address signal indicating touch position of corresponding touch input. The touch input interface 120 may constantly monitor the position of the touch input, and the image processing unit 130 then updates position of the cursor icon in the display image accordingly. Similarly, the image processing unit 130 may refresh the display images according to the operation corresponding to the touch input. For example, if user performs a tap on a link within the webpage, the central processing unit 110 may direct to another webpage of the link and loads its content, the image processing unit 130 may access the content, add the cursor on the new display image and refresh the frame buffer 132 with the new display image for output.
  • Next please refer to FIG. 2 which illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention. First in step S210, the touch control device detects connection to an external display device. The connection may be wired or wireless connection such as USB, HDMI, Wi-Fi, Bluetooth and/or others. In response to connection is detected, the touch control device switches from a first display mode to a second display mode in step S220. In the first display mode, display images are only provided to internal display unit, while in the second mode display images are provided to the connected external display device. Also the internal display unit may be disabled for saving power consumption in the second display mode. Then in step S230, a graphics user interface is provided to the display image in the second display mode. The graphics user interface may be a cursor icon or other graphics icon. The display image along with the cursor icon is displayed on the external display device. In step S240, a control signal corresponding to the graphics user interface is received from the touch panel of the touch control device. The touch input on the touch panel is converted to corresponding control signal according to the touch position and application currently running. For example, the touch position may be mapped to an operation of the application. According to the control signal, the display image is refreshed and provided to the external display device in step S250.
  • FIG. 3 illustrates an embodiment of display images in external display mode of the invention. In the embodiment of FIG. 3, a cursor icon 210 originally not provided in internal display mode is added on the display image of the external display device 200. The touch screen unit 140 of touch control device 100 is used as a control interface for controlling the cursor icon 210. When user moves his/her finger, for example, on the touch panel 144, the cursor 210 moves its position along with the movement of the finger. FIG. 4 illustrates an embodiment of controlling display images in external display mode. Assume that the original position of the cursor icon 210 is at position 246 and the touch panel 144 receives a touch input at position 146. The position 146 of the touch panel 144 is mapped to the position 246 of the cursor icon 210 in the displayed image. When the touch input moves from position 146 to position 148, the cursor icon 210 is moved from position 246 to position 248 accordingly. As described above, the touch panel 144 provides touch input signal to the touch input interface unit 120. The touch input signal may comprise information of the touch input position, such as absolute address. The information is provided to the central processing unit 110 and the central processing unit 110 may calculate the address offset of touch input positions. The address offset of touch input positions is then converted into display offset of cursor positions. The central processing unit 110 may calculate the display offset of cursor positions according to the address offset of touch input positions and the resolution of the display images on the external display device 200. Then the display offset of cursor position is provided to the image processing unit 130 to refresh the display image. The image processing unit 130 may refresh the display image by updating the position of the cursor image overlaying on the original image. In another embodiment of the invention, the touch input signal may be converted into a command for performing certain operation by the central processing unit 110, and the image processing unit 130 may refresh the display image by loading new images corresponding to the command. Yet in another embodiment of the invention, the cursor icon 210 may be removed in response to the cursor position corresponding to specific region of the display images, such as border of the display images, and be added back again in response to the cursor position is changed back to normal region of the display images.
  • In the embodiment of FIG. 4, the touch input position may be updated to the central processing unit 110 periodically so as to reduce the latency of cursor position update. Address offsets of the touch input positions between two time points are calculated in x and y dimensions separately, denoted as ΔX1 and ΔY1. A ratio R is applied to the address offsets according to resolution of the display image or it may be predefined. Similarly, different ratios Rx, Ry may be used for x and y dimensions respectively. The display offsets of cursor positions are then calculated by multiplying R (or Rx, Ry) with ΔX1 and ΔY1 so as to obtain ΔX2 and ΔY2. The new position 248 can be thus determined by adding ΔX2 and ΔY2 to position 246, which means moves the cursor ΔX2 in x direction and ΔY2 in y direction.
  • FIG. 5 illustrates a block diagram of a touch control device according to an embodiment of the invention. The touch control device 500 comprises, among others, an event handler 510, a touch screen driver 520, a display driver 530 and a touch screen unit 540. The touch screen unit 540 is configured to display images to a user and receive touch input from the user. The touch input signal, which comprises an absolute address, is sent to the touch driver 520. Consequently, the touch driver 520 converts the touch input into a touch address event, which also comprises the absolute address and sends the touch address event to the event handler 510. The event handler 510 is configured to convert the touch address event to a touch control event for performing certain operation corresponding to the content at the position of the touch input. For example, if the touch input corresponds to a position where the content is a playback link, the touch control event would comprise a command for loading a video and playing back. The operation of the touch control event is processed by the central processing unit 110. The event handler 510 would send to touch control event to related components to execute the command. In the example of above, the event handler 510 may instruct a video processing unit to access the video file, decode the video file, and send decoded video file to the touch screen unit 540. The event handler 510 may also be configured to convert the absolute address to a cursor address and send to the display driver 530 so as to update the cursor position.
  • In another embodiment of the invention, the touch driver 520 is configured to send the touch address event to the event handler 510, and convert the absolute address into cursor address and provide to the display driver 530. The display driver 530 is configured to refresh display image and change the overlaying cursor image to designated cursor position according to the cursor address. The cursor address can be calculated according to the embodiment of FIG. 4. Yet in another embodiment of the invention, the display driver 530 may add the cursor image by blending it with the original image with predefined transparency (from 1 to 0). In one embodiment of the invention, the event handler 510 is implemented in the central processing unit 110 of FIG. 1, the touch driver 520 is implemented in the touch input interface unit 120, the display driver 530 is implemented in the image processing unit 130 of FIG. 1. Please note that these units/components may be implemented in hardware, logic gates, software program code, or combination of above.
  • FIG. 6 illustrates another embodiment of display images in external display mode of the invention. In this embodiment, when the cursor is moved to a position that allows text input, the display unit 140 of the touch control device 100 may be configured to display a virtual keyboard automatically. As a result, user needs not to activate the virtual keyboard manually and the virtual keyboard would not be displayed on the external display device 200 to provide a clear view. With reference back to FIG. 5, the touch driver 520 converts the touch input into a touch address event comprising a command to launch a virtual keyboard on the touch screen unit 540. Upon receiving the touch address event, the event handler 510 instructs the display driver 530 to provide the virtual keyboard to the touch screen unit 540 meanwhile update the cursor position shown on the external display device 200. Later if other touch input corresponds to a position of a character shown on the keyboard is received, for example capital A, the touch driver 520 sends a touch address event of typing A to the event handler 510. The event hander 510 then instructs the display driver to update the display image with A in the text field by corresponding touch control event.
  • Now please refer to FIG. 7 which illustrates a method for displaying images of a touch control device on an external display device according to an embodiment of the invention. The method may be implemented in the touch control device 100 of FIG. 1. In step S710, the touch control device detects whether the external display is connected. The detection may be performed by monitoring an interrupt from the connection interface unit is received, and the connection may be a hot-plug connection. In response to the connection is detected, a cursor icon is provided on an image and the image with the cursor icon is displayed on the external display device in step S720. Meanwhile, the internal display unit of the touch control device may be disabled. Next in step S730 a control interface is provided for controlling the cursor displayed on the external display device. The control interface may be the touch panel of the touch control device. In one embodiment of the invention, the internal display unit may be configured to provide graphics user interface for directing user to use the control interface. The control interface is used to receive control signal inputted by a user in step S740. For example, user may use finger or stylus to input control signals for controlling the position of the cursor. Then in step S750, the touch control device performs operation according to the control signal. In the above example, the touch control device may update the cursor position according to the finger trace (control signals) received by the control interface.
  • FIG. 8 depicts a method for displaying images of a touch control device on an external display device according to another embodiment of the invention. The touch control device may be connected to an external display device via wired or wireless connection and the connection may be built by hot-plug. The method can be implemented in the touch control device of FIG. 5. First in step S810, a control signal is received from a control interface of the touch control device. The control interface is a touch control interface such as a touch panel. The control interface may receive control signals from various input tools, such as finger or stylus, and monitor the control signals periodically. The control signals are sent to a touch input interface unit for converting into corresponding control events. Then the displacement corresponding to the control signal is determined in step S820. The displacement may correspond an address offset of the input tool at different time points, and be determined by the touch input interface unit or an event handler executed by the central processing unit of the touch control device. The displacement may be calculated as a cursor offset according to the address offset and the resolution of the external display device. For example, the cursor offset may be multiplication result of the address offset and a ratio defined according to resolution. Once determined, the displacement is provided to the display driver of the touch control device. Next position of the cursor is updated according to the displacement, in step S830. The display driver may update the cursor image overlaying on the display image from one position to another according to the displacement. And the image is refreshed and provided to the external display device in step S840. Please note that in another embodiment of the invention, the position of the cursor is updated by overlaying to cursor image with a new display image, for example loading a new webpage. Yet in another embodiment of the invention, the cursor may be enabled or disabled depending on the application currently running. For example, if the touch control device switches to run a gaming application, the cursor may not appear even when external display device is connected.
  • In contrast to the prior art, the present invention provides a method for displaying images of the touch control device on the external display device. The touch control device of the present invention can be converted to an input device when the image of the operation mode of the touch control device is displayed on the external display device, so as to increase convenience during use.
  • Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.

Claims (20)

What is claimed is:
1. A method for displaying images of a touch control device on an external display device, comprising:
providing a graphical icon on the image displayed on the external display device;
providing a control interface for controlling the graphical icon on the touch control device;
receiving a control signal from the control interface; and
performing an operation corresponding to the control signal.
2. The method of claim 1, further comprising:
detecting a connection to the external display device;
wherein the graphical icon is provided in response to the connection being detected.
3. The method of claim 2, wherein the detecting further comprises determining a resolution of the external display device.
4. The method of claim 3, wherein the providing of graphical icon further comprises adjusting the graphical icon according to at least one of the following: resolution of the external display device and an application corresponding to the image displayed.
5. The method of claim 1, wherein the receiving of control signal further comprises
determining a displacement of an input tool on the control interface corresponding to the control signal; and
updating position of the graphical icon on the display image according to the displacement.
6. The method of claim 5, wherein the control interface is a touch screen and the input tool is one of the following: finger-tip, stylus.
7. The method of claim 5, wherein the position of the graphical icon is updated according to the displacement of the input tool and a resolution of the external display device.
8. The method of claim 1, wherein the performing of operation comprises refreshing the image displayed on the external display device.
9. The method of claim 7, wherein in response to the control signal corresponding to selecting another application, the external display device is refreshed with another image corresponding to the application.
10. A touch control device, comprising:
a touch input interface unit, configured to receive a touch input;
a processing unit, configured to process a control signal corresponding to the touch input; and
an image processing unit, configured to provide an image displayed with a graphical icon;
wherein the graphical icon is controlled according to the control signal.
11. The touch control device of claim 10, further comprising:
a connection interface unit, configured to detect connection to an external device;
wherein the image with the graphical icon is displayed on the external device in response to the connection is detected.
12. The touch control device of claim 11, the processing unit is further configured to disable a display module within the touch input interface unit in response to the connection is detected.
13. The touch control device of claim 10, wherein the processing unit is further configured to control a position of the graphical icon within the image displayed according to the control signal and a display resolution of the external device.
14. The touch control device of claim 13, wherein the position of the graphical icon is updated according to a displacement of the touch input on the touch input interface unit.
15. The touch control device of claim 10, wherein the processing unit is configured to perform an operation corresponding to the control signal, and the image processing unit is configured to refresh the image displayed according to the application.
16. The touch control device of claim 10, further comprising:
a memory unit configured to store the graphics icon.
17. A method for displaying images of a touch control device on an external display device, comprising:
detecting a connection of the touch control device to the external device; and
switching from a first display mode to a second display mode for displaying an image on the external device in response to the connection being detected;
wherein the second display mode provides additional graphics user interface not supported in the first display mode.
18. The method of claim 17, further comprising:
receiving a control signal corresponding to the additional graphics user interface in the second display mode; and
refreshing the image displayed on the external display device according to the control signal.
19. The method of claim 17, wherein the additional graphics user interface is a cursor.
20. The method of claim 17, wherein the additional graphics user interface is provided according to an application currently running on the touch control device.
US13/684,099 2012-11-21 2012-11-21 Method for displaying images of touch control device on external display device Abandoned US20140139431A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US13/684,099 US20140139431A1 (en) 2012-11-21 2012-11-21 Method for displaying images of touch control device on external display device
TW102133623A TW201421350A (en) 2012-11-21 2013-09-17 Method for displaying images of touch control device on external display device
CN201310472906.9A CN103838505A (en) 2012-11-21 2013-10-11 Method for displaying images of touch control device on external display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/684,099 US20140139431A1 (en) 2012-11-21 2012-11-21 Method for displaying images of touch control device on external display device

Publications (1)

Publication Number Publication Date
US20140139431A1 true US20140139431A1 (en) 2014-05-22

Family

ID=50727455

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/684,099 Abandoned US20140139431A1 (en) 2012-11-21 2012-11-21 Method for displaying images of touch control device on external display device

Country Status (3)

Country Link
US (1) US20140139431A1 (en)
CN (1) CN103838505A (en)
TW (1) TW201421350A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130091449A1 (en) * 2011-10-06 2013-04-11 Rich IP Technology Inc. Touch processing method and system using a gui image
US20140125609A1 (en) * 2006-10-26 2014-05-08 Apple Inc. Portable Multifunction Device, Method, and Graphical User Interface for Adjusting an Insertion Point Marker
US20140210713A1 (en) * 2013-01-31 2014-07-31 Samsung Electronics Co., Ltd. Method for controlling display of pointer and displaying the pointer, and apparatus thereof
US20140218310A1 (en) * 2013-02-01 2014-08-07 Rich IP Technology Inc. Touch display driving circuit capable of responding to cpu commands
US20140372915A1 (en) * 2013-06-13 2014-12-18 Compal Electronics, Inc. Method and system for operating display device
US20150009096A1 (en) * 2013-07-08 2015-01-08 Lg Electronics Inc. Wearable device and the method for controlling the same
US20150067577A1 (en) * 2013-08-28 2015-03-05 Acer Inc. Covered Image Projecting Method and Portable Electronic Apparatus Using the Same
US9092130B2 (en) 2011-05-31 2015-07-28 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
TWI511121B (en) * 2013-05-04 2015-12-01 Nvidia Corp Power gating a display of a data processing device during cloning thereof across an external display while retaining touch-sensibility thereof
US20160026331A1 (en) * 2013-03-14 2016-01-28 Rich IP Technology Inc. Touch display driving circuit capable of responding to cpu commands
US20160117081A1 (en) * 2014-10-27 2016-04-28 Thales Avionics, Inc. Controlling entertainment system using combination of inputs from proximity sensor and touch sensor of remote controller
US9348511B2 (en) 2006-10-26 2016-05-24 Apple Inc. Method, system, and graphical user interface for positioning an insertion marker in a touch screen display
US9846533B2 (en) 2009-03-16 2017-12-19 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US20170371492A1 (en) * 2013-03-14 2017-12-28 Rich IP Technology Inc. Software-defined sensing system capable of responding to cpu commands
US20180005603A1 (en) * 2015-04-17 2018-01-04 Hewlett-Packard Development Company, L.P. Management of display inputs
EP3382524A1 (en) * 2017-03-29 2018-10-03 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
WO2019117566A1 (en) * 2017-12-12 2019-06-20 삼성전자 주식회사 Electronic device and input control method thereof
US11320880B2 (en) 2018-11-01 2022-05-03 Hewlett-Packard Development Company, L.P. Multifunction display port
US11372609B2 (en) * 2017-10-05 2022-06-28 Displaylink (Uk) Limited System and method for locally generating data
US20220283770A1 (en) * 2021-03-02 2022-09-08 Champ Vision Display Inc. Control method of electronic device and external control device

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105335076B (en) * 2014-06-19 2019-07-26 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN105573530A (en) * 2014-10-08 2016-05-11 宏碁股份有限公司 Touch display device and method for starting touch panel of touch display device
CN104331234B (en) * 2014-10-29 2018-05-18 广州三人行壹佰教育科技有限公司 A kind of method and apparatus for performing mapping operation
CN107959811B (en) * 2017-12-20 2022-08-16 深圳市深智电科技有限公司 Touchable interactive HDMI IN display and processing method
CN110231968A (en) * 2018-03-06 2019-09-13 联发科技股份有限公司 Improve the method and processor of the rendering of graphical interfaces

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030025678A1 (en) * 2001-08-04 2003-02-06 Samsung Electronics Co., Ltd. Apparatus with touch screen and method for displaying information through external display device connected thereto
US20070126714A1 (en) * 2005-12-07 2007-06-07 Kabushiki Kaisha Toshiba Information processing apparatus and touch pad control method
US20100085316A1 (en) * 2008-10-07 2010-04-08 Jong Hwan Kim Mobile terminal and display controlling method therein
US20100323762A1 (en) * 2009-06-17 2010-12-23 Pradeep Sindhu Statically oriented on-screen transluscent keyboard
US7870496B1 (en) * 2009-01-29 2011-01-11 Jahanzeb Ahmed Sherwani System using touchscreen user interface of a mobile device to remotely control a host computer
US20110022990A1 (en) * 2009-07-22 2011-01-27 Elan Microelectronics Corporation Method for operation to a multi-touch environment screen by using a touchpad
US20110181520A1 (en) * 2010-01-26 2011-07-28 Apple Inc. Video out interface for electronic device
US20110254774A1 (en) * 2010-04-20 2011-10-20 Nec Casio Mobile Communications, Ltd. Terminal device and recording medium with control program recorded therein
US20120098771A1 (en) * 2010-10-22 2012-04-26 Sony Corporation Operational terminal device, display control device, method of operating terminal device, method of operating display control device, and system
US20120271969A1 (en) * 2011-04-22 2012-10-25 Akihiko Ikeda Multifunctional touch-enabled devices
US20120287058A1 (en) * 2010-08-27 2012-11-15 Google Inc. Switching display modes based on connection state
US20130050122A1 (en) * 2011-08-31 2013-02-28 You-Jin KANG Controlling user equipment as touch pad for external device connected thereto
US20130285927A1 (en) * 2012-04-30 2013-10-31 Research In Motion Limited Touchscreen keyboard with correction of previously input text

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10191142A (en) * 1996-12-20 1998-07-21 Nikon Corp Image processor
CN101566906A (en) * 2008-04-25 2009-10-28 宏碁股份有限公司 Electronic device connected with exterior display device
JP2011134278A (en) * 2009-12-25 2011-07-07 Toshiba Corp Information processing apparatus and pointing control method
CN102446049A (en) * 2010-10-11 2012-05-09 梁宇杰 Device and method for cursor operation induction processing and using external display devices to display information

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030025678A1 (en) * 2001-08-04 2003-02-06 Samsung Electronics Co., Ltd. Apparatus with touch screen and method for displaying information through external display device connected thereto
US20070126714A1 (en) * 2005-12-07 2007-06-07 Kabushiki Kaisha Toshiba Information processing apparatus and touch pad control method
US20100085316A1 (en) * 2008-10-07 2010-04-08 Jong Hwan Kim Mobile terminal and display controlling method therein
US20110093822A1 (en) * 2009-01-29 2011-04-21 Jahanzeb Ahmed Sherwani Image Navigation for Touchscreen User Interface
US7870496B1 (en) * 2009-01-29 2011-01-11 Jahanzeb Ahmed Sherwani System using touchscreen user interface of a mobile device to remotely control a host computer
US20100323762A1 (en) * 2009-06-17 2010-12-23 Pradeep Sindhu Statically oriented on-screen transluscent keyboard
US20110022990A1 (en) * 2009-07-22 2011-01-27 Elan Microelectronics Corporation Method for operation to a multi-touch environment screen by using a touchpad
US20110181520A1 (en) * 2010-01-26 2011-07-28 Apple Inc. Video out interface for electronic device
US20110254774A1 (en) * 2010-04-20 2011-10-20 Nec Casio Mobile Communications, Ltd. Terminal device and recording medium with control program recorded therein
US20120287058A1 (en) * 2010-08-27 2012-11-15 Google Inc. Switching display modes based on connection state
US20120098771A1 (en) * 2010-10-22 2012-04-26 Sony Corporation Operational terminal device, display control device, method of operating terminal device, method of operating display control device, and system
US20120271969A1 (en) * 2011-04-22 2012-10-25 Akihiko Ikeda Multifunctional touch-enabled devices
US20130050122A1 (en) * 2011-08-31 2013-02-28 You-Jin KANG Controlling user equipment as touch pad for external device connected thereto
US20130285927A1 (en) * 2012-04-30 2013-10-31 Research In Motion Limited Touchscreen keyboard with correction of previously input text

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9207855B2 (en) * 2006-10-26 2015-12-08 Apple Inc. Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker
US20140125609A1 (en) * 2006-10-26 2014-05-08 Apple Inc. Portable Multifunction Device, Method, and Graphical User Interface for Adjusting an Insertion Point Marker
US9632695B2 (en) 2006-10-26 2017-04-25 Apple Inc. Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker
US9348511B2 (en) 2006-10-26 2016-05-24 Apple Inc. Method, system, and graphical user interface for positioning an insertion marker in a touch screen display
US9846533B2 (en) 2009-03-16 2017-12-19 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US9875013B2 (en) 2009-03-16 2018-01-23 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US10761716B2 (en) 2009-03-16 2020-09-01 Apple, Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US9092130B2 (en) 2011-05-31 2015-07-28 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US9244605B2 (en) 2011-05-31 2016-01-26 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US10664144B2 (en) 2011-05-31 2020-05-26 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US11256401B2 (en) 2011-05-31 2022-02-22 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US20130091449A1 (en) * 2011-10-06 2013-04-11 Rich IP Technology Inc. Touch processing method and system using a gui image
US9489125B2 (en) * 2011-10-06 2016-11-08 Rich IP Technology Inc. Touch processing method and system using a GUI image
US20140210713A1 (en) * 2013-01-31 2014-07-31 Samsung Electronics Co., Ltd. Method for controlling display of pointer and displaying the pointer, and apparatus thereof
US9600088B2 (en) * 2013-01-31 2017-03-21 Samsung Electronics Co., Ltd. Method and apparatus for displaying a pointer on an external display
US20140218310A1 (en) * 2013-02-01 2014-08-07 Rich IP Technology Inc. Touch display driving circuit capable of responding to cpu commands
US9176613B2 (en) * 2013-02-01 2015-11-03 Rich IP Technology Inc. Touch display driving circuit capable of responding to CPU commands
US20160026331A1 (en) * 2013-03-14 2016-01-28 Rich IP Technology Inc. Touch display driving circuit capable of responding to cpu commands
US20170371492A1 (en) * 2013-03-14 2017-12-28 Rich IP Technology Inc. Software-defined sensing system capable of responding to cpu commands
US9778784B2 (en) * 2013-03-14 2017-10-03 Rich IP Technology Inc. Touch display driving circuit capable of responding to CPU commands
US9256316B2 (en) 2013-05-04 2016-02-09 Nvidia Corporation Power gating a display of a data processing device during cloning thereof across an external display while retaining touch-sensibility thereof
TWI511121B (en) * 2013-05-04 2015-12-01 Nvidia Corp Power gating a display of a data processing device during cloning thereof across an external display while retaining touch-sensibility thereof
US20140372915A1 (en) * 2013-06-13 2014-12-18 Compal Electronics, Inc. Method and system for operating display device
US20150009096A1 (en) * 2013-07-08 2015-01-08 Lg Electronics Inc. Wearable device and the method for controlling the same
US20150067577A1 (en) * 2013-08-28 2015-03-05 Acer Inc. Covered Image Projecting Method and Portable Electronic Apparatus Using the Same
US20160117081A1 (en) * 2014-10-27 2016-04-28 Thales Avionics, Inc. Controlling entertainment system using combination of inputs from proximity sensor and touch sensor of remote controller
TWI664621B (en) * 2015-04-17 2019-07-01 美商惠普發展公司有限責任合夥企業 Management of display inputs
US20180005603A1 (en) * 2015-04-17 2018-01-04 Hewlett-Packard Development Company, L.P. Management of display inputs
EP4235414A3 (en) * 2017-03-29 2023-10-18 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
CN108694032A (en) * 2017-03-29 2018-10-23 三星电子株式会社 Use the picture outputting method of external equipment and the electronic equipment for supporting it
US11119601B2 (en) * 2017-03-29 2021-09-14 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
EP3382524A1 (en) * 2017-03-29 2018-10-03 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
EP4231130A3 (en) * 2017-03-29 2023-10-18 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
US11669190B2 (en) 2017-03-29 2023-06-06 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
US11747933B2 (en) 2017-03-29 2023-09-05 Samsung Electronics Co., Ltd. Screen output method using external device and electronic device for supporting the same
US11372609B2 (en) * 2017-10-05 2022-06-28 Displaylink (Uk) Limited System and method for locally generating data
WO2019117566A1 (en) * 2017-12-12 2019-06-20 삼성전자 주식회사 Electronic device and input control method thereof
US11353968B2 (en) 2017-12-12 2022-06-07 Samsung Electronics Co., Ltd Electronic device and control method for providing display coordinates on an external display device
US11320880B2 (en) 2018-11-01 2022-05-03 Hewlett-Packard Development Company, L.P. Multifunction display port
US20220283770A1 (en) * 2021-03-02 2022-09-08 Champ Vision Display Inc. Control method of electronic device and external control device

Also Published As

Publication number Publication date
TW201421350A (en) 2014-06-01
CN103838505A (en) 2014-06-04

Similar Documents

Publication Publication Date Title
US20140139431A1 (en) Method for displaying images of touch control device on external display device
US8659553B1 (en) Orientation-based touchscreen display
US20230068100A1 (en) Widget processing method and related apparatus
US8799828B2 (en) Scrolling method and apparatus for electronic device
US20140149905A1 (en) Electronic device and page navigation method thereof
KR101673068B1 (en) Text select and enter
US20140351761A1 (en) Method and apparatus for displaying picture on portable device
US20120317503A1 (en) Apparatus and method for providing web browser interface using gesture in device
US20150370458A1 (en) Responding to user input including providing user feedback
US20130120251A1 (en) System and method for mutually controlling electronic devices
US20120223898A1 (en) Display control device, display control method, and program
US20100265209A1 (en) Power reduction for touch screens
US20120262388A1 (en) Mobile device and method for controlling mobile device
US20150339026A1 (en) User terminal device, method for controlling user terminal device, and multimedia system thereof
US8044932B2 (en) Method of controlling pointer in mobile terminal having pointing device
AU2013276998A1 (en) Mouse function provision method and terminal implementing the same
US10019148B2 (en) Method and apparatus for controlling virtual screen
EP2824562B1 (en) Method and apparatus to reduce display lag of soft keyboard presses
US20150128080A1 (en) Method and terminal for determining operation object
EP2998838B1 (en) Display apparatus and method for controlling the same
US20160142624A1 (en) Video device, method, and computer program product
KR20170074537A (en) Remote control apparatus, method for controlling thereof, display system
US20160170596A1 (en) Image display apparatus, image display method, and image-display program product
CN111782169A (en) Computer system, display device and operation method of display interface on screen
US10949078B2 (en) Display apparatus, display method, and non-transitory computer-readable recording medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: HTC CORPORATION, TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TSENG, CHIEH-CHIH;WU, JENN-WEIN;CHUEH, HSIN-TI;REEL/FRAME:029342/0311

Effective date: 20121114

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION