WO2006130727A2 - System and method for flexible user interfaces - Google Patents

System and method for flexible user interfaces Download PDF

Info

Publication number
WO2006130727A2
WO2006130727A2 PCT/US2006/021185 US2006021185W WO2006130727A2 WO 2006130727 A2 WO2006130727 A2 WO 2006130727A2 US 2006021185 W US2006021185 W US 2006021185W WO 2006130727 A2 WO2006130727 A2 WO 2006130727A2
Authority
WO
WIPO (PCT)
Prior art keywords
client
data
application
content
server
Prior art date
Application number
PCT/US2006/021185
Other languages
French (fr)
Other versions
WO2006130727A3 (en
Inventor
Meyyappan Alagappan
Stephen Paul Paddon
Thomas Sherwin Paddon
Alexander Flavio Panelli
Original Assignee
Trilibis Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/151,798 external-priority patent/US20060077941A1/en
Application filed by Trilibis Inc. filed Critical Trilibis Inc.
Publication of WO2006130727A2 publication Critical patent/WO2006130727A2/en
Publication of WO2006130727A3 publication Critical patent/WO2006130727A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/04Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577Optimising the visualization of content, e.g. distillation of HTML documents
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/30Profiles
    • H04L67/303Terminal profiles

Definitions

  • This invention relates to user interfaces for applications for clients in client-server computer systems. More particularly, but not by way of limitation, this invention enables the implementation of user interfaces for a plurality of server-based applications on a plurality of client types with fast performance and reduced upfront development time.
  • Client-server computing systems typically use servers to provide services to a client.
  • the client is often smaller, less capable, less expensive, and more mobile than an associated server.
  • One server usually provides services to multiple clients, whereas a client can often obtain services from multiple servers.
  • the communication link between a client and a server may be of any appropriate type, including wired or wireless.
  • wireless clients offer the opportunity for tether-free mobility, and usually have self-contained power sources such as batteries. Communication bandwidth is usually restricted more for a wireless connection than it is for a cabled connection.
  • providing batteries for suitable client operating time constrains the power that can be consumed by the client. In the interest of providing more mobility and greater battery lifetimes for clients, it is important to reduce the computational burden required of clients to perform their functions.
  • thin clients Such minimal clients are sometimes referred to as "thin clients.”
  • a thin client for wireless use is often implemented to reduce memory and processor requirements for reduced power consumption, size, and cost - while at the same time, conserving wireless communication bandwidth for communication with a server or other devices over a communication channel (often wireless).
  • the term mobile data communication device can refer to a wireless communication device that provides access to wireless data services when in communication with a server.
  • wireless communication devices include "smart" cell phones, wireless enabled notebook computers or PDAs, alphanumeric pagers, and many others that are limited only by the imagination.
  • wireless data services have proliferated more and more among mobile communication device users, especially, for example "smart" cell phone users.
  • Popular wireless data services for cell phone users currently include, among others, e-mail exchange (including graphics), short message service, internet browsing, and paid mobile access to databases. Emerging services further include, position location based services, wireless advertising, wireless "e-community" services - to name a few -with the list being constantly expanded. Expanding the user popularity and commercial potential of wireless data services generally depends on their widespread deployment with minimal development, deployment, and operating costs.
  • RTOS real time operating systems
  • RTOS real time operating systems
  • Cell phone service providers for example, often endeavor to support cell phones from manufacturers espousing different software platform standards such as WAP (the "Wireless Applications Protocol” standard), J2ME (a mobile version of Java®), BREW (from QUALCOMM, Inc.), and others.
  • WAP the "Wireless Applications Protocol” standard
  • J2ME a mobile version of Java®
  • BREW from QUALCOMM, Inc.
  • Wireless data enabled PDA manufacturers often alternatively use software platforms such as Palm OS® (from Palm Computing, Inc.), Windows® Mobile (from Microsoft, Inc.), Symbian® (a European standard), and Blackberry® OS, among others.
  • devices for user data input, and visual displays can vary greatly in capabilities from product to product.
  • Devices for user data input include keyboards ranging from augmented phone dial pads to full QWERTY (also called ASCII herein) keyboards, as well as others such as touch screens.
  • Displays can be monochrome or color, of various resolutions and aspect ratios, different character set capabilities, different vector graphics capabilities, and different levels of grayscale or color depth as expressed in bits.
  • the current invention provides a method and system for implementing a user interface for providing a data service in a mobile client using a server with knowledge of the client's hardware and software capabilities (hereinafter referred to jointly as "device characteristics") to modify data content and display rules for an improved user interface on the client.
  • Data may be cached on the client to improve application response time and to provide stand-alone application capabilities for the client.
  • the automatic conversion of newly developed applications for a plurality of clients with differing client device characteristics reduces application software development and maintenance costs.
  • Software updates and bug fixes for previously deployed applications can be deployed to mobile communication devices using the same method and system, through data downloads when a client device accesses an application.
  • a method for determining a data format handling capability of a client by a first server in a client-server system comprises: receiving a data packet that was transmitted by the client at the first server, the data packet having a data packet header comprising indicia designating the type of client that transmitted the data packet; correlating the indicia with one of a plurality of stored indicia, each stored indicia having a corresponding stored data format handling capability indication for a type of client; and selecting the most correlated data format handling capability as the data format handled by the client.
  • Some embodiments further comprise translating the data format of the received data packet from the data format handled by the client to a second data format, and transmitting the translated data packet to a second server, and/or receiving an application content data packet in the second data format from a third server, translating the application content data packet to the data format handled by the client, and transmitting the translated application content data packet to the client.
  • the data format handling capability of the client comprises on of the set of data formats consisting of WML and xHTML
  • the second data format comprises HTTP.
  • a meta rule can comprise one of a plurality of meta rules that are translated according to the first policy meta rule, and a policy meta rule comprises one of a plurality of policy meta rules used to translate meta rules.
  • a method of controlling a native application of a mobile terminal, by a client residing on the mobile terminal, of a client-server based application comprises: invoking the execution of the native application; transferring control data to the native application; and terminating the execution of the native application, responsive to the received data.
  • the native application can be an Internet browser, or the native application can play audio files, streaming audio files, video files, streaming video files, or the like.
  • data can be received by the client from a native application, and transmitted to a server of the client-server based application.
  • Exemplary native applications include, among others, audio recorders, photo albums, address books, and calendars.
  • a data file residing on a mobile terminal for use by a native application can be added or modified with data received from the server.
  • Exemplary types of native application data include, among others, ring tones and wallpapers.
  • Figure 1 is a block diagram illustrating an overview of an exemplary wireless network in accordance with one embodiment of the present invention.
  • Figure 2 illustrates display pages of an exemplary mobile application in another embodiment of the invention.
  • Figure 3 is a diagram illustrating a high level view of a wireless data service being deployed to a client in accordance with one embodiment of the invention.
  • Figure 4 illustrates an application server in accordance with one embodiment of the invention.
  • FIG. 5 is a flowchart illustrating server processing in accordance with an embodiment of the invention.
  • Figure 6 illustrates an expanded operational diagram in accordance with a further embodiment of the invention showing billing and reporting modules.
  • Figure 7 illustrates architectural details of a record reporting system according to an embodiment of the invention.
  • Figure 8 illustrates a screen displaying a View Applications page in accordance with one embodiment of the reporting module.
  • Figure 9 illustrates a screen displaying a Register New Application page according to another embodiment of the invention.
  • Figure 10 illustrates a computer screen displaying a View Reports Page according to yet another embodiment of the invention.
  • Figure 11 illustrates a computer screen displaying a View New Applications Page in accordance with another embodiment of the invention.
  • Figure 12 illustrates architectural details of WAP module embodiment.
  • Figure 13 is a flowchart illustrating WAP module processing according to an embodiment of the invention.
  • Figure 14 illustrates a client in accordance with another embodiment of the invention.
  • Figure 15 is a flowchart illustrating client processing in accordance with one embodiment of the invention.
  • Figure 16 is a flowchart showing client processing in accordance with another embodiment of the invention.
  • Figure 17 is a flowchart showing client processing in accordance with a further embodiment of the invention.
  • Figure 18 is a flowchart illustrating an operation of a content adapter in accordance with an embodiment of the invention.
  • Figure 19 is a flowchart showing the development of an application in accordance with an embodiment of the invention.
  • Figure 20 illustrates an exemplary client display screen for an exemplary application in a further embodiment of the invention.
  • Figure 21 illustrates a computer display screen of an application development tool in an embodiment of the invention.
  • Figure 22 illustrates another computer display screen of an application development tool in an embodiment of the invention.
  • Figure 23 illustrates an exemplary hardware architecture of a server in an embodiment of the invention.
  • Figure 24 illustrates an exemplary hardware architecture of a client in another embodiment of the invention.
  • One embodiment of the present invention is directed toward a novel system and method to enable software developers for a client-server environment to efficiently develop, deploy, and maintain an instance of an application that can be configured to operate on different types of client devices, including mobile communication devices such as mobile phones, smart phones, personal digital assistants, and two-way paging systems.
  • developers are provided with the tools and features to develop and deploy applications that are, at least to some extent, device independent. In one or more implementations, these goals can be accomplished with little or no modification to existing infrastructure and without a need for a manufacturer's modification of client devices.
  • FIG. 1 is a block diagram illustrating an overview of this example wireless network in accordance with one embodiment of the present invention.
  • the illustrated wireless network includes one or more mobile communication devices 102, one or more mobile base stations 101, and a communication network 105. Also illustrated are a server 108, a firewall 110, and content service providers 111, which can be included to interface to the wireless communication network in accordance with one embodiment of the invention.
  • the clients in this example mobile communication devices 102, can be implemented as smart phones, which can be implemented as a wireless phone (for example, a cellular telephone) with data features.
  • a wireless phone for example, a cellular telephone
  • the invention is from time to time described herein in terms of clients implemented as smart phones 102.
  • mobile communication devices 102 are in wireless communication with one or more base stations 101.
  • a base station 101 may be implemented as a conventional cellular telephone base station, or another type of relay or base station such as, for example, a wireless access point in a wireless local area network.
  • other devices may be utilized to allow a client to access a server such as, for example, a router or gateway or other like device.
  • base stations 101 can in certain implementations be described as having three components.
  • the cell sites which are often referred to as base transceiver stations or BTS 's, communicate directly with the mobile communication devices 102.
  • Base station controllers or BSCs (not shown) control the base transceiver stations either over land links (typically) or over radio links.
  • Mobile switching centers or MSCs (not shown), often called mobile telephone switching offices, control the base station controllers, usually over land links. There is no fixed ratio of BTS to BSC to MSC, required, and these base station functions may be combined into a single site.
  • Often cellular phone systems, and other wireless mobile data systems have multiple base stations 101. This provides for data communication service handoff from one base station to another as a mobile data terminal roves among the base stations' respective coverage areas.
  • Smart phones 102 can be implemented utilizing one or more of several types of real time operating systems (RTOS) 103 running on an internal processor such as, for example a baseband or other processor (also referred to as "microprocessor” or “microcontroller”), operating system 103 can interface applications running on the internal digital processor with hardware operably connected with the processor, such as, for example, a radio frequency (RF) modem, a keypad, a visual display, baseband, mixed-signal and analog circuitry, and others.
  • RF radio frequency
  • Various smart phones 102 can be implemented using various different configurations of hardware and software, including, for example, different types or versions of operating systems 103 and different configurations of user interfaces (for example, keypads and displays).
  • each of two base stations 101 is illustrated as being in wireless connection with a respective one of two mobile communication devices 102. Because base stations 101 are connected via network 105 in Figure 1, mobile communication devices 102 can communicate with one another through the base stations 101 and network 105, or sometimes directly. Of course additional base stations 101 and additional mobile communication devices 102 (and various alternatives of either) can be eliminated, substituted, or added as well.
  • Network 105 may be implemented as any type or combination of types of communication network, including local area and wide area networks of varying configurations and protocols.
  • base stations 101 are sometimes connected using the asynchronous transfer mode (ATM) standard protocol.
  • ATM asynchronous transfer mode
  • IP v.4 or IP v.6 Internet Protocol
  • the cellular network is designed to connect to the existing phone system, also called the Public Switched Telephone Network or PSTN (not illustrated), or to other data network voice or data networks.
  • PSTN Public Switched Telephone Network
  • the connection to the PSTN is similar to the connection of other telephone switching equipment such as a Public Branch Exchange (PBX).
  • PBX Public Branch Exchange
  • one or more mobile communication devices 102 can include a UI engine 104 that can be implemented as an application that is interfaced with, or running "on top of," operating system 103 in a mobile communication device 102. In can also be implemented in various other software embodiments, or as hardware, firmware, or other logical components. In an embodiment of the present invention, UI engine 104 can be implemented so as to improve the user interface performance for wireless data applications.
  • content service providers 111 can interface with the wireless communication network to provide one or more items of content to network users.
  • content items such as games, ring tones, screen savers, photographs, movies, and other applications and content items (generally referred to herein as "content"
  • content service providers 111 can be connected to network 105 in various different ways to enable downloading of content to the clients 102.
  • content can be downloaded to the mobile communication device 102 using other means such as, for example a direct connection.
  • One example of a direct connection can be a synchronization operation between the mobile communication device 102 and a user's personal computer where the content was previously downloaded to or otherwise resides on the computer and is subsequently downloaded to the mobile communication device 102 during a synchronization or other operation.
  • server 108 can be implemented so as to support applications for UI engine 104 on clients 102. In one embodiment, this can be accomplished by retrieving application content from service providers 111 and processing content.
  • One or more content service providers 111 can be in communicative contact with the example environment. They can access network 105 and one or more servers 108 in a number of different ways. For example, a content service provider 111 may have a connection to server 108 other than through the network 105. Additionally, a content service provider 111 may be in communicative contact with a server 108 via network 105. Although content service provider 111 is illustrated as being somewhat directly connected to network 105, other communication channels, connections or interface techniques can be provided to allow communication between content service provider 111 and server 108.
  • Content service provider 111 provides data services to clients 102.
  • Content services providers 111 are often implemented as servers, and can use similar hardware and operating system software to server 108.
  • Types of data services are too numerous to list, but can include, for example: news, weather, driving directions, horoscope, stock quotes, hotel and restaurant information, etc.
  • content service providers 111 can also provide other content to one or more clients 102 such as, for example, applications and application programs, media content, software plug-ins and modules, games and gaming applications suitable for running on a client device 102, and other forms of content or other information that may be useful or of interest to the user with his or her client device 102.
  • the term "content” is used to refer to any of a number of different forms of information, data, application, media or other content that may be provided from a content service provider 111 to a client device such as a mobile communication device 102.
  • This content can be in various forms and include one or more of a plurality of different data or information types including, for example, software or other code, graphics, textual information, audio information, image information, and video information.
  • UI Engine 104 transmits an event to a server 108 communicatively connected to the network.
  • the event includes device characteristics about the requesting device and the content. These device characteristics can include, for example, information such as an identification of the requested content along with other useful information such as, for example, information to identify the mobile communication device 102 for which the request is made.
  • the event may include an identification of the brand, model, type or class of mobile communication device 102 for which the content is being requested. Additional examples of device characteristics are provided below.
  • a rule set is appropriately applied to the content based on device characteristics from the requesting client device 102 (e.g., device type, class, brand, model, carrier, application, application state, and so on), thus formatting or otherwise preparing the content for execution on the mobile communication device 102. This process of combining a rule set with content is described in greater detail below with reference to Figure 4.
  • one embodiment of the invention provides the capability to download a UI Engine 104 configured for the specific mobile communication device 102 or class of mobile communication device 102. In one embodiment, this can be downloaded transparently before a first component of the application (for example a splash screen) is downloaded. Thus, a UI Engine 104 can be prepared and downloaded to the client device 102 for the particular content item requested. As such, one or more UI Engines 104 may be installed and running on a given client device 102 in this particular embodiment.
  • UI Engine it is not necessary that a given UI Engine 104 perform any or all of the functionality that may be traditionally or conventionally associated with UI Engines 104 in implementations of client devices 102 such as, for example, mobile communication devices 102.
  • client devices 102 such as, for example, mobile communication devices 102.
  • UI Engine should not be construed as limited to a conventional or traditional UI Engine.
  • Mobile communication device 102 can be configured so as to execute UI Engine 104 which, in one embodiment as mentioned above, is specific to that mobile communication device 102, or to that class of devices to which mobile communication device 102 belongs.
  • UI Engine 104 can be created once per device and configured so as to be able execute various application interfaces.
  • mobile communication device 102 can perform specified functions by downloading a UI component that can include a rule set for the desired content item along with any associated content data or information.
  • Figure 2 illustrates exemplary application display pages as they could appear on a mobile communication device display in accordance with one embodiment of the invention.
  • Figure 2a shows an example initial display page for a hypothetical application (i.e., content) used to retrieve and provide information to a user of a mobile communication device 102 in a number of different categories as listed on the exemplary screen shot.
  • the categories shown in this example are emergency services, gas stations, restaurants, and hotels.
  • Figure 2b shows an example of the screen in Figure 2a, but with one of the categories, in this case "restaurants," being highlighted.
  • This selection can be made, for example, through a user actuation of an input device such as a keyboard, keypad, joystick, touchscreen, touchpad, mouse, voice command interpreter, or other user interface. This is generally referred to as a user input.
  • an appropriate user input the user selects the category for which he or she desires more information.
  • a simple user action such as, for example, pressing an Enter key or other action via a user interface, can facilitate selection of the highlighted category.
  • An event need not be selected by first highlighting a category as illustrated in the above example.
  • an event can be generated via a number of different user inputs including, for example, a direct selection of the desired category via the available user interface.
  • an event can also be generated by server action or via another device.
  • This selection generates an event that can be used to facilitate retrieval of additional content as specified by the event.
  • the event can be used to indicate to the application that additional information about the category of restaurants is requested by the user.
  • the example screen illustrated in Figure 2c can be retrieved and displayed which, in this case, lists categories or types of restaurants from which the user may choose.
  • the example display page illustrated in Figure 2c shows a listing of the categories or types of restaurants about which additional information can be retrieved in the currently running application.
  • the user can cause one of the categories to be selected, which results in an event, to facilitate retrieval of additional content.
  • the user highlighted the category "Mexican" for selection as the type of restaurant about which he or she desires additional information.
  • Mexican restaurants As a result of this event, additional information about Mexican restaurants is provided as illustrated by the example display of Figure 2d.
  • various categories of Mexican restaurants are provided which, in this example, are particular Mexican restaurants by name such as, for example, Acapulco, Taco Bell, El Torito, and so on.
  • a user input selects a category of Mexican restaurant that results in the display of Figure 2e, which in this example is a selection of location cities for that category of Mexican restaurant. Selecting a location city results in information about a specific restaurant being displayed in Figure 2f.
  • each user input on the various screens selects or generates exit criteria for a display page that results in the loading of the next display page, that can be one of a plurality of possible next display pages. For example, if the user had selected the category "Italian" in Figure 2c, the display of Figure 2d could display categories of Italian, instead of Mexican, restaurants.
  • one or more display pages can include exit criteria for the page, which can vary for the various selections or options associated with the page. The exit criteria can be used to generate the appropriate event to retrieve an appropriate next screen based on the user input.
  • Figures 2b - 2f also include “Back” as an option.
  • the "Back” option allows users to recover from mistaken entries, or to back track through selections.
  • buttons or selections can be included depending on the application and depending on the application developer's wishes or goals in creating the application. For example, Home and End buttons can be provided as well as other action buttons, allowing exit criteria to be actuated and events to be generated.
  • one or more of the content screens include exit criteria that are used to facilitate retrieval of a subsequent screen.
  • exit criteria can be included to provide information about an action to be taken or additional content to be retrieved or displayed based on a user input.
  • the invocation of exit criteria can result in the creation of an event that can be used to facilitate retrieval of additional content.
  • the event can be sent to the server 108 to indicate to the server that additional content has been requested and also to indicate the type or other specific information about the requested content.
  • events do not necessarily need to be forwarded to a server such as, for example, server 108 to retrieve additional content in response thereto.
  • a server such as, for example, server 108 to retrieve additional content in response thereto.
  • one or more various content items can be cached locally or at some other location and the content retrieved from the cache rather than from a remote location.
  • Applications composed of display pages with exit criteria pointing to subsequent display pages can contain both static and dynamic content.
  • Static content preferably does not change or at least does not change frequently with time.
  • Static content may be loaded in an application executing on UI Engine 104 of a mobile communication device 102, and optionally updated on an infrequent basis, or never updated.
  • static content could include service categories or perhaps a splash screen or main menu.
  • Dynamic content is content that generally goes out of date more frequently and is therefore typically periodically refreshed. Examples of this can include restaurant addresses, addition of new restaurants, changing phone numbers and so on.
  • pages displaying various news items or advertisements may utilize frequent updates.
  • each display page has exit criteria that can point to, for example, a next display page, one of a plurality of next display pages, an application execution termination, or a branching to another application.
  • the rule set comprises a set of application display pages.
  • the rule set may include an introductory splash screen display page and can further include one or more subsequent display page(s) that can be "clicked" through by user input via either keypad entry, touchscreen entry, voice commands or other user interface command. Because the original event identified the type or class of mobile communication device 102, this information can be used, for example to ensure that these screens are formatted properly for suitable display on the particular mobile communication device 102.
  • UI Engine 104 transmits another event to a server 108 that is preferably communicatively connected to the network.
  • the event in one embodiment can include information such as an identification of the content and a screen identification, along with other useful information to identify the content and the mobile communication device 102 for which the request is made.
  • rule sets based on device characteristics such as, for example, a resolution size for a device, font size, language preference, font type supported, an application identifier and an application state indicator that specifies the current state of the identified application as it runs on the mobile communication device, among others.
  • device characteristics such as, for example, a resolution size for a device, font size, language preference, font type supported, an application identifier and an application state indicator that specifies the current state of the identified application as it runs on the mobile communication device, among others.
  • This allows fine tuning of content parameters such as, for example, button sizes and label sizes, in order to take advantage of the mobile communication device-specific display or other characteristics.
  • the rule set may default to a standard rule set if no optimization has occurred for a characteristic of a given mobile communication device type.
  • This invention can be implemented in one embodiment to allow an application developer to develop and administer a data application for a mobile terminal that is subsequently compatible with multiple different clients without.
  • the server can maintain a plurality of rule sets that are used to conform the content to the requesting device - it not exactly, then at least close enough to enable suitable performance.
  • new rule sets can be added to better conform the application to one or more of the device characteristics corresponding to that type of client.
  • multiple rule sets can be maintained for various sets of device characteristics to enable appropriate delivery of content.
  • the server can also maintain or utilize data and instruction transformation rules, which are referred to as meta-rules.
  • Meta rules as also discussed below with reference to Figure 4 can, be used to conform rule sets to various devices or special conditions.
  • a meta-rule in one embodiment can be thought of as a rule that modifies a rule set or the application of a rule set.
  • the invention can be implemented in one embodiment so as to allow separation of tasks of developing and maintaining applications, from the tasks of preparing, optimizing or conforming applications for specific types for terminals.
  • Embodiments of the invention provide developers with the ability to develop and deploy client device independent applications that can ultimately be tailored to particular client device characteristics, either manually or automatically.
  • development is performed using a workflow.
  • a workflow may be utilized in one embodiment as a sequence of application screens (referred to herein as display pages).
  • the sequence of displays can be defined in terms of exit criteria used for the various screens. Transitioning from one screen to a next screen can be made so as to be contingent on events generated from user input or other action with exit criteria defining how to respond to a particular event.
  • An event for example, may be an item of data received by a first client device from a server, an item of data received from another client device, or a user interface actuation of the first client device.
  • a display page in one embodiment can be implemented as representing a set of data content and associated formatting instructions to generate a user interface display.
  • Display components sent to a client comprise device specific instructions to render an appropriate display (or provide other appropriate user interface functions) on a client.
  • a display page may be defined as a display component that is built with lower level display components. Together, a set of one or more display components is herein referred to as a rule set.
  • a rule set may be used to define various user interface features or other device specifications for providing the appropriately configured display page or pages to the client. For example, a rule set may define the audio or video display of information and formatting on a client, or how user information from a client is used and so on.
  • a rule set a set of criteria for one or more display pages, assembled with their respective content as a template or with a placeholder for respective content to be added.
  • Display pages can include exit criteria that specify, perhaps conditionally, information such as, for example, the next display page to be displayed. Additional exit criteria could include, for example, responses to warnings received from the server, or application termination responsive to receipt of an error message from a server.
  • workflows may include global data comprising visual display components that may be common to more than one display page in an application, or even to more than one application.
  • Examples of global data may include various cached messages or images, some or all of which can be cached to speed the execution of a client application, while minimizing client device memory requirements.
  • FIG 3 illustrates how a server 302 can provide content to a plurality of clients 304 in accordance with one embodiment of the invention.
  • the data connectivity between a server and a content service provider 301 may be implemented in a variety of ways.
  • server 302 can be implemented on a server 108 and communicate with a client 304 such as a mobile communication device 102 via client/server communication providers 303 such as the wireless network.
  • Server 302 communicates with clients 304 through one or more client/server communication providers 303.
  • client/server communication providers 303 may be a cellular carrier or other wireless service provider.
  • Server 302 may provide application service through just one, or a plurality of client/server communication providers 303.
  • providers 303 may use other types of cabled or wireless communication services such as, for example, wide area networks, local area networks and other communication interfaces.
  • Rule set 305 is accessed by server 302 to provide the content bearing applications to clients 304, in conjunction with data from content service providers 301.
  • Rule set repository 305 may be maintained at server 302, or at a remote server that is in communication with server 302.
  • a client 304 may be a mobile communication device 102 such as, for example, a smart cell phone, a personal digital assistant (PDA) with wireless access, a notebook computer with wireless access, or any other client device.
  • data connectivity may be by cable, optical fiber, or other wired or wireless means.
  • a client/server communication provider 303 provides a bidirectional data link between a server 302, and a client 304.
  • client/server communication provider 303 is a wireless communication provider that can provide communicative connectivity between the mobile communication device 102 and one or more devices such as servers 108 or content service providers 111 associated with the network.
  • client/server communication provider 303 may conform to one of a variety of wireless cellular phone or wireless data communication standards such as code division multiple access (CDMA), frequency division multiple access (FDMA), time division multiple access (TDMA), or orthogonal frequency division multiple access (OFDM), or other types as are well known to one of ordinary skill in the art.
  • CDMA code division multiple access
  • FDMA frequency division multiple access
  • TDMA time division multiple access
  • OFDM orthogonal frequency division multiple access
  • the data communications may be part of a circuit switched call, or an "always on" type of packet data service.
  • client/server communication provider 303 can be implemented so as to generally provide a substantially transparent channel of communication between client 304 and server 302.
  • server 302 links client 304, via client/server communication provider 303 to a content service provider 301.
  • Server 302 can be any type of computer with associated memory storage and data connectivity.
  • server 303 can be configured to transform data flows, manage client UI Engines, and perform other administrative and management functions.
  • Communication between server 302 and client 304 can be mediated by any of several communication protocols such as Brew®. J2ME®, WAP®, and Microsoft Corporation's Windows® Mobile.
  • rule set 305 can share physical memory according to some embodiments of the invention.
  • FIG. 4 provides a more detailed description of one embodiment of server 302 of Figure 3.
  • client interface 402 communicates with clients through air interface 401. In other embodiments, other communication interfaces with clients may be used, alone or in combination.
  • Client interface 402 communicates with content provider 111 via content adapters 407 and a communication channel, which is network 105 in the illustrated example.
  • the application server 302 in this embodiment comprises a client interface 402, selection logic 403, rule set translator 406, meta rules 405, and content adapters 407.
  • FIG. 5 is an operational flow diagram illustrating a process by which the example server system illustrated in Figure 4 can process client requests for content in accordance with one embodiment of the invention. Some aspects of the operation of the server system of Figure 4 can be better understood in relation to the operation of the server as shown in the flowchart of Figure 5.
  • client interface 402 receives a message from a client 304 (not shown in Figure 4) via air interface 401.
  • the message received from the client 304 can be in the form of an event that indicates information about the content being requested such as, for example device characteristics.
  • the event can provide information pertaining to a particular content screen being requested and information about the device requesting the content.
  • the event can include information specifying the information or type of information that is to be retrieved to fill in the content data screen. Due to the fact that data transmission rates between a mobile communication device and a server system tend to be low in certain environments, UI components and events may be encoded in binary in order to increase the responsiveness of the applications.
  • device characteristics are provided in a file that can be stored on the client device.
  • This thin client, or other file is, in one embodiment, designed to consume minimal storage space, while providing appropriate information regarding the device characteristics for assembly of the appropriate rule sets from a local cache or from an external source.
  • this file is maintained by the client and used for all applications.
  • the file is downloaded for a new application and reused for that application when an event is transmitted to the server.
  • device information is maintained in a file and augmented by application specific or other information that may be provided by an application or other event.
  • Table 1 includes exemplary device characteristic information such as display screen dimensions, and device characteristic software information such as Client-server protocol version ID number and UI Engine version ID number, in addition to data service request and status information.
  • Table 1 represents a specific example of information that can be included with a service request message. Other examples will become readily apparent to one of ordinary skill in the art after reading this description, including modifications, deletions, additions, and substitution of one or more fields or field definitions. Table 1
  • Client interface 402 can respond to the client with a service request, of which an example is given in Table 2. Note that this service request message can include information about the requested application, as well as warning and error status information for potential use by the client. Table 2
  • Client SW platform type e.g., J2ME, BREW®, SmartPhone
  • Table 2 represents a specific example of a service request acknowledgement. Other examples will become readily apparent to one of ordinary skill in the art after reading this description, including modifications, deletions, additions, and substitution of one or more fields or field definitions.
  • selection logic 403 examines the message and selects a rule set corresponding to the current state of the application being requested by the message. For example, this can be retrieved from a repository of rule sets 404.
  • Rule sets 404 in one embodiment provide information that can be utilized to format or otherwise allow content to be conformed to characteristics of a particular device or device class.
  • selection logic 403 utilizes information about the requesting device in making a determination as to which rule or rule set of a group of rules or rule sets to retrieve in fulfilling the request embodied by the message.
  • the message from the client device includes a listing or specification of the one or more device characteristics, including application state descriptors, for a particular mobile communication device.
  • selection logic 403 can look to those characteristics to determine a rule set that matches those characteristics.
  • the message can include an identification of the device or device type that is requesting the content. This identification can be used to access a look-up table or other repository that identifies the characteristics associated with the device identified by the device ID.
  • the message can contain this information each time a message is sent from the requesting device.
  • a rule set may not be available to identically match each of the characteristics specified for the requesting device or device type.
  • selection logic 403 can be implemented so as to select a closest or best match depending on a number of criteria.
  • a set of device characteristics includes a language preference, a screen aspect ratio, and a font size specification. If in this example, also assume that there are three possible device languages, three possible screen aspect ratios, and three possible font sizes, there are 27 potential different rule sets to match each of the 27 permutations of device characteristics.
  • selection logic 403 may be implemented to select the closest matching rule set based on available rule sets and an evaluation of their differences in the three parameters of font size, language, and aspect ratio.
  • the device characteristics can be weighted such that selection can be made based on the relative importance of the various parameters.
  • the best choice may be chosen as the rule set that addresses the appropriate language, as the screen may otherwise be unusable to the end user if it is not in a language that he or she can understand.
  • Selection logic 403 can also be implemented to determine or select a set of meta rules 405 on the fly or from meta rule repository (on the basis of client characteristic information included with the message) to be used to translate the selected rule set.
  • meta rules 405 can be implemented as rules that are used to modify (for example, to change or constrain) rule sets 404.
  • a rule set translator 406 is used to apply one or more selected meta rules 405 to the selected rule set to result in a translated rule set that can be used to conform the content to the requesting device.
  • a meta rule 405 can be implemented is a situation where it is preferable or desired not to exceed a given maximum font size for a device even if the device itself is capable of supporting a larger font size. For example, assume that a particular communication device can support a given font size, yet the display characteristics are such that it is more desirable to use a smaller maximum font size that this device can handle.
  • the meta rule translator 406 can identify the device, obtain the appropriate meta rule 405, which modifies the rule set to specify the preferred font size.
  • a meta rule 405 can be implemented to modify a rule set that may have been chosen by the selection logic based on given device characteristics.
  • the meta rule 405 would serve to insure that the selected rule set 404 utilizes the preferred maximum font size as opposed to a larger, but not preferred, maximum font size that may have been specified.
  • a meta rule 405 can be used to modify a rule set by rule set translator 406.
  • the modification can be done by adjusting one or more of the parameters that may be specified in a rule set 404. Meta rules are discussed in greater detail, below.
  • Rule set translator 406 delivers the translated rule set to client interface 402. If meta rules are not applied, the non-translated rule set is returned by selection logic.
  • Content adapters 407 retrieve and process dynamic and any updated static data from content providers 111 via network 105 for combining with the translated rule set by client interface 402. More specifically, in one embodiment, the translated rule set defines areas or locations on a display page where information or other content is to be included with the final rule set for delivery to the client device. As such, in this step 504, content adaptor 407 communicates with the appropriate content provider 111 (via network 105 in the illustrated example) to retrieve the appropriate information or other content for inclusion with the display page as defined by the rule set.
  • the information or content to be retrieved from a content provider 111 and included with the meta rule can include information pertaining to the various gas stations, restaurants, hotels, or other items for which information can be supplied via the hypothetical application.
  • the information is embedded in the rule set indicating which content is to be retrieved from a content provider 111.
  • identification of the appropriate content for inclusion with a rule set can be made by a number of different techniques including, for example, including an identification of the content with the event that is generated by the client to request the new rule set, including an identification of the content within the rule set itself, or otherwise appropriately identifying content for retrieval.
  • the content can be identified directly or indirectly, for example, via a look-up table.
  • an identification key is included with the event generated by the client application, preferably utilizing exit information associated with the application screen. This identification is provided to the content provider which utilizes the identification to identify the particular content to be retrieved, retrieves the content, and provides it to content adapter 407 for inclusion with the rule set.
  • This identification is provided to the content provider which utilizes the identification to identify the particular content to be retrieved, retrieves the content, and provides it to content adapter 407 for inclusion with the rule set.
  • rule sets are principally sets of interrelated display pages, they may also contain global data.
  • Global data can comprise, for example, bitmapped images, that are included once and reused by multiple display pages in order to save memory and communication bandwidth.
  • Global data may be cached only for the duration of an application's execution, or it may be maintained indefinitely, or until updated.
  • Global data may be used by a single application, or it may be used by multiple applications.
  • Global data can include data that is global to the particular client itself or data that is global to a particular application.
  • a given application may have a brand or other logo associated therewith that is included in one or more of the display screens of the application.
  • each screen includes the brand designation "TravelPal" on each screen.
  • a brand or other identification of the mobile communication device may appear on the screen of one or more applications running on the client device.
  • the client device is a mobile communication device such as a cellular telephone
  • the cellular carrier's brand or logo may also appear on one or more screens of one or more applications running on the device.
  • Global data is preferably cached locally to the client device to conserve bandwidth and other resources. However, global data may also be cached at other locations and communicated to the client device for inclusion with the display.
  • SmartEngineTM 306, wireless carrier 303, and end users 304 can be implemented as described above in connection with Figure 3.
  • Application development can be facilitated by a software module 1607 (described below, and sometimes referred to as SmartBuilderTM, herein) having a graphical user interface.
  • SmartBuilderTM a software module 1607 having a graphical user interface.
  • SmartEngineTM 306 can access application content from a content provider's 1606 database 1605 as described above in connection with Figures 1 and 3 to service applications. SmartEngineTM 306 can also access customer database 1604 to retrieve or store information related to customers, information such as profiles, preferences, and the like. Customer databases 104 can reside within SmartEngineTM 306 according to some embodiments or can reside with advertisers 1601, or content providers 1605, according to other embodiments. In further embodiments, customer databases 1604 can be distributed (and/or replicated in part or in whole) among two or more of these entities.
  • SmartEngineTM 306 may combine content-based applications with advertising for ultimate delivery to an end user 304 via wireless carrier 303.
  • module 1603 can provide integration between SmartEngineTM 306 and a billing system used by wireless carrier 303.
  • a billing system used by wireless carrier 303 includes those provided by third parties, systems such as Qpass® or Bango®, as well as carrier-proprietary billing systems such as the SprintTM Billing module.
  • Billing system formats and protocols are well known to one of ordinary skill in the art.
  • Billing options in addition to carrier-based account billing, are enabled because SmartRevenueTM can access device ID, session ID, unique user ID and related information from SmartEngineTM 306.
  • Such additional billing options include billing to an end user's charge card, debiting a phone card account, or "microbilling" (where end users charge to their mobile phone, eliminating the need to supply credit card information).
  • module 1602 (sometimes referred to as SmartManager®, herein) can end userr usage and revenue report reports based on transaction information from SmartEngine® 306. (The use of the term SmartManagerTM herein is for convenience only and does not to imply loss of generality from the generic description herein.)
  • Examples of information included in usage reports include, without limitation: (i) hit rates for content provider and advertiser sites visited; (ii) numbers and types of unique end users by carrier (as well as whether a unique end user is new to a service, through identification of a user flag set by the service); (iii) numbers and types of unique end user devices; and (iv) numbers and types of unique end user device's native software platforms.
  • "uniqueness" can be established, for example, on the basis of Unique User ID, Session ID, Device ID, and Carrier ID obtained from SmartEngineTM 306 on a per data communication transaction basis for end users 304.
  • information obtained from a customer profile database may be obtained through matching with such ID information. For reasons of consumer privacy, such data could be voluntarily submitted from a consumer in order to better customize content-based services and/or receive better targeted advertisements.
  • Examples of customer profile database information include without limitation: age, gender, home location, and current location.
  • Examples of information that can be included in revenue reports include, without limitation: (i) revenue generated by carrier; (ii) revenue generated by type of end user mobile terminal; and (iii) revenue generated by content provider's and/or advertiser's offers (on a per offer basis).
  • ID information related to consumers can be obtained via SmartEngineTM 306.
  • times and dates for such transactions can also be recorded, so that SmartManagerTM can generate reports covering specified time intervals.
  • Content providers 1606, advertisers 1601, and or wireless carriers 303 can access SmartManagerTM 1602 to evaluate the effectiveness of content services, advertising campaigns, and communication service offerings, respectively.
  • FIG. 7 illustrates a SmartManagerTM 1602 architecture according to an embodiment of the invention.
  • SmartEngineTM 306 handles communication transactions 307 for content-based services and/or advertising.
  • Module 1711 can extract information from the communication transactions such as (without exclusion): (i) site/page address; (ii) wireless carrier ID; (iii) end user software platform type ID; (iv) session (ID); (v) unique end user ID; (vi) unique end user phone type ID; and (vii) whether or not this is an end user's first use of an application (determined by inspecting a flag or "cookie" that is set by the application). This information can sometimes be obtained by inspecting a header of a transaction data packet, eliminating the need to take up communication transaction bandwidth for extra messages.
  • Report engine 1713 can access database 1712 to retrieve and process the collected data for report generation.
  • report engine 113 can access one or more additional, optional databases such as, for example, voluntary profile database 1714, carrier billing database 1715, and/or sales database 1716.
  • Figure 7 illustrates these optional database examples as residing within SmartManagerTM 1602. According to alternative embodiments they may reside wholly or partly elsewhere, as long as access by report engine 1713 is available. More generally, SmartManagerTM 1602 can be implemented on the same hardware as SmartEngineTM 306, or on different hardware as described below.
  • a system user 1703 can interact with report engine 1713 through, for example, a terminal 1702.
  • Exemplary terminal screen displays 1800 are illustrated in Figures 8 through 11 according to an embodiment of the invention.
  • the displays illustrated share some common features, such as option selection box 1801 (for click-select) and selected option name display 1803, otherwise the displays are different to accommodate subsequent actions corresponding to a selected option.
  • Figure 9 illustrates a "Register New Application” display.
  • the label "Application Name” 1904 corresponding to the selected option, is displayed in conjunction with text entry box 1905 and "Submit” button 1906.
  • Figure 10 shows a View Reports display allowing a user to specify criteria 2005 for report generation.
  • Figure 11 presents a "Not Deployed Application” display as a further example.
  • SmartManagerTM in response to a report request and specification, can interactively display reports on a terminal, and/or send them to other computer devices such as disc drives or printers.
  • additional modules can be interfaced with SmartEngineTM 306 to adapt it for operability with additional third parties.
  • third party adapters can include, without limitation: a Yahoo® location services adapter (that can goes to yet another third party's website to obtain latitude and longitude designations corresponding to a particular location position description); an Enpocket® adapter to provide various services based on SMS messaging; and page-based upcoming events interface adapter.
  • FIG. 12 Another type of adapter can allow SmartEngineTM 306 to adapt to mobile terminal clients having different data communication format capabilities for data services.
  • a functional module 2201 having data format detection and translation capabilities will be called a WAP Module for purposes of convenience, herein.
  • WAP Module 2201 mediates communication between SmartEngineTM server 302 and mobile terminal clients 304 A and 304B via client/server communication provider 303.
  • detection logic 2203 is operably connected to translator 2202 to detect which formats are supported by a mobile terminal client and directing translator 2202 to perform format translations accordingly.
  • detection logic 2203 can determine supported format types for a mobile terminal client as illustrated in example embodiment of Figure 13.
  • translator 2202 can examine header information for packets transmitted by a mobile terminal client to determine, for example carrier ID, device ID, and unique user ID.
  • detection logic 2203 queries lookup table 2204 which stores mobile terminal format capabilities associated with one or more of the ID items.
  • detection logic 2203 determines whether or not a particular mobile terminal client (phone) has xHTML format capabilities in step 2303, and if so, directs translator 2202 to perform HTTP/xHTML translations in step 2304. Otherwise, detection logic 2203 directs translator 2202 to perform HTTP/WAP translations as shown in step 2305. Determining a mobile terminal client's format capabilities from the examination of data packet header information can obviate the need to send additional overhead data packets to select translator options, thereby improving communication efficiency.
  • FIG 14 is a block diagram illustrating an example implementation of a client device in accordance with one embodiment of the invention.
  • the various components of the client may be implemented in hardware, software, firmware, or any appropriate combination of hardware, software, and/or firmware.
  • bidirectional communication with a server is achieved via an air interface 601.
  • air interface 601 can be implemented utilizing the cellular communication channel between the cellular telephone 102 and a base station 101.
  • additional communication equipment may be included between the server 108 and the air interface 601.
  • a parser 602 can be included convert data files to binary for transmission, and also can convert received binary data files to http, or any appropriate data format, for subsequent processing by a UI engine 603.
  • UI engine 603 runs on top of the operating system of the client, and implements an improved user interface for an application on the client.
  • a display driver 604 can be included and operably connects UI engine 603 and client display 605 for displaying application display pages. Although for the purposes of illustration in this embodiment, display 605 is a visual display, audio, tactile and other output devices may also be used. Display Driver 604 accesses display component library 610 to generate actual display pages from received rule sets (optionally augmented with content and global data).
  • a display page may be defined as a display component that is built with lower level display components.
  • Table 4 provides an example of a set of display components that may be included in display component library 610, and lists associated parameters that can be provided in one embodiment of the invention. These are discussed in more detail, below.
  • UI engine 603 can receive user interface inputs from user input device 608 via an event handler 607. Such user inputs can include key depressions, touch screen or touchpad actuations, joystick actuations, mouse actuations, or voice activated actuations, to name a few options.
  • UI Engine 603 can also interface with a cache 609 to retrieve cached display pages (rule sets), global data and other information.
  • Cache 609 can also store application state information, application version number information, and display page version number information, as well as UI version number, client ID, display and UI input device descriptions, and other types of information as discussed herein. Additionally cache 609 can retain cookies or other files or information left by the execution of applications for later retrieval by applications.
  • Event processing can occur, for example, when a UI Engine is informed by an event handler of a user interface actuation such as, for example, a graphical button on a GUI or a keystroke on a keypad.
  • an initial UI component is constructed from an application rule set and content data, either locally cached and/or received from the server system, resulting in a display page such as a splash screen or login screen, for example, to be presented on mobile communication device 102.
  • event information is transmitted from the UI engine to the client interface.
  • This event information can include information such as, for example, the application name, screen name, current application status, operation asserted by the user (such as a button press for a given button name) and any user input data.
  • client interface retrieves and provides the appropriate rule set, for example as described above with reference to Figures 4 and 5.
  • the air interface to the server 601 can be implemented in one of many alternatives including those that are readily known to those of ordinary skill in the art.
  • the air interface component for a mobile communication device 102 could be a wireless data modem implemented in conjunction with wireless voice services.
  • a Parser 602 can also be included to converts various message and data formats that may be used by UI engine 603 to, and from, a more efficient binary file format for transmission and reception over the air interface.
  • XML encoded files may be used by UI engine 603 in operation.
  • XML encoded files encode long text based names such as
  • the message may have been originally expressed in http, or a data format such as XML, at the client, but converted to a binary file representation at the client, prior to transmission via the air interface, in order to conserve transmission bandwidth and improve transmission efficiency.
  • client interface 402 may convert the binary file representation back to http, or another comparable data format, subsequent to further processing by the server. This conversion operation is referred to as parsing.
  • parsing Once the data received by client interface 402 via air interface 401 has been parsed, if parsing is used, the client interface 402 forwards the message to selection logic 403.
  • UI Engine 603 executes instructions used to implement the user interface.
  • UI Engine 603 in one embodiment is software that executes on a microcontroller or microprocessor in the mobile communication device client. Such a microcontroller or microprocessor also may execute other tasks for the mobile communication device on a time and resource sharing basis.
  • air interface 601, parser 602, event handler 607, and display driver 604 may also execute, at least in part, on the same microcontroller or microprocessor that executes UI engine 603.
  • UI engine 603 communicates with the server through the air interface and the optional parser, as described above.
  • UI engine 603 interfaces with cache 609 and event handler 607.
  • Cache can be implemented as memory storage circuitry and is used to store rule sets, global data, cookies, and application state information for a client-server application on the mobile communication device.
  • Event handler 607 captures and processes user input device actuations from the user input device 608, prior to passing them on the UI engine 603.
  • Display driver 604 receives higher-level display page descriptions from UI engine 603 and processes them according to display components stored in display component library 610.
  • display component library 610 can be implemented using memory storage circuitry. In some embodiments, cache 609 and display component library 610 may be implanted using the same memory circuit(s).
  • Display component library 610 contains display components (described in detail below) that translate the higher-level display page description (described above) into the actual displays that are shown on hardware display 605.
  • Display component library 610 can have a communication path with UI engine 603, so that display components can be initially stored, and later updated.
  • FIG. 15 illustrates an example of client processing in accordance with one embodiment of the invention.
  • event handler 607 captures a user actuation of user input device 608 and alerts 702 UI engine 603.
  • a user may select an icon on a screen of the mobile communication device that indicates the invocation of a specific application or service.
  • a user may select one or more items from a displayed list of items in an application.
  • the user actuation may be the depression of a single key, either hard labeled or soft labeled.
  • UI engine 603 can process the notification according to logic embodied, for example, as an exit criterion in a display pages of a rule set to generate a data message requesting an application service.
  • This message can also contain information about the client's status, such as, for example, client device characteristics, UI engine version number, application version number, version numbers of cached information, and current application state (if any).
  • parser 602 and air interface 601 convert and transmit the message, respectively, to a server system such as the one described in connection with Figure 4.
  • step 500 of Figure 15 the server processes the transmitted message and returns a message to the client. In one embodiment, this processing can be performed as described above in connection with Figure 5.
  • step 703 the client receives, converts, and caches returned rule set, content, and global data.
  • the UI engine may also display a first display page of the application session on the screen of the mobile communication device.
  • the above method may be used, for example, when a new client application is loaded for the first time, or when a previously loaded application requires updating.
  • Figure 16 is an operational flow diagram illustrating a process for displaying content in response to an event at a client device in accordance with one embodiment of the invention. In the embodiment illustrated in Figure 16, an action occurring at the client device can result in a request to a server 108 for content.
  • an event occurs.
  • an event handler 607 captures an application event indicating that additional content is requested. As described above, this can occur as a result of user interaction, interaction by another device, or via operation of the current application. For example, a user may make a menu selection, keypad entry, or other action or user input resulting in the identification of additional content to be retrieved.
  • exit information for a display screen may result in automatic generation of an event, for example, at the expiration of a time out period.
  • a splash screen may be configured so as to display on the client device for a given period of time and, at the end of the period of time, automatically transition to a subsequent screen such as, for example, a Welcome screen.
  • the event can include information such as, for example, an indication of a current screen as well as an indication of subsequent content or a display screen as requested as a result of the execution of the application and, where applicable, interaction with a user or another device.
  • the event indicates a subsequent rule set or display screen or other content to be displayed.
  • UI Engine 603 checks cache 609 to determine whether local copies of information specified by or identified by the event are stored locally. Thus, for example, UI Engine 603 can check cache 609 for locally-stored versions of the display screen, content, and global data. If some or all of the data are found in the local cache, as illustrated by step 803, then the operation continues at step 804.
  • the locally stored information is utilized in generating or providing content for the subsequent operation of the application.
  • a locally stored display screen, content information, and any global data can be retrieved from the cache, appropriately assembled (if not stored in a pre-assembled fashion), and provided for display. This is illustrated by steps 804, 805, and 806.
  • step 803 If, on the other hand, in step 803 certain of the requested information is not found in cache 609 or if the cached copy is stale, in a step 807, a request is sent to the server 108 for processing. This is illustrated by steps 807 and 500.
  • Server processing, as illustrated in step 500 can occur in one embodiment as discussed above with reference to Figures 4 and 5.
  • the updated rule set is received by the client device.
  • the rule set and any associated updated information can be used to update the cache 609. Additionally, this information can be used to display the appropriate information for the subsequent operation of the application such as, for example, the subsequent display screens, as illustrated by steps 805 and 806.
  • the system can also be implemented so as to combine one or more cached and newly retrieved content items in a single display page.
  • the UI Engine can enable a user to select a preference for type of currency, and subsequently provide inter- conversion between the currency type used in an application and the selected type of currency, including currency symbols and exchange rate conversions.
  • the Currency support feature can also provide secure memory storage of personal identification numbers (PINs) and/or passwords, optionally along with corresponding phone numbers.
  • PINs personal identification numbers
  • This PIN/password storage feature can allow access to these items for communication with server applications through a secret preset sequence of keystrokes on the mobile phone.
  • the PIN/password will not be displayed on the screen of the phone when accessed.
  • PINs, passwords, corresponding phone numbers, and secret keystroke sequences can only be viewed and edited when unlocked by a secure memory password, but usually not otherwise.
  • the Wakeup/Push Registry SMS capability can enable a phone to establish SMS communication with the server for more efficient communication of application data than with http, when supported by the service providing carrier.
  • “Wakeup” is a Brew® term
  • “Push Request” is a J2ME® term.
  • the “Wakeup/Push Request SMS” designation for this component is for convenience only, and is not meant to limit applicability of this feature to other native client terminal systems such as Windows® Mobile or Symbian®, for example.
  • the Wakeup/Push Request SMS component enables a phone to receive server initiated SMS data.
  • the event handler captures an actuation indicating a content request.
  • the event can include information such as, for example, the executing application (in this example, TravelPal) and the exit information associated with the selection "Restaurants.”
  • the event information indicates (directly or indirectly) that the operating application is to return the screen illustrated in Figure 2c with a list of restaurant types available for selection.
  • the event is provided by event handler 607 to UI Engine 603 to effectuate retrieval of the screen of Figure 2c with the appropriate information.
  • UI Engine 603 uses the event to obtain the next screen (in this example, Figure 2c) from server 108 or from the cache 609.
  • parser 602 can be used to generate appropriate binary information from the event object such that the appropriate request can be forwarded to the server 108 for processing, as illustrated by step 807.
  • a network adapter or other communication interface, although not illustrated in Figure 6, can also be provided. Parser 602 can also be utilized to convert the received binary information into an appropriate object for display by the display unit 605.
  • Figure 17 illustrates a "push" type embodiment in which the client does not initiate the interaction with the server.
  • the server or a third party (for example, another client or other device) sends a "push" type message to the client, for example via SMS (short message service) or WAP (Wireless Application Protocol).
  • the UI engine detects the message in step 902, and generates a message for transmission to the server in step 903.
  • the process that follows can be the same as described in connection with Figure 15 in one embodiment. This method can be useful in cases where someone other than the client user needs to communicate with the client user via a client application.
  • An example of such an application is wireless e-community services.
  • a translated rule set exchange can ensue between server and client.
  • a content provider typically sends formatted content to a client, wherein the format of the content is converted by the rule set translator 406 such that it is more optimally presented by the UI engine 603 on the client.
  • rule set translator 406 may transform user interface actuation data or mobile communication device telemetry data being sent from the client to the content provider.
  • An example of such a transformation is the mapping of client keypad assignments to a map of standard keypad assignments.
  • instructions to configure the UI Engine on the mobile communication device can be added to the workflow and sent to the mobile communication device.
  • the client interface 402 converts and processes the data message, builds the display page component from the rule set and content data, and provides the next display page to mobile communication device 102a. This process can continue in this iterative manner as the content is executed on the mobile communication device 102a,
  • the display pages and related global data can be installed and stored permanently on the mobile communication device 102a. Alternatively, they may be dynamically loaded each time they are accessed. Display pages may also be cached for a session or otherwise as may be desirable for a given content item. Permanent storage techniques can include, for example, read-only memory, flash memory, or any other memory, and preferably memory that retains information during power down.
  • UI engine 603, along with display component library 610 and cache 609 for implementing applications may be initially installed on the client by the manufacturer in nonvolatile memory, as is other firmware for a phone, they may be loaded at a service center or in the field through a data connection (for example, USB cable, IR, or Bluetooth ® , etc.) with a personal computer, downloaded off-the-air as part of a wireless service provider's over the air service provisioning (OTASP) process, or even download via a wireless web browser that may already be on the smart phone.
  • Client applications may be installed or updated (or have software bugs fixed) through the download of rule sets, global information, and display components.
  • an embodiment of the invention allows for a UI Engine 603 for the specific type of mobile communication device to be transparently downloaded before the first UI component of the application (for example a splash screen) is downloaded.
  • the UI Engine 603 is downloaded at the factory, for example, by beaming from a cell phone or by infrared transfer to the mobile communication device. Any other method of downloading an application to a mobile communications device is in keeping with the spirit of the invention. Download of the UI Engine 603 may also be part of the download of an application and a user may not be aware that a UI Engine has been downloaded. Regardless of the method in which the UI Engine for the device specific operating system is loaded, once the UI Engine is executing on a mobile communication device there are two tasks the UI Engine generally performs in one embodiment.
  • One task of the UI Engine is to display a UI component as requested by the application. This may involve a request to a server system (for example, server system 108) for combining a rule set for a given mobile communication device, application and screen with content obtained from a third party content provider.
  • displaying a UI component may involve processing a message from another device locally such as, for example, a mobile communications device, and determining the subsequent UI component to display via logic local to the mobile communications device.
  • Content adaptor 107 can be provided to allow conversion of the native format of the content on the content provider's system 111 to a format suitable for combination with a rule set in order to form a UI component for transmittal to a mobile communication device.
  • the rule set specifies what events and data are sent back and when the events and data are sent to the rule interface component when a particular interface element for example a button is asserted by a user.
  • Another task is to act as an event handler for user inputs, which are interpreted and formed into events comprising an application name, screen name, operation name such as a button name and any user input data and either processed locally or sent to a rule interface component in a server system.
  • a second UI component for display on the mobile communication device is generated, possibly including content from a content provider.
  • the UI Engine may check the UI component comprising a rule set and locally highlight the field that is required before allowing an event to be sent to the rule interface component.
  • the workflow module may be re-run in order to fix the application and re-deploy the rule set into the server system.
  • the UI Engines have the option of dynamically asking for a UI component every time, or caching the UI component for a session or permanently storing a UI component so that the application may only ask for content to fill the needs of a UI component.
  • Each UI component may comprise a version ID which is simply checked at any convenient time in the UI Engine and if the UI component is found to be outdated regardless of the dynamic, cached or permanent status of the UI component on the mobile communication device, then the new version of the UI component may be downloaded to correct the fixed bug. Since this download happens automatically and since the deployed rule set was changed once, the result is that a bug can be fixed once and propagated to as many types of mobile communication devices as use the application seamlessly.
  • the version identification of the UI Engine may be checked at any time and the UI Engine itself may be reloaded into the mobile communication device. This may occur automatically or optionally by prompting a user. Since an update to a UI Engine affects only one mobile communication device hosting a device specific operating system only those mobile communication devices hosting the specific UI Engine are affected. This is unlike the automatic update of an application across all types of mobile communication devices at once since applications are independent of the mobile communication device.
  • a UI engine can be originally installed during a mobile communication device's manufacture using a data link of a cabled or wireless type.
  • the UI engine can be downloaded using a browser program on the mobile communication device, for example, a WAP (Wireless Applications Protocol) Browser.
  • the UI engine can be updated by a server whenever an application is initiated.
  • the UI engine can also be updated via a data cable to a personal computer with access to an internet web site containing appropriated downloads.
  • Another means for updating a UI engine is a wireless service provider's over the air service and provisioning (OTASP) capabilities.
  • UI engines can also be updated from other mobile communication devices with cabled (e.g. RS232 or USB) or wireless (e.g. IR or Bluetooth®) connection.
  • an embodiment of the invention allows for a UI Engine for the specific type of mobile communication device to be transparently downloaded before the first UI component of the application (for example, a splash screen) is downloaded.
  • the UI Engine is downloaded at the factory through an appropriate data link as readily ascertainable to one of ordinary skill in the art. Regardless of the method in which the UI Engine for the device specific operating system is loaded, once the UI Engine is executing on a mobile communication device, there are two tasks that the UI Engine may generally perform.
  • rule sets based on a resolution size for a device. This allows fine tuning of button sizes and label sizes, for example, in order to take full advantage of the layout of the mobile communication device's specific display and may default to a standard rule set if no optimization has occurred for a range of display sizes for a given mobile communication device type.
  • Rule sets can be considered as user displays or display screens containing content and content formatting rules that are linked to one another via generic events. These rule sets can exist independent of a mobile communication device operating system on which they may be implemented. The look and feel of each application can be independent of the mobile communication device in which each application ultimately executes. Each mobile communication device executes a UI Engine that is specific to that device and the real time operating running on that device. Device specific information may be available locally through the UI Engine and/or may alternatively be a part of the UI component sent to the UI Engine.
  • one or more content adapters 407 can be used to retrieve one or more designated content items from a content provider 111 for inclusion in a translated rule set to be downloaded to a client.
  • Figure 18 is an operational flow diagram illustrating a process for retrieving this content in accordance with one embodiment of the invention.
  • content identification information e.g. content provider and access information
  • a rule set i.e. imbedded content ID
  • a database associated with a content adapter i.e. associated content ID.
  • An advantage of maintaining associated content ID is that it separates any associated maintenance or updating tasks for content provision with a content provider itself, rather than with a specific application. Thus if a content provider changes, it is only necessary to modify the content adapter. It is unnecessary to modify the rule set. This allows the present invention to separate development and maintenance tasks relating to application, content provider, and client device type.
  • a content adapter checks for the availability of an associated content ID.
  • the associated content ID is stored within the content adapter.
  • Such ID can be stored as data structures that associate specific content providers, and specific content identification information within those specific content providers with a more general content description within the rule set.
  • the associated content ID may include one or more content providers from which content can be extracted and combined.
  • associated content ID may specify a ranked ordering of more or less preferred content providers for obtaining specific types of content. If associated content ID is not found, the content adapter must rely on default associated content ID or specific imbedded content ID.
  • the content adapter requests content from appropriate content provider(s) using the respective associated and/or imbedded content IDs for a rule set.
  • requests typically involve the sending of query messages to the URLs of content providers, along with associated requestor ID information.
  • the content providers may be accessed via an internet service provider, or through other computer network means such are well known to those of ordinary skill in the computer arts.
  • the responses to the queries are generally received via the same network means that are used to send the queries.
  • step 1003 the content adapter receives and processes the requested content.
  • the content may be requested from one or a plurality of content providers.
  • the content adapter processes the content on the basis of logic associated with the rule set. Processing can include filtering, combining, re-ordering, etc. in addition to the format specification of the rule set.
  • Step 1003 can also include the collection and management of information such as, for example, billing information for cases in which content is provided for a per-item charge.
  • step 1004 the client interface assembles the rule set and processed content to make a rule set with content that is subsequently transmitted to a client.
  • the client interface can optionally recognize that some requested data is missing, or otherwise unavailable for assembly into display pages. In such a case, the client interface may either generate a warning or error message for transmission to the client, or it may forward a message back to the content adapter to retry retrieval of the missing content.
  • the client interface may also convert from http or html to a more efficient binary data format for transmission to the client.
  • a UI engine on the client uses the received rule set with content, along with cached display pages, global data, and display components to create display pages that are shown on the display screen of the mobile communication device.
  • a procedure for creating a rule set in an embodiment of the invention is shown in Figure 19.
  • a rule set file corresponding to a particular application is created an named.
  • the rule set may comprise multiple files, optionally organized in a directory with a hierarchical structure to facilitate the authoring and modification of large applications.
  • the rule set file can be thought of as the universe of an application, into which all other design and specification information for generating display pages for a specific application is contained, independent of a particular client device type.
  • one or more icons are inserted representing display pages to be shown on a mobile communication device's screen during the execution of the application.
  • the display pages can be represented as icons with various levels of detail in various embodiments of the invention.
  • the display pages may simply be boxes containing a text or other type of designator.
  • the display pages may be detailed depictions of an actual display page at varying resolutions.
  • the content editing of the icons is described below in relation to steps 1104 through 1106.
  • the icons may be manually positioned on a display screen of a computer development tool by a user.
  • the icons can be automatically positioned on a display screen according to a preset schema. Icons may be individually inserted and placed, and then edited as described below, prior to the insertion of additional icons. Alternatively, many icons may be inserted and placed followed by editing as described below.
  • a step 1103 the icons, representing pages, are linked to one another with lines or arrows to show how one may traverse from one display page to another display page during the execution of the application.
  • the next page to be displayed is conditional based on a user interface actuation and/or a server response.
  • the progression from one display page to another may be determined by time intervals.
  • the properties to transition from one display page to another in an application can be set as described in connection with step 1106, below.
  • a display page, other than an initial display page is not an active part of an application unless it is linked to another display page as an exit criterion.
  • step 1104 display pages are individually designed by inserting display components such as those listed in Table 4. Such display components may include, for example, text messages text boxes, bitmapped graphic images, icons, borders, etc. Many display components also have an associated selection of properties, for example, as listed in Table 4. These associated properties are selected in step 1105.
  • step 1106 properties for each complete display page are selected. Such properties may include, for example, whether or not a page should be cached by a UI engine, exit criteria for a page, and others as described above. Exit criteria refer to which page to display next and upon what action to display which page next if the application step is conditional. In one embodiment, exit criteria as set by filling in table entries associating events with corresponding next display pages.
  • the display page linking step 1103 may occur before, during, or after steps 1104 through 1106. For example, once pages are created 1102 they can be linked 1103 or modified 1104-1106 at any time. Additionally, pages may be deleted or new pages created, linked, and modified at any time.
  • Figure 20 illustrates an exemplary display page 200 for a display screen of a mobile communication device in an embodiment of the invention.
  • Different types of display components such as described in Table 4, are shown.
  • 1201 can be a bitmapped image, or an animated display made of sequentially displayed bitmapped images.
  • the images may be looped for the animation of a repetitive action (for example, to repetitively depict the character's winking).
  • an animation image sequence can be altered or replaced with another animation image sequence for a dynamic change.
  • the "Travel Pal” text may also be a bitmap to accommodate a special logo font.
  • the horizontal line under "Travel Pal,” can be a bit map graphic in one embodiment. In another embodiment it can be represented as a vector drawn graphic element.
  • Item 1012 can be a formatted alphanumeric text box representing static data. Although the data is static, the data display need not be. For example, in some embodiments there may be repetitively flashing visual highlighting. In other embodiments, the static data may scroll horizontally or vertically.
  • Item 1203 can be a list of selectable items (corresponding to a selectable output criterion for a display page) with a cursor 1204 to indicate a user selection.
  • the list may fit onto one display page, as shown, or it may be represented a box containing border icons to scroll horizontally and/or vertically.
  • the selection icon is an arrow in the illustrated embodiment. Alternatively, other icons may be used such as bullet marks, check boxes, etc.
  • multiple list items may be selected.
  • the choice of list items may be exclusive.
  • Items 1205 and 1206 can represent dynamic content.
  • item 1206 can be a formatted, continuously scrolling text box to display highway traffic data.
  • a single traffic report may be locally cached and repetitively scrolled, until it is replaced by an updated report.
  • certain transmitted data may contain triggers to stop scrolling, or to specially highlight a scrolling text box, for example, to indicate alert conditions.
  • Item 1206 can be a formatted text box that is periodically updated, for example, to display the current time and/or temperature.
  • Other display components can link to native phone features to provide additional application interface capabilities for further applications.
  • the Camera component can provide access to photographic images on a camera phone to enable a user to select and transmit a particular image to the server;
  • the Play Audio component can select and play a cached (on the phone) audio file on a phone;
  • the Play Streaming Audio component can invoke the playing of streaming audio from a server on a phone;
  • the Play Video component can select and play a cached (on the phone) video file on a phone;
  • the Play Streaming Video component can invoke the playing of streaming video from a server on a phone;
  • the Launch Browser component can launch a browser that is native to a phone;
  • the Save Ring Tone component can direct a phone to save an audio file to its native ring tone directory;
  • the Save Wallpaper component can direct a phone to save an image file to its native wallpaper directory;
  • the Address Book component can provide access to a native address book on a phone to enable a user to select
  • Figure 21 shows a computer screen display of an embodiment of a software tool (sometimes referred to as SmartBuilderTM, herein, for the sake of convenience and not to imply any loss of scope from the generic descriptions, herein) to create a rule set.
  • the software tool can operate on a personal computer or on a workstation in a windows environment.
  • the display is divided into five display panes 1301 through 1305.
  • Display pane 1301 is pictured showing unique icons representing unique display pages 1306 through 1318 and arrows interrelating the display pages representing both conditional and non-conditional exit criteria, as discussed above.
  • Display page icons can be added via a main operation button in display pane 1303, and repositioned using a mouse.
  • the following icons representing icons can be shown in display pane 1303: new document, open file, save file, image settings, page settings, default setting, screen width & height, deploy to server, download file from net address, and add screen.
  • Interrelating arrows may be drawn from icon to icon by designating the icons using a mouse or, in another embodiment, they may be automatically generated by entering an exit criterion for a display page in a display page properties table.
  • Display pane 1302 list property settings for a display page corresponding to a display page icon in display pane 1301 that has been selected, for example, by a mouse click.
  • Examples of display page property settings can include, for example: display page name, display page version, cache type, back button enablement, OK button enablement, home display page ID, time out, animation enablement, exit from application enablement, and user- defined menu items for user-defined exit criteria.
  • Display pane 1304 lists folders for root files and children of the root files in which the rule set is stored.
  • a rule set may be stored as a single file, or for ease of development and maintenance, as a set of files in an associated hierarchical directory.
  • Display pane 1305 shows image set information, and rule set associations for image sets.
  • FIG. 22 shows another computer screen display of an embodiment of a software tool to create a rule set.
  • Display pane 1401 presents an image of an actual display page 1404 with its display components for editing.
  • Display pane 1402 lists property settings for a selected display component of display page 1404. Examples of such display component properties include: component name, component type, LocX, LocY, width, height, text style, value type, language, border size, fill border, rolling support, panning, relative dynamic, focusable, font style, alignment, foreground color, background color, foreground focus color, background focus color border color, and others.
  • individual display component properties have associated drop-down lists for selecting one among a finite number of options.
  • individual display component properties are entered as text into associated text boxes.
  • display pane 1403 includes mouse-selectable button icons for commands relating to the page display such as: save, add/remove, add label, add text box, add text area, add message area, add choice box, add choice group, add list, add image, add button image, add hotspot, add shapes, and others.
  • images representing actual phone displays, after modification according to corresponding sets of meta rules, can be displayed for review.
  • a rule set comprising icons and relationships represented graphically
  • the rule set may be created in a text editor in this embodiment.
  • the rule set (e.g. in a format such as HTML, XML, WML, etc%) can contain screen names background colors, button names, dimensions and labels and any image data or content data that is needed or useful for an application including the events that allow for traversing screens in the application (for example, exit information).
  • Table 3 presents an exemplary listing of an XML (extensible markup language) workflow in an embodiment of the invention.
  • Line 1 of the listing describes the encoding of the XML.
  • Line 2 of the listing describes the name of the workflow as "demo.”
  • Line 3 comprises an XML tag that surrounds a list of display pages or UI components.
  • Line 4 is blank for ease of illustration.
  • Line 5 comprises an XML tag that surrounds a block of XML that defines the "LOGIN” screen as described on line 6, along with a version identification of the "LOGIN” screen. The version identification is used in order to update the "LOGIN" screen on any mobile communication device that does not have the latest version.
  • Other attributes are listed that determine the look and feel and functional settings for the UI component.
  • a Menu Component block is described on line 11 that generates a value of "OK” if the menu item is selected as shown on line 13.
  • Line 18 shows that when "MENU.OK” is selected, the next UI component to be displayed is the "WELCOME” UI component.
  • Line 25 is a condensed version of the "WELCOME” UI component the details of which are not listed for ease of Illustration.
  • Line 29 comprises an XML tag that surrounds a block of XML that defines the "SPLASH" screen as described on line 30.
  • the "SPLASH” UI component comprises two exit points defined on lines 34 and 38 that direct the flow of UI components to the "LOGIN” or “WELCOME” screens depending upon the value of the "CLOGIN” argument meaning that when the "SPLASH” UI component times out, if the "CLOGIN” value has been set then the next UI component that is shown is the "WELCOME” screen, and if the "CLOGIN” value has not been set, then the next UI component shown in the "LOGIN” screen.
  • the "CLOGIN” value may be passed to the UI Engine from the server system as true after the user has logged in.
  • the "CLOGIN” value may be kept in a session of the server and passed as a cookie back to the UI Engine, for example.
  • Meta rules such as meta rules 405 described above with reference to Figure 4
  • Meta rules can be used to translate a rule set for an application to a rule set that provides an improved user interface for specific types of client devices running that application.
  • Meta rules can be selected based on carrier technology and ID, mobile communication device screen size, and mobile communication device ID, among other criteria. If no meta rules exist for a specific criterion, then default meta rules can be used or no meta rule is used.
  • meta rules may be wireless carrier (service) provider specific, such as adding a carrier's logo or other features in display screens that help brand the carrier.
  • this example can be implemented using global content as described above.
  • Other meta rules may depend on client device screen size in number of pixels by number of pixels. Such other meta rules may change font sizes or icon bit maps or number of displayed content items per display page on the basis of the client device screen size.
  • Still other meta rules may depend on client features such as cache memory size, in which case a rule set could be adjusted to change caching and application response speed characteristics.
  • meta rules can block, generally or selectively, the transmission of advertising to a client.
  • Additional meta rules can adapt rules to native phone features such as described above in connection with display components such as Camera, Play Audio, Play Streaming Audio, Play Video, Play Streaming Video, Launch Browser, Save Ring Tone, Save Wallpaper, Address Book, Calendar, Uplink Voice Clip, Currency Support, and Wakeup/Push Registry SMS.
  • the same meta rules can be applied to multiple rule sets representing multiple respective applications. Once a rule set has been translated by all appropriate meta rules, it can be subsequently processed for transmission to a client. Additional examples of meta rules are given below:
  • Best Fit ratio 2 - xjx r +yjy r
  • x c and>> c are the horizontal and vertical dimensions in pixels, respectively, of a client's screen
  • x r and y r are the horizontal and vertical dimensions in pixels, respectively, of the reference screen from the rule set.
  • meta rules can also be applied to other meta rules for the specific implementation of policies for meta rules according to factors such as country, language, carrier, and type of phone — to name a few.
  • Such meta rules for application to other meta rules can be termed "policy" meta rules.
  • policy meta rules can be applied to meta rules for rules, and different sets of meta rules for rules without the need to manually adapt each different set of meta rules.
  • higher level meta rules can be developed for application to sets of policy meta rules, and even higher level meta rules could be developed and applied to sets of the higher level meta rules, and so forth. Such embodiments can enable the modification of rule sets for an unlimited number of deployment scenarios with vastly reduced development cost and time.
  • Figure 23 describes an exemplary server hardware implementation 108 of an embodiment of the invention.
  • Server software and data is stored in memory 1504 that is accessed by control logic 1502 to perform methods of the embodiments.
  • Memory 1504 also stores rule sets and meta rules.
  • Memory 1504 may be one or more of any conventional computer memory types as are well known to those of ordinary skill in the art.
  • Control logic 1502 can be implemented using a variety of commercial or custom server processors as are also well known to those of ordinary skill in the art.
  • Modems 1501 and 1503 enable communication with a client 102 and a content provider 111, respectively, and are also well known to those of ordinary skill in the arts of computer networking and wireless communication systems.
  • Figure 24 illustrates an exemplary implementation of client device in accordance with one embodiment of the invention.
  • the example provided in Figure 16 illustrates operable linkages of control logic 1601, memory 1602, UI input device 608, and display 605.
  • Memory 1602 is typically random access memory, and may be implemented in volatile and/or nonvolatile integrated circuit technologies and is used to store data such as display pages and global data.
  • the control logic 1601 can be a CMOS IC that implements microcontroller functions for the mobile communication device 102 (or other client functions or features), in addition to digital signal processing and data processing, as are well known in the art.
  • the UI engine can execute on control logic 1601.
  • Processor 403 process inputs from UI input device 406 and/or server 108, to generate outputs for display via UI output device 605, using data from memory 1602 and/or from server 108.
  • UI output device 605 serves as a way to send data to a user.
  • Examples of UI output device 605 include electronic display screens (such as light emitting diode, LED, or liquid crystal display, LCD), visual annunciators such as LEDs or other type of lamps, sound emitters such as speakers or buzzers, and tactile stimulators, such as vibrators.
  • UI input device 406 provides a means for users to input data to the mobile communication device.
  • Examples of UI input devices 608 include keypads, touch screens, and other types of tactile or audio sensors.
  • Table 4 list examples of visual display component along with their respective descriptions and parameter options.
  • a display page is itself a display component that consists of other, lower-level, display component.
  • a variety of lower-level display components are listed that can accommodate the composition of a creative variety of client applications.
  • WAP refers to the Wireless Access Protocol Standard of the Open Mobile Alliance, 4275 Executive Square, Suite 240, La Jolla, Ca 92037.
  • "focusable” is synonymous with selectable. It is the act of making a display component selected for editing, rather than moving between components. For example, when a text component is focused, a cursor can appear.
  • Text Field a box for user entry of 1) Name - name of the component a single line of data
  • Rolling support circular, back and forth, reset, or no rolling
  • Border color border color
  • Text Field type type of text field (anything, number, alphanumeric, email, alphabet, small alphabet, password)
  • Text field can be empty? - whether text field can be empty
  • Text Area a scrollable box for 1
  • Name name of the component user entry of multiple lines of data
  • Type what type of component it is
  • Rolling support circular, back and forth, reset, or no rolling
  • Border color border color
  • Choice Box an icon that can be 1) Name — name of the component selected by a user to indicate a choice from 2) Type - what type of component it is a list of choices
  • Choice Group a group of options 1) Name - name of the component Name: Description: Parameters with, each with a 2) Type - What type of component it is selection status display 3) LocationX - starting X coordinate
  • Border Size border size
  • Dynamic - is the content is determined dynamically?
  • Border focus color border color when focused
  • Action to activate - what type of action to activate when a user selects it e.g. data call, voice call, SMS, ring tone, wallpaper,...
  • Auto Fire - fire event is enabled when a item is selected or not (a fire event is a timing critical event, such as a call to a server)
  • Border Size border size
  • Border color border color
  • Photo album whether it is part of a photo album or not
  • Button Image a pair of images: one 1) Name - name of the component focused, the other blurred 2) Type — what type of component it is
  • Rolling support circular, back and forth, reset, or no rolling
  • Hotspot component with 1) Name — name of the component images from which user may select one 2) Type - what type of component it is
  • Border Size border size
  • Circle a vector drawn circle 1) Name - name of the component
  • Camera provides access to 1 ) Name - name of the component photographic images on a camera phone to 2) Type — what type of component it is enable a user to select and transmit an image 3) LocationX - starting X coordinate to the server
  • Play Audio selects and invokes 1) Name - name of the component the playing of a cached (on the phone) 2) Type — what type of component it is audio file on a phone
  • Play Streaming invokes the playing of 1) Name — name of the component Audio streaming audio from a server on a phone 2) Type - what type of component it is
  • Play Video selects and invokes 1 ) Name - name of the component the playing of a cached (on the phone) 2) Type - what type of component it video file on a phone is
  • Play Streaming invokes the playing of 1 )
  • Name - name of the component Video streaming video from a server on a phone 2)
  • Save Ring Tone directs a phone to 1) Name — name of the component save an audio file to its native ring tone 2) Type - what type of component it is directory
  • Save Wallpaper directs a phone to 1) Name - name of the component save an image file to its native wallpaper 2) Type - what type of component it is directory
  • Address Book provides access to a 1) Name — name of the component native address book on a phone enabling a 2) Type - what type of component it is user to select and transmit an address 3) LocationX - starting X coordinate book entry to the server 4) LocationY - starting Y coordinate
  • Calendar provides access to a 1 ) Name — name of the component native appointment calendar on a phone 2) Type - what type of component it is enabling a user to select and transmit an 3) LocationX — starting X coordinate appointment calendar entry to the server 4) LocationY - starting Y coordinate
  • Uplink Voice enables a user to 1 )
  • Name name of the component Clip select a voice memo recorded on a phone 2)
  • Type what type of component it is and transmits the Name:
  • Table 4 is but one example of definitions of user interface components corresponding to one embodiment of the invention. Other embodiments of the invention can use other definitions of user interface components without impacting the overall performance of the invention, as readily apparent to one of ordinary skill in the art.

Abstract

A method and system for implementing a user interface for providing a data service in a mobile client using a server with knowledge of the client's hardware and software capabilities to modify data content and display rules for an improved user interface on the client. Data may be cached on the client to improve application response time and provide a standalone application capability for the client. The automatic conversion of newly developed applications to a plurality of clients with differing hardware and software capabilities reduces application software development and maintenance costs. Software updates and bug fixes can be deployed with the same method and system. An interoperable array of adapters for reporting, billing, and format conversions is also described.

Description

SYSTEM AND METHOD FOR FLEXIBLE USER INTERFACES
Cross-Reference to Related Applications
[0001] This application is related to United States application No. 60/686,129, filed May 31, 2005 entitled "SYSTEM AND METHOD FOR FLEXIBLE USER INTERFACES" which is hereby incorporated herein in its entirety by reference. This application is also related to United States Patent Application Ser. No. 11/151,798, filed June 13, 2005, entitled "USER INTERFACE SYSTEM AND METHOD FOR IMPLEMENTATION ON MULTIPLE TYPES OF CLIENTS" which is related to United States Patent Application Ser. No. 10/963,929, filed October 12, 2004, entitled "SYSTEM AND METHOD FOR DEVELOPING AND DEPLOYING DEVICE INDEPENDENT APPLICATIONS" which is related to United States application No. 60/611,353, filed September 20, 2004, entitled "SYSTEM AND METHOD FOR DEVELOPING AND DEPLOYING DEVICE INDEPENDENT APPLICATIONS," all of which are hereby incorporated herein in their respective entireties by reference.
Technical Field
[0002] This invention relates to user interfaces for applications for clients in client-server computer systems. More particularly, but not by way of limitation, this invention enables the implementation of user interfaces for a plurality of server-based applications on a plurality of client types with fast performance and reduced upfront development time.
Background Art
[0003] Client-server computing systems typically use servers to provide services to a client. The client is often smaller, less capable, less expensive, and more mobile than an associated server. One server usually provides services to multiple clients, whereas a client can often obtain services from multiple servers. The communication link between a client and a server may be of any appropriate type, including wired or wireless. In particular, wireless clients offer the opportunity for tether-free mobility, and usually have self-contained power sources such as batteries. Communication bandwidth is usually restricted more for a wireless connection than it is for a cabled connection. Moreover, providing batteries for suitable client operating time constrains the power that can be consumed by the client. In the interest of providing more mobility and greater battery lifetimes for clients, it is important to reduce the computational burden required of clients to perform their functions. Such minimal clients are sometimes referred to as "thin clients." A thin client for wireless use is often implemented to reduce memory and processor requirements for reduced power consumption, size, and cost - while at the same time, conserving wireless communication bandwidth for communication with a server or other devices over a communication channel (often wireless).
[0004] The term mobile data communication device can refer to a wireless communication device that provides access to wireless data services when in communication with a server. Examples of such devices include "smart" cell phones, wireless enabled notebook computers or PDAs, alphanumeric pagers, and many others that are limited only by the imagination. Over the past several years, wireless data services have proliferated more and more among mobile communication device users, especially, for example "smart" cell phone users. Popular wireless data services for cell phone users currently include, among others, e-mail exchange (including graphics), short message service, internet browsing, and paid mobile access to databases. Emerging services further include, position location based services, wireless advertising, wireless "e-community" services - to name a few -with the list being constantly expanded. Expanding the user popularity and commercial potential of wireless data services generally depends on their widespread deployment with minimal development, deployment, and operating costs.
[0005] An aspect of the rapidly evolving field of wireless data services that hinders widespread deployment and development cost reduction, is the plurality of software platform standards for clients (sometimes referred to as "real time operating systems," or "RTOS"s), and the diversity of hardware and user interface capabilities for wireless terminals serving as clients. Cell phone service providers, for example, often endeavor to support cell phones from manufacturers espousing different software platform standards such as WAP (the "Wireless Applications Protocol" standard), J2ME (a mobile version of Java®), BREW (from QUALCOMM, Inc.), and others. Wireless data enabled PDA manufacturers often alternatively use software platforms such as Palm OS® (from Palm Computing, Inc.), Windows® Mobile (from Microsoft, Inc.), Symbian® (a European standard), and Blackberry® OS, among others. Additionally, devices for user data input, and visual displays can vary greatly in capabilities from product to product. Devices for user data input include keyboards ranging from augmented phone dial pads to full QWERTY (also called ASCII herein) keyboards, as well as others such as touch screens. Displays can be monochrome or color, of various resolutions and aspect ratios, different character set capabilities, different vector graphics capabilities, and different levels of grayscale or color depth as expressed in bits.
[0006] Although the standard software platforms described above were created to facilitate device independent client applications, the incompatibility problem largely remains in that there are multiple standards and multiple devices. Hence, applications cannot be created for only one standard or hardware device given the diversity of software standards and user interface hardware options for the range of mobile communication devices to be provided with wireless data service. For example, client application software to run on two different manufacturers' phones might need to be written in both BREW® (for a first manufacturer's phone) and J2ME (for a second manufacturer's phone). Further aggravating the software development problem is the fact that the first manufacturer, for example, may provide mobile communication devices with a number of different options for display sizes, further requiring additional versions of software.
[0007] Deploying one application to multiple platforms can require that software developers write multiple client applications where each application is specific to a particular platform. This is the case even though the functionality of the application and often the interface itself is intended to be the same regardless of the underlying software platform or user interface hardware. Thus wireless data application developers often invest significant time and resources in developing and maintaining applications that are platform, and often device, specific. When a program error is discovered in one version of an application, the error must often be fixed in other platform and/or device dependent versions of the same application, and then deployed separately to multiple server systems. Each time an application is ported to a new application environment, a team of developers is required to invest their time and energy in developing, maintaining, and upgrading the software. It is not uncommon for companies to employ completely separate teams of developers to develop and maintain these different versions of the same application. Consequently, a significant waste of resources can be incurred as a result of current application development methods for wireless data applications. And this problem is not limited to wireless data service environments, but can arise in other data service environments where it is desirable to deploy client-server applications that accommodate many types of clients.
[0008] Furthermore, direct marketers are continually seeking new and compelling ways of reaching their target markets, such as using wireless advertising. But while the appeal of mobile marketing is clear, it is hindered by some distinct disadvantages. For example, mobile handset devices, with their inherently small screen sizes, have considerable text limitations, while the requirement that end users manually type in website addresses on their phones in order to reach rich, compelling messages, is a step many users don't have the patience to take. Additionally, running advertising campaigns without being able to quickly and easily modify the content and application makes optimization impossible. Furthermore customer relations management (CRM) and business reporting capabilities are common tools that marketers expect to measure the performance of, and direct the improvement of, their advertising campaigns.
Summary of the Invention
[0009] The current invention provides a method and system for implementing a user interface for providing a data service in a mobile client using a server with knowledge of the client's hardware and software capabilities (hereinafter referred to jointly as "device characteristics") to modify data content and display rules for an improved user interface on the client. Data may be cached on the client to improve application response time and to provide stand-alone application capabilities for the client. The automatic conversion of newly developed applications for a plurality of clients with differing client device characteristics reduces application software development and maintenance costs. Software updates and bug fixes for previously deployed applications can be deployed to mobile communication devices using the same method and system, through data downloads when a client device accesses an application.
[0010] According to an embodiment, a method for determining a data format handling capability of a client by a first server in a client-server system, comprises: receiving a data packet that was transmitted by the client at the first server, the data packet having a data packet header comprising indicia designating the type of client that transmitted the data packet; correlating the indicia with one of a plurality of stored indicia, each stored indicia having a corresponding stored data format handling capability indication for a type of client; and selecting the most correlated data format handling capability as the data format handled by the client. Some embodiments further comprise translating the data format of the received data packet from the data format handled by the client to a second data format, and transmitting the translated data packet to a second server, and/or receiving an application content data packet in the second data format from a third server, translating the application content data packet to the data format handled by the client, and transmitting the translated application content data packet to the client. According to some embodiments the data format handling capability of the client comprises on of the set of data formats consisting of WML and xHTML, and the second data format comprises HTTP.
[0011] According to another embodiment is a method for modifying a meta rule for a rule set based application in a client-server system, comprising translating a meta rule according to a first policy meta rule. According to some embodiments, a meta rule can comprise one of a plurality of meta rules that are translated according to the first policy meta rule, and a policy meta rule comprises one of a plurality of policy meta rules used to translate meta rules.
[0012] According to yet another embodiment, A method of controlling a native application of a mobile terminal, by a client residing on the mobile terminal, of a client-server based application, the method comprises: invoking the execution of the native application; transferring control data to the native application; and terminating the execution of the native application, responsive to the received data. According to various embodiments, the native application can be an Internet browser, or the native application can play audio files, streaming audio files, video files, streaming video files, or the like. According to a further embodiment, data can be received by the client from a native application, and transmitted to a server of the client-server based application. Exemplary native applications include, among others, audio recorders, photo albums, address books, and calendars. According to another, further embodiment a data file residing on a mobile terminal for use by a native application can be added or modified with data received from the server. Exemplary types of native application data include, among others, ring tones and wallpapers.
Brief Description of the Drawings
[0013] Figure 1 is a block diagram illustrating an overview of an exemplary wireless network in accordance with one embodiment of the present invention.
[0014] Figure 2 illustrates display pages of an exemplary mobile application in another embodiment of the invention.
[0015] Figure 3 is a diagram illustrating a high level view of a wireless data service being deployed to a client in accordance with one embodiment of the invention. [0016] Figure 4 illustrates an application server in accordance with one embodiment of the invention.
[0017] Figure 5 is a flowchart illustrating server processing in accordance with an embodiment of the invention.
[0018] Figure 6 illustrates an expanded operational diagram in accordance with a further embodiment of the invention showing billing and reporting modules.
[0019] Figure 7 illustrates architectural details of a record reporting system according to an embodiment of the invention.
[0020] Figure 8 illustrates a screen displaying a View Applications page in accordance with one embodiment of the reporting module.
[0021] Figure 9 illustrates a screen displaying a Register New Application page according to another embodiment of the invention.
[0022] Figure 10 illustrates a computer screen displaying a View Reports Page according to yet another embodiment of the invention.
[0023] Figure 11 illustrates a computer screen displaying a View New Applications Page in accordance with another embodiment of the invention.
[0024] Figure 12 illustrates architectural details of WAP module embodiment.
[0025] Figure 13 is a flowchart illustrating WAP module processing according to an embodiment of the invention.
[0026] Figure 14 illustrates a client in accordance with another embodiment of the invention.
[0027] Figure 15 is a flowchart illustrating client processing in accordance with one embodiment of the invention.
[0028] Figure 16 is a flowchart showing client processing in accordance with another embodiment of the invention.
[0029] Figure 17 is a flowchart showing client processing in accordance with a further embodiment of the invention.
[0030] Figure 18 is a flowchart illustrating an operation of a content adapter in accordance with an embodiment of the invention.
[0031] Figure 19 is a flowchart showing the development of an application in accordance with an embodiment of the invention.
[0032] Figure 20 illustrates an exemplary client display screen for an exemplary application in a further embodiment of the invention. [0033] Figure 21 illustrates a computer display screen of an application development tool in an embodiment of the invention.
[0034] Figure 22 illustrates another computer display screen of an application development tool in an embodiment of the invention.
[0035] Figure 23 illustrates an exemplary hardware architecture of a server in an embodiment of the invention.
[0036] Figure 24 illustrates an exemplary hardware architecture of a client in another embodiment of the invention.
Modes of Carrying Out the Invention
[0037] One embodiment of the present invention is directed toward a novel system and method to enable software developers for a client-server environment to efficiently develop, deploy, and maintain an instance of an application that can be configured to operate on different types of client devices, including mobile communication devices such as mobile phones, smart phones, personal digital assistants, and two-way paging systems. In accordance with one embodiment of the present invention, developers are provided with the tools and features to develop and deploy applications that are, at least to some extent, device independent. In one or more implementations, these goals can be accomplished with little or no modification to existing infrastructure and without a need for a manufacturer's modification of client devices.
[0038] Before describing the invention in detail, it is useful to describe an example environment in which the invention can be implemented. The example environment described is that of a wireless communication network. More particularly, the example environment described is a wireless communication network configured to provide wireless data services to one or more network users. Figure 1 is a block diagram illustrating an overview of this example wireless network in accordance with one embodiment of the present invention. The illustrated wireless network includes one or more mobile communication devices 102, one or more mobile base stations 101, and a communication network 105. Also illustrated are a server 108, a firewall 110, and content service providers 111, which can be included to interface to the wireless communication network in accordance with one embodiment of the invention.
[0039] In one implementation of the example environment illustrated in Figure 1, the clients, in this example mobile communication devices 102, can be implemented as smart phones, which can be implemented as a wireless phone (for example, a cellular telephone) with data features. For ease of description and to illustrate various features, the invention is from time to time described herein in terms of clients implemented as smart phones 102. However, after reading this description it will become apparent to one of ordinary skill in the art how to implement the various features and functions of the invention with other mobile communication devices and with other client devices in general.
[0040] In operation, mobile communication devices 102 are in wireless communication with one or more base stations 101. A base station 101 may be implemented as a conventional cellular telephone base station, or another type of relay or base station such as, for example, a wireless access point in a wireless local area network. In this and other environments other devices may be utilized to allow a client to access a server such as, for example, a router or gateway or other like device.
[0041] In a conventional cellular network, base stations 101 can in certain implementations be described as having three components. The cell sites, which are often referred to as base transceiver stations or BTS 's, communicate directly with the mobile communication devices 102. Base station controllers or BSCs (not shown) control the base transceiver stations either over land links (typically) or over radio links. Mobile switching centers or MSCs (not shown), often called mobile telephone switching offices, control the base station controllers, usually over land links. There is no fixed ratio of BTS to BSC to MSC, required, and these base station functions may be combined into a single site. Often cellular phone systems, and other wireless mobile data systems, have multiple base stations 101. This provides for data communication service handoff from one base station to another as a mobile data terminal roves among the base stations' respective coverage areas.
[0042] Smart phones 102 can be implemented utilizing one or more of several types of real time operating systems (RTOS) 103 running on an internal processor such as, for example a baseband or other processor (also referred to as "microprocessor" or "microcontroller"), operating system 103 can interface applications running on the internal digital processor with hardware operably connected with the processor, such as, for example, a radio frequency (RF) modem, a keypad, a visual display, baseband, mixed-signal and analog circuitry, and others. Various smart phones 102 can be implemented using various different configurations of hardware and software, including, for example, different types or versions of operating systems 103 and different configurations of user interfaces (for example, keypads and displays). [0043] In Figure 1, each of two base stations 101 is illustrated as being in wireless connection with a respective one of two mobile communication devices 102. Because base stations 101 are connected via network 105 in Figure 1, mobile communication devices 102 can communicate with one another through the base stations 101 and network 105, or sometimes directly. Of course additional base stations 101 and additional mobile communication devices 102 (and various alternatives of either) can be eliminated, substituted, or added as well.
[0044] Network 105 may be implemented as any type or combination of types of communication network, including local area and wide area networks of varying configurations and protocols. For example, base stations 101 are sometimes connected using the asynchronous transfer mode (ATM) standard protocol. Often, at least a part of network 105 may be implanted with an Internet Protocol (IP v.4 or IP v.6) protocol. In some environments, such as the cellular environment, for example, the cellular network is designed to connect to the existing phone system, also called the Public Switched Telephone Network or PSTN (not illustrated), or to other data network voice or data networks. The connection to the PSTN is similar to the connection of other telephone switching equipment such as a Public Branch Exchange (PBX).
[0045] In the example environment illustrated in Figure 1, one or more mobile communication devices 102 can include a UI engine 104 that can be implemented as an application that is interfaced with, or running "on top of," operating system 103 in a mobile communication device 102. In can also be implemented in various other software embodiments, or as hardware, firmware, or other logical components. In an embodiment of the present invention, UI engine 104 can be implemented so as to improve the user interface performance for wireless data applications.
[0046] Also illustrated in the example environment of Figure 1 are content service providers 111. One or more content service providers 111 can interface with the wireless communication network to provide one or more items of content to network users. For example, with increasing capabilities of contemporary mobile communication terminals 102, various content items such as games, ring tones, screen savers, photographs, movies, and other applications and content items (generally referred to herein as "content") are often made available to users for download onto clients such as mobile communication devices 102. As illustrated, content service providers 111 can be connected to network 105 in various different ways to enable downloading of content to the clients 102. [0047] In addition to downloading content via the wireless link, content can be downloaded to the mobile communication device 102 using other means such as, for example a direct connection. One example of a direct connection can be a synchronization operation between the mobile communication device 102 and a user's personal computer where the content was previously downloaded to or otherwise resides on the computer and is subsequently downloaded to the mobile communication device 102 during a synchronization or other operation. After reading this description it will become apparent to one of ordinary skill how other content delivery mechanisms can be implemented.
[0048] In the present invention, server 108 can be implemented so as to support applications for UI engine 104 on clients 102. In one embodiment, this can be accomplished by retrieving application content from service providers 111 and processing content. One or more content service providers 111 can be in communicative contact with the example environment. They can access network 105 and one or more servers 108 in a number of different ways. For example, a content service provider 111 may have a connection to server 108 other than through the network 105. Additionally, a content service provider 111 may be in communicative contact with a server 108 via network 105. Although content service provider 111 is illustrated as being somewhat directly connected to network 105, other communication channels, connections or interface techniques can be provided to allow communication between content service provider 111 and server 108.
[0049] Content service provider 111 provides data services to clients 102. Content services providers 111 are often implemented as servers, and can use similar hardware and operating system software to server 108. Types of data services are too numerous to list, but can include, for example: news, weather, driving directions, horoscope, stock quotes, hotel and restaurant information, etc. In addition to these information services type of data services, content service providers 111 can also provide other content to one or more clients 102 such as, for example, applications and application programs, media content, software plug-ins and modules, games and gaming applications suitable for running on a client device 102, and other forms of content or other information that may be useful or of interest to the user with his or her client device 102. Thus, as used in this document, the term "content" is used to refer to any of a number of different forms of information, data, application, media or other content that may be provided from a content service provider 111 to a client device such as a mobile communication device 102. This content can be in various forms and include one or more of a plurality of different data or information types including, for example, software or other code, graphics, textual information, audio information, image information, and video information.
[0050] Having thus described an example environment in which the present invention can be applied, the present invention will now be described in greater detail in terms of this example environment. After reading this description, it will become apparent to one of ordinary skill in the art how to implement the invention in its various forms and embodiments in this or alternative environments in which it may be desirable to utilize the features and aspects of the present invention.
[0051] When a user determines that he or she desires to obtain content for his or her mobile communication device 102, one technique for carrying out these wishes is to identify the content (for example, a particular application) and to indicate a request for the content such as, for example, by entering appropriate keystrokes or other inputs to request a download of the content. Upon receiving a user request, UI Engine 104, in one embodiment transmits an event to a server 108 communicatively connected to the network. The event, in one embodiment includes device characteristics about the requesting device and the content. These device characteristics can include, for example, information such as an identification of the requested content along with other useful information such as, for example, information to identify the mobile communication device 102 for which the request is made. For example, the event may include an identification of the brand, model, type or class of mobile communication device 102 for which the content is being requested. Additional examples of device characteristics are provided below. Upon receipt, a rule set is appropriately applied to the content based on device characteristics from the requesting client device 102 (e.g., device type, class, brand, model, carrier, application, application state, and so on), thus formatting or otherwise preparing the content for execution on the mobile communication device 102. This process of combining a rule set with content is described in greater detail below with reference to Figure 4.
[0052] When a user downloads content to mobile communication device 102, one embodiment of the invention provides the capability to download a UI Engine 104 configured for the specific mobile communication device 102 or class of mobile communication device 102. In one embodiment, this can be downloaded transparently before a first component of the application (for example a splash screen) is downloaded. Thus, a UI Engine 104 can be prepared and downloaded to the client device 102 for the particular content item requested. As such, one or more UI Engines 104 may be installed and running on a given client device 102 in this particular embodiment. Thus, for example, it is not necessary that a given UI Engine 104 perform any or all of the functionality that may be traditionally or conventionally associated with UI Engines 104 in implementations of client devices 102 such as, for example, mobile communication devices 102. As such, the term "UI Engine" should not be construed as limited to a conventional or traditional UI Engine.
[0053] Mobile communication device 102 can be configured so as to execute UI Engine 104 which, in one embodiment as mentioned above, is specific to that mobile communication device 102, or to that class of devices to which mobile communication device 102 belongs. In one embodiment, UI Engine 104 can be created once per device and configured so as to be able execute various application interfaces. As such, in this embodiment, mobile communication device 102 can perform specified functions by downloading a UI component that can include a rule set for the desired content item along with any associated content data or information.
[0054] As stated above, in accordance with one embodiment of the invention, features and functionality can be provided to facilitate the development, deployment, and performance of content bearing applications to mobile communication device 102 users. Figure 2 illustrates exemplary application display pages as they could appear on a mobile communication device display in accordance with one embodiment of the invention. In this particular illustrated example, Figure 2a shows an example initial display page for a hypothetical application (i.e., content) used to retrieve and provide information to a user of a mobile communication device 102 in a number of different categories as listed on the exemplary screen shot. The categories shown in this example are emergency services, gas stations, restaurants, and hotels.
[0055] Figure 2b shows an example of the screen in Figure 2a, but with one of the categories, in this case "restaurants," being highlighted. This selection can be made, for example, through a user actuation of an input device such as a keyboard, keypad, joystick, touchscreen, touchpad, mouse, voice command interpreter, or other user interface. This is generally referred to as a user input. Through an appropriate user input, the user selects the category for which he or she desires more information. For example, in the example illustrated in Figure 2b, once the appropriate category is highlighted, a simple user action such as, for example, pressing an Enter key or other action via a user interface, can facilitate selection of the highlighted category. An event need not be selected by first highlighting a category as illustrated in the above example. Indeed, an event can be generated via a number of different user inputs including, for example, a direct selection of the desired category via the available user interface. In other embodiments, an event can also be generated by server action or via another device. [0056] This selection generates an event that can be used to facilitate retrieval of additional content as specified by the event. Thus, in the example illustrated in Figure 2b, when the user selects "restaurants" as the appropriate category, the event can be used to indicate to the application that additional information about the category of restaurants is requested by the user. As such, continuing with this example scenario, the example screen illustrated in Figure 2c can be retrieved and displayed which, in this case, lists categories or types of restaurants from which the user may choose.
[0057] As mentioned above, the example display page illustrated in Figure 2c shows a listing of the categories or types of restaurants about which additional information can be retrieved in the currently running application. As with the previous screen, the user can cause one of the categories to be selected, which results in an event, to facilitate retrieval of additional content. In the examples illustrated in Figure 2c, the user highlighted the category "Mexican" for selection as the type of restaurant about which he or she desires additional information.
[0058] As a result of this event, additional information about Mexican restaurants is provided as illustrated by the example display of Figure 2d. In this example of Figure 2d, various categories of Mexican restaurants are provided which, in this example, are particular Mexican restaurants by name such as, for example, Acapulco, Taco Bell, El Torito, and so on.
[0059] As illustrated in Figure 2d, a user input selects a category of Mexican restaurant that results in the display of Figure 2e, which in this example is a selection of location cities for that category of Mexican restaurant. Selecting a location city results in information about a specific restaurant being displayed in Figure 2f.
[0060] In this application example, each user input on the various screens selects or generates exit criteria for a display page that results in the loading of the next display page, that can be one of a plurality of possible next display pages. For example, if the user had selected the category "Italian" in Figure 2c, the display of Figure 2d could display categories of Italian, instead of Mexican, restaurants. Thus, one or more display pages can include exit criteria for the page, which can vary for the various selections or options associated with the page. The exit criteria can be used to generate the appropriate event to retrieve an appropriate next screen based on the user input.
[0061] Note that in this example, Figures 2b - 2f also include "Back" as an option. The "Back" option allows users to recover from mistaken entries, or to back track through selections. Of course, other buttons or selections can be included depending on the application and depending on the application developer's wishes or goals in creating the application. For example, Home and End buttons can be provided as well as other action buttons, allowing exit criteria to be actuated and events to be generated.
[0062] As discussed above, in one embodiment, one or more of the content screens include exit criteria that are used to facilitate retrieval of a subsequent screen. For example, exit criteria can be included to provide information about an action to be taken or additional content to be retrieved or displayed based on a user input. Thus, for example, where multiple user selections are permitted, it may be appropriate to include different exit criteria for the various user selections such that appropriate action can be identified based on the user selection. Also, as described above, the invocation of exit criteria can result in the creation of an event that can be used to facilitate retrieval of additional content. For example, in one embodiment, the event can be sent to the server 108 to indicate to the server that additional content has been requested and also to indicate the type or other specific information about the requested content.
[0063] As described in more detail below, in one embodiment, events do not necessarily need to be forwarded to a server such as, for example, server 108 to retrieve additional content in response thereto. In one embodiment, as described in more detail below, one or more various content items can be cached locally or at some other location and the content retrieved from the cache rather than from a remote location.
[0064] Applications composed of display pages with exit criteria pointing to subsequent display pages can contain both static and dynamic content. Static content preferably does not change or at least does not change frequently with time. Static content may be loaded in an application executing on UI Engine 104 of a mobile communication device 102, and optionally updated on an infrequent basis, or never updated. In the hypothetical example of Figure 2, an example of static content could include service categories or perhaps a splash screen or main menu. Dynamic content is content that generally goes out of date more frequently and is therefore typically periodically refreshed. Examples of this can include restaurant addresses, addition of new restaurants, changing phone numbers and so on. To provide another example, in a news service application, pages displaying various news items or advertisements may utilize frequent updates.
[0065] In accordance with one embodiment of the invention, application developers are provided with a method to create a content bearing mobile application consisting of an interrelated set of display pages consisting of static content and formatting (together, making a "rule set") that can also be combined with dynamic content. In one embodiment, each display page has exit criteria that can point to, for example, a next display page, one of a plurality of next display pages, an application execution termination, or a branching to another application.
[0066] In one embodiment, the rule set comprises a set of application display pages. For example, in this embodiment, the rule set may include an introductory splash screen display page and can further include one or more subsequent display page(s) that can be "clicked" through by user input via either keypad entry, touchscreen entry, voice commands or other user interface command. Because the original event identified the type or class of mobile communication device 102, this information can be used, for example to ensure that these screens are formatted properly for suitable display on the particular mobile communication device 102.
[0067] When a user makes an input selecting further content (for example, selects an option from a menu screen) UI Engine 104, in one embodiment, transmits another event to a server 108 that is preferably communicatively connected to the network. The event, in one embodiment can include information such as an identification of the content and a screen identification, along with other useful information to identify the content and the mobile communication device 102 for which the request is made.
[0068] Alternatively, in order to optimize or at least enhance the application appearance, it is possible to also generate rule sets based on device characteristics such as, for example, a resolution size for a device, font size, language preference, font type supported, an application identifier and an application state indicator that specifies the current state of the identified application as it runs on the mobile communication device, among others. This allows fine tuning of content parameters such as, for example, button sizes and label sizes, in order to take advantage of the mobile communication device-specific display or other characteristics. In one embodiment, the rule set may default to a standard rule set if no optimization has occurred for a characteristic of a given mobile communication device type.
[0069] This invention can be implemented in one embodiment to allow an application developer to develop and administer a data application for a mobile terminal that is subsequently compatible with multiple different clients without. The server can maintain a plurality of rule sets that are used to conform the content to the requesting device - it not exactly, then at least close enough to enable suitable performance. When new clients are added to the system, if needed, new rule sets can be added to better conform the application to one or more of the device characteristics corresponding to that type of client. Thus, multiple rule sets can be maintained for various sets of device characteristics to enable appropriate delivery of content. These rule sets are discussed in more detail below with reference to Figure 4.
[0070] The server can also maintain or utilize data and instruction transformation rules, which are referred to as meta-rules. Meta rules, as also discussed below with reference to Figure 4 can, be used to conform rule sets to various devices or special conditions. Thus, a meta-rule in one embodiment can be thought of as a rule that modifies a rule set or the application of a rule set. As a result of rule sets and meta rules, the invention can be implemented in one embodiment so as to allow separation of tasks of developing and maintaining applications, from the tasks of preparing, optimizing or conforming applications for specific types for terminals.
[0071] Embodiments of the invention provide developers with the ability to develop and deploy client device independent applications that can ultimately be tailored to particular client device characteristics, either manually or automatically. In one embodiment, development is performed using a workflow. A workflow may be utilized in one embodiment as a sequence of application screens (referred to herein as display pages). The sequence of displays can be defined in terms of exit criteria used for the various screens. Transitioning from one screen to a next screen can be made so as to be contingent on events generated from user input or other action with exit criteria defining how to respond to a particular event. An event, for example, may be an item of data received by a first client device from a server, an item of data received from another client device, or a user interface actuation of the first client device.
[0072] A display page in one embodiment can be implemented as representing a set of data content and associated formatting instructions to generate a user interface display. In another embodiment, Display components sent to a client comprise device specific instructions to render an appropriate display (or provide other appropriate user interface functions) on a client.
[0073] In one embodiment, a display page may be defined as a display component that is built with lower level display components. Together, a set of one or more display components is herein referred to as a rule set. A rule set may be used to define various user interface features or other device specifications for providing the appropriately configured display page or pages to the client. For example, a rule set may define the audio or video display of information and formatting on a client, or how user information from a client is used and so on.
[0074] Thus a rule set a set of criteria for one or more display pages, assembled with their respective content as a template or with a placeholder for respective content to be added. Display pages can include exit criteria that specify, perhaps conditionally, information such as, for example, the next display page to be displayed. Additional exit criteria could include, for example, responses to warnings received from the server, or application termination responsive to receipt of an error message from a server.
[0075] In a further embodiment, workflows may include global data comprising visual display components that may be common to more than one display page in an application, or even to more than one application. Examples of global data may include various cached messages or images, some or all of which can be cached to speed the execution of a client application, while minimizing client device memory requirements.
[0076] Figure 3 illustrates how a server 302 can provide content to a plurality of clients 304 in accordance with one embodiment of the invention. The data connectivity between a server and a content service provider 301 may be implemented in a variety of ways. For example, in terms of the example environment illustrated in Figure 1, server 302 can be implemented on a server 108 and communicate with a client 304 such as a mobile communication device 102 via client/server communication providers 303 such as the wireless network.
[0077] Server 302 communicates with clients 304 through one or more client/server communication providers 303. Thus terms of the example environment described above with reference to Figure 1, client/server communication providers 303 may be a cellular carrier or other wireless service provider. Server 302 may provide application service through just one, or a plurality of client/server communication providers 303. Alternatively, providers 303 may use other types of cabled or wireless communication services such as, for example, wide area networks, local area networks and other communication interfaces. Rule set 305 is accessed by server 302 to provide the content bearing applications to clients 304, in conjunction with data from content service providers 301. Rule set repository 305 may be maintained at server 302, or at a remote server that is in communication with server 302.
[0078] Referring again to Figure 3, in terms of the example illustrated in Figure 1 , a client 304 may be a mobile communication device 102 such as, for example, a smart cell phone, a personal digital assistant (PDA) with wireless access, a notebook computer with wireless access, or any other client device. In alternative embodiments data connectivity may be by cable, optical fiber, or other wired or wireless means.
[0079] In an embodiment of the invention, a client/server communication provider 303 provides a bidirectional data link between a server 302, and a client 304. For example, in terms of the example environment illustrated in Figure 1, client/server communication provider 303 is a wireless communication provider that can provide communicative connectivity between the mobile communication device 102 and one or more devices such as servers 108 or content service providers 111 associated with the network. In the event that client/server communication provider 303 is wireless, it may conform to one of a variety of wireless cellular phone or wireless data communication standards such as code division multiple access (CDMA), frequency division multiple access (FDMA), time division multiple access (TDMA), or orthogonal frequency division multiple access (OFDM), or other types as are well known to one of ordinary skill in the art. The data communications may be part of a circuit switched call, or an "always on" type of packet data service.
[0080] In the embodiment of the invention shown in Figure 3, client/server communication provider 303 can be implemented so as to generally provide a substantially transparent channel of communication between client 304 and server 302. In this embodiment of the present invention, server 302 links client 304, via client/server communication provider 303 to a content service provider 301. Server 302 can be any type of computer with associated memory storage and data connectivity. As discussed above, server 303 can be configured to transform data flows, manage client UI Engines, and perform other administrative and management functions. Communication between server 302 and client 304 can be mediated by any of several communication protocols such as Brew®. J2ME®, WAP®, and Microsoft Corporation's Windows® Mobile. The combination of rule set 305 and server 302 will sometimes be referred to as a SmartEngine™ 306, herein, for convenience only and not to imply loss of generality from the generic description herein. Note that rule set 305 can share physical memory according to some embodiments of the invention.
[0081] Having thus generally described a high-level overview of various features of the invention, the operation is now described in greater detail. Figure 4 provides a more detailed description of one embodiment of server 302 of Figure 3. In this particular embodiment, client interface 402 communicates with clients through air interface 401. In other embodiments, other communication interfaces with clients may be used, alone or in combination. Client interface 402 communicates with content provider 111 via content adapters 407 and a communication channel, which is network 105 in the illustrated example. As shown, the application server 302 in this embodiment comprises a client interface 402, selection logic 403, rule set translator 406, meta rules 405, and content adapters 407.
[0082] Figure 5 is an operational flow diagram illustrating a process by which the example server system illustrated in Figure 4 can process client requests for content in accordance with one embodiment of the invention. Some aspects of the operation of the server system of Figure 4 can be better understood in relation to the operation of the server as shown in the flowchart of Figure 5. Referring now to Figures 4 and 5, in step 501, client interface 402 receives a message from a client 304 (not shown in Figure 4) via air interface 401. As described above, the message received from the client 304 can be in the form of an event that indicates information about the content being requested such as, for example device characteristics. As one example, the event can provide information pertaining to a particular content screen being requested and information about the device requesting the content. Additionally, in one embodiment, the event can include information specifying the information or type of information that is to be retrieved to fill in the content data screen. Due to the fact that data transmission rates between a mobile communication device and a server system tend to be low in certain environments, UI components and events may be encoded in binary in order to increase the responsiveness of the applications.
[0083] In one embodiment, device characteristics are provided in a file that can be stored on the client device. This thin client, or other file, is, in one embodiment, designed to consume minimal storage space, while providing appropriate information regarding the device characteristics for assembly of the appropriate rule sets from a local cache or from an external source. In one embodiment, this file is maintained by the client and used for all applications. In another embodiment, the file is downloaded for a new application and reused for that application when an event is transmitted to the server. In a hybrid approach, device information is maintained in a file and augmented by application specific or other information that may be provided by an application or other event.
[0084] Table 1 includes exemplary device characteristic information such as display screen dimensions, and device characteristic software information such as Client-server protocol version ID number and UI Engine version ID number, in addition to data service request and status information. Table 1 represents a specific example of information that can be included with a service request message. Other examples will become readily apparent to one of ordinary skill in the art after reading this description, including modifications, deletions, additions, and substitution of one or more fields or field definitions. Table 1
Service Request Message (from Client) Field No. Description:
1 Client initiates call? (Y/N)
2 Screen size: x-dimension (no. of pixels)
3 Screen size: y-dimension (no. of pixels)
4 Client-server Protocol version ID no.
5 UI Engine (client) version ID no.
6 Application version ID no.
7 Application name (char, strng.)
8 Client Device ID no.
9 Client SW platform type (e.g., J2ME, BREW®, SmartPhone...) s
10 Type of Exit from application ("time out" and/or menu option)
11 Pair Data? (Y/N) (should two items of data be associated?)
12 Is current display a splash display (y/n)
13 Current Display page name: name of current display page
14 Next Display page: name of the current display page dataset
15 User Entered Data - data values entered by the user (for initialization protocol, it will be the version ID for the display page.
[0085] Client interface 402 can respond to the client with a service request, of which an example is given in Table 2. Note that this service request message can include information about the requested application, as well as warning and error status information for potential use by the client. Table 2
Service Request Acknowledgement (from Server) Field No. Description:
1 Client initiates call? (y/n)
2 Exit application on error (y/n)
3 Client-server Protocol version ID no.
4 UI Engine (client) version ID no.
5 Application version ID no.
6 Application name (character string.)
7 Server-initiated error condition (y/n)
8 Server-initiated warning (y/n)
9 Client Device ID no.
10 Client SW platform type (e.g., J2ME, BREW®, SmartPhone...)
[0086] Table 2 represents a specific example of a service request acknowledgement. Other examples will become readily apparent to one of ordinary skill in the art after reading this description, including modifications, deletions, additions, and substitution of one or more fields or field definitions.
[0087] Referring still to Figures 4 and 5, in step 502, selection logic 403 examines the message and selects a rule set corresponding to the current state of the application being requested by the message. For example, this can be retrieved from a repository of rule sets 404. Rule sets 404 in one embodiment provide information that can be utilized to format or otherwise allow content to be conformed to characteristics of a particular device or device class. Thus, for example, in one embodiment, selection logic 403 utilizes information about the requesting device in making a determination as to which rule or rule set of a group of rules or rule sets to retrieve in fulfilling the request embodied by the message.
[0088] Information regarding the device or device characteristics can be provided to selection logic 403 in a number of different ways. For example, in one embodiment, the message from the client device includes a listing or specification of the one or more device characteristics, including application state descriptors, for a particular mobile communication device. As such, selection logic 403 can look to those characteristics to determine a rule set that matches those characteristics. As another example, the message can include an identification of the device or device type that is requesting the content. This identification can be used to access a look-up table or other repository that identifies the characteristics associated with the device identified by the device ID. Depending on the implementation, the message can contain this information each time a message is sent from the requesting device.
[0089] In one embodiment, a rule set may not be available to identically match each of the characteristics specified for the requesting device or device type. In that event, selection logic 403 can be implemented so as to select a closest or best match depending on a number of criteria. Thus, for example, assume that a set of device characteristics includes a language preference, a screen aspect ratio, and a font size specification. If in this example, also assume that there are three possible device languages, three possible screen aspect ratios, and three possible font sizes, there are 27 potential different rule sets to match each of the 27 permutations of device characteristics. However, it may be impractical to provide this many rule sets for a given application. Indeed, considering the number of devices that exist in actuality, it is likely that there may not be a sufficient number of rule sets to match every possible permutation of device characteristics.
[0090] Therefore, continuing with the previous example, selection logic 403 may be implemented to select the closest matching rule set based on available rule sets and an evaluation of their differences in the three parameters of font size, language, and aspect ratio. To aid in computation of dimensions and also to potentially resolve ambiguities, the device characteristics can be weighted such that selection can be made based on the relative importance of the various parameters. Consider, for example, a scenario where matching aspect ratios and font sizes are only available in rule sets that do not have a matching language, yet a rule set in the matching language is available with a less than ideal font size and/or aspect ratio. In this example, the best choice may be chosen as the rule set that addresses the appropriate language, as the screen may otherwise be unusable to the end user if it is not in a language that he or she can understand.
[0091] Selection logic 403 can also be implemented to determine or select a set of meta rules 405 on the fly or from meta rule repository (on the basis of client characteristic information included with the message) to be used to translate the selected rule set. Thus, in one embodiment, meta rules 405 can be implemented as rules that are used to modify (for example, to change or constrain) rule sets 404. Thus, in this embodiment, a rule set translator 406 is used to apply one or more selected meta rules 405 to the selected rule set to result in a translated rule set that can be used to conform the content to the requesting device.
[0092] One example of where a meta rule 405 can be implemented is a situation where it is preferable or desired not to exceed a given maximum font size for a device even if the device itself is capable of supporting a larger font size. For example, assume that a particular communication device can support a given font size, yet the display characteristics are such that it is more desirable to use a smaller maximum font size that this device can handle. In this instance, the meta rule translator 406 can identify the device, obtain the appropriate meta rule 405, which modifies the rule set to specify the preferred font size. As such, this is one example where a meta rule 405 can be implemented to modify a rule set that may have been chosen by the selection logic based on given device characteristics. Thus, in this example, the meta rule 405 would serve to insure that the selected rule set 404 utilizes the preferred maximum font size as opposed to a larger, but not preferred, maximum font size that may have been specified.
[0093] Other examples can include a situation where certain devices perform best when limited to a plain font only, as opposed to various stylized fonts that they may otherwise support, or a situation where a particular keyboard type is specified for the application. Thus, for example, as these examples illustrate, a meta rule 405 can be used to modify a rule set by rule set translator 406. In one embodiment, the modification can be done by adjusting one or more of the parameters that may be specified in a rule set 404. Meta rules are discussed in greater detail, below.
[0094] Rule set translator 406 delivers the translated rule set to client interface 402. If meta rules are not applied, the non-translated rule set is returned by selection logic. In a step 504, Content adapters 407 retrieve and process dynamic and any updated static data from content providers 111 via network 105 for combining with the translated rule set by client interface 402. More specifically, in one embodiment, the translated rule set defines areas or locations on a display page where information or other content is to be included with the final rule set for delivery to the client device. As such, in this step 504, content adaptor 407 communicates with the appropriate content provider 111 (via network 105 in the illustrated example) to retrieve the appropriate information or other content for inclusion with the display page as defined by the rule set.
[0095] As an example, consider the hypothetical application illustrated by Figure 2. In this example, the information or content to be retrieved from a content provider 111 and included with the meta rule can include information pertaining to the various gas stations, restaurants, hotels, or other items for which information can be supplied via the hypothetical application. In one embodiment, the information is embedded in the rule set indicating which content is to be retrieved from a content provider 111. In alternative embodiments, identification of the appropriate content for inclusion with a rule set can be made by a number of different techniques including, for example, including an identification of the content with the event that is generated by the client to request the new rule set, including an identification of the content within the rule set itself, or otherwise appropriately identifying content for retrieval. The content can be identified directly or indirectly, for example, via a look-up table.
[0096] In one embodiment, an identification key is included with the event generated by the client application, preferably utilizing exit information associated with the application screen. This identification is provided to the content provider which utilizes the identification to identify the particular content to be retrieved, retrieves the content, and provides it to content adapter 407 for inclusion with the rule set. Of course, as these examples serve to illustrate, there are other methods and techniques that can be utilized to identify updated content for inclusion with the rule set.
[0097] In a step 505, the translated, rule set, combined with the appropriate content is transmitted back to the client. Although rule sets are principally sets of interrelated display pages, they may also contain global data. Global data can comprise, for example, bitmapped images, that are included once and reused by multiple display pages in order to save memory and communication bandwidth. Global data may be cached only for the duration of an application's execution, or it may be maintained indefinitely, or until updated. Global data may be used by a single application, or it may be used by multiple applications. Global data can include data that is global to the particular client itself or data that is global to a particular application.
[0098] For example, a given application may have a brand or other logo associated therewith that is included in one or more of the display screens of the application. For example, consider the exemplary embodiment illustrated in Figure 2, where each screen includes the brand designation "TravelPal" on each screen. In another example, a brand or other identification of the mobile communication device may appear on the screen of one or more applications running on the client device. As yet another example, where the client device is a mobile communication device such as a cellular telephone, the cellular carrier's brand or logo may also appear on one or more screens of one or more applications running on the device. Global data is preferably cached locally to the client device to conserve bandwidth and other resources. However, global data may also be cached at other locations and communicated to the client device for inclusion with the display.
[0099] Turning now to Figure 6, an expanded version of a system is presented according to an embodiment that includes application development, billing integration, report generation capabilities. SmartEngine™ 306, wireless carrier 303, and end users 304 can be implemented as described above in connection with Figure 3. Application development can be facilitated by a software module 1607 (described below, and sometimes referred to as SmartBuilder™, herein) having a graphical user interface. (The use of the term SmartBuilder™ herein is for convenience only and does not to imply loss of generality from the generic description herein.)
[0100] SmartEngine™ 306 can access application content from a content provider's 1606 database 1605 as described above in connection with Figures 1 and 3 to service applications. SmartEngine™ 306 can also access customer database 1604 to retrieve or store information related to customers, information such as profiles, preferences, and the like. Customer databases 104 can reside within SmartEngine™ 306 according to some embodiments or can reside with advertisers 1601, or content providers 1605, according to other embodiments. In further embodiments, customer databases 1604 can be distributed (and/or replicated in part or in whole) among two or more of these entities.
[0101] Continuing with Figure 6, content providers 1606 and advertisers 1601 can use SmartBuilder™ 1607 to develop applications and advertising applications for subsequent processing by SmartEngine™ 306. According to some embodiments, SmartEngine™ 306 may combine content-based applications with advertising for ultimate delivery to an end user 304 via wireless carrier 303.
[0102] According to a further embodiment, module 1603 (sometimes referred as SmartRevenue™, herein) can provide integration between SmartEngine™ 306 and a billing system used by wireless carrier 303. (The use of the term SmartRevenue™ herein is for convenience only and does not to imply loss of generality from the generic description herein.) Examples of such carrier billing systems include those provided by third parties, systems such as Qpass® or Bango®, as well as carrier-proprietary billing systems such as the Sprint™ Billing module. Billing system formats and protocols are well known to one of ordinary skill in the art. Billing options, in addition to carrier-based account billing, are enabled because SmartRevenue™ can access device ID, session ID, unique user ID and related information from SmartEngine™ 306. Such additional billing options include billing to an end user's charge card, debiting a phone card account, or "microbilling" (where end users charge to their mobile phone, eliminating the need to supply credit card information).
[0103] Referring again to Figure 6, according to yet a further embodiment, module 1602 (sometimes referred to as SmartManager®, herein) can end userr usage and revenue report reports based on transaction information from SmartEngine® 306. (The use of the term SmartManager™ herein is for convenience only and does not to imply loss of generality from the generic description herein.)
[0104] Examples of information included in usage reports include, without limitation: (i) hit rates for content provider and advertiser sites visited; (ii) numbers and types of unique end users by carrier (as well as whether a unique end user is new to a service, through identification of a user flag set by the service); (iii) numbers and types of unique end user devices; and (iv) numbers and types of unique end user device's native software platforms. In this regard, "uniqueness" can be established, for example, on the basis of Unique User ID, Session ID, Device ID, and Carrier ID obtained from SmartEngine™ 306 on a per data communication transaction basis for end users 304. Additionally, in some embodiments information obtained from a customer profile database (not shown) may be obtained through matching with such ID information. For reasons of consumer privacy, such data could be voluntarily submitted from a consumer in order to better customize content-based services and/or receive better targeted advertisements. Examples of customer profile database information, include without limitation: age, gender, home location, and current location.
[0105] Examples of information that can be included in revenue reports include, without limitation: (i) revenue generated by carrier; (ii) revenue generated by type of end user mobile terminal; and (iii) revenue generated by content provider's and/or advertiser's offers (on a per offer basis). As discussed above in connection with usage reports, ID information related to consumers can be obtained via SmartEngine™ 306.
[0106] According to further embodiments, times and dates for such transactions can also be recorded, so that SmartManager™ can generate reports covering specified time intervals. Content providers 1606, advertisers 1601, and or wireless carriers 303 can access SmartManager™ 1602 to evaluate the effectiveness of content services, advertising campaigns, and communication service offerings, respectively.
[0107] Figure 7 illustrates a SmartManager™ 1602 architecture according to an embodiment of the invention. SmartEngine™ 306 handles communication transactions 307 for content-based services and/or advertising. Module 1711 can extract information from the communication transactions such as (without exclusion): (i) site/page address; (ii) wireless carrier ID; (iii) end user software platform type ID; (iv) session (ID); (v) unique end user ID; (vi) unique end user phone type ID; and (vii) whether or not this is an end user's first use of an application (determined by inspecting a flag or "cookie" that is set by the application). This information can sometimes be obtained by inspecting a header of a transaction data packet, eliminating the need to take up communication transaction bandwidth for extra messages. Such information can be stored on database 1712, along with corresponding times and dates of collection. Report engine 1713 can access database 1712 to retrieve and process the collected data for report generation. According to some further embodiments, report engine 113 can access one or more additional, optional databases such as, for example, voluntary profile database 1714, carrier billing database 1715, and/or sales database 1716. Figure 7 illustrates these optional database examples as residing within SmartManager™ 1602. According to alternative embodiments they may reside wholly or partly elsewhere, as long as access by report engine 1713 is available. More generally, SmartManager™ 1602 can be implemented on the same hardware as SmartEngine™ 306, or on different hardware as described below.
[0108] According to an embodiment, a system user 1703 can interact with report engine 1713 through, for example, a terminal 1702. Exemplary terminal screen displays 1800 are illustrated in Figures 8 through 11 according to an embodiment of the invention. The displays illustrated share some common features, such as option selection box 1801 (for click-select) and selected option name display 1803, otherwise the displays are different to accommodate subsequent actions corresponding to a selected option.
[0109] For example, in Figure 8 a "View Applications" option was selected, text bar 1804 lists headings for application attributes 1804, aligned with a listing of the attributes 1806 and a click-select button 1807 to activate an application. In the event that there is more than one application, multiple lines of application attributes and corresponding activation buttons can be displayed.
[0110] Figure 9 illustrates a "Register New Application" display. In this example, the label "Application Name" 1904, corresponding to the selected option, is displayed in conjunction with text entry box 1905 and "Submit" button 1906. Figure 10 shows a View Reports display allowing a user to specify criteria 2005 for report generation. Figure 11 presents a "Not Deployed Application" display as a further example. [0111] According to various embodiments, in response to a report request and specification, SmartManager™ can interactively display reports on a terminal, and/or send them to other computer devices such as disc drives or printers.
[0112] Returning to Figure 6, additional modules (not shown) can be interfaced with SmartEngine™ 306 to adapt it for operability with additional third parties. Examples of such third party adapters can include, without limitation: a Yahoo® location services adapter (that can goes to yet another third party's website to obtain latitude and longitude designations corresponding to a particular location position description); an Enpocket® adapter to provide various services based on SMS messaging; and page-based upcoming events interface adapter.
[0113] Another type of adapter can allow SmartEngine™ 306 to adapt to mobile terminal clients having different data communication format capabilities for data services. According to embodiments as illustrated in Figure 12, a functional module 2201 having data format detection and translation capabilities will be called a WAP Module for purposes of convenience, herein. (The use of the term WAP module herein is for convenience only and does not to imply any loss of generality from the generic description herein, nor does it imply a restriction to work with WAP protocols.) WAP Module 2201 mediates communication between SmartEngine™ server 302 and mobile terminal clients 304 A and 304B via client/server communication provider 303. Content service providers generally provide HTTP (HyperText Transport Protocol) formatted data for applications, whereas mobile terminal clients can generally accommodate WML (Wireless Markup Language) or xHTML (Extended HyperText Markup Language) formats, detection logic 2203 is operably connected to translator 2202 to detect which formats are supported by a mobile terminal client and directing translator 2202 to perform format translations accordingly. In some embodiments, detection logic 2203 can determine supported format types for a mobile terminal client as illustrated in example embodiment of Figure 13. In step 2301, translator 2202 can examine header information for packets transmitted by a mobile terminal client to determine, for example carrier ID, device ID, and unique user ID. In following step 2302, detection logic 2203 queries lookup table 2204 which stores mobile terminal format capabilities associated with one or more of the ID items. For this example embodiment, detection logic 2203 then determines whether or not a particular mobile terminal client (phone) has xHTML format capabilities in step 2303, and if so, directs translator 2202 to perform HTTP/xHTML translations in step 2304. Otherwise, detection logic 2203 directs translator 2202 to perform HTTP/WAP translations as shown in step 2305. Determining a mobile terminal client's format capabilities from the examination of data packet header information can obviate the need to send additional overhead data packets to select translator options, thereby improving communication efficiency.
[0114] Figure 14 is a block diagram illustrating an example implementation of a client device in accordance with one embodiment of the invention. The various components of the client may be implemented in hardware, software, firmware, or any appropriate combination of hardware, software, and/or firmware. In this particular embodiment, bidirectional communication with a server, such as described above in relation to Figure 4, is achieved via an air interface 601. For example, where the client device 102 is a cellular telephone, air interface 601 can be implemented utilizing the cellular communication channel between the cellular telephone 102 and a base station 101. Although not illustrated in Figure 14, in this example, additional communication equipment may be included between the server 108 and the air interface 601.
[0115] To accommodate the conversion of data files to and from binary representation for transmission efficiency over the air interface, a parser 602 can be included convert data files to binary for transmission, and also can convert received binary data files to http, or any appropriate data format, for subsequent processing by a UI engine 603. In one embodiment, UI engine 603 runs on top of the operating system of the client, and implements an improved user interface for an application on the client.
[0116] A display driver 604 can be included and operably connects UI engine 603 and client display 605 for displaying application display pages. Although for the purposes of illustration in this embodiment, display 605 is a visual display, audio, tactile and other output devices may also be used. Display Driver 604 accesses display component library 610 to generate actual display pages from received rule sets (optionally augmented with content and global data).
[0117] In one embodiment, a display page may be defined as a display component that is built with lower level display components. Table 4 provides an example of a set of display components that may be included in display component library 610, and lists associated parameters that can be provided in one embodiment of the invention. These are discussed in more detail, below.
[0118] UI engine 603 can receive user interface inputs from user input device 608 via an event handler 607. Such user inputs can include key depressions, touch screen or touchpad actuations, joystick actuations, mouse actuations, or voice activated actuations, to name a few options. UI Engine 603 can also interface with a cache 609 to retrieve cached display pages (rule sets), global data and other information. Cache 609 can also store application state information, application version number information, and display page version number information, as well as UI version number, client ID, display and UI input device descriptions, and other types of information as discussed herein. Additionally cache 609 can retain cookies or other files or information left by the execution of applications for later retrieval by applications.
[0119] During processing of a rule set, in one embodiment the rule set is parsed and saved for event processing. Event processing can occur, for example, when a UI Engine is informed by an event handler of a user interface actuation such as, for example, a graphical button on a GUI or a keystroke on a keypad. When the user instructs his or her mobile communication device to execute an application, an initial UI component is constructed from an application rule set and content data, either locally cached and/or received from the server system, resulting in a display page such as a splash screen or login screen, for example, to be presented on mobile communication device 102.
[0120] In response to a user input, for example in response to actuation of a button drawn on the mobile communication device display screen as instructed by the UI engine, event information is transmitted from the UI engine to the client interface. This event information can include information such as, for example, the application name, screen name, current application status, operation asserted by the user (such as a button press for a given button name) and any user input data. Based on the this event information, client interface retrieves and provides the appropriate rule set, for example as described above with reference to Figures 4 and 5.
[0121] The air interface to the server 601 can be implemented in one of many alternatives including those that are readily known to those of ordinary skill in the art. For example, the air interface component for a mobile communication device 102 could be a wireless data modem implemented in conjunction with wireless voice services.
[0122] A Parser 602 can also be included to converts various message and data formats that may be used by UI engine 603 to, and from, a more efficient binary file format for transmission and reception over the air interface. For example XML encoded files may be used by UI engine 603 in operation. However, XML encoded files encode long text based names such as
"<SCREEN ID>TIMESHEET APP SCREEN 5</SCREEN ID>" with 8 bit or 16 bit numbers for example representing a screen identification for example screen ID OlOl' (5). These files are typically larger than their binary counterparts. For instance, in this example the XML entry for screen identification including tags would require 46 bytes to be transmitted while a binary formatted message where one byte is reserved in a particular location in a buffer yields a factor of 46 in reduction of bits sent. This can provide an advantage when the amount of fields sent is large. As memory is cheap, the XML may be kept as is for debugging purposes or auditing purposes on the server and also encoded into binary blocks for ease of assembly at content insertion time.
[0123] In one embodiment of the invention, the message may have been originally expressed in http, or a data format such as XML, at the client, but converted to a binary file representation at the client, prior to transmission via the air interface, in order to conserve transmission bandwidth and improve transmission efficiency. In such cases, client interface 402 may convert the binary file representation back to http, or another comparable data format, subsequent to further processing by the server. This conversion operation is referred to as parsing. Once the data received by client interface 402 via air interface 401 has been parsed, if parsing is used, the client interface 402 forwards the message to selection logic 403.
[0124] Returning still to Figure 14, UI Engine 603 executes instructions used to implement the user interface. UI Engine 603 in one embodiment is software that executes on a microcontroller or microprocessor in the mobile communication device client. Such a microcontroller or microprocessor also may execute other tasks for the mobile communication device on a time and resource sharing basis. For example, air interface 601, parser 602, event handler 607, and display driver 604 may also execute, at least in part, on the same microcontroller or microprocessor that executes UI engine 603.
[0125] UI engine 603 communicates with the server through the air interface and the optional parser, as described above. UI engine 603 interfaces with cache 609 and event handler 607. Cache can be implemented as memory storage circuitry and is used to store rule sets, global data, cookies, and application state information for a client-server application on the mobile communication device. Event handler 607 captures and processes user input device actuations from the user input device 608, prior to passing them on the UI engine 603. Display driver 604 receives higher-level display page descriptions from UI engine 603 and processes them according to display components stored in display component library 610.
[0126] As with cache 609, display component library 610 can be implemented using memory storage circuitry. In some embodiments, cache 609 and display component library 610 may be implanted using the same memory circuit(s). Display component library 610 contains display components (described in detail below) that translate the higher-level display page description (described above) into the actual displays that are shown on hardware display 605. Display component library 610 can have a communication path with UI engine 603, so that display components can be initially stored, and later updated.
[0127] Because data services may be initiated by a client, by another client via the server, by the server, or by the content provider via the server, both "pull" (i.e. initiated by the client) and "push" (i.e. initiated by or via the server or a third party) scenarios can be considered.
[0128] A pull type embodiment of an operation of the client of Figure 14 can be better understood in connection with the flowchart shown in Figure 15. Figure 15 illustrates an example of client processing in accordance with one embodiment of the invention. Referring now to Figure 15, in step 701, event handler 607 captures a user actuation of user input device 608 and alerts 702 UI engine 603. For example, a user may select an icon on a screen of the mobile communication device that indicates the invocation of a specific application or service. Alternatively, a user may select one or more items from a displayed list of items in an application. Or the user actuation may be the depression of a single key, either hard labeled or soft labeled.
[0129] UI engine 603 can process the notification according to logic embodied, for example, as an exit criterion in a display pages of a rule set to generate a data message requesting an application service. This message can also contain information about the client's status, such as, for example, client device characteristics, UI engine version number, application version number, version numbers of cached information, and current application state (if any). Then parser 602 and air interface 601 convert and transmit the message, respectively, to a server system such as the one described in connection with Figure 4.
[0130] In step 500 of Figure 15, the server processes the transmitted message and returns a message to the client. In one embodiment, this processing can be performed as described above in connection with Figure 5.
[0131] In step 703 the client receives, converts, and caches returned rule set, content, and global data. The UI engine may also display a first display page of the application session on the screen of the mobile communication device. The above method may be used, for example, when a new client application is loaded for the first time, or when a previously loaded application requires updating. [0132] Figure 16 is an operational flow diagram illustrating a process for displaying content in response to an event at a client device in accordance with one embodiment of the invention. In the embodiment illustrated in Figure 16, an action occurring at the client device can result in a request to a server 108 for content.
[0133] Referring now to Figure 16, in a step 801, an event occurs. For example, in the embodiment illustrated in Figure 6, an event handler 607 captures an application event indicating that additional content is requested. As described above, this can occur as a result of user interaction, interaction by another device, or via operation of the current application. For example, a user may make a menu selection, keypad entry, or other action or user input resulting in the identification of additional content to be retrieved. As another example, exit information for a display screen may result in automatic generation of an event, for example, at the expiration of a time out period. As an illustration of this latter example, a splash screen may be configured so as to display on the client device for a given period of time and, at the end of the period of time, automatically transition to a subsequent screen such as, for example, a Welcome screen. Thus, as these examples illustrate, the event can include information such as, for example, an indication of a current screen as well as an indication of subsequent content or a display screen as requested as a result of the execution of the application and, where applicable, interaction with a user or another device. Thus, in one embodiment, the event indicates a subsequent rule set or display screen or other content to be displayed.
[0134] In a step 802, UI Engine 603 checks cache 609 to determine whether local copies of information specified by or identified by the event are stored locally. Thus, for example, UI Engine 603 can check cache 609 for locally-stored versions of the display screen, content, and global data. If some or all of the data are found in the local cache, as illustrated by step 803, then the operation continues at step 804. In step 804, the locally stored information is utilized in generating or providing content for the subsequent operation of the application. Thus, for example, a locally stored display screen, content information, and any global data, can be retrieved from the cache, appropriately assembled (if not stored in a pre-assembled fashion), and provided for display. This is illustrated by steps 804, 805, and 806.
[0135] If, on the other hand, in step 803 certain of the requested information is not found in cache 609 or if the cached copy is stale, in a step 807, a request is sent to the server 108 for processing. This is illustrated by steps 807 and 500. Server processing, as illustrated in step 500, can occur in one embodiment as discussed above with reference to Figures 4 and 5. Thus, in a step 808, the updated rule set is received by the client device. The rule set and any associated updated information can be used to update the cache 609. Additionally, this information can be used to display the appropriate information for the subsequent operation of the application such as, for example, the subsequent display screens, as illustrated by steps 805 and 806. Although the above exemplary process discussed the display of content in terms of displaying either cached or newly-retrieved content, the system can also be implemented so as to combine one or more cached and newly retrieved content items in a single display page.
[0136] Additional features that might be supported by the UI Engine include Currency Support and Wakeup/Push Registry SMS capabilities. The Currency Support feature can enable a user to select a preference for type of currency, and subsequently provide inter- conversion between the currency type used in an application and the selected type of currency, including currency symbols and exchange rate conversions. The Currency support feature can also provide secure memory storage of personal identification numbers (PINs) and/or passwords, optionally along with corresponding phone numbers. This PIN/password storage feature can allow access to these items for communication with server applications through a secret preset sequence of keystrokes on the mobile phone. Optionally, the PIN/password will not be displayed on the screen of the phone when accessed. PINs, passwords, corresponding phone numbers, and secret keystroke sequences can only be viewed and edited when unlocked by a secure memory password, but usually not otherwise.
[0137] The Wakeup/Push Registry SMS capability can enable a phone to establish SMS communication with the server for more efficient communication of application data than with http, when supported by the service providing carrier. (With respect to the Wakeup/Push Request SMS component, "Wakeup" is a Brew® term and "Push Request" is a J2ME® term. The "Wakeup/Push Request SMS" designation for this component is for convenience only, and is not meant to limit applicability of this feature to other native client terminal systems such as Windows® Mobile or Symbian®, for example.) The Wakeup/Push Request SMS component enables a phone to receive server initiated SMS data.
[0138] Having thus described an example process for retrieving content information for an application, this process is now described with reference to the hypothetical application illustrated in Figure 2. Referring now to Figures 2 and 16, in a step 801, the event handler captures an actuation indicating a content request. Thus, when the user selected "Restaurants" in Figure 2b, the event can include information such as, for example, the executing application (in this example, TravelPal) and the exit information associated with the selection "Restaurants." Thus, in this embodiment, the event information indicates (directly or indirectly) that the operating application is to return the screen illustrated in Figure 2c with a list of restaurant types available for selection. The event is provided by event handler 607 to UI Engine 603 to effectuate retrieval of the screen of Figure 2c with the appropriate information. As described above with reference to steps 802, 803, 804, 805, 807, 500, and 808, UI Engine 603 uses the event to obtain the next screen (in this example, Figure 2c) from server 108 or from the cache 609. In this operation, parser 602 can be used to generate appropriate binary information from the event object such that the appropriate request can be forwarded to the server 108 for processing, as illustrated by step 807. A network adapter or other communication interface, although not illustrated in Figure 6, can also be provided. Parser 602 can also be utilized to convert the received binary information into an appropriate object for display by the display unit 605.
[0139] Figure 17 illustrates a "push" type embodiment in which the client does not initiate the interaction with the server. In step 901 the server, or a third party (for example, another client or other device) sends a "push" type message to the client, for example via SMS (short message service) or WAP (Wireless Application Protocol). The UI engine detects the message in step 902, and generates a message for transmission to the server in step 903. The process that follows can be the same as described in connection with Figure 15 in one embodiment. This method can be useful in cases where someone other than the client user needs to communicate with the client user via a client application. An example of such an application is wireless e-community services.
[0140] In the above example embodiments, a translated rule set exchange can ensue between server and client. In such a converted workflow exchange, a content provider typically sends formatted content to a client, wherein the format of the content is converted by the rule set translator 406 such that it is more optimally presented by the UI engine 603 on the client. Also, rule set translator 406 may transform user interface actuation data or mobile communication device telemetry data being sent from the client to the content provider. An example of such a transformation is the mapping of client keypad assignments to a map of standard keypad assignments. Additionally, instructions to configure the UI Engine on the mobile communication device can be added to the workflow and sent to the mobile communication device.
[0141] The client interface 402 converts and processes the data message, builds the display page component from the rule set and content data, and provides the next display page to mobile communication device 102a. This process can continue in this iterative manner as the content is executed on the mobile communication device 102a,
[0142] Of course, there are embodiments where only one display page is downloaded, and subsequent UI components are not used to execute the content. The display pages and related global data can be installed and stored permanently on the mobile communication device 102a. Alternatively, they may be dynamically loaded each time they are accessed. Display pages may also be cached for a session or otherwise as may be desirable for a given content item. Permanent storage techniques can include, for example, read-only memory, flash memory, or any other memory, and preferably memory that retains information during power down.
[0143] UI engine 603, along with display component library 610 and cache 609 for implementing applications may be initially installed on the client by the manufacturer in nonvolatile memory, as is other firmware for a phone, they may be loaded at a service center or in the field through a data connection (for example, USB cable, IR, or Bluetooth®, etc.) with a personal computer, downloaded off-the-air as part of a wireless service provider's over the air service provisioning (OTASP) process, or even download via a wireless web browser that may already be on the smart phone. Client applications may be installed or updated (or have software bugs fixed) through the download of rule sets, global information, and display components.
[0144] When a user downloads an application into a mobile communication device, an embodiment of the invention allows for a UI Engine 603 for the specific type of mobile communication device to be transparently downloaded before the first UI component of the application (for example a splash screen) is downloaded. In other embodiments, the UI Engine 603 is downloaded at the factory, for example, by beaming from a cell phone or by infrared transfer to the mobile communication device. Any other method of downloading an application to a mobile communications device is in keeping with the spirit of the invention. Download of the UI Engine 603 may also be part of the download of an application and a user may not be aware that a UI Engine has been downloaded. Regardless of the method in which the UI Engine for the device specific operating system is loaded, once the UI Engine is executing on a mobile communication device there are two tasks the UI Engine generally performs in one embodiment.
[0145] One task of the UI Engine is to display a UI component as requested by the application. This may involve a request to a server system (for example, server system 108) for combining a rule set for a given mobile communication device, application and screen with content obtained from a third party content provider. Alternatively, displaying a UI component may involve processing a message from another device locally such as, for example, a mobile communications device, and determining the subsequent UI component to display via logic local to the mobile communications device. Content adaptor 107 can be provided to allow conversion of the native format of the content on the content provider's system 111 to a format suitable for combination with a rule set in order to form a UI component for transmittal to a mobile communication device. The rule set specifies what events and data are sent back and when the events and data are sent to the rule interface component when a particular interface element for example a button is asserted by a user.
[0146] Another task is to act as an event handler for user inputs, which are interpreted and formed into events comprising an application name, screen name, operation name such as a button name and any user input data and either processed locally or sent to a rule interface component in a server system. Once the local logic or rule interface component has interpreted the event a second UI component for display on the mobile communication device is generated, possibly including content from a content provider. Alternatively, if a screen is not required to change, for example when a user has failed to enter an item required before accessing another screen, then the UI Engine may check the UI component comprising a rule set and locally highlight the field that is required before allowing an event to be sent to the rule interface component.
[0147] When a bug is found in an application the workflow module may be re-run in order to fix the application and re-deploy the rule set into the server system. In one embodiment, the UI Engines have the option of dynamically asking for a UI component every time, or caching the UI component for a session or permanently storing a UI component so that the application may only ask for content to fill the needs of a UI component. Each UI component may comprise a version ID which is simply checked at any convenient time in the UI Engine and if the UI component is found to be outdated regardless of the dynamic, cached or permanent status of the UI component on the mobile communication device, then the new version of the UI component may be downloaded to correct the fixed bug. Since this download happens automatically and since the deployed rule set was changed once, the result is that a bug can be fixed once and propagated to as many types of mobile communication devices as use the application seamlessly.
[0148] The version identification of the UI Engine may be checked at any time and the UI Engine itself may be reloaded into the mobile communication device. This may occur automatically or optionally by prompting a user. Since an update to a UI Engine affects only one mobile communication device hosting a device specific operating system only those mobile communication devices hosting the specific UI Engine are affected. This is unlike the automatic update of an application across all types of mobile communication devices at once since applications are independent of the mobile communication device.
[0149] As discussed above, a UI engine can be originally installed during a mobile communication device's manufacture using a data link of a cabled or wireless type. Alternatively, the UI engine can be downloaded using a browser program on the mobile communication device, for example, a WAP (Wireless Applications Protocol) Browser. The UI engine can be updated by a server whenever an application is initiated. The UI engine can also be updated via a data cable to a personal computer with access to an internet web site containing appropriated downloads. Another means for updating a UI engine is a wireless service provider's over the air service and provisioning (OTASP) capabilities. UI engines can also be updated from other mobile communication devices with cabled (e.g. RS232 or USB) or wireless (e.g. IR or Bluetooth®) connection.
[0150] When a user downloads an application into a mobile communication device, an embodiment of the invention allows for a UI Engine for the specific type of mobile communication device to be transparently downloaded before the first UI component of the application (for example, a splash screen) is downloaded. In other embodiments, the UI Engine is downloaded at the factory through an appropriate data link as readily ascertainable to one of ordinary skill in the art. Regardless of the method in which the UI Engine for the device specific operating system is loaded, once the UI Engine is executing on a mobile communication device, there are two tasks that the UI Engine may generally perform.
[0151] Alternatively, in order to optimize the precise application appearance, it is possible to also generate rule sets based on a resolution size for a device. This allows fine tuning of button sizes and label sizes, for example, in order to take full advantage of the layout of the mobile communication device's specific display and may default to a standard rule set if no optimization has occurred for a range of display sizes for a given mobile communication device type.
[0152] Rule sets can be considered as user displays or display screens containing content and content formatting rules that are linked to one another via generic events. These rule sets can exist independent of a mobile communication device operating system on which they may be implemented. The look and feel of each application can be independent of the mobile communication device in which each application ultimately executes. Each mobile communication device executes a UI Engine that is specific to that device and the real time operating running on that device. Device specific information may be available locally through the UI Engine and/or may alternatively be a part of the UI component sent to the UI Engine.
[0153] As described above, in one embodiment, one or more content adapters 407 can be used to retrieve one or more designated content items from a content provider 111 for inclusion in a translated rule set to be downloaded to a client. Figure 18 is an operational flow diagram illustrating a process for retrieving this content in accordance with one embodiment of the invention. Referring now to Figure 18, content identification information (e.g. content provider and access information) for a display page may be included in a rule set (i.e. imbedded content ID) and/or maintained in a database associated with a content adapter (i.e. associated content ID). An advantage of maintaining associated content ID is that it separates any associated maintenance or updating tasks for content provision with a content provider itself, rather than with a specific application. Thus if a content provider changes, it is only necessary to modify the content adapter. It is unnecessary to modify the rule set. This allows the present invention to separate development and maintenance tasks relating to application, content provider, and client device type.
[0154] In step 1001, a content adapter checks for the availability of an associated content ID. In one embodiment, the associated content ID is stored within the content adapter. Such ID can be stored as data structures that associate specific content providers, and specific content identification information within those specific content providers with a more general content description within the rule set. The associated content ID may include one or more content providers from which content can be extracted and combined. In another embodiment, associated content ID may specify a ranked ordering of more or less preferred content providers for obtaining specific types of content. If associated content ID is not found, the content adapter must rely on default associated content ID or specific imbedded content ID.
[0155] In step 1002, the content adapter requests content from appropriate content provider(s) using the respective associated and/or imbedded content IDs for a rule set. Such requests typically involve the sending of query messages to the URLs of content providers, along with associated requestor ID information. The content providers may be accessed via an internet service provider, or through other computer network means such are well known to those of ordinary skill in the computer arts. The responses to the queries are generally received via the same network means that are used to send the queries.
[0156] In step 1003, the content adapter receives and processes the requested content. The content may be requested from one or a plurality of content providers. The content adapter processes the content on the basis of logic associated with the rule set. Processing can include filtering, combining, re-ordering, etc. in addition to the format specification of the rule set. Step 1003 can also include the collection and management of information such as, for example, billing information for cases in which content is provided for a per-item charge.
[0157] In step 1004 the client interface assembles the rule set and processed content to make a rule set with content that is subsequently transmitted to a client. The client interface can optionally recognize that some requested data is missing, or otherwise unavailable for assembly into display pages. In such a case, the client interface may either generate a warning or error message for transmission to the client, or it may forward a message back to the content adapter to retry retrieval of the missing content. In this step, the client interface may also convert from http or html to a more efficient binary data format for transmission to the client. As discussed above, a UI engine on the client uses the received rule set with content, along with cached display pages, global data, and display components to create display pages that are shown on the display screen of the mobile communication device.
[0158] A procedure for creating a rule set in an embodiment of the invention is shown in Figure 19. In step 1101 a rule set file corresponding to a particular application is created an named. The rule set may comprise multiple files, optionally organized in a directory with a hierarchical structure to facilitate the authoring and modification of large applications. The rule set file can be thought of as the universe of an application, into which all other design and specification information for generating display pages for a specific application is contained, independent of a particular client device type.
[0159] In step 1102, one or more icons are inserted representing display pages to be shown on a mobile communication device's screen during the execution of the application. The display pages can be represented as icons with various levels of detail in various embodiments of the invention. For example, the display pages may simply be boxes containing a text or other type of designator. Alternatively, the display pages may be detailed depictions of an actual display page at varying resolutions. The content editing of the icons is described below in relation to steps 1104 through 1106. In one embodiment of the invention, the icons may be manually positioned on a display screen of a computer development tool by a user. In an alternate embodiment, the icons can be automatically positioned on a display screen according to a preset schema. Icons may be individually inserted and placed, and then edited as described below, prior to the insertion of additional icons. Alternatively, many icons may be inserted and placed followed by editing as described below.
[0160] In a step 1103, the icons, representing pages, are linked to one another with lines or arrows to show how one may traverse from one display page to another display page during the execution of the application. To exit from a display page in an application, one may terminate the application, or invoke the display of a subsequent display page. In some cases, there may be no option regarding the next page to be displayed. In other cases, the next page to be displayed is conditional based on a user interface actuation and/or a server response. In other embodiments, the progression from one display page to another may be determined by time intervals. The properties to transition from one display page to another in an application can be set as described in connection with step 1106, below. A display page, other than an initial display page, is not an active part of an application unless it is linked to another display page as an exit criterion.
[0161] In step 1104, display pages are individually designed by inserting display components such as those listed in Table 4. Such display components may include, for example, text messages text boxes, bitmapped graphic images, icons, borders, etc... Many display components also have an associated selection of properties, for example, as listed in Table 4. These associated properties are selected in step 1105.
[0162] In step 1106, properties for each complete display page are selected. Such properties may include, for example, whether or not a page should be cached by a UI engine, exit criteria for a page, and others as described above. Exit criteria refer to which page to display next and upon what action to display which page next if the application step is conditional. In one embodiment, exit criteria as set by filling in table entries associating events with corresponding next display pages.
[0163] As apparent to one of ordinary skill in the art, the display page linking step 1103 may occur before, during, or after steps 1104 through 1106. For example, once pages are created 1102 they can be linked 1103 or modified 1104-1106 at any time. Additionally, pages may be deleted or new pages created, linked, and modified at any time.
[0164] Figure 20 illustrates an exemplary display page 200 for a display screen of a mobile communication device in an embodiment of the invention. Different types of display components, such as described in Table 4, are shown. For example, 1201 can be a bitmapped image, or an animated display made of sequentially displayed bitmapped images. In some cases, the images may be looped for the animation of a repetitive action (for example, to repetitively depict the character's winking). According to some embodiments, once started, an animation image sequence can be altered or replaced with another animation image sequence for a dynamic change. The "Travel Pal" text may also be a bitmap to accommodate a special logo font. The horizontal line under "Travel Pal," can be a bit map graphic in one embodiment. In another embodiment it can be represented as a vector drawn graphic element.
[0165] Item 1012 can be a formatted alphanumeric text box representing static data. Although the data is static, the data display need not be. For example, in some embodiments there may be repetitively flashing visual highlighting. In other embodiments, the static data may scroll horizontally or vertically.
[0166] Item 1203 can be a list of selectable items (corresponding to a selectable output criterion for a display page) with a cursor 1204 to indicate a user selection. The list may fit onto one display page, as shown, or it may be represented a box containing border icons to scroll horizontally and/or vertically. The selection icon is an arrow in the illustrated embodiment. Alternatively, other icons may be used such as bullet marks, check boxes, etc. For some embodiments, multiple list items may be selected. For other embodiments, the choice of list items may be exclusive.
[0167] Items 1205 and 1206 can represent dynamic content. For example item 1206 can be a formatted, continuously scrolling text box to display highway traffic data. A single traffic report may be locally cached and repetitively scrolled, until it is replaced by an updated report. In some embodiments certain transmitted data may contain triggers to stop scrolling, or to specially highlight a scrolling text box, for example, to indicate alert conditions. Item 1206 can be a formatted text box that is periodically updated, for example, to display the current time and/or temperature.
[0168] Other display components can link to native phone features to provide additional application interface capabilities for further applications. To list a few examples: (1) the Camera component can provide access to photographic images on a camera phone to enable a user to select and transmit a particular image to the server; (2) the Play Audio component can select and play a cached (on the phone) audio file on a phone; (3) the Play Streaming Audio component can invoke the playing of streaming audio from a server on a phone; (4) the Play Video component can select and play a cached (on the phone) video file on a phone; (5) the Play Streaming Video component can invoke the playing of streaming video from a server on a phone; (6) the Launch Browser component can launch a browser that is native to a phone; (7) the Save Ring Tone component can direct a phone to save an audio file to its native ring tone directory; (8) the Save Wallpaper component can direct a phone to save an image file to its native wallpaper directory; (9) the Address Book component can provide access to a native address book on a phone to enable a user to select and transmit an address book entry to the server; (10) the Calendar component can provide access to a native appointment calendar on a phone to enable a user to select and transmit an appointment calendar entry to the server; and (11) the Uplink Voice Clip component enables a user to select a voice memo recorded on a phone and transmit the voice memo to the server (for example, for subsequent, automatic speech recognition).
[0169] Alternative embodiments of display components to implement alternative display pages for alternative applications are readily apparent to one of ordinary skill in the art. Although the example embodiments described above have been composed of some visual display components as described below in Table 4, it is easily seen how other visual display components can also be used. Additionally Table 4 can be expanded to contain additional display components. This unlimited flexibility can easily support unlimited creativity for application developers.
[0170] Figure 21 shows a computer screen display of an embodiment of a software tool (sometimes referred to as SmartBuilder™, herein, for the sake of convenience and not to imply any loss of scope from the generic descriptions, herein) to create a rule set. The software tool can operate on a personal computer or on a workstation in a windows environment. The display is divided into five display panes 1301 through 1305. Display pane 1301 is pictured showing unique icons representing unique display pages 1306 through 1318 and arrows interrelating the display pages representing both conditional and non-conditional exit criteria, as discussed above. Display page icons can be added via a main operation button in display pane 1303, and repositioned using a mouse. In one embodiment, the following icons representing icons can be shown in display pane 1303: new document, open file, save file, image settings, page settings, default setting, screen width & height, deploy to server, download file from net address, and add screen. Interrelating arrows may be drawn from icon to icon by designating the icons using a mouse or, in another embodiment, they may be automatically generated by entering an exit criterion for a display page in a display page properties table.
[0171] Display pane 1302 list property settings for a display page corresponding to a display page icon in display pane 1301 that has been selected, for example, by a mouse click. Examples of display page property settings can include, for example: display page name, display page version, cache type, back button enablement, OK button enablement, home display page ID, time out, animation enablement, exit from application enablement, and user- defined menu items for user-defined exit criteria.
[0172] Display pane 1304 lists folders for root files and children of the root files in which the rule set is stored. As described above, a rule set may be stored as a single file, or for ease of development and maintenance, as a set of files in an associated hierarchical directory.
[0173] Display pane 1305 shows image set information, and rule set associations for image sets.
[0174] Figure 22 shows another computer screen display of an embodiment of a software tool to create a rule set. Display pane 1401 presents an image of an actual display page 1404 with its display components for editing. Display pane 1402 lists property settings for a selected display component of display page 1404. Examples of such display component properties include: component name, component type, LocX, LocY, width, height, text style, value type, language, border size, fill border, rolling support, panning, relative dynamic, focusable, font style, alignment, foreground color, background color, foreground focus color, background focus color border color, and others. In some embodiments, individual display component properties have associated drop-down lists for selecting one among a finite number of options. In other embodiments, individual display component properties are entered as text into associated text boxes.
[0175] In one embodiment, display pane 1403 includes mouse-selectable button icons for commands relating to the page display such as: save, add/remove, add label, add text box, add text area, add message area, add choice box, add choice group, add list, add image, add button image, add hotspot, add shapes, and others. In yet a further embodiment (not shown), images representing actual phone displays, after modification according to corresponding sets of meta rules, can be displayed for review.
[0176] Although the embodiment of a rule set comprising icons and relationships represented graphically has been described above, there is no requirement to show these elements in this manner and because in one embodiment a rule set can be an XML file or any other data format capable of defining rules, the rule set may be created in a text editor in this embodiment. The rule set (e.g. in a format such as HTML, XML, WML, etc...) can contain screen names background colors, button names, dimensions and labels and any image data or content data that is needed or useful for an application including the events that allow for traversing screens in the application (for example, exit information).
[0177] Table 3 presents an exemplary listing of an XML (extensible markup language) workflow in an embodiment of the invention. Line 1 of the listing describes the encoding of the XML. Line 2 of the listing describes the name of the workflow as "demo." Line 3 comprises an XML tag that surrounds a list of display pages or UI components. Line 4 is blank for ease of illustration. Line 5 comprises an XML tag that surrounds a block of XML that defines the "LOGIN" screen as described on line 6, along with a version identification of the "LOGIN" screen. The version identification is used in order to update the "LOGIN" screen on any mobile communication device that does not have the latest version. Other attributes are listed that determine the look and feel and functional settings for the UI component.
[0178] In addition, a Menu Component block is described on line 11 that generates a value of "OK" if the menu item is selected as shown on line 13. Line 18 shows that when "MENU.OK" is selected, the next UI component to be displayed is the "WELCOME" UI component. Line 25 is a condensed version of the "WELCOME" UI component the details of which are not listed for ease of Illustration. Line 29 comprises an XML tag that surrounds a block of XML that defines the "SPLASH" screen as described on line 30. The "SPLASH" UI component comprises two exit points defined on lines 34 and 38 that direct the flow of UI components to the "LOGIN" or "WELCOME" screens depending upon the value of the "CLOGIN" argument meaning that when the "SPLASH" UI component times out, if the "CLOGIN" value has been set then the next UI component that is shown is the "WELCOME" screen, and if the "CLOGIN" value has not been set, then the next UI component shown in the "LOGIN" screen. The "CLOGIN" value may be passed to the UI Engine from the server system as true after the user has logged in. The "CLOGIN" value may be kept in a session of the server and passed as a cookie back to the UI Engine, for example.
Table 3
<?xml version="1.0" encoding="utf-8"?>
<WorkFlowData BackColor="32896" Version="2" Name="demo" FlagColor="8388736"> <WorkFlowDisplay pageDataList>
<WorkFlowDisplay pageData LocX="124" ID="2" LocY="222" Name="LOGIN" Version="632297280888915648" CachingType=" 1 " IsBackButtonEnbaled="True"
BorderSize="0" FillBorder="Trae"
Timeθut="3"" ImageData="" Imageld=""
ForeGroundcolor="0"
BackGroundColor="l 6777215" BorderColor="l 6777215">
<MenuComponent ListType="" Name="MENU"
ComponentType=" 10" ... >
<WorkFlowValueList>
<WorkFlowStringData Value="OK" />
<WorkFlowValueList> </MenuComponent>
<WorkFlowExitData List>
<WorkFlowExitData SelectedItem="MENU.OK" Display page=" WELCOME" Display pageID="l" ArgName="" ArgValue="" Type="False"> <WorkFlowImageData ImageDataId="" BinaryData="" /> </WorkFlowExitData> </WorkFlowExitDataList> </WorkFlowDisplay pageData>
<WorkFlowDisplay pageData LocX="324" BD="1" LocY="65+ Name="WELCOME"
</WorkFlowDisplay pageData>
<WorkFlowDisplay pageData LocX="50" ID="O" LocY="50" Name="SPLASH" Version="632297280708756592" CachingType="l" IsBackButtonEnbaled="False" ...>
<WorkFlowExitDataList> <WorkFlowExitData SelectedItem="TIMEOUT" Displa page="LOGIN" Display pageID="2"
ArgName="CLOGIN" ArgValue="False"
Type="False"> <WorkFlowImageData
ImageDataId="" Binary Data="" /> </WorkFlowExitData> <WorkFlowExitData SelectedItem="TIMEOUT" Displa page="WELCOME" Display pageID="l"
ArgName="CLOGIN" ArgValue="True"
Type="False"> <WorkFlowImage Data
ImageDataId="" BinaryData="" /> </WorkFlowExitData> </WorkFlowExitDataList> </WorkFlowDisplay pageData>
</WorkFlowDisplay pageDataList> <FlagsDataList>
<WorkFlowCookieData Name="LOGIN" Type="0" /> </FlatsDataList> </WorkFlowData>
[0179] Rule sets are typically developed for specific applications, although, depending on the applications, there may be cross-application sharing. Meta rules, such as meta rules 405 described above with reference to Figure 4, can be used to translate a rule set for an application to a rule set that provides an improved user interface for specific types of client devices running that application. Meta rules can be selected based on carrier technology and ID, mobile communication device screen size, and mobile communication device ID, among other criteria. If no meta rules exist for a specific criterion, then default meta rules can be used or no meta rule is used.
[0180] For example, some meta rules may be wireless carrier (service) provider specific, such as adding a carrier's logo or other features in display screens that help brand the carrier. Of course, this example can be implemented using global content as described above. Other meta rules may depend on client device screen size in number of pixels by number of pixels. Such other meta rules may change font sizes or icon bit maps or number of displayed content items per display page on the basis of the client device screen size. Still other meta rules may depend on client features such as cache memory size, in which case a rule set could be adjusted to change caching and application response speed characteristics. Furthermore meta rules can block, generally or selectively, the transmission of advertising to a client. Additional meta rules can adapt rules to native phone features such as described above in connection with display components such as Camera, Play Audio, Play Streaming Audio, Play Video, Play Streaming Video, Launch Browser, Save Ring Tone, Save Wallpaper, Address Book, Calendar, Uplink Voice Clip, Currency Support, and Wakeup/Push Registry SMS. In such embodiments, the same meta rules can be applied to multiple rule sets representing multiple respective applications. Once a rule set has been translated by all appropriate meta rules, it can be subsequently processed for transmission to a client. Additional examples of meta rules are given below:
1. Select meta rules for a specific carrier, and if those meta rules are not found use the meta rules for a default carrier.
2. Select meta rules for a given client software operating system technology. If those meta rules are not found, use the meta rules for a default technology.
3. Select meta rules for a given client device type. If those meta rules are not found, use the meta rules for a default device type.
4. Select the meta rules for a given client screen size. If those meta rules are not found, use the ratios of the client's horizontal and vertical dimensions in pixels, to the respective horizontal and vertical dimensions in pixels of the reference screen assumed for the existing rule to scale selected display components in the in the existing rule. For example, a Best fit Ratio can be calculated as
Best Fit ratio ("BFR") = 2 - xjxr +yjyr where xc and>>c are the horizontal and vertical dimensions in pixels, respectively, of a client's screen, and xr and yr are the horizontal and vertical dimensions in pixels, respectively, of the reference screen from the rule set. Use the BFR that is closest to zero as the best scaling factor for this screen size.
5. If the device screen is not same as the workflow screen size use the following meta rule: a. Zoom based upon screen ratio for components that has relative flag=false and type is not equal to Image or Image Button b. For Image or Image button use a best fit image set. Best fit image set is calculated using the Best Fit Ratio (BFR) as above 6. For the following devices modify the workflow rules a. If it is Motorola device (Motorola v260, Motorola V262, Motorola V265) use plain font only b. For all other Motorola phone change small fonts to medium fonts c. For treoόOO change keymapper type to ASCII
[0181] Furthermore, meta rules can also be applied to other meta rules for the specific implementation of policies for meta rules according to factors such as country, language, carrier, and type of phone — to name a few. Such meta rules for application to other meta rules can be termed "policy" meta rules. In such cases policy meta rules can be applied to meta rules for rules, and different sets of meta rules for rules without the need to manually adapt each different set of meta rules. In still further embodiments, higher level meta rules can be developed for application to sets of policy meta rules, and even higher level meta rules could be developed and applied to sets of the higher level meta rules, and so forth. Such embodiments can enable the modification of rule sets for an unlimited number of deployment scenarios with vastly reduced development cost and time.
[0182] The above meta rules are exemplary and, after reading this description, modifications, additions, substitutions, and deletions are readily accomplished by one of ordinary skill in the art.
[0183] Figure 23 describes an exemplary server hardware implementation 108 of an embodiment of the invention. Server software and data is stored in memory 1504 that is accessed by control logic 1502 to perform methods of the embodiments. Memory 1504 also stores rule sets and meta rules. Memory 1504 may be one or more of any conventional computer memory types as are well known to those of ordinary skill in the art. Control logic 1502 can be implemented using a variety of commercial or custom server processors as are also well known to those of ordinary skill in the art. Modems 1501 and 1503 enable communication with a client 102 and a content provider 111, respectively, and are also well known to those of ordinary skill in the arts of computer networking and wireless communication systems.
[0184] Figure 24 illustrates an exemplary implementation of client device in accordance with one embodiment of the invention. The example provided in Figure 16 illustrates operable linkages of control logic 1601, memory 1602, UI input device 608, and display 605. Memory 1602 is typically random access memory, and may be implemented in volatile and/or nonvolatile integrated circuit technologies and is used to store data such as display pages and global data. The control logic 1601 can be a CMOS IC that implements microcontroller functions for the mobile communication device 102 (or other client functions or features), in addition to digital signal processing and data processing, as are well known in the art. The UI engine can execute on control logic 1601.
[0185] Processor 403 process inputs from UI input device 406 and/or server 108, to generate outputs for display via UI output device 605, using data from memory 1602 and/or from server 108. UI output device 605 serves as a way to send data to a user. Examples of UI output device 605 include electronic display screens (such as light emitting diode, LED, or liquid crystal display, LCD), visual annunciators such as LEDs or other type of lamps, sound emitters such as speakers or buzzers, and tactile stimulators, such as vibrators. UI input device 406 provides a means for users to input data to the mobile communication device. Examples of UI input devices 608 include keypads, touch screens, and other types of tactile or audio sensors.
[0186] Table 4 list examples of visual display component along with their respective descriptions and parameter options. A display page is itself a display component that consists of other, lower-level, display component. A variety of lower-level display components are listed that can accommodate the composition of a creative variety of client applications. In Table 4, WAP refers to the Wireless Access Protocol Standard of the Open Mobile Alliance, 4275 Executive Square, Suite 240, La Jolla, Ca 92037. Also in Table 4, "focusable" is synonymous with selectable. It is the act of making a display component selected for editing, rather than moving between components. For example, when a text component is focused, a cursor can appear.
Table 4
Display Components
Name: Description: Parameters
Display page a screen display in an 1) Name - name of the display page application
2) Version - version id of the display page
3) Caching type - different types of caching : Name: Description: Parameters
-dynamic ~ no caching, -caching - cached for the session, -store - cached permanently, -back caching -cached during the back operation
4) Back button - whether the back button is enabled
5) Round border - whether the display page has round border
6) Ok button Height - whether the OK button is enabled
7) Home - whether or not the home button is enabled
8) Time Out - whether is timeout to a another display page automatically
9) Show animate — shows animation during a network call
10) Exit enabled — whether exit button is enabled
11) Menu items - options for user to select
12)Keymapper — type of key set used (normal dialing pad or ASCII)
Label a single line of text 1) Name - name of the component
2) Type - What type of component it is
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Text Style - style of the component (plain, bold, small, large, medium, .. ,) Name: Description: Parameters
8) Value type - redundant
9) Language - English or other natural language
10) Fill border - whether has a border
11) Border Size - border size
12) Rolling support - circular, back and forth, reset, or no rolling for scrolling options
13) Panning - whether or not panning is supported
14) Relative - if screen size changes do we need to scale accordingly
15) Dynamic - is the content dynamic?
16) Focusable - whether or not the component can be focused (i.e. visually highlighted, usually upon selection)
17) Font Style - proportional, system, or other styles
18) Alignment - right, left, top, bottom
19) Foreground color - foreground color
20) Background color - background color
21) Foreground focus color - foreground color when focused
22) Background focus color - background color when focused
23) Border color - border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP Name: Description: Parameters
26) WAP column ID - component column for WAP
27) Value - data for the label
Text Field a box for user entry of 1) Name - name of the component a single line of data
2) Type - component type
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - component width
6) Height - component height
7) Text Style - plain, bold, small, large, medium,...
8) Value type - redundant
9) Language - English or other natural language
10) Fill border — whether has a border
11) Border Size - border size
12) Rolling support — circular, back and forth, reset, or no rolling
13) Panning - whether or not panning is supported
14) Relative - if screen size changes do we need to scale the display component accordingly?
15) Dynamic - is the content dynamic?
16) Focusable - whether or not the component can be focused
17) Font Style - proportional, system or other styles
18) Alignment - right, left, top, bottom, center, ... Name: Description: Parameters
19) Foreground color - foreground color
20) Background color - background color
21) Foreground focus color - foreground color when focused
22) Background focus color - background color when focused
23) Border color — border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column for WAP
27) Text Field type - type of text field (anything, number, alphanumeric, email, alphabet, small alphabet, password)
28) Text field can be empty? - whether text field can be empty
29) Maximum size - maximum size of the text field size
30) Value - data for the label
Text Area a scrollable box for 1 ) Name — name of the component user entry of multiple lines of data 2) Type - what type of component it is
3) LocationX - starting X coordinate
4) LocationY — starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Text Style — style of the component (plain, bold, small, large, medium) Name: Description: Parameters
8) Value type - redundant
9) Language - English or other natural language
10) Fill border - whether has a border
11) Border Size - border size
12) Rolling support — circular, back and forth, reset, or no rolling
13) Panning — whether or not panning is supported
14) Relative - if the screen size changes do we need to scale display component accordingly
15) Dynamic — is the content dynamic?
16) Focusable - whether the component can be focused
17) Font Style - proportional, system, or other styles
18) Alignment - right, left, top, or bottom aligned
19) Foreground color - foreground color
20) Background color - background color
21) Foreground focus color - foreground color when focused
22) Background focus color - background color when focused
23) Border color — border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column Name: Description: Parameters for WAP
27) Maximum size - maximum size of the text field size
28) Value - data for the label
Message Area a scrollable text 1 ) Name - name of the component display box
2) Type - what type of component it is
3) LocationX - starting X coordinate
4) Location Y- starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Text Style - style of the component (plain, bold, small, large, medium,...)
8) Value type - redundant
9) Language - English or other natural language
10) Fill border - whether has a border
11) Border Size - border size
12) Rolling support - circular, back and forth, reset, or no rolling
13) Panning - whether or not panning is supported
14) Relative - if screen size changes do we need to scale the display component accordingly?
15) Dynamic - is the content dynamic?
16) Focusable — whether or not the component can be focused
17) Font Style - proportional, system or other styles
18) Alignment - right, left, top, bottom, Name: Description: Parameters center, ...
19) Foreground color - foreground color
20) Background color - background color
21) Foreground focus color - foreground color when focused
22) Background focus color - background color when focused
23) Border color - border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column for WAP
27) Value - data for the label
Choice Box an icon that can be 1) Name — name of the component selected by a user to indicate a choice from 2) Type - what type of component it is a list of choices
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Text Style — Style of the component (plain, bold, small, large, medium,...)
8) 'Value type - redundant
9) Language — English or other natural language
10) Fill border — whether has a border
11) Border Size - border size
12) Rolling support - circular, back and Name: Description: Parameters forth, reset, or no rolling
13) Panning - whether or not panning is supported
14) Relative - if the screen size changes do we need to scale accordingly
15) Dynamic - is the content dynamic?
16) Focusable - Whether the component can be focused
17) Font Style - proportional, system, or other styles
18) Alignment - right, left, top, bottom, centered, ...
19) Foreground color — foreground color
20) Background color - background color
21) Foreground focus color - foreground color when focused
22) Background focus color - background color when focused
23) Border color - border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column for WAP
27) Items - list of values
28) Default selection - the default selection of the choice box
29) Arrange - whether to arrange text items alphabetically or not
Choice Group a group of options 1) Name - name of the component Name: Description: Parameters with, each with a 2) Type - What type of component it is selection status display 3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Text Style - Style of the component (plain, bold, small, large, medium,...)
8) Value type - redundant
9) Language - English or other natural language
10) Fill border - whether has a border
11) Border Size - border size
12) Rolling support ~ circular, back and forth, reset, or no rolling
13) Panning - whether supports panning or not
14) Relative — if screen size changes do we need to scale the display component accordingly?
15) Dynamic — Is the content dynamic?
16) Focusable - Whether the component can be focused
17) Font Style - proportional, system, or other styles
18) Alignment — right, left, top, bottom, center, ...
19) Foreground color - foreground color
20) Background color - background color
21) Foreground focus color — foreground color when focused Name: Description: Parameters
22) Background focus color - background color when focused
23) Border color - border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column for WAP
27) Number of selection - maximum number of selections allowed
28) Pairvalues - items having an associated selected or a non selected state
List a list of items from 1) Name - name of the component which a user may make a selection 2) Type - What type of component it is
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height — height of component
7) Text Style - style of the component (plain, bold, small, large, medium,...)
8) Value type - redundant
9) Language - English or other natural language
10) Fill border - whether has a border
11) Border Size — border size
12) Rolling support - circular, back and forth, reset, or no rolling
13) Panning - whether or not panning is Name: Description: Parameters supported
14) Relative - if screen size changes do we scale display component accordingly?
15) Dynamic - is the content is determined dynamically?
16) Focusable - whether the component can be focused
17) Font Style - proportional, system or other styles
18) Alignment - right, left, top, bottom, centered,...
19) Foreground color - foreground color
20) Background color - background color
21) Foreground focus color — foreground color when focused
22) Background focus color — background color when focused
23) Border color - border color
24) Border focus color — border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column for WAP
27) Scroll color — color of the scrolling bar
28) Action to activate - what type of action to activate when a user selects it (e.g. data call, voice call, SMS, ring tone, wallpaper,... )
29) ListType — type of list (image, complex, static, dynamic,...) Name: Description: Parameters
30) Is continues - whether or not the list is continuous
31) Auto Fire - fire event is enabled when a item is selected or not (a fire event is a timing critical event, such as a call to a server)
32) Exit point - whether continuous exit point are in list or not
33) Items - list items
Image a bitmapped image 1 ) Name - name of the component
2) Type - what type of component it is
3) LocationX — starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height — height of component
7) Fill border - whether has a border
8) Border Size — border size
9) Rolling support ~ circular, back and forth, reset or no rolling
10) Panning - whether or not panning is supported
11) Relative - if screen size changes do we need to scale the display component accordingly?
12) Dynamic - is the content dynamic?
13) Focusable - whether the component can be focused
14) Alignment - right, left, top, bottom, center, ... Name: Description: Parameters
15) Background color - background color
16) Background focus color - background color when focused
17) Border color - border color
18) Border focus color - border color when focused
19) WAP row ID - component row for WAP
20) WAP column ID — component column for WAP
21) Image — image name
22) Photo album - whether it is part of a photo album or not
Background a semi-transparent 1 ) Name - name of the component Image bitmapped image
2) Type - what type of component it is
3) LocationX - starting X coordinate
4) LocationY — starting Y coordinate
5) Width — width of component
6) Height - height of component
7) Fill border — whether has a border
8) Border Size - border size
9) Rolling support ~ circular, back and forth, reset or no rolling
10) Panning - whether or not panning is supported
11) Relative - if screen size changes do we need to scale the display component accordingly?
12) Dynamic — is the content dynamic? Name: Description: Parameters
13) Focusable - whether the component can be focused
14) Alignment - right, left, top, bottom, center, ...
15) Background color - background color
16) Background focus color - background color when focused
17) Border color — border color
18) Border focus color - border color when focused
19) WAP row ID - component row for WAP
20) WAP column ID - component column for WAP
21) Image - image name
22) Photo album — whether it is part of a photo album or not
Button Image a pair of images: one 1) Name - name of the component focused, the other blurred 2) Type — what type of component it is
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Fill border - whether has a border
8) Border Size - border size
9) Rolling support — circular, back and forth, reset, or no rolling
10) Panning — whether or not panning is supported Name: Description: Parameters
11) Relative — if screen size changes do we need to zoom
12) Dynamic — is the content dynamic?
13) Focusable - whether or not the component can be focused
14) Alignment - right, left, top, bottom, center, ...
15) Background color - background color
16) Background focus color - background color when focused
17) Border color - border color
18) Border focus color — border color when focused
19) WAP row ID — component row for WAP
20) WAP column ID - component column for WAP
21) Image - image name
22) Focuslmage - image name when focused
Hotspot component with 1) Name — name of the component images from which user may select one 2) Type - what type of component it is
3) LocationX - starting X coordinate
4) LocationY — starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Text Style - Style of the component (plain, bold, small, large, medium, ...)
8) Value type — redundant Name: Description: Parameters
9) Language - English or other national language
10) Fill border - whether has a border
11) Border Size — border size
12) Rolling support — Circular, back and forth, reset or no rolling
13) Panning — whether or not panning is supported
14) Relative - if screen size changes do we need to zoom
15) Dynamic - is the content dynamic?
16) Focusable - whether or not the component can be focused
17) Font Style - proportional, system, or other styles
18) Alignment - right, left, top, bottom, center, ...
19) Foreground color - foreground color
20) Background color — background color
21) Foreground focus color - foreground color when focused
22) Background focus color - background color when focused
23) Border color - border color
24) Border focus color - border color when focused
25) WAP row ID - component row for WAP
26) WAP column ID - component column for WAP
27) Exit points - list the image items Name: Description: Parameters corresponding to next display screen selections
Circle a vector drawn circle 1) Name - name of the component
2) Type - what type of component it is
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Fill background - whether to fill or not
8) Round rectangle - whether borders are rounded or not
9) Foreground color — foreground color
10) Background color - background color
Square a vector drawn 1) Name — name of the component rectangle
2) Type - what type of component it is
3) LocationX — starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
T) Fill background — whether to fill or not
8) Round rectangle - whether borders are rounded or not
9) Foreground color - foreground color
10) Background color — background
Line a vector drawn line 1) Name - name of the component Name: Description: Parameters
2) Type - What type of component it is
3) LocationX - starting X coordinate
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
7) Foreground color - foreground color
8) Background color - background
Camera provides access to 1 ) Name - name of the component photographic images on a camera phone to 2) Type — what type of component it is enable a user to select and transmit an image 3) LocationX - starting X coordinate to the server
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height — height of component
Play Audio selects and invokes 1) Name - name of the component the playing of a cached (on the phone) 2) Type — what type of component it is audio file on a phone
3) Sequence - play sequence
Play Streaming invokes the playing of 1) Name — name of the component Audio streaming audio from a server on a phone 2) Type - what type of component it is
3) URL - UrI value
Play Video selects and invokes 1 ) Name - name of the component the playing of a cached (on the phone) 2) Type - what type of component it video file on a phone is
3) Sequence - play sequence
Play Streaming invokes the playing of 1 ) Name - name of the component Video streaming video from a server on a phone 2) Type — what type of component it is Name: Description: Parameters
3) URL - UrI value
Launch launches a browser 1) Name - name of the component
Browser that is native to a phone 2) Type - what type of component it is
3) URL - uniform resource location value?
Save Ring Tone directs a phone to 1) Name — name of the component save an audio file to its native ring tone 2) Type - what type of component it is directory
3) Datald - Ringtone Content
Save Wallpaper directs a phone to 1) Name - name of the component save an image file to its native wallpaper 2) Type - what type of component it is directory
3) Datald - Wallpaper Content
Address Book provides access to a 1) Name — name of the component native address book on a phone enabling a 2) Type - what type of component it is user to select and transmit an address 3) LocationX - starting X coordinate book entry to the server 4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
Calendar provides access to a 1 ) Name — name of the component native appointment calendar on a phone 2) Type - what type of component it is enabling a user to select and transmit an 3) LocationX — starting X coordinate appointment calendar entry to the server 4) LocationY - starting Y coordinate
5) Width - width of component
6) Height - height of component
Uplink Voice enables a user to 1 ) Name — name of the component Clip select a voice memo recorded on a phone 2) Type - what type of component it is and transmits the Name: Description: Parameters voice memo to the 3) Locationχ _ starting X coordinate server
4) LocationY - starting Y coordinate
5) Width - width of component
6) Height — height of component
[0187] Table 4 is but one example of definitions of user interface components corresponding to one embodiment of the invention. Other embodiments of the invention can use other definitions of user interface components without impacting the overall performance of the invention, as readily apparent to one of ordinary skill in the art.
[0188] While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not of limitation. Thus the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents. Additionally, the invention is described above in terms of various exemplary embodiments and implementations. It should be understood that the various features and functionality described in one or more of the individual embodiments are not limited in their applicability to the particular embodiment with which they are described, but instead can be applied, alone or in some combination, to one or more of the other embodiments of the invention, whether or not such embodiments are described and whether or not such features are presented as being a part of a described embodiment.
[0189] Terms and phrases used in this document, and variations thereof, unless otherwise expressly stated, should be construed as open ended as opposed to limiting. As examples of the foregoing: the term "including" should be read as mean "including, without limitation" or the like; the term "example" is used to provide exemplary instances of the item in discussion, not an exhaustive or limiting list thereof; and adjectives like "conventional," "traditional," "normal," "standard," and terms of similar meaning should not be construed as limiting the item described to a given time period or to an item available as of a given time, but instead should be read to encompass conventional, traditional, normal, or standard technologies that may be available now or at any time in the future. Likewise, a group of items linked with the conjunction "and" should not be read as requiring that each and every one of those items be present in the grouping, but rather should be read as "and/or" unless expressly stated otherwise.
[0190] Additionally, the various embodiments set forth herein are described in terms of exemplary block diagrams, flow charts and other illustrations. As will become apparent to one of ordinary skill in the art after reading this document, the illustrated embodiments and their various alternatives can be implemented without confinement to the illustrated examples. For example, block diagrams and their accompanying description should not be construed as mandating a particular architecture or configuration. Indeed, alternative functional, logical or physical partitioning can be implemented to achieve the desired features and functionality of the present invention. Additionally, a multitude of different constituent module names other than those depicted herein can be applied to the various partitions. As an additional example, with regard to flow diagrams and their accompanying description, the order in which steps may be set forth shall not be interpreted as requiring that the operations take place in that particular order unless the context dictates otherwise.

Claims

Claims
1. A method for determining a data format handling capability of a client by a first server in a client-server system, comprising: receiving a data packet that was transmitted by the client at the first server, the data packet having a data packet header comprising indicia designating the type of client that transmitted the data packet; correlating the indicia with one of a plurality of stored indicia, each stored indicia having a corresponding stored data format handling capability indication for a type of client; and selecting the most correlated data format handling capability as the data format handled by the client.
2. The method of claim 1 , further comprising translating the data format of the received data packet from the data format handled by the client to a second data format, and transmitting the translated data packet to a second server.
3. The method of claim 2, further comprising receiving an application content data packet in the second data format from a third server, translating the application content data packet to the data format handled by the client, and transmitting the translated application content data packet to the client.
4. The method of claim 2, wherein the data format handling capability of the client comprises on of the set of data formats consisting of WML and xHTML, and the second data format comprises HTTP.
5. A method for modifying a meta rule for a rule set based application in a client-server system, comprising translating a meta rule according to a first policy meta rule.
6. The method of claim 5 wherein the meta rule comprises one of a plurality of meta rules that are translated according to the first policy meta rule.
7. The method of claim 5, wherein the policy meta rule comprises one of a plurality of policy meta rules used to translate the meta rule.
8. A method of controlling a native application of a mobile terminal, by a client residing on the mobile terminal, of a client-server based application, the method comprising: invoking the execution of the native application; and transferring control data to the native application; and terminating the execution of the native application, responsive to the received data.
9. The method of claim 8, wherein the native application plays an audio file that is stored on the mobile terminal.
10. The method of claim 8, wherein the native application plays a streaming audio file that is received by the mobile terminal.
11. The method of claim 8, wherein the native application plays a video file that is stored on the mobile terminal.
12. The method of claim 8, wherein the native application plays a streaming video file that is received by the mobile terminal.
13. The method of claim 8, wherein the native application is an Internet browser.
14. The method of claim 8, further comprising receiving data from the native application and transmitting the received data to a server of the client-server based application.
15. The method of claim 14, wherein the native application is an audio recorder and the received data is an audio recording.
16. The method of claim 14, wherein the native application selects an image from one of a plurality of images stored on the mobile terminal and the received data is an image file.
17. The method of claim 14, wherein the native application comprises an address book, and the received data comprises an address book entry.
18. The method of claim 14, wherein the native application comprises a calendar of events, and the received data comprises a calendar of events entry.
19. A method for a client of a client-server based application, the client residing on a mobile terminal, to modify a data file residing on the mobile terminal, the data file for use by a native application of the mobile terminal, the method comprising: receiving data from a server of the client-server based application, the data comprising a native application designation and data content; and storing at least a portion of the received data in an area of the physical memory corresponding to the designated native application.
20. The method of claim 19, wherein the designated native application plays ring tones.
21. The method of claim 20, wherein the designated native application displays background images for other applications.
PCT/US2006/021185 2005-05-31 2006-05-31 System and method for flexible user interfaces WO2006130727A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US68612905P 2005-05-31 2005-05-31
US60/686,129 2005-05-31
US11/151,798 2005-06-13
US11/151,798 US20060077941A1 (en) 2004-09-20 2005-06-13 User interface system and method for implementation on multiple types of clients

Publications (2)

Publication Number Publication Date
WO2006130727A2 true WO2006130727A2 (en) 2006-12-07
WO2006130727A3 WO2006130727A3 (en) 2007-05-03

Family

ID=37482297

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/021185 WO2006130727A2 (en) 2005-05-31 2006-05-31 System and method for flexible user interfaces

Country Status (1)

Country Link
WO (1) WO2006130727A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008139469A1 (en) * 2007-05-13 2008-11-20 C-Nario Method and device for accessing data in signage systems
EP3346720A3 (en) * 2016-12-07 2018-07-18 Alticast Corporation System for providing cloud-based user interfaces and method therefor

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020019854A1 (en) * 2000-06-30 2002-02-14 Miklos Sagi Method of accessing remote data
US6633314B1 (en) * 2000-02-02 2003-10-14 Raja Tuli Portable high speed internet device integrating cellular telephone and palm top computer

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6633314B1 (en) * 2000-02-02 2003-10-14 Raja Tuli Portable high speed internet device integrating cellular telephone and palm top computer
US20020019854A1 (en) * 2000-06-30 2002-02-14 Miklos Sagi Method of accessing remote data

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008139469A1 (en) * 2007-05-13 2008-11-20 C-Nario Method and device for accessing data in signage systems
EP3346720A3 (en) * 2016-12-07 2018-07-18 Alticast Corporation System for providing cloud-based user interfaces and method therefor
US10499089B2 (en) 2016-12-07 2019-12-03 Alticast Corporation System for providing cloud-based user interfaces and method therefor

Also Published As

Publication number Publication date
WO2006130727A3 (en) 2007-05-03

Similar Documents

Publication Publication Date Title
US20070061488A1 (en) System and method for flexible user interfaces
US20060077941A1 (en) User interface system and method for implementation on multiple types of clients
US10200322B1 (en) Methods for responding to an email message by call from a mobile device
US9497147B2 (en) Systems and methods for supporting downloadable applications on a portable client device
US8949361B2 (en) Methods for truncating attachments for mobile devices
US9319360B2 (en) Systems and methods for prefetching relevant information for responsive mobile email applications
US7934162B2 (en) Running state migration of platform specific graphical user interface widgets between heterogeneous device platforms
KR100874985B1 (en) Web server
US8543927B1 (en) Methods for simulating icon popout on memory constrained devices
US7392483B2 (en) Transformation of platform specific graphical user interface widgets migrated between heterogeneous device platforms
US20190034187A1 (en) Systems and methods for application program and application program update deployment to a mobile device
US7895522B2 (en) Layout of platform specific graphical user interface widgets migrated between heterogeneous device platforms
US7970437B2 (en) Wireless terminal device with user interaction system
US6356543B2 (en) Controlling mobile phone system user views from the world-wide web
US7234111B2 (en) Dynamic adaptation of GUI presentations to heterogeneous device platforms
US9678933B1 (en) Methods for auto-completing contact entry on mobile devices
US20050208930A1 (en) Method and apparatus for arranging network content on mobile devices
US20030063120A1 (en) Scalable graphical user interface architecture
US20050015772A1 (en) Method and system for device specific application optimization via a portal server
US7607100B2 (en) Method, system and program product for display management of web page phone/fax numbers by a data processing system
US20080046557A1 (en) Method and system for designing, implementing, and managing client applications on mobile devices
US20050198353A1 (en) Method and apparatus for providing dynamic network content to target devices
JP2004213664A (en) Template-based customization of user interface for message application program
CN100444108C (en) System and method for executing wireless applications using common UI components from a UI repository
US20010018703A1 (en) Client server system and communication method thereof

Legal Events

Date Code Title Description
NENP Non-entry into the national phase in:

Ref country code: DE

NENP Non-entry into the national phase in:

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 06771775

Country of ref document: EP

Kind code of ref document: A2