System and method for an extendable mobile communications device user interface

[0001] This application claims priority from and is related to the following prior application: System and Method for an Extendable Mobile Communications Device User Interface, U.S. Provisional Application No. 60/215,605, filed Jun. 30, 2000. This prior application, including the entire written description and drawing figures, is hereby incorporated into the present application by reference.

[0002] 1. Field of the Invention

[0003] This invention relates generally to a software interface for a mobile device. More particularly, the invention provides an extendable software interface enabling forward compatibility in a mobile device, such that new applications may be easily integrated into the mobile device. This invention is particularly well-suited for use in Personal Digital Assistants, mobile communication devices, cellular phones, and wireless two-way email communication devices (collectively referred to herein as “mobile devices”).

[0004] 2. Description of the Related Art

[0005] Typical mobile device interfaces are constrained by resource limitations on the mobile device as compared to those of a desktop system. As a result of these constraints, known mobile device interfaces are generally either hard-wired or hard-coded. In either case, the known mobile device interfaces are immutable once the mobile device has been manufactured. For instance, in a hard-wired mobile device, physical components, such as push buttons and displays, are generally integrated into a user interface by control logic wired into a printed circuit board. Consequently, a hard-wired mobile device is not capable of being upgraded to support new applications. In a hard-coded mobile device, a programmable device is typically used for the control logic, and the user interface is generally controlled by the firmware and/or operating system of the mobile device. New applications can generally be added to a hard-coded mobile device, but this process typically involves replacing or upgrading the interface software, which often involves a risk of breaking compatibility with legacy features of the mobile device. In addition, neither hard-wired nor hard-coded mobile devices typically allow a user to seamlessly interface between an application program and data types associated with other application programs.

[0006] A system and method for an extendable software interface includes a software architecture for use in a mobile device having a processor and a memory device. The software architecture comprises a plurality of application programs stored in the memory device and executed by the processor, and at least one controller module for interfacing the plurality of application programs with a one of a plurality of data objects stored in the memory device in the form of a data model. Each controller module utilizes one or more generic interfaces with the plurality of application programs, and also utilizes a specific interface with the data model.

[0016] Referring now to the drawing figures, FIG. 1 is a block diagram showing a mobile device 10 with an exemplary extendable software interface. The mobile device comprises a processor 12 coupled to a system memory 14, an input device 20, a display 22, and a transceiver 24. Within the system memory 16 is an operating system 26 that includes a virtual machine 28. The virtual machine 28 operates using two types of software modules, controllers 30 and data models 32, that interface with application programs 34 through a plurality of generic interfaces 18.

[0017] Operationally, the software interface of the mobile device 10 is extended using the software modules 30 and 32, and the generic interfaces 18. The software modules 30 and 32 are executed by the virtual machine 28, which is preferably an object oriented run-time environment such as Sun Micro System's J2ME (JAVA® 2 Micro Edition). The software modules 30 and 32 are preferably constructed using a JAVA® compiler capable of enforcing a software application interoperation architecture that takes on the form of a collection of compiled classes and objects along with an application programming interface (API).

[0018] Data models 32 are classes that represent the various types of data stored on the mobile device 10. The types of data may include, for example, e-mail messages, address book entries, calendar items, tasks, and memos. In addition, next-generation mobile devices may store data such as SMS messages, phone call logs, voice mail indicators, WAP requests, multiple e-mail sources, HTML content exchanges, specialized banking services, financial services, field server and customer service offerings, or downloads from corporate databases.

[0019] The data models 32 are preferably stored on the mobile device 10 in the form of Java objects for execution in the J2ME run time environment. Each data model 32 is designed for a particular type of data object, and includes specialized functions for retrieving information associated with the data type. For example, an e-mail message model may have specialized functions for retrieving the subject of the e-mail object and for retrieving the body of the e-mail object. A calendar entry model, on the other hand, may include specialized functions specific to a calendar entry object, such as a function capable of retrieving the duration of an appointment.

[0020] Each type of data model 32 has an associated controller 30 capable of interacting with the specific functions of the data model 32 type and representing the data model 32 in a uniform way to the rest of the software interface system. Operationally, the controllers 30 isolate the data models 32 from the application programs 34, and implement the generic interfaces 18 such that each controller 30 can be easily hosted by any application program 34 that supports the generic interfaces 18. In this manner, the controllers 30 present a common, standard interface to any application 34; and each application that supports the generic interfaces 18 is able to interact with any arbitrary controller 30. For example, an e-mail application using one or more of the generic interfaces 18 can interface with an address book controller to retrieve an e-mail address from an address book data model. Moreover, existing controllers 30 can be used to interface with any new applications supporting the generic interfaces 18. In this manner, a mobile device user is able to install new applications without having to upgrade his or her operating system 26 or interface software 28, and is able to interface the new applications with data objects already stored on the mobile device (e-mail, addresses, calendar entries, etc.) without having to perform data type conversions. The flexibility provided by the interoperability of the controllers 30 may also enable the mobile device user to expand the functionality of his or her mobile device 10 by interacting with third party applications, such as banking or other commercial services.

[0021] The interaction between an application program 34 and any arbitrary controller 30 is primarily made possible by generic interfaces 18 that are implemented by each controller 30. The generic interfaces 18 are generic in the sense that they are object-oriented as opposed to being specific to a certain type of data. Put another way, each generic interface 18 is preferably programmed to perform a certain operation regardless of the data type. Each application 34 is preferably programmed to query any controller 30 to determine if the controller 30 supports one or more generic interfaces 18 required to perform a given operation. If so, the application 34 then interacts with the controller 30 and its associated data model 32 to complete the operation. For instance, an application 34 may query a controller 30 to determine whether it supports a generic interface 18 capable of painting an object (such as the body of an e-mail message) onto a screen, and if so, then interface with the controller 30 to display the object. In this manner, the same type of generic interface 18 that is used by an application 34 to display the body of an e-mail message could also be used, for example, to display a clipping from a lengthy SMS message. In another example, the same generic interface 18 used to display the e-mail message may also be used to receive an e-mail address from an e-mail controller and interface with an address book application to paint the address into an address file. Preferably, new controllers could also be implemented that support new generic interfaces. Therefore, new controllers can easily be designed to interface with upgraded applications supporting new functions, and still be compatible with older applications as long as the new controller includes the older generic interfaces.

[0022] Three exemplary generic interfaces that may be implemented by a controller 30 are briefly described below. It should be understood, however, that these are just a few examples of the many types of generic interfaces that could be used within the system shown in FIG. 1.

• [0023] 1. PaintProvider—The Paint Provider interface supports painting a data model 32 into a given region of an application program 34. For example, this generic interface 18 could be used to instruct a controller to paint a data model into a list view. The PaintProvider interface may be implemented as follows:

[0024]

	public interface PaintProvider
	{
	void paint(Object model, Graphics g, int x, int y,
	int width, int height, Object context);
	}

• [0025] 2. FieldProvider—The FieldProvider interface enables a controller 30 to provide an application program 34 with a read-only or editable field from a data model 32. For instance, the FieldProvider interface may enable a data model 32 to be displayed in a list of fields, such as in the edit screen of an email message. The FieldProvider interface may be implemented as follows:

[0026]

	public interface FieldProvider
	{
	Field getField(Object model, Object context) throws
	NoFieldException;
	void grabDataFromField(Object model, Field field);
	}

• [0027] 3. VerbProvider—The VerbProvider interface enables a controller 30 to supply an array of “verbs” when a user selects an object associated with a data model 32. For instance, when a user positions a cursor over an object (such as a portion of text) associated with a particular data model, the VerbProvider interface may display a list of menu selections specific to that data model. The VerbProvider interface may be implemented as follows:

[0028]

	public interface VerbProvider
	{
	Verb [] getVerbs(Object model, Object context);
	Verb [] getDefaultVerb(Object model, Object context);
	}

[0029] FIG. 2 is a block diagram 40 illustrating the interaction between four exemplary controllers 42, 44, 46 and 48, and four exemplary data models 52, 54, 56 and 58. The exemplary controllers shown in the diagram 40 include an e-mail message controller 42, an SMS message controller 44, an address book card controller 46, and a calendar entry controller 48. Each exemplary controller 42, 44, 46, and 48 is unique to a data model type; respectively shown in the diagram 40 as an e-mail message 52, a SMS message 54, an address book card 56, and a calendar entry 58. The uniqueness of the controllers and their corresponding data models is illustrated by the varying shapes at the interface between each exemplary controller 42, 44, 46, and 48 and data model 52, 54, 56, and 58. In addition, each exemplary controller 42, 44, 46, and 48 includes three generic interfaces: Interface A 60, Interface B 62, and Interface C 64. Although every controller 42, 44, 46, and 48 is unique to a data model 52, 54, 56, and 58, the same generic interfaces 60, 62 and 64 are implemented universally throughout the software interface. Therefore, as discussed above with reference to FIG. 1, each exemplary controller 42, 44, 46, and 48 is able to interface with any application program that supports the generic interfaces 60, 62 and 64.

[0030] FIG. 3 is a block diagram 70 illustrating that multiple controllers 72, 74, 76 and 78 having generic interfaces 80, 82, and 84 can each interact with the same application program 86. For example, FIG. 3 shows an e-mail message controller 72, an SMS message controller 74, a voice mail indicator controller 76, and a third-party supplied controller 78. Each controller 72, 74, 76 and 78 includes the same three generic interfaces 80, 82 and 84, and thus all four controllers 72, 74, 76 and 78 are able to interact with the same application 86. In this manner, the interface software 28 remains consistent regardless of the data type being accessed. In addition, FIG. 3 demonstrates that a third-party may easily design a new controller 78 that is compatible with the existing software interface system by including the generic interfaces 80, 82 and 84 supported by the application program 86 and other applications on the system.

[0031] FIG. 4. is a block diagram 90 illustrating that controllers 92, 94, and 96 are singletons each capable of interfacing with multiple data models of the same type. As data entries or messages are received into the system, they are preferably entered into a persisted list of data objects that is included in, or assessable to, each application program 34. The persisted list should preferably identify a data model for each data object in the list. Since the same type of data model may often be associated with multiple data objects in the list, multiple instances of various data model software modules could be executing in the system at the same time. This is illustrated in FIG. 4 by the multiple instances of the e-mail message data models 98 and 100, the SMS message data models 102 and 104, and the voice mail indicator data models 106 and 108.

[0032] In a preferred embodiment, however, the persisted list should not identify a controller 92, 94 or 96 for each data object. Rather, the appropriate controller 92, 94 or 96 is preferably identified as some action is taken with a data model 98, 100, 102, 104, 106 or 108. When an application 34 needs to access a data model, the application 34 preferably (1) queries the data model for the correct controller, (2) calls the controller, and then (3) passes in the data model as a parameter. In this manner, the controllers 92, 94 and 96 are stateless objects such that only one instance of a controller 92, 94 or 96 is capable of handling all of the data models of a certain type that are executing in the system. For example, in FIG. 4 one instance of an e-mail message controller 92 interfaces with both instances of the e-mail message data model 98 and 100.

[0033] FIG. 5 is a block diagram 200 illustrating exemplary second-order controllers 210, 212 and 214 and second-order data models 218, 220 and 222. The controllers and data models illustrated in FIGS. 2 and 3 are examples of software modules designed to interface with first order objects, such as an e-mail message, an address book entry or a calendar item. In a preferred embodiment, however, the extendable software interface is also capable of interfacing with multiple objects within a first-order object, referred to herein as second-order objects. An example of a second-order object is an address that appears within the body of an e-mail message. In order to interface with a second-order object, the extendable software interface preferably utilizes second-order controllers that operate within a first-order controller. For instance, in FIG. 5 three second-order controllers 210, 212 and 214 are shown within an e-mail message controller 226. Each of the second-order controllers 210, 212 and 214 are preferably programmed to access a particular type of second-order object. FIG. 5 shows one exemplary method by which a second-order controller may access a second-order object. In this embodiment, a second-order data model 218, 220 or 222 is created for each type of second-order object. The second-order data models 218, 220 and 222 preferably operate within a first-order data model 228. In this manner, each second-order data model 218, 220 or 222 is programmed to access a particular type of information within a data type, thus enabling a second-order object to be manipulated by an application program 34 through the second-order controllers 210, 212 and 214. Examples illustrating the manipulation of second-order objects are detailed below with reference to FIGS. 7 and 8.

[0034] It should be understood, that the designation of a data object as first-order or second-order may depend on which application program and controller module is accessing the data object. For instance, an e-mail message data model may include an address book card data object as an attachment. If the e-mail message data model is accessed by an e-mail messaging application through e-mail message controller, then the e-mail message data object is the first-order object and the address book card data object is a second-order object because it is contained within the e-mail message data model. However, if the same address book card data object were accessed by an address book application through an address book card controller, then the address book card data object would be the first-order data object.

[0035] FIG. 6 is a block diagram showing an alternative embodiment 300 in which second-order objects are accessed with second-order controllers 302, 304 and 306 and a first-order data model 310. In this embodiment, the first-order data object is grouped by the virtual machine 28 in such a way that second-order data objects can be identified from within the first-order data model 310. This may be accomplished, for example, by grouping a first-order data object that includes multiple second-order data objects such that they appear to the system as essentially one immutable object. When the group is accessed by the virtual machine 28, however, each of the sub-pieces (second-order objects) of the group can be independently accessed. The second-order controllers 302, 304 and 306 are then programmed to identify the second-order data objects from within the data object grouping. In this manner, memory space on the system can be better utilized by eliminating the need for second-order data models.

[0036] FIG. 7 illustrates an implementation of the extendable software interface that adds functionality to an e-mail message application. In the embodiment shown in FIG. 7, the e-mail addresses appearing within three displayed e-mail messages 400 are action-linked. This may be accomplished, for example, by designing an e-mail message controller capable of (1) recognizing e-mail addresses as second-order objects, and (2) delegating the interface between the e-mail message application and the e-mail address to an object-specific, second-order e-mail address controller operating within the e-mail controller. The e-mail address controller should preferably be capable of retrieving e-mail addresses 410 from a first-order e-mail message model. Alternatively, specialized second-order e-mail address models may be constructed to operate within the e-mail message model and interact with the e-mail address controller. In either case, by defining e-mail addresses 410 as second-order objects, and designing interface software modules capable of retrieving the addresses 410 from within any portion of an e-mail message 400, an existing e-mail application is extended such that it can perform previously unavailable operations.

[0037] For instance, with reference to FIG. 7, when a mobile device user positions a cursor in the vicinity of the e-mail address “[email protected]” 410, the e-mail message controller preferably recognizes that the address 410 is a second-order object and calls the specialized second-order e-mail address controller. Through one of the generic interfaces, the e-mail address controller then preferably presents a list of functions 412 on a display of the mobile device that can be performed on the e-mail address 410. In addition, the function list 412 may preferably include operations involving other applications. For example, the function “Add Ulf to address book” may require the e-mail address controller to interface with an address book application. This seamless operation is possible because the generic interfaces enable the e-mail address controller to interface with multiple applications within the system.

[0038] FIG. 8 illustrates an implementation of the extendable software interface that adds third-party stock brokerage functions 500 to the e-mail message application. In this example, an e-mail message 510 sent from a stock broker includes action-linked stock quotations 512. In order to implement this example, the mobile device manufacturer, or preferably the third party, may design an e-mail message controller upgrade that adds second-order controllers that are specific to data objects typically found in an e-mail from a stock broker. With reference to the illustration, when a user positions a cursor in the vicinity of a stock quote or ticker symbol 512 in the e-mail message 510, the upgraded e-mail controller preferably (1) recognizes the quote or symbol 512 as a second-order object and (2) calls the object-specific second-order controller. The second-order controller then preferably presents a list of functions 500 to the e-mail message application that are capable of being performed on the object 512. In this example, the available functions are “SELL,” “BUY,” “Request more info,” and “Cancel.” If, for example, the user selects the “SELL” function from the list 500, then the second-order controller may be programmed to (1) instruct the e-mail application to create a new e-mail message, (2) paint the address “[email protected]” into the receiver line (the “To:” line) of the new message, (3) paint the address “[email protected]” into the sender line (the “From:” line) of the new message, and (4) paint the text “SELL” along with the second-order object “ALCN. TO 12.33-122.21” into the body portion of the new message. Significantly, none of these steps require an upgrade to the e-mail message application. Rather, the extendable software interface preferably enables additional functionality to be added to an existing application with only a simple upgrade to the application's controller.

[0039] FIG. 9 is a flow diagram showing an exemplary method 600 for adding functionality to an application operating on a mobile device by utilizing the extendable software interface. In step 610, one or more second-order objects are defined within the first-order data model associated with the application. For instance, in an e-mail message data model, second-order objects may be defined as described above with reference to FIGS. 7 and 8. It should be understood, however, that this method 600 is not limited to an e-mail messaging application, but may be utilized with any application operating on a mobile device. In step 620, the application data model containing the second-order objects is displayed by the application. As discussed above with reference to FIG. 1, the data model is preferably accessed by the application through generic interfaces and a first-order controller. Once the data is displayed, a mobile device user may preferably select a second-order object by positioning a cursor on, or in the vicinity of, the second-order object (step 630). Alternatively, the second-order object may be selected by any other means available on the mobile device, such as highlighting the object or touching the object with a stylus. When a second-order object is selected by the user, the first-order controller preferably (1) recognizes the object as a second-order object, and (2) calls a second-order controller that is specifically designed to access the second-order object (step 640).

[0040] In step 650, the second-order controller preferably provides a list of functions that may be performed on the second-order object. Once a function associated with a second-order object has been selected by the mobile device user (step 660), the second-order controller preferably establishes whether the function (1) relates to the current application, or (2) requires access to another application installed on the mobile device (step 670). For instance, if an address is selected as a second-order object within an e-mail message, then the user may be given the option to (1) insert the address into the “To:” line of a new message, or (2) insert the address into an address book. If the user chooses to compose a new message using the selected address in the “To:” line, then the second-order (address) controller preferably knows that the selected operation relates to the e-mail messaging application that is already executing. Then, the first and second-order controllers may interface with the currently executing application to perform the selected function (step 700). If, however, the user chooses to insert the object into an address book file, then the e-mail message controller and second-order address controller need access to an address book application before the function may be completed. Therefore, when another application installed on the mobile device is required to perform the selected function, the new application is preferably launched by either the first or second-order controller (step 680). Then, because the first and second-order applications utilize generic interfaces, both may interface with the new application to perform the selected function (steps 690 and 700).

[0041] The embodiments described herein are examples of structures, systems or methods having elements corresponding to the elements of the invention recited in the claims. This written description may enable those skilled in the art to make and use embodiments having alternative elements that likewise correspond to the elements of the invention recited in the claims. The intended scope of the invention thus includes other structures, systems or methods that do not differ from the literal language of the claims, and further includes other structures, systems or methods with insubstantial differences from the literal language of the claims.