System and method for automatically setting up a universal remote control

[0001] This application claims priority to and is a continuation-in-part of U.S. application Ser. No. 10/151,635, filed May 20, 2002, entitled System and Method For Automatically Setting Up A Universal Remote Control, which is a continuation-in-part of U.S. application Ser. No. 09/615,473, filed Jul. 13, 2000, entitled Customizable And Upgradeable Devices And Methods Related Thereto and U.S. application Ser. No. 09/334,584, filed Jun. 16, 1999, entitled Digital Interconnect Of Entertainment Equipment.

[0002] This invention relates generally to remote controls and, more particularly, to a system and method for automatically setting up a universal remote control to control the operation of one or more devices.

[0003] Universal remote controls used to control the operations of a number of various types of devices such as televisions, video cassette recorders (VCRs), cable boxes, disk players, digital video recorders (DVRs), thermostats, fans, HVAC equipment, etc. are known in the art. Examples of such remote controls can be seen in commonly assigned U.S. Pat. Nos. 5,255,313 and 5,552,917. In one method of setting up a universal remote control to communicate with a given device, command codes are manually learned from a remote control provided by the manufacturer of the given device (U.S. Pat. No. 4,623,887). In other methods of setting up a universal remote control, a user manually configures the universal remote control to select appropriate command codes from a command code library (U.S. Pat. Nos. 5,872,562, 5,614,906, 4,959,810, 4,774,511, and 4,703,359). These methods for manually setting up a universal remote control, however, have the problem of being demanding, exacting and generally frustrating for many users.

[0004] To overcome this and other problems, a system and method for configuring a remote control to command the operation of appliances, to capture demographic data, and to provide services, such as automated warranty registration, instructions, viewing guides, etc., relevant to the appliances is provided. The system includes a database and associated server that are located remotely from the remote control and accessible via a network connection. Command codes, graphical user interface elements, and services are accessible and downloadable to the remote control, as appropriate, using data supplied to the server that identifies the appliances and/or functional capabilities of the appliances. This data can be supplied by the user, by the appliances directly, or from other sources such as barcode labels, network devices, etc.

[0005] A better understanding of the objects, advantages, features, properties and relationships of the invention will be obtained from the following detailed description and accompanying drawings which set forth an illustrative embodiment and which are indicative of the various ways in which the principles of the invention may be employed.

[0006] For a better understanding of the invention, reference may be had to a preferred embodiment shown in the following drawings in which:

[0007] FIG. 1 is a block diagram view of an exemplary remote control;

[0008] FIG. 2 is a flow chart diagram of an exemplary method for sending a setup signal to the remote control;

[0009] FIG. 3 is a flow chart diagram of an exemplary setup method;

[0010] FIG. 4 illustrates exemplary setup signal data frames;

[0011] FIG. 5 illustrates an exemplary setup signal bit pattern;

[0012] FIG. 6 illustrates an exemplary setup signal frame format, bit format and subcarrier format using a burst-type modulation;

[0013] FIG. 7 is a flow chart diagram of an exemplary method to configure capabilities and key layouts of the remote control;

[0014] FIG. 8a and FIG. 8b illustrate exemplary listings of functions for a TV and VCR, respectively;

[0015] FIG. 9 illustrates an exemplary listing of functions grouped to provide a compact version of the respective functions;

[0016] FIGS. 10a-10d illustrate exemplary touch screen displays for four example device codes and resulting Graphical User Interfaces on the remote control;

[0017] FIG. 11 illustrates an exemplary table showing reserved numbering for indicating a new function;

[0018] FIG. 12 illustrates an exemplary data frame for transmitting configuration data;

[0019] FIG. 13 illustrates an exemplary method for retrieving device information from a centralized device database for use in the remote control;

[0020] FIGS. 14-19 illustrate exemplary systems and networks in which the principles of the invention may be employed; and

[0021] FIG. 20 illustrates an exemplary remote control application residing on a portable display device;

[0022] FIG. 21 illustrates an exemplary system and network using a portable display device to effect remote control of consumer entertainment appliances;

[0023] FIG. 22 presents a flow diagram illustrating an exemplary method for setting up a remote control residing on a portable display device; and

[0024] FIGS. 23-28 illustrate exemplary screen shots that further illustrate a method for setting up a remote control residing on a portable display device.

[0025] Turning now to the figures, wherein like reference numerals refer to like elements, exemplary systems and methods for setting up a remote control to control the operation of one or more devices are illustrated and described. The remote control may additionally be adapted to display information related to the operation of the one or more devices. In this regard, the devices can include, but are not limited to, televisions, VCRs, DVRs, DVD players, cable converter boxes, amplifiers, CD players, game consoles, home lighting, drapery, fans, HVAC systems, thermostats, personal computers, etc.

[0026] To perform these and other functions, the remote control 10 may include, as needed for a particular application, a processor 24 coupled to a ROM memory 26, a key matrix 28 (e.g., physical buttons, a touch screen display, or a combination thereof), an internal clock and timer 30, transmission circuit(s) 32, receiver circuit(s) 33 and/or transceiver circuit(s) (e.g., IR and/or RF), a non-volatile read/write memory 34, a means 36 to provide visual feedback to the user (e.g, LED, display, and/or the like), means 37 to provide audio feedback to the user (e.g., a speaker), a power supply 38, serial I/O port 42 (e.g., a jack or contacts), and a bar code scanner 44, as illustrated in FIG. 1. As will be understood by those of skill in the art, the ROM memory 26 includes executable instructions that are intended to be executed by the processor 24 to control the operation of the remote control 10. In this manner, the processor 24 may be programmed to control the various electronic components within the remote control 10, e.g., to monitor the power supply 38, to cause the transmission of signals, display icons and/or HTML pages, etc. The non-volatile read/write memory 34, for example an EEPROM, battery-backed up RAM, Smart Card, memory stick, or the like, is provided to store setup data and parameters as necessary. While the memory 26 is illustrated and described as a ROM memory, memory 26 can also be comprised of any type of readable media, such as ROM, RAM, SRAM, FLASH, EEPROM, or the like. Preferably, the memory 26 is non-volatile or battery-backed such that data is not required to be reloaded after battery changes. In addition, the memories 26 and 34 may take the form of a chip, a hard disk, a magnetic disk, and/or an optical disk.

[0027] To cause the remote control 10 to perform an action, the remote control 10 is adapted to be responsive to events, such as a sensed user interaction with the key matrix 28, receipt of a transmission, etc. In response to an event appropriate instructions within the memory 26 are executed. For example, when a command key is activated on the remote control 10, the remote control 10 may retrieve a command code corresponding to the activated command key from memory 26 and transmit the command code to a device in a format recognizable by the device. It will be appreciated that the instructions within the memory 26 can be used not only to cause the transmission of command codes and/or data to the devices but also to perform local operations. While not limiting, local operations that may be performed by the remote control 10 include displaying information/data, favorite channel setup, macro button setup, command function key relocation, etc. Since examples of local operations can be found in U.S. Pat. Nos. 5,481,256, 5,959,751, and 6,014,092 they will not be discussed in greater detail herein.

[0028] Additional examples of remote controls 10 may be found in commonly owned, U.S. Pat. No. 6,225,938 and U.S. application Ser. Nos. 60/264,767, 09/905,423, 09/905,432, and 09/905,396.

[0029] In one method for setting up the remote control 10 to communicate with a device, the remote control 10 and the device are provided with Device Activated Setup (hereinafter DAS) capabilities. Generally, in accordance with this method and as illustrated in FIG. 2, the DAS setup procedure may commence when the device is first plugged in which, in turn, causes the device to emit a DAS squawk signal. After transmitting the squawk signal, the device may monitor for a command, e.g., power on, transmitted from the remote control 10. If the device receives the command from the remote control 10, it may perform a function in accordance with the received command and, furthermore, cease the transmission of the squawk signal. If the device does not receive a command from the remote control 10, the device may check to see if a command has been received via its front panel and, if so, the device may perform the function corresponding to the entered command and, furthermore, cease transmission of the squawk signal. If the device does not receive a command via its front panel or via a remote control transmission, the device may continue to repeat this squawk process. Alternatively, the device need not check for the receipt of a command code but may be adapted to merely transmit the squawk signal a predetermined number of times or over a predetermined time duration before ceasing the transmission of the squawk signal. It should be appreciated that the sending of the squawk signal can also be initiated in response to the operation of one or more keys on the front panel of the device. Generally, the squawk signal includes data that functions to identify: a) the device type; and b) the remote control encoding format to which the device responds. The remote control encoding format to which the device responds could be indicated by data that is representative of the manufacturer (and sometime model number) of the device.

[0030] To setup the remote control 10, as illustrated in FIG. 3, a key on the remote control 10 can be actuated to generate an event which causes the processor 24 to place the remote control 10 in a receive mode to listen for a transmitted squawk signal. The actuation of the remote control 10 setup procedure can result from a predefined key depression/event or any key activation/event without limitation. If the remote control 10 detects a recognizable squawk signal, it proceeds to analyze the identification data embedded within the squawk signal. If the device type and requested transmission format are supported by the remote control 10, the processor 24 can commence executing a sequence of instructions to select those command codes from a command code library that will appropriately command operations of the squawking device. In addition, the remote control 10 may send one of the selected command codes to the squawking device for the purpose of acknowledging receipt of the squawk signal and ending the squawking procedure at the device. Thus, in this manner, the remote control unit 10 may be setup to communicate with the device. If the data in the squawk signal is not recognized by the remote control 10, i.e., communications with the device are not supported by the remote control 10, the remote control 10 may simply remain unchanged and continue to use its previous setup configuration. Alternatively, if the remote control 10 does not support communications with the device, the remote control 10 may access, as described hereinafter, a remote data repository to attempt to download configuration data that will allow the remote control 10 to be used to communicate with the device.

[0031] In a standard universal remote control, the user is often required to setup the remote control by: 1) looking up a designation number for a device in a code list supplied with the remote control; and 2) manually entering the looked-up designation number into the remote control. As becomes clear from the foregoing explanation, the squawk signal of the described system allows a device to automatically supply this designation number, or like type of designation information, to the remote control 10.

[0032] An exemplary data frame layout of a squawk signal is illustrated in FIG. 4a. In this regard, the data content of the squawk signal can be a 32 bit value having the following data fields:

[0033] Data field one8 bits used as a system identification to allow multiple versions of the system to co-exist without interfering with one another's settings.

[0034] Data field two4 bits used to identify a device type category such as, by way of example:

00	TV
01	VCR
02	Cassette tape
03	Laser disk
04	Digital audio tape
05	Cable box
06	Satellite IRD
07	Video Accessory
08	CD player
09	Amplifier
10	Tuner
11	Home automation
12	Misc. audio
13	Phonograph
14	DVD
15	Spare.

[0035] Data field three12 bits used to indicate a device designation number (e.g., a setup code usually indicative of the manufacturer and sometimes model number of the device).

[0036] Data field four8 bits used as a check sum byte (e.g., longitudinal parity of the preceding three bytes).

[0037] The data may be transmitted, most significant bit first, using a burst duration modulation scheme as follows:

[0038] Encoding: Burst duration modulation using amplitude shift keyed IR subcarrier.

[0039] Subcarrier: 40 KHz

[0040] Bit encoding: Basic time interval is t500 us (20 cycles of subcarrier). Burst times (nominal) are t and 2t. Gap times (nominal) are t and 2t.

[0041] Frame format: Bits per frame: 32

[0042] Preamble burst: 4.0 mS (8t)

[0043] Preamble gap: 4.0 mS (8t)

[0044] Interframe gap: 150 MS minimum

[0045] The encoded data stream may consist of alternating intervals of carrier and no carrier. The duration of each interval signals the value of the bit corresponding to that location. Ones are represented by short intervals, zeros are represented by long intervals. An example of the bit pattern for 1101001 may thus be encoded as shown in FIG. 5. The data frame layout is shown in FIG. 4a. Each data frame may be preceded by a preamble (pre) burst which consists of 4.0 mS of constant carrier, followed by a 4.0 mS gap that is followed, in turn, by a inter-frame gap of 150 mS during which time the transmitting device may monitor for a command transmitted in the format indicated by the data in the squawk signal. Note that the device can provide squawk signals alternating between a number of different device designation numbers if it is capable of supporting multiple transmission formats. It is to be appreciated that this encoding format is one implementation but other encoding schemes can be used to achieve the same result.

[0046] It will also be appreciated that the data payload may be extended to include additional information, e.g. appliance model or serial numbers where such information would be of use. As needed, appropriate adjustments may be made to frame timings, etc. to accommodate this additional data. By way of example, FIG. 4(b) illustrates a case where the data frame is extended to 48 bits to include an additional 16-bit field containing a unit serial number for use in automated warranty registration as will be described in more detail hereinafter. Other data formats and field assignments are also possible.

[0047] As is shown in FIG. 6, in the bit encoding scheme used, the minimum frame time (including the preamble burst) is 24.5 mS, while the maximum frame time is 40.5 mS. The exact time is dependent on the particular mixture of ones and zeros being sent. After sending a squawk signal, the device may enable its receiver and monitor for a transmitted command. If no command is detected after 150 mS of monitoring, the device may repeat this pattern. Since the majority of remote control transmission formats use a frame repetition rate equal to or less than 120 mS, the 150 mS monitoring time is adequate to allow a standard (non-universal) remote control shipped with the system to initiate a command transmission and cause the device to exit the squawking procedure.

[0048] As discussed previously, upon the occurrence of the setup event, the remote control 10 enables its receiver for approximately 600 mS and monitors for a valid squawk signal. Since the squawk is repeated at least once every 190 mS, there will be at least three opportunities to decode a valid squawk signal during this time interval. If no squawk is detected, or if a squawk is detected but specifies an unknown setup number (i.e., device type or manufacturer not supported by the built-in database of the remote control 10), the remote control 10 may simply continue to process events using its current configuration or, alternatively, the remote control 10 may initiate access to a remote data repository and attempt to download the remote control user interface and signaling information that corresponds to the setup number provided by the device. The remote control 10 may also store the data in the squawk signal for uploading to an intermediate, client device. The client device may then use this data to download the appropriate user interface and signaling information for subsequent, off-line downloading to the remote control 10. If, however, a valid squawk signal is detected, the remote control 10 may respond by sending a command to the device in the requested format, commencing during the 150 mS inter-frame interval, to suspend the squawk procedure at the device.

[0049] The remote control 10, after sending a command to the device, may continue to monitor to confirm that the transmission of squawk signals from the device has ceased. If the transmission of squawk signals has ceased (indicating that the device received and recognized the transmitted command), the remote control 10 may then set itself to use the communications format/command codes specified within the squawk signal when transmitting communications/commands to the device. If the transmission of squawk signals has not ceased, the remote control 10 may then sequence twice more before abandoning the attempt and exiting setup with its current settings unchanged.

[0050] In yet another embodiment, in situations where the user has a device that does not include DAS, a personal computer, set top box, or the like could have the capability of performing the function of setting up the remote control 10. In such a case, the personal computer or set top box can be used to transmit a squawk signal having the requisite information to setup the remote control 10 using one or more of the various procedures described herein. The data content and signaling format for the squawk signal may obtained from local data storage or from a remote data repository, and selection of the specific squawk to be transmitted could be via user entry of a brand and model number, a UPC code, other text-based identifying information, or by a user visually scanning a database containing pictures or other identifying characteristics of device brands and models.

[0051] While the above described exemplary methods are particularly adapted for use with current consumer appliances which are generally equipped to communicate using infrared (IR) signals, it is to be understood that the concepts expressed may be applied to devices which communicate using radio frequency (RF), including but not limited to those supporting various emerging standards such as Bluetooth, HomeRF, IEE 802.11, etc.

[0052] In connection with the DAS method described above, a function configuration process could also be implemented. The function configuration process, generally illustrated in FIG. 7, may be used to setup function identity and operating parameters within the remote control 10. Typically, this would occur after the DAS information was used to setup the remote control 10 to use the command codes/communication format appropriate for the device. For each type of device to be controlled, a set of possible functions is defined and each function is assigned a unique numeric identifier which is communicated to the remote control 10. In an exemplary implementation, up to 256 possible numeric identifiers can be used.

[0053] By way of example, two sets of function identifiers are shown in FIGS. 8a and 8b for a TV and a VCR device, respectively. Similar tables may be constructed for each additional device type to be controlled. It is to be understood that the number identifiers in the tables of FIGS. 8a and 8b do not themselves define what signal is to be sent to the controlled (target) device to effect the function; the numbers simply indicate to the remote control 10 which functions a particular device supports.

[0054] The tables of FIGS. 8a and 8b include several groups of functions which could reasonably be expected to be supported by the respective devices. Additionally, the groups often comprise families of related functions. For example, the family comprising Volume Up and Volume Down, and the family comprising Play and Stop, could both be included as a group. From the teachings herein it will be understood that the family relationship may be defined in terms of a functional relationship, such as audio control; an entertainment relationship, such as audio control of source a and image control of source b and signal selection control of source c; a device relationship, such as VCR or Digital Satellite; as well as a task optimized or a user defined relationship. Other families and groupings will be apparent to those of skill in the art. FIG. 9 demonstrates that grouping such functions under a single designator results in a more compact representation, or table. While both representations can be used effectively, the compact version of FIG. 9 is preferred.

[0055] Referring now to FIGS. 10a-10d, an example of the uses of the identifiers is illustrated. A simple playback only VCR could completely identify its functionality to the remote control 10 by transmitting to the remote control 10 two bytes of data: 01 followed by 02 (see FIG. 10a). If another model of a VCR device additionally featured recording functionality and channel tuner functionality, that model could identify its functional capabilities to the remote control 10 by transmitting a data string 01,02,03,10,11 to the remote control 10 (see FIG. 10b). Another model of a VCR device supporting further still a slow motion function could transmit the data string 01,02,03,04,05,10,11 to the remote control 10 (see FIG. 10c). The remote control is then able to tailor its presentation of function keys (used to command functional operations of the device) to match the exact device being controlled. In keeping with the discussion concerning DAS above, the appropriate user interface elements and signaling information for commanding the remote operation of functions identified in this manner can be retrieved from the built-in database of the remote control 10 or downloaded from a remote location. Furthermore, it is to be understood that there is no ambiguity in assigning the same function number to different functions across devices, since the device type is already known to the remote control as a result of the initial DAS.

[0056] FIG. 11 shows an assignment of a number to allow for future expansion and/or addition of new functions not included in the initial function number assignments. As shown in FIG. 11, and as an example, 00 is reserved to indicate that the data following 00 is a definition of a new code and function. So, for example, if a VCR device were a dual format deck which allowed the user to switch between playing tapes recorded in NTSC and PAL formats, it might define a format switching function to the remote control by sending the following data to the remote control 10 (see FIG. 10d): 01,02,00,11,39,38,31,78,84,83,67,47,80,65,76 where:

[0057] 01,02 represents the basic functionality of the unit, as before (power plus transport key group only);

[0058] 00 represents the start of the special function definition sequence;

[0059] 11 is the number of bytes of data following;

[0060] 39,38,31 is an ASCII representation of the infrared key data as disclosed in U.S. Pat. No. 5,515,052. This value is a numeric representation of the IR code to be transmitted, (981 in this case); and

[0061] 78,84,83,67,47,80,65,76 is the ASCII representation of the key label to be used when displaying the function key 1054, (NTSC/PAL in this case) the activation of which transmits the function command.

[0062] Besides 00, one other special characterthe value 255 is reserved. This is used for packet formatting purposes and will be described further below.

[0063] To effect function setup within the remote control 10, the 8-bit system identification value from the DAS data is examined. Returning to FIG. 7, if the identification value indicates that the transmitting device does not support the extensions described herein (i.e., is not CC in the example given), the remote control 10 setup is complete and the remote control 10 resumes normal operation. If, however, the system identification value indicates that the device supports functional capability reporting then the remote control 10 continues the setup procedure by requesting from the device its FCD data string. This request will usually take the form of a single specific remote control command (i.e., the equivalent of a key press) sent to the target device using the communication format recognized by the target device (i.e., the format established during the DAS process). By agreement with the manufacturer of that device, that particular command will be recognized by the target device as a request to transmit to the remote control 10 FCD of the form described above.

[0064] FCD data may be transmitted from the device to the remote control 10 using a variant of the DAS protocol described above. For example, the FCD data may be divided into eight-byte blocks as illustrated in FIG. 12. The final block may be padded as necessary with FF (255) values to bring it to exactly eight bytes. An eight byte header block is then constructed as follows:

[0065] 1 byte Length (represents the number of 8-byte blocks present of header (to allow for future expansion, currently fixed at 1))

[0066] 1 byte Length of data to follow (excluding header block)

[0067] 2 byte Data checksum (calculated across all bytes of data, including pad bytes but excluding header)

[0068] 3 bytes Reserved for future expansion

[0069] 1 byte Header checksum (calculated across the seven preceding bytes)

[0070] It has been found preferable that this data and the DAS data use the same transmit and receive hardware, i.e., carrier frequency and pulse timing. However, for some applications it is preferable to utilize separate transmit and receive hardware.

[0071] As indicated in the flowchart of FIG. 7, if the remote control 10 receives the FCD data successfully, it configures itself as appropriate for operation of that device. If for any reason the data is not received successfully (e.g., truncated number of packets, bad checksum(s), etc.) the remote control 10 will wait an appropriate period of time and then repeat the request. If after three such attempts the data has still not been obtained, the remote control 10 may abort the process and revert to default operationusually, supporting the maximum set of possible functions for that device type. While the described embodiment and example transactions assume that the DAS and FCD acquisition occur together, there is nothing that prevents the remote control 10 from issuing a request for data at any time. Thus, the remote control 10 could avail itself of data at any time. Furthermore, FCD data may be obtained from a location other than the device itself, such as a local PC database or a remote Web server and downloaded into the remote control.

[0072] To additionally assist in configuring the remote control 10, it is contemplated that the remote control system can be adapted to utilize one or more of various standards that are being proposed which standards are intended to provide uniform methods of digital interconnection between devices. These standards generally specify not only how to transfer audio video source materials, but also how to effect the exchange of control functions between devices, since it is relatively easy to interleave these different signals on a single interface when they are encoded at the digital level. An example of such a standard is the Home Audio Video interoperability (HAVi) architecture specification proposed by a group of major device manufacturers. Another standard which specifies how control function are exchanged between devices is Universal Plug and Play (UPnP). The methods disclosed herein are applicable generally, to these and other such standards that determine parameter passing and interaction between devices. Present suggested standards disclose methods that are not only directed to home entertainment devices, but are also applicable to other devices in the home such as the control of lighting, personal computers, security, communications, sprinklers and other convenience items.

[0073] In general, such standards allow control information to be transferred between devices using two methodologies. The first methodology involves predefining a set of standardized commands for each appliance type (such as play/stop/pause for a VCR, channel change for a TV tuner, etc.). Since not all devices necessarily support all possible commands (e.g., a VCR may not support indexed skip) provision may be made for an appliance to enumerate its capabilities in response to a query from another device on the bus in the form of a list of which standard functions are or are not supported by the appliance. The controlling device (e.g., remote control) uses this information to determine the look and feel of the user interface and the controlled device simply accepts commands from the controlling device.

[0074] The second method allows the target device to specify to the controlling device a complete user interface, including the exact icons to display for each function, labels for functions, data and status displays, etc. The controlling device simply presents these to the user and reports back to the controlled device which icon was selected. In other words, unlike the first method, in this scheme the controlled device determines the look and feel of the user interface and the controlling device simply acts as intermediary between the controlled device and the user. It is to be understood that different standards may support either or both of these described methods.

[0075] With appliances compliant with such standards, a remote control 10 of the type described herein can be utilized by providing an adapter device that attaches to the digital bus interconnecting these appliances and which solicits capability information from appliances on the bus for transfer to the remote control 10. By way of example, communications from the adapter to the remote control 10 may be via a two-way communication link. Thus, a single standard compatible adapter can provide remote configuration services for all devices connected to the bus, instead of each device individually supplying its DAS data directly to the remote control 10. The remote control 10 can issue user commands to a device either by relaying them back through this same adapter or by communicating directly with the device, whichever is best supported by the device in question. The adapter can be either a stand alone unit or incorporated within some other device (e.g., a cable set top box).

[0076] As an illustrative example, an LCD based remote control 10, shown in FIG. 18, can download configuration information from multiple consumer devices which are interconnected via a digital network as described above. Such a remote control 10, which includes a graphic LCD display and touch screen input capability, would be capable of supporting both types of command structure. The remote control 10 would, therefore, represent an extremely powerful user interface device, essentially becoming an extension of the controlled device in the user's hand. Also, since the standard being used may allow an ongoing two-way dialog between the controlled and controlling devices, the remote control display and configuration may be updated dynamically during use of the system; not just at setup time as is the case with the basic extended DAS transaction described earlier.

[0077] Since devices other than pure entertainment equipment may also share this network, it will be appreciated that it may not be necessary that the entire information set utilized to configure the remote control 10 to work with the equipment be available locally from the equipment itself. For example, devices such as personal computers and the like which have communication capabilities that extend beyond the home may be attached to the network, as illustrated in FIG. 19. In this case, provided that the minimum data required to identify a device type and model can be obtained via DAS, direct user input, or the like, the remote control 10 may use the personal computer as a intermediate client to access a remote data repository and obtain from the remote data repository a complete set of capability and configuration data necessary to configure the remote control 10 to control the consumer's equipment.

[0078] To reduce the complexity of the user interface of the remote control 10 resulting from the configuration methods described herein, the system may be adapted to display only function indicators corresponding to respective functions to be controlled from the listing of controllable functions of the device to be controlled. Referring to FIG. 10a, the remote control 10 shows function indicators comprising a rewind icon 1038, a stop icon 1040, a pause icon 1042, a play icon 1044, and a fast forward icon 1046. Since these are the only functions desired to be controlled, for example, with this particular VCR, the user is presented with a remote control 10 having substantially reduced apparent complexity. This eases the user's selectivity by reducing extraneous information.

[0079] It will be understood that the listing of controllable functions may also be divided into a plurality of families and the single set of function indicators may be divided into a corresponding plurality of families. Accordingly, the step of displaying the graphical user interface elements may include displaying only the family of indicators corresponding to the family of functions to be controlled. For example, the indicators 1036 of FIG. 10b have been divided into a channel tuning family 1050 and a tape transport control family 1052.

[0080] As discussed above, device and function identity information, whether included in a DAS transmission, read from a barcode label (as described in U.S. Pat. No. 6,225,938), entered by the consumer as a UPC or other code, etc. may, in turn, be used to directly access information stored in a centralized device database that contains definitions necessary to configure the remote control 10 to communicate with and/or control the identified device generally and/or specific functions of the identified device. To this end, the centralized device database may include control codes for devices of different types and manufacturers (and sometime model number) as well as elements of graphical user interface layouts to be displayed by the remote control 10 as an interface to communicate with/control various devices. As illustrated in FIG. 13, the remote control 10 can access the centralized device database server, provide the centralized device database server with the device and/or function identity information, and request that the centralized device database server download to the remote control 10 information from the centralized device database needed by the remote control 10 to configure itself to communicate with and/or control the device corresponding to the device identity and/or function identity information. As will be described in greater detail hereinafter, the centralized device database may also store information relevant to the operation of devices such as user manuals, TV-guide listings, etc. Additionally, the identity information provided to the centralized device database server can be used to provide services such as automatic warranty registration, capturing of demographics (e.g., identifying devices a user owns/has previously setup), etc.

[0081] The identity information, whether received via a unidirectional or bi-directional DAS communication, barcode label, or the like, is preferably stored in the memory 34 of the remote control 10. This information may be then be read from the memory 34 and communicated to the centralized device database server 300 during an on-line communications session. Alternatively, the device identity information may be uploaded from the remote control 10 into an intermediate client device 302, such as a personal computer, set top box, etc. for future off-line communication to the centralized device database server 300. Similarly, the information/data returned from the centralized device database for use in the remote control 10 can be loaded into the memory 34 of the remote control 10 during an on-line communications session or this information/data can be downloaded to the intermediate device 302 for subsequent, off-line downloading into the memory 34 of the remote control 10.

[0082] To upload the identity information to the centralized device database server 300, as illustrated in FIGS. 14-17, the remote control 10 is first placed in communication with a client device 302 which, in turn, is capable of communicating with and accessing the centralized device database server 300. Access to the centralized device database server 300 may be via direct connection or via the Internet, PSTN, or other network. By way of example, the client device 302 can be a personal computer as illustrated in FIGS. 14 and 15 or a cable set top box as illustrated in FIG. 16. Still further, the client device 302 can itself be the remote control, as illustrated in FIG. 17, when the remote control functionality is embodied in a PDA, Webpad, personal computer or the like. Communications with the client 302 can be by means of a docking device 304, as illustrated in FIG. 14, or by means of RF wireless communications, using protocols such as 802.11b, Bluetooth, etc., as illustrated in FIG. 15. Still further, communications with the client 302 can be accomplished using bi-directional IR transmissions, as illustrated in FIG. 16.

[0083] To communicate with the centralized device database server 300, the client device 302 can include software that is designed to monitor for data messages from the remote control 10 and initiate contact with the centralized database server 300 when the remote control 10 indicates that it possesses a new device or function identity. Preferably, this software runs in a background mode. The software can be responsive to a transmission from the remote control 10 which notifies the software of the fact that the remote control 10 includes new identity information. This notification can include data representative of the new device or function identity or the software can request that the new device or function identity be supplied in a further transmission. Still further, the software can periodically read the memory of the remote control 10 to determine if there has been a change in the device identity data stored in memory 34. This is especially useful in the case where the remote control is a PDA or PDA-like device, as is possible in the examples shown in FIG. 14 or 15, where the software could form part of the synchronization process which is automatically invoked whenever the portable device is docked or otherwise establishes communication with the host PC. A similar arrangement may be used in the case of a remote control which is equipped to display TV guide information (as described, for example, in co-pending U.S. application Ser. No. 09/905,396 or in U.S. Pat. No. 6,130,726) wherein the remote control 10 engages in periodic communication with a PC client device 302 in order to refresh guide data. In cases where the client device 302 is not a PC but is a cable or satellite set top box, home gateway appliance or the like, an embedded application may be installed in the device to perform in a similar manner.

[0084] Upon receipt of the identity information from the remote control 10, the centralized device database server 300 uses the identity information to select from a command code library stored in the centralized device database one or more command codes and transmission formats recognizable and appropriate for the identified device and/or function. This data is then returned from the centralized database server 300 to the client device 302 whence it may be transferred directly back to the remote control 10 if the remote control is still in communication with the client device 302. Alternatively, the data may be stored on the client device 302 for later transfer to the memory of the remote control 10 during a subsequent docking or communication session with the remote control 10. Once the data is transferred to the remote control 10 the data is used in a manner well known to those of skill in the art to setup the remote control 10 to control the operation of the device and/or the identified function.

[0085] In addition, the centralized device database server 300 may also use the device and/or function identity information to retrieve from the centralized device database graphical user interface elements, such as command key representations and layouts, that are appropriate for the identified device and/or function. The graphical user interface elements may then be downloaded as described above to the remote control 10 for use in providing a display by which the user can command the operation of the device. The graphical user interface elements can be embodied in an XHTML file or the like to be displayed using browser software resident on the remote control 10 as described in U.S. application Ser. Nos. 60/264,767, 09/905,423, 09/905,432, and 09/905,396. Still further, the graphical user interface elements may be in a proprietary format compatible with specific remote control application software such as described in co-pending U.S. patent applications Ser. Nos. 60/344,020, 60/334,774, 10/288,727 and 10/290,605. Importantly, from an equipment manufacturer's point of view, offering downloadable graphical user interface elements in this manner allows the manufacturer to retain a degree of control over the look and feel of their device's remote control user interface, even when used with aftermarket LCD remote controls.

[0086] The centralized database server 300 may also be used to provide other information relevant to the operation of devices to the benefit of the consumer and/or device manufacturer. For example, device specific reference documentation such as user manuals, hook-up instructions, FAQs, and the like may be stored at the centralized database server and downloaded to the client device or remote control 10 according to the device identity information provided to the centralized database server 300. This additional information may be provided either as part of an initial setup procedure or at some later point by explicit user request. Alternatively, in cases where the remote control 10 is capable of wireless communication with the client device or directly to the server 300 (as shown, for example in FIGS. 15-17) reference information can be offered interactively using, for example, the techniques described in co-pending U.S. application Ser. No. 09/905,423.

[0087] Another application that may be supported by such a centralized server 300 is warranty registration. Since a remote control 10 can be expected to access the centralized database shortly after the consumer has purchased a device, warranty registration can be advantageously performed in conjunction with the database access made to setup the remote control 10 to communicate with/control the device. Depending upon the manufacturer, warranty registration may be partially or fully automated. For example, the device identity data supplied to the remote control 10 by the device may be extended to include a serial number that, in turn, can be communicated to the centralized server 300. The user may then be requested to enter his personal information to complete the registration process. In cases where the remote control function is implemented within a PDA device, which may already contain the user information, the retrieval of the personal information can also be made fully automatic using well known retrieval techniques.

[0088] In addition to warranty registrations, consumer demographic information may also be captured as part of the processes described herein. In this regard, the remote control 10 knows what other devices the consumer owns by virtue of the remote control 10 having been set up to control those devices. Accordingly, this information can be accumulated at the centralized server 300 for analysis. For example, answers to marketing research questions such as How many purchasers of Sony DVD players also own a PVR and What proportion of owned PVRs are Sony branded could be extracted from a such a data accumulation.

[0089] Since the centralized device database inherently includes elements which infer the functionality of individual device brands and models (i.e., the remote control command set for each of them) another service that could be offered to the consumer through the server may be the ability to research feature sets of devices of different manufacturers prior to purchasing a device. For example, a consumer may access the centralized database and inquire Which PVR models have dual tuners or Which Panasonic TVs support picture-in-picture.

[0090] Another feature that a manufacturer may wish to offer through the centralized server 300 is providing customers with information regarding the availability of accessories, supplies, and add-on equipment. Advantageously, the centralized server 300 can be used to prepare sales catalog listings that could be tailored to a particular device type and model using the device identity and/or serial number information received from the remote control 10. Tailored catalog and purchasing information can be downloaded to the client device 302 or remote control 10 itself for display to and perusal by the consumer. Once this information is presented to a user, either on the display of the remote control 10 or a display associated with a client device, orders can be placed interactively through the centralized server 300 using well known e-commerce principals.

[0091] Still further, since consumer electronic devices are designed to allow for upgrade of their internal firmware programming to add future capabilities, updated remote control command code libraries and/or GUI layouts may be provided to the remote control 10 via the centralized device database server to match any upgrades. By way of example, digital cable or satellite set-top boxes, PVRs, and the like can have their capabilities updated from a remote location without any significant involvement by the user. In cases where an update to the device functionality is received, the consumer may be prompted to manually initiate a further remote control setup in order to acquire a corresponding command code/GUI update from the centralized device database. Alternatively, the newly-loaded device firmware update could automatically initiate a DAS sequence to, in turn, initiate the setting up of the remote control 10 using one or more of the procedures described herein.

[0092] In the case where the remote control uses an LCD or other display and/or a touchscreen to implement the user interface, the information downloaded from the centralized database server 300 would result in a user interface appropriate for the device and the new device functionality with no further action on the user's part. In the case of a remote control with hard keys only, the centralized database server 300 may be used to provide new labeling for the remote control 10. For example, in some embodiments it is contemplated that the manufacturer will build a base remote control 10 having a set of blank, configurable keys and, possibly, basic functions expected to be required by everyone (e.g., volume control keys, digit keys, channel control keys, power). Provision may then be made at the centralized database server 300 to create custom labels for the blank keys in connection with the setup process which can be downloaded and printed on an overlay for use in connection with the remote control 10 to identity to the user the functions to be controlled upon activation of a remote control key.

[0093] Still further, once a device is identified to the centralized device database server 300, the customer can be allowed to customize the key configuration and/or graphical user interface of the remote control 10. To this end, the consumer may be presented with one or more screens, showing a virtual representation of the remote control 10 together with a table of all functions available for the device. Using a drag and drop interface, for example, the consumer may assign functions to blank keys/iconic locations on the remote control 10. In some cases, users may be presented with iconic layouts for LCD displays that, while user alterable, are preformatted, based on the device ID, so as to have a key layout appearance similar to the original remote control provided by the manufacturer of a device.

[0094] When the key layout configuration process is completed by a user, the centralized device database server 300 downloads the configuration into the remote control 10 as described above. In the case where blank hard keys are utilized, the consumer may print a label further provided by the central server 300 to be installed on the remote. In an alternative labeling approach, the central server 300 could transmit the label data to a center where a more durable label, e.g., a mylar overlay, would be pad printed and mailed to the user. Various means for providing labels to the remote control 10 are illustrated in U.S. application Ser. No. 09/615,473.

[0095] In yet another embodiment, the user may access the centralized device database to download to the remote control 10 one or more sequences of instructions to perform various operations, otherwise known as macros. For example, a user who has just purchased a new VCR may be able to download preprogrammed macros which facilitate setup and adjustment of a home theater system in which the VCR is inferred to be a part of. In this case, the devices in the home theater system can be inferred from prior device setups performed using the centralized device database. As additional devices are added to the remote control 10, the centralized server can use the device information to make informed decisions regarding the instructions to include in a macro given the devices owned by a user. Alternatively, the user can be presented with one or more screens by which the user can create a custom sequence of macro instructions.

[0096] To, in part, avoid overloading memory in the remote control 10, the user can be provided with a memory indicator indicating, preferably on a percent basis, how much memory is available in the remote control 10 for downloading further data/information. Memory usage may be maintained locally or remotely, e.g., at the centralized database server. In another embodiment, the indicator represents the amount of memory the download will use without regard to the amount of data already stored in memory.

[0097] With reference to FIGS. 20 and 21, an application for a remote control 10 may be embodied for use in connection within a portable display device 220 such as a Smart Display, a Microsoft platform formerly known by the development code name Mira, that includes a means for communicating commands to consumer entertainment or home automation devices 226, e.g., using either RF or IR communication protocols. In this context, the portable display device 220 is adapted to be an extension of a personal computer 222 with which it remains in wireless communication 224. The portable display device 220 thus allows the user to seamlessly interact with various application programs running on the personal computer 222 and/or locally on the portable display device 220 itself as the user of the portable display device 220 moves around their home or office. As will therefore be appreciated, the aforementioned remote control 10 may be provided as an application that resides partly or totally on the portable display device 220 and/or the personal computer 222 whereby the portable display device 220 can be used to interact with the remote control 10 to allow the user to conveniently control consumer entertainment or home automation devices 226.

[0098] To set up the remote control 10 to match the device(s) to be controlled, a graphical user interface setup wizard 200 may be provided. As illustrated in FIGS. 23-28, the setup wizard 200 may be used to select local device/function codes and/or remote device/function codes to setup the remote control 10 to control the operation of an intended target device. In this regard, since the portable display device 220 is adapted to be an extension of the personal computer 222 (e.g., the portable display device 220 is in wireless communication with a host personal computer 222), any device/function codes stored within the local memory of such a computer 222 may also be considered to be local within the context of the following description. Instantiation of the setup wizard 200 may result, for example, from the user selecting an add device icon 201 or the like.

[0099] To indicate to the setup wizard 200 a desire to setup the remote control 10 to control the operation of a device, the user may request that a setup by brand operation be performed, for example, by selecting the easy setup icon 202. In response, the device setup wizard 200 may request that the user identify parameters associated with the device 226 to be controlled, i.e., the target of the present setup procedure. For example, the setup wizard 200 may present to the user a drop down menu list 204 or like GUI interface element by which the user may identify the device type, e.g., television, VCR, DVD, etc., as illustrated in FIG. 24. Once the device type is indicated, the setup wizard 200 may use that information to present to the user a listing of known brands for the selected device type from which the user may select the brand of the intended target device, for example, using the drop down menu list 206 or like GUI element. The brands presented to the user in the drop down menu list 206 may be limited to those brands that are known to have function codes in the local command code library for the selected device type. Alternatively, the brands may simply be all of the brands known at the time the setup wizard 200 was last created or updated for the selected device type. Still further, the brands may be all of the brands for all of the available, possible device types, i.e., the brands presented for user selection are presented without regard to the selection of a device type.

[0100] In the case where the brand for the selected device type is not available, e.g., it is not listed in the pull-down menu 206, findable in the case of a manual entry of the brand information, or does not have function codes stored in local memory (although listed for selection), the user is prompted to return and attempt an advanced setup, where one or more of the previously described setup procedures may be made available to the user, e.g., direct entry, step-and-set, or the like. The user may also seek to find function codes for the intended target device that may be stored remotely, as described hereinafter. Assuming that the brand of the intended target device is available, i.e., the local memory has function command codes for the identified appliance type and brand, the user may indicate a desire to continue with the setup procedure, for example, by activating the next icon 208. In response, the setup wizard 200 may present a graphical user interface for testing possible device function codes, an example of which is illustrated in FIG. 25.

[0101] For use in allowing the user to test possible device function codes, the setup wizard 200 first loads or provides access to one or more sets of function codes for the specified device and brand (in the case where multiple sets exist) that are within local memory. An indication of which function code set is being used in the testing procedure may be indicated, for example, via text 214. The setup wizard 200 then allows a user to select one or more of the functions codes from each set to be transmitted from the portable display device 220 to the intended target device, for example, by activating one or more displayed soft keys 210. Preferably, the soft keys 210 are labeled to provide an indication as to what function the intended target device is to perform upon a successful receipt of the transmitted command that was assigned to the soft key 210 activated. If the user transmits a command and the intended target device does respond as expected, the user may indicate the successful interaction between the remote control 10 and the target device, for example, by activating the yes icon 212. An indication of a successful interaction between the setup wizard/remote control 10 and the intended target device may then be used to lock the function codes for the function code set presently being utilized in the testing procedure to a device mode in the remote control 10 which function codes are to be used to command the operation of the intended target device when the remote control 10 is placed into that device mode.

[0102] In the case where the intended target device does not respond to a transmitted command as expected, the user can elect to try one or more function codes from a further function code set, for example, by activating the no icon 216, to see if the intended target device responds to any further transmitted function codes. The function code sets can be presented for testing in any order, although it may be preferred to present them in a manner that mirrors their percentage of usage, i.e., the ones most likely to command the intended target device for that brand are presented first for testing. In the case where the user has cycled through all of the locally available function code sets for the specified device type and brand without the intended target device responding to a transmitted command, the user may request that the setup wizard 200 look to a remote data repository to find additional functions codes that may be used to command functions of the intended target, as illustrated by way of example in FIG. 26. Alternatively, in the case where brand setup was not successful, the setup wizard 200 may offer other setup techniques to attempt to find function codes for the intended target device, e.g., using a step-and-set procedure.

[0103] For finding remotely located function codes that may be useful in setting up the remote control 10 to command the operation of the intended target device, access may be made to the centralized device database server 300, as illustrated by way of example in the flowchart of FIG. 22. Access to the centralized device database server 300 may be made via the personal computer 222 that is in wireless communication with the portable display device 220. In the event that wireless communication has been temporarily lost, for example, if the user and the portable display device 220 have wandered out of range of the stationary RF transceiver incorporated into the personal computer 222, the setup wizard may branch directly into an alternative setup mode, for example step-and-set (230, FIG. 28), as is shown in the decision block 240. Assuming RF communication exists, contact is made with the centralized database server 300 via the PC 222 and extended setup of the remote control 10 may be performed in any of the manners previously discussed, for example, additional data and setup codes for the device type and brand specified, which were not included in the local library, may be downloaded and used in a further setup by brand operation 228 as illustrated in FIG. 27.

[0104] The procedures described previously may also be used to download and/or configure graphical user interface elements for the remote control 10. In this regard, the centralized database may contain both control codes for devices of different types and manufacturers as well as elements of graphical user interface layouts to be displayed by the remote control 10 for use in controlling various devices, i.e., the graphical user interface elements are interacted with to cause the transmission of control codes from the portable display device 220. When loaded in conjunction with additional code sets during set up, these graphical user interface elements/layouts may be used to replace or supplement the graphical user interface elements/layouts already stored locally in the portable display device 220 or the personal computer as required to support the features of the additional code sets downloaded from the centralized database. Alternatively, where additional setup wizard steps or entire setup wizards are provided which may offer the user the ability to customize the appearance of the remote control, for example, by selecting from a library of graphic images used to represent devices, activities, favorites, key shapes, and the like (such as described in more detail in co-pending U.S. patent applications Ser. No. 60/344,020 and 10/288,727) similar procedures may be used to provide seamless extension of graphic element libraries across both local and centralized server-based repositories.

[0105] While specific embodiments of the present invention have been described in detail, it will be appreciated by those skilled in the art that various modifications and alternatives to those details could be developed in light of the overall teachings of the disclosure. For example, it should be appreciated that any of the above described methods can be used alone or in combination to setup the remote control. Additionally, as noted, the functionality of the universal remote control can be included in other devices such as PDAs, personal computers, home devices, or the like. Accordingly, it will be understood that the particular arrangements and procedures disclosed are meant to be illustrative only and not limiting as to the scope of the invention which is to be given the full breadth of the appended claims and any equivalents thereof.

[0106] All of the cited patents and patent applications are hereby incorporated by reference in their entirety.