Timing and velocity control for displaying graphical information

[0002] This is a continuation of U.S. patent application Ser. No. 08/873,855, filed Jun. 12, 1997, now U.S. Pat. No. 6,281,879, which is a continuation of U.S. patent application Ser. No. 08/709,529, filed Sep. 6, 1996, now abandoned, which is a File Wrapper Continuation of U.S. patent application Ser. No. 08/260,558, filed Jun. 16, 1994, now abandoned, which applications are incorporated herein by reference.

[0003] The present invention relates generally to data processing systems and, more particularly, to the displaying of graphical information in data processing systems.

[0004] Many conventional application programs utilize tool bars. Tool bars provide the user with a number of tools that assist the user in performing tasks. Typically, a separate control is provided for each tool on the tool bar. The control may be a pushbutton or another graphical object that allows the user to invoke the desired tool. Often times the controls on the tool bar have icons on their faces that indicate the nature of the tool. Unfortunately, as the typical number of controls on the tool bar has grown for applications, it has become more and more difficult for the user to discern the nature of the tool solely from the icons shown as part of the tool bar. As such, many users have difficulty using the tools on the tool bar.

[0005] The limitations of the prior art are overcome by the present invention. In accordance with a first aspect of the present invention, a method is practiced in a data processing system having a video display for displaying a cursor that points to positions on the video display. The data processing system also includes an input device for manipulating the cursor. In accordance with this method, it is first determined that the cursor points to a position within a region on the video display. A velocity metric of the cursor is measured. Where the velocity metric does not exceed a predetermined threshold value, an event is triggered. On the other hand, where the velocity metric exceeds the predetermined threshold value, the event is inhibited.

[0006] In accordance with a second aspect of the present invention, it is determined that a cursor points to a position within a region on the video display. A time period metric that specifies how long the cursor has remained pointing within the region is measured. A velocity metric of the cursor within the region is also measured. Based upon these metrics, a determination is made whether to trigger an event.

[0007] In accordance with an additional aspect of the present invention, a method is practiced in a data processing system having a video display for displaying a cursor that points to positions in the video display and an input device for manipulating the cursor. In accordance with this method, a graphical object is displayed on the video display. The user uses the input device, and in response, the data processing system positions the cursor to point at the graphical object. A predetermined period of time, such as a time greater than 0.4 seconds, is allowed to pass and then a determination is made whether the cursor still points at the graphical object. If it is determined that the cursor still points at the graphical object, information about the graphical object is displayed adjacent to the graphical object on the video display.

[0008] In accordance with another aspect of the present invention, a method is practiced wherein a tool bar having tools is displayed on the video display. When the user uses the input device, the cursor is position to point at a selected one of the tools on the tool bar. The system waits a predetermined non-negligible amount of time. The system also measures a velocity metric of the cursor within the first graphical object. If the cursor still points at the selected tool after waiting the predetermined non-negligible amount of time and the velocity metric has remained below a predetermined threshold during the predetermined non-negligible amount of time, information about the selected tool is displayed in the video display. The position is adjacent to the selected tool.

[0009] In accordance with a further aspect of the present invention, a method is practiced in a computer system having a video display for displaying a cursor that points to positions on the video display and an input device for moving the cursor on the video display. In this method, a first graphical object is displayed on the video display. In response to the user using the input device, the cursor is positioned to point at the first graphical object. The system waits a non-negligible predetermined amount of time. A determination is made whether the cursor still points at the graphical object after the non-negligible predetermined amount of time has passed. Where the cursor still points at the first graphical object, a number of steps are performed. These steps include displaying information about the first graphical object adjacent to the first graphical object of the video display. The non-negligible predetermined amount of time is then reset to a substantially shorter amount of time. A second graphical object is displayed on the video display and, in response to the user using the input device, the cursor is positioned to point at the second graphical object on the video display. The system waits the substantially shorter amount of time. Where the cursor is still pointing at the second graphical object after waiting the substantially shorter period of time, information about the second graphical object is displayed adjacent to the second graphical object on the video display.

[0010] In accordance with a still further aspect of the present invention, a data processing system includes a video display for displaying video data. The video display displays a first graphical object and a cursor that points to the first graphical object. An input device is included in this part of the data processing system for moving the cursor on the video display. A message generator is provided for displaying information about the first graphical object. The information is displayed adjacent to the first graphical object on the video display when the cursor remains pointing at the first graphical object for a predetermined non-negligible amount of time. The message generator includes a comparator and a message source. The comparator determines whether the cursors remain pointing at the first graphical object for the predetermined non-negligible amount of time. The message source provides and displays information about the first graphical object adjacent to the first graphical object on the video display when the comparator determines that the cursor has remained pointing at the first graphical object for the specified amount of time.

[0011] FIG. 1 is a block diagram of a data processing system that is suitable for practicing a preferred embodiment of the present invention.

[0012] FIG. 2A is a diagram illustrating a tool bar and a tool tip that is provided for a print button in accordance with the preferred embodiment of the present invention.

[0013] FIG. 2B is a diagram illustrating a tool bar and a tool tip that is provided for a font list box in accordance with the preferred embodiment of the present invention.

[0014] FIG. 3A is a flow chart illustrating the steps performed to initially set a timer when a cursor is positioned over a control on the tool bar in accordance with the preferred embodiment of the present invention.

[0015] FIG. 3B is a flow chart illustrating the steps performed to determine the magnitude of the velocity of the cursor when the cursor is positioned over a control on the tool bar in accordance with the preferred embodiment of the present invention.

[0016] FIG. 4 is a flow chart illustrating the steps performed to determine whether a tool tip is to be displayed in the preferred embodiment of the present invention.

[0017] FIG. 5 is a flow chart illustrating the steps performed when a cursor no longer points within the tool bar in the preferred embodiment of the present invention.

[0018] FIG. 6 is a low chart illustrating the steps that are performed relative to the timer when the cursor leaves the tool bar in the preferred embodiment of the present invention.

[0019] The preferred embodiment of the present invention displays a tool tip when a mouse cursor points to a tool or a tool bar for a sufficient amount of time and the magnitude of the velocity of the mouse cursor remains below a predetermined threshold. A tool tip is a brief textual message, such as a name of a tool, that identifies the nature of the tool. The preferred embodiment of the present invention provides a delay between when the mouse cursor is initially positioned to point at the tool control on the tool bar and when the tool tip is displayed. This delay prevents the user from receiving undesired tool tips when the user inadvertently passes the mouse cursor over a control on the tool bar. The delay is sufficiently long (i.e., it is non-negligible) to allow the user to move the mouse cursor if he does not want to receive a tool tip. The delay is shortened when an initial tool tip is displayed so as to allow the user to quickly browse the tool controls that are available on the tool bar. The magnitude of the velocity of the mouse cursor is measured to determine whether the user likely intends to point at the tool to receive a tool tip or whether the user, instead, is merely passing over the tool while moving to another destination.

[0020] Although the preferred embodiment of the present invention concerns controlling when tool tips for tools on a tool bar are displayed, those skilled in the art will appreciate that the present invention may generally be applied to other regions of a video display (such as other types of graphical objects) for which graphical information is to be provided. It should be appreciated that the present invention may be applied to both visible and invisible graphical objects.

[0021] FIG. 1 is a block diagram of a data processing system 10 that is suitable for practicing the preferred embodiment of the present invention. The data processing system 10 includes at least one central processing unit (CPU) 12. The CPU 12 is connected to a number of peripheral devices, including a mouse 14, a keyboard 16 and a video display 18. The CPU 12 is also connected to a memory 20 and a secondary storage device 22, such as a hard disk drive. The memory 20 holds a copy of an operating system 24, such as the Microsoft Windows, version 3.1, operating system sold by Microsoft Corporation of Redmond, Wash. The memory 20 also holds a copy of an application program 26. The implementation of the preferred embodiment of the present invention will be described below with reference to use of tool tips within the application program 26. Nevertheless, it should be appreciated that the tool tips may alternatively be implemented in the operating system 24 or as a system resource.

[0022] FIG. 2A shows the tool bar 34 that is generated and displayed on the video display 18 when the application program 26 is run on the CPU 12. The tool bar 34 includes a number of controls, such as buttons and list boxes, that enable a user to access the tools of the tool bar. When the user positions a mouse cursor 30 over one of the buttons and clicks the mouse (i.e., quickly depresses and releases a predefined one of the mouse buttons), the tool associated with the button is invoked. Similarly, by positioning the mouse cursor 30 over one of the buttons of the list boxes, a drop-down list appears, and the user may select one of the options on the drop-down list using the mouse 14.

[0023] The tool bar 34 is created as a window by the application program 26. The operating system 24 facilitates the definition of such windows (as is provided in the Microsoft Windows, version 3.1, operating system). FIG. 2A shows the mouse cursor 30 pointing to a print button 32 on the tool bar 34. When a user positions the mouse cursor 30 over the print button 32 and clicks the mouse button, the document currently displayed in the window of the application program is printed.

[0024] The user interface provided for the application program 24 is logically divisible into a number of windows. One of these windows is the tool bar 34. In general, each window of the user interface has a separate window procedure associated with it. The operating system 24 maintains a message queue for each program that generates windows. Accordingly, the application program 26 has its own message queue. Since the application program 26 may generate multiple windows, the message queue may hold messages for multiple windows. When an event occurs, the event is translated into a message that is put into the message queue for the application program 26. The application program 26 retrieves and delivers the message to the proper windows by executing a block code known as the “message loop.” The window procedure that receives the message then processes the message.

[0025] Movements of the mouse 14 are reflected in messages that are placed into the message queue of the application program 26. In particular, when a user positions the mouse cursor 30 with the mouse 14 over a window or clicks the mouse by depressing one of the mouse buttons within a window, the procedure for the window receives a mouse message. The operating system 24 provides a number of predefined mouse messages. The mouse messages specify the status of mouse buttons and the position of the mouse cursor 30 within the window. The position of the mouse cursor 30 within the window is specified in (X, Y) coordinates relative to the upper left-hand corner of the window. Thus, when the mouse cursor 30 moves within the tool bar 34, the position of the mouse cursor 30 within the tool bar is reflected and a mouse message that specifies (X, Y) coordinates of the mouse cursor relative to the upper left-hand corner of the tool bar. The window procedure receives the mouse message and utilizes the information contained in the message to respond to the mouse 14 activities.

[0026] As mentioned above, the application program 26 specifies the window that constitutes the tool bar 34. The application program 26 paints each of the controls, including print button 32, at known locations within the window of the tool bar 34. When the mouse cursor 30 is positioned within the tool bar, mouse messages specify the position of the mouse cursor within the tool bar 34. The mouse messages are sent to the window procedure that is responsible for the tool bar window. The window procedure for the tool bar 34 compares the coordinates specified by the mouse message with the known location of the controls within the tool bar. Accordingly, the window procedure for the tool bar 34 can determine whether the mouse cursor 30 is pointing at any of the controls. When it is determined that the mouse cursor 30 is pointing at one of the controls of the tool bar 34, a tool tip 28 may be displayed if the mouse cursor 30 has remained pointing at the control for a sufficient period of time and the magnitude of the velocity of the mouse cursor is below a predetermined threshold. Hence, in the example shown in FIG. 2A, the message “Print” is displayed as a tool tip 28, given that the mouse cursor 30 is pointing to the print button 32.

[0027] Tool tips are provided not only for buttons on the tool bar 34 but are also provided for other types of controls. For example, as shown in FIG. 2B, a mouse cursor 38 points to a portion of a list box 40 that concerns the font which the user wishes to utilize. Accordingly, a tool tip 36 is displayed that includes the text “Font”. It is worth noting that the mouse cursor 38 changes from an arrow to a cross bar, since the cursor points to a portion of a list box that contains text rather than a button as in FIG. 2A.

[0028] Tool tips are displayed using text output commands that are provided by the operating system 24. Specifically, the ExtTextOut( ) function that is provided by the Microsoft Windows, version 3.1, operating system is used in the preferred embodiment. The format of this function is as follows:

[0029] The hdc parameter of this function specifies a handle (i.e., a numerical identifier) for a device context. In this case, the device context specifies attributes that determine how the operating system interacts with the video display 18. The nXStart parameter specifies the logical X coordinate at which the string of the tool tip message begins. Similarly, the nYStart parameter specifies the logical Y coordinate at which the string begins. The fuOptions parameter specifies the type of rectangle for the tool tip. The operating system 24 provides predefined data structures that specify rectangle types. In this case, the rectangle type is defined as a clipped rectangle. The lprc parameter is a pointer to a structure that holds a rectangle and the lpszString is a pointer to a structure that holds the textual string to be displayed in the tool tip. The cbString parameter specifies the number of bytes in the string and the lpDx parameter specifies spacing between character cells.

[0030] When the window procedure for the tool bar 34 receives a mouse message that indicates that the mouse cursor 30 (see FIG. 2A) is positioned over one of the controls of the tool bar 34, a sufficient time has elapsed and the measured magnitude of the velocity of the mouse cursor 30 is below a predetermined threshold, the procedure determines the string that is to be displayed in the tool tip for the control to which the mouse cursor points. The address of this string is passed as the lpszString parameter to the ExtTextOut( ) function. This function then proceeds to draw the tool tip.

[0031] As the rectangle for the tool tip is a clipped rectangle, the background color may be specified. In the preferred embodiment of the present invention, the background color is yellow, as specified in red/green/blue (RG3) coordinates as (255, 255, 128). The size of the rectangle used for the tool tip is as follows: height equals the height of the text as specified by the font (i.e., the point of the font) plus 4, and length equals length of the text plus 4.

[0032] The tool tips are displayed at predefined locations relative to the controls. In general, tool tips are displayed centered under edit boxes and combo boxes and displayed relative to tool bar buttons at a position where the upper left-hand corner of the tool tip rectangle is 2 pixels to the left of the top left corner of the button and 15 pixels below the hot spot of the mouse 14. Those skilled in the art will appreciate that tool tips may be displayed at other locations that are adjacent to the tools.

[0033] The discussion will now focus on the controls for determining when to display the tool tip. When the mouse cursor 30 is initially positioned to point to a tool bar control (i.e., the first time that the mouse cursor points to a control while it has been in the tool bar 34), the steps shown in FIG. 3A are performed. Initially, the window procedure for the tool bar 34 determines that the mouse cursor 30 points to a tool bar control (step 42 in FIG. 3A). The application program 26 uses a timer to determine whether or not to display a tool tip. This timer may be a system-provided resource that is provided by the operating system 24 or may be a separate component that is provided by the application program 26. The tip is displayed when the timer counts up to a preset trigger point and the magnitude of the velocity of the mouse cursor is an acceptable range. The timer trigger point is then set to 0.7 seconds (step 43 in FIG. 3A). Those skilled in the art will appreciate that the choice of 0.7 seconds is not intended to be limiting of the present invention; rather, 0.7 seconds is a value used in the preferred embodiment of the present invention, which appears to empirically produce desirable results. The timer is then reset to zero seconds so that it can begin counting time.

[0034] As mentioned above, the magnitude of the velocity of the mouse cursor 30 is also used to control whether a tool tip is displayed. FIG. 3B shows the steps that are performed to determine the magnitude of velocity of the mouse cursor 30. Initially, a mouse message is received (step 45). As discussed above, the mouse message includes the (X, Y) coordinates that specify the most recent position of the mouse cursor 30. The coordinates are utilized to determine whether the mouse cursor 30 points to a tool bar control (step 46). As was discussed above, the system knows the locations of the tool bar controls within the tool bar 34. This knowledge is used to determine whether the cursor points to a tool bar control. Mouse messages are generated periodically as the mouse cursor position changes. The time interval between mouse messages is reasonably fixed. Hence, the magnitude of the velocity of the mouse cursor 30 may be determined by comparing the (X, Y) coordinates for the most recently received mouse message with the coordinates from the last previous mouse message. The Euclidean distance between these two sets of coordinates may be calculated and, since the time interval is known, the magnitudes of velocity can then be calculated. However, since the time interval is fixed, there is no need to calculate the magnitude of velocity in each instance; rather, the measure of the distance traveled quantifies the magnitude of the velocity of the mouse cursor 30. Accordingly, the preferred embodiment of the present invention merely measures the distance in pixels since the last mouse message as the velocity metric (step 47).

[0035] Those skilled in the art will appreciate that in alternative embodiments, the present invention may use the magnitude of the velocity as the measure that must exceed a predetermined empirically derived threshold. Alternatively, the vector value of the velocity may be utilized and compared to a vector threshold to determine whether a tool tip should be displayed or not. Moreover, those skilled in the art will appreciate that mouse cursor velocity may be used alone to determine whether a tool tip is displaced or, as employed in the preferred embodiment of the present invention, may be used in conjunction with time metrics to determine whether to display a tool tip or not. In addition, it should be realized that the controls described herein may be applied more broadly to any events that are triggered by measuring the time and velocity variables or velocity variable alone of a mouse cursor within a region of a user interface.

[0036] Whenever the mouse cursor 30 is positioned to point to a control within the tool bar 34 of the application program 26, the steps shown in FIG. 4 are performed. Initially, the timer is initiated to run (step 48). When the timer expires (step 50), a determination is made whether the mouse cursor 30 is still pointing at the same control on the tool bar 34 (step 51 in FIG. 4) and whether the measured velocity metric has remained below an empirically derived threshold value during the time period (step 52). If both of these conditions are met, a tool tip is displayed as discussed above (step 54 in FIG. 4). In an alternative embodiment, the velocity metric is only measured as the timer expires rather than during the entire time interval. In addition to the tool tip being displayed, the timer trigger point is set to 0.1 seconds (step 56). The setting of the timer trigger point to a shorter duration (e.g., 0.1 seconds) facilitates browsing, so that the tool tips will be more quickly displayed when the user moves to an adjacent button or other control on the tool bar 34. If either of the conditions is not met, a tool tip is not displayed and the timer is reset to 0 seconds (step 53).

[0037] The time duration for which the mouse cursor 30 remains pointing at a tool bar control and the measured magnitude of the velocity of the mouse cursor provide helpful indicators of the intent of the user. Empirical tests indicate that users typically will leave the mouse cursor pointing at a control for a time period greater than 0.7 seconds if they wish to use the control. Similarly, users tend to move the mouse cursor slowly over a tool bar control when they wish to utilize the tool bar control. In contrast, when users do not wish to use a tool bar control and are merely passing over a tool bar control, the users move the mouse cursor with a sufficient magnitude of velocity to indicate their intent.

[0038] FIG. 5 is a flow chart illustrating the steps performed when a mouse cursor is positioned to no longer point at a tool bar control (step 58). As soon as the cursor no longer points at the tool bar control, the tool tip is no longer displayed (step 60).

[0039] When the mouse cursor is positioned so as to no longer point within the tool bar, the steps shown in FIG. 6 are performed. In particular, when the cursor leaves the tool bar (step 62), the timer is cleared (step 64). The clearing of the timer allows the processing to be reinitiated when the cursor again returns to point to a location within the tool bar.

[0040] While the present invention has been described with reference to a preferred embodiment thereof, those skilled in the art will appreciate that various changes in form and detail may be made without departing from the intended scope of the present invention as defined in the appended claims. For example, the timing control described above relative to the preferred embodiment of the present invention may also be applied to graphical objects other than tools on a tool bar. Moreover, the timing parameters utilized by the preferred embodiment of the present invention are intended to merely illustrative. Other timing parameters may be utilized as well. Still further, pointing devices other than the mouse may be used to position the cursor.