Display System With Nested Objects

This invention generally relates to improvements in display systems and more particularly to menu bar selection processing.

Subject matter in the present application is related to the invention in U.S. patent application; AT9-92-041; Ser. No. 07/888,221 filed May 26, 1992 under the title "DISPLAY SYSTEM WITH IMBEDDED ICONS IN A MENU BAR".

currently, graphical user interfaces present menu choices to a user using a combination of a menu bar and pull-down menus. An example of this technique is found in U.S. Pat. No. 4,772,882 which discloses menu item selection in a personal computer system through the use of a mouse device. The display system has means for allowing a user to invoke a header block which performs the function of a menu bar, and to erase the header block from the screen when menu operations are not required. Multiple menu items can be selected during the same menu session by using a pair of mouse buttons to generate a sequence of selection commands.

The menu bar, first popularized by Xerox and Apple in the early 1980s is typically a horizontal row of choices across the top of the display screen or across the top of a particular window on the display. A pull-down menu appears below a menu bar choice when a user selects a choice. The menu bar choices are represented by words such as FILE, EDIT, VIEW, OPTIONS, HELP and so forth.

Several of these interfaces represent objects as icons and allow a user to perform actions on a particular object by dragging its associated icon via a mouse, or by selecting choices from the menu bar and pull-down menus. U.S. Pat. No. 4,899,136 discloses a multiprocessor system with a user interface in the form of metaphoric objects, called icons, with which the user can interact by changing the input focus to a designated object by visually pointing to it via the input means, which thereafter permits manipulation of the designated object or interaction with data input/output relative to the designated object.

However, these interfaces provide little direct correlation between dragging actions and actions accomplished via the menus. They are treated as two separate and independent mechanisms. Users can become confused about the relationships of actions performed via the menus and via the dragging of the icons.

Microsoft has attempted to address some of the user's requirements for user selection of menu commands by providing a separate line of button commands that are referred to as a toolbar. The toolbar is located under the menu bar. However, the graphical representations cannot be dragged or otherwise manipulated by a user with the same degree of freedom as an icon. Finally, the button commands cannot be incorporated into the menu bar by the user.

The prior art is void of direct correlation between the group of choices in a pull-down menu and an object. Current menu-bar interface actions which affect a particular object are typically spread across multiple pull-down menus, and other actions may apply to two or more objects. Thus, users can become confused concerning which object that may be affected by a particular choice.

Accordingly, it is a primary objective of the present invention to include selections on the menu bar that are icons wherein the icons have associated nested menus of additional actions.

These and other objectives of the present invention are accomplished by the operation of an algorithm in the memory of a processor that provides for presenting a menu bar with imbedded icons. The icons can be selected to present nested levels of menu driven functions that are associated with the particular icons. From the menu, a user can directly perform nested, hierarchial operations associated with the icon upon another icon or other objects on a display.

FIG. 1A is a block diagram of a personal computer system in accordance with the subject invention;

FIG. 1B is a listing of pseudo code that sets forth the logic flow in accordance with the subject invention;

FIG. 1C is a flow chart that sets forth the logic flow in accordance with the subject invention;

FIG. 1D is a display showing an initial folder in accordance with the subject invention;

FIG. 2 is an illustration of a display with a window with the contents of a folder displayed in accordance with the subject invention;

FIG. 3 is an illustration of a display with a set of selections available for a particular icon in accordance with the subject invention;

FIG. 4 is an illustration of a display with a set of selections available for a particular icon in a menu bar in accordance with the subject invention;

FIG. 5, is an illustration of a display with a set of selections available for a particular icon in accordance with the subject invention;

FIG. 6 is an illustration of a display with a particular icon selected in accordance with the subject invention;

FIG. 7 is an illustration of a display with a particular icon in the menu bar selected and the selection choices for the icon presented in accordance with the subject invention;

FIG. 8 is an illustration of a display with a particular icon's associated document opened in accordance with the subject invention;

FIG. 9 is an illustration of a display with a particular document's pop up display invoked by selection from a menu icon in accordance with the subject invention;

FIG. 10 is an illustration of a display with a particular table selected in accordance with the subject invention;

FIG. 11 is an illustration of a pop up menu associated with a particular table in accordance with the subject invention;

FIG. 12 is an illustration of a direct invocation of a table from a particular selection and menu in accordance with the subject invention; and

FIG. 13 is an illustration of a display with a pop up menu associated with a particular icon in a report in accordance with the subject invention.

The invention is preferably practiced in a representative hardware environment as depicted in FIG. 1, which illustrates a typical hardware configuration of a workstation in accordance with the subject invention having a central processing unit 10, such as a conventional microprocessor, and a number of other units interconnected via a system bus 12. The workstation shown in FIG. 1 includes a Random Access Memory (RAM) 14, Read only Memory (ROM) 16, an I/O adapter 18 for connecting peripheral devices such as disk units 20 and tape drives 40 to the bus, a user interface adapter 22 for connecting a keyboard 24, a mouse 25, a speaker 28, a microphone 32, and/or other user interface devices such as a touch screen device (not shown) to the bus, a communication adapter 23 for connecting the workstation to a data processing network and a display adapter 29 for connecting the bus to a display device 27.

The invention is a method and system for displaying a menu bar with imbedded icons on the menu bar on a display device 27. The use of icons as part of the menu bar choices clearly identifies the object upon which actions are to be performed. Using icons to represent objects at each level of an object hierarchy is applied in a recursive fashion to enable decomposition of nested objects employing a consistent user interface at all levels of the hierarchy.

Icons can be dragged to accomplish actions in exactly the same manner as icons are used in other areas of the desktop motif. For example, dragging the icon of a document to a printer icon results in a print operation generating a paper version of the document. The invention allows users to drag icons from the menu bar to a printer icon with the same effect.

The invention provides a direct correlation between the dragging action and menu bar actions. Dragging actions on a particular icon perform actions that are listed as choices in an icon's associated pull-down menu. Thus, the dragging actions can then be thought of as simple shortcuts for corresponding menu choices.

The invention allows an icon to serve as a convenient handle for an object or group of objects that would otherwise be more difficult to manipulate. For example, when users select several objects in a window at the same time it is non-intuitive and confusing when the group of objects are dragged by one of the members of the group. Furthermore, the window may have been scrolled so that none of the selected objects are visible.

An icon in a menu represents a selected group regardless of how many selections are associated with the icon. Direct manipulation of the group is performed conveniently by simply dragging the menu bar icon that represents the selection group. Similarly, an icon from which a window is first opened is often covered by the window. The menu bar icon that represents the object is equivalent to the icon from which the window was opened, and the icon provides a convenient way to perform direct manipulation on the object displayed in the window. Thus, the use of icons as menu bar selections simplifies and enhances the interface of a user to a display system.

FIG. 1B is a listing of pseudo-program logic in accordance with the subject invention. As user input events occur, the events are trapped in a while loop at 0, and mouse events are analyzed at 12. Mouse events on the menu bar involving icons 13 are routed to the appropriate object 20, 24, 30 and 40 depending on the position of the mouse pointer on the display. Each object handles the mouse event by displaying the pop up menu associated with the object as shown at 22, 28, 32 and 42.

Mouse events associated with a pointer on the current selected object in a window 44 are routed to that object for display of the associated pop up menu 50. This logic is performed recursively for each set of objects and at each level of a nested object hierarchy. Thus, a call to a particular routine may result in another call to the same routine to complete the processing.

FIG. 1C is a flow chart that sets forth the logic flow in accordance with the subject invention. Processing commences at decision block 52 when a program detects a selection. At decision block 52, a test is performed to determine if a user has requested program termination. If the user has asked to terminate the Program, then processing is finished. If not, then further testing is performed at decision block 53 to determine if a mouse click event has been detected. If the event is not a mouse click, then other processing irrelevant to the subject invention is performed.

If the event is a mouse event, then a test is performed at decision block 54 to determine if the mouse was clicked on the menu bar. If the mouse click is not made on the menu bar, then another test is performed at decision block 55 to determine if the selection is on a current selection. If the click was detected on a noncurrent selection, then processing is passed to other logic irrelevant to the subject invention. However, if the click was in a current selection, then a pop up menu associated with the current selection is displayed as shown in function block 56 and control is passed to label 76 to continue other processing.

If the mouse was clicked on the menu bar, then control is passed to decision block 58 to determine if the icon is the icon that was opened to display the window. If so, then a pop up menu associated with the object icon is displayed as shown in function block 59 and control is passed to label 76 to continue processing.

If the icon was not the object icon, then another test is performed at decision block 60 to determine if the one icon represents the group of selected objects in this window. If so, then a pop up menu associated with the selected object is displayed at function block 62 and control is passed to label 76 to continue processing.

If the icon was not the selected object icon, then a further test is performed at decision block 64 to detect if the window icon has been clicked on. If so, then a pop up menu associated with the window icon is presented to the user as shown at function block 70 and control is passed to label 76 to continue processing.

If the icon was not the window icon, then a final test is performed at decision block 72 to determine if a help icon has been clicked upon. If so, then an associated pop up menu is presented at function block 74 and control is passed to label 76 to continue processing. If not a help icon, then processing is continued at label 76.

FIG. 1D is a display showing an initial folder 99 in accordance with the subject invention. The folder's contents are subsequently opened in FIG. 2 by a user desiring access to the contents. The menu bar 210 and title bar for the window 220 are combined in this example. One of ordinary skill in the art will realize that they could be separate lines of a window. The content of the menu bar 210 is: a folder icon representing the March Reports Folder 222; a title of the folder and type of view (March Reports--Icons) 223; an icon representing an object selected in the window 224 (none selected in this example); an icon representative of the window 226; and an icon representing a Help object (information (i)) 230. The two remaining symbols on the menu bar are buttons for sizing the window and are ancillary to the subject invention. The stripes behind the March Reports icon 250 on the desktop display indicate that a window is currently open on this object.

FIG. 3 is an illustration of a display with a set of selections available for a particular icon in accordance with the subject invention. When a user clicks a mouse button on the mouse with the cursor pointer 300 located over the folder icon on the desktop, a pop up menu 310 for the folder is displayed overlaying the desktop information 320. This menu is typically unique to the object it is associated with.

FIG. 4 is an illustration of a display with a set of selections available for a particular icon in a menu bar in accordance with the subject invention. If a user clicks a menu button on the mouse while the cursor pointer 400 is over a folder icon in the menu bar 420 of the display 430, an associated pop up menu is displayed as shown at 410.

FIG. 5 is an illustration of a display with a set of selections available for a particular icon in accordance with the subject invention. If a user clicks the menu button on the mouse when the cursor pointer 500 is over a report document icon 510, an associated pop up menu is displayed as shown at 520.

FIG. 6 is an illustration of a display with a particular icon selected in accordance with the subject invention. The report icon 600 is selected by positioning the cursor pointer 610 over the report icon and clicking the mouse button. This selection process associated the selected icon object 630 in the menu bar with the report that was selected.

FIG. 7 is an illustration of a display with a particular icon in the menu bar selected and the selection choices for the icon presented in accordance with the subject invention. Since the selected icon 700 in the menu bar is associated with the report icon 720, when a user clicks the menu button of the mouse while the cursor arrow 710 is positioned over the selected object icon, the same pop up menu 730 is displayed as in FIG. 5.

FIG. 8 is an illustration of a display with a particular icon's associated document opened in accordance with the subject invention. If a user opens a window by positioning the cursor arrow 810 over the report icon 800 and pressing the mouse button, a window 820 containing the report is presented to the user. Note that the new window 820 has a menu bar 830 with information associated with the report icon. The content of the new menu bar 830 is: a document icon 832 associated with the report icon 800; the title information 833; an icon representing a selected object 834 (none currently selected); an icon representing the new window 836; and an icon representative of a help function 838.

FIG. 9 is an illustration of a display with a particular document's pop up display invoked by selection from a menu icon in accordance with the subject invention. If a user presses the menu button while the arrow cursor 900 is positioned over the report icon in the title bar 910, a pop up menu 920 associated with the report is displayed.

FIG. 10 is an illustration of a display with a particular table selected in accordance with the subject invention. If a user clicks the select button on the mouse when the arrow cursor 1010 is over a table 1000, the table is selected.

FIG. 11 is an illustration of a pop up menu associated with a particular table in accordance with the subject invention. If a user clicks the menu button while the cursor arrow 1100 is over the table 1110, a pop up menu 1120 is displayed.

FIG. 12 is an illustration of a direct invocation of a table from a particular menu icon in accordance with the subject invention. A user opens a window 1200 by positioning the arrow cursor 1210 over the icon representing the selected table object 1220 of the menu bar 1222 and pressing the menu button. Another menu bar 1230 is created and displayed in the window 1200. The new menu bar 1230 has contents associated with the table, comprising: a table icon representing the table 1231, a title (March--Table) 1232, an icon representing an object or objects selected in the window (none are currently selected) 1234, an icon representing the window 1236, and an icon representing the help object 1238.

FIG. 13 is an illustration of a display with a pop up menu associated with a menu icon in a report in accordance with the subject invention. If a user presses the mouse button while the arrow cursor 1300 is positioned over the report icon 1310, then a pop up window 1320 appears on the display.

It should be clear to one of ordinary skill in the art that such nesting of windows could continue indefinitely to the cells and headings of the table, and the contents of each cell depending on the composition of the objects involved.

While the invention has been described in terms of a preferred embodiment in a specific system environment, those skilled in the art recognize that the invention can be practiced, with modification, in other and different hardware and software environments within the spirit and scope of the appended claims.