Computer Application Programs Data Input Interface for Handicapped Persons Responsive to Multiple Push Buttons for Selecting Data Stored in Binary Tree

This invention relates to a text processing method which may be practiced by a handicapped person who has access to a personal computer. Many word processing programs are available for editing and organizing text material, but these programs require entry of raw text via a keyboard. If an operator has normal eye-hand coordination, it is a relatively simple matter to produce neatly typed documents using such systems. However, these systems are not suitable for use by a person who has lost the normal use of the hands. Often times such persons have sufficient voluntary movement control for operating one or more fairly large switches but are unable to perform other more complex manual tasks. Accordingly, there exists a need for a system which will enable such handicapped persons to create processed text.

The problem of enabling communication by the handicapped has been addressed in a number of ways by the prior art. For instance, Kafafian U.S. Pat. No. 3,781,802 discloses a communication system comprising a plurality of keys which are configured for actuation by a handicapped person. These keys may be operated in various sequences for selection of solenoids which will cause the printing of symbols of the type appearing on a conventional typewriter keyboard.

Kafafian U.S. Pat. No. 3,798,599 discloses a communication system for the handicapped having a single-input transducer or switch for operation of a typewriter or the like. By operating the switch, the handicapped person causes the system to step through a two-dimensional matrix for selection of a symbol to be printed.

Dufresne U.S. Pat. No. 4,241,521 discloses a communication system wherein a series of symbols are arranged in a two-dimensional matrix for selection from an associated keyboard. The keyboard has UP, DOWN, LEFT, RIGHT, RECORD, and PLAY BACK switches which may be operated by a handicapped person to control selection of symbols from the array. Each symbol has an associated indicator light that is energized when the associated symbol has been selected.

It will be appreciated that all of the above prior art devices require tedious symbol-by-symbol selection. They merely replace a typewriter keyboard with another different type of keyboard. Thus their operating speed is a direct function of the speed at which a handicapped person is able to operate the switches. A somewhat different system is disclosed in Brown U.S. Pat. No. 4,274,753 wherein an electrical switch may be operated to select a plural digit number. The selected number corresponds to a message which may be any desired length. Another communication device which is not limited to selection of individual symbols is disclosed in Willough U.S. Pat. No. 4,406,998. In the Willough patent, means are provided for selecting either symbols or words from a message block. Clearly, neither the Brown nor the Willough device is suitable for text processing.

This invention provides a method of text processing wherein a dictionary of words is stored in a computer memory. A program is provided for causing the computer to display the letters of the alphabet on its monitor. A handicapped person operates one or more switches to select that letter which is also the first letter of a word to be processed. Upon selection of such a letter, the computer consults its memory and commences displaying words having the selected letter as their initial letter. Presentation of the words proceeds in accordance with a predetermined searching algorithm under operational control of the handicapped person. Selection of the desired word is signalled by the handicapped person through operation of a switch. The sequence is repeated until an entire message mas been selected. The assembled message may comprise all upper case letters, but preferably a routine is provided for enabling the handicapped person to cause appropriate punctuation of the assembled text.

In the preferred embodiment, the computer stores its dictionary of words in a series of files corresponding to the letters of the alphabet. Once a file has been selected, searching of the file proceeds on a binary basis. The first words selected for presentation to the handicapped person is the middle word of the file. Switching means are provided for enabling the handicapped person to cause the computer to search either forwardly or rearwardly through the file. Each operation of the switch causes the computer to advance in the selected direction halfway to the end of the file. This technique enables selection of any word within a 4,000 word file with no more than 12 switch closures.

It is therefore an object of this invention to provide an improved method for text processing by handicapped persons. Other further objects and advantages of the invention will be apparent from the following description, the accompanying drawings, and the appended claims.

FIG. 1 is a pictorial illustration of a system configured for practicing the text processing method of the present invention.

FIG. 2 is a wiring diagram for switches connected to a game port connector of an IBM Personal Computer.

FIG. 3 is a generalized flowchart for the method of the present invention

FIGS. 4-24 illustrate a series of monitor presentations during a typical text processing sequence; more specifically,

FIG. 4 illustrates the monitor presentation with the pointer pointing to a generally centralized location, namely the letter "M";

FIG. 5 is a similar monitor presentation with the pointer pointing at the letter "A";

FIG. 6 is a monitor presentation showing a first word beginning with the letter "A";

FIG. 7 illustrates a monitor presentation showing a second word beginning with the letter "A";

FIG. 8 is a monitor presentation illustrating a third word beginning with the letter "A";

FIG. 9 illustrates a monitor presentation illustrating the word "alloy" having been selected;

FIG. 10 is a monitor presentation illustrating the selection by the user of the "capitalized first letter" modification of the word "alloy";

FIG. 11 is yet another monitor presentation showing the word "Alloy" (with initial capitalization);

FIG. 12 illustrates the monitor presentation with the word "Alloy" selected and with the pointer returned to the M location;

FIG. 13 is a monitor presentation showing the letter "T" being selected;

FIG. 14 is a monitor presentation showing the word "toasty" being selected;

FIG. 15 is a monitor presentation showing the words "Alloy" and "toasty" having been selected and the pointer returned to the "M" position;

FIG. 16 shows the pointer at a symbol used to select a shifted keyboard;

FIG. 17 shows the alphanumeric choices corresponding to the shifted keyboard with the pointer at a generally central location;

FIG. 18 illustrates the selection of the letter "i";

FIG. 19 illustrates the letter "i" having been selected;

FIG. 20 illustrates the selection of the letter "s";

FIG. 21 illustrates the selection of the letters "i" and "s," thereby spelling the word "is";

FIG. 22 shows the selection of the option "do nothing to it";

FIG. 23 shows the resultant selection of the words "Alloy toasty is"; and

FIG. 24 is a final monitor presentation allowing the user to print the phrase "Alloy toasty is" to the printer.

FIG. 25 illustrates wiring connections for a game port connector as appropriate for an alternative embodiment of the invention.

FIG. 26 illustrates a monitor presentation during text processing in accordance with an alternative embodiment of the invention.

In the preferred embodiment of the invention, text processing is performed through use of a programmed personal computer known as the IBM PC and sold by International Business Machines Corporation of Armonk, N.Y. The specific embodiment described herein utilizes an IBM PC equipped with a 640 kilobyte RAM disk and a game port option. The system may appear as generally illustrated in FIG. 1 and includes four large momentary switches 32, 34, 36 and 38 connected into the game port terminal 40 (FIG. 2) at the rear of computer 42. A monitor 44, including a screen 46, is positioned for viewing by a handicapped person who desires to process text. A keyboard 45 is available for programming purposes and for printer control. Computer 42 is fully described in product literature available from the manufacturer and is programmed as discussed below.

The method of the present invention utilizes as disk operating system (DOS) available on a flexible disk supplied by the manufacturer of the computer and a specially prepared source program stored on another flexible disk. The source program is prepared in accordance with the listing set forth in Table I and is stored on a flexible disk in the customary manner. A dictionary of words divided into 26 files and stored on two flexible disks is also provided. These files are organized alphabetically and are named in accordance with their initial letters. Files A-M may be stored on one flexible disk, and files N-Z on the other. These files may be prepared by consulting a standard dictionary, loading the entries into the computer memory and thereafter off-loading onto the flexible disks in the customary manner.

Operation of the text processing method commences in the customary manner by booting DOS and then booting the program disk. Thereafter the A-M and N-Z flexible disks are placed into the left and right disk drives 48, 50, respectively, for reading onto the RAM disk in accordance with operating instructions provided by the computer manufacturer. Thereafter a series of presentations appear on screen 46 instructing the operator regarding the proper operation of switches 32, 34, 36 and 38. These switches are connected to game port terminal 40, as illustrated in FIG. 2, and are marked with the letter P, a left arrow symbol, a right arrow symbol, and the designation 9/E, respectively. The "P" switch is used for picking a file or a word within a file. The left and right arrow switches cause left and right progressive movement through symbols and files presented on screen 46. The "9/E" switch is used variously for initiating an editing function or ending a sequence. This switch may be operated for execution of either a "9" instruction or an "E" instruction.

As illustrated in FIG. 3, a text processing sequence commences with presentation of a list of word files (block 101). This is simply a listing of the letters A-Z on screen 46. Switches 34 and 36 are used to direct a cursor across the list of letters until the desired file is indicated. For instance, if the first word in the text to be processed in the word "alloy", then file "A" is first desired. When the cursor has been brought in position under the letter A, switch 32 is operated to pick the "A" file (block 102). Thereafter the computer causes the middle word in the "A" file to be presented on screen 46 (block 104). Then switches 34, 36 are operated to cause the computer to search through the words in the "A" file (block 108). In the preferred embodiment, the searching is done on a binary basis whereby the computer moves in the desired direction through the file halfway toward an established limit with each operation of switches 34 or 36 (block 109). When the desired word has been presented on screen 46, it is selected by operating switch 32 (block 107). After the word has been selected, the computer may be directed to enter an editing routine by operating switch 38. Decision points within the method are illustrated in FIG. 3 by the reference numerals 103, 105, 106 and 110. As hereinafter described in detail, the method may include provision for letter-by-letter construction of words not present in any of the stored files.

For a better understanding of the operation of the text processing method, reference now will be made to FIGS. 4-24, which present an example illustrating a series of screen presentations during a typical text processing sequence. FIG. 4 illustrates the screen presentation which appears upon entry into the text processing program. The screen presentation includes operating instructions and a line of 26 characters comprising the alphabet. A special "build" symbol is placed at the end of the alphabet, and a cursor in the form of an upwardly pointing arrow is directed at the letter "M."

The first step in the text processing method is to select the letter which is the initial letter of the first word comprising a message to be composed. By way of example, if the first word of the message is "alloy," then the operator selects the letter "A." This is done by operating the "left arrow" switch 34 repeatedly until the cursor is positioned below the letter "A." Operation of either of switches 34 or 36 causes binary cursor movement by calculating value for a cursor control variable M in accordance with the following logical sequence:

1. If the left arrow control is selected, then set R=M-1, where R is a right-hand limit variable and M is the value of the cursor control variable for the immediately preceding program loop. The initial value of M is 13 which causes cursor placement under the alphabetical letter "M," as shown in FIG. 4. The initial value of R is 27. There is also a left limit variable L, which has an initial value of 1. Operation of the left movement control 34 has no effect upon the value of L.

2. If the right movement control 36 is selected, then the value of R remains fixed and L is set to a new value in accordance with the equation L=M+1.

3. Calculate a new value for M in accordance with the equation M=INT((L+R)/2), where INT denotes the integer function.

4. Reset the position of the cursor in accordance with the new value of M.

After the first operation of switch 34, the value of M becomes 6, and the cursor points to the letter "F." After two more switch closures, the cursor points to the letter "A," as illustrated in FIG. 5.

After the letter A has been designated, the operator creates a pick command by depressing switch 32. This generates a letter designating signal which indicates to the computer that the initial letter of the first word of the message is "a." The computer then accesses its file of all such words and presents the middle word thereof on the lower left-hand corner of the screen, as illustrated in FIG. 6. For the purposes of this example, it is assumed that the middle word of the file is "anaphase". Thereafter the file of "A" words is switched on a binary basis as illustrated in FIGS. 7 and 8 by operating switches 34, 36. The logic is the same as for selection of an initial letter, except for the selection of the initial values for the variables M, L and R. M is assigned the value for the middle of the file. L is assigned a value of 1. R is assigned a value equal to the number of words in the file. For the example being described herein, a single operation of the left switch causes selection of the word "afro," as illustrated in FIG. 7. Thereafter a single operation of the right switch causes selection of the word "alloy," as illustrated in FIG. 8.

A this point, four options are available to the operator. The left, right and pick switches may be used to produce left searching, right searching, or selection of the word "alloy." Alternatively, the "9/E" switch may be operated to cause appearance of the display illustrated in FIG. 9. When this display is present, the operator is able to edit the word last produced by the search. Seven editing options are available. These options may be selected by moving the illustrated indicating arrow up or down with the left or right switches and then pressing either the "P" or "9/E" switch. As illustrated in FIGS. 10 and 11, the indicating arrow has been moved down to the phrase "Capitalize first letter," after which the "P" switch has been actuated to capitalize the word alloy.

After the first word has been edited, as described, the screen appears as illustrated in FIG. 12. The presentation is the same as the initial presentation illustrated in FIG. 4, except that the edited first word "Alloy" appears immediately below the alphabetical string. Thereafter the next word "toasty" is placed in the message by selecting the letter "T" and searching the corresponding file of "T" words, as illustrated in FIGS. 13-15.

FIGS. 16-23 illustrate a feature of the program whereby character strings may be assembled on a symbol-by-symbol basis. The first step is to place the cursor under the "build" symbol (FIG. 16) and operate the "P" switch to produce the display of symbols illustrated in FIG. 17. Thereafter the desired sequence of symbols are designated and picked, as illustrated in FIGS. 18-21. Those figures illustrate the sequence for building the word "is." In the particular program set forth in the attached program listing, cursor movement through the string of available symbols progresses on a symbol-by-symbol basis. However, the above described binary technique could also be used.

It will be appreciated that a data base of reasonable size most likely would include the word "is" within its file of "I" words. The above example is given merely for purposes of illustration.

After the desired string of symbols has been assembled, the operator actuates the "9" switch to produce the display illustrated in FIG. 22. At this point in the program, the operator may edit the selected string of symbols, as illustrated by the selections appearing on the screen of FIG. 22. In the illustrated example, the operator selects "Do nothing to it" and actuates the "9" switch. This produces a display of processed text, as illustrated in FIG. 23. The technique may be continued to produce any desired message. When text processing is completed, exits the program by operating the "9" switch to produce the display of FIG. 24. At this point, the computer is prepared to send the text to the printer upon actuation of any key on keyboard 45.

A program listing for implementing the above described operational sequence is set forth in Table I. This program listing is written in that version of the BASIC language, which is understood by the IBM PC. Reference may be made to manuals available from the manufacturer of that computer for an explanation of each of the instructions set forth in Table I. The variables used in Table I are defined in Table II.

In very general terms, the instructions set forth in lines 10-80 initialize the computer. Following the initialization, there is a jump to the subroutine at lines 1000-1270 which enable the operator to pick a variable from the screen. That corresponds to the operation described above in connection with FIGS. 4 and 5. In the event that the "build" symbol is selected, then the procedure described above in connection with FIGS. 16-19 is implemented by the instructions appearing at lines 100-170. The binary search of a dictionary file, as described above in connections with FIGS. 6-9, is implemented by the instructions appearing at lines 180-310 of the program listing

In lines 320-440 of the program listing, the computer enables the operator to pick or edit a word from a dictionary file or commence a new search within the file when the file has been exhausted by a presently pending search. Lines 450-470 strip blanks from the right side of a word and determine the length of the word. Lines 480-530 add a word to the current line of text, while lines 540-610 print the completed text upon the screen. Printing on the printer is effected by program lines 620-720.

Program lines 1000-7050 are a series of subroutines which are utilized by the main program. As noted above, the subroutine for picking a variable from the screen is set forth at program lines 1000-1140. Processing of switch inputs is accomplished by the subroutine at lines 1150-1270, and switch reading is accomplished by the subroutine at lines 2000-2140. These subroutines and the other subroutines set forth in the program listing will be readily understood by anyone having a working knowledge of the BASIC programming language.

In an alternative embodiment, switches 32, 34, 36 and 38 may be replaced by a single switch 57 wired into game port connector 40, as illustrated in FIG. 25. For the alternative embodiment, program lines 2010-3000 are modified to read as set forth in Table III. When the system is so configured and modified, the initial screen presentation appears as illustrated in FIG. 26. This presentation includes a line 58 containing left arrow, right arrow, "P" and "E." An arrow 60 is positioned above the line 58 and is strobed back and forth above the characters therein. Those characters correspond to the four switches 32, 34, 36, 38, and selection of one of the characters has the same effect as activating the corresponding one of the switches. Such selection is made by activating switch 57 when the arrow 60 is pointing toward the symbol to be selected. Line 58 and arrow 60 are presented on all screens displayed in connection with the alternative embodiment.

While the methods herein described constitute preferred embodiments of this invention, it is to be understood that the invention is not limited to these precise methods, and that changes may be made without departing from the scope of the invention, which is defined in the appended claims.