Method and Apparatus for Communicating With People

Communicating with individuals who cannot see nor hear is often very difficult. These individuals, because of their handicaps, are informationally deprived. Since few such individuals learn Braille, the almost universal mode of communication with the deaf and blind is the one-hand alphabet. Since there are only a few non-deaf people who know the one-hand alphabet, the deaf-blind individuals are limited to the number of people with whom they can communicate. Since the deaf-blind have so little opportunity to communicate, many of them are functionally retarded. Because they cannot see, it is necessary for them to feel configurations of the hand forming the one-hand alphabet thereby requiring physical contact with the person with whom they are communicating.

Other electromechanical means for "hands-off" communication with the deaf-blind are difficult and require the deaf-blind to learn a new code. For example, electro-stimulation via skin surface electrodes requires the learning of a new code, and presents the additional problem of maintaining a reliable and constant level of stimulation.

The one-hand manual alphabet can be found in Riekehof, Talk To The Deaf, Gospel Publishing House, 1445 Boonville Ave., Springfield, Mo., p.1 (Library of Congress, No. 63-17975). A copy of the one-hand manual alphabet is included with this application.

The present invention provides a means and apparatus for communicating with deaf and blind persons through the use of an electromechanical hand which forms letters of the one-hand manual alphabet. The hand is controlled by an electronic buffer that converts signals from the electric typewriter code to the one-hand manual alphabet code. The electronic buffer includes selection means to activate the electromechanical hand to form separate letters of the manual alphabet upon receiving control signals for each letter of the alphabet through a decoding section of the electronic buffer. The hand is programmed to proceed directly from one letter to another without return to a neutral position, if the next letter input has been received. A rest period for the electromechanical hand can be recognized by the deaf-blind as being the end of the sequence of letters forming a word. Practice will enable the deaf-blind to follow messages at higher repetition rates. With practice, the deaf-blind will be able to follow messages converted from 60 words-per-minute teletype signals into the one-hand alphabet.

It is the primary object of this invention to provide a method of communication with individuals who are both deaf and blind.

It is a further object of this invention to provide an apparatus for communicating with individuals who are both deaf and blind.

It is another object of this invention to provide a system for converting typewriter and teletype signals into the manual one-hand alphabet signals being simulated by an electromechanical hand.

It is still another objective of this invention to provide a "hands-off" communication system for deaf-blind persons so that persons unfamiliar with the one-hand alphabet can communicate with the deaf-blind without being in direct contact.

These and other advantages, features and objects of the invention will become more apparent from the following description taken in connection with the illustrative embodiment in the accompanying drawings.

FIG. 1 is an illustrative perspective view of a mechanical hand utilizing the present invention.

FIG. 2 is a block diagram illustrating electrical connections between a typewriter keyboard and the mechanical hand.

FIG. 3 is a more detailed block diagram showing all inputs from the typewriter keyboard through the decoding logic to the solenoid selector of FIG. 2.

FIGS. 4a and 4b are detailed electrical schematics for the solenoid selector shown in FIG. 2.

FIG. 5 is a top view of a finger with the outer surface removed.

FIG. 6 is a sectional view of FIG. 5 along section lines 6--6.

FIGS. 7a-7d illustrate different possible positions for the fingers and thumb on the electromechanical hand.

FIG. 8 shows TABLE II of the invention.

FIG. 8a shows TABLE IIa of the invention.

FIG. 9 shows a pictorial view of a mechanical hand of the invention.

The most universal method of communication with a person who is both deaf and blind is through use of the one-hand manual alphabet. By use of the one-hand manual alphabet, a person that is both deaf and blind would place his left hand on the right hand of a second person. Likewise, the second person would place his left hand on the right hand of the person that is both deaf and blind. As the deaf-blind person forms the characters of the one-hand manual alphabet with his right hand, the second person can read the hand signals, either visually or by feeling the hand. Likewise, the second person can communicate to the deaf-blind person by forming letters of the one-hand manual alphabet with his right hand. A deaf-blind person would feel the letters formed with his left hand.

However, deaf and blind persons have considerable problems communicating because so few individuals know the one-hand manual alphabet. Also, normal methods of communication by sound or sight seriously deprive deaf and blind persons of information. By use of the present invention of a electromechanical hand, other people who do not know the one-hand manual alphabet can communicate with the deaf-blind by use of the standard typewriter keyboard. A person that is deaf and blind could communicate with anyone by typing messages on a standard typewriter. Most deaf-blind persons can type or learn to type without great difficulty.

By use of the electromechanical hand shown in FIG. 1 as will be hereinafter described, a whole new field of communication has opened up for persons who are both deaf and blind, including the possibility of receiving teletype communications from distant points. This would also allow a deaf-blind person to "read" a book from a recording that could easily be made at the same time as the book is typed. The recording could be played and "translated" through the mechanical hand, thereby enabling the deaf-blind person to "read" the book.

Referring to FIG. 1 of the drawings, there is shown an electromechanical hand represented generally by reference numeral 16. The hand 18 is controlled by a series of cables, wires, rods or filaments that connect to actuators such as solenoids, motors, or other electrical drivers located in control box 20. For the purposes of this invention, the actuators will be solenoids and the control box 20 will hereinafter be called a solenoid control box 20; however, other types of actuators may be used. The hand 18 and solenoid control box 20 are located on a support structure 22.

The solenoid control box 20 receives inputs through input cable 24, which inputs will be subsequently described in more detail. Pursuant to input signals received through input cable 24, one or more solenoids contained in solenoid control box 20 would be activated thereby pulling any one of the fourteen cables or filaments connecting to the hand 18. The various positions of the fingers, thumb and wrist of the hand 18 as controlled by the solenoids in solenoid control box 20 are as follows:

The various positions of the fingers and thumb can be more clearly seen in illustrative FIGS. 7a-7d.

Without describing how the control signals are generated that are received through cable inputs 24 (which control signals will be subsequently described in more detail), movement caused by the energization of each solenoid will be described hereinbelow in conjunction with FIG. 1. When solenoid 1 is energized, the index finger is straightened by pulling cable I.sub.1. By pulling cable I.sub.3 upon the energization of solenoid 2, the index finger will be closed. Vertical movement of the index finger occurs about pivot points 26 and 27. Upon energization of solenoid 3, cable R.sub.B /I.sub.B is pulled thereby causing the index finger to move to the left about pivot point 28, and the ring finger to move to the right about pivot point 29.

Upon the energization of solenoid 4, the middle finger will straighten by pulling cable M.sub.1. Likewise, by the energization of solenoid 5, the middle finger will close by pulling cable M.sub.3. Vertical movement of the middle finger occurs around pivot points 30 and 31.

By the energization of solenoid 6, cable R.sub.1 is pulled thereby straightening the ring finger. Likewise, by energization of solenoid 7, cable R.sub.3 is pulled thereby closing the ring finger. The ring finger has vertical movement by pivoting about pivot points 32 and 33.

By the energization of solenoid 8, cable L.sub.1 is pulled thereby straightening the little finger. Likewise, by energizing solenoid 9, cable L.sub.3 is pulled thereby closing the little finger. Vertical movement of the little finger occurs about pivot points 34 and 35.

By the energization of solenoid 10, cable T.sub.3 is pulled thereby moving the thumb to the half-closed position. By the energization of solenoid 11, which automatically energizes solenoid 10, cable T.sub.3 is also pulled thereby moving the thumb to the fully closed position. Horizontal movement of the thumb occurs about pivot points 35 and 36. By the energization of solenoid 12, cable T.sub.B is pulled thereby moving the thumb down. Vertical movement of the thumb occurs about pivot point 37.

By the energization of solenoid 13, cable W.sub.B is pulled thereby moving the entire hand 18 down, with motion being about pivot point 39. By the energization of solenoid 14, cable W.sub.T is pulled thereby moving the entire hand 18 to the right with motion being about pivot point 40.

The position for the hand 18 as shown in FIG. 1 is the rest position wherein none of the solenoids 1-14 are energized. By proper selection of solenoids 1-14, each of the characters of the one-hand manual alphabet can be formed, or very closely approximated, so that a deaf and blind person feeling the mechanical hand 18 can recognize the characters of the one-hand manual alphabet being formed.

Referring now to FIG. 2, there is shown a block diagram of the electrical connections necessary for operation of the hand 18. The typewriter keyboard 41 should be of a standard type, such as an ASC II keyboard. For the purpose of the present invention, applicants have assumed that the typewriter keyboard 41 uses the standard code for information interchange as is found in USA Standard Code for Information Interchange (USA SC II) X 3.4-1957, USA Standards Institute; or Reference Data for Radio Engineers, 5th Ed., 1972, Howard W. Sams & Company, Inc., pp. 30-44 (Library of Congress No. 43-14655).

The standard output from the typewriter keyboard 41 is in straight binary as is illustrated in TABLE II and TABLE IIa shown in FIGS. 8 and 8a on page 18 for each letter being formed. Upon receiving the appropriate clock pulse from clock 42, a letter typed on the typewriter keyboard 41 will be fed into the decoding logic 43. By viewing FIGS. 2 and 3 in combination, a better understanding of the decoding logic can be obtained. All of the binary inputs from the typewriter feed directly into the decoding logic 43 when an enable pulse is received from the clock 42. Upon receipt of a strobe pulse from the decoding logic 43 by the typewriter keyboard 41, which strobe pulse is controlled by the clock sequencing 44 and master reset 45 (as will be explained in more detail hereinafter), the binary output from the typewriter keyboard feeds into decoding logic 43 via coded inputs b.sub.1 -b.sub.7. The decoding logic 43 utilizes standard off-the-shelf components for converting straight binary to individual characters representing the letters typed in typewriter keyboards. Such standard components could include a Motorola integrated circuit sold under part no. MC14515.

Clock 42 is an oscillator that generates a number of pulses per second and is enabled by the decoding logic. By use of a binary-coded-decimal to 1-10 converter in the sequencing logic 44, a series of clock pulses are generated from the sequencing logic 44. On the first clock pulse from clock 42, sequencing logic 44 generates an output pulse T.sub.1 which feeds into solenoid selector 46. Likewise, on the third clock pulse received from clock 42, the sequencing logic 44 generates clock pulse T.sub.3. Also, on the fifth, seventh and ninth clock pulses from clock 42, sequencing logic 44 generates clock pulses T.sub.5, T.sub.7 and T.sub.9, respectively. Each of the outputs from the sequencing logic, T.sub.1, T.sub.3, T.sub.5, T.sub.7 and T.sub.9 feed to the solenoid selector 46.

Upon receiving the ninth clock pulse from clock 42, the sequencing logic 44 will activate master reset 45 thereby resetting the decoding logic 43 and the solenoid selector 46, plus generating a strobe pulse to the typewriter keyboard 41 for strobing the next alphabetical character into the decoding logic 43. A standard component which can be used to form the sequencing logic 44 is an RCA integrated circuit sold under manufacturer's part no. CD4017. It should also be realized that master reset 45 may have a manual switch for the resetting of the logic thereby generating the T.sub.9 or reset R pulse. The manual reset is necessary for resetting the logic upon turning power ON for the system.

It is estimated through testing of the electromechanical hand 16 with various individuals that are both deaf and blind that the time necessary (in the beginning) for the reading of each character of the one-hand manual alphabet is approximately 0.6 second. Therefore, within 0.6 of a second, it is necessary that the clock 42 generate a total of 10 clock outputs. (This may be increased as reading speed increases.) The power supply 47 supplies electrical power necessary for the typewriter keyboard 41, decoding logic 43, solenoid selector 46, master reset 45, sequencing logic 44 and clock 42.

The outputs for the decoding logic 43 are normally high. When a particular letter has been selected, that output will drop to 0. When a particular solenoid has been selected via the solenoid selector 46, a solenoid driver 95 amplifies the signal to operate the selected solenoid 96. Power for operation of the solenoid driver 95 and solenoid 96 may be received from previously mentioned power supply 47, but because of design considerations in generating more than one voltage level, it is more practical to receive power from a separate power supply 97.

Referring to FIGS. 4a and 4b, the solenoid selector 46 will be explained in detail. The capital letters in FIGS. 4a-4b indicate connections to FIG. 3 as represented by the same capital letters, each capital letter being the same voltage line that corresponds to that particular letter being typed in the typewriter keyboard 41. Each reference to a solenoid hereinbelow will be referring to both the solenoid and its associated driver. Starting first with solenoid 1, if any of the inputs on NAND gate 48 drop to 0 indicating that letter had been selected, the output of NAND gate 48 would become high thereby energizing solenoid 1. Likewise, if any input for NAND gate 49 drops to 0 indicating that letter had been selected, the output of NAND gate 49 would become high thereby strobing NAND gate 48 to give a high output to energize solenoid 1, and strobing NAND gate 50 to generate a high output therefrom turning ON solenoid 5.

If any input for NAND gate 51 goes low indicating that letter has been selected, the output of NAND gate 51 becomes high thereby turning ON solenoid 2. The letter S which connects through inverter 52 to flip-flop 53 is delayed until time T.sub.3 if the letter S is selected. The flip-flop 53, which would be turned ON at time T.sub.3, would be reset at time T.sub.9. Therefore, if the letter S is selected, the output of NAND gate 51 would go high after a delay of three clock pulses until time T.sub.3. Likewise, the S input for NAND gate 50 would be delayed until time T.sub.3 for energizing solenoid 5.

If any of the inputs for NAND gate 54 goes low indicating that letter has been selected, the output for NAND gate 54 would become high thereby energizing solenoid 3. If any of the inputs for NAND gate 55 goes low indicating that letter has been selected, the output for NAND gate 55 will go high energizing solenoid 4. If any of the inputs for NAND gate 50 are selected, other than the previously described inputs, the output of NAND gate 50 becomes high thereby energizing solenoid 5. The letter X which feeds to NAND gate 50 through inverter 56 and flip-flop 57 is delayed until clock pulse T.sub.3 thereby energizing solenoid 5 only after a delay until clock pulse T.sub.3. Likewise, the letter X is delayed to NAND gate 58 which controls solenoid 7 and to NAND gate 59 via connection "a" which controls solenoid 9. Therefore, upon selection of the letter X, the energization of solenoids 5, 7 and 9 will be delayed by the flip-flop 57 until clock pulse T.sub.3, which flip-flop 57 is reset at time T.sub.9.

If any other letter inputs for NAND gate 58 are selected other than the letter X, the output for NAND gate 58 will immediately go high thereby energizing solenoid 7. If any of the letters received in NAND gate 60 are selected, the output of NAND gate 60 will go high, which output will strobe NAND gates 59 and 58 ON via connection "b" thereby energizing both solenoids 7 and 9. If any of the inputs on NAND gate 61 are selected, the output of NAND gate 61 will go high energizing solenoid 6. Likewise, if any of the inputs for NAND gate 62 are selected, the output for NAND gate 62 will go high thereby energizing solenoid 8. Other than the previously described inputs for NAND gate 59, if any other letters are selected thereby causing the particular input to go low, the output of NAND gate 59 will go high thereby energizing solenoid 9.

If any of the inputs for NAND gate 63 are selected, the output for NAND gate 63 will go high thereby energizing solenoid 10. If any of the inputs for NAND gate 64 are selected, NAND gates 65 and 66 are strobed ON thereby energizing solenoids 11 and 12, respectively. Any time NAND gate 65 is ON to energize solenoid 11, solenoid 10 will also be energized through diode 67. Diode 68 prevents the output of NAND gate 65 from feeding back to NAND gate 63. Therefore, solenoid 10 will always be energized if solenoid 11 is energized. Other inputs for NAND gate 65 or NAND gate 66 will energize solenoids 11 and 12, respectively. If any of the inputs for NAND gate 69 are selected, the output of NAND gate 69 will go high thereby energizing solenoid 13.

If the letters G or H are selected, NAND gate 70 will immediately go high thereby energizing solenoid 14. However, if the letter J is selected, the energization of solenoid 14 will be delayed until time T.sub.3 via inverter 71 and flip-flop 72. Flip-flop 72 will be set upon receiving clock pulse T.sub.3 and reset by clock pulse T.sub.9. If the letter Z is selected, a high input will exist for flip-flop 73 via inverter 74. A low output from flip-flop 73 will turn NAND gate 70 ON at time T.sub.3 because of the clock pulse received through NOR gate 75 and inverter 76. The flip-flop 73 will then be reset at clock pulse T.sub.5 via NOR gate 77 and inverter 78 thereby de-energizing solenoid 14 at time T.sub.5. However, solenoid 14 will be reenergized at time T.sub.7 via NOR gate 75 and inverter 76. Again, flip-flop 73 will be reset at time T.sub.9 via NOR gate 77 and inverter 78 thereby de-energizing solenoid 14. Motion created by solenoid 14 upon receiving the letter Z will appear as a sequenced motion that occurs at T.sub.3 and T.sub.5.

The energization of any of the solenoids 1-14 will cause the respective cable given in TABLE I to be pulled thereby causing motion of the hand 18 to form the letters of the one-hand manual alphabet. The selection of the proper solenoids to form each of the letters of the one-hand manual alphabet is determined by the solenoid selector 46 as described in detail hereinabove. The forming of illustrative letters of the one-hand manual alphabet will be demonstrated in more detail subsequently.

FIG. 1 simply shows the fingers in a diagramatic illustration, but does not show the mechanical structure internal to the finger. Referring to FIGS. 5 and 6 in combination, one possible mechanical configuration of the fingers is shown therein. In FIGS. 5 and 6, the covering of the fingers, which could be similar to the covering of an anthropomorphic dummy, has been removed. A base plate 79 extends outward inside hand 18 on which finger support 80 is mounted by any suitable means, such as screw 81. Pivot pin 82, which is anchored in finger support 80, pivotally supports first extension 83 of the finger. On the opposite end of first extension 83 from pivot pin 82 is located a second pivot pin 84 mounted thereon. Pivotally connected on pivot pin 84 is a second extension 85. First extension 83 and second extension 85 form the structure for the fingers. It should be noted that the joint of the finger closest to the finger tip has been maintained stiff and merely simulated by a small angle in second extension 85.

Around pivot pin 82 is located a sleeve 86 that is fixed with respect to first extension 83. Likewise, sleeve 87 around pin 84 is fixed with respect to second extension 85. A line 88 is tightly drawn in a cross configuration over sleeves 86 and 87 as shown with the ends being anchored to stop pins 89 and 90. By pulling on cable 91 that is anchored to stop pin 92 of first extension 83, first extension 83 will be pulled to the horizontal position as shown in FIG. 6. Likewise, because of the friction between line 88 and sleeves 86 and 87, second extension 85 will also be moved to the horizontal position as shown in FIG. 6. Contrary, if cable 93 is pulled which is anchored to pin 94 of first extension 83, first extension 83 will be moved clockwise around pin 82. Again, because of the friction between line 88 and sleeves 86 and 87, the second extension 85 will be moved clockwise around pin 84. Such clockwise motion will "close" the finger.

It should be realized that many other methods of construction of the individual fingers may exist, including the use of levers, pulleys, gears or many other mechanical connections.

Referring now to FIGS. 7a-7d, the various positions of the fingers and thumb are shown. FIG. 7a, which shows a side view of a finger, illustrates the three vertical positions of the finger. FIG. 7b, which shows a side view of the hand, illustrates the vertical positions of the thumb. FIG. 7c, which shows a top view of the hand, illustrates the horizontal positions of the thumb. FIG. 7d, which shows a top view of the hand, illustrates the horizontal positions of the index and ring fingers, both of which are simultaneously moved by solenoid 3.

Assume that the letter A has been typed on the typewriter keyboard 41. To form the letter A in the one-hand manual alphabet, reference is made to the incorporated reference of Talk To The Deaf. The ASC II binary output for the typewriter keyboard for the letter A is shown as zeros and ones for the information lines b.sub.1 -b.sub.7 in TABLE II and TABLE IIa. The decoding logic 43 converts the output from the typewriter keyboard 41 to give a low output for the letter A which is fed into the solenoid selector 46. As can also be seen in TABLE II, for the proper formation of the letter A in the one-hand manual alphabet, solenoids 2, 5, 7, 9 and 10 should be energized. This corresponds to the index finger being in the 3A position, the middle finger being in the 3 position, the ring finger being in the 3A position, the little finger being in the 3 position, the thumb being in the 2A position and the wrist being in the 1A position, all of which are given in TABLE II. Therefore, all of the fingers will be closed with the thumb pressed thereagainst to form the letter A in the one-hand manual alphabet.

Assume now that the letter S is selected. After decoding the ASC II binary output from the typewriter keyboard 42 via the decoding logic 43, a low output will be given for the letter S. The low output for the letter S will immediately energize solenoids 7, 9, 10, 11 and 12, thereby causing the ring finger to move to the 3A position, the little finger to move to the 3 position, the thumb to move to the 3B position. Thereafter, at time T.sub.3, the index finger will move to the 3A position and the middle finger will move to the 3 position, thereby forming the letter S for the one-hand manual alphabet.

Assume now that the letter Z is selected by the typewriter keyboard 41, which letter is strobed into the decoding logic 43. Immediately, the solenoid selector 46 will energize solenoids 1, 5, 7, 9, 10 and 12 thereby moving the index finger to the 1A position, the middle finger to the 3 position, the ring finger to the 3A position, the little finger to the 3 position, and the thumb to the 2B position. Thereafter at time T.sub.3, solenoid 14 will be energized moving the entire hand to the right in a motion simulating a pivot of the wrist. At time T.sub.5, solenoid 14 will be de-energized allowing the hand to return to its normal position; however, solenoid 14 will again be reenergized at time T.sub.7, again moving the entire hand to the right to form a sequencing motion illustrating the letter Z of the one-hand manual alphabet.

By following any particular letter from the typewriter keyboard through the truth table shown as TABLE II, a person can see in advance which solenoids will be activated thereby seeing the configuration of the hand. The configuration of the hand will approximate the one-hand manual alphabet as shown in the incorporated reference, which one-hand manual alphabet is the standard means for communication with the deaf and blind.

By use of the apparatus described hereinabove, any individual can communicate with a deaf and blind person practiced in the one-hand manual alphabet. Since the one-hand manual alphabet is the standard means for communicating with the deaf and blind, by use of the apparatus described hereinabove, the deaf and blind can communicate with almost anyone. Reversed communication from the deaf and blind to another person not so handicapped can be a simple typewritten message on a typewriter.

While the apparatus and method described hereinabove relates to the forming of letters of the English language, any given character may be formed with the apparatus. The character may be a number or letter of any language that can be represented with one-hand gestures. Minor circuitry changes or pivotal changes may have to be made to form other alphanumeric characters.