Controller

The present invention relates to a controller. More particularly the present invention relates to an electromagnetic system for the application of force feedback to the moveable platform of a controller.

The concept of applying force feedback to a manual controller has been advanced and in fact implemented.

An article entitled Computing with Feeling by Atkinson et al in Computers and Graphics, Volume II, 1977, pp. 97 to 103, describes providing a "touchy, feely" and "touchy, twisty" to the operator so that the operator has the feel of the actions taking place. These force feedback sensations were created for molecular designs and models, etc.

A paper entitled Artificial Reality with Force Feedback; Development of Desktop Virtual Space and Compact Master Manipulator in Siggraph, Dallas, Aug. 6-10, 1990, Iwata describes a force feedback system with a human interface for manipulation of mock ups of solid objects and a paper entitled Creating an Illusion of Feel; Control Issues and Force Display, Sep. 16, 1989 Ouh-Young et al, describes the use of force feedback to create an illusion of feel. The National Aeronautics and Space Administration in an Abstract publication NASA Technology Transfer Division-Force Feedback Control May 1990 describes the use of force feedback to repel the controller and create the illusion the cursor should not cross boundaries of images, or that the cursor is attracted toward a point and to guide the operators hand in following a straight line or even along a curve.

To advance further the feedback to the operator requires control of the element manipulated by the operator, e.g. the joystick.

U.S. PAT. NO. 3,919,691 issued Nov. 11, 1975 to Noel discloses gantry mounted platform movement which is controllable in two mutually perpendicular directions by electromagnetic motors and cable or belt drives to the gantry system to impede the movement of the control platform in the two mutually perpendicular directions.

U.S. PAT. No. 4,868,549 issued Sep. 19, 1989 to Affinito et al applies brakes to a ball in two mutually perpendicular directions. The brakes are operated by a computer to provide force feedback means to resist motion of the mouse or cursor.

It is an object of the present invention to provide a control which permits the effective application of x, y (or z) force feedback to impede or direct movement of the hand control in the x,y (or z) direction.

Broadly the present invention relates to a controller comprising a base, a platform, means for mounting said platform for a range of movement in a plane of at least 1/2 inches (12.5 mm) in each of two different directions, a first magnetic force applying means including a first magnet means mounted on said base and a first cooperating magnetic force generating means mounted on and moveable with said platform in position to interact with said first magnet means, a second magnetic force applying means including a second magnet means mounted on said base and a second cooperating magnetic force generating means mounted on and moveable with said platform in a position to interact with said second magnet means, said first force applying means being positioned and constructed to controllably apply selected forces to said platform in one of said two directions and said second force applying means being constructed and positioned to controllable apply selected forces to said platform in the other of said two directions and control means to selectively control said first and said second force applying means to generate said selected forces.

Preferably said two directions will be mutually perpendicular.

Preferably said controller will further comprise a sensor means for sensing the position of said platform relative to said base.

More preferably said sensor means will comprise a transparent grid mounted on and moveable with said platform and a light source and a detector means fixed relative to said base in positions wherein light from said source passes through said grid and is detected by said detector means

Preferably said first cooperating magnet force generating means including a first coil means position to interact with said first magnet means when a current is applied to said first coil means, and said second magnetic force generating means including a second cooperating coil means in a position to interact with said second magnet means when a current is applied to said second coil means, said first magnet means and said first cooperating coil means of said first force applying means being shaped and positioned so that in any position of said platform within said range said coil may be controlled to apply said selected force between each of said first and second cooperating coil means and its respective magnet means and wherein said control means selectively applies current to said first and said second cooperating coil means to generate said selected forces.

It is also preferred that the projected area of a field generated by said first magnet means onto said first cooperating coil means is substantially constant so that the application of a selected current to said first cooperating coil means generates the same force between said first magnet means and said first cooperating coil means regardless of the position of said platform within said range of movement, said second magnet means and said second cooperating coil means of said second force applying means being shaped and positioned so that in any position of said platform within said range the projected area of a field generated by said second magnet means onto said second cooperating coil means is substantially constant so that the application of a selected current to said second cooperating coil means generates the same force between said second magnet means and said second cooperating coil means regardless of the position of said platform within said range.

Preferably said first cooperating coil means will comprise a first elongated substantially planar coil having its major axis extending substantially parallel to said plane and to one of said pair of mutually perpendicular directions and said second cooperating coil means will comprise a second elongated substantially planar coil having its major axis substantially parallel to said plane and said other of said mutually perpendicular directions.

Preferably said first magnet means and said second magnet means each will comprise a pair of permanent magnet means, one permanent magnet means of each said pair located on one side of its said cooperating coil means and the other permanent magnet means of each said pair of permanent magnet means located on the side of its said cooperating coil means opposite its respective said one permanent magnet means.

Preferably each said permanent magnet means is configured with with its magnetic poles facing in opposite directions and with their polar axes substantially parallel to the plane of said planar coils.

More preferably said polar axis of each said permanent magnet means is substantially parallel to said major axis of its respective cooperating planar coil.

Preferably said means for mounting will comprise gantry means

Further features, objects and advantages will be evident from the following detailed description of the preferred embodiments of the present invention taken in conjunction with the accompanying drawings in which:

FIG. 1 is an exploded schematic illustration of the main component of the controller of the present invention.

FIG. 2 is an exploded view illustrating how the platform is mounted.

FIG. 3 is an exploded view of one pair of cooperating magnets and cooperating coil.

FIG. 4 is an exploded view of multi-layered planer actuator coil forming the electromagnet.

FIG. 5 a schematic exploded illustration of the permanent magnetic the cooperating coil with the plot of field strength of the permanent magnets applied thereto.

FIG. 6 is an exploded view of the handle which may be used with a mouse of the present invention.

FIG. 7 is a section through the handle of FIG. 6 illustrating the construction of the actuator for the tactile element.

FIG. 8 is a schematic illustration of a hand controller or joystick that may be used in place of the control button of the controller.

FIG. 9 is an exploded view similar to FIG. 1 but illustrating the incorporation of a z direction controller.

FIG. 10 is an isometric illustration of the z controller.

FIG. 11 is a schematic illustration of the control system of the present invention.

FIG. 12 is an illustration of a typical program window that would be shown on a model illustrated some of the applications to which the present invention may be applied.

The controller 10 illustrated in FIG. 1 includes a base element 12 and a cover 13 between which a platform 14 is mounted on a mounting system 16 that may take any suitable form, and in the illustrated embodiment is in the form of a gantry system 16 mounting the platform 14 from the base 12. The mounting system 16 permits of the platform 14 to move in two mutually perpendicular directions (as will be described in more detail hereinbelow).

A suitable controller or handle 18 having a push button switch 20 (used in a conventional manner of a typical mouse) is mounted on the platform 14.

The controller or handle 18 may also be provided with a tactile system which through movement of the tactile feedback element 22 may be used to apply pressure to the operator or used tin reverse to control an operation (as will be described hereinbelow).

The gantry 16 is more clearly indicated in the exploded view of FIG. 2. As illustrated it comprises a pair of similar one degree of freedom sliding frame units 24 and 26. The first frame unit 24 consists of parallel mounting bars 28 and 30 fixed to the base 12 and a pair of parallel rods 32 and 34 extending between and perpendicular to the mounting 28 and 30. A pair of spaced substantially parallel bars 36 and 38 extend substantially to and are slidable mounted on the rods 32 and 34 via guiding aperture 40 and 42 to permit the bars 36 and 38 to slide therealong.

The bars 36 and 38 of the first frame element 24 are held in spaced relationship by a pair of end mounting bar 44 and 46 which act in the same manner as the bars 28 and 30 but to mount a second pair of parallel mounting rods 48 and 50 oriented substantially perpendicular to the rods 32 and 34.

These rods 48 and 50 mount a second pair of parallel bars 52 and 54 similar to the bars 36 and 38 and provided with guiding holes 56 and 58 for movement of the bars 52 and 54 along the rods 48 and 50 so that the second frame unit 26 slides in the direction perpendicular to the direction in which the first frame unit 24 slides. The platform 14 is mounted on the second frame 26, i.e. is fixed to the bar 52 and 54.

The exploded view of FIG. 2 will also be used to explain the operation of the position sensor which determines the position of the platform' 14 relative to the base 12. In the FIG. 2 illustration the position of the platform 14 is determined using the grid or mesh 60 of mutually perpendicular uniformly spaced lines that influence the transmission of light through the grid in a manner different from the spaces between the lines. The lines of the grid 60 are preferably oriented so that one set of parallel lines is parallel to the rods 32 and 34 and the other set is parallel to the rods 54 and 56, The grid 60 is the operative part of the platform 14 required to determine position.

Fixed to the top cover 13 is a suitable light source 62 which projects a beam of light 64 through the grid 60 onto a detector 66 fixed to the base 12. It will be evident that as the grid 60 is moved with the platform 14, each element (line) of the grid disrupts the light beam 64 as that element (line) traverses the beam 64. The disruption is sensed by the optical detector 66 which detects movements in the two mutually perpendicular directions.

The detector system or position detecting system described above may be replaced by any other suitable position detector.

The force applying actuators 70 or 72 (of FIG. 1) are essentially the same but are oriented in the controller 10 in mutually perpendicular relationship to the other. These actuators 70 and 72 control force applied to the platform 14. Each is composed of a pair of permanent magnets 74 and 76 fixed to the base 12 and cover 13 respectively and a flat or planer coil 90 mounted on the platform 14 and interposed between the fixed magnets 74 and 76, The actuators 70 and 72 are constructed essentially the same and thus like reference numerals have been used to illustrate like parts of the respective actuators 70 and 72.

The stationary magnet assemblies 74 and 76 are each composed of a pair of permanent magnets 78 and 80 mounted on a return plate 82 which magnetically interconnects the magnet 78 and 80.

In the arrangement illustrated in FIG. 3, the magnetic field between the corresponding magnets 78 of each pair of stationary magnets 74 and 76 in each of the actuators 70 and 72 extends as indicated at 84 (upward in FIG. 3) while field between the corresponding magnets 80 of each pair of stationary magnets 74 and 76 in each of the actuators 70 and 72 extend in the opposite direction as indicated at 86 (downward).

Each of the actuators 70 and 72 includes an actuator coil 90 (eg. a Lorentz voice coil) mounted on-with the platform in a position to cooperates with the magnet 74 and 76. of its respective actuator 70 and 72. The coil(s) 90 as schematically illustrated in FIG. 4 is formed by interconnected coil winding 92, 94, 96 and 98 (only 4 shown) each embedded in its own coil plate 92A, 94A, 96A, and 98A respectively. Electrical power may selectively be introduced to the outer turns of the upper and lower windings 92 and 98 as indicated by the leads 100 and 102 and the windings are electrically interconnected via jumpers 104, 106, 108. The jumper 104 connects the inner turn of winding 92 with the inner turn of winding 94, the jumper 106 connects the outer turn of winding 94 with the outer turn, of winding 96 and the jumper 108 interconnects the inner turn of winding 96 with the inner turn of winding 98 so that the current travels in the same direction around each of the windings 92, 94, 96 and 98 and generates reinforcing lines of flux. The windings, shown in the exploded view of FIG. 5 could be manufactured directly on a printed circuit board which would obviously also serve as coil plate. If necessary a multi-layered printed circuit board that could be used to increase the amount of current.

In a particular example of the actuator coil constructed as shown in FIG. 3 the coil 90 had a thickness of approximately 2.5mm and there was a clearance of approximately 1.25mm between the coil 90 and each of the magnets 74 and 76 (it is preferred to make the clearance smaller than this i.e. as small as possible or practical). The width W of each of the magnets 78 and 80 of this specific example were about 17mm while the gap G between the two magnets 78 and 80 was about 3mm so that the total width of the magnet 74 and 76 was 37mm.

The width W.sub.c of each side 87 and 89 on opposite sides of the core 91 of the wound coil 90 in the example shown in FIG. 3 was 17mm and the length of the opening as indicated by the dimension L was 48mm to accommodate the axial displacement of the coil 90, i.e perpendicular at the arrows 110 and 112 which indicate the direction of force applied when the coil 90 is active by current flow in one direction or the other as will be described below.

The widths W and W.sub.c and the width of the core 91 are coordinated to ensure that at all times the total projected area of the permanent magnets 78 and 80 onto the coil 90 remains constant over the range of movement of the coil 90 which is depicted by the dotted line 114.

The size of the coils 90 particularly their longitudinal axes have a significant influence on the range of movement of the platform 14 relative to the based. This range preferably will be at least 1/2 inch (12.5mm) in each of the two mutually perpendicular directions and preferably at least 1 inch (25mm) in each of those directions.

FIG. 5 illustrates the electromagnetic field that will be generated by each of the magnet 74 and 76 measured in the plane of the coil 90 mounted on the platform 14.

The width W of the permanent magnet 80 will be the same for each of the magnets 80 and for the magnets 78 and the spacing G therebetween will also be the same, but may be selected differently depending on how actuator coil 90 mounted on the platform 14 is constructed. The dimensions of the coil 90, i.e. width W.sub.C and length L as above indicated define the permitted movement of the platform 14. In the arrangement illustrated in FIG. 3, in the neutral position, i.e. the position where the light beam 64 is in the centre of the grid 60, the magnets 78 and 80 are positioned as indicated in dotted lines at 88, in the centre of the coil 90 with half (1/2 ) of the projected area of each of the magnets 78 and 80 overlapping respectively with sides 87 and 89 of the coil 90.

It will be apparent that in this position if the platform is moved in the directions of the 110 or 112 the same amount of one of the projected areas moves from overlapping with the coil 90 into the core space 91 that moves from the space 91 into the coil 90 and that movement in the axial direction of the coil 90 does not change the relative amount of area directly subjected to the magnetic field of the permanent magnets 78 and 80.

Thus a given current through the coil 90 in one direction develops the same force regardless of the position of the platform within its range of movement. If the platform is moved so that the projections 88 extend beyond the length L in either direction, the total force generated between the coil 90 and the magnets 74 and 76 will not remain constant.

For the illustration in FIG. 3 the gap G is relatively narrow and the width of the core 91 of the coil 90 is relatively wide since the magnets 78 and 80 project into the core 91. In an alternative arrangement as illustrated in FIG. 1 the magnets 78 and 80 have been spaced farther, i.e. the gap G has increased dramatically so that half of magnet 78 project outside of the coil 90 as does half of the magnet 80. The arrangement of FIG. 1 and 5 is preferred as it permits using a narrower coil 90.

The width of the coil as indicated at W.sub.c defines the amount of movement that can be accommodated in the direction of the arrows 110 and 112 while maintaining the constant force application for a given current. In the FIG. 3 arrangement the effective maximum width W.sub.c of each side of the coil 90 should not exceed

as if this width is exceeded movement of the platform in the directions 110 or 112 might result in more projected area of the magnets 78 and 80 onto the coil 90.

FIG. 5 shows the magnetic field form the permanent magnets 78 and 80 via the dash line 93, it being a maximum directly between the aligned magnets 78 or 80.

In operation with a given current i in the conductor of the coil 90 with a differential element length d1, a differential force dF will be exerted on the conductor when crossed by the magnetic field B generated by the magnet 74 and 76. The mathematical relationship is

By integrating over the portions of the coil 90 that intersect the effective flux areas of the permanent magnets 74 and 76, a total force F is seen to act along one axis with its orientation dictated by the direction of the current. It follows that the x and y direction actuation forces on the coil 90 can be controlled by two independent, bi-directional currents. An embedded micro-controller 67 (see FIG. 1) may be used for controlling the motion sensing and force actuation of the system. This micro-controller determines the movement of the platform as above described by the interruption of the beam 64 by the line grid. When motion is detected, the micro-controller 67 sends the appropriate information packet through a connection to the computer's mouse port where it is interpreted by that system's mouse driver in the same way as it would for a common mouse.

After calculating the position of the platform 14, the micro-controller's control program also calculates any necessary feedback forces and causes their actuation by turning on current drivers that excite one or both of the x and/or y direction coils 90.

While it is preferred to construct the platform 14, coils 90 and permanent magnets 47 and 76 as above described so that anywhere within the normal range of movement of the platform 14 a given current to the coils 90 imparts the same force to the platform 14 in the selected direction, it is also possible to construct the coils 90 and magnets 74 and 76 so that the same projected area of the permanent magnets 74 and 76 onto the coils 90 does not occur throughout the complete range of movement of the platform 14 relative to the base 12 and to vary the current applied to the coils 90 based on the relative position of each of the coils 90 with its respective permanent magnets 74 and 76 so that the current will be adjusted to generate the desired force by applying a current that will obtain that desired force at that relative positioning of the coil 90 and its respective magnets 74 and 76. Depending on the shape and size of the coils 90 this may require active adjustment (for example on the basis of lookup tables) based on limited movements of the platform 14 relative to the base 12 and for that reason the previously described arrangement permitting the use of a constant current for a given force anywhere within the normal range of relative movement between the platform 14 and the base 12 is preferred.

The mouse handle 18 is shown in exploded view in FIG. 6 and includes as above described an actuator button 20 and a tactile element 22. The button 20 actuates a micro switch 118 while the tactile element 22 is controlled by an E-core type magnet 122 with a coil as schematically indicated at 124.

The structure of the tactile element is more clearly shown in FIG. 7 and includes an E-core magnet 122 with a coil 124 wrapped around its inner leg which is positioned to cooperate with a permanent magnet 126 mounted on the tactile element 22.

A pair of springs 128 and 130 tend to hold the tactile element in its lower most position as illustrated i.e. closest to the core 122, however when the coil is activated the repulsion of the magnet 126 from the core 122 and the coil 124 is stronger than the tension in the springs 128 and 130 so that the tactile element moves upwardly away from the core 122 with the amount of movement being dependent on the current in the coil 124.

The position of the tactile element 22 is such that it contacts with the hand of the user and when activated applies pressure thereagainst, the pressure being proportional to the amount of current passing through the coil 124.

Other types of handles may be used if desired, for example, the control handle 131 in FIG. 8, which takes the form of a joystick control may also be used and may be provided with further controller buttons as schematically indicated at 132 and further tactile elements as indicted at 134, 136 and 138 on the joystick 140. Tactile elements may be operated in a similar manner to the tactile element 22 described above and the control elements 132 may take the form of pressure switches or the like.

In the event a controller for controlling three degrees of freedom is required, the handle 18 or 140 may be replaced by or modified to provide z axis control, for example instead of the tactile element 22 functioning as a tactile element it could be used as a z controller by providing a suitable position sensor to sense the position of the element 22 when it is displaced from a rest position or alternatively as a bi-stable switch for limited z direction control.

A z direction controller 142 is illustrated in FIG. 9. This controller 142 is fixed to the platform 14 enclosed by a top 13A replacing and similar to the top 13 but modified to accommodate the z direction controller 142.

In the embodiment illustrated in FIG. 9, like reference numerals have been used to indicate like parts of those in FIG. 1.

The configuration of the coil 90 and of the permanent magnet 74 and 76 in FIGS. 1 and 9 are significantly different, in the FIG. 9 arrangement the permanent magnets in neutral position project to the outside of the sides 87 and 89 while in FIG. 3 they were on the inside.

The z direction controller 142 is composed of a frame 144 which is fixed to the platform 14. Mounted to the frame 144 are parallel rods 146 and 148 fixed at their upper ends to the bar 150 and their bottom ends to the cross base 152. The rods 146 and 148 are perpendicular to the rods 32,34,36 and 38. A platform 154 on which is mounted a coil plate 156 similar to the coil plate 90 described hereinabove is slidable mounted on the rods 146 and 148 via bars 170 and 172 with suitable opening to receive the rods 146 and 148 (similar to the manner in which the platform 14 is mounted).

The coil plate 156 cooperates with a pair of permanent magnets 158 (only one shown) equivalent to the permanent magnets 74 and 76 described hereinabove.

An LED or other light source 160 projects light through encoding 162 which is provided with a plurality of uniformly spaced horizontal lines between which the light from the source 160 projects so that movement of these lines disrupts the light from the source 160. Light passing through the grid or encoder 162 is focused via lens 164 onto sensor or photo detector 166 which generates a signal substantially in the same manner as the encoder 66 and 67 for the platform 14.

The platform 154 is provided with a handle 168 moveable in the z direction on the rod 146 and 148 and is used to manipulate the platform 14.

Force feedback is applied to the handle 18, 140 or 168 is generated by programming a computer. For demonstration purposes the configuration shown in FIG. 11 was used wherein a first display station computer 200 was interconnected with a mouse controller 202 by two lines of serial communication 204 and 206 respective specifically a connection to the mouse port for supplying the work station with mouse motion data and a connection from a serial port for receiving commands and screen information from the work station.

A second computer 206 was connected to the mouse controller 202 and was used as a monitor for loading new code into memory on the controller board. A suitable power supply 210 provides power to the driver 212 for the controller 10.

The software is running on both the computers 200 and 208 so the responsibilities of the two units must be properly divided.

Preferably the mouse 202 will send movement and button status data to the computer 200 where software calculates the desired forces for that particular pointer location and sends that force information to the micro controller which in turn drives the coils 90, 124 and 156 as required. However, this requires a very high powered computer and therefore to simplify to permit operation with the equipment available the computer 200 responsibilities were limited to handling the usual x window events, process input to maintain graphic interface and to initiate a synchronous transmission of non-real time commands to the micro controller when necessary. The micro controller is given the responsibility of doing the mouse position sensing to control movement and the transmission of mouse status data to the host mouse port and at the same time respond to commands from the host 200 and store in memory the locations of icon, windows, buttons, etc. that are activated on the display and to interactively calculate the necessary feedback forces with respect to pointer or curser positions during control movements.

FIG. 12 shows an example of a graphic user interface that could be augmented with tactile and kinesthetic interface using the present invention. The various lettered designations illustrate some of the features that may be obtained using the force feedback of the present invention.

A. The mouse may be programmed to constrain the cursor for movement along a straight edge.

B. indicates a menu bar that may be programmed as kinaesthetically stable place when it is approached from below so that the user can move the pointer rapidly in the direction of the menu bar from below and when it reaches the menu bar force feedback applied to the control handle to stop the motion of the controller and thus of the pointer.

The menu bar itself may be provided with bi-stable tactile elements to indicate when the pointer moves from one menu item to the next.

C. indicates a vertical menu. In this system the mouse could be set to permit the pointer to move only vertically up or down the menu.

D. The scroll bar shown at D may be supplemented with force feedback applied to the arrow used for the scrolling process by allowing the user to move faster and be more carefree when trying to position the pointer over the arrow. This can be done by creating forces at the sides on the arrow that prevent the pointer from overshooting, i.e. it would impede the mouse as it moves across the arrow.

The force feedback system could be also be used to actuate the computer rather than the button or switch mounted on the handle EG.switch 20. The mouse would simulate a button press in its transmission to the computer whenever the force with which the user pushes against one of the sides of the arrow exceeds a threshold.

E. shows a thumb type scroll bar which is similar to the arrow type scroll bar and to which force feedback could be applied to form a stable position in the bar and prevent the pointer from overshooting and constrain the pointer from going beyond the thumb opening. After the pointer is in position within the thumb opening pressing the pointer against the top or bottom of the thumb opening, the thumb would follow the motion of the pointer.

Furthermore, as the thumb is moved a damping force could be added and the motion direction, giving the user feedback in the form of a viscous drag sensation and when the thumb has reached the limit of its range appropriate force could be applied to the handle.

F. Command Soft button manipulatable by movement of the pointer or curse to initiate command i.e. soft buttons that may be pressed by the pointer and the tactile sense of pressing a button transferred back to the controller handle so that the feel of pressing a button.

G. shows further examples of soft buttons that could be used in a manner similar to icons and incorporate in the software a force gravitational scheme to facilitate user arriving at the button.

H. shows tactile regions wherein examples of specific tools may be selected The use of a bi-stable tactile feedback system could be employed to make user selection of the desired tool more quick and accurate.

I. indicates a system wherein gravitational force may be applied to draw the cursor pointer to the icon when it comes within a certain preselected distance of the icon.

J. demonstrates a window boundary wherein force feedback would be designed to prevent the pointer or cursor from traversing such a boundary or apply force when the window is entered or exited.

It will be apparent that by programming, control of the power to the coils 90, 122 and 156 may be accomplished making it possible to apply any desired force feedback to the handle i.e. the position of the handle corresponds with the position of the pointer which provides the necessary information to apply force feedback coordinated with the position of the pointer on the monitor.

The coils 90 throughout description have been defined as having their longitudinal axes mutually perpendicular which is the preferred arrangement, but it will be apparent with appropriate software modification it is possible to arrange the coils differently i.e. so their axes extend in different directions that are neither parallel nor perpendicular

Having described the invention, modifications will be evident to those skilled in the art without departing from the spirit of the invention as defined in the appended claims.