Providing force feedback to a user of an interface device based on interactions of a user-controlled cursor in a graphical user interface

Patent Citations (286)

Non-Patent Literature (129)

• MagicMouse: “Tactile and Kinesthetic Feedback In The Human-computer Interface Using An Electromagnetically Actuated/output Device”, Dept of EE Univ of British Columbia (Oct. 19, 1993).Examiner
• Baigrie, “Electric Control Loading—A Low Cost, High Performance Alternative,” Proceedings of Interservice/Industry Training Systems Conference, pp. 247-254, Nov. 6-8, 1990.Applicant
• Iwata, “Pen-based Haptic Virtual Environment,” 0-7803-1363-1/93 IEEE, pp. 287-292, 1993.Applicant
• Russo, “The Design and Implementation of a Three Degree of Freedom Force Output Joystick,” MIT Libraries Archives pp. 1-131, May 1990, archived Aug. 14, 1990.Applicant
• Brooks et al., “Hand Controllers for Teleoperation—A State-of-the-Art Technology Survey and Evaluation,” JPL Publication 85-11, NASA-CR-175890; N85-28559, pp. 1-84, Mar. 1, 1985.Applicant
• Jones et al., “A perceptual analysis of stiffness,” ISSN 0014-4819 Springer International ( Springer-Verlag); Experimental Brain Research, vol. 79, No. 1, pp. 150-156, 1990.Applicant
• Burdea et al., “Distributed Virtual Force Feedback, Lecture Notes for Workshop on Force Display in Virtual Environments and its Application to Robotic Teleoperation,” 1993 IEEE International Conference On Robotics and Automation, pp. 25-44, May 2, 1993.Applicant
• Snow et al., “Model-X Force-Reflecting-Hand-Controller,” NT Control No. NPO-17851; JPL Case No. 7348, pp. 1-4 with 45 pages of attachments, Jun. 15, 1989.Applicant
• Ouh-Young, “Force Display in Molecular Docking,” Doctoral Dissertation, University of North Carolina at Chapel Hill, UMI Order No. 9034744, p. 1-369, 1990.Applicant
• Tadros, “Control System Design for a Three Degree of Freedom Virtual Environment Simulator Using Motor/Brake Pair Actuators,” MIT Archive, pp. 1-88, Feb. 1990, archived Aug. 13, 1990.Applicant
• Caldwell et al., “Enhanced Tactile Feedback (Tele-Taction) Using a Multi-Functional Sensory System,” 1050-4729/93, pp. 955-960, 1993.Applicant
• Adelstein et al., “Design and Implementation of a Force Reflecting Manipulandum for Manual Control research,” DSC- vol. 42, Advances in Robotics, pp. 1-12, 1992.Applicant
• Gotow et al., “Controlled Impedance Test Apparatus for Studying Human Interpretation of Kinesthetic Feedback,” WA11-11:00, pp. 332-337.Applicant
• Stanley et al., “Computer Simulation of Interacting Dynamic Mechanical Systems Using Distributed Memory Parallel Processors,” DSC-vol. 42, Advances in Robotics, pp. 56-61, ASME 1992.Applicant
• Russo, “Controlling Dissipative Magnetic Particle Brakes in Force Reflective Devices,” DSC-vol. 42, Advances in Robotics, pp. 63-70, ASME 1992.Applicant
• Kontarinis et al., “Display of High-Frequency Tactile Information to Teleoperators,” Telemanipulator Technology and Space Telerobotics, Won S. Kim, Editor, Proc. SPIE vol. 2057, pp. 40-50, Sep. 7-9, 1993.Applicant
• Patrick et al., “Design and Testing of A Non-reactive, Fingertip, Tactile Display for Interaction with Remote Environments,” Cooperative Intelligent Robotics in Space, Rui J. deFigueiredo et al, Editor, Proc. SPIE vol. 1387, pp. 215-222, 1990.Applicant
• Adelstein, “A Virtual Environment System For The Study of Human Arm Tremor,” Ph.D. Dissertation, Dept. of Mechanical Engineering, MIT, Jun. 1989, archived Mar. 13, 1990.Applicant
• Bejczy, “Sensors, Controls, and Man-Machine Interface for Advanced Teleoperation,” Science, vol. 208, No. 4450, pp. 1327-1335, 1980.Applicant
• Bejczy et al., “Generalization of Bilateral Force-Reflecting Control of Manipulators,” Proceedings Of Fourth CISM-IFToMM, Sep. 8-12, 1981.Applicant
• McAfee et al., “Teleoperator Subsystem/Telerobot Demonstrator: Force Reflecting Hand Controller Equipment Manual,” JPL 1988, JPL D-5172.Applicant
• Minsky, “Computational Haptics: The Sandpaper System for Synthesizing Texture for a Force-Feedback Display,” Ph.D. Dissertation, MIT, Jun. 1995, archived Jul. 6, 1995.Applicant
• Jacobsen et al., “High Performance, Dextrous Telerobotic Manipulator With Force Reflection,” Intervention/ROV '91 Conference & Exposition, Hollywood, Florida, May 21-23, 1991.Applicant
• Shimoga, “Finger Force and Touch Feedback Issues in Dexterous Telemanipulation,” Proceedings of Fourth Annual Conference on Intelligent Robotic Systems for Space Exploration, Rensselaer Polytechnic Institute, Sep. 30-Oct. 1, 1992.Applicant
• IBM Technical Disclosure Bulletin, “Mouse Ball-Actuating Device With Force and Tactile Feedback,” vol. 32, No. 9B, Feb. 1990.Applicant
• Terry et al., “Tactile Feedback In A Computer Mouse,” Proceedings of Fourteenth Annual Northeast Bioengineering Conference, University of New Hampshire, Mar. 10-11, 1988.Applicant
• Howe, “A Force-Reflecting Teleoperated Hand System for the Study of Tactile Sensing in Precision Manipulation,” Proceedings of the 1992 IEEE International Conference on Roboitcs and Automation, Nice, France, May 1992.Applicant
• Eberhardt et al., “OMAR—A Haptic display for speech perception by deaf and deaf-blind individuals,” IEEE Virtual Reality Annual International Symposium, Seattle, WA, Sep. 18-22, 1993.Applicant
• Rabinowitz et al., “Multidimensional tactile displays: Identification of vibratory intensity, frequency, and contractor area,” Journal of The Acoustical Society of America, vol. 82, No. 4, Oct. 1987.Applicant
• Bejczy et al., “Kinesthetic Coupling Between Operator and Remote Manipulator,” International Computer Technology Conference, The American Society of Mechancial Engineers, San Francisco, CA, Aug. 12-15, 1980.Applicant
• Bejczy et al., “A Laboratory Breadboard System For Dual-Arm Teleoperation,” SOAR '89 Workshop, JSC, Houston, TX, Jul. 25-27, 1989.Applicant
• Ouhyoung et al., “A Low-Cost Force Feedback Joystick and Its Use in PC Video Games,” IEEE Transactions on Consumer Electronics, vol. 41, No. 3, Aug. 1995.Applicant
• Marcus, “Touch Feedback in Surgery,” Proceedings of Virtual Reality and Medicine The Cutting Edge, Sep. 8-11, 1994.Applicant
• Bejczy, et al., “Universal Computer Control System (UCCS) For Space Telerobots,” CH2413-3/87/0000/0318501.00 1987 IEEE, 1987.Applicant
• Patrick, “Design, Construction, and Testing of a Fingertip Tactile Display for Interaction with Virtual and Remote Environments,” Master of Science Thesis, MIT, Aug. 1990, archived Nov. 8, 1990.Applicant
• Calder, “Design of A Force-Feedback Touch-Introducing Actuator For Teleoperator Robot Control,” Bachelor of Science Thesis, MIT, May 1983, archived Jun. 23, 1983.Applicant
• Wiker, “Teletouch Display Development: Phase 1 Report,” Technical Report 1230, Naval Ocean Systems Center, San Diego, Jul. 1988.Applicant
• Bliss, “Optical-to-Tactile Image Conversion for the Blind,” IEEE Transactions on Man-Machine Systems, vol. MMS-11, No. 1, Mar. 1970.Applicant
• Johnson, “Shape-Memory Alloy Tactile Feedback Actuator,” Armstrong Aerospace Medical Research Laboratory, AAMRL-TR-90-039, Aug. 1990.Applicant
• Kontarins et al., “Tactile Display of Vibratory Information in Teleoperation and Virtual Environments,” PRESECNE, 4(4):387-402, Havard Univ., 1995.Applicant
• Aukstakalnis et al., “Silicon Mirage: The Art and Science of Virtual Reality,” ISBN 0-938151-82-7, pp. 129-180, 1992.Applicant
• Eberhardt et al., “Inducing Dynamic Haptic Perception by The Hand: System Description and Some Results,” DSC-vol. 55-1, Dynamic Systems and Control: vol. 1, ASME 1994.Applicant
• Gobel et al., “Tactile Feedback Applied to Computer Mice,” International Journal of Human-Computer Interaction, vol. 7, No. 1, pp. 1-24, 1995.Applicant
• Pimentel et al., “Virtual Reality: through the new looking glass,” 2nd Edition; McGraw-Hill, ISBN 0-07-050167-X, pp. 41-202, 1994.Applicant
• “Cyberman Technical Specification,” Logitech Cyberman SWIFT Supplement to Logitech Mouse Technical Reference and Programming Guide, Apr. 5, 1994.Applicant
• Ouhyoung et al., “The Development of a Low-Cost Force Feedback Joystick and its Use in the Virtual Reality Environment,” Proceedings of the Third Pacific Conference on Computer Graphics and Applications, Pacific Graphics '95, Seoul, Korea, Aug. 21-24, 1995.Applicant
• Kaczmarek et al., “Tactile Displays,” Virtual Environmental Technologies, Chap. 9, pp. 349-414.Applicant
• Lake, “Cyberman from Logitech,” at http://www.ibiblio.org/GameBytes/issue21/greviews/cyberman.html, 1994.Applicant
• “Component Maintenance Manual With Illustrated Parts List, Coaxial Control Shaker Part No. C-25502,” Safe Flight Instrument Corporation, Revised Jan. 28, 2002 (3 pages).Applicant
• “Technical Manual Overhaul Instructions With Parts Breakdown, Coaxial Control Shaker Part No. C-25502,” Safe Flight Instrument Corporation, Revised Jul. 15, 1980 (23 pages).Applicant
• Scannell, “Taking a Joystick Ride,” Computer Currents, Boston Edition, vol. 9, No. 11, Nov. 1994.Applicant
• Yamakita et al., “Tele-Virtual Reality of Dynamic Mechanical Model,” Proceedings of the 1992 IEEE/RSJ International Conference on Intelligent Robots and Systems, Raleigh, NC, Jul. 7-10, 1992.Applicant
• Noll, “Man-Machine Tactile,” SID Journal, Jul./Aug. 1972 Issue.Applicant
• Rosenberg, “Virtual Fixtures: Perceptual Overlays Enhance Operator Performance In Telepresence Tasks,” Ph.D. Dissertation, Stanford University, Jun. 1994.Applicant
• Cursor Walso, “Designer's Comer-Useful Technology for Your Idea File,” Design News, Mar. 7, 1993, p. 63.Applicant
• “Foot-Operated Mouse,” IBM Technical Disclosure Bulletin, Apr. 1986, vol. 28, No. 11.Applicant
• “High Performance Model of the Immersion Probe,” Immersion Probe-MD™, Immersion Corporation (1994).Applicant
• “Proceedings of the IFIP Congress 65,” International Federation for Information Processing, Information Processing 1965, vol. 3, New York, May 24-29, pp. 506.Applicant
• “The Personal Digitizer.TM.,” Immersion Human Interface Corporation 1994.Applicant
• “Useful Technology for Your Idea File,” Design News, Mar. 7, 1994, p. 63.Applicant
• 3D Human Interface Tool, Immersion Probe. TM., Immersion Human Interface Corporation 1994.Applicant
• Adachi, Yoshitaka et al., “Sensory Evaluation of Virtual Haptic Push-Buttons,” Technical Research Center, Suzuki Motor Corporation, Nov. 1994.Applicant
• Adelstein Bernard D. et al., “A High Performance Two Degree-of-Freedom Kinesthetic Interface,” Massachusetts Institute of Technology 1992, pp. 108-112.Applicant
• Akamatsu et al., “Multimodal Mouse: A Mouse-Type Device with Tactile and Force Display”, Presence, vol. 3, No. 1, Winter 1994, pp. 73-80.Applicant
• Ansley, D., “Thimble gets in touch with reality,” New Scientist, 1994, p. 19.Applicant
• Atkinson, William D. et al., “Computing with Feeling,” Comput. & Graphics, vol. 2, No. 2-E, pp. 97-103.Applicant
• Batter, James J. et al., “Grope-1: A Computer Display to the Sense of Feel,” pp. TA-a-188-Ta-4-192.Applicant
• Bejczy, Antal K., “The Phantom Robot: Predictive Displays for Teleoperation with Time Delay,” IEEE 1990, pp. 546-550.Applicant
• Aldstein, Bernard D. et al., “Design and Implementation of a Force Reflecting Manlpulandum for Manual Control Research,” 1992, pp. 1-24.Applicant
• Brooks, F. et al., “Project Grope-Haptic Displays for Scientific Visualization,” Computer Graphics, vol. 24, No. 4, Aug. 1990, pp. 177-185.Applicant
• Burdea, Grigore et al., “A Portable Dextrous Master with Force Feedback,” Presence: Teleoperators and Virtual Environments, MIT Press, Jun. 1991.Applicant
• Burdea, Grigora et al., “Dextrous Telerobotics with Force Feedbacks-An Overview,” Robotica 1991, vol. 9.Applicant
• Burdea, Grigore et al., “Distributed Virtual Force Feedback,” IEEE, May 2, 1993, pp. 25-44.Applicant
• Buttolo, Pietro et al., “Pen-Based Force Display for Precision Maniputation in Virtual Environments,” IEEE Mar. 1995, pp. 1-8.Applicant
• Colgate J. Edward et al., Implementation of Stiff Virtual Walls in Force-Reflecting Interfaces, Sep. 22, 1993, pp. 1-9.Applicant
• Ellis, R.E. et al., “Design and Evaluation of a High-Performance Prototype Planar Haptic Interface,” ASME Dec. 3, 1993, Dsc-vol. 49, pp. 55-65.Applicant
• Fischer, Patrick et al., “Specification and Design of Input devices for Teleoperation,” 1990.Applicant
• Fischer, S.S. et al., “Virtual Environmental Display System,” ACM Interactive 3D Graphics, Oct. 1986.Applicant
• Gotow, J.K., et al., “Perception of Mechanical Properties at the Man-Machine Interface,” IEEE 1987, pp. 688-689.Applicant
• Hannaford, B. et al., “Force Feedback Cursor Control,” NASA Tech Brief, vol. 13, No. 11, Item #21, 1989, pp. I, 1-4.Applicant
• Hannaford, Blake et al., “Performance Evaluation of a Six-Axis Generalized Force-Reflecting Teleoperator,” IEEE May/Jun. 1991, vol. 21, No. 3, pp. 620-633.Applicant
• Hasser, Christopher John, “Tactile Feedback for a Force-Reflecting Haptic Display,” The School of Engineering, University of Dayton, Dec. 1995, pp. iii-xii & 1-96.Applicant
• Herndon, J.N. et al., “The State-of-the-Art Model M-s Maintence System,” Proceedings of the 1984 National Topical Meeting on Robotics and Remote Handling in Hostile Environments, American Nuclear Society, pp. 59-65.Applicant
• Hirota, K., “Development of Surface Display”, IEEE 0-7803-1363, 1993, pp. 256-262.Applicant
• Howe, Robert D., “Task Performance with a Dextrous Teleoperated Hand System,” Proceedings of SPIE, Nov. 1992, vol. 1833, pp. 1-9.Applicant
• Iwata, H. “Artifical Reality with Force-feedback: Development of Desktop Virtual Space with Compact Master Manipulator”, Computer Graphics, vol. 24, No. 4, Aug. 1990, pp. 165-170.Applicant
• Iwata, Hiroo et al., vol. Haptization, IEEE 1993, pp. 16-18.Applicant
• Iwata, Hiroo, “Pen-based Haptic Virtual Environment,” Institute of Engineering Mechanics, University of Tsukuba, Japan, pp. 287-292.Applicant
• Jacobsen, S.C. et al., “High Performance, High Dexterity, Force Reflective Teleoperator II,” ANS Topical Meeting on Robotics & Remote Systems, Albuquerque, New Mexico Feb. 24-27, 1991, pp. 1-10.Applicant
• Jones, L.A., et al., “A Perceptual Analysis of Stiffness,” Experimental Brain Research 1990, pp. 151-156.Applicant
• Kelley, A.J. et al., “MagicMouse: Tactile and Kinesthetic Feedback in the Human-Computer Interface using an Electromagnetically Actuated Input/Output Device,” Univ. of British Columbia, Dept. of Electrical Engineering Tech, Report, 1993, pp. 1-27.Applicant
• Kilpatrick, P., “The Use of a Kinesthic Supplement in an Interactive Graphics System”, Univ. of North Carolina, 1976.Applicant
• Kim, Won S. et al., “Graphics Displays for Operator Aid in Telemanipulation,” IEEE 1991, pp. 1059-1067.Applicant
• Kim, Won S. et al., A Teleoperation Training Simulator with Visual and Kinesthetic Force Virtual Reality.Applicant
• Kotoku, Tetsuo et al., “Environment Modeling for the Interactive Display (EMID) Used in Telerobotic Systems,” IEEE Nov. 3-5, 1991, pp. 99-1004.Applicant
• Kotoku, Tetsuo, “A Predictive Display with Force Feedback and its Application to Remote Manipulation System with Transmission Time Display,” IEEE 1992, Jul. 7-10, 1992, pp. 239-246.Applicant
• Krishna Roy, “Virtual Presence Takes Surgeons through the Virtual Keyhole to Hone Their Skills”, Business & Industry, Jul. 4, 1995.Applicant
• Kelle et al., “On the Development of a Force-Feedback Mouse and its Integration into a Graphical User Interface,” 1994 Int'l Mechanical Engineering Congress and Exhibition, Chicago, Nov. 1994.Applicant
• Krueger, Myron W., Artifical Reality 1988, pp. 54-75.Applicant
• McAffee, Douglas A., “Teleoperator System/Telerobot Demonstrator: Force Reflecting Hand Controller Equipment Manual,” JPL Jan. 1988, pp. 3-8, 11, and A-34.Applicant
• Meyer, Kenneth et al., “A Survey of Position Trackers,” The Massachusetts Institute of Technology 1992, Presence, vol. 1, No. 2.Applicant
• Millman, P., “Design of a Four Degree-of-freedom Force-Reflecting Manipulandum with a Specified Force/Torque Workspace,” Proc. of the 1991 IEEE Int'l Conf. on Robotics and Automation, 1991, pp. 1488-1493.Applicant
• Minsky, Margaret et al., “Feeling and Seeing: Issues in Force Display,” ACM 1990, pp. 235-242.Applicant
• Noll, A. Michael, “Man-Machine Tactile Communication Dissertation,” Polytechnic Institute of Brooklyn, Jun. 1971, pp. 1-88.Applicant
• Ouh-young, M. et al., “Creating an Illustion of Feel: Control Issues in Force Display,” Computer Science Dept., Univ. of N. Carolina, 1989, pp. 1-14.Applicant
• Ouh-young, Ming et al., “Using A Manipulator for Force Display in Molecular Docking,” IEEE 1988, pp. 1824-1829.Applicant
• Ouh-young, Ming, “Force Display in Molecular Docking” Chapel Hill 1990, pp. 1-85.Applicant
• Precision Machine Design, Slocum, Prentice Hall, pp. 661-664.Applicant
• Ramstein, C. et al., “The Pantograph: A Large Workspace Haptic Device for a Multimodal Human-Computer Interaction,” Computer-Human Interaction, CHI '94. 1994.Applicant
• Repperger, D.W., “Active Force Reflection Devices in Tele-operation”, IEEE Control Systems, 1991, pp. 52-56.Applicant
• Rosenberg, L., “Virtual Fixtures': Perceptual Overlays Enhance Operator Performance in Telepresence Tasks”, Stamford University, Jun. 1994, pp. 1-214.Applicant
• Rosenberg, Louis B. et al., “Perceptual Decomposition of Virtual haptic Surfaces,” IEEE, Oct. 1993.Applicant
• Ouh-young, Ming et al., “Force Display Performs Better than Virtual display in a Simple 6-D Docking Task,” IEEE 1989, pp. 1462-1466.Applicant
• Rosenberg, Louis B., “Perceptual Design of a Birtual Rigid Surface Contact,” Center for Design Research Stanford University, Air Force material Command, Apr. 1993, pp. 1-41.Applicant
• Rosenberg, Louis B., “The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments,” Air Force Material Command, Sep. 1992, pp. 1-42.Applicant
• Rosenberg, Louis B., “Virtual Fixtures as Tools to Enhance Operator Performance in Telepresence Environments,” SPIE telemanipulator Technology, 1993.Applicant
• Rosenberg, Louis B., “Virtual Haptic Overlays Enhance Performance in Telepresence Tasks,” SPIE 1994.Applicant
• Rosenberg, Louis B., The Use of Virtual Fixtures to Enhance Operator Performance in Time Delayed Teleoperation, Armstrong Laboratory, Mar. 1993, pp. 1-45.Applicant
• Russo, Massimo, Andrea, “The Design and Implementation of a Three Degree-of-Freedom Force Output Joystick,” Department of Mechanical Engineering , May 11, 1990, pp. 9-40 & 96 & 97.Applicant
• Schmult, Brian et al., “Application Areas for a force-Feedback Joystick,” ASME 1993, DSC-vol. 49, pp. 47-54.Applicant
• Smith, Geoffrey, “Call it Palpable Progress,” Business Week, Oct. 9, 1995, p. 93, 96.Applicant
• Snow, E. et al., “Compact Force-Reflecting Hand Controller,” JPL, Apr. 1991, vol. 15, No. 3, Item No. 153, pp. 1-15a.Applicant
• Su, S. Augustine et al., “The Virtual Panel Architecture: A 3D Gesture Framework,” IEEE 1993, pp. 387-393.Applicant
• Tan, Hong Z et al., “Manual Resolution of Compliance When Work and Force Cues are Minimized,” ASME 1993, DSC-vol. 49, pp. 99-104.Applicant
• Tan, Hong Z. et al., “Human Factors for the Design of Force-Reflecting Haptic Interfaces,” Tan, Srinivasan, Eberman, & Chang, ASME WAM 1994, pp. 1-11.Applicant
• Wiker, Steven F. et al., “Development of Tactile Mice for Blind Access to Computers: Importance of Simulation of Locus, Object Size, and Vibrotactile Display Resolution,” Proceedings of the Human Factors Society 35th Annual Meeting 1991, pp. 708-712.Applicant
• Winey III, C., “Computer Simulated Visual and Tactile Feedback As An Aid to Manipulator and Vehicle Control”, MIT, 1981, pp. 1-80.Applicant
• Yamakita, M. et al., Tele-Virtual Reality of Dynamic Mechanical Model, IEEE Jul. 7-10, 1992, pp. 1103-1110.Applicant
• Yokokohji et al., “What You Can See Is What You Can Feel -Development of a Visual/Haptic Interface to Virtual Environment”, Proceedings of VRAIS '96, IEEE 1996, pp. 46-54.Applicant