US 8,849,679 B2Grant
Remote controlled robot system that provides medical images
Issue Date:2014-09-30
•11 Claims
•6 Drawing Sheets
Abstract
A remote controlled robot system that includes a mobile robot and a remote control station. The mobile robot is controlled by the remote control station and includes a robot monitor, and a robot camera that captures a robot image. The system also includes a medical image device that can be coupled to the robot. The remote control station includes a camera that captures a remote station image, and a monitor that displays the robot image captured by the robot camera in a robot view field, displays the remote station image in a station view field. The robot transmits the robot and medical images to the remote control station such that a larger portion of a network bandwidth is allocated for the medical image than the robot image.
Metadata
Assignee
- Intouch Technologies, Inc.
Inventors
- Yulun Wang
- Charles S. Jordan
- Marco Pinter
Application Information
Application Number:US 12/277,842
Filing Date:2008-11-25
Priority Date:2006-06-15
Art Unit:3686
Classifications
IPC:
G06F3/048G06F19/00H04N7/18
Patent Drawings (6 sheets)
Description
Cross-Reference to Related Application
[0001] This application is a continuation-in-part of U.S. application Ser. No. 11/542,605, filed on Oct. 2, 2006, pending, which is as a continuation-in-part of U.S. application Ser. No. 11/455,161, filed on Jun. 15, 2006.
Background of the Invention
[0002] 1. Field of the Invention
[0003] The subject matter disclosed generally relates to the field of mobile two-way teleconferencing.
[0004] 2. Background Information
[0005] There has been marketed a mobile robot introduced by InTouch Technologies, Inc., the assignee of this application, under the trademarks COMPANION, RP-6 and RP-7. The InTouch robot is controlled by a user at a remote station. The remote station may be a personal computer with a joystick that allows the user to remotely control the movement of the robot. Both the robot and remote station have cameras, monitors, speakers and microphones to allow for two-way video/audio communication. The robot camera provides video images to a screen at the remote station so that the user can view the robot's surroundings and move the robot accordingly.
[0006] The InTouch robot can be used by medical personnel to monitor and interact with a patient. For example, a doctor can move the robot into a patient's room and utilize the two-way videoconferencing capabilities of the system to examine the patient. Examination of the patient is limited to visual inspection and audio feedback. It would be desirable if the system would also allow other devices to be used to examine and interact with a patient.
Brief Summary of the Invention
[0007] A remote controlled robot system that includes a mobile robot and a remote control station. The mobile robot is controlled by the remote control station and includes a robot monitor, and a robot camera that captures a robot image. The system also includes a medical image device that can be coupled to the robot. The remote control station includes a camera that captures a remote station image, and a monitor that displays the robot image captured by the robot camera in a robot view field, displays the remote station image in a station view field. The robot transmits the robot and medical images to the remote control station such that a larger portion of a network bandwidth is allocated for the medical image than the robot image.
Brief Description of the Drawings
[0008] FIG. 1 is an illustration of a robotic system;
[0009] FIG. 2 is a schematic of an electrical system of a robot;
[0010] FIG. 3 is a further schematic of the electrical system of the robot;
[0011] FIG. 4 is a graphical user interface of a remote station;
[0012] FIG. 5 is the graphical user interface showing a medical image in an auxiliary view field.
Detailed Description
[0013] Disclosed is a remote controlled robot system that includes a mobile robot and a remote control station. The mobile robot is controlled by the remote control station and includes a robot monitor, and a robot camera that captures a robot image. The system also includes a medical image device that can be coupled to the robot. The remote control station includes a camera that captures a remote station image, and a monitor that displays the robot image captured by the robot camera in a robot view field, displays the remote station image in a station view field. The robot transmits the robot and medical images to the remote control station such that a larger portion of a network bandwidth is allocated for the medical image than the robot image. A medical personnel at the remote control station can interact with another personnel at the robot site to move the medical image device to vary the captured images. The system allows the remote operator to conduct a video conference with someone at the robot site while viewing medical images in real time.
[0014] Referring to the drawings more particularly by reference numbers, FIG. 1 shows a robotic system 10 that can be used to conduct a remote visit. The robotic system 10 includes a robot 12, a base station 14 and a remote control station 16. The remote control station 16 may be coupled to the base station 14 through a network 18. By way of example, the network 18 may be either a packet switched network such as the Internet, or a circuit switched network such has a Public Switched Telephone Network (PSTN) or other broadband system. The base station 14 may be coupled to the network 18 by a modem 20 or other broadband network interface device. By way of example, the base station 14 may be a wireless router. Alternatively, the robot 12 may have a direct connection to the network thru for example a satellite.
[0015] The remote control station 16 may include a computer 22 that has a monitor 24, a camera 26, a microphone 28 and a speaker 30. The computer 22 may also contain an input device 32 such as a joystick and/or a mouse and a keyboard 34. The control station 16 is typically located in a place that is remote from the robot 12. Although only one remote control station 16 is shown, the system 10 may include a plurality of remote stations. In general any number of robots 12 may be controlled by any number of remote stations 16 or other robots 12. For example, one remote station 16 may be coupled to a plurality of robots 12, or one robot 12 may be coupled to a plurality of remote stations 16, or a plurality of robots 12.
[0016] Each robot 12 includes a movement platform 36 that is attached to a robot housing 38. Also attached to the robot housing 36 is a pair of cameras 40 and 42, a monitor 44, a microphone(s) 46 and a speaker(s) 48. The microphone 46 and speaker 30 may create a stereophonic sound. The robot 12 may also have an antenna 50 that is wirelessly coupled to an antenna 52 of the base station 14. The robot monitor 44 and cameras 40 and 82 move together in two degrees of freedom including pan and tilt directions. The system 10 allows a user at the remote control station 16 to move the robot 12 through operation of the input device 32. The robot cameras 40 and 42 are coupled to the remote monitor 24 so that a user at the remote station 16 can view a patient. Likewise, the robot monitor 44 is coupled to the remote camera 26 so that the patient can view the user. The microphones 28 and 46, and speakers 30 and 48, allow for audible communication between the patient and the user.
[0017] Camera 40 may provide a wide angle view. Conversely, camera 42 may contain a zoom lens to provide a narrow angle view. Camera 42 can capture a zoom image that is transmitted to the remote control station. Camera 40 can capture a non-zoom image that can be transmitted to the remote control station. Although two cameras are shown and described, it is to be understood that the robot may contain only one camera that has the capability to provide a zoom image and a non-zoom image.
[0018] The remote station computer 22 may operate Microsoft OS software and WINDOWS XP or other operating systems such as LINUX. The remote computer 22 may also operate a video driver, a camera driver, an audio driver and a joystick driver. The video images may be transmitted and received with compression software such as MPEG CODEC.
[0019] The robot 12 may include an auxiliary video port 70. The auxiliary video port 70 may include USB, VGA, Y-video/audio electrical connectors and associated electronic circuitry. A plurality of video devices 72 can be connected to one or more of the ports 70. By way of example, the video devices 72 may include an ultrasound device, an otoscope, a echocardiogram, a dermatology camera, a ceiling camera and/or a video playback machine such as a VCR or DVD player. The video devices 72 capture video that is transmitted to the remote station 16 through the mobile robot 12. By way of example, the ultrasound device may capture images of a patient that are then transmitted to the remote control station 16 and displayed by the station monitor 24. The video devices 72 can be coupled to the robot with either a wire or through a wireless connection. For purposes of this patent an auxiliary port will describe both wireless and wired connections between a video device and the robot.
[0020] FIGS. 2 and 3 show an embodiment of a robot 12. Each robot 12 may include a high level control system 150 and a low level control system 152. The high level control system 150 may include a processor 154 that is connected to a bus 156. The auxiliary video port 70 is coupled to the robot cameras 40 and 42 and the external video devices 72. The port 70 may include a frame grabber that has multiple composite video inputs that allow the robot to capture video from the cameras 40 and 42 and the video devices 72. The port 70 provides video from one of the video devices, or cameras 40 or 42, based on input from the remote control station 16. For example, the port 70 may feed video from camera 40 and then switch the feed to one of the video devices 72.
[0021] The monitor 44 is coupled to the bus 156 by a serial output port 160 and a VGA driver 162. The monitor 44 may include a touchscreen function that allows the patient to enter input by touching the monitor screen.
[0022] The speaker 48 is coupled to the bus 156 by a digital to analog converter 164. The microphone 46 is coupled to the bus 156 by an analog to digital converter 166. The high level controller 150 may also contain random access memory (RAM) device 168, a non-volatile RAM device 170 and a mass storage device 172 that are all coupled to the bus 156. The mass storage device 172 may contain medical files of the patient that can be accessed by the user at the remote control station 16. For example, the mass storage device 172 may contain a picture of the patient. The user, particularly a health care provider, can recall the old picture and make a side by side comparison on the monitor 24 with a present video image of the patient provided by the camera 40. The robot antennae 50 may be coupled to a wireless transceiver 174. By way of example, the transceiver 174 may transmit and receive information in accordance with IEEE 802.11b.
[0023] The controller 154 may operate with a LINUX OS operating system. The controller 154 may also operate MS WINDOWS along with video, camera and audio drivers for communication with the remote control station 16. Video information may be transceived using MPEG CODEC compression techniques. The software may allow the user to send e-mail to the patient and vice versa, or allow the patient to access the Internet. In general the high level controller 150 operates to control communication between the robot 12 and the remote control station 16.
[0024] The remote control station 16 may include a computer that is similar to the high level controller 150. The computer would have a processor, memory, I/O, software, firmware, etc. for generating, transmitting, receiving and processing information.
[0025] The high level controller 150 may be linked to the low level controller 152 by serial ports 176 and 178. The low level controller 152 includes a processor 180 that is coupled to a RAM device 182 and non-volatile RAM device 184 by a bus 186. Each robot 12 contains a plurality of motors 188 and motor encoders 190. The motors 188 can actuate the movement platform and move other parts of the robot such as the monitor and camera. The encoders 190 provide feedback information regarding the output of the motors 188. The motors 188 can be coupled to the bus 186 by a digital to analog converter 192 and a driver amplifier 194. The encoders 190 can be coupled to the bus 186 by a decoder 196. Each robot 12 also has a number of proximity sensors 198 (see also FIG. 1 ). The position sensors 198 can be coupled to the bus 186 by a signal conditioning circuit 200 and an analog to digital converter 202.
[0026] The low level controller 152 runs software routines that mechanically actuate the robot 12. For example, the low level controller 152 provides instructions to actuate the movement platform to move the robot 12. The low level controller 152 may receive movement instructions from the high level controller 150. The movement instructions may be received as movement commands from the remote control station or another robot. Although two controllers are shown, it is to be understood that each robot 12 may have one controller, or more than two controllers, controlling the high and low level functions.
[0027] The various electrical devices of each robot 12 may be powered by a battery(ies) 204. The battery 204 may be recharged by a battery recharger station 206 (see also FIG. 1 ). The low level controller 152 may include a battery control circuit 208 that senses the power level of the battery 204. The low level controller 152 can sense when the power falls below a threshold and then send a message to the high level controller 150.
[0028] The system 10 may be the same or similar to a robotic system provided by the assignee InTouch-Health, Inc. of Santa Barbara, Calif. under the name RP-6 or RP-7. The system may also be the same or similar to the system disclosed in U.S. Pat. No. 6,925,357 issued to Wang et al. on Aug. 2, 2005, which is hereby incorporated by reference.
[0029] FIG. 4 shows a display user interface (“DUI”) 220 that can be displayed at the remote station 16. The DUI 220 may include a robot view field 222 that displays a video image provided by one of the cameras 40 or 42, or one of the video devices 72 at the robot location. The DUI 220 may include a station view field 224 that displays a video image provided by the camera of the remote station 16. The DUI 220 may be part of an application program stored and operated by the computer 22 of the remote station 16.
[0030] The display user interface 220 may include a Aux Video graphical tab 226 that display a button 228. The button 228 can be selected by a user to display video provided by one of the video devices 72 in the robot view field 222. The interface 220 may have additional graphical icons 230 that allow the user to adjust different parameters of the system such as camera brightness, audio volume, capturing a still picture, etc.
[0031] The user can highlight a portion of a non-zoom image to display a zoom image that corresponds to the highlighted area. Additionally, the user can circle, annotate, etc. portions of video with a telestrator function of the system 10.
[0032] The system 10 can be used in a process wherein a medical personnel such as a doctor move the robot 12 adjacent to a patient that is being assisted by another medical personnel such as a nurse. The nurse can plug the ultrasound device into the auxiliary video port of the robot. Plugging the ultrasound device into the robot may cause ultrasound images to be transmitted and displayed within the robot view field 222. Alternatively, the doctor can select graphical button 228 which causes the ultrasound image to be displayed in an auxiliary view field 240 shown in FIG. 5 . The auxiliary field 240 may have a graphical button 242 that can be selected to switch the ultrasound image into the robot view field 222 and the images from the robot camera into field 240. When both ultrasound and video images from the robot camera are transmitted to the remote station, the robot may enter a mode wherein the ultrasound images are transmitted at a larger frame size, higher frame rate and higher video compression and the robot camera images are transmitted at a smaller frame size, lower frame rate and lower compression. This mode allocates a higher portion of network bandwidth to the medical images. This mode can be selected through a graphical button (not shown) displayed on the remote control station monitor. The robot camera images and the medical images may also be encrypted. For example, the images may be encrypted with a 128 bit AES encryption with a symmetric key that is exchanged at the start of a session.
[0033] During a session where an ultrasound device is coupled to the robot a technician may be located at the robot site in the vicinity of a patient. The technician may move the ultrasound device to different positions on the patient. The images are transmitted to the control station and displayed by the monitor for viewing by a doctor. The doctor and technician can discuss the ultrasound images through the control station and robot. The doctor may also provide instructions on where to place the ultrasound device. For example, the doctor can instruct the technician to move the ultrasound device to different locations on a patient. The system allows the doctor to conduct a remote video conference while viewing ultrasound images in real time.
[0034] The robot 12 may be placed in a home or a facility where one or more patients are to be monitored and/or assisted. The facility may be a hospital or a residential care facility. By way of example, the robot 12 may be placed in a home where a health care provider may monitor and/or assist the patient. Likewise, a friend or family member may communicate with the patient. The cameras and monitors at both the robot and remote control stations allow for teleconferencing between the patient and the person at the remote station(s).
[0035] The robot 12 can be maneuvered through the home or a facility by manipulating the input device 32 at a remote station 16. The robot 10 may be controlled by a number of different users. To accommodate for this the robot may have an arbitration system. The arbitration system may be integrated into the operating system of the robot 12. For example, the arbitration technique may be embedded into the operating system of the high-level controller 150.
[0036] By way of example, the users may be divided into classes that include the robot itself, a local user, a caregiver, a doctor, a family member, or a service provider. The robot 12 may override input commands that conflict with robot operation. For example, if the robot runs into a wall, the system may ignore all additional commands to continue in the direction of the wall. A local user is a person who is physically present with the robot. The robot could have an input device that allows local operation. For example, the robot may incorporate a voice recognition system that receives and interprets audible commands.
[0037] A caregiver is someone who remotely monitors the patient. A doctor is a medical professional who can remotely control the robot and also access medical files contained in the robot memory. The family and service users remotely access the robot. The service user may service the system such as by upgrading software, or setting operational parameters.
[0038] The robot 12 may operate in one of two different modes; an exclusive mode, or a sharing mode. In the exclusive mode only one user has access control of the robot. The exclusive mode may have a priority assigned to each type of user. By way of example, the priority may be in order of local, doctor, caregiver, family and then service user. In the sharing mode two or more users may share access with the robot. For example, a caregiver may have access to the robot, the caregiver may then enter the sharing mode to allow a doctor to also access the robot. Both the caregiver and the doctor can conduct a simultaneous tele-conference with the patient.
[0039] The arbitration scheme may have one of four mechanisms; notification, timeouts, queue and call back. The notification mechanism may inform either a present user or a requesting user that another user has, or wants, access to the robot. The timeout mechanism gives certain types of users a prescribed amount of time to finish access to the robot. The queue mechanism is an orderly waiting list for access to the robot. The call back mechanism informs a user that the robot can be accessed. By way of example, a family user may receive an e-mail message that the robot is free for usage. Tables I and II, show how the mechanisms resolve access request from the various users.
[0040]
| TABLE I | |||||
|---|---|---|---|---|---|
| Access | Medical | Command | Software/Debug | Set | |
| User | Control | Record | Override | Access | Priority |
| Robot | No | No | Yes (1) | No | No |
| Local | No | No | Yes (2) | No | No |
| Caregiver | Yes | Yes | Yes (3) | No | No |
| Doctor | No | Yes | No | No | No |
| Family | No | No | No | No | No |
| Service | Yes | No | Yes | Yes | Yes |
[0041]
| TABLE II | ||||||
|---|---|---|---|---|---|---|
| Requesting User | ||||||
| Local | Caregiver | Doctor | Family | Service | ||
| Current | Local | Not Allowed | Warn current user of | Warn current user of | Warn current user of | Warn current user of |
| User | pending user | pending user | pending user | pending user | ||
| Notify requesting | Notify requesting user | Notify requesting user | Notify requesting | |||
| user that system is in | that system is in use | that system is in use | user that system is in | |||
| use | Set timeout = 5 m | Set timeout = 5 m | use | |||
| Set timeout | Call back | No timeout | ||||
| Call back | ||||||
| Caregiver | Warn current user | Not Allowed | Warn current user of | Warn current user of | Warn current user of | |
| of pending user. | pending user | pending user | pending user | |||
| Notify requesting | Notify requesting user | Notify requesting user | Notify requesting | |||
| user that system is | that system is in use | that system is in use | user that system is in | |||
| in use. | Set timeout = 5 m | Set timeout = 5 m | use | |||
| Release control | Queue or callback | No timeout | ||||
| Callback | ||||||
| Doctor | Warn current user | Warn current user of | Warn current user of | Notify requesting user | Warn current user of | |
| of pending user | pending user | pending user | that system is in use | pending user | ||
| Notify requesting | Notify requesting | Notify requesting user | No timeout | Notify requesting | ||
| user that system is | user that system is in | that system is in use | Queue or callback | user that system is in | ||
| in use | use | No timeout | use | |||
| Release control | Set timeout = 5 m | Callback | No timeout | |||
| Callback | ||||||
| Family | Warn current user | Notify requesting | Warn current user of | Warn current user of | Warn current user of | |
| of pending user | user that system is in | pending user | pending user | pending user | ||
| Notify requesting | use | Notify requesting user | Notify requesting user | Notify requesting | ||
| user that system is | No timeout | that system is in use | that system is in use | user that system is in | ||
| in use | Put in queue or | Set timeout = 1 m | Set timeout = 5 m | use | ||
| Release Control | callback | Queue or callback | No timeout | |||
| Callback | ||||||
| Service | Warn current user | Notify requesting | Warn current user of | Warn current user of | Not Allowed | |
| of pending user | user that system is in | request | pending user | |||
| Notify requesting | use | Notify requesting user | Notify requesting user | |||
| user that system is | No timeout | that system is in use | that system is in use | |||
| in use | Callback | No timeout | No timeout | |||
| No timeout | Callback | Queue or callback | ||||
[0042] The information transmitted between the station 16 and the robot 12 may be encrypted. Additionally, the user may have to enter a password to enter the system 10. A selected robot is then given an electronic key by the station 16. The robot 12 validates the key and returns another key to the station 16. The keys are used to encrypt information transmitted in the session.
[0043] The robot 12 and remote station 16 transmit commands through the broadband network 18. The commands can be generated by the user in a variety of ways. For example, commands to move the robot may be generated by moving the joystick 32 (see FIG. 1 ). The commands are preferably assembled into packets in accordance with TCP/IP protocol. Table III provides a list of control commands that are generated at the remote station and transmitted to the robot through the network.
[0044]
| TABLE III | ||
|---|---|---|
| Control Commands | ||
| Command | Example | Description |
| drive | drive 10.0 0.0 5.0 | The drive command directs the robot to move |
| at the specified velocity (in cm/sec) in the | ||
| (x, y) plane, and turn its facing at the | ||
| specified rate (degrees/sec). | ||
| goodbye | goodbye | The goodbye command terminates a user |
| session and relinquishes control of the | ||
| robot | ||
| gotoHomePosition | gotoHomePosition 1 | The gotoHomePosition command moves the head |
| to a fixed “home” position (pan and tilt), | ||
| and restores zoom to default value. The | ||
| index value can be 0, 1, or 2. The exact | ||
| pan/tilt values for each index are specified | ||
| in robot configuration files. | ||
| head | head vel pan 5.0 tilt | The head command controls the head motion. |
| 10.0 | It can send commands in two modes, | |
| identified by keyword: either positional | ||
| (“pos”) or velocity (“vol”). In velocity | ||
| mode, the pan and tilt values are desired | ||
| velocities of the head on the pan and tilt | ||
| axes, in degree/sec. A single command can | ||
| include just the pan section, or just the | ||
| tilt section, or both. | ||
| keepalive | keepalive | The keepalive command causes no action, but |
| keeps the communication (socket) link open | ||
| so that a session can continue. In scripts, | ||
| it can be used to introduce delay time into | ||
| the action. | ||
| odometry | odometry 5 | The odometry command enables the flow of |
| odometry messages from the robot. The | ||
| argument is the number of times odometry is | ||
| to be reported each second. A value of 0 | ||
| turns odometry off. | ||
| reboot | reboot | The reboot command causes the robot computer |
| to reboot immediately. The ongoing session | ||
| is immediately broken off. | ||
| restoreHeadPosition | restoreHeadPosition | The restoreHeadPosition functions like the |
| gotoHomePosition command, but it homes the | ||
| head to a position previously saved with | ||
| gotoHomePosition. | ||
| saveHeadPosition | saveHeadPosition | The saveHeadPosition command causes the |
| robot to save the current head position (pan | ||
| and tilt) in a scratch location in temporary | ||
| storage so that this position can be | ||
| restored. Subsequent calls to | ||
| “restoreHeadPosition” will restore this | ||
| saved position. Each call to | ||
| saveHeadPosition overwrites any previously | ||
| saved position. | ||
| setCameraFocus | setCameraFocus 100.0 | The setCameraFocus command controls focus |
| for the camera on the robot side. The value | ||
| sent is passed “raw” to the video | ||
| application running on the robot, which | ||
| interprets it according to its own | ||
| specification. | ||
| setCameraZoom | setCameraZoom 100.0 | The setCameraZoom command controls zoom for |
| the camera on the robot side. The value | ||
| sent is passed “raw” to the video | ||
| application running on the robot, which | ||
| interprets it according to its own | ||
| specification. | ||
| shutdown | Shutdown | The shutdown command shuts down the robot |
| and powers down its computer. | ||
| stop | stop | The stop command directs the robot to stop |
| moving immediately. It is assumed this will | ||
| be as sudden a stop as the mechanism can | ||
| safely accommodate. | ||
| timing | Timing 3245629 500 | The timing message is used to estimate |
| message latency. It holds the UCT value | ||
| (seconds + milliseconds) of the time the | ||
| message was sent, as recorded on the sending | ||
| machine. To do a valid test, you must | ||
| compare results in each direction (i.e., | ||
| sending from machine A to machine B, then | ||
| from machine B to machine A) in order to | ||
| account for differences in the clocks | ||
| between the two machines. The robot records | ||
| data internally to estimate average and | ||
| maximum latency over the course of a | ||
| session, which it prints to log files. | ||
| userTask | userTask “Jane Doe” | The userTask command notifies the robot of |
| “Remote Visit” | The current user and task. It typically is | |
| sent once at the start of the session, | ||
| although it can be sent during a session if | ||
| the user and/or task change. The robot uses | ||
| this information for record-keeping. | ||
[0045] Table IV provides a list of reporting commands that are generated by the robot and transmitted to the remote station through the network.
[0046]
| TABLE IV | ||
|---|---|---|
| Reporting Commands | ||
| Command | Example | Description |
| abnormalExit | abnormalExit | This message informs the user that the robot |
| software has crashed or otherwise exited | ||
| abnormally. Te robot software catches top- | ||
| level exceptions and generates this message | ||
| if any such exceptions occur. | ||
| bodyType | bodyType 3 | The bodyType message informs the station |
| which type body (using the numbering of the | ||
| mechanical team) the current robot has. | ||
| This allows the robot to be drawn correctly | ||
| in the station user interface, and allows | ||
| for any other necessary body-specific | ||
| adjustments. | ||
| driveEnabled | driveEnabled true | This message is sent at the start of a |
| session to indicate whether the drive system | ||
| is operational. | ||
| emergencyShutdown | emergencyShutdown | This message informs the station that the |
| robot software has detected a possible | ||
| “runaway” condition (an failure causing the | ||
| robot to move out of control) and is | ||
| shutting the entire system down to prevent | ||
| hazardous motion. | ||
| odometry | odometry 10 20 340 | The odometry command reports the current |
| (x, y) position (cm) and body orientation | ||
| (degrees) of the robot, in the original | ||
| coordinate space of the robot at the start | ||
| of the session. | ||
| sensorGroup | group_data | Sensors on the robot are arranged into |
| groups, each group of a single type (bumps, | ||
| range sensors, charge meter, etc.) The | ||
| sensorGroup message is sent once per group | ||
| at the start of each session. It contains | ||
| the number, type, locations, and any other | ||
| relevant data for the sensors in that group. | ||
| The station assumes nothing about the | ||
| equipment carried on the robot; everything | ||
| it knows about the sensors comes from the | ||
| sensorGroup messages. | ||
| sensorState | groupName state data | The sensorState command reports the current |
| state values for a specified group of | ||
| sensor. The syntax and interpretation for | ||
| the state data is specific to each group. | ||
| This message is sent once for each group at | ||
| each sensor evaluation (normally several | ||
| times per second). | ||
| systemError | systemError | This message informs the station user of a |
| driveController | failure in one of the robot's subsystems. | |
| The error_type argument indicates which | ||
| subsystem failed, including driveController, | ||
| sensorController, headHome. | ||
| systemInfo | systemInfo wireless 45 | This message allows regular reporting of |
| information that falls outside the sensor | ||
| system such as wireless signal strength. | ||
| text | text “This is some | The text string sends a text string from the |
| text” | robot to the station, where the string is | |
| displayed to the user. This message is used | ||
| mainly for debugging. | ||
| version | version 1.6 | This message identifies the software version |
| currently running on the robot. It is sent | ||
| once at the start of the session to allow | ||
| the station to do any necessary backward | ||
| compatibility adjustments. | ||
[0047] The processor 154 of the robot high level controller 150 may operate a program that determines whether the robot 12 has received a robot control command within a time interval. For example, if the robot 12 does not receive a control command within 2 seconds then the processor 154 provides instructions to the low level controller 150 to stop the robot 12. Although a software embodiment is described, it is to be understood that the control command monitoring feature could be implemented with hardware, or a combination of hardware and software. The hardware may include a timer that is reset each time a control command is received and generates, or terminates, a command or signal, to stop the robot.
[0048] The remote station computer 22 may monitor the receipt of video images provided by the robot camera. The computer 22 may generate and transmit a STOP command to the robot if the remote station does not receive or transmit an updated video image within a time interval. The STOP command causes the robot to stop. By way of example, the computer 22 may generate a STOP command if the remote control station does not receive a new video image within 2 seconds. Although a software embodiment is described, it is to be understood that the video image monitoring feature could be implemented with hardware, or a combination of hardware and software. The hardware may include a timer that is reset each time a new video image is received and generates, or terminates, a command or signal, to generate the robot STOP command.
[0049] While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention not be limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art.
Claims
What is claimed is:
1. A remote controlled robot system, comprising:
a robot with a robot monitor, and a robot camera that captures a patient image of a patient, said robot having an auxiliary video port, said robot including a microphone and a speaker;
a medical image device that is coupled to said auxiliary video port and can capture a medical image of a patient; and,
a remote control station that has a microphone and a speaker and transmits commands to control said robot, said remote control station includes a control station camera that captures a medical image of a medical personnel and a control station monitor that displays a display user interface, said display user interface simultaneously displays the patient image captured by said robot camera in a robot view field, said medical personnel image in a station view field, and said medical image in an auxiliary view field, wherein a doctor located at said remote control station can conduct a video conference with a technician located at said robot while viewing the patient image and the medical image.
2. The system of claim 1, wherein said medical image device is an ultrasound device.
3. The system of claim 1, wherein said medical image device is an otoscope.
4. The system of claim 1, wherein said medical image device is an echocardiogram.
5. The system of claim 1, further comprising a broadband network coupled to said robot and said remote control station.
6. The system of claim 1, wherein said robot camera and said robot monitor are mechanically coupled to always move together.
7. The system of claim 1, wherein a larger portion of a network bandwidth is allocated for the medical image than the patient image.
8. A method for reviewing images of a patient, comprising:
moving a robot that has a microphone, a speaker, a monitor and a camera adjacent to a patient with commands from a remote control station that includes a microphone, a speaker, a camera and a monitor;
capturing a patient image of a patient with the robot camera;
transmitting the patient image to the remote control station;
displaying the patient image on the remote control station monitor;
moving a medical image device relative to a patient by a technician;
capturing a medical personnel image of the patient with the medical image device, the captured medical image being provided to the robot;
transmitting the medical image from the robot to the remote control station;
capturing a medical personnel image of a medical personnel with a remote control station camera;
displaying the medical image on a display user interface of the remote control station monitor simultaneously with the display of the patient image and the remote station medical personnel image; and, conducting a video conference between the technician and a doctor, while the doctor views the medical image and the patient image.
9. The method of claim 8, wherein the medical image device captures ultrasound images.
10. The method of claim 8, further comprising selecting a graphical input of a graphical user interface displayed by the remote control station monitor to display the medical image.
11. The method of claim 8, wherein the medical image is transmitted at a higher frame rate than the patient image.
Patent Citations (739)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4413693(A) | 1983-11-01 | Derby | Applicant |
| US4572594(A) | 1986-02-01 | Schwartz | Applicant |
| US4625274(A) | 1986-11-01 | Schroeder | Applicant |
| US4638445(A) | 1987-01-01 | Mattaboni | Applicant |
| US4652204(A) | 1987-03-01 | Arnett | Applicant |
| US4669168(A) | 1987-06-01 | Tamura et al. | Applicant |
| US4679152(A) | 1987-07-01 | Perdue | Applicant |
| US4697472(A) | 1987-10-01 | Hiyane | Applicant |
| US4709265(A) | 1987-11-01 | Silverman et al. | Applicant |
| US4751658(A) | 1988-06-01 | Kadonoff et al. | Applicant |
| US4766581(A) | 1988-08-01 | Korn et al. | Applicant |
| US4777416(A) | 1988-10-01 | George et al. | Applicant |
| US4797557(A) | 1989-01-01 | Ohman | Applicant |
| US4803625(A) | 1989-02-01 | Fu et al. | Applicant |
| US4847764(A) | 1989-07-01 | Halvorson | Applicant |
| US4875172(A) | 1989-10-01 | Kanayama | Applicant |
| US4878501(A) | 1989-11-01 | Shue | Applicant |
| US4942512(A) | 1990-07-01 | Kohno | Applicant |
| US4942538(A) | 1990-07-01 | Yuan et al. | Applicant |
| US4953159(A) | 1990-08-01 | Hayden et al. | Applicant |
| US4974607(A) | 1990-12-01 | Miwa | Applicant |
| US4977971(A) | 1990-12-01 | Crane, III et al. | Applicant |
| US5006988(A) | 1991-04-01 | Borenstein et al. | Applicant |
| US5040116(A) | 1991-08-01 | Evans, Jr. et al. | Applicant |
| US5051906(A) | 1991-09-01 | Evans et al. | Applicant |
| US5073749(A) | 1991-12-01 | Kanayama | Applicant |
| US5084828(A) | 1992-01-01 | Kaufman et al. | Applicant |
| US5130794(A) | 1992-07-01 | Ritchey | Applicant |
| US5148591(A) | 1992-09-01 | Pryor | Applicant |
| US5153833(A) | 1992-10-01 | Gordon et al. | Applicant |
| US5155684(A) | 1992-10-01 | Burke et al. | Applicant |
| US5157491(A) | 1992-10-01 | Kassatly | Applicant |
| US5182641(A) | 1993-01-01 | Diner et al. | Applicant |
| US5193143(A) | 1993-03-01 | Kaemmerer et al. | Applicant |
| US5217453(A) | 1993-06-01 | Wilk | Applicant |
| US5224157(A) | 1993-06-01 | Yamada et al. | Applicant |
| US5230023(A) | 1993-07-01 | Nakano | Applicant |
| US5231693(A) | 1993-07-01 | Backes et al. | Applicant |
| US5236432(A) | 1993-08-01 | Matsen, II et al. | Applicant |
| US5315287(A) | 1994-05-01 | Sol | Applicant |
| US5319611(A) | 1994-06-01 | Korba | Applicant |
| US5341242(A) | 1994-08-01 | Gilboa et al. | Applicant |
| US5341459(A) | 1994-08-01 | Backes | Applicant |
| US5347306(A) | 1994-09-01 | Nitta | Applicant |
| US5347457(A) | 1994-09-01 | Tanaka et al. | Applicant |
| US5350033(A) | 1994-09-01 | Kraft | Applicant |
| US5366896(A) | 1994-11-01 | Margrey et al. | Applicant |
| US5374879(A) | 1994-12-01 | Pin et al. | Applicant |
| US5375195(A) | 1994-12-01 | Johnston | Applicant |
| US5417210(A) | 1995-05-01 | Funda et al. | Applicant |
| US5436542(A) | 1995-07-01 | Petelin et al. | Applicant |
| US5441042(A) | 1995-08-01 | Putman | Applicant |
| US5441047(A) | 1995-08-01 | David et al. | Applicant |
| US5442728(A) | 1995-08-01 | Kaufman et al. | Applicant |
| US5462051(A) | 1995-10-01 | Oka et al. | Applicant |
| US5511147(A) | 1996-04-01 | Abdel-Malek | Applicant |
| US5528289(A) | 1996-06-01 | Cortjens et al. | Applicant |
| US5539741(A) | 1996-07-01 | Barraclough et al. | Applicant |
| US5544649(A) | 1996-08-01 | David et al. | Applicant |
| US5550577(A) | 1996-08-01 | Verbiest et al. | Applicant |
| US5553609(A) | 1996-09-01 | Chen et al. | Applicant |
| US5563998(A) | 1996-10-01 | Yaksich et al. | Applicant |
| US5572229(A) | 1996-11-01 | Fisher | Applicant |
| US5572999(A) | 1996-11-01 | Funda et al. | Applicant |
| US5594859(A) | 1997-01-01 | Palmer et al. | Applicant |
| US5600573(A) | 1997-02-01 | Hendricks et al. | Applicant |
| US5636218(A) | 1997-06-01 | Ishikawa | Applicant |
| US5652849(A) | 1997-07-01 | Conway et al. | Applicant |
| US5657246(A) | 1997-08-01 | Hogan et al. | Applicant |
| US5659779(A) | 1997-08-01 | Laird et al. | Applicant |
| US5673082(A) | 1997-09-01 | Wells et al. | Applicant |
| US5675229(A) | 1997-10-01 | Thorne | Applicant |
| US5682199(A) | 1997-10-01 | Lankford | Applicant |
| US5684695(A) | 1997-11-01 | Bauer | Applicant |
| US5701904(A) | 1997-12-01 | Simmons et al. | Applicant |
| US5739657(A) | 1998-04-01 | Takayama et al. | Applicant |
| US5748629(A) | 1998-05-01 | Caldara et al. | Applicant |
| US5749058(A) | 1998-05-01 | Hashimoto | Applicant |
| US5749362(A) | 1998-05-01 | Funda et al. | Applicant |
| US5754631(A) | 1998-05-01 | Cave | Applicant |
| US5758079(A) | 1998-05-01 | Ludwig et al. | Applicant |
| US5762458(A) | 1998-06-01 | Wang et al. | Applicant |
| US5764731(A) | 1998-06-01 | Yablon | Applicant |
| US5767897(A) | 1998-06-01 | Howell | Applicant |
| US5786846(A) | 1998-07-01 | Hiroaki | Applicant |
| US5787545(A) | 1998-08-01 | Collens | Applicant |
| US5802494(A) | 1998-09-01 | Kuno | Applicant |
| US5836872(A) | 1998-11-01 | Kenet et al. | Applicant |
| US5867653(A) | 1999-02-01 | Aras et al. | Applicant |
| US5876325(A) | 1999-03-01 | Mizuno et al. | Applicant |
| US5911036(A) | 1999-06-01 | Wright et al. | Applicant |
| US5917958(A) | 1999-06-01 | Nunally et al. | Applicant |
| US5927423(A) | 1999-07-01 | Wada et al. | Applicant |
| US5949758(A) | 1999-09-01 | Kober et al. | Applicant |
| US5954692(A) | 1999-09-01 | Smith et al. | Applicant |
| US5959423(A) | 1999-09-01 | Nakanishi et al. | Applicant |
| US5961446(A) | 1999-10-01 | Beller et al. | Applicant |
| US5966130(A) | 1999-10-01 | Benman, Jr. | Applicant |
| US5973724(A) | 1999-10-01 | Riddle | Applicant |
| US5974446(A) | 1999-10-01 | Sonnenreich et al. | Applicant |
| US5983263(A) | 1999-11-01 | Rothrock et al. | Applicant |
| US5995119(A) | 1999-11-01 | Cosatto et al. | Applicant |
| US5995884(A) | 1999-11-01 | Allen et al. | Applicant |
| US5999977(A) | 1999-12-01 | Riddle | Applicant |
| US6031845(A) | 2000-02-01 | Walding | Applicant |
| US6047259(A) | 2000-04-01 | Campbell et al. | Applicant |
| US6113343(A) | 2000-09-01 | Goldenberg et al. | Applicant |
| US6133944(A) | 2000-10-01 | Braun et al. | Applicant |
| US6135228(A) | 2000-10-01 | Asada et al. | Applicant |
| US6148100(A) | 2000-11-01 | Anderson et al. | Applicant |
| US6160582(A) | 2000-12-01 | Hill | Applicant |
| US6170929(B1) | 2001-01-01 | Wilson et al. | Applicant |
| US6175779(B1) | 2001-01-01 | Barrett | Applicant |
| US6201984(B1) | 2001-03-01 | Funda et al. | Applicant |
| US6211903(B1) | 2001-04-01 | Bullister | Applicant |
| US6219587(B1) | 2001-04-01 | Ahlin et al. | Applicant |
| US6232735(B1) | 2001-05-01 | Baba et al. | Applicant |
| US6233504(B1) | 2001-05-01 | Das et al. | Applicant |
| US6233735(B1) | 2001-05-01 | Ebihara | Applicant |
| US6250928(B1) | 2001-06-01 | Poggio et al. | Applicant |
| US6256556(B1) | 2001-07-01 | Zenke | Applicant |
| US6259806(B1) | 2001-07-01 | Green | Applicant |
| US6259956(B1) | 2001-07-01 | Myers et al. | Applicant |
| US6266162(B1) | 2001-07-01 | Okamura et al. | Applicant |
| US6266577(B1) | 2001-07-01 | Popp et al. | Applicant |
| US6289263(B1) | 2001-09-01 | Mukherjee | Applicant |
| US6292713(B1) | 2001-09-01 | Jouppi et al. | Applicant |
| US6304050(B1) | 2001-10-01 | Skaar et al. | Applicant |
| US6317652(B1) | 2001-11-01 | Osada | Applicant |
| US6321137(B1) | 2001-11-01 | De Smet | Applicant |
| US6324184(B1) | 2001-11-01 | Hou et al. | Applicant |
| US6324443(B1) | 2001-11-01 | Kurakake et al. | Applicant |
| US6325756(B1) | 2001-12-01 | Webb et al. | Applicant |
| US6327516(B1) | 2001-12-01 | Zenke | Applicant |
| US6330486(B1) | 2001-12-01 | Padula | Applicant |
| US6330493(B1) | 2001-12-01 | Takahashi et al. | Applicant |
| US6346950(B1) | 2002-02-01 | Jouppi | Applicant |
| US6346962(B1) | 2002-02-01 | Goodridge | Applicant |
| US6369847(B1) | 2002-04-01 | James et al. | Applicant |
| US6381515(B1) | 2002-04-01 | Inoue et al. | Applicant |
| US6400378(B1) | 2002-06-01 | Snook | Applicant |
| US6408230(B2) | 2002-06-01 | Wada | Applicant |
| US6430471(B1) | 2002-08-01 | Kintou et al. | Applicant |
| US6430475(B2) | 2002-08-01 | Okamoto et al. | Applicant |
| US6438457(B1) | 2002-08-01 | Yokoo et al. | Applicant |
| US6445964(B1) | 2002-09-01 | White et al. | Applicant |
| US6452915(B1) | 2002-09-01 | Jorgensen | Applicant |
| US6457043(B1) | 2002-09-01 | Kwak et al. | Applicant |
| US6459955(B1) | 2002-10-01 | Bartsch et al. | Applicant |
| US6463352(B1) | 2002-10-01 | Tadokoro et al. | Applicant |
| US6463361(B1) | 2002-10-01 | Wang et al. | Applicant |
| US6466844(B1) | 2002-10-01 | Ikeda et al. | Applicant |
| US6468265(B1) | 2002-10-01 | Evans et al. | Applicant |
| US6470235(B2) | 2002-10-01 | Kasuga et al. | Applicant |
| US6480762(B1) | 2002-11-01 | Uchikubo et al. | Applicant |
| US6491701(B2) | 2002-12-01 | Tierney et al. | Applicant |
| US6496099(B2) | 2002-12-01 | Wang et al. | Applicant |
| US6496755(B2) | 2002-12-01 | Wallach et al. | Applicant |
| US6501740(B1) | 2002-12-01 | Sun et al. | Applicant |
| US6507773(B2) | 2003-01-01 | Parker et al. | Applicant |
| US6522906(B1) | 2003-02-01 | Salisbury et al. | Applicant |
| US6523629(B1) | 2003-02-01 | Buttz et al. | Applicant |
| US6526332(B2) | 2003-02-01 | Sakamoto et al. | Applicant |
| US6529765(B1) | 2003-03-01 | Franck et al. | Applicant |
| US6529802(B1) | 2003-03-01 | Kawakita et al. | Applicant |
| US6532404(B2) | 2003-03-01 | Colens | Applicant |
| US6535182(B2) | 2003-03-01 | Stanton | Applicant |
| US6535793(B2) | 2003-03-01 | Allard | Applicant |
| US6540039(B1) | 2003-04-01 | Yu et al. | Applicant |
| US6543899(B2) | 2003-04-01 | Covannon et al. | Applicant |
| US6549215(B2) | 2003-04-01 | Jouppi | Applicant |
| US6563533(B1) | 2003-05-01 | Colby | Applicant |
| US6580246(B2) | 2003-06-01 | Jacobs | Applicant |
| US6584376(B1) | 2003-06-01 | Van Kommer | Applicant |
| US6594269(B1) | 2003-07-01 | Polcyn | Applicant |
| US6602469(B1) | 2003-08-01 | Maus et al. | Applicant |
| US6604019(B2) | 2003-08-01 | Ahlin et al. | Applicant |
| US6604021(B2) | 2003-08-01 | Imai et al. | Applicant |
| US6611120(B2) | 2003-08-01 | Song et al. | Applicant |
| US6643496(B1) | 2003-11-01 | Shimoyama et al. | Applicant |
| US6646677(B2) | 2003-11-01 | Noro et al. | Applicant |
| US6650748(B1) | 2003-11-01 | Edwards et al. | Applicant |
| US6684129(B2) | 2004-01-01 | Salisbury et al. | Applicant |
| US6691000(B2) | 2004-02-01 | Nagai et al. | Applicant |
| US6710797(B1) | 2004-03-01 | McNelley et al. | Applicant |
| US6728599(B2) | 2004-04-01 | Wang et al. | Applicant |
| US6763282(B2) | 2004-07-01 | Glenn et al. | Applicant |
| US6764373(B1) | 2004-07-01 | Osawa et al. | Applicant |
| US6769771(B2) | 2004-08-01 | Trumbull | Applicant |
| US6781606(B2) | 2004-08-01 | Jouppi | Applicant |
| US6784916(B2) | 2004-08-01 | Smith | Applicant |
| US6785589(B2) | 2004-08-01 | Eggenberger et al. | Applicant |
| US6791550(B2) | 2004-09-01 | Goldhor et al. | Applicant |
| US6798753(B1) | 2004-09-01 | Doganata et al. | Applicant |
| US6799065(B1) | 2004-09-01 | Niemeyer | Applicant |
| US6799088(B2) | 2004-09-01 | Wang et al. | Applicant |
| US6804580(B1) | 2004-10-01 | Stoddard et al. | Applicant |
| US6804656(B1) | 2004-10-01 | Rosenfeld et al. | Applicant |
| US6810411(B1) | 2004-10-01 | Coughlin et al. | Applicant |
| US6836703(B2) | 2004-12-01 | Wang et al. | Applicant |
| US6839612(B2) | 2005-01-01 | Sanchez et al. | Applicant |
| US6840904(B2) | 2005-01-01 | Goldberg | Applicant |
| US6845297(B2) | 2005-01-01 | Allard | Applicant |
| US6852107(B2) | 2005-02-01 | Wang et al. | Applicant |
| US6853878(B2) | 2005-02-01 | Hirayama et al. | Applicant |
| US6853880(B2) | 2005-02-01 | Sakagami et al. | Applicant |
| US6871117(B2) | 2005-03-01 | Wang et al. | Applicant |
| US6879879(B2) | 2005-04-01 | Jouppi et al. | Applicant |
| US6888333(B2) | 2005-05-01 | Laby | Applicant |
| US6892112(B2) | 2005-05-01 | Wang et al. | Applicant |
| US6895305(B2) | 2005-05-01 | Lathan et al. | Applicant |
| US6898484(B2) | 2005-05-01 | Lemelson et al. | Applicant |
| US6914622(B1) | 2005-07-01 | Smith et al. | Applicant |
| US6925357(B2) | 2005-08-01 | Wang et al. | Applicant |
| US6951535(B2) | 2005-10-01 | Ghodoussi et al. | Applicant |
| US6952470(B1) | 2005-10-01 | Tioe | Applicant |
| US6957712(B2) | 2005-10-01 | Song et al. | Applicant |
| US6958706(B2) | 2005-10-01 | Chaco et al. | Applicant |
| US6965394(B2) | 2005-11-01 | Gutta et al. | Applicant |
| US6995664(B1) | 2006-02-01 | Darling | Applicant |
| US7007235(B1) | 2006-02-01 | Hussein et al. | Applicant |
| US7015934(B2) | 2006-03-01 | Toyama et al. | Applicant |
| USRE39080(E) | 2006-04-01 | Johnston | Applicant |
| US7030757(B2) | 2006-04-01 | Matsuhira et al. | Applicant |
| US7058689(B2) | 2006-06-01 | Parker et al. | Applicant |
| US7092001(B2) | 2006-08-01 | Schulz | Applicant |
| US7096090(B1) | 2006-08-01 | Zweig | Applicant |
| US7115102(B2) | 2006-10-01 | Abbruscato | Applicant |
| US7117067(B2) | 2006-10-01 | McLurkin et al. | Applicant |
| US7123285(B2) | 2006-10-01 | Smith et al. | Applicant |
| US7123974(B1) | 2006-10-01 | Hamilton | Applicant |
| US7123991(B2) | 2006-10-01 | Graf et al. | Applicant |
| US7127325(B2) | 2006-10-01 | Nagata et al. | Applicant |
| US7129970(B2) | 2006-10-01 | James et al. | Applicant |
| US7133062(B2) | 2006-11-01 | Castles et al. | Applicant |
| US7142945(B2) | 2006-11-01 | Wang et al. | Applicant |
| US7142947(B2) | 2006-11-01 | Wang et al. | Applicant |
| US7151982(B2) | 2006-12-01 | Liff et al. | Applicant |
| US7154526(B2) | 2006-12-01 | Foote et al. | Applicant |
| US7155306(B2) | 2006-12-01 | Haitin et al. | Applicant |
| US7156809(B2) | 2007-01-01 | Quy | Applicant |
| US7158859(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7158860(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7158861(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7161322(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7162338(B2) | 2007-01-01 | Goncalves et al. | Applicant |
| US7164969(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7164970(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7167448(B2) | 2007-01-01 | Wookey et al. | Applicant |
| US7171286(B2) | 2007-01-01 | Wang et al. | Applicant |
| US7174238(B1) | 2007-02-01 | Zweig | Applicant |
| US7181455(B2) | 2007-02-01 | Wookey et al. | Applicant |
| US7184559(B2) | 2007-02-01 | Jouppi | Applicant |
| US7188000(B2) | 2007-03-01 | Chiappetta et al. | Applicant |
| US7199790(B2) | 2007-04-01 | Rosenberg et al. | Applicant |
| US7202851(B2) | 2007-04-01 | Cunningham et al. | Applicant |
| US7206627(B2) | 2007-04-01 | Abovitz et al. | Applicant |
| US7215786(B2) | 2007-05-01 | Nakadai et al. | Applicant |
| US7227334(B2) | 2007-06-01 | Yang et al. | Applicant |
| US7256708(B2) | 2007-08-01 | Rosenfeld | Applicant |
| US7262573(B2) | 2007-08-01 | Wang et al. | Applicant |
| US7289883(B2) | 2007-10-01 | Wang et al. | Applicant |
| US7292912(B2) | 2007-11-01 | Wang et al. | Applicant |
| US7317685(B1) | 2008-01-01 | Flott et al. | Applicant |
| US7321807(B2) | 2008-01-01 | Laski | Applicant |
| US7346429(B2) | 2008-03-01 | Goldenberg et al. | Applicant |
| US7382399(B1) | 2008-06-01 | McCall | Applicant |
| US7386730(B2) | 2008-06-01 | Uchikubo | Applicant |
| US7391432(B2) | 2008-06-01 | Terado | Applicant |
| US7400578(B2) | 2008-07-01 | Guthrie et al. | Applicant |
| US7404140(B2) | 2008-07-01 | O'Rourke | Applicant |
| US7421470(B2) | 2008-09-01 | Ludwig et al. | Applicant |
| US7430209(B2) | 2008-09-01 | Porter | Applicant |
| US7432949(B2) | 2008-10-01 | Remy et al. | Applicant |
| US7433921(B2) | 2008-10-01 | Ludwig et al. | Applicant |
| US7441953(B2) | 2008-10-01 | Banks | Examiner |
| US7492731(B2) | 2009-02-01 | Hagendorf | Applicant |
| US7523069(B1) | 2009-04-01 | Friedl et al. | Applicant |
| US7525281(B2) | 2009-04-01 | Koyanagi et al. | Applicant |
| US7535486(B2) | 2009-05-01 | Motomura et al. | Applicant |
| US7587512(B2) | 2009-09-01 | Ta et al. | Applicant |
| US7590060(B2) | 2009-09-01 | Miceli | Applicant |
| US7593030(B2) | 2009-09-01 | Wang et al. | Applicant |
| US7599290(B2) | 2009-10-01 | Dos Remedios et al. | Applicant |
| US7624166(B2) | 2009-11-01 | Foote et al. | Applicant |
| US7630314(B2) | 2009-12-01 | Dos Remedios et al. | Applicant |
| US7643051(B2) | 2010-01-01 | Sandberg et al. | Applicant |
| US7647320(B2) | 2010-01-01 | Mok et al. | Applicant |
| US7680038(B1) | 2010-03-01 | Gourlay | Applicant |
| US7693757(B2) | 2010-04-01 | Zimmerman | Applicant |
| US7698432(B2) | 2010-04-01 | Short et al. | Applicant |
| US7719229(B2) | 2010-05-01 | Kaneko et al. | Applicant |
| US7739383(B1) | 2010-06-01 | Short et al. | Applicant |
| US7756614(B2) | 2010-07-01 | Jouppi | Applicant |
| US7761185(B2) | 2010-07-01 | Wang et al. | Applicant |
| US7769492(B2) | 2010-08-01 | Wang et al. | Applicant |
| US7769705(B1) | 2010-08-01 | Luechtefeld | Applicant |
| US7813836(B2) | 2010-10-01 | Wang et al. | Applicant |
| US7831575(B2) | 2010-11-01 | Trossell et al. | Applicant |
| US7835775(B2) | 2010-11-01 | Sawayama et al. | Applicant |
| US7860680(B2) | 2010-12-01 | Arms et al. | Applicant |
| US7890382(B2) | 2011-02-01 | Robb et al. | Applicant |
| US7912583(B2) | 2011-03-01 | Gutmann et al. | Applicant |
| USRE42288(E) | 2011-04-01 | Degioanni | Applicant |
| US7924323(B2) | 2011-04-01 | Walker et al. | Applicant |
| US7949616(B2) | 2011-05-01 | Levy et al. | Applicant |
| US7982763(B2) | 2011-07-01 | King | Applicant |
| US7987069(B2) | 2011-07-01 | Rodgers et al. | Applicant |
| US8077963(B2) | 2011-12-01 | Wang et al. | Applicant |
| US8116910(B2) | 2012-02-01 | Walters et al. | Applicant |
| US8170241(B2) | 2012-05-01 | Roe et al. | Applicant |
| US8179418(B2) | 2012-05-01 | Wright et al. | Applicant |
| US8180486(B2) | 2012-05-01 | Saito et al. | Applicant |
| US8209051(B2) | 2012-06-01 | Wang et al. | Applicant |
| US8265793(B2) | 2012-09-01 | Cross et al. | Applicant |
| US8292807(B2) | 2012-10-01 | Perkins et al. | Applicant |
| US8340654(B2) | 2012-12-01 | Bratton et al. | Applicant |
| US8340819(B2) | 2012-12-01 | Mangaser et al. | Applicant |
| US8463435(B2) | 2013-06-01 | Herzog et al. | Applicant |
| US8503340(B1) | 2013-08-01 | Xu | Applicant |
| US8527094(B2) | 2013-09-01 | Kumar et al. | Applicant |
| US8532860(B2) | 2013-09-01 | Daly | Applicant |
| US2001/0002448(A1) | 2001-05-01 | Wilson et al. | Applicant |
| US2001/0010053(A1) | 2001-07-01 | Ben-Shachar et al. | Applicant |
| US2001/0020200(A1) | 2001-09-01 | Das et al. | Applicant |
| US2001/0034475(A1) | 2001-10-01 | Flach et al. | Applicant |
| US2001/0034544(A1) | 2001-10-01 | Mo | Applicant |
| US2001/0037163(A1) | 2001-11-01 | Allard | Applicant |
| US2001/0048464(A1) | 2001-12-01 | Barnett | Applicant |
| US2001/0051881(A1) | 2001-12-01 | Filler | Applicant |
| US2001/0054071(A1) | 2001-12-01 | Loeb | Applicant |
| US2001/0055373(A1) | 2001-12-01 | Yamashita | Applicant |
| US2002/0015296(A1) | 2002-02-01 | Howell | Applicant |
| US2002/0027597(A1) | 2002-03-01 | Sachau | Applicant |
| US2002/0027652(A1) | 2002-03-01 | Paromtchik et al. | Applicant |
| US2002/0033880(A1) | 2002-03-01 | Sul et al. | Applicant |
| US2002/0038168(A1) | 2002-03-01 | Kasuga et al. | Applicant |
| US2002/0049517(A1) | 2002-04-01 | Ruffner | Applicant |
| US2002/0055917(A1) | 2002-05-01 | Muraca | Examiner |
| US2002/0057279(A1) | 2002-05-01 | Jouppi | Applicant |
| US2002/0058929(A1) | 2002-05-01 | Green | Applicant |
| US2002/0059587(A1) | 2002-05-01 | Cofano et al. | Applicant |
| US2002/0063726(A1) | 2002-05-01 | Jouppi | Applicant |
| US2002/0073429(A1) | 2002-06-01 | Beane et al. | Applicant |
| US2002/0082498(A1) | 2002-06-01 | Wendt et al. | Applicant |
| US2002/0085030(A1) | 2002-07-01 | Ghani | Applicant |
| US2002/0095238(A1) | 2002-07-01 | Ahlin et al. | Applicant |
| US2002/0095239(A1) | 2002-07-01 | Wallach et al. | Applicant |
| US2002/0098879(A1) | 2002-07-01 | Rheey | Applicant |
| US2002/0104094(A1) | 2002-08-01 | Alexander et al. | Applicant |
| US2002/0109770(A1) | 2002-08-01 | Terada | Applicant |
| US2002/0111988(A1) | 2002-08-01 | Sato | Applicant |
| US2002/0120362(A1) | 2002-08-01 | Lathan et al. | Applicant |
| US2002/0130950(A1) | 2002-09-01 | James et al. | Applicant |
| US2002/0133062(A1) | 2002-09-01 | Arling et al. | Applicant |
| US2002/0141595(A1) | 2002-10-01 | Jouppi | Applicant |
| US2002/0143923(A1) | 2002-10-01 | Alexander | Applicant |
| US2002/0177925(A1) | 2002-11-01 | Onishi et al. | Applicant |
| US2002/0183894(A1) | 2002-12-01 | Wang et al. | Applicant |
| US2002/0184674(A1) | 2002-12-01 | Xi et al. | Applicant |
| US2002/0186243(A1) | 2002-12-01 | Ellis et al. | Applicant |
| US2003/0021107(A1) | 2003-01-01 | Howell et al. | Applicant |
| US2003/0030397(A1) | 2003-02-01 | Simmons | Applicant |
| US2003/0048481(A1) | 2003-03-01 | Kobayashi | Applicant |
| US2003/0050733(A1) | 2003-03-01 | Wang et al. | Applicant |
| US2003/0050734(A1) | 2003-03-01 | Lapham | Applicant |
| US2003/0060808(A1) | 2003-03-01 | Wilk | Applicant |
| US2003/0063600(A1) | 2003-04-01 | Noma et al. | Applicant |
| US2003/0069752(A1) | 2003-04-01 | Ledain et al. | Applicant |
| US2003/0100892(A1) | 2003-05-01 | Morley et al. | Applicant |
| US2003/0104806(A1) | 2003-06-01 | Ruef et al. | Applicant |
| US2003/0114962(A1) | 2003-06-01 | Niemeyer | Applicant |
| US2003/0126361(A1) | 2003-07-01 | Slater et al. | Applicant |
| US2003/0135203(A1) | 2003-07-01 | Wang et al. | Applicant |
| US2003/0144579(A1) | 2003-07-01 | Buss | Applicant |
| US2003/0144649(A1) | 2003-07-01 | Ghodoussi et al. | Applicant |
| US2003/0151658(A1) | 2003-08-01 | Smith | Applicant |
| US2003/0152145(A1) | 2003-08-01 | Kawakita | Applicant |
| US2003/0171710(A1) | 2003-09-01 | Bassuk et al. | Applicant |
| US2003/0174285(A1) | 2003-09-01 | Trumbull | Applicant |
| US2003/0180697(A1) | 2003-09-01 | Kim et al. | Applicant |
| US2003/0199000(A1) | 2003-10-01 | Valkirs et al. | Applicant |
| US2003/0206242(A1) | 2003-11-01 | Choi et al. | Applicant |
| US2003/0212472(A1) | 2003-11-01 | McKee | Applicant |
| US2003/0216834(A1) | 2003-11-01 | Allard | Applicant |
| US2003/0220541(A1) | 2003-11-01 | Salisbury et al. | Applicant |
| US2003/0220715(A1) | 2003-11-01 | Kneifel, II et al. | Applicant |
| US2003/0231244(A1) | 2003-12-01 | Bonilla et al. | Applicant |
| US2003/0232649(A1) | 2003-12-01 | Gizis | Applicant |
| US2003/0236590(A1) | 2003-12-01 | Park et al. | Applicant |
| US2004/0001197(A1) | 2004-01-01 | Ko et al. | Applicant |
| US2004/0001676(A1) | 2004-01-01 | Colgan et al. | Applicant |
| US2004/0010344(A1) | 2004-01-01 | Hiratsuka | Applicant |
| US2004/0012362(A1) | 2004-01-01 | Tsurumi | Applicant |
| US2004/0013295(A1) | 2004-01-01 | Sabe et al. | Applicant |
| US2004/0019406(A1) | 2004-01-01 | Wang et al. | Examiner |
| US2004/0024490(A1) | 2004-02-01 | McLurkin et al. | Applicant |
| US2004/0041904(A1) | 2004-03-01 | Lapalme et al. | Applicant |
| US2004/0065073(A1) | 2004-04-01 | Nash | Applicant |
| US2004/0068657(A1) | 2004-04-01 | Alexander et al. | Applicant |
| US2004/0078219(A1) | 2004-04-01 | Kaylor et al. | Applicant |
| US2004/0080610(A1) | 2004-04-01 | James et al. | Applicant |
| US2004/0088077(A1) | 2004-05-01 | Jouppi et al. | Applicant |
| US2004/0093409(A1) | 2004-05-01 | Thompson et al. | Applicant |
| US2004/0095516(A1) | 2004-05-01 | Rohlicek | Applicant |
| US2004/0098167(A1) | 2004-05-01 | Yi et al. | Applicant |
| US2004/0102167(A1) | 2004-05-01 | Shim et al. | Applicant |
| US2004/0107254(A1) | 2004-06-01 | Ludwig et al. | Applicant |
| US2004/0107255(A1) | 2004-06-01 | Ludwig et al. | Applicant |
| US2004/0117065(A1) | 2004-06-01 | Wang et al. | Applicant |
| US2004/0123158(A1) | 2004-06-01 | Roskind | Applicant |
| US2004/0135879(A1) | 2004-07-01 | Stacy et al. | Applicant |
| US2004/0138547(A1) | 2004-07-01 | Wang et al. | Applicant |
| US2004/0143421(A1) | 2004-07-01 | Wang et al. | Applicant |
| US2004/0148638(A1) | 2004-07-01 | Weisman et al. | Applicant |
| US2004/0153211(A1) | 2004-08-01 | Kamoto et al. | Applicant |
| US2004/0157612(A1) | 2004-08-01 | Kim | Applicant |
| US2004/0162637(A1) | 2004-08-01 | Wang et al. | Applicant |
| US2004/0167666(A1) | 2004-08-01 | Wang et al. | Applicant |
| US2004/0167668(A1) | 2004-08-01 | Wang et al. | Applicant |
| US2004/0170300(A1) | 2004-09-01 | Jouppi | Applicant |
| US2004/0172301(A1) | 2004-09-01 | Mihai et al. | Applicant |
| US2004/0172306(A1) | 2004-09-01 | Wohl et al. | Applicant |
| US2004/0174129(A1) | 2004-09-01 | Wang et al. | Applicant |
| US2004/0175684(A1) | 2004-09-01 | Kaasa et al. | Applicant |
| US2004/0179714(A1) | 2004-09-01 | Jouppi | Applicant |
| US2004/0186623(A1) | 2004-09-01 | Dooley et al. | Applicant |
| US2004/0189700(A1) | 2004-09-01 | Mandavilli et al. | Applicant |
| US2004/0201602(A1) | 2004-10-01 | Mody et al. | Applicant |
| US2004/0205664(A1) | 2004-10-01 | Prendergast | Applicant |
| US2004/0215490(A1) | 2004-10-01 | Duchon et al. | Applicant |
| US2004/0222638(A1) | 2004-11-01 | Bednyak | Applicant |
| US2004/0224676(A1) | 2004-11-01 | Iseki | Applicant |
| US2004/0230340(A1) | 2004-11-01 | Fukuchi et al. | Applicant |
| US2004/0240981(A1) | 2004-12-01 | Dothan et al. | Applicant |
| US2005/0003330(A1) | 2005-01-01 | Asgarinejad | Applicant |
| US2005/0004708(A1) | 2005-01-01 | Goldenberg et al. | Applicant |
| US2005/0007445(A1) | 2005-01-01 | Foote et al. | Applicant |
| US2005/0013149(A1) | 2005-01-01 | Trossell | Applicant |
| US2005/0021182(A1) | 2005-01-01 | Wang et al. | Applicant |
| US2005/0021183(A1) | 2005-01-01 | Wang et al. | Applicant |
| US2005/0021187(A1) | 2005-01-01 | Wang et al. | Applicant |
| US2005/0021309(A1) | 2005-01-01 | Alexander et al. | Applicant |
| US2005/0024485(A1) | 2005-02-01 | Castles et al. | Examiner |
| US2005/0027567(A1) | 2005-02-01 | Taha | Applicant |
| US2005/0027794(A1) | 2005-02-01 | Decker | Applicant |
| US2005/0028221(A1) | 2005-02-01 | Liu et al. | Applicant |
| US2005/0035862(A1) | 2005-02-01 | Wildman et al. | Applicant |
| US2005/0038416(A1) | 2005-02-01 | Wang et al. | Applicant |
| US2005/0038564(A1) | 2005-02-01 | Burick et al. | Applicant |
| US2005/0049898(A1) | 2005-03-01 | Hirakawa | Applicant |
| US2005/0052527(A1) | 2005-03-01 | Remy et al. | Examiner |
| US2005/0060211(A1) | 2005-03-01 | Xiao et al. | Applicant |
| US2005/0065438(A1) | 2005-03-01 | Miller | Applicant |
| US2005/0065659(A1) | 2005-03-01 | Tanaka et al. | Applicant |
| US2005/0065813(A1) | 2005-03-01 | Mishelevich et al. | Applicant |
| US2005/0071046(A1) | 2005-03-01 | Miyazaki et al. | Applicant |
| US2005/0078816(A1) | 2005-04-01 | Sekiguchi et al. | Applicant |
| US2005/0083011(A1) | 2005-04-01 | Yang et al. | Applicant |
| US2005/0099493(A1) | 2005-05-01 | Chew | Applicant |
| US2005/0104964(A1) | 2005-05-01 | Bovyrin et al. | Applicant |
| US2005/0110867(A1) | 2005-05-01 | Schultz | Applicant |
| US2005/0122390(A1) | 2005-06-01 | Wang et al. | Applicant |
| US2005/0125098(A1) | 2005-06-01 | Wang et al. | Applicant |
| US2005/0154265(A1) | 2005-07-01 | Miro et al. | Applicant |
| US2005/0182322(A1) | 2005-08-01 | Grispo | Applicant |
| US2005/0192721(A1) | 2005-09-01 | Jouppi | Applicant |
| US2005/0204438(A1) | 2005-09-01 | Wang et al. | Applicant |
| US2005/0212478(A1) | 2005-09-01 | Takenaka | Applicant |
| US2005/0219356(A1) | 2005-10-01 | Smith et al. | Applicant |
| US2005/0225634(A1) | 2005-10-01 | Brunetti et al. | Applicant |
| US2005/0231156(A1) | 2005-10-01 | Yan | Applicant |
| US2005/0231586(A1) | 2005-10-01 | Rodman et al. | Applicant |
| US2005/0232647(A1) | 2005-10-01 | Takenaka | Applicant |
| US2005/0234592(A1) | 2005-10-01 | McGee et al. | Applicant |
| US2005/0267826(A1) | 2005-12-01 | Levy et al. | Applicant |
| US2005/0283414(A1) | 2005-12-01 | Fernandes et al. | Applicant |
| US2006/0007943(A1) | 2006-01-01 | Fellman | Applicant |
| US2006/0013263(A1) | 2006-01-01 | Fellman | Applicant |
| US2006/0013469(A1) | 2006-01-01 | Wang et al. | Applicant |
| US2006/0014388(A1) | 2006-01-01 | Lur et al. | Applicant |
| US2006/0020694(A1) | 2006-01-01 | Nag et al. | Applicant |
| US2006/0029065(A1) | 2006-02-01 | Fellman | Applicant |
| US2006/0047365(A1) | 2006-03-01 | Ghodoussi et al. | Applicant |
| US2006/0048286(A1) | 2006-03-01 | Donato | Applicant |
| US2006/0052676(A1) | 2006-03-01 | Wang et al. | Applicant |
| US2006/0052684(A1) | 2006-03-01 | Takahashi et al. | Applicant |
| US2006/0064212(A1) | 2006-03-01 | Thorne | Applicant |
| US2006/0074525(A1) | 2006-04-01 | Close et al. | Applicant |
| US2006/0074719(A1) | 2006-04-01 | Horner | Applicant |
| US2006/0082642(A1) | 2006-04-01 | Wang et al. | Applicant |
| US2006/0087746(A1) | 2006-04-01 | Lipow | Applicant |
| US2006/0095158(A1) | 2006-05-01 | Lee et al. | Applicant |
| US2006/0095170(A1) | 2006-05-01 | Yang et al. | Applicant |
| US2006/0098573(A1) | 2006-05-01 | Beer et al. | Applicant |
| US2006/0103659(A1) | 2006-05-01 | Karandikar et al. | Applicant |
| US2006/0104279(A1) | 2006-05-01 | Fellman et al. | Applicant |
| US2006/0106493(A1) | 2006-05-01 | Niemeyer et al. | Applicant |
| US2006/0122482(A1) | 2006-06-01 | Mariotti et al. | Applicant |
| US2006/0125356(A1) | 2006-06-01 | Meek et al. | Applicant |
| US2006/0142881(A1) | 2006-06-01 | Wang et al. | Applicant |
| US2006/0142983(A1) | 2006-06-01 | Sorensen | Applicant |
| US2006/0149418(A1) | 2006-07-01 | Anvari | Applicant |
| US2006/0161136(A1) | 2006-07-01 | Anderson et al. | Applicant |
| US2006/0161303(A1) | 2006-07-01 | Wang et al. | Applicant |
| US2006/0164546(A1) | 2006-07-01 | Adachi et al. | Applicant |
| US2006/0171515(A1) | 2006-08-01 | Hintermeister et al. | Applicant |
| US2006/0173708(A1) | 2006-08-01 | Vining et al. | Applicant |
| US2006/0173712(A1) | 2006-08-01 | Joubert | Applicant |
| US2006/0178776(A1) | 2006-08-01 | Feingold et al. | Applicant |
| US2006/0178777(A1) | 2006-08-01 | Park et al. | Applicant |
| US2006/0189393(A1) | 2006-08-01 | Edery | Applicant |
| US2006/0195569(A1) | 2006-08-01 | Barker | Applicant |
| US2006/0224781(A1) | 2006-10-01 | Tsao et al. | Applicant |
| US2006/0247045(A1) | 2006-11-01 | Jeong et al. | Applicant |
| US2006/0259193(A1) | 2006-11-01 | Wang et al. | Applicant |
| US2006/0268704(A1) | 2006-11-01 | Ansari et al. | Applicant |
| US2006/0271238(A1) | 2006-11-01 | Choi et al. | Applicant |
| US2006/0271400(A1) | 2006-11-01 | Clements et al. | Applicant |
| US2006/0293788(A1) | 2006-12-01 | Pogodin | Applicant |
| US2007/0021871(A1) | 2007-01-01 | Wang et al. | Applicant |
| US2007/0025711(A1) | 2007-02-01 | Marcus | Applicant |
| US2007/0046237(A1) | 2007-03-01 | Lakshmanan et al. | Applicant |
| US2007/0050937(A1) | 2007-03-01 | Song et al. | Applicant |
| US2007/0064092(A1) | 2007-03-01 | Sandberg et al. | Applicant |
| US2007/0078566(A1) | 2007-04-01 | Wang et al. | Applicant |
| US2007/0112700(A1) | 2007-05-01 | Den et al. | Applicant |
| US2007/0117516(A1) | 2007-05-01 | Saidi et al. | Applicant |
| US2007/0120965(A1) | 2007-05-01 | Sandberg et al. | Applicant |
| US2007/0122783(A1) | 2007-05-01 | Habashi | Applicant |
| US2007/0133407(A1) | 2007-06-01 | Choi et al. | Applicant |
| US2007/0135967(A1) | 2007-06-01 | Jung et al. | Applicant |
| US2007/0142964(A1) | 2007-06-01 | Abramson | Applicant |
| US2007/0176060(A1) | 2007-08-01 | White et al. | Applicant |
| US2007/0192910(A1) | 2007-08-01 | Vu et al. | Applicant |
| US2007/0197896(A1) | 2007-08-01 | Moll et al. | Applicant |
| US2007/0198128(A1) | 2007-08-01 | Ziegler et al. | Applicant |
| US2007/0198130(A1) | 2007-08-01 | Wang et al. | Applicant |
| US2007/0199108(A1) | 2007-08-01 | Angle et al. | Applicant |
| US2007/0216347(A1) | 2007-09-01 | Kaneko et al. | Applicant |
| US2007/0250212(A1) | 2007-10-01 | Halloran et al. | Applicant |
| US2007/0255706(A1) | 2007-11-01 | Iketani et al. | Applicant |
| US2007/0262884(A1) | 2007-11-01 | Goncalves et al. | Applicant |
| US2007/0273751(A1) | 2007-11-01 | Sachau | Applicant |
| US2007/0291109(A1) | 2007-12-01 | Wang et al. | Applicant |
| US2007/0291128(A1) | 2007-12-01 | Wang et al. | Applicant |
| US2008/0009969(A1) | 2008-01-01 | Bruemmer et al. | Applicant |
| US2008/0011904(A1) | 2008-01-01 | Cepollina et al. | Applicant |
| US2008/0045804(A1) | 2008-02-01 | Williams | Applicant |
| US2008/0065268(A1) | 2008-03-01 | Wang et al. | Applicant |
| US2008/0082211(A1) | 2008-04-01 | Wang et al. | Applicant |
| US2008/0126132(A1) | 2008-05-01 | Warner et al. | Applicant |
| US2008/0133052(A1) | 2008-06-01 | Jones et al. | Applicant |
| US2008/0174570(A1) | 2008-07-01 | Jobs et al. | Applicant |
| US2008/0201016(A1) | 2008-08-01 | Finlay | Examiner |
| US2008/0201017(A1) | 2008-08-01 | Wang et al. | Applicant |
| US2008/0215987(A1) | 2008-09-01 | Alexander et al. | Applicant |
| US2008/0229531(A1) | 2008-09-01 | Takida | Applicant |
| US2008/0255703(A1) | 2008-10-01 | Wang et al. | Applicant |
| US2008/0263451(A1) | 2008-10-01 | Portele et al. | Applicant |
| US2008/0269949(A1) | 2008-10-01 | Norman et al. | Applicant |
| US2008/0281467(A1) | 2008-11-01 | Pinter | Applicant |
| US2008/0306375(A1) | 2008-12-01 | Sayler et al. | Applicant |
| US2009/0030552(A1) | 2009-01-01 | Nakadai et al. | Applicant |
| US2009/0044334(A1) | 2009-02-01 | Parsell et al. | Applicant |
| US2009/0055023(A1) | 2009-02-01 | Walters et al. | Applicant |
| US2009/0070135(A1) | 2009-03-01 | Parida et al. | Applicant |
| US2009/0086013(A1) | 2009-04-01 | Thapa | Applicant |
| US2009/0105882(A1) | 2009-04-01 | Wang et al. | Applicant |
| US2009/0106679(A1) | 2009-04-01 | Anzures et al. | Applicant |
| US2009/0122699(A1) | 2009-05-01 | Alperovitch et al. | Applicant |
| US2009/0125147(A1) | 2009-05-01 | Wang et al. | Applicant |
| US2009/0144425(A1) | 2009-06-01 | Marr et al. | Applicant |
| US2009/0164255(A1) | 2009-06-01 | Menschik et al. | Applicant |
| US2009/0164657(A1) | 2009-06-01 | Li et al. | Applicant |
| US2009/0171170(A1) | 2009-07-01 | Li et al. | Applicant |
| US2009/0177323(A1) | 2009-07-01 | Ziegler et al. | Applicant |
| US2009/0177641(A1) | 2009-07-01 | Raghavan | Applicant |
| US2009/0237317(A1) | 2009-09-01 | Rofougaran | Applicant |
| US2009/0240371(A1) | 2009-09-01 | Wang et al. | Applicant |
| US2009/0248200(A1) | 2009-10-01 | Root | Applicant |
| US2009/0259339(A1) | 2009-10-01 | Wright et al. | Applicant |
| US2010/0010672(A1) | 2010-01-01 | Wang et al. | Applicant |
| US2010/0010673(A1) | 2010-01-01 | Wang et al. | Applicant |
| US2010/0019715(A1) | 2010-01-01 | Roe et al. | Applicant |
| US2010/0051596(A1) | 2010-03-01 | Diedrick et al. | Applicant |
| US2010/0063848(A1) | 2010-03-01 | Kremer et al. | Applicant |
| US2010/0070079(A1) | 2010-03-01 | Mangaser et al. | Applicant |
| US2010/0073490(A1) | 2010-03-01 | Wang et al. | Applicant |
| US2010/0076600(A1) | 2010-03-01 | Cross et al. | Applicant |
| US2010/0085874(A1) | 2010-04-01 | Noy et al. | Applicant |
| US2010/0088232(A1) | 2010-04-01 | Gale | Applicant |
| US2010/0115418(A1) | 2010-05-01 | Wang et al. | Applicant |
| US2010/0116566(A1) | 2010-05-01 | Ohm et al. | Applicant |
| US2010/0131103(A1) | 2010-05-01 | Herzog et al. | Applicant |
| US2010/0145479(A1) | 2010-06-01 | Griffiths | Applicant |
| US2010/0157825(A1) | 2010-06-01 | Anderlind et al. | Applicant |
| US2010/0191375(A1) | 2010-07-01 | Wright et al. | Applicant |
| US2010/0228249(A1) | 2010-09-01 | Mohr et al. | Applicant |
| US2010/0268383(A1) | 2010-10-01 | Wang et al. | Applicant |
| US2010/0323783(A1) | 2010-12-01 | Nonaka et al. | Applicant |
| US2011/0050841(A1) | 2011-03-01 | Wang et al. | Applicant |
| US2011/0071702(A1) | 2011-03-01 | Wang et al. | Applicant |
| US2011/0172822(A1) | 2011-07-01 | Ziegler et al. | Applicant |
| US2011/0187875(A1) | 2011-08-01 | Sanchez et al. | Applicant |
| US2011/0190930(A1) | 2011-08-01 | Hanrahan et al. | Applicant |
| US2011/0213210(A1) | 2011-09-01 | Temby et al. | Applicant |
| US2011/0218674(A1) | 2011-09-01 | Stuart et al. | Applicant |
| US2011/0245973(A1) | 2011-10-01 | Wang et al. | Applicant |
| US2011/0292193(A1) | 2011-12-01 | Wang et al. | Applicant |
| US2011/0301759(A1) | 2011-12-01 | Wang et al. | Applicant |
| US2012/0023506(A1) | 2012-01-01 | Maeckel et al. | Applicant |
| US2012/0036484(A1) | 2012-02-01 | Zhang et al. | Applicant |
| US2012/0072023(A1) | 2012-03-01 | Ota | Applicant |
| US2012/0072024(A1) | 2012-03-01 | Wang et al. | Applicant |
| US2012/0092157(A1) | 2012-04-01 | Tran | Applicant |
| US2012/0095352(A1) | 2012-04-01 | Tran | Applicant |
| US2012/0191246(A1) | 2012-07-01 | Roe et al. | Applicant |
| US2012/0191464(A1) | 2012-07-01 | Stuart et al. | Applicant |
| AU1216200(A) | 2000-05-01 | Applicant | |
| CA2289697(A1) | 1998-11-01 | Applicant | |
| CN1554193(A) | 2004-12-01 | Applicant | |
| CN1554985(A) | 2004-12-01 | Applicant | |
| CN101106939(A) | 2008-01-01 | Applicant | |
| CN101390098(A) | 2009-03-01 | Applicant | |
| CN101507260(A) | 2009-08-01 | Applicant | |
| CN101730894(A) | 2010-06-01 | Applicant | |
| CN101866396(A) | 2010-10-01 | Applicant | |
| CN101978365(A) | 2011-02-01 | Applicant | |
| CN102203759(A) | 2011-09-01 | Applicant | |
| CN101106939(B) | 2011-11-01 | Applicant | |
| EP92/466492(A2) | 1992-01-01 | Applicant | |
| EP92/488673(A2) | 1992-06-01 | Applicant | |
| EP981905(B1) | 2002-01-01 | Applicant | |
| EP1262142(A2) | 2002-12-01 | Applicant | |
| EP1304872(A1) | 2003-04-01 | Applicant | |
| EP1536660(B2) | 2004-09-01 | Applicant | |
| EP1536660(A2) | 2005-06-01 | Applicant | |
| EP2005/1573406(A2) | 2005-09-01 | Applicant | |
| EP2005/1594660(A2) | 2005-11-01 | Applicant | |
| EP1763243(A2) | 2007-03-01 | Applicant | |
| EP2007/1791464(A2) | 2007-06-01 | Applicant | |
| EP2007/1800476(A2) | 2007-06-01 | Applicant | |
| EP1819108(A2) | 2007-08-01 | Applicant | |
| EP2007/1856644(A2) | 2007-11-01 | Applicant | |
| EP1536660(A3) | 2008-04-01 | Applicant | |
| EP2008/1928310(A2) | 2008-06-01 | Applicant | |
| EP1232610(B1) | 2009-01-01 | Applicant | |
| EP20092027716(A2) | 2009-02-01 | Applicant | |
| EP2010/2145274(A1) | 2010-01-01 | Applicant | |
| EP2010/2214111(A2) | 2010-08-01 | Applicant | |
| EP2010/2263158(A2) | 2010-12-01 | Applicant | |
| EP2011/2300930(A2) | 2011-03-01 | Applicant | |
| EP2300930(A1) | 2011-03-01 | Applicant | |
| EP2011/2342651(A2) | 2011-07-01 | Applicant | |
| GB2431261(A) | 2007-04-01 | Applicant | |
| JP7-194609(A) | 1995-08-01 | Applicant | |
| JP2007-213753(A) | 1995-08-01 | Applicant | |
| JP2007-248823(A) | 1995-08-01 | Applicant | |
| JP2007-257422(A) | 1995-10-01 | Applicant | |
| JP8084328(A) | 1996-03-01 | Applicant | |
| JPH0884328 | 1996-03-01 | Applicant | |
| JP96/8320727(A) | 1996-12-01 | Applicant | |
| JP9-267276(A) | 1997-10-01 | Applicant | |
| JP10079097(A) | 1998-03-01 | Applicant | |
| JP10288689(A) | 1998-10-01 | Applicant | |
| JP2000-032319(A) | 2000-01-01 | Applicant | |
| JP2000/049800(A) | 2000-02-01 | Applicant | |
| JP2000/079587(A) | 2000-03-01 | Applicant | |
| JP2000/196876(A) | 2000-07-01 | Applicant | |
| JP2000-235423(A) | 2000-08-01 | Applicant | |
| JP2001/188124(A) | 2001-04-01 | Applicant | |
| JP2001/125641(A) | 2001-05-01 | Applicant | |
| JP2001-147718(A) | 2001-05-01 | Applicant | |
| JP2001/179663(A) | 2001-07-01 | Applicant | |
| JP2001-198865(A) | 2001-07-01 | Applicant | |
| JP2001-198868(A) | 2001-07-01 | Applicant | |
| JP2001-199356(A) | 2001-07-01 | Applicant | |
| JP2002-000574(A) | 2002-01-01 | Applicant | |
| JP2002-046088(A) | 2002-02-01 | Applicant | |
| JP2002/112970(A) | 2002-04-01 | Applicant | |
| JP2002/101333(A) | 2002-05-01 | Applicant | |
| JP2002-305743(A) | 2002-10-01 | Applicant | |
| JP2002-355779(A) | 2002-12-01 | Applicant | |
| JP2004/524824(T) | 2004-08-01 | Applicant | |
| JP2004-261941(A) | 2004-09-01 | Applicant | |
| JP2004/289379(A) | 2004-10-01 | Applicant | |
| JP2005/028066(A) | 2005-02-01 | Applicant | |
| JP2005/059170(A) | 2005-03-01 | Applicant | |
| JP2006/508806(A) | 2006-03-01 | Applicant | |
| JP2006/109094(A) | 2006-04-01 | Applicant | |
| JP2006/224294(A) | 2006-08-01 | Applicant | |
| JP2006/246438(A) | 2006-09-01 | Applicant | |
| JP2007-007040(A) | 2007-01-01 | Applicant | |
| JP2007/081646(A) | 2007-03-01 | Applicant | |
| JP2007-232208(A) | 2007-09-01 | Applicant | |
| JP2007-316966(A) | 2007-12-01 | Applicant | |
| JP2010/064154(A) | 2010-03-01 | Applicant | |
| JP2010/532109(A) | 2010-09-01 | Applicant | |
| JP2010/246954(A) | 2010-11-01 | Applicant | |
| KR2006/0037979(A) | 2006-05-01 | Applicant | |
| KR2009/0012542(A) | 2009-02-01 | Applicant | |
| KR2010/0019479(A) | 2010-02-01 | Applicant | |
| KR2010/0139037(A) | 2010-12-01 | Applicant | |
| WO93-06690(A1) | 1993-04-01 | Applicant | |
| WO98-51078(A) | 1998-11-01 | Applicant | |
| WO99/67067(A1) | 1999-12-01 | Applicant | |
| WO/25516(A1) | 2000-05-01 | Applicant | |
| WO/33726(A3) | 2000-06-01 | Applicant | |
| WO1/31861(A1) | 2001-05-01 | Applicant | |
| WO3/077745(A) | 2003-09-01 | Applicant | |
| WO2004/008738(A1) | 2004-01-01 | Applicant | |
| WO2004/012018(A2) | 2004-02-01 | Applicant | |
| WO2004/075456(A2) | 2004-09-01 | Applicant | |
| WO2006/012797(A1) | 2006-02-01 | Applicant | |
| WO2006/078611(A1) | 2006-04-01 | Applicant | |
| WO2006044847(A2) | 2006-04-01 | Applicant | |
| WO2007/041295(A1) | 2006-09-01 | Applicant | |
| WO2007/041295(A2) | 2007-04-01 | Applicant | |
| WO2007/041038(A1) | 2007-06-01 | Applicant | |
| WO2008/100272(A2) | 2008-08-01 | Applicant | |
| WO2008/100272(A3) | 2008-10-01 | Applicant | |
| WO2009/117274(A2) | 2009-09-01 | Applicant | |
| WO2009/128997(A1) | 2009-10-01 | Applicant | |
| WO2009/145958(A2) | 2009-12-01 | Applicant | |
| WO2010/006205(A1) | 2010-01-01 | Applicant | |
| WO2010/006211(A1) | 2010-01-01 | Applicant | |
| WO2010/033666(A1) | 2010-03-01 | Applicant | |
| WO2010/047881(A1) | 2010-04-01 | Applicant | |
| WO2010/062798(A1) | 2010-06-01 | Applicant | |
| WO2010/065257(A1) | 2010-06-01 | Applicant | |
| WO2010/120407(A1) | 2010-10-01 | Applicant | |
| WO2011/028589(A2) | 2011-03-01 | Applicant | |
| WO2011/028589(A3) | 2011-04-01 | Applicant | |
| WO2011/097130(A2) | 2011-08-01 | Applicant | |
| WO2011/097132(A2) | 2011-08-01 | Applicant | |
| WO2011/109336(A2) | 2011-09-01 | Applicant | |
| WO2011/097132(A3) | 2011-12-01 | Applicant | |
| WO2011/149902(A2) | 2011-12-01 | Applicant |
Non-Patent Literature (183)
- Han, et al., “Construction of an Omnidirectional Mobile Robot Platform Based on Active Dual-Wheel Caster Mechanisms and Development of a Control Simulator”, 2000, Kluwer Acedemic Publishers, vol. 29, pp. 257-275.Applicant
- Haule et al., “Control Scheme for Delayed Teleoperation Tasks”, May 17, 1995, Proceedings of the Pacific Rim Conference on Communications, Computer and Signal Processing.Applicant
- Lee et al., “A novel method of surgical instruction: International telementoring”, 1998, Internet pp. 1-4.Applicant
- Ogata et al., “Emotional Communication Robot: WAMOEBA-2R—Emotion Model and Evaluation Experiments”, 1999, Internet, pp. 1-16.Applicant
- Rovetta et al., “A New Telerobotic Application: Remote Laparoscopic Surgery Using Satellites and Optical Fiber Networks for Data Exchange”, Jun. 1, 1996, International Journal of Robotics Research, pp. 267-279.Applicant
- Tahboub, Karim A. et al., “Dynamics Analysis and Control of a Holonomic Vehicle With Continously Variable Transmission”, Mar. 2002, Journal of Dynamic Systems, Measurement, and Control, ASME vol. 124, pp. 118-126.Applicant
- Yamauchi et al., PackBot: A Versatile Platform for Military Robotics, 2004, Internet, pp. 1-10.Applicant
- International Search Report received for International Patent Application No. PCT/US2007/14099, mailed on Jul. 30, 2008, 1 page.Applicant
- International Preliminary Report on Patentability and Written Opinion received for International Patent Application No. PCT/US/200714099, dated Dec. 16, 2008, 5 pages.Applicant
- Al-Kassab, “A Review of Telemedicine”, Journal of Telemedicine and Telecare, 1999, vol. 5, Supplement 1.Applicant
- F. Ando et al., “A Multimedia Self-service Terminal with Conferencing Functions”, 1995, IEEE, pp. 357-362.Applicant
- Android Amusement Corp., “What Marketing Secret”, 1982 http:///www.theoldrobots.com/images17/dc8.JPG.Applicant
- Applebome, “Planning Domesticated Robots for Tomorrow's Household”, New York Times, Mar. 4, 1982, pp. 21 and 23 http://www.theoldrobots.com/images17/dc17.JPG.Applicant
- Baltus et al., “Towards Personal Service Robots for the Elderly, Proceedings for the Elderly Workshop on Interactive Robots and Entertainment”, 2000, Computer Science and Robotics, http://www.cs.cmu.edu/thrun/papers/thrun.nursebot-early.pdf.Applicant
- Bar-Cohen et al., Virtual reality robotic telesurgery simulations using MEMICA haptic system, Mar. 5, 2001, Internet, pp. 1-7.Applicant
- Bartholomew, “An Apothecary's Pharmacy”, 1230-1240 http://classes.bnf.fr/ema/grands/034.htm.Applicant
- Bauer, Jeffrey C., “Service Robots in Health Care: The Evolution of Mechanical Solutions to Human Resource Problems”, Jun. 2003.Applicant
- Bauer, John et al., “Remote telesurgical mentoring: feasibility and efficacy”, 2000, IEEE, pp. 1-9.Applicant
- Bischoff, “Design Concept and Realization of the Humanoid Service Robot HERMES”, Field and Service Robotics, Springer, London, 1998, pp. 485-492.Applicant
- Blackwell, Gerry, “Video: A Wireless LAN Killer App?”, 2002, Internet pp. 1-3.Applicant
- Breslow, Michael J., MD et al., “Effect of a multiple-site intensive care unit telemedicine program on clinical and economic outcome: An alternative paradigm for intensivist staffing”, Critical Care Med, Jan. 2004, vol. 32, No. 1, pp. 31-38.Applicant
- Brooks, Rodney, Abstracts from Flesh & Machines, How Robots Will Change Us, “Remote Presence”, p. 131-147, Feb. 2002.Applicant
- Candelas Herias, F.A. et al., “Flexible virtual and remote laboratory for teaching Robotics”, Formatex 2006, Proc. Advance in Control Education, Madrid, Spain, Jun. 21-23, 2006.Applicant
- Celi et al., “The eICU: It's not just telemedicine”, Critical Care Medicine, vol. 29, No. 8 (Supplement), Aug. 2001.Applicant
- Cheetham, Anastasia et al., “Interface Development for a Child's Video Conferencing Robot”, 2000, pp. 1-4.Applicant
- Cleary et al., “State of the art in surgical robotics: Clinical applications and technology challenges”, Feb. 24, 2002 Internet, pp. 1-26.Applicant
- CNN, “Floating ‘droids’ to roam space corridors of the future”, Jan. 12, 2000, Internet, pp. 1-4.Applicant
- CNN.com/Technology,“Paging R.Robot: Machine helps doctors with patients”, Sep. 30, 2003, Internet, 1-3.Applicant
- Crowley, “Hello to Our Future”, AARP Bulletin, Jan. 2000 http://www.cs.cmu.ed/-nursebot/web/press/aarp—99—14/millennium.html.Applicant
- Dalton, “Techniques for Web Telerobotics”, PhD thesis, University of Western Australia, 2001, http://telerobot.mech.uwa.edu.au/information.html, http://catalogue.library.uwa.edu.au/search.Applicant
- Davies, “Robotics in Minimally Invasive Surgery”, 1995, Internet, pp. 5/1-5/2.Applicant
- DiGiorgio, James, “Is Your Emergency Department of the ‘Leading Edge’?”, 2005, Internet, pp. 1-4.Applicant
- Discovery Channel Canada, “Inventing the Future: 2000 Years of Discovery”, Jan. 2, 2000 (Video/Transcript).Applicant
- Elhajj et al., “Supermedia in Internet-based telerobotic operations”, 2001, Internet, pp. 1-14.Applicant
- Elhajj et al., “Synchronization and Control of Supermedia Transmission Via the Internet”, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing, May 2-4, 2001, Hong Kong.Applicant
- Ellison et al., “Telerounding and Patient Satisfaction Following Surgery”.Applicant
- Fels, “Developing a Video-Mediated Communication System for Hospitalized Children”, Telemedicine Journal, vol. 5, No. 2, 1999.Applicant
- Fetterman, Videoconferencing over the Internet, 2001, Internet, pp. 1-8.Applicant
- Fiorini, “Health Care Robotics: A Progress Report, IEEE International Conference on Robotics and Automation”, 1997.Applicant
- Ghiasi, “A Generic Web-based Teleoperations Architecture: Details and Experience”, SPIE Conference on Telemanipulator and Telepresence Technologies VI, Sep. 1999.Applicant
- Goldberg et al., “Collaborative Teleoperation via the Internet”, IEEE International Conference on Robotics and Automation, Apr. 2000, San Francisco, California.Applicant
- Goldberg, “Desktop Teloperation via the World Wide Web, Proceedings of the IEEE International Conference on Robotics and Automation”, 1995, http://citeseer.ist.psu.edu/cache/papers/cs/5/ftp:zSzzSzusc.eduzSzpubzSziriszSzraiders.pdf/gol.Applicant
- Goldberg, “More Online Robots, Robots that Manipulate”, Internet, Updated Aug. 2001 http://ford.ieor.berkeley.edu/ir/robots—a2.html.Applicant
- Goldman, Lea, “Machine Dreams”, Entrepreneurs, Forbes, May 27, 2002.Applicant
- Gump, Michael D., “Robot Technology Improves VA Pharmacies”, 2001, Internet, pp. 1-3.Applicant
- Handley, “RFC 2327—SDP: Session Description Protocol”, Apr. 1998 http://www.faqs.org/rfcs/rfc2327.html.Applicant
- Hanebeck, “ROMAN: a mobile Robotic Assistant for Indoor Service Applications”, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robots and Systems, 1997.Applicant
- Harmo et al., “Moving Eye—Interactive Telepresence Over Internet With a Ball Shaped Mobile Robot”, 2000.Applicant
- Hees, William P., “Communications Design for a Remote Presence Robot”, Jan. 14, 2002.Applicant
- Holmberg, “Development of a Holonomic Mobile Robot for Mobile Manipulation Tasks”, International Conference on Field and Service Robotics, Pittsburgh, PA, Aug. 1999.Applicant
- Ishiguro, “Integrating a Perceptual Information Infrastructure with Robotic Avatars: A Framework for Tele-Existence” Proceeding of IEEE Conference on Intelligent Robots and Systems, http://www.ai.soc.i.kyoto-u.ac.jp/services/publications/99/99conf/07.pdf.Applicant
- Ishihara, Ken et al., “Intelligent Microrobot DDS (Drug Delivery System) Measured and Controlled by Ultrasonics”, Nov. 3-May 1991, IEEE/RSJ, pp. 1145-1150, vol. 2.Applicant
- Itu, “ITU-T H.323 Packet-based multimedia communications”, ITU, Feb. 1998, http://www.itu.int/rec/T-REC-H.323-199802-S/en.Applicant
- Ivanova, Natali, “Master's thesis: Internet Based Interface for Control of a Mobile Robot”, Department of Numerical Analysis and Computer Science.Applicant
- Jenkins, “Telehealth Advancing Nursing Practice”, Nursing Outlook, Mar./Apr. 2001, vol. 49, No. 2.Applicant
- Johanson, Supporting video-mediated communication over the Internet, Chalmers University of Technology, Dept of Computer Engineering, Gothenburg, Sweden, 2003.Applicant
- Jouppi, et al., “Mutually-Immersive Audio Telepresence”, Audio Engineering Society Convention Paper, presented at 113th Convention Oct. 2002.Applicant
- Jouppi, Norman P., “First Steps Towards Mutually-Immersive Mobile Telepresence”, CSCW '02, Nov. 16-20, 2002, New Orleans LA.Applicant
- Kanehiro, Fumio et al., Virtual Humanoid Robot Platform to Develop Controllers of Real Humanoid Robots without Porting, 2001, IEEE, pp. 3217-3276.Applicant
- Kaplan et al., “An Internet Accessible Telepresence”.Applicant
- Keller et al., “Raven Interface Project”, Fall 2001 http://upclose.Irdc.pitt.edu/people/louw—assets/Raven—Slides.pps.Applicant
- Khatib, “Robots in Human Environments”, Proc. International Conference on Control, Automation, Robotics, and Vision, ICRACV2000, Dec. 2000, Singapore, pp. 454-457.Applicant
- Kuzuoka et al., “Can the GestureCam Be a Surrogate?”.Applicant
- Lane, “Automated Aides”, Newsday, Oct. 17, 2000, http://www.cs.cum.edu/-nursebot/web/press/nd4380.htm.Applicant
- Lim, Hun-ok et al., Control to Realize Human-like Walking of a Biped Humanoid Robot, IEEE 2000, pp. 3271-3276.Applicant
- Linebarger, John M. et al., “Concurrency Control Mechanisms for Closely Coupled Collaboration in Multithreaded Virtual Environments”, Presence, Special Issue on Advances in Collaborative VEs (2004).Applicant
- Loeb, Gerald, “Virtual Visit: Improving Communication for Those Who Need It Most”, 2001.Applicant
- Long, “HelpMate Robotics, Inc. (Formerly Transitions Research Corporation) Robot Navigation Technology”, NIST Special Publication 950-1, Mar. 1999, http://www.atp.nist.gov/eao/sp950-1/helpmate.htm.Applicant
- Luna, Nancy, “Robot a new face on geriatric care”, OC Register, Aug. 6, 2003.Applicant
- Mack, “Minimally invasive and robotic surgery”, 2001, Internet IEEE, pp. 568-572.Applicant
- Mair, Telepresence—The Technology and Its Economic and Social Implications, IEEE Technology and Society, 1997.Applicant
- Martin, Anya, “Days Ahead”, Assisted Living Today, vol. 9, Nov/Dec 2002, pp. 19-22.Applicant
- Barrett, “Video Conferencing Business Soars as Companies Cut Travel; Some Travel Cuts Are Permanent”, http://www.ivci.com/international—videoconferencing—news—videoconferencing—news—19.html, Mar. 13, 2002.Applicant
- Brooks, “A Robust Layered Control System for a Mobile Robot,” IEEE Journal of Robotics and Automation, 2 (1), Mar. 1986, 10 pgs.Applicant
- Davis, “Meet iRobot, the Smartest Webcam on Wheels,” Wired Magazine, 8.09, http://www.wired.com/wired/archive/8.09/irobot—pr.html, Sep. 2000, 2 pgs.Applicant
- Dean, et al., “1992 AAAI Robot Exhibition and Competition,” AI Magazine, Spring 1993, 10 pgs.Applicant
- Defendant VGo Communications, Inc.'s Invalidity Contentions Pursuant to the Feb. 27, 2012 Civil Minute Order, May 2, 2012.Applicant
- Defendant-Counterclaimant VGo Communications, Inc.'s Supplemental Invalidity Contentions Pursuant to the Feb. 27, 2012 Civil Minute Order, May 14, 2012.Applicant
- Dudenhoeffer, et al., “Command and Control Architectures for Autonomous Micro-Robotic Forces”, http://www.inl.gov/technicalpublications/Documents/3157051.pdf, Apr. 2001.Applicant
- Elhajj, “Real-Time Haptic Feedback in Internet-Based Telerobotic Operation”, IEEE International Conference on Electro/Information Technology, http://www.egr.msu.edu/˜ralab-web/cgi—bin/internet-teleoperation.php, Jun. 2000.Applicant
- Fong, “Collaborative Control: A Robot-Centric Model for Vehicle Teleoperation”, The Robotics Institute Carnegie Mellon University, http://web.archive.org/web/20030504040803/www.ricmu.edu/cgi-bin/tech—reports.cgi?year=2001&text=0, Nov. 2001.Applicant
- Goldenberg, et al., “Telemedicine in Otolaryngology”, American Journal of Otolaryngology vol. 23,No. 1, 2002 , pp. 35-43.Applicant
- Grow, “Office Coworker Robot,” Time Magazine, http://www.time.com/time/specials/packages/article/0,28804,1936165—1936255—1936640,00.html, Nov. 19, 2001, 2 pgs.Applicant
- Itu, “ITU-T H.281 A Far End Camera Control Protocol for Videoconferences using H.224”, http://www.itu.int/rec/T-RECH.281-199411-I/en, Nov. 1994.Applicant
- Itu, “ITU-T H.450.11 Call Intrusion Supplementary Service for H.323”, http://www.itu.int/rec/T-RECH.450.11-200103-I/en, Mar. 2001.Applicant
- Itu, “ITU-T H.450.9 Call Completion Supplementary Services for H.323”, http://www.itu.int/rec/T-RECH.450.9-200011-I/en, Nov. 2000.Applicant
- Knight, et al., “Active Visual Alignment of a Mobile Stereo Camera Platform”, Proceedings of the IEEE, International Conference on Robotics and Automation, San Francisco, Apr. 24-28, 2000, pp. 3202-3208.Applicant
- Metz, “HP Labs”, pcmag.com, http://www.pcmag.com/article2/0,2817,1130820,00.asp, Jul. 1, 2003.Applicant
- PictureTel Adds New Features and Functionality to Its Award-Winning Live200 Desktop Videoconferencing System, PR Newswire Association, LLC, Gale, Cengage Learning, http://www.thefreelibrary.com/PictureTel+Adds+New+Features+And+Functionality+To+Its+Award-Winning . . . -a019512804, Jun. 13, 1997.Applicant
- Picturetel, “PictureTel Live200 for Windows NT Product Guide”, http://support.polycom.com/global/documents/support/user/products/video/live200—live200NT—product—guide.pdf, Nov. 1994.Applicant
- Roach, “Automatic Call Back Service in SIP”, http://tools.ietf.org/pdf/draftroach-sip-acb-00.pdf, Mar. 2000.Applicant
- Summers, “Microsoft NetMeeting 3 Features excerpt from Official Microsoft NetMeeting 3.0 Book”, http://technet.microsoft.com/en-us/library/cc723477.aspx#XSLTsection121121120120, excerpt from Microsoft Press http://www.computerbooksonline.com/abook.asp?i=0735605823, Mar. 1999.Applicant
- U.S. Appl. No. 10/783,760, filed Feb. 20, 2004, Wang, et al., 48 pgs.Applicant
- U.S. Appl. No. 60/449,762, filed Feb. 24, 2003, Wang, et al., 28 pgs.Applicant
- Weiss, et al., “Pebbles: A Personal Technology for Meeting Education, Social and Emotional Needs of Hospitalised Children”, Personal and Ubiquitous Computing 5, Springer-Verlag London Ltd., 2001, pp. 157-168.Applicant
- Zambroski, “CMU, Pitt Developing ‘nursebot’”, http://www.cs.cmu.edu/˜nursebot/web/press/tribunereview.html, Oct. 27, 2000.Applicant
- Blaer, et al., “TopBot: Automated Network Topology Detection With a Mobile Robot”, Proceedings of the 2003 IEEE International Conference on Robotics 7 Automation, Taipei, Taiwan, Sep. 14-19, 2003, pp. 1582-1587.Applicant
- Bradner, “The Internet Standards Process—Revision 3”, Network Working Group Request for Comments: 2026, www.rfc-e ditor.org!rfC/rfc2026. txt, Oct. 1996, pp. 1-36.Applicant
- Christensen et al., “BeeSoft User's Guide and Reference”, Robots for the Real World™, Real World Interface, Inc., www.praecogito.com/-brudy/zaza/BeeSoft-manual-1.2-2/ beeman˜1.htm, Sep. 26, 1997, pp. 1-203.Applicant
- Dario, “A Robot Workstation for Diagnosis and Physical Therapy”, IEEE Catalog No. 88TH0234-5, 1989, pp. 67-72.Applicant
- Gump, “Robot Technology Improves VA Pharmacies”, Internet, 2001, pp. 1-3.Applicant
- Leifer, et al., “VIPRR: A Virtually in Person Rehabilitation Robot”, Proceedings of 1997 International Conference on Rehabilitation Robotics, http://www.stanford.edu/group/rrdlPeople/vdl/publicationsIICORR97/VIPRR.html, Apr. 14-15, 1997, 4 pgs.Applicant
- Minsky “Telepresence”, Omni, Jun. 1980, pp. 1-6.Applicant
- Motorola Technical Developments, et al., “Detection of Target Mobile Signal Strength”, PriorArt Database: Technical Disclosure, IP.com, Retrieved from http:www.ip.com/pubview/IPCOM000009024D, original publication date: Jan. 1, 1999 by Motorola, Inc., pp. 205-206, Aug. 1, 2002, pp. 1583-1587.Applicant
- Noritsugu, “Application of Rubber Artificial Muscle Manipulator as a Rehabilitation Robot”, IEEE/ASME Transations on Mechatronics, vol. 2, No. 4, Dec. 1997, pp. 259-267.Applicant
- Reynolds et al., “Review of Robotic Telemedicine Utilization in Intensive Care Units (ICUs)”, 11th Annual ATA Symposium, Tampa, Florida, 2011, 1 pg.Applicant
- “Saphira Software Manual”, Saphira Version 5.3, ActiveMedia, Inc., 1997, 105 pgs.Applicant
- Tipsuwan, et al., “Gain Adaptation of Networked Mobile Robot to Compensate QoS Deterioration”, IEEE, 2000, pp. 3146-3151.Applicant
- Tsui, et al., “Exploring Use Cases for Telepresence Robots”, Human-Robot Interaction, Lausanne, Switzerland, http://robotics.cs.uml.edu/fileadmin/content/publications/2011/tsui-et-al-telepresence-HRI11.pdf, Robotics Lab UMass Lowell, 2011, 7 pgs.Applicant
- Umass Lowell Robotics Lab, “Robotics Lab @ UMASS Lowell”, Brochure, http://robotics.cs.uml.edu/fileadmin/content/brochures/roboticslab—brochure—2011—WEB.pdf, 2011, 2 pgs.Applicant
- Appeal from the U.S. District Court for the Central District of California in case No. 11-cv-9185, Judge Percy Anderson, Joint Appendix, vol. I of IV, Jun. 24, 2013, pp. A1-A6357.Applicant
- Appeal from the U.S. District Court for the Central District of California in case No. 11-cv-9185, Judge Percy Anderson, Joint Appendix, vol. II of IV, Jun. 24, 2013, pp. A6849-A10634.Applicant
- Appeal from the U.S. District Court for the Central District of California in case No. 11-cv-9185, Judge Percy Anderson, Joint Appendix, vol. III of IV, Jun. 24, 2013, pp. A10654-A15517.Applicant
- Appeal from the U.S. District Court for the Central District of California in case No. 11-cv-9185, Judge Percy Anderson, Joint Appendix, vol. IV of IV, Jun. 24, 2013, pp. A15677-A18127.Applicant
- Brief for Defendant-Appellee VGO Communications, Inc., Appeal from the U.S. District Court for the Central District of California, in Case No. 2:11-cv-9185, Judge Percy Anderson, May 28, 2013, 75 pages.Applicant
- Civil Minutes-General: Case No. CV 11-9185PA (AJWx), InTouch Tech., Inc. v. VGo Commons, Inc., Sep. 10, 2012, 7 pages.Applicant
- Office Action received for Chinese Patent Application No. 200680044698.0, Nov. 4, 2010, 9 pages of Official Copy and 15 pages of English Translation.Applicant
- Opening Brief for Plaintiff-Appellant InTouch Technologies, Inc., Appeal from the U.S. District Court for the Central District of California in Case No. 11-cv-9185, Judge Percy Anderson, Apr. 12, 2013, 187 pages.Applicant
- Reply Brief for Plaintiff-Appellant InTouch Technologies, Inc., Appeal from the U.S. District Court for the Central District of California in Case No. 11-cv-9185, Judge Percy Anderson, Jun. 14, 2013, 39 pages.Applicant
- Activmedia Robotics, “Pioneer 2/PeopleBot, Operations Manual, Version 9”, Oct. 2001, 78 pages.Applicant
- Weaver et al., “Monitoring and Control Using the Internet and Java”, vol. 3, Proceedings of the 25th Annual Conference of the IEEE Industrial Electronics Society, 1999, pp. 1152-1158.Applicant
- Apple Inc., “I Phone”, iPhone Series XP-002696350, pp. 1-29.Applicant
- “Magne Charge”, Smart Power for Electric Vehicles, General Motors Corporation, Serial No. 75189637, Registration No. 2114006, Filing Date: Oct. 29, 1996, Aug. 26, 1997, 2 pages.Applicant
- “Using your Infrared Cell Phone Camera”, Available on <http://www.catsdomain.com/xray/about.htm>, retrieved on Jan. 23, 2014, Courtesy of Internet Wayback Machine, Jan. 30, 2010, 4 pages.Applicant
- Gostai “Gostai Jazz: Robotic Telepresence”, available online at <http://www.gostai.com>, 4 pages.Applicant
- Jacobs et al., “Applying Telemedicine to Outpatient Physical Therapy”, AMIA, Annual Symposium Proceedings, 2002, 1 page.Applicant
- Kurlowicz et al., “The Mini Mental State Examination (MMSE)”, The Hartford Institute for Geriatric Nursing, Journal of Psychiatric Research, No. 3, Jan. 1999, 2 pages.Applicant
- Lemaire, Edward, “Using Communication Technology to Enhance Rehabilitation Services”, Terry Fox Mobile Clinic, The Rehabilitation Centre, Ottawa, Canada, Version 2.0, 1998-2001, 104 pages.Applicant
- Nakazato et al., “Group-Based Interface for Content-Based Image Retrieval”, Proceedings of the Working Conference on Advanced Visual Interfaces, 2002, pp. 187-194.Applicant
- Nakazato et al., “Group-Oriented User Interface for Digital Image Management”, Journal of Visual Languages and Computing, vol. 14, No. 4, Aug. 2003, pp. 45-46.Applicant
- North, Michael, “Telemedicine: Sample Script and Specifications for a Demonstration of Simple Medical Diagnosis and Treatment Using Live Two-Way Video on a Computer Network”, Greenstar Corporation, 1998, 5 pages.Applicant
- Piquepaille, Roland, “How New Technologies are Modifying Our Way of Life”, Roland Piquepaille's Technology Trends, This Blog and its RSS Feed Are Moving, Oct. 31, 2004, 2 pages.Applicant
- Radvision, “Making Sense of Bandwidth the NetSense Way”, Network Congestion in Unmanaged Networks Bandwidth Estimation and Adaptation Techniques, Radvision's Netsense Technology, 2010, 7 pages.Applicant
- Roy et al., “Towards Personal Service Robots for the Elderly”, Workshop on Interactive Robots and Entertainment (Wire 2000), vol. 25, Apr. 30-May 1, 2000, 7 pages.Applicant
- Theodosiou et al., “MuLVAT: A Video Annotation Tool Based on XML-Dictionaries and Shot Clustering”, 19th International Conference, Artificial Neural Networks-ICANN, Sep. 14-17, 2009, pp. 913-922.Applicant
- Tyrrell et al., “Teleconsultation in Psychology: The Use of Videolinks for Interviewing and Assessing Elderly Patients”, British Geriatrics Society, Age and Ageing, vol. 30, No. 3, May 2001, pp. 191-195.Applicant
- Telepresence Research, Inc., “Telepresence Mobile Robot System”, available online at <http://www. telepresence.com/telepresence-research/TELEROBOT/>, retrieved on Nov. 23, 2010, Feb. 20, 1995, 3 pages.Applicant
- Adams, Chris, “Simulation of Adaptive Behavior (SAB'02)—From Animals to Animats 7”, Mobile Robotics Research Group, The Seventh International Conference, available online at: <http://www.dai.ed.ac.uk/groups/mrg/MRG.html>, retrieved on Jan. 22, 2014, Aug. 4-11, 2002, 1 page.Applicant
- Evans et al., “HelpMate: The Trackless Robotic Courier”, PYXIS, available online at <http://www.pyxis.com/>, 3 pages.Applicant
- Gaidioz et al., “Synchronizing Network Probes to Avoid Measurement Intrusiveness with the Network Weather Service”, High-Performance Distributed Computing, Proceedings of the Ninth International Symposium, 2000, pp. 147-154.Applicant
- Garner et al., “The Application of Telepresence in Medicine”, BT Technology Journal, vol. 15, No. 4, Oct. 1, 1997, pp. 181-187.Applicant
- McCardle et al., “The challenge of utilizing new technology in design education”, 2000 Internet, pp. 122-127.Applicant
- Meng, “E-Service Robot in Home Healthcare”, Proceedings of the 2000, IEEE/RSJ, International Conference on Intelligent Robots and Systems, 2000.Applicant
- Michaud, Introducing ‘Nursebot’, The Boston Globe, Sep. 11, 2001, pp. 1-5, http://www.cs.cmu.edu/nursebot/web/press/globe—3—01/index.html.Applicant
- Mobile Robotics Research Group, “Mobile Robotics Research Group”, 2000 Internet, pp. 1-2, Edinburgh.Applicant
- Montemerlo, “Telepresence: Experiments in Next Generation Internet”, CMU Robotics Institute, Oct. 20, 1998, http://www.ri.cmu.edu/creative/archives.htm (Video/Transcript).Applicant
- Murphy, “Introduction to A1 Robotics”, 2000.Applicant
- Nakajima et al., “A Multimedia Teleteaching System sing an Electronic Whiteboard for Two-Way Communication of Motion Videos and Chalkboards”, 1993, IEEE, pp. 436-441.Applicant
- “National Energy Research Scientific Computing Center, Berkeley Lab's RAGE Telepresence Robot Captures R&D100 Award”, Jul. 2, 2002, http://www.nersc.gov/news/newsroom/RAGE070202.php.Applicant
- Nomadic Technologies, Inc., “Nomad XR4000 Hardware Manual”, Mar. 1999.Applicant
- Ogata et al., “Development of Emotional Communication Robot: WAMOEBA-2r—Esperimental evaluation . . . ”, 2000 IEEE, pp. 175-180.Applicant
- Oh, “Autonomous Battery Recharging for Indoor Mobile Robots”, Proceedings of Australian Conference on Robotics and Automation, 2000, http://users.rsise.anu.edu.au/rsl/rsl—papers/ACRA2000/Auto—Recharge—Paper.pdf.Applicant
- Ojha, Anad, “An application of Virtual Reality in Rehabilitation”, Jan. 1994, IEEE, pp. 4-6.Applicant
- Paulos et al., “A World Wide Web Telerobotic Remote Environment Browser”, http://vive.cs.berkeley.edu/capek, 1995.Applicant
- Paulos, “Designing Personal Tele-embodiment”, IEEE International Conference on Robotics and Automation, 1998, http://www.prop.org/papers/icra98.pdf.Applicant
- Paulos, Eric John, “Personal Tele-Embodiment”, UC Berkeley, Fall 2001.Applicant
- Paulos, “PRoP: Personal Roving Presence”, ACM:CHI Proceedings of CHI '98, http://www.prop.org/papers/chi98.pdf.Applicant
- Paulos, Video of PRoP 2 at Richmond Field Station, www.prop.org.May 2001, Printout of Home Page of Website and two-page Transcript of the audio portion of said PRoP Video.Applicant
- Paulos, et al. , “Ubiquitous Tele-embodiment: Applications and Implications”, International Journal of Human Computer Studies, Jun. 1997, vol. 46, No. 6, pp. 861-877.Applicant
- Pin et al., “A New Family of Omnidirectional and Holonomic Wheeled Platforms for Mobile Robots”, IEEE, vol. 10, No. 4, Aug. 1994.Applicant
- Roy et al., “Towards Personal Service Robots for the Elderly”, Internet, Mar. 7, 2002.Applicant
- Salemi et al, “MILO: Personal robot platform”, 2005, Internet, pp. 1-6.Applicant
- Sandt, Frederic et al., “Perceptions for a Transport Robot in Public Environments”, 1997, IROS '97.Applicant
- Schaeffer, “Care-O-bot: A System for Assisting Elderly or Disabled Persons in Home Environments”, Proceedings of AAATE-99, 1999, http://morpha.de/download/publications/IPA—Systems—For—AssistingElderly—or—DisabledPersons—AAATE1999.pdf.Applicant
- Schultz, “Web Interfaces for Mobile Robots in Public Places”, Robotics & Automation magazine, IEEE, vol. 7, Issue 1, Mar. 2000.Applicant
- Shimoga et al., Touch and force reflection for telepresence surgery, 1994, IEEE, pp. 1049-1050.Applicant
- Siegwart, “Interacting Mobile Robots on the Web”, Proceedings of the 1999 IEEE International Conference on Robotics and Automation, May 1999.Applicant
- Simmons, “Xavier: An Autonomous Mobile Robot on the Web”, IEE robotics and Automation Magazine, 1999, pp. 43-48.Applicant
- Spawar Systems Center, “Robart”, 1998, San Diego, CA, http://web.archive.org/web/★/http://www.nosc.mil/robots/land/robart/robart.html http://web.archive.org/web/19981202205636/http://www.nosc.mil/robots/land/robart/robart.html.Applicant
- Stephenson, Gary, “Dr. Robot Tested at Hopkins”, Aug. 5, 2003, Internet, pp. 1-2.Applicant
- Stoianovici et al., “Robotic Tools for Minimally Invasive Urologic Surgery”, Dec. 2002, Internet, 1-17.Applicant
- Suplee, “Mastering the Robot”, The Washington Post, p. A01, Sep. 17, 2000 http://www.cs.cmu.edu-nursebot/web/press/wash/index.html.Applicant
- Tendick et al., “Human-Machine Interfaces for Minimally Invasive Surgery”, 1997, IEEE, pp. 2771-2776.Applicant
- Thrun et al, “Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva”, 2000, Internet pp. 1-35.Applicant
- Tzafestas, et al., “VR-based Teleoperation of a Mobile Robotic Assistant: Progress Report”, 2000, Internet, pp. 1-23.Applicant
- Urquhart, Kim, “InTouch's robotic Companion ‘beams up’ healthcare experts”, Medical Device Daily, vol. 7, No. 39, Feb. 27, 2003, p. 1, 4.Applicant
- Weiss et al., Telework and video-mediated communication: Importance of real-time, interactive communication for workers with disabilities, pp. 1-4, California State University Northridge, http://www.csun.edu/cod/conf/1999/proceedings/session0238.html.Applicant
- West et al., “Design of Ball Wheel Mechanisms for Omnidirectional Vehicles with Full Mobility and Invariant Kinematics”, Journal of Mechanical Design, vol. 119, pp. 153-161, Jun. 1997.Applicant
- Yamasaki et al., Applying Personal Robots and Active Interface to Video Conference Systems, 1995, Internet, pp. 243-248.Applicant
- Yong et al., “Robot task execution with telepresence using virtual reality technology”, 1998, Internet, pp. 1-9.Applicant
- Zamrazil, Kristie, “Telemedicine in Texas: Public Policy Concerns”, House Research Organization Focus Report, Texas House of Representatives, No. 76-22, May 5, 2000 http://www.hro.house.state.tx.us/focus/telemed.pdf.Applicant
- Zipperer, Lorri, “Robotic dispensing system”, 1999, Internet, pp. 1-2.Applicant
- Zorn, Benjamin G., “Ubiquitous Telepresence”, http://www.cs.colorado.edu/˜zorn/ut/vision/vision.html, Mar. 5, 1996.Applicant