Video teleconferencing assembly and process

[0002] This application is a continuation-in-part of Applicant's co-pending application U.S Ser. No. 09/195,781, filed Nov. 18, 1998 and titled Video Teleconferencing Assembly and Process, which application is pending, and which is incorporated by reference herein.

[0003] This invention relates generally to video teleconferencing assemblies and processes and more particularly to video teleconferencing assemblies and processes relating to medical, analytical and research applications. The video teleconferencing assemblies and processes relate to computer based services in present time and which include training, diagnostic and repair services for medical equipment as well as to laboratory procedures. The assemblies and processes of the invention further relate to the repair, installation, calibration and operation at remote sites of equipment in other industries, for example, industrial machines, tools and equipment, industrial process equipment, telecommunication equipment, heavy construction equipment, agriculture, food processing, food service, electronic and packaging equipment and heating, vacuum and air conditioning equipment and the like.

[0004] The assemblies of this invention include a host site and a remote site and between which information is relayed via a telecommunication link, such as via the internet, satellite point to point relay, satellite network relay, electromagnetic (EM) wave transmission, graviton radiation wave transmission or via radio frequency (RF) wave transmission, for example. The invention relates particularly to video duplexing (i.e., receiving and sending information concurrently) and is adapted to provide diagnostic services for servicing various research devices, medical equipment and related processes, for example.

[0005] Presently, if equipment located at a remote area fails to perform properly, needs servicing, or is scheduled to be tested, a service technician, skilled in a particular art, is often required to travel to that remote location to diagnose the problem, order the parts, and repair and test the equipment. Travel and time considerations make this practice an expensive and time consuming procedure. The assembly and process of this invention overcome these problems and shortcomings and does so in a timely and efficient manner.

[0006] The present invention permits a party, such as an operator located at a host site, to directly communicate with a second party at a remote location via a telecommunication link. The telecommunications link may comprise a telephone line, a data line, a satellite connection, the internet, wireless communication, satellite point to point direct relay, satellite network relay, electromagnetic wave transmission, graviton radiation wave transmission, radio frequency wave transmission and other communication links and combinations thereof. This invention also permits multiple parties at both the host and remote sites to be in direct communication with each other.

[0007] The present invention includes the adaptation of a visual and audio recognition system in the medical application at the remote site. The visual and/or audio recognition systems are used with medical apparatus and laboratory procedures at the remote site. The recognition system is monitored at the host site. The apparatus may include or be connected to a modem so that data may be directly sent to the host site for monitoring and diagnostic purposes.

[0008] The assemblies and processes of this invention permit various services and procedures to be performed between two separated or distant sites. These services include: technical and application troubleshooting, instrument installation assistance, technique monitoring and training, and technical training. Further, this invention may be used for parts replacement assistance, instrument and parts identification, instrument performance verification, staff monitoring, client and staff counseling, and enhancement of sales and service capabilities. Examples of areas in which this assembly can be used include: diagnosing instrument malfunctions, determining misalignment and movement impairments for robotics applications, monitoring fluidic action in medical applications, diagnosing pressure or vacuum malfunctions and mechanical impairments, diagnosing and adjusting electronic circuitry, and diagnosing technical malfunctions of chemical reactions and dilution ratios.

[0009] An object of this invention is to provide to industrial, research and medical institutions as well as to industrial machine, tool and equipment, industrial process equipment, telecommunication equipment, heavy construction equipment, agriculture, food processing, food service, electronic and packaging equipment, and HVAC equipment entities, and the like, assemblies and processes adapted for dealing with various service applications. For example, the repair, installation, calibration, monitoring and operation of equipment, devices and processes in various industries may be serviced by the assemblies and processes of the present invention. Preferably, the technical service is available on a 24 hours per day basis. A medical application for the purposes of this invention includes medical apparatus and laboratory procedures. For example, medical instrumentation having robotic equipment, vacuum or pressurized fluid holding components, electronic circuitry, or chemical components or consumables may be monitored by the assembly and process of the invention.

[0010] Medical equipment areas and products within those areas for which the assembly and process of this invention may be used, include but are not limited to: Medical Products including cardiac monitors, gamma counters, lasers, peptide synthesizers, autoclaves, EKG, imaging equipment, operating tables, portable X-ray's, and the like; Research/Production products including atomic absorption, DNA extractors, DNA synthesizers, flow cytometers, freeze dryers, gamma counters, HPLC, mass spectrometers, microtomes, peptide synthesizers, autoclaves, cell counters, centrifuges, fermenters, LS counters, microplate readers, pilot plant equipment, RIA analyzers, and the like; Analytical products including atomic absorption, DNA extractors, DNA synthesizers, flow cyometers, freeze dryers, gamma counters, HPLC, mass spectrometers, microtomes, peptide synthesizers, autoclaves, cell counters, centrifuges, fermenters, LS counters, microplate readers, RIA analyzers, and the like; and General Laboratory Medical products including chemistry analyzers, coag analyzers, DNA extractors, DNA synthesizers, electrolyte analyzers, flow cytometers, gamma counters, HPLC, microtomes, autoclaves, blood gas analyzers, cell counters, centrifuges, densitometers, LS counters, RIA analyzers, imaging and radiology products and the like. The latter products and equipment including those having a c.p.u. and related peripheral computer devices, i.e., a modem, being exemplary, however, and other equipment in other fields may also be serviced according to the teachings of the present invention. The assembly and process of this invention can be used to analyze not only research and medical device problems, but may also include the chemicals (consumables and reagents) that are used to generate the test results for patients and which are used for quality assurance purposes.

[0011] This invention relates to video teleconferencing assemblies and processes between separated sites or distant physical locations for the purpose of providing particular services related to medical applications in present time. The invention includes a host site and a remote site and wherein specified equipment is located at each site for communication between the sites.

[0012] The host site assembly includes a computer, video and audio hardware and a communication link between the host and remote sites, such as via an internet connection, a satellite point to point direct relay, satellite network relay, electromagnetic wave transmission, graviton radiation wave transmission, radio frequency wave transmission and like communication connections. The computer preferably contains PCI bus architecture. Specific hardware and software are also used for video duplexing including a video input device, such as a camera in addition to a PCI video digitizing card. Finally, the invention may require an internet connection consisting of internet related hardware, software and services. The internet connection preferably uses an ISDN router/hub, DSL, cable modem, T-1000 or the like, a communications link such as an analog or digital telephone line, a network providing internet connectivity, and an internet service provider. The communication link utilized for the internet connection may include ISDN, T-1000, a satellite transmission, digital and analog lines, or the like. The communication link may also include lines having combinations of these connections. As discussed, the communication link may be established via satellite point to point direct relay, satellite network relay, electromagnetic wave transmission, graviton radiation wave transmission, radio frequency wave transmission and/or other communication connections which provide for the transmission of data, video and audio signals.

[0013] The host site further has reference materials relating to medical applications that are located and used at a remote site. The reference materials include information relating to various medical applications including medical apparatus and medical testing procedures used in medical laboratories. The medical applications are provided with visual and/or audio recognition systems that are recognized and analyzed at the host site.

[0014] The remote site assembly includes a computer, video and audio hardware, an internet connection or other communication link, such as a satellite direct relay or other transmission. Preferably, the remote site assembly is portable to enable setup of the assembly in proximity to the device or process that is the subject of the conferencing session. The video hardware also includes a portable video input device. The computer and internet connection or other communication is similar to and compatible with that of the host site.

[0015] The process of this invention involves the utilization of the computer assemblies located at the host and remote sites and includes a number of process steps. To conduct a video conferencing session, the host site is initially turned on and connected to the internet or to another communication link, such as satellite point to point direct relay, satellite network relay, electromagnetic wave, graviton radiation wave transmission or radio frequency wave transmission. The host system may identify the IP address and utilizes an operational video capture subsystem to perform video duplexing. Communication may be received in video and/or audio and carried out by informing the remote site assembly of the IP address of the receiving computer located at the remote site.

[0016] The computer assembly at the remote site includes an internet connection or the like via an ISP connection and/or means to establish a communication link via satellite point to point direct relay, satellite network relay or other transmission. Users may send calls to the host site's IP address by means of video and/or audio. Communication between the remote site and the host site is maintained via communication software, such as Netmeeting 2.0 or like software, for example.

[0017] The visual and/or audio recognition systems of the invention include visual indicators used in connection with medical apparatus and laboratory procedures. The visual and/or audio indicators are used to determine the status of medical applications at the remote site. A modem may also be connected to or incorporated into the medical application for transmitting data and/or other signals between the host and remote sites. For example, the visual indicators may include a plurality of colored lights, such as LED's. The visual and/or audio recognition systems may be internal or external to the medical apparatus.

[0018] These and other benefits of this invention will become clear from the following description by reference to the drawing.

[0019] FIG. 1 is a schematic diagram showing the host site and the remote site as well as the equipment utilized at the respective sites;

[0020] FIG. 2 is a schematic diagram showing the steps utilized between the host site and remote site(s) to practice the present invention;

[0021] FIG. 3 is a schematic diagram showing a satellite point to point direct relay between the host site and the remote site; and

[0022] FIG. 4 is a schematic diagram showing a satellite network relay between the host site and the remote site.

[0023] As shown in FIG. 1 of the drawing, a schematic diagram is set forth showing the assemblies utilized in the present invention. FIG. 1 shows the host site and the remote site connected for communication, such as via the internet, via satellite point to point direct relay, via satellite network relay, via electromagnetic wave transmission, graviton radiation wave transmission or radio frequency wave transmission. The respective sites may be located in different countries for example, whereby an operator having access to various manuals and databases is able to communicate with a technician at the remote site. The communication between the host site and the remote site may be in present time, i.e., at least 30 frames /sec., however, this communication speed is not required for purposes of this invention. For example, communication between the sites at 15 frames per/sec. has been found suitable for purposes of practicing the teachings of this invention. The operator at the host site, in the U.S.A., for example, is able to communicate with a technician at a hospital or other person at a remote facility, in either the U.S.A. or in a country outside of the U.S.A. for example, and is able to instruct the technician to diagnose and repair a particular piece of equipment, for example. Initially, a business relationship may be entered into between the respective parties by means of an agreement sent via facsimile.

[0024] For example, it is customary and important under the laws and governmental regulations of various countries that proper agreements and service procedures be followed with respect to the servicing of specified equipment. The computer assemblies of this invention may include databases having specified contracts for service orders, for example. The operator at the host site may transmit the proper documentation to the remote site for signature and subsequently have the signed agreement of service order returned to the host site so that a contractual relationship has been entered into before any substantive services are provided.

[0025] FIG. 1 further shows that the operator at the host site has available for use various equipment, manuals, references, databases and a visual recognition system for performing the various services set forth herein. For example, the operator upon seeing the equipment at the remote site may consult an equipment manual, access a database and provide service information to the technician at the remote site or to other individual parties at the site. The verbal and visual information exchanged between the sites may include the use of similar operational devices, teaching aids and programmed procedural techniques at the host site so that the technician at the remote site may readily see and understand the proper operational parameters of the equipment or procedure at issue.

[0026] The assembly and process of the invention include the use of a visual and/or audio recognition system. A visual recognition system is a visual signal provided by a medical application located at the remote site that indicates to a host site technician a particular problem or the general condition of the device or process. The visual signal provided is such that the host site technician, for example, can easily identify it via the video teleconferencing system. The visual recognition systems may include a light or a plurality of lights which when activated relate to a specific condition. Further, a light or plurality of lights may flash in predetermined patterns to show the status of medical equipment. The visual recognition systems also include chemical reagents which appear one color if mixed correctly or another color if incorrectly mixed. The visual recognition system may be internal or external to the apparatus to be diagnosed. An audio recognition system relates to any sound that may be generated from the equipment, i.e., a buzzer.

[0027] The present invention may also use a direct link between the medical apparatus and the portable computer assembly, work station, laptop, computer on a cart, and the like at the remote site so that the host site can analyze the readings/data generated from the apparatus at the remote site. For example, pH, temperature, signal input and output, voltage, flow rates and the like may be monitored directly at the host site to diagnose a piece of equipment. The latter readings and data being exemplary of data important to analyze medical equipment, however, it is within the purview of this invention to enable readings directly from medical apparatus to be input in the remote site assembly for transmission to the host site.

[0028] The assembly and process of the present invention relates to video teleconferencing which may be conducted over the internet or other communication link such as a satellite point to point direct relay, satellite network relay and like connections. FIG. 3 is a schematic diagram which shows the assemblies at the host site and the remote site in communication via a satellite point to point direct relay communication link. FIG. 4 is a schematic diagram which shows the assemblies at the host site and the remote site in communication via a satellite network relay communication link. The assembly of the invention includes a host site, having specified computer equipment, a remote site(s) also having specified computer equipment and a process for video teleconferencing between the respective sites.

[0029] An exemplary list of the equipment used at the host site, at the remote site and the process linking the respective sites are as follows (use of compatible or like equipment may be used in the teachings of this invention):

[0030] Host Site System Assembly

[0031] Computer

[0032] The computer system equipment for the host site may include the following:

[0033] A desktop computer with the following features

[0034] Windows 95/98/NT

[0035] 16 MB RAM

[0036] 772 MB HD

[0037] Windows compatible sound system

[0038] 14″ SVGA Color Display

[0039] PCI bus architecture

[0040] Additional Video Hardware—Only Necessary for Video Duplexing (Receiving and Sending).

[0041] For full duplexing of video (receiving and sending) the host computer system will also require the following additional video hardware:

[0042] A video input device such as a Toshiba Noteworthy Notebook CCD Camera

[0043] A PCI video digitizing card such as the Micro Video DC30

[0044] Internet Connection

[0045] The computer system preferably includes the following Internet related hardware, software, and services:

[0046] A dedicated ISDN router/hub such as the Ascend Pipeline 75.

[0047] A standard ISDN digital telephone line (an example of a communication link. Use of other communication links, as discussed above, are within the purview of this invention).

[0048] Microsoft TCP/IP network protocol configured for Internet connectivity (Explorer, Netscape or like compatible software may also be used).

[0049] An Internet Service Provider relationship (internet connection).

[0050] Communication Link (Alternative Connections)—Can be Utilized with or without Internet Connection.

[0051] Means for satellite point to point direct relay, satellite network relay connection, electromagnetic wave transmission, graviton radiation wave transmission and radio frequency wave transmission.

[0052] Remote Site Assembly

[0053] Computer

[0054] The computer system equipment for the remote site include the following:

[0055] A Notebook computer with the following features:

[0056] Windows 95/98/NT

[0057] 16 MB RAM

[0058] 772 MB HD

[0059] Windows compatible sound system

[0060] 10.4″ Active Matrix Display

[0061] 2×PCMCIA Type II Expansion Slots

[0062] Additional Video Hardware

[0063] The computer will also use the following video hardware:

[0064] A portable video input device such as a Toshiba Noteworthy Notebook CCD Camera

[0065] A PCMCIA Type II video digitizing card such as the Toshiba Noteworthy Video Capture Card

[0066] Internet Connection

[0067] The computer system will also use the following Internet related hardware, software and services:

[0068] 36.6 band modem (minimum)

[0069] standard analog telephone line (minimum)

[0070] Microsoft remote access configured for Internet connectivity

[0071] An Internet Service Provider relationship (internet connection)

[0072] Communication Link (Alternative Connection)—Can be Utilized with or without Internet Connection.

[0073] Means for satellite point to point direct relay, satellite network relay connection, electromagnetic wave transmission, graviton radiation wave transmission and radio frequency wave transmission.

[0074] The above list of computer equipment at the host and remote sites represent exemplary and minimum requirements for purposes of practicing the present invention. As is known, computer equipment, software, communication links and related devices may change rapidly and it is within the purview of this invention to utilize such computer equipment, software and related devices having added function, power and capacity.

[0075] The Process of Creating a Video Conferencing Session

[0076] Host Configuration and Process Steps

[0077] To set up a video conferencing session the host site creates the following computer environment:

[0078] 1. All local computers and routers are powered on;

[0079] 2. Connection to the internet or other communication link, such as satellite connection is established;

[0080] 3. Identifying the receiving (remote) system's IP address;

[0081] 4. Initiate the video capture subsystem, as identified above (video duplexing only)

[0082] 5. Execute Microsoft Netmeeting 2.0 or above or the like;

[0083] 6. Turn on receive calls with video/audio; and

[0084] 7. Communicate to the remote site the IP address of the receiving computer.

[0085] Remote System Configuration and Process Steps

[0086] To set up a video conferencing session the remote system creates the following computer environment:

[0087] 8. The notebook or work station computer is powered on;

[0088] 9. Connection to the internet via ISP connection or other communication link, such as satellite connection is established;

[0089] 10. Identifying the host system receiving system's IP address (as provided in step 7 above);

[0090] 11. Ensure that the Notebook video capture subsystem is working correctly;

[0091] 12. Execute Microsoft Netmeeting 2.0 or above or the like;

[0092] 13. Turn on send calls with video/audio; and

[0093] 14. In Netmeeting 2.0 or the like software initiate a communication session with the host system's IP address.

[0094] Functions and Purposes of the Assemblies and Processes

[0095] In summary, the assemblies and processes of the invention may be utilized to provide the following procedures which are often encountered in the medical equipment diagnostic field:

[0096] 1. Technical and application troubleshooting;

[0097] 2. Instrument installation assistance;

[0098] 3. Technique monitoring and training;

[0099] 4. Technical training;

[0100] 5. Parts replacement assistance;

[0101] 6. Instrument and parts identification;

[0102] 7. Instrument performance verification;

[0103] 8. Staff/personnel monitoring;

[0104] 9. Client and staff counseling; and

[0105] 10. Enhancement of sales and service capabilities.

[0106] Further, industrial, research and medical institutions are able to use the assemblies and processes of this invention for handling the services set forth above. The assemblies and processes can also be used to analyze not only medical device problems, but the chemicals (consumables, reagents) that are used to generate the test results for patients and quality control. It is within the purview of this invention that similar or like assemblies for the host and remote sites be usable for performing the processes of the invention.

[0107] FIG. 2 is a schematic diagram showing the steps utilized between the host site and the remote site(s) to practice the present invention. A typical sequence of events is as follows:

[0108] Step 1: Establish a Contractual Relationship

[0109] The Host Technical Service Center and a Remote Site having a medical or other application, or an intermediary of the Remote Site, engage in the formation of a contract to provide technical service with regard to the medical or other application. The Host Site may provide services to the Remote Site by contracting in any of a variety of ways.

[0110] If a Remote Site wants the equipment to stay at their facility, they can lease or rent the equipment and provide their own Remote System Operator. If a Remote Site does not want the equipment to stay at their facility, the Host can provide service by either sending an independent contractor, who leases or rents the equipment, to the remote site; send the equipment to a person in the Remote Site's area that is able to provide service under a single visit contract; or send the equipment with a Host employee to the Remote Site to provide service.

[0111] Step 2: Providing the Proper Equipment

[0112] The Host Technical Service Center (Host Site) has technical personnel, service information, and an audio-visual teleconferencing system (Host System). The Remote Site obtains a portable audio-video teleconferencing system (Remote System) that can communicate with the Host System. The Remote Site may obtain a temporary Remote System, provided by the Host Technical Service Center, that can be stored at the Remote Site indefinitely.

[0113] Step 3: Initial Set-Up

[0114] The Remote Site System Operator (Remote System Operator) sets up the Remote System in close proximity to the medical or other application that is to be the subject of the telecommunications session and establishes a connection between the Host System and the Remote System via a communications link, preferably over the Internet, via satellite point to point direct relay, satellite network relay, radio frequency wave transmission or other communication connection.

[0115] Step 4: Verifying the Contractual Relationship

[0116] Once the Remote System is set up, the Remote System Operator confirms that a contractual relationship is in effect. This can be accomplished via telephone, facsimile, or via the audio-video telecommunications system once a communications connection is established. Host Site Personnel confirm the contract and authorize the service session to commence.

[0117] Step 5: Technical Services Provided

[0118] The Host Technician operating the Host System can provide a variety of services including: training, troubleshooting, and guidance on calibration and maintenance. These services are completed by providing instruction to the Remote Operator based upon the information available to the Host Technician at the Host Site, information conveyed from the Remote Operator and other Remote Site personnel via the linked audio-video telecommunications systems, and the Host Technician can see and hear the operation of the application via the linked audio-video telecommunications systems. Further, the Remote Site Operator can move the Remote System to give the Host Technician a different perspective which may aid the Host Technician in providing proper information to the Remote Site personnel.

[0119] Step 6: Documentation

[0120] As shown in FIG. 1, the equipment at the host site includes software. It is preferred that such software includes means to track and maintain history of the remote site and the equipment and procedures there located. As shown in FIG. 2, prior to sign off, all services that have been provided at the remote site are documented. Thus, a history and steps taken at any remote site is kept in the computer system at the host site. It is within the purview of the invention to maintain a PMI (Preventative Maintenance Inspection) docket in the software at the host site so that proper maintenance and/or verification procedures are indicated. At the direction of the host site, the latter information may be sent to or maintained on the remote site computer assembly.

[0121] Step 7: Ending the Session

[0122] Once services have been provided, the Remote System Operator disconnects the communications connection. The Remote System Operator then either moves the Remote System to a new medical or other application for which the current Remote Site needs assistance, stores the system away at the Remote Site, or reconfigures the device to be taken with the Operator. The device may then be shipped back to the Host Site or may be kept by the Operator until the next job depending on the arrangement between the Operator and the Host Site.

[0123] Although medical application services are discussed herein, the assemblies and processes of the invention may also be utilized to perform services relating to other applications, i.e., relating to the repair, installation, calibration and operation at remote sites of equipment in other industries, for example, industrial machines, tools and equipment, industrial process equipment, telecommunication equipment, heavy construction equipment, agriculture, food processing, food service, electronic and packaging equipment, and heating, vacuum and air conditioning equipment and the like.

[0124] In summary, the computer equipment and software equipment discussed herein are exemplary and compatible and like equipment and software may be used in the teachings of this invention. Further, the host site may be more than one in number, i.e., wherein two operators skilled in respective arts are networked to communicate with one or more remote sites. Furthermore, one or more host sites may simultaneously be linked to a plurality of remote sites i.e., to conduct a training session.

[0125] As many changes are possible to the embodiments of this invention utilizing the teachings thereof, the descriptions above, and the accompanying drawings should be interpreted in the illustrative and not the limited sense.