US 6,785,709 B1Grant
Method and apparatus for building customized data and/or video conferencing applications utilizing prepackaged conference control objects
Issue Date:2004-08-31
•24 Claims
•18 Drawing Sheets
Abstract
A prepackaged object-oriented data and/or video conferencing (DVC) application programming toolkit (PK) having a number of conference control objects is provided for building customized DVC applications. Instances of these conference control objects are to be incorporated in customized DVC applications. An instance of a conference control object is used to facilitate accesses to conference management services of a local general purpose personal conference (GPPC) application, including connection management functions, extended A/V services, and data management services.
Metadata
Assignee
- Intel Corporation
Inventor
- Ramesh Pendakur
Application Information
Application Number:US 08/947,920
Filing Date:1997-10-09
Priority Date:1995-04-28
Art Unit:7
Classifications
IPC:
G06F 1516G06F 944
Field of Search:
709320719320719315719328719316
Patent Drawings (18 sheets)
Description
[0002] This is a Continuation Application of application Ser. No. 08/431,115, filed Apr. 28, 1995, now abandoned.
Background of the Invention
[0003] 1. Field of the Invention
[0004] The present invention relates to the field of data and/or video conferencing (DVC) applications. More specifically, the present invention relates to the development and running of these applications.
[0005] 2. Background Information
[0006] As advances in telecommunication and computing technology continue to bring forth more powerful and yet affordable computer conferencing systems, it has become increasingly viable to apply the technology of DVC to a wide range of business problems. For example, the technology can be applied to allow a person in the process of relocating to a new geographic area to preview homes for sale in the new area, under the guidance of a real estate marketing representative in the new area, while the person is still in the old area. As a further example, the technology can also be applied to allow a west coast investor to remotely review the performance data of a number of financial instruments with his/her financial adviser in New York.
[0007] Conventional approaches would develop these DVC applications using any number of well known high level programming languages such as COBOL and C, and/or assembly language, employing various software development techniques such as top down design and data flow analysis. However, it will be costly if each of these DVC applications has to provide their own conferencing services, such as connection management functions, conference management functions and audio and video (A/V) services.
[0008] Since a general purpose personal conference (GPPC) application is typically incorporated with these conferencing services, it would be a lot more cost effective if DVC applications can be developed and run in a manner allowing them to exploit the conferencing services of a GPPC application, leaving substantially only the special user interfaces tailored for the special customer sets, and the companion logic to be developed.
[0009] Additionally, it is further desirable to allow DVC applications to be independently developed under this more cost effective approach, and yet they can cooperate with each other at runtime, even when the independent development led to DVC applications having different levels of capabilities, such as different number of data and file channels supported for performing data and file transfers.
[0010] As will be disclosed in more detail below, the methods and apparatus of the present invention achieve these and other desirable results.
Summary of the Invention
[0011] A prepackaged object-oriented DVC application programming toolkit (PK) having a number of prepackaged conference control objects is provided for building customized DVC applications. The customized DVC applications are to be incorporated with instances of these prepackaged conference control objects for facilitating accesses to conferencing services of a local GPPC application, thereby alleviating these customized DVC applications from having to provide the conferencing services.
[0012] The prepackaged conference control objects of the DVC application PK of the present invention include a Connection Control Object, a Local A/V Control Object, a Remote A/V Control Object, a Data Channel Control Object and a File Channel Control Object.
[0013] The Connection Control Object facilitates accesses to connection management functions of the local GPPC application to allow the incorporating local DVC application to connect and manage its connection to a similarly constituted remote DVC application.
[0014] The Local A/V. Control Object facilitates accesses to the extended A/V services of the local GPPC application to allow the incorporating local DVC application to manage the capturing of local A/V, their local rendering, and provision to the connected remote DVC application. The Remote A/V Control Object also facilitates accesses to the extended A/V services of the local GPPC application to allow the incorporating local DVC application to manage the receipt of remote A/V signals from the connected remote DVC application, and their local rendering.
[0015] The Data Channel Control Object provides data channels and facilitates accesses to the data management functions of the local GPPC application to allow the incorporating local DVC application to manage data transfers to and from the connected remote DVC application. The File Channel Control Object provides file channels and also facilitates accesses to the data management functions of the local GPPC application to allow the incorporating local DVC application to manage file transfers to and from the connected remote DVC application.
[0016] In the presently preferred embodiments, these prepackaged conference control objects are implemented using commercially available object-oriented programming products (OOPP). In addition to the standard properties and events provided by the OOPP, each conference control object includes a number of custom properties and/or custom functions for qualifying the kind of functions/services to be facilitated, and a number of custom events for properly notifying the incorporating DVC applications.
[0017] In particular, the Data Channel Control Object includes a Data Channel Send as well as a Data Channel Receive function for the incorporating local and connected remote DVC applications to send and receive data from each other, whereas the File Channel Control Object includes an Action property for the incorporating local DVC application to send files to the connected remote DVC application.
[0018] Additionally, under the presently preferred embodiments, the conference control objects are designed to complement an interposed runtime synchronizer which automatically synchronizes local and remote A/V rendering as well as data and file channels for data and file transfers between the incorporating local and connected remote DVC applications, thereby relieving the conference control objects from having to individually provide the applicable synchronization and yet the DVC applications are not burdened with the responsibilities.
Brief Description of Drawings
[0019] The present invention will be described by way of exemplary embodiments, but not limitations, illustrated in the accompanying drawings in which like references denote similar elements, and in which:
[0020] FIG. 1 illustrates a typical point-to-point DVC system incorporating the teachings of the present invention;
[0021] FIG. 2 illustrates the essential hardware elements of conferencing Computer A/B of FIG. 1;
[0022] FIG. 3 illustrates the essential software elements of conferencing Computer A/B of FIG. 1;
[0023] FIG. 4 illustrates the GPPC application of FIG. 3 in further detail;
[0024] FIG. 5 illustrates a particular relevant aspect of the transport and audio/video service interface of FIG. 3 in further detail;
[0025] FIG. 6 illustrates the DVC application development toolkit of the present invention in further detail;
[0026] FIGS. 7-11 illustrate custom properties for one embodiment of the control objects of FIG. 6;
[0027] FIG. 12 illustrates custom events for one embodiment of the control objects of FIG. 6;
[0028] FIG. 13 illustrates custom functions for one embodiment of the control objects of FIG. 6;
[0029] FIG. 14 illustrates the manifestation, instance creation, property value setting, and event procedure provision for one embodiment of the control objects of FIG. 6;
[0030] FIG. 15 illustrates the DVC application runtime interface of FIG. 6 in further detail;
[0031] FIGS. 16a-16billustrate one embodiment of the message format employed by the runtime management objects of FIG. 15;
[0032] FIGS. 17a-17billustrate various essential control data maintained by the runtime management objects of FIG. 15; and
[0033] FIGS. 18-21 illustrate the runtime method steps of the present invention.
Detailed Description of the Invention
[0034] In the following description, for purposes of explanation, specific numbers, materials and configurations are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well known features are omitted or simplified in order not to obscure the present invention.
[0035] Referring now to FIG. 1, an exemplary point-to-point DVC system incorporated with the teachings of the present invention is illustrated. Point-to-point DVC system 10 comprises conferencing computers A & B 12aand 12bconnected to each other in a peer-to-peer manner, via either a LAN, POTS, ISDN or the like 14. Computer A 12aand Computer B 12bare joined together in conference when one of the two computers 12aor 12bcall the other.
[0036] FIG. 2 illustrates the essential hardware elements of Computer A/B 12*. Computer A/B 12* comprises processor 16, cache memory 18, system memory 20, memory controller 22 and processor bus 24 coupled to each other as shown. Additionally, computer A/B 12* further comprises input/output (I/O) controller 26, audio I/O devices 28, video I/O devices 30, keyboard and cursor control devices 32, communication interface 36, and I/O bus 36 coupled to each other and the earlier described elements as shown. Audio I/O devices-28 include a microphone, speakers/headphones, an audio add-on card and its driver(s), whereas video I/O devices 30 include a video display, a video camera, a video capture add-on card and its driver(s). Network interface 34 include circuitry and/or driver software in support of the physical aspects of the peer-to-peer connection, including a reliable data link manager for reliably transferring data. Computer A/B 12* is intended to represent a broad range of high performance microprocessor based computer systems including but not limited to i486 or Pentium® processors based computers. i486 and Pentium are registered trademarks of Intel Corp., the assignee of the present invention.
[0037] FIG. 3 illustrates the essential software elements of Computer A/B 12* in further detail. As shown, each computer 12* comprises a number of DVC applications 42. More importantly, each computer 12* comprises DVC application programming toolkit (PK) 40aand DVC application runtime synchronizer (RS) 40bof the present invention. As will be described in more detail below, DVC application PK 40aincludes a number of control objects, whereas DVC application RS 40bincludes a number of runtime management and channel objects. Additionally, each computer 12* comprises an operating system 44 and a GPPC application 38.
[0038] DVC applications 42 are intended to represent a wide range of business applications including but not limited to the examples discussed earlier in the background section. DVC applications 42 are developed using control objects of the DVC application PK 40a. In other words, DVC applications 42 include instances of these control objects. During runtime, these control object instances facilitate accesses to the conference management services of GPPC application 38 by the respective DVC applications 42, thereby alleviating the DVC applications 42 from having to provide their own conferencing services and achieving the desired more cost effective approach to developing and running DVC applications 42. As will be obvious from the description to follow, DVC applications 42 may be developed independently, and therefore may have different levels of data and/or video capabilities, including different number of data and/or file channels for performing data and/or file transfers.
[0039] DVC application RS 40bis used to manage runtime interactions between a local and a remote DVC application 42, including control communication, A/V exchanges, and data/file transfers between the two independent DVC applications 42, thereby relieving the control objects from having to provide the appropriate A/V rendering as well as data/file channel synchronization, and yet without burdening the DVC application 42 with the responsibilities. The runtime management and channel objects of DVC application RS 40bcomplement the control object instances in facilitating runtime accesses to the conference management services of GPPC application 38 by a local DVC application 42 for those accesses made for the purpose of interacting with a remote DVC application 42.
[0040] Operating system 44 is intended to represent the operating system kernel as well as related, extensions and subsystems. Operating system 44 provide traditional operating system services such as memory allocation and scheduling, which are well known in the art. Operating system 44 also provides communication device drivers for physically sending and receiving data as well as A/V signals through communication interfaces 34. Preferably, the “related extensions” of operating system 44 also provide multi-media device drivers for receiving A/V signals from the A/V input devices 28 and 30 as well as rendering audio and video on the A/V output devices 28 and 30. Preferably, the “related subsystems” of operation system 44 also provide modern object-oriented application environment support including messaging services, event notification, and graphical end user interface presentation.
[0041] GPPC application 38 is intended to represent a number of the point-to-point personal conferencing applications known in the art, including but not limited to the ProShare™ Conferencing Product manufactured by Intel Corp., of Santa Clara, Calif., the assignee of the present invention. In particular, GPPC application 38 is incorporated with “internal” conference management services including connection management functions, and extended A/V services beyond the basic A/V services offered by operation system 44.
[0042] FIG. 4 illustrates one embodiment of GPPC application 38 in further detail. As shown, for this embodiment, GPPC application 38 comprises conference manager 46 and address book services 48. Furthermore, GPPC application 38 comprises transport independent services 52, extended A/V services 54, and an “integrated” interface 50 to these services 52 and 54. Conference manager 46 provides a set of services that allows several conferencing applications to share a common transport independent interface connection. Address book services 48 provide services related to managing connection addresses for conference participants. Transport independent services 52 provide connection services on multiple transport media and multiple connections. A/V services 54 provide sampling, digitization, compression/decompression of audio signals exchanged between the two computers 12a-12bover a full-duplex audio connection, as well as capture and playback services for video streams including interfacing with the proper CODEC to compress and decompress the video signals. Integrated interface 50 provides abstraction of these transport and A/V services, enabling the serviced application to perform call management, data and/or file channel management, and A/V streams management. These and other related services are known in the art, and therefore will not be described in further detail.
[0043] The above described control object instances incorporated in DVC applications 42 (directly or in conjunction with the runtime management objects of DVC application RS 40b) facilitate accesses to the connection management functions as well as A/V services of GPPC application 38 through integrated interface 50. While for ease of explanation, GPPC application 38 is illustrated with all the relevant transport and A/V services abstracted at the integrated interface 38 level, it will be appreciated by those skilled in the art, the present invention may be practiced with the incorporated control object instances of DVC application 42 and runtime management object of DVC application RS 40bfacilitating accesses through direct interactions with the transport independent services 52 and A/V services 54, partially or totally by-passing interface 50.
[0044] Before proceeding to describe DVC application PK 40aand DVC application RS 40bin further detail, we now refer briefly to FIG. 5, wherein an operational modification to conference manager 46 such that it cooperates also with DVC application RS 40bis shown. As illustrated, conference manager 46 is modified such that it will handle any connection request received from a remote computer 12* in one of two ways. More specifically, a connection request will be handled by conference manager 46, step 60, if it is determined at step 58, the request is not a request originated from a remote DVC application for a local DVC application. However, a connection request will be routed to DVC application RS 40b, step 62, if it is determined at step 58, the request is a request originated from a remote DVC application for a local DVC application.
[0045] It should also be noted that while for ease of explanation Computer A and B 12aand 12bare both described as having DVC application PK 40aand DVC application RS 40b, those skilled in the art would appreciate that DVC application PK 40aand DVC application RS 40bof the present invention may be practiced separately on different systems. Furthermore, DVC application PK 40amay be practiced on a system without all the hardware elements described earlier, such as A/V devices 28 and 30 and communication interface 34.
[0046] We now proceed first to describe DVC application PK 40ain further detail, with references to FIGS. 6-14. Referring first to FIG. 6, wherein the presently preferred embodiment is illustrated. As shown, under the presently preferred embodiment, DVC application PK 40ais object-oriented. DVC application PK 40aincludes a Connection Control Object 64, a Local A/V Control Object 66, a Remote A/V Control Object 68, a Data Channel Control Object 70 and a File Channel Control Object 72. In other words, the various control data, i.e. connection control data, local A/V control data etc., are “encapsulated”, and the object users, i.e. the rest of DVC applications 42 manipulate the control data by invoking the associated methods, as is known in the art of object-oriented programming.
[0047] Connection Control Object 64 (more specifically, an instance thereof) is used by local DVC application 42 to exploit the connection management functions of local GPPC application 38 to manage its connection to remote DVC application 42. Local A/V Control Object 66 (more specifically, an instance thereof) is used by local DVC application 42 to exploit the extended A/V services 54 of local GPPC application 38 to manage the capturing of local A/V, their local rendering, and provision to remote DVC application 42. Similarly, Remote A/V Control Object 68 (more specifically, an instance thereof) is used by local DVC application 42 to exploit the extended A/V services of local GPPC application 39 to manage the receipt of remote A/V signals from remote DVC application 42, and their local rendering.
[0048] Data Channel Control Object 70 (more specifically, instances thereof is used by local DVC application 42 to exploit the data management functions of local GPPC application 38 to manage its data channels and transfer data to and from remote DVC application 42. In like manner, File Channel Control Object 72 (more specifically, instance thereof is used by local DVC application 42 to exploit the data management functions of local GPPC application 38 to manage its file channels and transfer files to remote DVC application 42.
[0049] Each DVC application 42 must include an instance of Connection Control Object 64. Additionally, each DVC application 42 may include one instance each of Local A/V Control Object 66 and Remote A/V Control Object 68. Furthermore, each DVC application 42 may include one or more instance each of Data Channel Control Object 70 and File Channel Control Object 72. In other words, a DVC application 42 may have multiple data channels as well as multiple file channels, making it easier for the DVC application 42 to manage data and file transfer. However, because transmission bandwidth is limited, only a subset of these channels may be open at any one point in time. In one embodiment, a DVC application 42 may have up to two data channels and two file channels, with two channels of either kind open at any one point in time.
[0050] In the presently preferred embodiments, these control objects 64-72 are implemented using Visual Basic and Visual C++, manufactured by Microsoft Corp., of Redmond, Wash. In addition to the standard properties and events, each control object 64-72 includes a number of custom properties for qualifying the kind of functions/services to be facilitated, and a number of events for properly notifying the local DVC application 42. The Data Channel Control Object 70 further includes a Data Channel Send as well as a Data Channel Receive function for sending and receiving data. The standard properties and events will not be further described. For further information, refer to the various product literature's.
[0051] FIG. 7-11 illustrate the key custom properties and their legal values including the meaning of the legal values, for the various conference control objects 64-72. As shown in FIG. 7, Connection Control Object's 64 key custom properties 74 include Action 74a, CallerId 74b, ConnectionAddress 74c, ConnectionType 74d, IsCaller 74e, Status 74fand UserId 74g. Whether any of these key properties 74a-74gare writable or read only or both are illustrated in the adjacent column.
[0052] Action 76 may be set to Connect, HangUp, or ShareNotebook. Action 76 may be set to Connect only after ConnectionAddress 74cand ConnectionType 74dhave been set accordingly as described below. Whenever Action 76 is set to Connect, connection management object 64 initiates a connection request to a remote DVC application 42 on behalf of a local DVC application 42. Whenever Action 76 is set to HangUp, connection management object 64 initiates a connection disconnect to a remote DVC application 42 on behalf of a local DVC application 42. Finally, whenever Action 76 is set to ShareNotebook, connection management object 64 causes the Conference Notebook of the local GPPC application 38 to be shared with the remote GPPC application 38.
[0053] CallerId 74bis set to the identification of the remote party. CallerID 74bis set after the connection is established, regardless whether the local DVC application 42 initiated the connection request or received the connection request from a remote DVC application 42. ConnectionAddress 74cis set to the phone number or the LAN address of the remote computer 12*. ConnectionType 74dis set to the type of connection to be established, e.g. ISDN, IPX, NetBIOS, TCP/IP etc. IsCaller 74eis set to either True or False denoting whether the local computer 12* is the computer who initiated the call. Skipping to UserId 74g, it is set to the identification of the local party. Userid 74gis provided to the remote DVC application 42 when making the connection.
[0054] Finally, going back to Status 74f, it is set to the current status of the “connection”, i.e. Ready meaning ready to make a new connection, Connecting meaning connection is in progress, Connected meaning connection has been established, Disconnecting meaning disconnection is in progress, and ConnectRequest meaning a connection is requested of local DVC application 42 by remote DVC application 42.
[0055] As shown in FIGS. 8 and 9, both Local and Remote A/V Control Object's 66 and 68 key custom properties include Action 80aand 86a, Brightness 80band 86b, Contrast 80cand 86c, Saturation 80dand 86e, Size 80eand 86f, SnapshotDestination 80fand 86g, SnapshotFilename 80gand 86h, SnapshotFormat 80hand 80i, Status 80iand 86j, Zoom 80kand 86l, and ZoomState 80land 86m. Additionally, Local A/V Control Object's 66 key custom properties further include Tint 80j, whereas Remote A/V Control Object's 68 key custom properties further include OpenAudio 86dand Volume 86k.
[0056] Action 80aand 86amay be set to Snapshot, or Zoom. Additionally Action 80a(Local A/V Control Object 66) may also be set to Play or Pause with or without further qualification of Audio or Video. Whenever Action 80ais set to Play, Local A/V Control Object 66 causes local A/V to be captured, rendered locally, and provided to remote DVC application 42. Whenever Action 80ais set to Pause, Local/Remote A/V Control Object 66/68 will cause local A/V capturing, their rendering as well as provision to remote DVC application 42 to be paused accordingly. If no further qualification is provided, both capturing, rendering and providing of audio and video will be caused to be paused. If audio is further specified, only capturing, rendering, and providing of audio will be caused to be paused. Similarly, if video is further specified, only, capturing, rendering, and providing of video will be caused to be paused.
[0057] Brightness 80band 86b, Contrast 80cand 86c, and Saturation 80dand 86emay be set to an integer between a predetermined range such as 0-100, denoting the relative brightness, contrast and saturation of the local and remote video to be rendered. Similarly, Tint 80jand Volume 86kmay be set to an integer between a predetermined range such as 0-100, denoting the relative tint of the local video and the relative volume of the remote audio to be rendered.
[0058] OpenAudio 86dmay be set to either On or Off denoting whether remote audio signals are to be rendered through a Speaker or a Headset (audio output devices 28). Size 80eand 86fmay be set to either Normal or Large denoting a video window size of 160×120 pixels and 320×240 pixels respectively. Snapshot destination 80fand 86gmay be set to File or Clipboard. Whenever File is specified, the associated SnapshotFile 80g/86his set to the file name, and the associated SnapshotFormat 80h/86iis set to the snapshot image format standard, such as DIB or BMP. Zoom 80kand 86lmay be set to either out or in denoting zoom out or zoom in of the local/remote video input device 30. ZoomState 80land 86mare set to the respective current status of the zoom state, i.e. zoom out or zoom in.
[0059] Lastly, Status 80iand 86jmay be set to the current status of A/V signal rendering, i.e. Play if the A/V signals are being rendered or Pause if either audio or video signals are not being rendered. If only either audio or video is paused, the Pause status is further qualified to denote whether audio or video is paused.
[0060] As shown in FIGS. 10 and 11, both Data Channel and File Channel Control Objects' 70 and 72 key custom properties 92 and 98 include Action 92aand 98a, Priority 92band 98c, and Status 92cand 98f. Additionally, as shown in FIG. 11, File Channel Control Object's 72 key custom properties 98 further include Overwrite 98b, ReceiveFileName 98dand SendFileName 98e.
[0061] Action 92aand 98amay be set to Open, Close or Abort. Whenever Action 92a/98ais set to Open, Data/File Channel Control Object 70/72 causes a data/file channel to be open. Whenever Action 92b/98bis set to Close, Data/File Channel Control Object 70/72 causes a data/file channel to be closed. Whenever Action 92a/98ais set to Abort, Data/File Channel Control Object 70/72 causes a data/file transfer to be aborted. Additionally, Action 98amay also be set to Send. Whenever Action 98ais set to Send, File Channel Control Object 72 causes a file to be transferred.
[0062] Priority 92band 98cmay be set to Low, Medium or High denoting the relative data transfer speed to be employed for transferring data. A data transfer involving a Data/File Channel Control Object instance having a higher priority designation will take priority over another transfer involving a Data/File Control Object instance having a lower priority designation, when insufficient bandwidth is available to accommodate both transfers without discriminating one over the other. A data transfer involving a Data File Channel Object instance having a High setting will also be favored to the extent even if it means loss of real time A/V signals. Overwrite 98bmay be set to True or False, denoting whether a file transfer should overlay an existing file on the remote computer 12* with the same filename. ReceiveFileName 98dis used to denote the destination file of a file transfer, whereas SendFileName 98eis used to denote the source file of a file transfer.
[0063] Lastly, Status 92cand 98fmay be set to the current status of the data and file channels respectively, i.e. Closed if the data/file channel is closed, Ready if the data/file channel is open and ready for data/file transfer, Sending if outbound data/file transfer is in progress, and Receiving if inbound data/file transfer is in progress.
[0064] We now refer to FIGS. 12 and 13, wherein the custom events and custom functions of control objects 64-72 are listed. As listed in FIG. 12, connect control object 64 has a Connect, a Connect Failure, a Connect Progress, a Connect Request and a Disconnect custom event. Similarly, Local and Remote A/V Control Objects 66 and 68 also have a Connect and a Disconnect custom event. Additionally, Local/Remote A/V Control Object 66/68 also includes a ZoomChanged event.
[0065] Connect is used to notify a local DVC application 42 that connection to a remote DVC application 42 has been achieved, whereas Disconnect is used to notify a local DVC application 42 the opposite, i.e. connection to a remote DVC application 42 has been severed. Connect Request is used to notify a local DVC application 42 that connection request is being made by a remote DVC application 42, whereas Connect Progress is used to notify a local DVC application 42 that connection to a remote DVC application 42 is in progress. Connect Failure is used to notify a local DVC application 42 that connection attempt to a remote DVC application 42 has failed. Finally, ZoomChanged is used to notify the DVC applications 42 of zoom changes to the local/remote A/V capturing.
[0066] As listed also in FIG. 12, both Data and File Channel Control Objects 70-72 have a Channel Close, a Channel Open, a Done Receiving, a Done Sending, a Receive Progress, a Receive Started, a Send Progress, a Send Started, and a Transfer Aborted custom event. Channel Open and Close are used to notify a DVC application 42 of the opening or closing of a data/file channel. Send and Receive Started are used to notify a DVC application 42 of the starting of sending and receiving of data/file. Send and Receive Progress are used to notify a DVC application 42 that sending and receiving of data/file are in progress. Done Receiving and Sending are used to notify a DVC application 42 of the completion of sending and receiving of data/file. Lastly, Transfer Aborted is used to notify a DVC application 42 that the sending and receiving of data/file has been aborted.
[0067] The DVC applications 42 provide event procedures for handling these events for the applicable control objects 64-72, upon being notified of the events. The manner in which an event procedure handles an event for a control object 64-72 is application dependent.
[0068] As listed in FIG. 13, Data Channel Control Object 70 also includes two custom functions 108, Data Channel Send 108aand Data Channel Receive 108b. The two functions 108 are used by DVC applications 42 to send and receive data. Data Channel Send 108ahas a pointer parameter SND_PTR 110apointing to the start of a source buffer, and a length parameter 110adenoting the size of the data to be sent. Similarly, Data Channel Receive 108bhas a pointer parameter REC_PTR 110bpointing to the start of a destination buffer, and a length parameter 110bdenoting the size of the data to be received.
[0069] FIG. 14 illustrates the manifestation, instance creation, property setting (at design time), and event procedure provision for Control Objects 64-72 of FIG. 6. As shown, Control Objects 64-72 are manifested as “tools” (CX, LV, RV, DC and FC) 116a-116din Visual Basic's tool palette 114. Instance creation, property setting (at design time), and event procedure provision for Control Objects 64-72 are all performed in identical manner as standard Visual Basic objects. Thus, these aspects of Control Objects 64-72 are only briefly illustrated here.
[0070] As shown, a local video window 120 controlled by an instance of Local A/V Control Object 66 is created by dragging LV 116bto the desired area of the design form 118 for DVC application XYZ 42. The properties for this instance of Local A/V Control Object 66 is set through Property window 122, whereas the event handling procedure for the Connect event is entered through Event Procedure window 130. For further description, refer to Visual Basic's product literature's.
[0071] We now proceed to describe DVC application RS 40bin further detail, with references to FIGS. 15-17. Referring first to FIG. 15, wherein the presently preferred embodiment is illustrated. As shown, under the presently preferred embodiment, DVC application RS 40bis object-oriented. DVC application RS 40bincludes a Runtime Manager Object 134, a Channel Manager Object 136, a pair of Control Input and Output Channel Objects 138, zero or more pairs of Data Input and Output Channel Objects 140, and zero or more pairs of File Input and Output Channel Objects 141. In other words, the various runtime data, i.e. DVC application capabilities, data and file blocks being transferred etc., are “encapsulated”, and the object users, i.e. instances of control objects 64-72 manipulate the runtime data by invoking the associated methods, as is known in the art of object-oriented programming.
[0072] Runtime Manager Object 134 and Channel Manager Object 136 are created at installation time, whereas Control Input and Output Channel Objects 138 is created at connect time, and Data as well a File Input and Output Channel Objects 140 and 141 are created on an as needed basis, that is when their corresponding data and file channels of DVC application 42 are open, as will be described in more detail below.
[0073] Runtime Manager Object 134 is used by instances of control objects 64-72 to exploit the conference services of local GPPC application 38 to manage its interactions with their counterparts of a remote DVC application 42, including control communications, A/V exchanges, and data/file transfers. More specifically, Runtime Manager Object 134 is used by instances of Local and Remote A/V Control Objects 66-68 to exploit the extended A/V services of local GPPC application 38 to manage capturing of local A/V and local as well as remote rendering of the captured A/V. (Local and Remote A/V Control Objects 66-68 also access the extended A/V services of local GPPC application 38 directly to manage aspects of local rendering of local and remote A/V signals that do not have remote effects, e.g. changing the rendering of remote audio signals from headphone to speakers.) Runtime Manager Object 134 is also used by an instance of Connection Control Object 64 to exploit the connection management functions of local GPPC application 38, through Channel Manager Object 136 and Control Input/Output Channel Objects 138, to manage connection to its counterpart of a remote DVC application 42, including automatic exchange of DVC application capabilities at connect time. Lastly, Runtime Manager Object 134 is used by instances of Data and File Channel Control Objects 70-72 to exploit the data management functions of local GPPC application 38, through Channel Manager Object 136 and Data/File Input/Output Channel Objects 140 and 141, to manage sending and receiving of data and files to their counterparts of a remote DVC application 42.
[0074] Channel Manager Object 136 is used by Runtime Manager Object 134 to map its logical control channel to Control Input/Output Channel Objects 138, and its virtual data and file channels to Data/File Input/Output Channel Objects 140. In turn, Control Input/Output Channel Objects 138 are used by Channel Manager Object 136 to send and receive control messages for Runtime Manager Object 134, whereas Data/File Input/Output Channel Objects 140 and 141 are used by Channel Manager Object 136 to send and receive data/files for Runtime Manager Object 134. Input Channel Objects, Control as well as Data/File, 138 and 140 and 141, are used to forward control messages and data/file received from the remote DVC application 42 to Runtime Manager Object 134, whereas Output Channel Objects, Control as well as Data/File, 138, 140 and 141, are used to send control messages and data/file blocks received from Runtime Manager Object 134 to the remote DVC application 42.
[0075] In addition to control messages, both data as well as file blocks are also sent and received as messages. FIG. 16a-16billustrate one embodiment of the message format employed by the runtime management objects 134-141. As shown in FIG. 16a, under this embodiment, each message 142 comprises a message type 144, i.e. control message or data message etc., message parameters 146, a sequence number 148 (for multi-block data/file transfers), a buffer/data size 150 and the buffer/data itself 152. As shown in FIG. 16b, under this embodiment, the buffer/data 152aof the capability exchange control message comprises the number of DVC application objects incorporated 154, and the object type and object identification 156 of each instance of control object 62-74 incorporated.
[0076] FIGS. 17a-17billustrate one embodiment of various essential control data maintained by Runtime Manager Object 134 and Channel Manager Object 136. As shown in FIG. 17a, under this embodiment, Runtime Manager Object 134 maintains a “table” each on whether the various instances of control object 64-72 are supported by local and remote DVC applications 42, and if supported, their corresponding object identification. As described earlier, these capabilities information of local DVC application 42 are provided automatically to remote DVC application 42 at connect time, and the capabilities information of remote DVC application 42 are received automatically from remote DVC application 42 at connect time. Runtime Manager Object 134 disables those capabilities of a local DVC application 42 that are not supported by the counterpart remote DVC application 42.
[0077] For example, if Local A/V Control Object 66 is not supported by remote DVC application 42, Remote A/V Control Object 68 will be marked as unsupported for local DVC application 42. Likewise, if a data channel of local DVC application 42 has no corresponding data channel on remote DVC application 42, it will also be marked as unsupported. The manner in which whether a data/file channel has a corresponding data/file channel will be described in more detail below.
[0078] As shown in FIG. 17b, under this embodiment, Channel Manager Object 134 maintains a mapping of the various logical data and file channels of DVC application 42 to the Data and File Input/Output Channel Objects 140 and 141. The Data and File Input/Output Channel Objects 140 and 141 are uniquely identified within a DVC application RS 40bin accordance to a predetermined convention. In one embodiment, they are chronologically identified, for examples, DC0, DC1, FC0, FC1 etc. The data and file channels of DVC application 42 are logically assigned the Data and File Input and Output Channel Objects 140 and 141 at design time. Data/file channels of the local and remote DVC applications are implicitly associated with each other, or corresponding, if they are assigned to Data/File Input and Output Channel Objects 140 and 141 with the same identification.
[0079] As accesses for data/file block transfers are routed from the sending DVC application 42 through Runtime Manager Object 134, Channel Manager Object 136 forwards them through the assigned Data/File Input and Output Channel Objects 140 or 141. In like manner, on the receiving end, Channel Manager Object 136 routes the received data/file blocks to receiving DVC application 42 through associated Data/File Channel Input and Output Channels 140 or 141 having the same identification and Runtime Manager Object 134. As a result, data/file transfers between local and remote DVC applications 42 are synchronized to the proper data/file channels.
[0080] We now proceed to describe the runtime method steps of the present invention in further detail, with references to FIGS. 18-20. For ease of explanation, in the description to follow, all accesses to conferencing services of a GPPC application. 38 are assumed to be routed through its TAVSI 50 as described earlier. Similarly, all interactions between a local and a remote DVC application 42 are routed through DVC application RS 40b, with all inbound control messages being routed through Channel Manager Object 136, Control Input Channel Object 138, and Runtime Manager Object 134, all outbound control messages being routed through Runtime Manager Object 134, Channel Manager Object 136, and Control Output Channel Object 138, all inbound data/file blocks being routed through Channel Manager Object 136, Data/File Input Channel Object 140, and Runtime Manager Object 134, and all outbound data/file blocks being routed through Runtime Manager Object 134, Channel Manager Object 136, and Data/File Output Channel Object 140, as described earlier. Furthermore, each reference to a control object 64-72 means a particular DVC application's instance of the control object 64-72. Accordingly, these details will not be repeated below.
[0081] Referring first to FIG. 18, as illustrated, DVC application 42 on Computer A 12amakes a connection with DVC application 42 on Computer B 12bby setting Action 74aof Connection Control Object 64 on Computer A 12ato Connect, step 200. In response to the setting, Connection Control Object 64 requests connection management functions of GPPC application 38 through DVC application RS 40bto make the desired connection, steps 200 and 202. Connection Control Object 64 provides the CallerId, ConnectAddress and ConnectType to the connection management functions. In response to the request, the connection management functions validate the request and place the call if the request is a valid request, else reject the request, step 204.
[0082] Upon either placing or rejecting the requested call, the connection management functions notify Connection Control Object 64, step 206. In response, Connection Control Object 64 triggers either a Connect Progress or a Connect Failure event, step 208, causing the Connect Progress or Connect Failure event handling procedure of DVC application 38 to be given control to handle the Connect Progress/Connect Failure.
[0083] In the meantime, over in Computer B 12b, upon receiving the call (if it was found to be valid and made), connection management functions of GPPC application 38 notify Connection Control Object 64 of DVC application 42, through DVC application RS 40b, steps 210 and 212. Connection Control Object 64 then triggers Connect Request event, step 214. As a result, Connect Request event handling procedure of DVC application 42 is given control. The call is either accepted or rejected by the Connect Request event handling procedure, step 214. The event handling procedure may accept or reject the call in a number of application dependent manner, including but not limited to validating the Caller against a list of “approved” callers.
[0084] Upon being notified accordingly by Connection Control Object 64, DVC application RS 40bpasses the acceptance/rejection to the connection management functions, step 216, which in turn transmits the acceptance/rejection back to Computer A 12a, step 218.
[0085] Back over on Computer A 12a, if the call was accepted, connection management functions of GPPC application 38 either confirm the acceptance with Connection Control Object 64 of DVC application 42 and acknowledge receipt of the acceptance from Computer B 12b, or notify Connection Control Object 64 of the rejection, step 220. In response, Connection Control Object 64 triggers either a Connect or a Connect Failure event accordingly, step 222, causing the Connect or Connect Failure event handling procedure of DVC application 42 to be given control to handle the Connect/Connect Failure.
[0086] Over on Computer B 12b, in response to the acknowledgment, connection management functions of GPPC application 38 notify Connection Control Object 64 of DVC application 42 of the acknowledgment, step 224. In response, Connection Control Object 64 triggers a Connect event, step 226, causing the Connect event handling procedure of DVC application 42 to be given control to handle the Connect.
[0087] Similarly, DVC application 42 on Computer A 12acauses the conference notebook of GPPC application 38 on Computer A 12ato be shared with GPPC application 38 on Computer B 12bby setting Action 74aof Connection Control Object 64 of DVC application 42 to ShareNotebook, step 228. In response, Connection Control Object 64 requests conference management functions of GPPC application 38 to share its notebook through DVC application RS 40b, steps 228 and 230. In response, the conference management functions send a message to Computer B 12brequesting GPPC application 38 therein to start its Notebook application, step 232. At the same time, the conference management functions notify Connection Control Object 64 sharing of notebook has started, step 232.
[0088] Over on Computer B 12b, upon receipt of the request, conference management functions of GPPC application 38 therein start the Notebook application as requested, and notify Computer A 12aaccordingly, step 234.
[0089] Likewise, DVC application 42 on Computer A 12acauses its connection with DVC application 42 on Computer B 12bto be disconnected by setting Action 74aof Connection Control Object 64 of DVC application 42 to HangUp, step 236. In response, Connection Control Object 64 requests connection management functions of GPPC application 38 to disconnect the connection through DVC application RS 40b, steps 236 and 238. In response, the connection management functions send a message to Computer B 12bnotifying GPPC application 38 of the severing of the connection, and then sever the connection, step 240. In the meantime, Connection Control Object 64 also triggers a Disconnect event, step 242, causing the Disconnect event handling procedure of DVC application 42 to be given control to handle the disconnect.
[0090] Over on Computer B 12b, upon receipt of the notification, connection management functions of GPPC application 38 therein sever the connection and notify Connection Management Object 64 of DVC application 42, through DVC application RS 40b, steps 244 and 246. In response, Connection Management Object 64 triggers a Disconnect event, step 248, causing Disconnect event handling procedure of DVC application 42 to be given control to handle the disconnect.
[0091] Referring now to FIG. 19, DVC application 42 on Computer A 12astarts local A/V capturing, local rendering of the captured A/V, and provision of the captured A/V to remote DVC application 42 by setting Action 82aof Local A/V Control Object 66 of DVC application 42 on Computer A 12ato Play, step 250. In response to the setting, Local A/V Control Object 66 requests A/V services 54 of GPPC application 38 to capture local A/V, locally render the captured A/V, and provide the captured A/V to remote DVC application 42, through DVC application RS 40b, steps 250 and 252. Local A/V Control Object 66 also provides the A/V parameters, i.e. Brightness etc. to A/V services 54. In response to the requests, A/V services 54 capture local A/V, locally render and remotely provide the captured A/V accordingly, step 254.
[0092] Over on Computer B 12b, upon first receipt of the remote A/V signals, A/V services 54 of GPPC application 38 notify Remote Video Control Object 68 of DVC application 42, through DVC application RS 40b, steps 256 and 257. In response, Remote Video Control Object 68 provides the remote A/V parameters to A/V services 54 through DVC application RS 40b, steps 258 and 259. A/V services 54 then locally render the remote A/V signals per remote A/V parameters provided, step 260.
[0093] Similarly, DVC application 42 on Computer A 12apauses local A/V rendering (audio and/or video) by setting Action 82aof the particular instance of Local A/V Control Object 66 on Computer A 12ato Pause (with or without audio/video qualification), step 262. In response to the setting, Local A/V Control Object 66 requests A/V services 54 of GPPC application 38 to pause capturing of local audio and/or video, as well as rendering and providing of the captured A/V, through DVC application RS 40b, steps 262 and 263. Additionally, DVC application RS 40bfurther requests a pause control message to be sent to remote DVC application 42, step 263. In response to the requests, A/V services 54 pause the capturing, local rendering, and remote providing, as well as forwarding the pause control message accordingly, step 264.
[0094] Upon cessation of remote A/V signals and receipt of the pause control message over on Computer B 12*, A/V services 54 of GPPC application 38 pause rendering of remote audio and/or video accordingly, step 265. Furthermore, A/V services 54 forward the pause control message to DVC application's instance of Remote A/V Control Object 68 through DVC application RS 40b, steps 265 and 266, which in turn causes the pause control message to be displayed, step 268.
[0095] DVC application 42 on Computer A 12acauses a snapshot of local video to be taken or local video to be zoomed by setting Action 82aof Local A/V Control Object 66 of DVC application 42 on Computer A 12ato Snapshot or Zoom, step 270. In response to the setting, Local A/V Control Object 66 requests A/V services 54 of GPPC application 38, through DVC application RS 40b, to take the snapshot or zoom the local video, steps 270 and 272. Additionally, DVC application RS 40bfurther requests A/V services 54 to send a “Snapshot being taken” or a “Zoom Changed” control message to remote DVC application 42, step 272. In response to the requests, A/V services 54 take the snapshot or zoom the local video, as well as forwarding the control message accordingly, step 274.
[0096] Upon receipt of the “snapshot in progress” or “zoom changed” control message, A/V services 54 of GPPC application 38 forward the control message to Remote A/V Control Object 68 of DVC application 42, through DVC application RS 40b, steps 276 and 278. In response, Remote A/V Control Object 68 displays the “snapshot in progress” control message or triggers the ZoomChanged event, causing the ZoomChanged event handling procedure of DVC application 42 to be given control to handle the event, step 280.
[0097] In like manner, DVC application 42 on Computer A 12acauses a snapshot of remote video to be taken or remote video to be zoomed by setting Action 86aof Remote A/V Control Object 68 of DVC application 42 on Computer A 12ato Snapshot or Zoom, step 282. In response to the setting, Remote A/V Control Object 68 requests A/V services 54 of GPPC application's 38, through DVC application RS 40b, to take the snapshot or zoom the remote video, steps 282 and 283. Additionally, for a snapshot request, DVC application RS 40bfurther requests A/V services 54 to send a “Snapshot being taken” control message to remote DVC application 42, step 283. In response to the requests, A/V services 54 take the snapshot or request zooming the remote video, as well as forwarding the control message accordingly, step 284.
[0098] Upon receipt of the “snapshot in progress” control message or zoom change request, A/V services 54 of GPPC application 38 forward the “snapshot in progress” or a “zoom changed” control message to Local A/V Control Object 66 of DVC application 42, through DVC application RS 40b, steps 286 and 287. For the zoom change request, A/V services 54 also change zooming of the local video accordingly, step 287. In response, Local A/V Control-Object 68 displays the “snapshot in progress” control message or triggers the ZoomChanged event, causing the ZoomChanged event handling procedure of DVC application 42 to be given control to handle the event, step 288. In the meantime, A/V services 54 returns a zoom changed message to Computer A 12a.
[0099] Upon receipt of the zoom changed message on Computer A 12a, A/V services 54 of GPPC application 38 forwards the message to Remote A/V Control Object 68, through DVC application RS 40b, steps 292 and 293. In response, Remote A/V Control Object 68 triggers the ZoomChanged event, causing the ZoomChanged event handling procedure of DVC application 42 to be given control to handle the event, step 294.
[0100] Referring now to FIG. 20, DVC application 42 on Computer A 12aopens a data channel by setting Action 92aof Data Channel Control Object 70 of DVC application 42 on Computer A 12ato Open, step 300. In response to the setting, Data Channel Control Object 70 requests DVC application RS 40bto open the corresponding logical data channel, step 300. In response, DVC application RS 40binternally binds the logical data channel to one pair of its Data/File Input/Output Channel Objects 140, step 302. Additionally, DVC application RS 40bnotifies the remote counterpart of the opening of the logical data channel, through data management functions of GPPC application 38, step 302. In response, data management functions notify the remote counterpart accordingly, step 304. In the meantime, Data Channel Control Object 70 triggers a DataChannelOpen event causing the Data Channel Open event handling procedure of DVC application 42 to be given control to handle the event, step 306.
[0101] Over on Computer B 12b*, in response to the notification, data management functions of GPPC application 38 notify DVC application RS 40b, step 308. In response, DVC application RS 40binternally binds the corresponding logical data channel to one pair of its Data/File Input/Output Channel Objects 140, step 310. DVC application RS 40bfurther notifies Data Channel Control Object 66 of DVC application 38, step 310. In response, Data Channel Control Object 66 triggers a DataChannelOpen event causing the Data Channel Open event handling procedure of DVC application 42 to be given control to handle the event, step 312.
[0102] Upon learning that the desired data channel is open, DVC application 42 on Computer A 12asends data to DVC application 42 on Computer B 12bby calling Data Channel Send Function 108aof Data Channel Control Object 70 on Computer A 12a, providing the pointer and length parameters, step 314. In response to the call, Data Channel Send Function 108afirst requests data management functions of GPPC application's 38, through DVC application RS 40b, to send a data header, steps 314 and 316. In response, data management functions send the header packet to Computer B 12b, step 318. In the meantime, Data Channel Control Object 70 triggers a DataSendStart event causing the Data Send Start event handling procedure of DVC application 42 to be given control to handle the event, step 320.
[0103] Over on Computer B 12b, in response to the header packet, data management functions of GPPC application 38 notify Data Channel Control Object 70 of DVC application 42, through DVC application RS 40b, steps 322 and 324. In response, Data Channel Control Object 70 triggers a DataReceiveStart event causing the Data Receive Start event handling procedure of DVC application 42 to be given control to handle the event, step 326.
[0104] Data Receive Start event handling procedure of DVC application 42 then calls Data Channel Receive Function 108bproviding the pointer and length parameters to receive the data being sent, step 328. Data Receive Start event handling procedure of DVC application 42 further causes an acknowledgment to be returned, through DVC application RS 40band GPPC application 38, steps 328-332.
[0105] Back over on Computer A 12a, data management functions of GPPC application 38 forward the acknowledgment to Data Channel Control Object 66 of DVC application 42, through DVC application RS 40b, steps 334 and 336. In response, Data Channel Control Object 66 triggers a DataSendProgress event causing the Data Send Progress event handling procedure of DVC application 42 to be given control to handle the event, step 338.
[0106] In the meantime, DVC application RS 40buses data management functions of GPPC application 38 to send the first data packet to Computer B 12b*, steps 340 and 342. Upon detecting the sending of the first data packet, Data Channel Control Object 70 triggers a DataSendProgress event causing the Data Send Progress event handling procedure of DVC application 42 to be given control to handle the event, step 344.
[0107] Over on Computer B 12b, in response to the first data packet, data management functions of GPPC application 38, through DVC application RS 40bstore the data and notify Data Channel Control Object 70 of DVC application 42, steps 346 and 348. In response, Data Channel Control Object 70 triggers a DataReceiveProgress event causing the Data Receive Progress event handling procedure of DVC application 42 to be given control to handle the event, step 350.
[0108] These steps are repeated until eventually, back over on Computer A 12a, DVC application RS 40b, through data management functions of GPPC application 38, sends the last data packet to Computer B 12b*, steps 352 and 354.
[0109] Over on Computer B 12b, in response to the last data packet, data management functions of GPPC application 38, through DVC application RS 40bstore the data and notify Data Channel Control Object 70, steps 356 and 358. In response, Data Channel Control Object 70 triggers another DataReceiveProgress event causing the Data Receive Progress event handling procedure of DVC application 42 to be given control to handle the event, step 360. Data Receive Progress event handling procedure of DVC application 42 then through DVC application RS 40band management functions of GPPC application 38, returns an acknowledgment to Computer A 12a, steps 362-366.
[0110] Back over on Computer A 12a, data management functions of GPPC application 38 through DVC application RS 40bforward the acknowledgment to Data Channel Control Object 66 of DVC application 42, steps 368 and 370. In response, Data Channel Control Object 70 triggers one last DataSendProgress event causing the Data Send Progress event handling procedure of DVC application 42 to be given control one last time to handle the event, step 372.
[0111] Next, DVC application RS 40b, through data management functions of GPPC application 38, sends a trailer to Computer B 12b, steps 374 and 376. In response, Data Channel Control Object 70 of DVC application 42 triggers a DataDoneSending event causing the Data Done Sending event handling procedure of DVC application 42 to be given control to handle the event, step 378.
[0112] Over on Computer B 12b, in response to the receipt of the trailer, data management functions of GPPC application 38, through DVC application RS 40bforward the trailer to the appropriate instance of Data Channel Control Object 70, steps 380 and 382. In response, Data Channel Control Object 70 triggers a DataDoneReceiving event causing the Data Done Receiving event handling procedure of DVC application 42 to be given control to handle the event, step 384.
[0113] Lastly, DVC application 42 on Computer A 12acloses a data channel by setting Action 92aof Data Channel Control Object 70 of DVC application 42 on Computer A 12ato Close, step 386. In response to the setting, Data Channel Control Object 70 requests DVC application RS 40bto close the corresponding logical data channel, step 386. In response, DVC application RS 40binternally deallocates the bound pair of Data/File Input/Output Channel Objects 140, step 388. Additionally, DVC application RS 40b, through data management services of GPPC application 38 notifies its remote counterpart of the closing of the logical data channel, steps 388 and 390. In the meantime, Data Channel Control Object 70 triggers a DataChannelClose event causing the Data Channel Close event handling procedure of DVC application 42 to be given control to handle the event, step 392.
[0114] Over on Computer B 12b*, in response to the notification, data management functions of GPPC application 38 notify DVC application RS 40b, step 394. In response, DVC application RS 40binternally severs the corresponding logical data channel from its bound pair of Data/File Input/Output Channels 140, step 396. DVC application RS 40bfurther notifies Data Channel Control Object 66, step 396. In response, Data Channel Control Object 66 triggers a DataChannelOpen event causing the Data Channel Open event handling procedure of DVC application 42 to be given control to handle the event, step 398.
[0115] FIG. 21 illustrates the runtime method steps for transferring a file from a local DVC application 42 to a remote DVC application 42. Except for the fact that the transfer is initiated by setting Action 98aof File Channel Control Object 72 of DVC application 42 on Computer A 12ato Send (as oppose to the employment of Data Send and Data Received Functions), the opening of a file channel, multi-block file transfer, and the closing of a file channel are all performed in similar manners as the opening of a data channel, multi-block data transfer, and the closing of a data channel, described earlier with reference to FIG. 20.
[0116] Thus, a method and apparatus for utilizing conferencing services of a GPPC application by a DVC application has been described. While the method and apparatus of the present invention has been described in terms of the above illustrated embodiments, those skilled in the art will recognize that the invention is not limited to the embodiments described. The present invention can be practiced with modification and alteration within the spirit and scope of the appended claims. The description is thus to be regarded as illustrative instead of restrictive on the present invention.
Claims
What is claimed is:
1. A computer system having a prepackaged object-oriented data and/or video conference (DVC) application programming toolkit (PK) for building customized DVC applications, wherein the DVC application PK includes a prepackaged connection control object whose instance is to be incorporated in the customized DVC applications being built for facilitating accesses to conferencing services of a general purpose personal conference (GPPC) application during runtime operation to allow a local incorporating customized DVC application having a local GPPC application to connect to another remote incorporating customized DVC application having a remote GPPC application, and to interactively manage the connection, the local incorporating customized DVC application and the remote incorporating customized DVC application being independent of and separate from the local and remote GPPC applications, wherein the local and remote incorporating customized DVC applications each respectively utilize the conferencing services of their respective local or remote GPPC application.
2. The computer system as set forth in claim 1, wherein the DVC application PK further includes a prepackaged local audio and video control object whose instance is to be incorporated in the customized DVC applications being built for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to interactively control capturing of local audio and video.
3. The computer system as set forth in claim 2, wherein the prepackaged local audio and video control object whose instance is to be incorporated in the customized DVC applications being built is further used for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to interactively control local rendering of the captured audio and video.
4. The computer system as set forth in claim 3, wherein the prepackaged local audio and video control object whose instance is to be incorporated in the customized DVC applications being built is further used for facilitating accesses to conferencing services of the GPPC application during operation to allow the local incorporating customized DVC application to interactively control provision of the captured audio and video to the connected remote incorporating customized DVC application.
5. The computer system as set forth in claim 1, wherein the DVC application PK further includes a prepackaged remote audio and video control object whose instance is to be incorporated in the customized DVC applications being built for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to interactively control local rendering of remote audio and video received from the connected remote incorporating customized DVC application.
6. The computer system as set forth in claim 1, wherein the DVC application PK further includes one or more prepackaged data channel control objects whose instances are to be incorporated in the customized DVC applications being built for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to open and close one or more data channels for the purpose of sending and receiving data to and from the connected remote incorporating customized DVC application.
7. The computer system as set forth in claim 6, wherein the one or more prepackaged data channel control objects whose instances are to be incorporated in the customized DVC applications being built is further used for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to send and receive data to and from the connected remote incorporating customized DVC application via the open data channels.
8. The computer system as set forth in claim 1, wherein the DVC application PK further includes one or more prepackaged file channel control objects whose instances are to be incorporated in the customized DVC applications being built for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to open and close one or more data channels for the purpose of sending and receiving files to and from the connected remote incorporating customized DVC application.
9. The computer system as set forth in claim 8, wherein the one or more data channels are to be incorporated in the customized DVC applications being built is further used for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to send and receive file s to and from the connected remote incorporating customized DVC application via the open file channels.
10. In computer system, a method for building customized DVC applications, the method comprising the step of:
(a) incorporating an instance of a prepackaged connection control object of a prepackaged object-oriented data and/or video conference (DVC) application programming toolkit (PK) into a customized DVC application being built responsive to a user request, the prepackaged connection control object comprising procedure(s) for facilitating accesses to conferencing services of a general purpose personal conference (GPPC) application during runtime operation to allow a local incorporating customized DVC application having a local GPPC application to connect to another remote incorporating customized DVC application having a remote GPPC application, and to interactively manage the connection, the local incorporating customized DVC application and the remote incorporating customized DVC application being independent of and separate from the local and remote GPPC applications, wherein the local and remote customized DVC applications each respectively utilize the conferencing services of their respective local or remote application.
11. The method as set forth in claim 10, wherein the method further comprises the step of (b) setting custom connection control property values of the incorporated prepackaged connection control object instance responsive to user inputs.
12. The method as set forth in claim 10, wherein the method further comprises the step of (b) associating customized event handling logic for handling custom events of the incorporated prepackaged connection control object instance responsive to user inputs.
13. The method as set forth in claim 10, wherein the method further comprises the step of (b) incorporating an instance of a prepackaged local audio and video control object of the prepackaged object-oriented DVC application PK into the customized DVC application being built responsive to the user request, the prepackaged local audio and video control object comprising procedure(s) for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to interactively control capturing of local audio and video, local rendering of captured audio and video, and provision of the captured audio and video to the remote incorporating customized DVC application.
14. The method as set forth in claim 13, wherein the method further comprises the step of (c) setting custom local audio and video control property values of the incorporated prepackaged local audio and video control object instance responsive to user inputs.
15. The method as set forth in claim 13, wherein the method further comprises the step of (c) associating customized event handling logic for handling custom events of the incorporated prepackaged local audio and video control object instance responsive to user inputs.
16. The method as set forth in claim 10, wherein the method further comprises the step of (b) incorporating an instance of a prepackaged remote audio and video control object of the prepackaged object-oriented DVC application PK into the customized DVC application being built responsive to the user request, the prepackaged remote audio and video control object comprising procedure(s) for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to interactively control local rendering of remote audio and video received from the remote incorporating customized DVC application.
17. The method as set forth in claim 16, wherein the method further comprises the step of (c) setting custom remote audio and video control property values of the incorporated prepackaged remote audio and video control object instance responsive to user inputs.
18. The method as set forth in claim 16, wherein the method further comprises the step of (c) associating customized event handling logic for handling custom events of the incorporated prepackaged remote audio and video control object instance responsive to user inputs.
19. The method as set forth in claim 10, wherein the method further comprises the step of (b) incorporating an instance of a prepackaged data channel control object of the prepackaged object-oriented DVC application PK into the customized DVC application being built responsive to the user request, the prepackaged data channel control object comprising procedures for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to open and close one or more data channels for the purpose of sending and receiving data to and from the connected remote incorporating customized DVC application.
20. The method as set forth in claim 19, wherein the method further comprises the step of (c) setting custom data channel control property values of the incorporated prepackaged data channel control object instance responsive to user inputs.
21. The method as set forth in claim 19, wherein the method further comprises the step of (c) associating customized event handling logic for handling custom events of the incorporated prepackaged data channel control object instance responsive to user inputs.
22. The method as set forth in claim 10, wherein the method further comprises the step of (b) incorporating an instance of a prepackaged file channel control object of the prepackaged object-oriented DVC application PK into the customized DVC application being built responsive to the user request, the prepackaged file channel control object comprising procedures for facilitating accesses to conferencing services of the GPPC application during runtime operation to allow the local incorporating customized DVC application to open and close one or more file channels for the purpose of sending and receiving data to and from the connected remote incorporating customized DVC application.
23. The method as set forth in claim 22, wherein the method further comprises the step of (c) setting custom file channel control property values of the incorporated prepackaged file channel control object instance responsive to user inputs.
24. The method as set forth in claim 22, wherein the method further comprises the step of (c) associating customized event handling logic for handling custom events of the incorporated prepackaged file channel control object instance responsive to user inputs.
Patent Citations (17)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5452299(A) | 1995-09-01 | Thessin et al. | Examiner |
| US5544302(A) | 1996-08-01 | Nguyen | Examiner |
| US5572582(A) | 1996-11-01 | Riddle | Examiner |
| US5594859(A) | 1997-01-01 | Palmer et al. | Examiner |
| US5619555(A) | 1997-04-01 | Fenton et al. | Examiner |
| US5717863(A) | 1998-02-01 | Adamson et al. | Examiner |
| US5724508(A) | 1998-03-01 | Harpleet al. | Examiner |
| US5737530(A) | 1998-04-01 | Kukkal et al. | Examiner |
| US5754775(A) | 1998-05-01 | Adamson et al. | Examiner |
| US5754776(A) | 1998-05-01 | Hales et al. | Examiner |
| US5794018(A) | 1998-08-01 | Vrvilo et al. | Examiner |
| US5802282(A) | 1998-09-01 | Hales, II et al. | Examiner |
| US5805830(A) | 1998-09-01 | Reese et al. | Examiner |
| US5828838(A) | 1998-10-01 | Downs et al. | Examiner |
| US5852807(A) | 1998-12-01 | Skarbo et al. | Examiner |
| US5854898(A) | 1998-12-01 | Riddle | Examiner |
| US5918051(A) | 1999-06-01 | Savitzky et al. | Examiner |
Non-Patent Literature (16)
- Burke, John P., Communique! Sends a Message about Video Conferencing, HP Professional,v8,n 10,p.20(1) Oct. 1994.Applicant
- Frye, Colleen, Talking Heads: Coming to a Desktop Near You, Software Magazine,v15,n5,p.69(5), May 1995.Applicant
- Nye(1) et al, X Tollkit Intrinsics Programming Manual, O'Reilly & Assoc., p. 508, Jan. 1990.Applicant
- Nye(2) et al, Xlib Programming Manual, O', Reilly & Assoc., p. 249-250, 441-442, Dec. 1992.Applicant
- Roseman, Mark et al. “GroupKit, A Groupware Toolkit for Building Real-Time Conferecign Applications”. ACM Nov. 1992, pp. 43-50.Applicant
- Gajewska, Hania et al. “Argo: A System for Distributed Collaboration”. ACM Oct. 1994, pp. 433-440.Applicant
- Aguilar L. et al. “Architecture for a Multimedia Teleconferencing System”. ACM. 1986, pp. 126-136.Applicant
- Anderson et al. “COMET: A Toolkit for Multiuser Audio/Video Applications.” IEEE 1992.Applicant
- Jeffay et al. “System Design for Workstation-Based Conferencing With Digital Audio and Video.” IEEE. 1991.Applicant
- Teege et al. “Integrating Access and Collaboration for Multimedia Applications.” Proc. of the East-West Int. Conf. on Multimedia, Hyptermedia, and Virtual Reality. 1994.Applicant
- Craighill, Earl et al. “SCOOT: An Object-Oriented Toolkit for Multimedia Collaboration.” ACM. 1994.Applicant
- Mines, Robert F.et al. “DAVE: A Plug and Play Model for Distributed Multimedia Application Development”. ACM. 1994.Applicant
- Zikos, M. et al. “CoMed: Cooperation in Medicine.” EuroPACS'96. Oct. 3-5, 1996.Applicant
- Crowley, Terrance et al. “MMConf: An Infrastructure for Building Shared Multimedia Applications.” CSCW 90 Proceedings. Oct. 1990.Applicant
- Roseman, Mark et al. “Building Real Time Groupware with GroupKit, A Groupware Toolkit.” Jul. 1995.Applicant
- Rodriquez, Karen. “Microsoft signs on to T.120 data conferencing standard.” Infoworld; Feb. 27, 1995.Examiner