US 5,802,283 AGrant
Method and System for Accessing Multimedia Data Over Public Switched Telephone Network
Issue Date:1998-09-01
•14 Claims
•8 Drawing Sheets
Abstract
A public switched telephone network for providing information from a multimedia information server to any one of a plurality of subscriber premises, comprises a central office receiving multimedia information signals from a multimedia information server and orders from a prescribed subscriber. The central office includes a gateway system for conveying routing data in response to subscriber orders and a switch for routing multimedia signals from the server to the prescribed subscriber in accordance with the routing data. An interface at the central office transmits and receives audio telephone service signals, subscriber control signals and digital multimedia information signals on first, second and third signal channels. Each subscriber premises includes an interface for transmitting and receiving audio telephone service signals, subscriber control signals and digital multimedia information signals on the three signal channels. A plurality of subscriber local loops interconnect each subscriber interface and the central office interface. Multimedia information is collected from information providers and stored at media servers that provide a library of data and control sessions. Software modules at the media servers and resident terminals enable interactive multimedia session building, sharing of databases and joint authoring of multimedia presentations.
Metadata
Assignee
- Bell Atlantic Network Services, Inc.
Inventors
- John Grady
- Kenneth Hand
- John Modrowsky
- Arthur A. Richard, III
Application Information
Application Number:US 6237614
Filing Date:1996-03-29
Priority Date:1991-09-27
Art Unit:237
Classifications
IPC:
G06F 1300G06F 1314
Field of Search:
395364348370379200;200.12;200.11;610401;222.27;1;617;8853;96;399
Patent Drawings (8 sheets)
Description
Technical Field
The invention relates to data distribution using the Public Switched Telephone Network (PSTN), and, more particularly, to distribution of multimedia data to subscribers over a PSTN.
Background Art
Advances in personal computer capabilities have created increased demands on data base sources to supply information to households and business. Corresponding increases in data availability, storage, retrieval and transmission capabilities have supported multimiedia data presentation of information. Multimedia presentations include, in addition to conventional text, still-images, animation, slow and fast scan video, and graphics format visual presentations. Multimedia also includes sound data presented together with, or independent of, one or more visual presentations. A multimedia presentation can range from the equivalent of an electronic book including plain text in combination with still images to full motion video presentations of feature movies. Thus, multimedia spans a wide spectrum of data storage, retrieval and transmission requirements to present information in various formats to system subscribers.
Considerable potential exists to improve the availability of multimedia service to the public. One example is in education. Several segments of society find themselves remote from learning resources. Educators have traditionally tried to find a way to overcome the limitations imposed by physical distance, on one hand by using school buses to transport people and on the other by employing telecommunications to transport information. However, physical distance remains a barrier to education despite numerous experiments and studies to solve the problem. Known proposals to implement multimedia information transmission over the public service telephone network have not yet been successful, in part by the limited bandwidth of telephone cable and the unavailability of adequate technology to support copper based multimedia information transmission. Broad bandwidth transport is necessitated not only by the need to carry good quality video information from an information provider to the student, but subscriber control signals and ordinary telephone service as well.
Although optical fiber is capable of providing sufficient bandwidth, even optimistic projections of installation of fiber in the local loop expect only modest market penetration by the turn of the century and ubiquity many years after that. This invention implements the public switch telephone network (PSTN) to carry out transport of multimedia information from one source or multiple sources to a subscriber over a single loop in the form of copper wire or other medium, including fiber, to help remove distance as a barrier to information transfer at affordable cost.
Disclosure of the Invention
According to one aspect of the invention, a public switched telephone network for providing information from a multimedia information server to any one of a plurality of subscriber premises comprises a telephone company central office receiving multimedia information signals from a multimedia information server and orders from a prescribed subscriber. The central office includes a gateway system for providing routing data in response to subscriber orders and a switch for routing multimedia signals from the server to the prescribed subscriber in accordance with the routing data. An interface at the central office includes a first multiplexer/demultiplexer for transmitting or receiving audio telephone service signals, subscriber control signals and digital multimedia information signals on first, second and third signal channels. Each subscriber premises includes an interface having a second multiplexer/demultiplexer for transmitting or receiving audio telephone service signals, subscriber control signals and digital multimedia information signals on the three signal channels. The interface may incorporate frequency multiplexing/demultiplexing so that the three channels are displaced from each other in frequency. A plurality of subscriber local loops interconnect each subscriber interface and the central office interface. Preferably, the central office interface comprises a plurality of interfaces, one for each subscriber.
In accordance with the preferred embodiment, the first channel is a bidirectional channel carrying audio telephone service signals between the subscriber and central office. The second channel is a bidirectional channel carrying subscriber control signals to the central office and possibly response signals from the central office, and the third channel is a unidirectional channel carrying digital multimedia information signals from the central office to the subscriber. The local loops preferably comprise copper pair wiring, although optical fiber is another possibility.
Furthermore, the subscriber interface may include a decoder for converting an incoming digital multimedia information signal to an analog signal having a video component. The decoder decompresses the incoming multimedia signal and produces analog video and associated audio output signals. Alternatively the multimedia information may incorporate uncompressed digital signals applied directly to a digital terminal, such as a personal computer.
In accordance with a particular aspect of the invention, the central office further includes a packet data network responsive to the gateway system for supplying command signals to the multimedia information server. Digital multimedia information storage, remote from the subscriber premises, buffers multimedia information and supplies the same to the central office interface.
In the preferred embodiment of the invention, the multimedia information server comprises a subscriber request processing means, responsive to subscriber request data, for supplying information request data and a session control means, responsive to the information request data, for supplying information retrieval data and output control data. Also included in the server are a data storage means, preferably comprising plural types of storage media, responsive to the information retrieval data for supplying program data and an output control means, responsive to the output control data, for supplying the multimedia information.
Another aspect of the invention involves interaction between subscribers and sources of multimedia information. In accordance with the preferred embodiment, the multimedia server system comprises a number of data bases that are transparently shared by a subscriber. When the subscriber queries a principal data base containing multimedia information and does not find the information sought, other data bases sharing resources either through the gateway system or outside the gateway, are searched.
A further aspect involves multiple subscriber interaction with the multimedia servers. Groupware functionality incorporated in subscriber resident software enables subscribers to share a session and thereby mutually contribute to a multimedia joint presentation.
Various objects and advantages of the present invention will become readily apparent to those skilled in this art from the following detailed description, wherein only the preferred embodiment of the invention is shown and described, simply by way of illustration of the best mode contemplated of carrying out the invention. As will be realized, the invention is capable of other and different embodiments, and its several details are capable of modifications in various obvious respects, all without departing from the invention. Accordingly, the drawing and description are to be regarded as illustrative in nature, and not as restrictive.
Brief Description of Drawings
FIG. 1 is a system diagram of a PSTN incorporating flow of multimedia information from a source to a subscriber, in accordance with the invention.
FIG. 2 is a simplified block diagram of a media server, according to the invention.
FIG. 3 is a more detailed block diagram of the media server of FIG. 2.
FIG. 4 is a block diagram of multimedia information storage facilities of the media server.
FIG. 5 is a functional diagram of a subscriber interface unit.
FIG. 6 is a spectrum diagram showing channelization of a local loop by the interface unit.
FIG. 7 shows a typical in-the-home configuration providing video transported over a 1.544 MBPS channel overlaid, with standard telephone service signaling.
FIG. 8 is a block diagram of the interface unit in the form of an asymmetrical digital subscriber line (ADSL) system providing simplex high-bit-rate access and POTS on a common copper loop.
FIG. 9 is a diagram depicting interaction among server, data base and subscriber software modules, in accordance with the invention.
FIG. 10 shows the fundamental architecture of software for performing communications between the central office and subscribers sharing in a multimedia session.
Best Mode for Carrying Out the Invention
Overview
The digital multimedia information service platform shown in FIG. 1 is of an architecture similar to the type described in copending application Ser. No. 07/766,535, filed on Sept. 27, 1991 and entitled PSTN ARCHITECTURE FOR VIDEO-ON-DEMAND SERVICES, incorporated by reference, modified herein to accommodate delivery of multimedia services to subscribers that include home and institutional (e.g., school) subscribers at terminals 100 and 120, respectively. The architecture for multimedia delivery, in accordance with the invention, includes four main components: at least one multimedia server 162, a gateway system 32, a central office (CO) 10 based transmission system and the-subscriber terminals. The multimedia server 162 stores compressed multimedia presentations in the form of data files received from providers of multimedia information (not shown) that may reside outside the CO 10. Encoded multimedia data is stored on the multimedia server 162, in for example, digital magnetic tape or digital cassette format, at the CO 10. The server 162 may alternatively be external to the CO 10. The data may be electronically buffered for transmission over a POTS line to the subscriber.
The gateway system 32 performs two main functions. It controls access to the multimedia server 162 and originates the control messages to set up a high speed link between the servers and subscriber terminals via the transmission system. The multimedia file server system 162 handles requests received from the gateway system 32 through a packet data network 40 and provides a multimedia file feed to the subscriber via the network link. The server is a file management system responsible for inputting multimedia files from providers, storing these files or passing the real-time data through to the subscriber, keeping track of sessions, handling all interactive control requests from the subscriber, and controlling all outputs.
The transmission system uses a transmission medium of optical fiber or of telephone cable carrying separate channels of audio telephone service, single direction subscriber control signals and multimedia signals, multiplexed/demultiplexed at central office and subscriber interfaces. Alternatively, a public switched telephone network coupled with a Public Data Network (PDN) or an Integrated Services Digital Network (ISDN) may be used. Data can be packetized in the PDN and transmitted to the gateway system 32. When ISDN is used, the data are packetized in the subscriber terminal itself, which preferably is in the form of a-personal computer. The data alternatively may be synchronized data.
Utilizing a communications application program in the terminal, the subscriber sets up a connection to the gateway system 32. The gateway 32 validates the subscriber through a log-in sequence and presents a menu of available multimedia presentations or other forms of data from which the subscriber can choose. When a choice has been made, the gateway system 32 provides the multimedia server 162 with the selection information and the network address of the subscriber. The server assigns a spare port over which it will transmit the information and passes identification of this port back to the gateway. The gateway 32 combines the port identification with the customer identification, and passes both pieces of information via network 40 to a digital cross connect (DCC) management system 26, which controls cross connect switch (DCS) system 24 to set up a temporary connection between the relevant input and output ports. When the connection has been established, the subscriber may interact with the multimedia application by sending commands to the multimedia server 162 and receiving responses at the subscriber's terminal or work station. The server 162 may, if necessary, access information from another multimedia server to satisfy a particular request for information.
The multimedia presentation can be full motion video, text, graphics, animation, audio information, etc. Alternatively, the complete multimedia presentation may be transferred to the subscriber terminal where it will be stored locally in a high capacity storage device. All interactions between the subscriber and the multimedia presentation will then occur locally at the subscriber terminal. Through use of resource sharing programming, subscribers can share a session, jointly accessing the server and authoring a multimedia presentation, a capability particularly useful to students.
The platform adopts existing components of the Public Switched Telephone Network (PSTN) and implements compression techniques to store multimedia information for subsequent forwarding over interoffice facilities. The switching facilities are located in central offices serving residential subscribers. Loop electronic devices modify the transmission characteristics of the local copper loop to provide required enhancement to the PSTN and permit delivery of full multimedia information.
High data rate types of multimedia data are encoded to conserve system resources. For example, analog information is first converted to a digital format and then compressed using, for example, encoding algorithms standardized by the International Standards Organization (ISOs) Motion Picture Experts Group (MPEG). Another example is the JPEG standard for images. Each title comprises information stored by a media server as an addressable data file in conventional data processing devices functioning as a video library. Establishing and monitoring connections which link a library port transmitting selected information with the end subscriber ports that receive the information are performed by a supervisory controller such as a network control system, e.g., FLEXCOM (TM) software, used to control an electronic digital cross-connect switch system 24 in the PSTN. The DCS 24, also used for switching two-way DS-1 rate transmissions, is adapted to additionally provide bridging or broadcast of multimedia information to several subscribers.
Subscriber local loops having ends equipped with asymmetric digital subscriber line (ADSL) devices 18, 124 are connected to the DCS 24. The multimedia distribution system provides for the simultaneous transport of a one-way 1.544 megabit per second (MBPS) signal over the same twisted pair transmitting voice messages to the residential subscriber. The ADSL transported signal is demultiplexed and the 1.544 Mbit portion is then decoded using appropriate standard techniques to deliver a multimedia information signal.
It can be anticipated that fiberoptic technology will replace existing coaxial and twisted pair connectivity with corresponding enhancements made to switching and routing equipment in the PSTN. Hence, with reference to FIG. 1, assume the subscriber is a school or other site having multiple student terminals, as at institutional site 100. Connectivity from the multimedia server on optical fiber may be multiplexed to student terminals on separate DS1 channels (not shown). Each student will communicate with the server through a personal computer to develop a multimedia presentation. As will be described later, in accordance with an aspect of the invention students are enabled to share a common session with the server, or with multiple servers.
PSTN Architecture
Referring now to FIG. 1 in more detail, PSTN central office (CO) equipment 10 provides connectivity from information providers (not shown) to media server system 162 and subscribers 100 and 120. CO 10, which may but not necessary is telephone company central office equipment, includes a conventional voice switch that includes conventional elements to detect off-hook, service requests, call completion (i.e., ring trip), a DTMF decoder and dial pulse detector. The voice switch also includes a telephone call connection switch for routing voice circuits among the various ports. These elements are all conventional.
An institutional or residential subscriber at premises 100, 120 is connected to the CO 10 through an interface consisting of an asymmetrical digit subscriber line (ADSL) system. The ADSL system comprises a pair of ADSL devices 124 and 18 on the subscriber and CO ends of the subscriber loop 20 for multiplexing (i) voice and signaling information from the CO voice switch and (ii) digital multimedia data from DCS 24.
In addition to providing multimedia programming, the server system 162 accepts multimedia programming from multimedia information providers for later transmission.
ADSL system 18, 124 multiplexes data on subscriber loop 20 using frequency domain multiplexing, dividing the available loop bandwidth into multiple segments or channels. However, other types of multiplexing, such as time domain (TDM), are possible. Base band audio and signaling below 4 kilohertz (kHz) provides connectivity for a conventional telephone services available on the "plain old telephone system" (POTS). Alternatively, ISDN channel requirements consume the bottom 80 kHz of loop bandwidth. Reverse channel digital packet information is positioned between 80 and 90 kHz providing approximately 16 kilobits per second (kbps) connectivity from the subscriber premises to a packet switched network such as ISDN network 12 over a D-channel interface. Compressed multimedia data is contained between 100 and 400 kHz to provide a 1.6 MBPS channel for transporting the multimedia data over subscriber loop 20 to premises 100/120.
ADSL 18 carries out error correction and, as shown in FIG. 6, divides the available loop bandwidth into three channels 302, 304 and 306. Base band audio and signaling below 4 kilohertz (kHz) provide connectivity for a conventional telephone services available on the "plain old telephone system" (POTS). Alternatively, ISDN channel requirements consume the bottom 80 kHz of loop bandwidth. Reverse channel digital packet information, centered on 95 kHz., provides 8 kilobits per second (kbps) of handshaking protocol between the subscriber- and CO-side ADSLs 124 and 18 to test the copper pair transmission path, and approximately 16 kbps connectivity from the subscriber premisses to a packet switched network, such as the ISDN network over a D-channel interface. The 16 kbps signal is stripped by the ADSL 18 and sent to the CO 10. Compressed digital video information is contained within the frequency range of about 100 and 500 kHz to provide about a 1.6 mbps (1.544 mbps) channel for transporting video/audio data over loop 20 to subscriber premises 120.
The frequency channel represented by segment 302 in FIG. 6 thus establishes a 2-way channel used to provide standard POTS service or ISDN (2B+D) service over the subscriber loop 20. Channel 304 is an up-stream only (subscriber to CO), low speed data channel. 8 kbps of this channel are used for transfer of operations, administration, maintenance, and provisioning (OAM&P) data for the ADSL unit. Optionally, the channel may provide response messages or the like from the CO, and hence, may be considered a bidirectional channel. The remaining 16 kbps, compatible with X.25 or D channel interfaces of BRI-ISDN, is used to interface with a packet switch allowing the subscriber to interact with the network and/or the 1.544 mbps signal provider.
Channel 306 carries a down-stream only (CO to subscriber) digital signal providing 1.544 mbps transport (1.6 mbps with overhead) for carrying the digitized compressed video signal. The lower edge of channel 306 is set at 120 kHz., chosen to minimize channel loss and allow appropriate bandwidth for base band channel 302 and reverse channel 304 and to minimize interference from impulse noise. The combined digital down-stream signal utilizes the DS1 bit map specified by ANSIT1.403-1989.
Because data channels 304 and 306 are unidirectional (although channel 304 optionally may be operated bidirectionally, as mentioned above), the system does not experience self-NEXT (near end cross-talk). This allows concentration on the interface and interference from impulse noise because the ADSL system is loss-limited rather than NEXT limited. Impulse noise exposure can be reduced by using a pass band technique as opposed to a base band approach since impulse noise affects are greatest below 40 kHz. Therefore, a modulation technique such as Quadrature Amplitude Modulation (QAM) is preferred over a 2B1Q base band system.
ADSL multiplexer 200 shown functionally in FIG. 5, within each ADSL unit 18, 124, supports transmission of a one-way 1.544 mbps digital signal along with a POTS or a BRI-ISDN signal over a single non-loaded copper pair. This configuration provides service to a customer over copper loop lengths of up to 18,000 feet, conforming with Carrier Serving Area (CSA) and resistance design rules. Discreet multi-tone is an alternative.
The ADSL system (the hardware block diagram is shown in more detail in FIG. 8) provides simplex high-bit-rate video data and POTS connectivity to a subscriber over a common copper loop with transport capability to deliver a one-way high-bit-rate data stream with POTS or ISDN basic access multiplexed at baseband. Each ADSL on the subscriber- and CO- sides includes an error correction circuit 21 implementing an error correction algorithm, such as the Reed-Sullivan algorithm, for correcting errors that arise as a result of transmission of data on a twisted pair of copper lines. The subscriber- and CO-side ADSLs on opposite ends of the twisted copper pair carry out "handshaking" while implementing the algorithm to reduce error in the video signal to a minimum.
The multiplexer 200 residing in each subscriber-side ADSL includes, in addition to a frequency converter for channelizing the incoming signal into 1.544 Mbps, 16 Kbs and 8 Kbps components, a splitter/filter (not shown) for separating the standard POTS signal from the multimedia composite. Hence, the multimedia component incoming on the twisted copper pair is transparent to a standard phone resident on the line at the usual network interface device (NID).
Subscriber and CO ADSL interface units 124 and 18 are synchronized to ensure that both subscriber and CO side units derive timing from one master clock to prevent data loss. Preferably, the units derive timing from the incoming 1.544 mbps signal. Subscriber end ADSL equipment is powered locally from the customer premises; CO end ADSL equipment is preferably powered by an external source of DC input voltage in the range of between -42.5 and -55 VDC.
FIG. 7 shows a typical in-the-home configuration which provides multimedia information transported over the 1.544 mbps channel. The unidirectional 1.544 mbps signal carried by the ADSL system has either a Superframe Format (SF) or an Extended Superframe format (ESF). The Superframe format consists of 24 consecutive 8-bit words preceded by one bit, called the framing bit (F-bit), for a total of 193 bits per frame. The F-bit is time-shared to synchronize the ADSL interface equipment and to identify signaling framing. Twelve consecutive frames form a Superframe. A line code used with a Superframe format is bi-polar return-to-zero, also known as Alternate Mark Inversion (AMI).
The ESF format consists of 24 consecutive frames, each of which includes 192 information bits preceded by 1F-bit for a total of 193 bits per frame. The F-bit is used for basic frame synchronization, a cyclic redundancy check and a data link. Twenty-four frames form a Superframe. The line code used with the ESF is either AMI, bi-polar 8-zero substitution (B8ZS), or AMI with Zero-Byte Time Slot Interchange (ZBTSI).
Media Server System The media server system 162, shown in further detail in FIGS. 2-4. processes all requests from gateway system 32 for providing multimedia and video file feeds to customer premises via the DCS and ADSL systems. The media server system performs input of video and other information files from multimedia information providers, stores these files, monitors and records subscriber sessions, processes all interactive control requests from subscribers, and controls all outputs to the subscribers.
The media server system 162 also processes and supplies multimedia services including interactive learning, interactive games, and other presentations. The server stores and processes all data required for the multimedia applications including text, still pictures, audio, and partial and full motion video, as well as interactive application scripts.
Media server system 162 includes eight major components shown in FIG. 2: input device 210, Q.931 interface 230, librarian 250, storage manager 270, session manager 320, output controller 310, interactive processor 350 and multimedia application processor 370. Input device 210 includes a plurality of DS-3 Input ports 212 or other input devices for receiving multimedia data including encoded digital video signals. Alternatively, the data may be supplied from a magnetic tape or the like source of stored data. Multimedia information in MPEG or other standard of encoded format is supplied to output controller 310 or to gateway interface 410 (FIG. 3) to be routed to session manager 320 for eventual storage by the server system.
The network control software of the media server in combination with management resources of the PSTN controls the "network session" between an output controller 310 of the media server and subscriber ports. The session manager 320 also maintains a record of relevant data regarding each session which is forwarded to a customer billing system.
Q.931 interface 230 provides connectivity between interactive processor 350 and ISDN Interface 12 (FIG. 1). Interactive processor 350 includes a user control monitor 352 and a control channel filter 354. Interactive processor 350 receives command data over the ISDN from subscribers running interactive programming from the media server. Interactive programs include multimedia presentations. The interactive processor 350 also receives command data from the subscriber for interactive control of multimedia applications and data objects. These commands are passed to session manager 320 for further processing and control of multimedia programming.
Data to be stored in or retrieved from memory is first routed through librarian 250 and, under its control, storage manager 270 either stores the program data or retrieves and provides previously stored program data to output processor 330.
Media librarian 250 controls distribution of video, audio, still image data and text selections to session manager 290 in response to information requests from the session manager and multimedia application processor 370 that includes an application script and a multi-media tool kit. Referring to FIG. 3, the librarian further monitors and record in feature index 252 the storage location of all video selections for multimedia applications. The librarian also records a history of access to multimedia information provided during each prescribed, e.g., twenty-four hour period in usage data accumulation system 260. The usage data is supplied to usage probability processor 262 to establish an intelligent cache using DRAM storage 278 for rapid access and highly addressable storage of features.
Feature indexes 252 maintain a catalog of data and support processing for storing all locally stored multimedia information. This includes the allocation of storage media type and space, maintenance of addressing tables for program stat and frame indices, and indexes for all volumes. The program listing data is supplied to a menuing system supported by gateway 32 (FIG. 1) via packet data network 40.
Feature indexes system 252 performs required catalog maintenance functions including input of new multimedia information into the system. The catalog maintenance system determines the priority of the incoming multimedia data and allocates appropriate storage to the data. Once the file space is allocated and the file is stored, the volume indexes are updated, the frame positions of the program are calculated and frame addressing tables are created and stored. The frame addressing tables are used to address multimedia information or a data object from any position in the multimedia production.
When it is determined that stored multimedia production is no longer required, media librarian 250 removes the program data from the file catalog. The record to be deleted is then flagged by the system administrator.
The catalog system updates multimedia data as the multimedia productions are loaded into the media server. The updated catalog information is supplied by librarian 250 of the media server to gateway 32.
Storage channel management processor 274 controls the flow of data between all storage devices and output control processor 330. Input control processor 210 receives multimedia data from the multimedia information providers. Multimedia data input is accepted as appropriately encoded multimedia information. All data is stored for play at a subscriber's request.
Session manger 320 includes a session trace 314, a VIP supervisor, a network optimizer and a session supervisor 312. The session supervisor 312 which manages all program sessions including system access by multimedia subscribers and input and output to, from and through the media server by multimedia information providers. Session supervisor 312 tracks and records all data considered pertinent to a subscriber's session including output port, multimedia data being played or multimedia application address, feature index data, feature frame data, and session condition.
Session supervisor 312 maintains a matrix of routing information for each session, including what subscribers are assigned to a given output port, and the source of the input data, that is, the input port of local storage. A file play clock uses the total number of frames in a given feature to estimate, by time, the frame position for that feature. This data is provided to the session registers for tracking frames for each logical subscriber session and is used to restart an interrupted session. Session supervisor 312 discontinues register updates upon detection of a session interruption.
The session supervisor also receives all requests from gateway 30 via Q.931 interface 230 and control channel filter 354 to establish a session and for file retrieval.
Interactive processor 350 processes incoming commands from subscriber sites once a session is established by the gateway. These commands include requests by multimedia work stations. The incoming data is interrogated for content and selectively forwarded to the appropriate module for processing, that is, the multimedia application processor for multimedia applications.
Control channel monitor 352 monitors each subscriber's control channel to detect a communication failure. In the event of a failure, session manager 320 is informed and corrective action is initiated.
Communications Software
FIG. 9 shows the software architecture for setting up communications between the subscriber terminals and the gateway, in accordance with the preferred embodiment. There are two principal programming modules: a server resident module 500 and a subscriber module 502 resident at customer premises equipment, interconnected with each other through DS-1 and/or ISDN channels. Within the server resident program module 500 is a resident database for storing multimedia information derived from the media server, an interface to the gateway system 32 and control software for controlling playback of session information at the terminal. An additional general utility communication program enables dialogue to be carried out between the subscriber and server, or between subscribers cooperating in a session.
The CPE resident software contains counterpart database, control (playback) and gateway interface software. The CPE control software will respond to subscriber commands, such as the commands generated by the position of a mouse, to send a command signal to the server. The server, in turn, will interpret the command signal and transmit appropriate multimedia information on the DS-1 channel to the subscriber. In this regard, the server reads the command signal, customizes or interprets it in view of the session being conducted, and makes a decision as to what next piece of multimedia information should be presented. The resident software loads the segments of information to be sent to the subscriber into a buffer, notifies the subscriber software that the next screen is ready to be downloaded, and the multimedia information sent. The purpose of the buffer is to enable construction of a seamless multimedia session composed of multiple data files that are assembled in sequence.
Through interactive communication with the server, the subscriber is able to redirect the multimedia session at each logical branch. The subscriber supplies the various control signals to create a multimedia performance to the authoring software module that recreates a new copy of a series of old multimedia information elements. The resulting copy is saved at the server and may be accessible to other subscribers, with certain constraints, under control of a system administrator.
Alternatively, a multimedia presentation may be comprised of multiple multimedia elements that are stored in a number of buffers within the server and indexed by a script stored at the subscriber terminal playback module for each presentation. The buffer size at the server memory is dependent on the amount of time required to access the data base and retrieve the elements, and to process the elements for delivery to the subscriber. Decision alternatives available to the subscriber during an interactive session are sent by the server to the playback unit of the subscriber. The playback module in the resident software thus includes the script itself and portions of the script. For each decision point, queuing information is provided to the server so that the server can ready other presentations while the selection of the next presentation is still carried out at the subscriber terminal. For example, four selections may be queued to the subscriber, and the playback module is controlling a particular one to play out.
If the media server is found not to contain a particular piece of information sought by the subscriber, the gateway system 32 is notified by the server, and other databases may be automatically searched for the required information. These databases may be resident at different media servers.
Alternatively, the subscriber may be notified of the failure of the media server database to satisfy the current information request and the subscriber given an option to search other data bases within a single media server, at another server of the media server system or outside the server system. As another alternative, other databases, broadband channeled to the media server outside the gateway system, may be searched. Intercommunication between data bases may be performed on a switched DS-3 line implementing a broadband gateway system, as shown in FIG. 9, or within an synchronous transfer mode (ATM) environment.
Although a multimedia authoring session ordinarily will involve one subscriber at a time, it is possible to enable multiple subscriber terminals to share a session using known "groupware" software at the subscriber terminals, as shown in FIG. 10, or communication software such as Rainbow(TM) or PC Anywhere(TM). Alternatively, the subscribers may coauthor a multimedia presentation using two B-channels of ISDN, a separate ISDN line using a second ISDN communication board or E-mail communication between subscribers operating a common session. This enables students to jointly author a multimedia presentation, and other forms of teaming efforts to be carried out.
As still another possibility, video communications may be established between server and subscriber terminals or between subscribers. For example, subject to federal regulations, a video camera may be provided at one subscriber terminal at a classroom, and video signals sent to a second terminal where an instructor resides to enable an instructor to view students during an interactive session.
The server resident software monitors the amount of time a subscriber is on line, and together with the gateway system, performs billing operations. If the subscriber remains on line for more than a prescribed amount of time without sending any command signals to the server, the server automatically drops the line, and is free to service other subscribers. However, when the subscriber next sends a command signal, the link between the server and subscriber is automatically reestablished.
Although the present invention has been described and illustrated in detail, it is clearly understood that the same is by way of illustration an example and is not to be taken by way of limitation, the spirit and scope of the present invention being limited only by terms of the appended claims. As one example, although the network, as described, implements an ISDN interface 12, as shown in FIG. 1, an X.25 interface is an alternative. As another, although all three channels, POTS, command and video are preferably multiplexed or a common transmission medium, as described, it is also possible within the scope of this invention, to transmit and/or receive at lease one of the channels on a separate medium, such as a cellular link.
Claims
What is claimed is:
1. A multimedia information server for providing compressed digital multimedia information over a public switched telephone network comprising: an input device for receiving multimedia data; a multimedia storage system for storing multimedia information and supplying said multimedia information in response to information retrieval data; a storage manager for managing said multimedia information stored in said multimedia storage system; a multimedia application processor for processing said multimedia information stored in said multimedia storage system; a librarian for controlling said storage manager, said input device and said multimedia application processor; a session manager, responsive to information request data, for supplying information retrieval data and output control data and for controlling communication sessions; an output controller, responsive to output control data, for supplying multimedia information; an interface having an external connection, responsive to subscriber request data, for supplying information request data; and an interactive processor, connected to said session manager, said multimedia application processor and said interface, for causing multimedia information to be processed in accordance with control signals received via said interface; wherein said librarian comprises feature indexes and a frame index, a usage data accumulation circuit, a usage probability processor, a real time MPEG encoder, and a multi-pass MPEG encoder.
2. A multimedia information server as recited in claim 1, wherein said multimedia storage system comprises plural types of storage media and supplies program data.
3. A multimedia information server as recited in claim 1, wherein said server supplies digital multimedia information from a plurality of databases that are transparently shared by a subscriber and includes a query processor which, when said subscriber queries a principal database of said plurality of databases containing multimedia information and does not find the information sought, searches secondary databases of said plurality of databases.
4. A multimedia information server as recited in claim 1, wherein said interactive processor is responsive to signals from groupware incorporated within subscriber resident software which enables multiple subscriber interaction and enables subscribers to share a session and thereby mutually contribute to a multimedia joint presentation.
5. A multimedia information server as recited in claim 1, wherein said interactive processor comprises a user control channel monitor and a control channel filter.
6. A multimedia information server as recited in claim 1, wherein said multimedia application processor comprises an application script and a multimedia tool kit.
7. A multimedia information server as recited in claim 1, wherein said storage manager comprises, a storage channel management circuit and a plurality of memory controllers, respectively corresponding to a plurality of types of storage media.
8. A multimedia information server as recited in claim 1, wherein said multimedia information server establishes communications with an interface in a subscriber terminal to initiate an interactive multimedia session for transmitting and receiving compressed multimedia information therebetween and interprets command signals transmitted from said interface, in view of the interactive multimedia session being conducted, in order to create information request data and to transmit digital multimedia information corresponding to said information request data to said subscriber terminal.
9. A multimedia information server as recited in claim 3, wherein said query processor searches secondary databases of said plurality of databases through a gateway system.
10. A multimedia information server as recited in claim 7, wherein said plurality of types of storage media comprise archival tapes, high speed tape storage units, disk storage units, and DRAM storage and wherein said plurality of memory controllers comprises an archival tape controller, a high speed tape controller, a disk controller, and a DRAM storage controller.
11. A multimedia information server as recited in claim 8, wherein one of said command signals comprises a command signal which instructs the multimedia information server to create and save a multimedia program, constructed in accordance with command signals previously transmitted in the interactive multimedia session, for access by other subscribers under control of a network administrator.
12. A multimedia information server as recited in claim 11, wherein said multimedia information server provides information to the subscriber for the transmission of said command signals.
13. A multimedia information server as recited in claim 8, wherein said command signals respectively identify indexes corresponding to digital multimedia information stored in a multimedia database of the multimedia information server.
14. A multimedia information server according to claim 13, wherein said multimedia information server provides information to the subscriber for the transmission of said command signals respectively identifying said indexes.
Patent Citations (78)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3766324 | 1973-10-01 | Budrys et al. | |
| US4332980 | 1982-06-01 | Reynolds et al. | |
| US4381522 | 1983-04-01 | Lambert | |
| US4506387 | 1985-03-01 | Walter | |
| US4654866 | 1987-03-01 | Bottle et al. | |
| US4692757 | 1987-09-01 | Tsuhara et al. | |
| US4755872 | 1988-07-01 | Bestler et al. | |
| US4761684 | 1988-08-01 | Clark et al. | |
| US4763191 | 1988-08-01 | Gordon et al. | |
| US4763317 | 1988-08-01 | Lehman et al. | |
| US4792849 | 1988-12-01 | McCalley et al. | |
| US4797913 | 1989-01-01 | Kaplan et al. | |
| US4807023 | 1989-02-01 | Bestler et al. | |
| US4829372 | 1989-05-01 | McCalley et al. | |
| US4847829 | 1989-07-01 | Tompkins et al. | |
| US4849811 | 1989-07-01 | Kleinerman | |
| US4852154 | 1989-07-01 | Lewis et al. | |
| US4864562 | 1989-09-01 | Murakami et al. | |
| US4868866 | 1989-09-01 | Williams, Jr. | |
| US4877408 | 1989-10-01 | Hartsfield | |
| US4890320 | 1989-12-01 | Monslow et al. | |
| US4891694 | 1990-01-01 | Way | |
| US4894825 | 1990-01-01 | Kobayashi | |
| US4897867 | 1990-01-01 | Foster et al. | |
| US4899334 | 1990-02-01 | Shimizu | |
| US4914586 | 1990-04-01 | Swinehart et al. | |
| US4924303 | 1990-05-01 | Brandon et al. | |
| US4931950 | 1990-06-01 | Isle et al. | |
| US4937821 | 1990-06-01 | Boulton | |
| US4941040 | 1990-07-01 | Pocock et al. | |
| US4947244 | 1990-08-01 | Fenwick et al. | |
| US4949187 | 1990-08-01 | Cohen | |
| US4954958 | 1990-09-01 | Savage et al. | |
| US4955019 | 1990-09-01 | Mizuhara et al. | |
| US4972462 | 1990-11-01 | Shibata | |
| US4974252 | 1990-11-01 | Osborne | |
| US4980886 | 1990-12-01 | Bernstein | |
| US4987486 | 1991-01-01 | Johnson et al. | |
| US4995073 | 1991-02-01 | Okata et al. | |
| US4995078 | 1991-02-01 | Monslow et al. | |
| US4998248 | 1991-03-01 | Matsuzaki | |
| US4999833 | 1991-03-01 | Lee | |
| US5008926 | 1991-04-01 | Misholi | |
| US5010399 | 1991-04-01 | Goodman et al. | |
| US5014125 | 1991-05-01 | Pocock et al. | |
| US5027400 | 1991-06-01 | Baji et al. | |
| US5033804 | 1991-07-01 | Faris | |
| US5042062 | 1991-08-01 | Lee et al. | |
| US5045940 | 1991-09-01 | Peters et al. | |
| US5051822 | 1991-09-01 | Rhoades | |
| US5065392 | 1991-11-01 | Sibbitt et al. | |
| US5065393 | 1991-11-01 | Sibbitt et al. | |
| US5068888 | 1991-11-01 | Scherk et al. | |
| US5119188 | 1992-06-01 | McCalley et al. | |
| US5130792 | 1992-07-01 | Tindell et al. | |
| US5132992 | 1992-07-01 | Yurt et al. | |
| US5133079 | 1992-07-01 | Ballantyne et al. | |
| US5189673 | 1993-02-01 | Burton et al. | |
| US5191410 | 1993-03-01 | McCalley et al. | |
| US5195092 | 1993-03-01 | Wilson et al. | |
| US5198899 | 1993-03-01 | Cang | |
| US5208665 | 1993-05-01 | McCalley et al. | |
| US5230015 | 1993-07-01 | Yokodate et al. | |
| US5247347 | 1993-09-01 | Litteral et al. | |
| US5311423 | 1994-05-01 | Clark | |
| US5341474 | 1994-08-01 | Gelman et al. | |
| US5351075 | 1994-09-01 | Herz et al. | |
| US5371532 | 1994-12-01 | Gelman et al. | |
| US5383112 | 1995-01-01 | Clark | |
| US5384732 | 1995-01-01 | Wheeler et al. | |
| US5384835 | 1995-01-01 | Wheeler et al. | |
| US5408465 | 1995-04-01 | Gusella et al. | |
| US5410343 | 1995-04-01 | Coddington et al. | |
| US5440334 | 1995-08-01 | Walters et al. | |
| US5508732 | 1996-04-01 | Bottomley et al. | |
| EPX2193420 | 1986-10-01 | ||
| EPXWO92/12599 | 1992-07-01 | ||
| GBX2207838 | 1989-02-01 |
Non-Patent Literature (53)
- "Digital Multimedia Systems" Communications of the ACM, vol. 34, No. 4 (1991).
- Talk given at the Motion Picture Industry Seminar, Dec. 3, 1984 "Dial-A-View" by A.F. Bulfer.
- "A Trial of a National Pay-Per-View Ordering and Billing System" by Andrew Bulfer et al., NCTA Technical Papers (1986).
- "BErKOM Test Network and BISDN/CATV Concept" by G. Domann, Electrical Communication, vol. 62, No. 3/4 (1988).
- "HDTV and Fiber Optic Communications -An Opinion"; Arpad G. Toth; pp. 1-11, Phillips Laboratories, North American Philips Corp., Briarcliff Manor, New York, EIA Digital ATV Workshop, Nov. 1989.
- "Integrated Voice, Data, and Video In the Local Loop"; Neale C. Hightower; pp. 0915-0919, .COPYRGT.1986 IEEE, Globecom 1986.
- "Heathrow -Experience and Evolution"; John Bourne, Mark Balmes, Jim Justice; pp. 1091-1095, .COPYRGT.1990 IEEE, ICC 90.
- "The Heathrow Broadband Access System"; Alan F. Graves; pp. 1675-1679, .COPYRGT.1989 IEEE, Globecom 1989.
- "Customer-Controlled Video Switching For Teleconferencing"; Keith J. Allen and Thomas K. Helstern; pp. 0907-0914, .COPYRGT.1986 IEEE, Globecom 86, Bell Communications Research.
- "Narrowband and Broadband ISDN CPE Directions"; Daryl J. Eigen; pp. 39-46, .COPYRGT.1990 IEEE Communications Magazine.
- "Multimedia Document Structure for Dialog Communication Service"; Naoki Kobayashi Toru Nakagawa; pp. 0526-0531, .COPYRGT.1991 IEEE, ICC 91, NTT Human Interface Laboratories.
- "A Proposal of Multimedia Document Architecture and Video Document Architecture"; Wataru Kameyama, Tsuyoshi Hanamura, Hideyoshi Tominaga; pp. 0511-0515, .COPYRGT.1991 IEEE, ICC 91, Dept. of Electronics and Communication Engineering Waseda University.
- "Object Representation for Multimedia Document Interchange"; Magda M. Mourad; pp. 0532-0539, .COPYRGT.1991 IEEE, ICC 1991; IBM Thomas J. Watson Research Center.
- "Evolutionary Architectures and Techniques for Video Distribution on Fiber"; Stuart S. Wagner, Ronald C. Menendez; pp. 17-25, .COPYRGT.1989 IEEE; IEEE Communications Magazine Dec. 1989.
- "Technologies Towards Broadband ISDN"; Kazuo Murano, Koso Murakami, Eisuke Iwabuchi, Toshio Katsuki, Hiroshi Ogasawara; pp. 66-70 .COPYRGT.1990 IEEE, IEEE Communications Magazine.
- "Can PON go broadband?"; Carl P. Engineer; 3 pages of text, Telephony -Jan. 14, 1991.
- "Television Coding For Broadband ISDN"; Jules A. Bellisio and Shuni Chu; pp. 0894-0900, .COPYRGT.1986 IEEE; Globecom 86; Bell Communications Research, Inc.
- "An Approach to the Multifunction Graphic Terminal for the ISDN Environment"; Takashi Komiya, Yasunobu Suzuki, Hajime Yamada and Keiko Tomita; pp. 0032-0036, .COPYRGT.1988 IEEE; Globecom 1988; OKI Electric Ind. Co., Ltd. ISDN Development Division.
- "Low-Cost Digital Passive Optical Networks"; A.R.J. Cook, D.W. Faulkner, P.J. Smith, R.A. Lobbett; pp. 0659-0662, .COPYRGT.1990 IEEE; ICC 1990; British Telecon Research Lab.
- "ATV Multiport Receiver An Overview of the EIA ATV Technical Subcommittee Work"; Arpad G. Toth, Joseph Donahue; 18 pages of text, EIA Digital ATV Workshop; Nov. 7, 1989.
- "Optical Networks for Local Loop Applications"; David W. Faulkner, David B. Payne, Jeffrey R. Stern and John W. Ballance; pp. 1741-1751, .COPYRGT.IEEE 1989, Journal of Lightwave Technology, vol. 7, No. 11, Nov. 1989.
- "Passive Optical Subscriber Loops With Multiaccess"; Yih-Kang, Maurice Lin and Dan R. Spears; pp. 1769-1777, .COPYRGT.IEEE, Bellcore; Journal of Lightwave Technology, vol. 7, No. 11 Nov. 1989.
- "Comparison of Discrete Cosine Transform and Vector Quantization of Medical Imagery"; Barry G. Haskell and Hsueh-Ming Hang; pp. 399-408, SPIE vol. 626 Medicine XIV/PACSIV (1986).
- "Distributed Desktop Conferencing System (MERMAID) Based on Group Communication Architecture"; Kazutoshi Maeno, Shiro Sakata and Toyoko Ohmori; pp. 0520-0525, .COPYRGT.IEEE 1991; ICC 1991.
- "Video Services on Copper"; Milton M. Anderson; pp. 0302-0306, .COPYRGT.IEEE 1991; ICC 1991.
- "System Architecture for a Large Scale Video on Demand Service"; W.D. Sincoskie; Computer Networks and ISDN Systems 22 (1991); pp. 155-162; .COPYRGT.1991 Elsevier Science Publishers.
- "To PON or not to PON? That is the question"; John S. McConnell; 4 pages of text Telephony -Jan. 14, 1991.
- "Break on Through to the Other Side"; George T. Hawley; 7 pages of text Telephony -Jan. 14, 1991.
- Joseph W. Lechleider, "High Bit Rate Digital Subscriber Lines: A Review of HDSL Progress," IEEE Journal of Selected Areas in Communications, vol. 9, No. 6, Aug. 1991, pp. 769-784.
- Earl E. Manchester, "New Uses for Residential Copper," Telephony, Jun. 10, 1991, pp. 27, 28 and 32.
- Waring et al., "Digital Subscriber Line Technology Facilitates a Graceful Transition from Copper to Fiber," reprinted from IEEE Communications Magazine, vol. 29, No. 3, Mar. 1991.
- Stanford University; Study Project: "Performance Evaluation of a Multichannel Transceiver System for Asymmetric Digital Subscriber Lines," dated Dec. 12, 1990, distribution to American National Standards Institute T1E1.4 Technical Subcommittee Working Group Members (partial copy).
- Bellcore, Technical Memorandum, "Asymmetrical Digital Subscriber Lines"; TM-TSY-015008, completion date Sep. 14, 1989.
- ISSIS 78, 24 Mar. 1978, Atlanta Georgia, US pp. 44-48, Coyne et al. "Integrated Broadband Distribution System For Low Density-Rural Areas Using Optical Fiber Transmission".
- ICC '91, 26 Jun. 1991, Denver, colorado, US pp. 842-846, Gelman et al., "A Store and Forward Architecture for Video-On-Demand Services".
- CATV Sessions, 13 Jun. 1987, pp. 426-435, Seguin, "Optical Fibre Local Networks for Distribution and Interactive Services".
- IEEE Communications Magazine, vol. 30, No. 7, Jul. 1992, pp. 36-41, Sutherland et al. "Residential Video Services".
- Gomez et al., "Project Edison: A Plan for a Multi-Media Extended Classroom Experiment," Globecom 92, IEEE Global Telecommunications Conference, 1992.
- Bellcore Exhcnage, "Multimedia Delivery Over Public Switched Networks, Jonathan Rosenberg", pp. 20-25.
- Standards Newsletter, "Video Future is Bright"; Hank Hudson, pp. 12-14.
- A PennWell Publication, Computer Graphics World, Mar. 1993, "The Full Picture", (New Mac-based video accelerator boards are helping to make full-screen digital video editing a reality), Jon Leland, pp. 47, 48 and 54.
- IEEE Spectrum, Interactive Multimedia Getting The Whole Picture, Mar. 1993, The Technology Framework, pp. 32-39.
- "Visual Telephony as an ISDN Application", by Ming Liou, IEEE Communications Magazine (1990).
- "1.544-Mbit/s Transmission of TV Signals by Interframe Coding System," by H. Yasuda et al., IEEE Transactions on Communications (1976).
- "Enhanced Video Response System-VRS Phase II," by H. Nakajima, Japan Telecommunications Review (1979).
- "Video Response System-VRS," by K. Haji, International Conference on Communications (1978).
- "Dial V for Video", Video Magazine dated Mar. 1982.
- "MCPIC: A Video Coding Algorithm for Transmission and Storage Applications," by A. Wong et al., IEEE Communications Magazine (1990).
- Multimedia Solutions, Vo. 2, No. 2, Mar./Apr. 1992, Editor Larry Baratto (entire magazine).
- Project Edison: A Plan for a Multi-media Extended Classroom Experiment, L.M. Gomez, C.N. Judice and J. Grady, pp. 770-778, Globecom 92, IEEE Global Telecommunications Conference 1992.
- Bellcore Exchange, Jan 1993, Issue One, John S. Schafer, Editor.
- News Release, Bell Atlantic, "Bel Atlantic and AT&T Announce New Technology To Benefit Education", Oct. 29, 1991, four pages.
- Bell Atlantic News, "Union City Selected For Education Services Trial", Apr. 30, 1992, six pages.