Process for selecting a recording on a digital audiovisual reproduction system, and system for implementing the process

[0001] This application is a continuation of application Ser. No. 08/935,826, filed Sep. 23,1997, now pending, the entire content of which is hereby incorporated by reference in this application.

[0002] This invention pertains to a process for selecting a recording on a digital audiovisual reproduction system with a touch screen, and the system for implementing the process.

[0003] Such audiovisual reproduction systems are generally found in cafes or pubs and are composed of a sound reproduction machine, generally referred to as a jukebox, connected to a monitor that displays video images or video clips. To do this, the jukebox is equipped with a video compact-disk reader and a library of video compact disks and includes pre-selection buttons that show the titles of the works of music that are to be selected. Payment of an adequate fee, followed by one or more pre-selections, activates the system, whereby the disk on which the selected work is found is automatically loaded into the reader, and the desired audiovisual reproduction can began.

[0004] Although these systems allow reliable and good-quality reproduction, they still have some serious drawbacks. A first drawback relates to the space that is required for storing the library. The library of disks requires that the system be of significant size. Likewise, these systems, which employ mainly mechanical hardware, use sophisticated techniques that lead to frequent and costly malfunctions. Moreover, it is quite uncommon for all of the works on a single disk to be listened to regularly, and some are almost never listened to, but the entire disk must be included in the library. Another drawback is due to the fact that the companies that manage and distribute these systems circulate a limited number of identical disks and require a certain amount of rotation among their clients. Consequently, the clients are sometimes made to wait when a disk is not available.

[0005] It is known from patent PCT/WO 93 184 65 that there are computerized jukeboxes that make it possible to receive, through a telecommunications network and a modem that connects the jukebox to the network, digitized information that comprises songs or works of music, which are remotely loaded into a bulk memory of the jukebox. The communication system can also remotely load files that are representative of digitized graphical data, whereby the songs and graphical files are compressed before they are sent onto the network. The jukebox processor then makes use of these files by decompressing them and sending the graphical data to the video circuit and the song data to the audio circuit.

[0006] The processor, however, also manages the user interfaces, and the management of these different elements is accomplished sequentially by displaying the graphic images that are representative of the song and then responding to the user's activation of the keys, then by re-loading if the user has paid the desired amount and, finally, when the desired amount has been paid, by placing the selection in a queue to be played later. Moreover, this system can operate only by first displaying the graphic images and then initiating the playback of the song because, according to the logic diagrams, the processor cannot execute two tasks at the same time.

[0007] The activation of the keys by a user requires a certain amount of training, is a source of errors, and also extends song selection time.

[0008] The object of this invention is a recording selection process that is convenient and easy to use, even for a beginner.

[0009] This object is achieved by providing a process for selecting a recording on an audiovisual reproduction system using friendly on-screen windows. Moreover, with the friendly windows, data required for the display can be selected from information that is stored in a bulk memory representing an image of the recording cover. Corresponding music recordings are stored in the bulk memory of the reproduction system, and each zone of a window is associated with at least one address for accessing the information of the databases via a touch-screen interface.

[0010] According to another feature, a light touch on one of the windows causes the corresponding cover to be displayed with the various titles that can be selected from this cover. The selection of a title can then be made by lightly touching one of the titles on the list, and playback is accomplished by lightly touching an alphanumeric tile.

[0011] According to another feature, an area that includes several graphic display tiles in which the images of available covers by the same artist are displayed.

[0012] According to another feature, one strip or zone of the screen includes arrows at each end effecting scrolling in one direction or the other so as to display the other images of covers that cannot be displayed in the windows or the display tiles.

[0013] According to another feature, the window zone, which includes the several windows, displays a cover in each window and includes representations of selection criteria for searching the database of the system. The selection criterion can be activated when the user touches the screen. The selection criterion consists of data ranges such as recent decades, music category, song index, etc.

[0014] Another object of the invention is to propose an audiovisual reproduction system that makes it possible to implement the process.

[0015] This object is achieved with an audiovisual reproduction system developed around a microprocessor device that is associated with a payment device. The system includes bulk storage for, among other things, storing visual and sound recordings in compressed digital form. The system interfaces with a digital display and digital sound reproduction structure, whereby a video monitor is connected to a touch screen which, in turn, is connected to an interface program to react to a user touching the touch screen. These contacts are translated for the operating system as mouse events which, via a library of integrated tools and services, initiates the modification of the running of one of the interface program modules. Each display zone of the video monitor, associated with the touch screen, is associated with a criterion for searching the database of the visual or audio representation data corresponding to the information displayed on the screen.

[0016] According to another feature, the search criterion is the selection of a number of albums corresponding to the number of windows that can be displayed on the screen and the associated graphical information. The search criterion may additionally or alternatively consist of music category, date range, etc.

[0017] According to another feature, scanning of the database is done in increments of the size of the number of windows that can be displayed on the selection screen.

[0028] Preferably, the audiovisual reproduction system according to the invention uses the items of hardware listed and referenced below, but it is not limited thereto.

[0029] Referring to FIG. 1, a central microprocessor unit (1) is a high-performance PC-compatible system, such as the Intel 80482 DX/2 type, which has the following memory resources and characteristics:

• • [0030] compatibility with the local Vesa bus;
  • [0031] processor cache memory: 256 Kbyte;
  • [0032] read-write memory: 32 Mbytes or more of RAM, auto-supply;
  • [0033] high-performance serial and parallel ports;
  • [0034] SVGA graphics adapter with microprocessor;
  • [0035] SCSI/2 bus controller.

[0036] Other processors having equivalent or better levels of performance may be used in the invention.

[0037] This central unit (1) controls and manages a sound control circuit (5), a telecommunications control circuit (4), an input control circuit (3), a bulk memory control circuit (2), and a circuit for controlling the display (6). The display consists primarily of a video monitor (62) with a flat non-interlaced screen, for example of the SVGA type with high resolution and low radiation. The monitor is used to reproduce images (for example, the album covers of the music selections), graphics, or video clips.

[0038] A bulk memory (21) uses high-speed, high-capacity hard disks and is connected to the memory already present in the microprocessor device. The bulk memory stores digitized and compressed audiovisual information.

[0039] A high-speed telecommunications modem (41), with a speed of at least 28.8 Kbps, or any other telecommunications hardware connected to other telecommunications media is integrated to enable the connection to an audiovisual information distribution network that is controlled by a central server.

[0040] In order to reproduce the sound information of the musical selections, the system includes speakers (54) that receive the signal from a tuner amplifier (53), which is connected to a music synthesizer electronic circuit (5). The system supports a large number of input sources while providing an output that ensures CD (compact disk) quality, such as, for example, the microprocessor-based multimedia audio adapter, like the “Sound Blaster” SBP32AWE sound card from Creative Labs Inc. to which two memory buffers (56,57) are added for the purpose explained above.

[0041] Likewise, the circuit for controlling the display (6) also contains two buffer memories (66, 67) for the purpose explained above.

[0042] A ventilated, heat-regulated 240-watt power supply supplies power to the system. This power supply is protected against overvoltages and overdriving.

[0043] Via an input controller circuit (3), the audiovisual reproduction system manages an “Intelli Touch” touch screen (33) from Elo Touch Systems Inc., which includes a glass cover panel that utilizes the “advanced surface wave technology,” as well as an AT bus controller. This screen serves as an interface for selection information used by the customers via the video monitor (62) or a TV monitor (61), as well as control information and management oversight information used by the manager or owner of the system. It is also used for purposes of maintenance in combination with an external keyboard (34) that is connected to the system, which for this purpose has a keyboard connector controlled by a key lock (32) through the interface circuit (3).

[0044] The interface circuit (3) also interfaces with the system via a remote-controlled assembly (31) which consists of, for example:

• • [0045] an infrared remote control from Mind Path Technologies Inc., consisting of a transmitter with 15 control keys for the microprocessor system and eight control keys for a projection device; and
  • [0046] an infrared receiver with serial adapter from Mind Path Technologies Inc.

[0047] A fee payment device (35) from National Registers Inc. is also connected to the input interface circuit (3). Any other device that makes it possible to receive payment using coins, tickets, tokens, magnetic cards, smart cards, or a combination of means of payment can also be used.

[0048] To accommodate the system, there is also a chassis or steel frame with personalizable external fittings.

[0049] A wireless microphone (55) is connected to the sound controller, which makes it possible to convert the latter into a powerful public-address system or a karaoke machine. Likewise, the remote-control system (31) allows the manager, for example from behind the bar, to access and monitor various controls such as:

• • [0050] the start-stop control for the microphone;
  • [0051] the speaker mute control;
  • [0052] the volume control;
  • [0053] the control for canceling the musical selection currently being played.

[0054] Two buffers (56,57) are associated with the sound controller circuit (5) for each alternatively storing an item of information corresponding to least a quarter of a second of sound. Likewise, two buffers (66, 67) are associated with the video controller circuit (6) and are able, each by itself and alternatively, to store at least a tenth of a second of images. Finally, a respective buffer (46, 36, 26) is connected to each of the communication controller circuit (4), the input interface circuit (3), and the storage circuit (2).

[0055] The software for operating the system was developed around a library of tools and services that is largely oriented toward the audiovisual domain in a multi-media environment. This library will advantageously include a multi-task operating system that makes it possible to execute multiple fragments of code simultaneously and efficiently. This operating software thus makes it possible to concurrently execute, in an orderly manner and avoiding any conflict, operations that are carried out on the display and the sound reproduction structure, as well as to manage the telecommunications links via the distribution network. Moreover, this software is highly flexible.

[0056] As will be seen below, the library of tools includes a programming interface for the touch screen (33) that is associated with each graphic module, which will be described below and which includes, depending on the associated graphics module, functions for reacting to activation by one or more external events. The external events come from the user and are processed via the touch-screen interface so that they can be interpreted by the operating system as the equivalent of a mouse event. Thus, touching a zone is recognized by the touch-screen interface as a push event (down), the moving of the finger on the screen as a drag event (drag), and the removal of the finger from the screen as the release of a button (up). Each event that is interpreted by the associated touch-screen interface is then delivered to the corresponding module in order to trigger either a modification of a running program by calling, for example, another graphic module, or a modification of the physical parameters of the machine by causing these parameters to be stored and ensuring later use by the electronics associated with this parameter.

[0057] The digitized and compressed audiovisual data are stored in the bulk memory (21).

[0058] Each selection is available in two digitized formats with hi-fi or CD quality.

[0059] Before describing the flow diagram in FIG. 2, it must be noted that, although all these modules, described separately, seem to be being used serially, in reality the specific tasks of these modules are being executed simultaneously in an environment using the multi-task operating system. Consequently, the flow diagram indicates specific operations that a module is supposed to carry out and not a branch to this module that would invalidate all of the operations executed by the other modules.

[0060] The first module, marked SSM, is the module for starting the system. This module provides only a single service, and therefore it is loaded automatically as soon as the system is powered up. If the system is started with a valid registration number, it then goes directly into the “in service” mode of the module marked RMM.

[0061] The RMM module is the module of the “in service” mode, which is the operating mode that the system enters as soon as its registration number is validated. In this mode, the system is ready to handle any request that can be triggered by various predefined events, such as for example:

• • [0062] customers who touch the screen: when a customer or a user touches the screen, the system transfers control of its first-level session to the CBSM module of the customer selection and operating mode;
  • [0063] receipt of a remote-control signal: when a command is received, it is processed in a background session by the system command module SMM while the foreground session remains available for other actions;
  • [0064] the appearance of an end of time-out indicating that the system is inactive: when one of the various timers is activated, control is temporary turned over to the inactivity routine module IRM for processing.

[0065] The system remains in the “in-service” mode until one of the events described above occurs.

[0066] Thus, the RMM module of the “in-service” mode includes a module that makes it possible to deliver a graphic display corresponding to, e.g., that of FIG. 7. This graphic module makes it possible to display a window (80) that contains, for example, a “NOW PLAYING” indication in a zone (81).

[0067] A second window (82), which is smaller and is contained in the first window (80), makes it possible to graphically display the cover of the disk being played. In an alphanumeric tile (83), the title of the album currently being played is displayed, and in a second alphanumeric tile (84), the name of the album is displayed. A third alphanumeric tile (85) indicates the name of the artist or the group. This information comes from the database (16) based on the identification number of the title and on information that is stored in the database according to the access procedures as indicated in FIG. 6, explained below. Finally, the window (80) contains a zone (86) that gives the direction “press” or “touch me,” urging the user to press his finger against the screen so that the RMM module, by detecting via the touch-screen interface module the position of the finger on any zone of the screen, transfers control of its session to the CBSM module of the mode for selection and searching of the selections by the customer.

[0068] In the event that the jukebox is no longer playing a song and when the end of the songs in the queue has been reached, the screen can display advertisements or the sample selections entered into memory by the jukebox manager. The purpose of these selection samples is to persuade the customer to listen to the entire song. The samples can be presented randomly or in an order that is pre-selected by the manager. This pre-selection is stored and serves as a search criterion for searching the jukebox database.

[0069] The IRM module is the inactivity routine module. This module contains routines that implement predefined functions such as the displaying of an album cover, the playing of snatches of musical works available in the system, the reproduction of complete selections for internal advertising purposes, audio reproductions for external advertising purposes, voiced-over advertising announcements of new musical selections, and the return to an auxiliary source. These options can be called up when the system is inactive and when a predefined, but adjustable, period of time, corresponding to a time-out, has elapsed.

[0070] A programming interface module (153) for the touch screen (33) contains different modules. Each of the sub-modules corresponds to one of the graphic modules indicated above.

[0071] The CBSM module is the customer search and selection mode module. Access to this module is triggered starting from the “in service” mode of FIG. 7 when the customer touches the screen. The display allows the user to display a selection menu, shown in FIGS. 8 and 9, to enable a powerful search tool and to aid the user in making his choice of musical selections.

[0072] FIG. 8 shows a first variant of the selection menu in which the monitor screen makes it possible to display a window (90), inside of which is an agenda that is equipped with, for example, an index (96). On one of the pages of the agenda is a display window showing the cover of an album (92), and on the other page (91) are a list (94) of the titles included in the album, and an alphanumeric tile (95), which makes it possible to initiate the playing of the recording that has been selected in advance by touching one of the titles on list (94). This action selects the title by, for example, highlighting. At the bottom of the screen is a strip (93) in which there are number of small windows (931-934) corresponding to different album covers belonging to the same musical group or the same singer. Directional arrows (930,935) make it possible, by touching these arrows, to scroll through the different covers not displayed in the small windows, either upward (930) or downward (935), that are available for the same group or singer.

[0073] In another embodiment of the interface shown in FIG. 9, the interface is divided into two sub-windows. In a first sub-window (100A), a number of small zones of sub-windows (101-106) in which a different image of each cover containing an album is displayed in each sub-window (101-106). Scrolling arrows, which are not shown and are identical to those (930, 935) in FIG. 9, make it possible to scan the other covers that are available. In another zone of the first sub-window (100A) selection criteria, for example, by new releases (111), by popular artists (112), by the names of artists (113), and by albums (114) are displayed. The second subwindow (100B) of the main window is divided into two parts, whereby a first part includes three selection criteria: a first criterion based on category (109), a second criterion based on index (108), and a third criterion based on era (110). A second part (107) of the sub-window (100B) displays an option for the user to select one of the decades that are displayed, for example, in alphanumeric tiles (1071-1076), each of which displays a decade in order to cover decade by decade, e.g., the half-century between 1940 and 1990. Thus, as can be understood, the touch-screen interface software associates with each of the touch-screen zones corresponding to a display zone a selection criterion that is used as a criterion for searching the database in order to access graphical or alphanumeric or audio data that are available in the database. Depending on need, this criterion is associated with an increment in the number of display windows shown at one time on the screen in order to select, for example, the number of graphical data corresponding to the maximum number of covers shown on the screen.

[0074] Here again, a programming interface module (153) for the touch screen (33) is connected in such a way that touching the different zones corresponding to the zones of action or scroll arrows is correctly interpreted by the interface module (153). Likewise, each graphic module will include a module that makes it possible to use the database (16) in the corresponding way later, which is described in connection with FIG. 6. This use of the database makes it possible, when the button “popular,” for example, is touched, to display successively in each of display tiles (101-106 or 931-934) the images of an album and various names of popular music artists that are available.

[0075] The multi-task operating system is one of the essential elements that makes it possible to simultaneously execute multiple fragments of code and to manage the priorities among the different tasks that are called.

[0076] As shown in FIG. 3, this multi-task operating system is organized around a core that comprises a task priority resolution module (11), a task supervisor module (12), a sterilization module (13), and a communication process module (14). Each of these modules communicates with application programming interfaces (15) and the database (16). There are as many programming interfaces as there are applications. Module (15) also includes a first programming interface (151) for key switch (32), a second programming interface (152) for remote control (31), a third programming interface (153) for touch screen (33), a fourth programming interface (154) for keyboard (34), a fifth programming interface (155) for payment device (35), a sixth programming interface (156) for sound control circuit (5), a seventh programming interface (157) for video control circuit (6), and a last interface (158) for telecommunications control circuit (4).

[0077] Five tasks, in descending order of priority, are managed by the operating system, a first task (76) for the video inputs/outputs having the highest priority, a second task (75) of level two regarding sound, a third task (74) of level three for telecommunications, a fourth task (73) of level four for the interfaces, and a fifth task (70) of level five for management. These priority orders will be taken into account by the priority resolution module (11) as tasks appear or disappear. Thus, as soon as a video task appears, the other tasks being run are suspended, priority is given to this task, and all of the system's resources are dedicated to the video task. At the output, the purpose of video task (76) is to unload the video files from both memory (21) towards one of the two buffers (66, 67), while the other buffer (67, or 66, respectively) is used by the video controller circuit (6) to produce the display after the data are decompressed. At the input, the purpose of the video task (76) is to transfer the data received at the telecommunications buffer (46) to the bulk memory (21) and one of two buffers (26) of the bulk memory (21). The same is true of the sound task (75), on the one hand, at the input between the telecommunications buffer (46) and the buffer (26) of the bulk memory (21) and, on the other, at the output between the buffer (26) of the bulk memory (21) and one of two buffers (56, 57) of sound controller circuit (5).

[0078] The task supervisor module (12) will now be described in connection with FIG. 4. This module carries out, in order of priority, a first test (761) to determine whether the video task is active, i.e., whether one of the video buffers (66, 67) is empty. In the event that the response is negative, the task supervisor module moves on to the next test, which is a second test (751) for determining whether the sound task is active, i.e., whether one of the buffers (56, 57) is empty. In the event of a negative response, a third test (741) determines whether the communications task is active, i.e., whether the buffer (46) is empty. After there is an affirmative response to one of the tests, at stage (131), the task supervisor module (12) fills a memory access request queue and at stage (132) fulfills this request by reading or writing between the bulk memory (21) and the buffer that corresponds to the active task, and then goes back to the first test. When test (741) for determining whether a communication is active is affirmative, the supervisor (12) runs a test (742) to determine whether information is being written into or read in memory. If yes, the write or read request is placed in the queue at stage (131). Otherwise, at stage (743) the supervisor determines whether it is a case of transmission or reception and, in the case of transmission, at stage (744) the supervisor sends the information block to the central server. In the case of reception, at stage (746) the supervisor verifies that the buffers of the core are free for access and, if the response is yes, sends a message to the central server to accept receipt of a block of data at stage (747). If the response is negative, the initial tests are restarted. After a block is received, an error check (748) of the cyclic redundance type SRC (Cyclic Redundant Check) is carried out. The block is rejected at stage (740) in the event of an error or else accepted if there is no error by sending a corresponding message to the central server indicating that the block bearing a specified number is rejected or accepted, and it then goes back to the initial tests. In the event that no higher-level task is active, at stage (731) or stage (701) the supervisor ensures the processing of the interface or management tasks and then goes back to the starting tasks.

[0079] As FIG. 5 shows, the detection of an active or ready task is accomplished by a corresponding test (721-761) at each of corresponding software or hardware modules (26) of the hard disk, interface buffer (36), telecommunications buffer (46), sound buffers (56 and 57), and video buffers (66 and 67), which are associated with each of respective controller circuits (2, 3, 4, 5, 6) of each of the hardware devices associated with central unit (1). Test (721) makes it possible to see whether there are data present in the input/output memory buffer of the disk, test (731) makes it possible to see whether data are present in the hardware or software memory buffers of the customer interface device, test (741) makes it possible to see whether data are present in the software or hardware memory buffers of the telecommunications device, test (751) makes it possible to determine whether data are present in the hardware or software memory buffer for the sound, and test (761) makes it possible to see whether data are present in the hardware or software memory buffers of the video device. If one or more of these buffers is (are) filled with data, the supervisor (12) positions respective status buffer(s) (821) for the hard disk, buffer (831) for the interface, buffer (841) for telecommunications, buffer (851) for the sound, and buffer (861) for the video corresponding to the hardware in a logic state that is indicative of the activity.

[0080] Otherwise, at stage (800), the status buffers of the supervisor are brought back to a value that is indicative of inactivity.

[0081] The operating status of the system is retained on the hard disk.

[0082] Each time a significant event is initiated, the system records it immediately on the disk.

[0083] Thus, in the event of a power failure or equipment malfunction, the system will be able to start up again right where it was interrupted.

[0084] The events that trigger the protection of the operating status are:

• • [0085] insertion of money (addition of credit);
  • [0086] the addition of a selection to the queue;
  • [0087] the end of a selection (changing of the selection currently being played).

[0088] The file is in a machine format that can be read only by the unit and takes up no more than 64 bytes.

[0089] In fact, based, on the one hand, on the task management module, whereby the highest priority is given to the video task and, on the other hand, on the presence of the hardware or software buffers that are assigned to each of these tasks to temporarily store the data and on the presence of the status buffers relative to each task, it is possible to have all of these tasks managed by a single central unit with a multi-task operating system that offers the ability to provide a video display, i.e., animated images opposite a graphical representation in which the data to be processed are less complex. This use of a video presentation can also be done without hampering the processing of the sound owing to the fact that the sound controller circuit (5) contains buffers that are large enough to store enough compressed data to make it possible, while the sound is being processed, to transfer video data to one of the video buffers (66, 67) while waiting for the next transfer of sound data.

[0090] Moreover, the multi-task operating system includes a library that contains a set of tools and services and makes it possible to accelerate the operation significantly due to the fact that it is integrated into the storage and to the great flexibility that is thus provided. In particular, this makes it possible to create a multimedia universe by simultaneously managing, in a simple and effective manner, the reproduction of sound, the displaying of images or graphics, video animation, and the user interface. As shown in FIG. 6, the database (16) is composed of several bases.

[0091] A first base (161) covers the titles of the audiovisual works, a second base (162) covers the artists, a third base (163) covers the labels (LABEL), a fourth base (164) covers the albums, and a fifth base (165) covers the fees. The first base (161) contains a first item of information (1611), corresponding to the title of the work, and a second item of information (1612) corresponding to the identification of the product. This product identification is unique. A third item of information (1613) relates to the music category, i.e., jazz, classical, variety, etc. A fourth item of information (1614) indicates the date of the update. A fifth item of information (1615) indicates in seconds the time required to play the piece. A sixth item of information (1616) is a link to the fee base, and a seventh item of information (1617) is a link to the album. An eighth item of information (1618) is a link to one of the “LABEL” labels. A ninth item of information (1619) indicates the purchase price for the manager of the jukebox. A tenth item of information (1620) indicates the amount of the fee for each play of the work. An eleventh item of information (1610) is a link to the base on the artists. This link consists of the identity of the artist (1621) and the name of the group (1622).

[0092] The album information base contains the album identity (1641), which is a link to the seventh item of information (1617) of the title base. The album information base also contains the title (1642), the update date of the album (1643), and the label identity (LABEL) (1644).

[0093] When an audio or audiovisual selection is being played, touching the screen initiates a search by artist name of the various albums and the display of a number of different albums by the same singer or group that are available in the database corresponding to the number of display windows or tiles. If the number of albums exceeds the number of windows, the software displays only the next n albums corresponding to the album played, and the user can display them by touching the scrolling arrows. When the jukebox is not playing an audio or audiovisual selection, the program initiates, e.g., by randomly scanning the database, the display at regular intervals of sets of images of covers of different albums that are available by random selection or by other selection criteria that are determined by the program. Touching a screen zone that is associated with a selection criterion initiates a program to search the database for data corresponding to the criteria and then makes it possible to send these data to the display management software for display, in each of the windows, of the images corresponding to the data selected on the basis of the criterion that is activated.

[0094] Any modification that is within the grasp of one skilled in the art is also part of this invention. Thus, with regard to buffers, it should be recalled that buffers may be present either physically on the circuit to which they are assigned or they may be implemented by software by reserving storage sites in the system memory.