System and method for coordinating music display among players in an orchestra

[0002] A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever.

[0003] The invention disclosed herein relates to computerized systems for composing and displaying musical scores. In particular, the present invention is an improved user interface and system that allows a conductor or composer to interactively modify a musical score and to transmit the modifications to individual musicians or selected groups of musicians in an orchestra.

[0004] Traditionally, printed paper copies of sheet music have been required for any orchestral or band musician to read in order to perform a musical score. The use of such printed sheet music has resulted in certain disadvantages, such as the need to turn pages, the risk of losing pages, and the time consuming task of making edits or changes to musical scores, which may involve reprinting the score. In addition, the use of printed sheet music limits the ability of the conductor of the orchestra to make changes during a rehearsal, concert or performance, and also unduly restricts the composition process.

[0005] Several systems have been developed for allowing the composition and notation of music on a computer. Examples of such systems include the FINALE music composition and notation software available from Coda Music Technology, Inc. of Minnesota, the MUSIC WRITE PLUS software from Voyetra Technologies Inc. of New York, the CUBASE VST system available from Steinberg North America of California, and the SIBELIUS music software available from Sibelius Software, Ltd. of the United Kingdom. These systems generally allow for the composition and editing of a musical score through a mouse or keyboard using a note palette or template, or through a MIDI compatible keyboard.

[0006] U.S. Pat. No. 5,665,927, assigned to Casio Computer Co., Ltd., describes a hand-held device that uses a pen-based input device for music notation. A touch screen of the device displays a musical staff and provides a method for the user to enter musical notations directly onto the displayed staff using the pen-based input device.

[0007] These software and systems provide some basic tools for the computerized composition and editing of music.

[0008] The Music Object Oriented Distributed System, or MOODS, is an integrated system of computer-based lecterns or stands which can be used for cooperatively editing and viewing musical scores. The MOODS system, which is described in a document retrievable on the Internet at <http://aguirre.dsi.unifi.it/˜moods>, is designed for use by, among other things, orchestras during rehearsals and public performances.

[0009] The MOODS system is comprised of a set of lecterns for musicians for displaying musical scores; a lectern for conductors that is used to show, visualize or modify a score; a network for connecting these lecterns; and a database for storing and retrieving the musical scores. The musicians' lecterns are organized according to a hierarchy within the orchestra, with first level musicians being qualified to perform changes on a score while other musicians can be active or passive. This hierarchical organization allows a first instrument such as a first violinist, to directly transmit changes in the score to the other sub-lecterns.

[0010] Similarly, PCT application No. PCT/US98/08658, published Nov. 12, 1998, describes a musical score display and editing system in which a band leader's device distributes display information to other devices. The leader may create modifications to a score using various music editing commands which are displayed on all devices displaying parts of the score to which they apply. The system also allows individual musicians to insert personal annotations into their own parts of the score, to be displayed on their own individual devices.

[0011] Despite this activity, to the inventor's knowledge there is no system which simplifies and facilitates the conductor's or composer's task of managing and coordinating score modification and dissemination. That is, none of these systems allow the conductor to work with a computerized device in the same fashion as if working with hard copy of sheet music and to fully control the extent to which others in an orchestra receive and view modifications to a score on an automatic, real-time basis. Furthermore, there is no fully integrated music display system that is self-contained, ergonomically designed, flexibly reconfigured, or easily transported. The present invention is directed to improvements that provide these advantages.

[0012] It is an object of the present invention to solve the problems described above associated with existing musical composition systems.

[0013] It is another object of the present invention to provide an intuitive user interface for a music editing system through which a conductor of an orchestra can change musical scores for all or some players in the orchestra.

[0014] It is another object of the present invention to integrate handwritten editing changes with a fully digital music composition and performance system.

[0015] It is another object of the present invention to provide an ergonomic and fully integrated system for multi-part musical composition and conducting.

[0016] The above and other objects are achieved by a method and system for facilitating multi-part score composition and conducting an orchestral performance, the method being implemented in a network of computerized devices each containing programming for displaying music on a display device, the computerized devices being used by each of a plurality of players in the orchestra under direction of the conductor. The method involves the step of registering an identity of an instrument in use by each player and the corresponding computerized device being used by the player. This allows the conductor to know which player and which instrument are using each device.

[0017] During a composition session or performance, the conductor enters at the conductor's computerized station one or more changes to a musical arrangement. These changes may be entered in a handwritten format, via an integrated piano keyboard, mouse, or keyboard. The conductor's computerized device contains a digitizer and touch screen for processing the input received from the conductor, and also contains means for converting the input changes from handwritten format to a digital music notation format. The means for handwriting conversion may be a music handwriting recognition program such as described above in relation to U.S. Pat. No. 5,665,927, which is hereby incorporated by reference into this application.

[0018] The conductor's station allows the conductor to select whether the input change is to be sent to all players in the orchestra or only to a selected group of one or more players who may be using an instrument impacted by the change. The conductor's station also allows the conductor to select whether the change should be converted to a digital music notation format before transmission to the players. If the conductor selects to send the change only to the player or players using an instrument impacted by the change, the conductor's station determines which instrument or instruments are impacted by the change and identifies the corresponding computerized device or devices registered for that instrument. The change is then transmitted over the network to the players in accordance with the conductor's selections.

[0019] One of the features of the system of the present invention that sets it apart from other computer-based score editors and related applications is the user interface. The conductor and other musicians are able to write directly onto the display screen, just as with any palm computing device, allowing for immediate note changes, edits, and other musical explorations. Thus, the musician will not have to edit using dialog boxes or keyboard commands, and simply takes an electronic pen and writes the desired changes directly onto the screen. For example, to replace a quarter note with a half note, all the musician would have to do is draw a half note on the staff, just as though it were on paper. The half note remains in a handwritten format until the musician explicitly decides to convert the handwritten representation to a digital music notation using a handwriting recognition application.

[0020] Because all of the computers in the band or orchestra are networked, the band leader or conductor can make a universal edit for all musicians at a rehearsal or performance from a central station and transmit the edited score to all of the other musicians simultaneously. The conductor could also make changes on an individual part as well. For example, if the conductor wanted the trumpet section to repeat four bars, the players would have the option to make the required changes individually or simply accept the changes made by the conductor.

[0021] The computer, display screen, operating system, and application are integrated into a single self-contained unit. Because everything is in one unit, external wiring and other clutter are eliminated reducing setup time, effort and possible errors. The unit housing the computerized device is large enough and provides sufficient display resolution to represent standard pages of printed music, while remaining compact and light enough to be portable. This allows for the musicians to comfortably travel to and from rehearsals, recordings and performances with the device. New musical scores and parts are distributed by discs, or other digital storage methods, which can be used directly by the computerized device. This eliminates the need for extraneous paper parts or bulky folders full of sheet music. Furthermore, any confusion about which is the most current or correct version of a musical score is eliminated. An entire music catalog can now be placed in a back pocket.

[0022] The invention is illustrated in the figures of the accompanying drawings which are meant to be exemplary and not limiting, in which like references are intended to refer to like or corresponding parts, and in which:

[0023] FIG. 1 shows an exemplary network of computerized musical composition devices in accordance with one embodiment of the present invention;

[0024] FIG. 2 is a block diagram of an exemplary musical composition device in accordance with one embodiment of the present invention;

[0025] FIG. 3ais a perspective view of an exemplary musical composition device of FIG. 2;

[0026] FIG. 3bis a side view of the keyboard assembly of a first embodiment of the present invention with the keyboard in a closed position;

[0027] FIG. 3cis a side view of the keyboard assembly of a first embodiment of the present invention with the keyboard in an open position;

[0028] FIG. 3dis a top view of the keyboard assembly of a first embodiment of the present invention with the keyboard in a closed position;

[0029] FIG. 3eis a side view of the keyboard assembly of first embodiment of the present invention with the keyboard in an open position;

[0030] FIG. 3fis a side view of the keyboard assembly of a second embodiment of the present invention with the keyboard in a closed position;

[0031] FIG. 3gis a side view of the keyboard assembly of a second embodiment of the present invention with the keyboard in an open position;

[0032] FIG. 3his a top view of the keyboard assembly of a second embodiment of the present invention with the keyboard in a closed position;

[0033] FIG. 3iis a top view of the keyboard assembly of a second embodiment of the present invention with the keyboard in a closed position;

[0034] 15FIG. 3jis a side view of the keyboard assembly of a third embodiment of the keyboard of the present invention with the keyboard in a closed position;

[0035] FIG. 3kis a side view of the keyboard assembly of the third embodiment of the keyboard of the present invention with the keyboard in an open position;

[0036] FIG. 3lis a top view of the keyboard assembly of the third embodiment of the keyboard of the present invention with the keyboard in a closed position;

[0037] FIG. 3mis a top view of the keyboard assembly of a third embodiment of the keyboard of the present invention with the keyboard in an open position;

[0038] FIG. 3nis a perspective view of the musical composition device of FIG. 3amounted on a music stand;

[0039] FIG. 4 is a flow chart showing an exemplary process of leading an orchestra using the system shown in FIG. 1;

[0040] FIG. 5 is an exemplary screen display for the device of FIGS. 2 and 3 showing an exemplary set of active control buttons; and

[0041] FIGS. 6a-6cand 7a-7brepresent exemplary sequences of screen displays generated during operation of one embodiment of the present invention.

[0042] Preferred embodiments of the present invention are now described with reference to the drawings in the Figures.

[0043] Referring to FIG. 1, a schematic diagram of an example orchestral configuration is presented with a single conductor station 102 and six musician stations, 104, 106, 108, 110, 112, and 114. The conductor station 102 is connected to the musician stations 104-114 by a computer network 120, which may be based on one of a number of networking technologies such as the Internet, a proprietary networking protocol such as the Token Ring system, or a wireless networking technology. These stations may be located in relatively close proximity or may be located at any distance from each other.

[0044] Referring to FIG. 2, a block diagram of the conductor station is presented. The conductor station includes a general purpose central processing unit (CPU) 204 that is connected to a memory 202 and one or more input/output devices 206. The CPU 204 is also connected to an integrated keyboard and MIDI interface 208 that provides input from an integrated alphanumeric keyboard and musical keyboard, described hereinbelow, or other musical device interface. Also connected to the CPU 204 is a network interface 212 used to access the other musician stations 104-114 on the network 120, and enables the conductor to transmit and receive information from the other musician stations 104-114 using a communications interface 218. Connected to the CPU 204 is a handwriting recognition system 210 that processes pen strokes to determine music edits, system commands, and other user input.

[0045] Executing on the CPU 204 are several software modules. The conducting module 216 provides program features for composing and conducting music and distributing the musical score to musicians on the network. Accessible to the conducting module is a general music score editing program 214 such as the FINALE system, described hereinabove. Underlying the system and connected to the conducting module and the music editor is a composition database 220 that may contain musical data such as musical compositions, scores, parts, and other information.

[0046] With reference to FIG. 3a, a generalized exemplary music composition device is shown. The machine includes a display screen 312, which is a touch screen capable of detecting handwritten input made by a stylus or digital pen 310. The stylus 310 may be connected to the system 102 by a connecting wire or via a wireless system such as an infrared communication system. The display screen 312 shows musical score pages 314 as well as command icons 316 that activate various system functions. These buttons are context sensitive in that they change when the system is performing different functions or operating in different modes. Integrated into the device is a carrying handle 30, a floppy diskette 304, a removable media storage device such as a ZIP drive 306 or other magnetic or optical storage device. A mouse 308 or other pointing device is also provided that may be used to operate the system.

[0047] The device also includes an integrated keyboard assembly that integrates an alphanumeric keyboard 318, such as typically used with a computer, with a musical keyboard 322. In one embodiment of the present inventions, the alphanumeric keyboard 318 and musical keyboard 322 may be connected by a sliding track 320 that allows the musical keyboard to slide into the alphanumeric keyboard. Additional embodiments of the keyboard assembly are described hereinbelow.

[0048] With reference to FIGS. 3b-3e, a first embodiment of a keyboard of the present invention is described. In FIG. 3bthe keyboard is shown in the closed position with the musical keyboard 322 slid under or into the alphanumeric keyboard 318 along a guide or track 320. FIG. 3cshows the keyboard in the open position with the musical keyboard 322 extended along the track 320 of the alphanumeric keyboard 318, so that both keyboards are simultaneously accessible. FIG. 3dshows a top view of the keyboard with the musical keyboard 322 slid into the alphanumeric keyboard 318; and, FIG. 3eshows the same top view with the musical keyboard 322 extended from the alphanumeric keyboard 318.

[0049] With reference to FIGS. 3f-3g, a second embodiment of a keyboard of the present invention is described. In FIG. 3fthe keyboard is shown in the closed position with the musical keyboard 322 folded over the alphanumeric keyboard 318 by a hinge or other attachment 324. FIG. 3gshows the keyboard in the open position with the musical keyboard 322 attached to alphanumeric keyboard 318 by the hinge in the open position 320, so that, once again, both keyboards are simultaneously accessible. FIG. 3dshows a top view of the keyboard with the musical keyboard 322 folded onto the alphanumeric keyboard 318; and, FIG. 3eshows the same top view with the musical keyboard 322 folded open from the alphanumeric keyboard 318.

[0050] It is hereby noted that in the above descriptions, in which the musical keyboard 318 is the movable component, the order of coupling of the musical keyboard 318 and the alphanumeric keyboard 322 may be switched such that the alphanumeric keyboard 322 is the movable component. For example, with respect to FIGS. 3b-3ethe alphanumeric keyboard 322 may slide into the musical keyboard 318, and with respect to FIGS. 3f-3ithe alphanumeric keyboard 322 may fold onto the musical keyboard 318.

[0051] With reference to FIGS. 3j-3m, a third embodiment of the musical portion of the keyboard assembly of the present invention is described. This configuration, called a ‘butterfly’, permits a musical keyboard 322 that is wider than the alphanumeric keyboard 318. With reference to FIG. 3jthe butterfly keyboard is shown in the closed position where the keyboard 322 is segmented into a center portion 328 and two side portions 330, also called wings, that are joined by two hinges 326. FIG. 3kshows the butterfly keyboard in the open position with the two wings 330 opened to be level with the center portion 328 to form a single wide keyboard 322. FIG. 31 shows a top view of the butterfly keyboard 322 with hinges 326 in the closed position and the wings 330 folded onto the alphanumeric keyboard 318; and, FIG. 3eshows the same top view with the butterfly keyboard 322 folded open from the center portion of the keyboard 318.

[0052] With reference to FIG. 3n, the music display system 102 is described mounted by a joint, adapter, or threaded screw 334 on top of a music stand or lectern 332. In one embodiment of the present invention the joint 334 enables the music display system 102 to tilt and swivel so that a comfortable viewing angle may be produced.

[0053] With reference to FIG. 4, a flow diagram describing the general operation of the system is presented. In step 402 the conductor selects a composition, or alternately creates a new composition. The composition will include one or more score parts, each score part corresponding to a musician and associated musician station in the orchestra. The conductor associates or registers the part with the corresponding musician or musician station in step 404. Alternatively, the musicians preregister their identity and/or instrument and station ID, which data is sent to and stored in the conductor's station for use and access by the conductor in selecting musicians stations to receive changes, e.g., by selecting an option to send changes only to those instruments affected by the changes. The system then can store the association so that the conductor is not required to reenter the association information. The conductor then selects a part, step 406, that corresponds to an individual musician or a group of musicians, in order to view, modify or transmit that score part. Once the score part is selected, the conductor can process the part using editing marks that are recognized by the handwriting system, step 408. The conductor then chooses whether to convert the handwritten changes to digital music format, step 410. If the conductor decides to finalize the handwritten edit changes, the system recognizes and converts the handwritten edit markings into digital music notation in step 412. The conductor then chooses which musician stations will receive the changes, e.g., all stations or just stations associated with affected instruments, step 414. The changes are then transmitted to the one or more selected musician stations on the network at step 416. The resulting changes to the musical score can also be saved in step 416.

[0054] With reference to FIG. 5, a detail view of the editing screen of the conductor system is shown. This screen display shows two pages of a musical score 314, drawn schematically. Below the musical score display 314 are a set of icons or buttons 316 that provide system functionality. In the example, screen six buttons 336-346 are active, although a greater or smaller number may be present and the location of the buttons 316 may vary. The text or symbols on the buttons 316 change when the system is executing different processes or modules. The six buttons in the present view, described from left to right are: a button that transmits the score to all musicians 336; a button that sends the score to a selected group of musicians 338, a button that sends the score to an individual musician 340. The next button 342, when selected, converts handwritten score changes into a digital music notation format. The next button 344 displays the previous score page, and the last button 346 displays the next score page.

[0055] With respect to FIGS. 6a-6c, an example of a simple music edit is described. FIG. 6ashows the abstracted score 314 on the display 312 of the present invention with a music note 350 displayed. In FIG. 6b, a handwritten music annotation 352, in this case an annotation to delete note 350 of the score 314 on the display 312, is shown. In FIG. 6c, the handwritten annotation 352 has been converted to digital music notation and note 350 is deleted from the score 314 on the display 312.

[0056] With respect to FIGS. 7a-7b, an example of adding a musical note is shown. In FIG. 7a, a hand drawn whole note 360 is drawn by the conductor on the score 314 on the display 312. In FIG. 7b, the whole note 350 is shown on the score 314 of the display 312 after it has been converted into a digital musical notation format.

[0057] While the invention has been described and illustrated in connection with preferred embodiments, many variations and modifications as will be evident to those skilled in this art may be made without departing from the spirit and scope of the invention, and the invention is thus not to be limited to the precise details of methodology or construction set forth above as such variations and modification are intended to be included within the scope of the invention.