Converting program-specific virtual machine instructions into variable instruction set

[0002] The invention relates to a method for executing a source program on a processing unit comprising a predetermined microcontroller core for executing native instructions from a predetermined set of micro-controller specific instructions; the method comprising:

[0003] a pre-processing step of expressing program statements of the source program in a sequence of instructions comprising virtual machine instructions; and storing the sequence of instructions in an instruction memory; and

[0004] an execution step of fetching instructions from the instruction memory; using conversion means of the processing unit to convert virtual instructions fetched from the instruction memory into native instructions; and feeding the native instructions to the microcontroller core for execution.

[0005] The invention further relates to a processing unit for executing instructions of a virtual machine, the instructions being referred to as virtual machine instructions; the processing unit comprising:

[0006] a predetermined microcontroller core for executing native instructions from a predetermined set of micro-controller specific instructions; the native instructions being different from the virtual machine instructions;

[0007] an instruction memory for storing instructions including at least one of the virtual machine instructions;

[0008] a converter comprising conversion means for converting a virtual machine instruction fetched from the instruction memory into at least one native instruction for execution by the microcontroller core.

[0009] Increasingly, source programs are expressed in (compiled to) instructions of a virtual machine instead of native instructions of a microcontroller core on which the program is to be executed. A main reason for using a virtual machine is portability of programs between different machines (platforms). A program expressed in the virtual machine instructions of the virtual machine can be executed relatively easily on several concrete machines, using suitable interpreters operating on those machines. At this moment a driving force for using portable programs is Java, where Java programs are exchanged via Internet and can be executed on different native machines using processors with different instruction sets. Using a compiler, Java programs are expressed in Java byte codes (JBCs), which form the instructions of the Java Virtual Machine. The resulting code is usually referred to as a Java applet.

[0010] Conventionally, programs expressed in virtual machine instructions are executed by means of software interpretation. The processor (CPU) executes a special interpreter program, where in a loop the processor fetches a virtual machine instruction, decodes it into a sequence of native instructions of the microcontroller core of the processor and executes each native instruction. This technique is slow and requires an additional interpreter program, which can be relatively large. To improve the execution speed, the so-called Just-In-Time (JIT) compilation technique is used. Just before starting execution of software module expressed in virtual machine instructions, the module is compiled to native code (i.e., expressed in native machine instructions). In this way, the module needs to be stored twice in addition to the code for the compiler. The additional storage requirements of software interpretation are not desired for embedded systems. To avoid performance and storage overhead, it is preferred to use a hardware interpreter. In itself a hardware interpreter is known in the form of a Prolog pre-processor for Warren's abstract instruction set. In the paper “A Prolog pre-processor for Warren's abstract instruction set” by B. Knödler and W. Rosenstiel, Microprocessing and Microprogramming 18 (1986) pages 71-81, a pre-processor is described for interpreting programs written in the Prolog programming language on a Motorola 68000 processor (MC68000). A compiler is used to translate the Prolog source program into instructions, which have been defined by Mr. Warren and which are generally used for executing Prolog programs. The set of Warren instructions forms a virtual machine designed for executing Prolog programs. The sequence of Warren instructions resulting from the compilation are loaded into RAM and executed by the MC68000 with the aid of the pre-processor. After power-on, the MC68000 first performs a booting procedure by executing native MC68000 instructions. At the end of the booting procedure, the MC68000 is ready to initiate the execution of a Prolog program. This is started by jumping to a predetermined address range. The pre-processor is a memory-mapped device, which is mapped to this range. When the pre-processor is addressed it reads a Warren instruction (of the translated Prolog program) from its own RAM, adaptively synthesizes a sequence of MC68000 instructions and constants and sends these directly to the CPU for execution. The MC68000 instructions for each Warren instruction are stored in ROM of the pre-processor. In general, the pre-processor translates one Warren instruction into a sequence of MC68000 instructions. The pre-processor contains its own RAM controller and ROM controller, which generate the addresses for the RAM and ROM of the pre-processor. The RAM controller manages the RAM instruction pointer. Each successive read operation of the MC68000 results in the pre-processor sending the next instruction (and optional constants) of the sequence to the CPU. If the sequence has been completed, a next read operation results in the first instruction of the sequence corresponding to the next Warren instruction of the program being send to the CPU. The known pre-processor supports one virtual machine (the Warren machine).

[0011] It is an object of the invention to provide a method and processing unit of the kind set forth which is more flexible. It is a further object of the invention to provide a method and processing unit of the kind set forth wherein the program is represented in a more compact form.

[0012] To meet the object of the invention, the method is characterised in that the method comprises the steps of defining for the program statements of the source program a program-specific virtual machine with a corresponding set of virtual machine instructions, such that the expression of the program statements in the sequence of instructions requires less storage space in the instruction memory compared to using only native instructions for expressing the program statements;

[0013] defining for the program-specific virtual machine an associated conversion means for converting virtual machine instructions of the program-specific virtual machine into native instructions of the microcontroller core; and

[0014] representing the associated conversion means in the processing unit. According to the invention, a program-specific virtual machine is defined for a program such that the program can be expressed in a form which is more compact than if the program was expressed in native instructions of the core. Also an associated conversion means is defined. The conversion means may for instance be implemented using a conversion table or microcode stored in ROM or dedicated logic, such as a PLD. The defined conversion means is represented in the processing unit. In this way, fast execution of the program is maintained, whereas at the same time a compact representation is achieved. This method is particularly suitable for use with embedded applications. In this case, the source program relates to all program statements initially represented in the embedded system (for instance, the program present in the system when the user purchases the system). The program may be stored in a permanent memory, such as ROM, or stored in a reprogrammable memory, such as EEPROM. For embedded applications it is highly desired that the code used to represent the embedded application program is compact and that the performance in executing the code is good. Typically, processing units used for embedded applications are based on a family concept, where for a specific application a processing unit is created from a given microcontroller core and I/O or storage components required for the application. It is desired to make no or at least no significant modifications to the core or the components in order to reduce costs. According to the invention, on the one hand virtual machine instructions are defined specifically for the program, giving full flexibility in achieving code compaction, whereas on the other hand an off-the-shelf core is used for executing the program. The required conversion from virtual machine instructions to native instructions is performed by a conversion means, which can be seen as a kind of pre-processor.

[0015] The article “Optimizing an ANSI C Interpreter with Superoperators”, Todd A. Proebsting, POPL'95:322-332, 1/95 describes the use of superoperators as an optimisation technique for byte coded interpreters. As a first step a compiler is used to express the program in virtual machine instructions. The virtual machine instruction are chosen such that the representation of the program using the virtual machine instructions is more compact. An example of such a virtual machine is a stack machine, which is known for its compact representation. Next, sequences of virtual machine instructions which occur frequently in the compiled code are identified and replaced by newly defined additional virtual machine instructions, where, for instance, one new instruction (a so-called superoperator) replaces a sequence of four existing instructions. A superoperator can also be defined, by during the parsing phase of the compiler, identifying most frequently occurring terms in the expression tree which is built during an intermediate representation in the compiler. Only a limited number of superoperators are defined, e.g., well less than 256. This allows a compact encoding of the superoperators (e.g., using a single byte code). Part of the code range is then assigned for representing the original virtual machine instructions and part of the range is used for representing newly added virtual machine instructions representing the superoperators. By using only 20 superoperators already a significant code compaction can be achieved. The virtual machine instructions are interpreted using a software interpreter running on a MIPS R3000 or SPARC processor. No use is made of a hardware interpreter which in combination with a given embedded microcontroller core provides code compaction of a given embedded application program without a performance penalty.

[0016] In an embodiment of the invention, a good level of code compaction can be achieved for different groups of program statements. Preferably, program statements relating substantially to a same subset of native instructions are grouped together and a virtual machine is defined for such a group. For instance, a different virtual machine may be defined for integer operations than for floating point operations. It is preferred to group program statements which relate to substantially the same subset of native instructions but use the instructions at a substantially differing frequency, allowing the definition of special virtual machine instructions for the most frequently occurring (sequences of) instructions. For a multi-tasking system, preferably program statements of one task are associated with one virtual machine. This simplifies development of the embedded program, since usually program statements for one task are produced under supervision of one engineer and in this approach the supervisory role can be extended to include the supervision over the production of compacted code and an associated conversion means. Depending on the chosen implementation, selection of the conversion means associated with the virtual machine instruction to be executed could incur a delay of the execution. Instead of then selecting a conversion means for individual virtual machine instruction, the overhead may be reduced by switching the conversion means as part of the task switching. As long as then the same tasks executes uninterrupted, no overhead is involved in selecting the appropriate conversion means. It will be appreciated that the same virtual machine may also be used for several tasks which use a similar mix of native instructions in a similar frequency. On the other hand, if the program for a task comprises more than one program module, where at least two of the program modules relate substantially to different subsets of native instructions or use instructions of a similar subset of instructions in substantially different frequencies, then it is preferred to use different virtual machines for those modules. Similarly, if an object-oriented programming technique is used, a virtual machine may be defined for each or a group of similar objects.

[0017] In another embodiment, an instruction module and conversion data for converting the instructions of the module to native instructions is received. For instance, the processing unit may be supplied with an additional or replacement program module. The supply may be local, e.g., by adding or replacing a ROM with the program module, or loading the program module from a portable storage medium, such as a floppy disk, into a programmable memory. The supply may also take place via a network, either a local area network or a wide area network, such as Internet. Increasingly, it is desired that embedded systems are ‘open’ to accept additional software or software which replaces part of the existing software at a stage after the initial programming of the system. Where the initial software was optimally compressed using a dedicated virtual machine, using this machine for the newly received code will not always give good results or could even be impossible. Even, if the supplier of the original software also supplies the new software, the nature of the software may be different, implying that a better compaction can be achieved by defining a separate virtual machine for the new software. Increasingly, the received software will be of an entirely different nature than the original software. As an example, the new software may be a Java applet expressed in Java bytecodes, whereas the original software was written in “C” and optimally compiled to a virtual machine matching the original program together with a corresponding conversion means. It will be understood that the defined conversion means can not be used for converting the Java bytecodes since these codes are expressed using a different virtual machine.

[0018] To meet the object of the invention, the processing unit is characterised in that the converter is operative to perform the conversion for a plurality of different virtual machines.

[0019] For instance, an embedded system may initially be supplied with an embedded program expressed using one virtual machine, which preferably is defined for the specific program. At a later stage a software update is required, replacing substantially all or a part of the software or adding a software module. For the entire application program which is then created it may be desired to use a new virtual machine which better reflects the then valid program (which may still contain parts of the old program as well). Particularly, since the required amount of software tends to grow over time a higher level of code compaction (reflected by a different virtual machine) may be required for the newly created application program. In this way, different virtual machines are used over time, where at each moment in time only one virtual machine is used. Alternatively, as described above, different virtual machines may be used at the same time for different parts of an embedded application program. Different virtual machines may also be used for programs of a different origin, such an embedded program written in “C” and compacted using a program-specific virtual machine and an program, such as a Java applet, expressed using a different and usually predetermined virtual machine. It will be appreciated that also multiple virtual machines may be present in the processing unit at the same time, where over time new virtual machines are added or existing virtual machines are replaced.

[0020] In an embodiment of the processing unit, the conversion means is of a re-programmable type. This allows ‘downloading’ of a new conversion means into the processing unit whenever a new program is loaded. The re-programmable conversion means may, for instance, be implemented using a re-programmable conversion table or microcode, e.g., stored in (E)EPROM, or using dedicated re-programmable logic, such as an E-PLD.

[0021] In an embodiment of the processing unit, the converter comprises dedicated conversion means for each one of the virtual machines. In this embodiment, the processing unit is created with several dedicated conversion means. In principle it is possible to use one large virtual machine with one corresponding conversion means. By using several virtual machines more compact code can be achieved. For instance, assume that an embedded program is formed by two program modules of which one module is mainly involved with user interface aspects of the embedded system, requiring mainly native integer instruction, whereas the second module is mainly involved with signal processing, requiring mainly floating point instructions. Assuming further that optimal virtual machines for each of the two modules comprise 256 virtual machine instructions each, the program modules are expressed using 8-bit codes. One virtual machine covering both modules can be made by combining the instruction of the two virtual machines, giving up to 512 virtual machine instructions (at least more than 256). Consequently, the code size will increase since now 9-bit codes are required. Such an increase can usually not be compensated by the fact that a combined conversion table may be smaller than two separate conversion table, due to a possible overlap in instructions.

[0022] In an embodiment of the processing unit, the converter distinguishes between conversion means for different virtual machines based on the location in the instruction memory where the virtual instruction to be executed is stored. For instance, if besides native instructions also virtual machine instructions of two different virtual machines are used, the memory may be subdivided into three regions; one region for each type of instruction. By determining in which region the address of the instruction to be executed lies, the converter can easily detect whether or not conversion is required (native instruction need not be converted) and which conversion means should be used for the conversion.

[0023] In an embodiment of the processing unit, a separate indicator (e.g., one or more bits) is used to differentiate between the native and the virtual machine and/or between different virtual machines. A separate indicator may be used for each instruction. Alternatively, one global indicator (e.g., a register) may be used which is set each time a change of machine occurs.

[0024] In an embodiment of the processing unit, one virtual machine instruction is converted into one corresponding native instruction, which is coded more compactly. In this way, the conversion can be very simple.

[0025] In an embodiment of the processing unit one virtual machine instruction is converted into a predetermined sequence of a plurality of native instructions, giving a further level of compaction. A sequencer is used to control the feeding of the sequence of native instructions to the microcontroller core, for instance by inhibiting an increment of the instruction pointer (program counter) of the microcontroller while the sequence is being fed and enabling an increment when a sequence has been completed. Alternatively, the processing unit comprises an instruction fetcher for fetching an instruction from the instruction memory under control of its own instruction counter. Whenever a sequence has been completed, changing of the counter is enabled, and the instruction counter is set to a different value in response to a change of an instruction pointer (program counter) of the microcontroller core. While a sequence is being processed, a change of value of the instruction counter is inhibited.

[0026] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments shown in the drawings.

[0027] FIG. 1 illustrates four possible architectural options of locating the converter in the processing unit;

[0028] FIG. 2 illustrates the process of defining the virtual machine and associated converter;

[0029] FIG. 3 illustrates the process for a program formed of several coherent groups of program statements; and

[0030] FIG. 4 shows a block diagram of the converter;

[0031] FIG. 1 illustrates four possible architectural options of locating the converter in the processing unit 100. Three main components of the processing unit 100, are the microcontroller 110, the instruction memory 120 and a pre-processor 130. The pre-processor 130 comprises the converter 132. In all shown figures the microcontroller 110 comprises the instruction memory 120 and the pre-processor 130. As such, the processing unit 100 is not shown explicitly. By combining all main elements in the microcontroller 110, which preferably is a one-chip device, optimum performance can be achieved. It will be appreciated that, if desired, the instruction memory 120 and/or the pre-processor 130 may be located outside the microcontroller 110, where the microcontroller bus 140 is extended outside the microcontroller 110 and, for instance, coupled to an external bus such as PCI.

[0032] The instruction memory 120 contains virtual machine instructions, such as instructions for a stack machine. The instruction memory may also be used for storing data. The invention is not limited to Harvard architecture, wherein data and instructions are separate. The microcontroller 110 comprises a processor 112 with a predetermined microcontroller core 114, referred to as a native machine, for executing native instructions from a predetermined set of microcontroller specific instructions. An example of a microcontroller suitable for executing embedded software is a RISC-type microcontroller, like the MIPS PR3001 range of microprocessors. The processor may comprise an instruction cache 116 for storing native instructions before executing the instructions. The native instructions of the microcontroller core 114 are different from the virtual machine instructions of the virtual machine. As such the microcontroller 110 is not able to directly execute virtual machine instructions stored in the instruction memory 120. In response to the processor 112 requesting an instruction, the pre-processor 130 issues the native instruction. In order to be able to generate the native instruction the pre-processor 130 may fetch a virtual machine instruction from the instruction memory 120 using fetching means 134. The converter 132 of the pre-processor 130 is used for converting a virtual machine instruction, fetched from the instruction memory 120, into at least one native instruction. In general, a virtual machine instruction is converted into a sequence of native instructions. The pre-processor 130 further comprises a feeding means 136 for feeding native instructions of the sequence to the microcontroller core 114 for execution. When executing a virtual machine program the microcontroller 110 in fact executes a native program generated by the pre-processor 130. Where normally an instruction pointer of the microcontroller 110 indicates the next instruction in the instruction memory 120 required by the microprocessor 110 to be executed next, now the instruction pointer indicates to the pre-processor 130 that a next native instruction is required (or a re-feeding of a previous instruction). Consequently, the pre-processor 130 manages an independent virtual machine instruction pointer indicating the current (or next) virtual machine instruction in the instruction memory 120. The microcontroller does not require (explicit) knowledge of the virtual machine instruction or the virtual machine instruction pointer.

[0033] In FIG. 1A the main components of the processing unit are interconnected via a general peripheral interconnect bus 140, such as the PI bus. The pre-processor 130 is a peripheral on the bus. The pre-processor 130 may act as a memory-mapped peripheral, where a predetermined range of addresses is allocated to the pre-processor. In response to the processor 112 issuing on the bus 140 a request for an instruction with an address in this range, the pre-processor 130 issues the native instruction on the bus 140. When required, the pre-processor 130 fetches a virtual machine instruction from the instruction memory 120 via the bus 140.

[0034] In FIGS. 1B and 1C, the pre-processor 130 is located in between the processor 112 and the instruction memory 120. If the pre-processor 130 needs to distinguish between native and virtual machine instructions, these configurations may delay execution of native instructions stored in the instruction memory 120. For reasons of clarity not all elements shown in FIG. 1A are repeated in FIGS. 1B, 1C and 1D.

[0035] In FIG. 1D, the pre-processor 130 is embedded in the processor 112. The pre-processor 130 is preferably located between an instruction cache 116 of the processor 112 and the core 114. This configuration allows for optimal performance but, unlike the configurations of FIGS. 1A, 1B and 1C, requires changes to the microcontroller 110 and, as such, the pre-processor 130 can not as an off-the-shelf design be used for different types of processors with the same type of core 114.

[0036] In a pre-processing step, a program-specific virtual machine with a corresponding set of virtual machine instructions is defined for the program statements of a source program, which needs to be executed by the processing unit 100. Furthermore, for the program-specific virtual machine an associated converter 132 is defined for converting virtual machine instructions into native instructions of the microcontroller core. The converter 132 provides for each of the virtual machine instructions one or, usually, a sequence of corresponding native instructions required for executing the virtual machine instruction of the native core 114. FIG. 2 illustrates the process of defining the virtual machine and associated converter. In step 205 the source program 200 is analysed. Based on the analysis (e.g., frequency of occurrence of operations), in step 210 a program-specific virtual machine 215 is defined. In step 220 for the virtual machine an associated converter 225 is defined and in step 230 the source program is expressed in instructions of the virtual machine resulting in code 235. The virtual machine is defined such that the code requires less storage space in the instruction memory compared to using only native instructions for expressing the program statements.

[0037] Preferably, the program-specific virtual machine is defined by translating the program to virtual machine instructions of a predetermined virtual machine. As a starting point a virtual machine, such as a stack machine, is chosen which is known to give a compact representation. Due to the fact that a stack machine does not use explicit registers for storing operands, but instead operands are stored on the stack and operators always act on top element(s) of the stack, the number of operands which can be used is less restricted and management of the operands is simpler for a stack machine. This makes it easier to build a compiler for a stack based machine than for a register based machine. Furthermore, stack machine instructions tend to have a simpler structure than most register based machines. However, it will be appreciated that also a suitable register based machine may be used. To illustrate the invention, the stack machine of Annex A is used. A sample program (which solves the eight queens problem) written in the “C” programming language is shown in Annex B. The translation of the program to stack code of the virtual machine of Annex A is shown in Annex C. By analysing the code, frequently occurring sequences of instructions are identified and additional virtual machine instructions are defined, each representing one of the identified sequences. Annex D shows a list of suitable additional machine instructions. Such an additional machine instruction can be seen as a “super virtual machine instruction”. The program specific virtual machine is then formed by the basic instructions of Annex A in combination with the superinstructions of Annex D. Annex E shows the expression of the program of Annex B into the virtual machine of Annex A and D. Next, for the program-specific virtual machine an associated converter 132, as shown in FIG. 1, is defined for converting virtual machine instructions into native instructions of the microcontroller core. The converter 132 provides for each of the virtual machine instructions (in the example, for the combination of the instructions in Annex A and D) one or, usually, a sequence of corresponding native instructions required for executing the virtual machine instruction on the native core 114. Using this approach, compaction of the code is achieved by using relatively few virtual machine instructions (in the example, 38 basic instructions and 40 super instructions) allowing a short representation (e.g., 7 bits) for each non-parameterised instruction, compared to 16 or 32 bits usually used for representing native instructions. The use of the superinstructions also results in requiring fewer instructions to represent the program. In the example, expressing the program in the instruction of the basic virtual machine requires 356 statements. Using superinstructions reduces this to requiring 262 statements. This compares favourably to the situation where the program is expressed in native instructions, where for a MIPS processor 608 statements are required.

[0038] Preferably, a program specific virtual machine is defined in the following way. The source program is converted to an intermediate level representation of so-called expression trees based on a predetermined virtual machine. An expression tree is constructed of nodes representing basic operations of the virtual machine. The expression tree represents the computation resulting from performing the basic operations of the nodes of the tree in a given sequence (e.g., postfix order). The conversion of the program to expression trees may be performed using the parsing phase of a compiler, such as the ‘light “C” compiler 1 cc’ of Fraser and Hanson. Next the expression trees and coherent tree fragments (representing a sequence of operations) are identified. Each of the trees and fragments is a candidate to be represented by a superinstruction. Starting from the basic virtual machine instructions, the tree or tree fragment which gives most savings in code size is represented by a superinstruction. The superinstruction is added to the virtual machine. The program is expressed in the new set of virtual machine instructions to determine the saving. New superinstructions are added as long as still room is available for adding new instructions (e.g., if the virtual machine instructions need to be stored as bytes, the number of instructions is limited to 256) or until no saving are achieved any more. Finally, the source program is expressed in instructions of the program-specific virtual machine and conversion data is generated.

[0039] Once the program has been expressed in virtual machine instructions, the resulting code is stored in the instruction memory 120. For embedded systems, the code is usually stored in a ROM, which is mask-programmed, or a programmable ROM, such as a PROM or (E)EPROM. Similarly, the generated conversion data is represented in the converter 132 of the processing unit 100. The converter 132 may, for instance, be implemented using a conversion table or microcode stored in ROM. The converter 132 may also be implemented using logic, such as a PLD. For a re-programmable converter the same approach can be used based on the respective re-programmable techniques, such as (E)EPROM or E-PLD.

[0040] FIG. 3 illustrates a further embodiment according to the invention, wherein the source program 300, e.g., programmed in “C”, is split in step 310 into several coherent groups of program statements, such as program modules, objects or task-specific code. Shown are modules 312 and 316. It will be appreciated that no explicit splitting may be required and the source program may already be available in a suitable modular organisation. For each of the groups 312 and 316, a program group specific virtual machine is defined (step 330) with a corresponding set of virtual machine instructions in a way similar to steps 205 and 210 of FIG. 2. Shown are the respective virtual machines 332 and 336. In step 340, the program statements of the groups 312 and 316 are expressed in instructions of the respective virtual machines 332 and 336, resulting in the respective code modules 342 and 346. The code modules are stored in the instruction memory 120 in step 350. In step 360 for the program group specific virtual machines 332 and 336 respective conversion means 362 and 366 are generated for converting virtual machine instructions into native instructions of the microcontroller core. In step 370, the conversion means 362 and 366 are represented in the processing unit 100, for instance by programming a conversion table or logic in the processing unit 100. As a consequence, the converter 132 comprises a specific conversion means for each of the program groups. To enable the processing unit 100 to select the group-specific conversion means associated with a fetched virtual instruction, in step 390 selection data is stored in the processing unit. During execution a virtual machine instruction is fetched from the instruction memory 120. The selection data is then used to locate the conversion means associated with the virtual machine to which the virtual machine instruction belongs.

[0041] FIG. 4 shows a block diagram of the converter 132 wherein the converter 132 comprises several conversion means (shown are 400, 410 and 420). Each of the conversion means is used for converting virtual machine instructions of a specific virtual machine. It will be appreciated that the converter 132 may comprise fully autonomous conversion means, each capable of performing the full conversion. Alternatively, the converter 132 may use some shared logic under control of separate conversion data (such as a table) for each of the virtual machines. The processing unit 100 comprises the selection data 430. The selection data may be represented in any suitable way, e.g., stored in the instruction memory 120 or, if the conversion means is stored (partly) as data, stored in combination with the conversion means. The selection data 430 may also take the form of a register in the converter 132 loaded from a memory. Various forms of selection data may be used.

[0042] In a further embodiment, the address range of the instruction memory 120 is divided into several sub-ranges. An address sub-range is reserved for storing virtual machine instructions of only one virtual machine. Preferably, an address sub-range is also reserved for storing native instructions. Such native instructions may, for instance, be used to initialise the system or to allow certain software modules, such as drivers or special parts of the embedded software application, to be compiled to native instructions for optimal performance. In this embodiment the selection data indicates for each of the defined address sub-ranges which one of the conversion means 400, 410 or 420 should be used for converting an instruction fetched by the instruction fetcher 134 to native instructions. To this end, the converter 132 comprises a detector 440 for selectively directing an instruction fetched from a location in the instruction memory 120 to one of the conversion means 400, 410 or 420, based on the selection data. If also native instructions are stored in the instruction memory 120, the detector 440 ensures that these instructions are directly supplied to the feeder 136 for supply to the microcontroller core 114.

[0043] As an alternative to basing the decision on the address of the fetched instruction, the information may also be stored in direct association with the instruction. For instance one or more bits of each entry in the instruction memory 120 may be reserved to differentiate between virtual machines and/or between native code or virtual code. For instance, if only two virtual machines are used, where the instructions require 7 bit, an eighth bit can be used to indicate the virtual machine to which the instruction belongs and the associated conversion means. Obviously, this technique may be combined with differentiating based on addresses.

[0044] As a further alternative, the selection data may be stored in a register where the register is set to indicate a different conversion means each time a switch occurs between virtual machines. To set the register a special instruction (e.g., a form of a jump instruction) may be used. Such implementation-supporting instructions can be mixed with the virtual machine/native instructions in the instruction memory.

[0045] As described above, typically a virtual machine instruction is converted to a sequence of native instructions. To regulate the supply of instructions to the core, the processing unit 100 comprises a sequencer 450 coupled in between the converter 132 and the microcontroller core 114 for sequentially feeding the sequence of native instructions to the microcontroller core 114. The sequencer 450 may be implemented using conventional components, such as a counter, which may, for instance, be incremented as a result of a trigger from the microcontroller core indicating that a new instruction is required (e.g., an increment of the instruction counter of the core). In a conventional processing unit, a change of the instruction pointer (also referred to as program counter) of the microcontroller core results in the fetcher 134 fetching an instruction from the instruction memory 120 and the feeder 136 supplying the instruction to the microcontroller core 114. To break the link between automatically fetching and feeding, the processing unit 100 further comprises inhibiting means 460 for inhibiting fetching an instruction from the instruction memory during the feeding of the sequence.

[0046] It will be appreciated that the sequencing and inhibiting may be performed in several ways. In a further embodiment, the inhibiting means 460 is operative to perform the inhibiting by obstructing an increment of the instruction pointer of the microcontroller core 114. This may require a small modification to the core 114. For instance, an additional control line into the core 114 may allow selective inhibiting of the instruction counter, where the inhibiting means 460 inhibits the increment whenever instructions from the sequence are being supplied and enables an increment when a sequence has been fully supplied.

[0047] In an alternative embodiment, the instruction fetcher 134 maintains its own instruction counter 135, separate from the instruction pointer of the microcontroller core 112. The inhibiting means 460 controls when an increment (or more general a change) of the instruction pointer of the microcontroller results in a change of the instruction counter 135 of the instruction fetcher 134. Similar as described above, the inhibiting means 460 inhibits a change of the instruction counter 135 whenever instructions from the sequence are being supplied and enables a change when a sequence has been fully supplied. As a result of a change of the instruction counter 135, the instruction fetcher 134 will normally fetch a new instruction from the instruction memory 112, from an address indicated by the instruction counter. Advantageously, particularly in view of the compact representation of virtual machine instructions, the instruction fetcher 134 may fetch several instructions from the memory in one read operation (e.g., four one-byte instructions may be read as one 32-bit word). In this way, not every change of the instruction counter 135 needs to result in actually fetching a new instruction.

[0048] In a further embodiment according to the invention, a program module expressed in virtual machine instructions of a further virtual machine is received, e.g., via a network or from a local background memory. An example of such a program module is a Java applet. The received program module is stored in the instruction memory 120. To enable conversion of the further virtual machine instructions into native instructions also conversion data is received. The conversion data may for instance specify a conversion table for a table based conversion means or E-PLD programming data for a PLD based conversion means. The conversion data is stored in the processing unit for subsequent use by a further conversion means of the converter 132. To be able to select the appropriate conversion means during execution, also selection data is stored in the processing unit associating each further virtual machine instruction with the conversion data. During execution, for a fetched further virtual machine instruction the further conversion means is operated under control of the conversion data indicated by the selection data.

[0049] As described above, the converter 132 may comprise a table for converting a virtual machine instruction to a sequence of native instructions. A one dimensional table may be used, where each cell of the table comprises a sequence of native instructions for one corresponding virtual machine instruction. The cell number may correspond to the value of the corresponding virtual machine instruction. As an example, the sequence of native instructions for the Java integer addition (0×60) may be located in cell 96 (=0×60 in hexadecimal notation). Since the length of the sequence of native instructions may vary considerably for the various virtual instructions, preferably the sequences are located in a one-dimensional table without any explicit cells where the sequences immediately follow each other. Such a translation table 500 is shown in FIG. 5, where the implicit cell boundaries are indicated using dotted lines. In order to be able to locate a sequence for a virtual machine instruction a code index table 510 may be used, which for each virtual machine instruction (VMI 1 to VMI N) indicates the starting point of the corresponding sequence in the translation table 500. For the cell of the translation table 500 which corresponds to VMI 3 the related sequence 520 of native instruction NI 1 to NI M are shown.

[0050] A further example of a conversion is given for the Java byte code bipush n (used for sign extending byte n and placing the result on top of the stack). This virtual machine instruction consists of two bytes {0×16 and n}, where the first byte specifies the operation and the second byte provides the parameter n. The instruction may be converted to the following sequence of native MIPS instructions:

[0051] This example illustrates that a virtual machine instruction may be parameterised, where an operation code is followed by at least one operand. Advantageously, the converter 132 comprises a conversion table 500, where native instructions are represented either by the full code or by an instruction skeleton. As an example, the instruction addi $tosp, −4 (last instruction of the sequence of the previous example) contains no variable parts and may be located in full as a 4-byte entry in the table. The instruction ori $a0, $0, n (first instruction of the sequence of the previous example) contains a variable part and may be located in the table as a skeleton, not specifying the variable part (being n). Preferably, the entry in the table for an instruction skeleton is the same width as a full instruction (e.g., 4-bytes for a MIPS processor), allowing a uniform table. Further information may be located in the table (or in separate table(s)) for indicating how the unspecified part of the native instruction skeleton should be filled in. Advantageously, microprogramming is used to fill in the unspecified parts. The further information may then comprise or indicate micro code. It will be appreciated that it is advantageous to use for an instruction skeleton a same structure (width and composition) as for a full native instruction. However, other structures may be used as well.

[0052] If the virtual machine is a stack oriented machine, preferably the stack or at least the top elements of the stack are mapped onto registers of the microcontroller 110. In this way the memory stack (with the virtual machine stack) is mapped to the register stack. Assuming that registers $r1, $r2 and $r3 contain three successive elements of the memory stack, where initially $r1 corresponds to the first empty location of the memory stack (above the top of the stack), $r2 contains the top of the memory stack, and $r3 contains the second element of the memory stack, the Java byte code bipush n may be converted to the following sequence of native MIPS instructions:

[0053] ori $r1, $0, n

[0054] s11 $r1, $r1, 24

[0055] $sra $r1, $r1, 24

[0056] After this operation, $r1 contains the top of the memory stack. Similarly, the Java byte code (a virtual machine instruction) for integer addition (0×60) may be converted to the following sequence of MIPS instructions, starting from the same position where initially $r1 corresponds to the first empty location of the memory stack (above the top of the stack), $r2 contains the top of the memory stack, and $r3 contains the second element of the memory stack:

[0057] add $r3, $r2, $r3

[0058] After this operation, $r3 contains the top of the memory stack.

[0059] In above examples, preferably the position of the top of the memory stack (i.e., which register contains the top of the memory stack) is indicated using a register 138 of the converter 132. The converter uses the register 138, referred to as the Register Stack Pointer (RSP), to generate the appropriate native instructions. Preferably, microprogramming is used to specify the register operands of the native instructions. In this way also fixed native instructions have become variable, since the register operands need to be specified by the converter 132. Preferably, such operands are also stored in the translation table 500 using instruction skeletons. Assuming that RSP points to the first free register, the Java byte code bipush n may be converted to the following sequence of native MIPS instructions under control of the corresponding micro code:

[0060] where f_tgindicates the target register for the instruction, and f_a0, and f_a1indicate the first and, respectively, second argument register for the instruction. A following Java byte code iadd for adding the two top elements of the stack would result in the following micro code and instruction:

[0061] f_tg=rsp+2; f_aO=rsp+2; f_a1=rsp+1; rsp+=1 add $(rsp+2), $(rsp+1)

[0062] Annex A. Basic Virtual Machine Instructions

[0063] Annex B. Sample “C” program

[0064] C. Sample Program Expressed in Default Virtual Machine

[0065] Annex D Superinstructions

[0066] Annex E. Sample Program Expressed in Program-specific Virtual Machine