US 8,990,939 B2Grant
Systems and methods for scheduling analysis of network content for malware
Issue Date:2015-03-24
•48 Claims
•6 Drawing Sheets
Abstract
A system is described for scheduling the processing of items of suspicious network content to determine whether these items contain malicious network content. The system features a memory and an analyzer that may comprise a processor-based digital device in which at least one virtual machine (VM) and a scheduler operates. The scheduler is configured to generate an order of processing of a plurality of items of network content by the processor based on a plurality of probability scores, each corresponding to an item of network content. The analyzer is configured to process the items of network content in at least the virtual machine by replaying these items in accordance with the order of processing. The virtual machine is configured with a software profile corresponding to each of the processed items and being adapted to monitor behavior of each of the items during processing, thereby to detect malicious network content.
Metadata
Assignee
- FireEye, Inc.
Inventors
- Stuart Gresley Staniford
- Ashar Aziz
Application Information
Application Number:US 13/925,733
Filing Date:2013-06-24
Priority Date:2008-11-03
Art Unit:2493
Classifications
IPC:
H04L29/06G06F21/56
Field of Search:
H04L 63/1408H04L 63/145G06F 21/561G06F 21/566G06F 21/567
Patent Drawings (6 sheets)
Description
Cross-Reference to Related Applications
[0001] This application is a continuation of U.S. patent application Ser. No. 12/263,971. U.S. patent application Ser. No. 12/263,971 is related to co-pending U.S. patent application Ser. No. 11/409,355 entitled “Heuristic Based Capture with Replay to Virtual Machine” and filed on Apr. 20, 2006, which is a continuation-in-part of U.S. patent application Ser. No. 11/152,286 entitled “Computer Worm Defense System and Method” and filed on Jun. 13, 2005, which claims the priority benefit of U.S. Provisional Patent Application Ser. No. 60/579,910 entitled “Computer Worm Defense System and Method” and filed on Jun. 14, 2004. U.S. patent application Ser. No. 11/409,355 is also a continuation-in-part of U.S. patent application Ser. No. 11/096,287 entitled “System and Method of Detecting Computer Worms” and filed on Mar. 31, 2005, which claims the priority benefit of U.S. Provisional Patent Application Ser. No. 60/559,198 entitled “System and Method of Detecting Computer Worms” and filed on Apr. 1, 2004. U.S. patent application Ser. No. 11/409,355 is also a continuation-in-part of U.S. patent application Ser. No. 11/151,812 entitled “System and Method of Containing Computer Worms” and filed on Jun. 13, 2005, which claims the priority benefit of U.S. Provisional Patent Application No. 60/579,953 entitled “System and Method of Containing Computer Worms” and filed on Jun. 14, 2004. Each of the aforementioned patent applications are incorporated by reference herein.
Background
[0002] 1. Field of the Invention
[0003] The present invention relates generally to network security and more particularly to detecting malicious network content.
[0004] 2. Related Art
[0005] Presently, malicious network content (e.g., malicious software or malware) can attack various devices via a communication network. For example, malware may include any program or file that is harmful to a computer user, such as bots, computer viruses, worms, Trojan horses, adware, spyware, or any programming that gathers information about a computer user or otherwise operates without permission.
[0006] Adware is a program configured to direct advertisements to a computer or a particular user. In one example, adware identifies the computer and/or the user to various websites visited by a browser on the computer. The website may then use the adware to either generate pop-up advertisements or otherwise direct specific advertisements to the user's browser. Spyware is a program configured to collect information regarding the user, the computer, and/or a user's network habits. In an example, spyware may collect information regarding the names and types of websites that the user browses and then transmit the information to another computer. Adware and spyware are often added to the user's computer after the user browses to a website that hosts the adware and/or spyware. The user is often unaware that these programs have been added and are similarly unaware of the adware and/or spyware's function.
[0007] Various processes and devices have been employed to prevent the problems that malicious network content can cause. For example, computers often include antivirus scanning software that scans a particular client device for viruses. Computers may also include spyware and/or adware scanning software. The scanning may be performed manually or based on a schedule specified by a user associated with the particular computer, a system administrator, and so forth. Unfortunately, by the time a virus or spyware is detected by the scanning software, some damage on the particular computer or loss of privacy may have already occurred.
[0008] In some instances, malicious network content comprises a bot. A bot is a software robot configured to remotely control all or a portion of a digital device (e.g., a computer) without authorization by the digital device's legitimate owner. Bot related activities include bot propagation and attacking other computers on a network. Bots commonly propagate by scanning nodes (e.g., computers or other digital devices) available on a network to search for a vulnerable target. When a vulnerable computer is scanned, the bot may install a copy of itself. Once installed, the new bot may continue to seek other computers on a network to infect. A bot may also be propagated by a malicious web site configured to exploit vulnerable computers that visit its web pages.
[0009] A bot may also, without the authority of the infected computer user, establish a command and control communication channel to receive instructions. Bots may receive command and control communication from a centralized bot server or another infected computer (e.g., via a peer-to-peer (P2P) network established by a bot on the infected computer). When a plurality of bots (i.e., a botnet) act together, the infected computers (i.e., zombies) can perform organized attacks against one or more computers on a network, or engage in criminal enterprises. In one example, bot infected computers may be directed to flood another computer on a network with excessive traffic in a denial-of-service attack. In another example, upon receiving instructions, one or more bots may direct the infected computer to transmit spam across a network. In a third example, bots may host illegal businesses such as pharmaceutical websites that sell pharmaceuticals without a prescription.
[0010] Malicious network content may be distributed over a network via web sites, e.g., servers operating on a network according to an HTTP standard. Malicious network content distributed in this manner may be actively downloaded and installed on a user's computer, without the approval or knowledge of the user, simply by accessing the web site hosting the malicious network content. The web site hosting the malicious network content may be referred to as a malicious web site. The malicious network content may be embedded within data associated with web pages hosted by the malicious web site. For example, a web page may include JavaScript code, and malicious network content may be embedded within the JavaScript code. In this example, the malicious network content embedded within the JavaScript code may be obfuscated such that it is not apparent until the JavaScript code is executed that the JavaScript code contains malicious network content. Therefore, the malicious network content may attack or infect a user's computer before detection by antivirus software, firewalls, intrusion detection systems, or the like.
Summary
[0011] A method for detecting malicious network content comprises inspecting one or more packets of network content, identifying a suspicious characteristic of the network content, determining a score related to a probability that the network content includes malicious network content based on at least the suspicious characteristic, identifying the network content as suspicious if the score satisfies a threshold value, executing a virtual machine to process the suspicious network content, and analyzing a response of the virtual machine to detect malicious network content.
Brief Description of the Drawings
[0012] FIG. 1 is a diagram of an exemplary malicious network content detection environment 100.
[0013] FIG. 2 illustrates an exemplary analysis environment.
[0014] FIG. 3 illustrates an exemplary method for detecting malicious network content.
[0015] FIG. 4 illustrates another exemplary method for detecting malicious network content.
[0016] FIG. 5 illustrates an exemplary controller.
Description of Exemplary Embodiments
[0017] Network content may include any data transmitted over a network (i.e., network data). Network data may include text, software, images, audio, or other digital data. An example of network content includes web content, or any network data that may be transmitted using a Hypertext Transfer Protocol (HTTP), HyperText Markup Language (HTML) protocol, or be transmitted in a manner suitable for display on a web browser software application. Another examples of network content includes email messages, which may be transmitted using an email protocol such as Simple Mail Transfer Protocol (SMTP), Post Office Protocol version 3 (POP3), or Internet Message Access Protocol (IMAP4). A further example of network content includes Instant Messages, which may be transmitted using an Instant Messaging protocol such as Session Initiation Protocol (SIP) or Extensible Messaging and Presence Protocol (XMPP). In addition, network content may include any network data that is transferred using other data transfer protocols, such as File Transfer Protocol (FTP). We distinguish network content from network protocol header information used for addressing, routing, and otherwise delivering the network content.
[0018] To detect malicious network content (e.g., malicious web content) being transmitted over a communication network to a computing device, a virtual machine may be used to simulate the receipt and processing of network content on the receiving system. A determination may be made as to whether the network content is malicious based on a response of the virtual machine to the network content. Sometimes, suspicious network content is determined to be non-malicious. Processing the suspicious network content in a virtual machine is an important step to determine whether the suspicious network content is in fact malicious and prevent a false assumption that the suspicious network content is malicious. False positives in detecting malicious network content may be avoided by processing suspicious network content in a virtual machine and detecting malicious network content by analyzing the virtual machine's response to the suspicious network content.
[0019] In the prior art, a proxy may be used in the network between the computing device and a web server hosting the malicious network content. The proxy may intercept a request for network content issued by a web browser executing on the computing device. The proxy may then issue the request to the web server as a proxy on behalf of the computing device. The proxy may receive a response to the request from the web server. The proxy may then process a data exchange including the request and response on a virtual machine and evaluate the virtual machine's response to the data exchange to detect malicious network content. If no malicious network content is detected, the proxy may forward the requested network content to the computing device from which the original request originated.
[0020] Because each data exchange is processed using a virtual machine, this approach is highly computation intensive, and is not scalable for large numbers of computing devices on a network. Also, because the requested network content is not delivered to the computing device until after it has been determined that the requested network content does not include malicious network content, a significant delay is introduced between the request for network content and the delivery of the requested network content.
[0021] Provos et al. (N. Provos, P. Mavrommatis, M. A. Rajab, and F. Monrose, “All your iFRAMEs Point to Us,” Google Technical Report provos-2008a, Feb. 4, 2008) reported on an analysis of web malware using a large web repository and corpus of malicious URLs. Provos et al. collected data for the analysis by first using a machine-learning framework in a pre-processing phase to extract features from web pages in the web repository and translate the features into a likelihood score. Next, a virtual machine was used in a verification phase to verify candidates identified by the machine-learning framework. Approximately 0.1% of the web pages in the web repository were processed by the virtual machine in the verification phase. Provos et al. noted that exhaustive inspection of each URL in the repository is prohibitively expensive. The system used by Provos et al. relied on a crawler proceeding gradually through the web to gather data in the repository for inspection, and could not inspect and select web pages in transit in the network for examination in a virtual machine.
[0022] FIG. 1 is a diagram of an exemplary malicious network content detection environment 100. The malicious network content detection environment 100 comprises a server device 105, a client device 110, and a tap 115, each coupled to a communication network 120. In various embodiments, there may be multiple server devices 105 and multiple client devices 110. The tap 115 is further coupled to a malicious network content detection system 125. The malicious network content detection system 125 may monitor exchanges of network content (e.g., web content) rather than intercepting and holding the network content until after determining whether the network content includes malicious network content. The malicious network content detection system 125 may be configured to inspect exchanges of network content over the communication network 120, identify suspicious network content, and analyze the suspicious network content using a virtual machine to detect malicious network content. In this way, the malicious network content detection system 125 may be computationally efficient and scalable as data traffic volume and a number of computing devices communicating over the communication network 120 increase. Therefore, the malicious network content detection system 125 may not become a bottleneck in the malicious network content detection environment 100.
[0023] The communication network 120 may include a public computer network such as the Internet, or a private computer network such as a wireless telecommunication network, wide area network, or local area network, or a combination of networks. Though the communication network 120 may include any type of network and be used to communicate different types of data, communications of web data may be discussed below for purposes of example.
[0024] The server device 105 and the client device 110 may include digital devices. Some examples of digital devices include computers, servers, laptops, personal digital assistants, and cellular telephones. The server device 105 may be configured to transmit network data over the communication network 120 to the client device 110. The client device 110 may be configured to receive the network data from the server device 105. The network data may include network content, such as web pages transmitted using a network communications protocol (e.g., Hypertext Transfer Protocol, or HTTP). In various embodiments, the server device 105 may include a web server configured to provide network content. The client device 110 may include a web browser configured to retrieve and/or display network content.
[0025] The tap 115 may include a digital data tap configured to monitor network data and provide a copy of the network data to the malicious network content detection system 125. Network data may comprise signals and data that are transmitted over the communication network 120 including data flows from the server device 105 to the client device 110. In one example, the tap 115 monitors and copies the network data without an appreciable decline in performance of the server device 105, the client device 110, or the communication network 120. The tap 115 may copy any portion of the network data. For example, the tap 115 may receive and copy any number of data packets from the network data.
[0026] In some embodiments, the network data may be organized into one or more data flows and provided to the malicious network content detection system 125. In various embodiments, the tap 115 may sample the network data based on a sampling scheme. Data flows may then be reconstructed based on the network data samples.
[0027] The tap 115 may also capture metadata from the network data. The metadata may be associated with the server device 105 and/or the client device 110. For example, the metadata may identify the server device 105 and/or the client device 110. In some embodiments, the server device 105 transmits metadata which is captured by the tap 115. In other embodiments, a heuristic module 130 (described herein) may determine the server device 105 and the client device 110 by analyzing data packets within the network data in order to generate the metadata.
[0028] The malicious network content detection system 125 may include a digital device, software, or a combination thereof that receives network data from the tap 115. The malicious network content detection system 125 includes a heuristic module 130, a heuristics database 135, a scheduler 140, a virtual machine pool 145, and an analysis environment 150. In some embodiments, the tap 115 may be contained within the malicious network content detection system 125.
[0029] The heuristic module 130 receives the copy of the network data from the tap 115 and applies heuristics to the data to determine if the network data might contain suspicious network content. The heuristics applied by the heuristic module 130 may be based on data and/or rules stored in the heuristics database 135. In one example, the heuristic module 130 flags network data as suspicious after applying a heuristic analysis. The network data may then be buffered and organized into a data flow. The data flow may then be provided to the scheduler 140. In some embodiments, the suspicious network data is provided directly to the scheduler 140 without buffering or organizing the data flow. In other embodiments, a notification of a group of data flows (e.g., a set of related web page requests and responses) may be sent to the scheduler 140 for later retrieval by the virtual machine.
[0030] The heuristic module 130 may perform one or more heuristic analyses on the network data. The heuristic module 130 may retain data packets belonging to a particular data flow previously copied by the tap 115. In one example, the heuristic module 130 receives data packets from the tap 115 and stores the data packets within a buffer or other memory. Once the heuristic module 130 receives a predetermined number of data packets from a particular data flow, the heuristic module 130 performs the heuristics and/or probability analysis.
[0031] In some embodiments, the heuristic module 130 performs a heuristic analysis on a set of data packets belonging to a data flow and then stores the data packets within a buffer or other memory. The heuristic module 130 may then continue to receive new data packets belonging to the same data flow. Once a predetermined number of new data packets belonging to the same data flow are received, the heuristic analysis may be performed upon the combination of buffered and new data packets to determine a likelihood of suspicious network content.
[0032] In some embodiments, an optional buffer receives the flagged network data from the heuristic module 130. The buffer may be used to store and organize the flagged network data into one or more data flows before providing the one or more data flows to the scheduler 140. In various embodiments, the buffer is used to store network data until the network data is provided to the scheduler 140. In one example, the buffer stores the network data to allow other components of the malicious network content detection system 125 time to complete functions or otherwise clear data congestion.
[0033] In some embodiments, the heuristic module 130 may maintain copies of network content data of potential interest to virtual machines and provide the network content data on request (e.g., when a web browser later executes inside a virtual machine and requests entities that were transmitted on the network earlier). The length of time that the heuristic module 130 keeps this data in memory may be based on how suspicious the data is, how much workload the system is under, and/or other factors.
[0034] The scheduler 140 may identify the client device 110 and retrieve a virtual machine associated with the client device 110. A virtual machine is software that is configured to mimic the performance of a device (e.g., the client device 110). The virtual machine may be retrieved from the virtual machine pool 145. Furthermore, the scheduler 140 may identify a web browser running on the client device 110, and retrieve a virtual machine associated with the web browser.
[0035] In some embodiments, the heuristic module 130 transmits the metadata identifying the client device 110 to the scheduler 140. In other embodiments, the scheduler 140 receives one or more data packets of the network data from the heuristic module 130 and analyzes the one or more data packets to identify the client device 110. In yet other embodiments, the metadata may be received from the tap 115.
[0036] The scheduler 140 may retrieve and configure the virtual machine to mimic the pertinent performance characteristics of the client device 110. In one example, the scheduler 140 configures the characteristics of the virtual machine to mimic only those features of the client device 110 that are affected by the network data copied by the tap 115. The scheduler 140 may determine the features of the client device 110 that are affected by the network data by receiving and analyzing the network data from the tap 115. Such features of the client device 110 may include ports that are to receive the network data, select device drivers that are to respond to the network data, and any other devices coupled to or contained within the client device 110 that can respond to the network data. In other embodiments, the heuristic module 130 may determine the features of the client device 110 that are affected by the network data by receiving and analyzing the network data from the tap 115. The heuristic module 130 may then transmit the features of the client device to the scheduler 140.
[0037] The virtual machine pool 145 may be configured to store one or more virtual machines. The virtual machine pool 145 may include software and/or a storage medium capable of storing software. In one example, the virtual machine pool 145 stores a single virtual machine that can be configured by the scheduler 140 to mimic the performance of any client device 110 on the communication network 120. The virtual machine pool 145 may store any number of distinct virtual machines that can be configured to simulate the performance of a wide variety of client devices 110.
[0038] The analysis environment 150 simulates the receipt and/or display of the network content from the server device 105 after the network content is received by the client device 110 to analyze the effects of the network content upon the client device 110. The analysis environment 150 may identify the effects of malware or malicious network content by analyzing the simulation of the effects of the network content upon the client device 110 that is carried out on the virtual machine. There may be multiple analysis environments 150 to simulate multiple streams of network content. The analysis environment 150 is further discussed with respect to FIG. 2 .
[0039] Although FIG. 1 depicts data transmitted from the server device 105 to the client device 110, either device can transmit and receive data from the other. Similarly, although only two devices are depicted, any number of devices can send and/or receive data across the communication network 120. Moreover, the tap 115 can monitor and copy data transmitted from multiple devices without appreciably effecting the performance of the communication network 120 or the devices coupled to the communication network 120.
[0040] FIG. 2 illustrates an exemplary analysis environment. The analysis environment 150 includes a replayer 205, a virtual switch 210, and a virtual machine 215. The replayer 205 receives network content that has been flagged by the heuristic module 130 and provides the network content to the virtual machine 215 via the virtual switch 210 (i.e., replays the network content) in the analysis environment 150. In some embodiments, the replayer 205 mimics the behavior of the server device 105 in transmitting the flagged network content. There may be any number of replayers 205 simulating the transmission of network content between the server device 105 and the client device 110. In a further embodiment, the replayer 205 dynamically modifies session variables, as is appropriate, to emulate a “live” client or server of the protocol sequence being replayed. In one example, dynamic variables that may be dynamically substituted include dynamically assigned ports, transaction IDs, and any other variable that is dynamic to each protocol session.
[0041] The virtual switch 210 may include software that is capable of forwarding packets of flagged network content to the virtual machine 215. In one example, the replayer 205 simulates the transmission of the data flow by the server device 105. The virtual switch 210 simulates the communication network 120, and the virtual machine 215 simulates the client device 110. The virtual switch 210 may route the data packets of the data flow to the correct ports of the virtual machine 215.
[0042] In some embodiments, requests for data from client software in the virtual machine 215 (e.g., a web browser) may be proxied by the replayer to the heuristic module 130 where the data has been cached, and a response from the heuristic module 130 may then be proxied back to the client software executing in the virtual machine 215.
[0043] The virtual machine 215 includes a representation of the client device 110 that may be provided to the analysis environment 150 by the scheduler 140. In one example, the scheduler 140 retrieves an instance of the virtual machine 215 from the virtual machine pool 145 and configures the virtual machine 215 to mimic a client device 110. The configured virtual machine 215 is then provided to the analysis environment 150 where it may receive flagged network content from the virtual switch 210.
[0044] As the analysis environment 150 simulates the transmission and reception of the network content, behavior of the virtual machine 215 can be closely monitored for unauthorized activity. If the virtual machine 215 crashes, performs illegal operations, performs abnormally, or allows access of data to an unauthorized entity (e.g., an unauthorized computer user, a bot, etc.), the analysis environment 150 may react. In one example, the analysis environment 150 may transmit a command to the client device 110 to stop accepting the network content or data flows from the server device 105.
[0045] In some embodiments, the analysis environment 150 monitors and analyzes the behavior of the virtual machine 215 in order to determine a specific type of malware or malicious network content. The analysis environment 150 may also generate computer code configured to eliminate new viruses, worms, bots, adware, spyware, or other malware or malicious network content. In various embodiments, the analysis environment 150 generates computer code configured to repair damage performed by malware or malicious network content. By simulating the transmission and reception of suspicious network content and analyzing the response of the virtual machine 215, the analysis environment 150 may identify known and previously unidentified malware and malicious network content before a computer system is damaged or compromised.
[0046] FIG. 3 illustrates an exemplary method 300 for detecting malicious network content. In step 305, a packet of network content is intercepted or copied. The packet may be intercepted and/or copied from a network data transmission between the server device 105 and an intended destination (e.g., the client device 110), such as by the tap 115. Alternatively, the packet may be intercepted and/or copied from a network data transmission between the client device 110 and an intended destination (e.g., the server device 105). The packet may include a request for data, such as network content, or data provided in response to a request.
[0047] In step 310, a packet of network content is inspected. The heuristic module 130 may utilize one or more heuristics to inspect the packet of network content for suspicious network content which indicates the potential presence of malicious network content or malware within the packet.
[0048] A packet of network content may be part of a data flow which includes additional packets of network content. For example, the packet of network content may represent a portion of a web page, while other related packets in the data flow represent additional portions of the web page. The packet of network content may be stored along with the other related packets of network content comprising the data flow, such that multiple packets of network content within the data flow may be inspected in a sequence or in parallel. The malicious network content detection system may store the packets of network content and all or a portion of a data flow. The data flow and data packets may be stored for any length of time, from a few seconds to minutes, tens of minutes, or more, for analysis at any time.
[0049] To facilitate longer storage times for data flows over a high data rate communication network, large data objects comprised of numerous data packets may be truncated to a small subset of representative data packets. Data object truncation is particularly useful where network communication bandwidth is mostly utilized by a small percentage of large data objects, such as video. For example, video data may be truncated to a few data packets, such as the first few data packets. An extent to which the large data objects are truncated may be adaptive based on available memory, data bandwidth, type of data objects, and other factors. An amount of memory allocated to storing a data flow may also be dependent upon a characteristic of the data flow, such as data type. In an example, octet streams, text streams, HTML streams, and miscellaneous binary streams may be allocated 1 megabyte (MB). Images and PDF files may be allocated 384 kilobytes (kB). Video, audio, and most other data types may be allocated 128 kB. The memory allocated to storing each data flow type may be adjusted, periodically or dynamically, to improve analysis throughput while maintaining accuracy in detection of malicious network content and working within memory limitations.
[0050] In step 315, a suspicious characteristic of the network content is identified. The heuristic module 130 may identify the suspicious characteristic of the network content as a result of inspecting the network content in step 310. When a characteristic of the packet, such as a sequence of characters or keyword, is identified that meets the conditions of a heuristic used in step 310, a suspicious characteristic or “feature” of the network content is identified. The identified features may be stored for reference and analysis. In some embodiments, the entire packet may be inspected and multiple features may be identified before proceeding to the next step. In some embodiments, features may be determined as a result of an analysis across multiple packets comprising the network content.
[0051] Keywords used by heuristics may be chosen by performing an approximate Bayesian probability analysis of all the keywords in an HTML specification using a corpus of malicious network content and a corpus of non-malicious network content. The approximate Bayesian probability analysis may be based on the principles of the Bayesian theorem and/or naïve Bayesian classification. For instance, a probability Pm that the keyword appears in malicious network content may be computed using the corpus of malicious network content, while a probability Pn that the keyword appears in non-malicious network content may be computed using the corpus of non-malicious network content. A given keyword may be determined to be a suspicious characteristic for being associated with malicious network content if a score based on a computed ratio Pm/Pn exceeds a threshold of suspicion. The threshold of suspicion may be a value greater than 1, 10, 30, 60, 100, or some other number indicating how much more likely the suspicious characteristic is to indicate malicious network content than to indicate non-malicious network content.
[0052] In step 320, a score related to a probability that the suspicious characteristic identified in step 315 indicates malicious network content is determined. An approximate Bayesian probability analysis may be used to determine the score. In various embodiments, the approximate Bayesian probability analysis may be performed in real-time or using a look-up table based on a previously performed approximate Bayesian probability analysis.
[0053] For example, the approximate Bayesian probability analysis may be performed to determine a relative probability score that a particular feature is associated with the presence of malicious network content in a packet by comparing a corpus of malicious network content and a corpus of regular, non-malicious network content. A feature may include a characteristic of the packet, such as a sequence of characters or keyword, that meets the conditions of a heuristic used in step 310. The feature may also include a characteristic involving more than one packet inspected in sequence or in parallel. An example of a feature may include the character sequence “eval(unescape(”, which indicates a JavaScript “unescape” command nested within a JavaScript “eval” command argument. Further examples of features are described below with respect to step 445 in method 400. A probability Pflm that the feature is present in a packet of malicious network content is computed by analyzing the corpus of malicious network content. A probability Pflm that the feature is present in a packet of non-malicious network content is computed by analyzing the corpus of non-malicious network content. A malicious probability score is computed as the base two logarithm of a relative probability factor Pmlf that the feature is associated with malicious network content. The malicious probability score is computed by computing the ratio of the base two logarithm (log2) of the probability that the feature is present in a packet of malicious network content and the base two logarithm of the probability that the feature is present in a packet of non-malicious network content. The relative probability factor Pmlf may be expressed as follows:
log2(Pmlf)=log2(Pflm)/log2(Pfln) Equation 1
log2(Pmlf)=log2(Pflm)/log2(Pfln) Equation 1
[0054] The size of the result log2(Pmlf)(i.e., malicious probability score) may indicate the probability that the suspicious network content includes malicious network content. For example, a result of eleven may indicate that the feature is approximately two thousand times more likely to appear in malicious network content than in non-malicious network content. Likewise, a value of twelve may indicate that the feature is approximately four thousand times more likely to appear in malicious network content.
[0055] In some embodiments, the malicious corpus and/or the non-malicious corpus may be continuously updated in response to monitored network data traffic, and the malicious probability scores associated with the features may be continuously updated in response to the updates to the corpuses. In other embodiments, the corpuses may be created and used in advance to store pre-computed malicious probability scores in a look-up table for reference when features are identified. The features associated with significant probabilities of malicious network content may change as the corpuses change.
[0056] In step 325, malicious network content is identified or flagged if the malicious probability score of a feature computed in step 320 satisfies an analysis threshold. The analysis threshold may be greater than 1, 10, 30, 60, 100, 1000, 2000, or higher. The analysis threshold may be preset, or may be variable based on operating conditions of the malicious network content detection system 125. If the malicious probability score does not satisfy the analysis threshold, no action may be taken with regard to the feature associated with the malicious probability score. Otherwise, the analysis may proceed to the next step, such as step 330 for analysis through processing by a virtual machine, such as the virtual machine 215. In some embodiments, the malicious probability scores of all features computed in step 320 may be compared against the analysis threshold to assign a priority level to each feature and/or the packet as a whole. The priority level may be computed based on a variety of factors, such as the number of features identified in the packet, the highest malicious probability score of a feature in the packet, an average malicious probability score of the features in the packet, a mean malicious probability score of the features in the packet, and the like.
[0057] The analysis threshold may be adaptive or be frequently updated based on operating conditions of the malicious network content detection system 125. For example, the threshold value may be dynamically revised according to a quantity of packets of network content to be inspected. As a quantity of data packets which are intercepted and/or copied from the network data transmission in step 310 increases, a quantity of data packets to be inspected may also increase. This may increase a computational load and leave less computational bandwidth available for more detailed analysis of the data packets. Consequently, the threshold may be increased to compensate for the decrease in available computational bandwidth for more detailed analysis. As another example, the threshold value may be dynamically revised according to an availability of one or more virtual machines to be used for the more detailed analysis. The threshold value may be set such that only features which have a significant probability of indicating malicious network content are processed using a virtual machine. For example, out of over one thousand features, less than fifty may be considered significant.
[0058] There may be multiple dynamically adaptive thresholds, which may be synchronized with each other. For example, the scheduler 140 may use a threshold to determine whether a virtual machine should be dispatched to process a queued suspicious network content. The scheduler 140's threshold may increase due to lack of available computational resources for the analysis environment 150 to execute virtual machines. The heuristic module 130 may use another threshold to determine whether heuristics should be applied to an identified feature. The heuristic module 130's threshold may be based on the malicious probability score for the identified feature. As the scheduler 140's threshold increases, the heuristic module 130's threshold may also increase. This is because flagging suspicious network content based on running heuristics on identified features may be irrelevant and an inefficient use of computational resources if the scheduler 140 will not process the suspicious network content in a virtual machine due to an increased threshold in the scheduler 140.
[0059] After suspicious network content has been flagged at step 325 for further analysis, the entire stored data flow including the suspicious network content may be reanalyzed. Each feature may be given a higher malicious probability score by virtue that one feature in the data flow has been found to have a malicious probability score greater than the threshold. A priority level for each feature found in the data flow may also be increased. Furthermore, all data packets and data flows associated with any domains associated with suspicious network content may be cached and given higher priorities and malicious probability scores than they would otherwise. The scheduler 140 may execute the virtual machine to process each flagged suspicious network content in the data flow individually, in priority order, in their original sequence of presentation, or in some other order. The virtual machine may process the suspicious network content until pre-empted by a higher priority suspicious network content.
[0060] In step 330, a virtual machine is executed to process the suspicious network content. The virtual machine may effectively replay the suspicious network content in a web browser executing on the virtual machine. The heuristic module 130 may provide the packet containing the suspicious network content to the scheduler 140, along with a list of the features present in the packet and the malicious probability scores associated with each of those features. Alternatively, the heuristic module 130 may provide a pointer to the packet containing the suspicious network content to the scheduler 140 such that the scheduler 140 may access the packet via a memory shared with the heuristic module 130. In another embodiment, the heuristic module 130 may provide identification information regarding the packet to the scheduler 140 such that the scheduler 140, replayer 205, or virtual machine may query the heuristic module 130 for data regarding the packet as needed.
[0061] The heuristic module 130 may also provide a priority level for the packet and/or the features present in the packet. The scheduler 140 may then load and configure a virtual machine from the virtual machine pool 145, and dispatch the virtual machine to the analysis environment 150 to process the suspicious network content. The virtual machine may be configured to execute for a minimum amount of processing, or for a minimum period of time, such as approximately 45 seconds. After the minimum period of time passes, the virtual machine may be pre-empted by the scheduler 140 to dispatch another virtual machine. Multiple virtual machines may be run simultaneously.
[0062] The scheduler 140 may choose which feature to process first according to the priority levels provided by the heuristic module 130. The scheduler 140 may cause another virtual machine already processing or analyzing another feature or packet, or set of packets, in the analysis environment 150 to terminate prior to dispatching the loaded virtual machine. For example, this may occur if computational resources are occupied with other virtual machines processing other features and therefore are not available to execute the loaded virtual machine. The scheduler 140 may choose which virtual machine(s) to terminate based on the priority levels of the features being processed by the virtual machine, how much time the virtual machine has already spent executing, or other reasons.
[0063] The scheduler 140 may reprioritize suspicious network content already in queue to be processed by virtual machines based on newly identified suspicious network content. For example, already queued suspicious network content may be reprioritized if there is a domain identified in common with the newly identified suspicious network content. Numerous incidents of suspicious network content associated with a single domain may increase the priority of all suspicious network content associated with the domain.
[0064] The replayer 205 in the analysis environment 150 may keep track of network content requested by the virtual machine. If suspicious network content already in the scheduler 140's queue is requested and processed by the virtual machine while processing other previously dispatched suspicious network content, and the queued suspicious network content is not found to be malicious, then the scheduler 140 may delete the queued suspicious network content from the queue. In this way, computational requirements can be reduced because an item of suspicious network content may only be processed in a virtual machine once, rather than each time a reference to the item of suspicious network content is made by another item of suspicious network content.
[0065] In step 335, malicious network content is detected by analyzing the virtual machine response to the suspicious network content. The analysis environment 150 may be configured to monitor the virtual machine for indications that the suspicious network content is in fact malicious network content. The analysis environment 150 may monitor the virtual machine for unusual memory accesses, unusual spawning of executable processes, unusual network transmissions, crashes, unusual changes in performance, and the like. The analysis environment may flag the suspicious network content as malicious network content according to the observed behavior of the virtual machine.
[0066] If a virtual machine processes suspicious network content for greater than a predetermined amount of time without any malicious network content being detected, the scheduler 140 may terminate the virtual machine to free up computational resources. The predetermined amount of time may be variable, according to a queue of suspicious network content that is awaiting processing by a virtual machine, the probability that the suspicious network content may be malicious network content, the feature being evaluated by the virtual machine, available computational resources, and the like. For example, the predetermined amount of time may be 45 seconds, two minutes, twenty minutes, or any other length of time.
[0067] If the suspicious network content is determined to be malicious network content, the malicious network content detection system 125 may report the malicious network content and/or log the malicious network content for future reference. For example, the malicious network content detection system 125 may generate an alert for a network content packet detected to include malicious network content. The malicious network content detection system 125 may report the malicious network content to an entity responsible for the client device 105. If the malicious network content was determined to originate from the server device 105, the client device 110 may be instructed not to continue network transmissions with the server device 105. If a party responsible for the server device 105 is known, the malicious network content detection system 125 may report the malicious network content to the party responsible for the server device 105. The server device 105 may be added to a list of malicious network content providers, and future network transmissions originating from the server device 105 may be blocked from reaching their intended destinations.
[0068] FIG. 4 illustrates another exemplary method 400 for detecting malicious network content. The method 400 may be performed by the heuristic module 130. In the method 400, a packet of network content is inspected to identify features which may indicate the presence of malicious network content. The method 400 may include the use of a single pass parser and/or an augmented finite state machine, which may maintain a stack of states. The method 400 may begin processing a data packet starting with a character after a character sequence “HTTP” has been identified.
[0069] In step 405, a data character is read from the data packet. The data character read may be subsequent to the character sequence “HTTP” or a data character previously read in a prior iteration of step 405. A pointer may be incremented to indicate the next data character to read in the method 400.
[0070] In step 410, the data character read in step 405 is evaluated to determine if the data character may indicate the start of a possible keyword or a possible feature as described with respect to method 300, or a different kind of data (e.g., JavaScript content embedded in HTML content). The data character may include a left angled bracket (i.e., “<”), for example. If the data character read may indicate the start of a keyword or a feature, the method may proceed to step 415. Otherwise, the method may proceed to step 420.
[0071] In step 415, a new state is pushed onto the stack of states to indicate that the method 400 has encountered the start of a keyword or feature. The new state may be an InKeyword state to indicate that the method is in the midst of processing a keyword. Depending on the character read, a different new state may be pushed onto the stack. A string of data characters may be stored, starting with the most recent character read or the next character to be read. The method 400 then proceeds to step 440.
[0072] In step 420, the data character read in step 405 is evaluated to determine if the data character may indicate the end of a keyword or a feature as described with respect to method 300. The data character may include a right angled bracket (i.e., “>”), for example. If the data character read may indicate the end of a keyword or a feature, the method may proceed to step 425. Otherwise, the method may proceed to step 440.
[0073] In step 425, heuristics to be applied to the data packet are identified and applied based on a character string read, which may start with the data character identified in step 410 and end with the data character identified in step 420. The heuristic module 300 may store the character string. The character string may be compared against a database of character strings stored in the heuristics database 135 to determine one or more heuristics that may be applied to the data packet based on the keyword. In some embodiments, a list of results of applying heuristics may be created. The list of results may be stored so that the list may be referenced in step 445.
[0074] Some examples of a heuristic that may be applied to the packet include keyword matches. Some keywords may be associated more with malicious network content than non-malicious network content, and their presence in a packet of network content may be an indication that the packet contains suspicious network content.
[0075] In one exemplary heuristic, an object filename's extension following a period may be examined. For example, a filename ending in the characters “.ini”, “.anr”, or “.htm” may be determined to be suspicious. Also, a filename generally associated with one file type but associated with a different file type in the reference may be determined to be suspicious. For example, a filename ending in “.jpg” which is not referring to an image file may be determined to be suspicious.
[0076] In other exemplary heuristics, content of web pages may be analyzed to determine whether network content is suspicious. For example, presence of small iframes, such as an iframe in which the width and/or height is 0 or 1 pixel, in a web page may be determined to be suspicious.
[0077] Further examples of heuristics may be associated with JavaScript code sequences. When an “eval(unescape( . . . ))” JavaScript command sequence, which includes an “unescape” command nested within the argument of an “eval” command, is detected in the data packet, the heuristic may evaluate the command sequence to identify suspicious network content. The “eval(unescape( . . . ))” command sequence may be used to obfuscate malicious network content so that the malicious network content is not easily detected in the network data transmission, and may therefore indicate suspicious network content.
[0078] Another example of a heuristic is a length of the argument of the “unescape” or other JavaScript function from a starting character to an ending character. The length may be determined by counting a number of characters, or measuring a length of time, between the opening parenthesis and the closing parenthesis after “unescape” or other function name. A greater number of characters between the parentheses may indicate that an obfuscated body to the command is being used.
[0079] Bi-gram detection is another exemplary heuristic that may be employed in JavaScript or other types of network content. In bi-gram detection, character transitions within the network content are analyzed. A table of conditional probabilities may be generated and updated continuously as data is evaluated. The table of conditional probabilities indicates the probability of each second character appearing after each first character. The conditional probability of a second character C2 given the first character C1 may be written as P(C2|C1). The heuristic may identify when a string of unusual character transitions occurs according to the table of conditional probabilities. Thresholds for the length of the string of unusual character transitions, combined with the values of the conditional probabilities that flags the character transitions as being unusual, may be set a priori based on an approximate Bayesian probability analysis using a corpus of malicious network content and a corpus of non-malicious network content. Alternatively, the thresholds may be adjusted in near real time as the table of conditional probabilities is updated. For example, a long string of unusual character transitions may indicate the presence of malicious network content in a JavaScript “eval(unescape( . . . ))” clause.
[0080] The use of domain profiles is another exemplary heuristic that may be used to reduce a rate of false positives from other heuristics. The domain profiles heuristic may be used in conjunction with other heuristics in order to increase throughput and reduce computational requirements for detecting malicious network content. Each network domain with which monitored network content is exchanged may be cataloged and annotated with a list of the features present in network content associated with the network domain. A typical network domain may be approximately constant in the features present in associated network content. When a feature is identified by another heuristic, the feature may be looked up in the list of features associated with the network domain. If the feature is listed as being associated with the network domain, and malicious network content was not previously detected due to identification of the feature in network content associated with the domain, a virtual machine may not be executed to process the network content containing the feature associated with the network domain. If, on the other hand, the feature was not previously detected or associated with the network domain, the network content may be identified as being suspicious and processed by a virtual machine.
[0081] A list of domains or web sites containing malicious network content may be maintained. The list of sources of malicious network content may be hosted on the computer network and accessible by clients on the computer network. The heuristic module 130 may access the list of domains and web sites containing malicious network content to supplement the information provided by the domain profiles heuristic. For example, the threshold for network content associated with a web site on a list of malicious network content sources may be set to be lower and/or the priority of a suspicious network content may be set higher than for other network content. When malicious network content is detected, the list of domains may be notified or updated with the information for reference by others.
[0082] In step 430, if a state is being exited, the state being exited is popped from the stack of states. The state being exited is the most recent state pushed onto the stack of states. For example, if the state being exited is the InKeyword state, the InKeyword state is popped from the stack of states to indicate that the method is no longer in the midst of reading a keyword. If a state is not being exited, a state may not be popped from the stack, and multiple states may be stored on the stack. In some embodiments, up to 32 states may be present on the stack of states at one time. For example, JavaScript may have embedded HTML, and therefore multiple states may be active at one time to account for nested features. In various embodiments, there may be more than 60 states associated with data packets being analyzed for malicious network content.
[0083] In step 435, a new state is pushed onto the stack of states to indicate that the method is now in the midst of a new state. The new state may be determined by the last keyword that was read, or a character indicating a new kind of content. For example, the new state may be an InBetweenKeyword state to indicate that the method is awaiting another keyword to process. In some embodiments, the new state may be an InJavaScript state to indicate that the method is in the midst of reading a JavaScript segment. The state may impact which heuristics are identified and applied to the packet of web data in step 445. For example, a first heuristic may be chosen if a first state is active, whereas a second heuristic may be chosen if a second state is active.
[0084] In step 440, the count of characters read in step 405 is evaluated to determine if the data character may lie at the end of a packet. If the data character lies at the end of the packet, the method may proceed to step 445. Otherwise, the method may proceed to step 405.
[0085] In step 445, the list of results produced by applying the heuristics in step 425 for the features in the data packet are referenced to determine which features in the data packet are to be processed using a virtual machine. Malicious probability scores for each feature may be compared against a threshold to determine whether the feature indicates suspicious network content. The features associated with the data packet may be ranked in priority order. The features may be used to prioritize whether to refer the data packet, and associated content, to a virtual machine in the order identified in step 425, in the priority order determined by their respective malicious probability scores, or in some other order.
[0086] FIG. 5 illustrates an exemplary controller 500. The controller 500 may comprise the malicious network content detection system 125 according to some embodiments. The controller 500 comprises at least a processor 505, a memory system 510, and a storage system 515, which are all coupled to a bus 520. The controller 500 may also comprise a communication network interface 525, an input/output (I/O) interface 530, and a display interface 535. The communication network interface 525 may couple with the communication network 120 via a communication medium 540. In some embodiments, the controller 500 may couple to a tap, such as the tap 115, which in turn couples with the communication network 120. The bus 520 provides communications between the communications network interface 525, the processor 505, the memory system 510, the storage system 515, the I/O interface 530, and the display interface 535.
[0087] The communications network interface 525 may communicate with other digital devices (not shown) via the communications medium 540. The processor 505 executes instructions. The memory system 510 permanently or temporarily stores data. Some examples of the memory system 510 are RAM and ROM. The storage system 515 also permanently or temporarily stores data. Some examples of the storage system 515 are hard disks and disk drives. The I/O interface 530 may include any device that can receive input and provide output to a user. The I/O interface 530 may include, but is not limited to, a keyboard, a mouse, a touchscreen, a keypad, a biosensor, a compact disc (CD) drive, a digital versatile disc (DVD) drive, or a floppy disk drive. The display interface 535 may include an interface configured to support a display, monitor, or screen. In some embodiments, the controller 500 comprises a graphical user interface to be displayed to a user over a monitor in order to allow the user to control the controller 500.
[0088] The embodiments discussed herein are illustrative. As these embodiments are described with reference to illustrations, various modifications or adaptations of the methods and/or specific structures described may become apparent to those skilled in the art.
[0089] The above-described modules may be comprised of instructions that are stored on storage media (e.g., computer readable media). The instructions may be retrieved and executed by a processor (e.g., the processor 600). Some examples of instructions include software, program code, and firmware. Some examples of storage media comprise memory devices and integrated circuits. The instructions are operational when executed by the processor to direct the processor to operate in accordance with embodiments of the present invention. Those skilled in the art are familiar with instructions, processor(s), and storage media.
[0090] In the foregoing specification, the invention is described with reference to specific embodiments thereof, but those skilled in the art will recognize that the invention is not limited thereto. Various features and aspects of the above-described invention can be used individually or jointly. Further, the invention can be utilized in any number of environments and applications beyond those described herein without departing from the broader spirit and scope of the specification. The specification and drawings are, accordingly, to be regarded as illustrative rather than restrictive. It will be recognized that the terms “comprising,” “including,” and “having,” as used herein, are specifically intended to be read as open-ended terms of art.
Claims
What is claimed is:
1. A computer implemented method of analyzing items of network content to determine whether the items of network content contain malicious network content, the method comprising:
A) determining whether a probability score corresponding to each of a first plurality of items of network content satisfies an analysis threshold, the probability score is related to a probability that the corresponding item of network content includes malicious network content;
B) determining, in accordance with a first processing order, at least a second plurality of items of network content that are a subset of the first plurality of items of network content, each of the second plurality of items of network content is associated with a corresponding probability score that satisfies the analysis threshold;
C) generating, by a controller, a second order of processing of each of the second plurality of items of network content being associated with a corresponding probability score that satisfies the analysis threshold, the second order of processing differs from the first order of processing and is based, at least in part, on the corresponding probability scores, the controller comprising a digital device providing a virtual machine; and
D) processing the second plurality of items of network content in the virtual machine in accordance with the second order of processing for subsequent analysis of behavior of the virtual machine to detect whether one or more of the items of network content include malicious network content.
2. The method of claim 1, wherein the second order of processing of the second plurality of items of network content is further based on a priority level generated from a plurality of the probability scores associated with the second plurality of items of network content.
3. The method of claim 1, wherein the second order of processing of the second plurality of items of network content is further based on priority levels, and the priority level of each of the second plurality of items of network content is based on the corresponding probability score.
4. The method of claim 3, wherein the priority level of each item of the second plurality of items of network content is based on one or more identified suspicious features associated with the corresponding item of the second plurality of items of network content.
5. The method of claim 1, wherein the analysis threshold includes a dynamically adaptive threshold based on an availability of the virtual machine.
6. The method of claim 5, wherein the dynamically adaptive threshold is dynamically revised according to a quantity of packets of network content to be processed.
7. The method of claim 1, further comprising terminating the processing by the virtual machine when the probability score of the corresponding item of the second plurality of items of network content does not satisfy a revised dynamically adaptive threshold applicable during the processing.
8. The method of claim 1, further comprising terminating the processing by the virtual machine when a minimum period of execution time has passed.
9. The method of claim 1, further comprising storing the first plurality of items of network content awaiting processing in a memory; and
deleting any of the stored items of the first plurality of network content when the probability score corresponding thereto does not satisfy the analysis threshold.
10. The method of claim 1, wherein the determining whether the probability score for each of the first plurality of items of network content comprises inspecting the first plurality of items of network content; identifying suspicious features of the first plurality of items of network content; and generating the probability scores for the first plurality of items of network content based on at least the suspicious features.
11. The method of claim 1, wherein the plurality of items of network content correspond to a plurality of data packets.
12. The method of claim 1, wherein the controller includes a malicious network content detection system that comprises at least a scheduler and an analysis environment including the virtual machine.
13. A computer implemented method of analyzing items of content to determine whether the items of content contain malicious content, the method comprising:
A) determining whether a probability score corresponding to each of a received plurality of items of content satisfies a predetermined threshold the probability score is related to a probability that the corresponding item of content includes malicious content;
B) determining, in accordance with a first processing order, at least a second plurality of items of content that are a subset of the received plurality of items of content, each of the second plurality of items of content is associated with a corresponding probability score that satisfies a predetermined threshold and is associated with a probability that at least one feature associated with the corresponding item of content includes malicious content;
C) generating, by a controller, a second order of processing for the second plurality of items of content based on the probability scores for the second plurality of items of content, the controller comprising a digital device providing a virtual machine; and
D) processing the second plurality of items of content in the virtual machine in accordance with the second order of processing that differs from the first order of processing of the second plurality of items of content; and
E) monitoring behavior of the virtual machine in response to processing of the second plurality of items of content in accordance with the second order of processing to detect whether one or more items of the second plurality of items of content include malicious content.
14. The method of claim 13, further comprising, prior to the generating of the second order of processing, inspecting the received plurality of items of content comprising packets where the received plurality of items of content is greater than or equal in number to the second plurality of items of content; using heuristics in identifying suspicious features associated with the received plurality of items of content; and generating the probability score corresponding to each of the received plurality of items of content based on at least the associated suspicious features.
15. The method of claim 14, wherein the associated suspicious features for a first item of content of the received plurality of items of content are directed to a sequence of characters.
16. The method of claim 13, wherein the probability score is dynamically adaptive based on available virtual machines.
17. The method of claim 13, wherein each of the probability scores is based on one or more heuristic scores, each of the heuristic scores is associated with the at least one feature of a corresponding one of the second plurality of items of content.
18. The method of claim 13, wherein the generating of the second order of processing of the second plurality of items of content further comprises excluding one or more of the received plurality of items of content based on a determination by the controller that one or more of the received plurality of items of content is not malicious content.
19. The method of claim 13, wherein the plurality of items of content correspond to a plurality of data packets.
20. The method of claim 13, wherein the at least one feature associated with each of the received plurality of items of content includes a characteristic of data within each of the received plurality of items of content, the characteristic of the data includes a sequence of the data.
21. The method of claim 13, wherein the at least one feature associated with each of the received plurality of items of content includes a characteristic of data within each of the received plurality of items of content, the characteristic of the data includes a sequence of characters associated with at least a portion of the content.
22. The method of claim 13, wherein the at least one feature associated with each of the received plurality of items of content includes a characteristic of data within each of the received plurality of items of content, the characteristic of the data includes one or more keywords within the data.
23. A system operable for processing of items of content to determine whether the items of content contains malicious content, the system comprising:
A) a memory that is configured to store a second plurality of items of content which are a subset of a first plurality of items of content and each of the second plurality of items of content having been previously determined, in accordance with a first order of processing, to be associated with a probability score that satisfies an analysis threshold, the probability score relates to a probability that the associated item of content includes malicious content;
B) a controller comprising a processor that is configured to process at least one virtual machine and a scheduler;
C) wherein the scheduler is operatively coupled with the memory and is configured to generate a second order of processing for each of the second plurality of items of content based, at least in part, on the associated probability scores of the second plurality of items of content, the second order of processing differs from the first order of processing; and
D) wherein the controller is configured to process the second plurality of items of content in the at least one virtual machine in accordance with the second order of processing for subsequent analysis of one or more behaviors of the at least one virtual machine to detect whether one or more of the second plurality of items of content include malicious content.
24. The system of claim 23, wherein the second order of processing of the second plurality of items of content is further based on a priority level generated from a second plurality of the probability scores corresponding to the second plurality of items of content.
25. The system of claim 23, wherein the second order of processing of the plurality of items of content is further based on a priority level for each of the second plurality of items of content; and the scheduler is configured to generate the priority level for each of the second plurality of items based on at least one suspicious feature associated with each of the second plurality of items of content.
26. The system of claim 23, wherein the scheduler is configured to load and configure the at least one virtual machine from a virtual machine pool, and dispatch the at least one virtual machine to an analysis environment to process each of the plurality of items of content to be analyzed.
27. The system of claim 23, wherein the second order of processing of the plurality of items of content is further based on a priority level for each of the second plurality of items of content; each of the second plurality of items of content being associated with a number of suspicious features, each of the suspicious features having an associated probability score; and the second order of processing reflects the probability scores of the suspicious features of the second plurality of items of content.
28. The system of claim 23, wherein at least one of the second plurality of probability scores is dynamically adaptive based on available virtual machines.
29. The system of claim 23, wherein the memory comprises a queue of the second plurality of items of content arranged in accordance with the second order of processing by the at least one virtual machine.
30. The system of claim 29, wherein the scheduler is configured to delete or reprioritize one or more of the items of content in the queue to set the second order of processing of the plurality of items of content.
31. The system of claim 23, wherein each of the second plurality of items of content to be analyzed by the at least one virtual machine is analyzed for an amount of time, the amount of time being based at least in part on a number of items of the plurality of items of content awaiting processing by the at least one virtual machine.
32. The system of claim 31, wherein the scheduler is configured to determine the amount of time.
33. The system of claim 23, wherein the at least one virtual machine comprises a plurality of virtual machines; and the scheduler causes the plurality of virtual machines to process the plurality of items of content simultaneously.
34. The system of claim 23, wherein the second plurality of items of content correspond to a plurality of data packets.
35. The system of claim 23, wherein the processor is further configured to process a heuristic module that determines the plurality of probability scores corresponding to the second plurality of items of content.
36. The system of claim 23, wherein each of the second plurality of probability scores is based, at least in part, on one or more features associated with a corresponding item of the second plurality of items of content and reflects a probability that the corresponding item of content comprises malicious content.
37. The system of claim 36, wherein the one or more features include a characteristic of data within at least the corresponding item of content, the characteristic of the data includes a sequence of the data.
38. The system of claim 36, wherein the one or more features include a characteristic of data within at least the corresponding item of content, the characteristic of the data includes a sequence of characters associated with at least a portion of the content.
39. The system of claim 36, wherein the one or more features include a characteristic of data within at least the corresponding item of content, the characteristic of the data includes one or more keywords within the data.
40. A computer implemented method of analyzing received data to determine whether the received data contains malicious data, the method comprising:
A) determining, in accordance with a first order of processing, whether a probability score corresponding to each of a first plurality of received data satisfies an analysis threshold, the probability score is related to a probability that the corresponding received data includes malicious data content;
B) identifying at least a second plurality of received data that are a subset of the first plurality of received data and are stored in a memory, each of the second plurality of received data is associated with a corresponding probability score that satisfies the analysis threshold;
C) generating a second order of processing of each of the second plurality of received data by a controller that differs from the first order of processing of the second plurality of received data when determining whether the probability score for each of the first plurality of received data satisfies the analysis threshold, the second order of processing being based, at least in part, on the corresponding probability scores, the controller comprising a digital device providing a virtual machine; and
D) processing the second plurality of received data in the virtual machine in accordance with the second order of processing for subsequent analysis of a behavior of the virtual machine to detect whether the second plurality of received data includes malicious data.
41. The method of claim 40, wherein at least a first data of the second plurality of received data includes a feature and the probability score associated with the first data that is based, at least in part, on the feature.
42. The method of claim 41, wherein the feature includes a sequence of data, the sequence of data is assigned a probability score during heuristic analysis of the first data.
43. The method of claim 42, wherein upon the probability score of the first data including the probability score assigned to the sequence of data satisfies the analysis threshold, the first data is subsequently processed as part of the second plurality of received data in the virtual machine.
44. The method of claim 41, wherein
the feature includes a sequence of characters associated with at least a portion of the first data, the sequence of characters is assigned a probability score during heuristic analysis of the first data; and
the first data is subsequently processed as part of the second plurality of received data in the virtual machine when the probability score of the first data, including the probability score assigned to the sequence of characters, is determined to satisfy the analysis threshold.
45. The method of claim 41, wherein
the feature includes one or more keywords within the first data of the second plurality of received data, the one or more keywords is assigned a probability score during heuristic analysis of the first data; and
the first data is subsequently processed as part of the second plurality of received data in the virtual machine when the probability score of the first data, including the probability score assigned to the one or more keywords, is determined to satisfy the analysis threshold.
46. The method of claim 41, wherein the first data comprises a first data packet of a plurality of data packets corresponding to the second plurality of received data, the feature comprises a portion of data within the first data packet.
47. The method of claim 41, wherein the first order of processing comprises an order of receipt of the second plurality of received data by the controller, and the controller to change a processing order of the second plurality of received data in the virtual machine from the first order of processing to the second order of processing.
48. The method of claim 40, wherein the first plurality of received data comprises a first plurality of data packets and the second plurality of received data comprises a second plurality of data packets that are lesser in number than the first plurality of data packets.
Patent Citations (361)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4292580(A) | 1981-09-01 | Ott et al. | Applicant |
| US5175732(A) | 1992-12-01 | Hendel et al. | Applicant |
| US5440723(A) | 1995-08-01 | Arnold et al. | Applicant |
| US5490249(A) | 1996-02-01 | Miller | Applicant |
| US5537540(A) | 1996-07-01 | Miller et al. | Applicant |
| US5603027(A) | 1997-02-01 | Ohkami | Applicant |
| US5657473(A) | 1997-08-01 | Killean et al. | Applicant |
| US5842002(A) | 1998-11-01 | Schnurer et al. | Applicant |
| US5978917(A) | 1999-11-01 | Chi | Applicant |
| US6088803(A) | 2000-07-01 | Tso et al. | Applicant |
| US6094677(A) | 2000-07-01 | Capek et al. | Applicant |
| US6108799(A) | 2000-08-01 | Boulay et al. | Applicant |
| US6269330(B1) | 2001-07-01 | Cidon et al. | Applicant |
| US6279113(B1) | 2001-08-01 | Vaidya | Applicant |
| US6298445(B1) | 2001-10-01 | Shostack et al. | Applicant |
| US6357008(B1) | 2002-03-01 | Nachenberg | Applicant |
| US6424627(B1) | 2002-07-01 | Sorhaug et al. | Applicant |
| US6442696(B1) | 2002-08-01 | Wray et al. | Applicant |
| US6484315(B1) | 2002-11-01 | Ziese | Applicant |
| US6487666(B1) | 2002-11-01 | Shanklin et al. | Applicant |
| US6493756(B1) | 2002-12-01 | O'Brien et al. | Applicant |
| US6550012(B1) | 2003-04-01 | Villa et al. | Applicant |
| US6775657(B1) | 2004-08-01 | Baker | Applicant |
| US6832367(B1) | 2004-12-01 | Choi et al. | Applicant |
| US6895550(B2) | 2005-05-01 | Kanchirayappa et al. | Applicant |
| US6898632(B2) | 2005-05-01 | Gordy et al. | Applicant |
| US6907396(B1) | 2005-06-01 | Muttik et al. | Applicant |
| US6971097(B1) | 2005-11-01 | Wallman | Applicant |
| US6981279(B1) | 2005-12-01 | Arnold et al. | Applicant |
| US7007107(B1) | 2006-02-01 | Ivchenko et al. | Applicant |
| US7028179(B2) | 2006-04-01 | Anderson et al. | Applicant |
| US7043757(B2) | 2006-05-01 | Hoefelmeyer et al. | Applicant |
| US7069316(B1) | 2006-06-01 | Gryaznov | Applicant |
| US7080407(B1) | 2006-07-01 | Zhao et al. | Applicant |
| US7080408(B1) | 2006-07-01 | Pak et al. | Applicant |
| US7093002(B2) | 2006-08-01 | Wolff et al. | Applicant |
| US7093239(B1) | 2006-08-01 | van der Made | Applicant |
| US7100201(B2) | 2006-08-01 | Izatt | Applicant |
| US7107617(B2) | 2006-09-01 | Hursey et al. | Applicant |
| US7159149(B2) | 2007-01-01 | Spiegel et al. | Applicant |
| US7231667(B2) | 2007-06-01 | Jordan | Applicant |
| US7240364(B1) | 2007-07-01 | Branscomb et al. | Applicant |
| US7240368(B1) | 2007-07-01 | Roesch et al. | Applicant |
| US7243371(B1) | 2007-07-01 | Kasper et al. | Applicant |
| US7287278(B2) | 2007-10-01 | Liang | Applicant |
| US7308716(B2) | 2007-12-01 | Danford et al. | Applicant |
| US7328453(B2) | 2008-02-01 | Merkle, Jr. et al. | Applicant |
| US7346486(B2) | 2008-03-01 | Ivancic et al. | Applicant |
| US7356736(B2) | 2008-04-01 | Natvig | Applicant |
| US7386888(B2) | 2008-06-01 | Liang et al. | Applicant |
| US7392542(B2) | 2008-06-01 | Bucher | Applicant |
| US7418729(B2) | 2008-08-01 | Szor | Applicant |
| US7428300(B1) | 2008-09-01 | Drew et al. | Applicant |
| US7441272(B2) | 2008-10-01 | Durham et al. | Applicant |
| US7448084(B1) | 2008-11-01 | Apap et al. | Applicant |
| US7458098(B2) | 2008-11-01 | Judge et al. | Applicant |
| US7464404(B2) | 2008-12-01 | Carpenter et al. | Applicant |
| US7464407(B2) | 2008-12-01 | Nakae et al. | Applicant |
| US7467408(B1) | 2008-12-01 | O'Toole, Jr. | Applicant |
| US7478428(B1) | 2009-01-01 | Thomlinson | Applicant |
| US7480773(B1) | 2009-01-01 | Reed | Applicant |
| US7487543(B2) | 2009-02-01 | Arnold et al. | Applicant |
| US7496960(B1) | 2009-02-01 | Chen et al. | Applicant |
| US7496961(B2) | 2009-02-01 | Zimmer et al. | Applicant |
| US7516488(B1) | 2009-04-01 | Kienzle et al. | Applicant |
| US7519990(B1) | 2009-04-01 | Xie | Applicant |
| US7523493(B2) | 2009-04-01 | Liang et al. | Applicant |
| US7530104(B1) | 2009-05-01 | Thrower et al. | Applicant |
| US7540025(B2) | 2009-05-01 | Tzadikario | Applicant |
| US7565550(B2) | 2009-07-01 | Liang et al. | Applicant |
| US7568233(B1) | 2009-07-01 | Szor et al. | Applicant |
| US7584455(B2) | 2009-09-01 | Ball | Applicant |
| US7603715(B2) | 2009-10-01 | Costa et al. | Applicant |
| US7607171(B1) | 2009-10-01 | Marsden et al. | Applicant |
| US7639714(B2) | 2009-12-01 | Stolfo et al. | Applicant |
| US7644441(B2) | 2010-01-01 | Schmidt et al. | Applicant |
| US7657419(B2) | 2010-02-01 | van der Made | Examiner |
| US7676841(B2) | 2010-03-01 | Sobchuk et al. | Applicant |
| US7698548(B2) | 2010-04-01 | Shelest et al. | Applicant |
| US7707633(B2) | 2010-04-01 | Danford et al. | Applicant |
| US7712136(B2) | 2010-05-01 | Sprosts et al. | Applicant |
| US7730011(B1) | 2010-06-01 | Deninger et al. | Applicant |
| US7739740(B1) | 2010-06-01 | Nachenberg et al. | Applicant |
| US7779463(B2) | 2010-08-01 | Stolfo et al. | Applicant |
| US7784097(B1) | 2010-08-01 | Stolfo et al. | Applicant |
| US7832008(B1) | 2010-11-01 | Kraemer | Applicant |
| US7836502(B1) | 2010-11-01 | Zhao et al. | Examiner |
| US7849506(B1) | 2010-12-01 | Dansey et al. | Applicant |
| US7854007(B2) | 2010-12-01 | Sprosts et al. | Applicant |
| US7869073(B2) | 2011-01-01 | Oshima | Applicant |
| US7877803(B2) | 2011-01-01 | Enstone et al. | Examiner |
| US7904959(B2) | 2011-03-01 | Sidiroglou et al. | Applicant |
| US7908660(B2) | 2011-03-01 | Bahl | Applicant |
| US7930738(B1) | 2011-04-01 | Petersen | Applicant |
| US7937761(B1) | 2011-05-01 | Benett | Applicant |
| US7949849(B2) | 2011-05-01 | Lowe et al. | Applicant |
| US7996556(B2) | 2011-08-01 | Raghavan et al. | Applicant |
| US7996836(B1) | 2011-08-01 | McCorkendale et al. | Applicant |
| US7996904(B1) | 2011-08-01 | Chiueh et al. | Applicant |
| US7996905(B2) | 2011-08-01 | Arnold et al. | Applicant |
| US8006305(B2) | 2011-08-01 | Aziz | Applicant |
| US8010667(B2) | 2011-08-01 | Zhang et al. | Applicant |
| US8020206(B2) | 2011-09-01 | Hubbard et al. | Applicant |
| US8028338(B1) | 2011-09-01 | Schneider et al. | Applicant |
| US8042184(B1) | 2011-10-01 | Batenin | Applicant |
| US8045458(B2) | 2011-10-01 | Alperovitch et al. | Applicant |
| US8069484(B2) | 2011-11-01 | McMillan et al. | Applicant |
| US8087086(B1) | 2011-12-01 | Lai et al. | Applicant |
| US8171553(B2) | 2012-05-01 | Aziz et al. | Applicant |
| US8176480(B1) | 2012-05-01 | Spertus | Applicant |
| US8201246(B1) | 2012-06-01 | Wu et al. | Applicant |
| US8204984(B1) | 2012-06-01 | Aziz et al. | Applicant |
| US8220055(B1) | 2012-07-01 | Kennedy | Applicant |
| US8225288(B2) | 2012-07-01 | Miller et al. | Applicant |
| US8234640(B1) | 2012-07-01 | Fitzgerald et al. | Applicant |
| US8234709(B2) | 2012-07-01 | Viljoen et al. | Applicant |
| US8239944(B1) | 2012-08-01 | Nachenburg et al. | Applicant |
| US8286251(B2) | 2012-10-01 | Eker et al. | Applicant |
| US8291499(B2) | 2012-10-01 | Aziz et al. | Applicant |
| US8307435(B1) | 2012-11-01 | Mann et al. | Applicant |
| US8307443(B2) | 2012-11-01 | Wang et al. | Applicant |
| US8312545(B2) | 2012-11-01 | Tuvell et al. | Applicant |
| US8321936(B1) | 2012-11-01 | Green et al. | Applicant |
| US8321941(B2) | 2012-11-01 | Tuvell et al. | Applicant |
| US8370938(B1) | 2013-02-01 | Daswani et al. | Applicant |
| US8370939(B2) | 2013-02-01 | Zaitsev et al. | Applicant |
| US8375444(B2) | 2013-02-01 | Aziz et al. | Applicant |
| US8381299(B2) | 2013-02-01 | Stolfo et al. | Applicant |
| US8402529(B1) | 2013-03-01 | Green et al. | Applicant |
| US8464340(B2) | 2013-06-01 | Ahn et al. | Applicant |
| US8479174(B2) | 2013-07-01 | Chiriac | Examiner |
| US8510827(B1) | 2013-08-01 | Leake et al. | Applicant |
| US8510828(B1) | 2013-08-01 | Guo et al. | Applicant |
| US8516478(B1) | 2013-08-01 | Edwards et al. | Applicant |
| US8516593(B2) | 2013-08-01 | Aziz | Applicant |
| US8528086(B1) | 2013-09-01 | Aziz | Applicant |
| US8533824(B2) | 2013-09-01 | Hutton et al. | Applicant |
| US8539582(B1) | 2013-09-01 | Aziz et al. | Applicant |
| US8549638(B2) | 2013-10-01 | Aziz | Applicant |
| US8561177(B1) | 2013-10-01 | Aziz et al. | Applicant |
| US8566946(B1) | 2013-10-01 | Aziz et al. | Applicant |
| US8584094(B2) | 2013-11-01 | Dahdia et al. | Applicant |
| US8584234(B1) | 2013-11-01 | Sobel et al. | Applicant |
| US8584239(B2) | 2013-11-01 | Aziz et al. | Applicant |
| US8595834(B2) | 2013-11-01 | Xie et al. | Applicant |
| US8627476(B1) | 2014-01-01 | Satish et al. | Applicant |
| US8635696(B1) | 2014-01-01 | Aziz | Applicant |
| US8850570(B1) | 2014-09-01 | Ramzan | Examiner |
| US8850571(B2) | 2014-09-01 | Staniford et al. | Applicant |
| US8881234(B2) | 2014-11-01 | Narasimhan et al. | Applicant |
| US2001/0005889(A1) | 2001-06-01 | Albrecht | Applicant |
| US2001/0047326(A1) | 2001-11-01 | Broadbent et al. | Applicant |
| US2002/0018903(A1) | 2002-02-01 | Kukubo et al. | Applicant |
| US2002/0038430(A1) | 2002-03-01 | Edwards et al. | Applicant |
| US2002/0091819(A1) | 2002-07-01 | Melchione et al. | Applicant |
| US2002/0095607(A1) | 2002-07-01 | Lin-Hendel | Applicant |
| US2002/0144156(A1) | 2002-10-01 | Copeland, III | Applicant |
| US2002/0162015(A1) | 2002-10-01 | Tang | Applicant |
| US2002/0166063(A1) | 2002-11-01 | Lachman et al. | Applicant |
| US2002/0169952(A1) | 2002-11-01 | DiSanto et al. | Applicant |
| US2002/0184528(A1) | 2002-12-01 | Shevenell et al. | Applicant |
| US2002/0188887(A1) | 2002-12-01 | Largman et al. | Applicant |
| US2002/0194490(A1) | 2002-12-01 | Halperin et al. | Applicant |
| US2003/0074578(A1) | 2003-04-01 | Ford et al. | Applicant |
| US2003/0084318(A1) | 2003-05-01 | Schertz | Applicant |
| US2003/0101381(A1) | 2003-05-01 | Mateev et al. | Applicant |
| US2003/0115483(A1) | 2003-06-01 | Liang | Applicant |
| US2003/0188190(A1) | 2003-10-01 | Aaron et al. | Applicant |
| US2003/0191957(A1) | 2003-10-01 | Hypponen et al. | Applicant |
| US2003/0200460(A1) | 2003-10-01 | Morota et al. | Applicant |
| US2003/0212902(A1) | 2003-11-01 | Van Der Made | Applicant |
| US2003/0229801(A1) | 2003-12-01 | Kouznetsov et al. | Applicant |
| US2003/0237000(A1) | 2003-12-01 | Denton et al. | Applicant |
| US2004/0003323(A1) | 2004-01-01 | Bennett et al. | Applicant |
| US2004/0015712(A1) | 2004-01-01 | Szor | Applicant |
| US2004/0019832(A1) | 2004-01-01 | Arnold et al. | Applicant |
| US2004/0047356(A1) | 2004-03-01 | Bauer | Applicant |
| US2004/0083408(A1) | 2004-04-01 | Spiegel et al. | Applicant |
| US2004/0093513(A1) | 2004-05-01 | Cantrell et al. | Applicant |
| US2004/0111531(A1) | 2004-06-01 | Staniford et al. | Applicant |
| US2004/0128355(A1) | 2004-07-01 | Chao et al. | Applicant |
| US2004/0165588(A1) | 2004-08-01 | Pandya | Applicant |
| US2004/0236963(A1) | 2004-11-01 | Danford et al. | Applicant |
| US2004/0243349(A1) | 2004-12-01 | Greifeneder et al. | Applicant |
| US2004/0249911(A1) | 2004-12-01 | Alkhatib et al. | Applicant |
| US2004/0255161(A1) | 2004-12-01 | Cavanaugh | Applicant |
| US2004/0268147(A1) | 2004-12-01 | Wiederin et al. | Applicant |
| US2005/0021740(A1) | 2005-01-01 | Bar et al. | Applicant |
| US2005/0033960(A1) | 2005-02-01 | Vialen et al. | Applicant |
| US2005/0033989(A1) | 2005-02-01 | Poletto et al. | Applicant |
| US2005/0050148(A1) | 2005-03-01 | Mohammadioun et al. | Applicant |
| US2005/0086523(A1) | 2005-04-01 | Zimmer et al. | Applicant |
| US2005/0091513(A1) | 2005-04-01 | Mitomo et al. | Applicant |
| US2005/0091533(A1) | 2005-04-01 | Omote et al. | Applicant |
| US2005/0091652(A1) | 2005-04-01 | Ross et al. | Applicant |
| US2005/0108562(A1) | 2005-05-01 | Khazan et al. | Applicant |
| US2005/0114663(A1) | 2005-05-01 | Cornell et al. | Applicant |
| US2005/0125195(A1) | 2005-06-01 | Brendel | Applicant |
| US2005/0149726(A1) | 2005-07-01 | Joshi et al. | Applicant |
| US2005/0157662(A1) | 2005-07-01 | Bingham et al. | Applicant |
| US2005/0183143(A1) | 2005-08-01 | Anderholm et al. | Applicant |
| US2005/0201297(A1) | 2005-09-01 | Peikari | Applicant |
| US2005/0210533(A1) | 2005-09-01 | Copeland et al. | Applicant |
| US2005/0238005(A1) | 2005-10-01 | Chen et al. | Applicant |
| US2005/0240781(A1) | 2005-10-01 | Gassoway | Examiner |
| US2005/0265331(A1) | 2005-12-01 | Stolfo | Applicant |
| US2005/0283839(A1) | 2005-12-01 | Cowburn | Applicant |
| US2006/0010495(A1) | 2006-01-01 | Cohen et al. | Applicant |
| US2006/0015715(A1) | 2006-01-01 | Anderson | Applicant |
| US2006/0015747(A1) | 2006-01-01 | Van de Ven | Applicant |
| US2006/0021029(A1) | 2006-01-01 | Brickell et al. | Applicant |
| US2006/0021054(A1) | 2006-01-01 | Costa et al. | Applicant |
| US2006/0031476(A1) | 2006-02-01 | Mathes et al. | Applicant |
| US2006/0047665(A1) | 2006-03-01 | Neil | Applicant |
| US2006/0070130(A1) | 2006-03-01 | Costea et al. | Applicant |
| US2006/0075496(A1) | 2006-04-01 | Carpenter et al. | Applicant |
| US2006/0095968(A1) | 2006-05-01 | Portolani et al. | Applicant |
| US2006/0101516(A1) | 2006-05-01 | Sudaharan et al. | Applicant |
| US2006/0101517(A1) | 2006-05-01 | Banzhof et al. | Applicant |
| US2006/0117385(A1) | 2006-06-01 | Mester et al. | Applicant |
| US2006/0123477(A1) | 2006-06-01 | Raghavan et al. | Applicant |
| US2006/0143709(A1) | 2006-06-01 | Brooks et al. | Applicant |
| US2006/0150249(A1) | 2006-07-01 | Gassen et al. | Applicant |
| US2006/0161983(A1) | 2006-07-01 | Cothrell et al. | Applicant |
| US2006/0161987(A1) | 2006-07-01 | Levy-Yurista | Applicant |
| US2006/0161989(A1) | 2006-07-01 | Reshef et al. | Applicant |
| US2006/0164199(A1) | 2006-07-01 | Gilde et al. | Applicant |
| US2006/0173992(A1) | 2006-08-01 | Weber et al. | Applicant |
| US2006/0179147(A1) | 2006-08-01 | Tran et al. | Applicant |
| US2006/0184632(A1) | 2006-08-01 | Marino et al. | Applicant |
| US2006/0191010(A1) | 2006-08-01 | Benjamin | Applicant |
| US2006/0221956(A1) | 2006-10-01 | Narayan et al. | Applicant |
| US2006/0236393(A1) | 2006-10-01 | Kramer et al. | Applicant |
| US2006/0242709(A1) | 2006-10-01 | Seinfeld et al. | Applicant |
| US2006/0248519(A1) | 2006-11-01 | Jaeger et al. | Applicant |
| US2006/0248582(A1) | 2006-11-01 | Panjwani et al. | Applicant |
| US2006/0251104(A1) | 2006-11-01 | Koga | Applicant |
| US2006/0288417(A1) | 2006-12-01 | Bookbinder et al. | Applicant |
| US2007/0006288(A1) | 2007-01-01 | Mayfield et al. | Applicant |
| US2007/0006313(A1) | 2007-01-01 | Porras et al. | Applicant |
| US2007/0011174(A1) | 2007-01-01 | Takaragi et al. | Applicant |
| US2007/0016951(A1) | 2007-01-01 | Piccard et al. | Applicant |
| US2007/0033645(A1) | 2007-02-01 | Jones | Applicant |
| US2007/0038943(A1) | 2007-02-01 | Fitzgerald et al. | Applicant |
| US2007/0064689(A1) | 2007-03-01 | Shin et al. | Applicant |
| US2007/0094730(A1) | 2007-04-01 | Bhikkaji et al. | Applicant |
| US2007/0101435(A1) | 2007-05-01 | Konanka et al. | Applicant |
| US2007/0143827(A1) | 2007-06-01 | Nicodemus et al. | Applicant |
| US2007/0156895(A1) | 2007-07-01 | Vuong | Applicant |
| US2007/0157180(A1) | 2007-07-01 | Tillmann et al. | Applicant |
| US2007/0157306(A1) | 2007-07-01 | Elrod et al. | Applicant |
| US2007/0168988(A1) | 2007-07-01 | Eisner et al. | Applicant |
| US2007/0171824(A1) | 2007-07-01 | Ruello et al. | Applicant |
| US2007/0174915(A1) | 2007-07-01 | Gribble et al. | Applicant |
| US2007/0192500(A1) | 2007-08-01 | Lum | Applicant |
| US2007/0192858(A1) | 2007-08-01 | Lum | Applicant |
| US2007/0198275(A1) | 2007-08-01 | Malden et al. | Applicant |
| US2007/0220607(A1) | 2007-09-01 | Sprosts et al. | Applicant |
| US2007/0240218(A1) | 2007-10-01 | Tuvell et al. | Applicant |
| US2007/0240219(A1) | 2007-10-01 | Tuvell et al. | Applicant |
| US2007/0240220(A1) | 2007-10-01 | Tuvell et al. | Applicant |
| US2007/0240222(A1) | 2007-10-01 | Tuvell et al. | Applicant |
| US2007/0250930(A1) | 2007-10-01 | Aziz et al. | Examiner |
| US2007/0271446(A1) | 2007-11-01 | Nakamura | Applicant |
| US2008/0005782(A1) | 2008-01-01 | Aziz | Applicant |
| US2008/0028463(A1) | 2008-01-01 | Dagon et al. | Applicant |
| US2008/0046781(A1) | 2008-02-01 | Childs et al. | Applicant |
| US2008/0072326(A1) | 2008-03-01 | Danford et al. | Applicant |
| US2008/0077793(A1) | 2008-03-01 | Tan et al. | Applicant |
| US2008/0080518(A1) | 2008-04-01 | Hoeflin et al. | Applicant |
| US2008/0086720(A1) | 2008-04-01 | Lekel | Applicant |
| US2008/0098476(A1) | 2008-04-01 | Syversen | Applicant |
| US2008/0120722(A1) | 2008-05-01 | Sima et al. | Applicant |
| US2008/0134178(A1) | 2008-06-01 | Fitzgerald et al. | Applicant |
| US2008/0134334(A1) | 2008-06-01 | Kim et al. | Applicant |
| US2008/0141376(A1) | 2008-06-01 | Clausen et al. | Examiner |
| US2008/0184373(A1) | 2008-07-01 | Traut et al. | Applicant |
| US2008/0189787(A1) | 2008-08-01 | Arnold et al. | Applicant |
| US2008/0201778(A1) | 2008-08-01 | Guo et al. | Examiner |
| US2008/0209557(A1) | 2008-08-01 | Herley et al. | Examiner |
| US2008/0215742(A1) | 2008-09-01 | Goldszmidt et al. | Applicant |
| US2008/0222728(A1) | 2008-09-01 | Chavez et al. | Applicant |
| US2008/0222729(A1) | 2008-09-01 | Chen et al. | Applicant |
| US2008/0263665(A1) | 2008-10-01 | Ma et al. | Applicant |
| US2008/0295172(A1) | 2008-11-01 | Bohacek | Applicant |
| US2008/0301810(A1) | 2008-12-01 | Lehane et al. | Applicant |
| US2008/0313738(A1) | 2008-12-01 | Enderby | Applicant |
| US2008/0320594(A1) | 2008-12-01 | Jiang | Applicant |
| US2009/0007100(A1) | 2009-01-01 | Field et al. | Applicant |
| US2009/0013408(A1) | 2009-01-01 | Schipka | Applicant |
| US2009/0031423(A1) | 2009-01-01 | Liu et al. | Applicant |
| US2009/0036111(A1) | 2009-02-01 | Danford et al. | Applicant |
| US2009/0037835(A1) | 2009-02-01 | Goldman | Applicant |
| US2009/0044024(A1) | 2009-02-01 | Oberheide et al. | Applicant |
| US2009/0044274(A1) | 2009-02-01 | Budko et al. | Applicant |
| US2009/0064332(A1) | 2009-03-01 | Porras et al. | Applicant |
| US2009/0077666(A1) | 2009-03-01 | Chen et al. | Applicant |
| US2009/0083369(A1) | 2009-03-01 | Marmor | Applicant |
| US2009/0083855(A1) | 2009-03-01 | Apap et al. | Applicant |
| US2009/0089879(A1) | 2009-04-01 | Wang et al. | Applicant |
| US2009/0094697(A1) | 2009-04-01 | Provos et al. | Applicant |
| US2009/0113425(A1) | 2009-04-01 | Ports et al. | Applicant |
| US2009/0125976(A1) | 2009-05-01 | Wasserman et al. | Applicant |
| US2009/0126015(A1) | 2009-05-01 | Monastyrsky et al. | Applicant |
| US2009/0126016(A1) | 2009-05-01 | Sobko et al. | Applicant |
| US2009/0133125(A1) | 2009-05-01 | Choi et al. | Applicant |
| US2009/0144823(A1) | 2009-06-01 | Lamastra et al. | Applicant |
| US2009/0172815(A1) | 2009-07-01 | Gu et al. | Applicant |
| US2009/0193293(A1) | 2009-07-01 | Stolfo et al. | Applicant |
| US2009/0199296(A1) | 2009-08-01 | Xie et al. | Applicant |
| US2009/0228233(A1) | 2009-09-01 | Anderson et al. | Applicant |
| US2009/0241187(A1) | 2009-09-01 | Troyansky | Applicant |
| US2009/0241190(A1) | 2009-09-01 | Todd et al. | Applicant |
| US2009/0265692(A1) | 2009-10-01 | Godefroid et al. | Applicant |
| US2009/0271867(A1) | 2009-10-01 | Zhang | Applicant |
| US2009/0300415(A1) | 2009-12-01 | Zhang et al. | Applicant |
| US2009/0300761(A1) | 2009-12-01 | Park et al. | Applicant |
| US2009/0328185(A1) | 2009-12-01 | Berg et al. | Applicant |
| US2009/0328221(A1) | 2009-12-01 | Blumfield et al. | Applicant |
| US2010/0005146(A1) | 2010-01-01 | Drako et al. | Applicant |
| US2010/0017546(A1) | 2010-01-01 | Poo et al. | Applicant |
| US2010/0031353(A1) | 2010-02-01 | Thomas et al. | Applicant |
| US2010/0037314(A1) | 2010-02-01 | Perdisci et al. | Examiner |
| US2010/0043073(A1) | 2010-02-01 | Kuwamura | Applicant |
| US2010/0054278(A1) | 2010-03-01 | Stolfo et al. | Applicant |
| US2010/0058474(A1) | 2010-03-01 | Hicks | Applicant |
| US2010/0077481(A1) | 2010-03-01 | Polyakov et al. | Applicant |
| US2010/0083376(A1) | 2010-04-01 | Pereira et al. | Applicant |
| US2010/0100718(A1) | 2010-04-01 | Srinivasan | Examiner |
| US2010/0115621(A1) | 2010-05-01 | Staniford et al. | Applicant |
| US2010/0192223(A1) | 2010-07-01 | Ismael et al. | Applicant |
| US2010/0251104(A1) | 2010-09-01 | Massand | Applicant |
| US2010/0281102(A1) | 2010-11-01 | Chinta et al. | Applicant |
| US2010/0281541(A1) | 2010-11-01 | Stolfo et al. | Applicant |
| US2010/0281542(A1) | 2010-11-01 | Stolfo et al. | Applicant |
| US2010/0287260(A1) | 2010-11-01 | Peterson et al. | Applicant |
| US2011/0047620(A1) | 2011-02-01 | Mahaffey et al. | Applicant |
| US2011/0078794(A1) | 2011-03-01 | Manni et al. | Applicant |
| US2011/0093951(A1) | 2011-04-01 | Aziz | Applicant |
| US2011/0099633(A1) | 2011-04-01 | Aziz | Applicant |
| US2011/0219450(A1) | 2011-09-01 | McDougal et al. | Applicant |
| US2011/0247072(A1) | 2011-10-01 | Staniford et al. | Applicant |
| US2011/0307954(A1) | 2011-12-01 | Melnik et al. | Applicant |
| US2011/0307955(A1) | 2011-12-01 | Kaplan et al. | Applicant |
| US2011/0314546(A1) | 2011-12-01 | Aziz et al. | Applicant |
| US2012/0079596(A1) | 2012-03-01 | Thomas et al. | Applicant |
| US2012/0117652(A1) | 2012-05-01 | Manni et al. | Applicant |
| US2012/0174186(A1) | 2012-07-01 | Aziz et al. | Applicant |
| US2012/0222121(A1) | 2012-08-01 | Staniford et al. | Applicant |
| US2013/0036472(A1) | 2013-02-01 | Aziz | Applicant |
| US2013/0227691(A1) | 2013-08-01 | Aziz et al. | Applicant |
| US2013/0246370(A1) | 2013-09-01 | Bartram et al. | Applicant |
| US2013/0291109(A1) | 2013-10-01 | Staniford, | Applicant |
| GB2439806 | 2008-01-01 | Applicant | |
| WO206928 | 2002-01-01 | Applicant | |
| WO223805 | 2002-03-01 | Applicant | |
| WO2007/022454 | 2007-02-01 | Applicant | |
| WO2007117636 | 2007-10-01 | Applicant | |
| WO2008/084259 | 2008-07-01 | Applicant | |
| WO2008041950 | 2008-10-01 | Applicant | |
| WO2012145066 | 2012-10-01 | Applicant |
Non-Patent Literature (82)
- Costa, M. et al. “Vigilante: End-to-End Containment of Internet Worms,” SOSP '05, Oct. 23-26, 2005, Association for Computing Machinery, Inc., Brighton U.K.Applicant
- Chaudet, C. et al., “Optimal Positioning of Active and Passive Monitoring Devices,” International Conference on Emerging Networking Experiments and Technologies, Proceedings of the 2005 ACM Conference on Emerging Network Experiment and Technology, Oct. 2005, pp. 71-82, CoNEXT '05, Toulousse, France.Applicant
- Crandall, J.R. et al., “Minos: Control Data Attack Prevention Orthognal to Memory Model,” 37th International Symposium on Microarchitechture, Dec. 2004, Portland, Oregon.Applicant
- Kim, H. et al., “Autograph: Toward Automated, Distributed Worm Signature Detection,” Proceedings of the 13th Usenix Security Symposium (Security 2004), Aug. 2004, pp. 271-286, San Diego.Applicant
- Kreibich, C. et al., “Honeycomb—Creating Intrusion Detection Signatures Using Honeypots,” 2nd Workshop on Hot Topics in Networks (HotNets—11), 2003, Boston, USA.Applicant
- Newsome, J. et al., “Polygraph: Automatically Generating Signatures for Polymorphic Worms,” In Proceedings of the IEEE Symposium on Security and Privacy, May 2005.Applicant
- Newsome, J. et al., “Dynamic Taint Analysis for Automatic Detection, Analysis, and Signature Generation of Exploits on Commodity Software,” In Proceedings of the 12th Annual Network and Distributed System Security, Symposium (NDSS '05), Feb. 2005.Applicant
- Singh, S. et al., “Automated Worm Fingerprinting,” Proceedings of the ACM/USENIX Symposium on Operating System Design and Implementation, Dec. 2004, San Francisco, California.Applicant
- Margolis, P.E., Random House Webster's “Computer & Internet Dictionary 3rd Edition,” ISBN 0375703519, Dec. 1998.Applicant
- IEEE Xplore Digital Library Seacrh results for “detection of unknown computer worms”. http://ieeexplore.ieee.org/search/searchresult.jsp?SortField=Score&SortOrder=desc&ResultC . . . Accessed on Aug. 28, 2009.Applicant
- AltaVista Advanced Search Results. “Event Orchestrator”. http://www.altavista.com/web/results?itag=ody&pg=aq&aqmode=s&aqa=Event+Orchestrator . . . Accessed on Sep. 3, 2009.Applicant
- AltaVista Advanced Search Results. “attack vector identifier”. http://www.altavista.com/web/results?itag=ody&pg=aq&aqmode=s&aqa=attack+vector+ide . . . Accessed on Sep. 15, 2009.Applicant
- Whyte et al. “DNS-Based Detection of Scannin Works in an Enterprise Network,” Proceedings of the 12th Annual Network and Distributed System Security Symposium, Feb. 2005. 15 pages.Applicant
- Kristoff, J. “Botnets, Detection and Mitigation: DNS-Based Techniques,” NU Security Day 2005, 23 pages.Applicant
- Silicon Defense. “Worm Containment in the Internal Network”, Mar. 2003, pp. 1-25.Applicant
- Nojiri, D. et al, “Cooperative Response Strategies for Large Scale Attack Mitigation,” DARPA Information Survivability Conference and Expostion, Apr. 22-24, 2003, vol. 1, pp. 293-302.Applicant
- Moore, D. et al., “Internet Quarantine: Requirements for Containing Self-Propogating Code”, INFOCOM, Mar. 30-Apr. 3, 2003, vol. 3 pp. 1901-1910.Applicant
- Williamson, Matthew M., “Throttling Viruses: Restricting Propogation to Defeat Malicious Mobile Code”, ACSAC Conference, Dec. 2002, Las Vegas, NV, USA, pp. 1-9.Applicant
- “Packet”, Microsoft Computer Dictionary, Microsoft Press, Mar. 2002, 1pg.Applicant
- U.S. Appl. No. 12/263,971, Non Final Office Action, mailed Apr. 18, 2011.Applicant
- U.S. Appl. No. 12/263,971, Non Final Office Action, mailed Apr. 11, 2012.Applicant
- U.S. Appl. No. 12/263,971, Non Final Office Action, mailed Mar. 14, 2013.Applicant
- U.S. Appl. No. 12/263,971, Final Office Action, mailed Aug. 26, 2011.Applicant
- U.S. Appl. No. 12/263,971, Final Office Action, mailed Sep. 11, 2012.Applicant
- U.S. Appl. No. 12/263,971, Final Office Action, mailed Sep. 10, 2013.Applicant
- IEEE Xplore Digital Library Sear Results for “detection of unknown computer worms”. Http//ieeexplore.ieee.org/searchresult.jsp?SortField=Score&SortOrder=desc&ResultC . . . , (Accessed on Aug. 28, 2009).Applicant
- AltaVista Advanced Search Results. “Event Orchestrator”. Http://www.altavista.com/web/results?Itag=ody&pg=aq&aqmode=aqa=Event+Orchesrator . . . , (Accessed on Sep. 3, 2009).Applicant
- AltaVista Advanced Search Results. “attack vector identifier”. Http://www.altavista.com/web/results?Itag=ody&pg=aq&aqmode=aqa=Event+Orchestrator . . . , (Accessed on Sep. 15, 2009).Applicant
- International Search Report and Written Opinion of the International Searching Authority Dated May 10, 2012; International Application No. PCT/US 12/21916, 9454P019XPCT.Applicant
- International Search Report and Written Opinion of the International Searching Authority Dated May 25, 2012; International Application No. PCT/US 12/26402, 9454P018XPCT.Applicant
- Cisco, Configuring the Catalyst Switched Port Analyzer (SPAN) (“Cisco”) (1992-2003, Cisco Systems).Applicant
- Reiner Sailer, Enriquillo Valdez, Trent Jaeger, Roonald Perez, Leendert van Doorn, John Linwood Griffin, Stefan Berger., sHype: Secure Hypervisor Appraoch to Trusted Virtualized Systems (Feb. 2, 2005) (“Sailer”).Applicant
- Excerpt regarding First Printing Date for Merike Kaeo, Designing Network Security (“Kaeo”) (Copyright 2005).Applicant
- The Sniffers's Guide to Raw Traffic available at: yuba.stanford.edu/˜casado/pcap/section1.html (Jan. 6, 2014).Applicant
- “Network Security: NetDetector—Network Intrusion Forensic System (NIFS) Whitepaper”, (“NetDetector Whitepaper”) (Copyright 2003).Applicant
- “Packet”, Microsoft Computer Dictionary, Microsoft Press, (Mar. 2002), 1 page.Applicant
- “When Virtual is Better Than Real ”, IEEEXplore Digital Library, available at, http://ieeexplore.ieee.org/xpl/articleDetails.jsp?reload=true&arnumber=990073, (Dec. 7, 2013).Applicant
- Adetoye, Adedayo , et al., “Network Intrusion Detection & Response System”, (“Adetoye”), (Sep. 2003).Applicant
- Baecher, “The Nepenthes Platform: An Efficient Approach to collect Malware”, Springer-verlag Berlin Heidelberg, (2006), pp. 165-184.Applicant
- Bayer, et al., “Dynamic Analysis of Malicious Code”, J Comput Virol, Springer-Verlag, France., (2006), pp. 67-77.Applicant
- Boubalos, Chris , “extracting syslog data out of raw pcap dumps, seclists.org, Honeypots mailing list archives”, available at http://seclists.org/honeypots/2003/q2/319 (“Boubalos”), (Jun. 5, 2003).Applicant
- Chaudet, C. , et al., “Optimal Positioning of Active and Passive Monitoring Devices”, International Conference on Emerging Networking Experiments and Technologies, Proceedings of the 2005 ACM Conference on Emerging Network Experiment and Technology, CoNEXT '05, Toulousse, France, (Oct. 2005), pp. 71-82.Applicant
- Cohen, M.I. , “PyFlag—An advanced network forensic framework”, Digital investigation 5, Elsevier, (2008), pp. S112-S120.Applicant
- Costa, M. , et al., “Vigilante: End-to-End Containment of Internet Worms”, SOSP '05, Association for Computing Machinery, Inc., Brighton U.K., (Oct. 23-26, 2005).Applicant
- Crandall, J.R. , et al., “Minos:Control Data Attack Prevention Orthogonal to Memory Model”, 37th International Symposium on Microarchitecture, Portland, Oregon, (Dec. 2004).Applicant
- Distler, “Malware Analysis: An Introduction”, SANS Institute InfoSec Reading Room, SANS Institute, (2007).Applicant
- Dunlap, George W. , et al., “ReVirt: Enabling Intrusion Analysis through Virtual-Machine Logging and Replay”, Proceeding of the 5th Symposium on Operating Systems Design and Implementation, USENIX Association, (“Dunlap”), (Dec. 9, 2002).Applicant
- Hjelmvik, Erik , “Passive Network Security Analysis with NetworkMiner”, (IN)SECURE, Issue 18, (Oct. 2008), pp. 1-100.Applicant
- Kaeo, Merike , “Designing Network Security”, (“Kaeo”), Exhibit 1006, (Nov. 2003).Applicant
- Kim, H. , et al., “Autograph: Toward Automated, Distributed Worm Signature Detection”, Proceedings of the 13th Usenix Security Symposium (Security 2004), San Diego, (Aug. 2004), pp. 271-286.Applicant
- Krasnyansky, Max , et al., Universal TUN/TAP driver, available at https://www.kernel.org/doc/Documentation/networking/tuntap.txt (2002) (“Krasnyansky”).Applicant
- Kreibich, C. , et al., “Honeycomb-Creating Intrusion Detection Signatures Using Honeypots”, 2nd Workshop on Hot Topics in Networks (HotNets-11), Boston, USA, (2003).Applicant
- Kristoff, J. , “Botnets, Detection and Mitigation: DNS-Based Techniques”, NU Security Day, (2005), 23 pages.Applicant
- Liljenstam, Michael, et al., “Simulating Realistic Network Traffic for Worm Warning System Design and Testing”, Institute for Security Technology studies, Dartmouth College, (“Liljenstam”), (Oct. 27, 2003).Applicant
- Marchette, David J., “Computer Intrusion Detection and Network Monitoring: A Statistical Viewpoint”, (“Marchette”) (2001).Applicant
- Margolis, P.E. , “Random House Webster's ‘Computer & Internet Dictionary 3rd Edition’”, ISBN 0375703519, (Dec. 1998).Applicant
- Moore, D. , et al., “Internet Quarantine: Requirements for Containing Self-Propagating Code”, INFOCOM, vol. 3, (Mar. 30-Apr. 3, 2003), pp. 1901-1910.Applicant
- Natvig, Kurt , “SANDBOXII: INTERNET”, Virus Bulletin Conference, (“Natvig”), Exhibit 1028, (Sep. 2002).Applicant
- Newsome, J. , et al., “Dynamic Taint Analysis for Automatic Detection, Analysis, and Signature Generation of Exploits on Commodity Software”, In Proceedings of the 12th Annual Network and Distributed System Security, Symposium (NDSS '05), (Feb. 2005).Applicant
- Newsome, J. , et al., “Polygraph: Automatically Generating Signatures for Polymorphic Worms”, In Proceedings of the IEEE Symposium on Security and Privacy, (May 2005).Applicant
- Nojiri, D. , et al., “Cooperation Response Strategies for Large Scale Attack Mitigation”, DARPA Information Survivability Conference and Exposition, vol. 1, (Apr. 22-24, 2003), pp. 293-302.Applicant
- Silicon Defense, “Worm Containment in the Internal Network”, (Mar. 2003), pp. 1-25.Applicant
- Singh, S. , et al., “Automated Worm Fingerprinting”, Proceedings of the ACM/USENIX Symposium on Operating System Design and Implementation, San Francisco, California, (Dec. 2004).Applicant
- Spitzner, Lance , “Honeypots: Tracking Hackers”, (“Spizner”), (Sep. 17, 2002).Applicant
- Thomas H. Ptacek, and Timothy N. Newsham , “Insertion, Evasion, and Denial of Service: Eluding Network Intrusion Detection”, Secure Networks, (“Ptacek”), (Jan. 1998).Applicant
- Venezia, Paul , “NetDetector Captures Intrusions”, InfoWorld Issue 27, (“Venezia”), (Jul. 14, 2003).Applicant
- Whyte, et al., “DNS-Based Detection of Scanning Works in an Enterprise Network”, Proceedings of the 12th Annual Network and Distributed System Security Symposium, (Feb. 2005), 15 pages.Applicant
- Williamson, Matthew M., “Throttling Viruses: Restricting Propagation to Defeat Malicious Mobile Code”, ACSAC Conference, Las Vegas, NV, USA, (Dec. 2002), pp. 1-9.Applicant
- Abdullah, et al., Visualizing Network Data for Intrusion Detection, 2005 IEEE Workshop on Information Assurance and Security, pp. 100-108.Applicant
- Goel, et al., Reconstructing System State for Intrusion Analysis, Apr. 2008 SIGOPS Operating Systems Review, vol. 42 Issue 3, pp. 21-28.Applicant
- Apostolopoulos, George; hassapis, Constantinos; “V-eM: A cluster of Virtual Machines for Robust, Detailed, and High-Performance Network Emulation”, 14th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, Sep. 11-14, 2006, pp. 117-126.Applicant
- Baldi, Mario; Risso, Fulvio; “A Framework for Rapid Development and Portable Execution of Packet-Handling Applications”, 5th IEEE International Symposium on Signal Processing and Information Technology, Dec. 21, 2005, pp. 233-238.Applicant
- Aura, Tuomas, “Scanning electronic documents for personally identifiable information”, Proceedings of the 5th ACM workshop on Privacy in electronic society. ACM, 2006.Applicant
- Filiol, Eric , et al., “Combinatorial Optimisation of Worm Propagation on an Unknown Network”, International Journal of Computer Science 2.2 (2007).Applicant
- Deutsch, P. ,“Zlib compressed data format specification version 3.3” RFC 1950, (1996).Applicant
- NetBIOS Working Group. Protocol Standard for a NetBIOS Service on a TCP/UDP transport: Concepts and Methods. STD 19, RFC 1001, Mar. 1987.Applicant
- King, Samuel T., et al., “Operating System Support for Virtual Machines”, (“King”), (2001).Applicant
- Peter M. Chen, and Brian D. Noble , “When Virtual Is Better Than Real, Department of Electrical Engineering and Computer Science”, University of Michigan (“Chen”), (References, 1973-2002).Applicant
- Idika et al., A-Survey-of-Malware-Detection-Techniques, Feb. 2, 2007, Department of Computer Science, Purdue University.Applicant
- Bayer et al., Dynamic analysis of malicious code, 2006, Springer-Verlag France.Applicant
- Mori, Detecting Unknown Computer Viruses, 2004, Springer-Verlag Berlin Heidelberg.Applicant
- Heng Yin et al, Panorama: Capturing System-Wide Information Flow for Malware Detection and Analysis, Research Showcase @ CMU, Carnegie Mellon University, 2007.Applicant