Fujitsu and Fujitsu Laboratories together have developed complex event processing technology designed for use with cloud technology that employs distributed and parallel processing, which enables adjustment to fluctuations in data loads when processing massive amounts of heterogeneous time series data, now popularly known as "big data."
Complex event processing is a method for mining big data in real time to extract useful information. Methods of processing a large volume of data using a database, for which the data first need to be stored on some medium, such as a disk, are therefore not suitable for real-time processing.
Applying distributed and parallel processing technology to complex event processing enables greater granularity in processing and with dynamic distribution during execution and high speeds, immediate adjustments in load fluctuations were achieved without the need to pause processing.
Complex event processing technology analyses time series data and puts the results to use and the technology enhances the granularity of processing and can transfer this finer processing across servers, as well as be configured based on technology that selects the optimum candidate processing to be transferred.
The new technology is able to apply distributed and parallel processing technology to address load variations and the unit-based management of complex event processing takes each query and the data parallelisation of each query, and then refines it into smaller parts.
In addition, the complex event processing enables the effective distribution of loads and that migrates processing tasks for which the impact of the migration is lowest, based on the speed of load fluctuations, the properties of each event or query, or the status of the processing load.
With the new technology, it will be possible to develop services that provide non-stop analysis, in real time using only the necessary resources, of the large-scale time series data by leveraging in-house facility systems. In addition, given the flexibility to flexibly alter configurations, the need for strict estimates of the resources is eliminated and will be accessible for even small-scale operations.
