Ds_Grid: A database oriented data grid supporting dynamicdata integration in a domain

Abstract

Database oriented data grid becomes a new demand with the development of grid technology, and DS_Grid (DatabaSe oriented Data Grid) is such a grid system supporting dynamic data integration with the idea of service. In DS_Grid, MultiChord is adopted as the grid framework implementing the distributed storage, processing and data integration of data service resources and the domain and its corresponding data resources schema are specified according to text similarity definition to locate the peers data service resources registered, so as to improve the cover range of data service resources discovered, multi-root and multi-peer data resources replica management mechanism to improve the efficiency of discovering data service resources and the reliability and availability of DS_Grid, filter distributed data integration strategy is applied to reduce the traffic cost and the data integration cost, and distributed clustering analysis technology is realized to summarize the huge data information. The experiments have demonstrated the availability of the key technologies adopted in DS_Grid.