Efficient Grid GIS Framework for Spatial Data

Abstract

Geographic Information System (GIS) data is huge in volume and requires tremendous data storage capacity. Grid computing technology in the GIS domain provides cooperation and integration of services to implement a complex spatial function, and consequently provides a significant performance gain. The combination of GIS and Grid Computing, well known as Grid-GIS, has become a new research tendency. The existing Grid-GIS architectures and frameworks, such as OGSI with WSDL and XML based Grid-GIS, OGSA with WSRF based Grid-GIS, and parallel processing oriented mobile agent based Grid-GIS, suffer from the less efficient data access, retrieval and complex procedures, for achieving fault tolerance, availability and scalability. Grid computing is characterized in dealing with a bag-of-tasks having few Inputs/Outputs (I/O)s. The analysis of voluminous spatial data, that is characterized as big data, requires few complex tasks, however the number of intermediate (I/O)s remain very high. The MapReduce computations are compatible for processing data-intensive spatial data that requires a large number of inputs and intermediate data. The MapReduce is also better than the mobile agent technology, as it provides built-in support for parallel processing operations and fault tolerance that abstracts the complexity of operations from the user. The integrated Grid and MapReduce for GIS data supplement each other by providing data analysis and computational environment together. Firstly, it provides high utilization of the resource pool. Secondly, the high data analytic feature of the MapReduce - Hadoop is complimented with the comprehensive accounting, resource utilization control, and policy management features of the grid. However, not much research work is found that integrates MapReduce and Grid-GIS. So, considering the benefits of the MapReduce, the proposed architecture and framework integrates the MapReduce in the Grid-GIS. Three parallel spatial indexing algorithms based on MapReduce are also included as significant