A grid middleware for distributed Java computing with MPI binding and process migration supports

Abstract

Grid" computing has emerged as an important new research field. With years of efforts, Grid researchers have successfully developed Grid technologies including security solutions, resource management protocols, information query protocols, and data management services. However, as the ultimate goal of Grid Computing is to design an infrastructure which supports dynamic, cross-organizational resource sharing, there is a need of solutions for efficient and transparent task re-scheduling in the Grid.In this research, we propose a new Grid middleware, named G-JavaMPI. This middleware adds the parallel computing capability of Java on the Grid with the support of a Grid-enabled message passing interface (MPI) for inter-process communication between Java processes executed at different Grid points. A special feature of the proposed G-JavaMPI is the support of Java process migration with post-migration message redirection. With these supports, we can migrate executing Java process from site to site for continuous computation, if some site is scheduled to turn down for system reconfiguration. The proposed middleware is useful for Grid computing as most applications in Grid require long processing time. Restart the execution of those applications will certainly lessen the productivity. Moreover, the proposed G-JavaMPI middleware is very portable as it requires no modification of underlying OS, Java virtual machine, and MPI package. Preliminary performance tests have been conducted. The proposed mechanisms have shown good migration efficiency in a simulated Grid environment. migration functions, which allows transparent migration of Java programs in the Grid environment.G-JavaMPI uses the Java built-in debugging interface (JVMDI) to capture execution states, and uses object serialization mechanism [16] to store data in portable form. As JVMDI [15] is a standard interface, this approach is potentially more portable and suitable for the heterogeneous Grid environments, where different JVMs are used. In a Grid environment, any attempt of remote process creation must first pass the authentication process with their appropriate credentials to the destination site before the process can be actually restarted. In G-JavaMPI, the authentic ation processes are based on the security services provided by GSI [8,19] (Globus Security Infrastructure) implemented in Globus toolkit [12].The implementation of the native MPI library that we use in this research is MPICH-G2 [3]. MPICH-G2 is a Grid-enabled implementation of the MPI v1.1 standard. MPICH-G2 uses services provided by the Globus Toolkit to coordinate work and enable authenticated inter-site communication in the Grid environment. MPICH-G2 can also automatically convert data in messages sent between machines of different architectures and supports multi-protocol communication by automatically selecting TCP for inter-machine messaging and vendorsupplied MPI (where available) for intra-machine messaging. To support transparent Java process migration, the communication channel s between...

Architecture design of grid GIS and its applications on image processing based on LAN*1

“…It accords with the principle of software modularization. In GIS project, especially in many big GIS projects, using middleware can help us to lighten our ''software's weight'', which accords with the principle of component software [9,16]. At the same time, grid middleware helps our system to develop toward software modularization, and we can easily advance the efficiency and the service quality of our software just by improving some grid middleware.…”

Distributed computing model for processing remotely sensed images based on grid computing

“…1, one can easily use the shared services of the grid-computing system when completing tasks. A characteristic of grid computing is that it combines the advantages of both parallel and distributed computing in network-computing procedures [2,6,27]. It also provides a global resources-sharing mechanism for data management and computing via its service registry/discovery mechanism.…”

G‐PASS: an instance‐oriented security infrastructure for Grid travelers

“…These Grid sites are interconnected by the Hong Kong Academic and Research Network (HARNET). The ray tracing program was implemented using G-JavaMPI [11], which is an MPI middleware that supports parallel and distributed Java computing in a Grid environment. A special feature of G-JavaMPI is its support of transparent Java process migration which can facilitate dynamic load sharing and resource-driven task migrations.…”