Recent advances in the ubiquitous computing and the context-aware system have driven the intelligent agents for the management of user movements and multi contexts. With the growth of the agent-based system and the advances in networking technologies, the design and development of the multi agent system have risen in importance. However, the conventional models offer some kinds of static services to limited users and operate the sequential structure of multi agent middleware. Relatively few studies have been devoted to the research issues of the convergence in heterogeneous networks, the diversity in service requirements and the efficiency in service management to effectively support next-generation context-aware services. Therefore, we propose a parallel Multi Agent Middleware which provides efficient approaches to manage the seamless service and the reconstruction of services according to user movements and a couple of situations. Our architecture allows us to create a rich set of MsMu (Multi Source Multi Use) services through the extension of OsMu (One Source Multi Use) services for enhancing a service satisfaction. Moreover, we enhance the aspect of the service response time and the success probability of the contextaware schedule by using the determination rules of service reconstruction.