Automating database schema evolution in information system upgrades

Abstract

The complexity, cost, and down-time currently created by the database schema evolution process is the source of incessant problems in the life of information systems and a major stumbling block that prevent graceful upgrades. Furthermore, our studies shows that the serious problems encountered by traditional information systems are now further exacerbated in web information systems and cooperative scientific databases where the frequency of schema changes has increased while tolerance for downtimes has nearly disappeared. The PRISM project seeks to develop the methods and tools that turn this error-prone and time-consuming process into one that is controllable, predictable and avoids down-time. Toward this goal, we have assembled a large testbed of schema evolution histories, and developed a language of Schema Modification Operators (SMO) to express concisely these histories. Using this language, the database administrator can specify new schema changes, and then rely on PRISM to (i) predict the effect of these changes on current applications, (ii) translate old queries and updates to work on the new schema version, (iii) perform data migration, and (iv) generate full documentation of intervened changes. Furthermore, PRISM achieves good usability and scalability by incorporating recent advances on mapping composition and invertibility in the implementation of (ii). The progress in automating schema evolution so achieved provides the enabling technology for other advances, such as light-weight database design methodologies that embrace changes as the regular state of software. While these topics remain largely unexplored, and thus provide rich opportunities for future research, an important area which we have been investigated is that of archival information systems, where PRISM query mapping techniques were used to support flashback and historical queries for database archives under schema evolution.

Evolution of XML schemas and documents from stereotyped UML class models: A traceable approach

“…With respect to the practical validation of completeness, some papers show [66] that a reduced number of simple, carefully designed primitives, as those presented in this paper, can express a high percentage of all the evolution cases. Moreover, the work [48] shows that a large library of operators increases the complexity of specifying migration.…”

Zero-Downtime SQL Database Schema Evolution for Continuous Deployment

“…The most influential work regarding schema evolution of SQL databases has been done on the Panta Rhei framework. In particular the tool PRISM and its successor PRISM++ have been an influential research effort [12,13,14]. The Panta Rhei framework is a long-running research effort into SQL databases and schema evolutions.…”

DaemonX

“…However, this is not the area we are dealing with since the updates are mostly considered within the respective XML schema. In the area of evolution of general database schemas we can find approaches that focus on evolution of (object-)relational schemas [19,20] as well as objectoriented schemas [8,30]. Similar to the case of XML schema evolution, there are also approaches that deal with propagation from an ER schema, i.e., PSM level, to a relational schema [5], i.e., schema level or propagation to an operational level [19].…”