Workflow, transactions and datalog

Bonner, Anthony J.

doi:10.1145/303976.304005

Cited by 41 publications

(30 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Some solutions for workflows focus on the control flow among processes such as active databases [18], relational transducers [19] and enhanced datalog [20]. As scientific jobs are typical long-running and resource-intensive, it is essential to efficiently manage the data-flow.…”

Section: Integrating Databases and Workflowsmentioning

confidence: 99%

ParaLite: A Parallel Database System for Data-Intensive Workflows

Chen

Taura

2014

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYTo better support data-intensive workflows which are typically built out of various independently developed executables, this paper proposes extensions to parallel database systems called User-Defined eXecutables (UDX) and collective queries. UDX facilitates the description of workflows by enabling seamless integrations of external executables into SQL statements without any efforts to write programs confirming to strict specifications of databases. A collective query is an SQL query whose results are distributed to multiple clients and then processed by them in parallel, using arbitrary UDX. It provides efficient parallelization of executables through the data transfer optimization algorithms that distribute query results to multiple clients, taking both communication cost and computational loads into account. We implement this concept in a system called ParaLite, a parallel database system based on a popular lightweight database SQLite. Our experiments show that ParaLite has several times higher performance over Hive for typical SQL tasks and has 10x speedup compared to a commercial DBMS for executables. In addition, this paper studies a real-world text processing workflow and builds it on top of ParaLite, Hadoop, Hive and general files. Our experiences indicate that ParaLite outperforms other systems in both productivity and performance for the workflow. key words: data-intensive workflow, parallel database system, userdefined executable, collective query

show abstract

Section: Integrating Databases and Workflowsmentioning

confidence: 99%

ParaLite: A Parallel Database System for Data-Intensive Workflows

Chen

Taura

2014

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

“…Bonner [35] proposes to solve transaction problems using Transaction Datalog (TD). He identified different types of transactions and exceptions that might occur, and wrote TD rules for them.…”

Section: Related Workmentioning

confidence: 99%

Transaction Management in Service-Oriented Systems: Requirements and a Proposal

Sun

Khoury²,

Aiello³

2011

IEEE Trans. Serv. Comput.

View full text Add to dashboard Cite

Abstract-Service-Oriented Computing (SOC) is becoming the mainstream development paradigm of applications over the Internet, taking advantage of remote independent functionalities. The cornerstone of SOC's success lies in the potential advantage of composing services on the fly. When the control over the communication and the elements of the information system is low, developing solid systems is challenging. In particular, developing reliable web service compositions usually requires the integration of both composition languages, such as the Business Process Execution Language (BPEL), and of coordination protocols, such as WSAtomicTransaction and WS-BusinessActivity. Unfortunately, the composition and coordination of web services currently have separate languages and specifications. The goal of this paper is twofold. First, we identify the major requirements of transaction management in Service-oriented systems and survey the relevant standards. Second, we propose a semiautomatic approach to integrate BPEL specifications and web service coordination protocols, that is, implementing transaction management within service composition processes, and thus overcoming the limitations of current technologies.

show abstract

“…CTR extends first-order logic for programming, executing and reasoning state changing concurrent processes [8]. It has been successfully applied to modeling, reasoning about and scheduling workflows [11,7]. CCTR exploits the workflow modeling, reasoning and scheduling capabilities of CTR and broadens these capabilities for the set of resource allocation constraints.…”

Section: Cctrmentioning

confidence: 99%