A novel approach to data deduplication over the engineering-oriented cloud systems

Sun, Zhe; Shen, Jun; Yong, Jianming

doi:10.3233/ica-120418

Cited by 23 publications

(8 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…From the literatures above, we can conclude that with the rapid development of large-scale web3D application especially in cloud computing [13,25,28] recently, sematic annotation mechanism becomes a sound base. Most current researches have proved the possibility of using ontology in 3D content annotation on high level.…”

Section: Comprehensive Annotation Based On Ontologymentioning

confidence: 99%

Semantic annotation for web3D scene based on three-layer ontology

Cai

Shi

et al. 2015

ICA

View full text Add to dashboard Cite

Semantic annotation provides a fundamental technology for web-based visualization application. However, the lack of automatic reasoning ability makes annotation task both boring and time-consuming when mass 3D models occurs. By means of three-layer ontology based on X3D, a comprehensive approach is proposed to implement semi-automatic semantic annotation in web3D scene. Firstly, three-layer ontology including general ontology, domain ontology and scene ontology is constructed by combining X3D instances with general knowledge, which forms a comprehensive knowledge representation for semantic annotation. Then, based on X3D, features extraction, node reduction and node matching is carried out to implement part-annotation of a certain scene. Next, based on the rules defined, annotation spread mechanism is carried out to implement automatic annotation. Lastly, a case study based on implemented prototype system is also provided to demonstrate the process of semantic annotation. The result shows that the proposed approach can help to implement semantic annotation effectively.

show abstract

Section: Comprehensive Annotation Based On Ontologymentioning

confidence: 99%

Semantic annotation for web3D scene based on three-layer ontology

Cai

Shi

et al. 2015

ICA

View full text Add to dashboard Cite

show abstract

“…Different solutions adopting cryptography to secure information in distributed computing environment have been conceived [3,6,7,11,13,16,17,[19][20][21]31]. In [19], the authors propose a technique for securing data disseminated in a distributed environment based on symmetric cryptography.…”

Section: Related Workmentioning

confidence: 99%

Information dependability in distributed systems: The dependable distributed storage system

Distefano

Puliafito

2014

ICA

View full text Add to dashboard Cite

In distributed infrastructures data are usually scattered among different nodes and thus accessible by several users. It is therefore necessary to provide mechanisms and tools for managing the information, ensuring the access exclusively to authorized users avoiding malicious ones. Furthermore, satisfactory performance and adequate fault tolerance have to be provided while addressing information confidentiality, availability and integrity issues. In this paper we face the problem of data dependability in distributed system, proposing a redundant lightweight cryptography algorithm combining symmetric and asymmetric cryptography approaches. The proposed algorithm, named dependable distributed storage system (D 2 S 2 ), has been implemented on top of the Grid gLite middleware file access and replica management libraries, as a file system service with cryptography capability, redundancy management and POSIX interface. To demonstrate the effectiveness and the applicability of the D 2 S 2 gLite implementation, performance and reliability of its operations have been evaluated and compared to those of existing solutions. The tests have been performed on real applications to provide a complete overview of the D 2 S 2 implementation. The results thus obtained demonstrate the effectiveness of the D 2 S 2 implementation also compared to existing solutions and former implementations.

show abstract

“…They are autonomous entities and are often self-organized, without a central controller. Moreover, bio-inspired concepts and mechanisms have already been applied successfully to service-oriented systems by a few researchers, including some of our work in applying bio-inspired algorithms to tackling the problems related to dataintensive service provision (Yuan et al, 2009;Shen et al, 2011;Dong et al, 2012;Wang & Shen, 2012;Sun et al, 2013;Wang et al, 2013aWang et al, , 2013b. Based on these existing studies, we are confident that bio-inspired algorithms present many advantages in dealing with data-intensive service-provision problems.…”

Section: Bio-inspired Algorithms To Optimize Data-intensive Service Pmentioning

confidence: 99%

“…To be able to allocate, aggregate (Dong et al, 2012), duplicate and de-duplicate (Sun et al, 2013) unstructured data stored virtually everywhere, the configuration and management of data should be optimized, not only for reasons of performance and efficiency of data access, but also for lower cost and even the implicit energy and space savings in the maintenance of data storage.…”

Section: Bio-inspired Algorithms To Optimize Data-intensive Service Pmentioning

confidence: 99%

Bio-Inspired Cost-Effective Access to Big Data

Wang¹,

Shen

2014

Proceedings of the International Symposium for Next Generation Infrastructure

Self Cite

View full text Add to dashboard Cite

With the rapid proliferation of services and cloud computing, Big Data has become a significant phenomenon across many scientific disciplines and sectors of society, wherever huge amounts of data are generated and processed daily. End users will always seek higher-quality data access at lower prices. This demand poses challenges to service composers, service providers and data providers, who should maintain their service and data provision as cost-effectively as possible. This paper will apply bio-inspired approaches to achieving equilibrium among the otherwise competitive stakeholders. In addition to novel models of cost for Big Data provision, bio-inspired algorithms will be developed and validated for dynamic optimisation. Furthermore, the optimised algorithms will also be applied in the data-mining research on the Alpha Magnetic Spectrometer (AMS) experiment, which is aiming to find dark matter in the universe. This experiment typically receives 200G and generates 700G data daily. ABSTRACTWith the rapid proliferation of services and cloud computing, Big Data has become a significant phenomenon across many scientific disciplines and sectors of society, wherever huge amounts of data are generated and processed daily. End users will always seek higher-quality data access at lower prices. This demand poses challenges to service composers, service providers and data providers, who should maintain their service and data provision as cost-effectively as possible. This paper will apply bio-inspired approaches to achieving equilibrium among the otherwise competitive stakeholders. In addition to novel models of cost for Big Data provision, bio-inspired algorithms will be developed and validated for dynamic optimisation. Furthermore, the optimised algorithms will also be applied in the data-mining research on the Alpha Magnetic Spectrometer (AMS) experiment, which is aiming to find dark matter in the universe. This experiment typically receives 200G and generates 700G data daily.

show abstract

A novel approach to data deduplication over the engineering-oriented cloud systems

Cited by 23 publications

References 17 publications

Semantic annotation for web3D scene based on three-layer ontology

Semantic annotation for web3D scene based on three-layer ontology

Information dependability in distributed systems: The dependable distributed storage system

Bio-Inspired Cost-Effective Access to Big Data

Contact Info

Product

Resources

About