A Real Time Data Extraction, Transformation and Loading Solution for Semi-structured Text Files

Viana, N.; Raminhos, Ricardo; Pires, João Moura

doi:10.1007/11595014_38

Cited by 8 publications

(7 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…[28], YiChuan and Yao [29], MadeSukarsa et al [30], Jain et al [13], Jia et al [31], Obali et al [32], Mao et al [33], Li and Mao [20] and Muddasir and Raghuveer [9] deals with low latency. Further, just Bruckner et al [26] and Viana et al [34] deal with availability requirements.…”

Section: Related Workmentioning

confidence: 99%

“…Although there are a lot of works that approach different aspects of real-time environment, few works deal with more than one of these requirements. Just Bruckner et al [26] approaches the availability and low response time requirements, and Viana et al [34] approaches the availability and scalability requirements. Just Guerreiro et al [1] pointed out the fact that ETL process should deal with Big Data in a real-time data warehousing.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

An Innovative Method to Extract Data in a Real-time Data Warehousing Environment

Vilela¹,

Ciferri²

2021

Computing Advances &Amp; Trends

View full text Add to dashboard Cite

ETL (Extract, Transform, and Load) is an essential process required to perform data extraction in knowledge discovery in databases and in data warehousing environments. The ETL process aims to gather data that is available from operational sources, process and store them into an integrated data repository. Also, the ETL process can be performed in a real-time data warehousing environment and store data into a data warehouse. This paper presents a new and innovative method named Data Extraction Magnet (DEM) to perform the extraction phase of ETL process in a real-time data warehousing environment based on non-intrusive, tag and parallelism concepts. DEM has been validated on a dairy farming domain using synthetic data. The results showed a great performance gain in comparison to the traditional trigger technique and the attendance of real-time requirements.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

An Innovative Method to Extract Data in a Real-time Data Warehousing Environment

Vilela¹,

Ciferri²

2021

Computing Advances &Amp; Trends

View full text Add to dashboard Cite

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Computing Advances & Trends

2021

View full text Add to dashboard Cite

The goal of this conference series is to bring together researchers and practitioners from academia and industry to focus on understanding computer science and information technology and to establish new collaborations in these areas. Authors are invited to contribute to the conference by submitting articles that illustrate research results, projects, survey work and industrial experiences describing significant advances in all areas of computer science and information technology.

show abstract

“…Se resalta de este modelo que es personalizable y extensible de tal forma que el diseñador del proceso puede enriquecerlo. Otros trabajos realizados en encuentran en Viana et al (2005) y Squire (1995.…”

Section: Introductionunclassified

Una aproximación multi-agente para el soporte al proceso de extracción- transformación-carga en bodegas de datos

Betancur-Calderón

Cadavid

2012

TecnoL.

View full text Add to dashboard Cite

Para brindar una solución adecuada en términos de robustez y auto-matización en el proceso de Extracción-Transformación-Carga (ETL por sus siglas en inglés) en bodegas de datos, en este artículo se presenta un modelo de sistema multi-agente que recopila las fortalezas de otros enfo-ques como son los wrappers y soluciones ad-hoc. Tal modelo considera la heterogeneidad y disponibilidad de las fuentes de datos, así como el carác-ter distribuido de los mismos. Para su validación se llevó a cabo una experimentación con datos tanto simulados como reales, la cual demostró no sólo su viabilidad técnica si no también su efectividad en cuanto a porcentaje de datos procesados y a tiempo para hacerlo.

show abstract

A Real Time Data Extraction, Transformation and Loading Solution for Semi-structured Text Files

Cited by 8 publications

References 5 publications

An Innovative Method to Extract Data in a Real-time Data Warehousing Environment

An Innovative Method to Extract Data in a Real-time Data Warehousing Environment

Computing Advances & Trends

Una aproximación multi-agente para el soporte al proceso de extracción- transformación-carga en bodegas de datos

Contact Info

Product

Resources

About