Advancing library cyberinfrastructure for big data sharing and reuse

Xie, Zhiwu; Fox, Edward A.

doi:10.3233/isu-170853

Cited by 16 publications

(9 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…95 Xie and Fox explored the roles that research libraries should play in the research lifecycle and discuss the motivations behind a research project to investigate effective library Big Data cyberinfrastructure strategies. 96 These papers present several possibilities and opportunities for the use of Big Data in research libraries, focusing on the analysis, management, and preservation of research data. Literature review indicated that understanding how researchers interact with their data at various points in the lifecycle can help librarians develop targeted services to meet the particular needs of researchers at their institutions and also enhance their services by implementing big data technologies.…”

Section: Big Data In Research Librariesmentioning

confidence: 99%

Big Data: Opportunities and Challenges in Libraries, a Systematic Literature Review

Garoufallou¹,

Gaitanou²

2021

CRL

View full text Add to dashboard Cite

Currently "Big Data" is an emerging field that presents several Information Technology challenges regarding the capture, storage search, structure, and visualization of this data. The real challenge for organizations is to find ways to extract value from it and provide better services to their clients. The data generated in academic and other institutions is vast and complex. Libraries face new challenges as they seek to determine their role in the handling of Big Data within their organization and use it to develop services. Thus, in most organizations, libraries will not have the knowledge to build new services unaided. Furthermore, libraries have always been information handlers and technology adopters; therefore, Big Data technologies will certainly affect their context. The purpose of this paper is to explore all these issues through a systematic literature review, unveiling the theories that underpin the paper's argument. It attempts to answer several research questions, such as how librarians are involved in the Big Data era? And what are the future research developments of Big Data within the library context? The study considered only papers published between 2012 and 2018 in English and presents the collected literature by grouping them according to the type of library each paper refers to. Thus, it identifies new and evolving roles in the context of all types of libraries. In addition, the study presents several interesting tables, which aim to help librarians locate relevant articles that will inform their practice and guide service development for users of large and complex datasets.

show abstract

Section: Big Data In Research Librariesmentioning

confidence: 99%

Big Data: Opportunities and Challenges in Libraries, a Systematic Literature Review

Garoufallou¹,

Gaitanou²

2021

CRL

View full text Add to dashboard Cite

show abstract

“…In other words, even if we can afford to build a query system that can hold all 40 petabytes of data, it is still more efficient to use this system only to partition the larger data set instead of directly handling batch analytics. Therefore, the suitable cyberinfrastructure pattern to reuse web archives should always be the "Bridge" [57], where archival files are stored separately from where the data are to be processed.…”

Section: Reuse Web Archives As Big Data Sourcesmentioning

confidence: 99%

“…For web archiving applications, Warcbase [33] chooses to load WARC files into HBase for querying. As such, archived data will need to persistently occupy the analytical systems, as in the "Network" pattern [57]. This is not suitable for long-term preservation.…”

Section: Related Workmentioning

confidence: 99%

The Case For Alternative Web Archival Formats To Expedite The Data-To-Insight Cycle

Wang

Xie

2020

Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020

Self Cite

View full text Add to dashboard Cite

The WARC file format is widely used by web archives to preserve collected web content for future use. With the rapid growth of web archives and the increasing interest to reuse these archives as big data sources for statistical and analytical research, the speed to turn these data into insights becomes critical. In this paper we show that the WARC format carries significant performance penalties for batch processing workload. We trace the root cause of these penalties to its data structure, encoding, and addressing method. We then run controlled experiments to illustrate how severe these problems can be. Indeed, performance gain of one to two orders of magnitude can be achieved simply by reformatting WARC files into Parquet or Avro formats. While these results do not necessarily constitute an endorsement for Avro or Parquet, the time has come for the web archiving community to consider replacing WARC with more efficient web archival formats.

show abstract

“…The role of librarians is essential for Big Data analytics, so there is a need to improve the skills and knowledge of librarians for the implementations of Big Data analytics. Xie and Fox (2017) argued that for the application of Big Data analytics, the library professionals do not have as such expertise to provide new value-added services. In this context, the research of Atkinson (2018) reveals that there is a need of client-centric approach for LIS professionals to be more integrated into the academic process and to understand and support different phases of research-based needs of library users.…”

Section: Big Data Analytics In Librariesmentioning

confidence: 99%

An analysis of academic librarians competencies and skills for implementation of Big Data analytics in libraries

Ahmad

Zheng

Rafi

2019

DTA

View full text Add to dashboard Cite

Purpose The purpose of this paper is to analyze the views and capabilities of librarians for the implementation of Big Data analytics in academic libraries of Pakistan. The study also sets out to check the relationship between the required skills of librarians and the application of Big Data analytics. Design/methodology/approach A survey was conducted to gather the required data from the targeted audience. The targeted population of the study was Head/In charge library managers of Pakistani university libraries, which were 173 in total. All the respondents (academic librarians) were invited through an e-mail to respond to the survey voluntarily. Out of 173 respondents from higher education commission of Pakistan chartered university libraries, 118 librarians (68.2 percent) completed the survey that was finally considered, and after checking data, recommendation for analysis was made. To analyze the collected data, statistical technique Pearson correlation was applied using statistical package for social science version 25 to know the strength of the mutual correlation of variables. Findings The findings of the study show a strong correlation between the required competencies and skills of librarians for the implementation of Big Data analytics in academic libraries. In all variables of the study, the correlation was highly significant, except two of the variables, including “concept of Big Data” and “different forms of data.” The study also reveals that most of the respondents were well aware of the concept of Big Data analytics. Moreover, they were using a large amount of data to carry out various library operations, including the acquisition, preservation, curation and analysis of data. Originality/value This study is significant in the sense that it fills a substantial gap in the literature regarding the perspective of librarians on Big Data analytics.

show abstract

Advancing library cyberinfrastructure for big data sharing and reuse

Cited by 16 publications

References 12 publications

Big Data: Opportunities and Challenges in Libraries, a Systematic Literature Review

Big Data: Opportunities and Challenges in Libraries, a Systematic Literature Review

The Case For Alternative Web Archival Formats To Expedite The Data-To-Insight Cycle

An analysis of academic librarians competencies and skills for implementation of Big Data analytics in libraries

Contact Info

Product

Resources

About