Web Scraping Techniques and Applications: A Literature Review

Lotfi, Chaimaa; Srinivasan, Savitha; Ertz, Myriam; Latrous, Imen

doi:10.52458/978-93-91842-08-6-38

Cited by 16 publications

(5 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Using web scraping techniques to mine data from relevant internet-based platforms can greatly aid organizational management applications. This study follows the basic web scraping design process steps proposed by Lotfi et al [ 35 ].…”

Section: Methodsmentioning

confidence: 99%

Exploring Consumers’ Negative Electronic Word-of-Mouth of 5 Military Hospitals in Taiwan Through SERVQUAL and Flower of Services: Web Scraping Analysis

Huang,

Lee,

Chen

2024

JMIR Form Res

View full text Add to dashboard Cite

Background In recent years, with the widespread use of the internet, the influence of electronic word-of-mouth (eWOM) has been increasingly recognized, particularly the significance of negative eWOM, which has surpassed positive eWOM in importance. Such reviews play a pivotal role in research related to service industry management, particularly in intangible service sectors such as hospitals, where they have become a reference point for improving service quality. Objective This study comprehensively collected negative eWOM from 5 military hospitals in Taiwan that were at or above the level of regional teaching hospitals. It aimed to investigate service quality issues before and after the pandemic. The findings provide important references for formulating strategies to improve service quality. Methods In this study, we used web scraping techniques to gather 1259 valid negative eWOM, covering the period from the inception of the first review to December 31, 2022. These reviews were categorized using content analysis based on the modified Parasuraman, Zeithaml, and Berry service quality (PZB SERVQUAL) scale and Flower of Services. Statistical data analysis was conducted to investigate the performance of service quality. Results The annual count of negative reviews for each hospital has exhibited a consistent upward trajectory over the years, with a more pronounced increase following the onset of the pandemic. In the analysis, among the 5 dimensions of PZB SERVQUAL framework, the “Assurance” dimension yielded the least favorable results, registering a negative review rate as high as 58.3%. Closely trailing, the “Responsiveness” dimension recorded a negative review rate of 34.2%. When evaluating the service process, the subitem “In Service: Diagnosis/Examination/Medical/Hospitalization” exhibited the least satisfactory performance, with a negative review rate of 46.2%. This was followed by the subitem “In Service: Pre-diagnosis Waiting,” which had a negative review rate of 20.2%. To evaluate the average scores of negative reviews before and during the onset of the COVID-19 pandemic, independent sample t tests (2-tailed) were used. The analysis revealed statistically significant differences (P<.001). Furthermore, an ANOVA was conducted to investigate whether the length of the negative reviews impacted their ratings, which also showed significant differences (P=.01). Conclusions Before and during the pandemic, there were significant differences in evaluating hospital services, and a higher word count in negative reviews indicated greater dissatisfaction with the service. Therefore, it is recommended that hospitals establish more comprehensive service quality management mechanisms, carefully respond to negative reviews, and categorize significant service deficiencies as critical events to prevent a decrease in overall service quality. Furthermore, during the service process, customers are particularly concerned about the attitude and responsiveness of health care personnel in the treatment process. Therefore, hospitals should enhance training and management in this area.

show abstract

Section: Methodsmentioning

confidence: 99%

Exploring Consumers’ Negative Electronic Word-of-Mouth of 5 Military Hospitals in Taiwan Through SERVQUAL and Flower of Services: Web Scraping Analysis

Huang,

Lee,

Chen

2024

JMIR Form Res

View full text Add to dashboard Cite

show abstract

“…Also, specific techniques are applied for each data source or format as they appear. Web scraping has grown to become a pivotal method for obtaining enormous quantities of diverse information nowadays that modern research projects relying on data analysis are largely based on [18], [19].…”

Section: Methods For Extracting Datamentioning

confidence: 99%

Web Scraping Scientific Repositories: Springer and Nature for University of Basrah

Taufeeq Al-Madhhachi,

A. Mahmood

2023

J. Al-Qadisiyah Comp. Sci. Math.

View full text Add to dashboard Cite

This study explores the field of scientific data extraction using online scraping techniques, with a specific focus on the Springer and Nature archives within the University of Basrah's setting. This study aims to explicate the theoretical underpinnings of web scraping, emphasizing its importance in the acquisition of structured data from online sources. This study explores the many issues presented by dynamic content, captchas, and IP blocking and proposes novel solutions for each of these obstacles. The university's research objectives were supported by a rich dataset that was carefully constructed through a painstaking approach encompassing data collection, preparation techniques. The results highlight the effectiveness of web scraping, significant influence of preprocessing. This study not only enhances the existing body of academic research methodology but also advances the University of Basrah's pursuit of data-driven and influential scholarly pursuits.

show abstract

“…Chaimaa Lotfi et al(2021), This paper speaks about how an organizations may now analyze massive data volumes and obtain fresh insights thanks to big data analytics. It assists in providing basic answers to inquiries concerning the performance and operations of businesses.…”

Section: Literature Surveymentioning

confidence: 99%

Personalized Job Opportunity Finder powered by Web Scraping

Akshay,

Arun Kumar,

Ramyasri

et al. 2024

MATEC Web Conf.

View full text Add to dashboard Cite

"Personalized Job Opportunity Finder powered by Web Scraping" research presents a comprehensive exploration the development and implementation of an innovative Job Portal, aiming to redefine the traditional job search experience. The project leverages cutting-edge techniques and integration with prominent communication tools. The experimental setup involves meticulous web scraping from renowned job portals, Google and Apple, using Puppeteer and Cheerio for data extraction. The user interface is thoughtfully designed, featuring an intuitive registration form and a dynamic home page that showcases personalized job recommendations. The research delves into the advantages of scraping job data from top companies, showcasing its efficacy compared to traditional methods such as partnerships and direct job postings. Big companies such as Google, Apple and Meta don't use partnerships for most of its hiring, that makes it difficult for candidates who aspire careers at such companies. Direct partnerships may have delays in updating job listings, whereas scraping allows for more immediate access to new postings.

show abstract

Web Scraping Techniques and Applications: A Literature Review

Cited by 16 publications

References 0 publications

Exploring Consumers’ Negative Electronic Word-of-Mouth of 5 Military Hospitals in Taiwan Through SERVQUAL and Flower of Services: Web Scraping Analysis

Exploring Consumers’ Negative Electronic Word-of-Mouth of 5 Military Hospitals in Taiwan Through SERVQUAL and Flower of Services: Web Scraping Analysis

Web Scraping Scientific Repositories: Springer and Nature for University of Basrah

Personalized Job Opportunity Finder powered by Web Scraping

Contact Info

Product

Resources

About