Case Studies on the Use of Sentiment Analysis to Assess the Effectiveness and Safety of Health Technologies: A Scoping Review

Polisena, Julie; Andellini, Martina; Salerno, Piergiorgio; Borsci, Simone; Pecchia, Leandro; Iadanza, Ernesto

doi:10.1109/access.2021.3076356

Cited by 14 publications

(7 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our findings are consistent with the recommendations from other recent reviews (21; 22), which concluded that "the outcomes of these applications should be considered exploratory" (in the context of sentiment analysis) (22) but also suggested that the current body of research should be used to inform further development of more structured and consistent methods as well as guidance (21). Therefore, a second, separate output from this project is an initial guidance or framework to support future producers and users of Social Media Research in quality assurance published in this same journal (17).…”

Section: Social Media Research Methodssupporting

confidence: 92%

Using social media research in health technology assessment: stakeholder perspectives and scoping review

Holtorf,

Danyliv,

Huang

et al. 2023

Int J Technol Assess Health Care

View full text Add to dashboard Cite

Objectives The aim of this initiative was to examine collaboratively, in a multi-stakeholder team (health technology assessment (HTA) practitioners with patient involvement expertise, health technology industry, patient advocates, health policy experts, patient engagement experts), whether evidence generated through social media research (SMR) fills current information gaps relating to insights on specific aspects of patient experiences, preferences, or patient needs and delivers additional value to HTA. Methods The framing of the project was done in a co-creative, deliberative multi-stakeholder process. Challenge and refinement happened through discussions with 25 independent stakeholders from HTA bodies, industry, academia, and patient advocacy. For critical themes identified during the framing phase, scoping literature reviews were performed including the state of methods and examples for the use of SMR in HTA. Results The framing and stakeholder discussions specified a set of expectations and requirements, and the scoping reviews revealed the current state of methods and usage of SMR in health-policy decision making. Conclusions The project concluded that SMR can contribute new, relevant evidence to HTA. It is however recommended to evolve the science through defining best practices when planning, conducting, and using SMR and to conduct multi-stakeholder pilot SMR projects to address questions relevant to current HTAs and to validate and improve the proposed practices.

show abstract

Section: Social Media Research Methodssupporting

confidence: 92%

Using social media research in health technology assessment: stakeholder perspectives and scoping review

Holtorf,

Danyliv,

Huang

et al. 2023

Int J Technol Assess Health Care

View full text Add to dashboard Cite

show abstract

“…Social media data analysis has been applied in various health research areas, such as, disease surveillance, and health outcomes research [8][9][10] . Safety outcomes, in particular, have been extensively studied [8][9][10], and patient reports of ADEs are found abundantly within this content-rich resource [11].…”

Section: Introductionmentioning

confidence: 99%

The value of social media analysis for adverse events detection and pharmacovigilance: a Scoping Review (Preprint)

Golder,

O'Connor,

Wang

et al. 2024

JMIR Public Health and Surveillance

View full text Add to dashboard Cite

Background: Adverse drug events pose a significant public health burden leading to hospitalisation, disability, and death. Even those adverse events categorised as non-serious can severely impact on patient quality of life, adherence, and persistence. Monitoring medication safety is challenging. Online patient reports on social media may be a useful supplementary source of realworld data. Despite the growth of sophisticated techniques for identifying adverse events using social media data, a consensus has not been reached as to the value of social media in relation to more traditional data sources.Objective: To evaluate and characterise the utility of social media analysis in adverse drug event detection and pharmacovigilance as compared to other data sources (such as spontaneous reporting systems and the clinical literature). Methods:In this scoping review, we searched 11 bibliographical databases and Google Scholar, followed by handsearching and forward and backward citation searching. Each records was screened by two independent reviewers at both title/abstract stage and the full-text screening stage. Studies were included if they 1) used any type of social media (such as Twitter or patient forums) to detect any adverse event associated with any drug medication and 2) compared the results ascertained from social media to any other data source. Study information was collated using a piloted data extraction sheet . Data were extracted on 1) the adverse events and drugs searched for and included, 2) the methods used (such as machine learning), 3) social media data source, 4) volume of data analysed, 5) limitations of the methodology, 6) availability of data and code, 7) comparison data source and comparison methods, 8) results, including the volume of adverse events, and how adverse events found compared to other data sources in their seriousness, frequencies, and expectedness/novelty (new vs. known knowledge) and 9) conclusions.Results: Of the 6538 unique records screened, 73 publications representing 60 studies and a wide variety of methods met our inclusion criteria. The most common social media platforms used were Twitter and online health forums. The most common comparator data source was spontaneous reporting systems, although other comparisons were made such as with scientific literature and product labels. Although similar patterns of adverse event reporting tended to be identified, the frequencies were lower in social media. Social media data were found useful in identifying new or unexpected adverse events and adverse events in a more timely manner.Conclusions: There is a large body of research comparing adverse events from social media to other sources. Most studies advocated the use of social media as an adjunct to traditional data sources. Some indicated the value of social media in understanding patient perspectives such as the impact of adverse events, which could be better explored.

show abstract

“…Social media data analysis and monitoring have been investigated for its application in health research including health outcomes research, disease surveillance, and patient perspectives [8][9][10]. However, the most commonly studied outcome is that of safety [8][9][10]. Indeed, social media has been identified as a content-rich resource of patient reports of ADEs [11].…”

Section: Introductionmentioning

confidence: 99%

The Role of Social Media for Identifying Adverse Drug Events Data in Pharmacovigilance: Protocol for a Scoping Review

Golder¹,

O’Connor²,

Wang³

et al. 2023

JMIR Res Protoc

View full text Add to dashboard Cite

Background Adverse drug events (ADEs) are a considerable public health burden resulting in disability, hospitalization, and death. Even those ADEs deemed nonserious can severely impact a patient’s quality of life and adherence to intervention. Monitoring medication safety, however, is challenging. Social media may be a useful adjunct for obtaining real-world data on ADEs. While many studies have been undertaken to detect adverse events on social media, a consensus has not yet been reached as to the value of social media in pharmacovigilance or its role in pharmacovigilance in relation to more traditional data sources. Objective The aim of the study is to evaluate and characterize the use of social media in ADE detection and pharmacovigilance as compared to other data sources. Methods A scoping review will be undertaken. We will search 11 bibliographical databases as well as Google Scholar, hand-searching, and forward and backward citation searching. Records will be screened in Covidence by 2 independent reviewers at both title and abstract stage as well as full text. Studies will be included if they used any type of social media (such as Twitter or patient forums) to detect any type of adverse event associated with any type of medication and then compared the results from social media to any other data source (such as spontaneous reporting systems or clinical literature). Data will be extracted using a data extraction sheet piloted by the authors. Important data on the types of methods used (such as machine learning), any limitations of the methods used, types of adverse events and drugs searched for and included, availability of data and code, details of the comparison data source, and the results and conclusions will be extracted. Results We will present descriptive summary statistics as well as identify any patterns in the types and timing of ADEs detected, including but not limited to the similarities and differences in what is reported, gaps in the evidence, and the methods used to extract ADEs from social media data. We will also summarize how the data from social media compares to conventional data sources. The literature will be organized by the data source for comparison. Where possible, we will analyze the impact of the types of adverse events, the social media platform used, and the methods used. Conclusions This scoping review will provide a valuable summary of a large body of research and important information for pharmacovigilance as well as suggest future directions of further research in this area. Through the comparisons with other data sources, we will be able to conclude the added value of social media in monitoring adverse events of medications, in terms of type of adverse events and timing. International Registered Report Identifier (IRRID) PRR1-10.2196/47068

show abstract

Case Studies on the Use of Sentiment Analysis to Assess the Effectiveness and Safety of Health Technologies: A Scoping Review

Cited by 14 publications

References 25 publications

Using social media research in health technology assessment: stakeholder perspectives and scoping review

Using social media research in health technology assessment: stakeholder perspectives and scoping review

The value of social media analysis for adverse events detection and pharmacovigilance: a Scoping Review (Preprint)

The Role of Social Media for Identifying Adverse Drug Events Data in Pharmacovigilance: Protocol for a Scoping Review

Contact Info

Product

Resources

About