
==== Front
Res Sq
ResearchSquare
Research Square
2693-5015
American Journal Experts

10.21203/rs.3.rs-4876692/v1
10.21203/rs.3.rs-4876692
preprint
1
Article
VaxBot-HPV: A GPT-based Chatbot for Answering HPV Vaccine-related Questions
Tao Cui
Li Yiming
Li Jianfu
Li Manqi
Yu Evan
Amith Muhammad
Tang Lu
Savas Lara
Cui Licong
11 9 2024
rs.3.rs-4876692https://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License, which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
https://www.researchsquare.com/article/rs-4876692/v1
nihpp-rs4876692v1.pdf
Abstract

Background : HPV vaccine is an effective measure to prevent and control the diseases caused by Human Papillomavirus (HPV). This study addresses the development of VaxBot-HPV, a chatbot aimed at improving health literacy and promoting vaccination uptake by providing information and answering questions about the HPV vaccine; Methods : We constructed the knowledge base (KB) for VaxBot-HPV, which consists of 451 documents from biomedical literature and web sources on the HPV vaccine. We extracted 202 question-answer pairs from the KB and 39 questions generated by GPT-4 for training and testing purposes. To comprehensively understand the capabilities and potential of GPT-based chatbots, three models were involved in this study : GPT-3.5, VaxBot-HPV, and GPT-4. The evaluation criteria included answer relevancy and faithfulness; Results : VaxBot-HPV demonstrated superior performance in answer relevancy and faithfulness compared to baselines (Answer relevancy: 0.85; Faithfulness: 0.97) for the test questions in KB, (Answer relevancy: 0.85; Faithfulness: 0.96) for GPT generated questions; Conclusions : This study underscores the importance of leveraging advanced language models and fine-tuning techniques in the development of chatbots for healthcare applications, with implications for improving medical education and public health communication.
==== Body
pmc
