e.g. mhealth
Search Results (1 to 9 of 9 Results)
Download search results: CSV END BibTex RIS
Skip search results from other journals and go to results- 7 JMIR Medical Education
- 1 JMIR Dermatology
- 1 JMIR Medical Informatics
- 0 Journal of Medical Internet Research
- 0 Medicine 2.0
- 0 Interactive Journal of Medical Research
- 0 iProceedings
- 0 JMIR Research Protocols
- 0 JMIR Human Factors
- 0 JMIR Public Health and Surveillance
- 0 JMIR mHealth and uHealth
- 0 JMIR Serious Games
- 0 JMIR Mental Health
- 0 JMIR Rehabilitation and Assistive Technologies
- 0 JMIR Preprints
- 0 JMIR Bioinformatics and Biotechnology
- 0 JMIR Cancer
- 0 JMIR Challenges
- 0 JMIR Diabetes
- 0 JMIR Biomedical Engineering
- 0 JMIR Data
- 0 JMIR Cardio
- 0 JMIR Formative Research
- 0 Journal of Participatory Medicine
- 0 JMIR Pediatrics and Parenting
- 0 JMIR Aging
- 0 JMIR Perioperative Medicine
- 0 JMIR Nursing
- 0 JMIRx Med
- 0 JMIRx Bio
- 0 JMIR Infodemiology
- 0 Transfer Hub (manuscript eXchange)
- 0 JMIR AI
- 0 JMIR Neurotechnology
- 0 Asian/Pacific Island Nursing Journal
- 0 Online Journal of Public Health Informatics
- 0 JMIR XR and Spatial Computing (JMXR)
The combined expertise of both professionals provided a robust and reliable reference standard against which the LLMs’ responses were compared.
The questions derived from the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) checklist for observational study and answers.
JMIR Med Inform 2024;12:e59258
Download Citation: END BibTex RIS
As a professional chatbot tool, Chat GPT uses sampling to predict the next token with varying distribution probabilities, ensuring responses are varied and natural in real-world applications. Zhu et al [17] have found that composite answers derived from repeated questioning can enhance the accuracy of Chat GPT. Typically, 2 or 3 repeated responses are necessary to ensure response stability [18-20].
JMIR Med Educ 2024;10:e52784
Download Citation: END BibTex RIS
Assessing GPT-4’s Performance in Delivering Medical Advice: Comparative Analysis With Human Experts
Moreover, the generation of “hallucinatory” or erroneous responses by GPT raises concerns about nonmedical expert users unintentionally accepting incorrect information as valid [15,16]. Consequently, proposals for regulatory oversight of LLMs have emerged, including the establishment of a new regulatory category specifically addressing LLM-related challenges and risks [4].
JMIR Med Educ 2024;10:e51282
Download Citation: END BibTex RIS
Finally, to examine the impact of image-based questions on the program’s ability to respond, we compared the responses to text-only questions with those to questions that included figures. We then added an English translation of the text (including the text provided along with figures) and analyzed the difference.
Regarding statistical methods, comparisons among 3 or more groups were performed using 1-way ANOVA.
JMIR Med Educ 2024;10:e57054
Download Citation: END BibTex RIS
Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study
Chat GPT may serve as a valuable teaching assistant in medical education; however, the inaccuracies in its responses are a significant concern [5,7]. Our current findings suggest that, especially with medical-related images, GPT-4 V should not be relied upon as a primary source of information for medical education or practice. If used, extreme caution should be exercised regarding the accuracy of its responses.
JMIR Med Educ 2024;10:e54393
Download Citation: END BibTex RIS
The prompts were designed to guide GPT’s behavior and ensure it provided medically accurate and relevant responses. Presented in detail next, our prompt included a chatbot-optimized illness script as well as a behavioral instruction prompt.
We developed a fictitious medical case in a format that could be posted to GPT. As our learning objective was to take a systematic history, we intended to provide all required details.
JMIR Med Educ 2024;10:e53961
Download Citation: END BibTex RIS
However, 97% of responses were deemed by physician evaluators as appropriate with no clinical guideline violations [13]. Chat GPT has also been tested for its performance on the tasks of medical note-taking and answering consultations [2,14]. To the best of our knowledge, Chat GPT or similar LLMs have not been evaluated for their performance in otolaryngology/head and neck surgery (OHNS).
JMIR Med Educ 2024;10:e49970
Download Citation: END BibTex RIS
However, these accomplishments have been attained exclusively in English, and investigations conducted until 2022 cast doubt on its ability to provide medically reliable responses in non-English languages [6]. On March 14, 2023, Open AI introduced the latest iteration of LLMs, GPT-4 [7,8]. Touted as more reliable and innovative than its predecessor, GPT-3.5, GPT-4 reportedly shows superior performance in non-English languages, particularly in academic and professional contexts [8,9].
JMIR Med Educ 2023;9:e52202
Download Citation: END BibTex RIS
Across both diseases, 78% (50/64) of Chat GPT responses were correct but inadequate (score ≤2), with 45% (29/64) of answers being fully comprehensive (score 1). No responses were completely inaccurate (score 4). For AD and acne specifically, 88% (28/32) and 66% (21 of 32) of responses were correct but inadequate (score ≤2), and 53% (17/32) and 34% (11/32) were fully comprehensive (score 1), respectively. This broadly indicates acceptable performance of Chat GPT across both conditions.
JMIR Dermatol 2023;6:e50409
Download Citation: END BibTex RIS