Journal article · 2024 · Open access
Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), 1–32 · Published 6 March 2024 · DOI 10.1145/3643540
In brief
“Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data” is a 2024 journal article by Xuhai Xu and 8 co-authors, published in Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies. OpenAlex counts 655 citations as of 19 November 2026. It is open access: the full text is free to read at PubMed Central.
- Citations
- 655
- Most cited in
- 2026 (248)
- Field-weighted impact
- 156.64
- References
- 131
- Authors
- 9
Abstract
Advances in large language models (LLMs) have empowered a variety of applications. However, there is still a significant gap in research when it comes to understanding and enhancing the capabilities of LLMs in the field of mental health. In this work, we present a comprehensive evaluation of multiple LLMs on various mental health prediction tasks via online text data, including Alpaca, Alpaca-LoRA, FLAN-T5, GPT-3.5, and GPT-4. We conduct a broad range of experiments, covering zero-shot prompting, few-shot prompting, and instruction fine-tuning. The results indicate a promising yet limited performance of LLMs with zero-shot and few-shot prompt designs for mental health tasks. More importantly, our experiments show that instruction finetuning can significantly boost the performance of LLMs for all tasks simultaneously. Our best-finetuned models, Mental-Alpaca and Mental-FLAN-T5, outperform the best prompt design of GPT-3.5 (25 and 15 times bigger) by 10.9% on balanced accuracy and the best of GPT-4 (250 and 150 times bigger) by 4.8%. They further perform on par with the state-of-the-art task-specific language model. We also conduct an exploratory case study on LLMs' capability on mental health reasoning tasks, illustrating the promising capability of certain models such as GPT-4. We summarize our findings into a set of action guidelines for potential methods to enhance LLMs' capability for mental health tasks. Meanwhile, we also emphasize the important limitations before achieving deployability in real-world mental health settings, such as known racial and gender bias. We highlight the important ethical risks accompanying this line of research.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Xu, X., Yao, B., Dong, Y., Gabriel, S., Yu, H. Q., Hendler, J., Ghassemi, M., Dey, A. K., & Wang, D. (2024). Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), 1–32. https://doi.org/10.1145/3643540
MLA 9
Xu, Xuhai, et al. “Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data.” Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, vol. 8, no. 1, 2024, pp. 1–32. https://doi.org/10.1145/3643540.
Chicago
Xu, Xuhai, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Qing Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, and Dakuo Wang. 2024. “Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data.” Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies 8 (1): 1–32. https://doi.org/10.1145/3643540.
Harvard
Xu, X. et al. (2024) ‘Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data’, Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), pp. 1–32. doi:10.1145/3643540.
IEEE
X. Xu et al., “Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data,” Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, vol. 8, no. 1, pp. 1–32, 2024, doi: 10.1145/3643540.
BibTeX
@article{xu2024mental,
title = {{Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data}},
author = {Xu, Xuhai and Yao, Bingsheng and Dong, Yuanzhe and Gabriel, Saadia and Yu, Hong Qing and Hendler, James and Ghassemi, Marzyeh and Dey, Anind K. and Wang, Dakuo},
journal = {Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies},
year = {2024},
volume = {8},
number = {1},
pages = {1--32},
doi = {10.1145/3643540},
url = {https://doi.org/10.1145/3643540}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 9 | |
| 2024 | 152 | |
| 2025 | 245 | |
| 2026 | 248 |
Its field-weighted citation impact is 156.64: it has been cited 156.64 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- large language models
- mental health prediction
- instruction tuning
- zero-shot prompting
- few-shot prompting
- prompt engineering
- GPT-4
- GPT-3.5
Work with this paper
Most-cited papers in Psychology
- Diagnostic and Statistical Manual of Mental DisordersAndrés Santiago González Moreno · American Psychiatric Association Publishing eBooks · 2013 · 123,932 citations
- The theory of planned behaviorIcek Ajzen · Organizational Behavior and Human Decision Processes · 1991 · 106,482 citations
- Self-efficacy: Toward a unifying theory of behavioral change.Albert Bandura · Psychological Review · 1977 · 61,923 citations
- Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.Richard M. Ryan, Edward L. Deci · American Psychologist · 2000 · 55,457 citations
- Mind in Society: The Development of Higher Psychological ProcessesL. S. Vygotsky · 기초학문자료센터(KRM) (Korea Research Foundation) · 1978 · 53,340 citations
Questions about this paper
How do I cite this paper in APA style?
Xu, X., Yao, B., Dong, Y., Gabriel, S., Yu, H. Q., Hendler, J., Ghassemi, M., Dey, A. K., & Wang, D. (2024). Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), 1–32. https://doi.org/10.1145/3643540
How many times has this paper been cited?
655 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at PubMed Central: sign in and open the PDF from this page.
Who wrote this paper?
Xuhai Xu, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Qing Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, Dakuo Wang.
What is the DOI of this paper?
10.1145/3643540, permanently at https://doi.org/10.1145/3643540. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.