Journal article · 2024 · Open access

Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data

Xuhai Xu, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Qing Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, Dakuo Wang

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), 1–32 · Published 6 March 2024 · DOI 10.1145/3643540

Open PDFView at the publisherCite this paper

In brief

“Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data” is a 2024 journal article by Xuhai Xu and 8 co-authors, published in Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies. OpenAlex counts 655 citations as of 19 November 2026. It is open access: the full text is free to read at PubMed Central.

Citations
655
Most cited in
2026 (248)
Field-weighted impact
156.64
References
131
Authors
9

Abstract

Advances in large language models (LLMs) have empowered a variety of applications. However, there is still a significant gap in research when it comes to understanding and enhancing the capabilities of LLMs in the field of mental health. In this work, we present a comprehensive evaluation of multiple LLMs on various mental health prediction tasks via online text data, including Alpaca, Alpaca-LoRA, FLAN-T5, GPT-3.5, and GPT-4. We conduct a broad range of experiments, covering zero-shot prompting, few-shot prompting, and instruction fine-tuning. The results indicate a promising yet limited performance of LLMs with zero-shot and few-shot prompt designs for mental health tasks. More importantly, our experiments show that instruction finetuning can significantly boost the performance of LLMs for all tasks simultaneously. Our best-finetuned models, Mental-Alpaca and Mental-FLAN-T5, outperform the best prompt design of GPT-3.5 (25 and 15 times bigger) by 10.9% on balanced accuracy and the best of GPT-4 (250 and 150 times bigger) by 4.8%. They further perform on par with the state-of-the-art task-specific language model. We also conduct an exploratory case study on LLMs' capability on mental health reasoning tasks, illustrating the promising capability of certain models such as GPT-4. We summarize our findings into a set of action guidelines for potential methods to enhance LLMs' capability for mental health tasks. Meanwhile, we also emphasize the important limitations before achieving deployability in real-world mental health settings, such as known racial and gender bias. We highlight the important ethical risks accompanying this line of research.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Xu, X., Yao, B., Dong, Y., Gabriel, S., Yu, H. Q., Hendler, J., Ghassemi, M., Dey, A. K., & Wang, D. (2024). Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), 1–32. https://doi.org/10.1145/3643540

MLA 9

Xu, Xuhai, et al. “Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data.” Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, vol. 8, no. 1, 2024, pp. 1–32. https://doi.org/10.1145/3643540.

Chicago

Xu, Xuhai, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Qing Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, and Dakuo Wang. 2024. “Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data.” Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies 8 (1): 1–32. https://doi.org/10.1145/3643540.

Harvard

Xu, X. et al. (2024) ‘Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data’, Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), pp. 1–32. doi:10.1145/3643540.

IEEE

X. Xu et al., “Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data,” Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, vol. 8, no. 1, pp. 1–32, 2024, doi: 10.1145/3643540.

BibTeX

@article{xu2024mental,
  title     = {{Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data}},
  author    = {Xu, Xuhai and Yao, Bingsheng and Dong, Yuanzhe and Gabriel, Saadia and Yu, Hong Qing and Hendler, James and Ghassemi, Marzyeh and Dey, Anind K. and Wang, Dakuo},
  journal   = {Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies},
  year      = {2024},
  volume    = {8},
  number    = {1},
  pages     = {1--32},
  doi       = {10.1145/3643540},
  url       = {https://doi.org/10.1145/3643540}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
202399
2024152152
2025245245
2026248248

Its field-weighted citation impact is 156.64: it has been cited 156.64 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Psychology › Social Psychology › Mental Health via Writing

  • large language models
  • mental health prediction
  • instruction tuning
  • zero-shot prompting
  • few-shot prompting
  • prompt engineering
  • GPT-4
  • GPT-3.5

Work with this paper

Most-cited papers in Psychology

All highly cited Psychology papers

Questions about this paper

How do I cite this paper in APA style?

Xu, X., Yao, B., Dong, Y., Gabriel, S., Yu, H. Q., Hendler, J., Ghassemi, M., Dey, A. K., & Wang, D. (2024). Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, 8(1), 1–32. https://doi.org/10.1145/3643540

How many times has this paper been cited?

655 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at PubMed Central: sign in and open the PDF from this page.

Who wrote this paper?

Xuhai Xu, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Qing Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, Dakuo Wang.

What is the DOI of this paper?

10.1145/3643540, permanently at https://doi.org/10.1145/3643540. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.