Journal article · 2016 · Open access
The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study
Educational and Psychological Measurement, 77(1), 5–31 · Published 18 April 2016 · DOI 10.1177/0013164416642823
In brief
“The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study” is a 2016 journal article by Hsien-Yuan Mark Hsu and 4 co-authors, published in Educational and Psychological Measurement. OpenAlex counts 46 citations as of 18 November 2026, which puts it in the top 7% of works published in 2016 by citations. It is open access: the full text is free to read at Europe PMC (PubMed Central).
- Citations
- 46
- Most cited in
- 2024 (9)
- Field-weighted impact
- 2.52
- References
- 40
- Authors
- 5
Abstract
Several researchers have recommended that level-specific fit indices should be applied to detect the lack of model fit at any level in multilevel structural equation models. Although we concur with their view, we note that these studies did not sufficiently consider the impact of intraclass correlation (ICC) on the performance of level-specific fit indices. Our study proposed to fill this gap in the methodological literature. A Monte Carlo study was conducted to investigate the performance of (a) level-specific fit indices derived by a partially saturated model method (e.g., [Formula: see text] and [Formula: see text]) and (b) [Formula: see text] and [Formula: see text] in terms of their performance in multilevel structural equation models across varying ICCs. The design factors included intraclass correlation (ICC: ICC1 = 0.091 to ICC6 = 0.500), numbers of groups in between-level models (NG: 50, 100, 200, and 1,000), group size (GS: 30, 50, and 100), and type of misspecification (no misspecification, between-level misspecification, and within-level misspecification). Our simulation findings raise a concern regarding the performance of between-level-specific partial saturated fit indices in low ICC conditions: the performances of both [Formula: see text] and [Formula: see text] were more influenced by ICC compared with [Formula: see text] and SRMR B . However, when traditional cutoff values ( RMSEA≤ 0.06; CFI, TLI≥ 0.95; SRMR≤ 0.08) were applied, [Formula: see text] and [Formula: see text] were still able to detect misspecified between-level models even when ICC was as low as 0.091 (ICC1). On the other hand, both [Formula: see text] and [Formula: see text] were not recommended under low ICC conditions.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Hsu, H.-Y. M., Lin, J.-H., Kwok, O., Acosta, S. T., & Willson, V. L. (2016). The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study. Educational and Psychological Measurement, 77(1), 5–31. https://doi.org/10.1177/0013164416642823
MLA 9
Hsu, Hsien-Yuan Mark, et al. “The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study.” Educational and Psychological Measurement, vol. 77, no. 1, 2016, pp. 5–31. https://doi.org/10.1177/0013164416642823.
Chicago
Hsu, Hsien-Yuan Mark, Jr-Hung Lin, Oi‐Man Kwok, Sandra T. Acosta, and Victor L. Willson. 2016. “The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study.” Educational and Psychological Measurement 77 (1): 5–31. https://doi.org/10.1177/0013164416642823.
Harvard
Hsu, H.-Y. M. et al. (2016) ‘The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study’, Educational and Psychological Measurement, 77(1), pp. 5–31. doi:10.1177/0013164416642823.
IEEE
H.-Y. M. Hsu, J.-H. Lin, O. Kwok, S. T. Acosta, and V. L. Willson, “The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study,” Educational and Psychological Measurement, vol. 77, no. 1, pp. 5–31, 2016, doi: 10.1177/0013164416642823.
BibTeX
@article{hsu2016impact,
title = {{The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study}},
author = {Hsu, Hsien-Yuan Mark and Lin, Jr-Hung and Kwok, Oi‐Man and Acosta, Sandra T. and Willson, Victor L.},
journal = {Educational and Psychological Measurement},
year = {2016},
volume = {77},
number = {1},
pages = {5--31},
doi = {10.1177/0013164416642823},
url = {https://doi.org/10.1177/0013164416642823}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 4 | |
| 2018 | 4 | |
| 2019 | 3 | |
| 2020 | 4 | |
| 2021 | 7 | |
| 2022 | 8 | |
| 2023 | 2 | |
| 2024 | 9 | |
| 2025 | 2 | |
| 2026 | 3 |
Its field-weighted citation impact is 2.52: it has been cited 2.52 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- intraclass correlation coefficient
- multilevel structural equation modeling
- model fit assessment
- RMSEA
- SRMR
- CFI
- thallium iodide
- cut-off values
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Hsu, H.-Y. M., Lin, J.-H., Kwok, O., Acosta, S. T., & Willson, V. L. (2016). The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study. Educational and Psychological Measurement, 77(1), 5–31. https://doi.org/10.1177/0013164416642823
How many times has this paper been cited?
46 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Europe PMC (PubMed Central): sign in and open the full text from this page.
Who wrote this paper?
Hsien-Yuan Mark Hsu, Jr-Hung Lin, Oi‐Man Kwok, Sandra T. Acosta, Victor L. Willson.
What is the DOI of this paper?
10.1177/0013164416642823, permanently at https://doi.org/10.1177/0013164416642823. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.