Journal article · 2016 · Open access

The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study

Hsien-Yuan Mark Hsu, Jr-Hung Lin, Oi‐Man Kwok, Sandra T. Acosta, Victor L. Willson

Educational and Psychological Measurement, 77(1), 5–31 · Published 18 April 2016 · DOI 10.1177/0013164416642823

Open full textView at the publisherCite this paper

In brief

“The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study” is a 2016 journal article by Hsien-Yuan Mark Hsu and 4 co-authors, published in Educational and Psychological Measurement. OpenAlex counts 46 citations as of 18 November 2026, which puts it in the top 7% of works published in 2016 by citations. It is open access: the full text is free to read at Europe PMC (PubMed Central).

Citations
46
Most cited in
2024 (9)
Field-weighted impact
2.52
References
40
Authors
5

Abstract

Several researchers have recommended that level-specific fit indices should be applied to detect the lack of model fit at any level in multilevel structural equation models. Although we concur with their view, we note that these studies did not sufficiently consider the impact of intraclass correlation (ICC) on the performance of level-specific fit indices. Our study proposed to fill this gap in the methodological literature. A Monte Carlo study was conducted to investigate the performance of (a) level-specific fit indices derived by a partially saturated model method (e.g., [Formula: see text] and [Formula: see text]) and (b) [Formula: see text] and [Formula: see text] in terms of their performance in multilevel structural equation models across varying ICCs. The design factors included intraclass correlation (ICC: ICC1 = 0.091 to ICC6 = 0.500), numbers of groups in between-level models (NG: 50, 100, 200, and 1,000), group size (GS: 30, 50, and 100), and type of misspecification (no misspecification, between-level misspecification, and within-level misspecification). Our simulation findings raise a concern regarding the performance of between-level-specific partial saturated fit indices in low ICC conditions: the performances of both [Formula: see text] and [Formula: see text] were more influenced by ICC compared with [Formula: see text] and SRMR B . However, when traditional cutoff values ( RMSEA≤ 0.06; CFI, TLI≥ 0.95; SRMR≤ 0.08) were applied, [Formula: see text] and [Formula: see text] were still able to detect misspecified between-level models even when ICC was as low as 0.091 (ICC1). On the other hand, both [Formula: see text] and [Formula: see text] were not recommended under low ICC conditions.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hsu, H.-Y. M., Lin, J.-H., Kwok, O., Acosta, S. T., & Willson, V. L. (2016). The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study. Educational and Psychological Measurement, 77(1), 5–31. https://doi.org/10.1177/0013164416642823

MLA 9

Hsu, Hsien-Yuan Mark, et al. “The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study.” Educational and Psychological Measurement, vol. 77, no. 1, 2016, pp. 5–31. https://doi.org/10.1177/0013164416642823.

Chicago

Hsu, Hsien-Yuan Mark, Jr-Hung Lin, Oi‐Man Kwok, Sandra T. Acosta, and Victor L. Willson. 2016. “The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study.” Educational and Psychological Measurement 77 (1): 5–31. https://doi.org/10.1177/0013164416642823.

Harvard

Hsu, H.-Y. M. et al. (2016) ‘The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study’, Educational and Psychological Measurement, 77(1), pp. 5–31. doi:10.1177/0013164416642823.

IEEE

H.-Y. M. Hsu, J.-H. Lin, O. Kwok, S. T. Acosta, and V. L. Willson, “The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study,” Educational and Psychological Measurement, vol. 77, no. 1, pp. 5–31, 2016, doi: 10.1177/0013164416642823.

BibTeX

@article{hsu2016impact,
  title     = {{The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study}},
  author    = {Hsu, Hsien-Yuan Mark and Lin, Jr-Hung and Kwok, Oi‐Man and Acosta, Sandra T. and Willson, Victor L.},
  journal   = {Educational and Psychological Measurement},
  year      = {2016},
  volume    = {77},
  number    = {1},
  pages     = {5--31},
  doi       = {10.1177/0013164416642823},
  url       = {https://doi.org/10.1177/0013164416642823}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201744
201844
201933
202044
202177
202288
202322
202499
202522
202633

Its field-weighted citation impact is 2.52: it has been cited 2.52 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing

  • intraclass correlation coefficient
  • multilevel structural equation modeling
  • model fit assessment
  • RMSEA
  • SRMR
  • CFI
  • thallium iodide
  • cut-off values

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Hsu, H.-Y. M., Lin, J.-H., Kwok, O., Acosta, S. T., & Willson, V. L. (2016). The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study. Educational and Psychological Measurement, 77(1), 5–31. https://doi.org/10.1177/0013164416642823

How many times has this paper been cited?

46 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Europe PMC (PubMed Central): sign in and open the full text from this page.

Who wrote this paper?

Hsien-Yuan Mark Hsu, Jr-Hung Lin, Oi‐Man Kwok, Sandra T. Acosta, Victor L. Willson.

What is the DOI of this paper?

10.1177/0013164416642823, permanently at https://doi.org/10.1177/0013164416642823. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.