Sociologický časopis / Czech Sociological Review 2021, 57(4): 455-484 | DOI: 10.13060/csr.2021.021
Factor Analysis as a Known Unknown – Principal Component Analysis with a Varimax Rotation Is Not Always the Ideal Approach
- Fakulta sociálních věd, Univerzita Karlova, Praha
This article seeks to show that, although factor analysis (mostly in its exploratory version) is a method frequently applied by social-science researchers (it is often also discussed in basic data analysis textbooks), only a very basic version of it is used, with settings that are far from optimal. However, what settings are used can have major implications, primarily in the form of conceptual problems, where the exploratory version is often used instead of the confirmatory version. Other settings used can also have an impact on the results. These are mainly partial options, which are used mainly in the exploratory version, in particular the choice of the correct correlation coefficients, the choice of method for the initial extraction of factors, the choice of the rotation method and the choice of the number of factors with which we want to work in the exploratory version. The text discusses the algorithms for ordinal variables, and the possibility of determining the number of factors through parallel analysis or MAP. The practical example discusses the advantages of the oblique rotation of factors. The article seeks to highlight good practices that best reflect the current state of the art of quantitative methodology and statistics. In addition to the general guidelines, the article contains practical advice about software and recommends a procedural schema for using factor analysis.
Keywords: factor analysis, paralell analysis, polychoric coefficient, oblique rotation
Received: May 12, 2021; Revised: May 25, 2021; Accepted: May 26, 2021; Prepublished online: September 8, 2021; Published: September 27, 2021 Show citation
| ACS | AIP | APA | ASA | Harvard | Chicago | Chicago Notes | IEEE | ISO690 | MLA | NLM | Turabian | Vancouver |
Attachments
| Download file | Stat_Soukup_online-priloha.pdf File size: 68.04 kB |
References
- Auerswald, M., M. Moshagen. 2019. "How to Determine the Number of Factors to Retain in Exploratory Factor Analysis: A Comparison of Extraction Methods Under Realistic Conditions." Psychological Methods 24 (4): 468-491, https://doi.org/10.1037/met0000200.
Go to original source... - Baglin, J. 2014. "Improving Your Exploratory Factor Analysis for Ordinal Data: A Demonstration Using FACTOR." Practical Assessment, Research & Evaluation [online] 19 (5): 1-15. Dostupné na: http://pareonline.net/getvn.asp?v=19&n=5.
- Blahuš, P. 1985. Faktorová analýza a její zobecnění. SNTL.
- Brown, T. 2006. Confirmatory factor analysis for applied research. New York: Guildford.
- Caron, P. O. 2019. "Minimum average partial correlation and parallel analysis: The influence of oblique structures." Communications in Statistics - Simulation and Computation 48 (7): 2110-2117, https://doi.org/10.1080/03610918.2018.1433843.
Go to original source... - Cattell, R. 1966. "The scree test for the number of factors." Multivariate Behavioral Research 1 (2): 245-276, https://doi.org/10.1207/s15327906mbr0102_10.
Go to original source... - Costello, A. B., J. W. Osborne. 2005. "Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis." Practical Assessment, Research & Evaluation [online] 10 (7): 1-9. Dostupné z: http://pareonline.net/getvn.asp?v=10&n=7.
- DeVellis, R. F. 2003. Scale development: theory and applications. Sage.
- Dinno, A. 2009. "Exploring the Sensitivity of Horn's Parallel Analysis to the Distributional Form of Random Data." Multivariate Behavioral Research 44 (3): 362-388, https://doi.org/10.1080/00273170902938969.
Go to original source... - Flora, D. B, P. J. Curran. 2004. "An Empirical Evaluation of Alternative Methods of Estimation for Confirmatory Factor Analysis With Ordinal Data." Psychological Methods 9 (4): 466-491, https://doi.org/10.1037/1082-989X.9.4.466.
Go to original source... - Gavora, P. 2012. Tvorba výzkumného nástroja pre pedagogické bádanie. Bratislava: SPN.
- Gorsuch, R. L. 1983. Factor analysis. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates.
- Green, S. B., R. Levy, M. S. Thompson, M. Lu, W. J. Lo. 2012. "A proposed solution to the problem with using completely random data to assess the number of factors with parallel analysis." Educational and Psychological Measurement 72: 357-374, https://doi.org/10.1177/0013164411422252.
Go to original source... - Green, S. B., N. Redell, M. S. Thompson, R. Levy. 2016. "Accuracy of Revised and Traditional Parallel Analyses for Assessing Dimensionality with Binary Data." Educational and psychological Measurement 76 (1): 5-21, https://doi.org/10.1177/0013164415581898.
Go to original source... - Green, S. B., M. S. Thompson, R. Levy, W. J. Lo. 2015. "Type I and II error rates and overall accuracy of the revised parallel analysis method for determining the number of factors." Educational and Psychological Measurement 75: 428-457, https://doi.org/10.1177/0013164414546566.
Go to original source... - Hayton, J. C., D. G. Allen, V. Scarpello. 2004. "Factor Retention Decisions in Exploratory Factor Analysis: A Tutorial on Parallel Analysis." Organizational Research Methods 7 (2): 191-205, https://doi.org/10.1177/1094428104263675.
Go to original source... - Henson, R. K., J. K. Roberts. 2006. "Use of Exploratory Factor Analysis in Published Research Common Errors and Some Comment on Improved Practice." Educational and Psychological Measurement 66 (3): 393-416, https://doi.org/10.1177%2F0013164405282485.
Go to original source... - Horn, J. L. 1965. "A rationale and test for the number of factors in factor analysis." Psychometrika 30 (2): 179-185, https://doi.org/10.1007/BF02289447.
Go to original source... - Chráska, M. 2006. Úvod do výzkumu v pedagogice. 2. vyd. Olomouc.
- Kaiser, H. F. 1960. "The application of electronic computers to factor analysis." Educational and Psychological Measurement 20 (1): 141-151, https://doi.org/10.1177/001316446002000116.
Go to original source... - Kline, R. B. 2011. Principles and Practice of Structural Equation Modeling. 3rd ed. Taylor & Francis.
- Ledesma, R. D., P. Valero-Mora. 2007. "Determining the Number of Factors to Retain in EFA: An easy-to-use computer program for carrying out Parallel Analysis." Practical Assessment Research & Evaluation [online] 12 (2). Dostupné na: http://pareonline.net/getvn.asp?v=12&n=2.
- Li, Ch. H. 2016a. "The Performance of ML, DWLS, and ULS Estimation With Robust Corrections in Structural Equation Models With Ordinal Variables." Psychological Methods 21 (3): 369-387, https://doi.org/10.1037/met0000093.
Go to original source... - Li, Ch. H. 2016b. "Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares." Behavioral Research 48: 936-949, https://doi.org/10.3758/s13428-015-0619-7.
Go to original source... - Lim, S., S. Jahng. 2019. "Determining the number of factors using parallel analysis and its recent variants." Psychological Methods 24 (4): 452-467, https://doi.org/10.1037/met0000230.
Go to original source... - MacCallum, R. C., K. F. Widaman, S. Zhang, S. Hong. 1999. "Sample size in Factor Analysis." Psychological Methods 4 (1): 84-89, https://doi.org/10.1037/1082-989X.4.1.84.
Go to original source... - Majerčíková, J., P. Gavora 2013. "Vnímaná zdatnosť (self-efficacy) učiteľa spolupracovať s rodičmi: konštrukcia výskumného nástroja." Pedagogika 62 (2): 128-146.
- Mazanec, J., E. Dvořáková. 2017. "Bayesovská exploratorní faktorová analýza." Testforum 9: 1-15, https://doi.org/10.5817/TF2017-9-131.
Go to original source... - Mundfrom, D. J., D. G. Shaw, T. Lu Ke. 2005. "Minimum Sample Size Recommendations for Conducting Factor Analyses." International journal of testing 5 (2): 159-168, https://doi.org/10.1207/s15327574ijt0502_4.
Go to original source... - Netermeyer, R. G., W. O. Bearden, S. Sharma. 2003. Scaling Procedures. Sage, https://doi.org/10.4135/9781412985772.
Go to original source... - O'Connor, B. P. 2000. "SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test." Behavior Research Methods, Instrumentation, and Computers 32: 396-402, https://doi.org/10.3758/BF03200807.
Go to original source... - Osborne, J. W. 2015. "What is Rotating in Exploratory Factor Analysis?" Practical Assessment, Research & Evaluation [online] 20 (2): 1-7. Dostupné na: http://pareonline.net/getvn.asp?v=20&n=2.
- Pallant, J. 2005. SPSS survival manual: a step by step guide to data analysis using SPSS. 2nd ed. Allen & Unwin.
- Pearson, R., D. Mundfrom, A. Piccone. 2013. "A Comparison of Ten Methods for Determining the Number of Factors in Exploratory Factor Analysis." Multiple Linear Regression Viewpoints 39 (1): 1-15.
- Rabušic, L., P. Soukup, P. Mareš. 2019. Statistická analýza sociálněvědních dat (nejen) v SPSS. Masarykova univerzita.
- Rhetmulla, M., P. E. Brosseau-Liard, V. Savalei. 2012. "When Can Categorical Variables Be Treated as Continuous? A Comparison of Robust Continuous and Categorical SEM Estimation Methods Under Suboptimal Conditions." Psychological Methods 17 (3): 354-373, https://doi.org/10.1037/a0029315.
Go to original source... - Ruscio, J., B. Roche. 2012. "Determining the Number of Factors to Retain in an Exploratory Factor. Analysis Using Comparison Data of Known Factorial Structure." Psychological Assessment 24 (2): 282-292, https://doi.org/10.1037/a0025697.
Go to original source... - Soukup, P. 2019. "P a d (Používání statistické a věcné významnosti v českých sociálních vědách)." Sociologický časopis / Czech Sociological Review 55 (2): 215-254, https://doi.org/10.13060/00380288.2019.55.2.459.
Go to original source... - Soukup, P., I. Kočvarová. 2016. "Velikost a reprezentativita výběrového souboru v kvantitativně orientovaném pedagogickém výzkumu." Pedagogická orientace 26 (3): 512-536, https://doi.org/10.5817/PedOr2016-3-512.
Go to original source... - Straková, J., J. Simonová, P. Soukup. 2020. "Validizace konceptu akademické marnosti v českém středním vzdělávání." Sociologický časopis / Czech Sociological Review 56 (5): 599-617, https://doi.org/10.13060/csr.2020.042.
Go to original source... - Urbánek, T. 2000. Strukturální modelování v psychologii. Pavel Křepela.
- Velicer, W. F. 1976. "Determining the number of components from the matrix of partial correlations." Psychometrika 41 (3): 321-327, https://doi.org/10.1007/BF02293557.
Go to original source... - Vlčková, K., P. Květon, S. Ježek, J. Mareš, K. Lojdová. 2019. "Adaptace Škály managementu chování a výuky na české podmínky." Studia paedagogica 24 (1): 135-155, https://doi.org/10.5817/SP2019-1-6.
Go to original source... - Winter, J. C. F. de, D. Dodou, P. A. Wieringa. 2009. "Exploratory Factor Analysis With Small Sample Sizes." Multivariate Behavioral Research 44 (2): 147-181, https://doi.org/10.1080/00273170902794206.
Go to original source... - Zwick, W. R, W. F. Velicer. 1986. "Comparison of five rules for determining the number of components to retain." Psychological Bulletin 99 (3): 432-442, https://doi.org/10.1037/0033-2909.99.3.432.
Go to original source... - Články citované v tabulkách 1 a 2Bernard, J. 2011. "Endogenní rozvojové potenciály malých venkovských obcí - obtížné hledání a měření jejich vlivu." Sociologický časopis / Czech Sociological Review 47 (4): 745-775, https://doi.org/10.13060/00380288.2011.47.4.06.
Go to original source... - Boberová, Z., I. Ropovik, P. Kolarčik, A. Madarasová Gecková, L. Paakkari. 2019. "Štruktúra zdravotnej gramotnosti u adolescentov." Československá psychologie 63 (1): 1-12.
- Gocet Tekin, E. 2017. "Shyness and subjective well-being: The mediation role of loneliness." Československá psychologie 61 (4): 321-330.
- Hamplová, D. 2008. "Čemu Češi věří: dimenze soudobé české religiozity." Sociologický časopis / Czech Sociological Review 44 (4): 703-723, https://doi.org/10.13060/00380288.2008.44.4.05.
Go to original source... - Köverová, M. 2018. "Konfirmačná faktorová analýza slovenkej verzie škály profesijnej kvality života (ProQOL)." Československá psychologie 62 (6): 565-578.
- Luthar, B., S. Korpivnik. 2011. "Class, Cultural Capital, and the Mobile Phone." Sociologický časopis / Czech Sociological Review 47 (6): 1091-1118, https://doi.org/10.13060/00380288.2011.47.6.01.
Go to original source... - Miklošová I., M. Makulajová, M. Jakubek. 2016. "Štruktúra jazykovo-kognitivnych schopností u detí s narušeným vývinom reči predškolského veku." Československá psychologie 60 (3): 252-265.
- Tišanská L., J. Kožený. 2018. "Pohotovost k agresivnímu chování u adolescentů umístěných v nápravných zařízeních." Československá psychologie 62 (6): 542-551.
- Vidovičová, L., M. Petrová Kafková. 2012. "Aktivity seniorů ve velkých městech: zdraví, prostor a subjektivní kvalita života." Sociologický časopis / Czech Sociological Review 48 (5): 939-963, https://doi.org/10.13060/00380288.2012.48.5.06.
Go to original source... - Vráblíková, K. 2009. "Politická participace a její determinanty v postkomunistických zemích." Sociologický časopis / Czech Sociological Review 45 (5): 867-897, https://doi.org/10.13060/00380288.2009.45.5.01.
Go to original source... - Vráblíková, K. 2009. "Politická participace a její determinanty v postkomunistických zemích." Sociologický časopis / Czech Sociological Review 45 (5): 867-897, https://doi.org/10.13060/00380288.2009.45.5.01.
Go to original source...
This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0), which permits non-comercial use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


