Abstract
The number of correctly produced words is the primary output variable n most verbal fluency tests. The examination of the number of clusters and cluster size achieves a more in-depth analyses of cognitive aspects and processes. We propose a scoring system for phonemic, semantic, and emotion word fluency tests in the Indonesian context. This study aimed to determine the underlying cognitive constructs of the participants, including the clustering and switching indices, using principal component analysis (PCA). A total of 150 participants were included, and the tests were administered online following a previously validated protocol. The three fluency tests loaded different factors, and the loading clustering patterns varied among the tests. Regression analyses confirmed that both cluster size and the number of switches predicted the number of correct words, although this relationship differed between semantic and phonemic tests. The number of switches and cluster size interrater reliability for all three tests exceeded 0.90. The cluster size and the number of switches were suitable additional variables for scoring Indonesian phonemic, emotion, and animal names as semantic word fluency tasks. This approach allows for a more in-depth analysis of cognitive styles in clients undergoing neuropsychological assessment.
Bahasa Abstract
Sebagian besar tes kelancaran verbal menggunakan ‘jumlah kata yang benar’ sebagai variabel keluaran utama. Pengujian jumlah kluster dan ukuran kluster menghasilkan analisis yang lebih mendalam tentang aspek dan proses kognitif. Peneliti mengusulkan sistem penilaian untuk tes kelancaran kata fonemik, semantik, dan emosi dalam konteks bahasa Indonesia. Studi ini bertujuan untuk menentukan konstruksi kognitif yang mendasari partisipan, termasuk indeks pengelompokan dan peralihan, menggunakan analisis komponen utama. Sebanyak 150 partisipan dilibatkan, dan tes diberikan secara daring mengikuti protokol yang telah divalidasi sebelumnya. Ketiga tes kelancaran tersebut memuat faktor yang berbeda, dan pola pengelompokan pemuatan bervariasi di antara tes-tes tersebut. Analisis regresi mengonfirmasi bahwa baik ukuran kluster maupun jumlah peralihan memprediksi jumlah kata yang benar, meskipun hubungan ini berbeda antara tes semantik dan fonemik. Reliabilitas antar penilai untuk jumlah peralihan dan ukuran kluster pada ketiga tes tersebut melebihi 0,90. Ukuran kluster dan jumlah peralihan merupakan variabel tambahan yang sesuai untuk penilaian nama fonemik, emosi, dan hewan dalam bahasa Indonesia sebagai tugas kelancaran kata semantik. Pendekatan ini memungkinkan analisis yang lebih mendalam tentang gaya kognitif pada klien yang mendapatkan asesmen neuropsikologis.
References
Abeare, C. A., Freund, S., Kaploun, K., McAuley, T., & Dumitrescu, C. (2017). The Emotion Word Fluency Test (EWFT): Initial psychometric, validation, and physiological evidence in young adults. Journal of Clinical and Experimental Neuropsychology, 39(8), 738–752. https://doi.org/10.1080/13803395.2016.1259396
Almairac, F., Herbet, G., Moritz-Gasser, S., de Champfleur, N. M., & Duffau, H. (2014). The left inferior fronto-occipital fasciculus subserves language semantics: a multilevel lesion study. Brain Structure and Function, 220(4), 1983–1995. https://doi.org/10.1007/s00429-014-0773-1
Ardila, A., Ostrosky‐Solís, F. & Bernal, B., 2006. Cognitive testing toward the future: The example of Semantic Verbal Fluency (ANIMALS). International Journal of Psychology, 41(5), pp.324-332. https://doi.org/10.1080/00207590500345542
Ardila, A. (2020). A cross-linguistic comparison of category verbal fluency test (ANIMALS): a systematic review. Archives of Clinical Neuropsychology, 35(2), 213-225. http://doi.org/10.1093/arclin/acz060
Baldo, J. V., Schwartz, Wilkins, & Dronkers, N. F. (2006). Role of frontal versus temporal cortex in verbal fluency as revealed by voxel-based lesion symptom mapping. Journal of the International Neuropsychological Society, 12(06), 896 - 900. https://doi.org/10.1017/S1355617706061078
Barattieri di San Pietro, C., Luzzatti, C., Ferrari, E., de Girolamo, G., & Marelli, M. (2023). Automated clustering and switching algorithms applied to semantic verbal fluency data in schizophrenia spectrum disorders. Language, Cognition and Neuroscience, 38(7), 950–965. https://doi.org/10.1080/23273798.2023.2178662
Batty, R., Francis, A., Thomas, N., Hopwood, M., Ponsford, J., Johnston, L., & Rossell, S. (2015). Verbal fluency, clustering, and switching in patients with psychosis following traumatic brain injury (PFTBI). Psychiatry Research, 227(2–3), 152–159. https://doi.org/10.1016/j.psychres.2015.03.040
Beber, B.C., Liedtke, F.V., de Oliveira, F.S., Müller-Silveira, L., Alves, E.V., Chaves, M.L.F., de Salles, J.F. (2023). Clustering and switching analysis of verb fluency in individuals with Alzheimer’s disease. CoDAS, 35(2), 1 – 8.https://doi.org10.1590/2317-1782/20232021179en
Becker, N., & de Salles, J. F. (2016). Methodological Criteria for Scoring Clustering and Switching in Verbal Fluency Tasks. Psico-USF, 21(3), 445–457. https://doi.org/10.1590/1413-82712016210301
Begeer, S., Wierda, M., Scheeren, A. M., Teunisse, J.-P., Koot, H. M., & Geurts, H. M. (2014). Verbal fluency in children with autism spectrum disorders: Clustering and switching strategies. Autism, 18(8), 1014–1018. https://doi.org/10.1177/1362361313500381
Benito-Cuadrado, M. M., Esteba-Castillo, S., Böhm, P., Cejudo-Bolívar, J., & Peña-Casanova, J. (2002). Semantic Verbal Fluency of Animals: A Normative and Predictive Study in a Spanish Population. Journal of Clinical and Experimental Neuropsychology, 24(8), 1117–1122. https://doi.org/10.1076/jcen.24.8.1117.8376
Biesbroek, J.M., van Zandvoort, M.J.E., Kappelle, L.J. et al. (2016). Shared and distinct anatomical correlates of semantic and phonemic fluency revealed by lesion-symptom mapping in patients with ischemic stroke. Brain Structure and Function, 221, 2123–2134. https://doi.org/10.1007/s00429-015-1033-8
Birn, R.M., Kenworthy, L., Case, L., Caravella, R., Jones, T.B., Bandettini, P.A., & Martin, A. (2010). Neural systems supporting lexical search guided by letter and semantic category cues: a self-paced overt response fMRI study of verbal fluency. Neuroimage, 49(1):1099-1107. https://doi.org/10.1016/j.neuroimage.2009.07.036
Bose, A., Wood, R., & Kiran, S. (2016). Semantic fluency in aphasia: clustering and switching in the course of 1 minute. International Journal of Language & Communication Disorders, 52(3), 334–345. https://doi.org/10.1111/1460-6984.12276
Carpenter, E., Peñaloza, C., Rao, L., & Kiran, S. (2021). Clustering and switching in verbal fluency across varying degrees of cognitive control demands: Evidence from healthy bilinguals and bilingual patients with aphasia. Neurobiology of Language, 2(4), 532–557. https://doi.org/10.1162/nol_a_00053
Caramazza, A., & Shelton, J. R. (1998). Domain-specific knowledge systems in the brain: The animate-inanimate distinction. Journal of Cognitive Neuroscience, 10(1), 1-34. https://doi.org/10.1162/089892998563752
Camodeca, A., Walcott, K., Hosack, A., & Todd, K. Q. (2021). Preliminary evidence for the Emotion Word Fluency Test as a unique semantic fluency measure. Psychological Assessment, 33(2), 195–200. https://doi.org/10.1037/pas0000965
Domain, L., Guillery, M., Linz, N., König, A., Batail, J.M., David, R., Corouge, I., Bannier, E., Ferré, J.C., Dondaine, T., Drapier, D., Robert, G.H. (2022). Multimodal MRI cerebral correlates of verbal fluency switching and its impairment in women with depression,
NeuroImage: Clinical, 33, 102910, 1 -11. https://doi.org/10.1016/j.nicl.2021.102910
Filippetti, V.A., Krumm, G. & López, M.B. (2023). Clustering and Switching During Verbal Fluency in Typical and Atypical Development: A Systematic Review in Children and Adolescents. Current Psychology, 42, 27516–27533. https://doi.org/10.1007/s12144-022-03787-4
Grogan, A., Green, D.W., Ali, N., Crinion, J.T., Price, C.J. (2009). Structural correlates of semantic and phonemic fluency ability in first and second languages. Cerebral Cortex, 19(11), 2690-8. https://doi.org/10.1093/cercor/bhp023
Hendrawan, D., & Hatta, T. (2010). Evaluation of stimuli for development of the Indonesian version of verbal fluency task using ranking method. Psychologia, 53(1), 14–26. https://doi.org/10.2117/psysoc.2010.14
Heim, S., Eickhoff, S. B., & Amunts, K. (2008). Specialisation in Broca’s region for semantic, phonological, and syntactic fluency? NeuroImage, 40(3), 1362–1368. https://doi.org/10.1016/j.neuroimage.2008.01.009
Jaimes-Bautista, A.G., Rodríguez-Camacho, M., Martínez-Juárez, I.E., Rodríguez-Agudelo, Y. (2020). Quantitative and qualitative analysis of semantic verbal fluency in patients with temporal lobe epilepsy. Neurología, 35 (1), 1—9.https://doi.org/10.1016/j.nrleng.2019.03.006
Katzev, M., Tüscher, O., Hennig J., Weiller C., Kaller, C.P. (2013). Revisiting the Functional Specialization of Left Inferior Frontal Gyrus in Phonological and Semantic Fluency: The Crucial Role of Task Demands and Individual Ability. Journal of Neuroscience, 33 (18), 7837-7845. https://doi.org/10.1523/JNEUROSCI.3147-12.2013
Kim, I., Millin, N. J., & Hwang, J. (2018). Word Retrieval by Verbal Fluency Tasks for Young and Old People: An fNIR Study. Clinical Archives of Communication Disorders, 3(1), 52–58. https://doi.org/10.21849/cacd.2018.00318
Kissler, J. (2013). Love letters and hate mail: Cerebral processing of emotional language content. In J. Armony & P. Vuilleumier (Eds.), The Cambridge handbook of human affective neuroscience (pp. 304–328)). Cambridge University Press. https://assets.cambridge.org/97811070/01114/frontmatter/9781107001114_frontmatter.pdf
Koo, T.K., & Li, M.Y. (2016). A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medicine, 15(2), 155 – 163. https://doi.org/10.1016/j.jcm.2016.02.012
Lehtinen, N., Luotonen, I., & Kautto, A. (2023). Systematic administration and analysis of verbal fluency tasks: Preliminary evidence for reliable exploration of processes underlying task performance. Applied Neuropsychology: Adult, 30(6), 727-739. https://doi.org/10.1080/23279095.2021.1973471
Lezak, M.D., Howieson, D.B., Bigler, E.D., & Tranel, D. (2012). Neuropsychological assessment (5th edition). Oxford University Press, Inc. https://www.pdfdrive.com/neuropsychological-assessment-d196377154.htm
MacCallum, R. C., Widaman, K. F., Preacher, K. J., & Hong, S. (2001). Sample Size in Factor Analysis: The Role of Model Error. Multivariate Behavioral Research, 36(4), 611–637. https://doi.org/10.1207/S15327906MBR3604_06
Okruszek, Ł., Rutkowska, A., & Wilińska, J. (2013). Clustering and switching strategies during the semantic fluency task in men with frontal lobe lesions and in men with Schizophrenia. Psychology of Language and Communication, 17(1), 93–100. https://doi.org/10.2478/plc-2013-000
Osborne, J.W. & Costello, A. B. (2004) "Sample size and subject to item ratio in principal components analysis," Practical Assessment, Research, and Evaluation, 9(11), 1 - 9. https://doi.org/10.7275/ktzq-jq66
Pagliarin, K.C.., Fernandes, E.G., Muller,M.D., Portalete, C.R., Fonseca, R.P., & Altmann, R.F. (2021). Clustering and switching in verbal fluency: a comparison between control and individuals with brain damage. CoDAS, 34(2), 1-7. https://doi.org/10.1590/2317-1782/20212020365
Pereira, A.H., Gonçalves, A.B., Holz, M., Gonçalves, H.A., Kochhann, R., Joanette, Y., Zimmermann, N., Fonseca, R.P. (2018). Influence of age and education on the processing of clustering and switching in verbal fluency tasks. Dement Neuropsychol, 12(4), 360-367. https://doi.org/10.1590/1980-57642018dn12-040004
Pesau, H. G., & van Luijtelaar, G. (2021). Equivalence of Traditional and Internet-Delivered Testing of Word Fluency Tasks. Jurnal Psikologi, 20(1), 35–49. https://doi.org/10.14710/jp.20.1.35-49
Pesau, H. G., Sulastri, A., & van Luijtelaar, G. (2024). Evaluation of Indonesian version of the emotion word fluency test. Jurnal Psikologi, 22(2), 157-176. https://doi.org/10.14710/jp.22.2.157-176
Price, S. E., Kinsella, G. J., Ong, B., Storey, E., Mullaly, E., Phillips, M., Pangnadasa-Fox, L., & Perre, D. (2012). Semantic verbal fluency strategies in amnestic mild cognitive impairment. Neuropsychology, 26(4), 490–497. https://doi.org/10.1037/a0028567
Raboutet, C, Sauzéon, H., Corsini, M.M., Rodrigues, J., Langevin, S., & N'Kaoua, B. (2010). Performance on a semantic verbal fluency task across time: Dissociation between clustering, switching, and categorical exploitation processes, Journal of Clinical and Experimental Neuropsychology, 32(3), 268-280. https://doi.org/10.1080/13803390902984464
Robert, P. H., Lafont, V., Medecin, I., Berthet, L., Thauby, S., Baudu, C., & Darcourt, G. (1998). Clustering and switching strategies in verbal fluency tasks: comparison between schizophrenics and healthy adults. Journal of the International Neuropsychological Society JINS, 4(6), 539–546. https://doi.org/10.1017/s1355617798466025
Rodríguez-Lorenzana, A., Benito-Sánchez, I., Adana-Díaz, L., Paz, C. P., Yacelga Ponce, T., Rivera, D., & Carlos, J. (2020). Normative Data for Test of Verbal Fluency and Naming on Ecuadorian Adult Population. Frontiers in Psychology, 11, 533527. https://doi.org/10.3389/fpsyg.2020.00830
Rosselli, M., Ardila, A., Salvatierra, J., Marquez, M., Luis, M., & Weekes, V. A. (2002). A cross-linguistic comparison of verbal fluency tests. International Journal of Neuroscience, 112(6), 759-776. https://doi.org/10.1080/00207450290025752
Sass, K., Fetz, K., Oetken, S., Habel, U., & Heim, S. (2013). Emotional verbal fluency: A new task on emotion and executive function interaction. Behavioral Sciences, 3(3), 372–387. https://doi.org/10.3390/bs3030372
Schober, P., & Boer, C. (2018). Correlation Coefficients: Appropriate Use and Interpretation. Anesthesia & Analgesia, 126 (5), 1763 - 1768. https://doi.org/10.1213/ANE.0000000000002864
Shao, Z., Janse, E., Visser, K., Meyer, A.S. (2014). What do verbal fluency tasks measure? Predictors of verbal fluency performance in older adults. Front. Psychol, 5(772) 1 - 10. https://doi.org/10.3389/fpsyg.2014.00772
Shaver, P. R., Murdaya, U., & Fraley, R. C. (2001). Structure of the Indonesian emotion lexicon. Asian Journal of Social Psychology, 4(3), 201–224. https://doi.org/10.1111/1467-839X.00086
Szatkowska I, Grabowska A, Szymańska O. (2000). Phonological and semantic fluencies are mediated by different regions of the prefrontal cortex. Acta Neurobiologiae Experimentalis, 60(4):503-8. https://doi.org/10.55782/ane-2000-1370
Suchy, Y. (2011). Clinical neuropsychology of emotion. The Guilford Press.
Troyer, A.K. (2000): Normative Data for Clustering and Switching on Verbal Fluency Tasks. Journal of Clinical and Experimental Neuropsychology, 22(3), 370-378. https://doi.org/10.1076/1380-3395(200006)22:3;1-V;FT370
Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics (6th ed.). Boston, MA: Pearson
https://ndl.ethernet.edu.et/bitstream/123456789/27657/1/Barbara%20G.%20Tabachnick_2013.pdf
Troyer, A.K., Moscovitch, M., & Winocur, G. (1997). Clustering and Switching as Two Components of Verbal Fluency: Evidence from Younger and Older Healthy Adults. Neuropsychology, 11 (1), 138 – 146. https://doi.apa.org/doi/10.1037/0894-4105.11.1.138
van den Berg, E., Jiskoot, L. C., Grosveld, M. J. H., van Swieten, J. C., & Papma, J. M. (2017). Qualitative Assessment of Verbal Fluency Performance in Frontotemporal Dementia. Dementia and geriatric cognitive disorders, 44(1-2), 35–44. https://doi.org/10.1159/000477538
Vaughan, R.M., Coen, R.F., Kenny, R., Lawlor, B.A. (2018). Semantic and Phonemic Verbal Fluency Discrepancy in Mild Cognitive Impairment: Potential Predictor of Progression to Alzheimer's Disease. J Am Geriatr Soc, 66: 755-759. https://doi.org/10.1111/jgs.15294
Wagner, S., Sebastian, A., Lieb, K. et al. (2014). A coordinate-based ALE functional MRI meta-analysis of brain activation during verbal fluency tasks in healthy control subjects. BMC Neurosci 15, 19. https://doi.org/10.1186/1471-2202-15-19
Wahyuningrum, S. E., Sulastri, A., Hendriks, M. P. H., & van Luijtelaar, G. (2022). The Indonesian neuropsychological test battery (INTB): psychometric properties, preliminary normative scores, the underlying cognitive constructs, and the effects of age and education. Acta Neuropsychologica, 20(4), 445-470. https://doi.org/10.5604/0 1.3001.0016.1339
Weaklay, A., & Schmitter-Edgecombe, M. (2014). Analysis of Verbal Fluency Ability in Alzheimer’s Disease: The Role of Clustering, Switching and Semantic Proximities. Archives of Clinical Neuropsychology, 29, 256–268. https://doi.org/10.1093/arclin/acu010
Weiss, E., Ragland, J., Brensinger, C., Bilker, W., Deisenhammer, E., & Delazer, M. (2006). Sex differences in clustering and switching in verbal fluency tasks. Journal of the International Neuropsychological Society, 12(4), 502-509. http://doi.org/10.1017/S1355617706060656
Zarino, B., Crespi, M., Launi, M. et al. (2014). A new standardization of semantic verbal fluency test. Neurol Sci 35, 1405–1411. https://doi.org/10.1007/s10072-014-1729-1
Recommended Citation
Pesau, H. G., & van Luijtelaar, G. (2026). Clustering and Switching as a Scoring System in Indonesian Three Word Fluency Tests. Makara Human Behavior Studies in Asia, 30(2), 122-134. https://doi.org/10.7454/hubs.asia.v30.i2.1602