Toward the Standardization of the BVL_RU: An Instrument for Speech and Language Assessment of Russian-speaking Children

Abstract

The Battery for the assessment of speech and language development in children from 4 to 12 years (BVL_4-12; [1]) was originally developed for Italian-speaking children and currently is under adaptation into several European languages including Russian. The BVL_4-12 consists of three parts and includes tasks assessing oral production, comprehension and repetition skills in children. This article describes the process of adaptation of the BVL_4-12 into Russia and focuses on the instructions’ translation and standardization. It presents the results of the tasks instructions’ clarity evaluation by an expert panel including Russian-speaking specialists constantly working with children of a target age in Russia and Italy (N = 7) and a cohort of children from 4.06 to
10.10 including monolinguals with typical language development, children previously diagnosed with primary language impairment (PLI) and heritage Russian speakers (N = 84). Overall, 10 task instructions were judged as absolutely clear and 5 task instructions were somewhat unclear to some of the participants. Further analysis of
the age of the participants who rated the instructions as ‘unclear’ was performed. Some of the youngest participants, whose age did not exceed 6.10, found that the instructions for the following tasks were not clear: phonological fluency; sentence completion; grammatical judgments; idiom comprehension, and comprehension of linguistic prosody. However, the minimum inter-rater agreement among the sample was reached. The potential explanation of the results of the study is proposed in the Discussion section.



Keywords: language assessment, Russian, children, SLI, task instructions

References
[1] Marini, A., Marotta, L., Bulgheroni, S., et al. (2015). Batteria per la Valutazione del Linguaggio in Bambini dai 4 ai 12 anni. Firenze, Italy: Giunti O.S.


[2] All-Russia population census of 2010. Retrieved from http://www.gks.ru/free_doc/ new_site/perepis2010/croc/perepis_itogi1612.htm


[3] Special Eurobarometer 386. (2012). Europeans and their languages. European Commission. Retrieved from http://ec.europa.eu/commfrontoffice/publicopinion/ archives/ebs/ebs_386_en.pdf


[4] Schwartz, R. G. (2017). Specific language impairment, in R. G. Schwartz (ed.) Handbook of Child Language Disorders, pp. 3–51. New York, NY: Routledge Taylor and Francis Group.


[5] Naglieri, J. A. and Graham, J. R. (2003). Current Status and Future Directions of Assessment Psychology. John Wiley & Sons, Inc.


[6] Borsa, J. C., Damásio, B. F., and Bandeira, D. R. (2012). Cross-cultural adaptation and validation of psychological instruments: Some considerations. Paidéia (Ribeirão Preto), vol. 22, no. 53, pp. 423–432.


[7] Astaeva, A. V. and Berebin, M. A. (2012). Comparative analysis of Russian and foreign systems for the neuropsychological diagnosis of children from the standpoint of the psychometric approach and its limitations when used in clinical practice. Psychology in Russia: State of Art, vol. 1, no. 5, pp. 203–218.


[8] Eliseeva, N. (October 18–21, 2017) The tools for Russian language assessment in monolingual children: an overview. Abstract in conference proceedings of ”Boduen de Courtenay and World Linguistics”. Institute of Philology and Intercultural communication (Kazan Federal University).


[9] Raven, J. C. (1938). Progressive Matrices: A Perceptual Test of Intelligence. London: HK Lewis.


[10] Cohen, Y., Gafni, N., and Hanani, P. (September 2007). Translating and Adapting a Test, Yet Another Source of Variance; the Standard Error of Translation. IAEA, Baku, Azerbaijan. Retrieved from www.iaea.info/documents/paper_1162d22ec7.pdf


[11] International Test Commission. (2010). International Test Commission guidelines for translating and adapting tests. Version 2010. Retrieved from https://www. intestcom.org/files/guideline_test_adaptation.pdf


[12] Hambleton, R. K., Merenda, P. F., and Spielberger, C. D. (eds.) (2004). Adapting Educational and Psychological Tests for Cross-cultural Assessment. Psychology Press.


[13] Beaton, D. E., Bombardier, C., Guillemin, F., et al. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, vol. 25, no. 24, pp. 3186– 3191.


[14] Eliseeva N. and Marini A. (October 31–November 3, 2016). Comprehension of idiomatic expressions by Russian-speaking preschoolers with typical development. Paper presented at the conference – Nauchnoe nasledie V.A. Bogorodickogo i sovremennyj vektor issledovanij Kazanskoj lingvisticheskoj shkoly: Trudy i materialy mezhdunarodnoj konferencii (Kazan’), vol. 2, pp. 78–81.


[15] Eliseeva, N. N., Guts, E. N., and Marini, A. (2017). Comprehension of idiomatic expressions by Russian speaking typically developing children. Psychology in Russia: State of the Art, vol. 10, no. 4, p. 39.


[16] Marini, A., Eliseeva, N., Gorobets, E. A., et al. An introduction to the Russian adaptation of the battery for the assessment of language in children (BVL_RU). 4th International Multidisciplinary Scientific Conferences on Social Sciences & Arts SGEM 2017, vol. 2, pp. 541–548.


[17] Lin, L. C., Chen, M. Y., Chen, Y. C., et al. (2001). Psychometrics of a Chinese translation of the swallowing questionnaire. Journal of advanced nursing, 34(3). pp. 296-303.


[18] Mikhail, B. I., & Petro‐Nustas, W. I. (2001). Transcultural adaptation of champion’s health belief model scales. Journal of Nursing Scholarship, vol. 33, no. 2, pp. 159–165.


[19] Sireci, S. G., Yang, Y., Harter, J., et al. (2006). Evaluating guidelines for test adaptations: A methodological analysis of translation quality. Journal of Crosscultural Psychology, vol. 37, no. 5, pp. 557–567.


[20] Sperber, A. D. (2004). Translation and validation of study instruments for crosscultural research. Gastroenterology, vol. 126, pp. 124–128.


[21] Van de Vijver, F. J. and Leung, K. (1997). Methods and Data Analysis for Cross-cultural Research, vol. 1. SAGE Publishing.


[22] Maneesriwongul, W. and Dixon, J. K. (2004). Instrument translation process: A methods review. Journal of advanced nursing, vol. 48, no. 2, pp. 175–186.


[23] Ljashevskaja, O. N. and Sharov, S. A. (2009). Chastotnyj slovar’ sovremennogo russkogo jazyka (na materialah Nacional’nogo korpusa russkogo jazyka). Retrieved from http://dict.ruslang.ru/freq.php


[24] Sousa, V. D. and Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross‐cultural health care research: A clear and user‐friendly guideline. Journal of Evaluation in Clinical Practice, vol. 17, no. 2, pp. 268–274.


[25] Marini, A., Eliseeva, N., and Fabbro, F. (2016). Impact of early second-language acquisition on the development of first language and verbal short-term and working memory. International Journal of Bilingual Education and Bilingualism, pp. 1–12.


[26] International Test Commission (2005). International Guidelines on Test Adaptation. Retrieved from www.intestcom.org