<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC
  "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.2 20190208//EN"
  "JATS-archivearticle1.dtd">
<article xml:lang="pt">

  <front>
    <article-meta>

      <!-- 1. Identificadores obrigatórios -->
      <article-id pub-id-type="publisher-id">787</article-id>
      <article-id pub-id-type="doi">10.25189/2675-4916.2025.V6.N2.ID787</article-id>
      <article-version>vor</article-version>

      <!-- 2. Título em Português e Espanhol -->
      <title-group>
        <article-title xml:lang="pt">THE USE OF THE CLOZE TEST IN READING COMPREHENSION ASSESSMENT IN BRAZIL: POST-PANDEMIC CHALLENGES</article-title>
        <trans-title-group>
          <trans-title xml:lang="es">EL USO DE LA PRUEBA “CLOZE” EN LA EVALUACIÓN DE LA COMPRENSIÓN LECTORA EN BRASIL: DESAFÍOS POST-PANDEMIA</trans-title>
        </trans-title-group>
      </title-group>

      <!-- 3. Contribuintes (autores) com papéis CRediT -->
      <contrib-group content-type="author">
        <!-- Autor 1 -->
        <contrib id="person-1" contrib-type="author" corresp="yes">
          <name>
            <surname>Freitas</surname>
            <given-names>Flávia Oliveira</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Conceptualization" vocab-term-identifier="https://credit.niso.org/contributor-roles/conceptualization/">Conceptualization</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Methodology" vocab-term-identifier="https://credit.niso.org/contributor-roles/methodology/">Methodology</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Validation" vocab-term-identifier="https://credit.niso.org/contributor-roles/validation/">Validation</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Formal Analysis" vocab-term-identifier="https://credit.niso.org/contributor-roles/formal-analysis/">Formal Analysis</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Investigation" vocab-term-identifier="https://credit.niso.org/contributor-roles/investigation/">Investigation</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Data curation" vocab-term-identifier="https://credit.niso.org/contributor-roles/data-curation/">Data Curation</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Writing – original draft" vocab-term-identifier="https://credit.niso.org/contributor-roles/writing-original-draft/">Writing – Original Draft</role>
          <role specific-use="CRediT">Writing – Review &amp; Editing</role>
          <contrib-id contrib-id-type="orcid">https://orcid.org/0009-0008-1795-6822</contrib-id>
        </contrib>

        <!-- Autor 2 -->
        <contrib id="person-2" contrib-type="author">
          <name>
            <surname>Santos</surname>
            <given-names>Gislane Evangelista dos</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Conceptualization" vocab-term-identifier="https://credit.niso.org/contributor-roles/conceptualization/">Conceptualization</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Methodology" vocab-term-identifier="https://credit.niso.org/contributor-roles/methodology/">Methodology</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Validation" vocab-term-identifier="https://credit.niso.org/contributor-roles/validation/">Validation</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Formal Analysis" vocab-term-identifier="https://credit.niso.org/contributor-roles/formal-analysis/">Formal Analysis</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Investigation" vocab-term-identifier="https://credit.niso.org/contributor-roles/investigation/">Investigation</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Data curation" vocab-term-identifier="https://credit.niso.org/contributor-roles/data-curation/">Data Curation</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Writing – original draft" vocab-term-identifier="https://credit.niso.org/contributor-roles/writing-original-draft/">Writing – Original Draft</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Visualization" vocab-term-identifier="https://credit.niso.org/contributor-roles/visualization/">Visualization</role>
          <contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-5232-3405</contrib-id>
        </contrib>

        <!-- Autor 3 -->
        <contrib id="person-3" contrib-type="author">
          <name>
            <surname>Freitag</surname>
            <given-names>Raquel Meister Ko.</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Conceptualization" vocab-term-identifier="https://credit.niso.org/contributor-roles/conceptualization/">Conceptualization</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Resources" vocab-term-identifier="https://credit.niso.org/contributor-roles/resources/">Resources</role>
          <role specific-use="CRediT">Writing – Review &amp; Editing</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Supervision" vocab-term-identifier="https://credit.niso.org/contributor-roles/supervision/">Supervision</role>
          <role specific-use="CRediT" vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Project administration" vocab-term-identifier="https://credit.niso.org/contributor-roles/project-administration/">Project Administration</role>
          <contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-4972-4320</contrib-id>
        </contrib>
      </contrib-group>

      <!-- 4. Contribuintes (editores) — para registro -->
      <contrib-group content-type="editor">
        <contrib id="editor-1">
          <name>
            <surname>Gedik</surname>
            <given-names>Tan Arda</given-names>
          </name>
          <xref ref-type="aff" rid="aff2"/>
        </contrib>
        <contrib id="editor-2">
          <name>
            <surname>Prela</surname>
            <given-names>Leonarda</given-names>
          </name>
          <xref ref-type="aff" rid="aff3"/>
          <xref ref-type="aff" rid="aff2"/>
        </contrib>
        <contrib id="editor-3">
          <name>
            <surname>Garza</surname>
            <given-names>Vania De la</given-names>
          </name>
          <xref ref-type="aff" rid="aff2"/>
        </contrib>
      </contrib-group>

      <!-- 5. Afiliações -->
      <aff id="aff1">
        <institution>Universidade Federal de Sergipe</institution>
      </aff>
      <aff id="aff2">
        <institution>Friedrich-Alexander-Universität, Baviera, Alemanha</institution>
      </aff>
      <aff id="aff3">
        <institution>Departamento de Lingüística, Universidade Federal de Sergipe</institution>
      </aff>

      <!-- 6. Datas de publicação -->
      <pub-date pub-type="epub">
        <day>02</day><month>05</month><year>2025</year>
      </pub-date>
      <pub-date pub-type="collection">
        <day>02</day><month>05</month><year>2025</year>
      </pub-date>

      <!-- 7. Histórico de recebimento e aceite -->
      <history>
        <date date-type="received" iso-8601-date="2024-04-25"/>
        <date date-type="accepted" iso-8601-date="2025-03-07"/>
      </history>

      <!-- 8. Permissões / Licença -->
      <permissions>
        <license>
          <ali:license_ref>https://creativecommons.org/licenses/by/4.0/</ali:license_ref>
        </license>
      </permissions>

      <!-- 9. Resumos originais -->
      <abstract>
        <p id="_paragraph-1">The cloze test is a pedagogical tool used by teachers and psychologists for 70 years to assess proficiency in understanding texts in different languages, both L1 and L2, including Brazil. The test was based on the systematic gapping of a text, and hit scores were associated with the participants’ degree of comprehension of the task. This procedure allows for distinguishing reader profiles—frustrated, instructional, and independent—by checking the participants’ performance when filling in the gaps. Almeida’s survey (2023) showed that 75 of the 345 studies on reading assessment over the last 20 years adopted this procedure. In the current COVID-19 post-pandemic context, where reading asymmetries have become even more pronounced, relying solely on the criterion of exact word matching proves inadequate for accurate diagnosis. The post-pandemic assessments conducted at the Colégio de Aplicação of the Federal University of Sergipe indicated that several students exhibited insufficient reading comprehension (Santos and Machado, 2022, Cardoso <italic id="italic-1">et al</italic>., 2024). This information underscores the need to encourage the use of consolidated tools such as the cloze test, which can assist educators in enhancing both their teaching practices and students’ reading proficiency. This article systematically reviews studies published across three databases that have applied the traditional cloze test to assess reading comprehension. The analysis criteria are based on Taylor’s (1953) original exact answers proposal (Brown, 1980, 2013) and are supplemented by additional assessment tools from the psychology field. This systematic review focuses on empirical studies that examined reading assessment through the cloze test, specifically those published between 2009 and 2022, and applied it to elementary school students to investigate the measures used to assess the test responses. Our research suggests that most studies have employed the exact word completion criterion (Joly and Istome, 2008), similar to computerized tests (Joly; Piovezan, 2012; Brito; Ribeiro; Seabra, 2022), instead of incorporating alternative approaches, such as word familiarity (Oliveira et al., 2007) or grammatical class (Abreu et al., 2017). We highlight the need to integrate natural language processing techniques, including lexical distance measurements, to offer a more refined comprehension analysis in the context of low reading proficiency. These lexical distances are calculated based on the “minimum number of insertions, deletions, or substitutions of a single character needed to transform one word into the other” (Petroni and Serva, 2010), while maintaining consistency in grammatical class or semantic field with the expected word.</p>
      </abstract>
      <abstract abstract-type="executive-summary">
        <title>Resumo</title>
        <p id="paragraph-02f994ad19f88df58a61dcaca08d9c4a">O Teste cloze é uma ferramenta pedagógica utilizada por professores e psicólogos há 70 anos para avaliar a proficiência na compreensão de textos em diferentes idiomas, tanto L1 quanto L2, incluindo o Brasil. A base do teste consiste na omissão sistemática de palavras em um texto, e as pontuações de acerto são associadas ao grau de compreensão da tarefa pelo participante. Esse procedimento permite distinguir perfis de leitores – frustrado, instrucional e independente – com base no desempenho do participante quanto ao preenchimento das lacunas. A pesquisa de Almeida (2023) aponta que 75 dos 345 estudos sobre avaliação de leitura, nos últimos 20 anos, adotaram esse procedimento. No atual contexto pós-pandemia de COVID-19, em que as assimetrias na leitura tornaram-se ainda maiores, a adoção exclusiva do critério de correspondência exata de palavras mostra-se insuficiente para um diagnóstico preciso. As avaliações pós-pandemia realizadas no Colégio de Aplicação da Universidade Federal de Sergipe indicaram que vários estudantes apresentam compreensão leitora insuficiente (Santos; Machado, 2022, Cardoso <italic id="italic-eb5d0b28af8e68fbff831caa18a71ded">et al</italic>., 2024). Esses dados reforçam a necessidade de incentivar o uso de ferramentas consolidadas, tais como o teste cloze, que podem auxiliar os educadores na melhoria tanto das práticas de ensino quanto da proficiência leitora dos estudantes. Esse artigo revisa, sistematicamente, estudos que aplicaram o teste cloze para avaliar a compreensão leitora e que foram publicados em três bases de dados escolhidas para esta pesquisa. Os critérios de análise baseiam-se na proposta original de respostas exatas de Taylor (1953) e (Brown, 1980; 2013) e são complementadas por instrumentos adicionais de avaliação provinientes do campo da psicologia. A revisão sistemática enfoca estudos empíricos publicados entre 2009 e 2022 que analisaram a avaliação de leitura por meio do teste cloze, especificamente aqueles aplicados a estudantes do ensino fundamental, com o objetivo de investigar as medidas utilizadas na correção das respostas ao teste. Esta pesquisa indica que a maioria dos estudos empregou o critério de completamento exato da palavra (Joly; Istome, 2008), assim como os testes computadorizados (Joly; Piovezan, 2012; Brito; Ribeiro; Seabra, 2022), em vez de considerar abordagens alternativas, como a familiaridade lexical (Oliveira <italic id="italic-29e93251187c869db115b1a4beefea96">et al</italic>., 2007) ou classe gramatical (Abreu<italic id="italic-22bd8e564c738f74824d682197f9f00d"> et al</italic>., 2017). Destacamos a necessidade de integrar técnicas de processamento de linguagem natural, incluindo medidas de distância lexical, para oferecer um entendimento mais preciso da compreensão em contextos de baixa proficiência leitora. Essas distâncias lexicais são calculadas com base no “número mínimo de inserções, deleções ou substituições de um simples caractere necessário para transformar uma palavra em outra” (Petroni; Serva, 2010), mantendo a consistência quanto à classe gramatical ou ao campo semântico da palavra esperada.</p>
      </abstract>

      <!-- 10. Palavras-chave originais -->
      <kwd-group>
        <kwd content-type="">Cloze test</kwd>
        <kwd content-type="">Exact Answers</kwd>
        <kwd content-type="">Systematic Review</kwd>
      </kwd-group>

    </article-meta>
  </front>

  
  
<body id="body">
    <sec id="heading-b2c69208fe4461ee0c684e96f29b696e">
      <title>Lay Summary</title>
      <p id="paragraph-1f1627b197c49d01442f98bf1aa9ad70">The cloze test has been in use for 70 years to assess reading comprehension in several languages. It involves removing words from a text and analyzing how well participants fill in the gaps, which helps identify their reading proficiency levels. In the post-pandemic period, reading difficulties increased, making traditional exact word matching methods insufficient for accurate assessment. A study conducted at the Colégio de Aplicação of the Federal University of Sergipe confirmed that many students struggled with comprehension. This article systematically reviews studies from 2009 to 2022 that have applied the traditional cloze test to elementary school students. The findings show that most studies rely on exact word matches, including computerized versions, rather than considering alternatives such as word familiarity or grammatical class. This research highlights the need for advanced assessment methods, such as natural language processing, which can analyze responses based on lexical distance—the number of small changes needed to transform one word into another while maintaining meaning. Incorporating natural language processing allows educators to understand students’ reading abilities, leading to improved teaching strategies and literacy development.</p>
    </sec>
    <sec id="heading-ac5b9ebaf5848a2aebfab7263fa7a046">
      <title>Introduction</title>
      <p id="paragraph-750561fbec6f3e9f9e488f942b5f23b2">The cloze test, also known as the cloze procedure, has been widely used to assess reading proficiency in first- and second-language contexts. Initially developed by Taylor in 1953, the cloze test was designed to evaluate the readability of texts for native English speakers. Researchers have expanded its use by adopting the cloze test as an instrument to measure proficiency in English as a foreign language (Brown 1980, 2002). Since then, it has been integrated into exams such as the Test of English as a Second Language (TOEFL) and Teaching English to Speakers of Other Languages (TESOL) assessments.</p>
      <p id="paragraph-c310345ecb7f1b3d82f44946e3b69723">The cloze test is currently used to evaluate how well a subject comprehends the meaning of a given text. In this procedure, the subject is required to read a text and then fill in blanks with a single word, which could be functional (e.g., prepositions, articles, conjunctions), lexical (e.g., nouns, adverbs, adjectives), or even a random term (Abreu et al., 2017; Cardoso, Menezes Freitas and Freitag, 2024; Colombo and Cárnio, 2017). The primary goal of this test is to allow participants to complete a passage by supplying omitted words, thereby obtaining meaning. The foundation of the cloze test lies in the systematic omission of words from a passage of prose (Bickley et al. 1970), with participants' scores reflecting their level of comprehension. In Brazil, the cloze procedure has been effectively utilized as a key tool for assessing L1 reading comprehension.</p>
      <p id="paragraph-a430eb470f84ac461d61b6bb2b9bb809">The cloze test can be a valuable tool for teachers and researchers to identify and distinguish three readers’ profiles – frustrated, instructional, and independent (Bormuth, 1968) –based on their performance. The frustrated level refers to participants who achieved up to 44% of correct literal answers, the instructional level applies when participants scored between 45% and 57% of correct answers, and the independent level was reached by individuals who scored more than 57% of correct answers according to the original passage of the text.</p>
      <p id="paragraph-d9ebe2d947659948d7a16e776abd23d4">These results are useful for calculating the individual performance of cloze test-takers. Once a participant has completed the test within the stipulated time, the total number of correct responses must be counted, multiplied by 100%, and divided by the total number of deleted spaces (Cardoso et al. in press).</p>
      <p id="paragraph-d78f5a227682733682496552b475e7d8">This study investigates methods to evaluate gap-filling through exact answers (EX) (Brown, 1980), which are considered the most appropriate to the context, thereby demonstrating students’ comprehension of the text. The criteria for analyzing these responses were based on Taylor’s initial proposal (1953), which prioritizes the exact answer. Despite alternative methods, such as multiple-choice and Clozentropy (Brown, 1980; Darnell, 1968), this study focuses on the exact-answer method, within the Brazilian context, where teachers must manually check their students’ responses, making the process less time-consuming.</p>
      <p id="paragraph-67d13353d8a3e70d4fadf3f02914d847">The primary objective of this systematic review was to identify the most validated cloze test assessment measures through empirical studies and published research, with a particular focus on Elementary School students. Almeida (2023) reported that the cloze procedure appeared in 75 of 345 studies on reading assessment over the past 29 years, highlighting the significance of investigating this procedure and its scoring methods. Three virtual databases — Scielo, Scopus, and Web of Science — were consulted for this study.</p>
      <p id="paragraph-4825a930aedb05aad3fb22bb7beb51e3">In the post-pandemic period, reading asymmetries have widened compared to the pre-pandemic era, yet the exact word criterion does not provide a fully adequate reading diagnostic; it remains the most appropriate available method. Post-pandemic applications conducted at Colégio de Aplicação of Universidade Federal de Sergipe revealed that some students were classified as having insufficient comprehension or frustration (Santos and Machado, 2022, Cardoso <italic id="italic-4b5f25ee9a1a52ed7e0d5be69b0688cf">et al.</italic>, 2024). These findings underscore the importance of encouraging the use of well-established tools such as the cloze test, which can aid education professionals in refining their practices and enhancing students’ reading proficiency levels.</p>
      <p id="paragraph-390017c67e010412a6085e61ecbfcfa6">The remainder of this paper is organized as follows. It begins with a brief introduction to the cloze procedure and the stages used to create this test. The second section provides a review of the relevant literature. Subsequently, this article outlines the methodology. The subsequent sections present the results, including the analysis of the papers selected for this study and a discussion supported by additional data. In the final section, the authors emphasize the applications of cloze tests, advocate for the broader dissemination of this practice across other regions of Brazil, and suggest the adoption of semantic similarity responses.</p>
    </sec>
    <sec id="heading-6ac97f7b86c076b1ed647d5a406cc81a">
      <title>1. Background</title>
      <p id="paragraph-9d56c3cde27a81e81293f2150c1756f2">In 1953, journalist Wilson Taylor developed the cloze test or cloze procedure to assess children’s reading comprehension and evaluate communication effectiveness in English (Brown, 2002; Bickley; Ellington; Bickley, 1970). Since then, different science fields, including psychology, phonology, and language teaching, have adopted it as a research method either independently or in conjunction with other assessment measurements.</p>
      <p id="paragraph-6bb7702033d74b8ab8578d69b34095a1">The cloze procedure is grounded in the Gestalt Psychology principle of “closure”, which highlights the natural human inclination to complete patterns by filling in gaps (Taylor, 1957; Oller; Conrad, 1971). In language field studies, this principle explains students' tendency to fill in the blanks of written text, drawing on their ability to understand the materials. This process involves various cognitive and linguistic factors including comprehension, general language proficiency, vocabulary, learning ability, attention, motivation, and memory (Taylor, 1957; Morais and Kolinsky, 2015).</p>
      <p id="paragraph-f840db76c62133c35442727ae60dfa3d">The cloze test typically uses a prose passage of 200 to 250 words (Bickley, Ellington and Bickley, 1970; Cardoso et al., 2024). The selected text may be informational, and the test designer can adapt the content from a school textbook or news report. The construction of the text can be tailored to the social and economic background, age, and educational level of the target students depending on the researcher’s objective. The passage may be taken from any test section (Bormuth, 1968), preserving its title and initial 15–17 words. This allowed participants to read the introductory segment and contextualize the subject matter of the text. Beginning from the sixteenth word, every fifth word was omitted, requiring the participant to complete the text by filling in the blank spaces. This method aids students in understanding the task and restoring disrupted patterns (Oller and Conrad, 1971), thereby facilitating comprehension of the text.</p>
      <p id="paragraph-c57c69132534dbb11341f3ed1a0c1c82">A blank of uniform length was placed after every fourth word (Trassi <italic id="italic-a41ea04d0675aabc813681f8c572d23a">et al</italic>., 2019), ensuring that all blanks were of the same size (Darnell, 1968; Brown, 1980). This standardization is crucial in preventing the participant from inferring the correct word based on the blank space, which could lead to skewed responses such as selecting longer or shorter answers. The consistent length of the blanks minimizes the potential for misleading cues, ensuring that the blank size does not influence the participant’s judgment of the most appropriate word.</p>
      <p id="paragraph-87e6837903f591d5145e6a19274efa58">Taylor’s scoring criterion adheres to a binary correct/incorrect system, where participants must fill in the blanks with exact words from the original text (Bormuth, 1968). A variation of this approach offered two answer options per blank, with only one being correct. Any responses that deviated from the original wording were considered incorrect.</p>
      <p id="paragraph-f469c5e743e000671ee2bbecc0b09c4c">Brown (1980) identified four prominent cloze test scoring methods: (1) the exact word method (EX), which only accepts the original word from the text to be correct; (2) the acceptable answer (AC), which allows any contextually appropriate word as the correct answer; (3) Clozentropy (CLNTZ-Darnell, 1968), a method that considers the frequency of native speaker responses in a pre-test and logarithmically weights acceptable answers; and (4) multiple-choice (MC), in which students are provided with alternative answers and must select the correct word for each blank. The following section outlines the methodology employed in this study.</p>
    </sec>
    <sec id="heading-998821675aa5b275d1b84c379c26aef7">
      <title>2. Method</title>
      <p id="paragraph-cacf1ff051e0fbcb05f0f7fb8402e7a1">The primary goal of this study was to identify the measurement procedures most commonly employed in Brazilian studies to assess gap-filling responses in cloze tests. The methodological approach to this study adheres to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), as Galvão and Ricarte (2019) recommend.</p>
      <p id="paragraph-ce53e4aa0bb7637522bb60de25787f09">The descriptors utilized for the database search included “test cloze” and “reading assessment combined with the Boolean operator AND. To validate these descriptors, the bibliometric tool, Bibioshiny, was used to generate a word cloud illustrating the frequency of terms in various cloze test studies. The search was conducted simultaneously and independently using the CAPES Journal Portal, which provides access to several databases. Based on the availability of articles related to the topic, the SciELO, Web of Science, and SCOPUS databases were selected as the primary databases for the literature search. The search criteria focused on the title, abstract, and keywords, and only the studies published in the paper were considered.</p>
      <p id="paragraph-eb38549ed2a4571c53dc12e3bd4bd2a4">The next step involved establishing inclusion and exclusion criteria. While the inclusion criterion focused on selecting empirical studies that used the cloze test to assess reading ability and involved studies with basic education in Brazil, the exclusion criterion, on the other hand, led to the removal of studies conducted on adults, graduate and undergraduate students, or those focusing on atypical populations, such as children with dyslexia or Attention Deficit Hyperactivity Disorder (ADHD).</p>
      <p id="paragraph-e5fd4166b33eb00b9086d67ac598dbe1">Two researchers independently reviewed all relevant papers on the topic, organizing the information in an Excel table to consolidate the data and facilitate content analysis. The corpus construction process was divided into three stages: 1) study identification, 2) screening, and 3) eligibility assessment. During the initial identification stage, 42 papers were retrieved: 27 from SciELO, three from Web of Science, and 12 from SCOPUS. The papers were screened for further evaluation.</p>
      <p id="paragraph-9947410c6c90c97aa348b0e3bd06328f">The second stage of this review was the screening process that explained the articles selected for this study. The exclusion criteria, based on paper titles, keywords, and abstracts, resulted in the removal of 15 texts, and one additional screening identified eight duplicated entries. Ultimately, 19 articles met our inclusion criteria.</p>
      <p id="paragraph-86aa27dc214ff40fb17f4be7d7880418">The eligibility stage involved full-text review of the remaining papers. The final selection of this review comprised 19 empirical studies that applied the cloze test to assess the reading abilities of basic-education students in Brazil. These studies are presented in a table containing detailed information on published papers across the selected databases.</p>
    </sec>
    <sec id="heading-441f5f6c1a95027e170b8f179a5495c9">
      <title>3. Results</title>
      <p id="paragraph-e191b71bae5cc0785006263b05f01815">This systematic review <italic id="italic-6d5a199c027d9001954e968f4df82005">corpus</italic> comprises 18 papers published<italic id="italic-2"> </italic>over thirteen years, from 2009 to 2022. The table 1 offers an overview of this information, including the authors’ names, fields of study, number of participants, and the specific measures used in the cloze test assessments.</p>
      <p id="paragraph-b4306a8469cd5ad5699ee1fd114e2fe9">After analyzing the papers, it was possible to realize that the participants’ preponderance was boys and girls, ranging from 6 to 14 years of age. In two studies, the participants were up to 17 years old. One paper does not specify the students’ school level, but addresses differences in textual genre issues (Brito et al., 2022). In addition, one study mentioned students’ social conditions, noting that the participants lived in socially at-risk conditions (Santos et al., 2009).</p>
      <p id="paragraph-c360b63ef78527bea7455af32c1040bd">Ten studies were conducted in public schools, five in private schools, and two in industrial institutions (Cunha and Santos, 2009; 2010). Two studies did not specify the setting of the studies (Brito et al., 2016; Brito et al., 2022).</p>
      <p id="paragraph-477c09be612304caf4fd086b98e7b110">In two separate studies, Cunha and Santos (2009, 2010) investigated the validity of evidence based on the traditional cloze test, which focuses on literal or verbatim answers. Their first study (Cunha and Santos, 2009) examined the errors in students' responses to a cloze test to identify the validity evidence in the response process. They compared the results obtained from students’ responses with their school averages and academic performance, observing that students with higher grades made more lexical errors, and those with lower grades showed more semantic errors. The authors noted evidence of validity in the response process by assessing the error-type distribution homogeneity.</p>
      <p id="paragraph-f0543a375055150af32a75141681634b">In the same study, the reliability of the cloze test measure was analyzed by conducting a pilot study with 314 children, both boys and girls, from 2<sup id="superscript-1">nd</sup> to 4<sup id="superscript-2">th</sup> grade. The study demonstrated satisfactory precision indices through internal consistency analysis (following the recommendations of CFP (2003), which prescribes an index above 0,70), indicating that the gap-filling text used in the research was suitable for the sample. Cronbach’s alpha was 0.83 for the participants. Internal consistency was also analyzed by grade level, with rates of 0.85 for the 2nd year, 0,70 for the 3<sup id="superscript-3">rd</sup>year, and 0,72 for the 4<sup id="superscript-4">th</sup> year (Cunha; Santos, 2009). There were no correlation tests between the cloze test and other instruments.</p>
      <fig id="figure-panel-ceb4d5967715dede533f24bc71877c99">
        <label>Figure 1</label>
        <caption>
          <title> <bold id="bold-c64500675cd3bfab2bd3a678639885c6">Table 1: </bold>Selected papers. </title>
          <p id="paragraph-0a674e61978760e688fa1d08ee24f5d3"/>
        </caption>
        <graphic id="graphic-dfb1708dd12f376dc09476f8ab9d9f3b" mimetype="image" mime-subtype="png" xlink:href="t1_2.png"><alt-text>Figura</alt-text></graphic>
      </fig>
      <p id="paragraph-e900c2ec04ad487672c1ed3387822a05">In their second study, Cunha and Santos (2010) examined the same group of 266 students from a previous study to investigate the evidence of convergent validity. By relating writing acquisition to reading comprehension, they identified evidence of convergent validity in the assessment of difficulties in learning writing scales, word recognition scales, and cloze test instruments. Responses were measured by considering the exact words. However, they did not specify how the reliability of the cloze test was assessed. The correlation between the averages of this test and the other instruments indicated statistically significant differences according to the analysis of variance results. These results were as follows: [F (3,262) = 105,942; p&lt;0,001, [F (3,262) = 49, 734; p &lt; 0,001] (Cunha and Santos, 2010).</p>
      <p id="paragraph-4d0aa9eceeb8c8d3a867057c08db90a6">Mota and Santos (2009, 2014) also explored the cloze test as a reading-assessment tool. Their first paper (Mota and Santos, 2009) focused on the relationship between phonological awareness and reading comprehension. The scores obtained in the phonological awareness tasks correlated with those of the cloze test, which were corrected using verbatim criteria, excluding synonyms or misspelled words. They argued that this correction method reduces the influence of the experimenter’s subjective judgment.</p>
      <p id="paragraph-19bbba906d6ab65f1c08cb33d4785c49">The cloze tests used by Mota and Santos (2009) demonstrated satisfactory internal consistency rates (α &gt; 0,70) and were effective in assessing 1<sup id="superscript-9e7c002c2dd03899a5b15f590d69e7e8">st</sup>-grade students in elementary education. There was a positive and significant correlation between reading comprehension and phonological awareness: [r = 0,37; p &lt; 0,05] for alliteration and cloze test scores 1, [r = 0,37; p &lt; 0,05] for alliteration and cloze test scores 2, [r = 0,40; p &lt; 0,01] for rhyme and cloze test 1, and [r = 0,51; p &lt; 0,01] for rhyme and cloze test 2 (Mota and Santos, 2009). To control for the influence of cognitive development on reading and writing acquisition, researchers also employed the vocabulary and digit subtest of the Weschler Intelligence Scale for Children WISC-III Weschler 1991) in their study. The digit memory measure showed a positive and significant correlation with the cloze test (cloze 1 p &lt; 0,05; cloze 2 p &lt; 0,01), whereas the vocabulary task did not correlate with the reading comprehension scores.</p>
      <p id="paragraph-94a019011b1b6585176a6ee6f953cf83">In their second study, in which the same cloze tests from the study mentioned above were employed, thus maintaining the same psychometric properties, Mota and Santos (2014) applied the cloze test as a measure of reading ability in two primary school grades, and compared the results with those of the School Achievement Test (TDE), whose focus is specifically on academic performance in reading and writing, used as a standard measure. The authors found that higher performance on the School Achievement Test correlated better with cloze test performance across grades and categories, with positive and significantly moderate results [r = 0,47; p &lt; 0,001].</p>
      <p id="paragraph-5d2598edbee106489453956a65925681">Using reading comprehension tests identical to those used by Mota and Santos (2009; 2014), Mota et al. (2009) conducted a study on 42 children from a private school and investigated the relationship between morphological awareness and text comprehension measured by the cloze test. The association between morphological awareness tasks and text comprehension measures showed that morphological awareness is related to contextual reading in Portuguese. There were positive and significant associations between the two cloze tests and the morphological awareness tasks (analogy task and morpheme-semantic association task): [r = 0,47, p &lt; 0,01] for cloze 1 and analogy task, and [r = 0,52, p &lt; 0,01] for cloze 2 and analogy task; and [ r= 0,25, p &lt; 0,01] for cloze 1 and morpheme-semantic association task, and [r = 0,58, p &lt; 0,01] for cloze 2 and morpheme-semantic association task (Mota et al., 2009). Mota et al. (2012) found similar results using an identical methodology.</p>
      <p id="paragraph-393eb437d53112e88460cc1c33d476aa">A study conducted by Santos et al. (2009) applied the cloze test to measure reading comprehension and relate it to intelligence, as assessed by the R1-Test- Form B (Sisto, Santos and Noronha, 2004). The criterion for evaluating the participants’ responses to the cloze test was literal accuracy. The authors found a significant positive correlation between the results of the intelligence and reading tests [r=0,39; p=0,002], indicating that higher scores on R1 -Test Form B were associated with greater accuracy in completing cloze test gaps. However, it does not address the test reliability.</p>
      <p id="paragraph-2a16a12f3b266568d6330132a18418a3">Santos and Oliveira (2010) sought to identify the appropriateness of cloze techniques for assessing and developing text comprehension skills through an intervention program. In this study, they employed the traditional cloze method, considering only words that matched the original text, similar to the approach used by Joly and Piovezan (2012) and other researchers. They used the Computerized Basic-MAR Cloze test as both pre-and post-measures. This test was developed by Joy and Piovezan as a reading comprehension test using the cloze technique with psychometric characteristics (Joly and Istome, 2008). Reliability was evaluated through test-retest (pre- and post-assessment). The results of both studies demonstrated a significant positive effect on students’ reading comprehension levels.</p>
      <p id="paragraph-3f8f0dfc467ae1a63a48e1c0eeaad5ba">Suehiro and Magalhães (2014) and Suehiro and Santos (2015) show the results from studies conducted in different Brazilian states, such as Bahia and São Paulo. The first study aimed to examine the relationship between reading and writing among public elementary school students and search for evidence of convergent discriminant validity and concurrent criteria between the instruments used. The second paper also sought validity evidence, but this time through measures that assess related constructs such as reading comprehension and phonological awareness. Both studies demonstrated criterion validity through contrasting group methods, and the cloze test proved to be sensitive in capturing the relationship between learning to write and reading comprehension.</p>
      <p id="paragraph-f2e077249a79e3a168c92b72d0eb7ecd">Santos and Fernades (2016) conducted a comprehensive study of five Brazilian regions. They aimed to explore the relationships between instruments assessing writing and reading comprehension, and to examine the predictive value of these instruments for school performance. They also investigated potential differences in children’s test performance based on gender and school grade. This study presented the reliability of the test by calculating the alpha coefficient (0,96). The measures of the instruments used – cloze, Writing Evaluation Scale (Sisto, 2005), and School Performance Test (Stein, 1994) – were correlated, indicating that cloze and writing evaluation scales predicted school performance in reading, as controlled by the school performance test in this study. The correlation coefficient between the cloze test and school performance (R=0,73, with an adjusted R² of 0,53) demonstrates the predictive value of the cloze test for academic performance.</p>
      <p id="paragraph-9092b5a8106fea5f39ee1f85c5c574f7">Although the study did not specify where data collection took place, Colombo and Cárnio (2018) aimed to develop an instrument to assess reading comprehension and examine the influence of receptive vocabulary on the reading comprehension of typical elementary school students. Although some students were impacted by their low socioeconomic status, the results indicated that most scored above average in receptive lexicons. The students also performed better on explicit and implicit questions. Furthermore, cloze tests revealed more homogeneous and similar performance across different school years. The authors did not explain how the reliability of the cloze instrument was assessed, and they suggested strong significant and positive associations between the results of the cloze procedure and the question-and-answer method [p &lt; 0,001].</p>
      <p id="paragraph-3cc96e96a4aac8cd43e9dd58eb82ae3d">Santos et al. (2018) sought to identify the relationship between reading comprehension and learning motivation among elementary-school students. Two measurement instruments were applied: the exact-answer cloze test and Motivation Assessment Scale for Learning. This scale is based on three goals that represent students’ efforts, their concern about standing out to their peers, and their concern about not showing weakness in front of their peers (Santos et al., 2018).</p>
      <p id="paragraph-2f8ff9b72c11e5fd09f7512b057057a4">The results revealed a positive correlation between cloze test and learning goal scores, with significant negative effects on performance, approach, and avoidance goals. According to the statistical data, the higher the reading comprehension score, the lower the score for a student’s interest in excelling in the classroom (performance/approach) and avoiding appearances in front of their classmates and teachers (performance avoidance). The results of the significance levels were as follows: [r= 0,167; p = 0,041] for cloze and goal to learn; [r = -0,234; p = 0,003] for cloze and goal performance approach; and [r = -0,224; p = 0,004] for cloze and goal performance avoidance. However, the authors did not explicitly determine the reliability of the cloze test.</p>
      <p id="paragraph-d17bdf360138c0cef968d24fb3d6154c">Trassi, Oliveira, and Inácio (2019) applied three measurement tools at different stages to achieve four objectives: to analyze the reading level of public elementary school students; compare their performance on the cloze test; investigate possible relationships between reading comprehension, learning strategies, and verbal reasoning; and determine whether verbal reasoning can predict other variables. A total of 470 students completed the test and assessment scales for learning strategies. Of these, only 45 were selected to complete the Wechsler Abbreviated Scales of Intelligence (WASI). This scale “briefly assesses the abilities in general, verbal and execution intelligence in 4 subtests: similarities, vocabulary, cubes, and matrix reasoning, the first two referring to the verbal area” (Trassi, Oliveira and Inácio, 2019, p. 618).</p>
      <p id="paragraph-234c91753486595978b6561157c01a9f">The results indicated that the sample exhibited an independent reading comprehension level, particularly among students in the 2<sup id="superscript-198dbc534008f801cc14b6921ef91ea7">nd</sup>, 3<sup id="superscript-ace96c8d79623abc0425f1c7f910b326">rd</sup>, and 4<sup id="superscript-a5d4a506bc145d8d9d255664db113892">th</sup> years compared to students in other grades. Based on the WASI results, the students in this sample demonstrated good verbal reasoning performance as expected. Regarding the cloze test used, there were no specific details regarding the instrument reliability. The research data indicated statistically significant correlations between the cloze test and metacognitive strategies [r = 0,217; p = 0,001], and between the cloze test and verbal IQ [r = 0,528; p = 0,001].</p>
      <p id="paragraph-517663d0a9e4b42a132641093826bacc">Cunha et al. (2020) applied the cloze test as evidence of validity through response processes and analyzed the types of semantic and syntactic errors. The highest and lowest scores on the cloze test were used to construct a scale to analyze the complexity of terms through morphosyntactic analysis. This study is similar to that of Cunha and Santos (2009), who identified five types of errors: blank space, phonological, lexical, syntactic, and semantic. Students with higher averages tended to make more syntactic and linguistic errors, whereas those with lower averages tended to make more semantic errors. Cunha and Santos (2009) demonstrated good test reliability, and an internal consistency analysis revealed a Cronbach’s alpha of 0,83.</p>
      <p id="paragraph-8f3ce6c526acf36603ddf855f95a2245">Cunha et al. (2021) conducted a psychometric study using a questionnaire and two cloze tests to investigate the psychometric properties of the Metatextual Awareness Assessment Questionnaire, based on the “Theory of Human Information Processing and the precepts of cognitive psychology” (Cunha et al., 2021). The questionnaire responses revealed differences in performance according to the school year. The cloze tests were evaluated using traditional or literal correction methods and provided valid evidence. For this study, the internal consistency of the cloze tests indicated (α = 0,82) (cloze 1) and (α = 0,77) (cloze 2).</p>
      <p id="paragraph-4d522836da2b9a882de4d3b0929ca3e9">Fabri et al. (2022) applied the traditional cloze to verify the internal structure of the Inventory of Learning Self-regulation Processes (Polydor et al., 2011<italic id="italic-15d4b127aef98d8487ede7be81858345">) </italic>and to assess self-regulation, learning strategies, and reading comprehension of students in early elementary school. This inventory, developed in Portugal, was designed to investigate self-regulatory processes in their different dimensions, consisting of a 9-item questionnaire, using a Likert scale, with responses ranging from “never” to “always” (Fabri et al., 2022). The authors reported significant use of self-regulatory strategies, demonstrating relationships between this construct, metacognitive strategies, and instructional reading comprehension levels. They also identified a dependent relationship between self-regulation and cognitive skill.</p>
    </sec>
    <sec id="heading-96a912baf114d2da3a18303c897a0c53">
      <title>4. Discussion</title>
      <p id="paragraph-b771a5ed3d4182366159d24e732a2247">The results of this systematic review reinforce the cloze test’s sensitivity in capturing reading and writing skills, making it a valuable indicator of overall academic performance. The cloze test is a well-established instrument that can be used independently or with other measurement tools.</p>
      <p id="paragraph-e00e98edb216bad364d0e94e521ed0c0">Most of the analyzed studies adopted the exact word as the criterion for scoring cloze test responses (Cunha, Ferraz and Santos, 2021; Cunha et al., 2020; Cunha and Santos, 2009; Cunha and Santos, 2010; Fabri et al., 2022; Joly; Piovezan, 2012; Mota et al.; 2012; Mota et al., 2009; Mota and Santos, 2009; Mota and Santos, 2014; Santos and Fernandes, 2016; Santos, Morais and Lima, 2018; Santos and Oliveira, 2010; Santos, Suehiro and Vendemiatto, 2009; Suehiro and Magalhães, 2014; Suehiro and Santos, 2015; Trassi, Oliveira and Inácio, 2019).</p>
      <p id="paragraph-11165fd2169253247cb42667a91d905b">There is a tendency to adopt the exact word criterion for scoring; however, a recent study by Brito et al. (2022) differs from others in that it does not specify the criterion used to score the responses. Instead, the researchers adopted a computerized correction made by the Coh-Metrix-Port 2.0. This study aimed to analyze the characteristics of words, syntactic structure, and cohesion elements in the Cloze Reading Comprehension Test (TCCL), comparing its two parts: narrative text (TCCL-N) and expository text (TCCL-E), using the Coh-Metrix software. This program allows for the analysis of cohesion, coherence, and difficulty in understanding a text (Brito, Ribeiro and Seabra, 2022) using Natural Language Processing resources and tools. The results showed that TCCL-E is slightly more complex than TCC-N, as supported by the literature, and the authors emphasized the importance of considering reader characteristics when determining text difficulty.</p>
      <p id="paragraph-c4c97bb33510a263e9857948d05cf138">Although Santos and Fernandes’s research in 2016 was the only study conducted across all five Brazilian regions, most participants were from the southeast region, particularly São Paulo, the most populous state (IBGE, 2010). Of the 19 papers analyzed, eight were from São Paulo (Santos et al.; 2009; Cunha and Santos, 2009; Santos and Oliveira, 2010; Cunha and Santos, 2010; Suehiro and Santos, 2015; Santos et al., 2018; Cunha et al., 2020), Minas Gerais (Mota et al., 2009; Mota and Santos, 2009; Mota et al., 2012; Mota and Santos, 2014; Cunha et al., 2021), and Paraná (Trassi et al., 2019; Fabri et al., 2022). Only one study was from Bahia (Suehiro and Magalhães, 2014), in the northeast region, and none were from the North or Midwest regions. Three papers did not specify the location of their study (Joly and Piovezan, 2012; Colombo and Cárnio, 2018; Brito et al., 2022).</p>
      <p id="paragraph-a110944cc343dc014ee6da3314bc7a56">The field that produced the most studies on the cloze test was psychology with 16 papers. One study was published in speech-language pathology (Colombo and Cárnio, 2018), one in education (Fabri et al., 2022), and one in the humanities (Joly and Piovezan, 2012).</p>
      <p id="paragraph-ebf5176f0117bc5efff45271caec463c">Despite their specific objectives, each study used the cloze test as a reading assessment, applying it to examine the relationship between reading comprehension and other linguistic abilities such as morphological and phonological awareness (Suehiro; Santos, 2015; Mota; Santos, 2009; Mota et al., 2009; Mota et al., 2012) and metatextual awareness (Cunha et al., 2021).</p>
      <p id="paragraph-dfa07e42db92b0f80c06e661c68aa70b">The cloze test has also been used to assess writing ability (Cunha and Santos, 2010; Santos and Fernandes, 2016; Suehiro and Magalhães, 2014) as well as other factors related to education, such as learning motivation (Santos et al., 2018), learning strategies, verbal reasoning (Trassi et al., 2019), and school development (Colombo and Cárnio, 2018). Furthermore, the latter study aimed to create a tool for assessing textual reading comprehension. It was the only study to consult linguists to validate the cloze tests before applying them.</p>
      <p id="paragraph-9d2b8edd6ebeb19506701cac3496bf53">A few studies have used the cloze test exclusively to analyze reading without relating it to other skills, such as Joly and Piovezan’s (2012) study, which aimed to evaluate their Computerized Reading Program Strategy (Programa Informatizado de Leitura Estratégica-PILE) (Joly, 2008).</p>
      <p id="paragraph-7fe257b4188792bbbeb464a453e3b2cb">This systematic review revealed that the analyzed studies consistently adopted exact answer scoring criteria, including those using computerized tests. Clozentropy or multiple-choice scoring methods have not been mentioned in previous papers.</p>
    </sec>
    <sec id="heading-f6da493812260f893754f713fbac8c7d">
      <title>5. Conclusion</title>
      <p id="paragraph-b57dbbcad25848868c21b825fc2bd984">The findings of this systematic review reinforce the consolidation of the cloze test in Brazil as a tool for assessing reading proficiency particularly in research that focuses on primary and elementary school students. It also underscores that the psychology and phonology areas have produced more research on the cloze procedure than the language studies field. Teachers, linguists, psychologists, and other professionals can work together to examine the development of these tests, ensuring that they are appropriately aligned with the participants’ age, educational level, and knowledge base.</p>
      <p id="paragraph-4d63bc50d67ec0cb30b656da55115d13">Currently, such research is concentrated in southeastern Brazil. Expanding these studies to other Brazilian states could provide a broader understanding of reading difficulties across the country, particularly in the Covid-19 post-pandemic context, where reading asymmetries have widened. Furthermore, the “exact word” criterion used in many cloze tests limits the accuracy of reading diagnosis as it narrows the range of acceptable responses and excludes answers with semantic similarity, such as synonyms. Despite these limitations, one piece of information should be highlighted. The research results assume that it is a reliable measure to assess reading comprehension and predicts students' performance in other skills related to reading activity.</p>
      <p id="paragraph-a2a032645af10d76d31921a12c88635e">Natural language processing techniques could be employed, utilizing measures of lexical distance, to better assess comprehension in contexts with low reading proficiency. Lexical distances, defined as the “minimum number of insertions, deletions or substitutions of a single character needed to transform one word into the other”,<ext-link id="external-link-1" xlink:href="#_ftn1">[1]</ext-link> could be used to measure responses that follow the same grammatical class or semantic field as the expected word, revealing alternative responses possibilities (Gois <italic id="italic-8a8f36950aa370437650841c429586fb">et al</italic>., 2025). </p>
      <p id="paragraph-7eac596688c596a21ecb6a85e376ffab">Previous studies reinforce the validity of the cloze test as an instrument for measuring reading comprehension. Due to its low cost and ease of application, it is a highly practical tool for diagnosing reading proficiency, especially in the post-pandemic context, where performance rates have declined, raising concerns among education networks and challenging teachers to address this issue. Mapping how the cloze technique has been applied in Brazil contributes to the development of new analytical approaches, particularly those based on natural language processing (Gois <italic id="italic-9293f587f256981b4afa3634925b345f">et al</italic>., 2025) and novel gap types, such as verbal aspect (Santos, 2025), ultimately aiding in the reduction of reading asymmetries.</p>
    </sec>
    <sec id="heading-f344fe9ef6626784bebd57fef9d79a4f">
      <title>Acknowledgments</title>
      <p id="paragraph-9cfd2e324305d6dd4290a5f27bfe51b5">We thank the CAPES for the master’s scholarship granted to one of the authors, which partially provided financial support for this study, that is part of “Impactos da Pandemia de COVID-19 na linguagem da criança e do adulto: foco no desenvolvimento e na aprendizagem da leitura” project (Impacts of the COVID-19 Pandemic on the Language of Children and Adults: Focus on Development and Reading Learning), funded by Programa de Desenvolvimento da Pós-Graduação (PDGP) - Impactos da Pandemia (Graduate Development Program - Impacts of the Pandemic) CAPES 12/2021, and is supported by other federal institutions. At the Universidade Federal de Sergipe, the project is developed through the subproject “Linguagem e Emoções no Cenário Educacional Pós-Pandêmico: Tecnologia de Avaliação e Monitoramento: (Language and Emotions in the Post-Pandemic Educational Scenario: Assessment and Monitoring Technology), funded by FAPITEC/SE/SEDUC 09/2022.</p>
    </sec>
    <sec id="heading-c763f4c4eb094adabc7d9efb648ec446">
      <title>Additional Information</title>
      <p id="paragraph-5046c915c6f60462a0498d38ce492fdf">
        <bold id="bold-22afd31499a52d3d5d9669d29843e248">Conflict of Interest</bold>
      </p>
      <p id="paragraph-18746b7a1cece825f41026ca3d587708">The authors declare no competing interests.</p>
      <p id="paragraph-6d451414e9b55afbaeb2d6d15d0ba219">
        <bold id="bold-9670e2a23c9f858c3413c260b26b500a">Statement of Data Availability</bold>
      </p>
      <p id="paragraph-013c026d83ab3bb1cc38b85f1e0f667f">Data sharing does not apply to this article, as no new data was created or analyzed in this study.</p>
      <p id="paragraph-3df3d9ff7997de213b7e38c6f8e3e8bc">
        <bold id="bold-c06b6860212e1b8825f147888ba36a89">Funding Sources</bold>
      </p>
      <p id="paragraph-9ecd2c0de1876dbf13eb92997aed8710">This article is one of the activities developed during the master’s degree of one of the authors, which was carried out with financial support from the CAPES through a scholarship.</p>
    </sec>
    <sec id="heading-e5b79e3a65ee07b4b6f229c5cf7dc9d0">
      <title>References</title>
      <p id="paragraph-c932b4a63a2dfa15597615a9d2797eec">ABREU, Kátia Nazareth Moura de; GARCIA, Daniela Cid de; HORA, Katharine de Freitas P. N. A. da; SOUZA, Cristiane Ramos de. O teste de Cloze como instrumento de medida da proficiência em leitura: Fatores linguísticos e não linguísticos. <bold id="bold-4d557cd08e388aac6eeb45ac15f4db7f">Revista de Estudos da Linguagem</bold>, Belo Horizonte, v. 25, n. 3. p. 1767-1799, 2017.</p>
      <p id="paragraph-2e193499a5028006d3b18ac6a9151554">ALMEIDA, Luise Maria da Silva. Métodos de investigação em leitura no Brasil: o Teste <italic id="italic-21db6adc9d05c363838512b446d82dc1">Cloze</italic> e a pesquisa em compreensão leitora no Brasil. <bold id="bold-2">Universidade Federal de Santa Catarina</bold>,<bold id="bold-3"> </bold>2023. DOI<bold id="bold-4"> </bold>https://repositorio.ufsc.br/handle/123456789/250902. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-3">BICKLEY, AC; ELLINGTON, Billie J.; BICKLEY, Rachel T. The Cloze procedure: a conspectus.<bold id="bold-5"> Journal of Reading Behavior</bold>, v. 2, n. 3, p. 232-249, 1970.</p>
      <p id="paragraph-bd6ab215d3f941665f82657d2a4707f7">BORMUTH, John R. Cloze test readability: Criterion references scores. University of Chicago. <bold id="bold-6">Journal of Educational Measurement</bold>. v. 5, n. 3, 1968.</p>
      <p id="paragraph-91277f554dff701ac179b9909914f8f3">BRITO, Gabriel Rodriguez; RIBEIRO, Camila Fragoso; SEABRA, Alessandra Gotuzo. Análise da inteligibilidade dos textos narrativo e expositivo do Teste Cloze de compreensão de leitura. <bold id="bold-7">Revista de Estudos e Investigação em Psicologia e Educação</bold>, v. 9, n. 2, p. 207-225, 2022. DOI https://doi.org/10.17979/reipe.2022.9.2.9101. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-2064ebc76215a61b8996ca69b314c631">BROWN,<bold id="bold-8"> </bold>James Dean. Do Cloze Tests work? Or, is it just an illusion? <bold id="bold-9">Second language Studies</bold>, v. 21, n. 1, p. 79-125, 2002.</p>
      <p id="paragraph-fb6a5d77288bcf7d7f759b49fd89a515">BROWN, James Dean. Relative merits of four methods for scoring Cloze Tests. <bold id="bold-10">The Modern Language Journal</bold>, Autumn, v. 64, n. 3, p. 311-317, 1980.</p>
      <p id="paragraph-af920b0144088349e2e55871bf307229">CARDOSO, Paloma Batista; MENEZES, Keila Vasconcelos. In press. Adivinhando palavras. p. 63-71. <italic id="italic-18925eedadd7c7752e736329230d0a2b">In</italic>: FREITAG, Raquel; TEJADA, Julian. <bold id="bold-11">Pra ler melhor</bold>. Manuscrito submetido ao edital 08/23 SEDUC.</p>
      <p id="paragraph-5a8334ea39e16c59762eba661867cc2f">CARDOSO, Paloma Batista; MENEZES, Keila Vasconcelos; FREITAS, Flávia Oliveira; FREITAG, Raquel Meister Ko. Eficiência na leitura: medidas de precisão e velocidade entre alunos do Colégio de Aplicação da Universidade Federal de Sergipe. <bold id="bold-12">Revista Científica Sigma</bold>, v. 5, n. 5, p. 120-143, 2024. Disponível em: https://iesap.edu.br/ojs/index.php/sigma/article/view/103. Acesso em: 14 mar. 2025.</p>
      <p id="paragraph-2373942a655b9d38d3d570f2de58b4a8">COLOMBO, Renata Correia; CÁRNIO, Maria Silvia. 2018. Compreensão de leitura e vocabulário receptivo em escolares típicos do ensino fundamental I. <bold id="bold-13">CoDAS. Sociedade Brasileira de Fonoaudiologia</bold>,<bold id="bold-14"> </bold>v.<bold id="bold-15"> </bold>30, n. 4 e 201700145, 2018. DOI:10.1590/2317-1782/20182017145. </p>
      <p id="paragraph-f708f0139cbc167da9d5b2473b75e908">Conselho Federal de Psicologia. Resolução nº 002/2003. Brasília: CFP, 2003. Disponível em: http://www.pol.org.br. </p>
      <p id="paragraph-12">CUNHA, Neide de Brito; FERRAZ, Adriana Satico; SANTOS, Acácia Aparecida Angeli dos. Estudo psicométrico do questionário de avaliação da consciência metatextual. <bold id="bold-16">Avaliação Psicológica: </bold><bold id="bold-17">Avaliaçao Psicologica: Interamerican Journal of Psychological Assessment</bold>,<bold id="bold-18"> </bold>v. 20, n. 4, p. 401-409, 2021.</p>
      <p id="paragraph-13">CUNHA, Neide de Brito; LIMA, Thatiana Helena de; SANTOS, Acácia Aparecida Angeli dos; OLIVEIRA, Katya Luciane de. Teste de Cloze: evidência de validade por processo de resposta. <bold id="bold-19">Psicologia Escolar e Educacional</bold>, v. 24. 2020. DOI https://doi.org/10.1590/2175-35392020191537. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-369d41b3c0eaf0dfad84fb6c1a0f553b">CUNHA, Neide de Brito; SANTOS, Acácia Aparecida Angeli dos. Estudos de validade entre instrumentos que avaliam habilidades linguísticas. <bold id="bold-20">Estudos de Psicologia, </bold>Campinas, v. 27, N. 3, p. 305-314, 2010.</p>
      <p id="paragraph-15">CUNHA, Neide de Brito; SANTOS, Acácia Aparecida Angeli dos. Validade por processo de resposta no teste de Cloze. <bold id="bold-21">Fractal: Revista de Psicologia</bold>, v. 21, p. 549-562, 2009. DOI https://doi.org/10.1590/S1984-02922009000300010. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-592192240dca90ca86c5290ffe484862">DARNELL, Donal K. <bold id="bold-22">The development of an English language proficiency for foreign students, using a Clozentropy procedure</bold>. U.S. Department of Health, Education, and Welfare. Office Education, Bureau of Research. Presented at the Annual Convention of the Association for Education in Journalism, San Diego, August, 1968.</p>
      <p id="paragraph-38ba4e284e57936e8ff90514effdc2d3">FABRI, Nayla Beatriz; OLIVEIRA, Katya Luciane de; INÁCIO, Amanda Lays Monteiro; SCHIAVON, Andreza; BZUNECK, José Aloyseo. Autorregulação, estratégias de aprendizagem e compreensão de leitura no Ensino Fundamental I. <bold id="bold-23">Revista Brasileira de Educação</bold>, v. 27, e270068, 2022. DOI https://doi.org/10.1590/s1413-24782022270068. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-58821384ca58691446616fd2a5722a96">FREITAG, Raquel Meister Ko.; SARMENTO, Victor Hugo Vitorino; COSTA, Camila Conceição; SANTOS, Katiana Leite. Teste <italic id="italic-3">Cloze</italic> e a competência em leitura de universitários: uma experiência no curso Química/Licenciatura da UFS/Itabaiana. <bold id="bold-24">InterSciencePlace, </bold>p.<bold id="bold-25"> </bold>1-13, 2014.</p>
      <p id="paragraph-9ab20cfca328bb82ad95468e64775ef2">FREITAS, Flávia Oliveira; MENEZES, Keila Vasconcelos. Desenvolvimento e aplicação do teste cloze workshop: uma sugestão pedagógica para avaliar a proficiência em leitura dos alunos. <bold id="bold-26">Revista de Estudos de Cultura</bold>, v. 10, n. 25, p. 1–18, 2024. DOI https://doi.org/10.32748/revec.v10i25.21467. Acesso em: 13 mar. 2025.</p>
      <p id="paragraph-f2cbbb29538cef6991ab9eec0bfa8793">GALVÃO, Maria Cristiane Barbosa; RICARTE, Ivan Luiz Marques. Revisão sistemática da literatura: conceituação, produção e publicação. <bold id="bold-27">Logeion:</bold> <bold id="bold-28">Filosofia da informação</bold>, v. 6, n. 1, p. 57–73, 2019. DOI https://doi.org/10.21728/logeion.2019v6n1.p57-73. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-baa862921fa0f040e4be5e70dfa07364">GOIS, Túlio Sousa; FREITAS, Flávia Oliveira; TEJADA; Julian; FREITAG, Raquel Meister Ko. NLP and education: using semantic similarity to evaluate filled gaps in a large-scale cloze test in the classroom. <bold id="bold-29">The Mental Lexicon</bold>, 2025. DOI https://doi.org/10.1075/ml.24027.deg. Acesso em: 14 mar. 2025.</p>
      <p id="paragraph-c818f9947118185b2ac8ffd9c385f595">JOLY, Maria Cristina Rodrigues Azevedo; ISTOME, Aline Christina. Compreensão em leitura e capacidade cognitiva: estudo de validade do Teste Cloze Básico-MAR. <bold id="bold-30">Psic: Revista da Vetor Editora</bold>, v. 9, n. 2, p. 219-228, 2008.</p>
      <p id="paragraph-1e88b97ef2c5ab1d8bdc5b773abb34bf">JOLY, Maria Cristina Rodrigues Azevedo. Programa Informatizado de Leitura Estratégica (PILE) – <bold id="bold-31">Pesquisa em desenvolvimento.</bold> Itatiba, SP: Universidade São Francisco, 2008.</p>
      <p id="paragraph-4e63d35b43730cf8357d4bf45aaacf42">JOLY, Maria Cristina Rodrigues Azevedo; PIOVEZAN, Nayane Martoni. Avaliação do Programa Informatizado de Leitura Estratégia para Estudantes do Ensino Fundamental. <bold id="bold-32">Paideia</bold>, v. 22, n. 51, p. 83-90, 2012.</p>
      <p id="paragraph-25">MORAIS, José. <bold id="bold-33">A arte de ler</bold>. Tradução: Álvaro Lorencini. São Paulo: Editora da Universidade Estadual Paulista, 1996.</p>
      <p id="paragraph-01125cf5a6721a727163f523bd5d8c68">MORAIS, José; KOLINSKY, Régine. Psicolinguística e leitura. <italic id="italic-4">In</italic>: MAIA, Marcus. <bold id="bold-34">Psicolinguística, psicolinguísticas</bold>: uma introdução. São Paulo: Contexto, 2015, p. 86-93</p>
      <p id="paragraph-8193020c8385b4b7e1c81ef47f87e799">MOTA, Márcia Maria Peruzzi Elia da; SANTOS, Acácia Aparecida Angeli dos. O Cloze como instrumento de avaliação de leitura nas séries iniciais. <bold id="bold-35">Revista quadrimestral da Associação Brasileira de Psicologia Escolar e Educacional</bold>, São Paulo, v. 18, n. 1, p. 135-142, 2014.</p>
      <p id="paragraph-28">MOTA, Márcia Maria Peruzzi Elia da; SANTOS, Acácia Aparecida Angeli dos. O papel da consciência fonológica na leitura contextual medida pelo teste de Cloze. <bold id="bold-36">Estudos de psicologia</bold>, v. 14, n. 3, p. 207-212, 2009. DOI https://doi.org/10.1590/S1413-294X2009000300004 Acesso em 12 mar. 2025.</p>
      <p id="paragraph-55bce273618628787035643342adec75">MOTA, Márcia Maria Peruzzi Elia da; VIEIRA, Marcel de Toledo; BASTOS, Ronaldo Rocha; DIAS, Jaqueline; PAIVA, Nádia; MANSUR-LISBOA, Stella; ANDRADE-SILVA, Danielle. Leitura contextual e processamento metalinguístico no português do Brasil: um estudo longitudinal. <bold id="bold-37">Psicologia: Reflexão e Crítica</bold>, v. 25, n. 1, 2012. DOI https://doi.org/10.1590/S0102-79722012000100014. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-8c3db0714963b1959cd8407c0b14a66d">MOTA, Márcia Maria Peruzzi Elia da; LISBOA, Rafaela; DIAS, Jaqueline; GONTIJO, Rhaisa; PAIVA, Nádia; MANSUR-LISBOA, Stella; SILVA, Danielle Andrade; SANTOS, Acácia Aparecida Angeli dos. Relação entre consciência morfológica e leitura contextual medida pelo Teste Cloze. <bold id="bold-38">Psicologia: Reflexão e Crítica</bold>, v. 22, n. 2, p. 223-229, 2009. DOI https://doi.org/10.1590/S0102-79722009000200008. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-d6f76e12d2949857c0552234ad982b1e">OLLER, John W. Jr.; CONRAD, Christine A. The Cloze technique and ESL proficiency. <bold id="bold-39">Language Learning</bold> , v. 21, n. 2, p. 183-194, 1971. DOI https://doi.org/10.1111/j.1467-1770.1971.tb00057.x. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-843a1730b20af4021a88635f02aa55e8">PETRONI, Filippo; SERVA, Maurizio. Measures of lexical distance between languages. <bold id="bold-40">Physica A: Statistical Mechanics and its Applications,</bold> v. 389, n. 11, p. 2280-2283, 2010. DOI https://doi.org/10.1016/j.physa.2010.02.004. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-33">POLYDORO, S. A. J; ROSÁRIO, P.; SAMPAIO, R. K. N.; FEITAS, F. A. de. Sucesso no ensino superior e variáveis envolvidas. <italic id="italic-5">In</italic>: <bold id="bold-41">Congresso Nacional de Psicologia Escolar e Educacional</bold>: caminhos trilhados, caminhos a percorrer, 2011.</p>
      <p id="paragraph-7e63938ccb2faeaba82a04222af4f77a">SANTOS, Gislane Evangelista dos; MACHADO, Alessandra Pereira Gomes. Fluência em leitura oral como avaliação diagnóstica de leitura de estudantes do 6º ano. <bold id="bold-42">Língu@ Nostr@</bold>, v. 10, n. 2, p. 148-163, 2022. DOI https://doi.org/10.29327/232521.9.1-25. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-58948aa1f1839615052a0785d771a732">SANTOS, Gislane Evangelista dos. <bold id="bold-43">O preenchimento de lacunas de aspecto verbal em teste cloze: pistas de compreensão em leitura</bold>. 2025.<bold id="bold-44"> </bold>Dissertação (Mestrado em Estudos Linguísticos) – Universidade Federal de Sergipe, Sergipe, 2025.</p>
      <p id="paragraph-36">SANTOS, Acácia Aparecida Angeli dos; MORAES, Mayara Salgado de; LIMA, Thatiana Helena. Compreensão de leitura e motivação para aprendizagem de alunos do ensino fundamental. <bold id="bold-45">Psicologia Escolar e Educacional</bold>, São Paulo, v. 22, n. 1, p. 93-101, 2018. DOI https://doi.org/10.1590/2175-35392018012208. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-1190ac3995145292e928d688dbc321bf">SANTOS, Acácia Aparecida Angeli dos; FERNANDES, Eliane Sousa de Oliveira. Habilidade de escrita e compreensão de leitura como preditores de desempenho escolar. <bold id="bold-46">Psicologia Escolar e Educacional</bold>, São Paulo, v. 20, n. 3, p. 465-473, 2016. DOI https://doi.org/10.1590/2175-3539201502031013. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-eb9927adf4acc1153567d4c6b61f6882">SANTOS, Acácia Aparecida Angeli dos; OLIVEIRA, Evelin Zago de. Avaliação e desenvolvimento da compreensão em leitura no ensino fundamental. <bold id="bold-47">Psico-USF,</bold> v. 15, n.1, p. 81-91, 2010. DOI https://doi.org/10.1590/S1413-82712010000100009. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-39">SANTOS, Acácia Aparecida Angeli dos; SUEHIRO, Adriana Cristina Boulhoça; VENDEMIATTO, Bianca Carolina. Inteligencia y comprensión en lectura de adolescentes en situación de riesgo social. <bold id="bold-48">Paradigma</bold>, v. 30, n. 2, p. 113-12, 2009.</p>
      <p id="paragraph-40">SISTO, F. F.; SANTOS, A. A. A.; NORONHA, A. P. P. <bold id="bold-49">R1: Teste não verbal de avaliação da inteligência Forma B –</bold> <bold id="bold-50">Manual.</bold> São Paulo: Vetor Editora Psicopedagógica Ltda, 2004.</p>
      <p id="paragraph-35fac7c66eac3a2123a96f532baf5a99">SISTO, F. F. Escala de Avaliação da Escrita (EAVE). <bold id="bold-51">Relatório Técnico</bold>, Universidade São Francisco, Itatiba-SP, 2005.</p>
      <p id="paragraph-1e934df08f8df0f5416817ac9e5bdab5">STEIN, L. M. TDE - Teste de Desempenho Escolar: manual para aplicação e interpretação. São Paulo: <bold id="bold-52">Casa do Psicólogo</bold>, 1994.</p>
      <p id="paragraph-cbd42c13d528ef712d6ffcb0f303cb15">SUEHIRO, Adriana Cristina Boulhoça; SANTOS, Acácia Aparecida Angeli dos. Compreensão de leitura e consciência fonológica: evidências de validade de suas medidas. <bold id="bold-53">Estudos de Psicologia</bold>. Campinas, v. 32, n. 2, p. 201-211, 2015. DOI https://doi.org/10.1590/0103-166X2015000200005. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-44">SUEHIRO, Adriana Cristina Boulhoça; MAGALHÃES, Marilene Moreira da Silva. Relação entre medidas de avaliação da linguagem escrita em estudantes do Ensino Fundamental. <bold id="bold-54">Psico-USF</bold>, Bragança Paulista, v. 19, n. 3, p. 489-498, 2014. DOI https://doi.org/10.1590/1413-8271201401900301. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-d85443c0382eab21c7f77e3f6f10bbe5">TAYLOR, Wilson L. Cloze procedure: a new tool for measuring readability. <bold id="bold-55">Journalism quarterly</bold>, v. 30, n. 4, p. 415-433, 1953. DOI https://doi.org/10.1177/107769905303000401. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-46">TRASSI, Angélica Polvani; OLIVEIRA, Katya Luciane de; INÁCIO, Amanda Lays Monteiro. Reading comprehension, learning strategies, and verbal reasoning: Possible relationships. <bold id="bold-56">Psico-USF</bold>, Bragança Paulista, v. 24, n. 4, p. 615-624, 2019. DOI https://doi.org/10.1590/1413-82712019240401. Acesso em: 12 mar. 2025.</p>
      <p id="paragraph-47">WECHSLER, D. WISC-III: Escala de inteligência Weschsler para crianças. São Paulo: <bold id="bold-57">Casa do Psicólogo</bold>, 1991.</p>
    </sec>
    <sec id="heading-adbb44a394ed4f75448c0cb961062ba6">
      <title>Review</title>
      <p id="paragraph-2d88b04a48645259345c0f36e1f61624"><bold id="bold-ae9c730acda03a75386070ae3ea9e63f">DOI: </bold>https://doi.org/10.25189/2675-4916.2025.V6.N2.ID787.R</p>
      <sec id="heading-3d5b29b7dc7a9e85ea0de3c70f08a2d3">
        <title>Editorial Decision </title>
        <p id="paragraph-44db908d95b785bef0b1f7f0dfe19747">EDITOR 1: Tan Arda Gedik</p>
        <p id="paragraph-2">ORCID: https://orcid.org/0000-0003-1429-9675</p>
        <p id="paragraph-5">AFFILIATION: Friedrich-Alexander-Universität, Baviera, Alemanha.</p>
        <p id="paragraph-6">-</p>
        <p id="paragraph-b3d9081d411d01c67b16004a14229058">EDITOR 2: Leonarda Prela</p>
        <p id="paragraph-a428d2583efd74d25a145b1a4c7c4403">ORCID: https://orcid.org/</p>
        <p id="paragraph-9">AFFILIATION: Friedrich-Alexander-Universität, Baviera, Alemanha.</p>
        <p id="paragraph-10">-</p>
        <p id="paragraph-5e4e13a21cd6e77ff20c17e5b0c170c8">EDITOR 3: Vania De la Garza</p>
        <p id="paragraph-4ab5698ea97d29d661447f3c561e8e0b">ORCID: https://orcid.org/</p>
        <p id="paragraph-f548fc0ba39bd68d1f43537fdd222c8c">AFFILIATION: Friedrich-Alexander-Universität, Baviera, Alemanha.</p>
        <p id="paragraph-5383f7e51d4efc74148a11ebed884032">-</p>
        <p id="paragraph-11">DECISION LETTER: The manuscript <italic id="italic-e947874ff0c148334ed6883c30c14068">The use of the cloze test in reading comprehension assessment in Brazil: post-pandemic challenges</italic> by Flávia Oliveira Freitas and colleagues systematically reviews studies published across three virtual databases that applied the traditional cloze test to assess reading comprehension. The study highlighted the cloze test’s sensitivity in capturing reading and writing skills, making it a valuable indicator of overall academic performance. This research aligns closely with the special issue <italic id="italic-7f22c31dd1f315ab4a18541aaa98c19f">Beyond Letters: Perspectives on the Effects of Illiteracy from Linguistics and Beyond</italic>, as it analyses the cloze test as a reading assessment. The study also emphasizes that it is essential to incorporate natural language processing techniques, such as lexical distance measurements. The latter can provide a more nuanced understanding of comprehension, especially in contexts with low reading proficiency. Tthe manuscript contributes to discussions on the assessing of reading comprehension through the cloze test. The study also points out that most of the research on cloze test has been produced in the field of psychology, promoting the possibility of collaboration between teachers, linguists, psychologists, and other professionals to research the development and application of these tests. </p>
      </sec>
      <sec id="heading-6f130cd190ada3d814515fcba305fc69">
        <title>Rounds of Review </title>
        <p id="paragraph-14">REVIEWER 1: Richenda Wright</p>
        <p id="paragraph-16">ORCID: http://orcid.org/</p>
        <p id="paragraph-17">AFFILIATION: Friedrich-Alexander-Universität, Baviera, Alemanha.</p>
        <p id="paragraph-18">-</p>
        <p id="paragraph-19">REVIEWER 2: Kátia Nazareth Moura de Abreu</p>
        <p id="paragraph-20">ORCID: https://orcid.org/0000-0002-8505-4512</p>
        <p id="paragraph-21">AFFILIATION: Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brasil.</p>
        <p id="paragraph-22">-</p>
        <p id="paragraph-23">
          <bold id="bold-fa3238c3f10b3c515a6f3925169a79fa">ROUND 1 </bold>
        </p>
        <p id="paragraph-24">REVIEWER 1 </p>
        <p id="paragraph-26">2024-07-29 | 04:41 PM</p>
        <list list-type="order" id="list-1">
          <list-item>
            <p>Assessment</p>
          </list-item>
        </list>
        <p id="paragraph-1">The manuscript aimed to investigate which of the scoring methods available for cloze tests is most valid and often used in research in Brazil with elementary school children. The manuscript would be of interest to teachers (both native and foreign languages) who routinely make use of cloze tests, along with psychologists, linguists, and researchers from other related fields.</p>
        <p id="paragraph-987fd0c76c1c3aa0f5a0af9423338e0e">The authors found that the most frequent way to score cloze tests is by only accepting answers that are an exact match to the source text. Beyond frequency in published studies, the validity or reliability of the scoring methods was not analysed in a systematic way and, thus, cannot be accurately judged. Comments on issues in individual articles and how cloze test performance relates to other linguistic skills are given. They also provide information about the geographic location and populations were this tool is most often used in research. This provides information about populations who have not yet been involved in research and could do so in the future. The authors briefly discuss problems with using the exact answer scoring method but did not undertake a more in-depth analysis to support a discussion of these problems and possible solutions based on the current literature.</p>
        <p id="paragraph-dec9d6f101e3eaa781f90361fce7217f">Overall, the paper provides a good overview of the current situation in measuring reading and reading-related skills using cloze tests in their specific context.</p>
        <list list-type="order" id="list-2">
          <list-item>
            <p>Public Review</p>
          </list-item>
        </list>
        <list list-type="bullet" id="list-3">
          <list-item>
            <p>Summary of the authors' objectives.</p>
          </list-item>
        </list>
        <p id="paragraph-47abd13efc68ae0b64052451f5be6fd9">The authors aimed to summarise the current state and validity of the procedures used to evaluate responses in cloze tests or gap texts in the Brazilian context. Children in primary education were the target population in the literature review.</p>
        <list list-type="bullet" id="list-4">
          <list-item>
            <p>Evaluation of the major strengths and weaknesses of the methods and results.</p>
          </list-item>
        </list>
        <p id="paragraph-d78acb9ec1668e13f3c180b4c3761fea">The methods attempted to get a good overview of the use of cloze tests in the target population by consulting three different databases. It is, however, not clear how the databases were chosen. The method section contains ambiguity about which search terms in which languages formed part of the final search. A total of 144 hits are described in the search term section, but only 42 are said to be part of the initial corpus of pre-exclusion articles. This forms part of general comments on the clarity of the writing across the paper. The authors followed PRISMA guidelines in conducting the review. Including additional information from the PRISMA checklist (e.g. comments on robustness or reliability) in the review would strengthen the findings from the paper.</p>
        <list list-type="bullet" id="list-5">
          <list-item>
            <p>Assessment of whether the authors achieved their goals and if the results support their conclusions.</p>
          </list-item>
        </list>
        <p id="paragraph-7">The authors provided a comprehensive summary of the way in which cloze tests are scored when used in studies with Brazilian primary school children and the validity of the methods. It is, however, difficult to interpret whether the most frequently-used measure is the best as there are no comments on the reliability of the measures themselves (test-retest or internal reliability such as split-half) or of the extent to which the cloze test predicts the outcomes they assume to measure (e.g. reading comprehension, morphological awareness etc.). </p>
        <p id="paragraph-8">The authors did succeed in providing a summary of the current state of research in their chosen domain. They gave a good overview of the research fields that commonly use cloze tests, how they are most often scored, and the most frequently-included populations and geographical locations.</p>
        <list list-type="bullet" id="list-6">
          <list-item>
            <p>Discussion of the anticipated impact of the work on the field and the utility of the methods and data for the community.</p>
          </list-item>
        </list>
        <p id="paragraph-ee6f3976f8d57a5b9bdf557ae6f43312">It is important to investigate widely-used assessment measures, such as cloze tests in novel settings to ensure their validity in different contexts. Providing a clear overview of the use of such tools and the methods used to score them guides future research and practice in several domains, including education, psychology, and linguistics.</p>
        <p id="paragraph-d39f165f92f0c369b6827868afc08ad2">The current results provide an overview of the current state of use in terms of scoring method, geographic location, and population. They also provide practical suggestions for overcoming some of the issues with the most frequently used scoring method. The insight into possible uses of natural language processing techniques shows future-oriented thinking. The paper, thus, provides a starting point for future research with this assessment tool in the Brazilian context into investigating the validity and reliability of the tools, a systematic analysis of how the outcomes relate to or, possibly, predict other linguistic outcomes, and better scoring methods using technology.</p>
        <list list-type="bullet" id="list-7">
          <list-item>
            <p>Any additional context you believe would aid readers in interpreting or understanding the significance of the work.</p>
          </list-item>
        </list>
        <p id="paragraph-05c2283e3d01b07d24620adfb3a117f7">The results are mostly qualitative in nature and should be interpreted as a general comment on the current state of research and not a quantitative analysis upon which to base the recommendation to use specific scoring methods for cloze tests or their general validity or reliability.</p>
        <p id="paragraph-2c43e07f8faa252c4666321d540b64da">Given the public nature of these reviews, they should:</p>
        <list list-type="order" id="list-8">
          <list-item>
            <p>Recommendations for the authors</p>
          </list-item>
        </list>
        <list list-type="bullet" id="list-9">
          <list-item>
            <p>Suggestions for enhancing or adding experiments, data, or analyses, especially if they can enhance the impact of the work.</p>
          </list-item>
        </list>
        <p id="paragraph-17bc83a4be810c6d00492db86f27f3d8">Your current analysis, in effect, can only comment in how frequently a specific scoring method is used. You are not able to systematically answer the question about how valid cloze tests themselves or the different scoring methods are.</p>
        <p id="paragraph-300bc2233ed4c5bf21b4c2b959c39372">I would propose two additional analyses that would strengthen your paper.</p>
        <list list-type="order" id="list-10">
          <list-item>
            <p>The first is an analysis of the reliability of the measure in each of the included papers. This can be inter-rater reliability, test-retest reliability in the cases where you have a pre-and post-assessment, or split-half reliability. As this is not very often reported, it is an important conclusion to draw at the end of your own paper that this is an aspect that needs further investigation in future research.</p>
          </list-item>
          <list-item>
            <p>The practical application of cloze tests in predicting other language outcomes. There are several themes that repeat in your included literature (e.g. reading comprehension, phonological awareness). You discuss some findings, but reporting the correlations between these measures systematically or, even better, significance in predicting other linguistic outcomes where regression analyses were done, would also provide valuable insight into how results from cloze tests can be interpreted and applied.</p>
          </list-item>
        </list>
        <p id="paragraph-be095539cbba0da50e0d7016cd94ba21">It would be beneficial if the results from the review (e.g. in spreadsheet format) were made available publically.</p>
        <list list-type="bullet" id="list-11">
          <list-item>
            <p>Recommendations for improving the writing and presentation.</p>
          </list-item>
        </list>
        <p id="paragraph-428bd54f96b23ed54017f92fc748d714">Initial suggestions for changes to the paper were made by means of comments. I would strongly suggest having the manuscript professionally proofread and corrected before resubmission. The language used is often unclear or redundant and takes away from the overall importance of the research,  as does the punctuation.</p>
        <p id="paragraph-cf1e3f0812881f069d7db503e562741a">The authors are also advised to carefully review their in-text referencing style. The placement of references obscures which information comes from the source in some cases. There are also several missing in-text references.</p>
        <p id="paragraph-29">-</p>
        <p id="paragraph-30">REVIEWER 2</p>
        <p id="paragraph-31">2025-01-25 | 06:58 PM</p>
        <p id="paragraph-32">O artigo apresenta um tema de relevância, com contribuição significativa para o campo das ciências humanas e sociais, especialmente, para os estudos da área da Linguagem e da Educação. A temática da avaliação da compreensão leitora tem sido discutida, porém a revisão sistemática, por ora apresentada, aponta para a importância de os estudos linguísticos se voltarem para essa questão, pois poderiam trazer contribuições originais e específicas sobre níveis de linguagem envolvidos nesse processo de compreensão, capazes de informar os professores da educação básica acerca da complexidade presente em uma atividade de avaliação de leitura.</p>
        <p id="paragraph-34">-</p>
        <p id="paragraph-35">
          <bold id="bold-64a51e8d827497cb8b32fad3a3cd358c">ROUND 2 </bold>
        </p>
        <p id="paragraph-37">REVIEWER 1 </p>
        <p id="paragraph-38">2025-02-03 | 08:30 AM</p>
        <p id="paragraph-aaa13887bdd85ceafd1f033223f9b9ce">The manuscript aimed to investigate which of the scoring methods available for cloze tests is most valid and often used in research in Brazil with elementary school children. The manuscript would be of interest to teachers (both native and foreign languages) who routinely make use of cloze tests, along with psychologists, linguists, and researchers from other related fields.The authors report on the most frequent method of scoring cloze tests – the exact answer. They report on the reliability of the method and the relationship that cloze test results have with other measures. In addition to the population and geographic location of the included studies, they comment on the fields of research that make use of the test. Geographic location provides important information about understudied populations. Overall, the paper provides a good overview of the current situation in measuring reading and reading-related skills using cloze tests in their specific context and how test results relate to performance in reading and other academic skills. </p>
      </sec>
    </sec>
  </body><back/></article>
