Academic literature on the topic 'Theory of response to item (TRI)'

Dynamic testing, with an intermediate phase of assistance, measures changes between pretest and post-test assuming a common metric between them. To test this assumption we applied the Item Response Theory in the responses of 69 children to dynamic cognitive testing Children's Analogical Thinking Modifiability Test adapted, with 12 items, totaling 828 responses, with the purpose of verifying if the original scale yields the same results as the equalized scale obtained by Item Response Theory in terms of "changes quantifying". We followed the steps: 1) anchorage of the pre and post-test items through a cognitive analysis, finding 3 common items; 2) estimation of the items' difficulty level parameter and comparison of those; 3) equalization of the items and estimation of "thetas"; 4) comparison of the scales. The Children's Analogical Thinking Modifiability Test metric was similar to that estimated by the TRI, but it is necessary to differentiate the pre and post-test items' difficulty, adjusting it to samples with high and low performance.

Resumo O texto aborda a relevância da atividade de análise métrica das questões ou dos itens componentes de testes de rendimento, enquanto procedimento essencial ao feedback que se deve proporcionar aos elaboradores das mesmas. Nesse âmbito, o objetivo do ensaio foi comparar os efeitos das características métricas dos itens sobre a estimativa do nível de habilidade do aluno (θ), utilizando-se, para tal, o modelo de três parâmetros logísticos da Teoria da Resposta ao Item (TRI). Este trabalho mostra uma das inúmeras possibilidades resultantes do uso da TRI: análises estatísticas pertinentes para aferir se o instrumento e os itens ou questões que o compõem cumpriram suas funções pedagógicas, isto é, se estimaram de modo válido e confiável o aprendizado dos discentes. Palavras chave: avaliação educacional; avaliação da aprendizagem; Teoria da Resposta ao Item (TRI); testes de rendimento. Metric analysis of assessment test components: feedback mechanisms to improve design Abstract This paper overviews the relevance of item metric analysis of assessment tests as an essential feedback procedure which should be provided to those who design them. The essay intends to compare the effects of the item metric characteristics over the estimated skill level of students (θ), using the three logistic parameters of the Item Response Theory (IRT). This work shows one of the many possibilities resulting from the use of the IRT: relevant statistical analysis to verify whether or not the tool and its items meet the expected pedagogical functions, i.e.: if they can validly and reliably estimate the learning of students. Key words: Educational Assessment; Learning Assessment; Item Response Theory (IRT); Performance Tests.

The National High School Examination (ENEM) gains each year more importance, as it gradually, replacing traditional vestibular. Many simulations are done almost randomly by teachers or systems, with questions chosen without discretion. With this methodology, if a test needs to be reapplied, it is not possible to recreate it with questions that have the same difficulty as those used in the first evaluation. In this context, the present work presents the development of an ENEM Intelligent Simulation Generation System that calculates the parameters of Item Response Theory (TRI) of questions that have already been applied in ENEM and, based on them, classifies them. in groups of difficulty, thus enabling the generation of balanced tests. For this, the K-means algorithm was used to group the questions into three difficulty groups: easy, medium and difficult. To verify the functioning of the system, a simulation with 180 questions was generated along the ENEM model. It could be seen that in 37.7% of cases this happened. This hit rate was not greater because the algorithm confounded the difficulty of issues that are in close classes. However, the system has a hit rate of 92.8% in the classification of questions that are in distant groups.

<p>Este artigo aborda os mais importantes aspectos inferenciais do Modelo de Crédito Parcial Generalizado (MCPG), da Teoria da Resposta ao Item (TRI). É mostrado um estudo sobre uma das principais dificuldades encontradas no processo de estimação e inferência dos modelos da TRI, que é a falta de identificabilidade. Além disso, apresenta-se a interpretação dos parâmetros do modelo e da função de informação do item e do teste.</p><p><strong>Palavras-chave:</strong> Teoria da Resposta ao Item; Modelos Politômicos; Modelo de Crédito Parcial Generalizado; Psicometria.</p><p> </p><p><strong>Contribuciones al estudio del Modelo de Crédito Parcial Generalizado</strong></p><p>Este artículo aborda los más importantes aspectos inferenciales del Modelo de Crédito Parcial Generalizado (MCPG), de la Teoría de la Respuesta al Ítem (TRI). Se presenta un estudio sobre una de las principales dificultades encontradas en el proceso de estimación e inferencia de los modelos de la TRI, que es la falta de identificabilidad. Por otra parte, se expone la interpretación de los parámetros del modelo y de la función de información del ítem y el test.</p><p><strong>Palabras clave:</strong> Teoría de la Respuesta al Ítem; Modelos Politómicos; Modelo de Crédito Parcial Generalizado; Psicometría.</p><p> </p><p><strong>Contributions to the study of Generalized Partial Credit Model</strong></p><p>This article covers the most important inferential aspects of the Generalized Partial Credit Model (GPCM) of the Item Response Theory (IRT). It presents a study on one of the main difficulties encountered in the process of estimation and inference of the IRT models, which is the lack of identifiability. In addition, it presents the interpretation of the model parameters and the information function of the item and the test.</p><p><strong>Keywords:</strong> Item Response Theory; Polytomous Models; Generalized Partial Credit Model; Psychometrics.</p>

Flood disaster is the commonest natural disaster with huge impact on healthcare services in Malaysia. The FloodDMQ-BM© questionnaire was developed as a tool to assess the knowledge, attitude, and practice of healthcare providers regarding patient management during a flood disaster. We aim to further validate the FloodDMQ-BM© questionnaire by using Confirmatory Factor Analysis (CFA) and Item Response Theory (IRT).This cross-sectional study involved doctors, nurses and paramedics working in the Emergency Department of Hospital Universiti Sains Malaysia, Hospital Raja Perempuan Zainab II and Hospital Kuala Krai. Respondents were required to complete the FloodDMQ-BM© questionnaire. The responses were analysed by using CFA and IRT to establish its validity and reliability. A total of 215 respondents participated in this study. CFA analysis with Maximum Likelihood Robust as the estimation method, on the attitude and practice components resulted in good factor loadings (>0.5) in nearly all items and excellent model fit indices values (CFI = 0.96-0.98, TLI = 0.95-0.96, SRMR = 0.04-0.05, RMSEA = 0.07). Meanwhile, IRT analysis on the knowledge section showed a good two-way marginal fit based on S-X2, and a good model fit with RMSEA of 0.08. Based on the 2PL model by using the IRT assessment of the knowledge section, one item in the knowledge section (K3) was removed (chi-squared residual >4) resulting in improved model fit. The included items had well-standardized loadings (>0.3) and marginal reliability of 0. 651.Our results confirmed that the FloodDMQ-BM© questionnaire displayed valid and reliable psychometric properties.

RESUMOObjetivo: analisar a utilização da Teoria da Resposta ao Item (TRI) nas pesquisas em saúde pública. Método: revisão integrativa, sem delimitação temporal, nas bases de dados LILACS, SCOPUS, MEDLINE/PUBMED e na biblioteca virtual SCIELO. Adotaram-se as etapas de leitura, contagem de ocorrência de características das publicações e organização em categorias temáticas no processo de análise. Resultados: 56 estudos atenderam aos critérios de inclusão que buscaram avaliar a validade e a confiabilidade de instrumentos de mensuração e realizar ajustes psicométricos. Destacaram-se, como traços latentes mais avaliados, a qualidade de vida, a saúde de idosos e o letramento em saúde. Conclusão: evidenciam-se as possibilidades de utilização da TRI para a avaliação de uma diversidade de traços antes relacionados à saúde pública ao permitir a transformação de resultados subjetivos em probabilidades. O desenvolvimento de novos instrumentos pode considerar a avaliação de traços latentes relevantes para a saúde pública, como a integralidade da assistência na atenção básica, o vínculo do usuário aos serviços de saúde e perspectivas sobre vulnerabilidades, contribuindo para o avanço do conhecimento científico. Descritores: Métodos e Procedimentos Estatísticos; Inquéritos e Questionários; Análise Quantitativa; Saúde Pública; Enfermagem; Avaliação em Enfermagem.ABSTRACTObjective: to analyze the use of Item Response Theory (IRT) in public health research. Method: integrative review, without temporal delimitation, in the databases LILACS, SCOPUS, MEDLINE / PUBMED and in the SCIELO virtual library. We adopted the steps of reading, counting of occurrence of characteristics of the publications and organization in thematic categories in the process of analysis. Results:56 studies met the inclusion criteria that sought to evaluate the validity and reliability of measurement instruments and to make psychometric adjustments. The quality of life, the health of the elderly and the health literacy were highlighted as more evaluated latent traits. Conclusion: the possibilities of using IRT for the evaluation of a diversity of traits previously related to public health are evidenced by allowing the transformation of subjective results into probabilities. The development of new instruments may consider the evaluation of latent traits relevant to public health, such as the integrality of care in basic care, the user's link to health services and perspectives on vulnerabilities, contributing to the advancement of scientific knowledge. Descriptors: Statistical Methods and Procedures; Surveys and Questionnaires; Quantitative Analysis; Public Health; Nursing; Nursing Assessment.RESUMENObjetivo: analizar la utilización de la Teoría de la Respuesta al Ítem (TRI) en las investigaciones en salud pública. Método: revisión integrativa, sin delimitación temporal, en las bases de datos LILACS, SCOPUS, MEDLINE / PUBMED y en la biblioteca virtual SCIELO. Se adoptaron las etapas de lectura, conteo de ocurrencia de características de las publicaciones y organización en categorías temáticas en el proceso de análisis. Resultados: 56 estudios atendieron a los criterios de inclusión, que buscaron evaluar la validez y la confiabilidad de instrumentos de medición y realizar ajustes psicométricos. Se destacaron como rasgos latentes más evaluados, la calidad de vida, la salud de ancianos y el letramiento en salud. Conclusión: se evidencian las posibilidades de utilización de la TRI para la evaluación de una diversidad de rasgos latentes relacionados a la salud pública, al permitir la transformación de resultados subjetivos en probabilidades. El desarrollo de nuevos instrumentos puede considerar la evaluación de rasgos latentes relevantes para la salud pública, como la integralidad de la asistencia en la atención básica, el vínculo del usuario a los servicios de salud y perspectivas sobre vulnerabilidades, contribuyendo al avance del conocimiento científico. Descriptores: Métodos y Procedimientos Estadísticos; Encuestas y Questionarios; Análisis Cuantitativo; Salud Pública; Enfermería; Evaluación em Enfermería.