Academic literature on the topic 'Samejima model'

Two multiple category item response theory models are compared using a data set of 52 mood terms with 713 subjects. Tellegen’s (1985) model of mood with two independent, unipolar dimensions of positive and negative affect provided a theoretical basis for the assumption of unidimensionality. Principle components analysis and item parameter tests supported the unidimensionality assumption. Comparative model data fit for the Samejima (1969) logistic model for graded responses and the Masters (1982) partial credit model favored the former model for this particular data set. Theoretical and practical aspects of the comparative application of multiple category models in the measurement of subjective well-being or mood are discussed.

The 3-parameter logistic model is commonly used to describe the relationship among an unobserved latent trait (ability), unobserved item properties, and an observed binary outcome. We show that for certain values of the item properties and latent ability, the observed information about ability contained in the binary response is negative. This result has implications for maximization procedures, such as Newton-Raphson; approximate sampling methods, such as the Metropolis-Hastings algorithm; and Bayesian adaptive testing. All of these typically utilize the observed information. This result is contrasted with the fact that observed negative information does not occur in the limiting case with no guessing (2-parameter logistic model). The probability of negative information is expressed by a simple formula. This research extends the work of Samejima (1973) and Yen, Burket, and Sykes (1991).

An extension of the graded response model of Samejima (1969) for the measurement of variability and change is presented. In this model it is assumed that an occasion-specific latent variable is decomposed into (a) a person-specific variable (a trait variable) and (b) an occasion-specific deviation variable measuring the variability caused by situational and/or interactional effects. Furthermore, it is assumed that interindividual differences in intraindividual trait change occur between a priori specified periods of time. The correlations of the latent trait variables between periods of time indicate the degree of (trait) change. It is shown how the parameters of the model can be estimated and some implications of the model can be tested with structural equation models for ordered variables. Finally, the model is illustrated by an application to the measurement of students’ interest in the topic of radioactivity. Based on the results of a longitudinal study of students over 4’years, it is shown that a model considering two periods of time—one before and one after the incident in Chernobyl—fits well. According to the accepted model, it can be concluded that 30% to 60% of the variance of interest in radioactivity on an occasion of measurement are due to situational and/or interactional effects. The autocorrelations of the latent trait variables between both periods of time (r = .72 and r = .76, respectively) indicate that there are interindividual differences in intraindividual changes on the level of the latent trait variables.

Škála reziliencie (Wagnild, Young, 1993) patrí v súčasnosti medzi najčastejšie používané metódy na skúmanie reziliencie ako osobnostnej črty. Výsledky výskumov poukazujú na veľmi dobré psychometrické charakteristiky škály. Cronbachovo α sa pohybuje od .72 do .94. Výsledky zahraničných aj lokálnych výskumov potvrdzujú dobrú konštruktovú validitu škály. Pôvodná verzia obsahuje 25 položiek. Autori vytvorili aj skrátenú verziu, ktorá pozostáva zo 14 položiek. Cieľom výskumu bolo overiť psychometrické vlastnosti skrátenej verzie škály. Výskumný súbor tvorilo 609 uchádzačov o štúdium na Katedre psychológie na FiF UK, ktorí vyplnili kompletnú 25 položkovú verziu. Pri analýze sme porovnávali psychometrické ukazovatele klasickej teórie testov a taktiež sme pri analýzach aplikovali aj Teóriu odpovede na položku (IRT). Na odhad parametrov položiek sme použili Samejimovej model. Priemerná bodovo-biseriálna korelácia skrátenej verzie škály bola r = .513. Odhad úrovne reziliencie (prostredníctvom IRT) zo skrátenej verzie škály bol takmer identický ako pri použití 25 položkovej verzie (R2 = .932). Obidve verzie škály merajú dostatočne presne na pomerne širokom intervale úrovne reziliencie a prinášajú najviac informácií o ľuďoch s podpriemernou až priemernou úrovňou reziliencie. Pôvodná 25 položková verzia meria trochu presnejšie, čo je spôsobené väčším počtom položiek. Z výsledkov vyplýva, že skrátená verzia Škály reziliencie je vhodný a dostatočne reliabilný nástroj, ktorý je časovo menej náročný ako pôvodná plná verzia Škály reziliencie. Resilience Scale (Wagnild, Young, 1993) is currently one of the most frequently used questionnaire for research about resilience as a personality traits. The research findings have showed very good psychometric characteristics of the scale. Cronbach's α ranging from .72 to .94. The results of foreign and local studies confirmed good construct validity. The original version contains 25 items. The authors have developed a shortened version consisting only of 14 items. The aim of the research was to investigate the psychometric properties of shortened version of the scale. Sample consisted of 609 applicants for study at the Department of Psychology at the Faculty of Arts UK, who filled the entire 25 item version. In the analysis, we compared the psychometric properties of Classical Test Theory and Item Response Theory (IRT). We used Samejima`s model. The average point-biserial correlation of shortened version scale was r = .513. Estimated level of resilience (through IRT) with a shortened version of the scale was almost identical to estimate from 25 item version (R2 = .932). Both scales measure with sufficient accuracy on relatively wide range level of resilience. Both scales bring the most information about people with below-average to average level of resilience. The original 25 item version measured more accurately, due to a larger number of items. Shortened version of Resilience Scale is truly suitable and sufficiently reliable tool to measure resilience, which is less time consuming than the original full version scale.

<div class="page" title="Page 1"><div class="section"><div class="layoutArea"><div class="column"><div class="page" title="Page 1"><div class="section"><div class="layoutArea"><div class="column"><p>La evaluación de las actitudes en el ámbito educativo ha sido utilizada como herramienta para prevenir la pérdida de asignaturas y la deserción académica. El objetivo del estudio es realizar el análisis psicométrico del instrumento Actitudes hacia las Matemáticas con el Modelo de Respuesta Graduada de Samejima (MRG). Se contó con una muestra total de 944 estudiantes de primeros semestres de diferentes carreras universitarias. Se realizó el análisis a partir de la TCT y se ajustó el modelo MRG. Se estimaron y analizaron los parámetros de los ítems y se encontró que la mayoría se ajustan al modelo. En conclusión, se encuentra que la escala cuenta con adecuadas propiedades psicométricas. Finalmente, se presentan las bondades del uso del MRG para la evaluación de actitudes.</p></div></div></div></div></div></div></div></div>

A mixture extension of Samejima’s continuous response model for continuous measurement outcomes and its estimation through a heuristic approach based on limited-information factor analysis is introduced. Using an empirical data set, it is shown that two groups of respondents that differ both qualitatively and quantitatively in their response behavior can be revealed. In addition to the real data application, the effectiveness of the heuristic estimation approach under real data analytic conditions was examined through a Monte Carlo simulation study. The results showed that the heuristic estimation approach provided reliable parameter estimates and the model successfully converged above 80% when the sample size was 250 and above 90% when the sample size was 500 or 1,000 for most conditions.

El objetivo de este trabajo fue elaborar un banco de ítems para medir las facetas del Neuroticismo basado en el Modelo de los Cinco Factores (McCrae & Costa, 2010) y examinar la viabilidad de una administración adaptativa. Se inició con un pool de 90 ítems, que fue reducido a 54 (nueve por faceta) por juicio experto y estudio piloto. La versión depurada se administró a 1147 adultos de población general del área metropolitana de Buenos Aires (52.7% mujeres). Un 70% de los casos se usó para: a) calibrar los ítems de cada faceta por separado con el Modelo de Respuesta Graduada de Samejima (2010), b) estudiar la estructura interna del banco con un Análisis Factorial Confirmatorio y c) obtener evidencias de validez concurrente. El alfa ordinal de las facetas osciló entre .76 y .87. Con el 30% restante de casos se efectuó una simulación de administración adaptativa con criterio de parada de error ≤ 0.50. Se concluye que el banco reúne evidencias de validez y confiabilidad aceptables para su administración en un formato convencional, pero se necesita incorporar más ítems si se pretende optimizar la medición de las facetas Impulsividad, Vulnerabilidad y Hostilidad.

Abstract. In this study the psychometric properties of the Personal Optimism scale of the POSO-E questionnaire ( Schweizer & Koch, 2001 ) for the assessment of dispositional optimism are evaluated by applying Samejima's (1969) graded response model, a parametric item response theory (IRT) model for polytomous data. Model fit is extensively evaluated via fit checks on the lower-order margins of the contingency table of observed and expected responses and visual checks of fit plots comparing observed and expected category response functions. The model proves appropriate for the data; a small amount of misfit is interpreted in terms of previous research using other measures for optimism. Item parameters and information functions show that optimism can be measured accurately, especially at moderately low to middle levels of the latent trait scale, and particularly by the negatively worded items.

RESUMO Objetivo Avaliar a depressão com instrumentos psicométricos válidos, confiáveis e breves é uma necessidade frequente de clínicos e outros profissionais de saúde mental. Este estudo apresenta evidências psicométricas do Inventário Beck de Depressão-II (BDI-II) e de sua versão desenvolvida especialmente para profissionais em Atenção Primária (BDI-PC). Métodos A amostra foi eleita de maneira não probabilística dos usuários do Facebook. O grupo foi composto por 692 participantes brasileiros, sendo 71,7% mulheres com idade média de 27,9 anos (DP = 11,6) e 28,3% homens com idade média de 30,1 anos (DP = 11,4). No geral, a idade média dos participantes foi de 28,5 anos (DP = 11,5). O modelo de Resposta Gradual de Samejima da Teoria de Resposta ao Item (TRI) foi implementado. Resultados Os resultados evidenciaram que o BDI-II (CFI = 0,99, RMSEA = 0,04) e o BDI-PC (CFI = 1,00, RMSEA = 0,01) são suficientemente unidimensionais e com indicadores adequados de fidedignidade, com coeficiente alfa de Cronbach de 0,96 para o BDI-II e de 0,92 para o BDI-PC. Conclusões Este trabalho apresenta uma importante contribuição à área de avaliação psicológica/neuropsicológica e oferece à comunidade de pesquisadores e clínicos evidências originais que proporcionam o uso do BDI-PC.

Testes Adaptativos Computadorizados (TAC) são aqueles que selecionam gradativamente as questões (itens) a serem apresentadas ao indivíduo de acordo com o seu nível de conhecimento (traco latente). Um TAC pode se basear em um modelo da Teoria da Resposta ao Item (TRI) para a estimação do traco latente e escolha do item a ser apresentado em cada passo do teste. Este trabalho apresenta modelos da TRI utilizados em TAC encontrados na literatura e descreve alguns métodos de calibração de itens para a formação e manutenção do banco de questões do teste sob o modelo de Samejima (1969), estimação do traço latente, seleção de itens com restrições utilizando a abordagem Shadow test e critérios de parada normalmente utilizados. Foram realizadas simulações com um banco grande (500 itens) e com um banco pequeno (21 itens) e avaliada a qualidade das estimativas dos traços latente (através do cálculos dos vícios e erros quadráticos médios) de TACs com diferentes números de itens. Foi aplicado o modelo de Samejima às respostas de estudantes do Exame ao proficiência em inglês (EPI) do ICMC - USP, que é aplicado semestralmente no formato lápis e papel, para a formação de um banco de itens e posterior construção de um TAC. Também foi aplicado o modelo às respostas de pacientes clínicos do Hospital das Clínicas da Medicina da USP, cedido pelo doutor Yuang-Pang Wang, ao Inventário de Depressão de Beck (BDI) para os mesmos propósitos. Comparações com a atual metodologia para avaliação da proficiência em língua inglesa do EPI (Medida de Probabilidade Admissível, MPA) e para o diagnóstico de depressão do BDI (critério sugerido por Kendall et al., 1987) foram realizadas demonstrando as vantagens e maior riqueza dos resultados obtidos com a TRI e com os TACs implementados. Adcionalmente foi desenvolvido um programa Same-CAT que armazena bancos de itens e possibilita a criação e aplicação de TACs com restrições, através da abordagem Shadow test
Computerized Adaptive Tests (CAT) are those that select questions (items) gradually to be presented to an individual according to their proficiency (latent trait level). A CAT can be based on an Item Response Theory (IRT) model for estimation of the latent trait and selection of the next item to be presented in each step of the test. This paper presents IRT models used in CATs found in literature and describes some methods of item calibration for creation and maintenance of a test items bank under the Samejima\'s model (Samejima; 1969), estimation of latent trait, item selection with constraints using the Shadow test approach and usuals stopping criteria. Simulations were conducted with a large bank (500 items) and a small bank (21 items) and the quality of the estimatives of latent traits were evaluated (through calculations of mean squared errors and bias) TACs with different item numbers. Samejima\'s model were applied for the responses of students to the English Proficiency Exam (EPE) of ICMC - USP, a test applied twice a year in paper and pencil format, to create an item bank and subsequent construction of a CAT. The model was also applied to the responses of clinical patients from the Hospital das Clnicas - USP, given by Dr. Yuang-Pang Wang, to the Beck Depression Inventory (BDI) for the same purposes. Comparisons using the current methodology to evaluate the English Language Proficiency of EPE (Measure of Probability Allowable, MPA) and the BDI (criterion suggested by Kendall et al., 1987) were performed, and the CATs provided better and richer results. Furthermore a program, Same-CAT, that stores item banks and allows CAT\'s applications with constraints was created

Dissertação (mestrado)—Universidade de Brasília, Instituto de Ciências Exatas, Departamento de Matemática, Programa de Mestrado Profissional em Matemática em Rede Nacional, 2015.
Submitted by Guimaraes Jacqueline (jacqueline.guimaraes@bce.unb.br) on 2015-11-09T10:56:26Z No. of bitstreams: 1 2015_BrunoMarxDeAquinoBraga.pdf: 1001581 bytes, checksum: e11ecef078f6857e5b6a80463288d001 (MD5)
Approved for entry into archive by Patrícia Nunes da Silva(patricia@bce.unb.br) on 2015-12-21T12:14:49Z (GMT) No. of bitstreams: 1 2015_BrunoMarxDeAquinoBraga.pdf: 1001581 bytes, checksum: e11ecef078f6857e5b6a80463288d001 (MD5)
Made available in DSpace on 2015-12-21T12:14:49Z (GMT). No. of bitstreams: 1 2015_BrunoMarxDeAquinoBraga.pdf: 1001581 bytes, checksum: e11ecef078f6857e5b6a80463288d001 (MD5)
Para a avaliação educacional em larga escala é necessário um sistema de dados que têm como objetivos fornecer instrumentos de gestão da aprendizagem visando a implementação ou manutenção de políticas educacionais públicas ou privadas, visto que promove um contínuo monitoramento das estratégias adotadas, visando detectar suas fragilidades e avanços. Logo, um sistema de avaliação deve obter e organizar informações periódicas e comparáveis sobre os diferentes aspectos do sistema educacional. Neste sentido, para a avaliação educacional em larga escala, vários países utilizam-se da Teoria da Resposta ao item (TRI) que, em princípio, veio complementar algumas limitações da Teoria Clássica de Medidas. No Brasil, a TRI foi usada pela primeira vez em 1995 na análise dos dados do Sistema Nacional de Ensino Básico – SAEB e, dentre outras avaliações em larga escala é utilizada também no Exame Nacional do Ensino Médio – ENEM. Todavia, embora a TRI seja utilizada nas provas de conhecimentos de Matemática, Ciências Humanas, Ciências da Natureza e Linguagens e Códigos, a correção da redação do ENEM é feita sob aspectos da Teoria Clássica de Medidas. A proposta deste trabalho é de apresentar, dentre os modelos para itens não dicotômicos, o modelo de Samejima, o qual permite a criação de uma escala de correção da redação do ENEM a partir da TRI. ______________________________________________________________________________________________ ABSTRACT
In large-scale educational evaluation, there is a need for a data system whose objective is to provide instruments of learning management, aiming for the implementation or maintenance of educational policies, either public or private. This data system is necessary, since it promotes a continuous monitoring of the adopted strategies, aiming to detect its fragilities and improvements. Therefore, an evaluation system must obtain and organize periodical and comparable information about the different aspects of the educational system. In this sense, for large-scale educational evaluation, several countries make use of the Item Response Theory (IRT), which, in principle, has come to complement some limitations of the Classic Testing Theory. In Brazil, IRT was used for the first time in 1995, to analyze data from the Sistema Nacional de Ensino Básico1 – SAEB. Among other large-scale evaluations, it is also used in the Exame Nacional do Ensino Médio2 - ENEM. However, even though the IRT is used in the ENEM knowledge tests of Mathematics, Human Sciences, Nature Sciences and Languages and Codes, grading of the ENEM essay is made under aspects of the Classic Testing Theory. The purpose of this work is to present, among non-dichotomous items models, the Samejima model, which permits the creation of a grading scale for the ENEM essay based on the IRT.