Dissertationen zum Thema „Education, Tests and Measurements|Education, Evaluation|Education, Policy“

International assessments such as the Trends in International Mathematics and Science Study (TIMSS) and Program for International Student Assessment (PISA) have exhibited United States students specifically in the fourth and eighth grades, are not performing well when compared to their international peers. Educational stakeholders including parents, teachers, politicians, and the business community are putting more pressure on schools to improve their student’s academic performance. The stakeholders want improved performance on not only American assessments but also on international tests. The purpose of the current qualitative phenomenological study was to explore the perceptions of educators in the United States to investigate the possible use of alternative educational innovations as a means for bridging the achievement gap between learners. The qualitative research study involved investigating the perceptions of 52 educational professionals through an online web-based survey and analyzing the data using the three steps outlined by Merriam. Two themes emerged from the data and two subthemes were revealed. The themes were finances and training and professional development. The subthemes were funding allocation and teacher compensation.

The Student Growth Objectives are assessments created locally or by commercial educational organizations. The students’ scores from the Student Growth Objectives are included in teacher summative evaluation as one of the measures of teacher’s effectiveness. The Danielson Model for Teaching and Learning supports the idea that assessment literate teachers are highly effective. The purpose of this quantitative causal-comparative study was to identify New Jersey teachers’ competence in student educational assessments. Prizovskaya measured teachers’ assessment literacy level between different groups based on subject taught, years of experience, school assignment and educational degree attained. The data collection occurred via e-mail. Seven hundred ninety eight teachers received an Assessment Literacy Inventory survey developed by Mertler and Campbell. Eighty-two teachers fully completed the survey (N=82). The inferential analysis included an independent-sample t test, One-Way Analyses of Variances test, a post hoc, Tukey test and Welch and Brown-Forsythe tests. The results of this study indicated teachers’ overall score of 51% on entire instrument. The highest overall score of 61% was for Standard 1, Choosing Appropriate Assessment Methods (M = 0.61, SD = 0.23). The lowest overall score of 39% (M = 0.39 and SD = 0.24) was for Standard 2, Developing Appropriate Assessment Methods. The conclusion of this study was that New Jersey teachers demonstrated a low level of competence in student educational assessments. In general, the teacher assessment literacy did not improve during the last two decades. Keywords: assessment literacy, teacher evaluation, student assessment, effective teaching

This study explored the relationship between a National Math and Science Initiative (NMSI) College Readiness Program (CRP) Grant and student achievement outcomes in Advanced Placement (AP) courses and on AP Exams in four Alaska high schools. A logistic regression model returned the odds of students obtaining an A or B versus a C, D, or F in an AP course, and earning a passing score versus a failing score on the exam. The results indicate there are more frequent significant differences in exam scores than in course grades based on the independent variables in the regression model. Free-and-reduced lunch (FRL) status and a school’s location were the most frequent predictors, followed by gender, grant status, and ethnicity. The lack of difference in AP course grades suggests that non-White, female students receiving FRL, attending an urban high school with the grant may be able to achieve at levels comparable to their more advantaged peers. Furthermore, the percent growth in exam pass rate at the grant schools in the study was higher than the non-grant schools and similar to other state-level studies of the NMSI CRP grant. Beyond the consistent increases in exam pass rate at grant schools, enrollment also grew by 13% for underrepresented students at the urban grant school and by 6% at the suburban grant school. These results can be understood in context of Bioecological Systems Theory, which posits that individuals who experience interactions that underlie development in one environment, which they have not routinely experienced in other environments, will show greater development. In light of this study, this means underserved students may be able to close to the achievement gap to their more affluent peers if they have the necessary academic support. As a result, this study supports reducing barriers to advanced course enrollment, and creating systems to extend time for classroom instruction and teacher professional development.

This quasi-experimental value-added study provided evidence for the predictive validity of the Massachusetts MTEL General Curriculum Mathematics Subtest by finding an association between the licensure test results of 130 teachers and the growth of their 2640 grade 4 and 5 students. The study took advantage of a natural experiment that arose due to a policy change made by the Massachusetts Department of Elementary and Secondary Education (MADESE) in response to the initial administration of a new highly rigorous math-specific licensure subtest for elementary and special education teachers in March, 2008. The emergency amendment allowed test takers to conditionally pass the licensure test based upon a lower, temporary cut score, therefore providing a comparison group of teachers who received conditional licensure without fully passing the licensure test. The study sample used a cross-sectional data set acquired from MADESE for the 2010-11 school year, the first year for which data was available that linked individual teachers to their students. The dependent variable of students' mathematics Student Growth Percentile (SGP) score on the statewide test, the MCAS, incorporated prior achievement and was calculated by comparing each student to his or her academic peers. OLS regression analyses including student background variables, classroom variables, and teacher characteristic variables showed that teacher results on the MTEL math test were positively associated with student math SGP scores. The strength of the association found in this study was substantial relative to the research literature and comparable in magnitude with established factors such as student low-income status. The predictive power of the MTEL math test was strongest at the lower range of test scores, suggesting that policymakers should consider lowering the permanent cut score to the level set by the emergency amendment in order to avoid screening effective teachers out of the workforce and potentially decreasing student achievement.

The No Child Left Behind Act (NCLB)'s emphasis of reading, language arts, and mathematics (RLA&M) and its de-emphasis of science has been a source of great concern among educators. Through an objectivist and constructionist framework, this study explored the unforeseen effects of the NCLB on public science education among Title I (TI) and non-Title I (NTI) students. The research questions focused on the effects of NCLB on Criterion Referenced Competency Test (CRCT) scores in the high-stakes subjects of reading, language arts, mathematics and the low stakes subject of science among TI and NTI 3rd, 4th, and 5th grade students in a north Georgia County during the 2010/2011 school year. This study also compared instructional time TI and NTI teachers dedicated to science. A causal-comparative quantitative methodology was used to analyze Georgia's public domain CRCT scores. Three independent-samples t tests showed that TI schools exhibited significantly lower Science CRCT scores than did NTI students at all grade levels (p < 0.0001). The data also showed CRCT scores in high-stakes subjects between TI and NTI students converging but science CRCT scores between TI and NTI students diverging. The self-report survey indicated no significant differences between TI and NTI teachers' instructional science time (t (107) = 1.49, p = 0.137). A teacher development project was designed to focus on improving teacher science content knowledge and pedagogical content knowledge through a formal introduction to the nature of science. With increasing global science competition, science is more relevant than ever, and communities need students with strong science foundations. Further study is recommended to analyze the factors associated with this science gap between TI and NTI students.

Growth modeling in education has focused on student characteristics in multilevel growth accountability models and has rarely included financial variables. In this dissertation, relations of several demographic and financial characteristics of Oregon school districts to the reading and mathematics growth of students receiving special education services in Grades 3-8 were explored after accounting for student level demographic characteristics. Previous research indicated that three variables were potentially related to student growth: district level aggregated student demographics, district geography (e.g., location in a remote area), and district funding. Three sources of data were used to investigate these relationships: institutional data reported by the Oregon Department of Education, the Common Core of Data gathered by the National Center for Education Statistics, and Oregon Assessment of Knowledge and Skills test data collected as part of the National Center on Assessment and Accountability in Special Education.

Multi-level models of student growth across Grades 3-8 were constructed for reading and mathematics, with time (level-1) nested within students (level-2) and districts (level-3). Results demonstrated that although student-level demographic factors account for the majority of meaningful differences in student growth, both district demographic characteristics and financial investment in students were related to growth for students who received special education services.

This quantitative study of summer learning for Maine students in grades three through grades eight analyzed changes in academic achievement level in mathematics and reading that occurred during the summer recess of 2009.

For mathematics, it appeared that when school was not in session, students showed a cumulative loss of nearly 11 percent of a standard deviation. Although small, the change in performance over the summer was not uniform across all grades studied. For the youngest students in this study, the summer recess represented a time where children collectively lost nearly 40 percent of a standard deviation in mathematics. While gender did not show a statistically significant affect on a child’s mathematics achievement over the summer, a child’s socioeconomic status (SES) did. Taken cumulatively over the course of this study, high-SES children made a cumulative gain of just over one third of a performance level in mathematics as compared to their low-SES classmates.

For reading achievement, it appeared that when school was not in session, students showed a slight gain in reading of just about 2 percent of a standard deviation. Again the change was not uniform: children in the youngest grades of the study appeared to gain in achievement level during the summer, while the oldest children in this study lost nearly 32 percent of a standard deviation. Both gender and SES had a statistically significant impact on a child’s summer learning. Over the five grade spans of this study, high-SES children gained nearly 25 percent of a performance level over their low-SES classmates while female students gained nearly 40 percent of an achievement level over their male classmates.

The patterns of learning exposed in this study for different categories of students during the summertime have meaningful implications for policymakers attempting to close the achievement gap. First, it suggests that efforts to close the achievement gap must include efforts to address out-of-school learning factors. Second, by including the summer learning in their calculations accountability measures that use an annual assessment to measure the effectiveness of teachers and schools at closing the achievement gap contain a substantial error.

In Tanzania, the debate surrounding language of instruction has been rekindled with an announcement in February of 2015 that the language of instruction would be changed from English to Kiswahili in Ordinary Level secondary schools. European languages have perceived economic benefits, while researchers in cognitive learning argue foreign languages of instruction are often detrimental to a child’s learning. However, this debate is studied largely at the national and international levels. This dissertation research investigates perceptions of language of instruction in a rural school community using critical theory, the theory of communicative action, and a language ecology framework. Qualitative analysis of community foreign language learning resources and a construct modeling approach was used to create and pilot a quantitative instrument in several rural secondary school communities for the purpose of measuring and acknowledging foreign language learning resources in a rural school community. Findings revealed participants’ cultural attachment to Kiswahili in tension with the high utilitarian value they place on knowing the English language. Few participants believed there are many resources for learning English in or outside of school. Findings from the survey using descriptive analysis and item response theory revealed that few items captured the variability of the construct within the sample, yet exposed possible weaknesses and offered direction for further, future investigation. This study concludes with a discussion of the findings in relation to the theories and framework guiding this study, as well as a discussion of the child’s right to learn.

A severe and worsening nursing shortage exists in the United States. Increasing numbers of new graduate nurses are necessary to meet this demand. To address the concerns of increased nursing demand, leaders of nursing schools must ensure larger numbers of nursing students graduate. Prior to practicing as registered nurses in the United States, graduates of nursing schools must pass the National Council Licensure Examination for Registered Nurses (NCLEX-RN). Various companies, such as the Assessment Technologies Institute (ATI) and Kaplan have created NCLEX-RN predictor tests that report candidates’ chances of passing the NCLEX-RN. ATI created a test called the RN Comprehensive Predictor and Kaplan created an NCLEX-RN predictor examination called the Kaplan Readiness Test. Students with less than optimal scores on the predictor can remediate to improve their knowledge of nursing, critical thinking, and test-taking skills. The intent for the ATI RN Comprehensive Predictor and the Kaplan Readiness Test is to predict the probability of success on the NCLEX-RN. The focus of the quantitative study was the ability of the aforementioned examinations to predict both success and failure on the NCLEX-RN. The overall TEAS score did not have a significant relationship with NCLEX-RN results. However, the ATI TEAS Math score was significantly higher (p = .005) for students who passed the NCLEX-RN. Data analysis showed no significant relationship between the Kaplan NCLEX-RN Readiness Test and NCLEX-RN results (p > .05). A significant relationship between the ATI RN Comprehensive Predictor and the NCLEX-RN scores existed in both the total sample (p = .001) and the BSN subsample ( p = .001). In the MSN student subsample, all 37 students passed the NCLEX on the first attempt.

Few studies have focused on middle school students’ academic achievement and overall performances (Flowers, 2003; Leithwood & Jantzi, 2006). Delaware Comprehensive Assessment system (DCAS) used by school officials recognized an emerging trend in which a large percentage of students’ academic performances consistently declined over a period of three years. Indications point to standardized test scores lower on each grade level. Students’ assessment scores were sixty-six percent lower on the State’s DCAS assessment tests in math for sixth, seventh and eighth grades. Fifty-seven percent of the students on the same grade level scored “below standard” in Reading.

The method of this research study is a quantitative multiple regression design seeking to find the relationship between the seven dimensions of distributed leadership and students’ achievement scores in Reading and Math. Results from the four schools showed a high statistical significance of correlational scores between distributed leadership practices and student assessment scores.

Implications of the study will allow transferability for stakeholders to generalize how to apply distributed leadership practices and improve student assessment scores. Findings from this research will fill gaps in the literature.

In the face of global economic recession, the competition and collaboration for innovation and future growth among nations has led to discussions of how young people are being prepared to become the next generation of workers and leaders. Although the U.S. has enjoyed a strong presence among the international community since the turn of the century, U.S. scores on international reading assessments and the GCI have dropped over the past decade. National literacy assessment comparisons on the NAEP show that variations exist in economic equity and literacy achievement among the fifty states.

Multiple Spearman rho calculations were performed in the study to examine the possibility of a correlation between academic achievement and economic health using the PISA OECD country literacy rankings, the NAEP U.S. state literacy rankings, and the GDP per capita from 2009. In doing so, the possibility of a correlation between international and national data was investigated.

The importance of school readiness to both the future of an individual child and society as a whole has given rise to several state-specific indexes designed to measure county-level risk for starting school unprepared to learn. One such index is the Oklahoma School Readiness Risk Index (OK SRRI), comprised of indicators known to be associated with poor school readiness. Among several indicators considered for the index, the final set was determined on the basis of multivariate statistical methods. Selected indicators related to race/ethnicity, family structure and economics, and child maltreatment. No health-related indicators were included.

A limitation of indexes is that there are no agreed-upon best methods or established theoretical framework of measurement for their construction, which makes indexes subject to specification error. Many indexes are developed using reflective measurement models, which assume indicators reflect a unidimensional latent construct. Indexes, however, follow formative measurement models in which indicators define a multidimensional construct. The use of an erroneous measurement model has considerable implications for policy and resource allocation decisions.

This study examined the sensitivity of the OK SRRI to changes to the indicator set. An alternate index was created that reduced the number of racial/ethnic indicators and included those related to health, such as low birth weight. Indicator selection was guided by a theoretical framework based on transactional/ecological and cumulative risk models of child development, as well as assumptions of formative measurement models. Nearly one-third of Oklahoma's counties experienced considerable shifts in rank from the original to the alternate index. Most increases occurred for counties with high rates on at least one health indicator, while many decreases were among counties with high rates on multiple racial/ethnic-related indicators.

This study demonstrated that changes to the indicator set can change the meaning of a construct, which underscores the significance of the indicator selection process. Given the political nature of indexes, it is imperative that those with a stake in the outcomes be included in these processes. As most indexes related to social constructs are intended to inform policy and resource decision-making, this study has important implications for the field of index construction.

Since the introduction of No Child Left Behind (NCLB), districts across the country implemented computerized benchmark, or interim assessments, into their curriculum as a means to monitor and improve student achievement. Often, a change in curriculum entails a demand of educators’ time, whether through professional development or lesson planning, and therefore affects teachers’ attitudes. The purpose of this study was to determine what, if any, relationship there was among middle school teachers’ attitudes, monthly computerized benchmark assessments, and student scores on the Missouri Assessment Program (MAP). Educators of the communication arts and mathematics content areas from one middle school were administered a survey and questionnaire to address two questions: 1) What are teachers’ attitudes regarding the use of the Tungsten Learning System in the areas of reading and mathematics, and 2) How, if at all, do teachers change their behaviors in regards to the monthly reports of the Tungsten Learning System? Both assessment tools addressed categories of Training or Comfort Level, Use of Tungsten Feedback, Teachers’ Perceptions of Tungsten, Accountability, and Student Preparation and Motivation. To observe if there was a difference in student achievement, as measured by the MAP, test scores of students from two middle schools of the same district, since the implementation of the Tungsten Learning System, were analyzed using ANOVA. In conclusion, the study found there was a difference in student achievement in mathematics MAP scores. Also, based on the survey and questionnaire responses, teachers did not believe Tungsten Learning System was a good predictor of student achievement. However, overall they favored computerized benchmark assessments if not administered monthly, aligned with the curriculum, provided student feedback and effective re-teaching tools, and they felt they were adequately trained. Teachers did believe their attitudes had more of an effect on their students’ attitudes than on students’ achievement.

This mixed methods study examined the responses of four administrators and three English learner (EL) teachers in a rural Indiana school corporation to the mandates of the state's accountability system. In addition, the study investigated the performance of ELs from the participating school corporation on the state's standardized test, the Indiana Statewide Testing for Educational Progress Plus (ISTEP+). The constant comparative method was used to analyze interview data, and descriptive statistics were generated to analyze four years of student test scores. Findings indicate that school corporation personnel have implemented a number of programmatic and instructional changes in response to the state's accountability system. Results from both the qualitative and quantitative analyses elucidate the level of English proficiency required for ELs to pass the ISTEP+. This study provides a starting point for reassessing Indiana's EL achievement objectives.

This quantitative, quasi-experimental, ex post facto analysis examined the relationship between the English proficiency level (ELP) attained by English Learners in the state of Georgia in 2016 and 2017 and their performance on standardized core content assessments administered entirely in English. From the theoretical perspective of validity theory, the researcher investigated the alternative hypothesis that the results of standardized content assessments administered in English to English Learner students yield little meaningful data that can be interpreted and used with validity in and of themselves. To investigate this interpretation, the researcher analyzed 176,941 individual 2016 and 2017 Georgia Milestones Assessment System (GMAS) assessment records (N = 102,312 for 2016; 74,649 for 2017) matched to the corresponding ACCESS for ELLs scores (N = 34,420 for 2016; 35,805 for 2017), employing linear regression to quantify the degree to which ELP influenced English Learner students’ performance on standardized assessments in English Language Arts, Mathematics, Science, and Social Studies and to define the threshold proficiency level at which the preponderance of English Learners were able to score at the Developing and Proficient levels on the content assessments.