Page 61 |
Save page Remove page | Previous | 61 of 136 | Next |
|
small (250x250 max)
medium (500x500 max)
Large (1000x1000 max)
Extra Large
large ( > 500x500)
Full Resolution
All (PDF)
|
This page
All
|
53
moderate inter-rater reliability coefficient. In a retrospective study of 52 physical
therapy students the reliability coefficients for an applicant’s essay range from 0.15
to 0.43. In a study conducted on medical students at McMaster University, the inter-rater
reliability coefficient on applicants’ autobiography was 0.45 (Moruzi, 1998).
Higher inter-rater reliability coefficients of 0.71 to 0.80 were reported by Brown et.
al (1991) and Heale et al (1989) reported higher inter-rater reliability coefficients
assessing letters, not essays.
The ambivalence of using writing samples as a criterion variable for
admission relates to these concerns: the lack of inter-rater reliability of evaluators
contributes significantly to the low inter-rater reliability coefficients of applicants’
essays (Youdas et al., 1992); the lack of clear guidance to both the writer and the
assessor leads to poor reliability and validity of essays as predictors of student
performance and true authorship of the personal statement submitted with the
application form. Roehrig (1990) demonstrated that an essay written on site and
graded on format, neatness, spelling, writing style and quality of content prove to be
good discriminators of student performance in physiotherapy. Schmalz et al. (1990)
concluded the same in his study on essay submission given on a selected topic and
rated using similar standards were predictive of student performance in an
occupational program.
In terms of predictive validity, Berchulc et al (1987) explained a 34%
variance in the first semester GPA of 72 students in an occupational therapy program
Object Description
| Title | A predictive valdity study: correlation of admission variables with program completion and student performance on the National Certification Examination in a physician assistant program |
| Author | Middleton, Delores E. |
| Author email | delores.middleton@rcc.edu; lolokinard@yahoo.com |
| Degree | Doctor of Education |
| Document type | Dissertation |
| Degree program | Education |
| School | Rossier School of Education |
| Date defended/completed | 2008-08-29 |
| Date submitted | 2008 |
| Restricted until | Unrestricted |
| Date published | 2008-10-18 |
| Advisor (committee chair) | Jimenez y West, Ilda |
| Advisor (committee member) |
Cole, Darnell Hocevar, Dennis J. |
| Abstract | The purpose of this investigation was to examine the reliability and predictive validity of the of admission data in predicting student success in completing a community college-based physician assistant program and their performance on the National Certification Examination (NCE). The files of 170 graduates were reviewed and the following data was complied: 1) science grade point average (GPAsci), 2) cumulative grade point average (GPAcum), 3) reference letter ratings, 4) personal statement ratings, and 5) work experience -- each identified as a predictor measure in this study. The criterion measures identified in the study were 1) program completion, 2) performance on the NCE, and 3) skills. Findings demonstrated variations in the degree of relationship among predictor measures and criterion measures. The GPAsci demonstrated the greatest degree of correlation with student outcome in comparison with other predictor measures, which is consistent with previous research. Overall, the research demonstrated that there was practical significance or potentially significance correlations between the majority of the predictor measures. |
| Keyword | admission variable; criterion measures; national certification examination; criterion related evidence; reliability and predictive validy; prior academic achievement; letters of reference; personal statement; work experience |
| Coverage date | 1999/2005 |
| Language | English |
| Part of collection | University of Southern California dissertations and theses |
| Publisher (of the original version) | University of Southern California |
| Place of publication (of the original version) | Los Angeles, California |
| Publisher (of the digital version) | University of Southern California. Libraries |
| Provenance | Electronically uploaded by the author |
| Type | texts |
| Legacy record ID | usctheses-m1678 |
| Contributing entity | University of Southern California |
| Rights | Middleton, Delores E. |
| Repository name | Libraries, University of Southern California |
| Repository address | Los Angeles, California |
| Repository email | cisadmin@lib.usc.edu |
| Filename | etd-Middleton-2420 |
| Archival file | uscthesesreloadpub_Volume32/etd-Middleton-2420.pdf |
Description
| Title | Page 61 |
| Contributing entity | University of Southern California |
| Repository email | cisadmin@lib.usc.edu |
| Full text | 53 moderate inter-rater reliability coefficient. In a retrospective study of 52 physical therapy students the reliability coefficients for an applicant’s essay range from 0.15 to 0.43. In a study conducted on medical students at McMaster University, the inter-rater reliability coefficient on applicants’ autobiography was 0.45 (Moruzi, 1998). Higher inter-rater reliability coefficients of 0.71 to 0.80 were reported by Brown et. al (1991) and Heale et al (1989) reported higher inter-rater reliability coefficients assessing letters, not essays. The ambivalence of using writing samples as a criterion variable for admission relates to these concerns: the lack of inter-rater reliability of evaluators contributes significantly to the low inter-rater reliability coefficients of applicants’ essays (Youdas et al., 1992); the lack of clear guidance to both the writer and the assessor leads to poor reliability and validity of essays as predictors of student performance and true authorship of the personal statement submitted with the application form. Roehrig (1990) demonstrated that an essay written on site and graded on format, neatness, spelling, writing style and quality of content prove to be good discriminators of student performance in physiotherapy. Schmalz et al. (1990) concluded the same in his study on essay submission given on a selected topic and rated using similar standards were predictive of student performance in an occupational program. In terms of predictive validity, Berchulc et al (1987) explained a 34% variance in the first semester GPA of 72 students in an occupational therapy program |
