写作测试中评分员与量表的交互作用研究 李航 著 著 经管、励志 文轩网

Chapter 1Introduction
1.1The Interactive Nature of the Scoring of Direct Writing Assessment
1.2Research Questions
1.3Significance of the Study
1.4Definition of the Key Terms
1.5Overview of the Book
Chapter 2Literature Review: Research on Raters and Rating Scales
2.1Studies Concerning Rater Factor
2.1.1Effects of Rater Characteristics on Essay Rating Outcomes and Processes
2.1.2Text Features Raters Focus On
2.1.3Raters' Mental Processes
2.2Studies Concerning Rating Scales
2.2.1Theoretical Arguments Concerning Holistic and Analytic Scales
2.2.2Effects of Interactions Between Raters and Holistic and Analytic Scales on Essay Rating Outcomes
2.2.3Interactions Between Raters and Holistic and Analytic Scales and the Effect of Such Interactions on Essay Rating Processes
2.3Approaches to Investigating Essay Rating Outcomes and Processes
2.3.1Essay Rating Outcomes: G-theory and MFRM
2.3.2Essay Rating Processes: Think-aloud Protocols
2.4Summary
Chapter 3Research Design
3.1Overview of the Research Design
3.2Context of the Study
3.2.1General Description of CET
3.2.2Writing Task in CET-6
3.2.3Rating Scale and Rating Procedure Used in CET-6
3.3Data Collection
3.3.1Materials
3.3.2Participants
3.3.3Data-collection Tools
3.3.4Data-collection Procedures
3.4Data Analyses
3.4.1Quantitative Analysis: Essay Scores
3.4.2Qualitative Analysis
3.5Summary
Chapter 4Effects of Rater-scale Interactions on Essay Rating Outcomes
4.1G-theory Analysis of the Scores
4.1.1Estimated Variance Components for the Two Rating Scales (G-study)
4.1.2Score Generalizability (D-study)
4.2MFRM Analysis of the Scores
4.2.1FACETS Screening
4.2.2MFRM Results
4.3Summary
Chapter 5Effects of Rater-scale Interactions on Essay Rating Processes
5.1Differences in the Use of Rating Strategies Across the Two Scales
5.1.1Differences in the General Categories of Rating Strategies Across the Scales
5.1.2 Differences in the Use of Specific Rating Strategies Across the Scales
5.1.3Summary of the Differences in Raters' Rating Strategies Across the Two Scales
5.2Differences in Raters' Text Focus Across_the Two Scales
5.2.1Differences in the Main Categories of Text Focus Across the Scales
5.2.2Differences in Specific Text Focuses Across'the Scales
5.2.3Summary of the Differences in Raters' Text Focus Across the Two Scales
5.3Difficulties Raters Encountered.When Applying the Tw6 Scales
5.3.1Major Difficulties in Essay Rating in the Holistic Rating Condition
5.3.2Major Difficulties in Essay Rating in the Analytic RatingCondition
5.3.3Summary of the Difficulties Raters Encountered When Applying the Two Scales
5.4Main Features of Raters' Interaction with the Two Scales
5.4.1Main Features of Raters' Interaction with the Holistic Scale
5.4.2Main Features of Raters' Interaction with the Analytic Scale
5.5Summary
Chapter 6Conclusion and Discussion
6.1Summary and Discussion of Findings
6.2Implications
6.2.1Theoretical Implications
6.2.2Practical Implications
6.2.3Methodological Implications
6.3Limitations
6.4Suggestions for Further Research
References
Appendixes
Appendix ACET Essay Rating Scale
Appendix BCET-6 Writing Task and Range Finders (June, 2010)
Appendix CAnalytic Rating Scale for CET-6 Writing Tasks
Appendix DAnchor Scripts for the Analytic Rating Scale
Appendix EQuestionnaire on the Interpretation and Application of the CET-6 Holistic Scale (Questionnaire 1)
Appendix FQuestionnaire on the Interpretation and Application of the Analytic Rating Scale (Questionnaire 2)
Appendix GInstructions and Training Tasks for Think-aloud Protocols
Appendix HPost-TA Interview Questions (Holistic Rating Scale) (Interview 1)
Appendix IPost-TA Interview Questions (Analytic Rating Scale) (Interview 2)
Appendix JSample Segmented Transcripts of Think-aloud Protocols
Appendix KCoding Scheme for Think-aloud Protocols
Index