Assessing Teaching Effectiveness Committee
For several decades, universities and colleges have attempted to measure the quality of teaching by relying on student evaluations. This sole means of evaluation is convenient and cheap to administer. It provides tangible measures that allow universities to mention it and evaluate the faculty member. In 2009, the Faculty Union at Ryerson University in Toronto filed a grievance with the University over teaching evaluations being an unfair measure of teaching effectiveness. The arbitrator ruled in favor of the faculty and noted that student evaluations can no longer be used for high stakes decisions such as tenure and promotion. Most traditional student evaluation surveys include broad questions such as the quality of the course overall and quality of the instructor overall. Such measures have been criticized as they tend to garner biased responses.
Several studies clearly show bias in student opinion surveys (examples, MacNeil et al 2015; Mitchell 2018; Peterson et al 2019; Physics Today 2020; Weinkle et al 2020; Kreitzer & Sweet-Cushman 2021). There is both measurement bias and equity bias in student evaluations of teaching. Measurement bias partially emanates from the lack of attention to the measures as being about perceptions, opinions, or actual behavior/experience. The course and student characteristics involved in measurement bias include generally lower evaluation scores in large and required classes and lower workload; disciplinary differences – humanities high and natural sciences low’ and lack of correlation between teaching and learning. Equity bias is rooted in the gender, race, accent of the instructor; among other differences including body ability. Gender bias in student evaluations of teaching is strong based on the evaluator and written comments typically display very strong gender bias (Kreitzer & Sweet-Cushman 2021). While racial biases are also evident, this aspect has been less studied.
A few institutions (examples – Georgia Institute of Technology; Purdue; UMass, Amherst; USC) have revisited and revised teaching evaluations by focusing on effectiveness and adopting a more holistic approach. There is an urgent need for VCU to reconsider its approach to assessment of teaching.
While student evaluations of teaching can be an important tool for evaluating and improving teaching and learning, there is substantial peer-reviewed evidence from other colleges and universities that student course evaluations of the sort used at VCU are biased with respect to gender and race and that the numerical scores maybe poorly correlated with teaching effectiveness and learning outcomes. There is also scholarly evidence that peer (faculty) reviews of teaching may be ineffective at evaluating teaching effectiveness and giving useful feedback for improvement.
Co-chairs
Susan Coombes, Office of the Provost - Faculty Affairs, Interim Director CTLE & Associate Professor
Jeffery Wilson, Graduate School, Associate Dean & Professor of Education
Members
Lisa Abrams, Office of the Provost - Faculty Affairs, Interim Assistant Vice Provost & Professor of Education
Amy Armstrong, College of Health Professions, Associate Dean & Associate Professor in Rehab Counseling
Sally Hunnicutt, College of Humanities & Sciences, Associate Dean & Professor
Priscilla Hwang, College of Engineering, Assistant Professor
Hyojin Im, School of Social Work (Senate Representative), Associate Professor
Judith Kornberg, VCU Online, Interim Executive Director
Mayoor Mohan, School of Business, Interim Associate Dean for Strategic Affairs
Wendy Rodgers, School of Education (Senate Representative), Associate Professor
Lisa Webb, Office of the Senior Vice President for Health Sciences, Assistant Vice President for Health Sciences Faculty Affairs
Timeline details
Revised as of August 2024
The committee report is expected to be received the first week of September. Details about the open forum being held in October will come in mid-September.
Revised as of June 2024
As the committee continues their work on this initiative, the timeline is being updated. Upon the receipt of the final committee report, it will be shared online sometime in August and an open forum will be scheduled for early fall 2024.
May 2024
The Committee sought an extension in time for submitting the final report. The final draft report is expected by the end of May 2024. This report will be shared online sometime in early July. As most faculty will be away for summer, the planned faculty open forum will be scheduled in early fall for input from faculty before moving forward.
References
Kreitzer, Rebecca J. & Jennie Sweet-Cushman. 2021. “Evaluating Student Evaluations of Teaching: a Review of Measurement and Equity Bias in SETs and Recommendations for Ethical Reform.” Journal of Academic Ethics 20 (1):73-84.
MacNeil, Lillian, Adam Driscoll & Andrea N. Hunt. 2015. “What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching.” Innovative Higher Education 40: 291–303.
Mitchell, David. 2018. The Ecology of Inclusive Education: Strategies to Tackle the Crisis in Educating Diverse Learners. London, Routledge.
Peterson, D.A.M., L.A. Biederman, D. Anderson, T.M. Ditonto, K. Roe, “Mitigating Gender Bias in Student Evaluations of Teaching. PLoS ONE, 14(5), May 15, 2019. https://doi.org/10.1371/journal.pone.0216241
Physics Today. “Reevaluating Teacher Evaluations in Higher Education.” January 2020
VCU Faculty Senate Report. White Paper on Evaluating Teaching Effectiveness. Academic and Professional Status Committee of VCU Faculty Senate - Kristine Artello, Chair and Masoud Manjili, Co-Chair
Weinkle, Laura J., Jennifer M. Stratford, Lisa M. J. Lee. 2020. Research Report -Voice in Digital Education: The Impact of Instructor's Perceived Age and Gender on Student Learning and Evaluation. Anatomical Sciences Education, 13(1): 59-70.