Expert: Higher Ed Needs to Embrace Assessments of Student LearningMarch 31, 2016 |
WASHINGTON â Colleges and universities should embrace assessments of student learning in order to prove their worth as college costs rise and the job market remains tough.
That was the proposition proffered during a panel discussion Monday at the New America Foundation, a nonprofit think tank.
It came by way of Fredrik deBoer, a Limited Term Lecturer at Purdue Universityâwhere he recently obtained his Ph.D. in rhetoric and compositionâand a writer who deals with higher education policy.
âThereâs no enterprise in the world where we pay hundreds of millions of dollars and no one asks to see how well weâre doing, except the defense industry,â deBoer said.
His message was directed largely at faculty, particularly those who may be resistant to assessments in the world of higher education.
âFaculty can take an active role in assessment and we can get out ahead of these problems and we can become a major force in shaping how assessment happens,â deBoer said. If not, he said, âitâs going to happen anyway, and itâs going to happen in a way that does not reflect faculty interests.â
deBoerâs remarks come at a time when there is continued concern on how much college students actually learnâan issue brought to the fore with the 2011 book âAcademically Adriftâ that claimed colleges were not making much of a difference in terms of what students know.
deBoer said the book, which relied on an assessment known as the CLA, or College Learning Assessment, was âdeeply flawedâ because it failed to look at what students have learned in their specific majors.
deBoer said itâs important to note that assessments are already taking place but not in any systemic way.
He says he sees nothing wrong with a âcollege NAEPââor National Assessment of Educational Progress, a federally administered test that examines student performance in a variety of subjects, including mathematics, reading, science and writingâ. He described the NAEP as a âminimally invasiveâ procedure because a relatively small number of students take it and they donât take it over and over again like K-12 students do with other tests.
âNAEP for college sounds good,â deBoer said. âNo kid is coming home because they had to go through another round of NAEP. Teachers arenât complaining that itâs using up time and forcing them to teach to the test.â
Other efforts to assess what kind of job higher education is doing have fallen short, deBoer said.
For instance, the College Scorecardâa web-based tool that the Obama administration created to give students and families data such as a collegeâs average cost, graduation rate and expected salary for graduatesâis âgreat,â deBoer said, but it also has gaps that donât allow for the comparison of institutions with different types of students.
Similarly, he said, the college rankings put out annually by US News & World Report fail to capture how well institutionsâparticularly elite institutionsâactually educate undergraduates, since they tend to âskim off the top and take only the truly elite high school students.â
âYou could probably put those students into any university and see them excel,â deBoer said. âItâs like having a height minimum and then bragging how tall your student body is.
âA lack of assessment data allows elite universities to maintain the fiction that they teach better without having to provide any evidence that they do so.â
deBoerâs paper looked at a variety of different assessments in place. In the end, he said he favors an assessment known as the CLA+ because it has a written performance task that he says is a âmore authentic mechanismâ than the multiple choice structures that other tests employ.
deBoer said that, while most students enroll in colleges that are close to where they grew up, one hope is that, for those who âcross-shop,â they begin to base their college choices on how much students learn versus whether a given college has nice dorms, climbing walls and the like.
âI can foresee a situation in which actual educational quality becomes a factor in determining a college, because right now it simply isnât,â deBoer said.
But a problem could lie in motivating students to invest an effort in doing well on the test like they do with the SAT because they know the stakes are high on the college admission exam.
âWe can motivate them perhaps to take the test, but motivating them to invest their top effort is one of the hardest things,â deBoer said. âThat to me is one of the major empirical challenges.â
Another challenge is whether employers will ever value CLA+ scores or other assessment scores.
âRight now employers donât know what it means,â deBaer said, because the scores âarenât interpretable.â
âYou would hope that, over time as more of these tests happen, you could say I scored on the X percentile of the test that I took, that would become more meaningful to employers,â deBoer said.
Jamaal Abdul-Alim can be reached at firstname.lastname@example.org or follow him on Twitter @dcwriter.36