Blogs > Cliopatria > Educrats, assessment, and farming: a polemic

Sep 27, 2007

Educrats, assessment, and farming: a polemic




On Tuesday, my college held its twice-yearly faculty "in-service education" day. The theme: "improving student learning outcomes" as part of the transition from a "teaching institution" to a "learning community."

For the last decade, the administration has been eager to impress upon the faculty that we are not merely teachers but "learning facilitators." Learning, we are told, is a collaborative process, more rich and democratic than the top-down method of traditional teaching. Few of us unblessed by graduate degrees from Schools of Education have any real idea what that means, and so the powers-that-be decree that we have these regular indoctrination sessions. The untenured faculty among us are advised to attend and feign earnestness, while the tenured folk hang around to see what sort of a free lunch will be put on. It's rarely any good.


On Tuesday, I was handed a little yellow binder stuffed with handouts of articles from various education journals. I got a free pencil (alas, already sharpened) which had"PCC Flex Day 2007: The Passion for Learning" emblazoned upon it. In my folder was a little self-survey, so that I could discover my own unique learning style, and then share it with my colleagues during the stimulating"break-out sessions" that were sure to follow. After all, the educrats opine, we can't really be effective"learning facilitators" until we become aware of our own learning styles -- and how our own"ways of learning" may be obstacles to understanding the needs of students (sorry,"fellow learners") who have different styles.

On the agenda for the day, the following:

Lunch (12:00-1:00)

Turn in your program assessment form at your food station to get your meal!


The Ed.Ds were on to us! They knew we came for free food, and so a crackdown had been implemented: no ticky, no lunchie. No self-assessment, no stir-fry over rice. Luckily enough, I had packed some trail mix, a nectarine, and a vegan protein bar, so the blackmail didn't work on me.

Seriously, of course, the real reason for all of this wallowing in self-congratulatory edu-speak is that the community colleges, like most public institutions, are worried about accountability. Accountability is the buzzword of the decade; the taxpayers (and their duly elected representatives) want to know that they're getting something in return for their billions. That's not unreasonable; I'm no longer inherently opposed to being held accountable. (This is a new development in my life, as my parents, siblings, and ex-wives will tell you.) So the educrats have decided that the best way to prove accountability is to create measurable, testable,"student learning outcomes" (SLOs).

The longer I teach, the more convinced I become that worrying too much about assessing learning is one of the chief enemies of inspiring our students to want to learn. Look, I want all my students to pass their final exams, get good grades, and remember what it is that they've learned. But I'm teaching history, not providing a certificate in refrigerator maintenance. While my final exams assess what, on one given day, a student has managed to memorize, they don't assess learning because real learning happens long after the student has left the class.

Especially in my gender studies courses, I know full well that it will take many of my students years and years to connect what they've learned in class to their own lives. Often, the epiphanies and break-throughs that matter will happen long after students have left this campus, long after they've moved out of reach of the educrats and their assessment tools. I always compare the job of a good teacher (I'm not a learning facilitator) to a gardener or a farmer. I know it sounds patriarchal, deeply Western, and unfashionably hierarchical, but there it is: I sow seeds in the soil of students' hearts and minds. (Some of the time, my seed falls on rock, other times it ends up in the thistles, but some of it ends up in nice, loamy earth.) And here's the thing: I don't often get to see what blossoms and what doesn't, because whatever flowers do bloom will generally do so months or years after the student has left my class.

So if the politicians and the educrats want to assess my skills as a teacher, they need to do more than look at my students' test results. We all know that students can cram in information for a December final -- and most of the facts they memorized will have vanished from their heads by Super Bowl Sunday. But a new way of seeing the world, of seeing, say, gender roles and relationships in a new light -- that may well endure even though there are no reliable ways of assessing that sort of internal transformation. The most important things my students learn in my classes can't possibly be measured by any government-provided instrument. I've been teaching long enough to have students come back years and years after taking a class; some just mouth platitudes such as"I really liked your class" but a few say wonderful, heartening, reassuring things; they tell me in detail how something I taught them helped change the direction of their lives. Most of the time, they'll say something like"I didn't realize it at the time, but when you said X, it started a whole new way of thinking about the world."

There's no SLO that can measure that.

Look, I know who pays my salary. If the state legislature and their Ed.D flacks want me to tweak my syllabi to emphasize the vocabulary of accountability, I'm happy to do it. But I'm still going to teach -- primarily through lecture in an ancient, top-down, one-sided way. I'm going to pour out my enthusiasm and my passion, laboring in a field filled with rocky soil and pockets of rich earth. And for the most part, I won't be around to see the harvest. That's what it means to teach.



comments powered by Disqus

More Comments:


K Woestman - 10/2/2007

Thanks for clarifying.

We've looked at that exam but decided to take the administration up on their offer of offering a 1-hour capstone course. However, they could still come back and want comparative data like the ETS exam will produce.

For our teacher ed majors, we count the methods course and the student teaching semester as the capstone given that they are the final measurements of their performance. It looks like we will add passing the Praxis II 0081 to passing the history credit (2 hours) they receive for student student teaching. That way, they are only considered "program completers" by the state if they pass that class.

It's an interesting maze. I would be more confident if I were assured that the results of the various tests I've experienced through teacher education were more reliable. Yet, until we come up with an alternative, there's really no other options.

Jonathon, it would be interesting to have you report here what the results of your department's experience using the ETS history test are - and to have others who have used it report to the rest of us. In our circles, it's still a big unknown how it works in practice.


Jonathan Dresner - 10/2/2007

No, I'm not being facetious at all. As part of our program review, the department agreed to produce data related to our seniors' achievement, specifically the ETS history exam.

It's not graded for them, but it's going to be used against us, for sure....


K Woestman - 10/1/2007

Jonathon - I think you are being facetious here, but we have already had to put a "senior assessment" in our curriculum - and chose a final 1-hour course instead of an exam.The exam was the preferred option from the administration.

Our students in our teacher education program will now have to pass an ETS test (Praxis II 0081 Social Studies) to earn their undergraduate degree, not just their state teaching license given the outside program evaluation that takes place as a result of ETS test scores.

Thanks for the link to the Engelmann article!


David Lion Salmanson - 10/1/2007

Hugo,
Look, I hate educrats as much as the next guy, but if your final only tests what the student memorized, it is not a well-designed final. The Burke and Andrews article in Perspectives about the 5Cs of history teaching for K-12 is a good starting place. Better yet, find a good high school history teacher, try independent schools if there are any near you, and see what they are doing. At least put a primary document section on the final next time.


Jonathan Dresner - 9/29/2007

"Encouraging Assessment From the Ground Up", by Donna Engelmann.

That reminds me, I have to schedule an exit exam for my seniors....


K Woestman - 9/28/2007

We have two options: we can have accountability forced upon us and continue to try to resist and end up with a total system we don't like.

Or we can devise ways to demonstrate our own accountability and incorporate what we know about learning our discipline - thus making our learning outcomes content-specific instead of one size fits all.

In my experience, "the education flacks" usually only come in when we have first failed to deal with reality. Those of us who teach in humanities departments who have a significant number of majors who go into K-12 teaching have been trying to grapple with this for a decade and continue to ask our colleagues at our flagships institutions to help us hold our ground for our individual disciplines before we're overrun by "generic accountability".