Sunday, July 18, 2010

Teacher Performance Measurement and Rhee's Bold Moves

Last week in my Education Pioneers workshop (a weekly, day-long session where we discuss and investigate ed reform topics such as school choice, district reform, the achievement gap, etc.), we looked at human capital issues in public school districts. The most recent news on this front is Michelle Rhee's "victory" to negotiate a new contract with the teachers union. I put "victory" in quotes because I believe it took leadership on both sides of the aisle - Rhee's camp and that of the teachers union - to come to a compromise that looks to be groundbreaking. Again, this is a great example of how leaders (in this case, Rhee and the various teachers union leaders) took bold moves to hammer out a compromise that, while initially divisive, has clear benefits for all sides. While Rhee gets increased power to remove ineffective teachers, effective teachers will be paid significantly more. In essence, ineffective teachers will slowly be removed from the system.

Here's an article that explains the reforms, and another article that explains possibly the most important piece in the agreement - a new rubric for evaluating teachers. It's worth noting that teacher evaluations - one of the most contentious pieces of education reform - will not be solely based on absolute test score benchmarks. Rather, they're based on "value add" (jargon in the Ed world) scores plus other measures. The practice of measuring teachers' effectiveness through multiple measures is similar to that of the balanced scorecard, which has become the predominant method for tracking performance in for-profit ventures. A balanced scorecard uses multiple measures (both quantitative and qualitative) to track performance.

In my view, human capital issues such as pay-for-performance are critical to public education reform. Teachers unions often rally around the trite, lazy, and reductive refrain that "you simply can't effectively evaluate teachers' performance." There is, indeed, some merit to this argument - an effective teacher will do things that don't always show up in a students' test scores. For example, a great teacher will go to the homes of students to involve parents, and they will teach students ethical lessons that won't "show up" in a student's character until years in the future. However, test scores are not the only way to measure student performance. Thus, the teachers unions' argument that you simply cannot measure teacher performance is hollow. There is a better, more complete way to measure performance - a problem that Michelle Rhee's contract is trying to resolve.

The difficulty is in designing and implementing such a performance management system. If we are to rely on other measures such as principal evaluations of teachers (an appropriate role for principals), then principals must have the abilities and time capacity to conduct these evaluations. The reality is that in many many schools, principals have neither the appetite nor ability to conduct these evaluations (which brings up a completely new issue of peer evaluations or evaluations by "master teachers", which would require building new tiered teacher roles in schools). For example, my sister, a first year teacher in the Mississippi Delta, said her teacher came into her classroom less than three times the entire year - a year when Jenny, as a new teacher, needed the most instructional assistance.

So, an effective evaluation system requires a lot more than just "putting the system in place." It requires higher competencies from principals, a new management structure within the schools, and buy in from local teachers unions (not an easy issue to overcome). The bottom line is that reform must start somewhere.

5 comments:

  1. Dave, I think you and I are largely in agreement. However, I would also add that there in fact seems to exist a great way do to teacher evaluations: see how much the students and parents like the teacher. Treat them as customers. In a competitive education system, such as with vouchers where funding is attached to students instead of schools, students will leave for schools with superior teachers and quality education (just as you would leave a sub-standard restaurant for a better establishment). If students seem to be bailing on a particular teacher that would also send a message that something might be amiss.

    It is just strange to me that plenty of organizations have to evaluate the performance of their staff and don't encounter too many problems. Then somehow with teachers we get this notion it is impossible. It doesn't wash.

    ReplyDelete
  2. Yes I agree with Colin..........
    ______________________________
    Monica Sharma

    Click Online Document Conversion and capture Text from your bills, invoices, letters, forms, statements, notices, books, journals, magazines, image or PDF Documents on internet and edit into your system directly.

    ReplyDelete
  3. Hey! I'm David's sister and I agree with what they're doing in D.C. Change does have to begin somewhere, and oftentimes the teacher unions are the most resistant to change because they are looking out for their jobs and not for the students' success. My teacher evaluations happen twice a year and I get little feedback. I get the most feedback from myself because I am constantly trying to improve my classroom. Constantly. It's hard to evaluate teachers, but it can be done. It won't be completely foolproof because of the subjective factor, but I agree that tests are definitely not the only way to determine a teacher's effectiveness. It's unfair to the teacher and the students to determine if they've "learned everything" from one test score. As a teacher, it's hard to balance making your students good thinkers and making them good test-takers.

    ReplyDelete
  4. Jenny, you raise some good points on how it's difficult for teachers to balance making them good thinkers (and humans) vs. good test takers. I'm reminded of a letter that a principal gave to all his teachers on the first day of class (this story is stolen from Hiam Ginott's "Teacher and Child":
    "Dear Teacher,
    I am the survivor of a concentration camp. My eyes saw what no person should witness:
    - Gas chambers build by learned engineers
    - Children poisoned by educated physicians
    - Infants killed by trained nurses
    - Women and babies shot and burned by high school and college graduates.
    So I am suspicious of education. My request is: Help your students become human. Your efforts myst never produce learned monsters, skilled psychopaths, educated Eichmanns. Reading, writing and arithmetic are important only if they were to make our children become more humane."

    To Colin's point - you're right that "customer" evaluations should be included. To my knowledge, many (perhaps most) school districts gather annual satisfaction data from parents (asking questions such as "I believe my child is in a safe school environment" and "I believe my child is being challenged by his schoolwork." The trick is to a) make these results public and b) incorporate the results into a well-rounded performance rubric. So, school districts are making progress (slowly, as things like Race to the Top and some enlightened state teachers unions step up) in using all types of data, I think the ideal end state is to have a balanced scorecard-type approach.

    A couple stories from California - San Francisco has actually has a system that's almost pure choice, where students can give their preferences on which school they'd like to attend, and money subsequently follows the student (just like the situation Colin describes). Of course, the consequence is that students all apply to the best schools and not to the worst school. This is not necessarily a bad thing since it sheds light on consistently underperforming school, but the issue is a bit more complicated than just "getting rid of" the bad schools.

    CA has a state law that says teachers cannot be evaluated based on student performance. Again - this is a law. Here's an NPR story on how a new Colorado state law allows for student progress to account for 1/2 of teacher evaluations: http://www.npr.org/templates/story/story.php?storyId=128484784.

    ReplyDelete
  5. By the way, here's an article on the SFUSD student placement process:
    http://www.nytimes.com/2010/02/21/education/21sfschool.html

    In theory it's equitable, but there are factors that prevent it from having the desired outcomes: parent involvement in a child's school selection, the parents' social networks through which parents can get information about which schools are better than others (usually works in favor of whites and asians, against blacks and latinos).

    ReplyDelete