Tuesday, November 11, 2014

Letter to A "Second Drafts" Skeptic (3 of 10)

Dear Michael,

I read your previous post and was intrigued by your argument. I'm sympathetic to the idea that "giving feedback" is hopelessly vague. And, I agree: giving feedback is only sometimes effective.

You suggested that teachers need to take the energy they put into "giving feedback" and redirect it into "facilitating second drafts."

I'm skeptical.

I'll grant that your post showed an example of "second drafting" that led to student learning. Sure. But who says that "improving the classwork" is ever the most effective activity to get to this learning? After all, the effectiveness of a teaching technique is at least partly determined by how much time it takes. Also: maybe you got lucky? Maybe asking students to improve their work wasn't the right decision to make, even if it happened to lead to learning.

In short, you've got more work to do.

Sincerely,

Skeptic


---

Dear Skeptic,

I agree completely. Here’s what I’ll try do to address these concerns. First, I’ll argue that there are at least some situations when helping students improve their classwork is the right instructional decision. But it’s a long way from saying that “second drafting” sometimes works to saying that it works in most classrooms, in many situations. I won’t be able to bridge that gap entirely, but I'll try to get as close as I can.

To start, I want to tell you about an awesome student of mine, Toni.

Toni is a 9th Grader. She's new to our school, and she stood out early on. On the first day of class, I gave students a version of the handshake problem and put them in groups. Toni took a quick look at the problem and said, "Oh this is simple" to her groupmates. She took a marker and whiteboard and scribbled a few calcuations without a word of explanation to the folks she was working with. She quickly and accurately calculated how many handshakes we’d need to all shake hands (but didn’t try the second half of the problem in search of a generalization) and sat back and called me over.

"We're finished." 

It was only after I nudged them that Toni (and her group) really dug into the second problem.


This is the sort of student Toni is. Quick, accurate, sharp, and likes being quick, accurate and sharp.

Toni has a group of friends in class that she gets along well with. One day I overheard them talking about how smart they were at math. Toni said, "Oh yeah I'm really good at math. It's in my blood." Being good at math is clearly an important part of Toni's identity. She sees smartness in math as something pre-determined and relatively fixed.

Another thing about Toni: she often didn’t justify her work, even when the assignment explicitly called for justification. In her classwork or quizzes, Toni would quickly come to conclusions that were poorly justified. Often (usually) they were dead-on. But sometimes they weren’t. For instance, for several days Toni was absolutely sure that she had found a counter-example to SAS.


I tried to give Toni some one-on-one feedback on her SAS counter-example during classwork. It was hard going. She didn’t seem interested in what I had to say, was easily distracted. I tried to get her to use reasoning to check her conclusion, but her confidence seemed absolute.

This pattern continued over the course of a few weeks. Toni would produce work quickly and without proof, even though we talked about and shared proofs explicitly during our class discussions.

This came to a head on a classwork assignment about trapezoid properties. My major goal for the lesson was to help students understand how to use parallel lines and triangles to write proofs about quadrilaterals. I gave students a problem set including the question, “Is it always, sometimes or never true that the sum of the angles of a trapezoid is 360 degrees?”

I came over to Toni and saw that she had written “always” by it. I nudged her to offer an argument, and she wrote “Because all quadrilaterals sum up to 360 degrees.” I asked her how we knew that, and she wrote “y=180(n-2)” on her page. Eventually, with a bit more nudging, she wrote "alternate interior angles are supplementary."


During my initial instruction I had suggested that students try to use parallel lines and alternate interior angles and the decomposition into triangles to develop these trapezoid proofs. The day before, we had worked on a proof that triangle angles sum to 180, and a student had shared a proof using parallel lines. I tried to use questioning to push Toni in this direction, but even as were talking she was looking at other problems and patiently waiting for me to leave her alone.

In other words, my initial instruction failed.

Now, Skeptic, how would you have me react to this failure of initial instruction?
  • Explicit instruction in a whole-class setting had already failed, and it’s not hard to understand why. Toni was heavily invested in being especially good at math, and was heavily incentivized to avoid making a connection between corrections in instruction and her own work.
  • I could create a new task whose sole purpose was to focus on the need to justify our claims in geometry. This would suffer from the same issues as explicit instruction, though. A further issue: the new task would, by definition, have new intellectual demands that would distract from the old ideas that I wanted Toni to learn. Any new math would be something else for her to think about rather than laser-focusing her on her areas of improvement.
  • I could try conferencing one-on-one with her during class, but this had already shown itself to be problematic. Her status/mindset issues suffice to explain why this had failed. Toni has trouble yielding when in the presence of her friends and peers.
  • I couldn't meet with Toni outside of class. She didn't see herself as needing my help, and the logistics of arranging an out-of-class meeting are difficult for us.
  • What about simply giving feedback without time to improve her work? This feedback is easily forgotten and ignored, in general, and wouldn't have been taken to heart by Toni, who has shown herself to be especially unreflective when it comes to proof and argumentation.
I decided that the only course of action that had a chance of working was giving feedback to the whole-class and asking the entire class to improve their earlier work. This way, Toni wouldn’t be able to escape from the connection between my instruction and her own work. She wouldn’t have any other mathematical distractions -- any other problems for her to show her ability on by rushing on to them during instruction. Most importantly, since the entire class would be improving their work, she wouldn't feel as if her struggles were on display for others. Toni could have a chance to quietly make improvements without losing status in the eyes of friends.

Here's how I did it: I handed everyone’s papers back with no comments, to minimize everyone's ego-involvement. Then I posted on the board: “Is it always, sometimes, or never true that a kite can be divided into two congruent triangles?”

After discussing the problem and sharing proofs verbally, I told the class that I had read and enjoyed their work from yesterday, but had noticed that lots of them had room to improve their proofs. I said that proof-writing is new to a lot of us, and is a different skill than answer-getting in geometry. We can get better at both, I argued. (At this, Toni groaned.)

Then I shared three “sample” responses to the kite problem:

Not a proof. No reasons given

OK proof. Reasons given, but they're private reasons



Great proof. Reasons given that others can understand.


After giving this feedback, I said: "Pick one of your problems from yesterday, and write a nice, improved proof, like this third proof, on a new piece of paper."

And then...

---

OK hold on a sec. This is Skeptic again, and I know where this is going. "And after this, the look of understanding! a smile blooms on Toni's face! She laughs and says, 'Mr. Pershan, I didn't realize that I can do this!'"

Right. And from that day on, Toni's proofs were much improved, and her attitude in class was better, and then five years later she calls to tell you how important your class was to her.

Pardon me, but I'm skeptical. I don't know Toni. No one knows Toni. You know Toni, and for all we know you're making this up. 

You expect us to believe your "second drafts" idea based on your totally unverifiable story?

Signed, 

Skeptic

---

I don't expect anyone to believe me based on my word. You shouldn't. I'm probably not making this up, but I'm also not an objective observer of my own classroom. Further, I can't be sure that what I think caused Toni to improve actually caused her improvement.

Instead, inspect my thinking. I'm not claiming that asking Toni to improve her work caused her to learn how to write a proof. I'm claiming that this was the only sensible teaching decision to make in this situation. Is there a flaw in my instructional reasoning? Is there an alternative to classwork-improvement that I didn't consider? Do you think that one of the solutions I dismissed could have helped?

If my reasoning is sound, then the first half of my response to a skeptic (and Skeptic) goes like this: this is a type of situation where asking students to improve their work is the best teaching decision. When a student's struggles aren't even on his own radar, asking for a second-draft is often going to be the best course of action, in particular when that student is disposed not to see their own areas of improvement.

But the skeptic's gap remains: how do we know that asking for a second draft is a generally useful teaching move, and not just helpful in the specific scenario that I outlined above? 

The best I can personally do is share my hunches and speculations. But that's another post for another day.

Questions

I love your comments, and I have a special love for your skeptical comments. Here are some questions I'm thinking about after writing this post.
  1. Do you think that asking students to improve their work is generally helpful for learning? Why do you think so?
  2. In some ways, this was pretty cautiously argued. Is this sort of justification of teaching decisions necessary? 
  3. Should we believe the evidence that teachers report from their classroom? Would you have been convinced if I had just said "...and now Toni is writing amaaazzzing proofs"?
  4. Is there still room for the skeptic?
Appendix

As it happens, Toni's proofs have been much better.


And for those playing at home, cross off "whole-class," "verbal" and "goal-setting" on your feedback Bingo card.

This is the third post in a series on feedback. To read the rest of the posts click here.

4 comments:

  1. Love this series of posts. Usually, I read your posts and reflect on how I can improve on my teaching. Proof is a natural fit for drafting in mathematics that can reach all audiences and I appreciate that you are using it in this post. I completely understand the pedagogical sequence that you followed leading you to determining the need for a lesson dedicated to a second draft. I wanted to toss out an alternate idea and see your thinking on it.

    Have you considered peer review as an intermediate step? Here is what I was thinking for a lesson structure.

    1. Individually create a proof. (Students are aware of the next step while doing this.)
    2. Swap your proof with your neighbor. Annotate the proof with your beliefs of their mathematical thinking along with one noticing and one wondering.
    3. Create a better proof together.
    4. Swap the proof of your pair with the other pair in your group of 4 and repeat steps 2 and 3 as a group.
    5. Summarize the lesson

    The reason I take this approach is that the work stays with the students. Yes, the lesson is still about drafting, but the feedback is from the peers. I do not know your students and whether or not they can recognize better logic in a proof or not. I also realize that individual evidence is lost along the way. However, I typically choose strategies like these in my class to have more students engaged in deeper learning. What are your thoughts on this type of approach before creating a second draft based on selected student models? Maybe the only real difference is the mode of feedback where most of the feedback in my suggestion would be based on solid questioning and your feedback starts with the models.

    My $0.02

    ReplyDelete
    Replies
    1. I think that, depending on the kids and depending on your teaching goals, this could be a really exercise.

      I think, in this case, peer feedback would be unlikely to help Toni, simply because Toni has such high-status in class that she'd be unlikely to accept the individual criticism that any other student could offer.

      Your idea is a great one to add to the menu of options for feedback. Here's a question I'd love to hear more from you about: can we figure out what sorts of teaching situations this sort of peer feedback is the perfect solution for? When would you need peer feedback in order to promote learning?

      Delete
  2. Hi Michael,
    I think I mentioned to you that we've been looking at your blog entries in thinking about the design of case studies to use in teacher professional development. (The "we" here is a group of Israeli researchers, teacher educators and teachers working on developing teacher professional collaboration and discourse.) We'd like to translate into Hebrew and adapt your account of "Toni". A few questions:
    1) Are you happy with that? We of course give you full credit and direct readers to your blog (indeed, one of the reasons we want to use this material is to introduce local teachers to this sort of reflection and sharing of practice).
    2) Regarding your interaction with Toni, you write:
    "I tried to give Toni some one-on-one feedback on her SAS counter-example during classwork. It was hard going. She didn’t seem interested in what I had to say, was easily distracted. I tried to get her to use reasoning to check her conclusion, but her confidence seemed absolute."
    Do you recall what sort of feedback you offered? And specifically how she responded?
    3) Would you like to see what we do with this? (In Hebrew) If so, please write me to my e-mail lefstein AT bgu DOT ac DOT il.
    4) Do you know of any other teachers who write about teaching in similar ways? Can you recommend their blogs?
    Thanks! Warm regards,
    adam

    ReplyDelete
    Replies
    1. 1) Yes, I'm very happy with that!
      2) The feedback came in the form of questions intended to seed some doubt. "I love what you have here -- these are potential counterexamples. But how do you know that they're actually not congruent? Maybe the measurements are actually the same, but they just appeared different because they're close." Toni responded by remeasuring and showing me that the measurements turned out different. Then I would suggest that she didn't measure the line as precisely as she might have and she would remeasure... We repeated this a few times until it became clear that it wasn't working.

      3) I would! I'll email you.

      4) Twitter is the best place for this, probably. I'm sure that if you put out a request for these sorts of accounts, we could get you and your team some.

      Delete