Making a Commitment to Observe

Since returning back to the classroom, I have been trying to gather more assessment information based on what I am seeing and hearing. In other words, I am drawing on  more observations and conversations to support student learning for assessment for learning.

But one of the things I have been thinking about is how can I use observations and conversations for assessment of learning. That is, how can I gather evidence of learning, that is not a product, and have reliable assessment information that I can use to generate a grade representing the students’ learning?

So, this year I committed to using observation for the first assessment for learning opportunity in one of my classes.

The assessment was based on students participating in writing workshop groups. The writing workshop groups are opportunities for students to bring drafts of their work to their peers and receive comments about the merits and drawbacks in their work. I wanted to assess how well students could provide feedback that would be useful to their peers as writers. The goal is for students to be able to offer feedback, both positive and negative, to their fellow writers so that they could know when their writing was effective and be prompted to make revisions where needed.

If feedback providers were effective, I should see and hear them

  • Identify specific points or parts in the writing to praise (give warm feedback) or note things that were not effective (give cool feedback)
  • Describe, in specific terms, the effect, positive or negative, of that part or aspect of the writing
  • Explain suggestions the writer may want to consider

Essentially, this is the success criteria. I will write more about success criteria in an upcoming entry; however, for now I’ll say that without success criteria, I think it would be difficult to make focused observations. Without success criteria, I think it would be easy to be distracted by other things that might be connected, but not directly related to the focus of the learning.

On the way to the assessment of learning, I needed to, like any other assessment opportunity, make sure that students had multiple opportunities to learn, practice and receive feedback on the learning goal. (And yes, I know, it’s feedback on feedback.) My process to do this worked as follows

  • First I shared a protocol with students that they would use to allow them a process to give feedback effectively and efficiently (with timing and roles).
  • Then, I took students through the protocol using a piece of my own writing. During this modelling, I played the dual role of writer, seeking feedback, and coach, guiding them through the process. In my coach role, I prompted students, for example, to be more specific and clear in their feedback or to expand on their comments when needed.
  • Based on the modelled experience, we brainstormed a list of criteria that would make an effective participant in the workshop. These included social norms (e.g., giving my full attention to the group) that were related to, but not directly about, the learning goal. We made a distinction between those social norms, which were important, and the descriptors that were directly related to the learning goal.

    img_0110.jpg
    A co-constructed list of criteria for being an effective member of a workshop group.
  • Students brought their writing drafts to their workshop groups (with 4-5 members in each group) to work through the protocol and to give each other feedback. While they workshopped, I observed and listened to the feedback they gave,  and I documented what I saw (e.g., students referring to specific passages in the writing) and heard (e.g., describing what they saw in the writing, positive and negative, and offering suggestions).
  • After the first round, I interrupted the workshops briefly and described to students observations I had made from the first round. I connected these observations to the success criteria. Specifically, I noted three different kinds of observations: where I heard specific and detailed feedback (what it sounded like), where the feedback was superficial (what was lacking) , and I heard no feedback (having no evidence). I gave feedback (on their feedback) on what could be improved, and explained the impact of not offering feedback at all, both from an assessment perspective, and as a missed opportunity to support a fellow writer.
  • For subsequent rounds: Where I heard superficial responses (or no responses at all), I stepped in to coach individual students, either by prompting for more detail or clarification or by offering some sentence stems to initiate the talk.

One of the things that made the observation manageable was that there were several rounds of feedback happening, and so I had a number of opportunities to focus on the members of each group for a sustained amount of time (while other workshop groups were happening simultaneously) and document the learning. Because of this format, I was able to circle back to groups a number of times to confirm earlier evidence (e.g., student demonstrating the same level of proficiency with another peer’s writing) or to see if my earlier coaching and feedback had an impact for students who needed to improve.

img_0103-e1540516037250.jpg
Students sharing their writing and offering each other feedback using a protocol.

By the end of the workshop rounds, I had notes (documentation) that represented multiple observations of each student. I felt a fairly high degree of confidence that I had good evidence that was directly tied to my learning goal. I also felt that students, where needed, received additional support in meeting that learning goal. For this opportunity, I was able to assign a level of achievement based on evidence. I felt that the assessment of learning was sound and valid. I also felt that, for this particular learning goal, making observations of students during workshop was the most authentic and reliable way to assess their learning.

3 thoughts on “Making a Commitment to Observe

  1. Terrific post, Brian.
    I have annotated the post using https://web.hypothes.is/
    The annotations are public. To see them, use this link: https://hyp.is/go?url=https%3A%2F%2Flearningalongthefold.com%2F2018%2F10%2F26%2Fmaking-a-commitment-to-observe%2F
    or add the Chrome extension to your browser and then the annotations appear automatically. There is also the option to establish private groups, which I normally do with students and teachers.

    Looking forward to more conversation about formative feedback and success criteria.

    Like

  2. Hi Brian – I love what you are doing with your students. Sometimes moving from group to group can feel “busy” when you want to linger but when I used this strategy with some Brock students, I tried to remember that this was not a one time event, that this was an ongoing practice so I would have many chances to observe and get to know the students and their work. I often asked students to write a little appreciation note(s) to their peer(s) after the feedback session. These notes also had to loop back to the success criteria. Such a good feeling as well as good skill development. I’m looking forward to reading more blogs from you.

    Like

    1. For me, a single workshop session needed a couple of days which allowed the luxury to linger. As well, as you point out, it’s a continual practice, so I have those multiple opportunities to work with too (and to feed forward to next opportunity). You are also reminding me that most students took the workshop quite seriously/diligently, and I’m hoping that the students were elevating their performance not just because it would produce a ‘grade’ but more because they saw the usefulness in the workshopping and because I was paying attention so specifically to their work.
      I love the idea of an appreciation note. Thanks for sharing.

      Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s