While it’s gratifying and inspiring to observe warm, nurturing, and instructionally dynamic classrooms, unfortunately that’s not always the case. I received an email the other day from an observer who conducts observations for a research project in middle and high schools. He was concerned about interactions he had observed, and wanted to make sure he was doing CLASS coding correctly. Since we have a blog on the website about classrooms scoring all 7s, I thought it would be important to bring up the other end of the continuum as well.
In his words, the classroom was “consistently chaotic.” He could barely hear the teacher because students were talking, screaming, arguing, banging things on desks, and wandering in and out of the room throughout the observation. He scored each dimension a 1.
Understandably he left feeling stressed about the situation for the students and teacher, for his own role as an observer, and wondering how to provide feedback in a way that was fair and useful. No question, it’s complicated.
What do you do when you, or the people you train, are being sucked into the emotional climate of a classroom?
Regardless of what you observe during an observation, always, always, always use the CLASS manual when assigning scores. When you’re conducting an observation, your scoring companions are your notes and your manual.
Trust the evidence you collect (i.e., your notes) and reference those to the manual. Look at each dimension separately and decide whether or not your observations best match low, mid, or high for each of the indicators. Your score weighs the evidence for both the presence and absence of interactions, and the overall level of quality over each 20-minute cycle. Be systematic—even when it's hard—and have confidence in the scores you assign to each dimension at the end of each cycle.
And, did I mention—always use your manual!
It might sound odd, but try telling your participants: you are a CLASS robot. As soon as they walk in the room (or begin watching a training video), they should be picking up on what CLASS measures, and nothing else. Every observer is a scoring machine.
The manuals (at each age level) have an important section on challenges to the observer. Emotions are contagious, and if you’re swept up in extremely negative or positive interactions, it’s incredibly difficult to remain objective.
Be aware of your own ideas and biases ahead of time. Remind yourself why you are there and why you are using the tool—it helps you stick to what you see rather than what you feel. Recognize what you loved, or disliked, and then put those emotions on hold and look to the manual to systematically pull in evidence the way the CLASS tool wants you to interpret the interactions.
Is this easy? No way.
But, using a robot approach and grounding yourself in the manual allows you to trust what you see and confirm that you're coding it objectively. Go dimension by dimension, step by step, to focus on each dimension separately and give credit where credit is—or isn’t—due.
In the case described at the beginning of this post, it was tough, because the observer is part of a research project that is not working with teachers over time to build professional capacity. While he provides feedback reports to the teachers based on his observations, these are less likely to be connected to specific, targeted, intentional, CLASS-based coaching on an ongoing basis.
Research plays an essential role in growing a body of evidence on effective instructional environments. But in cases like this where help is so clearly needed, it can feel especially frustrating. No one wins when students or staff members are left alone in classrooms like the one described. Ideally high-quality data are linked to a larger cycle that help teachers learn, test, and grow stronger practices.
Regardless of whether you’re working in research, practice, or policy settings, our research papers are a great resource for grounding yourself in why and how CLASS is being used.
Conducting observations and sharing results is no easy task. It takes commitment to use the tool correctly, finding time to do it well, and then keeping perspective regardless of what you end up observing. This can be especially tough when you work closely with teachers over time as their professional coach—especially when high stakes are involved!
A little parallel process might help frame our situation as observers. Just like we don’t expect teachers to fix problems on their own, we observers need a collegial network to bounce ideas off of and make sure our CLASS lens isn’t drifting.
A few ideas for keeping data quality high include:
I know I sure appreciated his email as a reminder for why our collective work is so important. Teachers and students deserve support. Instructional quality is too important for not only student outcomes—but teacher outcomes too (like teacher retention)!
So we need to be able to 1) trust the data we collect by using the tool correctly, and then 2) build systems that link high quality data into strong and ongoing systems of professional support.
What’s your experience in handling situations like the one described here? What worked well? What’s still tough?
Thanks for your questions and reflections - keep ‘em coming! We’re all in this together, and learning as we go.
As the Community Manager with Teachstone, I have been able to talk to many observers, trainers, coaches, and general CLASS lovers. I have found a common thread among these groups: a desire to connect with other CLASS users and put their CLASS knowledge to use.
We often hear from CLASS Observers that are interested in observing more classrooms. Meanwhile, many organizations—particularly smaller organizations or those doing research studies—don’t have Certified CLASS Observers and are in search of observers in their area.
If you're a CLASS observer, you've probably found yourself in a situation where you have to make inferences or rely on contextual evidence when assigning scores. However, it should always be your goal to minimize subjectivity and assumptions. You have to prevent your emotions, opinions, and ideas that are not a part of the CLASS tool from influencing scoring. Achieving an emotionless state of objectivity while observing can be incredibly challenging. It takes practice to recognize when objectivity is threatened and respond accordingly.
Exciting news, you can now purchase Individual CLASS Calibrations directly from the Teachstone Store! They're available for Certified CLASS observers at all 6 CLASS levels. When you purchase an individual calibration, you’ll receive a video to watch and code on your myTeachstone dashboard. After submitting your codes, you’ll get an automated score report and a prerecorded webinar discussing the master codes.
Have you ever meditated? One of the most challenging aspects of this practice is clearing your mind from day-to-day thoughts that pop into your head. If you meditate, you know that trying to push those thoughts away doesn’t work—in order to free your mind you must first acknowledge those distracting thoughts before you can return to your “moment of zen.”