S5.03. The right assessment and the right data with Dr. Jan Hasbrouck

tttt

 

Today on the podcast, we’re joined by literacy expert Jan Hasbrouck, Ph.D. Dr. Hasbrouck is an education consultant, author, and researcher. She opens the episode talking about her start with literacy, underscoring how she was one of the lucky ones who learned how to teach reading correctly in college. Dr. Hasbrouck also discusses what it’s like to combat skepticism—both of the Science of Reading and the power of assessment. She then goes on to talk about the book she co-authored on student-focused coaching and ends the episode by addressing assessment anxiety directly, including a discussion of where it comes from, the importance of progress monitoring, and more!

Speaker 1 (00:02):

If you don’t know the work of Dr. Jan Hasbrook, you are in for quite a treat. And if you do know her work, you’ll already be excited to listen. Jan has been in the work of literacy for decades and still brings us relevant, timely, and helpful information. You’ll enjoy hearing a bit about her science of reading journey. You’ll learn more about what she calls a weird little assessment, and you’ll be introduced to her most recent book, student focused coaching, drop us some comments in the science of reading the community Facebook group and let us know what you think. Well, hello, Jan, thank you so much for joining us on today’s episode.

Speaker 2 (00:43):

Hey Susan, I’m happy to be here. I look forward to our conversation.

Speaker 1 (00:47):

Oh, I’m really excited about this. We had some great conversation already in the pre-call, so we’re gonna unpack some of that, but I’m very excited as you know, our listeners. Just love to hear a little bit about who you are in your journey. How did you get interested in literacy?

Speaker 2 (01:04):

<Laugh> yeah, that was a fun one to think about because I am far along in my literacy journey at this stage of my career. I’ve been doing this as a professional educator for many, many decades to think back about how I got it started, took me back to my own personal journey with literacy. I was one of those precocious readers. I was PR I probably had taught myself to read but my very young mother was trying to follow all the rules. I was the eldest of three girls. So she, I was, you know, the, her Guinea pig <laugh>, but somehow she got the message that and we did have kindergarten back there in CA in California where I started school, but she was told don’t let your children, don’t teach your children to read. That will happen in first school grade.

Speaker 2 (02:03):

So don’t, you’re, you’re not supposed to do that. So as we know about precocious readers, those kids who basically teach themselves, she was reading to us and doing all that, not teaching us to read, but she said she was trying really hard to keep me from reading. And it was really <laugh>. It was really hard. So I don’t really remember learning to read. It was easy for me and a joy throughout the process. So personally I had that experience, but and, and, and right around that time, my another story my mom loved to tell about me is that the day of kindergarten, I came home that evening and we always had dinner together and we sat at the table. And so she wanted me to debrief this kindergarten experience for my sisters. And she said, I announced, and I, I wouldn’t be surprised that I said, I’m going to be a teacher when I grow up <laugh> and having, you know, okay.

Speaker 2 (03:07):

And of course life takes turns and all kinds of things. And there were periods of time when I played around with something else. I did seriously consider or possibly a medical career for a while. And because, you know, I’m a product of when I grew up, I grew up in the fifties and for women, the choices were stay at home mom. Or you could branch out maybe, and be a teacher or a nurse or librarian or something. So mm-hmm, <affirmative> for medical, I thought nursing, I in high school, my cousin was living with us at the time. She’s my age. And we did candy striper training together. And then went to volunteer in the high school with our little candy striper, uniforms and everything. And that first day we walked out and I said,

Speaker 1 (03:59):

No, thanks. <Laugh>

Speaker 2 (04:02):

Not for me. I am not going into nursing. And she just recently retired from a 40 some year career as a surgical nurse. Oh wow. With advanced degrees and everything. She knew that day. This is her thing. This is her passion, I, that day

Speaker 1 (04:21):

<Laugh>, I

Speaker 2 (04:21):

Better, I better stick with teaching, but right around that time, also the, the next, probably most major thing that happened on my road to where I am today is I had really narrowed down that I was gonna be a teacher and I was excited about it. But as I was getting ready to leave high school, I had a conversation one day with a high school English teacher that I really admired and had worked with. And so after school I went to her class and I had a life changing conversation because I said to her well you know, I’m gonna be grad soon. And I wanted to let you know that I’ve decided that when I go to the university next year, I’m going to study so that I can be a high school English teacher Ah-huh. And she gave me the resp not the response I expected. She looked at me and there was a pause. And, you know, to this day, of course, I don’t know if she just had a really rotten seventh period class or a bad headache or whatever it was. But she looked at me and said, oh, Jan, no, you don’t wanna be a high school English teacher.

Speaker 1 (05:35):

<Laugh> seriously. Wow.

Speaker 2 (05:38):

She said, I get it. Why you would want to, you know, reading and English and writing, and everything is so easy for you. And you’re so good at, and you wanna share that with, with children and your students. And that would be wonderful, but she said, Jan, the, the world doesn’t need more high school, English teachers there’s too many of these kids that just don’t even know how to read. Mm-Hmm <affirmative> we don’t need more high school English issues. We need somebody to teach these kids how to read. Wow. And I, her, okay, <laugh> I’ll do that or I’ll consider that. So she planted a seed cuz I hadn’t really thought about that. There were kids around me didn’t know how to read. I hadn’t thought about that. But then in I then started very soon after that the university of Oregon in the teacher ed pathway.

Speaker 2 (06:27):

And I was very unhappy around my junior year, I was just trying to come to grips with what I was being taught and what it felt like. And I think justifiably looking back, I was not being taught how to teach and I wanted that information. Surely there’s some art or some there’s some theory or there’s some, but I was getting art in theory, actually that wasn’t the problem. It was more the specifics. It, there was all the, this vague stuff. I would go to my music theory class or my music, ed class music methods mm-hmm <affirmative> and we would learn to play the recorder. And then we would go to science methods class and we would make toast and write up about the experience. It’s like, yeah, no, something’s not right here. And in one of those classes, we had to teach each other lessons make up a lesson and teach it.

Speaker 2 (07:25):

I don’t remember which class, but one of my peers, one of the teacher, ed candidates in there taught a lesson using what I now know is direct instruction. She was teaching us something and said, modeling, guided practice, coral repetition. Mm-Hmm <affirmative>, I’d never seen anything like that before and after she was done, I went right up to her and said, what were you doing? And she said, it’s called direct instruction. And right over there, there’s some trailers and there’s some folks working in there including Zig Engleman and he’s signing up students to learn direct instruction and you should go over and talk to him. So I did. And that was the next major step in my career. Cuz I draw dropped out of the teacher ed track and dropped into the direct instruction track at 19 years old, a junior. And so I learned to teach using direct instruction.

Speaker 2 (08:33):

And what I hear now at this stage of the discussions about the science of reading and that wonderful Donna Head medic lovely Facebook group of the science of reading, what I should have learned in college. There’s just so many people agonizingly telling their story about being taught incorrectly, how to teach or not taught how to teach and having to discover what I should have learned in college. And I am one of a small handful of people that I learned what I should have in college. I learned how to teach from Zig Engleman, which was not if anybody knows anything about Zig. That was not always an easy process, but he was passionate and heartfelt. And he, he knew his stuff and he, he taught us what he knew then, but you know, that was 19 many decades later. I’m still learning the, the process isn’t over.

Speaker 2 (09:42):

I have, I have bookmark two research studies that I hope to get to this afternoon to read. There’s just new information coming about both how to teach and, and how to teach reading specifically and writing and the interface between reading and writing. And so I know I chose the right career <laugh> I was right that first day in kindergarten when I came home. No doubt, no question in my mind, because it was a good fit for me. And it lucky for me, unlike some careers where my cousin, for instance we just talked this week and she said, there’s no way she could have continued in the career of nursing. She just, at her age, at my age, nursing was just much too demanding, physically and emotionally.

Speaker 1 (10:40):

Whereas

Speaker 2 (10:41):

My career can allow me, I mean, I don’t think I could teach a classroom of 30 some children every single day and maintain that, but I can find a way to keep involved with the profession and continue to grow myself, continue to give back to the profession. So yeah, my journey continues, but that’s, that’s great. That’s the trajectory

Speaker 1 (11:06):

<Laugh> I love that. And we love that you’re still involved in teaching us all along the way as you’re learning too. So thank you for your commitment to this career that you chose, which is really now more than just a career. It feels a, a little like you’re talking, this is a little passion for you or you wouldn’t be reading research articles on a Thursday afternoon. <Laugh>

Speaker 2 (11:25):

In between develop yeah. In between this morning creating a webinar that I will deliver next week and this evening delivering a webinar to some educators and parents apparently in Cal agree Alberta.

Speaker 1 (11:39):

Oh, that’s

Speaker 2 (11:40):

Amazing. Yeah. Yeah. It’s it’s a wonderful, exciting time.

Speaker 1 (11:44):

Well, part of your professional journey includes helping us understand a lot about this what you call the weird little assessment called Orff <laugh>. Oh, and I, I love that you called that weird little assessment. Talk to us a little bit about, I mean, Orff has it’s, it’s got a big place and it’s often misunderstood. Can you tell us a little bit about how you’ve been involved in that and what yeah. What you know, and learned?

Speaker 2 (12:14):

Yeah, I sure can. Yeah. And there, that was a moment too, that I remember much like that connecting with Zig Engelman, which was a memorable moment. My connection with Orff was a memorable moment too. I had been a reading specialist working in a couple of school districts, but I was still a reading specialist in Springfield, Oregon. And but, but my, the ma my administrator that I worked with, the district director of the title, one teachers, and I was a, the one reading specialist mm-hmm <affirmative> had this idea that it would be a really good idea if one of us, one of the reading teachers worked instead of working with kids, worked with the other reading specialists to go out into the schools and helped you know, mm-hmm, <affirmative> help them is yeah. Is pretty much what his words were. So I said, you’re thinking about me to do that job. So anyway, I was plucked out of the classroom, put into this role that had no job title, no job Des. And the goal was to go out in the schools and to help teachers.

Speaker 2 (13:39):

I kind of figured out right away, first of all that I needed some help. I needed some help doing that, that it was a whole different role than the thing I’d been doing for 15 years, which was teaching children. I knew how to get in a car and drive out to the schools that wasn’t the problem. But when I got there, what was I supposed to do? So I started thinking that I, it was clear I needed help. And around that time in my mailbox, I wish I still had that piece of paper. But for some reason I got a little flyer in my I mailbox that said that there was a program in our nearby university, university of Oregon mm-hmm <affirmative> that was training in a, a post a graduate level course or series of courses, training teachers to work with their peer colleagues to improve educational outcomes and student outcomes and that kind of thing.

Speaker 2 (14:44):

And I thought, I think maybe that’s what I’m supposed to be doing. And if there’s somebody over there teaching those courses. So I called up and found out that the person teaching those courses was this brand new professor named Jerry Tindel. And so I said, well, I wanna be in that program. So I went over and interviewed with Jerry and he signed me up and the first course, so that, that was a whole series of events that changed my life because but speaking about Orff, particularly, he had just completed his doctoral program at the university of Minnesota, where he worked with Stan Dino and Jim ISEL and his Jerry’s cohort of doctoral students included names that I’m sure many of your listeners would know. Other of the cohort were Lynn Fukes, her husband, Doug Fukes mark shin Gary ger gin and on and on and on, it was this dream cohort of doctoral students and what they were all studying together was this idea of creating very short, reliable, valid assessments that teachers could use to both quickly identify five kids who might need some academic help and evaluate the effectiveness of that.

Speaker 2 (16:18):

So that’s what Jerry had been studying as a doctoral student. One of those assessments that was created by this amazing team of people was this weird little assessment called oral reading fluency. And, and I remember sitting in that class, I mean, it had just been invented. Nobody heard about it, nobody was writing about it. I mean, there were, there were some research reports, but most of them were being published just at the university of Minnesota. I mean, it was really, really early on. But Jerry was, you know, all talking about it all the time. This, this was the key to everything. And I, I, you like, I’m supposed to be learning how to go out into schools and help teachers. And all you’re talking about is assessment. It didn’t quite jive. And then when he said, he told us about Orff so you have a child read aloud from an unpracticed passage.

Speaker 2 (17:13):

You have them read for 60 seconds, you score their errors, you calculate words, correct. Per minute. And that’s, that’s this amazing tool. And I raised my, oh, and he said, then you take that score words, correct, per minute, what do you do with it? Well, what you do with it is you create building level norms, and then you can find if your student is at the normative benchmark or not. And I just sat there thinking, first of all, 60 seconds, are you kidding me? You know, I’m a, I’m a reading specialist. I have a master’s degree. I’ve been doing this for a long time. I, you know, I can’t imagine that 60 seconds is gonna give me what I need. And also, are you kidding me that we should create building level norms? I like my hand went up, Jerry and I to this day, still recall that conversation.

Speaker 2 (18:12):

<Laugh> arrogant little student that I was, who said you know, Jerry I’ve been teaching primarily my 15 year career in title. I schools, you get to be a title I school by having low performing usual high poverty kids. Mm-Hmm <affirmative>. So I don’t get that. We should create building level norms for these low performing at risk kids, and then use those low norms to, as to let us know anything about kids that doesn’t make any sense to me. So this is going beyond your question for sure. But he said, well, what should we do about that? And I said, well, we need to create national norms. So that was the spark of now 25 years of research that Jerry tend, and I have done together to create those national norms. But I did take some convincing just to believe in the value of that or assessment.

Speaker 2 (19:16):

And so there could not be Susan, a bigger skeptic. I know there are skeptics of Orff when I share Orff, or now I’m very rarely sharing something new with people they’ve heard of it, or, you know, oral reading, fluency, dibbles you know, Acadians, whatever it is they’ve heard about it. And they may use it, but people are as skeptical as I was about the value of it. And I get it. I sit there and listen to their skepticism and say, yeah, yeah, <laugh>, it doesn’t make any since, but I’ve been using it now for what would this be? 30 some years with done th several research studies using it. I’ve used it as a practitioner. I’ve used it as a grandmother measuring my own grandson’s progress. It works that team back at the universe, Minnesota essentially invented the tool that we as reading professionals can use as a thermometer.

Speaker 2 (20:21):

It has reliability. We can trust the score. It gives us consistent scores. It has validity. We can it’s gives us good, useful information and like a thermometer it’s super quick. Mm-Hmm, <affirmative>, mm-hmm <affirmative>, but just like a thermometer, it only tells us essentially whether a student has a fever or not. Are you are, is, are you, should we worry about you or not worry about you? So if we can understand that this weird little assessment really is valuable when we understand what it ISN and what it isn’t, how to use it, how not to use it when to use it when not to use it, I could not imagine being a professional without that tool. But it is, as you say, widely misunderstood.

Speaker 1 (21:11):

Yeah. just talk a little bit about this. I know we have some more things to cover, but just this idea that oral reading fluency, I think you mentioned to me that you think the name itself sort of breeds some mixed misconceptions.

Speaker 2 (21:25):

Oh yes. Thank you for remembering that it does. And there are people on that team, mark shin, particularly he and I have had on that team of doctoral students, way back when that essentially invented these assessments mark and I have had conversations about the fact and he and I are not the only ones. There are others people have written about this, that it was very unfortunate to put the term the label of fluency on that assessment. Primarily because, I mean, certainly there are aspects, what words correct per minute is measuring is accuracy words, correct? Mm-Hmm <affirmative> per minute, which is a rate measure. And in the general research, the science of learning rate plus accuracy is considered fluency in, in educational psychology. And in, in where we study skill acquisition, you start with accuracy, and then as you get more proficient, your, your rate increases.

Speaker 2 (22:27):

And so you get to a point of fluency or automaticity. So it is in a way a measure fluency in the way the general world thinks about it. But we reading teachers think of fluency as something much, or we should think of fluency as something much more multifaceted and complex that at minimum includes proc or expression, which has nothing to do with an Orff score. And in reality, when we’re really looking at, does a student have sufficient text reading fluency to allow comprehension, it is their accuracy. It is their rate. It is their expression. It is their metacognition. It is their background knowledge. It’s all of this stuff that really experience reading teachers think of as fluency. So they think of fluency that way. And then you come along and say, here’s this little weird 62nd assessment that measures fluency. And they say, oh, no, it doesn’t.

Speaker 2 (23:32):

And they, Y you’re right. It doesn’t what it does. Measure is words, correct. Per minute, we could have just called it words, correct. Per minute. It is oral. It is reading, you know, reading aloud, but it’s, it’s, we shouldn’t have called it fluency. There’s some colleagues of mine in a book all about these kinds of assessments that said, suggested it should have been named oral passage reading op oral passage reading. That’s probably a little bit better. Do John hosp has suggested let’s just label it automaticity. It’s a measure of automaticity. Mm-Hmm <affirmative> I like that too. Cause I think mm-hmm, <affirmative>, I think that really is what it’s measuring and why it’s important. But yes, I, I, I think it’s unfortunate and I spend way too much time I’m in my webinars and trainings talking about what Orff is and how wonderful it is and how it’s weird. Yes. But you should trust it, but it should never have been called fluency. Yeah. Well, I wish they hadn’t cuz we have to backtrack and reexplain and all

Speaker 1 (24:42):

That mm-hmm <affirmative> so the message here is trust that Orff measure, but no, it’s a measure that needs, it’s an indicator of something it’s

Speaker 2 (24:50):

An indicator.

Speaker 1 (24:51):

Yeah. Yeah. All right. Well for those of our listeners that wanna attend a webinar with you, I’m sure you’ll unpack that Orff measure at another webinar. Or we can do another recording too, if we want, if we wanna do that, I recently attended the C DL plain talk conference in new Orleans and our team ask attendees to share their science of reading stories. Take a listen, and we’ll be right back.

Speaker 3 (25:15):

Hi, I’m a teacher. And what brought me to the science of reading was that my students were struggling so much with my guided reading instruction. It just did not align to what I wanted students to understand. It seemed to have been confusing them. And when I really realized by reading books and researching the science of reading, I understood more of why I was confusing my students and why it seemed like I was wasting their time. I was able to understand better ways to educate my students. And now I am the teacher of the year in my school Drake. So thank you to the science of reading.

Speaker 1 (25:49):

Well, let’s segue a little bit. So it’s, it was so fun to hear about you going from, you know, working with students directly to being extracted from that and doing a little bit of, of, I would call coaching. So that leads to your new book. Co-Authored book called student focused coaching recently published mm-hmm <affirmative> I, I have it here on my desk. I actually showed it to you. I have my copy all marked up. We’ll link our listeners in the show notes to the book. Tell us a little bit about the book and what the, you know, the Genesis for, for writing that was

Speaker 2 (26:21):

Oh, yes. I’m happy to do that. Thank you, Susan, for letting me talk about that, that book. That is a culmination. I mean, I could, I could go back really to that conversation that my boss had when he had that big idea of somebody should be available to go out and help the teachers. Yeah. He asked me to take that role, how quickly I figured out that I don’t know what to do. It I’m terrified as many coaches, I now have had contact over three decades with many, many coaches. And one of the things we all share is terror of doing this job because no matter how skillful and experience you are, how in the world can we have the Hupa to walk into a colleague’s classroom? Sometimes. I mean, if we’re, you know, much younger novice coach, they may have been teaching for decades longer than us.

Speaker 2 (27:23):

They may be teaching a, a content area that we’ve never taught before. What do we bring to the table? And what if they ask us a question we can’t answer there. There’s just, it’s such, it’s such a, a frightening and overwhelming role. So with that terror and being overwhelmed and frightened, I turned to Jerry Tindel as the beginning of my process to how, how do I do this job? And Jerry most importantly gave me the data message that data has a role, not only in teaching children, but also in working with adults. So I got that message really early on. It’s not all of about data by any means, but coaching involves coaching is enhanced by data collection too. But then I also found that there were other people studying this coaching, or there were quite a group of people back then 30 years ago, studying a process called consulting and that research was happening primarily in special education and school psychology.

Speaker 2 (28:31):

So what next happened was Jerry tend convinced me to drop my work as a reading coach and come work with him and get a, a study, a work on a doctoral program. And the focus of my doctoral program was coaching or consultation. So I spent quite a bit of time reading and studying and ultimately doing some research on the coaching and consultation process. And throughout that time I was training coaches because another thing that Jerry tends was quite renowned for was writing grants. So he had me writing grants and we would use those grants to fund research, but also to bring in students and pay their tuition and have them study under us. So right away in my doctoral program, I was working with people training them to be coaches using whatever knowledge I had. And I can tell you back in the day, I hope none of them are listening, but I was <laugh> one step ahead of them, maybe, maybe one step ahead of them, cuz we were trying to figure out what this thing was.

Speaker 2 (29:46):

Sure. What was coaching and consultation? So whatever I had figured out, I would meet with this group usually young women, but we had different cohorts of people over the year to talk about what coaching is, how to do it. What, what are the challenges? What are the nuances? So that was starting when my doctoral program started in 1986 and that year I was training coaches. So all of that work. And then I ended up, so I, I wrapped up my program with Jerry at the university of Oregon and was hired at Texas a and M university. That was a big shift in every possible way, culturally climate change, climate change that’s right. Language change. I had to learn a whole new language in a lot of ways, but I became I got a job as a tenure track professor in educational psychology and had a wonderful opportunity to work.

Speaker 2 (30:49):

Part-Time in school psychology with Dr. Jan Hughes who happened to have a grant to study consultation within school psychology. And the other half of, of that job was in special ed and I continued to work with right grants and train students in coaching. So those two worlds, I mean, all of that worked together. One of my students in the special ed half of that work was Carolyn Denton and she, and I wrote the first version, the original version of the book that you now have. We CA it was about the publisher that we worked with, wanted us to call it the reading coach, because at that time, most academic or instructional coaches were working in reading. And that worked very well. Carolyn’s been background was reading. My background was reading. So we wrote a book, actually we wrote two books, part one, and part two on the reading coach.

Speaker 2 (31:50):

And so that was used very widely during the reading first years, a lot of peop reading first mandated that schools had coaches, there were very few books for coaches. So a lot of, of teachers who used a lot of coaches used our book. But then, you know, reading first was over and the publisher of those two books decided to not continue to print it. So it was out of print and, but I was still doing coaching training here and there. And part of my at one time that work brought me into contact with Darrell MLE, who is just a wonderful person with a lot of interest and background himself in coaching in schools. And he had read the books that Carolyn and I wrote and was using them in his trainings. So he had a lot of experience with the model that we had created, which is called student focused coaching.

Speaker 2 (32:53):

It’s a particular model, it’s a particular way of offering coaching. So we put our heads together, Darrell and I and said, let’s, you know, that book, original book is out of print. I contacted Carolyn. And she said that she had moved on. She didn’t really want to go back and do a book on coaching. So Darrell and I rewrote the book. He brought a lot of wonderful new, fresh ID is to it, but it’s also the cumulation of 30 years of work and research and practice. So that’s what you, that’s what you have in your hand.

Speaker 1 (33:31):

Yeah. That’s amazing. What a great story. You must be very proud of yourself for that. The second version of the, this, the new one. I hope you are

Speaker 2 (33:42):

<Laugh>. I definitely am. And very I definitely am proud and very grateful to have Daryl on board, particularly. It’s the, it’s the huge value I have had. I have been so blessed in my career so many times to have the opportunity to collaborate with just the right person at just the right time, that original book, the reading coach would not have been written, could not have been written without the input of Carolyn Tinton. This book, I would’ve not had the energy or the impetus to write it without Darrell’s new vision and fresh ideas and, and great thinking around the process. So yeah, it is. I’m very proud of it, but very happy to have Daryl because I’m I think he’s going to take this model of coaching into the future and can, he’s very busy doing coaching trainings all, all over the world via zoom and other, other formats. So yeah, I’m really, I am proud and really happy to watch this little baby that I helped create now go off into the world and sure. Yeah,

Speaker 1 (34:58):

That’s great. Well, I would love to read just a, a, a couple of sentences that come right from this book and just ask you to respond to them. Okay. All right. The word assessment can bring about a great deal of anxiety based on conversations with some educators. There does not seem to be a shortage of tests being administered. Rather it sometimes seems like testing takes precedence over instruction. There is often too much time taken for testing, little time to analyze all of the data and even less time trying to figure out how to use the data, to differentiate instruction. What’s the power there of, of those sentences. There’s a lot packed into those.

Speaker 2 (35:40):

There is

Speaker 1 (35:41):

Isn’t there

Speaker 2 (35:42):

In there. Yes. and it rings true to me to this day. The, that we, there is a lot of anxiety around assessment. I think, I think I honest, I do think in my experience my many decades now I’ve experienced. I think most people who go into teaching are they, first of all, you don’t go into teaching because you love assessments. You know, that’s why, that’s why I wanna go into teaching. I don’t think certainly that’s not the reason. I mean that laughable, but also the personality type. I think that generally gets attracted to teaching is, are people who are people, people, and they like the relationship building and they like all of that. And data is something, you know, assessments are something they will use if they have to, but it’s not the reason that they get it up and go to work every day.

Speaker 2 (36:40):

I’ve having worked in school psychology and have having been you know, a researcher in a tier one university educational psychology department. I know there are brilliant, wonderful people who, whose life is all about data and a assessments and statistics mm-hmm <affirmative> and that kind of thing. And they couldn’t ever imagine themselves teaching in an elementary classroom or something. So there are really different people and there are. So I think a lot of us who’ve come become, teachers have a, a version of fear a dislike, a distrust of, for a lot of reasons. Then there’s the issue of in, in teaching, we never have enough time. We never have enough time or money or people to do the work that we want to do. And so assessments get a little we can feel annoyed about assessments there too. It’s absolutely right.

Speaker 2 (37:41):

The most important thing we do is our teaching and we don’t have enough time to do it. And then somebody usually tells us we have to take some of our time or a lot of our time to do assessments. And if those assessments aren’t really carefully selected, and if those assessments are, if we are not well trained in both how to do the assessment, but how to analyze the data and then what to do with that data, then it’s wasted time. So I’m, and I’m, that’s what I’m seeing in school that administrators are probably feeling pressure on themselves. They’re told you need to do these assessments. They don’t fully understand. Nobody’s taken the time to explain to them what these assessments are, how to use them. What does it mean? And then a lot of, and, and even at the highest leadership level that’s happening.

Speaker 2 (38:36):

So the culmination of that is layer upon layer upon layer of assessments. It’s very rare that someone goes in and says, okay, we’re not gonna do that assessment anymore. We’ve got this better, more strategic, more useful assessment. We’re gonna do this one instead. What’s often and happening too often and happening is assessments get layered on each other. So we’re doing you are doing lots of assessments. We’re doing assessments that were not well designed. I mean, going back to that weird little or I didn’t like it when I first heard about it, but I now love it. And I love it in part, because it is short because it does have those psychometric properties that you have to have in order to believe and get you have an assessment, be useful, reliability and validity, and it is 60 seconds. I love that about, about it.

Speaker 2 (39:28):

And some of these assessments take 45 minutes, an hour and a half of observational assessments that some kindergarten teachers are having to do. It it’s, it’s just and then at the end, what do I do with this data? So I really do understand that concern about yeah. There’s, there is anxiety. We are probably in most schools, I would say doing too much a test testing that overlaps repeats itself. We’re using assessments that are much longer than they need to be. And our attempt to fix all that really is let let’s just, first of all, take a deep breath. Let’s all have a kumbaya moment, link, arms, and agree that we don’t have enough time. We don’t have enough money. We don’t have enough people. OK. And with that precious time and money and people, we should be doing the best instruction possible.

Speaker 2 (40:33):

We all agree on that, but in order to do that best assessment possible, we really do it best. If we have some data, just, just like a physician. We have these amazingly trained physicians who know all this stuff, but if you said, go in and take care of this patient, but you spend any time, you only have to take care of the patient, but you can’t spend any time collecting data. You just have to do the care, taking part, do the surgery, do the, give them some medicine. A physician can’t do that, right? <Laugh>

Speaker 1 (41:12):

Yeah. My face, no, the listeners can’t see it, but my face just went crazy.

Speaker 2 (41:15):

I saw the reaction. No, we do not want a pH. I mean, we don’t like being poked and proded and have to get on the scale and have our, our brain scanned in an MRI and all this. And nobody loves that. It’s the patient, but we trust that our physicians are doing that to collect data that informs their decision making. So we as professional educators and our leaders who guide us and direct us need to know that we need data, just like a physician. Does we, we, we, we don’t need as much. We don’t have the antsy tools and we don’t need them. We need little things like Orff to get us started. Do you have a fever, an academic fever or not? Yeah. If okay, you do, you’re not at benchmark with this assessment of automaticity words, correct? Per minute, you’re not at benchmark.

Speaker 2 (42:10):

Well, what do we do about that? We turn to set of tools and I frame all of that assessment. I think it’s most helpful for administrators and teachers and specialists to think about organizing tools around assessment, around three key questions. Okay. What is, and the threshold question is I’ve got these children in front of me. I’ve got my 108 reading students that I see across a week. I’ve got my 27th, second graders, whatever it is, which of these students might need some extra help who needs, who needs some extra help. Then the next one is I found a student who need, or probably a few students who need some extra help. The next question is, what kind of help do they need? What are their skill strengths? What are their skill deficits? How am I going to use my precious time and resources to give them what they need, not what I think they need, or I, I wish they needed, but what do they really need?

Speaker 2 (43:09):

And then the third driving question is app our instruction starts it’s is the work working, I’m working really hard as a teacher. This child seems to be working really hard is that work working. So we have categories of assessments that answer these questions, that first question, which kids might need some extra help. That’s those benchmark screening at assessments, where we give to all kids. And the reason we give ’em to all kids is we’re making sure that nobody falls between the cracks. We’re finding those kids who might need help. Mm-Hmm <affirmative> when we found them, we turn to, we want to answer that question. What kind of help do they need? We have a category of assessments called diagnostic skills assessments. Do they need help with phon name awareness? Do they need help with phonics? Do they need help with reading text fluency?

Speaker 2 (44:05):

Do they have all that down, but they just need help with comprehen, just need help with comprehension, or is that the focus <laugh> and then once I’ve got that information, I can use that to plan my instruction. And then I should bravely pull out the assessments designed to answer that question is the work working? I do think that’s the bravest question that a professional educator can ask. I want to evaluate my own teaching and that category of assessments is called progress monitoring assessments mm-hmm <affirmative>. And we can use that to make determinations over a relatively short period of time about the effectiveness of our instruction and wise administrators can use that kind of assessment to make determinations about the effectiveness of an entire curriculum or a entire grade level. All most of these kids are making good progress or oops. Look at this fifth grade class it’s the whole fifth graders are not making sufficient progress. So it’s very valuable information to then use, to go back to those precious work that we do, the hard work that we do of teaching. So we wanna be smart. We wanna be strategic. We want to be efficient about the assessment. We never want to do one Ioda one, one minute of extra assessment that we don’t have to do, unless it answers a key question that makes us better teachers.

Speaker 1 (45:41):

Mm that’s great. I wanna go back to that progress monitoring. Mm moment. Mm-Hmm <affirmative> and what you said about that’s a that’s that’s a scary moment because sometimes teachers can take that to mean, I didn’t, I was the failure maybe, right? Like this is something maybe I did, but if we put it and this was just an aha moment for me right now, mm-hmm <affirmative>, if we put it in the context of the medical field, a doctor gives us a prescription and we back to have a six week check on that. How are you doing? Doctor says, mm, not so well, re really, so let’s try something else. There’s no, there, like there’s no value judgment there, right? It’s just like, well, this didn’t work. That’s okay. Let’s try the next thing. How can we encourage teacher to get to that place where it’s like, it’s okay. It’s about how the kids responding to this teaching and if they’re not responding, that’s all right. Let’s try another way.

Speaker 2 (46:42):

That’s exactly right. Well, this has been another mission of my work a few years ago, many years ago, at this point, I wrote a book called educator as physicians, and it was all about collecting the right data, which is as little as possible using it to make good decisions, including planning, instruction, and monitoring progress. But that analogy of educators as physicians is when I continue to use that book also. So is out of print. But I have another wonderful opportunity to collaborate with a colleague. Margaret Goldberg has said that she would be, I know, Aw,

Speaker 1 (47:29):

She is one of my favorite people in the world.

Speaker 2 (47:31):

Omar. She is amazing. And she has said she read I was writing a new version, an updated version of that book. And she expressed some interest in assessment, which not all teachers do. So I asked her to read an early draft of the book. And I said to her based on your re on your reaction I’m, you know, I’m, I may ask you to come on as a co-author and she agreed to do that. So it’s very much in the background because she’s full time teaching, working as a reading coach this year, and I’m busy too. But today I was working on a webinar based on that concept. And the webinar is about educators as physicians. And it’s that exactly your aha moment that we are responsible for the academic health and wellness, as well as the behavior and social, emotional wellness of our children.

Speaker 2 (48:35):

Just like a physician is responsible for the physical and, and depending on their, their field, the psychological wellness, we, in order to do that, well, we do need to collect data and just like a physician, it would be malpractice. If you come in with a sore throat that they say, okay, let’s do a cat scan of your spine. Let’s do a biopsy of your liver. Let’s do like what? No, let’s not collect too much data. I’ve got a sore throat. Why don’t you examine my throat and maybe take a swab? You know, it’s so not too much data data, but the, but some data and the right data, use that to make a determination of what should we try? Let’s try some medicine, let’s try some antibiotics and your statement that, okay, I tried the antibiotics I’ve taken ’em for three weeks or whatever.

Speaker 2 (49:28):

I come back and say, still sore. We don’t say, okay, doctor, we, we take away your medical license. Clearly you have failed. No, it medicine, the human body getting the human body well is very complex. Getting the brain to learn to read is very complex. We try some things sometimes we’re right. Sometimes we’re a little bit, right, but we need to do it differently or more. That’s what progress monitoring data can help us do. But it is brave cuz it’s a new question for teachers it’s it is part of the training that physicians get. They have to sit around with colleagues and their teachers and do case studies and grand rounds. And they are grilled. When they say, okay, the patient presented with a sore throat and I did these diagnostics and everybody said, why did you do those diagnostics? Why didn’t you do different diagnostics?

Speaker 2 (50:29):

Why didn’t you do this? That they’re grilled upon that. And then they say, okay, well that, but okay. And then I di I prescribe this and everybody jumps in, why didn’t you prescribe this? Why didn’t you SCRI there from the beginning of their work experiencing that kind of prof for good professional reasons, not to chop people down and make them feel bad, but to deepen their learning and to test their own thinking and to hear new ideas. I wish, I think that’s a potential for PLCs that are happening in school, for sure. Yeah. If we brought our student data and said, I’m doing the best I can, but this student is not making progress. Not I’m a failure, but help me colleagues to think about this differently. Should I have di should I have administered different assessments? Should, are there some interventions that I should be doing that I haven’t thought of yet?

Speaker 2 (51:28):

Or I’m only, I can only see this student twice a week for 20 minutes. Is there something else? The group as a whole, the system as a whole, can we teach him, can we find an two more 15 minute or 20 minute slots during the week? There’s all kinds of things that we should, should do that mirrors not to say that the medical world is perfect and has answered every question by any stretch of the imagination. But I think there there’s something about that analogy and some something that can, some things about the way they’ve done their work, that can be helpful to us.

Speaker 1 (52:07):

Yeah. That’s great. Well, so we’re, we’re gonna look forward to another Jan book coming sometimes. Shannon,

Speaker 2 (52:14):

Margaret, I’m hoping

Speaker 1 (52:15):

<Laugh> well, as we sort of wrap up here what, what final thoughts or advice do you have for our listeners?

Speaker 2 (52:23):

Hmm,

Speaker 1 (52:24):

Tough

Speaker 2 (52:24):

One. Well, all of you listeners out there who are engaged in this amazing work that we are doing of working with children keep it up and bless you. And thank you for choosing this profession. I know in this day and age, I’m even more grateful because unlike me and many of my peers back in the 50, when we were choosing our career, the options were really, maybe they weren’t as limited as we thought, but we were kind of put into it, just a few boxes. So I know that these young men and women who are choosing to be educators nowadays have many, many other choices. So I’m, I’m really grateful when I see these bright, eager people choosing this very challenging career and being brave enough to continue to grow and take risks, to take on new responsibilities, like coaching, if someone comes along and taps you on the shoulder, like I was to suggest trying something new yeah, that’s a good thing to do.

Speaker 2 (53:37):

And those people who feel called to move into administration that those are in incredibly important roles. And some of us will then also as I did move into higher ed and teacher education, that’s there’s just many, many options for professional growth, but the, the rewards just continue. I mean, there’s nothing like watching the light go on in a child’s eyes and you had something to do with that, that they get it, that this letter says, Hmm <laugh> or this multi syllable word really can be really can be decoded and has meaning or that this amazing piece of literature can speak to your soul or open worlds that you never imagined. So, yeah, that’s it’s just a wonderful place to be. And I’m grateful for you Susan, to bring these messages to so many educator, it’s one of the silver linings of the pandemic, right. Is we found ways to connect with each other and create this really global community. And I think it’s just fantastic. And your podcast is playing a big role in, in doing that.

Speaker 1 (55:05):

Well, thank you, Jan, and thank you again for the work you do. It’s been so great. Our listeners will get linked in the show notes to the book for sure. And we just appreciate you being here.

Speaker 2 (55:17):

It’s been my, my, my honor, and a great deal of fun to <laugh> walk back through some of the, some of the big moments of my long professional career.

Speaker 1 (55:31):

Thanks for listening and keep your feedback coming. Want to learn more, be sure to stay connected by subscribing to your favorite podcast app and join our Facebook discussion group science of reading the community. Don’t forget to register for our new webinar series. The science of reading is for everyone over the next few months, experts, including Natalie Wexler, Dr. Jan Hasbrook and Dr. Carolyn STR will discuss how the science of reading can help all students, educators, like you will talk about their journeys with the science of reading and why making the change is worth it.

“quote”

– Dr. Jan Hasbrouck

Education Consultant, Author, and Researcher

Meet the guest

Dr. Jan Hasbrouck worked as a reading specialist and coach for 15 years and later became a professor. She is the author and coauthor of several books, and her research in reading fluency, academic assessment and interventions, and instructional coaching has been widely published. She continues to collaborate with researchers on projects related to assessment and intervention.

About Science of Reading: The Podcast

Science of Reading: The Podcast delivers the latest insights from researchers and practitioners in early reading. Each episode takes a conversational approach and explores a timely topic related to the Science of Reading.

Stay connected!

Join our community and get new episodes every other Wednesday!

We’ll also share new and exciting free resources for your classroom every month!

You might also like: