I know it’s been quiet around here; the summer is usually a mad rush to get as much research done as possible without the time constraints of teaching, and it’s no different for me. This is especially so in the “final push”, as it were, but thankfully I have a bit of breathing room as projects move from my desk to those of the people who will make decisions. In the meantime, I’ve also been exploring the possibilities of part-time work to supplement my teaching income (we get about $300 less a month compared to doing research, which is pretty substantial on a grad student budget), and have had particular luck so far pursuing a position as an ACT/SAT tutor with Kaplan. It is that experience that has most recently provided me with fodder for my musings about higher education, and I’d like to share some of those.
As part of seeking this position, I am required to provide my SAT/ACT scores as evidence that I am qualified. Now, although I know those scores are around somewhere, I also know it would take a lot of digging and hoop-jumping to find them; given that this is really a side project, that’s not a time investment I was willing to make. Moreover, those test scores aren’t exactly, well, recent…if I remember correctly, I last took them as a junior in high school, which puts them on the upward side of ten years ago. I can’t honestly say 12-year-old scores are necessarily representative of my ability today to recall material that was tested back then. So, I decided to just bite the bullet, take a couple hours, and sit down to go through both tests again (mind you, these are provided by Kaplan, not officially sanctioned tests). I’ll also admit: I was more than a little curious to see how well I retained what had been taught in high school (in hindsight, a qualification exam was perhaps not the best time to indulge that curiosity). My experience and my results revealed some surprising things to me, particularly observations about the nature and quality of the tests that I would never have noticed before becoming an educator.
When I am designing an assessment, I not only want to make sure it covers the appropriate material from class, but also that it makes student use that material in a way that expands beyond the course. Ideally, my assessments test students on things they will actually need to know and do perhaps 5 years after my course; as a corollary, if my tests are well designed, students should be able to do as well (if not better!) 5 years after the fact. This is the same ideal I used to assess the quality of the SAT/ACT, and I have to say I was actually pleasantly surprised! I’ve always been rather dubious of the quality of standardized tests in general, so it was much to my shock that I either scored about the same or even improved on my scores of 12 years ago. Of course, I did go to an excellent high school, which helps in the long run, but if my “years after the fact” assessment ideal is valid, then I can say these two tests are actually surprisingly good. BUT…I have some issues with them.
First, based on my experience, the ACT – even though it is less popular – is from an educational standpoint a better test. Not only is it generally better well written (I took these back to back, so I can say that for certain), but it tests its concepts in a real-world and meaningful way. This is especially true of the science section, and even I – a professional scientist – had to stop and think about some of the critical thinking sections. I use all of the skills in those sections (reading, writing, math, and science) on a daily basis, and lo and behold, I made a perfect score of straight 36. To me, that says that not only am I an irredeemable nerd, but also that in the long run, the ACT is actually testing appropriate material in an appropriate way. The SAT, on the other hand…
I will be honest, I have never performed as well on the SAT as I have on the ACT, though after a couple of classes, I always solidly landed in the 99th percentile on both tests. This time, however, I didn’t even quite make 90th percentile on math (reading and writing were a different story)! Now mind you, it’s been a while since high school math, but my scientific career is at least partially built around complex differential equations. Nevertheless, when presented with a slew of geometry problems, I was stumped; worse, the reason that I was stumped is that I had forgotten many of the formulae that would be used. In other words, I was not being tested on my ability to identify and solve problems mathematically, I was being tested on my ability to remember information. Moreover, it’s information I never used again, one of the biggest complaints I hear levied against high school math. I always used to think that such complaining was nothing more than a case of teachings failing to articulate the importance of their content, but after taking these tests, I feel that there may just be a kernel of truth to the “I’ll never use this again” crowd.
Of course, I freely admit that all of this is just musing based on my own limited experience; I can’t provide the same sort of reasoned argument I usually try to give, though I bet enough digging would reveal that there is indeed evidence to inform these musings. For now, I have to keep chugging through on this application process (and this “dissertation thing”), but it just goes to show you: you never know when you’ll get some profound insight about what you do.