SAT Math Test inside scoop: Meet the Maker

- This is Sal Khan of the Khan Academy and I'm here with Arunan Roger Singham. What do you do at the College Board? I work on the assessment design and development team. I help with developing the Math Test, so specifically the SAT Test. - And when you say you help develop it, you actually write and review the questions. - That's right, I write a lot of the questions and review the ones that I don't write. - And when you are writing it and you are with this team of other folks who are writing it, what is the actual test in your mind trying to assess? What are y'all writing for? - The SAT Math Test is really aiming to collect evidence about a student's math performance, as you probably figure. So students are really expected to be fluent with, have a strong understanding of, and be able to apply, mathematical concepts and skills that are central to their ability to progress through a range of college courses and careers. - So it's really assessing a college readiness I guess, on top of-- - Exactly, exactly. - How do you guys collect or benchmark the evidence that you get on the test, on how people respond to the different items y'all construct? - We go through a long process. We work with a lot of middle and high school teachers, we work with college professors, instructional and assessment experts and researchers, basically to ensure that every question that is seen on the SAT reflects a skill or some knowledge that's important for college readiness. So basically every question that you see on the SAT is specifically designed so that a student correctly answering that question shows that they have some specific understanding, so some specific content knowledge or some kinda skill. - This is interesting, cause I think sometimes the perception is that, A, you guys just come up with maths problems to spread people out, see who can answer this, but it's not. It's really much more about, you guys literally go to people who have views on what does it mean to be college ready, what type of skills you need to be there, and those are the skills that you're trying to measure. - Absolutely, absolutely. So it's not just about finding out, writing a really tough question that no student's able to answer. We actually want to measure something tangible by a student answering a question correctly. - Yeah yeah yeah, and what type of math questions would a student expect to see? How far in terms of advanced math would they need to know, and other dimensions that y'all think about? - So most of the content on the SAT doesn't go beyond Algebra 2. We have several different, so the content is divided into four different domains on the SAT. We have what we call the Heart of Algebra, which is basically algebra. We have Problem Solving Data Analysis, which is primarily proportions, ratios, it has some probability and statistics as well as one of the other domains is Passport to Advanced Mathematics which is more non-linear equations, being able to play around with and manipulate expressions and then we have Additional Topics in Math which are basically a lot of geometry, so trigonometry, basic trigonometry, volume, surface area and things like that. - And how is the, especially with the SAT for the 2016 that y'all are working on probably as we talk, how is this test going to be laid out? What's in it, the test, the format? - So there are gonna be two sections. There's one where a calculator is not allowed, and the reason for that is that is that a lot of the content that we wanna assess is content that is based on procedural fluency and number sense and having a calculator available for that makes it difficult for us to actually assess that a student's able to do it. - Number sense is literally just being able to manipulate and conceptualize numbers well. - Absolutely. - And a calculator can-- - And a calculator does that very nicely, but we also wanna make sure the students can do that. So there's that section and there's also a calculator allowed section, which is where we're gonna have a little more of the calculation intensive items. So as we all know math problems don't always work out as easily as we'd like them to. You don't always have a whole number answer and sometimes you wanna put a 1.03 to the power of 30. That's not something you wanna manually do, so calculator comes in handy and we have a lot of questions like that on the calculator portion of the test. - And how is the test itself actually scored? - So there's a raw score. Basically as many questions as a student gets right is their raw score. You don't get dinged for any questions that you get wrong. And your raw score is put on a scale of 200 to 800 and that's the score that's reported out. - And that point about, you don't get anything wrong, you don't get dinged for getting a wrong question, you just don't get the points for that. That is a departure from where at least the SAT has historically been. - That's correct, yes. So what used to be referred to as the guessing penalty is now gone. - Right and that makes a lot of sense because if someone can do a little bit of deductive reasoning to rule out a couple of choices that actually is a skill, even in and of itself. So as someone who, I feel like I'm talking to the Wizard of Oz here, as someone who's actually writing items, who's at The College Board, who's thinking about what it means to be college ready, especially from a math point of view, what advice would you give to someone who is thinking about, or who is taking the SAT, especially on the math side of things, or broadly. - I would say preparation is everything, practice makes perfect as they say. So I would definitely start practicing early. Now we have this great partnership with Khan Academy so you guys are producing tons of content that students can practice for free, and it's great content. And I would say just get after it and start practicing. - Yeah and I'll just doubly underline that as someone, I've been making videos for a lot of the practice items that y'all are creating, that we're creating together. And when I've been doing it, the big thing that I'm discovering is these are the same things that are covered in high school and middle school courses but there is just a value to doing a lot of practice, just to learn math better. As you said, it's really just about measuring college readiness, and the more practice you're just gonna get more college ready. - Absolutely. - And quite frankly just doing the videos I feel more college ready already. - No one's ever complained about being over-prepared. - That's right. Well thanks so much for taking the time, this was really thorough, useful. - Thank you.