8
Discussing testing «discussion skills»  «They already do it in the class (a lot of times!)»  «Is it a good idea to test spoken language in written discourse?» «It may have benefical backwash effect. It can encourage students to pay attention to signposts» «They already do it... But let’s see if they can integrate sources and use appropriate strategies» «In this way, we can also test their critical thinking skills»

9
Part IV: Discussion Skills (4 pts.) The following excerpts are taken from discussions. Participate in each discussion as instructed. Express your views in 3-4 sentences. (2 pts. each) A: Read the transcript of a discussion on graffiti. Interrupt the last speaker appropriately, agree with Victoria, and support your stance by giving your own reasons. Victoria: I think one should consider graffiti from a broader angle. Graffiti is not limited to painted large letters on walls. Think of a graffiti artist like Banksy. I would love to have one of his paintings on my wall. Sadi: I do not think graffiti can be justified on any grounds. It is a form of vandalism and personally I would sue anybody, Banksy or Picasso, who would paint graffiti on the walls of my house. You: ______________________________________________________________

10
Sample answer: I am sorry but I’d like to make a point here. I think Victoria is right and we have to distinguish between different forms of graffiti. Besides, I’d also really appreciate a Banksy on my wall. First, his graffiti is full of important political and social messages which are worth spreading. Second, they cost a fortune. One of his graffiti works can make me a rich man. Criteria for marking: Signpost and stance: 0.5 pt. Support: 1.5 pts.

14
Success Rate in Different Sections of the Exam Part I (listening): 61% Part II-A (synthesizing): 72% Part II-B: (expressing opinions): 77% Part III: (organizing a speech): 78% Part IV-A: (discussion skills): 49.5% Part IV-B: (discussion skills): 49.5%

15
CHART DISPLAYING ST. GRADES IN PART IV AND IN-CLASS DISCUSSIONS

16
So? What does this mean? Is there a problem with the reliability of in-class speaking tests? Is there grade inflation on the part of the teacher? Is there a problem with the discussion grading rubric? Is there a problem with the validity of the written test? Are the two tests testing different skills?

17
A closer look at the extreme cases Grammar becomes more important in the indirect test. Repetitions & digressions may be overlooked in the direct test. Quality of ideas are scrutinized more in the indirect test. The criteria for the direct test is broader in scope. There are personality issues.