Effect of Participation in Student Success Skills on Prosocial and Bullying Behavior

Melissa Mariani, Linda Webb, Elizabeth Villares, Greg Brigman

This study involved fifth-grade students (N = 336) from one Florida school district and examined prosocial behaviors, bullying behaviors, engagement in school success skills and perceptions of classroom climate between the treatment group who received the school counselor-led Student Success Skills classroom guidance program, and their peer counterparts (comparison group). Statistically significant differences were found (p values ranged from .000–.019), along with partial eta-squared effect sizes ranging from .01 (small) to .26 (quite large) between groups. Evidence supported the Student Success Skills classroom program as a positive intervention for affecting student engagement, perceptions and behavior.

While some forms of youth victimization have steadily declined over the years, bullying occurrences have remained relatively stable (DeVoe et al., 2004; Wang, Iannotti, & Nansel, 2009). Reports have indicated that 30–40% of students admit to regular involvement in bullying behaviors (Bradshaw, O’Brennan, & Sawyer, 2008; Nansel et al., 2001; Spriggs, Iannotti, Nansel, & Haynie, 2007). Additionally, statistics reveal that bullying is much more common among early adolescents than elementary age children (Bradshaw et al., 2008; Olweus, 1993; Ortega & Lera, 2000). In fact, notable increases in the rates of peer aggression occur during the transition years, in both grade 6 (beginning of middle school) and grade 9 (beginning of high school; Olweus, 1993; Ortega & Lera, 2000); therefore, targeting students prior to these peaks would be considered more proactive.

Recent approaches to combat the bullying problem have highlighted the importance of increasing students’ social competencies and coping and social interaction skills (Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 2011). Greenberg et al. (2003) offered that alternative approaches to managing problem behavior are most beneficial when they simultaneously foster students’ personal and social skills while improving the quality of the school environment. The philosophy behind incorporating these types of programs in schools suggests that in order for students to fully reach their potential, educators must address the whole child (Payton et al., 2008; Saleebey, 2008). Ultimately, building key skills in all children contributes to creating a positive, safe and caring learning environment, one that discourages aggression and violence.

The literature further indicates that the actions of those involved in bullying situations, including bystanders, can either enhance or damage a school’s climate (Catalano, Haggerty, Oesterle, Fleming, & Hawkins, 2004; Swearer, Espelage, Vaillancourt, & Hymel, 2010). Carney (2008) concluded that experiencing bullying firsthand, as well as witnessing bullying incidents, can be traumatic for students. It is evident that schools should be concerned about proactively addressing bullying behaviors. If not, significant consequences related to student behavior and academic achievement can abound.

Empirical Support for Student Success Skills

The Student Success Skills (SSS) classroom program (Brigman & Webb, 2010) is based on extensive research reviews (Daly, Duhon, & Witt, 2002; Greenberg et al., 2003; Hattie, Biggs, & Purdie, 1996; Masten & Coatsworth, 1998; Payton et al., 2008; Wang, Haertel, & Walberg, 1994; Zins, Weissberg, Wang, & Walberg, 2004) that identified three key categories of skills needed in order to grow, perform and achieve: (a) cognitive and meta-cognitive skills such as goal setting, progress monitoring and memory skills; (b) social skills such as interpersonal, social problem solving, listening and teamwork skills; and (c) self-management skills such as managing attention, motivation and anger. Recent evidence supporting the use of these skills, valuing the teaching of both academic and social skills in order to promote student growth and success, also can be found in the literature (Winne & Nesbit, 2010; Yeager &Walton, 2011).

SSS is a comprehensive, evidence-based, school counselor-led program that supports development of these key skills in students. This manualized intervention consists of five 45-minute classroom lessons spaced one week apart, beginning in the fall, usually in late August or early September. Three monthly booster sessions are then implemented beginning in January. A total of 20 strategiesare introduced and reinforced using a highly engaging “tell-show-do” format known to increase levels of student engagement and motivation. Each SSS lesson follows a structured beginning, middle and end sequence clearly detailed in the SSS manual. (Due to space limitations, readers are encouraged to review the Webb and Brigman [2006] descriptive article on the SSS classroom program).

Five outcome studies testing the effectiveness of SSS classroom and small group programs have resulted in positive effects on both student achievement and behavior, as well as perceived improvement in classroom behaviors (Brigman & Campbell, 2003; Brigman, Webb, & Campbell, 2007; Campbell & Brigman, 2005; León, Villares, Brigman, Webb, & Peluso, 2011; Webb, Brigman, & Campbell, 2005). A recent meta-analysis of these five SSS studies revealed an overall effect size of .29 (large), a medium effect size of .17 (equivalent to an additional half of a year of learning in reading) and a large effect size of .41 (equivalent to an additional full year of learning in math; Villares, Frain, Brigman, Webb, & Peluso, 2012).

While the SSS program has been shown to positively affect student achievement and behavior in general, comparison studies have not examined the impact of SSS on reducing bullying behavior. Consequently, the current study sought to measure the effects of the SSS classroom program administered by school counselors (Brigman & Webb, 2010) on student prosocial behavior, bullying behavior, engagement in school success skills and perceptions of classroom climate. The SSS intervention was selected because the cognitive, social and self-management skills taught in the program are associated with promoting academic and prosocial behaviors in youth, behaviors that enhance a positive school climate and discourage negative behaviors like bullying.

Purpose of the Study

The purpose of this study was to determine the effectiveness of the SSS classroom program (Brigman & Webb, 2010) on fifth-grade students’ prosocial behavior, bullying behavior, engagement in school success skills and perceptions of classroom climate. The problem addressed is significant for two reasons. First, a wide range of negative consequences can result from ineffectively dealing with bullying (Bernstein & Watson, 1997; Carney, 2008; Catalano et al., 2004; Deluty, 1985; Gini & Pozzoli, 2009; Olweus, 1993; Reijntjes et al., 2010; Swearer et al., 2010). Second, further research is needed to demonstrate the positive impact that school counselors have in schools. It has been stated that the school counselor’s role in addressing bullying in schools is crucial (Crothers & Levinson, 2004; Hanish & Guerra, 2000; Hazler & Carney, 2000; Hermann & Finn, 2002).

Research Questions

The following research questions were addressed: (a) Is there an increase in the prosocial behaviors of fifth-grade students after participating in the SSS classroom program? (b) Is there a decrease in the bullying behaviors of fifth-grade students after participating in the SSS classroom program? (c) Is there an increase in levels of engagement in student success skills (cognitive and learning, social, and self-management) of fifth-grade students after participating in the SSS classroom program? (d) Is there an improvement in classroom climate after fifth-grade students participate in the SSS classroom program?

Method

Participants and Sampling Procedures

Fifth-grade students (N = 336, 181 females and 155 males) from five public elementary schools in central Florida volunteered to participate in this study. The eligibility criteria included the following: (a) participating schools had to employ a certified school counselor, (b) school counselors had to agree to implement the manualized SSS classroom program (Brigman & Webb, 2010), and (c) in an attempt to create a whole-school culture, the school had to have more than one fifth-grade classroom participating. On average, each school contained 4–6 general education fifth-grade classrooms; 21 of these 22 classrooms in the five participating elementary schools were included in the study. All students in general education fifth-grade classrooms were invited to participate. Blended classrooms (e.g., multiple grade levels in one classroom) were not included so that generalizations among age levels could be made between schools. The volunteer sample (N = 336) mean age was 10 years old. Racial identifications included 7 (2%) Asian, 52 (15%) African American, 221 (66%) Caucasian, 43 (13%) Latino/a,12 (3.6%) Multiracial and 1 (.4%) American Indian. Thirty-one percent of the sample (n = 104) received free lunch and 7.1% (n = 24) were on reduced-lunch status.

The study followed a pre-post quasi-experimental cohort group design (Cook & Campbell, 1979). Random assignment of individual students was not conducive to preserving the nature of a whole-school culture, so schools were assigned to either the treatment or comparison group based on the order in which they volunteered to participate. The first three schools to volunteer were assigned to the treatment group (schools A, B and C) while the last two schools (schools D and E) were assigned to the comparison group.

Procedures

Following approval from the university’s Institutional Review Board, consent for research was obtained from the participating school district, school administrators, parents, teachers and students. In September, five certified school counselors from the participating schools received a 1-day training in the manualized use of the SSS classroom guidance program as well as other study-related procedures including instrument administration and electronic summary report instructions. The SSS program, consisting of five consecutive 45-minute lessons spaced a week apart, was then implemented in all fifth-grade classrooms in the treatment schools beginning in October. Monthly booster lessons followed beginning in January. Only students with parent permission completed the required instruments: the Peer Relations Questionnaire (PRQ), the Student Engagement in School Success Skills (SESSS) survey and the My Class Inventory-Short Form Revised (MCI-SFR). Students were ensured of the anonymity of their reporting by using generic school, classroom and student numbers. For a classroom to remain eligible to participate, a minimum of 80% of the students in the classroom had to return a signed parent consent form.

Treatment group. Schools A, B and C served as the treatment group (n = 209) and participating fifth-grade students in this group received the SSS classroom intervention. These students completed the following pretests in September 2010: the PRQ, MCI-SFR and SESSS. Implementation of the SSS classroom program began in October. Following the completion of the first five SSS lessons, treatment students completed the SESSS instrument (posttest). Booster lessons were delivered in January, February and March, and treatment students were then asked to complete the PRQ, MCI-SFR and SESSS following the final booster lesson (post-posttest).

Comparison group. Schools D and E served as the comparison group (n = 127) and did not receive the SSS intervention during the study. Students in these schools experienced business as usual, including any regularly scheduled school counseling programming. Comparison schools were eligible to receive the SSS curriculum after the study was completed. Participating students in the comparison schools completed the three instruments at the same time intervals (pretest, posttest and post-posttest) as students in the treatment group.

Instruments

Peer Relations Questionnaire – For Children – Short Form. The PRQ (Rigby & Slee, 1993a) was designed to reveal student experiences with bullying at school. The questionnaire takes approximately 5–7 minutes to complete and is comprised of 20 items in which students are asked to circle how often the statements are true for them. The answers range on a 4-point scale from never = 1, once in a while = 2, pretty often = 3, to very often = 4. The PRQ consists of three scales and several filler items: a Bully Scale, a Victim Scale and a Prosocial Scale; students in the present study took all three scales. Scoring is determined by the items contained in each of the scales, with higher scores corresponding to a propensity for bully, victim and/or prosocial behaviors (Rigby & Slee, 1993b). Rigby and Slee (1993b) reported the reliability of the PRQ using the following alpha coefficients: bully scale (.75–.78), victim scale (.78–.86) and prosocial scale (.71–.74), indicating more than adequate internal consistency. Recent evaluation of the PRQ’s psychometric properties by Tabaeian, Amiri, and Molavi (2012) supported it as a highly reliable and valid instrument that should continue to be used in research.

Student Engagement in School Success Skills Survey. The SESSS is a 33-item student self-report of cognitive engagement in SSS program skills and strategies, using language specific to the SSS curriculum, and takes approximately 15 minutes to complete (Carey, Brigman, Webb, Villares, & Harrington, 2013). Students are asked to circle how often they have engaged in a list of behaviors within the last 2 weeks (e.g., “I tried to encourage a classmate who was having a hard time doing something,” “I noticed when another student was having a bad day,” “I listened to music so that I would feel less stressed”). Possible responses include I didn’t do this at all, I did this once, I did this two times or I did this three or more times. The SESSS is intended for use with students in grades 3–12. Though a four-factor model was first revealed in an exploratory factor analysis conducted by Carey et al. (2013), a subsequent confirmatory factor analysis revealed the following three factors: self-direction of learning (which represents the combination of two original factors—management of learning and application of learning strategies), support of classmates’ learning and self-regulation of arousal, which correspond to the three subscales of the SESSS (Brigman et al., 2014). Coefficient alphas for the three SESSS subscales were as follows: self-direction of learning: 0.89, support of classmates’ learning: 0.79 self-regulation of arousal: 0.68, and 0.90 for the SESSS as a whole (Villares et al., 2014), indicating good internal consistency.

My Class Inventory-Short Form-Revised. The MCI-SFR is a 20-item instrument that intends to measure the perceptions of students in grades 4–6 of four areas related to classroom climate (satisfaction, friction, competitiveness and cohesiveness). The instrument takes approximately 10–15 minutes to complete and respondents are asked to select either “yes” (3 points) or “no” (1 point). Omitted or invalidly scored items receive two points. Reports on the psychometric properties for both the MCI-SF and MCI-SFR have indicated strong concurrent validity when comparing long and short versions across each of the scales (.91–.97). Additionally, some degree of internal consistency (largely adequate coefficient alphas) has been reported for class means with Australian children (.58–.81). The MCI-SF yielded more acceptable alpha coefficients for each of the scales (.84–.93) than did the long version, the MCI. Modifications to the revised MCI-SFR produced a better overall instrument, improving factor interpretability and reliability (Fraser, 1982; Sink & Spencer, 2005). Sink and Spencer (2005) reported that interpreting students’ responses from pretest to posttest on the MCI-SFR should be straightforward, with higher scores on the satisfaction and cohesion scales providing positive indicators of a healthy classroom environment, and higher scores on the competitiveness and friction scales suggesting needed improvement in this area.

Data Analysis

Individual students were the units of analysis in the study. An alpha level of .05 and one-way analysis of variance (ANOVA) tests were used to analyze differences in prosocial behaviors, bullying behaviors, school engagement skills and perceptions of classroom climate between students who participated in the SSS program (treatment group) and students who did not (comparison group). A post hoc Bonferroni correction was used to lessen the chance of a Type I error. Prior to the analyses, all the variables of interest were examined for accuracy of data entry, missing values, outliers and the normality of distributions. In addition, effect sizes (ES) were calculated to determine the practical significance of the SSS classroom program for the various student outcomes.

In this study, a partial eta-squared (ES; hp2) calculation was computed by SPSS (Field, 2009; Howell, 2008; Sink & Mvududu, 2010). The ES addresses the magnitude of the difference between groups or relationships between variables. The following benchmarks were used to determine small, medium, and large or strong ES strengths regarding hp2 calculations: (a) .01 small, (b) .06 medium, and (c) .14 large or strong (Green & Salkind, 2008; Sink & Mvududu, 2010).

Results

Preliminary ANOVAs were conducted on the students’ PRQ, SESSS and MCI-SFR pretest scores to determine whether statistically significant differences existed among the treatment and comparison groups prior to the implementation of the SSS intervention. No statistically significant differences were found on pretest scores; therefore, no covariates were used in subsequent analyses of students’ PRQ, SESSS and MCI-SFR posttest scores. Table 1 provides a summary of the study’s main findings.

Prosocial Behaviors

Research question 1 examined whether fifth-grade students who participated in the SSS classroom program would experience an increase in prosocial behaviors as compared to their peer counterparts who did not receive the intervention. Prosocial behaviors were assessed using the prosocial scale of the PRQ. A total of 188 students from the treatment group (schools A, B and C) and 123 students from the comparison group (schools D and E) were included in this analysis (n = 311). Findings from an ANOVA showed a statistically significant difference between groups, F(1, 308) = 18.708, p = .000 and hp2 = .06, a medium effect size. Participants in the treatment group (n = 188, M = 12.61, SD = 2.47) reported higher scores for prosocial behaviors at posttest as opposed to participants in the comparison group (n = 123, M = 11.27, SD = 2.81). Results indicated that students in the treatment schools reported engaging in prosocial behaviors more often at posttest than students in the comparison schools, highlighting the practical significance of using this intervention to positively influence student behavior.

The second research question asked whether fifth-grade students who received SSS would experience a decrease in bullying behaviors, assessed by the bully scale of the PRQ, compared to their peers in the comparison group. Results from a one-way ANOVA showed a statistically significant difference between the participants’ (n = 311) posttest scores, F(1, 308) = 5.708, p = .017 and a small effect size, hp2 = .02. These findings confirmed that students in the treatment group evidenced a decrease in mean change scores on the PRQ bully scale after SSS implementation, whereas students in the comparison schools reported an increase. Thus, students in the treatment group who received the SSS classroom intervention reported less bullying behavior at posttest than students in the comparison group.

Engagement in School Success Skills

Research question 3 investigated whether participating fifth-grade students who received the SSS classroom program would experience an increase in levels of engagement in student success skills (cognitive and learning, social, self-management) as compared to their peer counterparts. Results from the SESSS instrument were used in this analysis. A total of 115 students in the treatment group (schools A, B and C) and 85 students in the comparison group (schools D and E) were included in the SESSS analysis (n = 200). Table 2 displays the treatment and comparison group means, standard deviations, and change scores for the SESSS by school at the following three data collection periods: pretest (prior to SSS implementation), posttest (immediately following implementation of the five weekly SSS lessons) and post-posttest (at the end of the study).

Table 2

Treatment and Comparison Group Means, Standard Deviations and Change Scores for the SESSS by School

SESSS posttest score analysis. Findings from an ANOVA on the posttest scores on the SESSS (from the pretest in October to the posttest in December) showed a statistically significant difference between schools, F(1, 197) = 69.295, p = .000 and hp2 = .26, a large effect size. Students in the treatment group (n = 115, M = 2.50, SD = .642) evidenced higher levels of engagement in school success skills from pretest to posttest than their counterparts in the comparison group (n = 85, M = 1.73, SD = .617).

Finally, research question 4 investigated whether fifth-grade treatment group students would perceive an improvement in classroom climate as compared to students in the comparison group. Due to attrition, 308 fifth-grade students completed the four scales (satisfaction, cohesion, competitiveness and friction) of the MCI-SFR. Findings from an ANOVA using the MCI-SFR satisfaction scale posttest scores revealed a statistically significant difference between the treatment and comparison groups, F(1, 305) = 5.523, p = .019 and hp2 = .02, a small effect size. In particular, students in the treatment group (n = 187, M = 10.96, SD = 2.86) reported higher scores on the satisfaction scale at posttest than did students in the comparison group (n = 121, M = 10.39, SD = 2.74). The ANOVA tests on the other three scales of the MCI-SFR did not result in statistically significant differences between the treatment and comparison groups.

Discussion

The findings of this study reflect the connection between prosocial skills and reduced aggression, a finding which has been well documented in previous literature (Endresen & Olweus, 2001; Feshbach, 1997; McMahon & Washburn, 2003). School counselor interventions that focus on teaching prosocial behaviors have been successful in reducing aggressive behaviors such as bullying (Frey, Hirschstein, & Guzzo, 2000); these types of interventions also have been tied to improved academic achievement (Wentzel, 2003; Wentzel & Caldwell, 1997). The American School Counselor Association (ASCA; 2012) recommends that counselors cover academic, personal and social, and career domains as part of a comprehensive school counseling program. Results of this study support the delivery of interventions that incorporate the teaching of cognitive, social and self-management skills as a means to increase prosocial skills, reduce bullying behavior and promote a positive classroom climate. The design of the current study attempted to create a whole-school approach by implementing the SSS classroom program across an entire grade level (grade 5) in the treatment schools. Given that bullying peaks in the transition years, addressing the fifth-grade population was viewed as a proactive approach. SSS implementation resulted in some positive outcomes for those students, indicating that even a modified whole-school approach can be beneficial.

Previous SSS studies have documented the intervention’s positive impact on student academic performance as measured by standardized test scores in math and reading (Villares et al., 2012). Professionals in the field of counseling have identified a need to evaluate the link between the SSS program and intermediate variables related to student learning such as engagement in school success skills, prosocial behavior and perceptions of classroom climate (Carey, Dimmitt, Hatch, Lapan, & Whiston, 2008). Findings from the current study indicate that students who received the SSS intervention engaged significantly more in behaviors indicative of school success at posttest. These results are encouraging, since a body of research cites the negative impact that bullying can have on student academic achievement (Beale & Scott, 2001; Boulton et al., 2008; Nansel et al., 2001; Olweus, 1993).

The quality of a classroom climate also can impact students’ success. Although improved perceptions of classroom climate were predicted across all areas in the current study, statistically significant differences were only noted on perceptions related to satisfaction. The researchers postulate that treatment students were more likely to tune into questions pertaining to satisfaction, as this is a focus of the SSS program (noticing small improvements, focusing on the positives, and creating a safe, caring, supportive, encouraging classroom). The maintenance of a positive school and classroom climate directly affects whether or not students feel accepted and happy among their peers (Greenberg et al., 2003; Millings, Buck, Montgomery, Spears, & Stallard, 2012; Shochet, Dadds, Ham, & Montague, 2006). The literature indicates that the effectiveness of school counseling interventions can be greatly impacted by the school’s climate (Greenberg et al., 2003). Specifically, factors such as teacher adherence to the curriculum and staff buy-in can affect a program’s success (Biggs, Vernberg, Twemlow, Fonagy, & Dill, 2008; Yoon, 2004). Teachers should be involved in program implementation so that they become invested in its success. The current study addressed this area in that the classroom teachers were collaborators in SSS implementation. The program asks that classroom teachers be present during the counselor-led sessions so that they can cue students to use the skills taught throughout the regular school day. Thus, evidence-based interventions like the SSS program that emphasize school connectedness can be of benefit to students (Millings et al., 2012).

Implications for Practice and Future Research

The findings of this study support the use of the school counselor-led SSS classroom program as a practical means of impacting students’ prosocial skills, bullying behavior, engagement in school success skills and some perceptions of classroom climate, as indicated by various student self-report measures. Since the bullying literature calls for the use of multiple measures when attempting to link interventions to improvements, we recommend that additional studies track attendance rates, disciplinary referrals, bullying incident reports, and peer and teacher nominations, in addition to student instruments. Future researchers in this area also should gather data from teacher participants and vary the type of measurements specifically tied to prosocial and bullying behaviors (Pellegrini & Bartini, 2000; Van Schoiack-Edstrom, Frey, & Beland, 2002), as well as academic outcomes (Carey et al., 2008; Hall, 2006). This study sought to create a whole-school culture by incorporating the intervention across an entire grade level at each school. Future researchers might consider implementing SSS across several grade levels or throughout the entire school, as students across various grades often come in contact with one another throughout the school day.

Limitations

The participants were derived from one suburban school district and randomization procedures were not possible, thereby limiting the sample size and generalizability of the results. Likewise, due to one school dropping out of the study at the onset, the numbers between the treatment and comparison groups were not equivalent. The high level of attrition also was a limitation, specifically regarding the SESSS instrument. Though 336 students were in the original sample, only 200 of these were included in the analysis on the SESSS due to dropping out or not adequately completing the instrument in its totality at all three intervals.

The self-report nature of all three of the instruments was an added limitation, particularly with the problem of bullying. Students involved in bullying incidents, whether they were bullies, victims or bystanders, might be hesitant to report or indicate negative behaviors. This reluctance could have resulted in respondent bias and decreased reliability in the results.

Finally, the current study used only one component of the SSS curriculum (classroom program). Future studies might involve additional modalities, including individual and small group counseling as well as parent involvement. This study did not examine the impact of the SSS program over time. Follow-up studies are needed to support the long-term effectiveness of school counselor-led interventions that increase prosocial behaviors, reduce bullying behaviors and promote a positive school climate.

Conclusion

Results of the study provide support that students who receive the SSS classroom intervention led by school counselors (Brigman & Webb, 2010) evidence statistically significant differences in prosocial behaviors, bullying behaviors, engagement in school success skills and perceptions related to satisfaction with their classroom climate, as compared to students who do not receive the program. The findings provide empirical support for the notion that when students are taught skills in key areas (personal and social, self-management, and cognitive and academic) they benefit across social, emotional and behavioral outcomes. The study also suggests that aggressive behaviors such as bullying can be influenced by programs that do not specifically target these behaviors. Finally, this research points to the positive impact school counselors can have on student success, particularly when they deliver interventions that promote social competence among students. Providing school counselors with an evidence-based program that impacts students across several domains is of great value for school counseling practice.

Conflict of Interest and Funding Disclosure

The authors reported no conflict of interest

or funding contributions for the development

of this manuscript.

References

American School Counselor Association. (2012). The ASCA national model: A framework for school counseling programs (3rd ed.). Alexandria, VA: Author.

Beale, A. V., & Scott, P. C. (2001). “Bullybusters”: Using drama to empower students to take a stand against bullying behavior. Professional School Counseling, 4, 300–305.

Rigby, K., & Slee, P. T. (1993a). Dimensions of interpersonal relation among Australian children and implications for psychological well-being. The Journal of Social Psychology, 133, 33–42. doi:10.1080/00224545.1993.9712116