MOOC Math Students Beat On-Campus Pass Rate

Udacity-San Jose State MOOC partnership, paused over poor early results, turns a corner and will resume.

10 Cool Back-To-School Tech Tools

(click image for larger view and for slideshow)

San Jose State University's (SJSU's) partnership with Udacity seems to be paying off after all, based on preliminary results from the program's summer term.

Statistics that SJSU published Wednesday night are the results that excited Udacity CEO Sebastian Thrun into declaring he was on the verge of discovering a magic formula for effective online education. At the time of that interview with InformationWeek, the numbers were still coming in. SJSU said it considers these results preliminary -- but solid enough to talk about.

In the SJSU Plus program, Udacity uses its massive open online course (MOOC) platform to host courses taught by SJSU instructors and offered for credit to enrolled students for a $150 fee. The same courses are available for free to any user of the Udacity.com website, but not for credit.

Poor results in an early test of the program this spring prompted SJSU to hold off on offering more courses this fall, but the summer program results offer justification for resuming the program in 2014, as planned.

Pass rates for elementary statistics and college algebra courses both improved significantly from spring to summer, reaching 83% and 73%, respectively. They now exceed the average pass rate for on-campus courses in those subjects.

The pass rate for an entry-level math course improved, but only to about 30%, compared with 45.5% for the on-campus equivalent. This is a remedial math course and SJSU's report emphasizes that, particularly in the spring, it was offered to students who had failed the course once before and otherwise would have been directed to go back to community college.

"A 30% pass rate does sound low, until you stop and think that most of these students would not otherwise have had access to the course at all," said SJSU provost and VP for academic affairs Ellen Junn in a statement.

The table below shows pass rates (students who scored a C or better).

Spring Pilot 2013

Summer Pilot 2013

SJSU On-Campus(based on past 6 semesters)

Elementary Statistics

50.5%

83.0%

76.3%

College Algebra

25.4%

72.6%

64.7%

Entry Level Math

23.8%

29.8%

45.5%

General Psychology

not offered

67.3%

83.0%

Intro to Programming

not offered

70.4%

67.6%

Junn pointed to three areas of improvement that made a difference:

-- Better orientation, particularly for students not otherwise enrolled at SJSU.

-- More encouragement along the way, including online tools to help students track their progress and mentors checking in with students more frequently.

-- More communication, with student feedback incorporated into changes in the courses. "We're also sending less email and more messages when students are 'in class' online," according to Junn.

A few other things were different. Although the spring semester boasted an 83% retention rate, over the summer SJSU let it drop to 60%, reflecting a "decision to be more flexible when students signaled to instructors that they needed to drop the course," according to Junn.

Some of the improvement in pass scores could be interpreted as a result of more students who would have failed having a chance to drop the course before they got to that point.

The summer enrollment was also much larger, with 2,091 students enrolled in five classes, compared with just under 300 students in three classes in the spring.

When SJSU Plus classes resume, the university wants to do more to "better sync our courses with our students' busy schedules," said Junn. Students also have asked for greater flexibility in course pacing, allowing them to speed up or slow down outside the confines of a semester schedule, and SJSU is investigating how it might make that work.

"To all those people who declared our experiment a failure, you have to understand how innovation works," Thrun wrote in a blog post on the latest results. "Few ideas work on the first try. Iteration is key to innovation. We are seeing significant improvement in learning outcomes and student engagement. And we know from our data that there is much more to be done."

I think we're going to see more kind of foundational course like these taught via cheaper, online options. Classrooms and team learning are indispensable for some subjects, but some subjects will be better done in online and self study mode.

There's no doubt Google has made headway into businesses: Just 28 percent discourage or ban use of its productivity ­products, and 69 percent cite Google Apps' good or excellent ­mobility. But progress could still stall: 59 percent of nonusers ­distrust the security of Google's cloud. Its data privacy is an open question, and 37 percent worry about integration.

IT’s tried for years to simplify business intelligence efforts. Have visual analysis tools and Hadoop and NoSQL databases helped? Respondents to our 2014 InformationWeek Analytics, Business Intelligence, and Information Management Survey have a mixed outlook.