POCATELLO, Idaho -- Cory McCaffrey scored on a 34-yard run with 1:52 remaining as Portland State won at Idaho State for the first time in 12 years Saturday.

The 42-35 victory puts the Vikings (3-1, 2-0 Big Sky), led by second-year coach Nigel Burton, off to their best start since 2006. It was also PSU's first conference road win since 2009.

PSU had to overcome early turnovers and 21 penalties to come from behind and get the win. McCaffrey and quarterback Connor Kavanaugh combined for 430 rushing yards and six touchdowns.

Kavanaugh finished with 212 yards on 12 carries with four TDs. He also completed six of 11 passes for 102 yards. McCaffrey, coming back from a missed start due to injury, rushed 33 times for 218 yards and two scores.

"Everyone was doing their job. When I got to the second level (of the defense) guys sprung me. When every guy does their job, plays happen," Kavanaugh said. "(Idaho State's) scheme was to shut down Cory and that did a lot of good things for me. But, you can't ever shut down Cory, he's going to bust one at the end."

Idaho State (2-3, 1-2) converted one of two first-half PSU fumbles into a touchdown and led 11-6 at the end of the quarter. PSU had two big plays on one drive on a 30-yard reception by Justin Monahan then a 33-yard touchdown run by Kavanaugh. PSU failed on a two-point conversion.

Trailing 14-6, Kavanaugh opened the second half quickly, completing a third-and-12 pass to tight end Gage Loftin, who rumbled 45 yards to the ISU 7. Three plays later, Kavanaugh knifed into the endzone from five yards out, and PSU finally led 20-14.

Following a defensive stop, Kavanaugh had another big play with a dodging, weaving run of 43 yards. That made it 27-14 Vikings. But, Idaho State came back to take the lead 28-27 after two touchdowns by receiver Rodrick Rumble.

The Vikings and Bengals traded leads again in the fourth before a bad ISU snap on a punt set the Vikings up for what would be McCaffrey's 34-yard game-winning run.

PSU totaled 538 yards, including 436 on the ground.

"It's an unbelievable feeling," Kavanaugh said of the conference road win, "and its going to give us confidence going into next week. I like where this team is at. We're playing strong and finishing."