2. She tuned her algorithm to her data set. Of course it did well on that set. How does it do on other data sets?

Her slides say that she did leave-out validation. Slides 7 and 8 suggest that she did validation on several different data sets, but don't give enough information to determine if those were truly withheld or if she did something different (e.g., new leave-out tests on each set).

brap:I tried to pull that stunt at the Science Fair too. Unfortunately the judges did not award my brilliant invention "The Fantastic Gropinator" with the blue ribbon. Apparently, medical science was not ready for the technology that is my hands, mouth, and rejected my patent for the "special veiny probinator meat wand cancer detector".