Wednesday, December 10, 2014

I just flew into Paris for a
single day of the Axon@LeWeb event. I presented our protocols.io, in a lineup
with 14 other terrific startups. But no sane person flies into Paris, in
December, to spend a day in a conference hall outside of the Paris everyone knows
and loves. Certainly you don’t do it for a 10-minute presentation. Of course, I
may be crazy, and all startup founders are to some extent, but I had a very
good reason to attend and I do not regret for a second the crazy flying and
exhaustion that I am experiencing at this very moment. No regrets for two
reasons:

a. I support enthusiastically
Victor Henning’s effort to showcase science startups. In a sea of interesting general-audience
companies at LeWeb, there is no way that an amazing company like Publons
(opening up peer reviews for all to see), can get featured at the main event.
Therefore, it is important to set up the precedent for an event that highlights
science startups to the right audience of investors, reporters, and others in
the science space. I am glad Victor did it; I hope it’s not a one-time event;
and I want to help it succeed as much as possible.

b. Researchers attend
science conferences for the opportunity to talk to other scientists. We don’t
go to hear a specific talk. The talks are nice, but the true
value of the science conference is in the productive discussion and
brainstorming after the sessions. The same holds true for a meeting of scientists who founded startups. As expected, the two hours of
discussion prior to our presentations, and the 6 hours of Paris metro, dinner,
drinks, and more metro after the event itself – this is the part that was truly
exhilarating, fun, inspiring, thought-provoking, and productive.

Throughout the course of our day together, we shared perspectives on other science startups, not at the event, but held in high regard by one or more of the assembled founders. Here are some of the science startups we like:

Thursday, November 20, 2014

There is a reason why you often hear entrepreneurs say something like, "I have three kids - two daughters and a startup." It's because parenting and being a founder have countless similarities. They are not identical since a startup, unlike your toddler, isn't going to bite you. And despite the biting, you don't really want to sell your child, but eventually hope to do that with the startup. Still, the comparison resonates because kids and startups are both rewarding, exhausting, exhilarating and life-changing. You never stop thinking about them, you worry ALL the time, you panic, you don't sleep - and yet, despite it all, you still have another kid and start another company.

What puzzles me is how often people lash out at founders and criticize and question our motives and decisions. Why? I have thought for a long time of writing a blog about this, and a major Twitter storm yesterday that accused us of being EVIL finally gave me the needed push.

We have given up our jobs and careers, have made enormous sacrifices, have subjected our families to financial difficulties and worries because of the crazy drive to create protocols.io. Of course I want to make money on this. But the real promise here is not the lucrative exit but the opportunity to change science communication. It's the opportunity to save society billions of wasted dollars every year and to speed up research.

So when someone accuses us of trying to stifle innovation and science communication, it hurts much more than any random mean Twitter comment ever should. It reminds me of the person at the park who criticizes a mother giving a bottle to her infant, "Don't you know that breastfeeding is so much better for your kid?" Why the assumption that the mother is a bad parent who doesn't care about the kid? Maybe the mother's milk never came in or she had a mastectomy. Maybe she tried her best and after two months of excruciating pain had a nervous breakdown and switched to formula.

Parents and founders need help and support, not vitriolic criticism. And keep in mind that neither parents nor founders are experts. At ZappyLab, we have degrees in math, molecular biology, computer science and business, but none in parenting or startups. That's because there is no PhD for these. We are all amateurs who learn on the job. That means we are all trying our best and we are all making mistakes.

If you disagree with what we are doing, just consider that there may be valid non-nefarious reasons for our decisions. But if you are sure that what we are doing is a mistake due to lack of experience, please do reach out and advise us. We crave feedback and help. Most parents and founders will welcome the advice.

Monday, November 10, 2014

Arjun Raj has written a good post on why publishing papers is important for getting a faculty job. It is in response to my argument that having a Science/Nature/Cell (SNC) publication is not nearly as important for getting a professor job as most people think (I published a list of professors who got job offers before publishing their main postdoctoral work).

I am in violent agreement with Arjun on much of what he wrote, and disagree just as strongly with other parts of it.

Agree

"I definitely feel like my job search might have been easier with a
published paper, especially in biology/medical departments. And I have
definitely heard of places, for example in other countries, in which
applicants have been explicitly told that the job is theirs if and only
if their postdoc paper is accepted."

I never meant to suggest that publishing does not help to get a faculty job. Reading your manuscripts allows search committees to assess how you communicate your science, how you write, and how you think - all important for trying to predict whether you will be able to do good science, get funding, teach, and get others interested in your research - factors crucial for the hiring decisions, as Arjun points out. A university would be a crazy risk-taker to hire someone who has never published at all.

Disagree

"If the search committee understands the work and the researcher and
believes in them both, then why does the existence of an accepted high
profile paper matter so much in and of itself? A big part of the answer
is that visibility matters... Having a high profile paper when you
start is undeniably a part of the answer to these questions. And it’s
also a simple metric of success that is readily interpreted by people
across disciplines."

While publishing your work is clearly important and helpful for assessing you as a researcher, using the journal/impact factor as a proxy is the opposite of good assessment. If instead of reading your papers, the committee invites you based on the name of the journal where you published, they are using a wrong and lazy metric. Your paper in Nature may be great or terrible, and it's impossible to say which one it is, without reading the paper itself.

Faculty searches are complicated with a million factors that play a role. Hope Jahren wrote a terrific comment on how faculty searches work, describing how unique each one is and that there is no formula or method that all universities or committees use. The list of faculty who got hired prior to publishing their postdoctoral discoveries makes it clear that having a paper in a fancy journal is not a prerequisite for getting a job.

Do publications help to get a job offer? Without a doubt. Does having your paper in a glam journal help? Yes, for some search committees it increases the chances you will be invited. But the correlation between hired faculty and glam pubs is driven by the quality of their work, as my list illustrates, rather than the name of the journal being the causal factor.

As I have commented already, "What I am arguing is that it's unclear if chasing the SNC paper helps or
hurts your chances of becoming faculty, all other factors being equal.
That chase - the rejections, rebuttals, resubmissions, followed by more
rejections, and resubmitting to another glam journal - carries a huge
cost. And if that costs you advances in your research, it's not
inconceivable that this very chase will hurt your chances of getting a
faculty job."

I'd love to see data on whether chasing the high-impact-factor publication helps or hurts postdocs.

Saturday, August 30, 2014

In my 2.5 years as a
co-founder of ZappyLab, the most surprising aspect of entrepreneurship for me
has been the realization that graduate academic training is just perfect for
founding a startup. I can’t think of any other training program that could have
better prepared me for the challenges of creating a company. The skills I
acquired in the 6 years of PhD work are precisely the ones essential for a
startup.

I will discuss in detail
below the specific similarities of academia and startups; however, I first want
to repost my answer to a postdoctoral researcher who asked if an MBA or some
business classes could help to transition from academia to industry.

As a
sixth-year postdoc, you have over a decade of training. You are more trained
than effectively the entire world labor force.

The last thing you need
now is additional classes.You are an
extremely valuable employee because you are a scientist. It’s not the pipetting
skills or the protein you have been studying – it’s the fact that you are a
scientist that makes you so valuable. You know how to research, form
hypotheses, test them, analyze and evaluate results, make quantitative
conclusions, and communicate the results to others.

The problem we
have is that we have not been exposed to non-academic careers. While good
mentors are supportive of all career plans (see here),
good mentors are rare. We are trained to be professors, even though only
a small fraction of the PhDs in life sciences will actually become faculty.
Non-academic careers are called “alternative”, even though the numbers make it
clear that it’s the professor job that is “alternative”.

Scientists
simply don’t know that they are valuable outside of academia. How many know
that intellectual property (patent) law firms will hire PhDs and will pay for
them to go to law school? How many know that life science venture capital firms
hire PhDs to evaluate proposals? How many scientists know that graduate
training is PERFECT for founding a startup? Think about lab meetings and the
qualifying exam – it’s all about presenting, communicating, and defending your
ideas. That’s exactly the set of skills key in pitching to investors. And
running a startup is all about experimenting, evaluating, and forming new
hypotheses. There are so many levels on which academia and the startup world
are similar, I could give a 2-hour talk on this! For the sake of brevity, I’ll
just say that I know many startup founders, and not a single one of them has an
MBA. Conversely, I know many MBAs, and not one of them has co-founded a
startup.

And
now for the concrete similarities.

Lab Meetings and Pitching
to Investors

This may be the most
valuable commonality. The qualifying exam, thesis committee meetings, and lab
meetings sharpen the communication skills spectacularly. You learn to make
effective presentation slides and to present to a small and hyper-critical
audience. You need to master the non-aggressive control. Answer all questions and the lab meeting just got away from you; you did not present the key data
and did not get advice on the parts you really care about. But you can’t be
dismissive or aggressive. Same thing with the qual – answer everything without
any control of the flow, and you never get past Aim 1. Most of all, these
meetings are all about fielding questions. Just as with control of the tempo,
this is an art. You need to convey confidence and defend your ideas and
positions. Yet, you also need to be open to advice. If you are too dismissive,
your colleagues will stop asking anything at your meetings, and that defeats
the purpose of the entire exercise.

The above perfectly
describes a meeting with an investor. These are strong and sharp personalities,
just as the researchers you are used to. They want confident answers and a
founder who has obviously thought through all contingencies. At the same time,
they don’t want to be cut off and don’t like feeling stupid if you belittle
their questions. They also want to make sure that if they invest, you are a
type of founder who is open to advice and suggestions. Investors don’t like to
think of themselves as just wallets; many will be getting a board seat, and if
you don’t listen to anyone, they won’t want to be on your board and that means
won’t want to invest in your company.

Handling Rejection - the Manuscript Reviewers and Venture Capitalists

Good results, getting your
PhD, publication, fellowships, funding, faculty position, and tenure all have
something in common – unpredictability. The only thing that is guaranteed in
academia is Rejection. Getting your first manuscript rejection letter is a
stunning and long-lasting level of pain. Pain killers don’t help, and the only
remedy I know of is to lose yourself in reading famous rejection letters to Nobel Prize winners and authors like Nabokov.

I never thought that I would
one day view my rejections from every single postdoctoral fellowship in a
positive light (interestingly, my postdoc proposals were really good
scientifically but not funded; meanwhile, my graduate NSF proposal was terrible
but I got it). The academic rejections seriously thickened my skin. Without
this, I could not have handled the constant stream of “NOs” that every startup
experiences (if you think getting a “yes” to a paper from an academic journal
is hard, try getting a “yes” to a huge sum of money in an investment or a
business deal).

And I certainly never
thought that I would view my two manuscript rejections in a positive
light. Well, I do. It gave me the opportunity to learn how to write a rebuttal.
The rebuttals worked both times. The key with rebuttals, just as with
presenting and fielding questions, is to strike the right tone. The rebuttal
has to be strong, but it can’t be angry. You have to use the reviews and investor
rejections to improve your manuscript/slide presentation/offer. Need to
identify the weak parts of your communication, strengthen them, and eloquently
and diplomatically explain why the reviewer/investor is wrong and why your paper
deserves to be in the journal and why investing in your startup is in fact an
opportunity the investor cannot miss.

Risk

As you embark on the PhD/startup, you are assuming a crazy level of risk. Years and years of effort, with hope but no guarantee of success. Miniscule financial compensation. Stress, self-doubt, and burnout. The one thing that drives you is the passion and belief in your project (passion and belief that is far from constant and often hits such lows that even you don’t understand why you are not dropping it).

Perseverance

Einstein, Ben Franklin, and Mark Twain have all been credited with the quote, “The definition of insanity is doing something over and over again and expecting a different result.” Regardless of the source, this remark brilliantly catches what my experimental research was like for a decade.

Whether you are in science or humanities, getting a PhD is extraordinarily hard. It requires years of a super-human level of commitment and perseverance. So does a startup.

If you don’t learn to
control the impostor syndrome, you can’t succeed in academia, and you certainly
can’t succeed with a startup.

Research Proposals, business plans, and experiments

I often see people comparing
writing a research proposal to a business plan. It is true that in both you
make up rosy projections and the people reviewing summarily dismiss them.
Beyond that, I disagree that this is a valid comparison.

I personally think business
plans are a waste of time. Not a single savvy investor has asked to see our
business plan. Y-combinator explicitly says it never reads them. Many startups, including ours, do end up writing one, but usually that’s
because one of your angel investors or their spouse went to business school and
asks for it, for no good reason.

A research proposal is very
different from a business plan in that you outline a series of experiments. You
have to formulate the experiments in a way that leads from one question to the
next, keeping in mind that for each experiment, the outcome may be A or B. You
can’t plan on “A” because “B” is just as likely. What if the hypothesis in the
first section is wrong? How do you move on to the next section? This is the
tricky and valuable part of writing a research grant proposal. And this is the
part that is relevant for a startup – the setup of the experiments and the
evaluation of your hypothesis.

One of the main things you
learn as a scientist is how to properly test a hypothesis. This is key for
startups. A startup itself is a research project. You are experimenting,
adjusting based on user feedback and data, devising new experiments, and switching
to a new project/pivoting if the first one does not work. Research is just as
unpredictable as startups. And it is also important to know when to ignore your
research plan. Some of the most interesting and important discoveries happen
accidentally, just as many startups are founded to do one thing but end up
switching and succeeding with an entirely different product.

Your PI, thesis committee, and the startup advisory board

When I give talks and advice
on founding a startup, I think my most valuable suggestion is to get good
advisors. Don’t worry, there is plenty of trial and error and you definitely
will learn from your mistakes. But if you don’t get advice and try to make all
the mistakes you are fated to make, instead of learning, you’ll just fail.
Similarly, the role of the PI and the thesis committee and your labmates is to
limit the number of mistakes you make, so that you graduate in 6 instead of 66
years. That is also why I have always stressed to students picking a graduate
or postdoc lab not to underestimate the importance of a good advisor (see my
recent "Your mentor can make or brake your academic career").

The second-most valuable
suggestion I offer is to learn when to ignore the advice. Part of maturing as a
PhD student involves becoming the expert on your thesis project. And at some
point, instead of asking for guidance from your advisor, your job becomes
guiding your advisor to understand and support your experiments and plans. As important as good mentors are to your success, it is equally
important to learn that advisors like to advise and a huge portion of the advice they give you is wrong. At some point in your startup, you suddenly
start drowning in conflicting advice from your investors, directors, advisors,
friends, and users. If you listen to everything, you’ll just fail. Again,
filtering this is an art that you pick up with time, and academia provides you
with plenty of time and opportunity to become a master at this.

If you cannot tolerate criticism and post-publication scrutiny
or criticism of your work, science may not be the right place for you.

What unnerved me over the last few months about the STAP
discussions is not the efforts to reproduce or the investigation. I want more
rather than less post-publication discussion. What I am calling for is caution
in assigning blame, guilt, and allegations of misconduct and fraud in the court
of public opinion. Media, blogs, Twitter, and private discussions of the STAP
work have been full of heated rhetoric, mostly based on assumptions, and often without
realizing the damaging consequences of the vitriol. Out of sensitivity, in
light of Dr. Sasai’s death, I will not mention any specific posts or
individuals.

I draw the line at discussions of Dr. Sasai that focus on “he
was full of himself” or “was not a researcher any more and only thought about
fame” or “did not have the time to supervise his lab, so of course this
happened” and so on. These assign blame. They say that he could have and should
have detected problems and is therefore responsible. If you don’t have internal
knowledge of RIKEN CDB and Dr. Sasai, if you are not on the investigating
committee – don’t blog these thoughts. You don’t know what happened.

I draw the line at blog posts arguing that Dr. Obokata must have
done this intentionally; at blog posts saying that her citation count is low
and Dr. Sasai should not have promoted her. At articles focusing on Dr.
Obokata’s “lawyering up”. Do you know Dr. Obokata? If not, you don’t know why
she did what she did, you don’t know whether it was misconduct or genuine
error. Have you been in her shoes? If not, you have no idea why she has an
attorney.

My line is very simple – focus on the figures and the methods.
Not on the intentions and accusations of misconduct and assigning blame. Leave
that to the investigating committees.

------------------

And a few post scriptum thoughts.

1. Retraction Watch has been accused of witch hunts mostly
because of the comments that appear under their posts. People, it’s the
internet! Have you seen comments on YouTube? If we argue against RW because of
the comments, we need to shut the internet down.

2. (This is from my e-mail
to a professor who argues that Sasai should have never published it and
deserves the blame for missing such poor science.)

On a personal note, I should say that I came across blatant
fabrication once in my 13 years in science. It was another student in the lab
who had incredible imaging results with a paper that would win all top prizes.
Then the hard drive was stolen and all of the images were on it without backup.
Then the student lost interest in the project.

Of course, the professor, couldn't let it go. He put another
student on the project. The student couldn't reproduce anything. He put a
postdoc on it. Postdoc couldn't reproduce. It took a year. The original student
kept claiming it is reproducible. Every time the person did the imaging, it
would be at midnight with no one else nearby. Refused to have anyone watch.

I observed this from the side, incredulous. Finally, I felt so
bad for everyone else, I walked into the professor’s office and asked him how
certain he was that the data were real. I made an explicit accusation of fraud.
I said I did not think there ever were any results. The professor was stunned.
Couldn't believe it.

Soon after, the student got on a plane with the PhD in hand and
went back to the home country. My professor persisted for a few more months,
wasting time of yet another postdoc. Finally gave up. It's been years, and no
more talk of this research.

This was a very eye-opening experience. The professor is an
amazing scientist. Simply brilliant. Yet, somehow, he just couldn't see the
blatant fraud in front of him. It was so obvious. Red flags waving as if it was
Soviet Union. But he was as colorblind as it gets.

Luckily, this student pulled back. But had the student persisted
and finished the story, I am 100% sure it would have been published. As long as
you trust the people in your lab, you just can't detect fraud.

Not being from the Sasai lab, I would hesitate before making any
statements of what he should or should not have done/detected.