Story highlights

Ten physicians across the country have banded together to tell Columbia they think having Oz on faculty is unacceptable

Radiology professor says that he just wants Oz to "follow the basic rules of science"

TV's "Dr. Oz" holds a faculty position at Columbia University's College of Physicians and Surgeons

(CNN)Talk show host Dr. Mehmet Oz is defending himself against a group of doctors who accuse him of "manifesting an egregious lack of integrity" in his TV and promotional work and who call his faculty position at Columbia University unacceptable.

In a written statement issued last week, Oz said, "I bring the public information that will help them on their path to be their best selves. We provide multiple points of view, including mine which is offered without conflict of interest. That doesn't sit well with certain agendas which distort the facts. For example, I do not claim that GMO (genetically modified organism) foods are dangerous, but believe that they should be labeled like they are in most countries around the world. I will address this on the show next week."

That show was taped on Tuesday and in a clip posted online after the taping, he tells his audience he will not be silenced. The episode will air on Thursday afternoon in most markets, Friday in others.

It all started when a group of 10 physicians from across the country emailed a letter to Columbia University expressing disapproval that Oz is on the faculty.

The email sent to Columbia's faculty dean for Health Sciences and Medicine, Dr. Lee Goldman, said the group is "surprised and dismayed" that Oz is on faculty and that he holds a senior administrative position. Oz is vice chair of the Department of Surgery, at Columbia University College of Physicians and Surgeons.

Read More

'An egregious lack of integrity'

The email was sent by Dr. Henry Miller, a fellow in scientific philosophy and public policy at Stanford University's Hoover Institute. It was signed by nine other physicians from across the country, none of whom is affiliated with Columbia. They accuse Oz of what they call "manifesting an egregious lack of integrity by promoting quack treatments and cures in the interest of personal financial gain."

They go on to say Oz has "either outrageous conflicts of interest or flawed judgments about what constitutes appropriate medical treatments, or both."

The doctors argue in their emailed letter that Oz shows "disdain for science and for evidence-based medicine, as well as baseless and relentless opposition to the genetic engineering of food crops." It's worth noting that Miller previously worked at the FDA, at one point reviewing genetically engineered drugs.

As an example, they cite an investigation reported on the show in 2011 in which apple juice was presented as having unsafe levels of arsenic. The FDA disputed the findings and said the report was misleading and irresponsible.

This is not the first time Oz has been called out.

He was in the hot seat on Capitol Hill at a June 2014 hearing on false advertising for deceptive weight loss products featured on his show. Sen. Claire McCaskill, D-Missouri, and chairwoman of the Senate Subcommittee on Consumer Protection, Product Safety and Insurance, said at the hearing he was perpetuating scams, whether it was intentional or not.

Miller and the other doctors who signed the email echo that sentiment, saying Oz is misleading the public and they tell Columbia's Goldman that having him on the faculty is unacceptable.

An invitation to sign the email

The doctors, who are in different areas of the country and different facets of the medical community, all have a connection to Miller although they do not all know each other. CNN has reached out to all of them. Those who have responded say Miller invited them to sign the email.

Orlando, Florida, anesthesiologist Dr. Shelley Fleet told CNN when she received an email from Miller inviting her to sign the email to Columbia, she said of course.

"He's a charlatan, and Columbia elevating him to a position of authority is a credence and platform for misleading more people," she said in a phone interview.

Fleet was a classmate of Miller's at MIT.

Dr. Joel Tepper, a radiology professor at the University of North Carolina School of Medicine, is also a former classmate of Miller's.

He told CNN he does not have a vendetta against Oz. He said he just wants him to "follow the basic rules of science and state what he knows as fact as fact and state what he doesn't know as fact as not fact."

He and Fleet share McCaskill's example of Oz's promotion of "miracle weight loss drugs" on the show as failure on Oz's part to follow the oath taken by doctors to do no harm.

Dr. Gordon Gill, professor emeritus of medicine and of cellular and molecular medicine at the University of San Diego School of Medicine, wrote in a letter to CNN: "In discussions with Henry, I agreed that the imprimatur of Columbia Medical School behind Dr. Oz gave an inaccurate message to TV viewers and as Dr. Goldman and I are long time colleagues I was comfortable pointing out these problems to him."

Miller worked in Gill's research lab before he went to medical school.

While the email does not call for any specific action to be taken by the university, Miller told CNN in an email that the group's goal is "for Dr. Oz to resign from the Columbia faculty and decide that he'd prefer a career as a TV celebrity doctor."

Oz spokesman Tim Sullivan sent an email to CNN last week listing the names of five of the 10 people who complained about Oz. The email questions the integrity and even the qualifications of those who are pointing fingers at Oz.

For its part, Columbia University is standing by Oz.

Spokesman Doug Levy said in a statement, "Columbia is committed to the principle of academic freedom and to upholding faculty members' freedom of expression for statements they make in public discussion."

Levy added that the university's role is to foster research, and it will not take action that hinders public statements by faculty members. The university has no position on what faculty members say in public discussion -- that is their individual academic freedom and is provided to them in the university's governing documents, he said.

A cardiac surgeon, Oz came to Columbia for his residency after medical school in 1986 and rose through the ranks. He is also the director of the Cardiovascular Institute and Complementary Medicine program at New York Presbyterian Hospital. Oz rose to fame after frequent appearances on "The Oprah Winfrey Show" led to the creation of his own show and magazine. He is also co-founder of the consumer health website Sharecare.com.