By appealing to America's generosity, Wounded Warrior Project raised more than a billion dollars in donations since 2003 -- $300 million in 2014 alone.

But while the money was pouring in, it was also flowing out on lavish employee conferences -- $26 million in 2014.

Donors outraged by Wounded Warrior Project expenditures

"Let's get a Mexican mariachi band in there, let's get maracas made with the WWP logo put them on every staff member's desk. Lets get it catered, have a big old party," said Eric Millette, a retired army staff sergeant.

He took a job with Wounded Warrior as a motivational speaker, but after two years he quit.

"I'll be damned if you're gonna take hard-working Americans' money and drink it and waste it, instead of helping those brave men and women who gave you the freedom to walk the face of this earth."

More than 40 former employees told CBS News that spending by the charity was out of control. Two former employees were so fearful of retaliation they asked us not to show their faces.

Wounded Warrior Project now on Charity Navigator's watch list

"It was extremely extravagant. Dinners and alcohol and and, just total excess," one said. "I mean, it's what the military calls fraud waste and abuse."

Former employees also told us the excessive spending began when Nardizzi took over as CEO in 2009. They point to the 2014 annual meeting at a luxury resort in Colorado Springs as typical of his style.

"He rappelled down the side of a building. He's come in on a Segway. He's come in on a horse."

Nardizzi has defended the charity's spending. "If your only fixation is spending the most on programs, that's feeling good, but not necessarily doing good," he said.

Former Wounded Warrior employees accuse charity of wasting millions

But many major donors were outraged, including Fred and Dianne Kane. They raised $325,000 with golf tournaments, and are not pleased with allegations that only a little over half of donations went to help wounded vets.

"I feel like I am representing all these people who have donated over the years, all these seniors over 65 sending $19 month, all these people on fixed incomes," Fred said. "If no one is going to talk about this right now and it has to be me, then it has to be me."

Fred continued, saying he is done with WWP except for his new mission of trying to see change within the organization.

Sources tell CBS News the board has received preliminary results of a financial audit. And there are discussions under way about retired senior military officers who are being considered to take over leadership of the organization.

Late Thursday night, the Wounded Warrior Project released the following statement: