CFMEU boss' threats referred to police

The peak union body in Victoria has refused to condemn threats made by a CFMEU boss at a rally as federal Labor distances itself from the controversy.

CFMEU state secretary John Setka told a Melbourne rally on Tuesday the union was going to expose Australian Building and Construction Commission inspectors and make their children "ashamed of who their parents are".

"Let me give a dire warning to them ABCC inspectors, be careful what you do. You're out there to destroy our lives," he warned.

But Victorian Trades Hall Council Secretary Luke Hilakari did not condemn the comments, instead saying ABCC inspectors made it "hard for union officials to save workers' lives".

"If you'd been to the funerals these blokes have, you'd be more concerned about the ABCC running around like the government's ideological attack dog and endangering lives, than some off-handed comments at a rally," Mr Hilakari said.

Federal employment minister Michaelia Cash has referred the "intimidating behaviour" of the CFMEU boss to federal police and Victoria Police.

She told parliament during question time in the Senate on Wednesday that "violent thug" Mr Setka had reached a "whole new low".