He said Mr Brown had been wanted in relation to a residential burglary committed in Kerr Street on October 27 which resulted in a substantial amount of jewellery and other household items being stolen.

"Knowing he was wanted in relation to that burglary, Mr Brown committed an offence at a Karana Drive home," he said.

"About 10am on November 14 he saw the resident drive off, broke in but couldn't gain entry to the home through a laundry window."

Detective Senior Constable Hughes said that early in the morning of November 24 Mr Brown went to the Uniting Church in Koroit Street with the intent of stealing cash.

"He forced entry through a rear window using a pocket knife and entered the building," he said.

"An alarm was activated before Mr Brown got to the office and he fled before he could steal anything."

Mr Brown was arrested at 11am on Wednesday and later appeared in Warrnambool Magistrates Court via a video link with Hamilton court for a bail/remand hearing.

Police claimed Mr Brown was an unacceptable risk of continuing to offend and he was remanded in custody until January 12.