Worshipper is arrested after churchgoers made an allegedly disturbing discovery and called police at St Mary Magdalene

An man has been arrested after allegedly carrying a knife into a Sydney church and interrupting worshippers during mass.

NSW Police were called after reports a man was acting suspiciously inside St Mary Magdalene Catholic Church on New South Head Road, Rose Bay, about 6.30pm on Sunday.

The 36-year-old man was arrested and taken to Waverley Police Station after officers discovered he was allegedly carrying capsicum spray and a multi tool with a knife. 

The Bangor man was charged with possessing a prohibited weapon and custody of a knife.

He was granted conditional bail to appear at the Downing Centre Local Court on July 26.

The incident took place during the middle of church's scheduled Sunday 6pm mass.