A memorial stone was taken from a graveyard at Cleenish Parish Church, and placed in a bin, police have said.