Significant damage has been caused to Richmond Castle after multiple stones were chiselled out of one of its walls.