The Rt. Rev. Peter James Lee, who served for 25 years as the 12th bishop of the Episcopal Diocese of Virginia, died in Chapel Hill, N.C., on Saturday, according to the diocese. He was 84.