You can visit the palace site as long as you obtain prior permission. The palace used to be the castle (the Edo Castle) of the Tokugawa shogunate, but it became the palace for the Imperial family in ...