You can wait at the bench in front of the Castle gate until it’s nighttime. Once it’s nighttime, you just have to approach the Castle gate. A guard will greet you and you need to follow her as ...