When the liver is damaged, bilirubin builds up in the bloodstream and causes the skin and the whites of the eyes to turn yellow. This yellow color is often first seen on the face, hands, and feet.