The 'Big Brother' and 'The Challenge' alum might be known for his 'Vacation Alliance' association, but he struggled with the globe-trotting adventure.