Without treatment, common ingrown hair cysts can cause scarring or turn into a recurrent problem ... but are more likely to develop in the armpits, legs, or pubic area in women.