If your portfolio has been underperforming, you might need to fire your adviser. That gets tricky if you share a friend group.