The recovery from that particular procedure doesn't seem to be significantly worse than getting a vasectomy, though the infertility is rather more permanent.
If it's any consolation I know someone who went through that and now wants them back. Ergo, there are problems if you go through that too. Perhaps it's too easy to do it...
Mine is not a philosophy. I'm closely related to someone who has to deal with the fall out of such procedures. The standards being met for surgery are fairly low and the psych evaluations are not always conclusive.