You don't have to take on employees. My one person business has been far more stable than my previous employment. I can lose a customer and still pay the bills, that wasn't the case when my only customer was my employer.

I agree with your original point, it isn't for everybody and it sounds like it wasn't for you. But I know many people who have managed to fit their business around their life rather than their life around their business.