We care because productive use of capital create income that is taxed, that pays for things like healthcare, social services, etc.

Could we live with less productive capital? Sure. It wouldn't be anywhere near as nice.