SIM cards are huge. Even the smallest form factor is a pretty large component. It has to be accessible from the exterior of the device and often has an ejection method of some kind. Getting rid of it is huge from a form factor standpoint.

I am sure there are downsides to eSIM but particularly for the average consumer who gets a SIM in their new phone and never changes it... there is probably zero difference.