I guess I don't really know what this article is even saying.

there is a lot of work being done on getting smaller models to work locally or low costs servers.

I still think fine tuning a model that translates to/from your database is possible using a small model.