I can't think of any case where inference doesn't care about latency. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jeffbee 23 days ago \| parent \| context \| favorite \| on: TPUs vs. GPUs and why Google is positioned to win ... I can't think of any case where inference doesn't care about latency.

cyanydeez 23 days ago [–]

I cant thinl of any reason training isnt going to become real time with a significant cpu budget.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact