He's also built a closed-source LLM inference engine, which he's been maintainin... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		simonw 18 days ago \| parent \| context \| favorite \| on: Fabrice Bellard Releases MicroQuickJS He's also built a closed-source LLM inference engine, which he's been maintaining since the GPT-2 days: https://bellard.org/ts_server/ and https://textsynth.com/

ronsor 18 days ago [–]

I used to play around with Textsynth, but not being OSS killed the appeal for me once llama.cpp came around.

brabel 18 days ago | [–]

I thought Bellard might be behind even llama.cpp (that would be completely expected for Bellard) but it's actually another great who's done that: Georgi Gerganov: https://github.com/ggerganov

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact