Do I need to do something run llamafile on Windows 10? Tried the llava-v1.5-7b-q... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		matsemann on Dec 13, 2023 \| parent \| context \| favorite \| on: Bash one-liners for LLMs Do I need to do something run llamafile on Windows 10? Tried the llava-v1.5-7b-q4-server.llamafile, just crashes with "Segmentation fault" if run from git bash, from cmd no output. Then tried downloading llamafile and model separately and did `llamafile.exe -m llava-v1.5-7b-Q4_K.gguf` but still same issue. Couldn't find any mention of similar problems, and not my AV as far as I can see either.

jart on Dec 13, 2023 | [–]

Did you try running it from cmd.exe or powershell? Could you try passing the --strace (or possibly --ftrace) flag and see what happens?

jshreder on Dec 14, 2023 | | [–]

On windows, you need to rename the downloaded .llamafile to a .exe

jshreder on Dec 14, 2023 | [–]

On windows you need to rename the .llamafile to a .exe

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact