The new GPT-4 model has a context length of 120k. For consumers this equates to ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		MattDaEskimo on Nov 30, 2023 \| parent \| context \| favorite \| on: Llamafile lets you distribute and run LLMs with a ... The new GPT-4 model has a context length of 120k. For consumers this equates to slightly more than $1/message input-only. If ChatGPT is using this model then it's more reasonable to assume that they are bleeding money and need to cut costs. People really need to stop asking ChatGPT to write out complete programs in a single prompt.

twobitshifter on Nov 30, 2023 [–]

Interesting, how is writing less code cutting costs for them? Does this get back to the rumor that the board was mad at Altman for prioritizing chatgpt over money going into research/model training?

afpx on Dec 1, 2023 | [–]

Code is very token dense, from what I understand.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact