> The 16k output token limit is just an arbitrary limit in the chatgpt interface...

		OutOfHere on Sept 12, 2024 \| parent \| context \| favorite \| on: Learning to Reason with LLMs > The 16k output token limit is just an arbitrary limit in the chatgpt interface. It is a hard limit in the API too, although frankly I have never seen an API output go over 700 tokens.