Yes, same way we need to worry about people being fooled into sending tons of gift cards to scammers or letting scammers install trojans on their computer. There is a slice of the pie that is personal responsibility, but there is a larger piece where efforts can be made to prevent these problems by the developers or OEMs.
Only an idiot would take a response generated by an LLM as gospel. Do we have to worry about idiots on the internet now?