The chat interface invites confusion - of course a user is going to assume what's on the other end is subject to the same folk psychology that any normal chat conversation would be. If you're serving up this capability in this way, it is on you to make sure that it doesn't mislead the user on the other end. People already assign agency to computers and search engines, so I have little doubt that most will never advance beyond the surface understanding of conversational interfaces, which leaves it to the provider to prevent gaslighting/hallucinations.