Every time I read an LLM's response state something like "I'm sorry for X", "I'm happy for Y" reminds me of the demons in Frieren, where they lacked any sense of emotion but they emulated it in order to get humans respond in a specific way. It's all a ploy to make people feel like they talk to a person that doesn't exist.

And yeah, I'm aware enough what an LLM is and I can shrug it off, but how many laypeople hear "AI", read almost human-like replies and subconsciously interpret it as talking to a person?