Note this paper that will be presented at ICSE in a couple of weeks too.

https://arxiv.org/abs/2408.02487v3

The point being is that this is very much a very real and yet unsolved problem with LLMs right now.