I was thinking about this recently... and in the early 2000s for a short time there was this weird chat bot crazy on the internet... everyone was adding them to web pages like MySpace and free hosting sites...
I feel like this has been the resurrection of that but on a whole other level... I don't think it will last it will find its uses but shoving glorified auto suggest down people's throats is not going to end up anywhere helpful...
A LLM has its place in an ai system... but without having reason its not really intelligent. Its like how you would decide what to say next in a sentence but without the logic behind it
No you can't use logic based on old information...
If information changes between variables a language model can't understand that, because it doesn't understand.
If your information relies on x being true, when x isn't true the ai will still say its fine because it doesn't understand the context
Just like it doesn't understand things like not to do something.