@bplein Before generative AI, people had the same behavior with other sources of knowledge, like encyclopedias. I remember seeing kids just copy and paste the content of a Wikipedia article without checking their sources. But they were just kids, and it's fundamental to teach them how to use an encyclopedia, that it's just a starting point, and if you want to go deeper into a topic, you have to check reliable sources.
I think the situation today is similar to your description. We have text generators that give convincing answers to the unwary, and those who haven't learned to question the sources of knowledge will accept LLM answers without any critical thinking. The same is true of encyclopedias, books, magazines, and any other sources of knowledge.
The importance of critical thinking has never been as important as it is today, especially given how easy it is to create disinformation campaigns using generative AI.