Discussion about this post

User's avatar
Jim Cook's avatar

This is a really well written, important post. Large Language Models (LLMs aka AIs) are really important tools. I've seen far too many articles ranging from "AI is mostly wrong" to "AI is going to eliminate jobs" to "AI is going to destroy humanity" and far too few articles about how this very important tool will change our minds and our world.

Although I'm retired, I still spend a lot of time online searching and reading about anything that is of interest to me (I have a lot of interests). About a year ago I started using the free versions of Gemini and ChatGPT. At first I used them as "super search engines." Before AI, I would often follow a trail of links and read the content of several dozen links from a search query to get a better understanding of what I was searching about. When I started to use the AIs, I found that I would accept the output without further searching if the output seemed to be accurate (even if I didn't know for sure). If I could clearly see something wasn't accurate, I would just revert back to a search engine and follow the trail of links.

After doing this for a few months, I noticed that I was accepting the AI output more and more without really following up because the output more and more seemed like a complete answer. Two months ago I subscribed to a paid version of Gemini because the free versions just didn't seem to be that much more useful than just using a search engine and I wanted to see if there was a difference. The paid version of Gemini (cheapest tier) seemed to be quite a bit more useful than the free version so I started using it for some personal projects.

One of my first projects was to use it like a personal assistant and ask it to provide me with a daily status report on topics of interest to me. I wanted a detailed list of summaries of any events relevant to each of more than 15 general topics with source links to each summary item. Since the topics were fairly general, I wanted many different summary items relevant to each topic and expected I would get a report of a hundred or more summary items arranged under the general topics. I didn't get that. I got 1, 2, or 3 items under each topic and generally did not get links to the source of the summary item. When I did get links, they were often a bad link or a link to content that had no relevance at all to the summary item. So, the "status report" about things I was interested in seemed to be useless and I was about to give up on the paid version.

I decided to "push back" on the responses I got so I started asking Gemini why it didn't give me more items on each topic, why it wasn't giving me source links, and why it was giving me bad links. The responses I got were kind of like excuses such as "must be a hallucination, I apologize. The correct link is: [new link]", etc.

I then started to ask why it made the mistake and why did I have to keep correcting it. That started to get responses about its internal tools, making responses based on its training knowledge rather than searching for something more recent, etc.

I then started to ask what permanent instructions I could give it to make it stop making the mistakes. It started to give me instructions I could add to its "memory." I added the instructions and it got better.

Now, I'm no longer just asking it questions and accepting the response. I'm pushing back on any mistake, asking it to explain something it put in a response, verify links before giving me a link, etc.

Anyway, this article has started me down another learning path. A couple of additional links related to the topic of this article.

https://pmc.ncbi.nlm.nih.gov/articles/PMC12848798/

https://news.harvard.edu/gazette/story/2025/11/is-ai-dulling-our-minds/

https://www.sofx.com/researchers-say-ai-triggers-cognitive-surrender-as-users-abandon-critical-thinking-for-machine-answers/

https://www.frontiersin.org/journals/education/articles/10.3389/feduc.2026.1759062/full

19 more comments...

No posts

Ready for more?