this post was submitted on 10 Feb 2025
141 points (98.6% liked)

Technology

62073 readers
4877 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

GenAI can inhibit critical engagement with work and can potentially lead to long-term overreliance on the tool and diminished skill for independent problem-solving.

Analysing 936 real-world GenAI tool use examples our participants shared, we find that knowledge workers engage in critical thinking primarily to ensure the quality of their work, e.g. by verifying outputs against external sources. Moreover, while GenAI can improve worker efficiency, it can inhibit critical engagement with work and can potentially lead to long-term overreliance on the tool and diminished skill for independent problem-solving. Higher confidence in GenAI’s ability to perform a task is related to less critical thinking effort. When using GenAI tools, the effort invested in critical thinking shifts from information gathering to information verification; from problem-solving to AI response integration; and from task execution to task stewardship. Knowledge workers face new challenges in critical thinking as they incorporate GenAI into their knowledge workflows. To that end, our work suggests that GenAI tools need to be designed to support knowledge workers’ critical thinking by addressing their awareness, motivation, and ability barriers.

all 26 comments
sorted by: hot top controversial new old
[–] sp3tr4l@lemmy.zip 34 points 2 days ago (2 children)

You see, an alternative way to make your AI pass the Turing test is just to use it to make all humans more stupid.

[–] azolus@slrpnk.net 12 points 2 days ago

Thanks, I hate it.

[–] FenrirIII@lemmy.world 2 points 1 day ago

Americans: Hold my beer.

[–] Famko@lemmy.world 10 points 2 days ago (1 children)

Do you think this is the reason why so much money is being poured into generative AI by tech bros and now the US government? Lessening the critical thinking skills of people who use it, which is a lot of people by now, so that they don't worry about what unethical things companies or the government does?

Something to think about, I suppose.

[–] rottingleaf@lemmy.world 5 points 2 days ago (2 children)

Yes. But I think I have a better viewpoint - they want to insert a blackbox mechanism between all our interactions.

A computer can be an instrument, a set of tools for our mind to do powerful things.

What such AIs do is to insert an easy to use layer between us and all those tools. A computer here encompasses computer networks, including global ones, and human communication over them. So even between us and all the world.

So ultimately it's a way to create Matrix. To control what we think, to control how things we want done are done. To intercept both outgoing and inbound signals, or falsify them.

I don't think this is even a question, when the world has a few dominating parties, they will want to exercise such control. It's not a conspiracy theory, it's how governments and huge companies and have functioned for all of history. Because humans are apes and when in power positions, should be brought down to sinful earth.

[–] IAMHEREDOTDOTDOTNOW@lemm.ee 4 points 2 days ago

This is The Patriots from Metal Gear Solid.

[–] Famko@lemmy.world 2 points 2 days ago (1 children)

I guess we should watch out for when they make an AI based VR "experience" then. That'll definitely turn into a Matrix like situation.

(Assuming it doesn't turn into complete garbage like that AI Minecraft experiment.)

[–] rottingleaf@lemmy.world 1 points 2 days ago

Nah, I think they've started with the most important part - text, specifically search. There were search engines which, while still honest, gave you direct access to sources in exchange for your time. There were search engines already dishonest, but still giving you that, just distorted. This integrates what could be scraped for you, so you can be fed any flavor of opinions and you'll consume that.

[–] rumba@lemmy.zip 11 points 2 days ago (4 children)

I wonder if there were articles like this when the pocket calculator came out.

[–] yogsototh@programming.dev 20 points 2 days ago (1 children)

If men learn this, it will implant forgetfulness in their souls. They will cease to exercise memory because they rely on that which is written, calling things to remembrance no longer from within themselves, but by means of external marks.

Plato against writing

[–] rumba@lemmy.zip 3 points 2 days ago

Thanks for that, also absolutely love your name.

[–] lunarul@lemmy.world 3 points 2 days ago* (last edited 2 days ago)

There are studies about how other tools reduced various capacities. Our memory capacity has decreased and how we use it has changed. People used to store a lot of information, now we only store a sort of index (we remember where to look it up, not the information itself). Our attention span has also greatly decreased with the shift to short form content (not a useful tool, but just another cognitive change).

[–] WalnutLum@lemmy.ml 1 points 2 days ago (1 children)
[–] rumba@lemmy.zip 1 points 2 days ago

It did! But we also ended up being more efficient per grey-matter mass.

FTA

This reduction in brain size however does not mean that modern humans are less intelligent. Human brains have evolved to work more efficiently and utilize less energy.

[–] amino@lemmy.blahaj.zone 2 points 2 days ago (1 children)

except calculators function as a disability aid if you have discalculia and actually foster your math skills instead of hallucinating a wrong result for your input

[–] rumba@lemmy.zip -2 points 2 days ago (1 children)

So you think that AI can't serve as a disability aid... Interesting.

[–] amino@lemmy.blahaj.zone 2 points 2 days ago (1 children)

we're talking about genAI here not AI in general. let's not kid ourselves...

[–] sunzu2@thebrainbin.org 3 points 2 days ago

A person who doesn't practice his or her trade is gonna lose the skill...

Owner class hates the idea that they have to rely on people with skills to be rich. Fucking doctors, engineers, lawyers... It is disgusting they get paid these wages when they really don't deserve any of it.

[–] tdawg@lemmy.world 10 points 2 days ago (2 children)

Honestly? I understand my code less when I use fancy auto complete

[–] rumba@lemmy.zip 7 points 2 days ago

I don't use the fancy autocomplete. I ask the AI to generate a boilerplate with X framework/language. Then I'll ask it to stub in whatever major features I know I'll want, maybe ask it for a handful of libraries.

Initial setup is all busy work.

[–] Traister101@lemmy.today 4 points 2 days ago

How fancy we talking? The most my fancy IDE tools extend to is like creating functions for me or creating a loop and junk like that. It's not writing any of my code more than autocorrect is writing an essay for me.

[–] jabathekek@sopuli.xyz 7 points 2 days ago
[–] MonkeyTown@midwest.social 1 points 2 days ago

I’ve only used genAI once, to re-write my resume. (And I played with image generation to sort of see what it can do and be a muse for me because I’m aphantasic, but I was wiiiiiildly disappointed.)

It spit out something less good than what I fed into it, hallucinated a ton of skills and experience I don’t have, and it looked like AI slop when it was done. So a lose-lose.

Might be good for people who don’t know things or who can’t write for shit (so your average first year college student, IME) but.. honestly it’s garbage if you aren’t average or below already. So I’m not surprised it’s ruining people’s ability to function.

Ai is a tool for dumb people (sorry. not sorry.) to land good jobs that dumb people shouldn’t hold or be hiring for, and that’s about it.