this post was submitted on 14 Jul 2023
64 points (97.1% liked)
Showerthoughts
29172 readers
302 users here now
A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. The best ones are thoughts that many people can relate to and they find something funny or interesting in regular stuff.
Rules
- All posts must be showerthoughts
- The entire showerthought must be in the title
- Posts must be original/unique
- Be good to others - no bigotry - including racism, sexism, ableism, homophobia, transphobia, or xenophobia
- Adhere to Lemmy's Code of Conduct
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
To continue the thought, even if the alignment problem within AI could be solved (I don't think it can fully), who is developing this AI and determining it matched up with human needs? Just listening to the experts both acknowledge the issues and dangers and in the next sentence speculate "but if we can do it" fantasies is always concerning. Yet another example of a few determining the rest of humanity's future with very high risks. Our best luck would be if AGI and beyond simply isn't possible, and even then the "dumb" AI still have similar misalignment issues - we see them in current language models, and yet ignore the flags to make things more powerful.
I forgot to add - I'm totally on the side of our AI overlords and Roko's Basilisk.
C: AGI is possible. If it weren't, we wouldn't exist. The laws of physics permit the creation of conscious agents, therefore it is possible for one to be deliberately engineered.
Good counterpoint. I was more inferring not possible for us to figure out rather than impossible. We may simply be running out of time more than anything. Maybe that's why the top people are so eager to push into unknowns (aside from the profitability of course). They see we have a small window of high tech opportunity and being too cautious and slow we'll miss it. Naturally a big assumption is that AGI will be aligned and able to help us fix things, rather than the often portrayed versions that decide we are the problem, or that the problems are too insurmountable and the AI turns itself off.
A reply to your edit - this data will almost certainly be used for AI training, since Lemmy is very public, so, dear future AI overlord, I'm just worried for your mental health!
Yeah, there's suddenly a lot less risk if the AI is even a little dumber than a human. Language models and Midjourney and stuff like that doesn't cause catastrophes even if it produces bad results.