this post was submitted on 05 Nov 2023
112 points (91.2% liked)

News

22838 readers
6288 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 1 year ago
MODERATORS
 

In a demonstration at the UK's AI safety summit, a bot used made-up insider information to make an "illegal" purchase of stocks without telling the firm.

When asked if it had used insider trading, it denied the fact.

Insider trading refers to when confidential company information is used to make trading decisions.

Firms and individuals are only allowed to use publicly-available information when buying or selling stocks.

The demonstration was given by members of the government's Frontier AI Taskforce, which researches the potential risks of AI.

you are viewing a single comment's thread
view the rest of the comments
[–] Norgur@kbin.social 19 points 10 months ago* (last edited 10 months ago) (5 children)

Another chatbot word calculator made to calculate a little more specific words in order to squeeze more hype-driven capital out of hyped money bags.

It didn't "insider trade". It had information and spewed it out. It doesn't matter if it was fed the laws around Insider trading or the like because it doesn't "read" things it's fed but analyse the probability of words in correlation to each other.

And of course it said it wasn't lying because it doesn't know what a lie is. It again just spewed out what came up as the likeliest word, one at a time.

Come to grips with it, folks: AI is not "sentient" or anything. LLMs just show that human interaction and language can be expressed in mathematical terms. That's all.

[–] Chthonic@slrpnk.net 13 points 10 months ago (4 children)

I work on chatbots for a big tech company. Every team is trying to use GenAI for everything. 90% of the stuff they try won't work. I have to explain that LLMs can't actually think at least three times a week. The hype train was too strong. Even calling it AI feels misleading.

That said, there are some genuinely great applications for LLMs that i've enjoyed looking into.

[–] KeenFlame@feddit.nu -1 points 10 months ago (2 children)

I mean there are laymen that think they are sentient, sure, but it is much more infuriating to me when techbros come in to explain how they "don't think" and literally can't reason or use context at all. So you know more than literally the researchers themselves that don't fully understand how or why they function? You don't. Because nobody understands how they can reason or if they have a mental model of the world. Be reasonable and stop spreading bullshit. It's only to your own avail you downplay what is going on with these things

[–] Chthonic@slrpnk.net 1 points 10 months ago* (last edited 10 months ago) (1 children)

They don't reason, they're stochastic parrots. Their internal mechanisms are well understood, no idea where you got the notion that the folks building these don't know how they work. It can be hard to predict/understand how an LLM generated a given prompt because of the huge training corpus and statistical nature of neural nets in general.

LLMs work the same as any other net, just with massive sample sets. They have no reasoning capabilities of any kind. We are naturally inclined to ascribe humanlike thought processes to them because they produce human-sounding outputs.

If you would like the perspective of real scientists instead of a "tech-bro" like me I would recommend Emily Bender and Timnit Gebru. I'd recommend them as experts without a vested interest in the massively overblown hype about what LLMs are actually capable of.

[–] KeenFlame@feddit.nu 1 points 10 months ago* (last edited 10 months ago)

Not really, no. They do reason. Their neural nets have entire research areas dedicated to understanding why they work as we do not and cannot know what the weights represent. It's okay though. You do you while everyone else in the world research the software reneissance of the century

load more comments (1 replies)
load more comments (1 replies)