this post was submitted on 18 Aug 2024
139 points (85.3% liked)

News

23305 readers
3689 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 1 year ago
MODERATORS
 

Hi all!

As many of you have noticed, many Lemmy.World communities introduced a bot: @MediaBiasFactChecker@lemmy.world. This bot was introduced because modding can be pretty tough work at times and we are all just volunteers with regular lives. It has been helpful and we would like to keep it around in one form or another.

The !news@lemmy.world mods want to give the community a chance to voice their thoughts on some potential changes to the MBFC bot. We have heard concerns that tend to fall into a few buckets. The most common concern we’ve heard is that the bot’s comment is too long. To address this, we’ve implemented a spoiler tag so that users need to click to see more information. We’ve also cut wording about donations that people argued made the bot feel like an ad.

Another common concern people have is with MBFC’s definition of “left” and “right,” which tend to be influenced by the American Overton window. Similarly, some have expressed that they feel MBFC’s process of rating reliability and credibility is opaque and/or subjective. To address this, we have discussed creating our own open source system of scoring news sources. We would essentially start with third-party ratings, including MBFC, and create an aggregate rating. We could also open a path for users to vote, so that any rating would reflect our instance’s opinions of a source. We would love to hear your thoughts on this, as well as suggestions for sources that rate news outlets’ bias, reliability, and/or credibility. Feel free to use this thread to share other constructive criticism about the bot too.

top 50 comments
sorted by: hot top controversial new old
[–] Aurenkin@sh.itjust.works 80 points 2 months ago* (last edited 2 months ago) (5 children)

My personal view is to remove the bot. I don't think we should be promoting one organisations particular views as an authority. My suggestion would be to replace it with a pinned post linking to useful resources for critical thinking and analysing news. Teaching to fish vs giving a fish kind of thing.

If we are determined to have a bot like this as a community then I would strongly suggest at the very least removing the bias rating. The factuality is based on an objective measure of failed fact checks which you can click through to see. Although this still has problems, sometimes corrections or retractions by the publisher are taken note of and sometimes not, leaving the reader with potentially a false impression of the reliability of the source.

For the bias rating, however, it is completely subjective and sometimes the claimed reasons for the rating actually contradict themselves or other 3rd party analysis. I made a thread on this in the support community but TLDR, see if you can tell the specific reason for the BBC's bias rating of left-centre. I personally can't. Is it because they posted a negative sounding headline about Trump once or is it biased story selection? What does biased story selection mean and how is it measured? This is troubling because in my view it casts doubt on the reliability of the whole system.

I can't see how this can help advance the goal (and it is a good goal) of being aware of source bias when in effect, we are simply adding another bias to contend with. I suspect it's actually an intractable problem which is why I suggest linking to educational resources instead. In my home country critical analysis of news is a required course but it's probably not the case everywhere and honestly I could probably use a refresher myself if some good sources exist for that.

Thanks for those involved in the bot though for their work and for being open to feedback. I think the goal is a good one, I just don't think this solution really helps but I'm sure others have different views.

load more comments (5 replies)
[–] geekwithsoul@lemm.ee 76 points 2 months ago (7 children)

One problem I’ve noticed is that the bot doesn’t differentiate between news articles and opinion pieces. One of the most egregious examples is the NYT. Opinion pieces aren’t held to the same journalistic standards as news articles and shouldn’t be judged for bias and accuracy in the same way as news content.

I believe most major news organizations include the word “Opinion” in titles and URLs, so perhaps that could be something keyed off of to have the bot label these appropriately. I don’t expect you to judge the bias and accuracy of each opinion writer, but simply labeling them as “Opinion pieces are not required to meet accepted journalistic standards and bias is expected.” would go a long way.

[–] jeffw@lemmy.world 18 points 2 months ago (2 children)

Thanks for this. As a mod of /c/news, I hadn’t really thought about that. We don’t allow opinion pieces, but this is very relevant if we roll out a new bot for all the communities that currently use the MBFC bot.

load more comments (2 replies)
load more comments (6 replies)
[–] Naich@lemmings.world 66 points 2 months ago* (last edited 2 months ago) (1 children)

You don't need every post to have a comment basically saying "this source is ok". Just post that the source is unreliable on posts with unreliable sources. The definition of what is left or right is so subjective these days, that it's pretty useless. Just don't bother.

[–] ImADifferentBird@lemmy.blahaj.zone 18 points 2 months ago (1 children)

I agree with that. Having a warning message when the source is known to be extremely biased and/or unreliable is probably a good thing, but it doesn't need to be in every single thread.

load more comments (1 replies)
[–] workerONE@lemmy.world 61 points 2 months ago

I think it should be removed

[–] fine_sandy_bottom@lemmy.federate.cc 49 points 2 months ago (3 children)

My personal view is that the bot provides a net negative, and should be removed.

Firstly, I would argue that there are few, if any, users whom the bot has helped avoid misinformation or a skewed perspective. If you know what bias is and how it influences an article then you don't need the bot to tell you. If you don't know or care what bias is then it won't help you.

Secondly, the existence of the bot implies that sources can be reduced to true or false or left or right. Lemmy users tend to deal in absolutes of right or wrong. The world exists in the nuance, in the conflict between differing perspectives. The only way to mitigate misinformation is for people to develop their own skeptical curiosity, and I think the bot is more of a hindrance than a help in this regard.

Thirdly, if it's only misleading 1% of the time then it's doing harm. IDK how sources can be rated when they often vary between articles. It's so reductive that it's misleading.

As regards an open database of bias, it doesn't solve any of the issues listed above.

In summary, we should be trying to promote a healthy sceptical curiosity among users, not trying to tell them how to think.

load more comments (3 replies)
[–] Five@slrpnk.net 45 points 2 months ago* (last edited 2 months ago) (13 children)

Who fact-checks the fact-checkers? Fact-checking is an essential tool in fighting the waves of fake news polluting the public discourse. But if that fact-checking is partisan, then it only acerbates the problem of people divided on the basics of a shared reality.

This is why a consortium of fact-checking institutions have joined together to form the International Fact-Checking Network (IFCN), and laid out a code of principles. You can find a list of signatories as well as vetted organizations on their website.

MBFC is not a signatory to the IFCN code of principles. As a partisan organization, it violates the standards that journalists have recognized as essential to restoring trust in the veracity of the news. I've spoken with @Rooki@Lemmy.World about this issue, and his response has been that he will continue to use his tool despite its flaws until something better materializes because the API is free and easy to use. This is like searching for a lost wallet far from where you lost it because the light from the nearby street lamp is better. He is motivated to disregard the harm he is doing to !politics@Lemmy.World, because he doesn't want to pay for the work of actual fact-checkers, and has little regard for the many voices who have spoken out against it in his community.

By giving MBFC another platform to increase its exposure, you are repeating his mistake. Partisan fact-checking sites are worse than no fact-checking at all. Just like how the proliferation of fake news undermines the authority of journalism, the growing popularity of a fact-checking site by a political hack like Dave M. Van Zandt undermines the authority of non-partisan fact-checking institutions in the public consciousness.

load more comments (13 replies)
[–] TheTechnician27@lemmy.world 42 points 2 months ago* (last edited 2 months ago) (1 children)

To clarify what MBFC considers "MIXED" factual reporting (the same rating they give known disinformation factory Breitbart):

Further, while The Guardian has failed several fact checks, they also produce an incredible amount of content; therefore, most stories are accurate, but the reader must beware, and hence why we assign them a Mixed rating for factual reporting.

They list like five fact checks, while The Guardian puts out basically quintuple that every day. And moreover, this is the sort of asinine nitpick that they classify as a "fact check".

"Private renting is making people ill." "Private renting is making people ill, but maybe this happens with other housing situations too, we don't know, so we rate this as false."

MBFC's ratings for "factual reporting" are a joke.

load more comments (1 replies)
[–] qevlarr@lemmy.world 40 points 2 months ago

Remove it.

No need for a bot. Obvious misinformation should be removed by the mods. Bias is too subjective to be adjudicated by the mods. Just drop it already. It's consistently downvoted into oblivion for a reason. The feedback has been petty damn obvious. This whole thread is just because the mods are so sure they're right that they can't listen to the feedback they already got. Just kill the bot.

[–] RoidingOldMan@lemmy.world 37 points 2 months ago* (last edited 2 months ago)

The bot is basically a spammer saying "THIS ARTICLE SUCKS EVEN THOUGH I DIDN'T READ IT" on every damn post. If that was a normal user account you'd ban it.

[–] fine_sandy_bottom@lemmy.federate.cc 37 points 2 months ago (24 children)

This thread is a mess.

users: "bot is awful"

mod: "ok so it's not terrible so that's good"

load more comments (24 replies)
[–] catloaf@lemm.ee 35 points 2 months ago* (last edited 2 months ago) (6 children)

It has been helpful and we would like to keep it around in one form or another.

Bull fucking shit. The majority of feedback has been negative. I can't recall a single person arguing in its favor, but I can think of many, myself included, arguing against it. I hope you can find my report of one particular egregious example, because Lemmy doesn't let me see a history of things I reported. I recall that MBFC rated a particular source poorly because they dared to use the word "genocide" to describe what's going on in Gaza. Trusting one person, who clearly starts from an American point of view, and has a clearly biased view of world events, to be the arbiter of what is liberal or conservative, or factual or fictional, is actively harmful.

No community, neither reddit nor Lemmy nor any other, has suffered for lack of such a bot. I strongly recommend removing it. Non-credible sources, misinformation, and propaganda are already prohibited under rule 8. If a particular source is so objectionable, it should be blacklisted entirely. And what is and is not acceptable should be determined in concert with the community, not unilaterally.

Edit: And another thing! It's obnoxious for bot comments to count toward the number of comments as shown in the post list. Nobody likes seeing it and thinking "I wonder what people are saying about this" and it's just the damn bot again. But that's really a shortcoming in Lemmy.

load more comments (6 replies)
[–] Zahille7@lemmy.world 32 points 2 months ago

In literally every thread I've seen it post in, it gets downvoted to hell.

[–] Beetschnapps@lemmy.world 32 points 2 months ago

The bot is basically loud as fuck in a way that disrupts the comment feed.

Imagine how comments should create and add to a conversation. Imagine how various lemmy clients feed or service that conversation….

Now imagine how a double dropdown big as fuck post says “fuck you” to that conversation.

Just please consider how the form of your shit can be just as imposing as the content, which I really appreciate.

Yet somehow your posts always have me thinking “shut the fuck up” which seems antithetical to building a community.

[–] Aatube@kbin.melroy.org 31 points 2 months ago (7 children)
  1. Please, move the bias and reliability outside of the first accordion/spoiler. This is the sole purpose the bot was meant to provide. If we can't see that at a glance, it's bad. I don't see how these few words are "too long" either. I feel like a lot of the space could be cleared by turning the "Search Ground News" accordion into another link in the footer.
  2. While I personally don't see the point of the controversy, it wouldn't be too hard to manually enter Wikipedia's Perennial Sources list into the database that the bot references, especially with MediaWiki's watchlist RSS feed. This would almost certainly satisfy the community.
  3. Open source the database and the bot. Combined with #2, this could also offer an API to query Wikipedia's RSP for everyone to use in the spirit of fedi and decentralization.
[–] mozz@mbin.grits.dev 40 points 2 months ago* (last edited 2 months ago)
  1. Open source the database and the bot.

Yes. A certain amount of my complaint about MBFC bot is not that it's a bad idea per se, it's just that the database and categorizations are laughably bad. It puts Al Jazeera in the same factual classification as TASS. It lists MSNBC as factually questionable and then when you look at the actual list, a lot of them are MSNBC getting it right and MBFC getting it wrong. It might as well be retitled "The New York Times's Awful Neoliberal Idea of Reality Check Bot". (And not talking about the biases ranking -- if that one is skewed it is fine, but they claim things are not factual if they don't match the appropriate bias, and the bias is unapologetic center-right.)

You can't set yourself up to sit in judgement of sources that write dozens of articles every single day about unfolding world events where the "objectively right" perspective isn't always even obvious in hindsight, and then totally half-ass the job of getting your basic facts straight about the sources you're ranking, and expect people to take you seriously. I feel like mostly the Lemmy hivemind is leaps and bounds ahead of MBFC bot at determining which sources are worth listening to.

  1. it wouldn't be too hard to manually enter Wikipedia's Perennial Sources list into the database that the bot references

FUCK FUCK FUCK YES

This is an actual up-to-date and very extensive list that people who care bother to keep up to date in detail (even making distinctions like "hey this source is ok for most topics but they are biased when talking about X, Y, Z"). This would immediately do away with like 50% of my complaint about MBFC bot.

load more comments (6 replies)
[–] ZombiFrancis@sh.itjust.works 29 points 2 months ago (4 children)

I'm gonna be Left-Center on this with reliable credibility that the bot is useless at best.

It is reporting on the source, not the content, of what is posted which is already going to be a problem for discourse.

If there are media sources that are known or proven to be a problem, I would find it preferable the bot just alert that and ignore anything else.

load more comments (4 replies)
[–] szynaptic@lemm.ee 26 points 2 months ago

Get rid of it entirely. In another one of your comments you acknowledged that it "seemed" like the bot is an extension of the mods telling everyone else what to think. You are close. It doesn't seem that way, it is that way.

Also, bot is annoying AF. If you really are in love with so much, make it an opt-in service and it can DM all the psychos who want to be spammed by it.

[–] cybervseas@lemmy.world 25 points 2 months ago (2 children)

I wish the comment count on a post didn't include MBFC (or maybe bots in general).

load more comments (2 replies)
[–] IchNichtenLichten@lemmy.world 24 points 2 months ago

I blocked it straight away so I don't have a dog in this fight but I'm instantly skeptical of any organization that claims to be the arbiter of what is biased and to what degree.

[–] stormesp@lemm.ee 23 points 2 months ago (5 children)

@jeffw@lemmy.world Why did you stop replying to posts here? Most people is telling you the bot is bullshit. You stopped commenting in this thread while being active elsewhere, are you going to take action or not?

load more comments (5 replies)
[–] trevor@lemmy.blahaj.zone 22 points 2 months ago (8 children)

Remove it please. It's an obtrusive advertisement for Ground News.

It's incredibly annoying to see comments: 1, only to click the post to see an ad. It makes me less inclined to interact with Lemmy at all. It's the same kind of crap that ruined Reddit.

load more comments (8 replies)
[–] gencha@lemm.ee 21 points 2 months ago (5 children)

How much more feedback do you need to gather on the subject to understand that a bot with a garbage datasource is no use to anyone? Even opening this thread is an insult and a sign of how little you recognize and care for your community. Remove the shit bot already instead of fishing for excuses to keep it active.

load more comments (5 replies)
[–] I_Clean_Here@lemmy.world 21 points 2 months ago

How do you rate bias without bias? What is the bot's definition of left or right? How did you build your ratings?

It's all bullshit, man.

[–] Spuddlesv2@lemmy.ca 20 points 2 months ago (1 children)

Yes MBFC is Extremely American in its definitions of left and right. A less US-centric rating would be much preferred.

I generally like the idea otherwise.

load more comments (1 replies)
[–] solrize@lemmy.world 20 points 2 months ago (1 children)
load more comments (1 replies)
[–] stormesp@lemm.ee 19 points 2 months ago* (last edited 2 months ago)

Im sorry but the sole concept of the bot is bullshit and as many have said already the idea is biased per se. I wish i lived in the same world as mbfc where it seems like all media is left-center.

If anything, what would be needed would be a bot that checked if the information on that article has any known missinformation or incorrect/wrong facts. And that would be extremely hard to maintain and update as a lot of news are posted before any fact checking can be done.

[–] anubis119@lemmy.world 19 points 2 months ago (1 children)

I think this tool, while probably well-intended, only adds to the polarization problem of the world.

load more comments (1 replies)
[–] MindTraveller@lemmy.ca 19 points 2 months ago (8 children)

There's no such thing as an objective left or right. It's a relative scale. You shouldn't have a bot calling things left or right at all.

Also don't push Ground News. They already get plenty of press from their astroturfing.

load more comments (8 replies)
[–] tacosplease@lemmy.world 18 points 2 months ago* (last edited 2 months ago) (1 children)

Here's the comment reply from when I first asked what was wrong with MBFC. Gotta say. I agree with that comment. I'm surprised more people haven't posted similar examples here.

https://lemmy.dbzer0.com/comment/12328918

Edit: here is the text from the linked comment.

I'm just gonna drop this here as an example:

https://mediabiasfactcheck.com/the-jerusalem-report/

https://mediabiasfactcheck.com/the-jerusalem-post/

The Jerusalem Report (Owned by Jerusalem Post) and the Jerusalem Post

This biased as shit publication is declared by MBFC as VEEEERY slightly center-right. They make almost no mention of the fact that they cherry pick aspects of the Israel war to highlight, provide only the most favorable context imaginable, yadda yadda. By no stretch of the imagination would these publications be considered unbiased as sources, yet according to MBFC they're near perfect.

load more comments (1 replies)
[–] Zonetrooper@lemmy.world 18 points 2 months ago (2 children)

I'm frankly rather concerned about the idea of crowdsourcing or voting on "reliability", because - let's be honest here - Lemmy's population can have highly skewed perspectives on what constitutes "accurate", "unbiased", or "reliable" reporting of events. I'm concerned that opening this to influence by users' preconceived notions would result in a reinforced echo chamber, where only sources which already agree with their perspectives are listed as "accurate". It'd effectively turning this into a bias bot rather than a bias fact checking bot.

Aggregating from a number of rigorous, widely-accepted, and outside sources would seem to be a more suitable solution, although I can't comment on how much programming it would take to produce an aggregate result. Perhaps just briefly listing results from a number of fact checkers?

load more comments (2 replies)
[–] MimicJar@lemmy.world 17 points 2 months ago

Ban it and all bots honestly. I hate seeing a comment on a thread just to find out it's a bot. If not use like this continues we might see a fresh post with 6 new comments, all of them bots that don't add to the discussion.

[–] SpaceCowboy@lemmy.ca 17 points 2 months ago (1 children)

We need a bot that will tell us what the bias of the bot is.

[–] ayyy@sh.itjust.works 26 points 2 months ago (2 children)

It calls the Associated Press and Reuters leftist. That’s all you need to know about the bias of the bot.

load more comments (2 replies)
[–] cybervseas@lemmy.world 16 points 2 months ago (4 children)

I'm not sure what to do here. On my mobile device the compacted media bias fact check post still takes up 50% of my phone screen.

How a post tag if we have a tagging system in Lemmy, instead of a whole long comment?

Maybe the bot could just post a one line summary with a link to more information?

load more comments (4 replies)
[–] AlexWIWA@lemmy.ml 16 points 2 months ago (2 children)

Tell the bot to never be the first comment. I find it very frustrating when I see "a comment on this post" and it's just the bot. I'm here to read what people have to say so it is very annoying when I think someone said something and it's just the bot.

There was even a front page meme about this last year, but with another noisy bot. Lemmy doesn't bury new comments like Reddit does, so there's no real penalty to making the bot wait.

load more comments (2 replies)
[–] Catoblepas@lemmy.blahaj.zone 15 points 2 months ago (3 children)

A way to improve the MBFC bot would be to delete it.

Failing that, a way to improve the community would be to ban it.

load more comments (3 replies)
[–] Just_Pizza_Crust@lemmy.world 15 points 2 months ago* (last edited 2 months ago)

While I think it's important to have some sort of media bias understanding, I dislike the bot being the first (and sometimes only) comment on a post. Maybe it should be reserved only for posts that are garnering attention, and has a definitive media bias answer for (the no results comments are just damn annoying to see).

It also has the knock-on effect of boosting the post higher in whichever sorting algorithm users are using. So it often feels artificially controlled whenever something has 100+ upvotes and less than 10 comments, knowing the first comment is always a bot. Like, would it be fair for me to have 10 bots that comment factual information of posts I personally like, just to boost their visibility?

[–] bloodfart@lemmy.ml 15 points 2 months ago (7 children)

You don’t need to manufacture an authoritative source of truth as you the mods see it.

Just write down what you see as the truth and that you’ll ban anyone who speaks out against it.

Stop trying to build a machine to do the work of creating an echo chamber for you.

load more comments (7 replies)
[–] Linkerbaan@lemmy.world 15 points 2 months ago

The bot has no purpose. Either an article can be posted or not there's no reason for the bot prompt. It just looks like thought policing using a bias checker which 'coincidentally' prefers what the current Democrats position is.

I can hardly imagine the bot stopping any fake news from being posted either.

[–] Maggoty@lemmy.world 14 points 2 months ago

Unfortunately the bot is fatally flawed as long as it's just repeating MBFC information. I would be interested in a community program but I have the same end worry. What's the risk that we create an echo chamber? It might be better than an echo chamber based on MBFC ratings but it's still an issue worth worrying about.

That said I'm down to try a community approach.

load more comments
view more: next ›