this post was submitted on 09 Oct 2024
610 points (96.6% liked)

Technology

58701 readers
3994 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

I suspect that this is the direct result of AI generated content just overwhelming any real content.

I tried ddg, google, bing, quant, and none of them really help me find information I want these days.

Perplexity seems to work but I don't like the idea of AI giving me "facts" since they are mostly based on other AI posts

ETA: someone suggested SearXNG and after using it a bit it seems to be much better compared to ddg and the rest.

top 50 comments
sorted by: hot top controversial new old
[–] vxx@lemmy.world 14 points 6 days ago* (last edited 6 days ago) (1 children)

You only tested Google and Bing.

Qwant and DDG both use the Bing architecture.

I agree though, search engines have become noticeably worse the last 2 years.

[–] moseschrute@lemmy.world 2 points 5 days ago

I’m pretty sure they discovered in the google monopoly case that google realized a couple years ago that a worse search experience would not negatively impact their bottom line. So makes sense

[–] Subverb@lemmy.world 8 points 6 days ago* (last edited 6 days ago)

It's intentional.

Obviously, Google makes money showing ads during search. But they have finally bit the bullet and starting tarpitting users in search in order to show more ads.

A quick, useful, and accurate search means that you're on their site for the least amount of time, perhaps mere seconds. That's not what's best for revenue growth.

PS: Go try Kagi and be reminded what good clean search results look like. I use it because my time has value. It's very good.

[–] Fedditor385@lemmy.world 4 points 6 days ago

There are no search engines besides Google and Bing, because everyone else just uses Bing under the hood.

[–] phoenixz@lemmy.ca 3 points 6 days ago (2 children)

So what about open source self hosted search engines? If it requires some hardware I'd gladly team up with a small group of people to finance a bigass server that just gets us our personal search engine

Any good ones out there?

[–] MTK@lemmy.world 2 points 6 days ago (1 children)

Searxng, but there are plenty of instances already

[–] Hawk@lemmynsfw.com 2 points 6 days ago (1 children)

Perplexica is interesting too, but it uses a moderate amount of ram because of elastic search.

And of course you need to have ollama running

[–] MTK@lemmy.world 1 points 6 days ago
[–] LonelyNematocyst@lemmy.world 1 points 6 days ago

There's stuff like Searxng or whoogle, but these aren't "real" search engines, merely "search aggregators" - they relay requests to a bunch of actual search engines, like bing or google, and aggregate the results. That's why they don't require tons of compute and scraping, and also why they often fail to work (since the search engines in question don't like or allow this). I believe it's not feasible to run a "real" search engine alone or even as a small group of people - according to this comment you need a powerful server with terabytes* of drive, hundreds of gigabytes of RAM and a lot of compute - and all of this will just let you crawl some top domains, nowhere near a good chunk of the internet.

*which sounds low actually, I would have expected more for this

[–] Shape4985@lemmy.ml 1 points 6 days ago

Brave has their own search. There is also meta searches such as metager, searx and mojeek. I hope more search engines enter the market

[–] alekwithak@lemmy.world -2 points 6 days ago* (last edited 6 days ago)

I just use chatGPT to search now. I have a super-prompt in its memory telling it how to search and to cite sources and provide links and it is so much better than Google even though it's using AI, too.

*The future is now, old men!

[–] Varyk@sh.itjust.works 154 points 1 week ago (35 children)

they're pretty bad, but ddg at least feels like I'm getting actual results.

[–] Fizz@lemmy.nz 54 points 1 week ago (13 children)

Yeah DDG is great. The only thing I find is its not good at local results but a quick !g on the end gets me the local results im looking for.

load more comments (13 replies)
load more comments (34 replies)
[–] Voroxpete@sh.itjust.works 122 points 1 week ago

It's not just you. Search got worse, and it did so intentionally.

Ed Zitron lays it all out really well, with all the receipts, but the basic version is this; Google has an incentive to make you search more for the same things, because then they can show you more ads. And google is, first and foremost, an ad delivery company. Every "product" they own is an ad delivery vehicle. It's not just AI slop that made search based; Google made search bad, and everyone else followed suit, to a greater or lesser degree.

[–] hannesh93@feddit.org 70 points 1 week ago (19 children)

I'm very happy with kagi at the moment. Just crossed one year using it as my main search engine last week and don't see why I would go back.

[–] tk1ll3r@discuss.tchncs.de 43 points 1 week ago (4 children)

Same. Using Kagi feels like surfing the old web. The first thing I did was block all Pinterest results. That alone made every search golden. 😂

load more comments (4 replies)
[–] MTK@lemmy.world 31 points 1 week ago (12 children)

Having to signup and login to a search engines sounds like an annoying hassle

load more comments (12 replies)
load more comments (17 replies)
[–] FauxPseudo@lemmy.world 66 points 1 week ago* (last edited 1 week ago) (3 children)

You know what I miss? Search engines that honored Boolean operators. I am often looking for niche results and being able to -, ! and NOT is incredibly useful. But that's just not a thing anymore. I know part of it is that SEO includes antonym meta data that ruins this but it would still be helpful on occasion.

load more comments (3 replies)
[–] Blackmist@feddit.uk 61 points 1 week ago (1 children)

It is, and it's not just the search engines to blame.

The content out there is incredibly spammy. It doesn't pay to create good content. It pays to make a pool of AI gunge based on what people search for and then stick ads on it.

load more comments (1 replies)
[–] RobotToaster@mander.xyz 52 points 1 week ago (2 children)

SEO spam has been a problem for a long time, but AI has allowed it to be accelerated to a whole new level.

load more comments (2 replies)
[–] zante@lemmy.wtf 44 points 1 week ago (4 children)

Not just you.

DDG has deteriorated to absolute nonsense, I’ve used it for years and years.

Recently gave startpage another go - maybe marginally better but still really poor

load more comments (4 replies)
[–] raspberriesareyummy@lemmy.world 41 points 1 week ago (1 children)

The whole internet is in the process of being filled with garbage content. Search engines are bad but also there's not much good content left to find (in % of the total)

load more comments (1 replies)
[–] anttifantti@sopuli.xyz 41 points 1 week ago (1 children)

I feel like it’s especially bad if you are searching for anything related to a marketable product. I tried searching ddg for information about using a surge protector with halogen bulbs and all I got was pages and pages of listicles on “best halogen lights 2024” full of affiliate links.

[–] undefined@links.hackliberty.org 25 points 1 week ago (3 children)

And if you’re looking for legitimate reviews, good luck! Everyone’s an affiliate now.

load more comments (3 replies)
[–] Zink@programming.dev 37 points 1 week ago (3 children)

My experience is that search engines are still decent at finding niche information that would normally be hard to find. But for anything mainstream, for instance any household product that should be easy to find information about, instead how about these 300 pages of top 10 lists of Amazon affiliate links buried under AI generated filler?

[–] JollyG@lemmy.world 2 points 6 days ago

I often have the opposite experience when looking for technical documentation about programming libraries. For example I will be dealing with a particular bug and will google the library name plus some descriptive terms related to the bug, and I get back general information about the library. In those cases, it seems google often ignores the supplemental information and focuses only on the library name as If I were looking for general information.

What is worse is that the top results are always blog-spam companies that just seem to be copying the documentation pages of whatever language or library I was looking at.

load more comments (2 replies)
[–] bitjunkie@lemmy.world 36 points 1 week ago

It's not just you. At some point, search's primary purpose went from "finding the information you're looking for" to "getting paid to put links in front of you". Then they kept iterating on it, quarter by quarter, for a very long time.

[–] recursive_recursion@lemmy.ca 33 points 1 week ago (7 children)

You might want to try SearXNG

It's an Open Source search aggregator:

[–] nullPointer@programming.dev 1 points 6 days ago

we have gone full circle back to metacrawler.

load more comments (6 replies)
[–] SapphironZA@sh.itjust.works 29 points 1 week ago (4 children)

Its not AIs fault, its advertising based SEOs fault. Search has been broken for years for many topics.

load more comments (4 replies)
[–] nick@midwest.social 27 points 1 week ago (1 children)

Kagi is good. I’m very happy with it.

load more comments (1 replies)
[–] DancingBear@midwest.social 26 points 1 week ago* (last edited 1 week ago) (3 children)

The other day I googled how long should I broil a ribeye steak and the google AI told me to broil it for 45 minutes.

Broil is the hottest setting on the oven and you’re supposed to broil the meat as close to the burner as possible. This would probably burn down your house.

load more comments (3 replies)
[–] JackbyDev@programming.dev 26 points 1 week ago

I'm going to be honest with you. They feel no worse today than they have for the past ~5+ years or so. SEO blog spam with a dozen paragraphs to tell you exactly one line of information have been around for quite a while. Many of these articles felt generated either from crappy writers or "AI" tools predating the LLMs we have now.

[–] FiskFisk33@startrek.website 25 points 1 week ago (6 children)

Kagi is working very well for me! and honestly i like that it's a paid service.

load more comments (6 replies)
[–] asdfasdfasdf@lemmy.world 24 points 1 week ago

Kagi is pretty awesome

load more comments
view more: next ›