You only tested Google and Bing.
Qwant and DDG both use the Bing architecture.
I agree though, search engines have become noticeably worse the last 2 years.
This is a most excellent place for technology news and articles.
You only tested Google and Bing.
Qwant and DDG both use the Bing architecture.
I agree though, search engines have become noticeably worse the last 2 years.
I’m pretty sure they discovered in the google monopoly case that google realized a couple years ago that a worse search experience would not negatively impact their bottom line. So makes sense
It's intentional.
Obviously, Google makes money showing ads during search. But they have finally bit the bullet and starting tarpitting users in search in order to show more ads.
A quick, useful, and accurate search means that you're on their site for the least amount of time, perhaps mere seconds. That's not what's best for revenue growth.
PS: Go try Kagi and be reminded what good clean search results look like. I use it because my time has value. It's very good.
There are no search engines besides Google and Bing, because everyone else just uses Bing under the hood.
So what about open source self hosted search engines? If it requires some hardware I'd gladly team up with a small group of people to finance a bigass server that just gets us our personal search engine
Any good ones out there?
Searxng, but there are plenty of instances already
Perplexica is interesting too, but it uses a moderate amount of ram because of elastic search.
And of course you need to have ollama running
Very cool
There's stuff like Searxng or whoogle, but these aren't "real" search engines, merely "search aggregators" - they relay requests to a bunch of actual search engines, like bing or google, and aggregate the results. That's why they don't require tons of compute and scraping, and also why they often fail to work (since the search engines in question don't like or allow this). I believe it's not feasible to run a "real" search engine alone or even as a small group of people - according to this comment you need a powerful server with terabytes* of drive, hundreds of gigabytes of RAM and a lot of compute - and all of this will just let you crawl some top domains, nowhere near a good chunk of the internet.
*which sounds low actually, I would have expected more for this
Brave has their own search. There is also meta searches such as metager, searx and mojeek. I hope more search engines enter the market
I just use chatGPT to search now. I have a super-prompt in its memory telling it how to search and to cite sources and provide links and it is so much better than Google even though it's using AI, too.
*The future is now, old men!
they're pretty bad, but ddg at least feels like I'm getting actual results.
Yeah DDG is great. The only thing I find is its not good at local results but a quick !g on the end gets me the local results im looking for.
It's not just you. Search got worse, and it did so intentionally.
Ed Zitron lays it all out really well, with all the receipts, but the basic version is this; Google has an incentive to make you search more for the same things, because then they can show you more ads. And google is, first and foremost, an ad delivery company. Every "product" they own is an ad delivery vehicle. It's not just AI slop that made search based; Google made search bad, and everyone else followed suit, to a greater or lesser degree.
I'm very happy with kagi at the moment. Just crossed one year using it as my main search engine last week and don't see why I would go back.
Same. Using Kagi feels like surfing the old web. The first thing I did was block all Pinterest results. That alone made every search golden. 😂
Having to signup and login to a search engines sounds like an annoying hassle
You know what I miss? Search engines that honored Boolean operators. I am often looking for niche results and being able to -, ! and NOT is incredibly useful. But that's just not a thing anymore. I know part of it is that SEO includes antonym meta data that ruins this but it would still be helpful on occasion.
It is, and it's not just the search engines to blame.
The content out there is incredibly spammy. It doesn't pay to create good content. It pays to make a pool of AI gunge based on what people search for and then stick ads on it.
SEO spam has been a problem for a long time, but AI has allowed it to be accelerated to a whole new level.
Not just you.
DDG has deteriorated to absolute nonsense, I’ve used it for years and years.
Recently gave startpage another go - maybe marginally better but still really poor
The whole internet is in the process of being filled with garbage content. Search engines are bad but also there's not much good content left to find (in % of the total)
I feel like it’s especially bad if you are searching for anything related to a marketable product. I tried searching ddg for information about using a surge protector with halogen bulbs and all I got was pages and pages of listicles on “best halogen lights 2024” full of affiliate links.
And if you’re looking for legitimate reviews, good luck! Everyone’s an affiliate now.
My experience is that search engines are still decent at finding niche information that would normally be hard to find. But for anything mainstream, for instance any household product that should be easy to find information about, instead how about these 300 pages of top 10 lists of Amazon affiliate links buried under AI generated filler?
I often have the opposite experience when looking for technical documentation about programming libraries. For example I will be dealing with a particular bug and will google the library name plus some descriptive terms related to the bug, and I get back general information about the library. In those cases, it seems google often ignores the supplemental information and focuses only on the library name as If I were looking for general information.
What is worse is that the top results are always blog-spam companies that just seem to be copying the documentation pages of whatever language or library I was looking at.
It's not just you. At some point, search's primary purpose went from "finding the information you're looking for" to "getting paid to put links in front of you". Then they kept iterating on it, quarter by quarter, for a very long time.
Its not AIs fault, its advertising based SEOs fault. Search has been broken for years for many topics.
The other day I googled how long should I broil a ribeye steak and the google AI told me to broil it for 45 minutes.
Broil is the hottest setting on the oven and you’re supposed to broil the meat as close to the burner as possible. This would probably burn down your house.
I'm going to be honest with you. They feel no worse today than they have for the past ~5+ years or so. SEO blog spam with a dozen paragraphs to tell you exactly one line of information have been around for quite a while. Many of these articles felt generated either from crappy writers or "AI" tools predating the LLMs we have now.
Kagi is working very well for me! and honestly i like that it's a paid service.
Kagi is pretty awesome