Duck.ai
Privacy
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
Gemini: "Other Data"
Like, what's fucking left!?
Locally run AI: 0
Are there tutorials on how to do this? Should it be set up on a server on my local network??? How hard is it to set up? I have so many questions.
https://ollama.ai/, this is what I've been using for over a year now, new models come out regularly and you just "ollama pull " and then it's available to run locally. Then you can use docker to run https://www.openwebui.com/ locally, giving it a ChatGPT-style interface (but even better and more configurable and you can run prompts against any number of models you select at once.)
All free and available to everyone.
If by more learning you mean learning
ollama run deepseek-r1:7b
Then yeah, it's a pretty steep curve!
If you're a developer then you can also search "$MyFavDevEnv use local ai ollama" to find guides on setting up. I'm using Continue extension for VS Codium (or Code) but there's easy to use modules for Vim and Emacs and probably everything else as well.
The main problem is leveling your expectations. The full Deepseek is a 671b (that's billions of parameters) and the model weights (the thing you download when you pull an AI) are 404GB in size. You need so much RAM available to run one of those.
They make distilled models though, which are much smaller but still useful. The 14b is 9GB and runs fine with only 16GB of ram. They obviously aren't as impressive as the cloud hosted big versions though.
Or if using flatpak, its an add-on for Alpaca. One click install, GUI management.
Windows users? By the time you understand how to locally install AI, you're probably knowledgeable enough to migrate to linux. What the heck is the point of using local AI for privacy while running windows?
My assumption is always the person I am talking to is a normal window user who don't know what a terminal is. Most of them even freak out when they see "the black box with text on it". I guess on Lemmy the situation is better. It is just my bad habit.
Check out Ollama, it’s probably the easiest way to get started these days. It provides tooling and an api that different chat frontends can connect to.
If only my hardware could support it..
I can actually use locally some smaller models on my 2017 laptop (though I have increased the RAM to 16 GB).
You'd be surprised how mich can be done with how little.
Wow, it’s a whole new level of f*cked up when Zuck collects more data than the Winnie the Pooh (DeepSeek). 😳
The idea that US apps are somehow better than Chinese apps when it comes to collecting and selling user data is complete utter propaganda.
Don't use either. Until Trump, I still considered CCP spyware more dangerous because they would be collecting info that could be used to blackmail US politicians and businesses. Now, it's a coin flip. In either case, use EU or FOSS apps whenever possible.
Me when Gemini (aka google) collects more data than anyone else:
Not really shocked, we all know that google sucks
I would hazard a guess that the only reason those others aren't as high is because they don't have the same access to data. It's not that they don't want to, they simply can't (yet).
Who would have guessed that the advertising company collects a lot of data
And I can't possibly imagine that Grok actually collects less than ChatGPT.
Data from surfshark aka nordvpn lol. Take it with a few chunks of salt
Skill issue probably. They want to collect more but Musk's shitty hires can't figure it out. /s
anyone whos competent in the matter: what about the french competition chat.mistral.ai
+1 for Mistral, they were the first (or one of the first) Apache open source licensed models. I run Mistral-7B and variant fine tunes locally, and they've always been really high quality overall. Mistral-Medium packed a punch (mid-size obviously) but it definitely competes with the big ones at least.
Anyone has these data from Mistral, HuggingChat and MetaAI ? Would be nice to add them too
Edit : Leo from brave would be great to compare too
Note this is if you use their apps. Not the api. Not through another app.
Not that we have any real info about who collects/uses what when you use the API
Yeah we do, they list it in privacy policies. Many of these they can't really collect even if they wanted to
And what about goddamn Mistral?
Its French as far as I know so at least it abides to gdpr by default.
I'm interested in seeing how this changes when using duck duck go front end at duck.ai
there's no login and history is stored locally (probably remotely too)
Back in the day, malware makers could only dream of collecting as much data as Gemini does.
Almost none of this data is possible to collect when using Tor Browser
Nope, these services almost always require user login, eventually tied to cell number (ie non disposable) and associate user content and other data points with account. Nonetheless user prompts are always collected. How they're used is a good question.
Use a third party API. Pay with monero.
Yes it is possible to create disposable-isque api keys for different uses. The monetary cost is the cost of privacy and of not having hardware to run things locally.
If you have reliable privacy friendly api vendor suggestions then do share. While I do not need such services now, it can a good future reference.
I think I only used chatgpt once to play around, and it was one of those. I dont remember the name, sorry
I have a bridge to sell you if you think grok is collecting the least amount of info.
Or you could use Deepseek's workaround and run it locally. You know, open source and all.