scrubbles

joined 1 year ago
[–] scrubbles@poptalk.scrubbles.tech 18 points 1 week ago (2 children)

Okay so I had a meltdown last year. I was staring down a startup that was circling the drain, I knew my time there was limited, and I was being bombarded daily with layoffs and friends not being able to find work, while hearing constantly that I was going to be left behind due to AI. (of course the layoffs were happening because tech CEOs heard AI and started frothing at the idea of getting rid of some of their most expensive staff)

So, I took it on myself to learn AI. I figured well, if it's coming for my job I might as well learn how it works. And oh lorde, did I learn a lot. To the point where I'm running several LLMs now at home, I have them running in k3s, across multiple servers, and have built several apps to interact with them. I've trained finetuned LLMs, I've played with image generation, voices, I dove headfirst in. Eventually I did lose that job, and that gave me a couple months to focus even more before finding my current one.

My biggest learnings, which I'm sure many of you know:

  • AI is a very neat technology, and it has several real applications, but those applications are extremely limited by the limitations of AI
  • LLMs and AI are incredibly hard to control. You can't just say if(nsfw) dont(). You have to spend a lot of time forcing the LLM to not give weight to the users course, and it's to the point that it hardly seems worth it.
  • Companies love the idea of LLMs for their chatbots, but using the above it's incredibly hard to prevent the chatbot from doing it's own thing. You can say "We only have a return policy of 14 days" but if someone works at it hard enough and tells the LLM that it can still perform the return because they say so... is it really that useful? LLMs have no hard rules
  • LLMs have very real hardware restrictions. At home, it's a single GPU. In the cloud they have some clever tricks to share memory, but overall it's still mostly limited by the GPU. We'll see as we're moving forward what shenanigans NVidia comes up with, but LLMs and AI are essentially a brute force approach, and we can see that in how much power they soak up. You can see ChatGPT slows down once your conversation goes on long enough, it's running low on memory
  • AI is not new. It's still ML under the hood, it's just coming up with unique ways to reuse it. Again with the brute force, I didn't realize that for every token (word for simplicity), You're entire conversation is passed in to the model, in which it will spit out one more word. Repeat for every word. That's all it is. It's just predicting the next word. Image generation is just predicting the next pixels, and then loops around again until it comes back. There is no consciousness, there's no real nuance to it, that's it. A predictive engine surrounded with a while loop.

There's more but this is too long already. It's neat, it's useful, but the hype was just as intense as blockchain. We're going to see some real great usages out of it, like integration with something like Word or a browser to summarize things is honestly a good idea. But there are so so so many pitfalls.

For coding? I think it's a great place to get started, or to get an idea. I would never trust it in production. It will take a very long time for us to get to the point where you can say "Go build this feature" and I would blindly trust what it generated.

[–] scrubbles@poptalk.scrubbles.tech 7 points 1 week ago (1 children)

Meanwhile we will be charging $5 a month, plus a battlepass, plus the initial $100 pricetag, plus DLCs that are required for the story to make any sense, plus...

[–] scrubbles@poptalk.scrubbles.tech 26 points 1 week ago (4 children)
[–] scrubbles@poptalk.scrubbles.tech 17 points 1 week ago (1 children)

Whenever someone wants to ban something, you know there's probably something worth learning about inside. I don't care if it's Russia, America, Christians, anyone.

Correct. It would only be for government officials, so anyone federated with them would know that they are in fact, validated as the government official.

Well, guess I don't have one then

[–] scrubbles@poptalk.scrubbles.tech 31 points 1 week ago (1 children)

I think it's perfect for governments. You can subscribe anywhere, you know it's legit, and that's a much better way to do notifications than twitter.

[–] scrubbles@poptalk.scrubbles.tech 3 points 1 week ago (2 children)

I'm pretty sure I have a yahoo account rolling around somewhere...

[–] scrubbles@poptalk.scrubbles.tech 26 points 1 week ago (2 children)

It's not.... it's the fediverse. I'm completely fine with them having their own instance, it's not like they control it by any means. Hell they can be defederated. It's a lot better than them choosing some random instance.

[–] scrubbles@poptalk.scrubbles.tech 59 points 1 week ago (14 children)

I mean there should be a mastodon.gov.uk

[–] scrubbles@poptalk.scrubbles.tech 92 points 1 week ago (16 children)

about time...

Start pushing for mastodon! Honestly there should be an official mastodon instance

[–] scrubbles@poptalk.scrubbles.tech 4 points 1 week ago (1 children)

yeah it is, also a west coast engineer, but there's also nuance. There's definitely a difference between HR telling you the corporate policies and then there's going to your VP and telling them their pet product may have ethical ramifications. There's a lot of rug sweeping if a project is important.

 

Or by her participating that she is knowingly involving herself in a scam. Which, yeah, it's just books - but it's pretty obviously a pyramid.

No shame if you don't see how it's a scam, the cozy blanket and glass of wine are meant to throw you, and they chose 36 because it's a confusing enough number where you don't think too much about how it grows.

She gives one book to her upline. She then sends out post to 36 more people to give her 36 books. Each one of them then needs to find 36 people each, which is now 1296 people in that level if they each want 36 books. Thus the exponential pyramid. Of course there is zero way each of them will find that many people, let alone the levels below that. It's a scam that benefits those higher up, and the ones lower will likely not receive anything.

Of course she sees nothing wrong with that. She said "Sometimes I get books, sometimes I don't, that's just part of the game". Which... it's not a game when it's real money being passed around.

On top of that, whenever we see a pyramid scheme we should be stamping it out - hard. Folks, please spot the signs and point them out. Don't be afraid to comment on posts calling them out as scams.

Edit: To be clear the idea of a growing book exchange isn't a bad one, as explained in the comments though the way to make it not a scam is to make it 1:1. You either send a book and receive a book, or if they like the 36 number, you change it to "I'll send a book to whoever sends me a book!". Then it's a true book exchange.

13
Kiosk OS? (poptalk.scrubbles.tech)
 

Hey Folks, I've made a couple kiosks in the past around the house, but I'm hoping there's an easier solution out there. Previously I'd install raspbian or something on to a pi and then remote into a full-screened chromium to set it up.

Does anyone know of a good OS that theoretically boot directly to a URL with minimal effort? Like I said I can do it manually but I'd like something pre-built for the task.

Bonus points if it would have a web-configurator, I may want to change the URL it's using occasionally and it'd be nice not to have to remote in directly.

 

Seriously launched the app (by accident today) and what is this? They're trying to play the victim from the big bad ad blockers saying all they're doing is trying to show an ad at the beginning of video, and then I see all of this crap.

This was after a non-skippable ad at the beginning followed by a totally real "survey" that it wanted me to fill out, one interruption so far in the content, and now three ads on the screen. That's 45% of the screen dedicated to ads. Freaking ridiculous. "But please turn off your ad blocker".

 

Hasn't been active for 5 months.

Post I made: https://lemmy.ml/post/3517286

 

I'm thinking of spinning up some streaming for a couple of games in the near future, (I always do massive 400+ hour factories in Satisfactory) and was wondering if there's a place or software to stream on that's not Amazon, Google, Microsoft, or Meta? I'm not looking for revenue or massive followers, this would just be for fun and I'd post a link in a couple communities if they wanted to watch. I'm happy to host myself too.

Any ideas? Theoretically activitypub so I could link it on mastodon and here?

 
 

(and I'm a mod of !taylorswift@poptalk.scrubbles.tech , and I'm getting tired of how much they're using her popularity)

 

People arguing about the price of gas, but as soon as someone mentions driving an EV they're "stupid" and woke

 

Hey all, I'm missing mod tools in my app. Is that an ultra only feature? It says it's enabled in the settings, and I'm logged in with my mod account, but I'm not seeing any options

 

Learned the term recently and really enjoy it, subscription fatigue is the feeling we all have had now where we are just over how everything is subscription based.

Which one was the last straw or most annoying/frustrating to you?

 

Hi all, looking for my next major project/frustration. I've been forcing myself to learn the new AI tools and I think I'm ready for the next step. I'm familiar with image generation and I dabbled in a bit of chat bot stuff, but I think I'm ready.

I've read a few blogs but I want to find something that could work with my existing setup. My dream setup would be:

A voice assistant that runs locally, preferably dockerized, backup linux, and final option would be Windows, that can run a decent model and preferably let me train a custom voice for it.

I currently have:

  • Home Assistant set up already, I've seen the OpenAI integrations but would like to migrate off of those
  • Google Minis laying around, I'm willing to sacrifice one of them if it means I can use my own stuff
  • Spare 1650GTX GPU, I know not the best but hopefully enough to get it off the ground before deciding to go in on a larger GPU that would be dedicated to this

Needs/wants/nice to haves would be:

  • Basic chat functionality, what's the weather like
  • Play music from my plex or jellyfin server
  • HA integrations so I could say stuff like "Turn off the lights"

Sorry for dumping all of this, like I said I've seen blog posts around, some are doing parts of this, but I wonder if anyone has done something like this. I'm sure people have tried. Guides, jumping off points, even githubs/projects you know of would be helpful.

Thanks all!

view more: ‹ prev next ›