@noroute@lemmy.world @yoasif@fedia.io local LLM execution times can be very fast on recent consumer hardware. No need to send anywhere, just like their translation - do it all on-device.
As an example, with no optimization or GPU support, my @frameworkcomputer@fosstodon.org (AMD) generates around 5 characters/sec from a 4 gigabyte pre-quantized model.
falken
joined 4 months ago
@henfredemars tried https://support.mozilla.org/en-US/kb/troubleshoot-and-diagnose-firefox-problems ?