rs137

Llama 2 70B with 8b quantization takes around 80GB VRAM if I remember correctly. I’ve tested it a while ago.

I think it was around 7.5k EUR. But because I bought and sold Apple shares with this in mind I’ve paid around 500 EUR for that thing.

And what exactly is wrong with that?

My MacBook Pro was 128 GB of memory is so desperate to fill it up that it gives the applications insane amounts of memory. That only took around 30 GB of memory, so the Mac also loaded the entire file system to the memory which takes around 80 GB. The whole system is super fast because it doesn’t have to read the files from a slow SSD, but from a fast memory.

It’s just a matter of how you look at it. The empty memory = wasted memory.

Get fucked for what? That I’m from the EU? That I send donations to the country at war? That I have a gf?

Not everyone! I’m one of those. From time to time some American reminds me but my brain filters out as a completely useless information and I forget it.

It’s the sense of speed and degree of realism is higher than in Forza games. GT Sophy AI is also amazing. It adds personalities to the AI cars so they no longer follow predefined lines but they block, attack, crash or spin from too much throttle.

I’m addicted to Grand Turismo 7 right now. I don’t play anything else which is rare with me. I even got to the point where I bought PS VR2 just for this game.