Thank you for that explanation. My regex impaired ass thought he wanted to hurt generation[x|y|z].
I'm like "what'd we ever do to you?"
OpticalMoose
joined 1 year ago
Switched from Kubuntu to Mint + KDE last week. Very happy indeed.
At least the article points out that this is a Wall Street valuation, meaning it's meaningless in reality, the company doesn't have that much money, nor is it actually worth that much. In reality, Nvidia's tangible book value (plant, equipment, brands, logos, patents, etc.) is $37,436,000,000.
$37,436,000,000 / 29,600 employees = $1,264,729.73 per employee
Which isn't bad considering the median salary at Nvidia is $266,939 (up 17% from last year).
It sounds like the processor is the real limitation. Plenty of stuff from Windows XP era and before ran in less than 512MB.
So here's the way I see it; with Data Center profits being the way they are, I don't think Nvidia's going to do us any favors with GPU pricing next generation. And apparently, the new rule is Nvidia cards exist to bring AMD prices up.
So here's my plan. Starting with my current system;
OS: Linux Mint 21.2 x86_64
CPU: AMD Ryzen 7 5700G with Radeon Graphics (16) @ 4.673GHz
GPU: NVIDIA GeForce RTX 3060 Lite Hash Rate
GPU: AMD ATI 0b:00.0 Cezanne
GPU: NVIDIA GeForce GTX 1080 Ti
Memory: 4646MiB / 31374MiB
I think I'm better off just buying another 3060 or maybe 4060ti/16. To be nitpicky, I can get 3 3060s for the price of 2 4060tis and get more VRAM plus wider memory bus. The 4060ti is probably better in the long run, it's just so damn expensive for what you're actually getting. The 3060 really is the working man's compute card. It needs to be on an all-time-greats list.
My limitations are that I don't have room for full-length cards (a 1080ti, at 267mm, just barely fits), also I don't want the cursed power connector. Also, I don't really want to buy used because I've lost all faith in humanity and trust in my fellow man, but I realize that's more of a "me" problem.
Plus, I'm sure that used P40s and P100s are a great value as far as VRAM goes, but how long are they going to last? I've been using GPGPU since the early days of LuxRender OpenCL and Daz Studio Iray, so I know that sinking feeling when older CUDA versions get dropped from support and my GPU becomes a paperweight. Maxwell is already deprecated, so Pascal's days are definitely numbered.
On the CPU side, I'm upgrading to whatever they announce for Ryzen 9000 and a ton of RAM. Hopefully they have some models without NPUs, I don't think I'll need them. As far as what I'm running, it's Ollama and Oobabooga, mostly models 32Gb and lower. My goal is to run Mixtral 8x22b but I'll probably have to run it at a lower quant, maybe one of the 40 or 50Gb versions.
My budget: Less than Threadripper level.
Thanks for listening to my insane ramblings. Any thoughts?
"Sir, they've given us a list of their demands, but I can't read this ... this chicken-scratch."
"As God is my witness..."
When I was in Korea, I leaned that chickens can (sort of) fly. They can flap their wings hard enough to get from the ground to a tree branch maybe 8 feet or so off the ground, and safely back down.
And I've heard chickens tasted better back in the old days. A bird that eats grubs, worms, grasshoppers, frogs, snakes, etc tastes different than one that just eats chickenfeed all day.
Renegade Cut had a pretty good video about her. https://piped.video/watch?v=HC4K1mx0SPQ. I was mostly wrong about her. I didn't realize they became friends later. That's a pretty big arc for only one season.
Maybe we don't live in the worst possible universe. Madonna and Will Smith in the Matrix, everybody using the Hulk Hogan Grill, Stallone as Axel Foley, OJ as the Terminator. I guess I'm ok with where we are now.
Awesome. I'd heard that Pat was one of Redd's old friends from the "Chitlin' Circuit" era of comedy, but I've never actually seen him do standup.
Probably better to ask on !localllama@sh.itjust.works. Ollama should be able to give you a decent LLM, and RAG (Retrieval Augmented Generation) will let it reference your dataset.
The only issue is that you asked for a smart model, which usually means a larger one, plus the RAG portion consumes even more memory, which may be more than a typical laptop can handle. Smaller models have a higher tendency to hallucinate - produce incorrect answers.
Short answer - yes, you can do it. It's just a matter of how much RAM you have available and how long you're willing to wait for an answer.
I had to take my GPU out to do some troubleshooting, so I figured why not try some games on the old Ryzen 5700G. Ray-traced Quake wasn't exactly playable at 3 fps, but I'm impressed that it could load and display correctly.
Other games I tried; Portal RTX wouldn't start at all. Spider-Man remastered did start, but I can't get past the load menu, not related to the Ryzen APU. Most of my library is 10+ years old, so pretty much everything else runs fine on the APU.
1
Pessimism growing in Trump's inner circle that a hush money guilty verdict is inevitable
(www.rawstory.com)
Apparently, it's rare for lawyers to draw objections during their opening statements, but it happened twice for Trump's team today and the judge sustained both objections.
MSNBC Commentary: https://www.youtube.com/watch?v=X-XetPGnx0M
1
Residents push for renaming of Trump Plaza to disassociate from ex-president
(www.theguardian.com)
view more: next ›
He was a great comedian but his "I don't vote" shtick really fucked this country over. Moderate, reasonable, people stayed home, thinking 'it doesn't matter', and conservative dickheads took over at the polls. 1996