Don’t DM me without permission please
You don’t need to be rude.
My original comment was in reply to someone looking for this type of information, the conversation then continued.
Disengage: I don’t want to deal with it today frankly, I don’t have time for rude people.
I like when it insists I’m using escape characters in my text when I absolutely am not and I have to convince a machine I didn’t type a certain string of characters because on its end those are absolutely the characters it recieved.
The other day I argued with a bot for 10 minutes that I used a right caret and not the html escape sequence that results in a right caret. Then I realized I was arguing with a bot, went outside for a bit, and finished my project without the slot machine.
Yes, precisely.
If you’re trying to use large models, you need more RAM than consumer grade nvidia products can supply. Without system ram sharing, the models error out and start repeating themselves or just crash and need to be restarted.
This can be fixed with CPU inferencing but would be much slower.
An 8b model will run fine on an RTX30 series, a 70b model will absolutely not. BUT you can do cpu inferencing with the 70b model if you don’t mind the wait.
Today I made vegetarian salisbury steaks using impossible patties, store bought broth, and fresh veggies and herbs (and some stuff I had laying around). I spent less than $15 total (costco, price per unit) on the ingredients. It took 2 hours of cooking.
Assuming a wage of $25/hr, lower than adequate but relatively high in service fields in the US (those who work enough that delivery is super tempting), my meal cost me $65 including my labor. That’s less than it’d cost for delivery of a similar meal, is higher quality than I could get for delivery, and I’ve got leftovers for tomorrow, which I wouldn’t get with delivery.
Delivery is a scam. Gig economy Based delivery doubly so.
8b parameter models are relatively fast on 3rd gen RTX hardware with at least 8gigs of vram, CPU inferencing is slower and requires boatloads of ram but is doable on older hardware. These really aren’t designed to run on consumer hardware, but the 8b model should do fine on relatively powerful consumer hardware.
If you have something that would’ve been a high end gaming rig 4 years ago, you’re good.
If you wanna be more specific, check huggingface, they have charts. If you’re using linux with nvidia hardware you’ll be better off doing CPU inferencing.
Edit: Omg y’all I didn’t think I needed to include my sources but this is quite literally a huge issue on nvidia. Nvidia works fine on linux but you’re limited to whatever VRAM is on your video card, no RAM sharing. Y’all can disagree all you want but those are the facts. Thays why AMD and CPU inferencing are more reliable, and allow for higher context limits. They are not faster though.
Sources for nvidia stuff https://github.com/NVIDIA/open-gpu-kernel-modules/discussions/618
https://forums.developer.nvidia.com/t/shared-vram-on-linux-super-huge-problem/336867/
https://github.com/NVIDIA/open-gpu-kernel-modules/issues/758
Could be an Alert Dog. I have e a neighbor with one, the Dog’s job is “Be a Dog unless daddy is about to go into diabetic shock, then calmly alert until someone does something.”
Not all service dogs have super big jobs, some are just like organic blood tests.
Its bleached and straightened. The bellend shape implies it would be curly if she didn’t cook it every morning with a flat iron.
👀 had no idea Qt6 had a mobile kit, I’ll be taking a look at this thank you for sharing.
deleted by creator
I once spent weeks dealing with a bizarre bug on my PC, couldn’t figure it out. When it persisted in a live environment I knew it was hardware.
I found a charred moth bridging two pins on my motherboard on an unused fan header, I think it was causing enough of a voltage drop to cause issues because I don’t see how a bridged fan header could cause issues otherwise
Unofficial:
Minigalaxy and Heroic are both clients which support GoG
They should put atomic clocks in the GPS satellites for exactly this purpose.
Just an aside, you can make Alkaline lemon water.
It do it:
I set up Linux on a laptop with a particularly aggressive keyboard power button recently. I’d be at the terminal go to hit backspace and where Linux?
Actually had this occur on a USB NTFS drive I haven’t migrated the data to another fs from yet. It mounts at boot so my whole system got hung up until I removed it from the fstab and installed the tools to scan and fix the ntfs filesystem from the aur.
Was like a 20 minute fix, including time to research the tools I needed to fix it.
Depends on your Distribution (really your desktop environment). On KDE Plasma for example, there is a little tile for it on the taskbar.
I DO do software dev, so my answer might not be relevant to you. Its because If the window is open, I need it right now. Otherwise it wouldn’t be open, or it’d be stashed away on another desktop.
I prefer offpunk.