Ah ok, I’ve had these drives for a while now but ended up using SSDs instead so they just sat in my parts drawer reminding me of a bad purchase xd.

Crazy how they are like 3x the price now from when i bought them in 2023

Do you happen to live in zuid holland?

I have 2 unopened Seagate IronWolf ST4000VN006 that I’ll be happy selling.

No idea what a fair price or your budget would be. That is if you are interested in these drives to begin with.

Obligatory shoutout to https://github.com/cat-milk/Anime-Girls-Holding-Programming-Books/tree/master

My 2 cents are that the issue is promotion not AI, if people started promoting stuff made without AI that would still be spam.

From the rules:

F/LOSS Exception: If your post is about a project that is completely open source & can be self-hosted in full without payment, your post is exempt from the 10% requirement. The exception does not exempt you from the account age requirement.

I would propose making this the requirement and not an exception, forbid all promotion of closed source, and allow the 10% requirement for open source projects.

Steam machine is 1039 euro

Why would anyone pay for this when documentation is readily available, even for non technical users?

https://github.com/oobabooga/textgen

Installing something like textgen is as easy as downloading a single executable.

https://gitlab.archlinux.org/archlinux/packaging/packages/code/-/blob/main/PKGBUILD

Seems like it, but isn’t that the same what vscodium does? https://github.com/VSCodium/vscodium#why-does-this-exist

Unless i am misunderstanding?

Not to discredit your point about the AUR as I use it plenty myself but for this specific case is there a reason to use vscodium on arch since they ship code as an official package which has a marketplace?

That user’s Linux is in bed with a US private corpo

Everyone’s linux is in bed witu US corpos if you just look at the commit history of the kernel

I’m running 2x4090, the 35B fits very comfortable in that.

For large models like the 397B without a ton of money there are several ways, ive seen posts of people using arrays of used 3090s with good results.

The other option is CPU inference although with current RAM prices that is less cost effective.

I was looking at maybe an array of Milk-V JUPITER2 since vllm added riscv support which could be very cost effective.

Depending what OP was using before but going from something like GPT5.2 to LLama 3 8B will be a massive difference (Although OP says to use it only for basic tasks so that does offset it)

LLama 3 already being a very old model doesn’t help either

I run Qwen3.5-35B-A3B-AWQ-4bit which while leagues ahead of LLama 3 8B still is a very noticeable difference.

This is not to say open source is bad, if one had the resources to run something like Qwen3.5-397B-A17B it would also be up there.

any tips?

My laptop has this option in the bios settings Not sure if it’s only for laptops but you could check there.

I’m running wayland with nvidia-open and nvidia-utils packages, and have never encountered any driver issues in both graphics and compute.

I think everyone has once thought of the idea of taking an sbc and a touchscreen and making a linux phone, cool to actually see one!

Forget that the real evil is that the first character of Int or Ganz in this case is capitalized

Haven’t used shotcut or openshot but can recommend kdenlive, it has alot of features but I find it a bit clunky sometimes to work with.

For me when I was working on a large project it crashed once and the autorecover worked, although I still manually save since I’m paranoid.

I’m selfhosting Forgejo and i don’t really see the benefit of migrating to a container, i can easily install and update it via the package manager so what benefit does containerization give?

Why do core counts and memory type matter when the table includes memory bandwith and tflop16?

The H200 has HBM and alot of tensor cores which is reflected in its high stats in the table and the amd gpus don’t have cuda cores.

I know a major deterioration is to be expected but how major? Even in extreme cases with only 10% efficiency of the total power then its still competitive against the H200 since you can get way more for the price, even if you can only use 10% of that.

Thanks! Ill go check it out.

My target model is Qwen/Qwen3-235B-A22B-FP8. Ideally its maxium context lenght of 131K but i’m willing to compromise. I find it hard to give an concrete t/s awnser, let’s put it around 50. At max load probably around 8 concurrent users, but these situations will be rare enough that oprimizing for single user is probably more worth it.

My current setup is already: Xeon w7-3465X 128gb DDR5 2x 4090

It gets nice enough peformance loading 32B models completely in vram, but i am skeptical that a simillar system can run a 671B at higher speeds then a snails space, i currently run vLLM because it has higher peformance with tensor parrelism then lama.cpp but i shall check out ik_lama.cpp.