u/zerd

36 post karma · 3,531 comment karma · joined Sep 2009

zerd

Some code can be art though. For example 4k intros, https://www.pouet.net/prod.php?which=52938, or quines https://mamememo.blogspot.com/2010/09/qlobe.html?m=1

zerd

How do you run 9xV100?

zerd

Some fun examples in https://github.com/Speykious/cve-rs as well

zerd

Is it not illegal now?

zerd

Some tips for controlling spend here: https://youtu.be/wdRV-K92gEI

zerd

It’s is a fork of Strata for larger models.

zerd

I prefer D♭

zerd

“Simple”

zerd

Hard to get pickpocketed in a car.

zerd

Which they already are https://www.bbc.com/news/articles/cly17834524o

They are also building drones, lots of them. https://shield.ai/

zerd

Assembly wrapped in C isn’t even portable.

zerd
zerd

Do you think there's anything left to squeeze out of it?

zerd
zerd

Do you see compression artifacts on 4K blu-ray?

zerd

It still honors e.g. --tensor-split 17,7. I'm running 5080+2070 and --split-mode tensor increased tps a lot, but it reduced prefill a bit.

zerd

Russia is also known for abducting children and brainwashing them into pro-Russia and making them join the army against their families https://en.wikipedia.org/wiki/Child\_abductions\_in\_the\_Russo-Ukrainian\_war

zerd
zerd

Try with -sm tensor for multi-gpu, got a decent speed up from that.

zerd

Yes, but heads up, there is a ton of plot holes.

zerd

I was testing various configs on a 5080+2070S. This is what I found max speed so far:

-m Qwen3.8-27B-IQ4_XS.gguf -ngl 99
-sm tensor --tensor-split 19,5
--flash-attn on -c 81920
--cache-type-k q8_0 --cache-type-v q8_0
--spec-type draft-mtp --spec-draft-n-max 2 --spec-draft-n-min 1
--reasoning-effort medium --reasoning-format deepseek
--reasoning-budget 4096 --reasoning-preserve
--cache-ram 2048 --ctx-checkpoints 8 --no-context-shift --cont-batching --metrics
# sampling: temp 1.0, top_p 0.95, top_k 20, min_p 0

~79 t/s decode · ~1210 t/s prefill · 82k context

Or --tensor-split 17,7 to get -c 122880 at 70 t/s. That's with upstream llama. -sm tensor helped because it splits the kv cache across both gpus.

zerd

NetAlertX does that part pretty well https://github.com/netalertx/NetAlertX

zerd

Curious, that fork seems to focus on MoE, how does it help on 27B?

zerd

Polo is a stick and ball game that is played on horseback as a traditional field sport, and is one of the oldest known team sports in the world.

https://en.wikipedia.org/wiki/Polo

zerd

It was to distinguish it from other ball games such as polo where you play on a horse instead of on foot.