u/zerd
zerd
zerd
How do you run 9xV100?
zerd
Some fun examples in https://github.com/Speykious/cve-rs as well
zerd
Is it not illegal now?
zerd
Some tips for controlling spend here: https://youtu.be/wdRV-K92gEI
zerd
It’s is a fork of Strata for larger models.
zerd
I prefer D♭
zerd
“Simple”
zerd
Hard to get pickpocketed in a car.
zerd
Which they already are https://www.bbc.com/news/articles/cly17834524o
They are also building drones, lots of them. https://shield.ai/
zerd
Assembly wrapped in C isn’t even portable.
zerd
Do you think there's anything left to squeeze out of it?
zerd
zerd
Do you see compression artifacts on 4K blu-ray?
zerd
It still honors e.g. --tensor-split 17,7. I'm running 5080+2070 and --split-mode tensor increased tps a lot, but it reduced prefill a bit.
zerd
Russia is also known for abducting children and brainwashing them into pro-Russia and making them join the army against their families https://en.wikipedia.org/wiki/Child\_abductions\_in\_the\_Russo-Ukrainian\_war
zerd
Got any sources on that? Here’s a couple that say certainty of getting caught acts as a deterrent (but harsher punishment does not):
https://nij.ojp.gov/topics/articles/five-things-about-deterrence
zerd
Try with -sm tensor for multi-gpu, got a decent speed up from that.
zerd
Yes, but heads up, there is a ton of plot holes.
zerd
I was testing various configs on a 5080+2070S. This is what I found max speed so far:
-m Qwen3.8-27B-IQ4_XS.gguf -ngl 99
-sm tensor --tensor-split 19,5
--flash-attn on -c 81920
--cache-type-k q8_0 --cache-type-v q8_0
--spec-type draft-mtp --spec-draft-n-max 2 --spec-draft-n-min 1
--reasoning-effort medium --reasoning-format deepseek
--reasoning-budget 4096 --reasoning-preserve
--cache-ram 2048 --ctx-checkpoints 8 --no-context-shift --cont-batching --metrics
# sampling: temp 1.0, top_p 0.95, top_k 20, min_p 0
~79 t/s decode · ~1210 t/s prefill · 82k context
Or --tensor-split 17,7 to get -c 122880 at 70 t/s. That's with upstream llama. -sm tensor helped because it splits the kv cache across both gpus.
zerd
NetAlertX does that part pretty well https://github.com/netalertx/NetAlertX
zerd
Curious, that fork seems to focus on MoE, how does it help on 27B?
zerd
Polo is a stick and ball game that is played on horseback as a traditional field sport, and is one of the oldest known team sports in the world.
zerd
It was to distinguish it from other ball games such as polo where you play on a horse instead of on foot.
Some code can be art though. For example 4k intros, https://www.pouet.net/prod.php?which=52938, or quines https://mamememo.blogspot.com/2010/09/qlobe.html?m=1