u/exploder98

Suomeksi tuo on nimeltään Mimun Maailma, ja näyttäis olevan Yle Areenassa: https://areena.yle.fi/1-50618192

Rajametsän tarinoita!

Looks pretty good in general.

Except for the "search term persistence". I want to see the URL!

"Very high damage: inf"

Yeah can't disagree with that

Flash Attention support (now they do)

Technically yes, but it's slower than pytorch math implementation on my hardware.

Pytorch natively has FA support

Technically yes (through the sdpa kernels), but it relies on aotriton which is only compiled for MI200, MI300 and Navi31 cards (6900xt is navi21).

Yes bitsandbytes does indeed (finally...) work on AMD! Great to hear that improved AMD support is basically planned.

I'd like to see proper AMD support, and not just for architectures xformers (or rather, composable_kernel) compiles on, as they are just the MI series datacenter cards. I personally have an RX 6900 XT which has the gfx1030 architecture, and xformers does not work on that.

At least flash-attention now somewhat supports gfx1030 via triton, even though based on my testing the plain pytorch version of attention is faster at least on my hardware...

Kiitos!

I think the "suggested" label only updates whenever you get souls, so that's where the feeling of bugginess comes from.

Eihän ole, äiti, ne ovat vain revontulia.

For me at least, llama.cpp flash attention on ROCm has pretty much been "just compile and it works". It hasn't really been that fast, but at least quantized KV caches work.

It's the python package version of FA that I just have not managed to get compiled for my 6900 XT (gfx1030).

"Won't be releasing in the EU" - does this refer to just Meta's website where the model could be used, or will they also try to geofence the weights on HF?

Yeah, I imagine there's something broken in these quantizations right now unless he implemented the model in his sleep or something :P

I wonder if the ggufs are just broken/done with a very old version of llama.cpp. When I tried to convert the model, the script complained that the model arch was unknown.

Also, the ggufs do not have the tokenizer.ggml.pre metadata attribute, so it's likely that the tokenizer is slightly broken at least.

Me who uses linux: "Wow, you got my webcam working? Please tell which driver you used!"

Exploder_98 (PC)

Ikävää kun kaivelee tämmöisiä /s

Just vähän aikaa takaperin joku valitti redditissä että sen pesukone käytti monta gigatavua dataa päivässä.

Tämä tais itse asias olla reitittimen tilastoinnin bugi.

Someone already did something similar, which seems to include most Vosfor values: https://www.reddit.com/r/Warframe/comments/18jhbjj/best_way_to_get_vosfor/

Paras oli jossain Ylen artikkelissa, jossa puhuttiin aggregaatista, joka tuottaa "yhdeksän kilowattia tunnissa" :D

Those super high scores seem to happen if you exit the game while the combining animation from a chain reaction is going on and then go back. This bug has been there for a while.

"Tell them we are not buying"

Should be a hyperconductor

Jos on moderaattorina missä tahansa subissa niin kolmannen osapuolen softat toimii edelleen. Ja kuulemma sekin toimii, että tekee itselleen uuden subredditin jossa sitten on moderaattorina.

Restrict the sub and have a bot create a daily post with only the current date in ISO8601 format (or hourly, whatever). Each comment must contain the comment's (approximate) sending time in ISO8601.

Or: the post title needs to be its posting time in ISO8601, and same for comments. Nothing else allowed.