u/jijig

I can get FP16 context at 150k but full context on Q8

Of course, sorry. KV cache is quantized at Q8. I can push my context to ~160k at F16

Llama.cpp

It’s quite good. I’m running 3.6 at Q8 with full context and getting ~60-70tps. No NVLink

Edit: Q8 KV cache. I can push my context to ~160k at F16

Get two. Run Q8 with full context at ~60tps.

Dual RTX 3090 owners:

ENGAGE ENGAGE

Hey you just need 79 more 3090s

Hey if you already got 2 3090s you only need 81 more

Hey, I like lamb with buttered leek

If you’re using pi there are extensions that manage a memory per project / folder for you in a simple MEMORY.md file. That’s basically the whole magic. You even could let pi create such an extension by itself and tailor it to your taste.

Right, an actual conversation without the words 'glazing' or 'bot'

lol all these random attempts to make Ornith happen

Just listened to Part 2 the other day. So good

Yes

https://i.imgur.com/0PjZgzj.jpeg

Drake & Uzi - At the Gates

Superhero the better song for the world cup

Echoing Strike Warlock needs ~100 hard points Dex now to be effective. The circlet would give you +40 points to vitality or +120 life

I see where you going with this but nah not really. They were using a lot of musical language that reminded of ye. But in the end it’s still yeat lol

Beat selection is very strong with the recent Cyhi joints

Amazing sample flip

The official one is very basic in functionality

The map-view plugin is excellent, highly recommended. I log every location I want to keep with it, especially searching with the Google Maps API for locations is awesome.

The last beat is crazy

Initially I thought the same but after aminute the horns seemed like some Suno / Udio AI shit