u/DigitalguyCH

How do you run qwen3.5 35bA3b at that speed on 16GB. Is is a very low quant? I can't fit the Q4 on my 24GB

The 15 Air is amazing device

I love the touchscreen on my Thinkpad X1 Carbon, plus it's matte and doesn't fingerprints at all. But I don't miss it on my MacBooks. I miss it on my Windows laptops if I don't have it tough. It's a nice bonus

I would love to be able to run 35b on my 24gb air, it just doesn't fit currently, unless I go Q3

they didn't need to justify the price to be honest, I like to think that this will allow to power macs apps to iPad more easily

This quant runs on my M5 pro 64GB at 30 t/s, but I would love to run something useful on my 24GB air. Can you make a version of the 35b or 27b that can run fwell on 24gb?

yeah Apple is charging more than double just for the RAM because they can, hope noone will buy this

The pros won't increase in price. The air could increase if it gets oled. The increase for memory and storage already happened.

Nope, $599 for the oled without the AI inflation, no less than that

Totally, I can run flash next iQ3 on my 64GB and it's better than 27b at any quant (not a lot for coding, but quite significantly for virtually anything else). And that's not possible with 48GB.

At these prices I am buying nothing else for a few years

I do, but honestly 20-30 t/s is ok and on my MacBook pro M5 64GB I can run 27b splash at over 50 t/s

well, linux is not an option for me, I need Windows

wow I only get 20 to 30, I don't know what Radiance is but I will look into it

what speed does it run?

I think my use of AI is not that complex, but I need high end models, I mainly use qwen flash next and 27b for financial document analysis and related tasks and while I use that everyday for my job, I barely even need agents, I can do most things from the chat box. I have dozens of old laptops and tablets but none other that those I bought in the last year is good enough for those models

I have tried putting to use my old 4770 with 32GB DDR3 and a (somewhat newer) 2070 super, which I wasn't using anymore since 2023. If I had nothing else, it can run Gemmas 12b fast and Qwen 35b at 13 t/s.
So not terrible. But forget 27b.
But since I had equipped myself for AI in the first part of 2026, when prices were high but not crazy like now (Z13 128GB $2500, M5 pro 64 16" nanotexture $3000, and a used 7900XT for $450 used with a egpu with my legion go 2). There is really not much of a reason to turn on my old desktop (which was replaced by a mini pc), because once you get used to have 27b at 50 t/s (with splash) and flash next between 20 and 30, there is really no point in even running 35b or gemmas at all... And the problem with old hardware is not just DDR3, it's everything that is a bottleneck, storage speed, bus speed, PCIe speed etc. But again if I had decided to get into AI now, I would do with what I have. And I am definitely not buying anything for a couple of years.

And too heavy

When you post something like this, you'll get a ton of anecdotal and sometimes contradicting evidence that means very little without scientific knowledge of lithium batteries, and hardly anyone has that unless they have worked in this field...
What happened to you is totally possible and has a very likely scientific explanation.
Sorry for my non native English.
Your battery was probably worn already but no cells were dead yet. A worn battery, somewhere in the 80% with no dead cell can still last a long time. But it's much more vulnerable to "stress".
Lithium batteries hate stress. But if they are in good shape, cells won't die, it will just wear faster. But once enough wear is there (like an old person vs a young one), stress take a much bigger toll.
When you kept you MacBook plugged in at 100% for days you put cells in a state of prolonged stress, and MacBook charge management does not change their behaviour immediately, it takes days to learn as it was not used to it (and unless you have a very regular usage pattern it's never as reliable as a charge threshold). But that alone is probably not enough in 4 days. You probably kept using your MacBook, so you added other sources of stress like heat, which is different from high voltage (high voltage is your 100%).
So this probably killed some cells and once some cells die it's a downward spiral. Have you already experienced a battery in a device that starts to last less and less faster faster at some point and maybe even turn off at 30% already? That's when some cells are dead, and there is no coming back from that.

absolutely not

I am the first to praise flash next, and Q3 in flash next is generally superior to Q8 in 27b, but Q1 is a massive downgrande while Q4 is a minor one. When you get to Q1 models are generally no longer reliable, unless maybe they have trillions of parameters

27b Q4 over flash next Q1 any day

Qwen has trillions parameters models, those may be affected not 27b and probably not flash next either. And regardless, things become obsolete fast in the world of local AI. Nobody will care about Qwen 3.8 when 5.0 will be there, just like nobody cares about 2.5 today... So this sounds even dumber than hoarding toilet paper during covid

Flash next is not a lot better at coding than 27b, but it's a lot better at everything else (in this sub there is a bias in favor of coding but a ton of people use local AI for other things).
Having said that if you can run both, flash next is also faster, so you not only gain in intelligence but also in speed.
If you have don't have enough RAM for flash next but you have enough fast vram or a Mac (with splash or kapitsa), the real entry point is not flash next, it's 27b.
I no long use any gemma, unless I have a device where the best I can fit is gemma 12b at Q4.
Qwen 35b is still very decent and better than any gemma, but 27b is great
64GB gives you flash next at iQ3 XXS, and 48GB gives you room for 27b, but get a Mac if you cannot get 27b, it's faster than any unified memory in Windows and you have a lot more optimized inference engines for MacOS

boy? in the laptop wallpaper?