u/CallMePyro

8,125 post karma · 85.5k comment karma · joined Sep 2011

CallMePyro

Kimi looking extremely benchmaxxed

CallMePyro

This much better fits my expectations with k3.1, it feels extremely benchmaxxed ands nice to see it fall so far down the list with the addition of some private evals.

CallMePyro

There's no comment body, I was just messing around

CallMePyro

Agreed, great points

CallMePyro

This would only be true if the next gen open models are cheaper than their closed source counterparts. https://matharena.ai/?comp=arxiv--september&view=problem

For example it seems that Kimi K3.1 is 4x more expensive (double tokens and double cost per token) than Sol 6.1 while being a lot worse at arxiv math. Open source needs to make significant gains in cost/performance if they want to compete with Anthropic or OpenAI in math.

CallMePyro

Claude slop

CallMePyro

The welders for the...datacenters?

CallMePyro

Cope

CallMePyro

The real answer that actual businesses use is to make a benchmark. Collect a set of tasks and either use a judge model or train a preference model and use one of the models that sits on the cost/capability frontier. For random people, find an existing benchmark that's close to what you want to use the model for and use the best model that fits your budget

CallMePyro
CallMePyro

And then go make matters worse, he's writing letters to all his friends about how Google is overvalued and has no use cases

CallMePyro

Let me put it this way: do you write or review code of any kind as one of your core responsibilities? And if so, approximately how many lines of code do you write and review each month?

CallMePyro

Complete radio silence from u/marvin_bender

CallMePyro

Which is a good thing for AI revenues.

CallMePyro

Bro someone sitting at a Claude or codex terminal can burn 12k in a month if they aren't careful.

CallMePyro

Of course they will show enormous returns on their CapEx. At 3 year-CUD rates a new TPU pays for itself in under a year, and TPUs installed 8 years ago are still running at 100% utilization. The massive returns they see will incentivize them to sell more debt, issue more equity, and continue to spend every dollar they make on growing their business. New TPUs will get significantly more efficient as they utilize new technologies like BPPD and GAA-FET lithography. Furthermore data and algorithms improvements to AI will make it increasingly profitable to serve a larger and larger portion of the planet with frontier-level AI.

CallMePyro

Not surprising since it was distilled from 6.1 Sol

CallMePyro

Is Nvidia a random stock?

CallMePyro

Maybe they could bundle kimi k3.1 with codex

CallMePyro

If a meteor destroys their headquarters it would be very bad for the stock

CallMePyro

Capex pressure will never ease, sorry. AI is going to eat the entire planet and Sundar realizes it.

CallMePyro

You think there's literally any chance that their chips sit idle when the CEO is going on the news to say that they're turning away new customers and they have a $500 billion cloud backlog of committed spend?

CallMePyro

What are you talking about? CVEs are scored on exactly this metric and every single one of those bugs has an appropriate severity. Human hallucination. Ask Claude next time before commenting.

CallMePyro

I've posted a couple of these, they're total garbage and they get a ton of upvotes. I just Google "AI Bubble" and if an article with a good headline pops up I'll post it

CallMePyro

So you're shifting your argument to be "of AMZNs 220B capex, only $10B of it is spent on NVidia chips"?