u/CallMePyro
CallMePyro
CallMePyro
This much better fits my expectations with k3.1, it feels extremely benchmaxxed ands nice to see it fall so far down the list with the addition of some private evals.
CallMePyro
There's no comment body, I was just messing around
CallMePyro
Agreed, great points
CallMePyro
This would only be true if the next gen open models are cheaper than their closed source counterparts. https://matharena.ai/?comp=arxiv--september&view=problem
For example it seems that Kimi K3.1 is 4x more expensive (double tokens and double cost per token) than Sol 6.1 while being a lot worse at arxiv math. Open source needs to make significant gains in cost/performance if they want to compete with Anthropic or OpenAI in math.
CallMePyro
Claude slop
CallMePyro
The welders for the...datacenters?
CallMePyro
Cope
CallMePyro
The real answer that actual businesses use is to make a benchmark. Collect a set of tasks and either use a judge model or train a preference model and use one of the models that sits on the cost/capability frontier. For random people, find an existing benchmark that's close to what you want to use the model for and use the best model that fits your budget
CallMePyro
And then go make matters worse, he's writing letters to all his friends about how Google is overvalued and has no use cases
CallMePyro
Let me put it this way: do you write or review code of any kind as one of your core responsibilities? And if so, approximately how many lines of code do you write and review each month?
CallMePyro
Complete radio silence from u/marvin_bender
CallMePyro
Which is a good thing for AI revenues.
CallMePyro
Bro someone sitting at a Claude or codex terminal can burn 12k in a month if they aren't careful.
CallMePyro
Of course they will show enormous returns on their CapEx. At 3 year-CUD rates a new TPU pays for itself in under a year, and TPUs installed 8 years ago are still running at 100% utilization. The massive returns they see will incentivize them to sell more debt, issue more equity, and continue to spend every dollar they make on growing their business. New TPUs will get significantly more efficient as they utilize new technologies like BPPD and GAA-FET lithography. Furthermore data and algorithms improvements to AI will make it increasingly profitable to serve a larger and larger portion of the planet with frontier-level AI.
CallMePyro
Not surprising since it was distilled from 6.1 Sol
CallMePyro
Is Nvidia a random stock?
CallMePyro
Maybe they could bundle kimi k3.1 with codex
CallMePyro
If a meteor destroys their headquarters it would be very bad for the stock
CallMePyro
Capex pressure will never ease, sorry. AI is going to eat the entire planet and Sundar realizes it.
CallMePyro
You think there's literally any chance that their chips sit idle when the CEO is going on the news to say that they're turning away new customers and they have a $500 billion cloud backlog of committed spend?
CallMePyro
What are you talking about? CVEs are scored on exactly this metric and every single one of those bugs has an appropriate severity. Human hallucination. Ask Claude next time before commenting.
CallMePyro
I've posted a couple of these, they're total garbage and they get a ton of upvotes. I just Google "AI Bubble" and if an article with a good headline pops up I'll post it
CallMePyro
So you're shifting your argument to be "of AMZNs 220B capex, only $10B of it is spent on NVidia chips"?
Kimi looking extremely benchmaxxed