u/satireplusplus

18.8k post karma · 175.8k comment karma · joined Apr 2016 · moderator

satireplusplus

How did it go?

satireplusplus

Vibe coding is having 0 programming experience and just letting the agent do anything it wants without understanding anything. This is here likely the opposite, someone gifted testing the limits of this new tech.

The times were human made code is somehow superior is likely over - the Fable / Astra class of models writes cleaner Python code than I ever did. The only thing we're I feel I can still make a difference is organizing a larger code base. 

satireplusplus

Also completely ignoring that there are tons of human slop games too. Like literally most of the Android/iOS games for example. "Human made" doesn't make those better.

satireplusplus

5090 is already fucked and priced like an enterprise card. but it also has way to low VRAM for serious model training, even at 32GB.

satireplusplus

Bf16 is an enterprise feature, so they do market segmentation. It's actually extremely useful for model training and apparently the silicon can do it, it was just turned off in the firmware / driver.

satireplusplus

I mean just don't use fucking php. And most WordPress sites could have been static .html sites anyway.

satireplusplus

Well now you need more DDR5 ECC RAM 😄

satireplusplus

idk maybe somebody just wanted to run kimi at home

satireplusplus

Cost of R&D and training those models is not factored in here. So it needs growth and scale to offset it.

satireplusplus

Looks like something out of a video game. Enemies running around clueless.

satireplusplus

Explain to me how Russian data centers going puff is a problem for America, without mentioning that MAGA needs their Russian bot farms for the mid terms.

satireplusplus

and played the game wrongly

satireplusplus

He's like a broken record now. Sneak peak of some of his recent predictions and comments.

  1. "In five years, nobody will use autoregressive LLMs" - 2023
  2. "They can't really reason" - January 2024
  3. During Lex Fridman Podcast episode 416, LeCun identified understanding, memory, reasoning, and planning as essential attributes of intelligence. "LLMs can do none of those or they can only do them in a very primitive way." - March 2024
  4. "If you are a PhD student, don't work on LLMs" — June 2024
  5. "A house cat is smarter than the biggest LLMs" — February 2024
  6. "LLMs are good at manipulating language, but not at thinking" — January 2025
  7. "Nobody in their right mind would use them anymore" — January 2025
  8. "LLMs will become obsolete within five years" — October 2025
  9. "AI sucks" — April 2026
satireplusplus

Meta seems to be doing better without him now. Sneak peak of some of his recent predictions and comments.

  1. "In five years, nobody will use autoregressive LLMs" - 2023
  2. "They can't really reason" - January 2024
  3. During Lex Fridman Podcast episode 416, LeCun identified understanding, memory, reasoning, and planning as essential attributes of intelligence. "LLMs can do none of those or they can only do them in a very primitive way." - March 2024
  4. "If you are a PhD student, don't work on LLMs" — June 2024
  5. "A house cat is smarter than the biggest LLMs" — February 2024
  6. "LLMs are good at manipulating language, but not at thinking" — January 2025
  7. "Nobody in their right mind would use them anymore" — January 2025
  8. "LLMs will become obsolete within five years" — October 2025
  9. "AI sucks" — April 2026
satireplusplus

He somehow got very anti-LLM, preaches that "true AI" (tm) cant be an LLM and generally lost touch with recent research. Im not surprised.

satireplusplus

Kimi enters the chat and it wants 4 of those 480GB GPUs

satireplusplus

They have Intel pytorch versions and SYCL, training perf will also depend on compute though. But yeah its not gonna be as plug and play and worry free as CUDA. With Claude code able to one shot ggml/gguf implementations of obscure models just from the pytorch code, it might not be the end of world to not have CUDA in 2026 either.

satireplusplus

The 10k dollars rich people tablet? lmao who is gonna buy these at car prices

satireplusplus

lmao

satireplusplus

Watch how even the worlds richest man cant do anything about the midterm trainwreck thats gonna come for repubs. Would love to see Elon face plant here and burn 300M for nothing.

satireplusplus

That's the thinking monologue that must have slipped through, this is usually no longer shown to you, but its something the model creates for every answer like any other output. And then its filtered out in post processing. This is what model is doing when it says "thinking" in the UI btw. It measurably improves the quality of the answer it gives next. They recently started to shorten it on purpose to save on output tokens, thats why you get this weird keyword salad and not full sentences. Also almost all of the frontier models use English to "think" regardless of the output language, and I've seen some Chinese ones that use Mandarin for all model monologues.

satireplusplus

Anthropic also delayed their IPO and wanted to release their S1 last month, I think they still haven't dropped it despite the leak.

satireplusplus

They look more white / cleaner to me before they go into that filthy dirt pool. And they are all going through the same dirty water. One of them shits in it and they all smell like poo lol.

satireplusplus

If they just made a subwide bus to connect to all LPDDR5X in parallel then it can still be miles better than regular desktop DDR5. They do claim 1.5TB/s, thats decent bandwidth regardless of the memory type used here and definilty GPU territory. RTX 5090 or RTX 6000 pro also have 1.7TB/s, so it would be comparable.

satireplusplus

At 10k or even 12k, It actually looks quite compelling next to a 20k RTX 6000 pro. Cause realistically you still dont have enough VRAM with 96GB for the really interesting models.
Cant wait to get my hands on these for a decent price in 10 years lol.