u/Terminator857
-
190points
-
0points
When will google TPUs trickle down to the common folk? (self.LocalLLM) [Question]
-
14points
When will google TPUs trickle down to the common folk? (self.LocalLLaMA) [Discussion]
-
0points
-
2points
-
35points
Intel Razor Lake Ax in 2028 ruff estimate about 46 TPS on dense 27b (wccftech.com) [Discussion]
-
0points
How to make money with open weight LLM (epoch.ai) [Discussion]
-
0points
Poll: when do you think you'll be able to run a model as smart as Qwen 3 27b on your phone at goodspeed? (self.LocalLLaMA) [Discussion]
Terminator857
Terminator857
You seem to be overlooking the first word in the post: theory. Theory means there isn't proof. If you don't like to discuss a theory you shouldn't come here and try to poop all over.
Terminator857
It varies. Each generation of TPU is optimized / prioritized for either training or inference.
Terminator857
Summary: we are well aware of how AI has automated coding. Hardware is software written into the hardware.
- https://www.forbes.com/sites/karlfreund/2026/10/27/chipagents-accelerates-chip-design-with-agentic-physics-aware-models/
- https://www.google.com/search?client=firefox-b-1-d&q=does+ai+cut+ai+chip+development+time%3F
- https://x.com/firesidealpha/status/2114329376628027755
- https://x.com/DanielNenni/status/2115189533113471171
Terminator857
We need more incompetent trillion dollar companies.
Terminator857
You missed the memo that AI cuts chip development time in half. Update: Summary: we are well aware of how AI has automated coding. Hardware is software written into the hardware.
- https://www.forbes.com/sites/karlfreund/2026/10/27/chipagents-accelerates-chip-design-with-agentic-physics-aware-models/
- https://www.google.com/search?client=firefox-b-1-d&q=does+ai+cut+ai+chip+development+time%3F
- https://x.com/firesidealpha/status/2114329376628027755
- https://x.com/DanielNenni/status/2115189533113471171
Terminator857
Careful step by step planning to become master of the universe.
Terminator857
Someone posted about 8 days ago that they were able to buy a used amd strix halo for $2K.
Terminator857
LLM generated title. Disappointing.
Terminator857
Terminator857
How long before I can run a model this smart locally for less than $5K, at >50 tps?
Terminator857
There are many papers on arxiv on looping coming out frequently. This suggests that smaller models are going to get smarter by looping. Which means more run time for inferencing, taking longer to process. Perhaps the opposite of what you want. Slower, but smarter.
Terminator857
Tell me more.
Terminator857
I enable medium think level. {"reasoning_effort": "medium"}
Terminator857
Some would say it doesn't matter, because memory bandwidth is the bottleneck for inferencing.
Terminator857
Open AI -> openly steal your precious data using AI.
Qwen 3.8 27b to the rescue.
Terminator857
Base die outsourcing, in other words outsourcing the logic die in a set of memory chips is common. https://www.reddit.com/r/intelstock/comments/1w2zgc0/breaking_news_sk_hynix_to_outsource/
You are lucky, I get one prompt and done for a week.