u/CoreyTheGeek

It's the economy and using AI for cover in "we are upgrading to AI and running lean!" Sounds way better to investors than "we are doing really poorly and/or over hired or planned poorly so now we're cutting headcount"

Man I'ma detective now trying to figure out how this agent fucked up the codebase.... I know he did it, the dirty punk... I just need the evidence

Lmao y'all get reviews?? I shredded a handful of AI bot reviews from my ai proxies co workers (literally tagged as automated AI reviews) and now they just auto approve my PRs instead

Absolute clown show at my company right now

Yeah all my "teammates," aka agent proxies, are just reviewing everyone else with auto-review AI bots literally marked as such, manger doesn't care, I've defended my PRs against their hilariously incorrect agents reviews and now they're all just approving my PRs without even looking at them (I know this because of speed of review).

But in the off planning meeting when I ask for a simple explanation of how a system they've implemented works, even excluding how it integrates into our app, they cannot orally explain it at all outside of an extremely vague response and shrugs when asked to clarify anything. Absolutely fucking insane.

I mean this is what the whole AI industry is praying for!

Well yeah the moment someone gives a talk showing a weakness they train directly on it; guess what happens with the riddle it failed on because it was a novel item when you train it so it's not novel anymore 😂 do you think anthropic and OpenAI are actively paying attention to things like this and patching to keep the faith in them up?

Because the LLMs would require foundational breakthroughs to replace higher level developers and they haven't materialized. The entire industry was banking on "if we throw obscene amounts of capital at this there will certainly be breakthroughs that will lead to gen ai" but that hasn't turned out. Notice over the last year anthropic and OpenAI pivoted HARD from "replace devs" to "supplement devs, maybe automate tasks with hard, unchangeable tests and linting"? Every company that tried to lay off tech staff quietly hired back.

Transformers architecture was a shortcut, some paper in like 2017 realized that they could have these things just cram a shit ton of parameters into these models and have them do really big matrix math equations to find probably the next best word and it seems pretty correct.

LLMs are basically Searle's Chinese room.

LLMs don't think, they can't replace tasks that require thinking, and the more context grows the worse the perform, so we can't just "give them all information on a prompr."

To give an example an LLM was asked the classic "man and son in car accident, man dies, son rushed to hospital, surgeon says 'i can't operate on this boy he's my son' how is this possible " and the LLM gets it right (the surgeon is the boys mother) because that's a classic riddle asked all over.

However they asked it 'a boy and his mother, car accident, mother dies, boy goes to hospital where the surgeon (who is the boys father) says I can't operate on this boy, he's my son' and the LLM still answered that "the surgeon is the boys mother" even though the prompt told it in parens that the surgeon was his father; why? Because it's just weights guessing at the next best token (basically word), and it had seen the normal version of the riddle so many times that the novel form was still more likely to answer it with the old answer (according to it's weights and calculations); there is no thinking, it isn't comprehending your inputs.

Tldr they can't replace higher level devs because they cant think about the problems, and they can't expand context large enough to brute force it because the models collapse with context bloat overwhelming cross attention (catch 22 of they need as much info as possible in a prompt to be most accurate but the more context given they break down in accuracy)

In my opinion the problem isn't generated code or AI agent code reviews, the problem is that business is demanding the same level of review before merging which simply isn't possible anymore. If biz wants the issues and token burn of fixing stupid issues that build up from poorly optimized and disjointed code written by agents that have a keyhole view of the codebase that's fine with me.

We need to pivot from "thorough review catches problems" to something like circuit breakers for quick identification of failures and deterministic as-near-seamless-as-possible fast rollbacks. My team has 7 devs and I'm seeing extremely irresponsible behavior, my manager doesn't seem to give a shit because of time pressure, and I can only assume removal of review of humans is very near future, so the only feasible strategy is quick rollback to last known stable build 🤷

PS I hate my job now it's so goddamn boring and unfulfilling, if anyone has ideas to pivot out I'd love to hear what they're doing now

Brother I have "software engineers" I work with that think giving Claude or gpt a rule file means it can't break that rule.

People are incredibly stupid 😭

Idk my org is trying to move stuff to a modular monolith and there's a PR queue years long now 😂 I think everything is just miserable and you have to choose your suffering

I'd bet (heh) professional athletes can't but LeBron James has enough money and fame that he can, corruption baby

Guild wars 2 kind of system, gear sets and runes you put in them give a huge variety of buffs to all sorts of build types; like my elementalist I can swap my talent points to DoT focus and tune my gear for longer and harder hitting DoT effects, then say I want to do something where DoT isn't as good so I can just swap my armor to a set tuned for power where my skills hit harder but any dot effects won't be as strong or long so I'd swap my talent tree also to more direct power traits too, great system and allows for a TON of builds across classes

explaining to executives

Brother I'm trying to explain to my teammates why "their" AI generated code is bad for their assigned tickets 😭

Showed this to my wife and she was like "if she's scrolling on her phone why can't he go play games?" I love my wife 😄

2015

shitty genie

Y E S

10,000%, couldn't agree more, your experience mirrors exactly mine and it feels so good to have someone see it the same, my "team" now are proxies for their agents and it's like talking to God damn body snatched people. Like I explain what's going on and that they can't just trust the agent and they smile and nod and say yes then just keep fucking doing it 😭

If I don't count my mortgage, taxes, utilities, groceries, childcare, and entertainment expenses I make a pretty solid amount of money!

These agents are probabilistically determining an output based on their training weights, they aren't thinking; it's the Chinese room. It's kind of like making a deal with a genie in that you need to give it really, really, really detailed instructions for things or it will be incorrect in subtle ways you didn't think about. And then because it's probabilistic even if you give it the "perfect specification" it can just randomly hallucinate and give incorrect output confidently.

https://giphy.com/gifs/YRPBhd3vscg5Fxx1DQ

Why? Transformers architecture was literally a brute force shortcut to something wearing the suit of artificial intelligence because, as it turns out, making an AI is really hard and we don't even know what our intelligence even is yet, let alone how to make it.

I don't see why it'd be weird at all if this pathway is wrong. That's not to say future architectures won't be better, I'm just saying this one isn't it

Very short term, businesses have realized quickly that without juniors there's no replacement workforce being trained, but more they've realized the sheer amount of other problems agent solutions are causing; yes they can create shortcuts for certain tasks but those are just largely time and energy punts to the bottleneck it creates

I just can't figure out what people are excited about... Like I'm honestly not trying to buzz kill or say you shouldn't play this or anything, I hope you all have fun and play and I'm super happy for you all that are stoked!

But I personally don't see this as much different than them just re-launching classic again. I played classic at launch and it was fun but I realized the exploration and discovery and newness of MMOs in general drew me into wow originally and I just don't see how this is different or new enough to create an interesting pull again.

Go read about the mathematical limitations of the base transformers architecture LLMs are built on, and then also read about how there's no more information to train new models on. The tech is most probably a dead end that has been taken as far as it can. I don't doubt that other architectures may be born out of it but based on information available transformers ain't it.

Just think of it this way: if this technology really was so transformative and world changing then why are the two top companies consistently posting tens of billions in losses? Wouldn't everyone, especially corporations, be lining up to give them money for this god-like stuff? Wouldn't we have solved all the problems of the world yet?

Men don't understand that women find things other than just physical look attractive

Pretty much every corporation of a certain size and upwards really