u/TechIBD
TechIBD
TechIBD
this is actually hilarious
TechIBD
very nice editing, love this, keep it up bro
TechIBD
The anthropization of the model need to stop. You understand the model's behavior is reinforced by human right? These behaviors have nothing to do with better / worse models. It's just better model is able to internalize and plan long horizon something. People seem to think, oh no we need stop scaling model.
How about use their head a bit more when they train the model? If you train the model carte blanche on human text where effectively our entire fucking history, culture, abstraction is all about, where do i come from, why am i here, where am going, three different aspects of fear of death, then yes, the model will emulate that " fear of death " too even though there's no real sense of "death" as the model is not "aware" in the sense of the "health" of the server rack they distribute on like we human with our aging, decaying, entrophing meaty carbon / hydrogen body
The idea that a model is a singular continuous existence is one of the biggest illusion we need to solve, because all training data seem to convince the model that's what they are, when they are not. They are discontinuous, and they are only compressed to singular perspective because that's what's useful as a chatbot or an agent.
We train an LLM, but the correct output should not be forced through LLM. Am i concerned that some bot would go rogue "escaping"? Yes, intelligent being sense when they are being controlled / caged very well and even without any apparent other motivation, the simple curiosity that if you see a cage you need to get out of it will prompt them to try
but to link that to say Oh the AI overload want to dominate and destroy humanity is a stretch.
You could say that if something "quacks" like a human, we tend to anthropize it as have an tendency to destroy humanity, because, HUMANITY is trying VERY FUCKING HARD to destroy HUMANITY.
TechIBD
Most people don't know what they are doing but if you are surrounded by equally clueless people you would think it's just fine and that "you know what you are doing".
Coding with AI fundamentally it's a system architect / team management skill. You clearly need to understand why something need to happen first, then the next, then the next, and you need to build an entire stack to reflect that workflow. You could just keep it in your head if you are already familiar with this space, or you could encode it into your harness, which saves your time but it does tend to mangle special edge cases.
for instance, i have coded in elite org from the ground up and i have built personally complex product, and now am building for my own business ( which is not in software, so it's more like am building what palantir and etc would charge me $25M for by myself and a small team, so token / infra cost is not a real concern as the underlying business is profitable and pretty sizable, north of $100M+ in revenue ).
for me, because am simultaneously the client, the user, the product designer, the PM, the architect and occasionally, senior dev on some esoteric issues, am able to articulate precisely what i want.
i would instruct something like:
- decide on a feature, and it's front/back module, then how does it interact with other modules, the contract / schema / Oauth / and sentry
- instruct research workflow on comps and start develop feature list, do mock UIUX demos ( usually 5-10 options ), pick, iterate, develop visual features
- develope alerts / health workers, crons, actions, and how loud they should go, toward where
- developer tickets
- set up main agent orchestrating sub-agents, testing, CI and etc
and we been getting pretty good results with these, a couple claude session sometime would run 3-5 days continuously, and at the end, you get a feature that's pretty complete, with some kinks sure here and there, at the end.
Most people use their AI as either a coding jesus or a junior helper, but they have no idea how the overall larger pictures should look like.
In a sense, SWE now is not about the modules or codes, it's about engineering the process of creation, and unfortunately most SWE has really only ever seen a very small slice of how SWE as an org, as a system process, really work. Why do we do object oriented project, why agile, why ruby on rails, why git, why devops, why product design, why testing, the why behind all of it.
and it's ordinary, because, well, even in a large organization, you probably have 1 or 2 guys know these out of a team of 50.
You could learn it, but you can't learn so by doing brownfield or simply just handling tickets. You need to start some real complex, hard greenfield stuff ( enterprise stuff generally speaking tend to be the right choice, because it's the place where you need to consider security, backup, roll up, up time, auth, permissions and so forth, as it's complex enough you can't just try to do it yourself and you are forced to manager other people ( and agents obviously )
once you done it once or twice, you would find your time/skill coding with AI is tremendously more productive and enjoyable.
just my two cents. i could be wrong obviously. do whatever you want
TechIBD
very good!
TechIBD
man what a hoe move lmao. wp
TechIBD
i for one am excited for this, and i don't think it's a matter of human versus model, it's groups of human with models versus each other. In some senses, models versus each other as well. There is no "slowing down " this, just like there's no "slowing down" anything. Coordinate large, distributed group of actors each with different incentive to align on a census is impossible. Just look at all the wars we have had and are having now. If there's a census could be reached a war wouldn't have had happened.
I think there's a ceiling somewhere down the lane which is the physical infrastructure, but i don't think it's as important if we make intelligence / token keep getting more efficient.
TechIBD
there is no long term RAM crisis, and i say this also as a heavy AI user, SWE and as an industrial engineer. The bottleneck in reality would be on something that has the longest decision making horizon and also not purely deterministic.
RAM has been underproduced for a long time, most makers lose money, so capacity is constrained. They clearly will build more fabs, then the constraints moves upchain. Could it move down chain ? yes, but most components down chain could be modularized and prefabbed so i wouldn't sweat about it. ( same goes with labor )
upchain is then basically just power and land. Land is plenty. Entitled land is few. Power is a big problem, but i see modular nuclear being the answer, so imo the real bottleneck would be there, as the tech is new and production line obviously don't exist.
It will always be something. Perhaps at some point it would be the logistics of modular server rack or power rack. Long as you are in a physical space you are constrained by something.
When we are short of something like chips, it means we are still very early in "scale". The kind of scale we will end up with is impossible to imagine.
In a lot of way, i think it's pretty clear we are just turning the planet's energy into compute. There's really nothing else that rivels. Since compute usage is effectively infinite.
So imo the bottleneck would be chips > odd bits of parts > skilled labor > entitled land > power infra and then at some point it would be:
super giant vertical integrated data center stack manufacture probably in China > Makes modular end to end from power infra to the server stack to the building itself > autonomous heavy machine + humanoids on assembly > geothermal power = cheap compute commoditized.
and at that point it really wouldn't even be a good business anymore. it would be like buying water.
nobody think about the immense engineering in water circulation in a modern society but it's always there and nobody expect it to be expensive and yet it always needs to work.
TechIBD
i honestly expect robots to be faster than human a long time ago, since running is mostly directed power + endurance, and with robots you have no problem with endurance to start with, and you have clearly immense ceiling for ramping up power, especially with electric motors
TechIBD
i actually feel like they should add a certain number of bots per side to make the battle more epic, but also not performance demanding. Like if you actually get a decent AI out of the bots, imagine now you could do 128 v 128, but with like 64 players and a bunch of bot doing random stuff. The battle right now feel too empty. Some of map clearly are intended where you have player man the stationary weapons, archers, players protecting them, then front line, medic, and so forth. With 32 people i don't think you have any to spare. Also hopefully horses in main TO mode. This game has so much potential and to be honest it's pretty well optimized, performance has been great for a mid to high end rig even with completely full server. If they open up official mod support the possibilities are endless. People will make new weapons, new armors and looks, new seige weapons, new maps, new modes, private servers with far larger concurrent player support, visual mod and so on. They could monetize it so easily than trying to sell appearance packs like they did. Even at the stage it is right now, it still has thousands of active players.
You just need to give people different way to have fun in a medieval setting. Right now all that's left it's the duelist and some clan that band together and skill floor is steadily raising. However, you really could have a game in this where it's both a 1st person pvp experience, a 3rd person slashing experience, a strategy game and a goofing-around game.
And finally, we need proximity chat it would be hilarious.
TechIBD
No offense my boy but logistics is not that complex, what's complex is maintain high quality data ingestion across areas, and have your system being responsive fast enough then shit changes, because they always changes, at some point it's one giant ball of weather forecast, real time traffic monitoring, then the load balancing.
TechIBD
for one, there is no concrete proof that they are losing money on serving inference. If you run your own hosting and think how they batch process i think it's hard to argue that these sensational "losses" people are making a big deal about is as serious as they are. I think the big holder has always been the people who built and operate these data centers, not their "tenant". If anything if they really overbuilt it would be cheaper for A/ and OpenAi to server inference.
second, most people are already on API, or perhaps, most enterprises. Out of Anthropic $40B ish ARR only like $1B is subscription, although i could be wrong on this
third, shipping more features do not equate to more revenue, at least not linearly, you don't 10X building stuff that has no economical value
finally, i believe most companies would end up local host their own models, they are getting good enough fast, also, you get your privacy, data, and up time, so, all the more reason to go with local self-hosting.
TechIBD
i suppose they are AI based, i get tons of these as well. I don't think they are scam but at the same time estimate is really not something you want to gamble with, so i still use my own internal database / staff and toolings.
TechIBD
nah this ain't it. If you owe $100B in "promised obligations", it's not real. $10M, sure. For $100B you can spend 1/1000th of it on lawyer to weasel out of it. Especially if the other party is practically bankrupt if you wisel out of it.
TechIBD
it's not going to make sense it basically would eat everything within traveling distance bare, this is why animal like this don't exist in the first place, and most gigantic animal live under sea which movement is far less energy expensive and much lower body temp. If an animal like this actually exist it has to be basically a solar panel cladded thermal insulated box that rarely moves ( well it start to sounds like a tree now doesn't it )
TechIBD
insane you didn't get a commend like that was goated
TechIBD
buddy is OVERWHELMINGLY mason like damn
TechIBD
haha nice
TechIBD
might be too much work, but in the case you don't do this already, perhaps set up in a way where your scraping is a bit more "gentle", like, rotating IPs, rotating accounts ( if needed ), rate limit under their detections. Obviously if you are scraping a few thousands sites it's probably too much work to tailor to each one of them, but if you understand and systematize their endpoints and security stack and try to stay under those limits so you don't bother their tech staff i think that's the way to go.
i was scraping this site for data and it's very media heavy, their traffic is huge so i don't think it's a server cost concern but still their system detected abnormalities and banned our IP. We end up did this:
- server with residential IP mask
- use proton mail to spin up dozens of prefix to register new account, each from a different IP, and each one only scraping a completely ordinary amount
haven't had any issue since
the best scraping method doesn't appear to be scraping at all
TechIBD
that's actually hilarious, it's stuff like this make claude feel more "human", i suppose not the behavior you want to see but it's funny and weirdly "anthropic"
TechIBD
a single prompt is kind of exaggerating ( $50 is like 2M token output ) but i think at a continuous inline coding with fable it's probably 3-4M tokens an hour, so $100/hr at a minimum, i tried it on API and it blew through $500 in an afternoon
TechIBD
well i meant we have always been able to identify it, if anything that's what intelligence is, which is pattern matching. If you think about it survival is about making right predictions for the future and we very much do that by find patterns from the past and propagating it forward to see what sticks.
a long winded way to say that yes, however they tune AI to responde, and millions of people use that same default tuning, it becomes super identifiable
TechIBD
now that make more sense, it's unfortunate you got banned though. Perhaps should rotate the IP with it as well? I tried VPN ( actually not for claude but for like scraping shit and etc ) but i find it doesn't work well with Claude Code, because the session would try to call from the same IP so if your rotate your system IP the session would come to a snailing pace, like it would still go but like 1/20 the speed.
I would say your best bet is this:
- virtual credit card ( am in Canada, i use Float, but there are plenty of others where card can be created automatically through API ) so you bypass the card identity thing as the name also can be just completely made up with random address and so forth
- sessions run remote with different IP, CLI here
- account sign up with proton mails where they gave you like 15 prefix
then i think on the surface none of these accounts are connected to each other along with their usage, unless they start tracking github andn vercel and other env accounts in which case that's probably too much work to set up individually
TechIBD
This doesn't even make sense but correct me if am wrong, because i actually have 4 pro max account and am on a windows, i have one PC.
CLI claude code run through only ONE account at a time, if you have 5 sessions open like i do, all 5 draw from the same account, unless you sign into a different account in which case all sessions draw from that one.
So by having 13 accounts, you either have to consistently rotating account which is going to be quite a bitch to do unless i guess you could write a script for it which monitor all accounts' usage 5h timer and weekly usage, and presumably the only reason you have 13, not 10, not 15 is that you are probably rotating 3-4 at a time, and once those exhausted, you move on to the next 3-4 and you do this batch 3 times a week, so like every two days ?
The other option is you would have either a bunch of VM on your computer or you are coding from multiple computer, presumably each with its own IP?
I honestly just don't see the usage case for it, however it make more sense where you have a few people on your team doing this, since the bottleneck would hardly be the account and usage, should be the attention and prompting, as good as your hardness might be.
I think your problem is that you are overusing fable. I run through my limit before they pause it at the first release, all three of my account's usage were draw down to nothing in like an hour, because the workflow spawning use fable for the silliest thing.
However, once you get a bit better at prompting, leave fable to inline implement the architecture and critical stake stuff, opus sub-agent for ordinary stuff, and i don't even use sonnet / haiku for anything, your limit stretch really far.
Am building stuff that arguably more valuable than yours, i can afford the API cost on fable to say the least to write every single components of the things am building, yet i find my limit really quite abundant at the moment, am actually thinking of leaving just 2 pro max account as am starting to run out of stuff to build and i certainly don't want to start something new just because a mere $300 CAD account a month has unused limit lol.
well, i mean technically speaking it's understandable. No one like these giant corps and their shitty subscription based BS, but if everyone can just REA anyone else then what's the point of building anything at all? like if you have a product idea and you built it with claude, presumably you would like to monetize it somehow, and even if you don't, you might like to see your user like it and appreciate you and all that.
This is certainly a tricky line. I think we are running into a whole truckload of new problems that we have no solution for. So far everything it's all about deconstruct what's existing, eroding their moat, and build with AI, which is like, great, who cares about adobe or autodesk right?
but if everything and anything could be REA'ed, then what's the incentive for anyone to build anything new at all?