u/klathmon

751 post karma · 169.9k comment karma · joined Mar 2012 · moderator

Klathmon

If my options are charging while waiting for the bathroom, or waiting to charge, I'll take the charging option any day...

Klathmon

Man all you fuckers must be so miserable and sad never doing anything for the bit

Klathmon

Good memory systems don't exist that I've seen.

Even vector dbs can only get you semantic similarity, that doesn't change how the LLM interprets the data, they don't weigh information based on importance, it's not memory it's barely a search engine.

What we need is a transformer moment for memories where we can build an efficient way to make continuously learning systems, and it might even unlock the next level of capabilities that current LLMs lack

Klathmon

Take a look at the paper, the results aren't great by any means but it points to this idea that we are able to capture something intrinsic about many ideas that it can cross the boundary like that

https://arxiv.org/abs/2209.15162

Klathmon

I do think memory is the one area that we haven't cracked yet, that process of continual learning and how reinforcement improves those memories.

The way we currently encode "memories" as massive docs that it searches through is such a kludge that I can't believe anyone is claiming it's AGI with a straight face

Klathmon

As someone who has built non-frontier models, there is something here but I don't think anyone knows if it can or will lead to AGI.

What convinced me is experiments which showed you can take a model trained only on text, haphazardly bolt it to a vision encoder, and it can tell the difference between cats and dogs despite never being trained on vision.

I really think we have found a fundamental thing here, some idea of what makes a distinct "concept". They've also shown that at specific sizes, emergent capabilities appear in completely separate models.

I don't know if it's turtles all the way down and that's all it takes for AGI, but it's definitely a good approximation for part of it. But the days of scaling by size kind of ended with the lackluster gpt-4.5

Klathmon

You can though!

You could go turn yourself into police and they'll let you get your GED while locked up!

They'll even cover your healthcare too!

You should sign up it seems like you need the education!

Klathmon

You seem kind of unamerican to me, why don't you turn yourself in to a detention center until we figure this whole thing out.

The backlog isn't super long right now, you should be able to be in and out in a few months, and you might get sent somewhere fun like el Salvador!

You wouldn't have a problem with law and order would you?

Klathmon

It's just another conservative smoothbrain, you aren't going to get through to them with reason, they know they're being a fucking idiot and are intentionally misinterpreting the point.

Klathmon

They're being disingenuous, just call them fucking idiots and move on

Klathmon

Not disagreeing just adding to your point, but hardwired smoke detectors still run primarily on the battery, the hardwire is actually a backup!

They do this so you can tell the battery is low and can replace it before it's needed

Klathmon

Lol really missing that harms way part, but hey pop off queen

Klathmon

Michael vick is that you?

Klathmon

If you're sending your pet to run after people trying to kill it then yes you're an animal abuser.

But I guess you are cool with dogfighting?

Klathmon

Supply chain attacks are a thing, they get firmware updates with proprietary software, it's a hackers wet dream.

Hell you don't even need to be a hacker, this is the US government, they can just walk into an office and grab a random dev and threaten to send them and their entire family to Guantanamo unless they plug in this USB drive and don't ask any questions.

Klathmon

There are so many ways to hack even a system that's just plugged in to a wall outlet.

Look at things like TEMPEST where extremely minor power usage fluctuations can be monitored to crack encryption. It's also been shown that you can manipulate computers by introducing power spikes at perfect times.

There's EMI interference that can flip bits and make them record the wrong data, or even really mundane stuff like "break into the high school storage closet where they're kept for 350 days of the year and install a "virus" on them that makes it miscount 6% of the votes"

You can also walk up the supply chain, maybe have one of the 3 letter agencies hack into the manufacturer and infect a firmware update and then let the manufacturer install it on all the machines on their own time. Maybe you hack the manufacturer of the CPU that the voting machine company uses and tweak it to bias results if it looks like it's running in a voting machine.

None of that is hypothetical, they are all real incidents that have already happened with computers.

You're naive if you think that just not connecting them to the Internet is full proof.

Klathmon

Even having police dogs is animal abuse IMO.

They act like it's some noble thing, but the dog can't consent to be put in harms way like that, and they often use them to manufacture suspicion and will send them after people knowing that most people won't want to hurt the dog.

Plus the fact that over 1/4 of them die from heat stroke from being left in the fucking patrol cars.

Funny how if you try to push a dog ripping you to pieces away you'll be charged with assault of a police officer, but some cop locks them in a car and lets them bake until they die and they just get another dog.

Klathmon

But also I suffered for years with a medication that was destroying my sleep but I didn't connect the dots and my autistic ass would just answering their questions directly and nothing else.

I offhand mentioned how I can't sleep any more to a nurse friend who told me it's probably the medication and I sent a message to my doctor she was floored that I "didn't tell her"

So now every doctor visit gets the life story, I don't care if you're running late, it's my fucking life and I deserve healthcare.

Klathmon

I did the same thing, mine was a lease so I was stuck with it for a little while longer, but I instantly canceled FSD and I sent the car back as soon as I could.

I was one of the first people to get a model 3 when it came out and I've owned Tesla's ever since then.

The Nazi salute was my line in the sand, and I will never give another penny to that company as long as that man is still benefiting from it in any way.

Klathmon

Yeah I love the car, but it's fugly IMO

Klathmon

Paradoxically you have to.

If you debate them you give their clearly disingenuous arguments legitimacy.

Those reading see 2 people on opposite sides debating a point, and suddenly there's a point worth arguing.

No sane person thinks the comment above was saying to deplatform people. If you just ignore them (not even downvote!) then people just see another crazy person shouting into the void.

But when you argue with them, suddenly there is a point worth arguing over, suddenly there are "sides" to an issue that you both just conjured out of nothing.

Just refuse to engage, just like you would do if someone started shouting that the moon isn't real and 5G ate their cat or something.

Klathmon

Ow my position hurts so badly!

Klathmon

It's a term of endearment for conservatives

Klathmon

That's the machine you're talking to.

They know they're being disingenuous, hell it's probably not even a person.

They just bring up some tangential bullshit and intentionally misunderstand the point to keep everyone angry and confused.

The only winning move I've found is to point and laugh at how utterly idiotic they're being until they crawl back to the cesspit they came from and spew their shit at other bots

Klathmon

See I just don't think they exist.

who out there is thinking "I see that he's a Nazi, a pedophile, a grifter, a rapist, and a racist, but I really like how he offered that woman a horse so she would sleep with him, so I'm just not sure how I feel about him"?