u/RecursionIsRecursion

What’s also odd is that AI can easily write a “scan my filesystem for duplicates” script, or you could look one up like the olden days, or like you mentioned there are tools that can do it already written that AI could suggest. I wonder what effort level OP had on at the time?

But critiquing the method itself, OP didn’t mention the shape of the data like [u/The_Gnar_Car](u/The_Gnar_Car) said. OP’s method appears to be to compute a hash of every single file, which can be super wasteful. If you have one 103GB file, and only one, no need to compute hash for it - it can’t match any other file because there’s nothing else that size! With a million files, I imagine they’re small, so it’s more likely to find size-based matches. But still, making that list of file and their respective sizes, sorting it, and only producing hashes of files that have the same size as others would DRASTICALLY reduce compute time and disk thrash.

Maybe not what you’re expecting with regard to “IT Tasks”, but documentation, diagram creation, document writing, and PowerPoint creation.

I keep notes about which systems connect to which and how. Those are for my own use and are written in my own shorthand that’s easy enough to understand I guess. But I pass that through Claude to make a full Markdown site that links to itself Wikipedia-style, so if I use a specific term or acronym for a server, you can click on it to find out what it does. I also have it take the whole plan and create SVG diagrams that embed back into those documents. Everything is in git.

Finally, when it comes time to do any presentations, I use some variation of the prompt “read my last 5 months of git commits and make a professional PowerPoint with the company logo throughout that talks about what has been changed and why”.

Everything needs thorough review but I no longer spend time fighting with PPT animations, I just use existing info and a prompt.

🫡 Thank you for your service

Ooooh yes. Bandwidth from outside wasn’t great but once it was in the RU network, you got fantastic peer-to-peer speeds. Everyone just shared their movie or TV (or exams…) folders.

The networking people knew about it and turned a blind eye to it because you were less likely to get the university sued by everyone downloading from each other rather than everyone downloading externally

I’m torn between being incredibly jealous of the amenities and being comfortable knowing that the grunginess of the campus was a major thing that brought my friends and I together, a real bonding experience. For example, we didn’t have a movie theater, we had twenty people packed in a tiny dorm room watching a movie pirated via DC++.

Did you know that Tillet used to have a dining hall? We’d call it Toillet, or Kill It and Fill It Tillet.

Clark street in Keyport!

I thought that might be the case given the lack of info online, but I thought maybe someone here would know that back story. If I saw this with my face and name, I’d find it hilarious

100% on the money. In fact, if they really wanted to cheap out, they could even solve things via splitting up the student body further via lottery so that fewer people sign up for things at the same time. It would still require a random number generator to mass-send emails to enrolled students…which is an intern project.

It’s not like the current system if “try real hard to sign in at the very first moment, maybe you’ll get in, maybe you’ll register, but hey, maybe not” is anything more than a lottery to begin with.

“I’ve been hoist by my own petard”

“I know people are saying that word again, but I’m still uncomfortable hearing it in my own house!”

I graduated RU in 2014. It’s amazing to me that over a decade later they haven’t put enough research into “when we make this live, a lot of people will visit all at once” infrastructure. I’m not saying it’s an easy problem to solve, but we do have big CS, CE, and ITI departments…

Does WebReg still crash (web)regularly?

Literally “cream within”

This is true, but for creative agencies, if a new hire joins in 3 months, you can’t buy them a license for the software that everyone else is using

Oh boy, this is bringing back memories. I worked for a company that had this as a feature. I noted how bad it was, and was told that “a better parser will not increase our sales at all”, so no one invested in it.

Applicants upload their resume and then need to fix everything it gets wrong in their profile, but those applicants don’t pay for the software, HR/IT does…so there’s no movement there.

Back before this LLM AI boom, they had an AI (just machine learning model) that would pick the “best” applicant for the job. The thing is, they based the training data on previous hires. That means a few important things: they had no information on whether anyone in the training data was any good at their job, just that they got hired. Also, if the people doing the hiring were racist/sexist, the model would also be racist/sexist. Finally, unless the system did something off the rails like saying you should hire a plumber for a sysadmin job, there’s no way to know if the person it chooses from the applicants is actually the best candidate. It’s effectively non-falsifiable.

TLDR job AI = dumb

This is true for a dedicated render machine, but a VM cluster won’t inherently help, except for possibly uptime during updates or hardware maintenance. If anything, I’d just set up a bare metal render server.

Yes, for that purpose clustering won’t get you any benefits but would get you more complication!

You can, but it’s not clear to me what your goal is.

Can you set up a Proxmox cluster on multiple machines? Yes.

Can you make a Windows VM that runs on one of the physical machines on that cluster? Yes.

Can you install Resolve or Lightroom on that VM, then remote into it? Yes.

What does the fact that it’s clustered get you? Nothing directly. You can’t reasonably combine the CPU, GPU, or RAM for the machines in the cluster to build one “super machine”. You’d be better off getting one powerful machine than three machines of 1/3 power each and clustering them. There ARE benefits to a cluster (upgrading means no downtime because you move VMs off a machine, update it, then bring it back into the cluster), hardware issues are more easily dealt with for the same reasons, etc. But those reasons are very unlikely to make video or photo editing any better.

Finally, remoting into a VM will feel slower than using the machine directly due to latency, there’s just another hop there between your mouse/keyboard and the program. This may make realtime editing unbearable.

I use the iMazing app - it can back up Notes as well (https://imazing.com/transfer-iphone-notes-voice-memos). I back up my iPhone using iTunes, but I also use iMazing to make a copy of my texts and notes on my computer where I archive them as files outside of the Apple ecosystem.

I thought maybe it could be the form of the word - maybe medical literature mentioned someone “being epileptic” and not “having epilepsy” specifically…but etymonline says French had “epilepsie” in the 1570’s. Really pretty baffling honestly.

This has nothing to do with etymology. It's possible that the answer to OP's question could relate to etymology, but it doesn't look like it does.

At nearly 100 comments, I'm leaving it up due to community interactions

This is for my backup NAS. The backup to my backup is in the cloud. It can be the backup to my backup to my backup…

“I just really need some space right now” - me, but also her

Mod note: this has nothing to do with etymology, but at 70 comments, the community clearly is engaged with it, so I’m leaving it up!

But it’s not everything you can, anything more than 8 does nothing. Depending on the RAM and CPU of your system, you may be causing the threads to fight against each other for resources and actively slow down your system. Try the steps I mentioned above.

100 threads?!

https://www.backblaze.com/computer-backup/docs/configure-performance-settings-windows

Most connections will see little to no performance gains with more than eight threads.

Reset to 4 threads for a bit and check your transfer rate. Then increase to 5 and see if it’s any faster. You won’t get to 100.

This was mentioned in https://www.youtube.com/watch?v=gg7a4pjdOY4 which is from 2018 but got reposted earlier today...