Follow

Ok hivemind, I have to check about 9 TB of files for duplicates. I SSH into the server (so CLI only), running Debian. I've tried fdupes, but it takes absolutely forever, sometimes timing out late in the process. What other options are there? I don't necessarily need to check on SHA256 checksum level, file size is fine.

· · Web · 2 · 0 · 0

@chmoensted Jeg har kigget lidt, det var mere hvis der var nogen, der lige bum vidste hvad jeg skulle gøre.

@infonauten jeg plejer at bruge dupeGuru, men det er desværre er gui program...

@infonauten If file size is really enough:

find /foo/bar -exec stat -f "%z %N" {} \;

and run sort(1) on the output?

Sign in to participate in the conversation
Helvede

Velkommen til Helvede, fediversets hotteste instance! Vi praktiserer mørk meme-magi og shitposter langt ind i de dybeste afgrunde. Hatespeech tolereres ikke. #helliswholesome Welcome to Hell, the hottest instance in the fediverse! We practice dark meme-magic and shitpost far into the abyss. Hate speech will not be tolerated. #helliswholesome