[LUNI] variation on a theme suggested by SyL

John Mason jlm at uic.edu
Thu Dec 14 16:02:17 CST 2006


On Thu, Dec 14, 2006 at 01:32:47PM -0600, Williamson, Brad wrote:
> I pulled this out of a "SpaceHog" script that I had lying around:
> 
> find /home -type f -print0 | xargs -0 md5sum |tee /root/checksums.txt
> cat /root/checksums.txt |sort|uniq -w 32 -D |tee /root/duplicates.txt
> 

I wrote a nasty hack several years ago that used "filesystem as database"

The media file was md5sum'd and the moved into a datastore with the
md5sum as path/filename, and a symlink was created to replace the original
file.

Ugly as sin, and slow as mud, but it was good at nailing dups.

-- 
%40 <- Ceci n'est pas une @.                           John Mason - jlm at uic.edu
University of Illinois at Chicago - Academic Computing and Communcations Center
   Usenet Administrator, Listserv Administrator, Sun Software Contact et al.


More information about the luni mailing list