• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

Duplicate file finding applications?

blankoboy

n00b
Joined
Jul 13, 2004
Messages
21
Hi all,

I'm looking for the most recommended software for identifying duplicate files on servers. We have a storage server (PowerVault 770N NAS running Server 2003 SP1 appliance edition) with ~600GB of space. Currently about 400GB is being used but I would like to cut this down by identifying the number of duplicate files as I am sure there are many.

ie:
xls = 50GB
exe = 30GB
pst = 25GB
doc = 21GB
tgz = 20GB
mdb = 17GB
zip = 13GB
pdf = 12.5GB.


I have tried using Treesize Pro from a remote server via a mapped drive. While it does a great job of showing the breakdown of your data it sadly cannot identify duplicate files.

Having looked around I can see a plethora of applications that perform this function but of course I would like to find the most recommended for use on servers (preferably not a homebrew app). Thanks all.
 
A few lines of perl should be able to do it fairly quickly. As well as save you cost as perl is free.
 
Back
Top