#Find largest directories by file count

1 messages · Page 1 of 1 (latest)

toxic bridge
#

I have users who have millions of files and am trying to determine which directories have the most files. Is there a way to get a report of which directories have the greatest file counts? Simply performing an ls has almost crashed the server I was working on in a single directory I identified as problematic. My instinct is either XCP or Quotas but I have not yet been able to figure out how to get the information I am looking for with either of these.

austere ravine
#

you can it with XCP using the scan option
it's what I use for the exact same purpose

xcp scan -stats -html -preserve-atime \NETAPP\SHARE

#

you can also use the systems built in file analytics tool for the same thing

#

storage, volume, file system, explorer, enable analytics, wait for it to finish and then the usage tab

toxic bridge
austere ravine
toxic bridge
toxic bridge
toxic bridge
#

I was hoping xcp would work as the source is on an isilon. I am trying to migrate it to Netapp but a directory is too large to transfer and I am helping him identify which directories to clean up

austere ravine
#

that is strange, we migrated a set of shares with over 120mil files. many folders had over 1mil files each

toxic bridge
#

The reason its failing is due to an individual directory size being greater than the -maxdirsize setting which allows for a directory to be up to 320mb. The directory size is based on the number of files in the directory. This setting can be increased but has a performance impact. I have identified the directory that is preventing the migration but would like to be able to scan for other directories that may become problematic in the future. A fast way to list the largest directories by file count is what I need for this, preferably regardless of the type of host it is on hence why I wanted to find a way to use XCP to list top directories by total files.