The following will move a series of files into subfolders. It hashes the file names, building a two character, two folder deep hierarchy to split the files, e.g. a1\/b2. The motivation for this is to split 500,000 folders into a manageable hierarchy, to avoid file system limits – in NTFS this is quite slow, and well over the 64,000 limit in ext4.<\/p>\n
\nvi f\nfor f in `ls pacer\/`; do echo -n $f | md5sum | sed 's`\\(..\\)\\(..\\).*`\\1\/\\2\/`' | tr -d '\\n'; echo $f; done;\n.\/f > t\nmkdir ..\/pacer2\ncat .\/t | sed 's`\\(..\\)\/\\(..\\)\/\\(.*\\)`mkdir pacer2\/\\1\\nmkdir pacer2\/\\1\/\\2\\nmv pacer\/\\3 pacer2\/\\1\/\\2\/\\3`' > dirs\n.\/dirs\n<\/pre>\n","protected":false},"excerpt":{"rendered":"The following will move a series of files into subfolders. It hashes the file names, building a two character, two folder deep hierarchy to split the files, e.g. a1\/b2. The motivation for this is to split 500,000 folders into a manageable hierarchy, to avoid file system limits – in NTFS this is quite slow, and … <\/p>\n