[Web4lib] Web site performance affected by large number of files in a directory?

Francis Kayiwa kayiwa at uic.edu
Fri Nov 6 19:42:38 EST 2009


On Nov 6, 2009, at 12:45 PM, Robert Sullivan wrote:

> I'm doing some testing for another historical records project (Civil
> War muster rolls).  It's working well so far, but my current structure
> for it has one file per company in a single directory.  This would
> eventually result in about 3000 pages (around 28K each).
>
> Is this likely to cause any performance issues?  The site is hosted on
> a Linux/Apache system.  I could rewrite my database programs to break
> up the files into folders by regiment if that would speed things up.

Not enough information to say definitively  but a well configured  
Linux/Apache (even) on Pentium III should not break a sweat with your  
specifications above. If you need to refactor you should but not  
because of the aforementioned Kernel (Operating System) or WebServer.

cheers,
./fxk






More information about the Web4lib mailing list