Gfs2 vs xfs vs ext4 – Page 2 – The UNIX and Linux Forums

1. What type of storage are you using.
Penguin x8dtn, 24 1tb disks

Can find anything about this setup. Do you have specs/a link ?

Quote:
2. What type of disks
sata

Definitely not optimal for the amount of files or the access patterns you describe.

Quote:
3. If using a controller based array, what you optimized for sequential or random operation.

Sounds like it should be random optimized, but depends on the array or RAID controller and its capabilities whether or not this a selectable.

Quote:
4. Will you mirror on-host or using hardware RAID
controller based raid 10. six disks per raid set


Seems like a reasonable choice.

Quote:

4. What is your storage block size.
Quote:
64k

Quote:

5. What is the average size of your writes
Quote:
dunno, guess is a few meg. No more than 16m. These are email attachments

That is the size of the objects not the size of the writes. iostats for the file systems would be good here.

Quote:
6. What is the breakdown of reads/writes
not sure

This might be essential information, depends on the pattern, but caching correctly might improve performance drastically.

Quote:

9. How many files per directory do you have ( files includes sub-directories) in the largest directory.
Quote:
millions

This is in all probability your main bottleneck, more file systems or directories with fewer files could improve this.