[Pvfs2-developers] Listing performance patch
Rob Ross
rross at mcs.anl.gov
Thu Sep 4 17:27:52 EDT 2008
Has the internal kernel value changed since we last looked?
Rob
On Sep 4, 2008, at 4:16 PM, Phil Carns wrote:
> Sam Lang wrote:
>> Hi Bart,
>> Thanks for the patch. For users with that many files in a
>> directory, using pvfs2-ls is probably a good alternative.
>> The kernel does readdir requests 32 entries at a time, so
>> increasing MAX_NUM_DIRENTS won't help for ls. Long listings
>> requires getting the size of files, which in PVFS is fairly
>> expensive.
>> Unfortunately, we haven't kept up with the readdirplus
>> implementation, some bugs have probably crept in since Murali added
>> that tool. If you were motivated to look at where the servers were
>> crashing, we'd certainly be interested in helping with the
>> debugging there.
>> Thanks again,
>> -sam
>
> It does look like ls improved with the patches for some reason,
> though.
>
> The 256 and 512 results are also just about close enough to be
> noise. It looks like most of the benefit came from the jump from
> 32/64 to 256.
>
> -Phil
> _______________________________________________
> Pvfs2-developers mailing list
> Pvfs2-developers at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
More information about the Pvfs2-developers
mailing list