[Pvfs2-developers] libpvfs2 usage

Scott Atchley atchley at myri.com
Thu Oct 19 13:21:23 EDT 2006


On Oct 19, 2006, at 1:12 PM, Sam Lang wrote:

> So the 256K chunks you see are from that default flow buffer size.   
> We only post bmi operations in flow buffer sized chunks, so at the  
> BMI method layer (IB in this case) on the server, you see those  
> memory registrations.  On the client the buffer passed in through  
> the system interfaces is used, so I would bet that the memory  
> registrations don't get chunked into flow buffer sized regions like  
> they do on the server.
>
> To change the flow buffer size, you can add this to your fs.conf:
>
> FlowBufferSizeBytes 1446864
>
> It needs to be added within the <Filesystem> context.
>
> -sam

This will make a difference on MX as well. If you want to get the  
most performance from a 10 Gb/s link, you want bulk transfers of 512  
KB or (preferably) more.

Scott


More information about the Pvfs2-developers mailing list