[Pvfs2-developers] PVFS2 tuning?

[Scott Atchley]

On Jun 11, 2009, at 11:22 AM, David Bonnie wrote:

> Hey everyone -
>
> Nick and I have completed our modifications to store metadata and  
> data separately and are in the process of testing/benchmarking.  Our  
> initial results are incredibly good (on the order of nearly twice as  
> fast as 2.8.1) but we're wondering if maybe we should tune the  
> standard release a bit to make it a more fair comparison.

What is twice as fast? Metadata ops? Bulk I/O? Everything?

> Our setup is as follows:
>
> 3 I/O nodes, each serving metadata and data
> Dual core Opterons in each node
> 10 Gbit Myrinet interconnects (PVFS2 runs on this)

Cool. :-)

Are you setting FlowBufferSizeBytes in your config file? If so, what  
value are you using?

Scott

>
> 1 Gbit management network
> Infiniband is in the works, we'll test on this as well
> Data is on a 1 TB Seagate 7200.11 (metadata as well for the 2.8.1  
> release)
> Metadata is stored on an Intel X-25E for our new code
>
>
> We haven't tuned anything in particular on either version of PVFS2.   
> It has been suggested we increase the amount of data written before  
> syncing metadata to about 4 MB to decrease the load on the metadata  
> server.  Is this a good idea and does anyone have any tips or links  
> to point me toward to make this a better comparison?
>
> Thanks!
>
> - Dave
> _______________________________________________
> Pvfs2-developers mailing list
> Pvfs2-developers at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers