[Pvfs2-users] pvfs2 performance tuning

Rob Ross rross at mcs.anl.gov
Wed Dec 1 08:07:53 EST 2010


See this. You can set the number of datafiles (i.e., the number of  
servers across which things are striped) via attributes.

http://www.mail-archive.com/pvfs2-users@beowulf-underground.org/msg01478.html

Rob

On Dec 1, 2010, at 2:30 AM, Zhou Jiang wrote:

> HI, all
> Now I have 32 nodes, both are used as IO servers and clients, one as  
> metadata server. When I write a different
> file in each client(e.g. client1 write /mnt/pvfs2/file1, client2  
> write /mnt/pvfs2/files), the aggregate io throughout tested by  
> iozone(read/write) is only half of performance of 4 nodes(both as IO  
> servers and clients).
> I think each file are striped to 32 nodes will cause the additional  
> network and data transaction overhead.
> If each file are only striped to small scale nodes(such as only 4  
> nodes among 32), the performance will be improved ?
> But when I use twod_stripe mode, which divides the 32 IO servers  
> into 7 groups, each group strip factor is 256 and  stripe size is  
> 32M, the performance is not improved as expected.
> Would you please tell me how to control each file to be stored into  
> different IO servers or improve the pvfs2 performance in 32 nodes by  
> tuning parameters or others?
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users



More information about the Pvfs2-users mailing list