[Pvfs2-users] performance problem

[Sam Lang]

On May 13, 2008, at 12:37 PM, Emmanuel Florac wrote:

>
> Hi, I've made a pvfs2 cluster to agregate storage from 2 machines. The
> machines run Linux Debian etch with 2.6.22.19 linux. All is well, both
> machines are identical with 3Ware raid controllers, and write disk
> thruput is about 550MB/s.
> Each machine has 4 GigEth ports. I've dedicated 2 of them to link the
> machines together (bonding, 802.3ad) for the pvfs traffic, the 2  
> others
> are connected to the outside world. The purpose is to provide a rough
> ftp/samba storage thru the VFS layer, and it works fine.
>
> However the performance is abysmal : the network thruput between the
> nodes is 8MB/s while copying! the total cluster write performance
> (cp from local disk to pvfs storage) is 17 MB/s.... What can be  
> going so
> wrong? Any hint would be appreciated.

Hi Emmanuel,

I would first make sure that you don't have some network bottleneck  
unrelated to PVFS.  What does netperf between the two nodes give you?   
If that's not the issue, you might try setting up a single server on a  
single node (just with a separate config file), and mount that pvfs  
volume on the same node.  That will allow you to see the performance  
of PVFS straight to disk without the network involved.

-sam


>
>
> -- 
> --------------------------------------------------
> Emmanuel Florac               www.intellique.com
> --------------------------------------------------
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2417 bytes
Desc: not available
Url : http://www.beowulf-underground.org/pipermail/pvfs2-users/attachments/20080513/36a04aee/smime.bin