[Pvfs2-users] Growing storage

[Dean Hildebrand]

We are using Cisco and Force10 10Gb switches here at Michigan to do the 
opposite, 10Gb clients accessing many  1Gb storage nodes.  One thing 
we've found (and it is worse with our Cisco switch) is that the switch 
can run out of buffer space when packets switch from the 1Gb ports to 
the 10Gb port, and packets are dropped.  1Gb to 1Gb is good, 10Gb to 
10Gb is good, but 1Gb to 10Gb doesn't work so well (this is our read 
throughput benchmark).  The best throughput we've been able to get is 
around 4Gb/s in this scenario.  We are currently working with Force10 to 
try and resolve this issue, but no progress yet.

Hope this helps,

-- 
Dean Hildebrand
Ph.D. Candidate
University of Michigan


Andrew Pochinsky wrote:
> Hi,
>     I'm looking to build a new PVFS2 storage and it seems that the 
> price sweet spot these days is on boxes with a lot of local disks (my 
> estimates are 5 to 10 TB per chassis). To provide enough bandwidth to 
> clients, I'm thinking about connecting PVFS2 servers to the switch via 
> 10Ge. (We already have a Cisco switch and can not go IB. GigE and 10G 
> are the only choices, as far as I know.) Did anybody have any 
> experience with such a setup? What pitfalls are there?
> Thanks,
> --andrew
>
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users