[Pvfs2-users] strange performance: IPoIB outperforms native IB
pw at osc.edu
Wed Aug 29 13:18:40 EDT 2007
On Wed Aug 15 16:39:06 EDT 2007, xiangyong ouyang <ouyang.17 at osu.edu> said:
> I setup pvfs-2.6.3 in a cluster with IB support(ofed-1.2) and linux kernel 126.96.36.199. I compiled pvfs2 using the following flags:
> ./configure --prefix=/tmp --with-db=/tmp/BerkeleyDB --with-openib=/usr/local/ofed --with-openib-li
> bs=/usr/local/ofed/lib64 --with-openib-includes=/usr/local/ofed/include --with-mpi=/home/ouyangx/m
> pich2-install --with-kernel=/usr/src/linux-188.8.131.52
> After that, I tested pvfs2 performance with "pvfs2-cp -t" to copy a local file to pvfs2 file system. At all different file size, pvfs2/IPoIB yields a better performance than pvfs2/IB. Here are the numbers (MB/sec).
Switch to CVS head and add a configure option: "--without-bmi-tcp".
Also, I think you only need --with-openib= as you have it, not the -libs and
-includes too. But no problem there.
More information about the Pvfs2-users