[Pvfs2-users] strange performance: IPoIB outperforms native IB

[Pete Wyckoff]

On Wed Aug 15 16:39:06 EDT 2007, xiangyong ouyang <ouyang.17 at osu.edu> said:
> I setup pvfs-2.6.3 in a cluster with IB support(ofed-1.2) and linux kernel 2.6.20.5. I compiled pvfs2 using the following flags:
> 
> ./configure --prefix=/tmp --with-db=/tmp/BerkeleyDB --with-openib=/usr/local/ofed --with-openib-li
> bs=/usr/local/ofed/lib64 --with-openib-includes=/usr/local/ofed/include --with-mpi=/home/ouyangx/m
> pich2-install --with-kernel=/usr/src/linux-2.6.20.5
[..]
> After that, I tested pvfs2 performance with "pvfs2-cp -t" to copy a local file to pvfs2 file system. At all different file size, pvfs2/IPoIB yields a better performance than pvfs2/IB. Here are the numbers (MB/sec).
[..]

Switch to CVS head and add a configure option: "--without-bmi-tcp".

Also, I think you only need --with-openib= as you have it, not the -libs and
-includes too.  But no problem there.

		-- Pete