[Pvfs2-users] Interesting: Mounts with both tcp and IB BMI;

[Kumar, Amit H.]

Hello Everyone,

I have configured PVFS2 with following options, hence not disabling bmi-tcp method as suggested by the configure script for better response time.

./configure --prefix=/opt/pvfs2 --enable-karma --with-kernel=/usr/src/linux-2.6 --with-openib=/usr --with-openib-includes=/usr/include --with-openib-libs=/usr/lib64 CFLAGS=-g --enable-nptl-workaround=yes


I generated a pvfs2-fs.conf file with 4 I/O server with one of them being a metadata server:
Part of the config file looks like:
<Aliases>
        Alias pvfs2-io-0-0 ib://pvfs2-io-0-0:3335,tcp://pvfs2-io-0-0:3334
        Alias pvfs2-io-0-1 ib://pvfs2-io-0-1:3335,tcp://pvfs2-io-0-1:3334
        Alias pvfs2-io-0-2 ib://pvfs2-io-0-2:3335,tcp://pvfs2-io-0-2:3334
        Alias pvfs2-io-0-3 ib://pvfs2-io-0-3:3335,tcp://pvfs2-io-0-3:3334
</Aliases>

As per my understanding I mount the pvfs2-clients through IB with the following command
mount -t pvfs2 ib://pvfs2-io-0-0:3335/pvfs-fs  /scratch/pvfs2

Though I do the above, I can still access the Pvfs2 File System when I bring down the IB interface. This means that Pvfs2 is not running through the IB interface. This is strange!

1)      Does this mean that I need to use the IB interface hostnames, for e.g. pvfs2-io-0-0.local-ib so that I can make use of IB?
2)      If I do use the IB hostnames, then how do I mount the Pvfs2 File System on the some of the compute nodes that do not have IB interface and would like to access it via Ethernet?

Please enlighten me!!!

Thank you,
Amit


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.beowulf-underground.org/pipermail/pvfs2-users/attachments/20080815/d096b834/attachment.htm