[PVFS2-users] PVFS2 gm setup help...

[Christopher K. Pinnow]

Nathan, Thomas,

I tried both of your suggestions and believe Nathan's to be correct
because of my 2.4 kernel. I have a good understanding of the quickstart
guide. Despite my best efforts, I'm still having troubles. So, right now
my fstab line is this:

pvfs2 /pvfshome pvfs2 gm://n1:6/pvfs2-fs,noauto 0 0

not this:

gm://n1:6/pfvs2-fs /pvfshome pvfs2 default,noauto 0 0


and I exec the mount command and mount complains in the usual,
uninformative manner with which it always does:

[root at n1 root]# mount -t pvfs2 pvfs2 /pvfshome -o gm://n1:6/pvfs2-fs
mount: wrong fs type, bad option, bad superblock on pvfs2,
       or too many mounted file systems
[root at n1 root]# 

I did notice something strange. If I change "n1" to "n2" (n2 is another
Myrinet node) and call mount again, mount mounts. But! Only after one
minute or so:

[root at n1 root]# mount -t pvfs2 pvfs2 /pvfshome -o gm://n2:6/pvfs2-fs
[root at n1 root]# mount
<<< *** local file systems mumbo-jumbo *** >>>
pvfs2 /pvfshome pvfs2 gm://n1:6/pvfs2-fs,noauto 0 0
[root at n1 root]# 

The deal is, with pvfs2 mounted, the VFS commands conk out and very slowly
at that:

[root at n1 root]# time ls /pvfshome
ls: /pvfshome: Operation not permitted
 
real    0m29.449s
user    0m0.000s
sys     0m0.010s
[root at n1 root]# time mkdir /pvfshome/junk
mkdir: cannot create directory `/pvfshome/junk': Operation not permitted
 
real    1m29.770s
user    0m0.000s
sys     0m0.010s
[root at n1 root]# !!!!!!!!

ls -la / output just omits the /pvfshome directory. Permissions on /pvfs
and /pvfshome are/were:

drwxrwxrwt    3 root     root         4096 Apr 20 10:40 pvfs
drwxrwxrwx    2 root     root         4096 Apr 19 12:30 pvfshome


Man, I can't wait to start exercising this thing. It seems there are not
alot of PVFS2 - Myrinet users out there. It'd be great to get some
numbers.

CP

| Christopher K. Pinnow (ckpinnow at mtu.edu)
| Computational Science and Engineering
| Research Institute - Systems Support
| Michigan Technological University

> Thus spake Christopher K. Pinnow:
> > The line in /etc/fstab is:
> > gm://n1:6/pfvs /pvfshome pvfs2 default,noauto 0 0
> > Is that the correct fstab syntax for 2.4 kernel? Research needs of my
> > colleagues will not allow me to upgrade to 2.6 kernel.
> The pvfs2 module on 2.4 kernels requires a different syntax.
> http://www.pvfs.org/pvfs2/pvfs2-quickstart.html#SECTION00064000000000000000
> Try something more like:
> pvfs2 /pvfshome pvfs2 tcp://n1:3334/pvfs2-fs,noauto 0 0