[Pvfs2-users] Testing pvfs 2.7.1

Emmanuel Florac eflorac at intellique.com
Mon Apr 21 07:04:14 EDT 2008


First, thanks for all the tremendous work :)

But I'm back with my NFS troubles...

I've set up a quick cluster ( 3 nodes, from which 2 IO servers and 2
clients). Well, the annoying readdir() bug from 2.6.3/2.7.0 is gone,
and it all worked very well. 
However sharing a PVFS volume thru NFS failed badly (though in a
different way than what it used to).
Basically the nfs mount works, listing the root works but send errors,
any any subdir listing, write or read fails :

storiq at 1[storiq]$ sudo mount -t nfs melodica:/mnt/pvfs2/ /mnt/temp
storiq at 1[storiq]$ df -h /mnt/temp
Sys. de fich.         Tail. Occ. Disp. %Occ. Monté sur
melodica:/mnt/pvfs2/  221G  2,3G  218G   2% /mnt/temp
storiq at 1[storiq]$ ls /mnt/temp
dir1  dir2  dir3  lost+found  popo  pvfs-2.7.1.tar.gz  vcop
zaemglkjzeg  zdgmlkjzd
storiq at 1[storiq]$ ll /mnt/temp
ls: /mnt/temp/dir1: Panne d'accès au fichier NFS
ls: /mnt/temp/dir2: Panne d'accès au fichier NFS
ls: /mnt/temp/dir3: Panne d'accès au fichier NFS
ls: /mnt/temp/popo: Panne d'accès au fichier NFS
ls: /mnt/temp/vcop: Panne d'accès au fichier NFS
ls: /mnt/temp/zdgmlkjzd: Panne d'accès au fichier NFS
ls: /mnt/temp/lost+found: Panne d'accès au fichier NFS
ls: /mnt/temp/zaemglkjzeg: Panne d'accès au fichier NFS
ls: /mnt/temp/pvfs-2.7.1.tar.gz: Panne d'accès au fichier NFS
total 6940
drwxr-xr-x 1 root   root     4096 2008-04-18 16:26 dir1
drwxr-xr-x 1 root   root     4096 2008-04-18 17:14 dir2
drwxr-xr-x 1 storiq users    4096 2008-04-18 18:56 dir3
drwxrwxrwx 1 root   root     4096 2008-04-18 12:10 lost+found
-rw-r--r-- 1 root   root        0 2008-04-18 16:08 popo
-rw-r--r-- 1 storiq users 4466847 2008-04-18 13:50 pvfs-2.7.1.tar.gz
-rw-r--r-- 1 root   root        5 2008-04-18 16:55 vcop
-rw-r--r-- 1 root   root  2607616 2008-04-18 16:09 zaemglkjzeg
-rw-r--r-- 1 root   root        8 2008-04-18 16:08 zdgmlkjzd
storiq at 1[storiq]$ ll /mnt/temp/dir1
ls: /mnt/temp/dir1: Panne d'accès au fichier NFS
ls: /mnt/temp/dir1: Panne d'accès au fichier NFS
storiq at 1[storiq]$ echo $?
2

Let's have a look to the pvfs2 client ( nfs server) machine : nothing
in the pvfs2 logs, but in klogd.log :

<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5
<4>/usr/src/pvfs-2.7.1/src/kernel/linux-2.6/pvfs2-utils.c line 464:
Critical error: Invalid handle despite using iget4/iget5

By the way I tried accessing the pvfs2 volume through Samba, FTP, SFTP,
scp and it works just fine. Only NFS looks tricky.

All 3 systems are running vanilla 2.6.22.19 amd64 smp kernels. The
pvfs2 FS resides on an XFS filesystem.

-- 
--------------------------------------------------
Emmanuel Florac               www.intellique.com   
--------------------------------------------------



More information about the Pvfs2-users mailing list