[PVFS-users] PVFS error at client side

Rob Ross rross at mcs.anl.gov
Wed Feb 4 14:43:20 EST 2004


Hi,

Have you tried applying the patch that I posted to the mailing list a few 
days back?

Also, can you try appending a pvfs: to your filename to perf and see if 
that makes a difference?

Thanks,

Rob

On Wed, 4 Feb 2004, Tajendra Vir Singh wrote:

> Thanks Rob,
> 
> Hello Rob,
> 
> Thanks for your attention.
> 
> Here is the information about the system:
> 
> Linux Kernel version: 2.4.20-28.8SMP
> CPU type: Intel Xeon 2.4 GHz (dual cpu system)
> PVFS version 1.6.2
>  
> 
> Build script for building pvfs:
> ================================
> #!/bin/bash
> 
> # build pvfs (non-kernel stuff)
> 
> here=`pwd`
> 
> tgt=/u/systems/pvfs
> 
> pkg=pvfs-1.6.2
> 
> rm -rf $pkg
> tar -xvzf $pkg.tgz
> 
> cd $pkg
> 
> ./configure --prefix=/u/systems/pvfs
> make
> make install
> ==========================================
> 
> Build script for kernel module:
> ===========================================
> #!/bin/bash
> 
> # build pvfs kernel module (after non-kernel stuff)
> 
> here=`pwd`
> 
> tgt=/u/systems/pvfs
> 
> pkg=pvfs-kernel-1.6.2-linux-2.4
> 
> rm -rf $pkg
> tar -xvzf $pkg.tgz
> 
> mkdir -p $tgt/kernel
> 
> cd $pkg
> 
> ./configure --prefix=/u/systems/pvfs --with-pvfs=/u/systems/pvfs
> --with-moddir=/u/systems/pvfs/kernel
> --with-kernel-headers=/usr/src/linux-2.4/include
> make
> make install
> =======================
> 
> It used gcc compiler for building the kernel module and pvfs binaries.
> 
> Thanks again,
> 
> TV Singh
> 5919A Math Sciences bldg,
> ATS, UCLA, Los Angeles, CA 90095-1557
> Ph: (310)825-5698  
> 
> -----Original Message-----
> From: pvfs-users-bounces at beowulf-underground.org
> [mailto:pvfs-users-bounces at beowulf-underground.org] On Behalf Of Rob Ross
> Sent: Wednesday, February 04, 2004 12:00 PM
> To: Tajendra Vir Singh
> Cc: pvfs-users at beowulf-underground.org
> Subject: Re: [PVFS-users] PVFS error at client side
> 
> Hi,
> 
> What can you tell me about the machine:
> - kernel version
> - CPU type
> - PVFS version
> - options?
> 
> Thanks,
> 
> Rob
> 
> On Tue, 3 Feb 2004, Tajendra Vir Singh wrote:
> 
> > Hello,
> > 
> > We are in testing mode for a pvfs system on our beowulf cluster. 
> > Yesterday I was trying to run the perf.c code using 2 nodes (dual cpu 
> > each) with SIZE parameter 1048576*640. That means from four cpus the 
> > total file size would have been 2684354560.
> > 
> > When I started running the code, the client from which I started it 
> > stopped doing any activity to /pvfs file system. I had to kill the run 
> > as I suspected it was hanging. Even ls on /pvfs just hanged after words.
> > 
> > The following are the message in the system's log at client side. The 
> > metaserver and ionodes were working properly even after this happened. 
> > The /pvfs was still mounted on other client properly and /pvfs was 
> > accessable through them.
> > 
> > Any clue as to why it happened will be highly appreciated.
> > 
> > Thanks in advance,
> > 
> > TV
> > 
> > messages:
> > 
> > Feb  2 17:37:59 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs
> > Feb  2 17:38:14 n99 last message repeated 3 times
> > Feb  2 17:42:07 n99 sshd(pam_unix)[3269]: session closed for user tvsingh
> > Feb  2 17:43:32 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs
> > Feb  2 17:43:32 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs
> > Feb  2 17:43:43 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:44:28 n99 automount[3331]: expired /u/home2
> > Feb  2 17:44:28 n99 kernel: (ll_pvfs.c, 233): ll_pvfs_create failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs/test
> > Feb  2 17:44:41 n99 kernel: (ll_pvfs.c, 87): ll_pvfs_lookup failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs/testFeb  2 17:46:50 n99 
> > kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on enqueue for 
> > 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:48:15 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:48:30 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:48:30 n99 kernel: (inode.c, 264): pvfs_statfs failed
> > Feb  2 17:48:41 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:48:41 n99 kernel: (inode.c, 264): pvfs_statfs failed
> > Feb  2 17:48:43 n99 automount[3457]: expired /u/7day
> > Feb  2 17:48:48 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-metaFeb  2 17:49:04 n99 kernel: 
> > (ll_pvfs.c, 459): ll_pvfs_getmeta failed on enqueue for 
> > 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:51:43 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:51:43 n99 kernel: (inode.c, 264): pvfs_statfs failed
> > Feb  2 17:51:46 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:51:46 n99 kernel: (inode.c, 264): pvfs_statfs failed
> > Feb  2 17:51:48 n99 sshd(pam_unix)[901]: session closed for user tvsingh
> > Feb  2 17:52:11 n99 sshd(pam_unix)[3469]: session opened for user 
> > tvsingh by (uid=1281)
> > Feb  2 17:52:11 n99 automount[407]: attempting to mount entry /u/7day
> > Feb  2 17:52:21 n99 sshd(pam_unix)[3469]: session closed for user tvsingh
> > Feb  2 17:52:24 n99 sshd(pam_unix)[2362]: session closed for user tvsingh
> > Feb  2 17:53:13 n99 automount[3500]: expired /u/7day
> > Feb  2 17:53:40 n99 sshd(pam_unix)[3504]: session opened for user 
> > tvsingh by (uid=1281)
> > Feb  2 17:53:40 n99 automount[407]: attempting to mount entry /u/7day
> > Feb  2 17:53:40 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:53:40 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs
> > Feb  2 17:53:40 n99 kernel: (ll_pvfs.c, 87): ll_pvfs_lookup failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs/testFeb  2 17:53:40 n99 
> > sshd(pam_unix)[3504]: session closed for user tvsingh
> > Feb  2 17:53:52 n99 sshd(pam_unix)[3544]: session opened for user 
> > tvsingh by (uid=1281)
> > Feb  2 17:54:17 n99 kernel: (ll_pvfs.c, 459): ll_pvfs_getmeta failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs
> > Feb  2 17:54:17 n99 kernel: (ll_pvfs.c, 87): ll_pvfs_lookup failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta/tvs
> > Feb  2 17:54:42 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:54:42 n99 kernel: (inode.c, 264): pvfs_statfs failed
> > Feb  2 17:54:48 n99 sshd(pam_unix)[20636]: session closed for user tvsingh
> > Feb  2 17:54:51 n99 kernel: (ll_pvfs.c, 507): ll_pvfs_statfs failed on 
> > enqueue for 10.10.0.90:3000/pvfs-meta
> > Feb  2 17:54:51 n99 kernel: (inode.c, 264): pvfs_statfs failed
> > 
> > 
> > 
> > 
> > 
> > 
> > >  
> > >
> > 
> > _______________________________________________
> > PVFS-users mailing list
> > PVFS-users at www.beowulf-underground.org
> > http://beowulf-underground.org/mailman/listinfo/pvfs-users
> > 
> > 
> 
> _______________________________________________
> PVFS-users mailing list
> PVFS-users at www.beowulf-underground.org
> http://beowulf-underground.org/mailman/listinfo/pvfs-users
> 
> 



More information about the PVFS-users mailing list