[PVFS-users] Re: ROMIO on PVFS

Phil Carns pcarns@parl.clemson.edu
Thu, 15 Jan 2004 12:03:53 -0500 (EST)


  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.
  Send mail to mime@docserver.cac.washington.edu for more info.

--2139235538-905002701-1074186233=:14526
Content-Type: TEXT/PLAIN; charset=US-ASCII

Hi Lei,

I think that we may have found your problem.  There is a subtle bug in
pvfs_open() in 1.6.2 that you might be running into in this case.

Could you try applying the attached patch to 1.6.2 and see if it fixes
the problem for you?

This patch has already been applied to cvs, but today might not be
the best time to check that code out (we are in the middle of some other
unrelated clean ups at the moment).

thanks!
-Phil

On Mon, 12 Jan 2004, Rob Ross wrote:

> Hey,
>
> Thanks for the additional information.  Sounds like things are mostly
> working anyway; that's a great start.
>
> Could you try appending "pvfs:" to your filename in your Fortran code, to
> see if that helps?
>
> Thanks,
>
> Rob
>
> On Fri, 9 Jan 2004, Lei@ICS wrote:
>
> > Hi Rob,
> >
> > Sorry for my cross-posting.
> >
> > The versions: pvfs: 1.6.2  Linux: RedHat 7.3, kernel 2.4.18-10smp,
> >               MPICH 1.2.5.2 built w/ the support of pvfs, nfs etc.
> >
> > The MPICH make script is attached at the end.
> > PVFS installed on p00-p03, but not the head node.
> > MPI code ran from p00, two node p00 and p01 are used.
> >
> > What does work?
> > 1). Can copy files and directories from NFS to PVFS.
> > 2). Symbolic link works on PVFS.
> > 3). pvfs-ping works:
> > [pan@pluto00 pan]$ /opt/local/bin/pvfs-ping -h p00 -f /pvfs-meta
> > mgr (p00:3000) is responding.
> > iod 0 (192.168.10.10:7000) is responding.
> > iod 1 (192.168.10.11:7000) is responding.
> > iod 2 (192.168.10.12:7000) is responding.
> > iod 3 (192.168.10.13:7000) is responding.
> > pvfs file system /pvfs-meta is fully operational.
> >
> > 4). Fortran open() works on PVFS, and can write a
> >     large file (3.2GB) to PVFS.
> >
> > I will test to see if C MPI code works.
> >
> > Thanks a lot,
> >
> > -Lei         mailto:pan@ics.uci.edu
> >
> >
> > ----------- make --------------------
> > #!/bin/csh -v
> > # edit the next couple of lines
> > setenv RSHCOMMAND rsh
> > setenv RSH rsh
> > setenv CC /home/packages/gcc-3.2/bin/gcc
> > setenv FC '/home/packages/absoft/bin/f77 -cpu:host -N90 -f -N22 -B108'
> > setenv F90 '/home/packages/absoft/bin/f95 -cpu:host -YCFRL=1 -YEXT_NAMES=LCS -YEXT_SFX=_ -YCOM_NAMES=LCS -YCOM_PFX= -YCOM_SFX=_'
> > setenv F95 '/home/packages/absoft/bin/f95 -cpu:host -YCFRL=1 -YEXT_NAMES=LCS -YEXT_SFX=_ -YCOM_NAMES=LCS -YCOM_PFX= -YCOM_SFX=_'
> > setenv PVFS_DIR /opt/local
> >
> > rm -f config-mine.log
> >
> > # edit this line for different compilers, arch, shell, flags
> > ./configure --disable-devdebug -opt=-O2 \
> >               --with-romio=--with-file-system=ufs+nfs+testfs+pvfs \
> >               -cflags="-g -I$PVFS_DIR/include -D_FILE_OFFSET_BITS=64 -D_LARGEFILE64_SOURCE" \
> >               -lib="-L$PVFS_DIR/lib -lpvfs" \
> >               --disable-weak-symbols --with-device=ch_p4 \
> >               --prefix=/home/pan/mpich/absoft_f95 \
> >               -rsh=$RSH \
> >                   >& config-mine.log
> > tail config-mine.log
> >
> > rm -f make.log
> > make >& make.log
> > tail make.log
> > make install >& make.install.log
> > tail make.install.log
> >
> >
> >
>
>
>
>
> _______________________________________________
> PVFS-users mailing list
> PVFS-users@www.beowulf-underground.org
> http://beowulf-underground.org/mailman/listinfo/pvfs-users
>

--2139235538-905002701-1074186233=:14526
Content-Type: TEXT/PLAIN; charset=US-ASCII; name="pvfs_open_pcount.patch"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.LNX.4.44.0401151203530.14526@acid.parl.clemson.edu>
Content-Description: 
Content-Disposition: attachment; filename="pvfs_open_pcount.patch"

ZGlmZiAtTmF1ciBwdmZzLW9sZC9saWIvcHZmc19vcGVuLmMgcHZmcy1uZXcv
bGliL3B2ZnNfb3Blbi5jDQotLS0gcHZmcy1vbGQvbGliL3B2ZnNfb3Blbi5j
CTIwMDMtMTAtMjMgMTQ6MDY6NDMuMDAwMDAwMDAwIC0wNDAwDQorKysgcHZm
cy1uZXcvbGliL3B2ZnNfb3Blbi5jCTIwMDQtMDEtMTUgMDg6MDA6MDYuMDAw
MDAwMDAwIC0wNTAwDQpAQCAtMjIzLDYgKzIyMyw3IEBADQogCWlmIChmbGFn
ICYgT19NRVRBKSB7DQogCQlyZXEucmVxLm9wZW4ubWV0YS5wX3N0YXQuYmFz
ZSA9IG1ldGFfcC0+YmFzZTsNCiAJCW5pb2RzZXJ2ZXJzID0gcmVxLnJlcS5v
cGVuLm1ldGEucF9zdGF0LnBjb3VudCA9IG1ldGFfcC0+cGNvdW50Ow0KKwkJ
aWYgKG5pb2RzZXJ2ZXJzIDwgMCkgbmlvZHNlcnZlcnMgPSAwOyAvKiBwY291
bnQgPCAwIGlucHV0IGlzIHZhbGlkICovDQogCQlyZXEucmVxLm9wZW4ubWV0
YS5wX3N0YXQuc3NpemUgPSBtZXRhX3AtPnNzaXplOw0KIAl9DQogCWVsc2Ug
ew0K
--2139235538-905002701-1074186233=:14526--