Re[3]: [PVFS-users] Re: ROMIO on PVFS
Lei@ICS
Lei@ICS" <pan@ics.uci.edu
Fri, 16 Jan 2004 12:20:13 -0800
Hi Rob,
Thanks! I am looking forward to your now patch.
I might have found another glitch in the version
that we have. From my Fortran code I dump out
a large file (~2.6GB) to PVFS (Fortran open()
or MPI_FILE_OPEN()): 960211.slc, the strange
thing is:
ls -l *.slc
ls: No match.
but,
ls -l 960211.slc
-rw------- 1 pan hpcc-gue 2567782400 Jan 16 11:54 960211.slc
My program is a set of Fortran exe's chained with
Perl scripts. The Perl script cannot find this file
even if it exists, therefore the execution halts.
If you need more info about this, please let me know.
But I would like to see this problem goes away
with your new patch.
Thanks again,
-Lei mailto:pan@ics.uci.edu
Friday, January 16, 2004, 6:40:34 AM, you wrote:
RR> Hi Lei,
RR> Excellent! We think that there are still some corner cases left, so we'll
RR> send another patch once we think we've got everything knocked out. But
RR> I'm glad that that one is doing the trick for you.
RR> Rob
RR> On Thu, 15 Jan 2004, Lei@ICS wrote:
>> Hi Phil,
>>
>> This patch seems to fix our problem. File
>> openings from on/off pvfs for read/write
>> were all successful!
>>
>> Thanks a lot,
>> -Lei mailto:pan@ics.uci.edu
>>
>> Thursday, January 15, 2004, 9:03:53 AM, you wrote:
>>
>> PC> Hi Lei,
>>
>> PC> I think that we may have found your problem. There is a subtle bug in
>> PC> pvfs_open() in 1.6.2 that you might be running into in this case.
>>
>> PC> Could you try applying the attached patch to 1.6.2 and see if it fixes
>> PC> the problem for you?
>>
>> PC> This patch has already been applied to cvs, but today might not be
>> PC> the best time to check that code out (we are in the middle of some other
>> PC> unrelated clean ups at the moment).
>>
>> PC> thanks!
>> PC> -Phil
>>
>> PC> On Mon, 12 Jan 2004, Rob Ross wrote:
>>
>> >> Hey,
>> >>
>> >> Thanks for the additional information. Sounds like things are mostly
>> >> working anyway; that's a great start.
>> >>
>> >> Could you try appending "pvfs:" to your filename in your Fortran code, to
>> >> see if that helps?
>> >>
>> >> Thanks,
>> >>
>> >> Rob
>> >>
>> >> On Fri, 9 Jan 2004, Lei@ICS wrote:
>> >>
>> >> > Hi Rob,
>> >> >
>> >> > Sorry for my cross-posting.
>> >> >
>> >> > The versions: pvfs: 1.6.2 Linux: RedHat 7.3, kernel 2.4.18-10smp,
>> >> > MPICH 1.2.5.2 built w/ the support of pvfs, nfs etc.
>> >> >
>> >> > The MPICH make script is attached at the end.
>> >> > PVFS installed on p00-p03, but not the head node.
>> >> > MPI code ran from p00, two node p00 and p01 are used.
>> >> >
>> >> > What does work?
>> >> > 1). Can copy files and directories from NFS to PVFS.
>> >> > 2). Symbolic link works on PVFS.
>> >> > 3). pvfs-ping works:
>> >> > [pan@pluto00 pan]$ /opt/local/bin/pvfs-ping -h p00 -f /pvfs-meta
>> >> > mgr (p00:3000) is responding.
>> >> > iod 0 (192.168.10.10:7000) is responding.
>> >> > iod 1 (192.168.10.11:7000) is responding.
>> >> > iod 2 (192.168.10.12:7000) is responding.
>> >> > iod 3 (192.168.10.13:7000) is responding.
>> >> > pvfs file system /pvfs-meta is fully operational.
>> >> >
>> >> > 4). Fortran open() works on PVFS, and can write a
>> >> > large file (3.2GB) to PVFS.
>> >> >
>> >> > I will test to see if C MPI code works.
>> >> >
>> >> > Thanks a lot,
>> >> >
>> >> > -Lei mailto:pan@ics.uci.edu
>> >> >
>> >> >
>> >> > ----------- make --------------------
>> >> > #!/bin/csh -v
>> >> > # edit the next couple of lines
>> >> > setenv RSHCOMMAND rsh
>> >> > setenv RSH rsh
>> >> > setenv CC /home/packages/gcc-3.2/bin/gcc
>> >> > setenv FC '/home/packages/absoft/bin/f77 -cpu:host -N90 -f -N22 -B108'
>> >> > setenv F90 '/home/packages/absoft/bin/f95 -cpu:host -YCFRL=1
>> >> -YEXT_NAMES=LCS -YEXT_SFX=_ -YCOM_NAMES=LCS -YCOM_PFX= -YCOM_SFX=_'
>> >> > setenv F95 '/home/packages/absoft/bin/f95 -cpu:host -YCFRL=1
>> >> -YEXT_NAMES=LCS -YEXT_SFX=_ -YCOM_NAMES=LCS -YCOM_PFX= -YCOM_SFX=_'
>> >> > setenv PVFS_DIR /opt/local
>> >> >
>> >> > rm -f config-mine.log
>> >> >
>> >> > # edit this line for different compilers, arch, shell, flags
>> >> > ./configure --disable-devdebug -opt=-O2 \
>> >> >
>> >> --with-romio=--with-file-system=ufs+nfs+testfs+pvfs \
>> >> > -cflags="-g -I$PVFS_DIR/include
>> >> -D_FILE_OFFSET_BITS=64 -D_LARGEFILE64_SOURCE" \
>> >> > -lib="-L$PVFS_DIR/lib -lpvfs" \
>> >> > --disable-weak-symbols --with-device=ch_p4 \
>> >> > --prefix=/home/pan/mpich/absoft_f95 \
>> >> > -rsh=$RSH \
>> >> > >& config-mine.log
>> >> > tail config-mine.log
>> >> >
>> >> > rm -f make.log
>> >> > make >& make.log
>> >> > tail make.log
>> >> > make install >& make.install.log
>> >> > tail make.install.log
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >>
>> >>
>> >> _______________________________________________
>> >> PVFS-users mailing list
>> >> PVFS-users@www.beowulf-underground.org
>> >> http://beowulf-underground.org/mailman/listinfo/pvfs-users
>> >>
>>
>>
>>
RR> _______________________________________________
RR> PVFS-users mailing list
RR> PVFS-users@www.beowulf-underground.org
RR> http://beowulf-underground.org/mailman/listinfo/pvfs-users