[Pvfs2-users] PVFS2 Too Slow

[Nasr Y.M.J.O.]

Hello Murali,

As per pvfs2, I have not done any benchmark yet but looks fine using linux 
commands (cp, ls, mkdir...etc), just instantaneous, no delay at all.

I still couldnot get the mpich compiled with romio support :(. I tried with 
gnu compiler and -lrt. Ill send the config files offlist.

Thanks in advance,

nasr




>From: Murali Vilayannur <vilayann at mcs.anl.gov>
>To: "Nasr Y.M.J.O." <nasr974 at hotmail.com>
>CC: pvfs2-users at beowulf-underground.org
>Subject: Re: [Pvfs2-users] PVFS2 Too Slow
>Date: Mon, 18 Sep 2006 09:04:52 -0500 (CDT)
>
>Hi Nasr,
>
> > Thanks for the hints. Regarding pvfs2 1.5.1, I compiled berkeley db 
>4.3.29
> > from source and later compiled pvfs2 1.5.1 pointing to it. Everything is
> > working fine.
>
>Great!
>
> > My question is, I have two databases now, the old one which
> > handles the cluster and the new compiled one which is for pvfs2, will 
>there
> > be any troubles later on? I compiled the new db (4.3.29) statically in 
>/opt
> > directory and pushed it to all nodes. So far, no errors in all tests and 
>the
> > kernel space commands are just fine.
>
>I think it should be ok. If you have problems later on, do report them..
>Is PVFS2 performance reasonable on your setup now?
> >
> > Regarding mpich, Ill send you the log file offlist in a separate email.
>
>Ok, from the log file I see that the link fails because of
>undefined functions gethrtime(), clock_gettime() which probably means if
>you do
>export LIBS="-lpvfs2 -lrt", then redo configure, and make it might just
>work :)
>Also try it first with gcc, since some of the functionalities (for eg.
>support for var arg macros) seem to be absent
>from the version of icc that is installed on your cluster.
>thanks!
>Murali
>
> >
> > Thanks for your help.
> >
> > nasr
> >
> >
> >
> >
> > >From: Murali Vilayannur <vilayann at mcs.anl.gov>
> > >To: "Nasr Y.M.J.O." <nasr974 at hotmail.com>
> > >CC: pvfs2-users at beowulf-underground.org
> > >Subject: Re: [Pvfs2-users] PVFS2 Too Slow
> > >Date: Mon, 18 Sep 2006 00:03:15 -0500 (CDT)
> > >
> > >Hi Nasr,
> > > >
> > > > Many thanks for the reply. Regarding pvfs2 being too slow I figured 
>out
> > >the
> > > > reason which was due to one of the IO servers going down. Now pvfs2 
>is
> > > > working fine.
> > >
> > >Cool! Good to hear that.
> > >
> > > > In a related matter, Im trying to compile mpich 1.2.7p1 with romio
> > >support
> > > > for pvfs2. Without pvfs2, the configuration step will go through, 
>but
> > >with
> > > > pvfs2 there is an error (I tried both Intel and gnu compilers). Im
> > >attaching
> > > > below as well the steps and the config.log.
> > >
> > > >
> > > > # cp /root/Desktop/cluster/mpich1.2.7/mpich.tar.gz /usr/local/src
> > > > # cd /usr/local/src
> > > > # tar -zxf mpich.tar.gz
> > > > # mkdir -p /opt/mpich1/intel
> > > > # mkdir -p /tmp/mpich1/intel
> > > > # export RSHCOMMAND=ssh
> > > > # export LDFLAGS="-L/opt/pvfs2/lib"
> > > > # export CFLAGS="-I/opt/pvfs2/include"
> > > > # export LIBS="-lpvfs2"
> > > > # export CC="/opt/intel/cc/9.1/bin/icc"
> > > > # export CXX="/opt/intel/cc/9.1/bin/icpc"
> > > > # export FC="/opt/intel/fc/9.1/bin/ifort"
> > > > # export F90="/opt/intel/fc/9.1/bin/ifort"
> > > > # cd /tmp/mpich1/intel
> > > > # /usr/local/src/mpich-1.2.7p1/configure --prefix=/opt/mpich1/intel
> > > > --with-device=ch_p4:-socksize=1048576 --with-comm=shared
> > >--enable-sharedlib
> > > > --enable-romio --with-file-system=pvfs2+nfs+ufs -opt=-O3
> > > >
> > 
> >------------------------------------------------------------------------------------------------------------------------------------------
> > > > CONFIG.LOG FILE
> > > >
> > > > configure:/opt/intel/cc/9.1/bin/icc -I/opt/pvfs2/include conftest.c 
>-o
> > > > conftest -lpvfs2
> > > > configure: failed program was:
> > > >
> > > > #define MPE_USE_EXTENSIONS 1
> > > > #include "confdefs.h"
> > > > int f(double a){return 0;}
> > > > int main() { exit(0); }
> > > > int t() {  }
> > > > conftest.c(4): warning #1011: missing return statement at end of
> > >non-void
> > > > function "t"
> > > >   int t() {  }
> > > >              ^
> > > >
> > > > configure:gcc -I/opt/pvfs2/include conftest.c -o conftest -lpvfs2
> > > > configure: failed program was:
> > > >
> > > > #define MPE_USE_EXTENSIONS 1
> > > > #include "confdefs.h"
> > > >
> > > > int main() { exit(0); }
> > > > int t() { return 0; }
> > > >
> > >
> > >Hmm.. Quite frankly, I am puzzled.
> > >The only thing I can think of is the following:
> > >Why isn't there a "-L /opt/pvfs2/lib" on the gcc command line? It is
> > >perhaps not picking up your LDFLAGS and therefore not able to locate
> > >libpvfs2.a. Also, can you double check to see if libpvfs2.a is indeed
> > >installed in that path?
> > >
> > >Other than those guesses, I do not know why the build failed..
> > >Is that all
> > >config.log/config.status had? If the file is not too big, can you just
> > >mail those to me off-list?
> > >
> > >
> > >
> >
> > _________________________________________________________________
> > Find love online with MSN Personals.
> > http://match.msn.com.my/match/mt.cfm?pg=channel
> >
> >

_________________________________________________________________
Block pop-up ads with MSN Toolbar. http://toolbar.msn.com.my/