[PVFS2-users] IBM JS20 ppc64 & redhat 4 issue

[vallard]

Robert, Thank you so much for your response.  I got the cvs tree and the
configure worked perfectly with the --disable-server.  Here is the command
and output:

 CFLAGS="-m64"
/configure --prefix=/usr/local/pvfs2/ppc64 --with-kernel=/lib/modules/2.6.9
-5.EL/build --disable-karma --disable-server
...
***** Displaying PVFS2 Configuration Information *****
------------------------------------------------------
PVFS2 configured to build karma gui               :  no
PVFS2 configured to perform coverage analysis     :  no
PVFS2 configured for aio threaded callbacks       : yes
PVFS2 configured for the 2.6.x kernel module      : yes
PVFS2 configured for the 2.4.x kernel module      :  no
PVFS2 configured for using the mmap-ra-cache      :  no
PVFS2 configured for a thread-safe client library : yes
PVFS2 will use workaround for redhat 2.4 kernels  :  no
PVFS2 will use workaround for buggy NPTL          :  no
PVFS2 server will be built                        :  no

PVFS2 version string: 1.1.0pre1-2005-04-05-20:47:22

But now it won't build.

make kmod
...
  LD            src/apps/kernel/linux/pvfs2-client-core
/usr/bin/ld: skipping incompatible lib/libpvfs2.a when searching for -lpvfs2
/usr/bin/ld: cannot find -lpvfs2
collect2: ld returned 1 exit status
make: *** [src/apps/kernel/linux/pvfs2-client-core] Error 1

Which seems strange to me because the ar archive is 64 bit.  Are you aware
of a cvs build that has been known to work with my set up?  Or am I doing
something stupid again?
Thanks again for your help and time.

Vallard


----- Original Message ----- 
From: "Robert Latham" <robl at mcs.anl.gov>
To: "vallard" <vallardb at hotmail.com>
Cc: <pvfs2-users at beowulf-underground.org>
Sent: Monday, April 04, 2005 2:13 AM
Subject: Re: [PVFS2-users] IBM JS20 ppc64 & redhat 4 issue


> On Sun, Apr 03, 2005 at 09:52:16PM -0400, vallard wrote:
> > Hi,
> > First, thanks for supporting this list and answering all the questions.
I
> > searched the archives as best I could but didn't find the answer to my
> > question so forgive me if I am repeating anything.  I am running redhat
4 on
> > ppc64 compiled with gcc. The default compiles 32bit binaries which I
guess
> > is ok, because everything works as far as pvfs2-ls, pvfs2-ping etc.  In
> > addition, I was able to insmod the pvfs2.ko.
> > However, what doesn't work is mounting now using the kernel module:
>
> We had a similar problem with rhel3 on ppc64
>
> > [root at blade002 linux-2.6]# mount /mnt/pvfs2
> > mount: wrong fs type, bad option, bad superblock on
> > tcp://blade006:3334/pvfs2-fs,
> >        or too many mounted file systems
> >
> > from the syslog:
> > Apr  3 20:06:30 blade002 kernel: pvfs2: pvfs2_get_sb -- wait timed out
> > (ec0001).  aborting attempt.
> > Apr  3 20:06:30 blade002 kernel: pvfs2_get_sb: mount request failed with
> > 15466497
> >
> > I am wondering if this is because I need to build the binaries, etc in
64
> > bit mode.  When I do that I com with:
>
> You've got it exactly right.
>
> > CFLAGS="-m64"
> >
/configure --prefix=/usr/local/pvfs2/ppc64/ --with-kernel=/lib/modules/2.6.
> > 9-5.EL/build/
> >
> > but it doesn't find the DB.  I modified the configure script (line 1981)
to
> > search for db4-2 (since thats what I see in /lib64 )and that configured
> > properly, but the make failed:
> >
> > /usr/bin/ld: skipping incompatible lib/libpvfs2-server.a when searching
> > for -lpvfs2-server
> > /usr/bin/ld: cannot find -lpvfs2-server
> > collect2: ld returned 1 exit status
> > make: *** [src/server/pvfs2-server] Error 1
> >
> > I'm sure I'm forgetting/doing something stupid.
>
> You're doing everything correctly.  In CVS, we have a new
> "--disable-server" option.
>
> > If anyone can help me, I would greatly appreciate it.  I should also
> > mention that the file server is an Intel Xeon machine EM64T running
> > rh4 as well and everything works perfect in that.
>
> Ok, so you are running in an environment much like ours.  Build the
> full pvfs2 tools (client and server) on the file server.
>
> On the ppc64 node, set that -m64 option,  configure with
> --disable-server, and build the client library, client programs,
> kernel module, and kernel helpers.   The berkely db libraries are only
> needed by the pvfs2 server.  On most systems berkely db is only
> provided in 32 bit mode.
>
> You will need CVS: see http://www.pvfs.org/pvfs2/developers.html for
> information about that.  If you are very patent you can wait for our
> next release, but we don't have a firm date in mind for that ("soon").
>
> ==rob
>
> -- 
> Rob Latham
> Mathematics and Computer Science Division    A215 0178 EA2D B059 8CDF
> Argonne National Labs, IL USA                B29D F333 664A 4280 315B
>