<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=gb2312">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7654.12">
<TITLE>re: [pvfs2-user] fail to use pvfs2-cp in 2.8.1</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/plain format -->
<P><FONT SIZE=2>It just says:<BR>
<BR>
[D 12/31 19:01] PVFS2 Server version 2.8.1 starting.<BR>
<BR>
Shouldn't it display something regarding my previous<BR>
pvfs2-ln operation? Hmm...<BR>
<BR>
My log is too simple to be a good log.<BR>
<BR>
Ben<BR>
<BR>
-----Original Message-----<BR>
From: Kevin Harms [<A HREF="mailto:harms@alcf.anl.gov">mailto:harms@alcf.anl.gov</A>]<BR>
Sent: 6/1/2009 () 16:14<BR>
To: Huang, Bin<BR>
Cc: Rob Ross; pvfs2-users@beowulf-underground.org<BR>
Subject: Re: [pvfs2-user] fail to use pvfs2-cp in 2.8.1<BR>
<BR>
<BR>
Do you see an messages in the server log? By default it should /tmp/<BR>
pvfs2-server.log.<BR>
<BR>
kevin<BR>
<BR>
On Jun 1, 2009, at 2:58 PM, Huang, Bin wrote:<BR>
<BR>
> Hi, Rob & list,<BR>
><BR>
> In my test, I have two nodes called n61 and n62.<BR>
> I ran my pvfs2 server on n62. When I was testing<BR>
> pvfs2-cp, I tried to run it from both n61 and n62.<BR>
> Both approaches gave me that pvfs2-cp failure.<BR>
><BR>
> As I said, only pvfs2-cp has such problem. For<BR>
> pvfs2-ping and pvfs2-ls, they work well either<BR>
> locally or remotely.<BR>
><BR>
> Interestingly, I can also do pvfs2-ln from the<BR>
> client. It seems that the client (my n61) is<BR>
> able to create a soft link in the server node (my n62).<BR>
><BR>
> I am wondering if pvfs2-cp is depending on<BR>
> any specific system library which I might miss<BR>
> installing in my kernel.<BR>
><BR>
> Briefly, here is what I am using:<BR>
> Linux version 2.6.26<BR>
> PowerPC405 (No FPU)<BR>
> 512MB DDR2<BR>
> GLibc 2.9<BR>
><BR>
> (It looks pretty odd, I know. But it is part of<BR>
> our research)<BR>
><BR>
> Any idea?<BR>
><BR>
> Ben<BR>
><BR>
><BR>
> -----Original Message-----<BR>
> From: Rob Ross [<A HREF="mailto:rross@mcs.anl.gov">mailto:rross@mcs.anl.gov</A>]<BR>
> Sent: 5/29/2009 () 17:10<BR>
> To: Huang, Bin<BR>
> Cc: Kevin Harms; pvfs2-users@beowulf-underground.org<BR>
> Subject: Re: [Pvfs2-users] [pvfs2-user] fail to use pvfs2-cp in 2.8.1<BR>
><BR>
> Hi,<BR>
><BR>
> Did you run this on a node other than n62?<BR>
><BR>
> Rob<BR>
><BR>
> On May 29, 2009, at 3:57 PM, Huang, Bin wrote:<BR>
><BR>
> > Hi, kevin and list,<BR>
> ><BR>
> > When I look at my output from pvfs2-ping, there<BR>
> > is a false sense of security...<BR>
> ><BR>
> > Here is my output:<BR>
> ><BR>
> > root:~# /usr/local/bin/pvfs2-ping -m /mnt/pvfs2<BR>
> ><BR>
> > (1) Parsing tab file...<BR>
> ><BR>
> > (2) Initializing system interface...<BR>
> ><BR>
> > (3) Initializing each file system found in tab file: /etc/fstab...<BR>
> ><BR>
> > PVFS2 servers: tcp://n62:3334<BR>
> > Storage name: pvfs2-fs<BR>
> > Local mount point: /mnt/pvfs2<BR>
> > /mnt/pvfs2: Ok<BR>
> ><BR>
> > (4) Searching for /mnt/pvfs2 in pvfstab...<BR>
> ><BR>
> > PVFS2 servers: tcp://n62:3334<BR>
> > Storage name: pvfs2-fs<BR>
> > Local mount point: /mnt/pvfs2<BR>
> ><BR>
> > meta servers:<BR>
> > tcp://n62:3334<BR>
> ><BR>
> > data servers:<BR>
> > tcp://n62:3334<BR>
> ><BR>
> > (5) Verifying that all servers are responding...<BR>
> ><BR>
> > meta servers:<BR>
> > tcp://n62:3334 Ok<BR>
> ><BR>
> > data servers:<BR>
> > tcp://n62:3334 Ok<BR>
> ><BR>
> > (6) Verifying that fsid 1186947128 is acceptable to all servers...<BR>
> ><BR>
> > Ok; all servers understand fs_id 1186947128<BR>
> ><BR>
> > (7) Verifying that root handle is owned by one server...<BR>
> ><BR>
> > Root handle: 1048576<BR>
> > Ok; root handle is owned by exactly one server.<BR>
> ><BR>
> ><BR>
> ><BR>
> > Ben<BR>
> ><BR>
> > -----Original Message-----<BR>
> > From: Kevin Harms [<A HREF="mailto:harms@alcf.anl.gov">mailto:harms@alcf.anl.gov</A>]<BR>
> > Sent: Fri 5/29/2009 16:31<BR>
> > To: Huang, Bin<BR>
> > Cc: pvfs2-users@beowulf-underground.org<BR>
> > Subject: Re: [Pvfs2-users] [pvfs2-user] fail to use pvfs2-cp in <BR>
> 2.8.1<BR>
> ><BR>
> ><BR>
> > What is the output from pvfs2-ping -m /mnt/pvfs2<BR>
> ><BR>
> > kevin<BR>
> ><BR>
> > On May 29, 2009, at 3:24 PM, Huang, Bin wrote:<BR>
> ><BR>
> > > Hi, list,<BR>
> > ><BR>
> > > I am currently testing my pvfs2-2.8.1 installation. I posted<BR>
> > > an error of failing to do pvfs2-ping on the list several<BR>
> > > weeks ago. It turned out that the issue came from lack of<BR>
> > > TCP wrapper in my kernel. Don't blame me for that because I<BR>
> > > was doing Linux from scratch and there are lots of ambiguous<BR>
> > > utilities to understand. :)<BR>
> > ><BR>
> > > Now I am facing another issue during my pvfs2 testing. When I<BR>
> > > was running pvfs2-cp, either when copying files to or from<BR>
> > > a PVFS2 file system, it failed to receive the package and the<BR>
> > > connection was refused.<BR>
> > ><BR>
> > > It is a little frustrating because this testing seems quite<BR>
> > > straightforward. Since I am doing Linux from scratch, I am<BR>
> > > not 100% sure my kernel will be compatible with pvfs2-2.8.1.<BR>
> > > I assume that people have tested pvfs2 with various mainstream<BR>
> > > distributions but not with a build-all-components-manually<BR>
> > > kernel before releasing it.<BR>
> > ><BR>
> > > I have no problem running pvfs2-ls, pvfs2-rm, pvfs2-mkdir,<BR>
> > > pvfs2-ln and pvfs2-fsck. So I am struggling to know whether<BR>
> > > this issue is from my kernel or from pvfs2 itself. I attached<BR>
> > > the error message hoping that someone can give me a guide.<BR>
> > ><BR>
> > > Here is my error message when using pvfs2-cp:<BR>
> > ><BR>
> > > root:~# /usr/local/bin/pvfs2-cp -t /usr/lib/libc.a /mnt/pvfs2/<BR>
> > testfile<BR>
> > > [ 167.181678] Signal: b<BR>
> > > [ 167.181686] Code: 30001<BR>
> > > [ 167.181694] Addr: 1a0<BR>
> > > [ 167.188761] Signal: b<BR>
> > > [ 167.188769] Code: 30001<BR>
> > > [ 167.188777] Addr: 1a0<BR>
> > > [E 03:13:52.731545] Receive immediately failed: Broken pipe<BR>
> > > [E 03:13:52.733795] Warning: msgpair failed to tcp://n62:3334, <BR>
> will<BR>
> > > retry: Broken pipe<BR>
> > > [E 03:13:52.734314] *** msgpairarray_completion_fn: msgpair to<BR>
> > > server tcp://n62:3334 failed: Broken pipe<BR>
> > > [E 03:13:52.734756] *** No retries requested.<BR>
> > > [E 03:13:52.743444] Receive immediately failed: Connection refused<BR>
> > > [E 03:13:52.744111] Warning: msgpair failed to tcp://n62:3334, <BR>
> will<BR>
> > > retry: Connection refused<BR>
> > > [E 03:13:52.744689] Warning: msgpair failed to tcp://n62:3334, <BR>
> will<BR>
> > > retry: Connection refused<BR>
> > > [E 03:13:52.745124] *** msgpairarray_completion_fn: msgpair to<BR>
> > > server tcp://n62:3334 failed: Connection refused<BR>
> > > [E 03:13:52.745494] *** No retries requested.<BR>
> > > [E 03:13:52.745898] *** msgpairarray_completion_fn: msgpair to<BR>
> > > server tcp://n62:3334 failed: Connection refused<BR>
> > > [E 03:13:52.746269] *** No retries requested.<BR>
> > > pvfs2-cp: src/client/sysint/sys-getattr.sm:309:<BR>
> > > getattr_acache_lookup: Assertion `object_ref.handle !=<BR>
> > > ((PVFS_handle)0)' failed.<BR>
> > > Aborted<BR>
> > ><BR>
> > ><BR>
> > ><BR>
> > > Benjamin Huang<BR>
> > > Reconfigurable Computing System lab<BR>
> > > UNC Charlotte<BR>
> > ><BR>
> > ><BR>
> > > _______________________________________________<BR>
> > > Pvfs2-users mailing list<BR>
> > > Pvfs2-users@beowulf-underground.org<BR>
> > > <A HREF="http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users">http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users</A><BR>
> ><BR>
> ><BR>
> ><BR>
> > _______________________________________________<BR>
> > Pvfs2-users mailing list<BR>
> > Pvfs2-users@beowulf-underground.org<BR>
> > <A HREF="http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users">http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users</A><BR>
><BR>
><BR>
><BR>
<BR>
<BR>
</FONT>
</P>
</BODY>
</HTML>