Thank you so much! I got it! It's running!<br><br><div class="gmail_quote">On Jan 23, 2008 2:34 PM, Phil Carns <<a href="mailto:carns@mcs.anl.gov">carns@mcs.anl.gov</a>> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
If you add a -p (so "netstat -tanp | grep 3334") and run it as root, you<br>can see what process is actually listening on that port. You want to<br>make sure that nothing is listening on the port before you start
<br>pvfs2-server. After pvfs2-server is successfully started, you should<br>then see that pvfs2-server is listening on 3334.<br><br>Perhaps there is an old instance of pvfs2-server already running on the<br>machine that is giving an error?
<br><br>It doesn't matter if you start the servers on the two nodes at the same<br>time or not. It also doesn't particularly matter what port you use on<br>either node, as long as that port is available. 3334 is preferred just
<br>for the sake of having a conventional configuration.<br><br>-Phil<br><div class="Ih2E3d"><br>Scully wrote:<br>> Thank you for your information. That's really helpful.<br>><br>> This time I try both 3334 port. OpenSUSE-desktop is OK this time, but
<br>> the server on suse64 can not be started.<br>><br>> on both machine, I ran<br>> # netstat -tan | grep 3334<br>><br>> I got<br></div>> {tcp 0 0 <a href="http://0.0.0.0:3334" target="_blank">0.0.0.0:3334
</a> <<a href="http://0.0.0.0:3334" target="_blank">http://0.0.0.0:3334</a>> 0.0.0.0:* LISTEN<br><div><div></div><div class="Wj3C7c">> }<br>> on both.<br>><br>> And the /tmp/pvfs2-server.log on suse64, on which can not start the
<br>> server, showed:<br>> {PVFS2 Server version 2.7.0 starting.<br>> [E 01/23 13:44] Error: BMI_sockio_bind_sock: Address already in use<br>> [E 01/23 13:44] Error: tcp_server_init() failure.<br>> [E 01/23 13:44] Error: BMI_initialize: Address already in use
<br>> [E 01/23 13:44] Error: Could not initialize server interfaces; aborting.<br>> [E 01/23 13:44] Error: Could not initialize server; aborting.<br>> }<br>><br>> Does it mean, I can not assign port 3334 to both of them? Or, maybe
<br>> starting the servers on both machines exactly at the same time will help?<br>><br>><br>> On Wed, 2008-01-23 at 10:10 -0500, Phil Carns wrote:<br>>> Hi,<br>>><br>>> When you run your netstat check to see if anything is using port 9000,
<br>>> you should probably run it with these arguments:<br>>><br>>><br>>> netstat -tan | grep 9000<br>>><br>>> The "-n" part of the netstat command line is important to make sure that
<br>>> you get numerical port numbers rather than symbolic names for them. The<br>>><br>>> "-t" makes it only show tcp ports, which are the only ones that matter<br>>> to PVFS.<br>>>
<br>>> IANA indicates that port 9000 could possibly be used by something called<br>>><br>>> "cslistener". If opensuse happens to include that in their<br>>> /etc/services file then you would see <host>:cslistener rather than
<br>>><br>>> <host>:9000 when checking netstat without the "-n" argument, and the<br>>> grep would miss it.<br>>><br>>><br>>> <a href="http://www.iana.org/assignments/port-numbers" target="_blank">
http://www.iana.org/assignments/port-numbers</a><br>>><br>>> -Phil<br>>><br>>> Scully wrote:<br>>> > Sorry, both nodes use port 9000<br>>><br>>> ><br>>> > On Tue, 2008-01-22 at 16:19 -0500, Scully wrote:
<br>>> >> Hi,<br>>> >> I am trying to setup a PVFS2 system in two nodes, suse64(x86_64) and<br>>><br>>> >> OpenSUSE-desktop(i386), each has a io server and meta server. Both of<br>
>> >> them are using kernel: 2.6.16.53-0.8. Both use port 3334.<br>>><br>>> >><br>>> >> The server can start correctly on suse64, but on OpenSUSE-desktop,<br>>> >> it's another story.
<br>>><br>>> >> It looks ok when I run:<br>>> >> {<br>>> >> OpenSUSE-desktop:/usr/local/bin #/etc/init.d/pvfs2-server start<br>>> >> Starting PVFS2 server: [S 01/22 15:44] PVFS2 Server on node
<br>>><br>>> >> OpenSUSE-desktop version 2.7.0 starting...<br>>> >> }<br>>> >> But when I check the log, I get<br>>><br>>> >> {<br>>> >> OpenSUSE-desktop:/usr/local/bin # cat /tmp/pvfs2-
server.log<br>>> >> [D 01/22 15:44] PVFS2 Server version 2.7.0 starting.<br>>><br>>> >> [E 01/22 15:44] Error: BMI_sockio_bind_sock: Address already in use<br>>> >> [E 01/22 15:44] Error: tcp_server_init() failure.
<br>>> >> [E 01/22 15:44] Error: BMI_initialize: Address already in use<br>>><br>>> >> [E 01/22 15:44] Error: Could not initialize server interfaces; aborting.<br>>> >> [E 01/22 15:44] Error: Could not initialize server; aborting.
<br>>><br>>> >> }<br>>> >> I think port 9000 is available:<br>>> >> {<br>>> >> OpenSUSE-desktop:/usr/local/bin # netstat | grep 9000<br>>><br>>> >> OpenSUSE-desktop:/usr/local/bin #
<br>>> >> }<br>>> >> When I set a new port to the server in the /etc/pvfs2-<br>>> fs.conf, say<br>>> >> 9001, there is no problem to start the server. But, next time, I have<br>>> >> to use another port. I guess pvfs2 doesn't work this way.
<br>>><br>>> >><br>>> >> When stopping a server and re-setup a new one, I do:<br>>> >> {<br>>> >> #/etc/init.d/pvfs2-server stop<br>>><br>>> >> #/usr/local/sbin/pvfs2-server /etc/pvfs2-
fs.conf -r<br>>> >> If above instruction can not delete the storage space, I do it manully<br>>><br>>> >> #rm -fr /pvfs2-storage-space.<br>>> >> }<br>>> >> The configure files are the same in both nodes
<br>>> >> {<br>>><br>>> >> OpenSUSE-desktop:/usr/local/bin # cat /etc/pvfs2-fs.conf<br>>> >> <Defaults><br>>> >> UnexpectedRequests 50<br>>><br>>> >> EventLogging none
<br>>> >> LogStamp datetime<br>>> >> BMIModules bmi_tcp<br>>><br>>> >> FlowModules flowproto_multiqueue<br>>> >> PerfUpdateInterval 1000
<br>>> >> ServerJobBMITimeoutSecs 30<br>>><br>>> >> ServerJobFlowTimeoutSecs 30<br>>> >> ClientJobBMITimeoutSecs 300<br>>> >> ClientJobFlowTimeoutSecs 300
<br>>><br>>> >> ClientRetryLimit 5<br>>> >> ClientRetryDelayMilliSecs 2000<br>>> >><br>>> >> StorageSpace /pvfs2-storage-space<br>>><br>>> >> LogFile /tmp/pvfs2-
server.log<br>>> >> </Defaults><br>>> >><br>>> >> <Aliases><br>>><br>>> >> Alias OpenSUSE-desktop tcp://OpenSUSE-desktop:9000<br>>> >> Alias suse64 tcp://suse64:9000
<br>>> >> </Aliases><br>>><br>>> >><br>>> >> <Filesystem><br>>> >> Name pvfs2-fs<br>>> >> ID 2061359039<br>>><br>>> >> RootHandle 1048576
<br>>> >> <MetaHandleRanges><br>>> >> Range OpenSUSE-desktop 3-2305843009213693953<br>>><br>>> >> Range suse64 2305843009213693954-4611686018427387904
<br>>> >> </MetaHandleRanges><br>>> >> <DataHandleRanges><br>>><br>>> >> Range OpenSUSE-desktop<br>>> >> 4611686018427387905-6917529027641081855
<br>>> >> Range suse64 6917529027641081856-9223372036854775806<br>>><br>>> >> </DataHandleRanges><br>>> >> <StorageHints><br>>> >> TroveSyncMeta yes
<br>>><br>>> >> TroveSyncData no<br>>> >> </StorageHints><br>>> >> </Filesystem><br>>><br>>> >> }<br>>> >><br>>> >>
<br>>> >> Did I do something wrong? Thanks.<br>>> ><br>>><br>>> > ------------------------------------------------------------------------<br>>> ><br>>> > _______________________________________________
<br>>><br>>> > Pvfs2-users mailing list<br></div></div>>> > <a href="mailto:Pvfs2-users@beowulf-underground.org">Pvfs2-users@beowulf-underground.org</a> <mailto:<a href="mailto:Pvfs2-users@beowulf-underground.org">
Pvfs2-users@beowulf-underground.org</a>><br><div><div></div><div class="Wj3C7c">>> ><br>>> <a href="http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users" target="_blank">http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
</a><br>>><br><br></div></div></blockquote></div><br>