Thank you for your information. That's really helpful.<br>
<br>
This time I try both 3334 port. OpenSUSE-desktop is OK this time, but the server on suse64 can not be started.<br>
<br>
on both machine, I ran <br>
# netstat -tan | grep 3334<br>
<br>
I got <br>
{tcp 0 0 <a href="http://0.0.0.0:3334">0.0.0.0:3334</a> 0.0.0.0:* LISTEN<br>
}<br>
on both.<br>
<br>
And the /tmp/pvfs2-server.log on suse64, on which can not start the server, showed:<br>
{PVFS2 Server version 2.7.0 starting.<br>
[E 01/23 13:44] Error: BMI_sockio_bind_sock: Address already in use<br>
[E 01/23 13:44] Error: tcp_server_init() failure.<br>
[E 01/23 13:44] Error: BMI_initialize: Address already in use<br>
[E 01/23 13:44] Error: Could not initialize server interfaces; aborting.<br>
[E 01/23 13:44] Error: Could not initialize server; aborting.<br>
}<br>
<br>
Does it mean, I can not assign port 3334 to both of them? Or, maybe starting the servers on both machines exactly at the same time will help?<br>
<br>
<br>
On Wed, 2008-01-23 at 10:10 -0500, Phil Carns wrote:
<blockquote type="CITE">
<pre><font color="#000000">Hi,</font><br><br><font color="#000000">When you run your netstat check to see if anything is using port 9000, </font><br><font color="#000000">you should probably run it with these arguments:</font>
<br><br><font color="#000000"> netstat -tan | grep 9000</font><br><br><font color="#000000">The "-n" part of the netstat command line is important to make sure that </font><br><font color="#000000">you get numerical port numbers rather than symbolic names for them. The
</font><br><font color="#000000">"-t" makes it only show tcp ports, which are the only ones that matter </font><br><font color="#000000">to PVFS.</font><br><br><font color="#000000">IANA indicates that port 9000 could possibly be used by something called
</font><br><font color="#000000">"cslistener". If opensuse happens to include that in their </font><br><font color="#000000">/etc/services file then you would see <host>:cslistener rather than </font><br>
<font color="#000000"><host>:9000 when checking netstat without the "-n" argument, and the </font><br><font color="#000000">grep would miss it.</font><br><br><font color="#000000"><a href="http://www.iana.org/assignments/port-numbers">
http://www.iana.org/assignments/port-numbers</a></font><br><br><font color="#000000">-Phil</font><br><br><font color="#000000">Scully wrote:</font><br><font color="#000000">> Sorry, both nodes use port 9000</font><br><font color="#000000">
> </font><br><font color="#000000">> On Tue, 2008-01-22 at 16:19 -0500, Scully wrote:</font><br><font color="#000000">>> Hi,</font><br><font color="#000000">>> I am trying to setup a PVFS2 system in two nodes, suse64(x86_64) and
</font><br><font color="#000000">>> OpenSUSE-desktop(i386), each has a io server and meta server. Both of </font><br><font color="#000000">>> them are using kernel: 2.6.16.53-0.8. Both use port 3334.</font><br>
<font color="#000000">>></font><br><font color="#000000">>> The server can start correctly on suse64, but on OpenSUSE-desktop, </font><br><font color="#000000">>> it's another story.</font><br><font color="#000000">
>> It looks ok when I run:</font><br><font color="#000000">>> {</font><br><font color="#000000">>> OpenSUSE-desktop:/usr/local/bin #/etc/init.d/pvfs2-server start</font><br><font color="#000000">>> Starting PVFS2 server: [S 01/22 15:44] PVFS2 Server on node
</font><br><font color="#000000">>> OpenSUSE-desktop version 2.7.0 starting...</font><br><font color="#000000">>> }</font><br><font color="#000000">>> But when I check the log, I get</font><br><font color="#000000">
>> {</font><br><font color="#000000">>> OpenSUSE-desktop:/usr/local/bin # cat /tmp/pvfs2-server.log</font><br><font color="#000000">>> [D 01/22 15:44] PVFS2 Server version 2.7.0 starting.</font><br><font color="#000000">
>> [E 01/22 15:44] Error: BMI_sockio_bind_sock: Address already in use</font><br><font color="#000000">>> [E 01/22 15:44] Error: tcp_server_init() failure.</font><br><font color="#000000">>> [E 01/22 15:44] Error: BMI_initialize: Address already in use
</font><br><font color="#000000">>> [E 01/22 15:44] Error: Could not initialize server interfaces; aborting.</font><br><font color="#000000">>> [E 01/22 15:44] Error: Could not initialize server; aborting.</font>
<br><font color="#000000">>> }</font><br><font color="#000000">>> I think port 9000 is available:</font><br><font color="#000000">>> {</font><br><font color="#000000">>> OpenSUSE-desktop:/usr/local/bin # netstat | grep 9000
</font><br><font color="#000000">>> OpenSUSE-desktop:/usr/local/bin # </font><br><font color="#000000">>> }</font><br><font color="#000000">>> When I set a new port to the server in the /etc/pvfs2-
fs.conf, say </font><br><font color="#000000">>> 9001, there is no problem to start the server. But, next time, I have </font><br><font color="#000000">>> to use another port. I guess pvfs2 doesn't work this way.
</font><br><font color="#000000">>></font><br><font color="#000000">>> When stopping a server and re-setup a new one, I do:</font><br><font color="#000000">>> {</font><br><font color="#000000">>> #/etc/init.d/pvfs2-server stop
</font><br><font color="#000000">>> #/usr/local/sbin/pvfs2-server /etc/pvfs2-fs.conf -r</font><br><font color="#000000">>> If above instruction can not delete the storage space, I do it manully</font><br><font color="#000000">
>> #rm -fr /pvfs2-storage-space.</font><br><font color="#000000">>> }</font><br><font color="#000000">>> The configure files are the same in both nodes</font><br><font color="#000000">>> {</font><br>
<font color="#000000">>> OpenSUSE-desktop:/usr/local/bin # cat /etc/pvfs2-fs.conf</font><br><font color="#000000">>> <Defaults></font><br><font color="#000000">>> UnexpectedRequests 50</font>
<br><font color="#000000">>> EventLogging none</font><br><font color="#000000">>> LogStamp datetime</font><br><font color="#000000">>> BMIModules bmi_tcp</font><br><font color="#000000">
>> FlowModules flowproto_multiqueue</font><br><font color="#000000">>> PerfUpdateInterval 1000</font><br><font color="#000000">>> ServerJobBMITimeoutSecs 30</font><br><font color="#000000">
>> ServerJobFlowTimeoutSecs 30</font><br><font color="#000000">>> ClientJobBMITimeoutSecs 300</font><br><font color="#000000">>> ClientJobFlowTimeoutSecs 300</font><br><font color="#000000">
>> ClientRetryLimit 5</font><br><font color="#000000">>> ClientRetryDelayMilliSecs 2000</font><br><font color="#000000">>></font><br><font color="#000000">>> StorageSpace /pvfs2-storage-space
</font><br><font color="#000000">>> LogFile /tmp/pvfs2-server.log</font><br><font color="#000000">>> </Defaults></font><br><font color="#000000">>></font><br><font color="#000000">>> <Aliases>
</font><br><font color="#000000">>> Alias OpenSUSE-desktop tcp://OpenSUSE-desktop:9000</font><br><font color="#000000">>> Alias suse64 tcp://suse64:9000</font><br><font color="#000000">>> </Aliases>
</font><br><font color="#000000">>></font><br><font color="#000000">>> <Filesystem></font><br><font color="#000000">>> Name pvfs2-fs</font><br><font color="#000000">>> ID 2061359039
</font><br><font color="#000000">>> RootHandle 1048576</font><br><font color="#000000">>> <MetaHandleRanges></font><br><font color="#000000">>> Range OpenSUSE-desktop 3-2305843009213693953
</font><br><font color="#000000">>> Range suse64 2305843009213693954-4611686018427387904</font><br><font color="#000000">>> </MetaHandleRanges></font><br><font color="#000000">>> <DataHandleRanges>
</font><br><font color="#000000">>> Range OpenSUSE-desktop </font><br><font color="#000000">>> 4611686018427387905-6917529027641081855</font><br><font color="#000000">>> Range suse64 6917529027641081856-9223372036854775806
</font><br><font color="#000000">>> </DataHandleRanges></font><br><font color="#000000">>> <StorageHints></font><br><font color="#000000">>> TroveSyncMeta yes</font>
<br><font color="#000000">>> TroveSyncData no</font><br><font color="#000000">>> </StorageHints></font><br><font color="#000000">>> </Filesystem></font><br><font color="#000000">
>> }</font><br><font color="#000000">>></font><br><font color="#000000">>></font><br><font color="#000000">>> Did I do something wrong? Thanks. </font><br><font color="#000000">> </font><br><font color="#000000">
> ------------------------------------------------------------------------</font><br><font color="#000000">> </font><br><font color="#000000">> _______________________________________________</font><br><font color="#000000">
> Pvfs2-users mailing list</font><br><font color="#000000">> <a href="mailto:Pvfs2-users@beowulf-underground.org">Pvfs2-users@beowulf-underground.org</a></font><br><font color="#000000">> <a href="http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users">
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users</a></font><br><br></pre>
</blockquote>