[Pvfs2-users] PVFS2 Installation

[Jeff Pummill]

Rob,

Getting really close!

After stopping the servers and restarting...

[root at prospero pvfs2]# /opt/pvfs2/bin/pvfs2-ping -m /mnt/pvfs2

(1) Parsing tab file...

(2) Initializing system interface...

(3) Initializing each file system found in tab file: /etc/pvfs2tab...

   /mnt/pvfs2: Ok

(4) Searching for /mnt/pvfs2 in pvfstab...

   PVFS2 servers: tcp://comp-pvfs-0-24.local:3334
   Storage name: pvfs2-fs
   Local mount point: /mnt/pvfs2

   meta servers:
   tcp://pvfs2-meta-server-0-0:3334

   data servers:
   tcp://comp-pvfs-0-24:3334
   tcp://comp-pvfs-0-25:3334
   tcp://comp-pvfs-0-26:3334
   tcp://comp-pvfs-0-27:3334
   tcp://comp-pvfs-0-28:3334
   tcp://comp-pvfs-0-29:3334

(5) Verifying that all servers are responding...

   meta servers:
   tcp://pvfs2-meta-server-0-0:3334 Ok

   data servers:
   tcp://comp-pvfs-0-24:3334 Ok
   tcp://comp-pvfs-0-25:3334 Ok
   tcp://comp-pvfs-0-26:3334 Ok
   tcp://comp-pvfs-0-27:3334 Ok
   tcp://comp-pvfs-0-28:3334 Ok
   tcp://comp-pvfs-0-29:3334 Ok

(6) Verifying that fsid 1594492348 is acceptable to all servers...

   Ok; all servers understand fs_id 1594492348

(7) Verifying that root handle is owned by one server...

   Root handle: 1048576
   Ok; root handle is owned by exactly one server.

=============================================================

The PVFS filesystem at /mnt/pvfs2 appears to be correctly configured.

Even pvfs2-cp works...

[root at prospero ~]# /opt/pvfs2/bin/pvfs2-cp /root/biobrew-4.1-0.i386.iso 
/mnt/pvfs2/biobrew-4.1-0.i386.iso
[root at prospero ~]# cd /mnt/pvfs2/sample
[root at prospero sample]# ls -l
total 169424
-rw-r--r--  1 root root 173328384 Apr 18 16:22 biobrew-4.1-0.i386.iso
-rw-r--r--  1 root root    155537 Apr 18 16:16 
libgfortran-4.0.2-8.fc4.i386.rpm
drwxrwxrwx  1 root root      4096 Apr 18 15:39 lost+found


However, I did not see a "copy time" as I expected...

I need to mod the remaining pvfs2tab files to point amongst the various 
servers, but what else can I run to see that the filesystem is indeed 
working as expected?

I sure appreciate your patience and diligence in this exercise, Rob. It 
has been a positive learning experience on this end!


Jeff F. Pummill



Robert Latham wrote:
> On Tue, Apr 18, 2006 at 10:44:40AM -0500, Jeff Pummill wrote:
>   
>> Rob,
>>
>> It's kinda weird how the -r is behaving...
>>
>> [root at pvfs2-meta-server-0-0 sbin]# ./pvfs2-server /etc/pvfs2-fs.conf 
>> /etc/pvfs2-server.conf-pvfs2-meta-server-0-0 -r
>> [15:39:45.817880] PVFS2 Server version 1.1.0 starting.
>>
>> [root at pvfs2-meta-server-0-0 sbin]# ./pvfs2-server /etc/pvfs2-fs.conf 
>> /etc/pvfs2-server.conf-pvfs2-meta-server-0-0 -f
>> [15:39:50.890118] PVFS2 Server version 1.1.0 starting.
>>
>> [root at pvfs2-meta-server-0-0 sbin]# ./pvfs2-server /etc/pvfs2-fs.conf 
>> /etc/pvfs2-server.conf-pvfs2-meta-server-0-0
>> [15:40:00.040960] PVFS2 Server version 1.1.0 starting.
>> [15:40:00.044211] Error: BMI_sockio_bind_sock: Address already in use
>> [15:40:00.044667] Error: tcp_server_init() failure.
>> [15:40:00.044900] Error: BMI_initialize: Address already in use
>> [15:40:00.045076] Error: Could not initialize server interfaces; aborting.
>> [15:40:00.045219] Error: Could not initialize server; aborting.
>>
>> The first time thru, I just ran the -r option because it always told me 
>> that the server was starting. I just assumed that it did the other two 
>> steps because of it's behavior when I would execute it...
>>     
>
> You're absolutely right: based on that message you'd think the server
> was still running.  Sorry for the confusion there.
>
>   
>> Thoughts?
>>     
>
> Now that you've re-created the storage spaces, kill the pvfs2-server
> that's running and start it again on all the nodes.  
>
>   
>> Regarding the pvfs2tab files, as I have 24 compute nodes...I will divide 
>> them up and assign 4 compute nodes per I/O server using the appropriate 
>> hostname in each pvfs2tab file.
>>     
>
> Sounds good!  
>
> ==rob
>
>   
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.beowulf-underground.org/pipermail/pvfs2-users/attachments/20060418/04acf585/attachment-0001.htm