[Pvfs2-users] PVFS2 Installation

[Jeff Pummill]

Getting closer...

Here's the output when I try to start the server on the meta node 
(haven't tried the others yet...)

[root at pvfs2-meta-server-0-0 ~]# /opt/pvfs2/sbin/pvfs2-server 
/etc/pvfs2-fs.conf /etc/pvfs2-server.conf-pvfs2-meta-server-0-0 -f
[08:52:53.644282] PVFS2 Server version 1.1.0 starting.
//mnt/pvfs2/storage_attributes.db: Permission denied
[08:52:53.652558] error: trove initialize failed; aborting!

Easy fix?

Jeff F. Pummill



Lois Alston wrote:
>
> Forget the /mnt/pvfs2 that is created by default on Rocks, since you 
> did not use it during the gen-config.  Or you can re-run the 
> gen-config and name /mnt/pvfs2 as Directory space name.  If you leave 
> it as it is now, you need to follow the document I sent to get things 
> to work.
>
>  
>
> Lois E Alston, RHCE
>
> Consultant
>
> Collective Technologies
>
> CL :  678-644-2257
>
> ------------------------------------------------------------------------
>
> *From:* Jeff Pummill [mailto:jpummil at uark.edu]
> *Sent:* Thursday, April 13, 2006 4:11 PM
> *To:* Lois Alston
> *Cc:* pvfs2-users at beowulf-underground.org
> *Subject:* Re: [Pvfs2-users] PVFS2 Installation
>
>  
>
> Lois...here are my pvfs2-genconfig results...
>
> [root at prospero bin]# ./pvfs2-genconfig /etc/pvfs2-fs.conf 
> /etc/pvfs2-server-conf
> **********************************************************************
>         Welcome to the PVFS2 Configuration Generator:
>
> This interactive script will generate configuration files suitable
> for use with a new PVFS2 file system.  Please see the PVFS2 quickstart
> guide for details.
>
> **********************************************************************
>
> You must first select the network protocol that your file system will use.
> The only currently supported options are "tcp", "gm", and "ib".
> (For multi-homed configurations, use e.g. "ib,tcp".)
>
> * Enter protocol type [Default is tcp]:
>
> Choose a TCP/IP port for the servers to listen on.  Note that this
> script assumes that all servers will use the same port number.
>
> * Enter port number [Default is 3334]:
>
> Next you must list the hostnames of the machines that will act as
> I/O servers.  Acceptable syntax is "node1, node2, ..." or "node{#-#,#,#}".
>
> * Enter hostnames [Default is localhost]: comp-pvfs-0-24, 
> comp-pvfs-0-25, comp-pvfs-0-26, comp-pvfs-0-27, comp-pvfs-0-28, 
> comp-pvfs-0-29
>
> Now list the hostnames of the machines that will act as Metadata
> servers.  This list may or may not overlap with the I/O server list.
>
> * Enter hostnames [Default is localhost]: pvfs2-meta-server-0-0
>
> Configured a total of 7 servers:
> 6 of them are I/O servers.
> 1 of them are Metadata servers.
>
> * Would you like to verify server list (y/n) [Default is n]? y
>
> ****** I/O servers:
> tcp://comp-pvfs-0-24:3334
> tcp://comp-pvfs-0-25:3334
> tcp://comp-pvfs-0-26:3334
> tcp://comp-pvfs-0-27:3334
> tcp://comp-pvfs-0-28:3334
> tcp://comp-pvfs-0-29:3334
>
> ****** Metadata servers:
> tcp://pvfs2-meta-server-0-0:3334
>
> * Does this look ok (y/n) [Default is y]?
>
> Choose a file for each server to write log messages to.
>
> * Enter log file location [Default is /tmp/pvfs2-server.log]:
>
> Choose a directory for each server to store data in.
>
> * Enter directory name: [Default is /pvfs2-storage-space]:
>
> Writing fs config file... Done.
> Writing 7 server config file(s)... Done.
>
> Next, I need to copy the config files to all of the other nodes (meta, 
> I/O, and compute) and create the /pvfs2-storage-space directory on all 
> of the I/O and meta nodes?
>
> What about the /mnt/pvfs2 entry created by the Rocks roll?
>
> Sorry for being a bit dense on this procedure, but I've never 
> configured a parallel filesystem before and I'm trying to bounce back 
> and forth between the .doc you provided and the Quickstart guide. I do 
> plan on writing up and submitting my install routine to the user group 
> for a reference when I get this one up and working.
>
> Thanks for your help and I appreciate your patience
>
> Jeff F. Pummill
>
>
>
> Lois Alston wrote:
>
> All Rocks does is install the Roll, you still need to run 
> pvfs2-genconfig and edit as needed to make the I/O servers available 
> to the compute nodes.
>
>  
>
> Lois E Alston, RHCE
>
> Consultant
>
> Collective Technologies
>
> CL :  678-644-2257
>
> ------------------------------------------------------------------------
>
> *From:* pvfs2-users-bounces at beowulf-underground.org 
> <mailto:pvfs2-users-bounces at beowulf-underground.org> 
> [mailto:pvfs2-users-bounces at beowulf-underground.org] *On Behalf Of 
> *Jeff Pummill
> *Sent:* Thursday, April 13, 2006 11:28 AM
> *To:* pvfs2-users at beowulf-underground.org 
> <mailto:pvfs2-users at beowulf-underground.org>
> *Subject:* Re: [Pvfs2-users] PVFS2 Installation
>
>  
>
> Well, here's where I'm at so far...
>
> Rocks installed PVFS2 and created the mount point "/mnt/pvfs2" from 
> which I can run things like ./pvfs2-ping and ./pvfs2-statfs.
>
> Per typical Rocks fashion, I have a head node (prospero), and 24 
> compute nodes (c0-0 thru c0-23). I also have six I/O servers 
> (comp-pvfs-0-24 thru comp-pvfs-0-29) and one metadata server 
> (pvfs2-meta-server-0-0).
>
> A "mount" on any appliance shows the following line...
> automount(pid6815) on /mnt/pvfs2 type autofs 
> (rw,fd=5,pgrp=6815,minproto=2,maxproto=4)
>
> My pvfs2tab shows the following...
> tcp://pvfs2-meta-server-0-0.local:3334/pvfs2-fs     /mnt/pvfs2       
> pvfs2    default,noauto     0 0
>
> And while pvfs2-ping shows no errors, it doesn't appear to show any 
> data on my six I/O servers...
>
> # ./pvfs2-ping -m /mnt/pvfs2
>
> (1) Parsing tab file...
>
> (2) Initializing system interface...
>
> (3) Initializing each file system found in tab file: /etc/pvfs2tab...
>
>    /mnt/pvfs2: Ok
>
> (4) Searching for /mnt/pvfs2 in pvfstab...
>
>    PVFS2 servers: tcp://pvfs2-meta-server-0-0.local:3334
>    Storage name: pvfs2-fs
>    Local mount point: /mnt/pvfs2
>
>    meta servers:
>    tcp://pvfs2-meta-server-0-0:3334
>
>    data servers:
>    tcp://pvfs2-meta-server-0-0:3334
>
> (5) Verifying that all servers are responding...
>
>    meta servers:
>    tcp://pvfs2-meta-server-0-0:3334 Ok
>
>    data servers:
>    tcp://pvfs2-meta-server-0-0:3334 Ok
>
> (6) Verifying that fsid 1709549296 is acceptable to all servers...
>
>    Ok; all servers understand fs_id 1709549296
>
> (7) Verifying that root handle is owned by one server...
>
>    Root handle: 1048576
>    Ok; root handle is owned by exactly one server.
>
> =============================================================
>
> The PVFS filesystem at /mnt/pvfs2 appears to be correctly configured.
>
> Due to the Rocks install setting up alot of PVFS2 for me, I have not 
> yet run anything like pvfs2-genconf as I am not certain of what Rocks 
> has done for me and what I still need to do.
>
> Am I getting close?
>
>
> Jeff F. Pummill
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.beowulf-underground.org/pipermail/pvfs2-users/attachments/20060414/10700b1d/attachment.htm