[Pvfs2-users] Problem mounting iso files saved on PVFS2

Sam Lang slang at mcs.anl.gov
Tue Feb 20 10:31:19 EST 2007


On Feb 20, 2007, at 4:08 AM, Mark Van De Vyver wrote:

> Ok, on a std Rocks Cluster install (CentOS 4.4) the instructions given
> by Murali (below) ran without any errors or warnings (that I could
> see).  I think the only change is:
> --prefix=/opt/pvfs2.
>
> While I'm feeling more comfortable with the idea of upgrading to
> v2.6.2 I have some questions/confirmations before I dive in tomorrow
> (it's getting late here):
> 1) Can I just `cp` the relevant /opt/pvfs directories from the
> frontend to the nodes, or is it better to build/make install on the
> nodes?

You can copy them.  The only problem you might run into is different  
install locations for berkeley DB on the different nodes, but if you  
installed the same distro on all of them you should be fine.  Also,  
if the path to libdb.so can't be found, you can point LD_LIBRARY_PATH  
at the correct path.

> 2) Can I use the server and client configuration files from the v1.5.1
> installation?  I'm assuming those configuration files are 'good', and
> v2.6.2 has not altered them....

Yes.

> In this scenario I'm thinking of just replacing the compiled/binary
> files and leaving all else unchanged
> 3) If I do have to run pvfs2-genconfig, etc will my current data in
> /mnt/pvfs2 be erased?

No, but /mnt/pvfs2 is the just the mountpoint, so there's no actual  
data residing there.  The real data (and metadata) is in the storage  
location(s) on each of the servers.  Again though, they won't get  
erased if you decide to re-run genconfig.

-sam
>
> Thanks in advance
> Regards
> Mark
>
> PS
> Reminder: In case I forget or someone else comes along this path....
> Reinstalling the Rock Cluster, or executing 'shoot-node' will undo all
> this and you'll be back to v1.5.1.  There is also the separate issue
> of formatting and the status of /state/partition1...
>
> On 2/20/07, Murali Vilayannur <murali.vilayannur at gmail.com> wrote:
>> Hi Mark,
>> No problem. In fact I am a newbie to the Rocks Roll setup, so someone
>> needs to correct me if the installation steps outlined below do not
>> work on your setup.
>>
>> Hmm.. Unfortunately, it is a build time option and not a run time  
>> option.
>> Download the pvfs2 source tarball. Any release tarball should do  
>> fine.
>> ftp://ftp.parl.clemson.edu/pub/pvfs2/pvfs-2.6.2.tar.gz
>> Then type
>> ./configure --with-kernel=</path/to/kernel26/>
>> --enable-kernel-sendfile --prefix=/usr/local/pvfs2/
>> then type
>> make && make kmod && make install
>>
>> Assuming you have the kernel sources/headers correctly installed  
>> and a
>> working gcc compiler, this build should work ok. After that, you can
>> follow the same steps outlined in the pvfs2 quick start guide to  
>> setup
>> your system (servers, kernel module, client-core and finally mount!)
>>
>> Sigh.. I really wish there was an easy way out. Sorry about that.
>> If someone knows how to roll out a Rocks-Roll images, I am sure they
>> will chime in.. I have no clue how to do it.
>> thanks
>> Murali
>>
>>
>>
>> On 2/20/07, Mark Van De Vyver <mvyver at gmail.com> wrote:
>> > Hi Murali,
>> > Thank you for responding.  Please bear with me for a moment -  I'm
>> > very green when it comes to linux, let alone pvfs2... having  
>> left the
>> > win xp world 3 months ago :)
>> >
>> > I used a Rocks Roll to setup PVFS2, so much of the configuration  
>> was
>> > done behind the scenes.  Is this option to be set in a config  
>> file?  I
>> > searched http://www.pvfs.org/pvfs2-options.html
>> > but found no mention.
>> >
>> > Thanks in advance
>> > Regards
>> > Mark
>> >
>> >
>> > On 2/20/07, Murali Vilayannur <murali.vilayannur at gmail.com> wrote:
>> > > Hi Mark,
>> > > Can you configure pvfs2 with an extra option
>> > > --enable-kernel-sendfile
>> > > in addition to your usual options? That should fix this issue.
>> > > Loopback requires the underlying FS to support sendfile..
>> > > By default, configure disables this option since noone seems  
>> to want
>> > > this feature (The only other use-case was with Apache which  
>> can be
>> > > configured to not use sendfile).
>> > > thanks!
>> > > Murali
>> > >
>> > > On 2/19/07, Mark Van De Vyver <mvyver at gmail.com> wrote:
>> > > > Hi,
>> > > > I am unable to mount an iso file that is saved on PVFS2  
>> (v1.5.1).
>> > > > If I copy the iso file from the PVFS2 area to a ext3  
>> formated area I
>> > > > can mount the iso file.
>> > > >
>> > > > The mount command used is:
>> > > >
>> > > > mount -t iso9660 -o ro,loop /pvfs2/file.iso /some/dir
>> > > > or
>> > > > mount -t iso9660 -o ro,loop=/dev/loop0 /pvfs2/file.iso /some/ 
>> dir
>> > > >
>> > > > The error message I see is:
>> > > >
>> > > > ioctl: LOOP_SET_FD: Device or resource busy.
>> > > > mount: failed setting up loop device
>> > > >
>> > > > The /tmp/pvfs2-client.log file is empty.
>> > > >
>> > > > Should it be possible to mount an iso file that is saved to  
>> pvfs2?
>> > > > Is there some incorrect setting I have?
>> > > > My PVFS2 setup is the default Rocks Cluster Roll settings. One
>> > > > metaserver and two Compute-I/O nodes.
>> > > >
>> > > > Appreciate any suggestions.
>> > > > Regards
>> > > > Mark
>> > > > _______________________________________________
>> > > > Pvfs2-users mailing list
>> > > > Pvfs2-users at beowulf-underground.org
>> > > > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>> > > >
>> > >
>> >
>>
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>



More information about the Pvfs2-users mailing list