[Pvfs2-users] multiple filesystems

[Chris Poultney]

Becky & Kyle-

The FS IDs are different for the two filesystems, as are the Names. An 
ls of the storage directory shows one directory for each fs:

root at wongburger:/etc# ls /pvfs2-storage-multi/
0f7d1736  0f7d1737  collections.db  storage_attributes.db

 From all the reading I've done and your replies to this thread, it 
looks like I need to start one server for each filesytem I want to 
share, each with its own config file and storage space. Is that right?

Thanks,
-crispy


On 10/20/2010 03:39 PM, Kyle Schochenmaier wrote:
> Hi Chris -
>
> I loosely recall there being some sort of FS ID flag that needs to be set
> uniquely for each filesystem in the config files, we used to have 3 or 4
> server processes running at the same time on different filesystems.
>
>
> Kyle Schochenmaier
>
>
> On Wed, Oct 20, 2010 at 2:35 PM, Becky Ligon<ligon at clemson.edu>  wrote:
>
>> I've never tried to do this before, but to start, I would try defining
>> separate storage spaces for each filesystem.   Curious, when you run the
>> server with the -f option, exactly which directories are created?  Can you
>> send me the output from an "ls"?
>>
>> Another tip is to make each server both meta and IO.  You want to spread
>> out the metadata just like you do for the streamed data.  Having one
>> server handle the metadata will become a bottleneck in a high performance
>> environment.
>>
>> Becky
>> --
>> Becky Ligon
>> PVFS Developer
>> Clemson University
>> 864-650-4065
>>
>>> I'd like to set up two shares to be managed by the same PVFS server.
>>> I've read in the docs that I can have multiple filesystem entries in
>>> pvfs2-fs.conf, but I haven't been able to successfully do this. Does
>>> someone have an example config file with multiple filesystem entries
>>> that they can share?
>>>
>>> More details:
>>>
>>> I've successfully set up a single share based on the quick start guide.
>>> It's a four-node network: one metadata server, four i/o nodes. Nodes are
>>> identical, each 6x dual-core xeon, LAN connection, running ubuntu lucid.
>>> To generate the two-filesystem config file, I ran pvfs2-genconfig twice,
>>> then pasted the filesystem section from the second file into the first,
>>> making sure the Name and ID fields were unique. This was based on 3.9 in
>>> the PVFS2 FAQ, "Can I mount more than one PVFS file system on the same
>>> client?"
>>>
>>> Using the two-filesystem config file, pvfs2-server -f works, but then
>>> pvfs2-server (with or without -d) ends immediately with a segfault.
>>> Nothing is written to the console or logfiles. I tried a different
>>> version of pvfs2-fs.conf with non-overlapping MetaHandleRange and
>>> DataHandleRange values for the two filesystems, but as I'm not exactly
>>> clear on what these do I'm not sure if that's the right approach. I've
>>> attached the conf file for a single-server test of two filesystems, with
>>> separate Range value.
>>>
>>> Thanks,
>>> -crispy
>>> _______________________________________________
>>> Pvfs2-users mailing list
>>> Pvfs2-users at beowulf-underground.org
>>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>>>
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> Pvfs2-users at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>>
>