[Pvfs2-developers] patches: pvfs2-ping, pvfs2-genconfig, test programs

Sam Lang slang at mcs.anl.gov
Wed May 31 22:47:39 EDT 2006


I went ahead and committed the --metaspec and --iospec options to  
pvfs2-genconfig.  The changes aren't based on your patch Bart, but I  
did a lot of cleanup and ended up changing the code fairly  
significantly.  The options themselves allow the endpoints to be  
specified as follows:

[<proto>://]<host>:<port>[:<storage>][:<logfile>]

You can specify multiple endpoints separated by semicolons.  Also,  
you can specify port ranges, i.e. for <port> you might have  
{1-4,8-12,16-20}.  If the protocol isn't specified, tcp is used.  If  
the storage or logfile aren't specified, filename (or path) is  
requested interactively, and modified for each endpoint by adding a  
unique suffix: -<host>_<proto><port>.  For example, /psto- 
hosta_tcp3334 and /plog-hosta_tcp3334.

Also, if you want to be able to specify multiple protocols for the  
same endpoint, you can do that by combining them between square  
brackets:

[endpoint1,endpoint2,endpoint3,...]

So you can have "[tcp://hosta:3334,gm://hosta:6]:/psto:/tmp/plog"

I think these changes will allow reasonable backward compatibility  
for the --ioports and --metaports options we have now, as well as  
covering pretty much all the use cases you guys have.  Let me know if  
you have any problems/concerns.

-sam

On May 18, 2006, at 11:26 AM, Phil Carns wrote:

> Robert Latham wrote:
>> On Thu, Apr 06, 2006 at 02:40:01PM -0600, Bart Taylor wrote:
>>> As an example, suppose that you are using a SAN and you want one  
>>> particular
>>> server to have a dedicated LUN for metadata.  In that case you  
>>> might want to
>>> specify something like this:
>>> --iospecs host1:3335:/mnt/data-lun,host2:3335:/mnt/data-lun
>>> --metaspces host1:3334:/mnt/meta-lun
>> It sounds like what you want, more than iospecs and metaspecs, is a
>> way to specify separate storage spaces for metadata and data.  ==rob
>
> I just ran across this email when looking for a reference to the  
> pvfs2-ping patch, but I thought I would add my 2c.
>
> I think for the range of cases that Bart was addressing it isn't  
> necessarily as simple as choosing different storage for meta vs. I/ 
> O (although that would work for this example).  Having more  
> flexibility in terms of the exact server specification can be  
> helpful for unusual server environments, like:
>
> - multiple servers per node on some machines (to access multiple  
> LUNs on systems with LUN size limitations)
> - tuning subsets of servers for specific purposes (maybe some have  
> different RAM or other hardware footprints)
> - temporarily doubling up servers on just one of the machines, so  
> that you can take a different one off line for maintenance (mainly  
> useful if you have network attached storage that other servers  
> could reach)
>
> We haven't necessarily seen all of these configurations, but it  
> would be nice to be able to handle all of those cases with the same  
> command line interface.
>
> There may be a cleaner way to represent all of this in general, but  
> this patch was also trying not to break existing arguments to  
> genconfig.
>
> -Phil
> _______________________________________________
> Pvfs2-developers mailing list
> Pvfs2-developers at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
>



More information about the Pvfs2-developers mailing list