[Pvfs2-developers] Sys create setting the datafile nodes depending
on interface call.
Walter B. Ligon III
walt at clemson.edu
Wed Aug 16 11:37:52 EDT 2006
I agree. I'm not completely clear what is being proposed, but it sounds
to me like its more of a hint than a fixed parameter. In any event, I
think we should consider a well-designed PVFS hints mechanism that
allows greater flexibility to be added for experimentation and even
permanent use.
Walt
Rob Ross wrote:
> We should think about whether we really want these new parameters to be
> optional (and thus *hints*) or mandatory (and thus new parameters), but
> I do like the idea of providing a clean way to get extensions into the
> calls for research purposes like this.
>
> Rob
>
> Murali Vilayannur wrote:
>
>> Hi Julian,
>>
>>> Yes they are, but if we extend the system interface then we could
>>> easily add
>>> another parameter if necessary and pending changes to the system
>>> interfaces
>>> can be done in one modification. Thats why I was asking.
>>
>>
>> Ok, if you say so :).
>> I suppose if everybody agrees to this interface change do
>> send a patch ;)!
>>
>>>> Can you tell us what exactly was the problem with the new distribution?
>>>
>>> I was thinking that all distributions could benefit from such a
>>> mechanism.
>>> Maybe the metatdata server for that file could be selected on the
>>> same way,
>>> too ?
>>> Within the distribution itself the server names are not available I
>>> guess, so
>>> there has to be some hack code outside. Also, I think due to dynamic
>>> migration etc. it is no good idea to write a distribution which
>>> fixated the
>>> datafiles.
>>
>>
>>> This might be possible and is a another cool way, however we want the
>>> user to
>>> set it for example with MPI_hints before the file is opened and only
>>> to set
>>> it for a single file. For example somehow to use dedicated servers
>>> for this
>>> file of a single file system, this might be used to place the
>>> datafiles on
>>> the same nodes if the client also acts as a server or to place the
>>> datafiles "close" to the client on a dataserver. It seems to be rather
>>> inefficent to change the extended attributes of a directory then
>>> create the
>>> file and change it back.
>>
>>
>> I am not sure how many people are going to use or require this
>> feature. I really wish we could come up with something cleaner though.
>>
>> Perhaps, we can create a new structure like PVFS_hints (that groups all
>> these extra parameters as they come by) and pass an optional
>> pointer to that at the time of sys_create, sys_mkdir and sys_symlink()?
>> thanks,
>> Murali
>> _______________________________________________
>> Pvfs2-developers mailing list
>> Pvfs2-developers at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
>>
> _______________________________________________
> Pvfs2-developers mailing list
> Pvfs2-developers at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
--
Dr. Walter B. Ligon III
Associate Professor
ECE Department
Clemson University
More information about the Pvfs2-developers
mailing list