[Pvfs2-users] PVFS2 directory attributes

Phil Carns carns at mcs.anl.gov
Mon Sep 15 17:18:58 EDT 2008


Xuechen and I continued this discussion off list and found that varstrip 
is not the right tool for the job.  It does not control which servers 
are used and also does not let you start at an arbitrary strip as I 
suggested in the B example.

Right now we don't really have hooks in PVFS to control the layout this 
specifically at a directory level.

-Phil

Phil Carns wrote:
> Hi Xuechen,
> 
> I believe that this is possible with the varstrip distribution in PVFS. 
>  Here is some further information:
> 
> http://www.pvfs.org/fisheye/browse/PVFS/doc/pvfs2-tuning.tex?r=1.1.22.1#l328 
> 
> 
> For example, I think on directory A you would set something like:
> 
>   setfattr -n user.pvfs2.dist_name -v varstrip_dist A
>   setfattr -n user.pvfs2.dist_params -v "strips:0:64K;1:64K" A
> 
> And this for B:
> 
>   setfattr -n user.pvfs2.dist_name -v varstrip_dist B
>   setfattr -n user.pvfs2.dist_params -v "strips:2:64K;3:64K" B
> 
> That should automatically set the number of datafiles to 2 based on the 
> distribution parameters, but it is possible that some previous releases 
> didn't do that.  If you have trouble use these commands to make it 
> explicit:
> 
>   setfattr -n user.pvfs2.num_dfiles -v "2" A
>   setfattr -n user.pvfs2.num_dfiles -v "2" B
> 
> A few other misc. pointers:
> 
> - this only affects new files in any given directory and does not change 
> existing files
> 
> - make sure to test the results by using "pvfs2-viewdist -f <filename>" 
> to see how new files are distributed
> 
> -Phil
> 
> Xuechen Zhang wrote:
>> There is a question about setting PVFS2 directory attributes. I have 
>> four I/O servers (0-3). I want to locate file A in directory A on 
>> server 0&1 and file B in directory B on server 2&3 by settting stripe 
>> distribution for the two directory. Can I implement this kind of 
>> distribution in PVFS2? If not, any suggestion for that? Thanks.
>>
>> Xuechen
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> Pvfs2-users at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
> 
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users



More information about the Pvfs2-users mailing list