[Pvfs2-users] PVFS2 directory attributes
Tony Kew
tonykew at ccr.buffalo.edu
Wed Sep 10 16:36:09 EDT 2008
Dear Xuechen,
Just to add to Phil's info, there is (at least one) patch that you will
have to
apply to pvfs 7.2.1 that fixes xattrs for the varstrip_dist distribution.
It is attached to the following message thread:
http://osdir.com/ml/file-systems.pvfs2.users/2007-01/msg00050.html
You may find a page I wrote for internal testers at CCR helpful:
http://www.ccr.buffalo.edu/display/WEB/PVFS+version+2+scratch+filesystem+on+U2
There are examples there for varstrip_dist there for a 16 node PVFS
filesystem.
Tony
Tony Kew
SAN Administrator
The Center for Computational Research
New York State Center of Excellence
in Bioinformatics & Life Sciences
701 Ellicott Street, Buffalo, NY 14203
CoE Office: (716) 881-8930 Fax: (716) 849-6656
CSE Office: (716) 645-3797 x2174
Cell: (716) 560-0910 Home: (716) 874-2126
"I love deadlines, I love the whooshing noise they make as they go by."
Douglas Adams
Phil Carns wrote:
> Hi Xuechen,
>
> I believe that this is possible with the varstrip distribution in
> PVFS. Here is some further information:
>
> http://www.pvfs.org/fisheye/browse/PVFS/doc/pvfs2-tuning.tex?r=1.1.22.1#l328
>
>
> For example, I think on directory A you would set something like:
>
> setfattr -n user.pvfs2.dist_name -v varstrip_dist A
> setfattr -n user.pvfs2.dist_params -v "strips:0:64K;1:64K" A
>
> And this for B:
>
> setfattr -n user.pvfs2.dist_name -v varstrip_dist B
> setfattr -n user.pvfs2.dist_params -v "strips:2:64K;3:64K" B
>
> That should automatically set the number of datafiles to 2 based on
> the distribution parameters, but it is possible that some previous
> releases didn't do that. If you have trouble use these commands to
> make it explicit:
>
> setfattr -n user.pvfs2.num_dfiles -v "2" A
> setfattr -n user.pvfs2.num_dfiles -v "2" B
>
> A few other misc. pointers:
>
> - this only affects new files in any given directory and does not
> change existing files
>
> - make sure to test the results by using "pvfs2-viewdist -f
> <filename>" to see how new files are distributed
>
> -Phil
>
> Xuechen Zhang wrote:
>> There is a question about setting PVFS2 directory attributes. I have
>> four I/O servers (0-3). I want to locate file A in directory A on
>> server 0&1 and file B in directory B on server 2&3 by settting stripe
>> distribution for the two directory. Can I implement this kind of
>> distribution in PVFS2? If not, any suggestion for that? Thanks.
>>
>> Xuechen
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> Pvfs2-users at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
More information about the Pvfs2-users
mailing list