[Pvfs2-users] Problems with basic distribution (with xattrs)

Tony Kew tonykew at ccr.buffalo.edu
Mon Jun 30 17:23:23 EDT 2008


Dear Phil,

Its looking good now on a single node test - I will expand to a 16 node 
test next...
The twod_stripe distribution is still seeing the errors about 2 groups I 
sent in my
last email, but the file is created anyhow.

In that regard, does someone have a good explanation of the 2D stripe & how
it works, i.e. what the "num_groups"  and "group_strip_factor" do to 
change the
stripe behavior?  The only comment I could find was that the distribution is
designed to combat incast, but I can't find a reference to what "incast" is
either!

Many, Many thanks,
Tony

Tony Kew
SAN Administrator
The Center for Computational Research
New York State Center of Excellence
 in Bioinformatics & Life Sciences
701 Ellicott Street, Buffalo, NY 14203

CoE Office: (716) 881-8930           Fax: (716) 849-6656
CSE Office: (716) 645-3797 x2174
      Cell: (716) 560-0910          Home: (716) 874-2126

"I love deadlines, I love the whooshing noise they make as they go by."
                                                          Douglas Adams



Phil Carns wrote:
> The attached patch depends on the previous one, but this one 
> specifically fixes the varstrip directory hints issue.  This has been 
> applied in cvs trunk as well.
>
> I didn't take Murali's patch verbatim, but the idea is basically the 
> same.  The varstrip params have to be parsed as a special case in the 
> code that handles directory hints because it uses a different 
> parameter format than the other distributions.
>
> -Phil
>
>>
>> I'll look into the varstrip issue soon.
>>
>> -Phil
>>
>> Tony Kew wrote:
>>> Dear PVFS users list,
>>>
>>> Mounting a pvfs 7.2.1, creating directories and setting the 
>>> distribution
>>> type with setfattr for each directory, only simple_stipe and 
>>> twod_stripe
>>> would allow me to write a file in the given directory.
>>>
>>> Adding the varstrip_dist xattrs patch from Murali Vilayannur 
>>> attached to
>>> this message thread:
>>>
>>>    http://osdir.com/ml/file-systems.pvfs2.users/2007-01/msg00050.html
>>>
>>> fixes the variable strip distibution, but the basic distribution still
>>> doesn't work for me.
>>>
>>> The patch adds
>>>
>>>    #include "pvfs2-dist-basic.h
>>>
>>> to src/client/sysint/sys-create.sm so I wonder if no one has tried 
>>> this...???
>>> Perhaps there is a little more code needed to make basic_dist work with
>>> xargs?
>>>
>>> The patch above is against 2.6, but works (and is needed for 
>>> varstrip_dist
>>> with xargs) with 7.2.1  & the latest cvs (best I can tell) - perhaps 
>>> this patch
>>> could be added to both?
>>>
>>> Let me know if there is useful debug info I can provide...
>>>
>>>
>>> Thanks Much
>>> Tony
>>>
>>> Tony Kew
>>> SAN Administrator
>>> The Center for Computational Research
>>> New York State Center of Excellence
>>> in Bioinformatics & Life Sciences
>>> 701 Ellicott Street, Buffalo, NY 14203
>>>
>>> CoE Office: (716) 881-8930           Fax: (716) 849-6656
>>> CSE Office: (716) 645-3797 x2174
>>>      Cell: (716) 560-0910          Home: (716) 874-2126
>>>
>>> "I love deadlines, I love the whooshing noise they make as they go by."
>>>                                                          Douglas Adams
>>>
>>> _______________________________________________
>>> Pvfs2-users mailing list
>>> Pvfs2-users at beowulf-underground.org
>>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> Pvfs2-users at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>


More information about the Pvfs2-users mailing list