[Pvfs2-users] Problems with basic distribution (with xattrs)
Tony Kew
tonykew at ccr.buffalo.edu
Mon Jun 30 17:23:23 EDT 2008
Dear Phil,
Its looking good now on a single node test - I will expand to a 16 node
test next...
The twod_stripe distribution is still seeing the errors about 2 groups I
sent in my
last email, but the file is created anyhow.
In that regard, does someone have a good explanation of the 2D stripe & how
it works, i.e. what the "num_groups" and "group_strip_factor" do to
change the
stripe behavior? The only comment I could find was that the distribution is
designed to combat incast, but I can't find a reference to what "incast" is
either!
Many, Many thanks,
Tony
Tony Kew
SAN Administrator
The Center for Computational Research
New York State Center of Excellence
in Bioinformatics & Life Sciences
701 Ellicott Street, Buffalo, NY 14203
CoE Office: (716) 881-8930 Fax: (716) 849-6656
CSE Office: (716) 645-3797 x2174
Cell: (716) 560-0910 Home: (716) 874-2126
"I love deadlines, I love the whooshing noise they make as they go by."
Douglas Adams
Phil Carns wrote:
> The attached patch depends on the previous one, but this one
> specifically fixes the varstrip directory hints issue. This has been
> applied in cvs trunk as well.
>
> I didn't take Murali's patch verbatim, but the idea is basically the
> same. The varstrip params have to be parsed as a special case in the
> code that handles directory hints because it uses a different
> parameter format than the other distributions.
>
> -Phil
>
>>
>> I'll look into the varstrip issue soon.
>>
>> -Phil
>>
>> Tony Kew wrote:
>>> Dear PVFS users list,
>>>
>>> Mounting a pvfs 7.2.1, creating directories and setting the
>>> distribution
>>> type with setfattr for each directory, only simple_stipe and
>>> twod_stripe
>>> would allow me to write a file in the given directory.
>>>
>>> Adding the varstrip_dist xattrs patch from Murali Vilayannur
>>> attached to
>>> this message thread:
>>>
>>> http://osdir.com/ml/file-systems.pvfs2.users/2007-01/msg00050.html
>>>
>>> fixes the variable strip distibution, but the basic distribution still
>>> doesn't work for me.
>>>
>>> The patch adds
>>>
>>> #include "pvfs2-dist-basic.h
>>>
>>> to src/client/sysint/sys-create.sm so I wonder if no one has tried
>>> this...???
>>> Perhaps there is a little more code needed to make basic_dist work with
>>> xargs?
>>>
>>> The patch above is against 2.6, but works (and is needed for
>>> varstrip_dist
>>> with xargs) with 7.2.1 & the latest cvs (best I can tell) - perhaps
>>> this patch
>>> could be added to both?
>>>
>>> Let me know if there is useful debug info I can provide...
>>>
>>>
>>> Thanks Much
>>> Tony
>>>
>>> Tony Kew
>>> SAN Administrator
>>> The Center for Computational Research
>>> New York State Center of Excellence
>>> in Bioinformatics & Life Sciences
>>> 701 Ellicott Street, Buffalo, NY 14203
>>>
>>> CoE Office: (716) 881-8930 Fax: (716) 849-6656
>>> CSE Office: (716) 645-3797 x2174
>>> Cell: (716) 560-0910 Home: (716) 874-2126
>>>
>>> "I love deadlines, I love the whooshing noise they make as they go by."
>>> Douglas Adams
>>>
>>> _______________________________________________
>>> Pvfs2-users mailing list
>>> Pvfs2-users at beowulf-underground.org
>>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> Pvfs2-users at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>
More information about the Pvfs2-users
mailing list