[Pvfs2-developers] increasing PVFS_REQ_LIMIT_CONFIG_FILE_BYTES

Tony Kew tonykew at ccr.buffalo.edu
Wed Jan 28 14:25:18 EST 2009


Dear All,

I'm running PVFS version 2.7.1 (with a bunch of patches) and am creating 
PVFS
filesystems on the fly for PBS jobs.
I can sun a 64 node job, creating a 64 node filesystem AOK, but things
break at 128 nodes.  I believe my problems are associated with rsh and PBS,
but to verify that there isn't a problem with pvfs2-genconfig I tried 
generating
config files for large numbers of nodes.
For the all the nodes in our cluster (just over 1000) pvfs2-genconfig will
create a config file, but for anywhere over about 500 nodes it outputs
the warning:

Warning: Generated config file: 
/scratch/1188301.bono.ccr.buffalo.edu/pvfs2-fs.conf.tmp
has size: 73271, which is larger than the current PVFS request: 65536
Increase the value of PVFS_REQ_LIMIT_CONFIG_FILE_BYTES in 
src/proto/pvfs2-req-proto.h
-rw-r--r--  1 tonykew ccrstaff 73271 Jan 28 14:19 
/scratch/1188301.bono.ccr.buffalo.edu/pvfs2-fs.conf.tmp
c14n32$

A config file for the whole cluster is 149693 characters in size.

Am I likely to run into problems if I, change 
PVFS_REQ_LIMIT_CONFIG_FILE_BYTES
to 262144 (for example)?

Many Thanks,
Tony

Tony Kew
SAN Administrator
The Center for Computational Research
New York State Center of Excellence
 in Bioinformatics & Life Sciences
701 Ellicott Street, Buffalo, NY 14203

CoE Office: (716) 881-8930           Fax: (716) 849-6656
CSE Office: (716) 645-3797 x2174
      Cell: (716) 560-0910          Home: (716) 874-2126

"I love deadlines, I love the whooshing noise they make as they go by."
                                                          Douglas Adams



More information about the Pvfs2-developers mailing list