[Pvfs2-developers] too large of a config file.

Sam Lang slang at mcs.anl.gov
Mon May 14 15:21:16 EDT 2007


Hi David,

There are a bunch of #defines that limit the sizes of requests.  The  
PVFS_REQ_LIMIT_CONFIG_FILE_BYTES (defaults to 16384) limits that  
fs.conf size.  Its defined in src/proto/pvfs2-req-proto.h.  If you  
increase that to something larger, you should be able to get past  
that assertion failure.

-sam

On May 14, 2007, at 12:29 PM, David Brown wrote:

> I performed a large scale test of pvfs last friday with some very
> interesting results... I have to pass it though our (PNNL) internal
> documentation sanitation system but I should be able to give you guys
> real data from the tests then, but here's what the problems were. ;)
>
> The main problems was the meta data server crashes with using 940 data
> servers, same error with 570 data servers. I ended up using 255 data
> server nodes and it started working fine.
>
> [root at node979 ~]# pvfs2-server -d
> /home/dmlb2000/pvfs-configs/pvfs2-fs.conf
> /home/dmlb2000/pvfs-configs/pvfs2-server.conf-$(hostname)
> [D 15:40:03.781222] PVFS2 Server version 2.6.3 starting.
> pvfs2-server: src/server/get-config.sm:76: getconfig_init: Assertion
> `user_opts->fs_config_buflen <= 16384' failed.
> Aborted
> [root at node979 ~]#
>
> I'm guessing this is because you load the entire config file when the
> first data server tries to connect and the config file was just too
> damn big. Is there a nice define somewhere that I can change to make
> it be able to load more?
>
> The config file ends up being quite large...
>
> [root at m979 ~]# ls -lh /home/dmlb2000/pvfs-configs/pvfs2-fs.conf
> -rw-------  1 root root 58K May 14 10:28
> /home/dmlb2000/pvfs-configs/pvfs2-fs.conf
> [root at m979 ~]#
>
> Thanks,
> - David Brown
> _______________________________________________
> Pvfs2-developers mailing list
> Pvfs2-developers at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
>



More information about the Pvfs2-developers mailing list