[Pvfs2-developers] too large of a config file.
David Brown
dmlb2000 at gmail.com
Mon May 14 13:29:47 EDT 2007
I performed a large scale test of pvfs last friday with some very
interesting results... I have to pass it though our (PNNL) internal
documentation sanitation system but I should be able to give you guys
real data from the tests then, but here's what the problems were. ;)
The main problems was the meta data server crashes with using 940 data
servers, same error with 570 data servers. I ended up using 255 data
server nodes and it started working fine.
[root at node979 ~]# pvfs2-server -d
/home/dmlb2000/pvfs-configs/pvfs2-fs.conf
/home/dmlb2000/pvfs-configs/pvfs2-server.conf-$(hostname)
[D 15:40:03.781222] PVFS2 Server version 2.6.3 starting.
pvfs2-server: src/server/get-config.sm:76: getconfig_init: Assertion
`user_opts->fs_config_buflen <= 16384' failed.
Aborted
[root at node979 ~]#
I'm guessing this is because you load the entire config file when the
first data server tries to connect and the config file was just too
damn big. Is there a nice define somewhere that I can change to make
it be able to load more?
The config file ends up being quite large...
[root at m979 ~]# ls -lh /home/dmlb2000/pvfs-configs/pvfs2-fs.conf
-rw------- 1 root root 58K May 14 10:28
/home/dmlb2000/pvfs-configs/pvfs2-fs.conf
[root at m979 ~]#
Thanks,
- David Brown
More information about the Pvfs2-developers
mailing list