[Pvfs2-users] "Remote Endpoint is Closed" error starting pvfs2-server

[Scott Atchley]

Josh,

It seems that the bmi_mx layer is working. I will let the PVFS2 folks handle it from here. I will keep following in case there is an unexpected behavior involving bmi_mx.

Scott


On Aug 25, 2010, at 2:30 PM, Joshua Randall wrote:

>>> There is a BMI pingpong test in $PVFS2_SRC/test/io/bmi/. Can you build and run it between two machines to make sure that bmi_mx can connect and pass data?
> 
> I compiled and ran the pingpong test, and it seems to work ok:
> 
>> renton$ sudo ./test/io/bmi/pingpong -h mx://renton:0:3 -s
>> Starting expected test
> 
> 
>> begbie$ sudo /tmp/pingpong -h mx://renton:0:3 -c
>>     Bytes        usecs         MB/s       StdDev          Min          Max
>>         1       13.121        0.079 +-     0.013        0.016        0.110
>>         2       13.138        0.159 +-     0.027        0.006        0.224
>>         4       12.230        0.336 +-     0.044        0.019        0.447
>>         8       12.848        0.641 +-     0.092        0.023        0.895
>>        16       12.160        1.342 +-     0.167        0.127        1.790
>>        32       13.367        2.477 +-     0.390        0.133        3.579
>>        64       12.836        5.082 +-     0.575        0.357        6.711
>>       128       13.753        9.529 +-     1.163        0.546       12.202
>>       256       19.303       13.571 +-     1.765        1.268       18.355
>>       512       25.314       20.553 +-     2.263        2.353       31.123
>>      1024       33.631       30.846 +-     3.005        4.170       56.887
>>      2048       56.869       36.631 +-     3.136        0.474       90.899
>>      4096       63.095       65.351 +-     3.840       15.401      126.323
>>      8192       90.809      107.935 +-    35.798       19.861      145.284
>>     16384      135.989      136.231 +-    49.138        0.815      282.216
>>     32768      164.927      203.865 +-    33.878       68.771      402.457
>>     65536      235.281      284.368 +-    29.277        6.566      385.523
>>    131072      349.701      382.089 +-    52.652      228.589      572.364
>>    262144      587.697      458.013 +-    74.054      238.532      708.677
>>    524288     1138.496      471.440 +-    71.701      276.816      710.853
>>   1048576     2223.087      478.532 +-    57.036      332.141      625.834
>>   2097152     4312.721      491.770 +-    51.694      349.641      638.207
>>   4194304     8763.014      487.486 +-    58.947      174.562      625.544
> 
> 
>> renton$ sudo ./test/io/bmi/pingpong -h mx://renton:0:3 -s
>> Starting unexpected test
> 
> 
>> begbie$ sudo /tmp/pingpong -h mx://renton:0:3 -c -u
>>     Bytes        usecs         MB/s       StdDev          Min          Max
>>         1       15.690        0.065 +-     0.007        0.006        0.087
>>         2       16.647        0.123 +-     0.016        0.013        0.166
>>         4       15.940        0.255 +-     0.030        0.036        0.336
>>         8       16.309        0.501 +-     0.063        0.055        0.671
>>        16       16.366        0.995 +-     0.119        0.114        1.342
>>        32       15.675        2.078 +-     0.251        0.339        2.796
>>        64       17.150        3.862 +-     0.444        0.051        5.162
>>       128       17.240        7.571 +-     0.916        0.807       10.226
>>       256       20.921       12.455 +-     1.450        1.528       17.180
>>       512       25.420       20.263 +-     1.234        4.079       26.189
>>      1024       33.449       30.914 +-     2.706        7.816       41.699
>>      2048       56.748       36.531 +-     2.806        1.480       63.866
>>      4096       63.077       65.247 +-     3.462       24.595      101.058
>>      8192      108.815       93.179 +-    38.932        6.014      144.978
> 
> 
> I did initially have some problems compiling pingpong, as attempting to make it resulted in an undefined reference error for sqrt.  I ended up just copying the gcc line from the make attempt and adding "-lm" to the end, which compiled it just fine. I see the test/io/bmi/module.mk.in file does set a variable that should be adding "-lm" to MODLDFLAGS_$(DIR)/pingpong.o, but for some reason that either isn't getting set or interpreted for me.  In any case, it's not a big deal, perhaps I was just calling make the wrong way (what I did was "make test/io/bmi/pingpong" from the top-level of the build tree, since I couldn't find any pseudo target for the test modules, and "make all" didn't build it).
> 
> Josh.
> 
>