[Pvfs2-users] PVFS2 over inifiniband(pathscales infinipath)

[Kyle Schochenmaier]

rishi pathak wrote:
>
> Hi All,
>    I am trying to install pvfs2 2.6.0 over infiniband.I am using 
> pathscales infinipath adapter.
>    make and make install works fine and also the storage space gets 
> created.I have configured it to use ib(infiniband.)
>    But when I try to run the servers normally they exit abnormally.The 
> log says that ib is unsupported protocol.
>    Is pathscale's infinipath support not enabled in pvfs2, or should I 
> go with TCP and use layered ethernet driver for inifinipath.
>    Below is my log:
>
> [D 21:03:46.121370] PVFS2 Server version 2.6.0 starting.
> [E 01/03 21:03] src/io/bmi/bmi.c line 1840: Error: no method available 
> for bmi_ib.
> [E 01/03 21:03]         [bt] /usr/local/pvfs2/sbin/pvfs2-server [0x41e890]
> [E 01/03 21:03]         [bt] 
> /usr/local/pvfs2/sbin/pvfs2-server(BMI_initialize+0x13e) [0x41ed5e]
> [E 01/03 21:03]         [bt] /usr/local/pvfs2/sbin/pvfs2-server [0x40df8d]
> [E 01/03 21:03]         [bt] 
> /usr/local/pvfs2/sbin/pvfs2-server(main+0xaa1) [0x40f821]
> [E 01/03 21:03]         [bt] 
> /lib64/tls/libc.so.6(__libc_start_main+0xdb) [0x332881c3fb]
> [E 01/03 21:03]         [bt] 
> /usr/local/pvfs2/sbin/pvfs2-server(aio_cancel64+0x16a) [0x40d62a]
> [E 01/03 21:03] Error: BMI_initialize: Protocol not available
> [E 01/03 21:03] Error: Could not initialize server interfaces; aborting.
> [E 01/03 21:03] Error: Could not initialize server; aborting
> !DSPAM:459bb560310608992556831!
> ------------------------------------------------------------------------
>
>   
If you're using OpenIB API I believe Infinipath is supported through 
user verbs, though I have yet to test this out.  I've also seen this 
message when not all of the kernel modules are loaded.  Make sure you 
have ib_uverbs.ko installed.  Hopefully this will clear it up.  If not, 
it looks like a config problem.

Kyle
> _______________________________________________
> Pvfs2-users mailing list
> Pvfs2-users at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>
>
>   


-- 
Kyle Schochenmaier
kschoche at scl.ameslab.gov
Research Assistant, Dr. Brett Bode
AmesLab - US Dept.Energy
Scalable Computing Laboratory