[Pvfs2-users] glibc detected double free or corruption

Thu Feb 5 13:16:32 EST 2009

Hi,

    I have successfully gotten pvfs2 up and running on a simple two node 
configuration.  When I mount the filesystem through the kernel interface 
I can ls to see the contents without a problem.  However, when I call 
pvfs2-ls I get this:

root at msh-new2:/testdata/pvfs2# /usr/local/pvfs2/bin/pvfs2-ls /testdata/pvfs2
blah
lost+found
*** glibc detected *** /usr/local/pvfs2/bin/pvfs2-ls: double free or 
corruption (!prev): 0x000000000068d010 ***
======= Backtrace: =========
/lib/libc.so.6[0x7f8092ef408a]
/lib/libc.so.6(cfree+0x8c)[0x7f8092ef7c1c]
/usr/local/pvfs2/bin/pvfs2-ls(main+0x5e0)[0x40e330]
/lib/libc.so.6(__libc_start_main+0xf4)[0x7f8092e9e1c4]
/usr/local/pvfs2/bin/pvfs2-ls[0x40d0b9]
======= Memory map: ========
00400000-00483000 r-xp 00000000 08:01 1394731                            
/usr/local/pvfs2/bin/pvfs2-ls
00683000-0068b000 rw-p 00083000 08:01 1394731                            
/usr/local/pvfs2/bin/pvfs2-ls
0068b000-007eb000 rw-p 0068b000 00:00 0                                  
[heap]
7f808c000000-7f808c021000 rw-p 7f808c000000 00:00 0
7f808c021000-7f8090000000 ---p 7f808c021000 00:00 0
7f8092038000-7f8092045000 r-xp 00000000 08:01 8242225                    
/lib/libgcc_s.so.1
7f8092045000-7f8092245000 ---p 0000d000 08:01 8242225                    
/lib/libgcc_s.so.1
7f8092245000-7f8092246000 rw-p 0000d000 08:01 8242225                    
/lib/libgcc_s.so.1
7f8092246000-7f8092258000 r-xp 00000000 08:01 8242244                    
/lib/libresolv-2.7.so
7f8092258000-7f8092458000 ---p 00012000 08:01 8242244                    
/lib/libresolv-2.7.so
7f8092458000-7f809245a000 rw-p 00012000 08:01 8242244                    
/lib/libresolv-2.7.so
7f809245a000-7f809245c000 rw-p 7f809245a000 00:00 0
7f809245c000-7f8092460000 r-xp 00000000 08:01 8242237                    
/lib/libnss_dns-2.7.so
7f8092460000-7f8092660000 ---p 00004000 08:01 8242237                    
/lib/libnss_dns-2.7.so
7f8092660000-7f8092662000 rw-p 00004000 08:01 8242237                    
/lib/libnss_dns-2.7.so
7f8092662000-7f809266c000 r-xp 00000000 08:01 8242238                    
/lib/libnss_files-2.7.so
7f809266c000-7f809286c000 ---p 0000a000 08:01 8242238                    
/lib/libnss_files-2.7.so
7f809286c000-7f809286e000 rw-p 0000a000 08:01 8242238                    
/lib/libnss_files-2.7.so
7f809286e000-7f8092874000 r-xp 00000000 08:01 1350100                    
/usr/lib/libmlx4-rdmav2.so
7f8092874000-7f8092a73000 ---p 00006000 08:01 1350100                    
/usr/lib/libmlx4-rdmav2.so
7f8092a73000-7f8092a74000 rw-p 00005000 08:01 1350100                    
/usr/lib/libmlx4-rdmav2.so
7f8092a74000-7f8092a7b000 r-xp 00000000 08:01 1350059                    
/usr/lib/libmthca-rdmav2.so
7f8092a7b000-7f8092c7b000 ---p 00007000 08:01 1350059                    
/usr/lib/libmthca-rdmav2.so
7f8092c7b000-7f8092c7c000 rw-p 00007000 08:01 1350059                    
/usr/lib/libmthca-rdmav2.so
7f8092c7c000-7f8092c7e000 r-xp 00000000 08:01 8242232                    
/lib/libdl-2.7.so
7f8092c7e000-7f8092e7e000 ---p 00002000 08:01 8242232                    
/lib/libdl-2.7.so
7f8092e7e000-7f8092e80000 rw-p 00002000 08:01 8242232                    
/lib/libdl-2.7.so
7f8092e80000-7f8092fd8000 r-xp 00000000 08:01 8242229                    
/lib/libc-2.7.so
7f8092fd8000-7f80931d8000 ---p 00158000 08:01 8242229                    
/lib/libc-2.7.so
7f80931d8000-7f80931db000 r--p 00158000 08:01 8242229                    
/lib/libc-2.7.so
7f80931db000-7f80931dd000 rw-p 0015b000 08:01 8242229                    
/lib/libc-2.7.so
7f80931dd000-7f80931e2000 rw-p 7f80931dd000 00:00 0
7f80931e2000-7f80931ed000 r-xp 00000000 08:01 1349981                    
/usr/lib/libibverbs.so.1.0.0
7f80931ed000-7f80933ec000 ---p 0000b000 08:01 1349981                    
/usr/lib/libibverbs.so.1.0.0
7f80933ec000-7f80933ed000 rw-p 0000a000 08:01 1349981                    
/usr/lib/libibverbs.so.1.0.0
7f80933ed000-7f8093403000 r-xp 00000000 08:01 8242243                    
/lib/libpthread-2.7.so
7f8093403000-7f8093603000 ---p 00016000 08:01 8242243                    
/lib/libpthread-2.7.so
7f8093603000-7f8093605000 rw-p 00016000 08:01 8242243                    
/lib/libpthread-2.7.so
7f8093605000-7f8093609000 rw-p 7f8093605000 00:00 0
7f8093609000-7f8093626000 r-xp 00000000 08:01 8242226                    
/lib/ld-2.7.so
7f809381c000-7f809381f000 rw-p 7f809381c000 00:00 0
7f8093820000-7f8093821000 rw-p 7f8093820000 00:00 0
7f8093823000-7f8093826000 rw-p 7f8093823000 00:00 0
7f8093826000-7f8093828000 rw-p 0001d000 08:01 8242226                    
/lib/ld-2.7.so
7fff9b813000-7fff9b828000 rw-p 7ffffffea000 00:00 0                      
[stack]
7fff9b9fe000-7fff9ba00000 r-xp 7fff9b9fe000 00:00 0                      
[vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  
[vsyscall]
Aborted

The first two lines are the correct contents of the folder.  Things get 
ugly after that.

I am running Ubuntu 8.04 Server x86_64.  uname -a: Linux msh-new2 
2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC 2008 x86_64 GNU/Linux

I downloaded the tarball for pvfs2.7.1 and did the install from there.  
I have configured for ib transport.  I am using two ConnectX IB cards.

For the record, I don't plan on using pvfs2-ls, but I thought I should 
submit a crash report.  I have just gotten pvfs2 running on my system, 
so if I run into further problems I'll be sure to let you know. :-)

Thanks,

Steven Truelove

-- 
Steven Truelove
Array Systems Computing, Inc.
1120 Finch Avenue West, 7th Floor
Toronto, Ontario
M3J 3H7
CANADA
http://www.array.ca
truelove at array.ca
Phone: (416) 736-0900 x307
Fax: (416) 736-4715