[Pvfs2-developers] RHEL4 and 2.7.1 mount problems

Phil Carns carns at mcs.anl.gov
Fri May 2 17:22:24 EDT 2008


The dmesg output probably will help, but I think that the inode 
alloc/dealloc check itself is a little trigger happy:

https://trac.mcs.anl.gov/projects/pvfs/ticket/7

I didn't think it would actually break anything other than printing out 
an unecessary warning, but I never followed up on it.  There may 
actually be something unrelated going wrong.

-Phil

Sam Lang wrote:
> 
> Hi Bart,
> 
> After loading the pvfs2 kmod, can you do:
> 
> echo "1" > /proc/sys/pvfs2/debug
> 
> Then run the same test, and send the dmesg output to me?  This should 
> show where the inode allocs/deallocs are going awry.
> 
> Thanks,
> -sam
> 
> On May 2, 2008, at 4:00 PM, Bart Taylor wrote:
> 
>> Hey guys,
>>
>> I have been running some tests against the 271 release, and I am 
>> having some trouble with multiple mounts on one client.  My setup has 
>> 2 servers (both meta and io servers on local disk) and one client all 
>> of which are running RHEL4 update 6. All that was done on the test 
>> client is loading the kernel module and starting pvfs2-client.  I can 
>> mount the file system once and use it without any problem, but I have 
>> attached a test script - takes file system information and a number of 
>> times to mount it - that keeps failing.  Here are the steps it executes:
>>
>> - For the number of mounts requested
>>    - Create a new directory (defaults to /tmp/mount_limit.#)
>>    - Mount the specified file system on the new dir
>>
>> - For the number of mounts requested
>>    - Do a recursive ls comparison (keep a copy the first time through 
>> and compare subsequent mounts to the first)
>>    - Unmount the dir
>>    - Delete the dir
>>
>> I have been able to consistently reproduce the problem running the 
>> attached script like this:
>> ./test-mount-limit.pl pvfs2-server1:3334/pvfs2-fs 100
>> It stalls every time with either 36 or 37 mounts remaining.  The 
>> script has been successfully run on previous versions of pvfs2 up to 
>> several thousand mounts.
>>
>> The problem comes at the umount step.  Eventually the process just 
>> hangs, strands a bunch of mounts, and umount doesn't work as expected 
>> after that even from the command line.  When it stalls, I start seeing 
>> messages like this one in dmesg and syslog:
>> May  2 15:02:44 client-node kernel: pvfs2_kill_sb: (WARNING) number of 
>> inode allocs (4100) != number of inode deallocs (2665)
>>
>> I am running this against an almost empty file system since the 
>> recursive ls would take a while if it were large. Am I doing something 
>> wrong/strange here, or is there a client/kernel problem? The test 
>> seems pretty straight-forward, and I've never had an issue with the 
>> script before. I'm not sure if it was run against the 2.7.0 release 
>> though.
>>
>> Bart.
>> <test-mount-limit.pl>_______________________________________________
>> Pvfs2-developers mailing list
>> Pvfs2-developers at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Pvfs2-developers mailing list
> Pvfs2-developers at beowulf-underground.org
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers



More information about the Pvfs2-developers mailing list