[Pvfs2-users] Error running pvfs2-server: Error: handle 0 is invalid (out of bounds)

Mark J. Hoy mhoy at cs.cmu.edu
Tue Jul 1 11:02:26 EDT 2008


Thanks Phil -

Retrying the re-initialization of the storage space (-f) - says it 
works, but also provides the additional messages:
[S 07/01 10:54] PVFS2 Server on node boston19 version 2.7.1 starting...
[E 07/01 10:54] TROVE:DBPF:Berkeley DB: DB_THREAD mandates memory 
allocation flag on key DBT
[E 07/01 10:54] error in dspace create (db_p->get failed).
[E 07/01 10:54] TROVE:DBPF:Berkeley DB: DB_THREAD mandates memory 
allocation flag on key DBT
[E 07/01 10:54] error in dspace create (db_p->get failed).
[E 07/01 10:54] TROVE:DBPF:Berkeley DB: DB_THREAD mandates memory 
allocation flag on key DBT
[E 07/01 10:54] error in dspace create (db_p->get failed).
[E 07/01 10:54] TROVE:DBPF:Berkeley DB: DB_THREAD mandates memory 
allocation flag on key DBT
[E 07/01 10:54] error in dspace create (db_p->get failed).
[D 07/01 10:54] PVFS2 Server: storage space created. Exiting.

This only happens on the very first server (server1 in my configuration 
below) - also, I'm using a standard make/make install of BerkeleyDB.4.7 
(no odd configuration options other than the --prefix setting to install 
to a different path)...

Running showcoll on the first server yields:
[E 10:58:15.614847] TROVE:DBPF:Berkeley DB: DB_THREAD mandates memory 
allocation flag on key DBT
[E 10:58:15.614940] TROVE:DBPF:Berkeley DB: DB->get: Invalid argument
        0x00100000 (dspace_getattr output: type = unknown, b_size = 5421632)
[E 10:58:15.614990] TROVE:DBPF:Berkeley DB: DB_THREAD mandates memory 
allocation flag on key DBT
[E 10:58:15.615003] TROVE:DBPF:Berkeley DB: DB->get: Invalid argument
        0x00000000 (dspace_getattr output: type = unknown, b_size = 5421632)

Running showcoll (with the same parameters) on any of the other 5 nodes 
yields:
[E 11:01:34.794473] src/io/trove/trove-dbpf/dbpf-mgmt.c line 515: 
dbpf_collection_geteattr: DB_NOTFOUND: No matching key/data pair found
[E 11:01:34.794792]     [bt] 
bin/pvfs2-showcoll(dbpf_collection_geteattr+0x103) [0x414063]
[E 11:01:34.794811]     [bt] bin/pvfs2-showcoll(main+0x417) [0x4070b7]
[E 11:01:34.794822]     [bt] /lib64/libc.so.6(__libc_start_main+0xf4) 
[0x30e2c1d084]
[E 11:01:34.794834]     [bt] bin/pvfs2-showcoll(aio_fsync64+0x39) [0x406669]
Storage space /usr2/pvfs-storage, collection pvfs2-fs (coll_id = 
1375400306, *** no root_handle found ***):

... not sure what I'm missing here... Thanks!

-Mark


Phil Carns wrote:
> Hello,
>
> I haven't seen that error message in that particular context before.  
> In general, though, it happens on startup when the server finds that 
> it has a handle (storage object) in its directory that doesn't match 
> the ranges specified in the configuration file.
>
> In this specific case it thinks there is a handle with value 0 in your 
> storage space, which shouldn't happen.
>
> Has the server ever started successfully, or is this the first attempt 
> to get it running?
>
> You may want to try just deleting the storage space (the 
> /usr2/pvfs-storage directory) and redoing the "-f" step, if you 
> haven't already.
>
> You could also try running this command:
>
> pvfs2-showcoll -s /usr2/pvfs-storage -c pvfs2-fs
>
> That should list all of the handles in the storage space so that we 
> can confirm if there is really bad data in there or if there is 
> something wrong with the server's startup.
>
> -Phil
>
> Mark J. Hoy wrote:
>> Hi -
>>
>> I'm trying to get PVFS2 version 2.7.1 (latest stable) up and running 
>> - It compiles correctly without issue and to initialize my storage 
>> (via "pvfs2-server -f /path/to/config/file" ) - but I'm having a 
>> problem getting the server to start...
>>
>> every time I try running "sbin/pvfs2-server /path/to/config/file" 
>> (where /path/to/config/file is my configuration file generated via 
>> pvfs2-genconfig), I keep getting an error: Error: handle 0 is invalid 
>> (out of bounds)
>>
>> The relevant pieces of the log are shown below:
>> [D 06/27 13:32] PVFS2 Server version 2.7.1 starting.
>> [E 06/27 13:32] Error: handle 0 is invalid (out of bounds)
>> [E 06/27 13:32] Error adding handle range 
>> 3-1317624576693539402,2635249153387078803-3952873730080618202 to 
>> filesystem pvfs2-fs
>> [E 06/27 13:32] Error: Could not initialize server interfaces; aborting.
>> [E 06/27 13:32] Error: Could not initialize server; aborting.
>>
>> This seems to happen both using a single-machine configuration, and 
>> during a cluster configuration (with 6 machines) - _but_ in the 
>> multiple machine configuration, it only happens when I try and start 
>> the first I/O node - the other 5 machines startup without issue.
>>
>> Has anyone else experienced this sort of problem? I've attached a 
>> copy of my configuration file below (but changed the machine names to 
>> protect the innocent). Also, I'm running on a homogeneous 
>> configuration where all six of my machines are running Fedora Core 5, 
>> kernel: Linux version 2.6.19.1-001-K8, Dual-Core AMD Opteron(tm) 
>> Processor (model 1218, 2.6 GHz), 4GB RAM, and 400 GB of storage on 
>> the volume for pvfs2
>>
>> <Defaults>
>>        UnexpectedRequests 50
>>        EventLogging none
>>        LogStamp datetime
>>        BMIModules bmi_tcp
>>        FlowModules flowproto_multiqueue
>>        PerfUpdateInterval 1000
>>        ServerJobBMITimeoutSecs 30
>>        ServerJobFlowTimeoutSecs 30
>>        ClientJobBMITimeoutSecs 300
>>        ClientJobFlowTimeoutSecs 300
>>        ClientRetryLimit 5
>>        ClientRetryDelayMilliSecs 2000
>>
>>        StorageSpace /usr2/pvfs-storage
>>        LogFile /tmp/pvfs2-server.log
>> </Defaults>
>> <Aliases>
>>        Alias server1 tcp://server1:3334
>>        Alias server2 tcp://server2:3334
>>        Alias server3 tcp://server3:3334
>>        Alias server4 tcp://server4:3334
>>        Alias server5 tcp://server5:3334
>>        Alias server6 tcp://server6:3334
>> </Aliases>
>> <Filesystem>
>>        Name pvfs2-fs
>>        ID 1375400306
>>        RootHandle 1048576
>>        <MetaHandleRanges>
>>                Range server1 3-1152921504606846977
>>                Range server6 1152921504606846978-2305843009213693952
>>        </MetaHandleRanges>
>>        <DataHandleRanges>
>>                Range server1 2305843009213693953-3458764513820540927
>>                Range server2 3458764513820540928-4611686018427387902
>>                Range server3 4611686018427387903-5764607523034234877
>>                Range server4 5764607523034234878-6917529027641081852
>>                Range server5 6917529027641081853-8070450532247928827
>>                Range server6 8070450532247928828-9223372036854775802
>>        </DataHandleRanges>
>>        <StorageHints>
>>                TroveSyncMeta yes
>>                TroveSyncData no
>>        </StorageHints>
>> </Filesystem>
>>
>> Thanks!
>>
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> Pvfs2-users at beowulf-underground.org
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>
>


-- 
Mark J. Hoy
Senior Research Programmer

Email: mhoy at cs.cmu.edu
Office: NSH 3612E
Phone: +1.412.268.2088
Fax:   +1.412.268.6298



More information about the Pvfs2-users mailing list