[PVFS-users] Weird problem - think I forgot a step.

[Michael Homa]

I'm upgrading my 64 node cluster to a more recent kernel (RH 2.4.20-28.7)
and I took the opportunity to rebuild pvfs-1.60. I have three metadata
servers:

  1 metadata server  and four  25GB IO servers /pvfs-scratch3
  1 metadata server  and four  25GB IO servers /pvfs-scratch2
  1 metadata server  and eight 25GB IO servers /pvfs-scratch1

When I start pvfs, as an example, and mount /pvfs-scratch3 I get the
following from df:

Filesystem           1k-blocks      Used Available Use% Mounted on
argo4-4:/pvfs-meta    48710144  48638336     71808 100% /pvfs-scratch3

Notice the available size, that should be closer to 100GB. And the "Used"
is completely wrong since there is nothing in /pvfs-scratch3. When I look
at the IO servers on each of the four machines, I get the correct size:

/dev/hda11            24098424       424  22873852   1% /pvfs-data
/dev/hda11            24098424        20  22874256   1% /pvfs-data
/dev/hda11            24098424       424  22873852   1% /pvfs-data
/dev/hda12            24098424        20  22874256   1% /pvfs-data

There is a step at this point that I think I've forgotten. Two of the data
filesystems contains just subdirectories( which is what it should be); the
other two filesystems have nothing in them. If memory serves, there is a
step to initialize the IO servers which creates the subdirectores.

Could someone refresh my memory?

Michael Homa
Academic Computing and Communication Center
University of Illinois at Chicago
email:  mhoma at uic.edu