[PVFS-users] A strange problem when download a file from /mnt/pvfs with FTP client.

Kevin.zsc kevin.zsc at gmail.com
Wed Aug 31 09:50:25 EDT 2005


Hi Rob,
 As you said, I used an init script to load the pvfs.o module since added 
the line "alias pvfsclient pvfs" in /etc/modules.conf couldn't loaded the 
module. But my problem still exists. I will describe my problem with more 
details.
 I want to submit a LS-DYNA(MPP) job in directory /mnt/pvfs. The input key 
file of LS-DYNA was generated at an workstation running Windows. Then I used 
a FTP client (FlashFXP) to upload the input key file into the directory 
/mnt/pvfs of our cluster. The uploading process works well. After that, I 
submitted the LS-DYNA job. It works well and the output d3plot files were 
generated in directory /mnt/pvfs. But when I used the FTP client to 
downloaded the output d3plot files from the directory /mnt/pvfs, the first 
time the FTP client can only download the file name with size 0 byte. If I 
downloaded the same file the second time, everything works well. The follows 
are the output from the FTP client.

[R] PWD
[R] 257 "/mnt/pvfs/kevin/one_global_dir"
[R] List (cached)
[R] List Complete: 2 KB in 0.03 seconds (83.4 KB/s)
[R] TYPE I
[R] 200 Switching to Binary mode.
[R] PORT 192,168,1,100,39,28
[R] 200 PORT command successful. Consider using PASV.
[R] RETR d3plot
[R] 150 Opening BINARY mode data connection for d3plot (65853440 bytes).
[R] 226 File send OK.
Transferred: d3plot 0 bytes in 5.70 seconds (0.1 KB/s)
Transfer queue completed
Transferred 1 file totaling 0 bytes in 5.78 seconds (0.0 KB/s)
[R] PORT 192,168,1,100,39,29
[R] 200 PORT command successful. Consider using PASV.
[R] RETR d3plot
[R] 150 Opening BINARY mode data connection for d3plot (65853440 bytes).
[R] 226 File send OK.
Transferred: d3plot 62.80 MB in 13.36 seconds (4,813.6 KB/s)
Transfer queue completed
Transferred 1 file totaling 62.80 MB in 13.44 seconds (4,813.6 KB/s)

I have tested the "option pvfs buffer=dynamic" method mentioned by Marcelo, 
but the problem still exists.
 PS: For that I am not familiar with pvfs and the pvfs2 needs the BerkleyDB 
which package was not included in our cluster, I selected the
pvfs1.6.3instead of pvfs2.
 Best regards
Kevin Zeng 
 On 8/30/05, Rob Ross <rross at mcs.anl.gov> wrote: 
> 
> Hi Kevin,
> 
> Regarding the module, you might want to load it via an init script.
> 
> To clarify, are you downloading *into* a PVFS volume (i.e. client is
> writing into PVFS volume), or are you downloading *from* a PVFS volume
> (i.e. server is reading from a PVFS volume), or both?
> 
> Are there any messages in any of the log files (kernel log, mgr log, iod
> logs)?
> 
> Any particular reason why you are using PVFS instead of PVFS2?
> 
> Thanks,
> 
> Rob
> 
> Kevin.zsc wrote:
> > Hi Marcelo and all,
> >
> > I have added the followed two lines to all my clients.
> > alias pvfsclient pvfs
> > options pvfs buffer=dynamic
> > then I reboot all my clients,I/O-data and meta-data server.
> > But the problem still exists.
> > I noticed that there is not pvfs module loaded after I reboot a client
> > and used the "lsmod" at prompt.
> > Are there any other issues that should be pay attention to?
> >
> > Best regards
> > Kevin Zeng
> > On 8/28/05, *Marcelo Matus* <mmatus at acms.arizona.edu
> > <mailto:mmatus at acms.arizona.edu>> wrote:
> >
> > Well, just to be sure, add the line
> >
> > options pvfs buffer=dynamic
> >
> > to all the clients.
> >
> > Marcelo
> >
> >
> > Kevin.zsc wrote:
> >
> > > Hi, Marcelo and all,
> > >
> > > I viewed the /etc/modules.conf file in my pvfs-meta server, no buffer
> > > option are set in this file.
> > > [root at controlNode /]# cat /etc/modules
> > > alias eth0 e1000
> > > alias scsi_hostadapter aic79xx
> > > alias scsi_hostadapter1 ata_piix
> > > alias usb-controller usb-uhci
> > > alias usb-controller1 ehci-hcd
> > >
> > > Should I add the buffer=dynamic into /etc/modules.conf ?
> > >
> > > Best regards
> > > Kevin zeng
> > > On 8/27/05, *Marcelo Matus* <mmatus at acms.arizona.edu
> > <mailto:mmatus at acms.arizona.edu>
> > > <mailto:mmatus at acms.arizona.edu
> > <mailto:mmatus at acms.arizona.edu>>> wrote:
> > >
> > > Do you have the buffer option in the /etc/modules.conf?
> > >
> > > If so, be sure you are using buffer=dynamic, since the mapped
> > > option has troubles with the RHEL kernel, well, that is
> > > what we observed here.
> > >
> > > Marcelo
> > >
> > >
> > > Kevin.zsc wrote:
> > >
> > > > Dear members,
> > > >
> > > > I have installed and configued PVFS-1.6.3 in our Linux
> > > cluster(OS,RHEL
> > > > AS3U3).
> > > > The ftp server in our linux cluster nodes is vsftp, which is
> > > > distributed with RHEL AS3U3.
> > > > When I download the files in /mnt/pvfs directory with FTP
> > client
> > > > (FlashFXP) or Command Lines FTP(get), the first time
> > downloading
> > > can
> > > > only download the file name with size 0 byte. While I
> > downloaded the
> > > > file the second time, it work well. I am puzzled by this
> > > problem. Why
> > > > this happened? How to figure out it?
> > > > Thanks in advance.
> > > >
> > > > Best Regards
> > > > Kevin Zeng
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.beowulf-underground.org/pipermail/pvfs-users/attachments/20050831/3480b37b/attachment.htm


More information about the PVFS-users mailing list