Problem (auto-)resuming with very large files

infernix · 01-30-2007, 01:27 PM

Hi,

I'm having strange issues trying to resume large (4GB and larger) files. I'm resuming over FXP.

Example: some file is 7.95GB large. On site A it's complete, on site B it's only 6.25GB. When I transfer the file from A to B through FXP with auto resume set, it will start resume somewhere halfway (e.g. 2.5GB) instead of at the end of the file. I have tried enabliing and disabling Rollback KB, switching to STAT -L instead of LS, but to no avail. I have no idea why it's not resuming the file at the end (minus rollback KB) but somewhere in the middle of the file.

Can anyone reproduce this?

thanks for any help

* FlashFXP v[3].[4.1], build [1156 BETA], [x]registered, [ ]unregistered, [ ]pirated
* OS [x] WinXP, [ ] Win2K, [ ] Win98, [ ] WinME, [ ] Other
* Running behind NAT/router [x] Yes & Model [Linux 2.6], [ ] No, [ ] Not sure
* Running firewall [ ] Yes, Name [ ], Ver. [ ], or [x] No
* Running Antivirus [ ] Yes, Name [ ] or [x] No
* Network [x] xDSL, [ ] CABLE, [ ] Dail-Up, [ ] Other
* FTP server(s) name [vsftpd, proftpd, any ftpd really], version [any]
* timestamped, and side prefixed FTP log (please paste)

[L] Connecting to site-a
[L] Connected to site-a
[L] 220 site-a (glFTPd 2.00_RC2 Linux+TLS) ready.
[L] AUTH SSL
[L] 234 AUTH SSL successful
[L] Connected. Negotiating SSL session..
[L] SSL negotiation successful...
[L] SSL encrypted session using cipher DHE-DSS-AES256-SHA (256 bits)
[L] PBSZ 0
[L] 200 PBSZ 0 successful
[L] USER someuser
[L] 331 Password required for someuser.
[L] PASS (hidden)
[L] 230 User someuser logged in.
[L] SYST
[L] 215 UNIX Type: L8
[L] FEAT
[L] 211- Extensions supported:
[L] AUTH TLS
[L] AUTH SSL
[L] PBSZ
[L] PROT
[L] CPSV
[L] SSCN
[L] MDTM
[L] SIZE
[L] SYST
[L] 211 END
[L] PWD
[L] 257 "/" is current directory.
[L] TYPE A
[L] 200 Type set to A.
[L] STAT -la
[L] List Complete: 790 bytes in 0,30 seconds (2,6 KB/s)
[R] Connecting to site-b
[R] Connected to site-b
[R] 220 (vsFTPd 2.0.5)
[R] AUTH TLS
[R] 234 Proceed with negotiation.
[R] Connected. Negotiating TLSv1 session..
[R] TLSv1 negotiation successful...
[R] TLSv1 encrypted session using cipher DES-CBC3-SHA (168 bits)
[R] PBSZ 0
[R] 200 PBSZ set to 0.
[R] USER someuser
[R] 331 Please specify the password.
[R] PASS (hidden)
[R] 230 Login successful.
[R] SYST
[R] 215 UNIX Type: L8
[R] FEAT
[R] 211-Features:
[R] AUTH SSL
[R] AUTH TLS
[R] EPRT
[R] EPSV
[R] MDTM
[R] PASV
[R] PBSZ
[R] PROT
[R] REST STREAM
[R] SIZE
[R] TVFS
[R] 211 End
[R] TYPE I
[R] 200 Switching to Binary mode.
[L] TYPE I
[L] 200 Type set to I.
[L] PROT C
[L] 200 Protection set to Clear
[R] PROT C
[R] 200 PROT now Clear.
[R] PASV
[R] 227 Entering Passive Mode (...)
[L] PORT (...)
[L] 200 PORT command successful.
[L] REST 2449599576
[L] 350 Restarting at 2449599576. Send STORE or RETRIEVE to initiate transfer.
[L] STOR hugefile.rar
[L] 150 Opening BINARY mode data connection for hugefile.rar using SSL/TLS.
[R] REST 2449599576
[R] 350 Restart position accepted (2449599576).
[R] RETR hugefile.rar
[R] 150 Opening BINARY mode data connection for hugefile.rar (8539125469 bytes).

MxxCon · 01-30-2007, 02:06 PM

Quote:

Originally Posted by infernix

Example: some file is 7.95GB large. On site A it's complete, on site B it's only 6.25GB. When I transfer the file from A to B through FXP with auto resume set, it will start resume somewhere halfway (e.g. 2.5GB) instead of at the end of the file. I have tried enabliing and disabling Rollback KB, switching to STAT -L instead of LS, but to no avail. I have no idea why it's not resuming the file at the end (minus rollback KB) but somewhere in the middle of the file.

during fxp transfer flashfxp doesn't see any content of the file, and it doesn't really care about its size. it just reads what one servers tells it and redirect it to the other. that file is being resumed at 2.5gb becuase server says that is how big it is. flashfxp itself has no problem transfering files over 4gb in size.
i don't want it to sound like pointing fingers, but you will need to look into server software to make sure that it does indeed can handle large files.

infernix · 01-30-2007, 02:42 PM

How can I debug this? I did point out that it happens with various FTP daemons, so is there any way to see where FlashFXP gets its information from regarding the file size?

Note that I had this earlier with a 25GB file; it would resume somewhere around 8GB while there was already 19GB uploaded.

infernix · 01-30-2007, 02:53 PM

Okay, my bad. Upgraded glftpd, problem solved.

Close thread, thanks for your help