Corrupt file names downloaded from server

[sjmike]

I'm trying to download some images with foreign characters in them, but upon download they're getting a totally different file name.

For example:

File name on FTP:
Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg

File name on local PC after download:
Metallica_1988-10-18_Lillestr

[R] MLST Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg
[R] 250-Start of list for Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg
[R]  modify=20100202194942;perm=adfrw;size=205991;type=file;unique=803U764601;UNIX.group=552;UNIX.mode=0777;UNIX.owner=550; /public/images/video/Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg
[R] 250 End of list
[R] PASV
[R] 227 Entering Passive Mode (XX,XX,XX,XX,XX,XX).
[R] Opening data connection IP: XX.XX.XX.XX PORT: XX
[R] RETR Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg
[R] 150 Opening BINARY mode data connection for Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg (205991 bytes)
[R] 226 Transfer complete
Download: Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg 201 KB in 0.50 seconds (201.2 KB/s)
Transfer queue completed
Transferred 1 File (201 KB) in 2 seconds (91.0 KB/s)

File name on FTP:
Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg

File name on local PC after download:
Metallica_1989-10-07_S

[R] MLST Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg
[R] 250-Start of list for Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg
[R]  modify=20100202195004;perm=adfrw;size=817147;type=file;unique=803U766530;UNIX.group=552;UNIX.mode=0777;UNIX.owner=550; /public/images/video/Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg
[R] 250 End of list
[R] PASV
[R] 227 Entering Passive Mode (XX,XX,XX,XX,XX,XX).
[R] Opening data connection IP: XX.XX.XX.XX PORT: XXXX
[R] RETR Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg
[R] 150 Opening BINARY mode data connection for Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg (817147 bytes)
[R] 226 Transfer complete
Download: Metallica_1989-10-07_SãoPaulo_cover_1201164171.jpg 797 KB in 6 seconds (139.8 KB/s)
Transfer queue completed
Transferred 1 File (797 KB) in 9 seconds (86.7 KB/s)

Running build 3732 on Windows 8.1. I have tried changing the character encoding in the site manager from Global to UTF-8. Also tried (auto detect) and ISO_8859_1. All with the same results.

[bigstar]

Do you know the brand/version of the FTP server software?

Can you please include a small part of the login sequence that shows the FEAT and OPTS UTF8 ON bits.

Also did you reconnect to the FTP server after changing the character encoding and re-queue the files?

[sjmike]

I also tried the 4.4.0 build 1987 and it won't even download the file.

[R] RETR Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg
[R] 550 Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg: No such file or directory
[R] Transfer Failed: Metallica_1988-10-18_Lillestrøm_cover_1201161610.jpg
Transfer queue completed
Transferred 0 Files (0 bytes) in 0.92 second (0.0 KB/s)
1 File Failed

Yes. After each time I changed the settings I would disconnect and log back on.

This beta release of FlashFXP will stop functioning in 41 days on 6/13/2014, do not distribute this release.

FlashFXP 5.0.0 (build 3732) [BETA]
Support Forums http://forum.flashfxp.com

Winsock 2.2 -- OpenSSL 1.0.1g 7 Apr 2014
[R] Connecting to ftp.com -> DNS=ftp.com IP=xx.xx.xx.xx PORT=21
[R] Connected to ftp.com
[R] 220 ProFTPD 1.3.4d Server ready.
[R] USER sjmike
[R] 331 Password required for sjmike
[R] PASS (hidden)
[R] 230 User sjmike logged in
[R] SYST
[R] 215 UNIX Type: L8
[R] FEAT
[R] 211-Features:
[R]  MDTM
[R]  MFMT
[R]  LANG ko-KR;it-IT;bg-BG;ja-JP;ru-RU;en-US;zh-CN;fr-FR;zh-TW
[R]  TVFS
[R]  UTF8
[R]  AUTH TLS
[R]  MFF modify;UNIX.group;UNIX.mode;
[R]  MLST modify*;perm*;size*;type*;unique*;UNIX.group*;UNIX.mode*;UNIX.owner*;
[R]  PBSZ
[R]  PROT
[R]  REST STREAM
[R]  SIZE
[R] 211 End
[R] OPTS UTF8 ON
[R] 200 UTF8 set to on
[R] PWD
[R] 257 "/" is the current directory

[bigstar]

Can you please try this.

Add the file or perhaps a few that have this problem to queue and then save the queue to a file, then zip and attach the zipped queue file to either this message or a private message.

A queue file does not contain the site login information, you can verify by opening it in notepad if necessary.

[bigstar]

I believe I have figured out what's going on.

The problem is that the remote file name is not UTF8 and FlashFXP is failing to detect this and assumes its UTF8 (all internal strings are UTF8)

Local files are created using Unicode, the text is first converted from UTF8 to Unicode, since the text isn't UTF8 the conversion stops at the first invalid character.

I was already planning on releasing a new build today, I have included a quick fix for this issue and I will do more testing and refine/tweak the code as needed.

You can grab the new build via LiveUpdate or the website.

[sjmike]

Thanks. That resolved the issue.

[sjmike]

A find another bug related to the same issue. Except this time when you compare the local folder contents vs what is on the server, FlashFXP doesn't see the non UTF-8 files as existing locally, even though they do and match up exactly. I've attached a screenshot. Let me know if you need more details.

[bigstar]

Thank you for bringing this to my attention.

I have addressed this issue in build 3736.

Any ANSI (non-UTF8) characters are now UTF8 encoded so that they can be compared.