ioFTPD v7.5.9 Released (Beta) - Page 9

opcode · 08-13-2010, 03:51 PM

Ok, i did some stresstests on my box and was able to reproduce the active adress error. here it goes:

Code:

[1] 227 Entering Passive Mode (my,public,ip,adress,0,24)
[2] PORT my,public,ip,adress,0,24
[2] 200 PORT command successful.
[1] STOR testfiles.r16
[2] RETR testfiles.r16
[2] 150 Opening BINARY mode data connection for testfiles.r16 (50000000 bytes) using SSL/TLS.
[1] Timeout, Connection closed
[2] Reversed FXP started
[1] CPSV
[1] 426 Connection closed: Connection timed out.
[i] Transfer failed: testfiles.r16
[2] Reversed FXP started
[1] CPSV
[1] 227 Entering Passive Mode (my,public,ip,adress,0,23)
[2] PORT my,public,ip,adress,0,23
[2] 435 Failed TLS negotiation on data channel (using SSL_accept()), disconnected: Connection reset by peer.
[i] Transfer failed: testfiles.r15
[2] Reversed FXP started
[1] CPSV
[1] 227 Entering Passive Mode (my,public,ip,adress,0,24)
[2] PORT my,public,ip,adress,0,24
[2] 200 PORT command successful.
[1] STOR testfiles.r14
[1] 550 testfiles.r14: No such file or directory.
[i] Transfer failed: testfiles.r14
[1] 227 Entering Passive Mode (my,public,ip,adress,1,187)
[2] Reversed FXP started
[1] CPSV
[1] 550 Active transfer in progress, terminate transfer with ABOR before proceeding.
[i] Transfer failed: testfiles.r13
[2] Reversed FXP started
[1] CPSV
[1] 550 Active transfer in progress, terminate transfer with ABOR before proceeding.
[i] Transfer failed: testfiles.r12

Using Ftprush latest (legit copy) with SSL DLL OpenSSL 0.9.8d 28 Sep 2006 (LOCKED).

Sometimes it just keeps hanging after [1] Timeout, Connection closed without doing anything anymore, which i actually don't mind.

But more often all following files just fail with [1] 550 Active transfer in progress, terminate transfer with ABOR before proceeding. At the end of the queue FTPRush rmdirs all empty directories (aka pretty much everything that failed) and leaves me with a broken queue (unusable now because none of the target dirs are there anymore) and nothing on the disk

What's weird is that it's actually trying different ports but still giving the error.

Also i installed the process explorer to find out what dlls are in use, so here they are:

Code:

ACTIVEDS.dll	ADs Router-Ebene-DLL	Microsoft Corporation	5.1.2600.5512
adsldpc.dll	DLL fÃ¼r ADs LDAP Provider C	Microsoft Corporation	5.1.2600.5512
ADVAPI32.dll	Erweitertes Windows 32 Base-API	Microsoft Corporation	5.1.2600.5755
ATL.DLL	ATL Module for Windows XP (Unicode)	Microsoft Corporation	3.5.2284.2
avsda.dll	AntiVir layered service provider	Avira GmbH	10.0.0.7
COMCTL32.dll	Common Controls Library	Microsoft Corporation	5.82.2900.5512
comctl32.dll	User Experience Controls Library	Microsoft Corporation	6.0.2900.5512
comdlg32.dll	DLL fÃ¼r gemeinsame Dialoge	Microsoft Corporation	6.0.2900.5512
CRYPT32.dll	Krypto-API32	Microsoft Corporation	5.131.2600.5512
ctype.nls			
DbgHelp.dll	Windows Image Helper	Microsoft Corporation	6.12.2.633
DNSAPI.dll	DNS Client API DLL	Microsoft Corporation	5.1.2600.5625
GDI32.dll	GDI Client DLL	Microsoft Corporation	5.1.2600.5698
hnetcfg.dll	Heimnetzwerkkonfigurations-Manager	Microsoft Corporation	5.1.2600.5512
IMM32.DLL	Windows XP IMM32 API Client DLL	Microsoft Corporation	5.1.2600.5512
ioFTPD.exe	ioFTPD Server		7.5.9.0
IPHLPAPI.DLL	IP-Hilfs-API	Microsoft Corporation	5.1.2600.5512
kernel32.dll	Client-DLL fÃ¼r Windows NT-Basis-API	Microsoft Corporation	5.1.2600.5781
lgscroll.dll	Logitech Scroll Enabler (UNICODE)	Logitech, Inc.	4.60.122.0
LIBEAY32.dll	OpenSSL Shared Library	The OpenSSL Project, http://www.openssl.org/	1.0.0.0
locale.nls			
mdnsNSP.dll	Bonjour Namespace Provider	Apple Inc.	2.0.2.0
MPR.dll	Router-DLL fÃ¼r Mehrfachanbieter	Microsoft Corporation	5.1.2600.5512
MPRAPI.dll	Windows NT MP Router Administration DLL	Microsoft Corporation	5.1.2600.5512
MSASN1.dll	ASN.1 Runtime APIs	Microsoft Corporation	5.1.2600.5875
MSCTF.dll	MSCTF-Server-DLL	Microsoft Corporation	5.1.2600.5512
msctfime.ime	Microsoft Text Frame Work Service IME	Microsoft Corporation	5.1.2600.5512
MSVCP60.dll	Microsoft (R) C++ Runtime Library	Microsoft Corporation	6.2.3104.0
MSVCR80.dll	MicrosoftÂ® C Runtime Library	Microsoft Corporation	8.0.50727.4053
MSVCR90.dll	MicrosoftÂ® C Runtime Library	Microsoft Corporation	9.0.30729.4148
msvcrt.dll	Windows NT CRT DLL	Microsoft Corporation	7.0.2600.5512
mswsock.dll	Microsoft Windows Sockets 2.0-Dienstanbieter	Microsoft Corporation	5.1.2600.5625
NETAPI32.dll	Net Win32 API DLL	Microsoft Corporation	5.1.2600.5694
ntdll.dll	DLL fÃ¼r NT-Layer	Microsoft Corporation	5.1.2600.5755
NTMARTA.DLL	Windows NT MARTA-Anbieter	Microsoft Corporation	5.1.2600.5512
nxHelper.dll	nxHelper Tcl Library		2.4.0.0
ODBC32.dll	Microsoft Data Access - ODBC Driver Manager	Microsoft Corporation	3.525.1132.0
odbcbcp.dll	Microsoft BCP for ODBC	Microsoft Corporation	2000.85.1132.0
odbcint.dll	Microsoft Data Access - ODBC Ressourcen	Microsoft Corporation	3.525.1117.0
ole32.dll	Microsoft OLE fÃ¼r Windows	Microsoft Corporation	5.1.2600.5512
OLEAUT32.dll		Microsoft Corporation	5.1.2600.5512
pdh.dll	Windows UnterstÃ¼tzungs-DLL fÃ¼r Leistungsdaten	Microsoft Corporation	5.1.2600.5773
Perflib_Perfdata_b00.dat			
perfos.dll	DLL fÃ¼r Windows-Systemleistungsobjekte	Microsoft Corporation	5.1.2600.5512
POWRPROF.dll	Power Profile Helper DLL	Microsoft Corporation	6.0.2900.5512
PSAPI.DLL	Process Status Helper	Microsoft Corporation	5.1.2600.5512
rasadhlp.dll	Remote Access AutoDial Helper	Microsoft Corporation	5.1.2600.5512
RPCRT4.dll	Remote Procedure Call Runtime	Microsoft Corporation	5.1.2600.5795
rsaenh.dll	Microsoft Enhanced Cryptographic Provider	Microsoft Corporation	5.1.2600.5507
rtutils.dll	Routing Utilities	Microsoft Corporation	5.1.2600.5512
SAMLIB.dll	SAM Library DLL	Microsoft Corporation	5.1.2600.5512
Secur32.dll	Security Support Provider Interface	Microsoft Corporation	5.1.2600.5834
SETUPAPI.dll	Windows Setup-API	Microsoft Corporation	5.1.2600.5512
SHELL32.dll	Allgemeine Windows-Shell-DLL	Microsoft Corporation	6.0.2900.6018
SHLWAPI.dll	Shell Light-weight Utility Library	Microsoft Corporation	6.0.2900.5912
sortkey.nls			
sorttbls.nls			
SSLEAY32.dll	OpenSSL Shared Library	The OpenSSL Project, http://www.openssl.org/	1.0.0.0
tcl85t.dll	Tcl DLL	ActiveState Corporation	8.5.2.8
tclreg12.dll			
tclsqlite3.dll			
twapi.dll	Tcl Windows API Extension DLL	Ashok P. Nadkarni	2.0.11.0
unicode.nls			
USER32.dll	Client-DLL fÃ¼r Windows XP USER-API	Microsoft Corporation	5.1.2600.5512
USERENV.dll	Userenv	Microsoft Corporation	5.1.2600.5512
VERSION.dll	Version Checking and File Installation Libraries	Microsoft Corporation	5.1.2600.5512
WINMM.dll	MCI API-DLL	Microsoft Corporation	5.1.2600.5512
winrnr.dll	LDAP RnR Provider DLL	Microsoft Corporation	5.1.2600.5512
WINSPOOL.DRV	Windows-Spoolertreiber	Microsoft Corporation	5.1.2600.5512
WINSTA.dll	Winstation Library	Microsoft Corporation	5.1.2600.5512
WLDAP32.dll	Win32 LDAP-API-DLL	Microsoft Corporation	5.1.2600.5512
WS2_32.dll	Windows Socket 2.0 32-Bit DLL	Microsoft Corporation	5.1.2600.5512
WS2HELP.dll	Windows Socket 2.0 Helper fÃ¼r Windows NT	Microsoft Corporation	5.1.2600.5512
wshtcpip.dll	Windows Sockets Helper DLL	Microsoft Corporation	5.1.2600.5512
WTSAPI32.dll	Windows Terminal Server SDK APIs	Microsoft Corporation	5.1.2600.5512

Sorry for the loads of kraut language, but i am too lazy to translate all the text. I think most of the dlls are fairly self-explanatory anyway :-)

Last but not least, while testing i found some strange behaviour. Not sure if it's an ioFTPD or ioNinja problem

When transferring some smaller (15mb) files, the ioNinja sfv check runs all well and at the end the directory is marked as complete. Yet when i test the files with winrar, sometimes files are missing. I checked the xferlog and the file was definately transfered. For example:

Quote:

Thu Aug 12 15:00:57 2010 57 85.230.#.# 15000000 /incoming/some/test/dir/here/files_go_in_here/somefile.r02 b _ i r user ftp 1 * l

It seems like ioNinja indeed processed the file, because in the .ioFTPD file i find

Quote:

{somefile.r02 8717ED29 user grp 15000000 258}

But yet it's not there in the end

It should be noted that i shorted the filename/path as they are very very long. Maybe that's the problem? On the other hand it only happens rather seldom, e.g. every few hundred files.

To wrap this post up, i checked the login stuff again and it seems the logins keep accumulating until ioFTPD crashes. I have no idea why that is, there is no considerable load and it can't be any "real" users either:

Code:

[2] 200-|?CID: 0    User: [Logging In]                            Idle:    7:54:32s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 1    User: [Logging In]                            Idle:    8:46:33s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 2    User: [Logging In]                            Idle:    7:43:32s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 3    User: [Logging In]                            Idle:    8:32:33s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 4    User: [Logging In]                            Idle:    8:22:33s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 5    User: [Logging In]                            Idle:    8:02:32s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 6    User: [Logging In]                            Idle:    8:13:33s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 7    User: [Logging In]                            Idle:    8:11:33s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 8    User: [Logging In]                            Idle:    7:46:32s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 9    User: [Logging In]                            Idle:    4:51:27s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 10   User: [Logging In]                            Idle:     49:22s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 11   User: [Logging In]                            Idle:    4:31:26s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 12   User: [Logging In]                            Idle:    4:11:26s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 13   User: [Logging In]                            Idle:    3:39:25s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 14   User: [Logging In]                            Idle:    2:57:25s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 15   User: [Logging In]                            Idle:    3:52:26s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|+CID: 16   User: user                Group: group  Dn:    187 KB/s |
[2] 200-| Dir: /public/test/                       |
[2] 200-| Action: RETR testdmp.r35                                  |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 17   User: [Logging In]                            Idle:    2:25:25s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 18   User: [Logging In]                            Idle:    3:37:25s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 19   User: [Logging In]                            Idle:    2:15:25s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 20   User: [Logging In]                            Idle:    2:00:25s|
[2] 200-| Action:                                                                 |
[2] 200-|-------------------------------------------------------------------------|
[2] 200-|?CID: 21   User: [Logging In]                            Idle:    1:58:25s|
[2] 200-| Action:                                                                 |

o_dog · 08-13-2010, 04:36 PM

i had this error too, turned out a faulty disk was causing it.

opcode · 08-13-2010, 04:42 PM

aww, don't make me sweat .. i guess i should check the harddisk then. any recommendation for a programm to use? or is chkdsk sufficient?

o_dog · 08-13-2010, 04:43 PM

hard to say, most hdd errors go undetected until they fail.

Yil · 08-13-2010, 08:06 PM

opcode: I think we can usually ignore any MS dll's so the two interesting ones to me are:

avsda.dll AntiVir layered service provider Avira GmbH 10.0.0.7
mdnsNSP.dll Bonjour Namespace Provider Apple Inc. 2.0.2.0

I have zero clue what the Apple thing does but it comes with iTunes and probably tries to fake out DNS replies, and I assume the other is part of your anti-virus. My guess is it must have some sort of internet filtering, spyware checking, etc component that is distinct from the actual anti-virus piece. Perhaps you can see if you can disable that for a bit? I know NOD32, which is a really nice anti-virus app, had an internet piece in v3 that was broken (though it took them a long time to acknowledge that) and ioFTPD hated it. My guess is you are looking at the same problem. Since you seem to have issues in a matter of hours disabling just the internet piece to see if that makes it happy shouldn't be too hard.

If anyone else is running Avira (?) as their A/V solution please chime in if it's working for you...

Disappearing files is kinda weird, but can happen if the zipscript ran into an error since ioFTPD would delete the file in that case. However it seems somewhat unlikely since it works for others...

Regarding the potential of a bad disk. You'll want to view the SMART details on your drive to see how healthy it is. My favorite is Hard Disk Sentinel because it's the only one that I've found that can read the SMART data off most USB external drives.

The "550 Active transfer in progress, terminate transfer with ABOR before proceeding." problem has been seen before. In your case the log looks kind of odd, can you check the logfile to see if a line got dropped?

[1] CPSV
[1] 227 Entering Passive Mode (my,public,ip,adress,0,24)
[2] PORT my,public,ip,adress,0,24
[2] 200 PORT command successful.
[1] STOR testfiles.r14
[1] 550 testfiles.r14: No such file or directory.
[i] Transfer failed: testfiles.r14
[1] 227 Entering Passive Mode (my,public,ip,adress,1,187)

The last line doesn't seem tied to a new PASV/CPSV command. I'm not really concerned about it at this point since v7.6 has had a lot of that associated code re-written but it would be interesting if it was just a dropped line or an indication of a bug in ioFTPD...

opcode · 08-13-2010, 08:20 PM

Yes, that avsda.dll is my Antivirus Software (Avira Antivir Premium, http://www.avira.com/en/pages/index.php) and the mdnsNSP.dll is indeed from the bloatware that is iTunes (i buy alot of music at there store so sadly i must cope with it ). I tried to get rid of that apple dll before but to no success. I will turn of AntiVir overnight and leave ioFTPD on, gonna see if that will do something.

There's probably another filetransfer following the last PASV. I just took a small chunk of the whole log, because it's all the same for each file in the queue and i wanted to spare you to have to wade through hundreds of similar loglines

Gonna check out that Hard Disk Sentinel aswell, thanks for the tip.

Yil · 08-13-2010, 08:27 PM

I'm not sure if turning off the internet piece of the A/V will be enough. Check to see if the dll is still being forced to load in all applications. If you don't see it loaded by ioFTPD.exe then that's good.

ArtCore7 · 08-14-2010, 01:39 PM

Hey YIL i have one more Question...

Is there a way to show the Folder Size in the Main directorys like /Folder1 | /Folder2 | /MP3 | and so on. I installed ioFTPD + newest ioNinja + newest nxTools and i see the Folder sizes of all sub dirs like /Folder1/MOVIE1 | /Folder2/Docu1 | /MP3/Musics.Best | and so on. And i want that Main Folder shows the sizes too.

Is there any way to do it ?

Peace ArtCore7

Yil · 08-15-2010, 01:58 PM

ArtCore7: ioFTPD, by default, currently only shows the size of the files in the immediate subdirectory (you can disable that via the 'No_SubDir_Sizing' option for performance reasons if needed). It does not have a way to show you the size of everything beneath a directory in a directory listing. You can of course request that for individual dirs via the "site size" command but depending on the size it may take a while to run...

A small trick when using "sorted" type dirs (i.e. a dir with lots of ioFTPD symlinks in them) is to use the -L argument to list/stat like "list -alL" which will force the server to open the target of the link and display the size of it just as if were a real directory (i.e. the size of the files in it). Doesn't really address the problem, but is useful once in a while

I should point out that I have a desire to enable showing the entire treesize in directory listings which is what I expect you want to do. I've worked out a couple of methods of doing it. However, my preferred method requires lazy disk writes of size information so it wouldn't impact performance but this means it also needs to be verified from time to time in case the server crashed before it was written.

My plan was to actually try to do this a while ago but then the whole switch to OpenSSL and stability issues came up so I haven't wanted to touch the internal dir caching stuff since it's tricky stuff. The last big update was in v7.1 when I taught the server about NTFS junctions/symlinks so the cache wouldn't get dirty when dirs were manipulated through junctions/symlinks...

Expect ioFTPD to support this in the future, but not until at least after 7.6 gets out and looks stable.

opcode · 08-18-2010, 05:24 PM

Just a quick update. Disabling the A/V ( i made sure that the DLL isn't loaded anymore) didn't solve anything. Seems like ioFTPD doesn't crash as often if there are no or atleast only few (1-2) transfers running.

Yil · 08-18-2010, 07:31 PM

opcode: Open up the passive range and see if that makes a difference. Or since you do most of the sending to it, switch the active/passive roles (FTP client calls this alternate FXP methods) so your local server is using the PORT command and the remote server PASV.

Yil · 08-26-2010, 07:30 PM

Since v7.5.9 has remained unchanged for a bit now I've uploaded the source for it in case anyone needs it. Link is at top of thread.

Sabour · 08-27-2010, 01:41 PM

thank you,really appreciated

ArtCore7 · 08-27-2010, 01:42 PM

I cant do anything with the sources, because i cant code very well. But i thing its very good for all the Coders out there

Yil · 08-27-2010, 02:07 PM

Hmm, it just occurred to me that starting with v7.1.0 the TCL libraries differ from the official TCL v8.5.8 sources because of the addition of the Tcl_RegisterHandleLockFunctions command. That was added so the TCL library can share the ioFTPD lock around process/socket creation. I've included a copy of the TCL sources I'm building from in the link at the top.

The OpenSSL library is unchanged, you should be able to use anybody's compiled copy or build it yourself. We are currently using 1.0.0 but 1.0.1 is out there.