Archiver

[Rusher]

so what script would you guys recommend to use for moving releases ?

for example

/incomming/mp3/

lets say i want everything in that location that is older than 25 days to be moved to

/Archive/mp3/


it does NOT need to update symlinks or so. just move directories and files.

[Sc0tTy]

I'm looking for the same script , updating dupe log is not required but it needs to be able to move directory based on regexp

[peep]

Try looking for warchive. Old script from many years ago, but might still work.. https://sites.google.com/site/ioftpdscripts/home/warc

[jeza]

You can test this script for moving/deleting folders.
Microsoft .net framework 3.5 SP1 must be installed on machine where the script will be executed.

You can setup windows task for it or add a line to ioFTPD scheduler.
Example:
archive = 59 3 * * E:\server\ioFTPD\scripts\jeza.ioFTPD.ArchiveScript \jeza.ioFTPD.Archive.exe

It uses XML file for configuration (check Example.txt).
This script can:

• move/delete folders older than X days

• move/delete folders when total count of folders exceeds X

• move/delete folders when free space on DISK is below X BYTES

• move/delete folders when total used space on DISK is over X BYTES

• move/delete folders when specified folder total used space is over X BYTES

I suggest using it on some test folder first

[Sc0tTy]

Yeh i didnt take a look @ WarChive because its so old an i'm running the latest ioFTPD
Jeza i'll take a look at it I'm a C# developer aswell ( in my spare time ) is it possible that you can add regexp to the options, that would be very usefull for me.

[jeza]

like for include or exclude specific folders by their names?
Right now you can exclude folders that start with specified string.

  <task>
    <skipPattern>.</skipPattern>
    <skipPattern>_old</skipPattern>
    <status>Enabled</status>
    <actionType>Move</actionType>
    <source>E:\\temp\\TestFiles</source>
    <destination>E:\\temp\\archive</destination>
    <action id="TotalFolderCount">
      <value>21</value>
      <minFolderAction>5</minFolderAction>
    </action>
  </task>

This will skip all folders that start with "." or "_old"

[Sc0tTy]

Its for a series archive and i want to archive per show.

So if a part in the release name is matched it has to be stored in the shows' folder

Archive\Tv\Series1
Archive\Tv\Series2

[jeza]

jeza.ioFTPD.Tools.v3.3.7.551.zip

This version has RegExpressionInclude and RegExpressionExclude setting.

May the Force be with you

[Rusher]

thx jeza !

[o_dog]

iotvarchive should work too ifit's jsut tvshows you want to archive. Think i have an updated version of it somewhere with more features.

[Sc0tTy]

o_dog , don't know that script so might as wel test jeza's script

[Sc0tTy]

[2011-10-06 23:29:22] System.IO.IOException: Source and destination path must have identical roots. Move will not work across volumes.
at System.IO.DirectoryInfo.MoveTo(String destDirName)
at jeza.ioFTPD.Archive.ConsoleApp.ExecuteArchiveTask( ArchiveTask archiveTask, DirectoryInfo directoryInfo)
at jeza.ioFTPD.Archive.ConsoleApp.Execute()
at jeza.ioFTPD.Archive.Program.Main(String[] args)

[jeza]

I will fix it during the weekend...

[Yil]

Hmm. Jeza if you get a chance, let me know what "features", or even propose an interface, you would like to see out of ioFTPD to help support whatever scripts your working on. The existing shared memory interface is pretty useful to adjust vfs perms, userfiles, etc, and there was some talk about providing a C# wrapper to make that accessible, but even the iTCL interface has a number of holes in it. I haven't prioritized filling them because no-one was complaining and I figured I'd get around to it when I needed the functionality in ioYil, but that was only going to be iTCL only originally. When I saw that exception stuff about cross drive moves a light bulb went off in my head that you will have the exact same problems ioYil will have...

If you want to move a directory tree to another drive you will have to do a copy/delete, which is trivial in C# to do, BUT if you want to actually be able to always delete the old directory you'll have to kick users in the old directory like nxtools does which is something you probably can't do now without access to the shared memory interface. Internally the RNFR/RNTO code for directory moves actually goes a step farther and locks the directories so nobody can enter the old dir as it's easy to see clients/bots get kicked and immediately restart. Now that I think about it I'm not sure if the internal code actually kicks users or just locks it so the next file can't be accessed because I was thinking about a slight of hand technique where I would automatically move users to the new dir if symbolic paths was enabled. Either way you'll also have to arrange to output something every 10-30 seconds if this is called from a site command to keep clients happy. Are you aware of the EXEC module line prefixed commands? You can enable non-buffered immediate output, change vfs perms on files/dirs, etc by just sending output back to the server and I believe you can take advantage of that via scheduled EXEC tasks as well if you need to change perms which I presume would be useful if you need to make the archived dirs read-only or something.

What I intend to do is either expose the directory locking stuff and/or the internal directory move stuff to iTCL for my use and I guess you wouldn't mind this in the future either, but if you can think of anything else you'd like to see please let me know. The only other hint I can give you is that internally ioFTPD takes special care to make sure that it copies over the .ioFTPD file before moving any files or subdirs. This guarantees that permission information is intact so the moved directory doesn't expose anything during the move and I thought you might want to make sure you do the same.

[jeza]

new version : jeza.ioFTPD.Tools.v3.3.10.553.zip

Moving between volumes should work now. You can Copy, Move or Delete folders .