Using Robocopy not giving desired results

[garp99]

While using batch files to run YAMJ, I have been using XCOPY to update files from local PC to NMT jukebox folder.

However now I am trying to get Robocopy to work so that source and destination are in sync,
mainly to remove obsolete files left over in the destination folder on NMT.

EDIT: I am using Windows XP

I've gone through all the options but can't find a way to avoid the results I am getting. When using this command:

Robocopy [source] [dest] /MIR /ZB

the output indicates that ALL files are NEWER and need to be copied. This simply isn't true.
I would expect that the first time, but not subsequent calls.
Both NMT units I have are using EXT3 file system.

I've tried other options like ...
/COPY:T to update timestamps so that they match up however some/many files seem to be 2 seconds earlier on dest.
According to manual, non-NTFS systems will be checked within 2 secs to see if they match -- so this should be ok.

/XN to avoid NEWER files, but after re-running YAMJ and a bunch of files are updated/changed, they are not found.

/IT for tweaked files, mostly attributes, but makes no difference even though timestamp and size are different


Anything else I should be trying or using?

[iboston]

Try my program i wrote. I wrote it specifically to transfer files to my PCH device. It has a help file to explain all the features. It will copy/replace and sync and even search for duplicate files. I think if you play with it, and give it a shot, you will love it.

The name of the program is CopyEnsure and can be downloaded from http://www.topcity.com

Give me your feedback on the program. That would be great.


Below is a description of the program copied from my website.
------------------------------------------------------------
I wrote copy ensure because windows is horrible with copying if any errors occur along the way. Windows will abort the file transfer, and then your stuck with a partial copy with no easy way to resume. Also, if the file is corrupt and you choose not to overwrite files on a re-copy to try and save time, you now have a corrupt file in hand. I've dealt with all this as i do a lot of copying of multi terabyte drives.. Copy ensure is a powerful and reliable copy program, backup tool and even duplicate file sniffer. Copy Ensure doesn't just copy the file and move on. It copies the file, maintaining the original source file dates! It also does binary comparison on the file to make sure the file was copied correctly. If you compare this feature to other programs you will notice that binary compare is always an option because it can horribly slow down the copy process. NOT with copy ensure. Its so fast, i don't give it as an option, you always get the binary compare which ensures a good copy. You can also sniff out duplicate files with copy ensure. Have 100,0000 pictures you want to scan for duplicates. NO Problem. It will find them every time! Ps. At the click of a button, you can have Copy Ensure delete those duplicates for you.

There is also a scheduling feature so that you can have backups run at per-determined times. You can queue up multiple copies so that you can build up a list of copies to process and then walk away allowing Copy Ensure to do its thing.

[garp99]

I will check it out... sounds a lot like SuperCopier2 which I use for Movie transfers.
Although it doesn't so syncing.

One concern with yours is that I am really in need of a command line program to use inside a batch file.
Can yours be called without GUI?

[iboston]

Well, if you were creative. If the program is running, it reads the .dir files if you have scheduling enabled. You could use echo commands or copy commands to build the DIR file and the program would then process what was specified within the .dir file.

this is a very active project. Although i myself and a couple friends have been using the program for over a year, I just released it to the public about a month ago. With input and suggestions, I can modify the program to tailor peoples desires.

With no disrespect for the programmer of SuperCopier2, I checked out his website and read about the program. This program is a bit on steroids compared to that program. I give you huge amounts of control over how each queue directory will copy along with many other features. You really have to check out the help file included with the program to appreciate how much it does. I am also proud because its the first program i have released where i made a help file.

[Omertron]

I suppose you've checked the time on the PCH is correct?

---

Also, you could try, for the first NMT:
Robocopy [source] [dest] /MIR /ZB /A
This only copies the files with "Archive" set.

For the second
Robocopy [source] [dest] /MIR /ZB /M
This does the same as the one above, but then resets the archive bit.

You might want to occasionally just sync the lot to make sure it's all correct

[garp99]

(01-27-2011 04:26 PM)Omertron Wrote:  I suppose you've checked the time on the PCH is correct?

No, could you write me a 10 page Wiki page on how to do that please.


Yes, the times are correct within seconds.
What I find annoying is that there's no more than 2 secs off as described with copying to FAT, or
any other non-NTFS system, and that Robocopy is supposed to take that into account, but it's not as advertised.

(01-27-2011 04:26 PM)Omertron Wrote:  Also, you could try, for the first NMT:
Robocopy [source] [dest] /MIR /ZB /A
This only copies the files with "Archive" set.

For the second
Robocopy [source] [dest] /MIR /ZB /M
This does the same as the one above, but then resets the archive bit.

You might want to occasionally just sync the lot to make sure it's all correct

For now I got something working with these options
/MIR /ZB /COPY:DAT /maxage:1

but I don't know yet if it will still work if you re-run the jukebox multiple times, will Robocopy still
find the newly changed files from last run or only all files within the last day.
.

---

.

(01-27-2011 03:29 PM)iboston Wrote:  Well, if you were creative. If the program is running, it reads the .dir files if you have scheduling enabled. You could use echo commands or copy commands to build the DIR file and the program would then process what was specified within the .dir file.

I did read the whole help file.. very nice.
For my needs from command line (YAMJ batch file), the src and dest will rarely change but there will be many.
So for me creating JOBS in the GUI and saving that config would work if I could call the program with options like
/nogui /job xx1.dir

(01-27-2011 03:29 PM)iboston Wrote:  With no disrespect for the programmer of SuperCopier2, I checked out his website and read about the program. This program is a bit on steroids compared to that program. I give you huge amounts of control over how each queue directory will copy along with many other features. You really have to check out the help file included with the program to appreciate how much it does. I am also proud because its the first program i have released where i made a help file.

What I really like about this program is right-clicking context menu that allows me drag/drop from Explorer
into dest folder. It also queues up and quite reliable for large size files.
I can walk away and know that it will complete properly.

[tcronin]

Quote:the output indicates that ALL files are NEWER and need to be copied. This simply isn't true.

you need to use /FFT switch.
I had the same problem copying from my pc to a readynas.

from help:

/FFT :: assume FAT File Times (2-second granularity).

[iboston]

What I really like about this program is right-clicking context menu that allows me drag/drop from Explorer into dest folder. It also queues up and quite reliable for large size files. I can walk away and know that it will complete properly.

----------------------------------------
You can drag / drop from explorer onto the source and target as well. Also, it does a byte comparison on the file. If its not a match, it will reprocess the file. So, no worries that you wont have an "EXACT" copy. As for large files. I have 4 terabytes of harddrive that i have to keep in sync. Often copying files 13 gigabytes in size and has never failed me. It also queues up. If you have a chance, check it out.