Hey.

I am buying two huge servers with hardisk space of about 3 terabytes on each server. (Bunch of drives on raid, oh yea.).

Here is the dilly. They are physically far apart. They will each have about 2 terabytes of data on it. The data will be changing daily at both locations.

I expect about 2 gigs to change each day at each location. What I need to do is to setup the systems to automatically synchronize and transfer updated files.

Can anybody point me in the direction of the software I would need to use?

It needs to check what has changed since last sync, and copy it. If the file it is replacing has also been changed since last sync, it needs someway to handle this situation.
(I am getting a connection of about 5 mbits/second.)

About one hour transfer each way.

I am not yet sure which distrobution of linux I will be using, the most important thing is the ability to sync the files. And once I know what I need for that, I will then choose which distro.

Thanks.

David

rsync should do everything you want, with the strong encryption of an SSH tunnel and compression capability. The only thing it doesn't do, and I'm not sure if you're expecting this, is diff individual files. rsync is only smart enough to replace, not touch, or delete individual files, so it wouldn't work well if you deal with huge files that always get modified between syncs.

I use rsync to backup the /home partition of my desktop (>100Gb) to a FreeBSD software RAID fileserver, and as a Gentoo user, to upgrade the portage tree.

I use rsync to back up over 8Gb of user data a night over a network and it completes dead quick....