Re: Repository Synchronization (250 Views)
Reply
Occasional Visitor
lscott
Posts: 3
Registered: ‎09-24-2012
Message 1 of 6 (316 Views)

Repository Synchronization

Hello,

 

We have about 130 ftp repositories that we need in complete sync with our main HPDM repository. Our repository is about 35GB and syncing the repository to our site servers by hand is tedious and very time consuming.

 

I've tried a consumer solution named "Allway Sync" but the software isn't very robust nor does it have specific bandwidth limitation controls that we need to sync the repository over our WAN.

 

I was hoping that someone here would have a better idea of how to synchronize these repositories. I've herd a rumor that the new HPDM will have this feature built in but I'm not so sure about that.

 

Thanks.

Regular Advisor
Dean Cunningham
Posts: 75
Registered: ‎04-22-2008
Message 2 of 6 (297 Views)

Re: Repository Synchronization

[ Edited ]

Have alook at sybcbak SE

http://www.2brightsparks.com/syncback/compare.html

Has bandwidth throttling and we have found reliable for file syncs to aremote site, but do not use if for repository syncing

Occasional Visitor
lscott
Posts: 3
Registered: ‎09-24-2012
Message 3 of 6 (286 Views)

Re: Repository Synchronization

This software is very similar to the AllSync software we purchased. It doesn't seem like a robust piece of synchronization software for a large repositories.

Valued Contributor
DeanC911
Posts: 110
Registered: ‎05-15-2012
Message 4 of 6 (283 Views)

Re: Repository Synchronization

What ftp software\OS are you using on the ftp repositories? If Linux, then I believe wget supports a mirror option. In this scenario, a cron job could be configured on the repository to sync with a designated master repository (you'd only have to update one then.

 

You could also consider setting up your own little "cloud". I've not used it myself, but ftpbox (ftpbox.org), looks pretty interesting. In this scenario, the servers running the ftp repositories would keep themselves in sync with a dropbox-like application.

 

 

I am a HP employee however, the views expressed in my contributions are my own and do not necessarily reflect the views and strategy of HP.
Occasional Visitor
lscott
Posts: 3
Registered: ‎09-24-2012
Message 5 of 6 (266 Views)

Re: Repository Synchronization

We're using Windows (W2kServer, XP, Win 7) and a mix between IIS and FileZilla server. 

 

I'm not opposed to a "dropbox" like solution. I'll look into this.

 

Because of the large file sizes I'm worried about data crouption during the process. I'd like something with an MD5 checker built in so I won't have to write a script for this. 

Regular Advisor
Dean Cunningham
Posts: 75
Registered: ‎04-22-2008
Message 6 of 6 (250 Views)

Re: Repository Synchronization

Have you tried syncbak?

We have used it for file server replication, so thousands of files.

It supports XCRC

 

You could also look at

http://www.blade.net.nz/

 

The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation.