Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Thanks for the tip guys, I'm used to unison, not rsync... So, no idea, then... :-) Le 04/04/2012 14:20, Tristan de CACQUERAY a écrit : > On Wed, 04 Apr 2012 14:12:02 +0200 > Pascal BERTON<pascal.berton3 at free.fr> wrote: > >> Dirk, >> >> Isn't there an error in your numbers ? >> You say that with you non-custered system you transfer 500GB in 400 >> seconds, which means more than a GB per second, and I can't figure out >> how you can achieve that with 100Mb link that can't run faster than >> roughly 10MB/s. Or did I miss something ? >> >> Regards, >> >> Pascal. >> >> > Pascal, > > for your information, rsync doesn't transfer everything each time as it uses a > delta-transfer algorithm to reduce the amount of data transfered! > > >> Le 04/04/2012 12:15, Dirk Bonenkamp - ProActive a écrit : >>> Hi, >>> >>> First off all: I posted a similar thread on the OCFS2 mailing list, but >>> I didn't receive a lot of response. This list seems to be busier, maybe >>> more luck over here... >>> >>> I'm having trouble backing up a OCFS2 file system. I'm using rsync and I >>> find this way, way slower than rsyncing a 'traditional' file system. >>> >>> The OCFS2 filesytem lives on a double primary DRBD setup. DRBD runs on >>> hardware RAID6, dedicated bonded gigabyte NICs, I get a 160 Mb/s syncer >>> speed. Read and write speeds are OK on the file system. >>> >>> Some figures: >>> >>> My OCFS2 filesystem is 3.7 Tb in size, 200 Gb is used, has about 1.5 >>> million files on it in 95 directories. About 3000 new files are added >>> each day, few files are changed. >>> >>> Rsyncing (directlty to the rsync daemon, no ssh shell overhead) this >>> filesystem over a Gb connection takes 70 minutes: >>> >>> Number of files: 1495981 >>> Number of files transferred: 2944 >>> Total file size: 201701039047 bytes >>> Total transferred file size: 613318155<tel:613318155> bytes >>> Literal data: 613292255<tel:613292255> bytes >>> Matched data: 25900 bytes >>> File list size: 24705311 >>> File list generation time: 0.001 seconds >>> File list transfer time: 0.000 seconds >>> Total bytes sent: 118692 >>> Total bytes received: 638195567<tel:638195567> >>> >>> sent 118692 bytes received 638195567<tel:638195567> bytes 154163.57 >>> bytes/sec >>> total size is 201701039047 speedup is 315.99 >>> >>> To compare this, I have a similar system (the old, non-HA system doing >>> the exact same thing), with an ext3 filesystem. This one holds 6.5 >>> million files, 500 Gb, about 10.000 new files a day. Backup done with >>> rsync through ssh on a 100 Mbit line takes 400 seconds. >>> >>> I'd like to know if somebody has encountered similar problems and maybe >>> has some tips / insights for me? >>> >>> Kind regards, >>> >>> Dirk >>> >>> >>> >>> >>> _______________________________________________ >>> drbd-user mailing list >>> drbd-user at lists.linbit.com >>> http://lists.linbit.com/mailman/listinfo/drbd-user >> _______________________________________________ >> drbd-user mailing list >> drbd-user at lists.linbit.com >> http://lists.linbit.com/mailman/listinfo/drbd-user >> > _______________________________________________ > drbd-user mailing list > drbd-user at lists.linbit.com > http://lists.linbit.com/mailman/listinfo/drbd-user