[DRBD-user] Backup issues with OCFS2

Pascal BERTON pascal.berton3 at free.fr
Wed Apr 4 17:35:24 CEST 2012

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Thanks for the tip guys, I'm used to unison, not rsync...
So, no idea, then... :-)

Le 04/04/2012 14:20, Tristan de CACQUERAY a écrit :
> On Wed, 04 Apr 2012 14:12:02 +0200
> Pascal BERTON<pascal.berton3 at free.fr>  wrote:
>
>> Dirk,
>>
>> Isn't there an error in your numbers ?
>> You say that with you non-custered system you transfer 500GB in 400
>> seconds, which means more than a GB per second, and I can't figure out
>> how you can achieve that with 100Mb link that can't run faster than
>> roughly 10MB/s. Or did I miss something ?
>>
>> Regards,
>>
>> Pascal.
>>
>>
> Pascal,
>
> for your information, rsync doesn't transfer everything each time as it uses a
> delta-transfer algorithm to reduce the amount of data transfered!
>
>
>> Le 04/04/2012 12:15, Dirk Bonenkamp - ProActive a écrit :
>>> Hi,
>>>
>>> First off all: I posted a similar thread on the OCFS2 mailing list, but
>>> I didn't receive a lot of response. This list seems to be busier, maybe
>>> more luck over here...
>>>
>>> I'm having trouble backing up a OCFS2 file system. I'm using rsync and I
>>> find this way, way slower than rsyncing a 'traditional' file system.
>>>
>>> The OCFS2 filesytem lives on a double primary DRBD setup. DRBD runs on
>>> hardware RAID6, dedicated bonded gigabyte NICs, I get a 160 Mb/s syncer
>>> speed. Read and write speeds are OK on the file system.
>>>
>>> Some figures:
>>>
>>> My OCFS2 filesystem is 3.7 Tb in size, 200 Gb is used, has about 1.5
>>> million files on it in 95 directories. About 3000 new files are added
>>> each day, few files are changed.
>>>
>>> Rsyncing (directlty to the rsync daemon, no ssh shell overhead) this
>>> filesystem over a Gb connection takes 70 minutes:
>>>
>>> Number of files: 1495981
>>> Number of files transferred: 2944
>>> Total file size: 201701039047 bytes
>>> Total transferred file size: 613318155<tel:613318155>   bytes
>>> Literal data: 613292255<tel:613292255>   bytes
>>> Matched data: 25900 bytes
>>> File list size: 24705311
>>> File list generation time: 0.001 seconds
>>> File list transfer time: 0.000 seconds
>>> Total bytes sent: 118692
>>> Total bytes received: 638195567<tel:638195567>
>>>
>>> sent 118692 bytes  received 638195567<tel:638195567>   bytes  154163.57
>>> bytes/sec
>>> total size is 201701039047  speedup is 315.99
>>>
>>> To compare this, I have a similar system (the old, non-HA system doing
>>> the exact same thing), with an ext3 filesystem. This one holds 6.5
>>> million files, 500 Gb, about 10.000 new files a day. Backup done with
>>> rsync through ssh on a 100 Mbit line takes 400 seconds.
>>>
>>> I'd like to know if somebody has encountered similar problems and maybe
>>> has some tips / insights for me?
>>>
>>> Kind regards,
>>>
>>> Dirk
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> drbd-user mailing list
>>> drbd-user at lists.linbit.com
>>> http://lists.linbit.com/mailman/listinfo/drbd-user
>> _______________________________________________
>> drbd-user mailing list
>> drbd-user at lists.linbit.com
>> http://lists.linbit.com/mailman/listinfo/drbd-user
>>
> _______________________________________________
> drbd-user mailing list
> drbd-user at lists.linbit.com
> http://lists.linbit.com/mailman/listinfo/drbd-user




More information about the drbd-user mailing list