[Csync2] Csync2 use case
Jens Schulte in den Bäumen
j.schulte at oneway.de
Thu May 23 00:00:18 CEST 2013
Am 22.05.13 22:31, schrieb Francisco Reyes:
> On 05/22/2013 11:34 AM, Michael Johnson wrote:
>> Have you seen this page?
>> https://www.axivo.com/community/threads/lightning-fast-synch-with-csync2-and-lsyncd.121/
>>
>
> No. Had not seen it. I am new to Csync2.
> Thanks. Looked over it. Will give it a try.
> However, doesn't seem that particular setup was against a large dataset.
>
> Anyone has any experience with Csync2 with directories with millions
> of files?
>
> _______________________________________________
> Csync2 mailing list
> Csync2 at lists.linbit.com
> http://lists.linbit.com/mailman/listinfo/csync2
Hi,
i´m also new to this list. I´m here because of getting some ideas about
how to handle million of files.
In our setup (2 nodes) we have round about 8 million small files (jpg
and png). Syncing of this set takes about 10 - 15 min.
Sqlite DB has a size of 3.4 GB.
So we are thinking about to write directly to dirty table and running
csync with -u parameter.
Initial sync is no problem at this point.
If you use:
csync2 -cIr /
on each node
Here csync is generating db file locally on each node.
See this link.
http://lists.linbit.com/pipermail/csync2/2012-October/000931.html
--
Mit freundlichen Grüßen
*Jens Schulte in den Bäumen*
Technical Director
Tel: +49 (0) 7361 529 929 16
Fax: +49 (0) 7361 529 929 22
E-Mail: j.schulte at oneway.de <mailto:j.schulte at oneway.de>
Web: www.oneway.de <http://www.oneway.de>
*Postanschrift:*
Schulze-Delitzsch-Straße 11, 73434 Aalen
Diese E-Mail ist nur für den Empfänger bestimmt und kann vertrauliches
bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche
darin enthaltene Ansicht oder Meinungsäußerung stellt die des Autors dar
und nicht notwendigerweise die Ansicht oder Meinung von Oneway. Sofern
Sie nicht der Empfänger sind, haben Sie diese E-Mail irrtümlich erhalten
und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder
jeglicher Druck dieser E-Mail ist strengstens untersagt.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/csync2/attachments/20130523/75df8a51/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: logo-oneway-dmc.jpg
Type: image/jpeg
Size: 9591 bytes
Desc: not available
URL: <http://lists.linbit.com/pipermail/csync2/attachments/20130523/75df8a51/attachment-0001.jpg>
More information about the Csync2
mailing list