[Csync2] speed of "-cr /"

[Lars Ellenberg]

On Wed, Jun 09, 2010 at 08:12:52PM +1000, Aristedes Maniatis wrote:
> On 8/06/10 12:02 AM, Lars Ellenberg wrote:
> >csync2 -cr /
> >does exactly that:
> >it looks at its database, and stats all files listed in that database,
> >as well as directories, and compares the recorded stat info with the
> >"live" stat info.
> >
> >In case a directory stat info has changed, that directory needs to be
> >scanned for potentially added files.
> >
> >Excludes (or non-includes) are respected.
> 
> I'm afraid that still doesn't quite make sense to me.
> 
> csync.cfg:
> 
>    include /usr/ports/packages;
> 
> 
> # time csync2 -cr /usr/ports/packages
> real	0m1.097s
> 
> # time csync2 -cr  /
> real	1m15.614s
> 
> 
> It does not appear to be respecting the includes with respect to the
> folders it is scanning. Perhaps they will never be added to the DB,
> but the above simple test seems to show that csync to scanning through
> lots of files which it doesn't need to. This is a problem with respect
> to load and speed in our use.
> 
> 
> Are you expecting that we need to pass on the command line to -c a
> list of every folder that we want csync to scan, even though they are
> already included in the 'include' configuration command?

No.

> One of the big drawcards of csync over rsync was the fact that the
> config is neatly contained in one configuration file.

Let me repeat myself:

Csync2 does already what you ask for.
(Even if it seems to you that it may not).

You may add a few -v to your csync2 command line,
or use strace, to see what it is doing?

Again: please try adding a few -v (one at a time),
and/or use strace, to see what it is doing.

And, of course, if all else fails, ...
but I said that before.


-- 
: Lars Ellenberg
: LINBIT | Your Way to High Availability
: DRBD/HA support and consulting http://www.linbit.com

DRBD® and LINBIT® are registered trademarks of LINBIT, Austria.