<div dir="ltr">Hi.<div><br></div><div>I put in:</div><div><br></div><div><div> host foo@foo-priv;</div><div> host (bar@bar-priv);</div><div><br></div><div>All 4 hostnames are in /etc/hosts on both hosts and the "-priv" are obviously the private network IPs. Made sure all config files were in sync, deleted the csync2 database (it was just test junk anyway), and it finally sort of worked.</div>
<div><br></div><div>My test worked, but real data still fails after a while.</div><div><br></div><div>Directory "1001" has 4,794,446 files and directories (many of them are hardlinks to the same data ... dirvish archive). This leaves me with a database size of 6,033,509,376 bytes (wow!).</div>
<div><br></div><div>The slave host has some data that was copied over the public network, before csync2 blew up. Now that I have it running over the private network, here's what I get:</div><div><br></div><div><div>[22:31:04] Updating /mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Body contouring BP March 31st.ppt.bwt on bar-priv ...</div>
<div>[22:31:09] File is already up to date on peer.</div><div>[22:31:09] Updating /mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Dr. Doctors Photo Galleries on bar-priv ...</div><div>[22:31:09] File is already up to date on peer.</div>
<div>[22:31:09] Updating /mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Dr. Doctors Photo Galleries/2005 NPR Weight Loss Support Group.ppt.bwt on bar-priv ...</div><div>[22:31:12] File is already up to date on peer.</div>
<div>[22:31:14] Updating /mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Dr. Doctors Photo Galleries/Body contouring 2 - oct 19-2004.ppt.bwt on bar-priv ...</div><div>[22:33:33] While syncing file /mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Dr. Doctors Photo Galleries/Body contouring 2 - oct 19-2004.ppt.bwt:</div>
<div>[22:33:33] ERROR from peer bar-priv: Connection closed.</div><div>[22:33:33] File stays in dirty state. Try again later...</div><div>[22:33:35] ERROR from peer bar-priv: Connection closed.</div><div>[22:33:35] Finished with 2 errors.</div>
<div>TIMESTAMP: 2008-09-08 22:33:35 EDT (GMT-0400)</div><div>TOTALTIME: 2:21:32</div><div><br></div><div>real 141m31.822s</div><div>user 15m47.471s</div><div>sys 4m3.219s</div><div>root@foo:/etc/csync2# ls -l '/mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Dr. Doctors Photo Galleries/Body contouring 2 - oct 19-2004.ppt.bwt'</div>
<div>-rw-r--r-- 1 1002 1001 388650873 2006-12-13 23:05 /mnt/dirvish02-data/1001/1002/2006-12-31/tree/Documents-and-Settings/Dr. Doctors Photo Galleries/Body contouring 2 - oct 19-2004.ppt.bwt</div></div></div><div><br>If I re-run this, it fails again, but takes even longer.</div>
<div><br></div><div>Is anyone using csync2 to keep larger files (388M really isn't that big) in sync? Also, is there an option to as csync2 to retry a connection a few times before giving up? The startup cost is huge, so that would really help a lot. (to put in perspective, of the 141 minute run time, less than 3 minutes elapsed after the source-side scan completed and the transfer actually started, and it failed on this first non-sync'd file).</div>
<div><br></div><div>RAM is not an issue, I don't think ... both hosts have >2GB free, dual core AMD64, Ubuntu Hardy.</div><div><br></div><div>Thanks,</div><div>Sam</div><div><br></div><div><br><div class="gmail_quote">
On Mon, Sep 8, 2008 at 3:09 AM, Lars Ellenberg <span dir="ltr"><<a href="mailto:lars.ellenberg@linbit.com">lars.ellenberg@linbit.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div class="Ih2E3d">On Mon, Sep 08, 2008 at 01:02:24AM -0600, Sam Howard wrote:<br>
> Hi.<br>
> The PDF docs talks about being able to use an alternate/private network, but<br>
> the example doesn't make sense to me ...<br>
><br>
> I have host "foo" in the /etc/hosts with its external IP, and 'foo-priv" in<br>
> the /etc/hosts with it's private IP.<br>
><br>
> I've tried config entries like:<br>
><br>
> foo@foo-priv<br>
> foo-priv@foo (getting desperate)<br>
> foo@foo-eth0 (not in hosts file, but who knows)<br>
> <a href="mailto:foo@1.2.3.4">foo@1.2.3.4</a> (private ip)<br>
><br>
> I can't seem to get any combination of entries to work. What does the<br>
> actual configuration need to look like?<br>
<br>
</div>node bar.<br>
node foo.<br>
bar connects to foo, saying "hello, I'm bar".<br>
foo does a forward lookup of "bar",<br>
gets back an ip address,<br>
tries to match that ip address with the one the connection comes from.<br>
if they don't match (the connection comes from a different IP than<br>
the result of a forward lookup of "bar" on foo), connection is refused.<br>
<br>
the hostname in csync2.cfg has two aspects:<br>
first, the hostname is compared to the local hostname,<br>
to identify whether or not this host is part of a certain group.<br>
second, the hostname is resolved to an ip address to connect to.<br>
usually both aspects can be matched in the same name.<br>
sometimes you need to say<br>
<br>
<baz>@<baz address><br>
<br>
where <baz> is the hostname for the node baz to identify itself,<br>
and <baz address> is the address baz can be reached at from other nodes.<br>
<br>
so if your node is named foo, there has to be foo@.<br>
if bar can reach foo under foo-addr, then it has to be @foo-addr.<br>
still, on foo, it needs to be able to forward lookup (resolve)<br>
"bar" to the remote end of the incoming tcp connection.<br>
if all else fails, you can still add a "bar's.incoming.ip.addr bar" to<br>
/etc/hosts.<br>
<br>
don't forget to "csync2 -R" to clean up left-overs from previous<br>
trial runs.<br>
<br>
did that help, or did it confuse you further?<br>
<div class="Ih2E3d"><br>
> Also, is there a way to use a different database name for each group?<br>
<br>
</div>you can have different databases for different _configs_.<br>
(-C switch)<br>
<div class="Ih2E3d"><br>
> My<br>
> test server has over 12M files (many are hard links -- it's a dirvish<br>
> archive) ... this ends me up with a 12GB database file ... needless to say,<br>
> it takes over 2 hours just to do a sync check, and I haven't even added the<br>
> other filesystems yet!<br>
<br>
</div>--<br>
: Lars Ellenberg<br>
: LINBIT HA-Solutions GmbH<br>
: DRBD®/HA support and consulting <a href="http://www.linbit.com" target="_blank">http://www.linbit.com</a><br>
<br>
DRBD® and LINBIT® are registered trademarks<br>
of LINBIT Information Technologies GmbH<br>
_______________________________________________<br>
Csync2 mailing list<br>
<a href="mailto:Csync2@lists.linbit.com">Csync2@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/csync2" target="_blank">http://lists.linbit.com/mailman/listinfo/csync2</a><br>
</blockquote></div><br></div></div>