[Csync2] Error syncing

David Winslow david.winslow at serendipitynow.com
Wed Dec 30 21:49:55 CET 2015 

All,
I’ve upgraded our servers to Centos 7 with csync2 v2.0 from Centos 6.4 with csync2 v1.34. I’m not able to sync files now. I also upgraded SQLite to 3.7 from 2.8. Librsync stayed at 0.9.7.

After trying my existing configuration with errors, I’ve set up a simple test configuration to see if that would work but I get errors as well. Based on the below, I can’t tell what the error is. The log completes saying it finished with two errors but nothing stands out as an error.

--------------------------------
nossl * *;
ignore;

group test {

    host rnd15-ic;
    host (rnd17-ic);

    key /etc/csync-group.key;

    include /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile;

    backup-directory /data/sync-conflicts/;
    backup-generations 2;
    auto first;

}
————————————————

when I run:
/usr/sbin/csync2 -xvvvG test

It says:

While syncing file /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile:
response from peer(/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile): rnd17-ic [8] <- Stating original file /home rc: 0 mode: 40755Changing owner of /data/sync-conflicts//home to user 0 and group 0, rc= 0
File stays in dirty state. Try again later…



Below is the full output 
------------------------------------------------

Config-File:   /etc/csync2.cfg
My hostname is rnd15-ic.
Database-File: sqlite3:///var/lib/csync2/rnd15-ic.db3
Opening shared library libsqlite3.so
Reading symbols from shared library libsqlite3.so
SQL: SELECT count(*) from file
SQL Query finished.
Running recursive check for / ...
SQL: SELECT filename from file where filename = '/' OR 1=1 ORDER BY filename
Match (+): /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile on /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile
 check: /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile 42, (null) 0, 0.
SQL Query finished.
Checking /* ..
Don't check at all: /var
Don't check at all: /usr
Don't check at all: /tmp
Don't check at all: /sys
Don't check at all: /srv
Don't check at all: /sbin
Don't check at all: /run
Don't check at all: /root
Don't check at all: /proc
Don't check at all: /opt2
Don't check at all: /opt
Don't check at all: /mnt
Don't check at all: /media
Don't check at all: /lost+found
Don't check at all: /lib64
Don't check at all: /lib
Checking /home/* ..
Don't check at all: /home/seshu.simhadri
Don't check at all: /home/ray.muslimani
Don't check at all: /home/praveen.chinnam
Don't check at all: /home/mpidev
Don't check at all: /home/hadoop
Checking /home/david.winslow/* ..
Don't check at all: /home/david.winslow/test_hostfile
Don't check at all: /home/david.winslow/test.txt
Don't check at all: /home/david.winslow/statistical_test_set
Don't check at all: /home/david.winslow/schema_region_000000000
Don't check at all: /home/david.winslow/schema.psv
Don't check at all: /home/david.winslow/save
Don't check at all: /home/david.winslow/pvt.pem
Don't check at all: /home/david.winslow/progress_bar.sh
Don't check at all: /home/david.winslow/preload_check.log
Don't check at all: /home/david.winslow/post_install_configuration.sh
Don't check at all: /home/david.winslow/passwordless_ssh.sh
Don't check at all: /home/david.winslow/passwordless_ssh-2.sh
Don't check at all: /home/david.winslow/nohup.out
Don't check at all: /home/david.winslow/menu.sh
Don't check at all: /home/david.winslow/limits_procs
Don't check at all: /home/david.winslow/liblist.sh
Don't check at all: /home/david.winslow/known_hosts
Don't check at all: /home/david.winslow/installer.sh
Don't check at all: /home/david.winslow/index.html
Don't check at all: /home/david.winslow/hosts
Don't check at all: /home/david.winslow/hostfile-full
Don't check at all: /home/david.winslow/hostfile-all
Don't check at all: /home/david.winslow/hostfile
Don't check at all: /home/david.winslow/globus-toolkit-repo-latest.noarch.rpm
Don't check at all: /home/david.winslow/gl_budgetary.psv_region_mapping
Don't check at all: /home/david.winslow/file.csv
Don't check at all: /home/david.winslow/entries.bak
Don't check at all: /home/david.winslow/edit?pli=1
Don't check at all: /home/david.winslow/distribute_regions.sh
Don't check at all: /home/david.winslow/diffwrap.sh
Don't check at all: /home/david.winslow/deploy.sh
Don't check at all: /home/david.winslow/datasets
Don't check at all: /home/david.winslow/csync2_david.cfg
Don't check at all: /home/david.winslow/csync.cfg
Don't check at all: /home/david.winslow/csync-group.key
Don't check at all: /home/david.winslow/crt.pem
Don't check at all: /home/david.winslow/createNarrowSVNTree.sh
Don't check at all: /home/david.winslow/convert_to_binary.log
Don't check at all: /home/david.winslow/cluster_datasets_meta_file
Don't check at all: /home/david.winslow/cluster_configuration.txt
Don't check at all: /home/david.winslow/changed_files_10_days
Don't check at all: /home/david.winslow/ca-vpn.tar
Don't check at all: /home/david.winslow/build.sh
Don't check at all: /home/david.winslow/authorized_keys
Don't check at all: /home/david.winslow/addkeys.sh
Don't check at all: /home/david.winslow/Serendipity
Checking /home/david.winslow/DISTRIBUTED_COMPUTING/* ..
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/testdata
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/test_client.cpp
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/test_client
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/split_dataset.cpp
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/split_dataset
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/split_all_small_datasets.sh
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/spell_check_test.sh
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/serendipity_dist
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/serendipity
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/rsync_files.sh
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/padd_dataset.sh
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/mpi_hostfile
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/mpd.hosts
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/killall.sh
Match (+): /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile on /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile
Checking /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile.
SQL: SELECT checktxt FROM file WHERE filename = '/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile'
SQL Query finished.
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/graph_generation.cpp
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/graph_generation
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/graph_cluster_configuration.txt
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/global_distribute.sh
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/distributed_computing.cpp
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/distributed_computing
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/dfs_cluster_configuration.txt
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/deploy.sh
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/convert_region_to_text.cpp
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/convert_region_to_text
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/convert_region_to_binary.cpp
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/convert_region_to_binary
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/conf_file
Don't check at all: /home/david.winslow/DISTRIBUTED_COMPUTING/add_dataset.sh
Don't check at all: /home/david.winslow/90-nproc.conf
Don't check at all: /home/david.winslow/0
Don't check at all: /home/david.winslow/.vimrc
Don't check at all: /home/david.winslow/.viminfo
Don't check at all: /home/david.winslow/.vim
Don't check at all: /home/david.winslow/.tempdat.swp
Don't check at all: /home/david.winslow/.subversion
Don't check at all: /home/david.winslow/.ssh
Don't check at all: /home/david.winslow/.split_log
Don't check at all: /home/david.winslow/.server36_regions.swp
Don't check at all: /home/david.winslow/.lesshst
Don't check at all: /home/david.winslow/.distribute_log
Don't check at all: /home/david.winslow/.config
Don't check at all: /home/david.winslow/.bashrc
Don't check at all: /home/david.winslow/.bash_profile
Don't check at all: /home/david.winslow/.bash_logout
Don't check at all: /home/david.winslow/.bash_history
Don't check at all: /etc
Don't check at all: /dev
Don't check at all: /data
Don't check at all: /boot
Don't check at all: /bin
Don't check at all: /.readahead
SQL: SELECT peername FROM dirty GROUP BY peername
SQL Query finished.
SQL: SELECT filename, myname, forced FROM dirty WHERE peername = 'rnd17-ic' ORDER by filename ASC
SQL Query finished.
Connecting to host rnd17-ic (PLAIN) ...
Connect to 10.30.72.17:30865 (rnd17-ic).
Local> CONFIG \n
Peer> OK (cmd_finished).\n
response from peer(<no file>): rnd17-ic [1] <- OK (cmd_finished).
Local> GROUP test\n
Peer> OK (cmd_finished).\n
response from peer(<no file>): rnd17-ic [1] <- OK (cmd_finished).
 check: /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile 42, /home/david.winslow/DISTRIBUTED_COMPUTING/ 42, 42.
Dirty item /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile rnd15-ic 0
Local> HELLO rnd15-ic\n
Peer> OK (cmd_finished).\n
While syncing file /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile:
response from peer(/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile): rnd17-ic [1] <- OK (cmd_finished).
Match (+): /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile on /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile
Updating /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile on rnd17-ic ...
Local> SIG KZLbZdvt.uwK_0kBis5jioC1.3wmUw_cNREAfQy4cA8_rPmb1ENtLAp95kiEYFPV /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile\n
Peer> OK (data_follows).\n
While syncing file /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile:
response from peer(/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile): rnd17-ic [2] <- OK (data_follows).
Peer> v1:mtime=0:mode=33152:uid=501:gid=501:type=reg:size=0\n
File /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile is different on peer (cktxt char #52).
>>> PEER:  v1:mtime=0:mode=33152:uid=501:gid=501:type=reg:size=0
>>> LOCAL: v1:mtime=0:mode=33152:uid=501:gid=501:type=reg:size=1100
Csync2 / Librsync: csync_rs_check('/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile', 1 [regular file])
Reading signature size from peer....
Peer> octet-stream 12\n
Receiving 12 bytes ..
Opening basis_file and sig_file for /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile
Running rs_sig_file() from librsync....
Signature size differs: local=24, peer=12
Peer> rs\0016\000\000\010\000\000\000\000\010
Got 12 bytes, 0 bytes left ..
File has been checked successfully (difference found).
File is different on peer (rsync sig).
Peer> OK (cmd_finished).\n
While syncing file /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile:
response from peer(/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile): rnd17-ic [1] <- OK (cmd_finished).
Local> PATCH KZLbZdvt.uwK_0kBis5jioC1.3wmUw_cNREAfQy4cA8_rPmb1ENtLAp95kiEYFPV /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile\n
Peer> Stating original file /home rc: 0 mode: 40755Changing owner of /data/sync-conflicts//home to user 0 and group 0, rc= 0 \n
While syncing file /home/david.winslow/DISTRIBUTED_COMPUTING/hostfile:
response from peer(/home/david.winslow/DISTRIBUTED_COMPUTING/hostfile): rnd17-ic [8] <- Stating original file /home rc: 0 mode: 40755Changing owner of /data/sync-conflicts//home to user 0 and group 0, rc= 0
File stays in dirty state. Try again later...
Local> BYE\n
Peer> Changing mode of /data/sync-conflicts//home to mode 16877, rc= 0 \n
response from peer(<no file>): rnd17-ic [8] <- Changing mode of /data/sync-conflicts//home to mode 16877, rc= 0
SQL: SELECT command, logfile FROM action GROUP BY command, logfile
SQL Query finished.
Connection closed.
Finished with 2 errors..
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/csync2/attachments/20151230/3ed739d1/attachment-0001.htm>

More information about the Csync2 mailing list