Confd master - slave sync issue

General
1

we are facing issue in slave confd where it is not able to connect to master and not syncing the data. connectivity wise we debugged and all seems working. we found some error log in the confd.err file. What could be the cause of the connectivity issue.

(process:3964): GLib-CRITICAL **: 14:30:42.640: g_source_destroy: assertion ‘source != NULL’ failed
CDB replacing with aaa_merge.xml: [ OK ]
Mergering aaa_merge.xml success${CONFD} --start-phase0 -c /usr/vos/cfg/confd.conf ${CONFD_FLAGS} --foreground

2

Can you give the status and cluster status from issuing ‘confd --status’ on both the master and the slave nodes?

For example, if you run the HA example in $CONFD_DIR/examples.confd/ha/dummy, you’ll see the following near the top of the output of the ‘confd --status’ command:

status: started
cluster status:
mode: master
node id: node0
connected slaves: 2

3

is there some thing we can decode from the confderr.log

confderr.log

node 1

nonode@nohost O hd idd ha_serverhd mfargshd ha_serverd
start_linkjhd restart_typed permanenthd shutdownb aÐhd
child_typed workerjj ˜bWLAƒhk 30-Dec-2019::16:39:57.885hd error_reportgd
nonode@nohost hgd
nonode@nohost J d supervisor_reportl hd
supervisorhd locald confd_second_suphd errorContextd shutdown_errorhd reasond killedhd offenderl hd pidgd
nonode@nohost R hd idd ha_serverhd mfargshd ha_serverd
start_linkjhd restart_typed permanenthd shutdownb aÐhd
child_typed workerjj ¥bWLAƒhk 30-Dec-2019::16:42:39.025hd errorgd
nonode@nohost hgd
nonode@nohost H k -~w:~w: Couldn’t map ~w (~p) to server: ~p
~p
l d confd_iab ðak HA sockethd errord undefinedl hd confd_iad handle_connectional hd filek confd_ia.erlhd lineb ñjhd confd_iad acceptoral hd filek confd_ia.erlhd lineb ªjhd proc_libd init_pal hd filek proc_lib.erlhd lineaájjj

================================================================================================================
node 2

l d confd_iab ðak capihd errord undefinedl hd confd_iad handle_connectional hd filek confd_ia.erlhd lineb ñjhd confd_iad acceptoral hd filek confd_ia.erlhd lineb ªjhd proc_libd init_pal hd filek proc_lib.erlhd lineaájjj bWLAƒhk 30-Dec-2019::16:40:05.943hd errorgd
nonode@nohost hgd
nonode@nohost H k -~w:~w: Couldn’t map ~w (~p) to server: ~p
~p
l d confd_iab ðak capihd errord undefinedl hd confd_iad handle_connectional hd filek confd_ia.erlhd lineb ñjhd confd_iad acceptoral hd filek confd_ia.erlhd lineb ªjhd proc_libd init_pal hd filek proc_lib.erlhd lineaájjj ˜bWLAƒhk 30-Dec-2019::16:40:06.062hd error_reportgd
nonode@nohost hgd
nonode@nohost J d supervisor_reportl hd
supervisorhd locald confd_second_suphd errorContextd shutdown_errorhd reasond killedhd offenderl hd pidgd
nonode@nohost R hd idd ha_serverhd mfargshd ha_serverd
start_linkjhd restart_typed permanenthd shutdownb aÐhd
child_typed workerjj ˜bWLAƒhk 30-Dec-2019::17:30:05.073hd error_reportgd
nonode@nohost hgd
nonode@nohost K d supervisor_reportl hd
supervisorhd locald confd_second_suphd errorContextd shutdown_errorhd reasond killedhd offenderl hd pidgd
nonode@nohost R hd idd ha_serverhd mfargshd ha_serverd
start_linkjhd restart_typed permanenthd shutdownb aÐhd
child_typed workerjj

4

confd devel.log

node 1:
8-Jan-2020::16:23:20.505 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:24:22.517 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:25:24.527 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:26:26.535 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:27:28.548 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:28:30.556 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:29:32.564 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout
8-Jan-2020::16:30:34.575 skl-vasn-1 confd[4030]: confd HA: Connect new slave failed: Timeout

node2:

8-Jan-2020::16:28:32.560 skl-vasn-2 confd[4042]: confd New HA socket connected
8-Jan-2020::16:29:32.565 skl-vasn-2 confd[4042]: confd HA: Failed to synchronize with master: Closed
8-Jan-2020::16:29:32.565 skl-vasn-2 confd[4042]: confd HA: Requested sync with master: error
8-Jan-2020::16:29:34.568 skl-vasn-2 confd[4042]: confd New HA socket connected
8-Jan-2020::16:30:34.576 skl-vasn-2 confd[4042]: confd HA: Failed to synchronize with master: Closed
8-Jan-2020::16:30:34.577 skl-vasn-2 confd[4042]: confd HA: Requested sync with master: error
8-Jan-2020::16:30:36.580 skl-vasn-2 confd[4042]: confd New HA socket connected
8-Jan-2020::16:31:36.586 skl-vasn-2 confd[4042]: confd HA: Failed to synchronize with master: Closed
8-Jan-2020::16:31:36.587 skl-vasn-2 confd[4042]: confd HA: Requested sync with master: error
8-Jan-2020::16:31:38.590 skl-vasn-2 confd[4042]: confd New HA socket connected
8-Jan-2020::16:32:38.595 skl-vasn-2 confd[4042]: confd HA: Failed to synchronize with master: Closed
8-Jan-2020::16:32:38.595 skl-vasn-2 confd[4042]: confd HA: Requested sync with master: error
8-Jan-2020::16:32:40.599 skl-vasn-2 confd[4042]: confd New HA socket connected