How to debug/prevent "Internal Error: Internal error: failed to load AAA from CDB"

In one of our setups, sometime

  • $CONFD_DIR/bin/confd -c ./confd.conf --ignore-initial-validation --addloadpath ./fxs --addloadpath ./clispec --start-phase0 runs successfully.
  • But confd --start-phase1 fails with failed to load AAA from CDB error. At that moment we generally recover from CDB backup files.

We tried to see the difference between non-working and working CDB files using --cdb-debug-dump option, and cannot see any difference in nacm database.

What should we look into to understand the issue?

The logs are the best place to start, but you probably know that. Is there anything more in the logs that would help?

Binary lines in confd error log

	
nonode@nohost�k$failed to load AAA ~p from CDB: ~p~nllldhttp://tail-f.com/ns/aaa/1.1daaajhhbadmatchd	not_foundl
                                                                                                                  hd
aaa_serverget_elemalhdfilekaaa_server.erlhdlineb<jhd
aaa_serverd	read_useralhdfilekaaa_server.erlhdlineb�jhd
aaa_serverd
read_usersalhdfilekaaa_server.erlhdlineb�jhd
aaa_serverd
read_usersalhdfilekaaa_server.erlhdlineb�jhd
]jhdserverread_aaaalhdfilekaaa_server.erlhdlineb
Rjhdserverread_aaaalhdfilekaaa_server.erlhdlineb
aaa_serverd-init_cdb/1-fun-3-alhdfilekaaa_server.erlhdlineb
                                                           �jhdlistsdfoldlalhdfilek	lists.erlhdlineb�jhd
aaa_serverinit_cdbalhdfilekaaa_server.erlhdlineb
                                                �jhd
gen_serverdinit_italhdfilekgen_server.erlhdlinebSjhproc_libdinit_p_do_applyalhdfilek
nonode@nohost�kinit:boot_msg: ~plk,Internal error: failed to load AAA from CDB      proc_lib.erlhdlinea�jjj�bWLA�hk1-May-2025::11:27:46.009hderrorgd

I could confirm tail-aaa.fxs (and hence http://tail-f.com/ns/aaa/1.1) exists and loaded into confd

<DEBUG> ... confd[5258]: - Loading file ./fxs/tailf-aaa.fxs

Other than this I did not find anything