Fix debug logging bug

fix a bug where using l ogging with coloredlogs, if the --debugflag was used it would duplicate all log messages

furthermore, using --debug with --log-nc caused a crash

This is a regression introduced by !119 (merged) but in some ways the bug predates it (but was just never triggered).